2026-02-17T11:38:05.425 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:38:05.438 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:38:05.518 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51338' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial051.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx8PzDXqm6eR9REttBZ6SfR9kbQiLqkbb/3bF8rwkLVjtUoFw+gkvp6EwAiwbQu4UKktHwgxY5geR0e5nIcMSg= trial142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbTr98ZVciPUeKhpZMlsnmu1iNaXMJeSQLWjJLDwZe3VE7Ly587GaOyrFVEmVqZgsasE0DaPUFxOTptbyHCzog= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:38:05.518 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:38:05.519 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:38:05.519 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:38:05.520 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:38:05.520 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:38:05.520 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:38:05.520 INFO:teuthology.packaging:ref: None 2026-02-17T11:38:05.520 INFO:teuthology.packaging:tag: None 2026-02-17T11:38:05.520 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:38:05.520 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:38:05.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:38:05.646 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:38:05.647 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:38:05.661 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:38:05.661 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:38:05.674 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:38:05.687 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:38:05.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:38:05.765 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial051.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:34:36.059756', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx8PzDXqm6eR9REttBZ6SfR9kbQiLqkbb/3bF8rwkLVjtUoFw+gkvp6EwAiwbQu4UKktHwgxY5geR0e5nIcMSg='} 2026-02-17T11:38:05.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial142.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:34:36.059169', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbTr98ZVciPUeKhpZMlsnmu1iNaXMJeSQLWjJLDwZe3VE7Ly587GaOyrFVEmVqZgsasE0DaPUFxOTptbyHCzog='} 2026-02-17T11:38:05.820 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:38:05.831 INFO:teuthology.task.internal:roles: ubuntu@trial051.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-17T11:38:05.831 INFO:teuthology.task.internal:roles: ubuntu@trial142.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-17T11:38:05.831 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:38:05.959 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78afb51c58a0>, signals=[15]) 2026-02-17T11:38:05.959 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:38:05.973 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:38:05.973 DEBUG:teuthology.task.internal:connecting to ubuntu@trial051.front.sepia.ceph.com 2026-02-17T11:38:05.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:38:06.036 DEBUG:teuthology.task.internal:connecting to ubuntu@trial142.front.sepia.ceph.com 2026-02-17T11:38:06.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:38:06.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:38:06.109 DEBUG:teuthology.orchestra.run.trial051:> uname -m 2026-02-17T11:38:06.124 INFO:teuthology.orchestra.run.trial051.stdout:x86_64 2026-02-17T11:38:06.124 DEBUG:teuthology.orchestra.run.trial051:> cat /etc/os-release 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:NAME="CentOS Stream" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:VERSION="9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:ID="centos" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:VERSION_ID="9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:ANSI_COLOR="0;31" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:38:06.181 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:38:06.182 INFO:teuthology.lock.ops:Updating trial051.front.sepia.ceph.com on lock server 2026-02-17T11:38:06.246 DEBUG:teuthology.orchestra.run.trial142:> uname -m 2026-02-17T11:38:06.262 INFO:teuthology.orchestra.run.trial142.stdout:x86_64 2026-02-17T11:38:06.262 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:NAME="CentOS Stream" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="9" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:ID="centos" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="9" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:38:06.318 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;31" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:38:06.319 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:38:06.319 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server 2026-02-17T11:38:06.397 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:38:06.408 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:38:06.422 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:38:06.422 DEBUG:teuthology.orchestra.run.trial051:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:38:06.424 DEBUG:teuthology.orchestra.run.trial142:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:38:06.439 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:38:06.449 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:38:06.449 DEBUG:teuthology.orchestra.run.trial051:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:38:06.479 DEBUG:teuthology.orchestra.run.trial142:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:38:06.497 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:38:06.654 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:38:06.673 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:38:06.673 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:38:06.674 DEBUG:teuthology.orchestra.run.trial051:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:38:06.674 DEBUG:teuthology.orchestra.run.trial142:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:38:06.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:38:06.688 DEBUG:teuthology.orchestra.run.trial142:> uname -r 2026-02-17T11:38:06.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:38:06.689 DEBUG:teuthology.orchestra.run.trial051:> uname -r 2026-02-17T11:38:06.744 INFO:teuthology.orchestra.run.trial051.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:38:06.744 INFO:teuthology.task.kernel:Running kernel on trial051: 5.14.0-645.el9.x86_64 2026-02-17T11:38:06.745 DEBUG:teuthology.orchestra.run.trial051:> sudo yum install -y kernel 2026-02-17T11:38:06.745 INFO:teuthology.orchestra.run.trial142.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:38:06.745 INFO:teuthology.task.kernel:Running kernel on trial142: 5.14.0-645.el9.x86_64 2026-02-17T11:38:06.745 DEBUG:teuthology.orchestra.run.trial142:> sudo yum install -y kernel 2026-02-17T11:38:07.803 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T11:38:11.524 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-17T11:38:13.109 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:05 2026-02-17T11:38:14.881 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 7.8 MB 00:00 2026-02-17T11:38:15.788 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 20 kB 00:00 2026-02-17T11:38:16.642 INFO:teuthology.orchestra.run.trial051.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T11:38:19.343 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 27 MB 00:05 2026-02-17T11:38:19.837 INFO:teuthology.orchestra.run.trial051.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T11:38:20.849 INFO:teuthology.orchestra.run.trial051.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:38:20.869 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:38:20.871 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:38:20.871 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-17T11:38:20.871 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:38:20.871 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout:Install 4 Packages 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:38:20.872 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 88 M 2026-02-17T11:38:20.873 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 135 M 2026-02-17T11:38:20.873 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:38:21.559 INFO:teuthology.orchestra.run.trial051.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2026-02-17T11:38:22.124 INFO:teuthology.orchestra.run.trial051.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T11:38:22.635 INFO:teuthology.orchestra.run.trial051.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T11:38:22.778 INFO:teuthology.orchestra.run.trial051.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T11:38:22.778 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:38:22.778 INFO:teuthology.orchestra.run.trial051.stdout:Total 46 MB/s | 88 MB 00:01 2026-02-17T11:38:22.972 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:38:23.176 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:38:23.176 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:38:23.258 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T11:38:23.523 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:38:23.523 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:38:24.155 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 20 kB 00:00 2026-02-17T11:38:24.419 INFO:teuthology.orchestra.run.trial142.stdout:Extra Packages for Enterprise Linux 101 MB/s | 20 MB 00:00 2026-02-17T11:38:24.606 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:38:24.888 INFO:teuthology.orchestra.run.trial051.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:38:24.908 INFO:teuthology.orchestra.run.trial051.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:26.704 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:26.732 INFO:teuthology.orchestra.run.trial051.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:27.622 INFO:teuthology.orchestra.run.trial142.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T11:38:28.630 INFO:teuthology.orchestra.run.trial142.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:38:28.650 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout: Package Architecture Version Repository Size 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:38:28.651 INFO:teuthology.orchestra.run.trial142.stdout:Installing dependencies: 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:Install 4 Packages 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 88 M 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 135 M 2026-02-17T11:38:28.652 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:38:29.355 INFO:teuthology.orchestra.run.trial142.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T11:38:29.753 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:29.759 INFO:teuthology.orchestra.run.trial051.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:38:29.937 INFO:teuthology.orchestra.run.trial142.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T11:38:30.412 INFO:teuthology.orchestra.run.trial142.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T11:38:30.575 INFO:teuthology.orchestra.run.trial142.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T11:38:30.575 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:38:30.575 INFO:teuthology.orchestra.run.trial142.stdout:Total 46 MB/s | 88 MB 00:01 2026-02-17T11:38:30.764 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:38:30.968 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:38:30.968 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:38:31.314 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:38:31.314 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:38:32.400 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:38:32.683 INFO:teuthology.orchestra.run.trial142.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:38:32.703 INFO:teuthology.orchestra.run.trial142.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:32.792 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:38:34.473 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:34.501 INFO:teuthology.orchestra.run.trial142.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:37.584 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:37.590 INFO:teuthology.orchestra.run.trial142.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:38:40.623 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:03.118 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:03.140 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:03.205 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:03.206 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:39:03.206 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:39:03.206 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:39:03.258 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:03.258 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:39:03.258 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:39:03.258 INFO:teuthology.orchestra.run.trial051.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.259 INFO:teuthology.orchestra.run.trial051.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.259 INFO:teuthology.orchestra.run.trial051.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.259 INFO:teuthology.orchestra.run.trial051.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.259 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:39:03.259 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:39:03.318 DEBUG:teuthology.orchestra.run.trial051:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:03.343 INFO:teuthology.orchestra.run.trial051.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:03.344 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:39:03.344 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:39:03.344 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:39:03.344 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:39:03.345 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial051.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:39:03.345 DEBUG:teuthology.orchestra.run.trial051:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:03.408 INFO:teuthology.orchestra.run.trial051.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.409 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:03.409 DEBUG:teuthology.orchestra.run.trial051:> sudo rpm -qi grub2-tools 2026-02-17T11:39:03.477 INFO:teuthology.orchestra.run.trial051.stdout:Name : grub2-tools 2026-02-17T11:39:03.477 INFO:teuthology.orchestra.run.trial051.stdout:Epoch : 1 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Version : 2.06 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Release : 118.el9 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Architecture: x86_64 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Group : Unspecified 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Size : 8393909 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:License : GPLv3+ 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:39:03.478 INFO:teuthology.orchestra.run.trial051.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:Packager : builder@centos.org 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:Vendor : CentOS 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:Summary : Support tools for GRUB. 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:Description : 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:39:03.479 INFO:teuthology.orchestra.run.trial051.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:39:03.480 INFO:teuthology.orchestra.run.trial051.stdout:hardware devices. 2026-02-17T11:39:03.480 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:39:03.480 INFO:teuthology.orchestra.run.trial051.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:39:03.481 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:39:03.481 INFO:teuthology.task.kernel:Updating grub on trial051 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:39:03.481 DEBUG:teuthology.orchestra.run.trial051:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:39:03.546 INFO:teuthology.orchestra.run.trial051.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:03.548 DEBUG:teuthology.orchestra.run.trial051:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:39:03.611 INFO:teuthology.orchestra.run.trial051.stdout:/sbin/grubby 2026-02-17T11:39:03.613 INFO:teuthology.orchestra.run.trial051.stdout:yes 2026-02-17T11:39:03.613 DEBUG:teuthology.orchestra.run.trial051:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:39:03.678 INFO:teuthology.orchestra.run.trial051.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:03.679 DEBUG:teuthology.orchestra.run.trial051:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:39:03.752 DEBUG:teuthology.orchestra.run.trial051:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:39:03.959 INFO:teuthology.orchestra.run.trial051.stderr:Generating grub configuration file ... 2026-02-17T11:39:04.022 INFO:teuthology.orchestra.run.trial051.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:39:04.029 INFO:teuthology.orchestra.run.trial051.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:39:04.279 INFO:teuthology.orchestra.run.trial051.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:39:04.285 INFO:teuthology.orchestra.run.trial051.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:39:04.316 INFO:teuthology.orchestra.run.trial051.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:39:04.323 INFO:teuthology.orchestra.run.trial051.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:39:04.346 INFO:teuthology.orchestra.run.trial051.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:39:04.352 INFO:teuthology.orchestra.run.trial051.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:39:04.436 INFO:teuthology.orchestra.run.trial051.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:39:04.444 INFO:teuthology.orchestra.run.trial051.stderr:done 2026-02-17T11:39:04.446 DEBUG:teuthology.orchestra.run.trial051:> test -d /sys/firmware/efi 2026-02-17T11:39:04.462 DEBUG:teuthology.orchestra.run.trial051:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:39:04.532 INFO:teuthology.orchestra.run.trial051.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:39:04.532 INFO:teuthology.orchestra.run.trial051.stdout:/boot/efi/EFI/centos 2026-02-17T11:39:04.533 DEBUG:teuthology.orchestra.run.trial051:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:39:04.605 INFO:teuthology.orchestra.run.trial051.stdout:no 2026-02-17T11:39:04.606 DEBUG:teuthology.orchestra.run.trial051:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:39:04.670 INFO:teuthology.orchestra.run.trial051.stdout:yes 2026-02-17T11:39:04.670 DEBUG:teuthology.orchestra.run.trial051:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:39:04.737 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial051 2026-02-17T11:39:04.737 DEBUG:teuthology.orchestra.run.trial051:> sudo bash -c ' 2026-02-17T11:39:04.737 DEBUG:teuthology.orchestra.run.trial051:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:39:04.737 DEBUG:teuthology.orchestra.run.trial051:> ' 2026-02-17T11:39:10.891 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:10.912 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:11.083 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:11.083 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:39:11.084 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:39:11.084 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:39:11.136 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:11.137 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:39:11.137 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:39:11.137 INFO:teuthology.orchestra.run.trial142.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.137 INFO:teuthology.orchestra.run.trial142.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.137 INFO:teuthology.orchestra.run.trial142.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.138 INFO:teuthology.orchestra.run.trial142.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.138 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:39:11.138 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:39:11.191 DEBUG:teuthology.orchestra.run.trial142:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:11.216 INFO:teuthology.orchestra.run.trial142.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:11.216 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:39:11.216 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:39:11.216 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:39:11.216 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T11:39:11.216 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial142.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:39:11.216 DEBUG:teuthology.orchestra.run.trial142:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:11.278 INFO:teuthology.orchestra.run.trial142.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.279 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:11.279 DEBUG:teuthology.orchestra.run.trial142:> sudo rpm -qi grub2-tools 2026-02-17T11:39:11.347 INFO:teuthology.orchestra.run.trial142.stdout:Name : grub2-tools 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Epoch : 1 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Version : 2.06 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Release : 118.el9 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Architecture: x86_64 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Group : Unspecified 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Size : 8393909 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:License : GPLv3+ 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Packager : builder@centos.org 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Vendor : CentOS 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Summary : Support tools for GRUB. 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:Description : 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:hardware devices. 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:39:11.348 INFO:teuthology.orchestra.run.trial142.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:39:11.349 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:39:11.349 INFO:teuthology.task.kernel:Updating grub on trial142 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:39:11.349 DEBUG:teuthology.orchestra.run.trial142:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:39:11.414 INFO:teuthology.orchestra.run.trial142.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:11.415 DEBUG:teuthology.orchestra.run.trial142:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:39:11.478 INFO:teuthology.orchestra.run.trial142.stdout:/sbin/grubby 2026-02-17T11:39:11.479 INFO:teuthology.orchestra.run.trial142.stdout:yes 2026-02-17T11:39:11.479 DEBUG:teuthology.orchestra.run.trial142:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:39:11.542 INFO:teuthology.orchestra.run.trial142.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:11.544 DEBUG:teuthology.orchestra.run.trial142:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.615 DEBUG:teuthology.orchestra.run.trial142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:39:11.820 INFO:teuthology.orchestra.run.trial142.stderr:Generating grub configuration file ... 2026-02-17T11:39:11.883 INFO:teuthology.orchestra.run.trial142.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:39:11.888 INFO:teuthology.orchestra.run.trial142.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:39:12.135 INFO:teuthology.orchestra.run.trial142.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:39:12.141 INFO:teuthology.orchestra.run.trial142.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:39:12.173 INFO:teuthology.orchestra.run.trial142.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:39:12.179 INFO:teuthology.orchestra.run.trial142.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:39:12.202 INFO:teuthology.orchestra.run.trial142.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:39:12.209 INFO:teuthology.orchestra.run.trial142.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:39:12.290 INFO:teuthology.orchestra.run.trial142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:39:12.298 INFO:teuthology.orchestra.run.trial142.stderr:done 2026-02-17T11:39:12.300 DEBUG:teuthology.orchestra.run.trial142:> test -d /sys/firmware/efi 2026-02-17T11:39:12.315 DEBUG:teuthology.orchestra.run.trial142:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:39:12.380 INFO:teuthology.orchestra.run.trial142.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:39:12.380 INFO:teuthology.orchestra.run.trial142.stdout:/boot/efi/EFI/centos 2026-02-17T11:39:12.382 DEBUG:teuthology.orchestra.run.trial142:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:39:12.448 INFO:teuthology.orchestra.run.trial142.stdout:no 2026-02-17T11:39:12.448 DEBUG:teuthology.orchestra.run.trial142:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:39:12.514 INFO:teuthology.orchestra.run.trial142.stdout:yes 2026-02-17T11:39:12.514 DEBUG:teuthology.orchestra.run.trial142:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:39:12.578 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial142 2026-02-17T11:39:12.578 DEBUG:teuthology.orchestra.run.trial142:> sudo bash -c ' 2026-02-17T11:39:12.578 DEBUG:teuthology.orchestra.run.trial142:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:39:12.578 DEBUG:teuthology.orchestra.run.trial142:> ' 2026-02-17T11:39:34.780 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:39:34.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-17T11:39:34.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:39:42.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T11:39:42.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-17T11:39:42.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:40:34.835 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T11:40:42.632 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T11:40:43.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-17T11:40:43.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:40:43.947 DEBUG:teuthology.orchestra.run.trial051:> true 2026-02-17T11:40:44.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-17T11:40:44.100 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:40:44.100 DEBUG:teuthology.orchestra.run.trial051:> uname -r 2026-02-17T11:40:44.156 INFO:teuthology.orchestra.run.trial051.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:40:44.157 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:40:44.157 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:40:44.157 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:40:45.157 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:40:45.158 DEBUG:teuthology.orchestra.run.trial051:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:40:45.187 INFO:teuthology.orchestra.run.trial051.stdout:ttyS1 2026-02-17T11:40:45.209 DEBUG:teuthology.parallel:result is None 2026-02-17T11:40:51.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-17T11:40:51.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:40:51.731 DEBUG:teuthology.orchestra.run.trial142:> true 2026-02-17T11:40:51.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-17T11:40:51.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:40:51.884 DEBUG:teuthology.orchestra.run.trial142:> uname -r 2026-02-17T11:40:51.940 INFO:teuthology.orchestra.run.trial142.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:40:51.941 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:40:51.941 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:40:51.941 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:40:52.942 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T11:40:52.943 DEBUG:teuthology.orchestra.run.trial142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:40:52.972 INFO:teuthology.orchestra.run.trial142.stdout:ttyS1 2026-02-17T11:40:52.997 DEBUG:teuthology.parallel:result is None 2026-02-17T11:40:52.998 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:40:53.012 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:40:53.012 DEBUG:teuthology.orchestra.run.trial051:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:40:53.015 DEBUG:teuthology.orchestra.run.trial142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:40:53.054 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:40:53.065 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:40:53.075 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:40:53.075 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:40:53.077 DEBUG:teuthology.orchestra.run.trial142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:40:53.119 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:40:53.130 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:40:53.130 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:40:53.133 DEBUG:teuthology.orchestra.run.trial142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:40:53.155 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:53.163 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:53.176 INFO:teuthology.orchestra.run.trial142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:53.184 INFO:teuthology.orchestra.run.trial142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:53.186 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:40:53.198 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:40:53.198 DEBUG:teuthology.orchestra.run.trial051:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:40:53.207 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:40:53.250 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:40:53.267 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:40:53.267 DEBUG:teuthology.orchestra.run.trial051:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:40:53.273 DEBUG:teuthology.orchestra.run.trial142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:40:53.305 DEBUG:teuthology.orchestra.run.trial051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:53.447 DEBUG:teuthology.orchestra.run.trial051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:53.471 DEBUG:teuthology.orchestra.run.trial051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:53.617 DEBUG:teuthology.orchestra.run.trial051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:53.641 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:40:53.641 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:40:53.704 DEBUG:teuthology.orchestra.run.trial142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:53.821 DEBUG:teuthology.orchestra.run.trial142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:53.846 DEBUG:teuthology.orchestra.run.trial142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:53.995 DEBUG:teuthology.orchestra.run.trial142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:54.020 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:40:54.020 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:40:54.083 DEBUG:teuthology.orchestra.run.trial051:> sudo service rsyslog restart 2026-02-17T11:40:54.085 DEBUG:teuthology.orchestra.run.trial142:> sudo service rsyslog restart 2026-02-17T11:40:54.110 INFO:teuthology.orchestra.run.trial051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:40:54.151 INFO:teuthology.orchestra.run.trial142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:40:54.608 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:40:54.618 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:40:54.618 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:40:54.637 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:40:54.650 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T11:40:54.650 DEBUG:teuthology.orchestra.run.trial051:> sudo service auditd rotate 2026-02-17T11:40:54.678 INFO:teuthology.orchestra.run.trial051.stdout:Rotating logs: 2026-02-17T11:40:54.680 DEBUG:teuthology.orchestra.run.trial142:> sudo service auditd rotate 2026-02-17T11:40:54.710 INFO:teuthology.orchestra.run.trial142.stdout:Rotating logs: 2026-02-17T11:40:54.712 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:40:54.712 DEBUG:teuthology.orchestra.run.trial051:> /usr/sbin/getenforce 2026-02-17T11:40:54.737 INFO:teuthology.orchestra.run.trial051.stdout:Permissive 2026-02-17T11:40:54.737 DEBUG:teuthology.orchestra.run.trial142:> /usr/sbin/getenforce 2026-02-17T11:40:54.768 INFO:teuthology.orchestra.run.trial142.stdout:Permissive 2026-02-17T11:40:54.769 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial051.front.sepia.ceph.com': 'permissive', 'ubuntu@trial142.front.sepia.ceph.com': 'permissive'} 2026-02-17T11:40:54.769 DEBUG:teuthology.orchestra.run.trial051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:40:54.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:40:54.802 DEBUG:teuthology.orchestra.run.trial142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:40:54.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:40:54.833 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:40:54.834 DEBUG:teuthology.orchestra.run.trial051:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:40:54.866 DEBUG:teuthology.orchestra.run.trial142:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:40:54.897 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:40:54.913 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:40:54.923 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:40:54.924 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial051.front.sepia.ceph.com,trial142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:43:46.168 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial051.front.sepia.ceph.com'), Remote(name='ubuntu@trial142.front.sepia.ceph.com')] 2026-02-17T11:43:46.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-17T11:43:46.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:46.328 DEBUG:teuthology.orchestra.run.trial051:> true 2026-02-17T11:43:46.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-17T11:43:46.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-17T11:43:46.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:46.496 DEBUG:teuthology.orchestra.run.trial142:> true 2026-02-17T11:43:46.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-17T11:43:46.572 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:43:46.585 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:43:46.585 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:43:46.586 DEBUG:teuthology.orchestra.run.trial051:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:43:46.588 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:43:46.588 DEBUG:teuthology.orchestra.run.trial142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:43:46.613 INFO:teuthology.orchestra.run.trial051.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:43:46.625 INFO:teuthology.orchestra.run.trial051.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:43:46.638 INFO:teuthology.orchestra.run.trial142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:43:46.645 INFO:teuthology.orchestra.run.trial051.stderr:sudo: ntpd: command not found 2026-02-17T11:43:46.650 INFO:teuthology.orchestra.run.trial142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:43:46.654 INFO:teuthology.orchestra.run.trial051.stdout:506 Cannot talk to daemon 2026-02-17T11:43:46.666 INFO:teuthology.orchestra.run.trial051.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:43:46.671 INFO:teuthology.orchestra.run.trial142.stderr:sudo: ntpd: command not found 2026-02-17T11:43:46.677 INFO:teuthology.orchestra.run.trial051.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:43:46.680 INFO:teuthology.orchestra.run.trial142.stdout:506 Cannot talk to daemon 2026-02-17T11:43:46.693 INFO:teuthology.orchestra.run.trial142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:43:46.705 INFO:teuthology.orchestra.run.trial142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:43:46.726 INFO:teuthology.orchestra.run.trial051.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:43:46.728 INFO:teuthology.orchestra.run.trial051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:43:46.728 INFO:teuthology.orchestra.run.trial051.stdout:=============================================================================== 2026-02-17T11:43:46.756 INFO:teuthology.orchestra.run.trial142.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:43:46.895 INFO:teuthology.orchestra.run.trial142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:43:46.895 INFO:teuthology.orchestra.run.trial142.stdout:=============================================================================== 2026-02-17T11:43:46.895 INFO:teuthology.orchestra.run.trial142.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:46.895 INFO:teuthology.orchestra.run.trial142.stdout:^? us-east-2.clearnet.pw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:46.895 INFO:teuthology.orchestra.run.trial142.stdout:^? s2-a.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:46.896 INFO:teuthology.orchestra.run.trial142.stdout:^? hc243.ips.PaulBunyan.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:46.897 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:43:46.908 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:43:46.908 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T11:43:46.908 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T11:43:46.908 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:43:46.913 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:43:46.913 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:43:46.914 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:43:46.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:43:46.916 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:43:46.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:43:47.092 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:43:47.092 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:43:47.101 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:43:47.101 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:43:47.237 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:43:47.237 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:43:47.237 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:43:47.245 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:43:47.246 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:43:47.246 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:43:47.263 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T11:43:47.263 DEBUG:teuthology.orchestra.run.trial051:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:43:47.271 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T11:43:47.271 DEBUG:teuthology.orchestra.run.trial142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:43:47.328 DEBUG:teuthology.orchestra.run.trial051:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:43:47.335 DEBUG:teuthology.orchestra.run.trial142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:43:47.402 DEBUG:teuthology.orchestra.run.trial051:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:43:47.408 DEBUG:teuthology.orchestra.run.trial142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:43:47.465 INFO:teuthology.orchestra.run.trial051.stdout:check_obsoletes = 1 2026-02-17T11:43:47.467 DEBUG:teuthology.orchestra.run.trial051:> sudo yum clean all 2026-02-17T11:43:47.472 INFO:teuthology.orchestra.run.trial142.stdout:check_obsoletes = 1 2026-02-17T11:43:47.473 DEBUG:teuthology.orchestra.run.trial142:> sudo yum clean all 2026-02-17T11:43:47.618 INFO:teuthology.orchestra.run.trial051.stdout:41 files removed 2026-02-17T11:43:47.624 INFO:teuthology.orchestra.run.trial142.stdout:41 files removed 2026-02-17T11:43:47.633 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-radosgw 2026-02-17T11:43:47.639 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-radosgw 2026-02-17T11:43:47.906 INFO:teuthology.orchestra.run.trial051.stdout:ceph packages for x86_64 674 kB/s | 86 kB 00:00 2026-02-17T11:43:47.908 INFO:teuthology.orchestra.run.trial142.stdout:ceph packages for x86_64 682 kB/s | 86 kB 00:00 2026-02-17T11:43:48.036 INFO:teuthology.orchestra.run.trial051.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:43:48.037 INFO:teuthology.orchestra.run.trial142.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T11:43:48.160 INFO:teuthology.orchestra.run.trial142.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:43:48.165 INFO:teuthology.orchestra.run.trial051.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:43:48.499 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - BaseOS 28 MB/s | 8.9 MB 00:00 2026-02-17T11:43:49.073 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.9 MB 00:00 2026-02-17T11:43:52.650 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 27 MB 00:03 2026-02-17T11:43:52.787 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-17T11:43:56.053 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-17T11:43:56.174 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-17T11:43:57.115 INFO:teuthology.orchestra.run.trial142.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 20 kB 00:00 2026-02-17T11:43:57.778 INFO:teuthology.orchestra.run.trial142.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-17T11:43:57.824 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-17T11:43:58.874 INFO:teuthology.orchestra.run.trial051.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-17T11:44:00.947 INFO:teuthology.orchestra.run.trial142.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:44:02.154 INFO:teuthology.orchestra.run.trial051.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:44:02.169 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repository Size 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout:Upgrading: 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:44:02.171 INFO:teuthology.orchestra.run.trial142.stdout:Installing dependencies: 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:44:02.172 INFO:teuthology.orchestra.run.trial142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:44:02.173 INFO:teuthology.orchestra.run.trial142.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout:Installing weak dependencies: 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:02.174 INFO:teuthology.orchestra.run.trial142.stdout:Install 33 Packages 2026-02-17T11:44:02.175 INFO:teuthology.orchestra.run.trial142.stdout:Upgrade 2 Packages 2026-02-17T11:44:02.175 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:02.175 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 63 M 2026-02-17T11:44:02.175 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:02.984 INFO:teuthology.orchestra.run.trial142.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 17 MB/s | 5.5 MB 00:00 2026-02-17T11:44:03.013 INFO:teuthology.orchestra.run.trial142.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 866 kB/s | 25 kB 00:00 2026-02-17T11:44:03.060 INFO:teuthology.orchestra.run.trial142.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 21 MB/s | 999 kB 00:00 2026-02-17T11:44:03.099 INFO:teuthology.orchestra.run.trial142.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 13 MB/s | 503 kB 00:00 2026-02-17T11:44:03.246 INFO:teuthology.orchestra.run.trial142.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 19 MB/s | 11 MB 00:00 2026-02-17T11:44:03.279 INFO:teuthology.orchestra.run.trial142.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 1.3 MB/s | 45 kB 00:00 2026-02-17T11:44:03.296 INFO:teuthology.orchestra.run.trial142.stdout:(7/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 27 MB/s | 5.4 MB 00:00 2026-02-17T11:44:03.304 INFO:teuthology.orchestra.run.trial142.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 5.5 MB/s | 142 kB 00:00 2026-02-17T11:44:03.308 INFO:teuthology.orchestra.run.trial142.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 13 MB/s | 165 kB 00:00 2026-02-17T11:44:03.319 INFO:teuthology.orchestra.run.trial142.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 21 MB/s | 322 kB 00:00 2026-02-17T11:44:03.324 INFO:teuthology.orchestra.run.trial142.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 19 MB/s | 303 kB 00:00 2026-02-17T11:44:03.335 INFO:teuthology.orchestra.run.trial142.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 3.0 MB/s | 33 kB 00:00 2026-02-17T11:44:03.337 INFO:teuthology.orchestra.run.trial142.stdout:(13/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 5.5 MB/s | 100 kB 00:00 2026-02-17T11:44:03.356 INFO:teuthology.orchestra.run.trial142.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 4.8 MB/s | 93 kB 00:00 2026-02-17T11:44:03.358 INFO:teuthology.orchestra.run.trial142.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 47 MB/s | 1.1 MB 00:00 2026-02-17T11:44:03.367 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:03.368 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout:Upgrading: 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:44:03.369 INFO:teuthology.orchestra.run.trial051.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:44:03.370 INFO:teuthology.orchestra.run.trial051.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:44:03.371 INFO:teuthology.orchestra.run.trial051.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:44:03.372 INFO:teuthology.orchestra.run.trial051.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout:Installing weak dependencies: 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:03.373 INFO:teuthology.orchestra.run.trial051.stdout:Install 33 Packages 2026-02-17T11:44:03.374 INFO:teuthology.orchestra.run.trial051.stdout:Upgrade 2 Packages 2026-02-17T11:44:03.374 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:03.374 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 63 M 2026-02-17T11:44:03.374 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:03.493 INFO:teuthology.orchestra.run.trial142.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 762 kB/s | 104 kB 00:00 2026-02-17T11:44:03.505 INFO:teuthology.orchestra.run.trial142.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2026-02-17T11:44:03.537 INFO:teuthology.orchestra.run.trial142.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-17T11:44:03.551 INFO:teuthology.orchestra.run.trial142.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2026-02-17T11:44:03.610 INFO:teuthology.orchestra.run.trial142.stdout:(20/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 23 MB/s | 22 MB 00:00 2026-02-17T11:44:03.611 INFO:teuthology.orchestra.run.trial142.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 292 kB 00:00 2026-02-17T11:44:03.638 INFO:teuthology.orchestra.run.trial142.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.3 MB/s | 37 kB 00:00 2026-02-17T11:44:03.645 INFO:teuthology.orchestra.run.trial142.stdout:(23/35): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2026-02-17T11:44:03.668 INFO:teuthology.orchestra.run.trial142.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.2 MB/s | 66 kB 00:00 2026-02-17T11:44:03.765 INFO:teuthology.orchestra.run.trial142.stdout:(25/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.5 MB/s | 240 kB 00:00 2026-02-17T11:44:03.866 INFO:teuthology.orchestra.run.trial142.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 245 kB/s | 25 kB 00:00 2026-02-17T11:44:03.867 INFO:teuthology.orchestra.run.trial142.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.4 MB/s | 308 kB 00:00 2026-02-17T11:44:03.907 INFO:teuthology.orchestra.run.trial142.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-17T11:44:03.910 INFO:teuthology.orchestra.run.trial142.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-17T11:44:04.109 INFO:teuthology.orchestra.run.trial142.stdout:(30/35): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-17T11:44:04.122 INFO:teuthology.orchestra.run.trial142.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2026-02-17T11:44:04.124 INFO:teuthology.orchestra.run.trial142.stdout:(32/35): re2-20211101-20.el9.x86_64.rpm 899 kB/s | 191 kB 00:00 2026-02-17T11:44:04.212 INFO:teuthology.orchestra.run.trial142.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2026-02-17T11:44:04.244 INFO:teuthology.orchestra.run.trial051.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 15 MB/s | 5.5 MB 00:00 2026-02-17T11:44:04.306 INFO:teuthology.orchestra.run.trial051.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 410 kB/s | 25 kB 00:00 2026-02-17T11:44:04.473 INFO:teuthology.orchestra.run.trial142.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 9.8 MB/s | 3.4 MB 00:00 2026-02-17T11:44:04.476 INFO:teuthology.orchestra.run.trial051.stdout:(3/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T11:44:04.506 INFO:teuthology.orchestra.run.trial142.stdout:(35/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 8.3 MB/s | 3.2 MB 00:00 2026-02-17T11:44:04.507 INFO:teuthology.orchestra.run.trial051.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 16 MB/s | 503 kB 00:00 2026-02-17T11:44:04.508 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:04.508 INFO:teuthology.orchestra.run.trial142.stdout:Total 27 MB/s | 63 MB 00:02 2026-02-17T11:44:04.614 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:04.633 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:04.633 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:04.688 INFO:teuthology.orchestra.run.trial051.stdout:(5/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 30 MB/s | 5.4 MB 00:00 2026-02-17T11:44:04.705 INFO:teuthology.orchestra.run.trial051.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 2.7 MB/s | 45 kB 00:00 2026-02-17T11:44:04.717 INFO:teuthology.orchestra.run.trial051.stdout:(7/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 2.4 MB/s | 999 kB 00:00 2026-02-17T11:44:04.723 INFO:teuthology.orchestra.run.trial051.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 7.5 MB/s | 142 kB 00:00 2026-02-17T11:44:04.736 INFO:teuthology.orchestra.run.trial051.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 8.6 MB/s | 165 kB 00:00 2026-02-17T11:44:04.746 INFO:teuthology.orchestra.run.trial051.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 14 MB/s | 322 kB 00:00 2026-02-17T11:44:04.760 INFO:teuthology.orchestra.run.trial051.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 12 MB/s | 303 kB 00:00 2026-02-17T11:44:04.765 INFO:teuthology.orchestra.run.trial051.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 5.0 MB/s | 100 kB 00:00 2026-02-17T11:44:04.850 INFO:teuthology.orchestra.run.trial051.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 368 kB/s | 33 kB 00:00 2026-02-17T11:44:04.871 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:04.872 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:04.886 INFO:teuthology.orchestra.run.trial051.stdout:(14/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 22 MB/s | 22 MB 00:01 2026-02-17T11:44:04.932 INFO:teuthology.orchestra.run.trial051.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-17T11:44:05.008 INFO:teuthology.orchestra.run.trial051.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 4.5 MB/s | 1.1 MB 00:00 2026-02-17T11:44:05.165 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:05.173 INFO:teuthology.orchestra.run.trial142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:44:05.176 INFO:teuthology.orchestra.run.trial142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:44:05.187 INFO:teuthology.orchestra.run.trial142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:44:05.287 INFO:teuthology.orchestra.run.trial051.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 260 kB/s | 104 kB 00:00 2026-02-17T11:44:05.337 INFO:teuthology.orchestra.run.trial142.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:44:05.341 INFO:teuthology.orchestra.run.trial142.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:05.370 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:05.384 INFO:teuthology.orchestra.run.trial051.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 362 kB/s | 164 kB 00:00 2026-02-17T11:44:05.387 INFO:teuthology.orchestra.run.trial051.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2026-02-17T11:44:05.412 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:44:05.413 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:05.425 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:05.429 INFO:teuthology.orchestra.run.trial142.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:44:05.438 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:44:05.459 INFO:teuthology.orchestra.run.trial051.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 355 kB/s | 160 kB 00:00 2026-02-17T11:44:05.462 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:44:05.462 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:05.475 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:05.506 INFO:teuthology.orchestra.run.trial142.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:44:05.509 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:44:05.516 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:44:05.518 INFO:teuthology.orchestra.run.trial142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:44:05.521 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:44:05.526 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:44:05.611 INFO:teuthology.orchestra.run.trial051.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2026-02-17T11:44:05.636 INFO:teuthology.orchestra.run.trial051.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-17T11:44:05.653 INFO:teuthology.orchestra.run.trial051.stdout:(23/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-17T11:44:05.666 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:44:05.668 INFO:teuthology.orchestra.run.trial142.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:44:05.693 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:44:05.694 INFO:teuthology.orchestra.run.trial051.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 448 kB/s | 37 kB 00:00 2026-02-17T11:44:05.695 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:44:05.703 INFO:teuthology.orchestra.run.trial142.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:44:05.723 INFO:teuthology.orchestra.run.trial051.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 761 kB/s | 66 kB 00:00 2026-02-17T11:44:05.885 INFO:teuthology.orchestra.run.trial051.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 153 kB/s | 25 kB 00:00 2026-02-17T11:44:05.929 INFO:teuthology.orchestra.run.trial142.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:44:05.931 INFO:teuthology.orchestra.run.trial142.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:44:05.944 INFO:teuthology.orchestra.run.trial051.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-17T11:44:05.946 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:44:05.949 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:44:05.954 INFO:teuthology.orchestra.run.trial142.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:44:05.956 INFO:teuthology.orchestra.run.trial142.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:44:05.957 INFO:teuthology.orchestra.run.trial142.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:44:05.962 INFO:teuthology.orchestra.run.trial051.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 642 kB/s | 49 kB 00:00 2026-02-17T11:44:05.976 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:44:05.986 INFO:teuthology.orchestra.run.trial051.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-17T11:44:06.040 INFO:teuthology.orchestra.run.trial051.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 3.5 MB/s | 191 kB 00:00 2026-02-17T11:44:06.088 INFO:teuthology.orchestra.run.trial142.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:44:06.090 INFO:teuthology.orchestra.run.trial142.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:44:06.126 INFO:teuthology.orchestra.run.trial051.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-17T11:44:06.139 INFO:teuthology.orchestra.run.trial051.stdout:(32/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 838 kB 00:00 2026-02-17T11:44:06.177 INFO:teuthology.orchestra.run.trial051.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-17T11:44:06.283 INFO:teuthology.orchestra.run.trial051.stdout:(34/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 22 MB/s | 3.2 MB 00:00 2026-02-17T11:44:06.288 INFO:teuthology.orchestra.run.trial051.stdout:(35/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 21 MB/s | 3.4 MB 00:00 2026-02-17T11:44:06.292 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:06.292 INFO:teuthology.orchestra.run.trial051.stdout:Total 22 MB/s | 63 MB 00:02 2026-02-17T11:44:06.370 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:44:06.371 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:44:06.371 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:06.392 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:06.406 INFO:teuthology.orchestra.run.trial142.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:44:06.408 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:44:06.410 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:06.410 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:06.647 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:06.647 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:06.949 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:06.957 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:44:06.959 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:44:06.971 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:44:07.121 INFO:teuthology.orchestra.run.trial051.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:44:07.126 INFO:teuthology.orchestra.run.trial051.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:07.157 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:07.200 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:44:07.201 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:07.213 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:07.217 INFO:teuthology.orchestra.run.trial051.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:44:07.225 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:44:07.248 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:44:07.248 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:07.262 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:07.297 INFO:teuthology.orchestra.run.trial051.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:44:07.300 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:44:07.307 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:44:07.309 INFO:teuthology.orchestra.run.trial051.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:44:07.312 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:44:07.317 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:44:07.387 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:07.389 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:07.456 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:44:07.457 INFO:teuthology.orchestra.run.trial051.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:44:07.483 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:44:07.485 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:44:07.491 INFO:teuthology.orchestra.run.trial051.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:44:07.673 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:07.676 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:44:07.716 INFO:teuthology.orchestra.run.trial051.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:44:07.717 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:44:07.717 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:44:07.717 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:44:07.717 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:07.718 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:44:07.720 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:07.733 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:44:07.736 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:44:07.741 INFO:teuthology.orchestra.run.trial051.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:44:07.743 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:44:07.744 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:44:07.761 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:44:07.873 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:44:07.875 INFO:teuthology.orchestra.run.trial051.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:44:08.154 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:44:08.154 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:44:08.154 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:08.191 INFO:teuthology.orchestra.run.trial051.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:44:08.193 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:44:09.171 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:09.173 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:09.453 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:44:09.457 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:44:09.492 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:44:09.493 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:44:09.493 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:44:09.493 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:09.496 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /sys 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /proc 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /mnt 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /var/tmp 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /home 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /root 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout:skipping the directory /tmp 2026-02-17T11:44:12.274 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:12.727 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:12.751 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:12.751 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:12.751 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:44:12.752 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:12.752 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:12.752 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:12.753 INFO:teuthology.orchestra.run.trial142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:12.766 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:12.766 INFO:teuthology.orchestra.run.trial142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:12.822 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:12.822 INFO:teuthology.orchestra.run.trial142.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:44:12.822 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:13.096 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:44:13.097 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:44:13.098 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:13.099 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:44:13.100 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:44:13.157 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout:Upgraded: 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.158 INFO:teuthology.orchestra.run.trial142.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.159 INFO:teuthology.orchestra.run.trial142.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:13.160 INFO:teuthology.orchestra.run.trial142.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:13.161 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:13.201 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-test 2026-02-17T11:44:13.521 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:13.603 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repository Size 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:Installing dependencies: 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout:Install 5 Packages 2026-02-17T11:44:13.604 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:13.605 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 50 M 2026-02-17T11:44:13.605 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 212 M 2026-02-17T11:44:13.605 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:13.750 INFO:teuthology.orchestra.run.trial142.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:44:13.796 INFO:teuthology.orchestra.run.trial142.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.8 MB/s | 233 kB 00:00 2026-02-17T11:44:13.819 INFO:teuthology.orchestra.run.trial142.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.7 MB/s | 64 kB 00:00 2026-02-17T11:44:13.861 INFO:teuthology.orchestra.run.trial142.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2026-02-17T11:44:13.995 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:13.995 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /sys 2026-02-17T11:44:13.995 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /proc 2026-02-17T11:44:13.995 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /mnt 2026-02-17T11:44:13.996 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /var/tmp 2026-02-17T11:44:13.996 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /home 2026-02-17T11:44:13.996 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /root 2026-02-17T11:44:13.996 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /tmp 2026-02-17T11:44:13.996 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:14.453 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:14.477 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:14.477 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:14.477 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:44:14.477 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:14.478 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:14.478 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:14.479 INFO:teuthology.orchestra.run.trial051.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:14.493 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:14.493 INFO:teuthology.orchestra.run.trial051.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:14.550 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:14.550 INFO:teuthology.orchestra.run.trial051.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:44:14.550 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:14.813 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:44:14.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:44:14.815 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:44:14.816 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:44:14.816 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:14.816 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:44:14.816 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout:Upgraded: 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:14.872 INFO:teuthology.orchestra.run.trial051.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:44:14.873 INFO:teuthology.orchestra.run.trial051.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.874 INFO:teuthology.orchestra.run.trial051.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:14.875 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:14.913 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-test 2026-02-17T11:44:15.223 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:15.305 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:44:15.306 INFO:teuthology.orchestra.run.trial051.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:Install 5 Packages 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 50 M 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 212 M 2026-02-17T11:44:15.307 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:15.636 INFO:teuthology.orchestra.run.trial142.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 25 MB/s | 50 MB 00:01 2026-02-17T11:44:15.638 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:15.638 INFO:teuthology.orchestra.run.trial142.stdout:Total 25 MB/s | 50 MB 00:02 2026-02-17T11:44:15.665 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:15.674 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:15.675 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:15.675 INFO:teuthology.orchestra.run.trial051.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 529 kB/s | 163 kB 00:00 2026-02-17T11:44:15.860 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:15.860 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:16.073 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:16.079 INFO:teuthology.orchestra.run.trial142.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:44:16.083 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:44:16.091 INFO:teuthology.orchestra.run.trial142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:44:16.092 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:16.501 INFO:teuthology.orchestra.run.trial051.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 367 kB/s | 303 kB 00:00 2026-02-17T11:44:16.512 INFO:teuthology.orchestra.run.trial051.stdout:(3/5): libxslt-1.1.34-12.el9.x86_64.rpm 203 kB/s | 233 kB 00:01 2026-02-17T11:44:16.590 INFO:teuthology.orchestra.run.trial051.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 721 kB/s | 64 kB 00:00 2026-02-17T11:44:17.501 INFO:teuthology.orchestra.run.trial051.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 23 MB/s | 50 MB 00:02 2026-02-17T11:44:17.503 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:17.503 INFO:teuthology.orchestra.run.trial051.stdout:Total 23 MB/s | 50 MB 00:02 2026-02-17T11:44:17.529 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:17.539 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:17.539 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:17.725 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:17.725 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:17.937 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:17.942 INFO:teuthology.orchestra.run.trial051.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:44:17.946 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:44:17.954 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:44:17.955 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:18.345 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:18.363 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:18.594 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:18.594 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:44:18.595 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:44:18.595 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:44:18.595 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:18.647 INFO:teuthology.orchestra.run.trial142.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:44:18.648 INFO:teuthology.orchestra.run.trial142.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:44:18.648 INFO:teuthology.orchestra.run.trial142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:44:18.648 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:18.648 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:18.682 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph 2026-02-17T11:44:18.985 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:19.071 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:19.073 INFO:teuthology.orchestra.run.trial142.stdout:====================================================================================== 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repository Size 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout:====================================================================================== 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout:Installing dependencies: 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:44:19.074 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:44:19.075 INFO:teuthology.orchestra.run.trial142.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:44:19.076 INFO:teuthology.orchestra.run.trial142.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:44:19.077 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:44:19.078 INFO:teuthology.orchestra.run.trial142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:44:19.079 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:44:19.080 INFO:teuthology.orchestra.run.trial142.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout:Installing weak dependencies: 2026-02-17T11:44:19.081 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:19.082 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:19.084 INFO:teuthology.orchestra.run.trial142.stdout:====================================================================================== 2026-02-17T11:44:19.084 INFO:teuthology.orchestra.run.trial142.stdout:Install 99 Packages 2026-02-17T11:44:19.084 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:19.086 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 95 M 2026-02-17T11:44:19.086 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 520 M 2026-02-17T11:44:19.086 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:19.439 INFO:teuthology.orchestra.run.trial142.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 113 kB/s | 6.5 kB 00:00 2026-02-17T11:44:19.538 INFO:teuthology.orchestra.run.trial142.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 6.9 MB/s | 1.1 MB 00:00 2026-02-17T11:44:19.572 INFO:teuthology.orchestra.run.trial142.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-17T11:44:19.606 INFO:teuthology.orchestra.run.trial142.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 934 kB/s | 31 kB 00:00 2026-02-17T11:44:19.634 INFO:teuthology.orchestra.run.trial142.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 5.2 MB/s | 150 kB 00:00 2026-02-17T11:44:19.834 INFO:teuthology.orchestra.run.trial142.stdout:(6/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 19 MB/s | 3.8 MB 00:00 2026-02-17T11:44:20.089 INFO:teuthology.orchestra.run.trial142.stdout:(7/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 7.3 MB/s | 4.7 MB 00:00 2026-02-17T11:44:20.125 INFO:teuthology.orchestra.run.trial142.stdout:(8/99): ceph-mgr-diskprediction-local-19.2.3-67 25 MB/s | 7.4 MB 00:00 2026-02-17T11:44:20.132 INFO:teuthology.orchestra.run.trial142.stdout:(9/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 513 kB/s | 22 kB 00:00 2026-02-17T11:44:20.154 INFO:teuthology.orchestra.run.trial142.stdout:(10/99): ceph-mgr-modules-core-19.2.3-675.g3c96 8.5 MB/s | 253 kB 00:00 2026-02-17T11:44:20.160 INFO:teuthology.orchestra.run.trial142.stdout:(11/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.7 MB/s | 49 kB 00:00 2026-02-17T11:44:20.180 INFO:teuthology.orchestra.run.trial142.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 636 kB/s | 17 kB 00:00 2026-02-17T11:44:20.191 INFO:teuthology.orchestra.run.trial142.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 9.4 MB/s | 299 kB 00:00 2026-02-17T11:44:20.228 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:20.230 INFO:teuthology.orchestra.run.trial142.stdout:(14/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 25 MB/s | 17 MB 00:00 2026-02-17T11:44:20.232 INFO:teuthology.orchestra.run.trial142.stdout:(15/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 14 MB/s | 769 kB 00:00 2026-02-17T11:44:20.246 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:20.461 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:20.462 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:44:20.462 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:44:20.462 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:44:20.462 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:44:20.514 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:20.515 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:20.550 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph 2026-02-17T11:44:20.724 INFO:teuthology.orchestra.run.trial142.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 82 kB/s | 40 kB 00:00 2026-02-17T11:44:20.846 INFO:teuthology.orchestra.run.trial142.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 117 kB/s | 72 kB 00:00 2026-02-17T11:44:20.854 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:20.940 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:20.943 INFO:teuthology.orchestra.run.trial051.stdout:====================================================================================== 2026-02-17T11:44:20.943 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-17T11:44:20.943 INFO:teuthology.orchestra.run.trial051.stdout:====================================================================================== 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:44:20.944 INFO:teuthology.orchestra.run.trial051.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:44:20.945 INFO:teuthology.orchestra.run.trial051.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:44:20.946 INFO:teuthology.orchestra.run.trial051.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:44:20.947 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:44:20.948 INFO:teuthology.orchestra.run.trial051.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:44:20.949 INFO:teuthology.orchestra.run.trial051.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:44:20.950 INFO:teuthology.orchestra.run.trial051.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout:Installing weak dependencies: 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:44:20.951 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout:====================================================================================== 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout:Install 99 Packages 2026-02-17T11:44:20.952 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:20.953 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 95 M 2026-02-17T11:44:20.953 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 520 M 2026-02-17T11:44:20.954 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:21.075 INFO:teuthology.orchestra.run.trial142.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 396 kB/s | 350 kB 00:00 2026-02-17T11:44:21.155 INFO:teuthology.orchestra.run.trial142.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-17T11:44:21.260 INFO:teuthology.orchestra.run.trial051.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T11:44:21.343 INFO:teuthology.orchestra.run.trial142.stdout:(20/99): python3-cryptography-36.0.1-5.el9.x86_ 6.6 MB/s | 1.2 MB 00:00 2026-02-17T11:44:21.344 INFO:teuthology.orchestra.run.trial142.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 943 kB/s | 253 kB 00:00 2026-02-17T11:44:21.350 INFO:teuthology.orchestra.run.trial051.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 7.7 MB/s | 1.1 MB 00:00 2026-02-17T11:44:21.364 INFO:teuthology.orchestra.run.trial051.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T11:44:21.389 INFO:teuthology.orchestra.run.trial051.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 1.2 MB/s | 31 kB 00:00 2026-02-17T11:44:21.419 INFO:teuthology.orchestra.run.trial051.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 4.9 MB/s | 150 kB 00:00 2026-02-17T11:44:21.446 INFO:teuthology.orchestra.run.trial142.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2026-02-17T11:44:21.447 INFO:teuthology.orchestra.run.trial142.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 135 kB 00:00 2026-02-17T11:44:21.551 INFO:teuthology.orchestra.run.trial142.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.4 MB/s | 150 kB 00:00 2026-02-17T11:44:21.551 INFO:teuthology.orchestra.run.trial142.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 1.2 MB/s | 126 kB 00:00 2026-02-17T11:44:21.579 INFO:teuthology.orchestra.run.trial051.stdout:(6/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 24 MB/s | 3.8 MB 00:00 2026-02-17T11:44:21.594 INFO:teuthology.orchestra.run.trial142.stdout:(26/99): libquadmath-11.5.0-14.el9.x86_64.rpm 247 kB/s | 184 kB 00:00 2026-02-17T11:44:21.609 INFO:teuthology.orchestra.run.trial051.stdout:(7/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 4.7 MB 00:00 2026-02-17T11:44:21.655 INFO:teuthology.orchestra.run.trial142.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 2.0 MB/s | 218 kB 00:00 2026-02-17T11:44:21.655 INFO:teuthology.orchestra.run.trial142.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 1.7 MB/s | 182 kB 00:00 2026-02-17T11:44:21.657 INFO:teuthology.orchestra.run.trial051.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 462 kB/s | 22 kB 00:00 2026-02-17T11:44:21.712 INFO:teuthology.orchestra.run.trial051.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.5 MB/s | 253 kB 00:00 2026-02-17T11:44:21.742 INFO:teuthology.orchestra.run.trial142.stdout:(29/99): flexiblas-3.0.4-9.el9.x86_64.rpm 338 kB/s | 30 kB 00:00 2026-02-17T11:44:21.765 INFO:teuthology.orchestra.run.trial142.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 647 kB/s | 15 kB 00:00 2026-02-17T11:44:21.766 INFO:teuthology.orchestra.run.trial051.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 916 kB/s | 49 kB 00:00 2026-02-17T11:44:21.822 INFO:teuthology.orchestra.run.trial051.stdout:(11/99): ceph-prometheus-alerts-19.2.3-675.g3c9 298 kB/s | 17 kB 00:00 2026-02-17T11:44:21.838 INFO:teuthology.orchestra.run.trial051.stdout:(12/99): ceph-mgr-diskprediction-local-19.2.3-6 29 MB/s | 7.4 MB 00:00 2026-02-17T11:44:21.856 INFO:teuthology.orchestra.run.trial142.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.7 MB/s | 246 kB 00:00 2026-02-17T11:44:21.861 INFO:teuthology.orchestra.run.trial051.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 7.5 MB/s | 299 kB 00:00 2026-02-17T11:44:21.883 INFO:teuthology.orchestra.run.trial142.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 7.0 MB/s | 188 kB 00:00 2026-02-17T11:44:21.885 INFO:teuthology.orchestra.run.trial051.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T11:44:21.906 INFO:teuthology.orchestra.run.trial142.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T11:44:21.961 INFO:teuthology.orchestra.run.trial051.stdout:(15/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:44:22.006 INFO:teuthology.orchestra.run.trial142.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 53 MB/s | 5.3 MB 00:00 2026-02-17T11:44:22.036 INFO:teuthology.orchestra.run.trial142.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-17T11:44:22.145 INFO:teuthology.orchestra.run.trial142.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 55 MB/s | 6.0 MB 00:00 2026-02-17T11:44:22.185 INFO:teuthology.orchestra.run.trial142.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 6.0 MB/s | 244 kB 00:00 2026-02-17T11:44:22.213 INFO:teuthology.orchestra.run.trial142.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.7 MB/s | 249 kB 00:00 2026-02-17T11:44:22.240 INFO:teuthology.orchestra.run.trial142.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.4 MB/s | 177 kB 00:00 2026-02-17T11:44:22.289 INFO:teuthology.orchestra.run.trial142.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 25 MB/s | 1.2 MB 00:00 2026-02-17T11:44:22.315 INFO:teuthology.orchestra.run.trial142.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.3 MB/s | 172 kB 00:00 2026-02-17T11:44:22.341 INFO:teuthology.orchestra.run.trial142.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.4 MB/s | 35 kB 00:00 2026-02-17T11:44:22.341 INFO:teuthology.orchestra.run.trial142.stdout:(43/99): zip-3.0-35.el9.x86_64.rpm 355 kB/s | 266 kB 00:00 2026-02-17T11:44:22.423 INFO:teuthology.orchestra.run.trial142.stdout:(44/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 74 MB/s | 6.1 MB 00:00 2026-02-17T11:44:22.448 INFO:teuthology.orchestra.run.trial142.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 3.1 MB/s | 77 kB 00:00 2026-02-17T11:44:22.463 INFO:teuthology.orchestra.run.trial051.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-17T11:44:22.473 INFO:teuthology.orchestra.run.trial142.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-17T11:44:22.498 INFO:teuthology.orchestra.run.trial142.stdout:(47/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.8 MB/s | 442 kB 00:00 2026-02-17T11:44:22.514 INFO:teuthology.orchestra.run.trial142.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.8 MB/s | 159 kB 00:00 2026-02-17T11:44:22.526 INFO:teuthology.orchestra.run.trial142.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 9.9 MB/s | 279 kB 00:00 2026-02-17T11:44:22.538 INFO:teuthology.orchestra.run.trial142.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.2 MB/s | 54 kB 00:00 2026-02-17T11:44:22.579 INFO:teuthology.orchestra.run.trial142.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2026-02-17T11:44:22.603 INFO:teuthology.orchestra.run.trial142.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-17T11:44:22.616 INFO:teuthology.orchestra.run.trial051.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 110 kB/s | 72 kB 00:00 2026-02-17T11:44:22.627 INFO:teuthology.orchestra.run.trial142.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.7 MB/s | 90 kB 00:00 2026-02-17T11:44:22.653 INFO:teuthology.orchestra.run.trial142.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 879 kB/s | 22 kB 00:00 2026-02-17T11:44:22.696 INFO:teuthology.orchestra.run.trial142.stdout:(55/99): protobuf-compiler-3.14.0-17.el9.x86_64 20 MB/s | 862 kB 00:00 2026-02-17T11:44:22.739 INFO:teuthology.orchestra.run.trial142.stdout:(56/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 90 MB/s | 19 MB 00:00 2026-02-17T11:44:22.861 INFO:teuthology.orchestra.run.trial051.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 755 kB/s | 184 kB 00:00 2026-02-17T11:44:22.914 INFO:teuthology.orchestra.run.trial051.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.7 MB/s | 794 kB 00:00 2026-02-17T11:44:22.952 INFO:teuthology.orchestra.run.trial142.stdout:(57/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.3 MB/s | 3.0 MB 00:01 2026-02-17T11:44:22.953 INFO:teuthology.orchestra.run.trial142.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 91 kB/s | 19 kB 00:00 2026-02-17T11:44:23.028 INFO:teuthology.orchestra.run.trial051.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-17T11:44:23.195 INFO:teuthology.orchestra.run.trial051.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2026-02-17T11:44:23.202 INFO:teuthology.orchestra.run.trial142.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-17T11:44:23.242 INFO:teuthology.orchestra.run.trial051.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 3.8 MB/s | 1.2 MB 00:00 2026-02-17T11:44:23.313 INFO:teuthology.orchestra.run.trial142.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 419 kB/s | 151 kB 00:00 2026-02-17T11:44:23.360 INFO:teuthology.orchestra.run.trial051.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 817 kB/s | 135 kB 00:00 2026-02-17T11:44:23.406 INFO:teuthology.orchestra.run.trial051.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 918 kB/s | 150 kB 00:00 2026-02-17T11:44:23.413 INFO:teuthology.orchestra.run.trial142.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 139 kB/s | 29 kB 00:00 2026-02-17T11:44:23.443 INFO:teuthology.orchestra.run.trial142.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-17T11:44:23.518 INFO:teuthology.orchestra.run.trial051.stdout:(25/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 211 kB/s | 350 kB 00:01 2026-02-17T11:44:23.528 INFO:teuthology.orchestra.run.trial051.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 754 kB/s | 126 kB 00:00 2026-02-17T11:44:23.571 INFO:teuthology.orchestra.run.trial051.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 1.3 MB/s | 218 kB 00:00 2026-02-17T11:44:23.602 INFO:teuthology.orchestra.run.trial142.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 208 kB/s | 60 kB 00:00 2026-02-17T11:44:23.629 INFO:teuthology.orchestra.run.trial051.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 516 kB/s | 30 kB 00:00 2026-02-17T11:44:23.632 INFO:teuthology.orchestra.run.trial142.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 199 kB/s | 43 kB 00:00 2026-02-17T11:44:23.654 INFO:teuthology.orchestra.run.trial142.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 152 kB/s | 32 kB 00:00 2026-02-17T11:44:23.694 INFO:teuthology.orchestra.run.trial051.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-17T11:44:23.748 INFO:teuthology.orchestra.run.trial142.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 97 kB/s | 14 kB 00:00 2026-02-17T11:44:23.763 INFO:teuthology.orchestra.run.trial051.stdout:(30/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 22 MB/s | 3.0 MB 00:00 2026-02-17T11:44:23.764 INFO:teuthology.orchestra.run.trial051.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 214 kB/s | 15 kB 00:00 2026-02-17T11:44:23.792 INFO:teuthology.orchestra.run.trial051.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.4 MB/s | 246 kB 00:00 2026-02-17T11:44:23.812 INFO:teuthology.orchestra.run.trial051.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 2.1 MB/s | 42 kB 00:00 2026-02-17T11:44:23.865 INFO:teuthology.orchestra.run.trial051.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 100 MB/s | 5.3 MB 00:00 2026-02-17T11:44:23.990 INFO:teuthology.orchestra.run.trial142.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 484 kB/s | 173 kB 00:00 2026-02-17T11:44:24.010 INFO:teuthology.orchestra.run.trial051.stdout:(35/99): unzip-6.0-59.el9.x86_64.rpm 369 kB/s | 182 kB 00:00 2026-02-17T11:44:24.076 INFO:teuthology.orchestra.run.trial142.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 851 kB/s | 358 kB 00:00 2026-02-17T11:44:24.169 INFO:teuthology.orchestra.run.trial142.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 604 kB/s | 254 kB 00:00 2026-02-17T11:44:24.205 INFO:teuthology.orchestra.run.trial051.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2026-02-17T11:44:24.229 INFO:teuthology.orchestra.run.trial051.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-17T11:44:24.251 INFO:teuthology.orchestra.run.trial051.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 11 MB/s | 249 kB 00:00 2026-02-17T11:44:24.273 INFO:teuthology.orchestra.run.trial051.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 8.0 MB/s | 177 kB 00:00 2026-02-17T11:44:24.299 INFO:teuthology.orchestra.run.trial051.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 48 MB/s | 1.2 MB 00:00 2026-02-17T11:44:24.326 INFO:teuthology.orchestra.run.trial051.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.2 MB/s | 172 kB 00:00 2026-02-17T11:44:24.346 INFO:teuthology.orchestra.run.trial051.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.7 MB/s | 35 kB 00:00 2026-02-17T11:44:24.398 INFO:teuthology.orchestra.run.trial051.stdout:(43/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 118 MB/s | 6.1 MB 00:00 2026-02-17T11:44:24.423 INFO:teuthology.orchestra.run.trial051.stdout:(44/99): protobuf-3.14.0-17.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2026-02-17T11:44:24.430 INFO:teuthology.orchestra.run.trial051.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 13 MB/s | 442 kB 00:00 2026-02-17T11:44:24.434 INFO:teuthology.orchestra.run.trial142.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 403 kB/s | 144 kB 00:00 2026-02-17T11:44:24.452 INFO:teuthology.orchestra.run.trial051.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 12 MB/s | 267 kB 00:00 2026-02-17T11:44:24.474 INFO:teuthology.orchestra.run.trial051.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 7.1 MB/s | 159 kB 00:00 2026-02-17T11:44:24.499 INFO:teuthology.orchestra.run.trial051.stdout:(48/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T11:44:24.516 INFO:teuthology.orchestra.run.trial142.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 401 kB/s | 139 kB 00:00 2026-02-17T11:44:24.520 INFO:teuthology.orchestra.run.trial051.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 2.5 MB/s | 54 kB 00:00 2026-02-17T11:44:24.564 INFO:teuthology.orchestra.run.trial051.stdout:(50/99): python3-packaging-20.9-5.el9.noarch.rp 546 kB/s | 77 kB 00:00 2026-02-17T11:44:24.594 INFO:teuthology.orchestra.run.trial051.stdout:(51/99): lua-5.4.4-4.el9.x86_64.rpm 227 kB/s | 188 kB 00:00 2026-02-17T11:44:24.640 INFO:teuthology.orchestra.run.trial051.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 549 kB/s | 42 kB 00:00 2026-02-17T11:44:24.642 INFO:teuthology.orchestra.run.trial142.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.1 MB/s | 2.0 MB 00:00 2026-02-17T11:44:24.657 INFO:teuthology.orchestra.run.trial142.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 76 kB/s | 11 kB 00:00 2026-02-17T11:44:24.689 INFO:teuthology.orchestra.run.trial051.stdout:(53/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 114 MB/s | 19 MB 00:00 2026-02-17T11:44:24.705 INFO:teuthology.orchestra.run.trial051.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 22 kB 00:00 2026-02-17T11:44:24.720 INFO:teuthology.orchestra.run.trial142.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 196 kB/s | 56 kB 00:00 2026-02-17T11:44:24.723 INFO:teuthology.orchestra.run.trial051.stdout:(55/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-17T11:44:24.726 INFO:teuthology.orchestra.run.trial051.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 39 MB/s | 862 kB 00:00 2026-02-17T11:44:24.758 INFO:teuthology.orchestra.run.trial051.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 622 kB/s | 19 kB 00:00 2026-02-17T11:44:24.775 INFO:teuthology.orchestra.run.trial051.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 8.5 MB/s | 151 kB 00:00 2026-02-17T11:44:24.784 INFO:teuthology.orchestra.run.trial051.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 8.8 MB/s | 551 kB 00:00 2026-02-17T11:44:24.800 INFO:teuthology.orchestra.run.trial051.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 1.9 MB/s | 29 kB 00:00 2026-02-17T11:44:24.801 INFO:teuthology.orchestra.run.trial051.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 21 MB/s | 548 kB 00:00 2026-02-17T11:44:24.813 INFO:teuthology.orchestra.run.trial051.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.8 MB/s | 43 kB 00:00 2026-02-17T11:44:24.814 INFO:teuthology.orchestra.run.trial051.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 4.2 MB/s | 60 kB 00:00 2026-02-17T11:44:24.817 INFO:teuthology.orchestra.run.trial051.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 7.7 MB/s | 32 kB 00:00 2026-02-17T11:44:24.818 INFO:teuthology.orchestra.run.trial051.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 3.2 MB/s | 14 kB 00:00 2026-02-17T11:44:24.828 INFO:teuthology.orchestra.run.trial051.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 16 MB/s | 173 kB 00:00 2026-02-17T11:44:24.836 INFO:teuthology.orchestra.run.trial051.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 21 MB/s | 358 kB 00:00 2026-02-17T11:44:24.849 INFO:teuthology.orchestra.run.trial051.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 12 MB/s | 254 kB 00:00 2026-02-17T11:44:24.858 INFO:teuthology.orchestra.run.trial051.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 14 MB/s | 144 kB 00:00 2026-02-17T11:44:24.860 INFO:teuthology.orchestra.run.trial142.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 81 kB/s | 18 kB 00:00 2026-02-17T11:44:24.866 INFO:teuthology.orchestra.run.trial142.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 111 kB/s | 23 kB 00:00 2026-02-17T11:44:24.866 INFO:teuthology.orchestra.run.trial051.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 17 MB/s | 139 kB 00:00 2026-02-17T11:44:24.871 INFO:teuthology.orchestra.run.trial051.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 13 MB/s | 56 kB 00:00 2026-02-17T11:44:24.874 INFO:teuthology.orchestra.run.trial051.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.9 MB/s | 11 kB 00:00 2026-02-17T11:44:24.878 INFO:teuthology.orchestra.run.trial051.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 4.7 MB/s | 18 kB 00:00 2026-02-17T11:44:24.879 INFO:teuthology.orchestra.run.trial051.stdout:(74/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 661 kB/s | 189 kB 00:00 2026-02-17T11:44:24.882 INFO:teuthology.orchestra.run.trial051.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 6.4 MB/s | 23 kB 00:00 2026-02-17T11:44:24.886 INFO:teuthology.orchestra.run.trial051.stdout:(76/99): python3-jaraco-functools-3.5.0-2.el9.n 4.3 MB/s | 19 kB 00:00 2026-02-17T11:44:24.900 INFO:teuthology.orchestra.run.trial051.stdout:(77/99): python3-jaraco-text-4.0.0-2.el9.noarch 2.0 MB/s | 26 kB 00:00 2026-02-17T11:44:24.912 INFO:teuthology.orchestra.run.trial051.stdout:(78/99): python3-jaraco-context-6.0.1-3.el9.noa 603 kB/s | 20 kB 00:00 2026-02-17T11:44:24.919 INFO:teuthology.orchestra.run.trial051.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 6.9 MB/s | 46 kB 00:00 2026-02-17T11:44:24.935 INFO:teuthology.orchestra.run.trial142.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 91 kB/s | 20 kB 00:00 2026-02-17T11:44:24.936 INFO:teuthology.orchestra.run.trial051.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 4.7 MB/s | 79 kB 00:00 2026-02-17T11:44:24.941 INFO:teuthology.orchestra.run.trial051.stdout:(81/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 19 MB/s | 2.0 MB 00:00 2026-02-17T11:44:24.946 INFO:teuthology.orchestra.run.trial051.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 12 MB/s | 58 kB 00:00 2026-02-17T11:44:24.948 INFO:teuthology.orchestra.run.trial051.stdout:(83/99): python3-kubernetes-26.1.0-3.el9.noarch 21 MB/s | 1.0 MB 00:00 2026-02-17T11:44:24.948 INFO:teuthology.orchestra.run.trial051.stdout:(84/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 6.6 MB/s | 86 kB 00:00 2026-02-17T11:44:24.965 INFO:teuthology.orchestra.run.trial051.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 14 MB/s | 272 kB 00:00 2026-02-17T11:44:24.965 INFO:teuthology.orchestra.run.trial051.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 5.2 MB/s | 90 kB 00:00 2026-02-17T11:44:24.966 INFO:teuthology.orchestra.run.trial051.stdout:(87/99): python3-portend-3.1.0-2.el9.noarch.rpm 917 kB/s | 16 kB 00:00 2026-02-17T11:44:24.969 INFO:teuthology.orchestra.run.trial051.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 6.7 MB/s | 31 kB 00:00 2026-02-17T11:44:24.978 INFO:teuthology.orchestra.run.trial051.stdout:(89/99): python3-saml-1.16.0-1.el9.noarch.rpm 15 MB/s | 125 kB 00:00 2026-02-17T11:44:24.982 INFO:teuthology.orchestra.run.trial051.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 3.7 MB/s | 59 kB 00:00 2026-02-17T11:44:24.983 INFO:teuthology.orchestra.run.trial051.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 6.6 MB/s | 36 kB 00:00 2026-02-17T11:44:24.986 INFO:teuthology.orchestra.run.trial051.stdout:(92/99): python3-routes-2.5.1-5.el9.noarch.rpm 8.8 MB/s | 188 kB 00:00 2026-02-17T11:44:24.998 INFO:teuthology.orchestra.run.trial051.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 5.5 MB/s | 86 kB 00:00 2026-02-17T11:44:24.998 INFO:teuthology.orchestra.run.trial051.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 15 MB/s | 230 kB 00:00 2026-02-17T11:44:24.999 INFO:teuthology.orchestra.run.trial051.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 7.0 MB/s | 90 kB 00:00 2026-02-17T11:44:25.008 INFO:teuthology.orchestra.run.trial051.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 4.9 MB/s | 48 kB 00:00 2026-02-17T11:44:25.017 INFO:teuthology.orchestra.run.trial051.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 1.2 MB/s | 22 kB 00:00 2026-02-17T11:44:25.021 INFO:teuthology.orchestra.run.trial051.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 1.6 MB/s | 20 kB 00:00 2026-02-17T11:44:25.025 INFO:teuthology.orchestra.run.trial051.stdout:(99/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 15 MB/s | 427 kB 00:00 2026-02-17T11:44:25.029 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:25.029 INFO:teuthology.orchestra.run.trial051.stdout:Total 23 MB/s | 95 MB 00:04 2026-02-17T11:44:25.071 INFO:teuthology.orchestra.run.trial142.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 92 kB/s | 19 kB 00:00 2026-02-17T11:44:25.075 INFO:teuthology.orchestra.run.trial142.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 126 kB/s | 26 kB 00:00 2026-02-17T11:44:25.352 INFO:teuthology.orchestra.run.trial142.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 165 kB/s | 46 kB 00:00 2026-02-17T11:44:25.364 INFO:teuthology.orchestra.run.trial142.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 273 kB/s | 79 kB 00:00 2026-02-17T11:44:25.453 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:25.489 INFO:teuthology.orchestra.run.trial142.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-17T11:44:25.492 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:25.492 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:25.642 INFO:teuthology.orchestra.run.trial142.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 298 kB/s | 86 kB 00:00 2026-02-17T11:44:25.651 INFO:teuthology.orchestra.run.trial142.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 201 kB/s | 58 kB 00:00 2026-02-17T11:44:25.856 INFO:teuthology.orchestra.run.trial142.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 76 kB/s | 16 kB 00:00 2026-02-17T11:44:25.905 INFO:teuthology.orchestra.run.trial142.stdout:(86/99): python3-pecan-1.4.2-3.el9.noarch.rpm 655 kB/s | 272 kB 00:00 2026-02-17T11:44:25.908 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:25.908 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:25.940 INFO:teuthology.orchestra.run.trial142.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 311 kB/s | 90 kB 00:00 2026-02-17T11:44:26.068 INFO:teuthology.orchestra.run.trial142.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 146 kB/s | 31 kB 00:00 2026-02-17T11:44:26.217 INFO:teuthology.orchestra.run.trial142.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 213 kB/s | 59 kB 00:00 2026-02-17T11:44:26.264 INFO:teuthology.orchestra.run.trial142.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 526 kB/s | 188 kB 00:00 2026-02-17T11:44:26.351 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:26.352 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:44:26.383 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:44:26.389 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:44:26.410 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:44:26.413 INFO:teuthology.orchestra.run.trial142.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 361 kB/s | 125 kB 00:00 2026-02-17T11:44:26.415 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:44:26.432 INFO:teuthology.orchestra.run.trial142.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 166 kB/s | 36 kB 00:00 2026-02-17T11:44:26.448 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:44:26.457 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:44:26.462 INFO:teuthology.orchestra.run.trial051.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:44:26.465 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:44:26.469 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:44:26.492 INFO:teuthology.orchestra.run.trial051.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:44:26.504 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:44:26.507 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:44:26.513 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:44:26.515 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:44:26.526 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:44:26.532 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:44:26.542 INFO:teuthology.orchestra.run.trial142.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 311 kB/s | 86 kB 00:00 2026-02-17T11:44:26.556 INFO:teuthology.orchestra.run.trial051.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:44:26.559 INFO:teuthology.orchestra.run.trial051.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:44:26.566 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:44:26.590 INFO:teuthology.orchestra.run.trial051.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:44:26.640 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:44:26.653 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:44:26.655 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:44:26.660 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:44:26.665 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:44:26.669 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:44:26.673 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:44:26.687 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:44:26.708 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:44:26.712 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:44:26.714 INFO:teuthology.orchestra.run.trial142.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 319 kB/s | 90 kB 00:00 2026-02-17T11:44:26.717 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:44:26.728 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:44:26.737 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:44:26.743 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:44:26.763 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:44:26.772 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:44:26.825 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:44:26.837 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:44:26.847 INFO:teuthology.orchestra.run.trial142.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 532 kB/s | 230 kB 00:00 2026-02-17T11:44:26.852 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:44:26.857 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:44:26.865 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:44:26.904 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:44:26.973 INFO:teuthology.orchestra.run.trial142.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 991 kB/s | 427 kB 00:00 2026-02-17T11:44:26.991 INFO:teuthology.orchestra.run.trial142.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 174 kB/s | 48 kB 00:00 2026-02-17T11:44:27.062 INFO:teuthology.orchestra.run.trial142.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 103 kB/s | 22 kB 00:00 2026-02-17T11:44:27.188 INFO:teuthology.orchestra.run.trial142.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 93 kB/s | 20 kB 00:00 2026-02-17T11:44:27.193 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:27.193 INFO:teuthology.orchestra.run.trial142.stdout:Total 12 MB/s | 95 MB 00:08 2026-02-17T11:44:27.225 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:44:27.235 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:44:27.239 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:44:27.245 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:44:27.246 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:44:27.273 INFO:teuthology.orchestra.run.trial051.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:44:27.316 INFO:teuthology.orchestra.run.trial051.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:44:27.323 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:44:27.326 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:44:27.332 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:44:27.335 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:44:27.342 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:44:27.346 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:44:27.373 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:44:27.383 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:44:27.417 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:44:27.608 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:27.640 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:44:27.644 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:27.645 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:27.663 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:44:27.666 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:44:27.725 INFO:teuthology.orchestra.run.trial051.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:44:27.727 INFO:teuthology.orchestra.run.trial051.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:44:27.748 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:44:28.062 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:28.062 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:28.069 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:44:28.141 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:44:28.509 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:28.510 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:44:28.542 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:44:28.547 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:44:28.568 INFO:teuthology.orchestra.run.trial142.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:44:28.574 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:44:28.608 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:44:28.618 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:44:28.623 INFO:teuthology.orchestra.run.trial142.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:44:28.625 INFO:teuthology.orchestra.run.trial142.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:44:28.630 INFO:teuthology.orchestra.run.trial142.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:44:28.653 INFO:teuthology.orchestra.run.trial142.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:44:28.666 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:44:28.669 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:44:28.674 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:44:28.676 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:44:28.687 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:44:28.693 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:44:28.718 INFO:teuthology.orchestra.run.trial142.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:44:28.721 INFO:teuthology.orchestra.run.trial142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:44:28.728 INFO:teuthology.orchestra.run.trial142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:44:28.752 INFO:teuthology.orchestra.run.trial142.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:44:28.804 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:44:28.805 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:44:28.817 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:44:28.819 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:44:28.822 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:44:28.824 INFO:teuthology.orchestra.run.trial142.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:44:28.829 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:44:28.832 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:44:28.834 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:44:28.837 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:44:28.839 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:44:28.852 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:44:28.852 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:44:28.867 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:44:28.872 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:44:28.877 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:44:28.882 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:44:28.894 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:44:28.903 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:44:28.909 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:44:28.928 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:44:28.937 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:44:28.942 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:44:28.951 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:44:28.974 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:44:28.992 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:44:29.003 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:44:29.004 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:44:29.020 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:44:29.024 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:44:29.032 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:44:29.053 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:44:29.059 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:44:29.063 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:44:29.064 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:44:29.072 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:44:29.082 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:29.082 INFO:teuthology.orchestra.run.trial051.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:44:29.082 INFO:teuthology.orchestra.run.trial051.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:44:29.082 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:29.091 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:29.118 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:29.118 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:44:29.118 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:29.154 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:44:29.218 INFO:teuthology.orchestra.run.trial051.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:44:29.220 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:29.234 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:29.234 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:29.235 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:44:29.235 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:29.400 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:44:29.410 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:44:29.414 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:44:29.419 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:44:29.421 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:44:29.449 INFO:teuthology.orchestra.run.trial142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:44:29.493 INFO:teuthology.orchestra.run.trial142.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:44:29.499 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:44:29.503 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:44:29.509 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:44:29.512 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:44:29.519 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:44:29.523 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:44:29.551 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:44:29.560 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:44:29.595 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:44:29.821 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:44:29.845 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:44:29.848 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:44:29.907 INFO:teuthology.orchestra.run.trial142.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:44:29.909 INFO:teuthology.orchestra.run.trial142.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:44:29.929 INFO:teuthology.orchestra.run.trial142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:44:29.933 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:29.958 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:29.958 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:29.959 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:44:29.959 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:29.959 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:29.959 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:30.014 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:30.015 INFO:teuthology.orchestra.run.trial051.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:30.020 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:44:30.040 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:44:30.041 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:30.256 INFO:teuthology.orchestra.run.trial142.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:44:30.330 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:44:30.535 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:30.538 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:30.987 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:30.988 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:30.999 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:31.000 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:31.002 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:44:31.020 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:44:31.030 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:44:31.037 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:44:31.050 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:44:31.055 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:31.066 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:44:31.105 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:44:31.106 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:31.128 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:31.140 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:31.141 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:44:31.150 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:44:31.174 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:44:31.204 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:44:31.254 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:44:31.261 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:44:31.264 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:44:31.265 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:44:31.283 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:31.283 INFO:teuthology.orchestra.run.trial142.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:44:31.283 INFO:teuthology.orchestra.run.trial142.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:44:31.284 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:31.293 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:31.318 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:31.319 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:44:31.319 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:31.355 INFO:teuthology.orchestra.run.trial142.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:44:31.356 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:31.357 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:31.378 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:31.419 INFO:teuthology.orchestra.run.trial142.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:44:31.421 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:31.435 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:31.435 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:31.435 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:44:31.435 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:31.479 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:31.498 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:31.498 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:31.498 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:44:31.498 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:31.498 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:31.499 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:31.516 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:32.133 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:32.158 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:32.158 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:32.158 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:44:32.159 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:32.159 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:32.159 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:32.182 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:44:32.183 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:44:32.184 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:44:32.185 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:44:32.186 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:44:32.187 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:44:32.188 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:44:32.189 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:44:32.190 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:44:32.214 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:32.216 INFO:teuthology.orchestra.run.trial142.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:32.220 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:44:32.240 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:44:32.241 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:32.245 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.246 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:44:32.247 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:44:32.248 INFO:teuthology.orchestra.run.trial051.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:44:32.249 INFO:teuthology.orchestra.run.trial051.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:44:32.250 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:44:32.251 INFO:teuthology.orchestra.run.trial051.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:44:32.252 INFO:teuthology.orchestra.run.trial051.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:44:32.253 INFO:teuthology.orchestra.run.trial051.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:44:32.254 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:44:32.254 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:44:32.254 INFO:teuthology.orchestra.run.trial051.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:44:32.254 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:32.254 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:32.303 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-base 2026-02-17T11:44:32.616 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:32.679 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:32.697 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:32.697 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:32.698 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:32.718 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install cephadm 2026-02-17T11:44:32.730 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:32.733 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:33.020 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:33.083 INFO:teuthology.orchestra.run.trial051.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:33.100 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:33.101 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:33.101 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:33.122 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:44:33.191 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:33.205 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:33.206 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:33.262 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:33.311 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:44:33.312 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:33.333 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:33.334 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:33.334 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:44:33.334 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:33.334 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:33.334 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:33.346 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:33.431 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:33.513 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:33.513 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:33.513 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 145 k 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 431 k 2026-02-17T11:44:33.514 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:33.560 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:33.561 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:33.583 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:33.583 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:33.583 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:44:33.583 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:33.583 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:33.584 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:33.612 INFO:teuthology.orchestra.run.trial051.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.4 MB/s | 145 kB 00:00 2026-02-17T11:44:33.613 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:33.613 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.4 MB/s | 145 kB 00:00 2026-02-17T11:44:33.613 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:33.616 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:33.616 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:33.647 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:33.647 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:33.684 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:33.701 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:33.702 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:33.705 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:33.724 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:33.725 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:33.725 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:33.725 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:44:33.725 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:34.037 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:34.063 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:44:34.359 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:44:34.360 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:44:34.361 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:44:34.362 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:44:34.363 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:44:34.364 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:44:34.365 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:44:34.366 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:44:34.367 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:44:34.369 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.424 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:34.425 INFO:teuthology.orchestra.run.trial142.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:44:34.426 INFO:teuthology.orchestra.run.trial142.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:44:34.427 INFO:teuthology.orchestra.run.trial142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:44:34.428 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:44:34.429 INFO:teuthology.orchestra.run.trial142.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:44:34.430 INFO:teuthology.orchestra.run.trial142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:44:34.431 INFO:teuthology.orchestra.run.trial142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:34.432 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:34.433 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:34.450 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:34.451 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:34.451 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:34.472 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:44:34.477 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-base 2026-02-17T11:44:34.778 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:34.786 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:34.842 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:34.850 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:34.860 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:34.860 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:34.861 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:34.867 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:34.868 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:34.868 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:34.881 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:44:34.889 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install cephadm 2026-02-17T11:44:35.190 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:35.199 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:35.253 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:35.262 INFO:teuthology.orchestra.run.trial142.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:35.271 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:35.272 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:35.272 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:35.279 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:35.280 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:35.280 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:35.292 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:44:35.300 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:44:35.601 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:35.605 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:35.665 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:35.682 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:35.683 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:35.683 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:35.687 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repo Size 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:35.688 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 145 k 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 431 k 2026-02-17T11:44:35.689 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:35.705 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:44:36.016 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:36.040 INFO:teuthology.orchestra.run.trial142.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 412 kB/s | 145 kB 00:00 2026-02-17T11:44:36.042 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:36.042 INFO:teuthology.orchestra.run.trial142.stdout:Total 409 kB/s | 145 kB 00:00 2026-02-17T11:44:36.042 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:36.046 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:36.046 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:36.077 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:36.077 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:36.079 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:36.097 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:36.097 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:36.097 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:36.118 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-fuse 2026-02-17T11:44:36.131 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:36.133 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:36.155 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:36.156 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:36.156 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:44:36.156 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:36.427 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:36.455 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:36.483 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-mgr 2026-02-17T11:44:36.508 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:36.509 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:36.509 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:36.509 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 1.2 M 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 3.6 M 2026-02-17T11:44:36.510 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:36.715 INFO:teuthology.orchestra.run.trial051.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 5.6 MB/s | 1.2 MB 00:00 2026-02-17T11:44:36.715 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:36.715 INFO:teuthology.orchestra.run.trial051.stdout:Total 5.6 MB/s | 1.2 MB 00:00 2026-02-17T11:44:36.716 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:36.719 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:36.719 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:36.753 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:36.753 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:36.794 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:36.853 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:36.859 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:36.871 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:36.877 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:36.878 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:36.878 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:36.900 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:44:37.101 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:37.157 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:37.183 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-volume 2026-02-17T11:44:37.216 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:37.283 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:37.300 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:37.301 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:37.301 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:37.323 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:44:37.498 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:37.561 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:37.578 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:37.579 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:37.579 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:37.599 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados-devel 2026-02-17T11:44:37.626 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:37.691 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:37.708 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:37.708 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:37.709 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:37.729 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:44:37.912 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:37.995 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:37.995 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:37.995 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-17T11:44:37.995 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 127 k 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 456 k 2026-02-17T11:44:37.996 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:38.036 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:38.099 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:38.113 INFO:teuthology.orchestra.run.trial051.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.1 MB/s | 127 kB 00:00 2026-02-17T11:44:38.115 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:38.115 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.0 MB/s | 127 kB 00:00 2026-02-17T11:44:38.116 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:38.117 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:38.117 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:38.117 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:38.119 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:38.119 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:38.138 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:44:38.150 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:38.150 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:38.205 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:38.221 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:38.304 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:38.361 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:38.388 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs2 2026-02-17T11:44:38.443 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:38.507 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:38.524 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:38.525 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:38.525 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:38.546 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-fuse 2026-02-17T11:44:38.721 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:38.784 INFO:teuthology.orchestra.run.trial051.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:38.801 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:38.802 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:38.802 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:38.823 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs-devel 2026-02-17T11:44:38.852 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:38.934 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:38.935 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:38.936 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:38.936 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 1.2 M 2026-02-17T11:44:38.936 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 3.6 M 2026-02-17T11:44:38.936 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:39.054 INFO:teuthology.orchestra.run.trial142.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T11:44:39.055 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:39.055 INFO:teuthology.orchestra.run.trial142.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T11:44:39.055 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:39.058 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:39.058 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:39.092 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:39.092 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:39.131 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:39.194 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:39.211 INFO:teuthology.orchestra.run.trial142.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.213 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:39.214 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:39.214 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-17T11:44:39.214 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:39.214 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:39.214 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 34 k 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 153 k 2026-02-17T11:44:39.215 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:39.277 INFO:teuthology.orchestra.run.trial051.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 534 kB/s | 34 kB 00:00 2026-02-17T11:44:39.278 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:39.278 INFO:teuthology.orchestra.run.trial051.stdout:Total 528 kB/s | 34 kB 00:00 2026-02-17T11:44:39.278 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:39.279 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:39.280 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:39.281 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:39.281 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:39.302 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:39.318 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.372 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.428 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.428 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:39.429 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:39.429 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:39.429 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:39.429 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:39.447 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.456 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados2 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:39.503 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:39.529 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install ceph-volume 2026-02-17T11:44:39.769 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:39.833 INFO:teuthology.orchestra.run.trial051.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:39.841 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:39.850 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:39.851 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:39.851 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:39.872 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librbd1 2026-02-17T11:44:39.905 INFO:teuthology.orchestra.run.trial142.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:39.922 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:39.923 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:39.923 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:39.944 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install librados-devel 2026-02-17T11:44:40.184 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:40.249 INFO:teuthology.orchestra.run.trial051.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:40.255 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:40.266 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:40.267 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:40.267 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:40.289 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rados 2026-02-17T11:44:40.337 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:40.337 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:40.337 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repo Size 2026-02-17T11:44:40.337 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 127 k 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 456 k 2026-02-17T11:44:40.338 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:40.442 INFO:teuthology.orchestra.run.trial142.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.2 MB/s | 127 kB 00:00 2026-02-17T11:44:40.443 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:40.443 INFO:teuthology.orchestra.run.trial142.stdout:Total 1.2 MB/s | 127 kB 00:00 2026-02-17T11:44:40.443 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:40.445 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:40.445 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:40.476 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:40.476 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:40.530 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:40.547 INFO:teuthology.orchestra.run.trial142.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:40.601 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:40.623 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:40.664 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:40.680 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:40.681 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:40.681 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:40.681 INFO:teuthology.orchestra.run.trial142.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:40.681 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:40.681 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:40.682 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:40.682 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:40.682 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:40.703 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rgw 2026-02-17T11:44:40.709 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install libcephfs2 2026-02-17T11:44:41.014 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:41.024 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:41.078 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:41.088 INFO:teuthology.orchestra.run.trial142.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:41.095 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:41.096 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:41.096 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:41.105 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:41.105 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:41.106 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:41.117 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-cephfs 2026-02-17T11:44:41.127 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install libcephfs-devel 2026-02-17T11:44:41.428 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:41.435 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:41.492 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:41.509 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:41.510 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:41.510 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:41.517 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repo Size 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:41.518 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:41.519 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:41.519 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:41.519 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 34 k 2026-02-17T11:44:41.519 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 153 k 2026-02-17T11:44:41.519 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:41.531 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rbd 2026-02-17T11:44:41.580 INFO:teuthology.orchestra.run.trial142.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 539 kB/s | 34 kB 00:00 2026-02-17T11:44:41.581 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:41.581 INFO:teuthology.orchestra.run.trial142.stdout:Total 531 kB/s | 34 kB 00:00 2026-02-17T11:44:41.581 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:41.583 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:41.583 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:41.585 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:41.585 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:41.607 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:41.623 INFO:teuthology.orchestra.run.trial142.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:41.680 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:41.736 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:41.736 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:41.736 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:41.736 INFO:teuthology.orchestra.run.trial142.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:41.736 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:41.737 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:41.765 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install librados2 2026-02-17T11:44:41.842 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:41.906 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:41.923 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:41.924 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-17T11:44:41.924 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:41.945 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-fuse 2026-02-17T11:44:42.071 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:42.135 INFO:teuthology.orchestra.run.trial142.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:42.152 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:42.153 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:42.153 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:42.175 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install librbd1 2026-02-17T11:44:42.254 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:42.337 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:42.337 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:42.338 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 85 k 2026-02-17T11:44:42.339 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 227 k 2026-02-17T11:44:42.339 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:42.465 INFO:teuthology.orchestra.run.trial051.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 674 kB/s | 85 kB 00:00 2026-02-17T11:44:42.465 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:42.465 INFO:teuthology.orchestra.run.trial051.stdout:Total 670 kB/s | 85 kB 00:00 2026-02-17T11:44:42.465 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:42.468 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:42.468 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:42.489 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:42.499 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:42.499 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:42.550 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:42.553 INFO:teuthology.orchestra.run.trial142.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:42.566 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:42.570 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:42.571 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:42.571 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:42.593 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install python3-rados 2026-02-17T11:44:42.645 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:42.703 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:42.704 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:42.704 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:42.704 INFO:teuthology.orchestra.run.trial051.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:42.704 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:42.704 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:42.734 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-mirror 2026-02-17T11:44:42.902 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:42.966 INFO:teuthology.orchestra.run.trial142.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:42.983 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:42.984 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:42.984 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:43.006 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install python3-rgw 2026-02-17T11:44:43.049 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:43.131 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:43.131 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:43.131 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 3.1 M 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 13 M 2026-02-17T11:44:43.132 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:43.314 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:43.378 INFO:teuthology.orchestra.run.trial142.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:43.396 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:43.397 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:43.397 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:43.419 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install python3-cephfs 2026-02-17T11:44:43.664 INFO:teuthology.orchestra.run.trial051.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 5.9 MB/s | 3.1 MB 00:00 2026-02-17T11:44:43.664 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:43.664 INFO:teuthology.orchestra.run.trial051.stdout:Total 5.8 MB/s | 3.1 MB 00:00 2026-02-17T11:44:43.664 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:43.668 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:43.669 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:43.708 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:43.709 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:43.732 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:43.796 INFO:teuthology.orchestra.run.trial142.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:43.814 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:43.814 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:43.815 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:43.837 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install python3-rbd 2026-02-17T11:44:43.904 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:43.905 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:43.929 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:44.144 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:44.209 INFO:teuthology.orchestra.run.trial142.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:44.226 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:44.227 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.227 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:44.227 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:44.228 INFO:teuthology.orchestra.run.trial051.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:44.228 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:44.228 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:44.228 INFO:teuthology.orchestra.run.trial142.stdout:Nothing to do. 2026-02-17T11:44:44.228 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:44.249 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install rbd-fuse 2026-02-17T11:44:44.255 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-nbd 2026-02-17T11:44:44.557 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:44.572 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:44:02 AM UTC. 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:44.640 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:44.641 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:44.641 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:44.641 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 85 k 2026-02-17T11:44:44.641 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 227 k 2026-02-17T11:44:44.641 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:44.654 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-17T11:44:44.655 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-17T11:44:44.656 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:44.656 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 171 k 2026-02-17T11:44:44.656 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 490 k 2026-02-17T11:44:44.656 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-17T11:44:44.738 INFO:teuthology.orchestra.run.trial142.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 874 kB/s | 85 kB 00:00 2026-02-17T11:44:44.738 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:44.738 INFO:teuthology.orchestra.run.trial142.stdout:Total 868 kB/s | 85 kB 00:00 2026-02-17T11:44:44.738 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:44.741 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:44.741 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:44.770 INFO:teuthology.orchestra.run.trial051.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2026-02-17T11:44:44.771 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:44.771 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.4 MB/s | 171 kB 00:00 2026-02-17T11:44:44.771 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-17T11:44:44.772 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:44.772 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:44.774 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-17T11:44:44.774 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-17T11:44:44.805 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-17T11:44:44.805 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-17T11:44:44.823 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:44.840 INFO:teuthology.orchestra.run.trial142.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.860 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-17T11:44:44.877 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.918 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.956 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:44.976 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:45.004 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install rbd-mirror 2026-02-17T11:44:45.012 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:45.012 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:45.012 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-17T11:44:45.012 INFO:teuthology.orchestra.run.trial051.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:45.012 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:45.013 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-17T11:44:45.042 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:45.324 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:45.409 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:45.409 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:45.409 INFO:teuthology.orchestra.run.trial142.stdout: Package Arch Version Repo Size 2026-02-17T11:44:45.409 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:45.409 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 3.1 M 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 13 M 2026-02-17T11:44:45.410 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:45.559 INFO:teuthology.orchestra.run.trial142.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:44:45.559 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:45.560 INFO:teuthology.orchestra.run.trial142.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:44:45.560 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:45.563 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:45.564 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:45.603 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:45.604 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:45.804 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:45.805 INFO:teuthology.orchestra.run.trial142.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:45.829 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.137 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:46.137 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.138 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:46.138 INFO:teuthology.orchestra.run.trial142.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:46.138 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.138 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:46.165 DEBUG:teuthology.orchestra.run.trial142:> sudo yum -y install rbd-nbd 2026-02-17T11:44:46.479 INFO:teuthology.orchestra.run.trial142.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 11:44:00 AM UTC. 2026-02-17T11:44:46.561 INFO:teuthology.orchestra.run.trial142.stdout:Dependencies resolved. 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Installing: 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Transaction Summary 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:================================================================================ 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Install 1 Package 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Total download size: 171 k 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Installed size: 490 k 2026-02-17T11:44:46.562 INFO:teuthology.orchestra.run.trial142.stdout:Downloading Packages: 2026-02-17T11:44:46.654 INFO:teuthology.orchestra.run.trial142.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2026-02-17T11:44:46.655 INFO:teuthology.orchestra.run.trial142.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:46.655 INFO:teuthology.orchestra.run.trial142.stdout:Total 1.8 MB/s | 171 kB 00:00 2026-02-17T11:44:46.655 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction check 2026-02-17T11:44:46.658 INFO:teuthology.orchestra.run.trial142.stdout:Transaction check succeeded. 2026-02-17T11:44:46.658 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction test 2026-02-17T11:44:46.691 INFO:teuthology.orchestra.run.trial142.stdout:Transaction test succeeded. 2026-02-17T11:44:46.691 INFO:teuthology.orchestra.run.trial142.stdout:Running transaction 2026-02-17T11:44:46.747 INFO:teuthology.orchestra.run.trial142.stdout: Preparing : 1/1 2026-02-17T11:44:46.764 INFO:teuthology.orchestra.run.trial142.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:46.845 INFO:teuthology.orchestra.run.trial142.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:46.904 INFO:teuthology.orchestra.run.trial142.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:46.904 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.904 INFO:teuthology.orchestra.run.trial142.stdout:Installed: 2026-02-17T11:44:46.904 INFO:teuthology.orchestra.run.trial142.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:46.904 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:46.905 INFO:teuthology.orchestra.run.trial142.stdout:Complete! 2026-02-17T11:44:46.936 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:46.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:44:47.115 DEBUG:teuthology.orchestra.run.trial051:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:44:47.137 INFO:teuthology.orchestra.run.trial051.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:47.138 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:47.138 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:44:47.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:44:47.286 DEBUG:teuthology.orchestra.run.trial142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:44:47.308 INFO:teuthology.orchestra.run.trial142.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:47.308 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:47.308 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:44:47.311 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:44:47.311 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:47.311 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:44:47.337 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:47.337 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:44:47.375 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:44:47.375 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:47.375 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:44:47.401 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:44:47.464 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:47.465 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:44:47.491 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:44:47.556 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:44:47.556 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:47.556 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:44:47.582 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:44:47.646 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:47.646 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:44:47.672 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:44:47.738 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:44:47.738 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:47.738 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:44:47.764 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:44:47.828 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:47.828 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:44:47.853 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:44:47.917 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:44:48.026 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:44:48.026 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 777 /var/log/ceph 2026-02-17T11:44:48.028 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod 777 /var/log/ceph 2026-02-17T11:44:48.053 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:44:48.053 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:44:48.093 DEBUG:teuthology.orchestra.run.trial142:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:44:48.118 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:44:48.119 DEBUG:teuthology.orchestra.run.trial051:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:44:48.157 DEBUG:teuthology.orchestra.run.trial142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:44:48.197 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:44:48.197 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:44:48.198 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51338', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial051.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx8PzDXqm6eR9REttBZ6SfR9kbQiLqkbb/3bF8rwkLVjtUoFw+gkvp6EwAiwbQu4UKktHwgxY5geR0e5nIcMSg=', 'trial142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbTr98ZVciPUeKhpZMlsnmu1iNaXMJeSQLWjJLDwZe3VE7Ly587GaOyrFVEmVqZgsasE0DaPUFxOTptbyHCzog='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 20, 'thrash_delay': 1}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:44:48.198 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:44:48.222 DEBUG:teuthology.orchestra.run.trial142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:44:48.240 DEBUG:teuthology.orchestra.run.trial051:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:44:48.281 DEBUG:teuthology.orchestra.run.trial142:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:44:48.305 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:48.306 DEBUG:teuthology.orchestra.run.trial051:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:44:48.363 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:44:48.363 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_1 2026-02-17T11:44:48.421 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:44:48.421 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:48.421 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-17T11:44:48.421 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:48.422 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:48.422 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-17 11:44:44.073061313 +0000 2026-02-17T11:44:48.422 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.422 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.422 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.422 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:44:48.483 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-17T11:44:48.484 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-17T11:44:48.484 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.00024731 s, 2.1 MB/s 2026-02-17T11:44:48.486 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:44:48.543 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_2 2026-02-17T11:44:48.599 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1320 Links: 1 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-17 11:44:44.074061296 +0000 2026-02-17T11:44:48.600 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.601 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.601 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-17 11:44:08.180639056 +0000 2026-02-17T11:44:48.601 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:44:48.663 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-17T11:44:48.663 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-17T11:44:48.663 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000224778 s, 2.3 MB/s 2026-02-17T11:44:48.664 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:44:48.721 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_3 2026-02-17T11:44:48.777 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:44:48.777 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-17 11:44:44.074061296 +0000 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-17 11:44:08.178639087 +0000 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-17 11:44:08.178639087 +0000 2026-02-17T11:44:48.778 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-17 11:44:08.178639087 +0000 2026-02-17T11:44:48.778 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:44:48.841 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-17T11:44:48.841 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-17T11:44:48.841 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000159517 s, 3.2 MB/s 2026-02-17T11:44:48.842 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:44:48.898 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_4 2026-02-17T11:44:48.954 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:44:48.954 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:48.954 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T11:44:48.954 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:48.955 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:48.955 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-17 11:44:44.074061296 +0000 2026-02-17T11:44:48.955 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-17 11:44:08.179639071 +0000 2026-02-17T11:44:48.955 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-17 11:44:08.179639071 +0000 2026-02-17T11:44:48.955 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-17 11:44:08.179639071 +0000 2026-02-17T11:44:48.955 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:44:49.016 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-17T11:44:49.016 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-17T11:44:49.016 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000135401 s, 3.8 MB/s 2026-02-17T11:44:49.018 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:44:49.075 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:44:49.075 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:49.075 DEBUG:teuthology.orchestra.run.trial142:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:44:49.105 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:44:49.106 DEBUG:teuthology.orchestra.run.trial142:> stat /dev/vg_nvme/lv_1 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Access: 2026-02-17 11:44:45.968526419 +0000 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Modify: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout:Change: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.165 INFO:teuthology.orchestra.run.trial142.stdout: Birth: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.165 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:44:49.228 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records in 2026-02-17T11:44:49.228 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records out 2026-02-17T11:44:49.228 INFO:teuthology.orchestra.run.trial142.stderr:512 bytes copied, 0.000154026 s, 3.3 MB/s 2026-02-17T11:44:49.229 DEBUG:teuthology.orchestra.run.trial142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:44:49.287 DEBUG:teuthology.orchestra.run.trial142:> stat /dev/vg_nvme/lv_2 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Access: 2026-02-17 11:44:45.968526419 +0000 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Modify: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout:Change: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.343 INFO:teuthology.orchestra.run.trial142.stdout: Birth: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.343 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:44:49.406 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records in 2026-02-17T11:44:49.406 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records out 2026-02-17T11:44:49.406 INFO:teuthology.orchestra.run.trial142.stderr:512 bytes copied, 0.000162101 s, 3.2 MB/s 2026-02-17T11:44:49.408 DEBUG:teuthology.orchestra.run.trial142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:44:49.464 DEBUG:teuthology.orchestra.run.trial142:> stat /dev/vg_nvme/lv_3 2026-02-17T11:44:49.521 INFO:teuthology.orchestra.run.trial142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Access: 2026-02-17 11:44:45.969526401 +0000 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Modify: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout:Change: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.522 INFO:teuthology.orchestra.run.trial142.stdout: Birth: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.523 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:44:49.585 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records in 2026-02-17T11:44:49.585 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records out 2026-02-17T11:44:49.585 INFO:teuthology.orchestra.run.trial142.stderr:512 bytes copied, 0.000143526 s, 3.6 MB/s 2026-02-17T11:44:49.587 DEBUG:teuthology.orchestra.run.trial142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:44:49.644 DEBUG:teuthology.orchestra.run.trial142:> stat /dev/vg_nvme/lv_4 2026-02-17T11:44:49.701 INFO:teuthology.orchestra.run.trial142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:44:49.701 INFO:teuthology.orchestra.run.trial142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:49.701 INFO:teuthology.orchestra.run.trial142.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout:Access: 2026-02-17 11:44:45.969526401 +0000 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout:Modify: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout:Change: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.702 INFO:teuthology.orchestra.run.trial142.stdout: Birth: 2026-02-17 11:44:06.394206096 +0000 2026-02-17T11:44:49.702 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:44:49.765 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records in 2026-02-17T11:44:49.765 INFO:teuthology.orchestra.run.trial142.stderr:1+0 records out 2026-02-17T11:44:49.765 INFO:teuthology.orchestra.run.trial142.stderr:512 bytes copied, 0.000144808 s, 3.5 MB/s 2026-02-17T11:44:49.766 DEBUG:teuthology.orchestra.run.trial142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:44:49.825 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T11:44:49.825 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial142.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:44:49.826 INFO:tasks.ceph:Generating config... 2026-02-17T11:44:49.828 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T11:44:49.828 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T11:44:49.828 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T11:44:49.828 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms inject delay max = 1 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms inject delay type = mon 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-17T11:44:49.829 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:44:49.829 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:44:49.829 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-17T11:44:49.829 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:44:49.829 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:44:49.829 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:44:49.830 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-17T11:44:49.830 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:44:49.830 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-17T11:44:49.830 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T11:44:49.830 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:44:49.831 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:44:49.832 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:44:49.832 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:44:49.832 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:44:49.868 INFO:teuthology.orchestra.run.trial051.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:44:49.870 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:44:49.946 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:44:50.012 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.51'), ('mon.c', '[v2:10.20.193.51:3301,v1:10.20.193.51:6790]'), ('mon.b', '10.20.193.142')] 2026-02-17T11:44:50.013 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.51,[v2:10.20.193.51:3301,v1:10.20.193.51:6790],10.20.193.142', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-17T11:44:50.014 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:50.014 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:44:50.069 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.51 --addv c '[v2:10.20.193.51:3301,v1:10.20.193.51:6790]' --add b 10.20.193.142 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:50.143 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:50.143 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: generated fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:setting min_mon_release = quincy 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:epoch 0 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:min_mon_release 17 (quincy) 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:election_strategy: 1 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:44:50.144 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T11:44:50.146 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:44:50.202 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d196e788-97c6-436f-bedf-bc3cc9f7e94a... 2026-02-17T11:44:50.203 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:44:50.244 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout:[global] 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout: chdir = "" 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout: auth supported = cephx 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.281 INFO:teuthology.orchestra.run.trial051.stdout: filestore xattr use omap = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon clock drift allowed = 1.000 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: osd crush chooseleaf type = 0 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: auth debug = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: ms die on old message = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: ms die on bug = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon pg warn max object skew = 0 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: osd pool default size = 2 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon osd allow primary affinity = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon osd allow pg remap = true 2026-02-17T11:44:50.282 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on no sortbitwise = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on too few osds = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon_allow_pool_size_one = true 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: osd default data pool replay window = 5 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon allow pool delete = true 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon cluster log file level = debug 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: debug asserts on shutdown = true 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon health detail to clog = false 2026-02-17T11:44:50.283 INFO:teuthology.orchestra.run.trial051.stdout: mon host = "10.20.193.51,[v2:10.20.193.51:3301,v1:10.20.193.51:6790],10.20.193.142" 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: mon client directed command retry = 5 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: mon election default strategy = 1 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms inject delay max = 1 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms inject delay probability = 0.005 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms inject delay type = mon 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms inject internal delays = 0.002 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms inject socket failures = 2500 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: ms type = async 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: fsid = d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout:[osd] 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: osd journal size = 100 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: osd scrub load threshold = 5.0 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: osd scrub max interval = 600 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.284 INFO:teuthology.orchestra.run.trial051.stdout: osd recover clone overlap = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd recovery max chunk = 1048576 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd debug shutdown = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd debug op order = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd debug verify stray on activate = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd debug trim objects = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd open classes on start = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd debug pg log writeout = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: osd map max advance = 10 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: journal zero on create = true 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:44:50.285 INFO:teuthology.orchestra.run.trial051.stdout: filestore apply finisher threads = 3 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bdev debug aio = true 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd debug misdirected ops = true 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bluestore block size = 96636764160 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bluestore compression algorithm = snappy 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bluestore compression mode = aggressive 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bluestore fsck on mount = True 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: bluestore zero block detection = True 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: debug bluefs = 20 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: debug bluestore = 20 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 1 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: debug osd = 20 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: debug rocksdb = 10 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: mon osd full ratio = 0.9 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd debug verify cached snaps = True 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd debug verify missing on start = True 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd mclock override recovery settings = True 2026-02-17T11:44:50.286 INFO:teuthology.orchestra.run.trial051.stdout: osd objectstore = bluestore 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: osd op queue = debug_random 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: osd op queue cut off = debug_random 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout:[mgr] 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 1 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug mgr = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug mon = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug auth = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: mgr/telemetry/nag = false 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug monc = 10 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout:[mon] 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 1 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug mon = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug paxos = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: debug auth = 20 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: mon data avail warn = 5 2026-02-17T11:44:50.287 INFO:teuthology.orchestra.run.trial051.stdout: mon mgr mkfs grace = 240 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon osd reporter subtree level = osd 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon osd prime pg temp = true 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: # 1m isn't quite enough 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon min osdmap epochs = 25 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon osdmap full prune interval = 2 2026-02-17T11:44:50.288 INFO:teuthology.orchestra.run.trial051.stdout: mon osdmap full prune min = 15 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: mon scrub inject missing keys = 0.05 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: mon scrub interval = 300 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: paxos service trim min = 5 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout:[client] 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: rgw cache enabled = true 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: rgw enable ops log = true 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: rgw enable usage log = true 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: debug monc = 20 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 1 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout:[mon.a] 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout:[mon.c] 2026-02-17T11:44:50.289 INFO:teuthology.orchestra.run.trial051.stdout:[mon.b] 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout:[global] 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: chdir = "" 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: auth supported = cephx 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: filestore xattr use omap = true 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: mon clock drift allowed = 1.000 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: osd crush chooseleaf type = 0 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: auth debug = true 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: ms die on old message = true 2026-02-17T11:44:50.290 INFO:teuthology.orchestra.run.trial142.stdout: ms die on bug = true 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon pg warn max object skew = 0 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: osd pool default size = 2 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon osd allow primary affinity = true 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon osd allow pg remap = true 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon warn on no sortbitwise = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon warn on too few osds = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: mon_allow_pool_size_one = true 2026-02-17T11:44:50.291 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: osd default data pool replay window = 5 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon allow pool delete = true 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon cluster log file level = debug 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: debug asserts on shutdown = true 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon health detail to clog = false 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon host = "10.20.193.51,[v2:10.20.193.51:3301,v1:10.20.193.51:6790],10.20.193.142" 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon client directed command retry = 5 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: mon election default strategy = 1 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms inject delay max = 1 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms inject delay probability = 0.005 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms inject delay type = mon 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms inject internal delays = 0.002 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms inject socket failures = 2500 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: ms type = async 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: fsid = d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout:[osd] 2026-02-17T11:44:50.292 INFO:teuthology.orchestra.run.trial142.stdout: osd journal size = 100 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd scrub load threshold = 5.0 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd scrub max interval = 600 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd recover clone overlap = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd recovery max chunk = 1048576 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd debug shutdown = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd debug op order = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd debug verify stray on activate = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd debug trim objects = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd open classes on start = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd debug pg log writeout = true 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: osd map max advance = 10 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.293 INFO:teuthology.orchestra.run.trial142.stdout: journal zero on create = true 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: filestore apply finisher threads = 3 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bdev debug aio = true 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: osd debug misdirected ops = true 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bluestore block size = 96636764160 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bluestore compression algorithm = snappy 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bluestore compression mode = aggressive 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bluestore fsck on mount = True 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: bluestore zero block detection = True 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: debug bluefs = 20 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: debug bluestore = 20 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: debug ms = 1 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: debug osd = 20 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: debug rocksdb = 10 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: mon osd full ratio = 0.9 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: osd debug verify cached snaps = True 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: osd debug verify missing on start = True 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:44:50.294 INFO:teuthology.orchestra.run.trial142.stdout: osd mclock override recovery settings = True 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: osd objectstore = bluestore 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: osd op queue = debug_random 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: osd op queue cut off = debug_random 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout:[mgr] 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug ms = 1 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug mgr = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug mon = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug auth = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mgr/telemetry/nag = false 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug monc = 10 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout:[mon] 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug ms = 1 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug mon = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug paxos = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: debug auth = 20 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon data avail warn = 5 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon mgr mkfs grace = 240 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:50.295 INFO:teuthology.orchestra.run.trial142.stdout: mon osd reporter subtree level = osd 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon osd prime pg temp = true 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: # 1m isn't quite enough 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon min osdmap epochs = 25 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon osdmap full prune interval = 2 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon osdmap full prune min = 15 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon scrub inject missing keys = 0.05 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: mon scrub interval = 300 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: paxos service trim min = 5 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout: 2026-02-17T11:44:50.296 INFO:teuthology.orchestra.run.trial142.stdout:[client] 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: rgw cache enabled = true 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: rgw enable ops log = true 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: rgw enable usage log = true 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: debug monc = 20 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout: debug ms = 1 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout:[mon.a] 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout:[mon.c] 2026-02-17T11:44:50.297 INFO:teuthology.orchestra.run.trial142.stdout:[mon.b] 2026-02-17T11:44:50.298 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:44:50.298 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:44:50.379 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:44:50.379 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:50.379 DEBUG:teuthology.orchestra.run.trial051:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:44:50.436 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:50.436 DEBUG:teuthology.orchestra.run.trial051:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:44:50.494 INFO:tasks.ceph:Sending monmap to node ubuntu@trial051.front.sepia.ceph.com 2026-02-17T11:44:50.494 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:50.494 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:44:50.494 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:44:50.567 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:44:50.567 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:50.623 INFO:tasks.ceph:Sending monmap to node ubuntu@trial142.front.sepia.ceph.com 2026-02-17T11:44:50.623 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:50.623 DEBUG:teuthology.orchestra.run.trial142:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:44:50.624 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:44:50.658 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:44:50.658 DEBUG:teuthology.orchestra.run.trial142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:50.713 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:44:50.713 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:44:50.713 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:44:50.799 INFO:teuthology.orchestra.run.trial142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:44:50.801 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:44:50.801 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:44:50.802 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T11:44:50.835 INFO:teuthology.orchestra.run.trial142.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T11:44:50.846 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:44:50.846 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial142.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:44:50.847 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:50.872 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:44:50.873 INFO:tasks.ceph:role: osd.0 2026-02-17T11:44:50.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T11:44:50.873 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:44:50.937 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:50.938 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:50.939 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:50.939 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:51.509 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-17T11:44:51.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-17T11:44:51.511 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:51.580 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:51.649 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:51.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:44:51.715 INFO:tasks.ceph:role: osd.1 2026-02-17T11:44:51.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T11:44:51.715 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:51.780 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:52.341 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-17T11:44:52.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-17T11:44:52.343 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:52.412 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:52.479 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:52.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:44:52.544 INFO:tasks.ceph:role: osd.2 2026-02-17T11:44:52.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T11:44:52.545 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:44:52.610 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:52.610 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:52.610 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:52.611 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:53.219 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-17T11:44:53.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-17T11:44:53.221 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:53.289 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:53.356 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:53.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:53.435+0000 7f5802e3f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:44:53.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:53.435+0000 7f5802e3f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:44:53.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:53.435+0000 7f5802e3f780 -1 bdev(0x5647965cf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:53.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:53.435+0000 7f5802e3f780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:44:56.581 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:56.646 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:56.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:56.723+0000 7faa8481f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:44:56.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:56.724+0000 7faa8481f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:44:56.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:56.724+0000 7faa8481f780 -1 bdev(0x557679e55800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:56.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:56.724+0000 7faa8481f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:44:59.633 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:59.699 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:59.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:59.775+0000 7f1b432d2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:44:59.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:59.776+0000 7f1b432d2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:44:59.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:59.776+0000 7f1b432d2780 -1 bdev(0x55ceef003800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:59.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:44:59.776+0000 7f1b432d2780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:45:02.932 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:45:02.998 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T11:45:03.024 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T11:45:03.024 INFO:tasks.ceph:role: osd.3 2026-02-17T11:45:03.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T11:45:03.025 DEBUG:teuthology.orchestra.run.trial142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:45:03.091 INFO:teuthology.orchestra.run.trial142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:45:03.092 INFO:teuthology.orchestra.run.trial142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:45:03.677 INFO:teuthology.orchestra.run.trial142.stdout:Discarding blocks...Done. 2026-02-17T11:45:03.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial142.front.sepia.ceph.com -o noatime 2026-02-17T11:45:03.679 DEBUG:teuthology.orchestra.run.trial142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T11:45:03.748 DEBUG:teuthology.orchestra.run.trial142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T11:45:03.815 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T11:45:03.881 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T11:45:03.881 INFO:tasks.ceph:role: osd.4 2026-02-17T11:45:03.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T11:45:03.881 DEBUG:teuthology.orchestra.run.trial142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:45:03.947 INFO:teuthology.orchestra.run.trial142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:45:03.948 INFO:teuthology.orchestra.run.trial142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:45:04.507 INFO:teuthology.orchestra.run.trial142.stdout:Discarding blocks...Done. 2026-02-17T11:45:04.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial142.front.sepia.ceph.com -o noatime 2026-02-17T11:45:04.510 DEBUG:teuthology.orchestra.run.trial142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T11:45:04.578 DEBUG:teuthology.orchestra.run.trial142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T11:45:04.644 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T11:45:04.707 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T11:45:04.707 INFO:tasks.ceph:role: osd.5 2026-02-17T11:45:04.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T11:45:04.707 DEBUG:teuthology.orchestra.run.trial142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:45:04.772 INFO:teuthology.orchestra.run.trial142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:45:04.772 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:45:04.772 INFO:teuthology.orchestra.run.trial142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:45:04.772 INFO:teuthology.orchestra.run.trial142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:45:04.772 INFO:teuthology.orchestra.run.trial142.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:45:04.773 INFO:teuthology.orchestra.run.trial142.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:45:04.773 INFO:teuthology.orchestra.run.trial142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:45:04.773 INFO:teuthology.orchestra.run.trial142.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:45:04.773 INFO:teuthology.orchestra.run.trial142.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:45:04.773 INFO:teuthology.orchestra.run.trial142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:45:05.335 INFO:teuthology.orchestra.run.trial142.stdout:Discarding blocks...Done. 2026-02-17T11:45:05.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial142.front.sepia.ceph.com -o noatime 2026-02-17T11:45:05.337 DEBUG:teuthology.orchestra.run.trial142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-17T11:45:05.417 DEBUG:teuthology.orchestra.run.trial142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T11:45:05.486 DEBUG:teuthology.orchestra.run.trial142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:45:05.563 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:05.561+0000 7fd6fde14780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T11:45:05.564 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:05.561+0000 7fd6fde14780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T11:45:05.564 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:05.561+0000 7fd6fde14780 -1 bdev(0x5617b78bd800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T11:45:05.564 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:05.561+0000 7fd6fde14780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T11:45:08.461 DEBUG:teuthology.orchestra.run.trial142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T11:45:08.526 DEBUG:teuthology.orchestra.run.trial142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:45:08.606 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:08.603+0000 7f1ada218780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T11:45:08.606 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:08.603+0000 7f1ada218780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T11:45:08.606 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:08.603+0000 7f1ada218780 -1 bdev(0x558d435ad800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T11:45:08.606 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:08.603+0000 7f1ada218780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T11:45:11.521 DEBUG:teuthology.orchestra.run.trial142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T11:45:11.587 DEBUG:teuthology.orchestra.run.trial142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:45:11.665 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:11.662+0000 7f46d2410780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T11:45:11.666 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:11.662+0000 7f46d2410780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T11:45:11.666 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:11.662+0000 7f46d2410780 -1 bdev(0x5641e1fab800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T11:45:11.666 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:11.663+0000 7f46d2410780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T11:45:14.825 DEBUG:teuthology.orchestra.run.trial142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T11:45:14.891 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:45:14.891 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:14.891 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:45:14.917 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:14.917 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:45:14.981 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:14.982 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:45:15.047 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:15.047 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:45:15.073 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:15.073 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T11:45:15.136 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:15.136 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T11:45:15.201 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:15.201 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T11:45:15.265 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:15.265 DEBUG:teuthology.orchestra.run.trial142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T11:45:15.321 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:45:15.322 DEBUG:teuthology.orchestra.run.trial051:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:45:15.324 DEBUG:teuthology.orchestra.run.trial142:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout:[osd.0] 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout: key = AQC1VJRp2M7/GRAAGv82AzCOyd4DkAEVL9ZrxQ== 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout:[osd.1] 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout: key = AQC4VJRpub80KxAAHdVsBL0d+9HMiOodz0+nqA== 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout:[osd.2] 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout: key = AQC7VJRpCe9NLhAAnk8iLPrgkX6I6TQL2vun5g== 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout:[mgr.x] 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout: key = AQCyVJRpECCJLxAAxHzggjrnwP6wly7HaOR5ag== 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout:[osd.3] 2026-02-17T11:45:15.364 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDBVJRp5BqCIRAANSPDAwIXaF8p8pRu/x6TBw== 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout:[osd.4] 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDEVJRpvYQFJBAAOatUu/5noWUj9NFFc19qlw== 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout:[osd.5] 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDHVJRpEz6PJxAAI/T0Eh3f3YH+/QXGallbKA== 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout:[client.0] 2026-02-17T11:45:15.365 INFO:teuthology.orchestra.run.trial051.stdout: key = AQCyVJRpWpeyMRAAZHIUWBGitUUD88VH8MTZyA== 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout:[osd.0] 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout: key = AQC1VJRp2M7/GRAAGv82AzCOyd4DkAEVL9ZrxQ== 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout:[osd.1] 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout: key = AQC4VJRpub80KxAAHdVsBL0d+9HMiOodz0+nqA== 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout:[osd.2] 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout: key = AQC7VJRpCe9NLhAAnk8iLPrgkX6I6TQL2vun5g== 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout:[mgr.x] 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout: key = AQCyVJRpECCJLxAAxHzggjrnwP6wly7HaOR5ag== 2026-02-17T11:45:15.384 INFO:teuthology.orchestra.run.trial142.stdout:[osd.3] 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout: key = AQDBVJRp5BqCIRAANSPDAwIXaF8p8pRu/x6TBw== 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout:[osd.4] 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout: key = AQDEVJRpvYQFJBAAOatUu/5noWUj9NFFc19qlw== 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout:[osd.5] 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout: key = AQDHVJRpEz6PJxAAI/T0Eh3f3YH+/QXGallbKA== 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout:[client.0] 2026-02-17T11:45:15.385 INFO:teuthology.orchestra.run.trial142.stdout: key = AQCyVJRpWpeyMRAAZHIUWBGitUUD88VH8MTZyA== 2026-02-17T11:45:15.386 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.408 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.468 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.491 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.547 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.570 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.626 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:45:15.650 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:45:15.706 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.730 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.786 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.809 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.864 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.889 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:45:15.941 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:45:15.968 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:45:16.022 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:45:16.022 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:45:16.070 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:45:16.157 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:45:16.181 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T11:45:16.245 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:45:16.327 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T11:45:16.391 DEBUG:teuthology.orchestra.run.trial142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T11:45:16.416 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:45:16.501 DEBUG:teuthology.orchestra.run.trial142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T11:45:16.565 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:45:16.567 DEBUG:teuthology.orchestra.run.trial142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:45:16.620 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:45:16.620 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:45:16.620 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:45:16.623 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:45:16.623 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:45:16.623 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:45:16.625 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:45:16.625 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:45:16.625 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T11:45:16.662 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:45:16.662 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:45:16.662 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:45:16.662 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T11:45:16.664 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:45:16.664 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:45:16.664 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:45:16.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 10 monclient: get_monmap_and_config 2026-02-17T11:45:16.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 10 monclient: build_initial_monmap 2026-02-17T11:45:16.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 10 monclient: monmap: 2026-02-17T11:45:16.730 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:16.729114+0000 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:16.729114+0000 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:16.731 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 1 Processor -- start 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 1 -- start start 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.728+0000 7f3a61c6f640 10 monclient: init 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-a con 0x7f3a5c0a0370 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:16.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-b con 0x7f3a5c0a0c90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a5c138870 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c0aa990 con 0x7f3a5c138870 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c0a2110 con 0x7f3a5c0a0370 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0a1590 con 0x7f3a5c0a0c90 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a61c6f640 10 monclient(hunting): authenticate will time out at 604.348227s 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52156/0 (socket says 10.20.193.51:52156) 2026-02-17T11:45:16.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 learned_addr learned my addr 10.20.193.51:0/2551712796 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38312/0 (socket says 10.20.193.51:38312) 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0370 auth_method 0 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5bfff640 1 --1- 10.20.193.51:0/2551712796 >> v1:10.20.193.51:6789/0 conn(0x7f3a5c138870 0x7f3a5c13f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34316/0 (socket says 10.20.193.51:34316) 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0c90 auth_method 0 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:16.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.729+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:16.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.731+0000 7f3a5bfff640 1 -- 10.20.193.51:0/2551712796 >> v1:10.20.193.51:6789/0 conn(0x7f3a5c138870 legacy=0x7f3a5c13f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:16.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:16.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:16.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0370 auth_method 0 2026-02-17T11:45:16.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0c90 auth_method 0 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:16.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:16.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:45:16.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:16.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:16.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:16.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:16.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:16.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:45:16.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:16.930+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:45:17.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0c90 auth_method 0 2026-02-17T11:45:17.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0370 auth_method 0 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:45:17.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.331+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:45:17.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347434675 0 0) 0x7f3a50002fe0 con 0x7f3a5c138870 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): my global_id is 4098 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a40003620 con 0x7f3a5c138870 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1513658472 0 0) 0x7f3a40003620 con 0x7f3a5c138870 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c138330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a5c138330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 msgr2=0x7f3a5c0a0750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 --2- 10.20.193.51:0/2551712796 >> v2:10.20.193.51:3300/0 conn(0x7f3a5c0a0370 0x7f3a5c0a0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0a29b0 con 0x7f3a5c138870 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f3a50003700 con 0x7f3a5c138870 2026-02-17T11:45:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: dump: 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:17.737 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 >> v1:10.20.193.51:6789/0 conn(0x7f3a5c138870 legacy=0x7f3a5c13f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a40003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): picked mon.c con 0x7f3a5c0a0c90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a40004250 0x7f3a40004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): picked mon.b con 0x7f3a40004250 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a40004f60 0x7f3a4000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): picked mon.a con 0x7f3a40004f60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0a2110 con 0x7f3a40004f60 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0a1590 con 0x7f3a40004250 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4000c000 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.723+0000 7f3a5a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a40003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0c90 auth_method 0 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a40004f60 0x7f3a4000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): get_auth_request con 0x7f3a40004f60 auth_method 0 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient(hunting): handle_auth_done global_id 4098 payload 293 2026-02-17T11:45:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a40004250 msgr2=0x7f3a40004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a40004250 0x7f3a40004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a40004250 0x7f3a40004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a40004f60 msgr2=0x7f3a4000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a40004f60 0x7f3a4000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 monclient: found mon.c 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a40003620 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a61c6f640 5 monclient: authenticate success, global_id 4098 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a61c6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5affd640 10 monclient: get_auth_request con 0x7f3a40004250 auth_method 0 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.724+0000 7f3a5affd640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a40004250 0x7f3a40004900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5b7fe640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a40003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a40003bd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3a48003b10 tx=0x7f3a4802f860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d635861b4f1c42aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4803d070 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: dump: 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:17.742 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a48038410 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 1 -- 10.20.193.51:0/2551712796 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48003710 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 4 set_mon_vals no callback set 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5a7fc640 10 monclient: dump: 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:17.744 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 10 monclient: shutdown 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 -- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a40003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 --2- 10.20.193.51:0/2551712796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c0a0c90 0x7f3a40003bd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3a48003b10 tx=0x7f3a4802f860 comp rx=0 tx=0).stop 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a5bfff640 1 -- 10.20.193.51:0/2551712796 reap_dead start 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 -- 10.20.193.51:0/2551712796 shutdown_connections 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 -- 10.20.193.51:0/2551712796 >> 10.20.193.51:0/2551712796 conn(0x7f3a5c0a7670 msgr2=0x7f3a5c0a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 -- 10.20.193.51:0/2551712796 shutdown_connections 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.727+0000 7f3a61c6f640 1 -- 10.20.193.51:0/2551712796 wait complete. 2026-02-17T11:45:17.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient: build_initial_monmap 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient: monmap: 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 Processor -- start 2026-02-17T11:45:17.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 -- start start 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient: init 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a5c0a0c90 0x7f3a5c1cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-b con 0x7f3a5c0a0c90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-c con 0x7f3a5c1cfa40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): picked mon.noname-a con 0x7f3a5c1cfe40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0a1070 con 0x7f3a5c1cfe40 2026-02-17T11:45:17.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0a8400 con 0x7f3a5c0a0c90 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c126c10 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a61c6f640 10 monclient(hunting): authenticate will time out at 605.347680s 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38346/0 (socket says 10.20.193.51:38346) 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 -- 10.20.193.51:0/1749589014 learned_addr learned my addr 10.20.193.51:0/1749589014 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): get_auth_request con 0x7f3a5c1cfa40 auth_method 0 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 10 monclient(hunting): get_auth_request con 0x7f3a5c1cfe40 auth_method 0 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 msgr2=0x7f3a5c125020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 msgr2=0x7f3a5c125020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5bfff640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:17.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5b7fe640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a5c0a0c90 0x7f3a5c1cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f3a5c0a0c90 auth_method 0 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient(hunting): handle_auth_done global_id 4100 payload 824 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a5c0a0c90 msgr2=0x7f3a5c1cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a5c0a0c90 0x7f3a5c1cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 msgr2=0x7f3a5c125020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 monclient: found mon.noname-c 2026-02-17T11:45:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.728+0000 7f3a5affd640 1 -- 10.20.193.51:0/1749589014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c128470 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a5affd640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 msgr2=0x7f3a5c124ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a5affd640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0129b0 tx=0x7f3a4c012e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c01c070 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: dump: 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.751 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0153f0 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 5 monclient: authenticate success, global_id 4100 2026-02-17T11:45:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _renew_subs 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c128750 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00f040 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 10 monclient: dump: 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:17.753 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a59ffb640 4 set_mon_vals no callback set 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _renew_subs 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c128a30 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3a4c0157c0 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3a4c01f360 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.731+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c0a33b0 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.732+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3a4c015cc0 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.732+0000 7f3a37fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.732+0000 7f3a37fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:17.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.761+0000 7f3a61c6f640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:45:17.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.762+0000 7f3a61c6f640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:45:17.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.762+0000 7f3a61c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:17.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.762+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3a5c06db60 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.763+0000 7f3a37fff640 1 -- 10.20.193.51:0/1749589014 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3a4c021450 con 0x7f3a5c1cfa40 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.763+0000 7f3a37fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.763+0000 7f3a37fff640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:adjusted tunables profile to default 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 10 monclient: shutdown 2026-02-17T11:45:17.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 msgr2=0x7f3a5c124ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0129b0 tx=0x7f3a4c012e80 comp rx=0 tx=0).stop 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 shutdown_connections 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a5c1cfe40 0x7f3a5c125020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a5c1cfa40 0x7f3a5c124ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 --2- 10.20.193.51:0/1749589014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a5c0a0c90 0x7f3a5c1cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 >> 10.20.193.51:0/1749589014 conn(0x7f3a5c0a7670 msgr2=0x7f3a5c0a5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 shutdown_connections 2026-02-17T11:45:17.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:17.764+0000 7f3a61c6f640 1 -- 10.20.193.51:0/1749589014 wait complete. 2026-02-17T11:45:17.773 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:45:17.774 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:45:17.774 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:17.774 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:45:17.799 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:17.799 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:45:17.863 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-17T11:45:17.863 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:45:17.927 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:17.927 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T11:45:17.952 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:17.952 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T11:45:18.018 DEBUG:teuthology.orchestra.run.trial142:> set -ex 2026-02-17T11:45:18.018 DEBUG:teuthology.orchestra.run.trial142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T11:45:18.084 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new 7ebf244d-48c6-40bb-b862-03bdb5f7e833 0 2026-02-17T11:45:18.087 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.084+0000 7f13ebc10140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:45:18.153 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.148+0000 7f343ffde640 10 monclient: get_monmap_and_config 2026-02-17T11:45:18.153 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.148+0000 7f343ffde640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.148+0000 7f343ffde640 10 monclient: monmap: 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:18.149801+0000 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:18.149801+0000 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:18.154 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 Processor -- start 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 -- start start 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient: init 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f343809c380 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 0x7f343809ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.155 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-b con 0x7f343809fbd0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f343813a750 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343809ac20 con 0x7f343813a750 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3438076490 con 0x7f343809c380 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f343809e130 con 0x7f343809fbd0 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343ffde640 10 monclient(hunting): authenticate will time out at 600.756431s 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343dd53640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f343809c380 0x7f343809f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.142:45220/0 (socket says 10.20.193.142:45220) 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343dd53640 1 -- 10.20.193.142:0/791171507 learned_addr learned my addr 10.20.193.142:0/791171507 (peer_addr_for_me v1:10.20.193.142:0/0) 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 1 --2- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 0x7f343809ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): get_auth_request con 0x7f343809fbd0 auth_method 0 2026-02-17T11:45:18.156 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient(hunting): handle_auth_done global_id 4103 payload 274 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 1 -- 10.20.193.142:0/791171507 >> v1:10.20.193.142:6789/0 conn(0x7f343809c380 legacy=0x7f343809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 1 -- 10.20.193.142:0/791171507 >> v1:10.20.193.51:6789/0 conn(0x7f343813a750 legacy=0x7f343813cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 1 monclient: found mon.noname-b 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.157 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:18.158 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.149+0000 7f343d552640 1 -- 10.20.193.142:0/791171507 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343806e0f0 con 0x7f343809fbd0 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343d552640 1 -- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 msgr2=0x7f343809ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343d552640 1 --2- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 0x7f343809ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098d0 tx=0x7f342c02ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f5573eba957a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 1 -- 10.20.193.142:0/791171507 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c03c070 con 0x7f343809fbd0 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: dump: 2026-02-17T11:45:18.164 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.165 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 1 -- 10.20.193.142:0/791171507 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c02fda0 con 0x7f343809fbd0 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 1 -- 10.20.193.142:0/791171507 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c037660 con 0x7f343809fbd0 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343ffde640 5 monclient: authenticate success, global_id 4103 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343ffde640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343ffde640 4 set_mon_vals no callback set 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.152+0000 7f343cd51640 10 monclient: dump: 2026-02-17T11:45:18.166 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.167 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: shutdown 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 msgr2=0x7f343809ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 --2- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 0x7f343809ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098d0 tx=0x7f342c02ee80 comp rx=0 tx=0).stop 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- 10.20.193.142:0/791171507 shutdown_connections 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 --2- 10.20.193.142:0/791171507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809fbd0 0x7f343809ffe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- 10.20.193.142:0/791171507 >> 10.20.193.142:0/791171507 conn(0x7f34380a30c0 msgr2=0x7f34380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- 10.20.193.142:0/791171507 shutdown_connections 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- 10.20.193.142:0/791171507 wait complete. 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: monmap: 2026-02-17T11:45:18.168 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 Processor -- start 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- start start 2026-02-17T11:45:18.169 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: init 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809c380 0x7f3438099f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-c con 0x7f343809c380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f343809fbd0 0x7f343813e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-a con 0x7f343809fbd0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): picked mon.noname-b con 0x7f343813a750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f343806da70 con 0x7f343809fbd0 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f34380a3e20 con 0x7f343813a750 2026-02-17T11:45:18.170 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3438093280 con 0x7f343809c380 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.153+0000 7f343ffde640 10 monclient(hunting): authenticate will time out at 600.760965s 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40356/0 (socket says 10.20.193.142:40356) 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 -- 10.20.193.142:0/1412651450 learned_addr learned my addr 10.20.193.142:0/1412651450 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809c380 0x7f3438099f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): get_auth_request con 0x7f343813a750 auth_method 0 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.171 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f343809fbd0 0x7f343813e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): get_auth_request con 0x7f343809fbd0 auth_method 0 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): get_auth_request con 0x7f343809c380 auth_method 0 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.172 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343d552640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343dd53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient(hunting): handle_auth_done global_id 4108 payload 824 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 -- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809c380 msgr2=0x7f3438099f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809c380 0x7f3438099f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 -- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f343809fbd0 msgr2=0x7f343813e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f343809fbd0 0x7f343813e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 monclient: found mon.noname-b 2026-02-17T11:45:18.173 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.154+0000 7f343e554640 1 -- 10.20.193.142:0/1412651450 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3438092fa0 con 0x7f343813a750 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343e554640 1 -- 10.20.193.142:0/1412651450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 msgr2=0x7f343813e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343e554640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f343400caf0 tx=0x7f343400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434016020 con 0x7f343813a750 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: dump: 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.174 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 5 monclient: authenticate success, global_id 4108 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3434012420 con 0x7f343813a750 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 10 monclient: _renew_subs 2026-02-17T11:45:18.175 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343809f6b0 con 0x7f343813a750 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434012810 con 0x7f343813a750 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f3427fff640 4 set_mon_vals no callback set 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 10 monclient: dump: 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.176 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 10 monclient: _renew_subs 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34380a1050 con 0x7f343813a750 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f343401b400 con 0x7f343813a750 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.156+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f343401a660 con 0x7f343813a750 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.157+0000 7f343ffde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.177 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.157+0000 7f343ffde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.178 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.157+0000 7f343ffde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.178 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.157+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343813fdc0 con 0x7f343813a750 2026-02-17T11:45:18.178 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.158+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3434020020 con 0x7f343813a750 2026-02-17T11:45:18.178 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.158+0000 7f34267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.178 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.158+0000 7f34267fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:18.193 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.190+0000 7f343ffde640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7ebf244d-48c6-40bb-b862-03bdb5f7e833", "id": 0}] 2026-02-17T11:45:18.193 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.190+0000 7f343ffde640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7ebf244d-48c6-40bb-b862-03bdb5f7e833", "id": 0}] 2026-02-17T11:45:18.193 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.190+0000 7f343ffde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.193 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.190+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ebf244d-48c6-40bb-b862-03bdb5f7e833", "id": 0} v 0) -- 0x7f343809d4d0 con 0x7f343813a750 2026-02-17T11:45:18.202 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.199+0000 7f34267fc640 1 -- 10.20.193.142:0/1412651450 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ebf244d-48c6-40bb-b862-03bdb5f7e833", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f343401b950 con 0x7f343813a750 2026-02-17T11:45:18.202 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.199+0000 7f34267fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7ebf244d-48c6-40bb-b862-03bdb5f7e833", "id": 0}] 2026-02-17T11:45:18.202 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.199+0000 7f34267fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:18.203 INFO:teuthology.orchestra.run.trial142.stdout:0 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 10 monclient: shutdown 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 msgr2=0x7f343813e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f343400caf0 tx=0x7f343400a060 comp rx=0 tx=0).stop 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 shutdown_connections 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f343813a750 0x7f343813e7a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f343809fbd0 0x7f343813e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 --2- 10.20.193.142:0/1412651450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f343809c380 0x7f3438099f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 >> 10.20.193.142:0/1412651450 conn(0x7f34380a30c0 msgr2=0x7f343809e300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.204 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 shutdown_connections 2026-02-17T11:45:18.205 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.200+0000 7f343ffde640 1 -- 10.20.193.142:0/1412651450 wait complete. 2026-02-17T11:45:18.210 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new 259ec14a-3fe1-44a8-b955-749225995616 1 2026-02-17T11:45:18.211 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.207+0000 7f13ebc10140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:45:18.237 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.234+0000 7f13ebc10140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:45:18.271 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.268+0000 7f13ebc10140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 10 monclient: get_monmap_and_config 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 10 monclient: monmap: 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:18.276597+0000 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:18.276597+0000 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.278 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:18.279 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.288 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 1 Processor -- start 2026-02-17T11:45:18.288 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 1 -- start start 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.275+0000 7f62eb990640 10 monclient: init 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f62e409fa10 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409cdc0 0x7f62e409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-b con 0x7f62e409cdc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f62e413b760 0x7f62e413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-a con 0x7f62e413b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e406db00 con 0x7f62e409fa10 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.289 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f62e406e140 con 0x7f62e413b760 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f62e409fdf0 con 0x7f62e409cdc0 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62eb990640 10 monclient(hunting): authenticate will time out at 600.883238s 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f62e413b760 0x7f62e413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f62e413b760 0x7f62e413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.142:33070/0 (socket says 10.20.193.142:33070) 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 -- 10.20.193.142:0/3441834107 learned_addr learned my addr 10.20.193.142:0/3441834107 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): get_auth_request con 0x7f62e413b760 auth_method 0 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.290 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409cdc0 0x7f62e409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): get_auth_request con 0x7f62e409cdc0 auth_method 0 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.291 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient(hunting): handle_auth_done global_id 4110 payload 274 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 -- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409cdc0 msgr2=0x7f62e409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409cdc0 0x7f62e409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 -- 10.20.193.142:0/3441834107 >> v1:10.20.193.51:6789/0 conn(0x7f62e409fa10 legacy=0x7f62e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 monclient: found mon.noname-a 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.276+0000 7f62e9f06640 1 -- 10.20.193.142:0/3441834107 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e409ec70 con 0x7f62e413b760 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62e9f06640 1 -- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e413b760 msgr2=0x7f62e413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62e9f06640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e413b760 0x7f62e413db50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009e50 tx=0x7f62e002f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab84550a4bc77003 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 1 -- 10.20.193.142:0/3441834107 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00373f0 con 0x7f62e413b760 2026-02-17T11:45:18.292 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: dump: 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.293 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 5 monclient: authenticate success, global_id 4110 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 1 -- 10.20.193.142:0/3441834107 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e0037590 con 0x7f62e413b760 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 1 -- 10.20.193.142:0/3441834107 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0037960 con 0x7f62e413b760 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 4 set_mon_vals no callback set 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62d3fff640 10 monclient: dump: 2026-02-17T11:45:18.294 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 10 monclient: shutdown 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.295 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 -- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e413b760 msgr2=0x7f62e413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e413b760 0x7f62e413db50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009e50 tx=0x7f62e002f260 comp rx=0 tx=0).stop 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 -- 10.20.193.142:0/3441834107 shutdown_connections 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e413b760 0x7f62e413db50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 --2- 10.20.193.142:0/3441834107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409cdc0 0x7f62e409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 -- 10.20.193.142:0/3441834107 >> 10.20.193.142:0/3441834107 conn(0x7f62e40a30c0 msgr2=0x7f62e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 -- 10.20.193.142:0/3441834107 shutdown_connections 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.279+0000 7f62eb990640 1 -- 10.20.193.142:0/3441834107 wait complete. 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient: monmap: 2026-02-17T11:45:18.296 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 Processor -- start 2026-02-17T11:45:18.297 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 -- start start 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient: init 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 0x7f62e413af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-a con 0x7f62e409cdc0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-c con 0x7f62e409fa10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): picked mon.noname-b con 0x7f62e413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40a3e20 con 0x7f62e409cdc0 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.298 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40a0560 con 0x7f62e413b760 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f62e40a3fa0 con 0x7f62e409fa10 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62eb990640 10 monclient(hunting): authenticate will time out at 600.887748s 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40370/0 (socket says 10.20.193.142:40370) 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 -- 10.20.193.142:0/2776899599 learned_addr learned my addr 10.20.193.142:0/2776899599 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 10 monclient(hunting): get_auth_request con 0x7f62e413b760 auth_method 0 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.299 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 msgr2=0x7f62e409abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 msgr2=0x7f62e409abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9705640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 0x7f62e413af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9f06640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9705640 10 monclient(hunting): get_auth_request con 0x7f62e409cdc0 auth_method 0 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9705640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9705640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e9705640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e8f04640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.300 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e8f04640 10 monclient(hunting): get_auth_request con 0x7f62e409fa10 auth_method 0 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e8f04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e8f04640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.280+0000 7f62e8f04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient(hunting): handle_auth_done global_id 4113 payload 824 2026-02-17T11:45:18.301 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 msgr2=0x7f62e409a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 msgr2=0x7f62e409a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 msgr2=0x7f62e409a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e8f04640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 msgr2=0x7f62e409abe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 monclient: found mon.noname-a 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.302 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.281+0000 7f62e9705640 1 -- 10.20.193.142:0/2776899599 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e4073ea0 con 0x7f62e409cdc0 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62e9705640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 msgr2=0x7f62e413af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62e9705640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 0x7f62e413af40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c450 tx=0x7f62d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4016020 con 0x7f62e409cdc0 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: dump: 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.303 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4012a40 con 0x7f62e409cdc0 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 5 monclient: authenticate success, global_id 4113 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 10 monclient: _renew_subs 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.304 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e409d7b0 con 0x7f62e409cdc0 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4012e30 con 0x7f62e409cdc0 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d37fe640 4 set_mon_vals no callback set 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 10 monclient: dump: 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.305 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 10 monclient: _renew_subs 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e4097f90 con 0x7f62e409cdc0 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f62d401b790 con 0x7f62e409cdc0 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.283+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f62d401ade0 con 0x7f62e409cdc0 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.284+0000 7f62eb990640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.284+0000 7f62eb990640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.284+0000 7f62eb990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.306 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.284+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e409e830 con 0x7f62e409cdc0 2026-02-17T11:45:18.307 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.285+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f62d4020030 con 0x7f62e409cdc0 2026-02-17T11:45:18.307 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.285+0000 7f62d1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.307 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.285+0000 7f62d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:18.307 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.291+0000 7f13ebc10140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:45:18.320 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.317+0000 7f62eb990640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "259ec14a-3fe1-44a8-b955-749225995616", "id": 1}] 2026-02-17T11:45:18.320 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.317+0000 7f62eb990640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "259ec14a-3fe1-44a8-b955-749225995616", "id": 1}] 2026-02-17T11:45:18.320 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.317+0000 7f62eb990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.321 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.317+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd new", "uuid": "259ec14a-3fe1-44a8-b955-749225995616", "id": 1} v 0) -- 0x7f62e4069830 con 0x7f62e409cdc0 2026-02-17T11:45:18.321 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.318+0000 7f13ebc10140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:45:18.321 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62d1ffb640 1 -- 10.20.193.142:0/2776899599 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "259ec14a-3fe1-44a8-b955-749225995616", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f62d401a3b0 con 0x7f62e409cdc0 2026-02-17T11:45:18.322 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62d1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "259ec14a-3fe1-44a8-b955-749225995616", "id": 1}] 2026-02-17T11:45:18.322 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62d1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:18.322 INFO:teuthology.orchestra.run.trial142.stdout:1 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 10 monclient: shutdown 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 msgr2=0x7f62e413af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 0x7f62e413af40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c450 tx=0x7f62d400c920 comp rx=0 tx=0).stop 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 shutdown_connections 2026-02-17T11:45:18.323 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f62e413b760 0x7f62e409abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.324 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f62e409fa10 0x7f62e409a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.324 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 --2- 10.20.193.142:0/2776899599 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f62e409cdc0 0x7f62e413af40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.324 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 >> 10.20.193.142:0/2776899599 conn(0x7f62e40a30c0 msgr2=0x7f62e4072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.324 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 shutdown_connections 2026-02-17T11:45:18.324 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.319+0000 7f62eb990640 1 -- 10.20.193.142:0/2776899599 wait complete. 2026-02-17T11:45:18.330 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new d8bfdc36-4f2d-4949-aa78-bf7c180cc26f 2 2026-02-17T11:45:18.377 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.374+0000 7f13ebc10140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:45:18.432 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.429+0000 7fa269ba7640 10 monclient: get_monmap_and_config 2026-02-17T11:45:18.432 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.429+0000 7fa269ba7640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.432 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.429+0000 7fa269ba7640 10 monclient: monmap: 2026-02-17T11:45:18.432 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.432 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:18.431094+0000 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:18.431094+0000 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:18.433 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 Processor -- start 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 -- start start 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient: init 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2640a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-b con 0x7fa2640a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa2640a0c90 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa264138a40 0x7fa264140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-a con 0x7fa264138a40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640aa990 con 0x7fa2640a0c90 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa2640a2110 con 0x7fa264138a40 2026-02-17T11:45:18.435 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa2640a1590 con 0x7fa2640a0370 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.430+0000 7fa269ba7640 10 monclient(hunting): authenticate will time out at 601.037947s 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa262ffd640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fa2640a0c90 0x7fa264138330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.142:45224/0 (socket says 10.20.193.142:45224) 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa262ffd640 1 -- 10.20.193.142:0/1670363385 learned_addr learned my addr 10.20.193.142:0/1670363385 (peer_addr_for_me v1:10.20.193.142:0/0) 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 --2- 10.20.193.142:0/1670363385 >> v2:10.20.193.51:3300/0 conn(0x7fa264138a40 0x7fa264140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): get_auth_request con 0x7fa264138a40 auth_method 0 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa2637fe640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2640a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa2637fe640 10 monclient(hunting): get_auth_request con 0x7fa2640a0370 auth_method 0 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa2637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa2637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.436 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa2637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient(hunting): handle_auth_done global_id 4116 payload 274 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 -- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 msgr2=0x7fa2640a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2640a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 -- 10.20.193.142:0/1670363385 >> v1:10.20.193.142:6789/0 conn(0x7fa2640a0c90 legacy=0x7fa264138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 monclient: found mon.noname-a 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:18.437 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.431+0000 7fa263fff640 1 -- 10.20.193.142:0/1670363385 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2640a29b0 con 0x7fa264138a40 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.433+0000 7fa263fff640 1 -- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 msgr2=0x7fa264140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa263fff640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264140590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d90 tx=0x7fa25802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c7c9d5de0b4e6d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 1 -- 10.20.193.142:0/1670363385 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25803c070 con 0x7fa264138a40 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: dump: 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.440 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 1 -- 10.20.193.142:0/1670363385 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258037440 con 0x7fa264138a40 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 5 monclient: authenticate success, global_id 4116 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 1 -- 10.20.193.142:0/1670363385 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258037810 con 0x7fa264138a40 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 4 set_mon_vals no callback set 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa2627fc640 10 monclient: dump: 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.441 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 10 monclient: shutdown 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 -- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 msgr2=0x7fa264140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264140590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d90 tx=0x7fa25802f190 comp rx=0 tx=0).stop 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 -- 10.20.193.142:0/1670363385 shutdown_connections 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264140590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 --2- 10.20.193.142:0/1670363385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2640a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 -- 10.20.193.142:0/1670363385 >> 10.20.193.142:0/1670363385 conn(0x7fa2640a7670 msgr2=0x7fa2640a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 -- 10.20.193.142:0/1670363385 shutdown_connections 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.434+0000 7fa269ba7640 1 -- 10.20.193.142:0/1670363385 wait complete. 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient: build_initial_monmap 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient: monmap: 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.442 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 Processor -- start 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 -- start start 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient: init 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2641cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-c con 0x7fa2640a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-b con 0x7fa2640a0c90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264124c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): picked mon.noname-a con 0x7fa264138a40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640a1070 con 0x7fa264138a40 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640a8400 con 0x7fa2640a0c90 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa264128b40 con 0x7fa2640a0370 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa269ba7640 10 monclient(hunting): authenticate will time out at 601.042649s 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40386/0 (socket says 10.20.193.142:40386) 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 -- 10.20.193.142:0/846221927 learned_addr learned my addr 10.20.193.142:0/846221927 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): get_auth_request con 0x7fa2640a0c90 auth_method 0 2026-02-17T11:45:18.443 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2641cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): get_auth_request con 0x7fa2640a0370 auth_method 0 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa263fff640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264124c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa263fff640 10 monclient(hunting): get_auth_request con 0x7fa264138a40 auth_method 0 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa2637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient(hunting): handle_auth_done global_id 4111 payload 824 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 -- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 msgr2=0x7fa2641cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2641cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 -- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 msgr2=0x7fa264124c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264124c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:18.444 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 monclient: found mon.noname-b 2026-02-17T11:45:18.445 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:18.445 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.445 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.435+0000 7fa262ffd640 1 -- 10.20.193.142:0/846221927 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa264126cf0 con 0x7fa2640a0c90 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa262ffd640 1 -- 10.20.193.142:0/846221927 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 msgr2=0x7fa2641cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa262ffd640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c780 tx=0x7fa25400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254005de0 con 0x7fa2640a0c90 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: dump: 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.446 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: _finish_auth 0 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa254007070 con 0x7fa2640a0c90 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254007440 con 0x7fa2640a0c90 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa261ffb640 4 set_mon_vals no callback set 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 10 monclient: dump: 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 5 monclient: authenticate success, global_id 4111 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _renew_subs 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2641273b0 con 0x7fa2640a0c90 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _renew_subs 2026-02-17T11:45:18.447 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2641282a0 con 0x7fa2640a0c90 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa254007620 con 0x7fa2640a0c90 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa25400aa60 con 0x7fa2640a0c90 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.438+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2640a3400 con 0x7fa2640a0c90 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.439+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa25400acf0 con 0x7fa2640a0c90 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.439+0000 7fa23ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:18.448 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.439+0000 7fa23ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:18.448 INFO:tasks.ceph.mgr.x.trial142.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:45:18.448 INFO:tasks.ceph.mgr.x.trial142.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:45:18.448 INFO:tasks.ceph.mgr.x.trial142.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:45:18.448 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.444+0000 7f13ebc10140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:45:18.473 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.471+0000 7f13ebc10140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:45:18.475 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.473+0000 7fa269ba7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d8bfdc36-4f2d-4949-aa78-bf7c180cc26f", "id": 2}] 2026-02-17T11:45:18.476 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.473+0000 7fa269ba7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d8bfdc36-4f2d-4949-aa78-bf7c180cc26f", "id": 2}] 2026-02-17T11:45:18.476 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.473+0000 7fa269ba7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:18.476 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.473+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8bfdc36-4f2d-4949-aa78-bf7c180cc26f", "id": 2} v 0) -- 0x7fa26406db60 con 0x7fa2640a0c90 2026-02-17T11:45:18.530 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.528+0000 7f13ebc10140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:45:18.574 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.571+0000 7f13ebc10140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:45:18.600 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.597+0000 7f13ebc10140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:45:18.624 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.622+0000 7f13ebc10140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:45:18.650 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.647+0000 7f13ebc10140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:45:18.672 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.670+0000 7f13ebc10140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:45:18.866 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.864+0000 7f13ebc10140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:45:18.913 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.910+0000 7fa23ffff640 1 -- 10.20.193.142:0/846221927 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8bfdc36-4f2d-4949-aa78-bf7c180cc26f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa25400a640 con 0x7fa2640a0c90 2026-02-17T11:45:18.913 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.910+0000 7fa23ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d8bfdc36-4f2d-4949-aa78-bf7c180cc26f", "id": 2}] 2026-02-17T11:45:18.913 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.910+0000 7fa23ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:18.914 INFO:teuthology.orchestra.run.trial142.stdout:2 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 10 monclient: shutdown 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 msgr2=0x7fa2641cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c780 tx=0x7fa25400cc50 comp rx=0 tx=0).stop 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 shutdown_connections 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa264138a40 0x7fa264124c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2640a0c90 0x7fa2641cfa40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.915 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 --2- 10.20.193.142:0/846221927 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa2640a0370 0x7fa2641cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:18.916 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 >> 10.20.193.142:0/846221927 conn(0x7fa2640a7670 msgr2=0x7fa2640a5470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:18.916 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 shutdown_connections 2026-02-17T11:45:18.916 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:18.911+0000 7fa269ba7640 1 -- 10.20.193.142:0/846221927 wait complete. 2026-02-17T11:45:18.921 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.918+0000 7f13ebc10140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:45:18.922 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new 4dd27506-7b96-49d3-affa-5840d62cd49e 3 2026-02-17T11:45:18.944 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.941+0000 7f13ebc10140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:45:18.967 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:18.965+0000 7f13ebc10140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:45:19.008 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 10 monclient: get_monmap_and_config 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 10 monclient: monmap: 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:19.007326+0000 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:19.007326+0000 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:19.009 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:19.010 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 1 Processor -- start 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 1 -- start start 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.006+0000 7fa7ac2d3640 10 monclient: init 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a40a0370 0x7fa7a40a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-b con 0x7fa7a40a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa7a40a0c90 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7a4138a40 0x7fa7a4140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.012 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-a con 0x7fa7a4138a40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7a40aa990 con 0x7fa7a40a0c90 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa7a40a2110 con 0x7fa7a4138a40 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a40a1590 con 0x7fa7a40a0370 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7ac2d3640 10 monclient(hunting): authenticate will time out at 601.614185s 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7a9847640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa7a40a0c90 0x7fa7a4138330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.142:59836/0 (socket says 10.20.193.142:59836) 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7a9847640 1 -- 10.20.193.142:0/3930955591 learned_addr learned my addr 10.20.193.142:0/3930955591 (peer_addr_for_me v1:10.20.193.142:0/0) 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a40a0370 0x7fa7a40a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): get_auth_request con 0x7fa7a40a0370 auth_method 0 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3930955591 >> v2:10.20.193.51:3300/0 conn(0x7fa7a4138a40 0x7fa7a4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): get_auth_request con 0x7fa7a4138a40 auth_method 0 2026-02-17T11:45:19.013 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa048640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient(hunting): handle_auth_done global_id 4122 payload 274 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 -- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a40a0370 msgr2=0x7fa7a40a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a40a0370 0x7fa7a40a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 -- 10.20.193.142:0/3930955591 >> v1:10.20.193.51:6789/0 conn(0x7fa7a40a0c90 legacy=0x7fa7a4138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 monclient: found mon.noname-a 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:19.014 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.007+0000 7fa7aa849640 1 -- 10.20.193.142:0/3930955591 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a40a29b0 con 0x7fa7a4138a40 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7aa849640 1 -- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a4138a40 msgr2=0x7fa7a4140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a4138a40 0x7fa7a4140590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009d90 tx=0x7fa7a002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b540173c306d328 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 1 -- 10.20.193.142:0/3930955591 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a003c070 con 0x7fa7a4138a40 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: dump: 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.018 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 1 -- 10.20.193.142:0/3930955591 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0037440 con 0x7fa7a4138a40 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7ac2d3640 5 monclient: authenticate success, global_id 4122 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7ac2d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 1 -- 10.20.193.142:0/3930955591 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0037810 con 0x7fa7a4138a40 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7ac2d3640 4 set_mon_vals no callback set 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.010+0000 7fa7a9046640 10 monclient: dump: 2026-02-17T11:45:19.019 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 10 monclient: shutdown 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a4138a40 msgr2=0x7fa7a4140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a4138a40 0x7fa7a4140590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009d90 tx=0x7fa7a002f190 comp rx=0 tx=0).stop 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3930955591 shutdown_connections 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a4138a40 0x7fa7a4140590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3930955591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a40a0370 0x7fa7a40a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3930955591 >> 10.20.193.142:0/3930955591 conn(0x7fa7a40a7670 msgr2=0x7fa7a40a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3930955591 shutdown_connections 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3930955591 wait complete. 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 10 monclient: monmap: 2026-02-17T11:45:19.020 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 Processor -- start 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 1 -- start start 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.011+0000 7fa7ac2d3640 10 monclient: init 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a40a0370 0x7fa7a41cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-a con 0x7fa7a40a0370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-b con 0x7fa7a40a0c90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): picked mon.noname-c con 0x7fa7a4138a40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40a1070 con 0x7fa7a40a0370 2026-02-17T11:45:19.021 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40a8400 con 0x7fa7a40a0c90 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a4074990 con 0x7fa7a4138a40 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7ac2d3640 10 monclient(hunting): authenticate will time out at 601.619105s 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40392/0 (socket says 10.20.193.142:40392) 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 -- 10.20.193.142:0/3877219839 learned_addr learned my addr 10.20.193.142:0/3877219839 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): get_auth_request con 0x7fa7a40a0c90 auth_method 0 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa048640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a40a0370 0x7fa7a41cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 10 monclient(hunting): get_auth_request con 0x7fa7a4138a40 auth_method 0 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 msgr2=0x7fa7a4125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:19.022 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 msgr2=0x7fa7a4125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7aa849640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient(hunting): handle_auth_done global_id 4114 payload 824 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 msgr2=0x7fa7a4125160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a40a0370 msgr2=0x7fa7a41cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a40a0370 0x7fa7a41cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 monclient: found mon.noname-b 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.012+0000 7fa7a9847640 1 -- 10.20.193.142:0/3877219839 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a4128e10 con 0x7fa7a40a0c90 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7a9847640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 msgr2=0x7fa7a41cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7a9847640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa79800c750 tx=0x7fa79800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798005de0 con 0x7fa7a40a0c90 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: dump: 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.023 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 5 monclient: authenticate success, global_id 4114 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa798007070 con 0x7fa7a40a0c90 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798007440 con 0x7fa7a40a0c90 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7a8845640 4 set_mon_vals no callback set 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 10 monclient: dump: 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.024 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 10 monclient: _renew_subs 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a4127960 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 10 monclient: _renew_subs 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a406d2d0 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa798007660 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.014+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa79801bb00 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.015+0000 7fa7ac2d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.015+0000 7fa7ac2d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.015+0000 7fa7ac2d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.015+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a40a3400 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.016+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa79801be20 con 0x7fa7a40a0c90 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.016+0000 7fa78affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.025 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.016+0000 7fa78affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:19.026 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.020+0000 7f13ebc10140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:45:19.043 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.041+0000 7f13ebc10140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:45:19.052 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.049+0000 7fa7ac2d3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4dd27506-7b96-49d3-affa-5840d62cd49e", "id": 3}] 2026-02-17T11:45:19.052 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.049+0000 7fa7ac2d3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4dd27506-7b96-49d3-affa-5840d62cd49e", "id": 3}] 2026-02-17T11:45:19.052 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.049+0000 7fa7ac2d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.052 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.049+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4dd27506-7b96-49d3-affa-5840d62cd49e", "id": 3} v 0) -- 0x7fa7a406db60 con 0x7fa7a40a0c90 2026-02-17T11:45:19.096 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.093+0000 7f13ebc10140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:45:19.250 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.247+0000 7fa78affd640 1 -- 10.20.193.142:0/3877219839 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dd27506-7b96-49d3-affa-5840d62cd49e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa79801b890 con 0x7fa7a40a0c90 2026-02-17T11:45:19.250 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.247+0000 7fa78affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4dd27506-7b96-49d3-affa-5840d62cd49e", "id": 3}] 2026-02-17T11:45:19.250 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.247+0000 7fa78affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:19.251 INFO:teuthology.orchestra.run.trial142.stdout:3 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 10 monclient: shutdown 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 msgr2=0x7fa7a41cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa79800c750 tx=0x7fa79800cc20 comp rx=0 tx=0).stop 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 shutdown_connections 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7a4138a40 0x7fa7a4125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7a40a0c90 0x7fa7a41cfa40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.252 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 --2- 10.20.193.142:0/3877219839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7a40a0370 0x7fa7a41cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.253 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 >> 10.20.193.142:0/3877219839 conn(0x7fa7a40a7670 msgr2=0x7fa7a4073e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.253 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 shutdown_connections 2026-02-17T11:45:19.253 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.248+0000 7fa7ac2d3640 1 -- 10.20.193.142:0/3877219839 wait complete. 2026-02-17T11:45:19.258 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3 4 2026-02-17T11:45:19.364 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 10 monclient: get_monmap_and_config 2026-02-17T11:45:19.364 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 10 monclient: monmap: 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:19.362611+0000 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:19.362611+0000 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:19.365 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 1 Processor -- start 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 1 -- start start 2026-02-17T11:45:19.366 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.361+0000 7fe6ba90a640 10 monclient: init 2026-02-17T11:45:19.374 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.374 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2026-02-17T11:45:19.374 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe6b409fa10 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:19.374 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe6b409cdc0 0x7fe6b409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.374 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-a con 0x7fe6b409cdc0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe6b413b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b406db00 con 0x7fe6b409fa10 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b409fdf0 con 0x7fe6b413b760 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b406e140 con 0x7fe6b409cdc0 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6ba90a640 10 monclient(hunting): authenticate will time out at 601.969409s 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b8e80640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fe6b413b760 0x7fe6b413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.142:45236/0 (socket says 10.20.193.142:45236) 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b8e80640 1 -- 10.20.193.142:0/3300441458 learned_addr learned my addr 10.20.193.142:0/3300441458 (peer_addr_for_me v1:10.20.193.142:0/0) 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 1 --2- 10.20.193.142:0/3300441458 >> v2:10.20.193.51:3300/0 conn(0x7fe6b409cdc0 0x7fe6b409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.375 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): get_auth_request con 0x7fe6b409cdc0 auth_method 0 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_done global_id 4125 payload 274 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 1 -- 10.20.193.142:0/3300441458 >> v1:10.20.193.142:6789/0 conn(0x7fe6b413b760 legacy=0x7fe6b413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 1 -- 10.20.193.142:0/3300441458 >> v1:10.20.193.51:6789/0 conn(0x7fe6b409fa10 legacy=0x7fe6b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 1 monclient: found mon.noname-a 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.376 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.362+0000 7fe6b37fe640 1 -- 10.20.193.142:0/3300441458 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b409ec70 con 0x7fe6b409cdc0 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b37fe640 1 -- 10.20.193.142:0/3300441458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409cdc0 msgr2=0x7fe6b409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b37fe640 1 --2- 10.20.193.142:0/3300441458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409cdc0 0x7fe6b409e1d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40098a0 tx=0x7fe6a402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779b71b79e218879 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 1 -- 10.20.193.142:0/3300441458 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a403c070 con 0x7fe6b409cdc0 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: dump: 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.377 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 1 -- 10.20.193.142:0/3300441458 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a402fce0 con 0x7fe6b409cdc0 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 1 -- 10.20.193.142:0/3300441458 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4037660 con 0x7fe6b409cdc0 2026-02-17T11:45:19.378 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6ba90a640 5 monclient: authenticate success, global_id 4125 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6ba90a640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6ba90a640 4 set_mon_vals no callback set 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.365+0000 7fe6b2ffd640 10 monclient: dump: 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.379 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 10 monclient: shutdown 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 -- 10.20.193.142:0/3300441458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409cdc0 msgr2=0x7fe6b409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/3300441458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409cdc0 0x7fe6b409e1d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40098a0 tx=0x7fe6a402ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 -- 10.20.193.142:0/3300441458 shutdown_connections 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/3300441458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409cdc0 0x7fe6b409e1d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 -- 10.20.193.142:0/3300441458 >> 10.20.193.142:0/3300441458 conn(0x7fe6b40a30c0 msgr2=0x7fe6b40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 -- 10.20.193.142:0/3300441458 shutdown_connections 2026-02-17T11:45:19.380 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 1 -- 10.20.193.142:0/3300441458 wait complete. 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.366+0000 7fe6ba90a640 10 monclient: monmap: 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:19.381 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 Processor -- start 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 -- start start 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient: init 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6b409cdc0 0x7fe6b41cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-c con 0x7fe6b409cdc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409fa10 0x7fe6b41d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-a con 0x7fe6b409fa10 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): picked mon.noname-b con 0x7fe6b413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:19.382 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40a3e20 con 0x7fe6b409fa10 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40a0560 con 0x7fe6b413b760 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b40a3fa0 con 0x7fe6b409cdc0 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6ba90a640 10 monclient(hunting): authenticate will time out at 601.974421s 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40394/0 (socket says 10.20.193.142:40394) 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 -- 10.20.193.142:0/1983964351 learned_addr learned my addr 10.20.193.142:0/1983964351 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:19.383 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): get_auth_request con 0x7fe6b413b760 auth_method 0 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409fa10 0x7fe6b41d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): get_auth_request con 0x7fe6b409fa10 auth_method 0 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.384 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b3fff640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6b409cdc0 0x7fe6b41cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 -- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6b409cdc0 msgr2=0x7fe6b41cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6b409cdc0 0x7fe6b41cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 -- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409fa10 msgr2=0x7fe6b41d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409fa10 0x7fe6b41d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 monclient: found mon.noname-b 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.385 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.367+0000 7fe6b8e80640 1 -- 10.20.193.142:0/1983964351 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40a28a0 con 0x7fe6b413b760 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b8e80640 1 -- 10.20.193.142:0/1983964351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 msgr2=0x7fe6b4096350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b8e80640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cb20 tx=0x7fe6a8005c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800adf0 con 0x7fe6b413b760 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 10 monclient: dump: 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.386 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a8012400 con 0x7fe6b413b760 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.369+0000 7fe6ba90a640 5 monclient: authenticate success, global_id 4117 2026-02-17T11:45:19.387 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _renew_subs 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b4097c70 con 0x7fe6b413b760 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80127f0 con 0x7fe6b413b760 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b27fc640 4 set_mon_vals no callback set 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 10 monclient: dump: 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.388 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _renew_subs 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b4099c60 con 0x7fe6b413b760 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe6a8012990 con 0x7fe6b413b760 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe6a801b910 con 0x7fe6b413b760 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.389 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.390 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.370+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b409e880 con 0x7fe6b413b760 2026-02-17T11:45:19.390 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.371+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fe6b40a28a0 con 0x7fe6b413b760 2026-02-17T11:45:19.390 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.371+0000 7fe6b0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.390 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.371+0000 7fe6b0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:19.406 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.403+0000 7fe6ba90a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3", "id": 4}] 2026-02-17T11:45:19.406 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.403+0000 7fe6ba90a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3", "id": 4}] 2026-02-17T11:45:19.406 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.403+0000 7fe6ba90a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.407 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.403+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3", "id": 4} v 0) -- 0x7fe6b40980a0 con 0x7fe6b413b760 2026-02-17T11:45:19.408 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.405+0000 7fe6b0ff9640 1 -- 10.20.193.142:0/1983964351 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe6a8012d80 con 0x7fe6b413b760 2026-02-17T11:45:19.408 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.405+0000 7fe6b0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3", "id": 4}] 2026-02-17T11:45:19.408 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.405+0000 7fe6b0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:19.409 INFO:teuthology.orchestra.run.trial142.stdout:4 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 10 monclient: shutdown 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 msgr2=0x7fe6b4096350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cb20 tx=0x7fe6a8005c20 comp rx=0 tx=0).stop 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 shutdown_connections 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6b413b760 0x7fe6b4096350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6b409fa10 0x7fe6b41d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 --2- 10.20.193.142:0/1983964351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6b409cdc0 0x7fe6b41cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.410 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 >> 10.20.193.142:0/1983964351 conn(0x7fe6b40a30c0 msgr2=0x7fe6b413ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.411 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 shutdown_connections 2026-02-17T11:45:19.411 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.406+0000 7fe6ba90a640 1 -- 10.20.193.142:0/1983964351 wait complete. 2026-02-17T11:45:19.416 DEBUG:teuthology.orchestra.run.trial142:> sudo ceph --cluster ceph osd new 9a395150-9617-43cb-8cf5-42ebb4535a87 5 2026-02-17T11:45:19.482 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.479+0000 7f4c7b987640 10 monclient: get_monmap_and_config 2026-02-17T11:45:19.482 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.479+0000 7f4c7b987640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.482 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.479+0000 7f4c7b987640 10 monclient: monmap: 2026-02-17T11:45:19.482 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.482 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:45:19.480755+0000 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:45:19.480755+0000 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:19.483 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.491 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 Processor -- start 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 -- start start 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient: init 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 0x7f4c740a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-b con 0x7f4c740a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c740a0c90 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4c74138a40 0x7f4c74140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-a con 0x7f4c74138a40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:19.492 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740aa990 con 0x7f4c740a0c90 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740a2110 con 0x7f4c74138a40 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4c740a1590 con 0x7f4c740a0370 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c7b987640 10 monclient(hunting): authenticate will time out at 602.087411s 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c78efb640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f4c740a0c90 0x7f4c74138330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.142:45238/0 (socket says 10.20.193.142:45238) 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c78efb640 1 -- 10.20.193.142:0/1764848400 learned_addr learned my addr 10.20.193.142:0/1764848400 (peer_addr_for_me v1:10.20.193.142:0/0) 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 --2- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 0x7f4c740a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): get_auth_request con 0x7f4c740a0370 auth_method 0 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.493 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c79efd640 1 --2- 10.20.193.142:0/1764848400 >> v2:10.20.193.51:3300/0 conn(0x7f4c74138a40 0x7f4c74140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c79efd640 10 monclient(hunting): get_auth_request con 0x7f4c74138a40 auth_method 0 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c79efd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c79efd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c79efd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient(hunting): handle_auth_done global_id 4127 payload 274 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 -- 10.20.193.142:0/1764848400 >> v2:10.20.193.51:3300/0 conn(0x7f4c74138a40 msgr2=0x7f4c74140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.494 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 --2- 10.20.193.142:0/1764848400 >> v2:10.20.193.51:3300/0 conn(0x7f4c74138a40 0x7f4c74140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 -- 10.20.193.142:0/1764848400 >> v1:10.20.193.142:6789/0 conn(0x7f4c740a0c90 legacy=0x7f4c74138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 monclient: found mon.noname-b 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.480+0000 7f4c796fc640 1 -- 10.20.193.142:0/1764848400 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c740a29b0 con 0x7f4c740a0370 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c796fc640 1 -- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 msgr2=0x7f4c740a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c796fc640 1 --2- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 0x7f4c740a0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c640098a0 tx=0x7f4c6402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e66dc231461cf3a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 1 -- 10.20.193.142:0/1764848400 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6403c070 con 0x7f4c740a0370 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:19.495 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: dump: 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.496 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 5 monclient: authenticate success, global_id 4127 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 1 -- 10.20.193.142:0/1764848400 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6402fc00 con 0x7f4c740a0370 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 1 -- 10.20.193.142:0/1764848400 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64037440 con 0x7f4c740a0370 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 4 set_mon_vals no callback set 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c63fff640 10 monclient: dump: 2026-02-17T11:45:19.497 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 10 monclient: shutdown 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 -- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 msgr2=0x7f4c740a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.498 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 --2- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 0x7f4c740a0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c640098a0 tx=0x7f4c6402ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 -- 10.20.193.142:0/1764848400 shutdown_connections 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 --2- 10.20.193.142:0/1764848400 >> v2:10.20.193.51:3300/0 conn(0x7f4c74138a40 0x7f4c74140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 --2- 10.20.193.142:0/1764848400 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0370 0x7f4c740a0750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.483+0000 7f4c7b987640 1 -- 10.20.193.142:0/1764848400 >> 10.20.193.142:0/1764848400 conn(0x7f4c740a7670 msgr2=0x7f4c740a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 -- 10.20.193.142:0/1764848400 shutdown_connections 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 -- 10.20.193.142:0/1764848400 wait complete. 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient: monmap: 2026-02-17T11:45:19.499 INFO:teuthology.orchestra.run.trial142.stderr:epoch 0 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 0.000000 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:created 0.000000 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 Processor -- start 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 -- start start 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient: init 2026-02-17T11:45:19.500 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-b con 0x7f4c740a0370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0c90 0x7f4c74137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-c con 0x7f4c740a0c90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c74138a40 0x7f4c74137d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.484+0000 7f4c7b987640 10 monclient(hunting): picked mon.noname-a con 0x7f4c74138a40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740a1070 con 0x7f4c74138a40 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740a8400 con 0x7f4c740a0370 2026-02-17T11:45:19.501 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4c74129250 con 0x7f4c740a0c90 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c7b987640 10 monclient(hunting): authenticate will time out at 602.092017s 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.142:40410/0 (socket says 10.20.193.142:40410) 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 -- 10.20.193.142:0/3474954157 learned_addr learned my addr 10.20.193.142:0/3474954157 (peer_addr_for_me v2:10.20.193.142:0/0) 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): get_auth_request con 0x7f4c740a0370 auth_method 0 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.502 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c78efb640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0c90 0x7f4c74137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c79efd640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c74138a40 0x7f4c74137d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c79efd640 10 monclient(hunting): get_auth_request con 0x7f4c74138a40 auth_method 0 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c79efd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c79efd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c79efd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient(hunting): handle_auth_done global_id 4120 payload 824 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 -- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0c90 msgr2=0x7f4c74137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0c90 0x7f4c74137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 -- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c74138a40 msgr2=0x7f4c74137d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c74138a40 0x7f4c74137d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.503 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 monclient: found mon.noname-b 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.485+0000 7f4c796fc640 1 -- 10.20.193.142:0/3474954157 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741cf8b0 con 0x7f4c740a0370 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c796fc640 1 -- 10.20.193.142:0/3474954157 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 msgr2=0x7f4c741cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c796fc640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c64002410 tx=0x7f4c640047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6403c040 con 0x7f4c740a0370 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: dump: 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.504 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.505 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 5 monclient: authenticate success, global_id 4120 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64047070 con 0x7f4c740a0370 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 10 monclient: _renew_subs 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7406d390 con 0x7f4c740a0370 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64040a40 con 0x7f4c740a0370 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c637fe640 4 set_mon_vals no callback set 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 10 monclient: dump: 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:epoch 1 2026-02-17T11:45:19.506 INFO:teuthology.orchestra.run.trial142.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:election_strategy: 1 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 10 monclient: _renew_subs 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c740a1d60 con 0x7f4c740a0370 2026-02-17T11:45:19.507 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4c6403f030 con 0x7f4c740a0370 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.487+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4c64042440 con 0x7f4c740a0370 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.488+0000 7f4c7b987640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.488+0000 7f4c7b987640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.488+0000 7f4c7b987640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.488+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c740a4d80 con 0x7f4c740a0370 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.489+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f4c740a4d80 con 0x7f4c740a0370 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.489+0000 7f4c61ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.508 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.489+0000 7f4c61ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:19.509 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.494+0000 7f13ebc10140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:45:19.519 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.517+0000 7f13ebc10140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:45:19.523 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.521+0000 7f4c7b987640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9a395150-9617-43cb-8cf5-42ebb4535a87", "id": 5}] 2026-02-17T11:45:19.523 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.521+0000 7f4c7b987640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9a395150-9617-43cb-8cf5-42ebb4535a87", "id": 5}] 2026-02-17T11:45:19.524 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.521+0000 7f4c7b987640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:19.524 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.521+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a395150-9617-43cb-8cf5-42ebb4535a87", "id": 5} v 0) -- 0x7f4c74128b60 con 0x7f4c740a0370 2026-02-17T11:45:19.525 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c61ffb640 1 -- 10.20.193.142:0/3474954157 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a395150-9617-43cb-8cf5-42ebb4535a87", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4c74128b60 con 0x7f4c740a0370 2026-02-17T11:45:19.525 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c61ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9a395150-9617-43cb-8cf5-42ebb4535a87", "id": 5}] 2026-02-17T11:45:19.526 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c61ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:19.526 INFO:teuthology.orchestra.run.trial142.stdout:5 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 10 monclient: shutdown 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 msgr2=0x7f4c741cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c64002410 tx=0x7f4c640047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 shutdown_connections 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c74138a40 0x7f4c74137d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c740a0c90 0x7f4c74137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.527 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 --2- 10.20.193.142:0/3474954157 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c740a0370 0x7f4c741cf370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.528 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 >> 10.20.193.142:0/3474954157 conn(0x7f4c740a7670 msgr2=0x7f4c740a5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.528 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 shutdown_connections 2026-02-17T11:45:19.528 INFO:teuthology.orchestra.run.trial142.stderr:2026-02-17T11:45:19.523+0000 7f4c7b987640 1 -- 10.20.193.142:0/3474954157 wait complete. 2026-02-17T11:45:19.533 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:45:19.534 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:45:19.536 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:45:19.536 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:45:19.537 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:45:19.539 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:45:19.539 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:45:19.540 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:45:19.542 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:45:19.542 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T11:45:19.542 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T11:45:19.544 INFO:tasks.ceph.osd.3:Started 2026-02-17T11:45:19.544 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T11:45:19.545 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-17T11:45:19.547 INFO:tasks.ceph.osd.4:Started 2026-02-17T11:45:19.547 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T11:45:19.547 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-17T11:45:19.549 INFO:tasks.ceph.osd.5:Started 2026-02-17T11:45:19.550 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:19.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: get_monmap_and_config 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: monmap: 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:19.618135+0000 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:19.618135+0000 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 Processor -- start 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 -- start start 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: init 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T11:45:19.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f478c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): picked mon.noname-b con 0x7f478c13b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 0x7f478c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): picked mon.noname-c con 0x7f478c13dcb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478c135430 con 0x7f478c0a3bb0 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f478c09a5c0 con 0x7f478c13dcb0 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f478c09b520 con 0x7f478c13b380 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f4792643640 10 monclient(hunting): authenticate will time out at 607.236909s 2026-02-17T11:45:19.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.617+0000 7f478b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38372/0 (socket says 10.20.193.51:38372) 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 -- 10.20.193.51:0/644398558 learned_addr learned my addr 10.20.193.51:0/644398558 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): get_auth_request con 0x7f478c13b380 auth_method 0 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f4790bb9640 1 --2- 10.20.193.51:0/644398558 >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 0x7f478c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient(hunting): handle_auth_done global_id 4142 payload 274 2026-02-17T11:45:19.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 -- 10.20.193.51:0/644398558 >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 msgr2=0x7f478c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 --2- 10.20.193.51:0/644398558 >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 0x7f478c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 -- 10.20.193.51:0/644398558 >> v1:10.20.193.142:6789/0 conn(0x7f478c0a3bb0 legacy=0x7f478c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 monclient: found mon.noname-b 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f478b7fe640 1 -- 10.20.193.51:0/644398558 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c09af60 con 0x7f478c13b380 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f4790bb9640 10 monclient: get_auth_request con 0x7f478c13dcb0 auth_method 0 2026-02-17T11:45:19.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.618+0000 7f4790bb9640 1 --2- 10.20.193.51:0/644398558 >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 0x7f478c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478b7fe640 1 -- 10.20.193.51:0/644398558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 msgr2=0x7f478c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478b7fe640 1 --2- 10.20.193.51:0/644398558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f478c077290 tx=0x7f477c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9320d602d503c854 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 1 -- 10.20.193.51:0/644398558 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c03c070 con 0x7f478c13b380 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: dump: 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:19.633 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 1 -- 10.20.193.51:0/644398558 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c02fd80 con 0x7f478c13b380 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 5 monclient: authenticate success, global_id 4142 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 1 -- 10.20.193.51:0/644398558 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c037660 con 0x7f478c13b380 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 4 set_mon_vals no callback set 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f478affd640 10 monclient: dump: 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.635 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 10 monclient: shutdown 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 1 -- 10.20.193.51:0/644398558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 msgr2=0x7f478c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.620+0000 7f4792643640 1 --2- 10.20.193.51:0/644398558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f478c077290 tx=0x7f477c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:45:19.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 -- 10.20.193.51:0/644398558 shutdown_connections 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 --2- 10.20.193.51:0/644398558 >> v2:10.20.193.142:3300/0 conn(0x7f478c13dcb0 0x7f478c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 --2- 10.20.193.51:0/644398558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c13d770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 -- 10.20.193.51:0/644398558 >> 10.20.193.51:0/644398558 conn(0x7f478c0a30c0 msgr2=0x7f478c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 -- 10.20.193.51:0/644398558 shutdown_connections 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 -- 10.20.193.51:0/644398558 wait complete. 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 10 monclient: build_initial_monmap 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 10 monclient: monmap: 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:19.637 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 Processor -- start 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 1 -- start start 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.621+0000 7f4792643640 10 monclient: init 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f478c0a3bb0 0x7f478c1cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): picked mon.noname-a con 0x7f478c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): picked mon.noname-c con 0x7f478c13b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 0x7f478c1cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): picked mon.noname-b con 0x7f478c13dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f478c135040 con 0x7f478c0a3bb0 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f478c074ac0 con 0x7f478c13dcb0 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f478c1351c0 con 0x7f478c13b380 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:19.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4792643640 10 monclient(hunting): authenticate will time out at 607.241259s 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f478c0a3bb0 0x7f478c1cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38382/0 (socket says 10.20.193.51:38382) 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 -- 10.20.193.51:0/2709218550 learned_addr learned my addr 10.20.193.51:0/2709218550 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): get_auth_request con 0x7f478c13b380 auth_method 0 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): get_auth_request con 0x7f478c0a3bb0 auth_method 0 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:19.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient(hunting): handle_auth_done global_id 4145 payload 824 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4790bb9640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 0x7f478c1cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:19.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 -- 10.20.193.51:0/2709218550 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 msgr2=0x7f478c1cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 0x7f478c1cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 -- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f478c0a3bb0 msgr2=0x7f478c1cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f478c0a3bb0 0x7f478c1cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f478b7fe640 1 -- 10.20.193.51:0/2709218550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c1cc820 con 0x7f478c13b380 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4790bb9640 10 monclient: get_auth_request con 0x7f478c13dcb0 auth_method 0 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.622+0000 7f4790bb9640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 0x7f478c1cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f478b7fe640 1 -- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 msgr2=0x7f478c131da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f478b7fe640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f477c002410 tx=0x7f477c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c046020 con 0x7f478c13b380 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: dump: 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c042640 con 0x7f478c13b380 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 5 monclient: authenticate success, global_id 4145 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 10 monclient: _renew_subs 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c12b820 con 0x7f478c13b380 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c03c040 con 0x7f478c13b380 2026-02-17T11:45:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 10 monclient: dump: 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:19.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f478a7fc640 4 set_mon_vals no callback set 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 10 monclient: _renew_subs 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c139960 con 0x7f478c13b380 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f477c03f030 con 0x7f478c13b380 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.624+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f477c006750 con 0x7f478c13b380 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.625+0000 7f4792643640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.625+0000 7f4792643640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.625+0000 7f4792643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.625+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c09d560 con 0x7f478c13b380 2026-02-17T11:45:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.626+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f477c050070 con 0x7f478c13b380 2026-02-17T11:45:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.626+0000 7f4788ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.626+0000 7f4788ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:19.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4792643640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4792643640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4792643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f478c1392a0 con 0x7f478c13b380 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4788ff9640 1 -- 10.20.193.51:0/2709218550 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7f478c1cc820 con 0x7f478c13b380 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4788ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.653+0000 7f4788ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:19.656 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:19.657 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":8,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:19.523218+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 10 monclient: shutdown 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 msgr2=0x7f478c131da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f477c002410 tx=0x7f477c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 shutdown_connections 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f478c13dcb0 0x7f478c1cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f478c13b380 0x7f478c131da0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 --2- 10.20.193.51:0/2709218550 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f478c0a3bb0 0x7f478c1cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 >> 10.20.193.51:0/2709218550 conn(0x7f478c0a30c0 msgr2=0x7f478c09c700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 shutdown_connections 2026-02-17T11:45:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:19.654+0000 7f4792643640 1 -- 10.20.193.51:0/2709218550 wait complete. 2026-02-17T11:45:19.663 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:45:19.663 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:45:19.868 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:19.865+0000 7f13ebc10140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:45:20.267 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:20.329 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 10 monclient: get_monmap_and_config 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 10 monclient: build_initial_monmap 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 10 monclient: monmap: 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:45:20.326452+0000 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:45:20.326452+0000 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.330 INFO:teuthology.misc.health.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 1 Processor -- start 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 1 -- start start 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.325+0000 7f135079e640 10 monclient: init 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-17T11:45:20.331 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f13480a34b0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f13480a1d40 0x7f134813af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): picked mon.noname-c con 0x7f13480a1d40 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f134809fb10 0x7f134813d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): picked mon.noname-a con 0x7f134809fb10 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13480a29c0 con 0x7f13480a34b0 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f13480a3890 con 0x7f134809fb10 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f13480a11e0 con 0x7f13480a1d40 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f135079e640 10 monclient(hunting): authenticate will time out at 607.945208s 2026-02-17T11:45:20.332 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134e513640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f13480a34b0 0x7f13480a1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34348/0 (socket says 10.20.193.51:34348) 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134e513640 1 -- 10.20.193.51:0/2090399417 learned_addr learned my addr 10.20.193.51:0/2090399417 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 --2- 10.20.193.51:0/2090399417 >> v2:10.20.193.51:3300/0 conn(0x7f134809fb10 0x7f134813d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): get_auth_request con 0x7f134809fb10 auth_method 0 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134dd12640 1 --2- 10.20.193.51:0/2090399417 >> v2:10.20.193.142:3300/0 conn(0x7f13480a1d40 0x7f134813af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient(hunting): handle_auth_done global_id 4161 payload 274 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 -- 10.20.193.51:0/2090399417 >> v2:10.20.193.142:3300/0 conn(0x7f13480a1d40 msgr2=0x7f134813af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:20.333 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 --2- 10.20.193.51:0/2090399417 >> v2:10.20.193.142:3300/0 conn(0x7f13480a1d40 0x7f134813af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 -- 10.20.193.51:0/2090399417 >> v1:10.20.193.51:6789/0 conn(0x7f13480a34b0 legacy=0x7f13480a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient: _finish_hunting 0 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 monclient: found mon.noname-a 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.334 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.326+0000 7f134ed14640 1 -- 10.20.193.51:0/2090399417 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480a0490 con 0x7f134809fb10 2026-02-17T11:45:20.344 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.328+0000 7f134ed14640 1 -- 10.20.193.51:0/2090399417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f134809fb10 msgr2=0x7f134813d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.328+0000 7f134ed14640 1 --2- 10.20.193.51:0/2090399417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f134809fb10 0x7f134813d460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f134806f200 tx=0x7f134402f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334da1b80e329f1c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 1 -- 10.20.193.51:0/2090399417 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134403c070 con 0x7f134809fb10 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: dump: 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.345 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: _finish_auth 0 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: _check_auth_tickets 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 1 -- 10.20.193.51:0/2090399417 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1344037640 con 0x7f134809fb10 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 5 monclient: authenticate success, global_id 4161 2026-02-17T11:45:20.346 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 1 -- 10.20.193.51:0/2090399417 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344037a10 con 0x7f134809fb10 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 4 set_mon_vals no callback set 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f134d511640 10 monclient: dump: 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:20.347 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 10 monclient: shutdown 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 -- 10.20.193.51:0/2090399417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f134809fb10 msgr2=0x7f134813d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:20.348 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 --2- 10.20.193.51:0/2090399417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f134809fb10 0x7f134813d460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f134806f200 tx=0x7f134402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 -- 10.20.193.51:0/2090399417 shutdown_connections 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 --2- 10.20.193.51:0/2090399417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f134809fb10 0x7f134813d460 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 --2- 10.20.193.51:0/2090399417 >> v2:10.20.193.142:3300/0 conn(0x7f13480a1d40 0x7f134813af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 -- 10.20.193.51:0/2090399417 >> 10.20.193.51:0/2090399417 conn(0x7f13480a6cc0 msgr2=0x7f13480a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 -- 10.20.193.51:0/2090399417 shutdown_connections 2026-02-17T11:45:20.349 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.329+0000 7f135079e640 1 -- 10.20.193.51:0/2090399417 wait complete. 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient: build_initial_monmap 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient: monmap: 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:created 0.000000 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:20.350 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 Processor -- start 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 -- start start 2026-02-17T11:45:20.351 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient: init 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 0x7f13481356a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): picked mon.noname-c con 0x7f134809fb10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f13480a1d40 0x7f1348135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): picked mon.noname-b con 0x7f13480a1d40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:20.352 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): picked mon.noname-a con 0x7f13480a34b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f134813d9a0 con 0x7f13480a34b0 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13480a0eb0 con 0x7f13480a1d40 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:20.353 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f134813db20 con 0x7f134809fb10 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f135079e640 10 monclient(hunting): authenticate will time out at 607.949634s 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52272/0 (socket says 10.20.193.51:52272) 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 0x7f13481356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:20.354 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 -- 10.20.193.51:0/1055682709 learned_addr learned my addr 10.20.193.51:0/1055682709 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): get_auth_request con 0x7f13480a34b0 auth_method 0 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): get_auth_request con 0x7f134809fb10 auth_method 0 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:20.355 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:20.356 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134dd12640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f13480a1d40 0x7f1348135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134dd12640 10 monclient(hunting): get_auth_request con 0x7f13480a1d40 auth_method 0 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134dd12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134dd12640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134dd12640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient(hunting): handle_auth_done global_id 4164 payload 824 2026-02-17T11:45:20.357 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 -- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 msgr2=0x7f13481356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 0x7f13481356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 -- 10.20.193.51:0/1055682709 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f13480a1d40 msgr2=0x7f1348135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f13480a1d40 0x7f1348135be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient: _finish_hunting 0 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 monclient: found mon.noname-a 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.358 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134ed14640 1 -- 10.20.193.51:0/1055682709 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134813cdb0 con 0x7f13480a34b0 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.330+0000 7f134e513640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 0x7f13481356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f134ed14640 1 -- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 msgr2=0x7f134811c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f134ed14640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f134402f6d0 tx=0x7f1344004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344047020 con 0x7f13480a34b0 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:20.359 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: dump: 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:20.360 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: _finish_auth 0 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1344035880 con 0x7f13480a34b0 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134403c040 con 0x7f13480a34b0 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 10 monclient: dump: 2026-02-17T11:45:20.361 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f134cd10640 4 set_mon_vals no callback set 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 5 monclient: authenticate success, global_id 4164 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _renew_subs 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134811edf0 con 0x7f13480a34b0 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _renew_subs 2026-02-17T11:45:20.362 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1348120030 con 0x7f13480a34b0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13480a1630 con 0x7f13480a34b0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.333+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 2) ==== 49971+0+0 (secure 0 0 0) 0x7f1344035cb0 con 0x7f13480a34b0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.334+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1344077100 con 0x7f13480a34b0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.335+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f1344051070 con 0x7f13480a34b0 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.335+0000 7f132effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:20.363 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.335+0000 7f132effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f134806d060 con 0x7f13480a34b0 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f132effd640 1 -- 10.20.193.51:0/1055682709 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7f134813cdb0 con 0x7f13480a34b0 2026-02-17T11:45:20.364 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f132effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:20.365 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f132effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:20.365 INFO:teuthology.misc.health.trial051.stdout: 2026-02-17T11:45:20.365 INFO:teuthology.misc.health.trial051.stdout:{"epoch":8,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:19.523218+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 10 monclient: shutdown 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 msgr2=0x7f134811c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f134402f6d0 tx=0x7f1344004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 shutdown_connections 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f13480a34b0 0x7f134811c8f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f13480a1d40 0x7f1348135be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 --2- 10.20.193.51:0/1055682709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f134809fb10 0x7f13481356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 >> 10.20.193.51:0/1055682709 conn(0x7f13480a6cc0 msgr2=0x7f13480a40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 shutdown_connections 2026-02-17T11:45:20.366 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:20.362+0000 7f135079e640 1 -- 10.20.193.51:0/1055682709 wait complete. 2026-02-17T11:45:20.370 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-17T11:45:20.890 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:20.887+0000 7f13085e5640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T11:45:20.890 INFO:tasks.ceph.mgr.x.trial142.stderr:2026-02-17T11:45:20.887+0000 7f13085e5640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T11:45:20.974 INFO:tasks.ceph.osd.1.trial051.stderr:2026-02-17T11:45:20.972+0000 7f6c43734780 -1 Falling back to public interface 2026-02-17T11:45:21.179 INFO:tasks.ceph.osd.0.trial051.stderr:2026-02-17T11:45:21.177+0000 7fcbb41f9780 -1 Falling back to public interface 2026-02-17T11:45:21.208 INFO:tasks.ceph.osd.2.trial051.stderr:2026-02-17T11:45:21.206+0000 7f004743f780 -1 Falling back to public interface 2026-02-17T11:45:21.231 INFO:tasks.ceph.osd.3.trial142.stderr:2026-02-17T11:45:21.228+0000 7f5d3e221780 -1 Falling back to public interface 2026-02-17T11:45:21.235 INFO:tasks.ceph.osd.4.trial142.stderr:2026-02-17T11:45:21.232+0000 7fd5ca20d780 -1 Falling back to public interface 2026-02-17T11:45:21.255 INFO:tasks.ceph.osd.5.trial142.stderr:2026-02-17T11:45:21.252+0000 7f50584fe780 -1 Falling back to public interface 2026-02-17T11:45:24.748 INFO:tasks.ceph.osd.1.trial051.stderr:2026-02-17T11:45:24.746+0000 7f6c43734780 -1 osd.1 0 log_to_monitors true 2026-02-17T11:45:24.930 INFO:tasks.ceph.osd.0.trial051.stderr:2026-02-17T11:45:24.928+0000 7fcbb41f9780 -1 osd.0 0 log_to_monitors true 2026-02-17T11:45:24.982 INFO:tasks.ceph.osd.3.trial142.stderr:2026-02-17T11:45:24.979+0000 7f5d3e221780 -1 osd.3 0 log_to_monitors true 2026-02-17T11:45:25.233 INFO:tasks.ceph.osd.2.trial051.stderr:2026-02-17T11:45:25.231+0000 7f004743f780 -1 osd.2 0 log_to_monitors true 2026-02-17T11:45:25.250 INFO:tasks.ceph.osd.4.trial142.stderr:2026-02-17T11:45:25.248+0000 7fd5ca20d780 -1 osd.4 0 log_to_monitors true 2026-02-17T11:45:25.292 INFO:tasks.ceph.osd.5.trial142.stderr:2026-02-17T11:45:25.290+0000 7f50584fe780 -1 osd.5 0 log_to_monitors true 2026-02-17T11:45:26.204 INFO:tasks.ceph.osd.1.trial051.stderr:2026-02-17T11:45:26.202+0000 7f6c3f6c1640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:45:26.214 INFO:tasks.ceph.osd.1.trial051.stderr:2026-02-17T11:45:26.212+0000 7f6c374e3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:26.946 INFO:tasks.ceph.osd.2.trial051.stderr:2026-02-17T11:45:26.944+0000 7f00433ce640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:45:26.946 INFO:tasks.ceph.osd.0.trial051.stderr:2026-02-17T11:45:26.945+0000 7fcbb0188640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:45:26.947 INFO:tasks.ceph.osd.5.trial142.stderr:2026-02-17T11:45:26.945+0000 7f505448b640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T11:45:26.948 INFO:tasks.ceph.osd.2.trial051.stderr:2026-02-17T11:45:26.946+0000 7f003f1f8640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:26.948 INFO:tasks.ceph.osd.3.trial142.stderr:2026-02-17T11:45:26.946+0000 7f5d3a1ae640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T11:45:26.949 INFO:tasks.ceph.osd.0.trial051.stderr:2026-02-17T11:45:26.947+0000 7fcbabfb2640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:26.949 INFO:tasks.ceph.osd.5.trial142.stderr:2026-02-17T11:45:26.947+0000 7f50502b5640 -1 osd.5 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:26.950 INFO:tasks.ceph.osd.3.trial142.stderr:2026-02-17T11:45:26.948+0000 7f5d35fd8640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:26.975 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:27.046 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 10 monclient: get_monmap_and_config 2026-02-17T11:45:27.046 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 10 monclient: build_initial_monmap 2026-02-17T11:45:27.046 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 10 monclient: monmap: 2026-02-17T11:45:27.046 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:27.046 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:45:27.035274+0000 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:45:27.035274+0000 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.047 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 1 Processor -- start 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 1 -- start start 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.034+0000 7f4acfa7c640 10 monclient: init 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4ac80a34b0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 0x7f4ac813af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ac80a1d40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 0x7f4ac813d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ac809fb10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac80a29c0 con 0x7f4ac80a34b0 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:27.048 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac80a3890 con 0x7f4ac80a1d40 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac80a11e0 con 0x7f4ac809fb10 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acfa7c640 10 monclient(hunting): authenticate will time out at 614.654139s 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acd7f1640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f4ac80a34b0 0x7f4ac80a1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54520/0 (socket says 10.20.193.51:54520) 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acd7f1640 1 -- 10.20.193.51:0/1118046561 learned_addr learned my addr 10.20.193.51:0/1118046561 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 1 --2- 10.20.193.51:0/1118046561 >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 0x7f4ac813af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 --2- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 0x7f4ac813d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): get_auth_request con 0x7f4ac809fb10 auth_method 0 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:27.049 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): get_auth_request con 0x7f4ac80a1d40 auth_method 0 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient(hunting): handle_auth_done global_id 4181 payload 274 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 -- 10.20.193.51:0/1118046561 >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 msgr2=0x7f4ac813af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:27.050 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 --2- 10.20.193.51:0/1118046561 >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 0x7f4ac813af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 -- 10.20.193.51:0/1118046561 >> v1:10.20.193.51:6789/0 conn(0x7f4ac80a34b0 legacy=0x7f4ac80a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient: _finish_hunting 0 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 monclient: found mon.noname-b 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4acdff2640 1 -- 10.20.193.51:0/1118046561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac80a0490 con 0x7f4ac809fb10 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.035+0000 7f4accff0640 1 --2- 10.20.193.51:0/1118046561 >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 0x7f4ac813af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acdff2640 1 -- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 msgr2=0x7f4ac813d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acdff2640 1 --2- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 0x7f4ac813d460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac402f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3630923c85179ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 1 -- 10.20.193.51:0/1118046561 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403c070 con 0x7f4ac809fb10 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:27.051 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: dump: 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.052 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 1 -- 10.20.193.51:0/1118046561 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4037440 con 0x7f4ac809fb10 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acfa7c640 5 monclient: authenticate success, global_id 4181 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acfa7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4ab7fff640 1 -- 10.20.193.51:0/1118046561 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4037810 con 0x7f4ac809fb10 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acfa7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.037+0000 7f4acfa7c640 4 set_mon_vals no callback set 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4ab7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4ab7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:27.053 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4ab7fff640 10 monclient: dump: 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 10 monclient: shutdown 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:27.054 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 -- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 msgr2=0x7f4ac813d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 0x7f4ac813d460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac402f150 comp rx=0 tx=0).stop 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 -- 10.20.193.51:0/1118046561 shutdown_connections 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/1118046561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac809fb10 0x7f4ac813d460 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/1118046561 >> v2:10.20.193.51:3300/0 conn(0x7f4ac80a1d40 0x7f4ac813af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 -- 10.20.193.51:0/1118046561 >> 10.20.193.51:0/1118046561 conn(0x7f4ac80a6cc0 msgr2=0x7f4ac80a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 -- 10.20.193.51:0/1118046561 shutdown_connections 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 1 -- 10.20.193.51:0/1118046561 wait complete. 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 10 monclient: build_initial_monmap 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.038+0000 7f4acfa7c640 10 monclient: monmap: 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:27.055 INFO:teuthology.misc.health.trial051.stderr:created 0.000000 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 Processor -- start 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 -- start start 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient: init 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ac809fb10 0x7f4ac8135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.056 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ac809fb10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ac80a1d40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 0x7f4ac811e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): picked mon.noname-c con 0x7f4ac80a34b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac813d9a0 con 0x7f4ac80a1d40 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80a0eb0 con 0x7f4ac809fb10 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac813db20 con 0x7f4ac80a34b0 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:27.057 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acfa7c640 10 monclient(hunting): authenticate will time out at 614.658441s 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32808/0 (socket says 10.20.193.51:32808) 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 0x7f4ac811e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 -- 10.20.193.51:0/3573877978 learned_addr learned my addr 10.20.193.51:0/3573877978 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): get_auth_request con 0x7f4ac80a1d40 auth_method 0 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): get_auth_request con 0x7f4ac80a34b0 auth_method 0 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:27.058 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acd7f1640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ac809fb10 0x7f4ac8135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acd7f1640 10 monclient(hunting): get_auth_request con 0x7f4ac809fb10 auth_method 0 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acd7f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acd7f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acd7f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient(hunting): handle_auth_done global_id 4188 payload 824 2026-02-17T11:45:27.059 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 -- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 msgr2=0x7f4ac811e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 0x7f4ac811e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 -- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ac809fb10 msgr2=0x7f4ac8135e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ac809fb10 0x7f4ac8135e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 monclient: found mon.noname-a 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4accff0640 1 -- 10.20.193.51:0/3573877978 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac8122530 con 0x7f4ac80a1d40 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.039+0000 7f4acdff2640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 0x7f4ac811e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4accff0640 1 -- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 msgr2=0x7f4ac81363a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4accff0640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebe0 tx=0x7f4abc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc017070 con 0x7f4ac80a1d40 2026-02-17T11:45:27.060 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: dump: 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:27.061 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc00cdf0 con 0x7f4ac80a1d40 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 5 monclient: authenticate success, global_id 4188 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 10 monclient: _renew_subs 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac8122810 con 0x7f4ac80a1d40 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc013690 con 0x7f4ac80a1d40 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:27.062 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab77fe640 4 set_mon_vals no callback set 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4ab5ffb640 10 monclient: dump: 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 10 monclient: _renew_subs 2026-02-17T11:45:27.063 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.041+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac8120e00 con 0x7f4ac80a1d40 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 4) ==== 50204+0+0 (secure 0 0 0) 0x7f4abc024060 con 0x7f4ac80a1d40 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acfa7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acfa7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acfa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac80a60c0 con 0x7f4ac80a1d40 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4ab5ffb640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 0x7f4a98040140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2203+0+0 (secure 0 0 0) 0x7f4abc051b20 con 0x7f4ac80a1d40 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acd7f1640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 0x7f4a98040140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:27.064 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.042+0000 7f4acd7f1640 10 monclient: get_auth_request con 0x7f4a9803dc80 auth_method 0 2026-02-17T11:45:27.065 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.045+0000 7f4acd7f1640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 0x7f4a98040140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8120120 tx=0x7f4ab8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:27.065 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.045+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4ac80a60c0 con 0x7f4ac80a1d40 2026-02-17T11:45:27.065 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.045+0000 7f4ab5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:27.066 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.045+0000 7f4ab5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:27.129 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4acfa7c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4acfa7c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4acfa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ac80a1630 con 0x7f4ac80a1d40 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4ab5ffb640 1 -- 10.20.193.51:0/3573877978 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6103 (secure 0 0 0) 0x7f4abc0407f0 con 0x7f4ac80a1d40 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4ab5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:27.130 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.127+0000 7f4ab5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:27.131 INFO:teuthology.misc.health.trial051.stdout: 2026-02-17T11:45:27.131 INFO:teuthology.misc.health.trial051.stdout:{"epoch":11,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:26.927207+0000","last_up_change":"2026-02-17T11:45:26.927207+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 msgr2=0x7f4a98040140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 0x7f4a98040140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8120120 tx=0x7f4ab8009040 comp rx=0 tx=0).stop 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 10 monclient: shutdown 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 msgr2=0x7f4ac81363a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:27.132 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebe0 tx=0x7f4abc00c520 comp rx=0 tx=0).stop 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 shutdown_connections 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4a9803dc80 0x7f4a98040140 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ac80a34b0 0x7f4ac811e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ac80a1d40 0x7f4ac81363a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 --2- 10.20.193.51:0/3573877978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ac809fb10 0x7f4ac8135e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 >> 10.20.193.51:0/3573877978 conn(0x7f4ac80a6cc0 msgr2=0x7f4ac80701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 shutdown_connections 2026-02-17T11:45:27.133 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:27.128+0000 7f4acfa7c640 1 -- 10.20.193.51:0/3573877978 wait complete. 2026-02-17T11:45:27.137 DEBUG:teuthology.misc:1 of 6 OSDs are up 2026-02-17T11:45:27.212 INFO:tasks.ceph.osd.4.trial142.stderr:2026-02-17T11:45:27.209+0000 7fd5c5a80640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T11:45:27.221 INFO:tasks.ceph.osd.4.trial142.stderr:2026-02-17T11:45:27.219+0000 7fd5bd8a2640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:33.743 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:33.807 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: get_monmap_and_config 2026-02-17T11:45:33.807 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: build_initial_monmap 2026-02-17T11:45:33.807 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: monmap: 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:45:33.804243+0000 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:45:33.804243+0000 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:33.808 INFO:teuthology.misc.health.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 Processor -- start 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 -- start start 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: init 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdee009cb40 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee013d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-b con 0x7fdee00a15c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdee013d540 0x7fdee013f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.809 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-a con 0x7fdee013d540 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee009b330 con 0x7fdee009cb40 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00a2750 con 0x7fdee013d540 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdee009b050 con 0x7fdee00a15c0 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.803+0000 7fdee832c640 10 monclient(hunting): authenticate will time out at 621.422993s 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee013d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdee013d540 0x7fdee013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee60a1640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fdee009cb40 0x7fdee009cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54534/0 (socket says 10.20.193.51:54534) 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee60a1640 1 -- 10.20.193.51:0/2356030392 learned_addr learned my addr 10.20.193.51:0/2356030392 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): get_auth_request con 0x7fdee00a15c0 auth_method 0 2026-02-17T11:45:33.810 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): get_auth_request con 0x7fdee013d540 auth_method 0 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.811 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient(hunting): handle_auth_done global_id 4190 payload 274 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 -- 10.20.193.51:0/2356030392 >> v2:10.20.193.51:3300/0 conn(0x7fdee013d540 msgr2=0x7fdee013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 --2- 10.20.193.51:0/2356030392 >> v2:10.20.193.51:3300/0 conn(0x7fdee013d540 0x7fdee013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 -- 10.20.193.51:0/2356030392 >> v1:10.20.193.51:6789/0 conn(0x7fdee009cb40 legacy=0x7fdee009cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 monclient: found mon.noname-b 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.812 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.804+0000 7fdee58a0640 1 -- 10.20.193.51:0/2356030392 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee009b610 con 0x7fdee00a15c0 2026-02-17T11:45:33.818 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee58a0640 1 -- 10.20.193.51:0/2356030392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 msgr2=0x7fdee013d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee58a0640 1 --2- 10.20.193.51:0/2356030392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee013d000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fded40098a0 tx=0x7fded402ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b48599eb0c64854a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 1 -- 10.20.193.51:0/2356030392 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded403c070 con 0x7fdee00a15c0 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: dump: 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.819 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: _finish_auth 0 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: _check_auth_tickets 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 1 -- 10.20.193.51:0/2356030392 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded402fc90 con 0x7fdee00a15c0 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee832c640 5 monclient: authenticate success, global_id 4190 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee832c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 1 -- 10.20.193.51:0/2356030392 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4037660 con 0x7fdee00a15c0 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee832c640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:33.820 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee832c640 4 set_mon_vals no callback set 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.806+0000 7fdee509f640 10 monclient: dump: 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.821 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 10 monclient: shutdown 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- 10.20.193.51:0/2356030392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 msgr2=0x7fdee013d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 --2- 10.20.193.51:0/2356030392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee013d000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fded40098a0 tx=0x7fded402ee10 comp rx=0 tx=0).stop 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- 10.20.193.51:0/2356030392 shutdown_connections 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 --2- 10.20.193.51:0/2356030392 >> v2:10.20.193.51:3300/0 conn(0x7fdee013d540 0x7fdee013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 --2- 10.20.193.51:0/2356030392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee013d000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- 10.20.193.51:0/2356030392 >> 10.20.193.51:0/2356030392 conn(0x7fdee00a68e0 msgr2=0x7fdee00a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- 10.20.193.51:0/2356030392 shutdown_connections 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- 10.20.193.51:0/2356030392 wait complete. 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 10 monclient: build_initial_monmap 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 10 monclient: monmap: 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:epoch 0 2026-02-17T11:45:33.822 INFO:teuthology.misc.health.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:created 0.000000 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 Processor -- start 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 1 -- start start 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.807+0000 7fdee832c640 10 monclient: init 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:33.823 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 0x7fdee01cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-b con 0x7fdee009cb40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-c con 0x7fdee00a15c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdee013d540 0x7fdee01cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): picked mon.noname-a con 0x7fdee013d540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0074580 con 0x7fdee013d540 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00a19d0 con 0x7fdee009cb40 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdee0074700 con 0x7fdee00a15c0 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:33.824 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee832c640 10 monclient(hunting): authenticate will time out at 621.427212s 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49532/0 (socket says 10.20.193.51:49532) 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 -- 10.20.193.51:0/1602471181 learned_addr learned my addr 10.20.193.51:0/1602471181 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): get_auth_request con 0x7fdee00a15c0 auth_method 0 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdee013d540 0x7fdee01cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): get_auth_request con 0x7fdee013d540 auth_method 0 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.825 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee68a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee60a1640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 0x7fdee01cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient(hunting): handle_auth_done global_id 4193 payload 824 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 -- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 msgr2=0x7fdee01cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 0x7fdee01cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 -- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdee013d540 msgr2=0x7fdee01cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdee013d540 0x7fdee01cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 monclient: found mon.noname-c 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:33.826 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee58a0640 1 -- 10.20.193.51:0/1602471181 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee009d8f0 con 0x7fdee00a15c0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee60a1640 10 monclient: get_auth_request con 0x7fdee009cb40 auth_method 0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.808+0000 7fdee60a1640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 0x7fdee01cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee58a0640 1 -- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 msgr2=0x7fdee0133f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee58a0640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fded4002410 tx=0x7fded40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded403c040 con 0x7fdee00a15c0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: dump: 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:33.827 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded4047070 con 0x7fdee00a15c0 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:33.828 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4040a40 con 0x7fdee00a15c0 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee489e640 4 set_mon_vals no callback set 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdec6ffd640 10 monclient: dump: 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:epoch 1 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.829 INFO:teuthology.misc.health.trial051.stderr: 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 5 monclient: authenticate success, global_id 4193 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 10 monclient: _renew_subs 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee013d110 con 0x7fdee00a15c0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 10 monclient: _renew_subs 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.810+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee013acf0 con 0x7fdee00a15c0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee832c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee832c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee832c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fded403f030 con 0x7fdee00a15c0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee009cf20 con 0x7fdee00a15c0 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdec6ffd640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 0x7fdeb0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.830 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 3989+0+0 (secure 0 0 0) 0x7fded4077590 con 0x7fdee00a15c0 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee60a1640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 0x7fdeb0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.811+0000 7fdee60a1640 10 monclient: get_auth_request con 0x7fdeb003dd60 auth_method 0 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.814+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdee009b330 con 0x7fdee00a15c0 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.814+0000 7fdec6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.814+0000 7fdec6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:33.831 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.814+0000 7fdee60a1640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 0x7fdeb0040220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fded00052b0 tx=0x7fded0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:33.899 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdee832c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdee832c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdee832c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdee006d510 con 0x7fdee00a15c0 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdec6ffd640 1 -- 10.20.193.51:0/1602471181 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10509 (secure 0 0 0) 0x7fded40762a0 con 0x7fdee00a15c0 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdec6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:33.900 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.897+0000 7fdec6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:33.901 INFO:teuthology.misc.health.trial051.stdout: 2026-02-17T11:45:33.901 INFO:teuthology.misc.health.trial051.stdout:{"epoch":16,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:32.597230+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:33.902 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 msgr2=0x7fdeb0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.902 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 0x7fdeb0040220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fded00052b0 tx=0x7fded0009040 comp rx=0 tx=0).stop 2026-02-17T11:45:33.902 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 10 monclient: shutdown 2026-02-17T11:45:33.902 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:33.902 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 msgr2=0x7fdee0133f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.898+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fded4002410 tx=0x7fded40047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 shutdown_connections 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdeb003dd60 0x7fdeb0040220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdee013d540 0x7fdee01cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdee00a15c0 0x7fdee0133f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 --2- 10.20.193.51:0/1602471181 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdee009cb40 0x7fdee01cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 >> 10.20.193.51:0/1602471181 conn(0x7fdee00a68e0 msgr2=0x7fdee0137ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 shutdown_connections 2026-02-17T11:45:33.903 INFO:teuthology.misc.health.trial051.stderr:2026-02-17T11:45:33.899+0000 7fdee832c640 1 -- 10.20.193.51:0/1602471181 wait complete. 2026-02-17T11:45:33.907 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-17T11:45:33.908 INFO:tasks.ceph:Creating RBD pool 2026-02-17T11:45:33.908 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T11:45:33.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: get_monmap_and_config 2026-02-17T11:45:33.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: build_initial_monmap 2026-02-17T11:45:33.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: monmap: 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:33.974115+0000 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:33.974115+0000 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:33.978 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 Processor -- start 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 -- start start 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: init 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f80e00a0370 0x7f80e00a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-c con 0x7f80e00a0370 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f80e00a0c90 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80e0138a40 0x7f80e0140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-a con 0x7f80e0138a40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e00aa990 con 0x7f80e00a0c90 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f80e00a2110 con 0x7f80e0138a40 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f80e00a1590 con 0x7f80e00a0370 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.973+0000 7f80e89e6640 10 monclient(hunting): authenticate will time out at 621.592918s 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80e0138a40 0x7f80e0140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80e0138a40 0x7f80e0140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32838/0 (socket says 10.20.193.51:32838) 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3889182051 learned_addr learned my addr 10.20.193.51:0/3889182051 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:33.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): get_auth_request con 0x7f80e0138a40 auth_method 0 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e675b640 1 --2- 10.20.193.51:0/3889182051 >> v2:10.20.193.142:3300/0 conn(0x7f80e00a0370 0x7f80e00a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e675b640 10 monclient(hunting): get_auth_request con 0x7f80e00a0370 auth_method 0 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e675b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e675b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e675b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_done global_id 4203 payload 274 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3889182051 >> v2:10.20.193.142:3300/0 conn(0x7f80e00a0370 msgr2=0x7f80e00a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 --2- 10.20.193.51:0/3889182051 >> v2:10.20.193.142:3300/0 conn(0x7f80e00a0370 0x7f80e00a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3889182051 >> v1:10.20.193.142:6789/0 conn(0x7f80e00a0c90 legacy=0x7f80e0138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient: _finish_hunting 0 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 monclient: found mon.noname-a 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:33.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.974+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3889182051 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e00a29b0 con 0x7f80e0138a40 2026-02-17T11:45:33.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3889182051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e0138a40 msgr2=0x7f80e0140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:33.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e6f5c640 1 --2- 10.20.193.51:0/3889182051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e0138a40 0x7f80e0140590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80e006f100 tx=0x7f80d402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6007a8cbb11608 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:33.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 1 -- 10.20.193.51:0/3889182051 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d402fe60 con 0x7f80e0138a40 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: dump: 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: _finish_auth 0 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: _check_auth_tickets 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 1 -- 10.20.193.51:0/3889182051 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d40373f0 con 0x7f80e0138a40 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e89e6640 5 monclient: authenticate success, global_id 4203 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e89e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:33.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 1 -- 10.20.193.51:0/3889182051 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d40377c0 con 0x7f80e0138a40 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e89e6640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e89e6640 4 set_mon_vals no callback set 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.976+0000 7f80e5759640 10 monclient: dump: 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 10 monclient: shutdown 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- 10.20.193.51:0/3889182051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e0138a40 msgr2=0x7f80e0140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3889182051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e0138a40 0x7f80e0140590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80e006f100 tx=0x7f80d402f230 comp rx=0 tx=0).stop 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- 10.20.193.51:0/3889182051 shutdown_connections 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3889182051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e0138a40 0x7f80e0140590 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3889182051 >> v2:10.20.193.142:3300/0 conn(0x7f80e00a0370 0x7f80e00a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- 10.20.193.51:0/3889182051 >> 10.20.193.51:0/3889182051 conn(0x7f80e00a7670 msgr2=0x7f80e00a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:33.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- 10.20.193.51:0/3889182051 shutdown_connections 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- 10.20.193.51:0/3889182051 wait complete. 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 10 monclient: build_initial_monmap 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 10 monclient: monmap: 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:33.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 Processor -- start 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 1 -- start start 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.977+0000 7f80e89e6640 10 monclient: init 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80e00a0370 0x7f80e01cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-b con 0x7f80e00a0370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-a con 0x7f80e00a0c90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 0x7f80e0124af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): picked mon.noname-c con 0x7f80e0138a40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:33.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00a8400 con 0x7f80e00a0c90 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00a10a0 con 0x7f80e00a0370 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00a8580 con 0x7f80e0138a40 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e89e6640 10 monclient(hunting): authenticate will time out at 621.597188s 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 0x7f80e0124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 0x7f80e0124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49536/0 (socket says 10.20.193.51:49536) 2026-02-17T11:45:33.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 1 -- 10.20.193.51:0/3551360896 learned_addr learned my addr 10.20.193.51:0/3551360896 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): get_auth_request con 0x7f80e0138a40 auth_method 0 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32854/0 (socket says 10.20.193.51:32854) 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): get_auth_request con 0x7f80e00a0c90 auth_method 0 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e6f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient(hunting): handle_auth_done global_id 4206 payload 824 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 msgr2=0x7f80e0124af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 0x7f80e0124af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80e00a0370 msgr2=0x7f80e01cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80e00a0370 0x7f80e01cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient: _finish_hunting 0 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 monclient: found mon.noname-a 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:33.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.978+0000 7f80e5f5a640 1 -- 10.20.193.51:0/3551360896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01272f0 con 0x7f80e00a0c90 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e5f5a640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 msgr2=0x7f80e01cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e5f5a640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c450 tx=0x7f80cc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc016020 con 0x7f80e00a0c90 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: dump: 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:33.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc012a40 con 0x7f80e00a0c90 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc012e30 con 0x7f80e00a0c90 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:34.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e4f58640 4 set_mon_vals no callback set 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80caffd640 10 monclient: dump: 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 5 monclient: authenticate success, global_id 4206 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 10 monclient: _renew_subs 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e0128a80 con 0x7f80e00a0c90 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 10 monclient: _renew_subs 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.980+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e0074890 con 0x7f80e00a0c90 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e89e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e89e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e89e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f80cc01b400 con 0x7f80e00a0c90 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e00a0a80 con 0x7f80e00a0c90 2026-02-17T11:45:34.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80caffd640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3989+0+0 (secure 0 0 0) 0x7f80cc052370 con 0x7f80e00a0c90 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e675b640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.981+0000 7f80e675b640 10 monclient: get_auth_request con 0x7f80b003dd10 auth_method 0 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80e675b640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f80d8006fd0 tx=0x7f80d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80e675b640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 msgr2=0x7f80b00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80e675b640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 msgr2=0x7f80b00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80e675b640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f80d8006fd0 tx=0x7f80d8008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80e675b640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f80d8006fd0 tx=0x7f80d8008040 comp rx=0 tx=0).stop 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 msgr2=0x7f80b00401d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:34.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80caffd640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f80e00a0a80 con 0x7f80e00a0c90 2026-02-17T11:45:34.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:34.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:33.984+0000 7f80caffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.068+0000 7f80e89e6640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:45:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.068+0000 7f80e89e6640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:45:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.068+0000 7f80e89e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.068+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f80e00a3320 con 0x7f80e00a0c90 2026-02-17T11:45:34.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.736+0000 7f80caffd640 1 -- 10.20.193.51:0/3551360896 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (secure 0 0 0) 0x7f80cc020030 con 0x7f80e00a0c90 2026-02-17T11:45:34.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.736+0000 7f80caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:45:34.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.736+0000 7f80caffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T11:45:34.739 INFO:teuthology.orchestra.run.trial051.stderr:pool 'rbd' created 2026-02-17T11:45:34.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 10 monclient: shutdown 2026-02-17T11:45:34.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 msgr2=0x7f80e01cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c450 tx=0x7f80cc00c920 comp rx=0 tx=0).stop 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 shutdown_connections 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80b003dd10 0x7f80b00401d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80e0138a40 0x7f80e0124af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80e00a0c90 0x7f80e01cfc20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 --2- 10.20.193.51:0/3551360896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80e00a0370 0x7f80e01cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 >> 10.20.193.51:0/3551360896 conn(0x7f80e00a7670 msgr2=0x7f80e0073dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 shutdown_connections 2026-02-17T11:45:34.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.738+0000 7f80e89e6640 1 -- 10.20.193.51:0/3551360896 wait complete. 2026-02-17T11:45:34.749 DEBUG:teuthology.orchestra.run.trial051:> rbd --cluster ceph pool init rbd 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: get_monmap_and_config 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: build_initial_monmap 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: monmap: 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:34.780145+0000 2026-02-17T11:45:34.781 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:34.780145+0000 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:34.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 Processor -- start 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 -- start start 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: init 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: _reopen_session rank -1 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 --2- >> v2:10.20.193.142:3300/0 conn(0x563ad7c94640 0x563ad7c89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-c con 0x563ad7c94640 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-b con 0x563ad7c8a6e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-c-legacy con 0x563ad7d265b0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x563ad7adcd20 con 0x563ad7d265b0 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x563ad7b09c50 con 0x563ad7c94640 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x563ad7b5e310 con 0x563ad7c8a6e0 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): _renew_subs 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.779+0000 7fef2d7570c0 10 monclient(hunting): authenticate will time out at 622.398986s 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49540/0 (socket says 10.20.193.51:49540) 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 -- 10.20.193.51:0/249489219 learned_addr learned my addr 10.20.193.51:0/249489219 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): get_auth_request con 0x563ad7c8a6e0 auth_method 0 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef27fff640 1 --2- 10.20.193.51:0/249489219 >> v2:10.20.193.142:3300/0 conn(0x563ad7c94640 0x563ad7c89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef27fff640 10 monclient(hunting): get_auth_request con 0x563ad7c94640 auth_method 0 2026-02-17T11:45:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient(hunting): handle_auth_done global_id 4199 payload 274 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 -- 10.20.193.51:0/249489219 >> v2:10.20.193.142:3300/0 conn(0x563ad7c94640 msgr2=0x563ad7c89880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 --2- 10.20.193.51:0/249489219 >> v2:10.20.193.142:3300/0 conn(0x563ad7c94640 0x563ad7c89880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 -- 10.20.193.51:0/249489219 >> v1:10.20.193.142:6789/0 conn(0x563ad7d265b0 legacy=0x563ad7d26a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 monclient: found mon.noname-b 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.780+0000 7fef277fe640 1 -- 10.20.193.51:0/249489219 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad7b25f40 con 0x563ad7c8a6e0 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef277fe640 1 -- 10.20.193.51:0/249489219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 msgr2=0x563ad7c89dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef277fe640 1 --2- 10.20.193.51:0/249489219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00a5a0 tx=0x7fef1c0584c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=724145c26d926f2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 1 -- 10.20.193.51:0/249489219 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c06d070 con 0x563ad7c8a6e0 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: dump: 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.795 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 1 -- 10.20.193.51:0/249489219 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c060bb0 con 0x563ad7c8a6e0 2026-02-17T11:45:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 1 -- 10.20.193.51:0/249489219 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c068440 con 0x563ad7c8a6e0 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 5 monclient: authenticate success, global_id 4199 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 10 monclient: get_monmap_and_config success 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 4 set_mon_vals no callback set 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef26ffd640 10 monclient: dump: 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.797 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 10 monclient: shutdown 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 -- 10.20.193.51:0/249489219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 msgr2=0x563ad7c89dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/249489219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00a5a0 tx=0x7fef1c0584c0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 -- 10.20.193.51:0/249489219 shutdown_connections 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/249489219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7c8a6e0 0x563ad7c89dc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/249489219 >> v2:10.20.193.142:3300/0 conn(0x563ad7c94640 0x563ad7c89880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 -- 10.20.193.51:0/249489219 >> 10.20.193.51:0/249489219 conn(0x563ad7c72940 msgr2=0x563ad7c72d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 -- 10.20.193.51:0/249489219 shutdown_connections 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.783+0000 7fef2d7570c0 1 -- 10.20.193.51:0/249489219 wait complete. 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient: build_initial_monmap 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient: monmap: 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.799 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 Processor -- start 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 -- start start 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient: init 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient: _reopen_session rank -1 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x563ad7c90160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-a con 0x563ad7c8a6e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x563ad7c906a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-b con 0x563ad7c94640 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): picked mon.noname-c con 0x563ad7d265b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x563ad7af8e50 con 0x563ad7c8a6e0 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x563ad7b5a240 con 0x563ad7c94640 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x563ad7d10370 con 0x563ad7d265b0 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): _renew_subs 2026-02-17T11:45:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d7570c0 10 monclient(hunting): authenticate will time out at 622.403607s 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x563ad7c90160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49546/0 (socket says 10.20.193.51:49546) 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x563ad7c90160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32868/0 (socket says 10.20.193.51:32868) 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 learned_addr learned my addr 10.20.193.51:0/419771982 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): get_auth_request con 0x563ad7d265b0 auth_method 0 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): get_auth_request con 0x563ad7c8a6e0 auth_method 0 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef277fe640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x563ad7c906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef277fe640 10 monclient(hunting): get_auth_request con 0x563ad7c94640 auth_method 0 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_done global_id 4202 payload 824 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 msgr2=0x563ad7c906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x563ad7c906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 msgr2=0x563ad7c90160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x563ad7c90160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient: _finish_hunting 0 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 monclient: found mon.noname-c 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad7d11be0 con 0x563ad7d265b0 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 msgr2=0x563ad7c90be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 msgr2=0x563ad7c90be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fef20003210 tx=0x7fef2000b580 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:34.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.784+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient: get_auth_request con 0x563ad7d265b0 auth_method 0 2026-02-17T11:45:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 0 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:45:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 msgr2=0x563ad7c90be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x563ad7d265b0 0x563ad7c90be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x7fef0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): picked mon.noname-a con 0x563ad7c8a6e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x7fef0c006890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): picked mon.noname-b con 0x563ad7c94640 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 0x7fef0c009780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): picked mon.noname-c con 0x7fef0c0072f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c00a280 con 0x563ad7c8a6e0 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c00a400 con 0x563ad7c94640 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fef0c00a600 con 0x7fef0c0072f0 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef17fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x7fef0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): get_auth_request con 0x563ad7c8a6e0 auth_method 0 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 0x7fef0c009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): get_auth_request con 0x7fef0c0072f0 auth_method 0 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient(hunting): handle_auth_done global_id 4202 payload 293 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef277fe640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x7fef0c006890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 msgr2=0x7fef0c006890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x7fef0c006890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 msgr2=0x7fef0c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x7fef0c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient: _finish_hunting 0 2026-02-17T11:45:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 monclient: found mon.noname-c 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c00a8c0 con 0x7fef0c0072f0 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef27fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x563ad7c8a6e0 0x7fef0c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef277fe640 10 monclient: get_auth_request con 0x563ad7c94640 auth_method 0 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.985+0000 7fef277fe640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x563ad7c94640 0x7fef0c006890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 msgr2=0x7fef0c009780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef2d4a6640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 0x7fef0c009780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef20003260 tx=0x7fef20006ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:34.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20011580 con 0x7fef0c0072f0 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: dump: 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200119b0 con 0x7fef0c0072f0 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.987+0000 7fef17fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20011d60 con 0x7fef0c0072f0 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 5 monclient: authenticate success, global_id 4202 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 10 monclient: _renew_subs 2026-02-17T11:45:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ad7d117c0 con 0x7fef0c0072f0 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef17fff640 10 monclient: dump: 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:35.001 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef267fc640 4 set_mon_vals no callback set 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 10 monclient: _renew_subs 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x563ad7c97ee0 con 0x7fef0c0072f0 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.988+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fef20024450 con 0x7fef0c0072f0 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef17fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x563ad7d265b0 0x7fef0c046be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4331+0+0 (secure 0 0 0) 0x7fef20051020 con 0x7fef0c0072f0 2026-02-17T11:45:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef2d7570c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef2d7570c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef2d7570c0 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x563ad7d253b0 con 0x7fef0c0072f0 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef27fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x563ad7d265b0 0x7fef0c046be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.989+0000 7fef27fff640 10 monclient: get_auth_request con 0x563ad7d265b0 auth_method 0 2026-02-17T11:45:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:34.992+0000 7fef27fff640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x563ad7d265b0 0x7fef0c046be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef180099a0 tx=0x7fef18005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:35.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (secure 0 0 0) 0x563ad7d11be0 con 0x7fef0c0072f0 2026-02-17T11:45:35.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef2d7570c0 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef1c060bb0 con 0x7fef0c0072f0 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fef20012760 con 0x7fef0c0072f0 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef267fc640 10 monclient: _renew_subs 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef267fc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef267fc640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=18}) -- 0x7fef04002ae0 con 0x7fef0c0072f0 2026-02-17T11:45:35.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 8 ==== osd_map(18..18 src has 1..18) ==== 658+0+0 (secure 0 0 0) 0x7fef20022350 con 0x7fef0c0072f0 2026-02-17T11:45:35.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x563ad7c90b20 0x563ad7d35da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:35.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x563ad7d362e0 con 0x563ad7c90b20 2026-02-17T11:45:35.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.739+0000 7fef277fe640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x563ad7c90b20 0x563ad7d35da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:35.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.740+0000 7fef277fe640 10 monclient: get_auth_request con 0x563ad7c90b20 auth_method 0 2026-02-17T11:45:35.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.744+0000 7fef277fe640 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x563ad7c90b20 0x563ad7d35da0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:35.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.746+0000 7fef277fe640 1 -- 10.20.193.51:0/419771982 <== osd.5 v2:10.20.193.142:6818/1680143311 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fef1c070040 con 0x563ad7c90b20 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.747+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x563ad7d8aa90 con 0x563ad7c90b20 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.747+0000 7fef277fe640 1 -- 10.20.193.51:0/419771982 <== osd.5 v2:10.20.193.142:6818/1680143311 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c070040 con 0x563ad7c90b20 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.747+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x563ad7d89b70 con 0x563ad7c90b20 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.748+0000 7fef277fe640 1 -- 10.20.193.51:0/419771982 <== osd.5 v2:10.20.193.142:6818/1680143311 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c070040 con 0x563ad7c90b20 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.748+0000 7fef25ffb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:35.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:35.748+0000 7fef25ffb640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fef08001f00 con 0x7fef0c0072f0 2026-02-17T11:45:36.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (secure 0 0 0) 0x7fef2004b020 con 0x7fef0c0072f0 2026-02-17T11:45:36.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef17fff640 10 monclient: _renew_subs 2026-02-17T11:45:36.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef17fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:36.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=19}) -- 0x7fef0c04a880 con 0x7fef0c0072f0 2026-02-17T11:45:36.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 10 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (secure 0 0 0) 0x7fef2000f860 con 0x7fef0c0072f0 2026-02-17T11:45:36.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.743+0000 7fef267fc640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7fef04005790 con 0x563ad7c90b20 2026-02-17T11:45:36.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.745+0000 7fef277fe640 1 -- 10.20.193.51:0/419771982 <== osd.5 v2:10.20.193.142:6818/1680143311 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fef1c070040 con 0x563ad7c90b20 2026-02-17T11:45:36.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.745+0000 7fef25ffb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:36.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:36.745+0000 7fef25ffb640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7fef08003350 con 0x7fef0c0072f0 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (secure 0 0 0) 0x7fef20023cd0 con 0x7fef0c0072f0 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef17fff640 10 monclient: _renew_subs 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef17fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=20}) -- 0x7fef0c04ab00 con 0x7fef0c0072f0 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef17fff640 1 -- 10.20.193.51:0/419771982 <== mon.2 v2:10.20.193.51:3301/0 12 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (secure 0 0 0) 0x7fef2000fa60 con 0x7fef0c0072f0 2026-02-17T11:45:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.744+0000 7fef267fc640 1 -- 10.20.193.51:0/419771982 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7fef04005b30 con 0x563ad7c90b20 2026-02-17T11:45:37.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.747+0000 7fef277fe640 1 -- 10.20.193.51:0/419771982 <== osd.5 v2:10.20.193.142:6818/1680143311 5 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c070040 con 0x563ad7c90b20 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x563ad7c90b20 msgr2=0x563ad7d35da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x563ad7c90b20 0x563ad7d35da0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x563ad7d265b0 msgr2=0x7fef0c046be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x563ad7d265b0 0x7fef0c046be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef180099a0 tx=0x7fef18005b80 comp rx=0 tx=0).stop 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 10 monclient: shutdown 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 msgr2=0x7fef0c009780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 --2- 10.20.193.51:0/419771982 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fef0c0072f0 0x7fef0c009780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef20003260 tx=0x7fef20006ae0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d4a6640 1 -- 10.20.193.51:0/419771982 reap_dead start 2026-02-17T11:45:37.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 shutdown_connections 2026-02-17T11:45:37.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 >> 10.20.193.51:0/419771982 conn(0x563ad7c72940 msgr2=0x563ad7c96bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:37.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 shutdown_connections 2026-02-17T11:45:37.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.748+0000 7fef2d7570c0 1 -- 10.20.193.51:0/419771982 wait complete. 2026-02-17T11:45:37.754 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:45:37.755 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:45:37.755 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:45:37.755 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:45:37.755 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:45:37.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: get_monmap_and_config 2026-02-17T11:45:37.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: build_initial_monmap 2026-02-17T11:45:37.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: monmap: 2026-02-17T11:45:37.865 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:37.861220+0000 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:37.861220+0000 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:37.866 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 1 Processor -- start 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 1 -- start start 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: init 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.860+0000 7f0dff591640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0df8138490 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-b con 0x7f0df80a3f80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 0x7f0df813fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-a con 0x7f0df813da10 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df80a4c10 con 0x7f0df8138490 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0df80707b0 con 0x7f0df813da10 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0df809caa0 con 0x7f0df80a3f80 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dff591640 10 monclient(hunting): authenticate will time out at 625.480060s 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 0x7f0df813fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58880/0 (socket says 10.20.193.51:58880) 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 0x7f0df813fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52450/0 (socket says 10.20.193.51:52450) 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/1982789762 learned_addr learned my addr 10.20.193.51:0/1982789762 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): get_auth_request con 0x7f0df80a3f80 auth_method 0 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): get_auth_request con 0x7f0df813da10 auth_method 0 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:37.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfed90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_done global_id 4205 payload 274 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/1982789762 >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 msgr2=0x7f0df813fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 --2- 10.20.193.51:0/1982789762 >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 0x7f0df813fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/1982789762 >> v1:10.20.193.142:6789/0 conn(0x7f0df8138490 legacy=0x7f0df8138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:37.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:37.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 monclient: found mon.noname-b 2026-02-17T11:45:37.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:37.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.861+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/1982789762 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df80a4360 con 0x7f0df80a3f80 2026-02-17T11:45:37.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/1982789762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 msgr2=0x7f0df813d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:37.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfdd8e640 1 --2- 10.20.193.51:0/1982789762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009970 tx=0x7f0de402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd7371f416c7476 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:37.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 1 -- 10.20.193.51:0/1982789762 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de403c070 con 0x7f0df80a3f80 2026-02-17T11:45:37.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:37.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: dump: 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:37.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: _finish_auth 0 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: _check_auth_tickets 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 1 -- 10.20.193.51:0/1982789762 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de402fcd0 con 0x7f0df80a3f80 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dff591640 5 monclient: authenticate success, global_id 4205 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 1 -- 10.20.193.51:0/1982789762 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037660 con 0x7f0df80a3f80 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dff591640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dff591640 4 set_mon_vals no callback set 2026-02-17T11:45:37.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.863+0000 7f0dfd58d640 10 monclient: dump: 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:37.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 10 monclient: shutdown 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- 10.20.193.51:0/1982789762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 msgr2=0x7f0df813d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 --2- 10.20.193.51:0/1982789762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009970 tx=0x7f0de402ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- 10.20.193.51:0/1982789762 shutdown_connections 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 --2- 10.20.193.51:0/1982789762 >> v2:10.20.193.51:3300/0 conn(0x7f0df813da10 0x7f0df813fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 --2- 10.20.193.51:0/1982789762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df80a3f80 0x7f0df813d4d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- 10.20.193.51:0/1982789762 >> 10.20.193.51:0/1982789762 conn(0x7f0df80a8570 msgr2=0x7f0df80a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- 10.20.193.51:0/1982789762 shutdown_connections 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- 10.20.193.51:0/1982789762 wait complete. 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 10 monclient: build_initial_monmap 2026-02-17T11:45:37.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 10 monclient: monmap: 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 Processor -- start 2026-02-17T11:45:37.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 1 -- start start 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.864+0000 7f0dff591640 10 monclient: init 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 0x7f0df81cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-a con 0x7f0df80a3f80 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 0x7f0df81377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-c con 0x7f0df8138490 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0df813da10 0x7f0df813a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): picked mon.noname-b con 0x7f0df813da10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0df806ee50 con 0x7f0df80a3f80 2026-02-17T11:45:37.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0df806fe80 con 0x7f0df813da10 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0df8138f80 con 0x7f0df8138490 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dff591640 10 monclient(hunting): authenticate will time out at 625.484307s 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 0x7f0df81cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 0x7f0df81377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 0x7f0df81cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52458/0 (socket says 10.20.193.51:52458) 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 1 -- 10.20.193.51:0/2272016173 learned_addr learned my addr 10.20.193.51:0/2272016173 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): get_auth_request con 0x7f0df8138490 auth_method 0 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:37.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): get_auth_request con 0x7f0df80a3f80 auth_method 0 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfe58f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient(hunting): handle_auth_done global_id 4208 payload 824 2026-02-17T11:45:37.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0df813da10 msgr2=0x7f0df813a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0df813da10 0x7f0df813a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 msgr2=0x7f0df81cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 0x7f0df81cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 monclient: found mon.noname-c 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.865+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/2272016173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df8123ea0 con 0x7f0df8138490 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dfdd8e640 1 -- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 msgr2=0x7f0df81377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dfdd8e640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 0x7f0df81377b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0df8070160 tx=0x7f0de40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de403c040 con 0x7f0df8138490 2026-02-17T11:45:37.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: dump: 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:37.888 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4004030 con 0x7f0df8138490 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 5 monclient: authenticate success, global_id 4208 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 10 monclient: _renew_subs 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df81cf4e0 con 0x7f0df8138490 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4004440 con 0x7f0df8138490 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:37.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0de2ffd640 10 monclient: dump: 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dfcd8c640 4 set_mon_vals no callback set 2026-02-17T11:45:37.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 10 monclient: _renew_subs 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.867+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df80a7a40 con 0x7f0df8138490 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dff591640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dff591640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dff591640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df809f6e0 con 0x7f0df8138490 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0de4053060 con 0x7f0df8138490 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0de2ffd640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 0x7f0dc80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f0de4077700 con 0x7f0df8138490 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dfe58f640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 0x7f0dc80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:37.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.868+0000 7f0dfe58f640 10 monclient: get_auth_request con 0x7f0dc803dd10 auth_method 0 2026-02-17T11:45:37.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.871+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0de40045e0 con 0x7f0df8138490 2026-02-17T11:45:37.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.871+0000 7f0de2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:37.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.871+0000 7f0de2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:37.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.871+0000 7f0dfe58f640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 0x7f0dc80401d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0df00052b0 tx=0x7f0df0003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:37.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.974+0000 7f0dff591640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:45:37.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.974+0000 7f0dff591640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:45:37.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.974+0000 7f0dff591640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:37.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.974+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0df809ee60 con 0x7f0df8138490 2026-02-17T11:45:37.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.975+0000 7f0de2ffd640 1 -- 10.20.193.51:0/2272016173 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+96695 (secure 0 0 0) 0x7f0df809ee60 con 0x7f0df8138490 2026-02-17T11:45:37.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.975+0000 7f0de2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:45:37.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.975+0000 7f0de2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:37.979 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 msgr2=0x7f0dc80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 0x7f0dc80401d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0df00052b0 tx=0x7f0df0003960 comp rx=0 tx=0).stop 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 10 monclient: shutdown 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 msgr2=0x7f0df81377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 0x7f0df81377b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0df8070160 tx=0x7f0de40047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 shutdown_connections 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0dc803dd10 0x7f0dc80401d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0df813da10 0x7f0df813a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0df8138490 0x7f0df81377b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 --2- 10.20.193.51:0/2272016173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0df80a3f80 0x7f0df81cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.976+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 >> 10.20.193.51:0/2272016173 conn(0x7f0df80a8570 msgr2=0x7f0df8073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.977+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 shutdown_connections 2026-02-17T11:45:37.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:37.977+0000 7f0dff591640 1 -- 10.20.193.51:0/2272016173 wait complete. 2026-02-17T11:45:37.986 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6800","nonce":1631919410},{"type":"v1","addr":"10.20.193.142:6801","nonce":1631919410}]},"active_addr":"10.20.193.142:6801/1631919410","active_change":"2026-02-17T11:45:19.869239+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.142:0","nonce":2419446133}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.142:0","nonce":3775418469}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.142:0","nonce":3938778057}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.142:0","nonce":169878029}]}]} 2026-02-17T11:45:37.991 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:45:37.991 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:45:37.991 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:38.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.056+0000 7f9388bf7640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.056+0000 7f9388bf7640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.056+0000 7f9388bf7640 10 monclient: monmap: 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.057827+0000 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.057827+0000 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.061 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 Processor -- start 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 -- start start 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient: init 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f93840a3bb0 0x7f938409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f93840a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f93840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f938409e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938406e140 con 0x7f938409e540 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93840a3f90 con 0x7f93840a3bb0 2026-02-17T11:45:38.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f938409f910 con 0x7f93840a0750 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9388bf7640 10 monclient(hunting): authenticate will time out at 625.676572s 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58888/0 (socket says 10.20.193.51:58888) 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 -- 10.20.193.51:0/1278049058 learned_addr learned my addr 10.20.193.51:0/1278049058 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): get_auth_request con 0x7f93840a0750 auth_method 0 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9382575640 1 --2- 10.20.193.51:0/1278049058 >> v2:10.20.193.142:3300/0 conn(0x7f93840a3bb0 0x7f938409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9382575640 10 monclient(hunting): get_auth_request con 0x7f93840a3bb0 auth_method 0 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9382575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9382575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient(hunting): handle_auth_done global_id 4211 payload 274 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 -- 10.20.193.51:0/1278049058 >> v2:10.20.193.142:3300/0 conn(0x7f93840a3bb0 msgr2=0x7f938409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 --2- 10.20.193.51:0/1278049058 >> v2:10.20.193.142:3300/0 conn(0x7f93840a3bb0 0x7f938409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 -- 10.20.193.51:0/1278049058 >> v1:10.20.193.142:6789/0 conn(0x7f938409e540 legacy=0x7f938413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.057+0000 7f9381d74640 1 -- 10.20.193.51:0/1278049058 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938409ccd0 con 0x7f93840a0750 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381d74640 1 -- 10.20.193.51:0/1278049058 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 msgr2=0x7f938409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381d74640 1 --2- 10.20.193.51:0/1278049058 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f938406c1c0 tx=0x7f936c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd48f186aab10770 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 1 -- 10.20.193.51:0/1278049058 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c03c070 con 0x7f93840a0750 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: dump: 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.070 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 1 -- 10.20.193.51:0/1278049058 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c02fca0 con 0x7f93840a0750 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 1 -- 10.20.193.51:0/1278049058 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c037660 con 0x7f93840a0750 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 5 monclient: authenticate success, global_id 4211 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 4 set_mon_vals no callback set 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9381573640 10 monclient: dump: 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 10 monclient: shutdown 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 -- 10.20.193.51:0/1278049058 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 msgr2=0x7f938409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 --2- 10.20.193.51:0/1278049058 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f938406c1c0 tx=0x7f936c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:45:38.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 -- 10.20.193.51:0/1278049058 shutdown_connections 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 --2- 10.20.193.51:0/1278049058 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f938409e000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 --2- 10.20.193.51:0/1278049058 >> v2:10.20.193.142:3300/0 conn(0x7f93840a3bb0 0x7f938409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 -- 10.20.193.51:0/1278049058 >> 10.20.193.51:0/1278049058 conn(0x7f93840a30c0 msgr2=0x7f93840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 -- 10.20.193.51:0/1278049058 shutdown_connections 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.060+0000 7f9388bf7640 1 -- 10.20.193.51:0/1278049058 wait complete. 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient: monmap: 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.073 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 Processor -- start 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 -- start start 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient: init 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938409e540 0x7f93841cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f938409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f93840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93840a3bb0 0x7f93841cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f93840a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f93840a04b0 con 0x7f93840a3bb0 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f938409c850 con 0x7f938409e540 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f938413de80 con 0x7f93840a0750 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9388bf7640 10 monclient(hunting): authenticate will time out at 625.680700s 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58890/0 (socket says 10.20.193.51:58890) 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 -- 10.20.193.51:0/967872625 learned_addr learned my addr 10.20.193.51:0/967872625 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): get_auth_request con 0x7f93840a0750 auth_method 0 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93840a3bb0 0x7f93841cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): get_auth_request con 0x7f93840a3bb0 auth_method 0 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9382d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient(hunting): handle_auth_done global_id 4214 payload 824 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 -- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938409e540 msgr2=0x7f93841cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938409e540 0x7f93841cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 -- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93840a3bb0 msgr2=0x7f93841cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93840a3bb0 0x7f93841cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.061+0000 7f9381d74640 1 -- 10.20.193.51:0/967872625 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9384133610 con 0x7f93840a0750 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9381d74640 1 -- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 msgr2=0x7f9384137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9381d74640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f936c009a70 tx=0x7f936c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c047070 con 0x7f93840a0750 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: dump: 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.077 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c02fe50 con 0x7f93840a0750 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c03c040 con 0x7f93840a0750 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9380d72640 4 set_mon_vals no callback set 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 10 monclient: dump: 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 5 monclient: authenticate success, global_id 4214 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _renew_subs 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93841338f0 con 0x7f93840a0750 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _renew_subs 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9384132160 con 0x7f93840a0750 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93840701b0 con 0x7f93840a0750 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.064+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f936c03fa10 con 0x7f93840a0750 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.065+0000 7f936affd640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 0x7f9350040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.065+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f936c077270 con 0x7f93840a0750 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.065+0000 7f9382575640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 0x7f9350040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.065+0000 7f9382575640 10 monclient: get_auth_request con 0x7f935003dd60 auth_method 0 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.067+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f93840701b0 con 0x7f93840a0750 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.067+0000 7f936affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.067+0000 7f936affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.068+0000 7f9382575640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 0x7f9350040220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9378006fd0 tx=0x7f9378008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f9388bf7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f9388bf7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f9388bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93841cfc90 con 0x7f93840a0750 2026-02-17T11:45:38.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f936affd640 1 -- 10.20.193.51:0/967872625 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12413 (secure 0 0 0) 0x7f93841cfc90 con 0x7f93840a0750 2026-02-17T11:45:38.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f936affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.154+0000 7f936affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.157 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:38.158 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":20,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:37.742914+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:45:34.073497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 msgr2=0x7f9350040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 0x7f9350040220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9378006fd0 tx=0x7f9378008040 comp rx=0 tx=0).stop 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 10 monclient: shutdown 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 msgr2=0x7f9384137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f936c009a70 tx=0x7f936c004830 comp rx=0 tx=0).stop 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 shutdown_connections 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935003dd60 0x7f9350040220 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93840a3bb0 0x7f93841cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93840a0750 0x7f9384137e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 --2- 10.20.193.51:0/967872625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938409e540 0x7f93841cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 >> 10.20.193.51:0/967872625 conn(0x7f93840a30c0 msgr2=0x7f93840a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 shutdown_connections 2026-02-17T11:45:38.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.155+0000 7f9388bf7640 1 -- 10.20.193.51:0/967872625 wait complete. 2026-02-17T11:45:38.165 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:45:38.165 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.230+0000 7f2feab53640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.230+0000 7f2feab53640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.230+0000 7f2feab53640 10 monclient: monmap: 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.231662+0000 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.231662+0000 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.232 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.233 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.233 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 Processor -- start 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 -- start start 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient: init 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 0x7f2fe409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-a con 0x7f2fe40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 0x7f2fe409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-b con 0x7f2fe40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2fe409e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe406e140 con 0x7f2fe409e540 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40a3f90 con 0x7f2fe40a3bb0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe409f910 con 0x7f2fe40a0750 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2feab53640 10 monclient(hunting): authenticate will time out at 625.850421s 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 0x7f2fe409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 0x7f2fe409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 0x7f2fe409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52476/0 (socket says 10.20.193.51:52476) 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 1 -- 10.20.193.51:0/2586772140 learned_addr learned my addr 10.20.193.51:0/2586772140 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): get_auth_request con 0x7f2fe40a3bb0 auth_method 0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): get_auth_request con 0x7f2fe40a0750 auth_method 0 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient(hunting): handle_auth_done global_id 4217 payload 274 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 -- 10.20.193.51:0/2586772140 >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 msgr2=0x7f2fe409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 --2- 10.20.193.51:0/2586772140 >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 0x7f2fe409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 -- 10.20.193.51:0/2586772140 >> v1:10.20.193.142:6789/0 conn(0x7f2fe409e540 legacy=0x7f2fe413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.231+0000 7f2fdbfff640 1 -- 10.20.193.51:0/2586772140 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe409ccd0 con 0x7f2fe40a0750 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdbfff640 1 -- 10.20.193.51:0/2586772140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 msgr2=0x7f2fe409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdbfff640 1 --2- 10.20.193.51:0/2586772140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 0x7f2fe409e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406c1c0 tx=0x7f2fcc02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f999b193cc9a00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 1 -- 10.20.193.51:0/2586772140 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc03c070 con 0x7f2fe40a0750 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: dump: 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 1 -- 10.20.193.51:0/2586772140 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fcc02fbd0 con 0x7f2fe40a0750 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 1 -- 10.20.193.51:0/2586772140 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc037440 con 0x7f2fe40a0750 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 5 monclient: authenticate success, global_id 4217 2026-02-17T11:45:38.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 4 set_mon_vals no callback set 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2fdb7fe640 10 monclient: dump: 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 10 monclient: shutdown 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 -- 10.20.193.51:0/2586772140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 msgr2=0x7f2fe409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 --2- 10.20.193.51:0/2586772140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 0x7f2fe409e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406c1c0 tx=0x7f2fcc02ed50 comp rx=0 tx=0).stop 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 -- 10.20.193.51:0/2586772140 shutdown_connections 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 --2- 10.20.193.51:0/2586772140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a0750 0x7f2fe409e000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 --2- 10.20.193.51:0/2586772140 >> v2:10.20.193.51:3300/0 conn(0x7f2fe40a3bb0 0x7f2fe409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 -- 10.20.193.51:0/2586772140 >> 10.20.193.51:0/2586772140 conn(0x7f2fe40a30c0 msgr2=0x7f2fe40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 -- 10.20.193.51:0/2586772140 shutdown_connections 2026-02-17T11:45:38.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.234+0000 7f2feab53640 1 -- 10.20.193.51:0/2586772140 wait complete. 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient: monmap: 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 Processor -- start 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 -- start start 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient: init 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-a con 0x7f2fe409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fe40a0750 0x7f2fe41d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-b con 0x7f2fe40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 0x7f2fe412dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): picked mon.noname-c con 0x7f2fe40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40a04b0 con 0x7f2fe409e540 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe409c850 con 0x7f2fe40a0750 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe413de80 con 0x7f2fe40a3bb0 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2feab53640 10 monclient(hunting): authenticate will time out at 625.854628s 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 0x7f2fe412dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52478/0 (socket says 10.20.193.51:52478) 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 -- 10.20.193.51:0/1623935019 learned_addr learned my addr 10.20.193.51:0/1623935019 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): get_auth_request con 0x7f2fe409e540 auth_method 0 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): get_auth_request con 0x7f2fe40a3bb0 auth_method 0 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient(hunting): handle_auth_done global_id 4224 payload 824 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 -- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 msgr2=0x7f2fe412dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 0x7f2fe412dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 -- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fe40a0750 msgr2=0x7f2fe41d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fe40a0750 0x7f2fe41d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe88c8640 1 -- 10.20.193.51:0/1623935019 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe412f960 con 0x7f2fe409e540 2026-02-17T11:45:38.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.235+0000 7f2fe90c9640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 0x7f2fe412dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.237+0000 7f2fe88c8640 1 -- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 msgr2=0x7f2fe41cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.237+0000 7f2fe88c8640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400e930 tx=0x7f2fd400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4017070 con 0x7f2fe409e540 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: dump: 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd400cc10 con 0x7f2fe409e540 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 5 monclient: authenticate success, global_id 4224 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4013470 con 0x7f2fe409e540 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fdaffd640 4 set_mon_vals no callback set 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 10 monclient: dump: 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _renew_subs 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe4131c50 con 0x7f2fe409e540 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _renew_subs 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe4131970 con 0x7f2fe409e540 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe409dac0 con 0x7f2fe409e540 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2fd4024060 con 0x7f2fe409e540 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.238+0000 7f2fd97fa640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 0x7f2fb40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.239+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f2fd4052550 con 0x7f2fe409e540 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.239+0000 7f2fdbfff640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 0x7f2fb40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.239+0000 7f2fdbfff640 10 monclient: get_auth_request con 0x7f2fb403dd10 auth_method 0 2026-02-17T11:45:38.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.241+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2fd4013e10 con 0x7f2fe409e540 2026-02-17T11:45:38.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.241+0000 7f2fd97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.241+0000 7f2fd97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.241+0000 7f2fdbfff640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 0x7f2fb40401d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fe409f230 tx=0x7f2fcc031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.323+0000 7f2feab53640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.323+0000 7f2feab53640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.323+0000 7f2feab53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.323+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fe412fdc0 con 0x7f2fe409e540 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2fd97fa640 1 -- 10.20.193.51:0/1623935019 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12413 (secure 0 0 0) 0x7f2fd40123d0 con 0x7f2fe409e540 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2fd97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2fd97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.325 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":20,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:37.742914+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:45:34.073497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 msgr2=0x7f2fb40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 0x7f2fb40401d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fe409f230 tx=0x7f2fcc031000 comp rx=0 tx=0).stop 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 10 monclient: shutdown 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 msgr2=0x7f2fe41cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400e930 tx=0x7f2fd400ee00 comp rx=0 tx=0).stop 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 shutdown_connections 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fb403dd10 0x7f2fb40401d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fe40a3bb0 0x7f2fe412dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fe40a0750 0x7f2fe41d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 --2- 10.20.193.51:0/1623935019 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fe409e540 0x7f2fe41cff70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 >> 10.20.193.51:0/1623935019 conn(0x7f2fe40a30c0 msgr2=0x7f2fe409b740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 shutdown_connections 2026-02-17T11:45:38.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.324+0000 7f2feab53640 1 -- 10.20.193.51:0/1623935019 wait complete. 2026-02-17T11:45:38.334 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:38.334 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:38.334 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:38.334 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:38.334 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T11:45:38.335 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T11:45:38.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.401+0000 7fc1e3949640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.401+0000 7fc1e3949640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.401+0000 7fc1e3949640 10 monclient: monmap: 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.402812+0000 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.402812+0000 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.404 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.405 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.405 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 Processor -- start 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 -- start start 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient: init 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-17T11:45:38.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fd2fadfb640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fd2fadfb640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fd2fadfb640 10 monclient: monmap: 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.403505+0000 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.403505+0000 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.407 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.408 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.408 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.408 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc1dc138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc1dc0a35a0 0x7fc1dc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-a con 0x7fc1dc0a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1dc13d8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc0a1df0 con 0x7fc1dc13d8a0 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc0a65b0 con 0x7fc1dc138600 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc1dc0a6830 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e3949640 10 monclient(hunting): authenticate will time out at 626.021673s 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7f0bd2a3a640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7f0bd2a3a640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7f0bd2a3a640 10 monclient: monmap: 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.403649+0000 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.403649+0000 2026-02-17T11:45:38.410 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.411 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc1dc0a35a0 0x7fc1dc13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e1ebf640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc1dc13d8a0 0x7fc1dc13fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44218/0 (socket says 10.20.193.51:44218) 2026-02-17T11:45:38.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): get_auth_request con 0x7fc1dc0a35a0 auth_method 0 2026-02-17T11:45:38.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e1ebf640 1 -- 10.20.193.51:0/960882154 learned_addr learned my addr 10.20.193.51:0/960882154 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_done global_id 4227 payload 274 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/960882154 >> v1:10.20.193.142:6789/0 conn(0x7fc1dc138600 legacy=0x7fc1dc1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/960882154 >> v1:10.20.193.51:6789/0 conn(0x7fc1dc13d8a0 legacy=0x7fc1dc13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/960882154 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc0a22d0 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.402+0000 7fd2fadfb640 1 Processor -- start 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 -- start start 2026-02-17T11:45:38.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient: init 2026-02-17T11:45:38.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 Processor -- start 2026-02-17T11:45:38.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 -- start start 2026-02-17T11:45:38.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient: init 2026-02-17T11:45:38.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-17T11:45:38.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f4138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd2f40a35a0 0x7fd2f40a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f40a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd2f40a58a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f40a1df0 con 0x7fd2f40a58a0 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40a6830 con 0x7fd2f40a35a0 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40a2c00 con 0x7fd2f4138600 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2fadfb640 10 monclient(hunting): authenticate will time out at 626.022340s 2026-02-17T11:45:38.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T11:45:38.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0bcc138600 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 0x7f0bcc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 10 monclient: monmap: 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.404349+0000 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.404349+0000 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.419 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-b con 0x7f0bcc0a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0bcc13d8a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bcc0a1df0 con 0x7f0bcc138600 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58928/0 (socket says 10.20.193.51:58928) 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 -- 10.20.193.51:0/3477748287 learned_addr learned my addr 10.20.193.51:0/3477748287 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): get_auth_request con 0x7fd2f4138600 auth_method 0 2026-02-17T11:45:38.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bcc0a65b0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0bcc0a6830 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd2a3a640 10 monclient(hunting): authenticate will time out at 626.022462s 2026-02-17T11:45:38.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 0x7f0bcc13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd0fb0640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f0bcc13d8a0 0x7f0bcc13fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:60338/0 (socket says 10.20.193.51:60338) 2026-02-17T11:45:38.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/3692308044 learned_addr learned my addr 10.20.193.51:0/3692308044 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_done global_id 4223 payload 274 2026-02-17T11:45:38.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): get_auth_request con 0x7f0bcc0a35a0 auth_method 0 2026-02-17T11:45:38.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 -- 10.20.193.51:0/3477748287 >> v2:10.20.193.51:3300/0 conn(0x7fd2f40a35a0 msgr2=0x7fd2f40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/3477748287 >> v2:10.20.193.51:3300/0 conn(0x7fd2f40a35a0 0x7fd2f40a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 -- 10.20.193.51:0/3477748287 >> v1:10.20.193.142:6789/0 conn(0x7fd2f40a58a0 legacy=0x7fd2f413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7fd2f8b70640 1 -- 10.20.193.51:0/3477748287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f4138f20 con 0x7fd2f4138600 2026-02-17T11:45:38.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient(hunting): handle_auth_done global_id 4226 payload 274 2026-02-17T11:45:38.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 1 -- 10.20.193.51:0/3692308044 >> v1:10.20.193.142:6789/0 conn(0x7f0bcc13d8a0 legacy=0x7f0bcc13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 1 -- 10.20.193.51:0/3692308044 >> v1:10.20.193.51:6789/0 conn(0x7f0bcc138600 legacy=0x7f0bcc1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f0bcb7fe640 1 -- 10.20.193.51:0/3692308044 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc0a22d0 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f31e1761640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f31e1761640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 1 Processor -- start 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f31e1761640 10 monclient: monmap: 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.404751+0000 2026-02-17T11:45:38.429 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.404751+0000 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.430 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 1 -- start start 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f5321640640 10 monclient: init 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f205ad96640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f205ad96640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.403+0000 7f205ad96640 10 monclient: monmap: 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.431 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.404919+0000 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.404919+0000 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.432 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2026-02-17T11:45:38.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f531c0a0370 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f531c0a0e60 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 Processor -- start 2026-02-17T11:45:38.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f531c06cb40 0x7f531c140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): picked mon.noname-a con 0x7f531c06cb40 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0a24c0 con 0x7f531c0a0e60 2026-02-17T11:45:38.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c06d5f0 con 0x7f531c0a0370 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0ab740 con 0x7f531c06cb40 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f5321640640 10 monclient(hunting): authenticate will time out at 626.023292s 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 -- start start 2026-02-17T11:45:38.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient: init 2026-02-17T11:45:38.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 Processor -- start 2026-02-17T11:45:38.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 -- start start 2026-02-17T11:45:38.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient: init 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc0a0370 0x7f31dc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-b con 0x7f31dc0a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 0x7f31dc0a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-a con 0x7f31dc0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f31dc138120 0x7f31dc1385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-c con 0x7f31dc138120 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f31dc0ab740 con 0x7f31dc0a0750 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f31dc06d080 con 0x7f31dc138120 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0a24c0 con 0x7f31dc0a0370 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f31e1761640 10 monclient(hunting): authenticate will time out at 626.023591s 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2054138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 0x7f205413d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-b con 0x7f20540a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f205413d8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540a1df0 con 0x7f205413d8a0 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540a65b0 con 0x7f2054138600 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f20540a6830 con 0x7f20540a35a0 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.404+0000 7f205ad96640 10 monclient(hunting): authenticate will time out at 626.023797s 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/960882154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 msgr2=0x7fc1dc13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1e0ebd640 1 --2- 10.20.193.51:0/960882154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 0x7fc1dc13d360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098a0 tx=0x7fc1d002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fe3691e56bd9d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 0x7f31dc0a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f531c06cb40 0x7f531c140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 0x7f31dc0a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52524/0 (socket says 10.20.193.51:52524) 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 1 -- 10.20.193.51:0/355656364 learned_addr learned my addr 10.20.193.51:0/355656364 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): get_auth_request con 0x7f31dc0a0750 auth_method 0 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531a7fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f531c0a0e60 0x7f531c13d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44240/0 (socket says 10.20.193.51:44240) 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531a7fc640 1 -- 10.20.193.51:0/4027499804 learned_addr learned my addr 10.20.193.51:0/4027499804 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): get_auth_request con 0x7f531c06cb40 auth_method 0 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f205930c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f205413d8a0 0x7f205413fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44246/0 (socket says 10.20.193.51:44246) 2026-02-17T11:45:38.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f205930c640 1 -- 10.20.193.51:0/4101327229 learned_addr learned my addr 10.20.193.51:0/4101327229 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 1 -- 10.20.193.51:0/960882154 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d003c070 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 10 monclient: dump: 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1e3949640 5 monclient: authenticate success, global_id 4227 2026-02-17T11:45:38.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7fc1e3949640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31db7fe640 1 --2- 10.20.193.51:0/355656364 >> v2:10.20.193.142:3300/0 conn(0x7f31dc138120 0x7f31dc1385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31db7fe640 10 monclient(hunting): get_auth_request con 0x7f31dc138120 auth_method 0 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.405+0000 7f31db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2f8b70640 1 -- 10.20.193.51:0/3477748287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 msgr2=0x7fd2f41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/3477748287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009970 tx=0x7fd2e402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4c5e6cd8666658 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31daffd640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc0a0370 0x7f31dc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31daffd640 10 monclient(hunting): get_auth_request con 0x7f31dc0a0370 auth_method 0 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 1 --2- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 0x7f205413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): get_auth_request con 0x7f20540a35a0 auth_method 0 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient(hunting): handle_auth_done global_id 4195 payload 274 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 -- 10.20.193.51:0/355656364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc0a0370 msgr2=0x7f31dc06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc0a0370 0x7f31dc06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 -- 10.20.193.51:0/355656364 >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 msgr2=0x7f31dc0a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 --2- 10.20.193.51:0/355656364 >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 0x7f31dc0a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f31db7fe640 1 -- 10.20.193.51:0/355656364 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc06d5f0 con 0x7f31dc138120 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 1 -- 10.20.193.51:0/3477748287 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403c070 con 0x7fd2f4138600 2026-02-17T11:45:38.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient(hunting): handle_auth_done global_id 4232 payload 274 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 1 -- 10.20.193.51:0/4101327229 >> v1:10.20.193.142:6789/0 conn(0x7f2054138600 legacy=0x7f20541389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 1 -- 10.20.193.51:0/4101327229 >> v1:10.20.193.51:6789/0 conn(0x7f205413d8a0 legacy=0x7f205413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: dump: 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.450 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f204bfff640 1 -- 10.20.193.51:0/4101327229 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540a22d0 con 0x7f20540a35a0 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 5 monclient: authenticate success, global_id 4223 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 1 -- 10.20.193.51:0/3477748287 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e402fdb0 con 0x7fd2f4138600 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 1 -- 10.20.193.51:0/3477748287 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037660 con 0x7fd2f4138600 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 4 set_mon_vals no callback set 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2eb7fe640 10 monclient: dump: 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.452 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcb7fe640 1 -- 10.20.193.51:0/3692308044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 msgr2=0x7f0bcc13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcb7fe640 1 --2- 10.20.193.51:0/3692308044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 0x7f0bcc13d360 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0098d0 tx=0x7f0bbc02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=860c3fc4842e5158 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 1 -- 10.20.193.51:0/3692308044 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc03c070 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: dump: 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 1 -- 10.20.193.51:0/3692308044 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bbc02fd20 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 1 -- 10.20.193.51:0/3692308044 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc037660 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 5 monclient: authenticate success, global_id 4226 2026-02-17T11:45:38.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 4 set_mon_vals no callback set 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bcaffd640 10 monclient: dump: 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.455 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 10 monclient: shutdown 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 -- 10.20.193.51:0/3477748287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 msgr2=0x7fd2f41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/3477748287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009970 tx=0x7fd2e402ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 -- 10.20.193.51:0/3477748287 shutdown_connections 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/3477748287 >> v2:10.20.193.51:3300/0 conn(0x7fd2f40a35a0 0x7fd2f40a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/3477748287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41389e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 -- 10.20.193.51:0/3477748287 >> 10.20.193.51:0/3477748287 conn(0x7fd2f40a7460 msgr2=0x7fd2f40a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 -- 10.20.193.51:0/3477748287 shutdown_connections 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 1 -- 10.20.193.51:0/3477748287 wait complete. 2026-02-17T11:45:38.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 10 monclient: shutdown 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/3692308044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 msgr2=0x7f0bcc13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 --2- 10.20.193.51:0/3692308044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 0x7f0bcc13d360 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0098d0 tx=0x7f0bbc02edc0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/3692308044 shutdown_connections 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 --2- 10.20.193.51:0/3692308044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc0a35a0 0x7f0bcc13d360 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/3692308044 >> 10.20.193.51:0/3692308044 conn(0x7f0bcc0a7460 msgr2=0x7f0bcc0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/3692308044 shutdown_connections 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/3692308044 wait complete. 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.406+0000 7fd2fadfb640 10 monclient: monmap: 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.457 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 Processor -- start 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 -- start start 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient: init 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient: monmap: 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.458 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f40a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f40a58a0 0x7fd2f4121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f40a58a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f4138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40a25b0 con 0x7fd2f40a35a0 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40a22d0 con 0x7fd2f40a58a0 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40a15f0 con 0x7fd2f4138600 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2fadfb640 10 monclient(hunting): authenticate will time out at 626.026394s 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 Processor -- start 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 -- start start 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient: init 2026-02-17T11:45:38.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531a7fc640 1 -- 10.20.193.51:0/4027499804 >> v1:10.20.193.51:6789/0 conn(0x7f531c0a0e60 legacy=0x7f531c13d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 1 -- 10.20.193.51:0/960882154 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d002fce0 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 1 -- 10.20.193.51:0/960882154 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0037660 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1cbfff640 10 monclient: dump: 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1e3949640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fc1e3949640 4 set_mon_vals no callback set 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0bcc0a35a0 0x7f0bcc1cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-b con 0x7f0bcc0a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc138600 0x7f0bcc137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-c con 0x7f0bcc138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 10 monclient(hunting): handle_auth_done global_id 4233 payload 274 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): picked mon.noname-a con 0x7f0bcc13d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0a15f0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 1 -- 10.20.193.51:0/4027499804 >> v1:10.20.193.142:6789/0 conn(0x7f531c0a0370 legacy=0x7f531c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 1 -- 10.20.193.51:0/4027499804 >> v1:10.20.193.51:6789/0 conn(0x7f531c0a0e60 legacy=0x7f531c13d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0a2c00 con 0x7f0bcc0a35a0 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0bcc0a1770 con 0x7f0bcc138600 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd2a3a640 10 monclient(hunting): authenticate will time out at 626.026831s 2026-02-17T11:45:38.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f531b7fe640 1 -- 10.20.193.51:0/4027499804 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0a27a0 con 0x7f531c06cb40 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52532/0 (socket says 10.20.193.51:52532) 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 1 -- 10.20.193.51:0/715939656 learned_addr learned my addr 10.20.193.51:0/715939656 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): get_auth_request con 0x7fd2f40a35a0 auth_method 0 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52536/0 (socket says 10.20.193.51:52536) 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 learned_addr learned my addr 10.20.193.51:0/1456656294 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 10 monclient(hunting): get_auth_request con 0x7f0bcc13d8a0 auth_method 0 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7f0bd0fb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.407+0000 7fd2f8b70640 10 monclient(hunting): handle_auth_done global_id 4236 payload 824 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 msgr2=0x7fd2f41224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f4138600 0x7fd2f41224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f40a58a0 msgr2=0x7fd2f4121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f40a58a0 0x7fd2f4121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fd2f8b70640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f4124510 con 0x7fd2f40a35a0 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: shutdown 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- 10.20.193.51:0/960882154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 msgr2=0x7fc1dc13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 --2- 10.20.193.51:0/960882154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 0x7fc1dc13d360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098a0 tx=0x7fc1d002ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient(hunting): handle_auth_done global_id 4239 payload 824 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc138600 msgr2=0x7f0bcc137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0bcc138600 0x7f0bcc137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0bcc0a35a0 msgr2=0x7f0bcc1cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0bcc0a35a0 0x7f0bcc1cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc1d0610 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- 10.20.193.51:0/960882154 shutdown_connections 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 --2- 10.20.193.51:0/960882154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 0x7fc1dc13d360 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- 10.20.193.51:0/960882154 >> 10.20.193.51:0/960882154 conn(0x7fc1dc0a7460 msgr2=0x7fc1dc0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- 10.20.193.51:0/960882154 shutdown_connections 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- 10.20.193.51:0/960882154 wait complete. 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: monmap: 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 Processor -- start 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 -- start start 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: init 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204bfff640 1 -- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 msgr2=0x7f205413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204bfff640 1 --2- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 0x7f205413d360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098d0 tx=0x7f203c02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af67c2adcca01169 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f31db7fe640 1 -- 10.20.193.51:0/355656364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc138120 msgr2=0x7f31dc1385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f31db7fe640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc138120 0x7f31dc1385b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31dc06f7a0 tx=0x7f31cc02f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5afeb52da4584d3c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 1 -- 10.20.193.51:0/4101327229 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c03c070 con 0x7f20540a35a0 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: dump: 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 1 -- 10.20.193.51:0/4101327229 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203c02fd20 con 0x7f20540a35a0 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 1 -- 10.20.193.51:0/4101327229 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c037660 con 0x7f20540a35a0 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f205ad96640 5 monclient: authenticate success, global_id 4232 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f205ad96640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f205ad96640 4 set_mon_vals no callback set 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7f204b7fe640 10 monclient: dump: 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 0x7fc1dc1371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.408+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-a con 0x7fc1dc0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 0x7fc1dc070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-c con 0x7fc1dc138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1dc13d8a0 0x7fc1dc071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): picked mon.noname-b con 0x7fc1dc13d8a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0a15f0 con 0x7fc1dc0a35a0 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0a2c00 con 0x7fc1dc13d8a0 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 1 -- 10.20.193.51:0/355656364 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc03c070 con 0x7f31dc138120 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc0a1770 con 0x7fc1dc138600 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e3949640 10 monclient(hunting): authenticate will time out at 626.028025s 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: dump: 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 5 monclient: authenticate success, global_id 4195 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 1 -- 10.20.193.51:0/355656364 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc037440 con 0x7f31dc138120 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 1 -- 10.20.193.51:0/355656364 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc037810 con 0x7f31dc138120 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:38.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 0x7fc1dc070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31d9ffb640 10 monclient: dump: 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 4 set_mon_vals no callback set 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 0x7fc1dc070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58970/0 (socket says 10.20.193.51:58970) 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/639545480 learned_addr learned my addr 10.20.193.51:0/639545480 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): get_auth_request con 0x7fc1dc138600 auth_method 0 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 10 monclient: shutdown 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 msgr2=0x7f205413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 --2- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 0x7f205413d360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098d0 tx=0x7f203c02edc0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient(hunting): handle_auth_done global_id 4235 payload 824 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1dc13d8a0 msgr2=0x7fc1dc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1dc13d8a0 0x7fc1dc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 msgr2=0x7fc1dc1371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1dc0a35a0 0x7fc1dc1371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- 10.20.193.51:0/4101327229 shutdown_connections 2026-02-17T11:45:38.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 --2- 10.20.193.51:0/4101327229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f20540a35a0 0x7f205413d360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- 10.20.193.51:0/4101327229 >> 10.20.193.51:0/4101327229 conn(0x7f20540a7460 msgr2=0x7f20540a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc13d630 con 0x7fc1dc138600 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- 10.20.193.51:0/4101327229 shutdown_connections 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- 10.20.193.51:0/4101327229 wait complete. 2026-02-17T11:45:38.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 10 monclient: shutdown 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 -- 10.20.193.51:0/355656364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc138120 msgr2=0x7f31dc1385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc138120 0x7f31dc1385b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31dc06f7a0 tx=0x7f31cc02f130 comp rx=0 tx=0).stop 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 -- 10.20.193.51:0/355656364 shutdown_connections 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc138120 0x7f31dc1385b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 --2- 10.20.193.51:0/355656364 >> v2:10.20.193.51:3300/0 conn(0x7f31dc0a0750 0x7f31dc0a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 --2- 10.20.193.51:0/355656364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc0a0370 0x7f31dc06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 -- 10.20.193.51:0/355656364 >> 10.20.193.51:0/355656364 conn(0x7f31dc0aa960 msgr2=0x7f31dc0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 -- 10.20.193.51:0/355656364 shutdown_connections 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 -- 10.20.193.51:0/355656364 wait complete. 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 10 monclient: monmap: 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 10 monclient: monmap: 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 Processor -- start 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 1 -- start start 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f205ad96640 10 monclient: init 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.409+0000 7f31e1761640 1 Processor -- start 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 -- start start 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient: init 2026-02-17T11:45:38.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2f8b70640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 msgr2=0x7fd2f4137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009970 tx=0x7fd2e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f20540a35a0 0x7f20541cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-b con 0x7f20540a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 0x7f20541376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-c con 0x7f2054138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f205413d8a0 0x7f2054137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): picked mon.noname-a con 0x7f205413d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f20540a15f0 con 0x7f205413d8a0 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f20540a2c00 con 0x7f20540a35a0 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f20540a1770 con 0x7f2054138600 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205ad96640 10 monclient(hunting): authenticate will time out at 626.029266s 2026-02-17T11:45:38.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4047070 con 0x7fd2f40a35a0 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc0a0370 0x7f31dc1cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-b con 0x7f31dc0a0370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 msgr2=0x7f0bcc137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: dump: 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2f8b70640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009970 tx=0x7fd2e40047c0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fd2e403c040 mon_map magic: 0 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 5 monclient: authenticate success, global_id 4236 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4043660 con 0x7fd2f40a35a0 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 10 monclient: _renew_subs 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd0fb0640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000cb20 tx=0x7f0bc000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f40a92f0 con 0x7fd2f40a35a0 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31dc0a0750 0x7f31dc1cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-a con 0x7f31dc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 0x7f31dc124770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): picked mon.noname-c con 0x7f31dc138120 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0a1090 con 0x7f31dc0a0750 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2eaffd640 4 set_mon_vals no callback set 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0a16e0 con 0x7f31dc0a0370 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0a1860 con 0x7f31dc138120 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31e1761640 10 monclient(hunting): authenticate will time out at 626.029339s 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 0x7f20541376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 0x7f20541376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58980/0 (socket says 10.20.193.51:58980) 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 -- 10.20.193.51:0/2828650451 learned_addr learned my addr 10.20.193.51:0/2828650451 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f20540a35a0 0x7f20541cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): get_auth_request con 0x7f2054138600 auth_method 0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 10 monclient: _renew_subs 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f4125960 con 0x7fd2f40a35a0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): get_auth_request con 0x7f20540a35a0 auth_method 0 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f531b7fe640 1 -- 10.20.193.51:0/4027499804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 msgr2=0x7f531c140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f531b7fe640 1 --2- 10.20.193.51:0/4027499804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c140ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e10 tx=0x7f530c02f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb84fedb42decb7d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 0x7f31dc124770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 0x7f31dc124770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58994/0 (socket says 10.20.193.51:58994) 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 learned_addr learned my addr 10.20.193.51:0/2552637582 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): get_auth_request con 0x7f31dc138120 auth_method 0 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f205413d8a0 0x7f2054137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f2058b0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): get_auth_request con 0x7f205413d8a0 auth_method 0 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc0a0370 0x7f31dc1cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31dc0a0750 0x7f31dc1cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 10 monclient(hunting): get_auth_request con 0x7f31dc0a0370 auth_method 0 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f205930c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): get_auth_request con 0x7f31dc0a0750 auth_method 0 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient(hunting): handle_auth_done global_id 4238 payload 824 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f20540a35a0 msgr2=0x7f20541cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f20540a35a0 0x7f20541cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f205413d8a0 msgr2=0x7f2054137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f205413d8a0 0x7f2054137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f204bfff640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054121050 con 0x7f2054138600 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000ae60 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 1 -- 10.20.193.51:0/4027499804 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c03c070 con 0x7f531c06cb40 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: dump: 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient(hunting): handle_auth_done global_id 4241 payload 824 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd0fb0640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000cb20 tx=0x7f0bc000a060 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f0bc0012400 config(0 keys) 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: dump: 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 1 -- 10.20.193.51:0/4027499804 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c037640 con 0x7f531c06cb40 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 1 -- 10.20.193.51:0/4027499804 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c037a10 con 0x7f531c06cb40 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 5 monclient: authenticate success, global_id 4233 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc0a0370 msgr2=0x7f31dc1cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc0a0370 0x7f31dc1cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31dc0a0750 msgr2=0x7f31dc1cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 5 monclient: authenticate success, global_id 4239 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc0012400 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 10 monclient: _renew_subs 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc13d130 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bc8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 4 set_mon_vals no callback set 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5319ffb640 10 monclient: dump: 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31dc0a0750 0x7f31dc1cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc128100 con 0x7f31dc138120 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bca7fc640 4 set_mon_vals no callback set 2026-02-17T11:45:38.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f31daffd640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31dc0a0370 0x7f31dc1cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 10 monclient: _renew_subs 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc0a1ae0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2f40a5360 con 0x7fd2f40a35a0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403c040 con 0x7fd2f40a35a0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 10 monclient: dump: 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd2e4043a90 con 0x7fd2f40a35a0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 10 monclient: shutdown 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 1 -- 10.20.193.51:0/4027499804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 msgr2=0x7f531c140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.410+0000 7f5321640640 1 --2- 10.20.193.51:0/4027499804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c140ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e10 tx=0x7f530c02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 -- 10.20.193.51:0/4027499804 shutdown_connections 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 --2- 10.20.193.51:0/4027499804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c140ca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 -- 10.20.193.51:0/4027499804 >> 10.20.193.51:0/4027499804 conn(0x7f531c0aa960 msgr2=0x7f531c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 -- 10.20.193.51:0/4027499804 shutdown_connections 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 -- 10.20.193.51:0/4027499804 wait complete. 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bd2a3a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bcc1406e0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2e97fa640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c403dcc0 0x7fd2c4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fd2e4077e20 con 0x7fd2f40a35a0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2e97fa640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd2c4043ac0 0x7fd2c4045f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2e4047e70 con 0x7fd2c4043ac0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2ebfff640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c403dcc0 0x7fd2c4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2ebfff640 10 monclient: get_auth_request con 0x7fd2c403dcc0 auth_method 0 2026-02-17T11:45:38.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e0ebd640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 msgr2=0x7fc1dc070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00127d0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e0ebd640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 0x7fc1dc070b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098a0 tx=0x7fc1d00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 10 monclient: dump: 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0bc00129b0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2f9371640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd2c4043ac0 0x7fd2c4045f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fd2f9371640 10 monclient: get_auth_request con 0x7fd2c4043ac0 auth_method 0 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 10 monclient: monmap: 2026-02-17T11:45:38.490 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0b9c03dcc0 0x7f0b9c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f0bc0052c50 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f0b9c043b30 0x7f0b9c045f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b9c046640 con 0x7f0b9c043b30 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 Processor -- start 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0046070 con 0x7fc1dc138600 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: dump: 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.491 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 1 -- start start 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0041870 con 0x7fc1dc138600 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e3949640 5 monclient: authenticate success, global_id 4235 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e3949640 10 monclient: _renew_subs 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e3949640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc074450 con 0x7fc1dc138600 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f5321640640 10 monclient: init 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7fc1cb7fe640 4 set_mon_vals no callback set 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bcb7fe640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f0b9c043b30 0x7f0b9c045f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bcbfff640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0b9c03dcc0 0x7f0b9c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bcb7fe640 10 monclient: get_auth_request con 0x7f0b9c043b30 auth_method 0 2026-02-17T11:45:38.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.411+0000 7f0bcbfff640 10 monclient: get_auth_request con 0x7f0b9c03dcc0 auth_method 0 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d003c040 con 0x7fc1dc138600 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e3949640 10 monclient: _renew_subs 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e3949640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc074a10 con 0x7fc1dc138600 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 10 monclient: dump: 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): picked mon.noname-a con 0x7f531c06cb40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f531c0a0370 0x7f531c1380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): picked mon.noname-b con 0x7f531c0a0370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c137bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52586/0 (socket says 10.20.193.51:52586) 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f531c0a0e60 0x7f531c13d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc1d0041c60 con 0x7fc1dc138600 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): picked mon.noname-c con 0x7f531c0a0e60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e3949640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1dc140990 con 0x7fc1dc138600 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 -- 10.20.193.51:0/2288374288 learned_addr learned my addr 10.20.193.51:0/2288374288 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0a16e0 con 0x7f531c06cb40 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1ac03dd60 0x7fc1ac040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f531c0a0370 0x7f531c1380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f531c06cfd0 con 0x7f531c0a0370 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f531c0a1860 con 0x7f531c0a0e60 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fc1d0077d40 con 0x7fc1dc138600 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f5321640640 10 monclient(hunting): authenticate will time out at 626.031757s 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): get_auth_request con 0x7f531c06cb40 auth_method 0 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): get_auth_request con 0x7f531c0a0370 auth_method 0 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f204bfff640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 msgr2=0x7f20541376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f204bfff640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 0x7f20541376d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098d0 tx=0x7f203c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7fc1ac043bd0 0x7fc1ac046010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1d0053e50 con 0x7fc1ac043bd0 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc1d0050060 con 0x7fc1dc138600 2026-02-17T11:45:38.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1c9ffb640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 msgr2=0x7f31dc124770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f31db7fe640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 0x7f31dc124770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02f640 tx=0x7f31cc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f531c0a0e60 0x7f531c13d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): get_auth_request con 0x7f531c0a0e60 auth_method 0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e1ebf640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7fc1ac043bd0 0x7fc1ac046010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7fc1e1ebf640 10 monclient: get_auth_request con 0x7fc1ac043bd0 auth_method 0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c046070 con 0x7f2054138600 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 10 monclient: dump: 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.496 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f20497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f205ad96640 5 monclient: authenticate success, global_id 4238 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f205ad96640 10 monclient: _renew_subs 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f205ad96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2054074b30 con 0x7f2054138600 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient(hunting): handle_auth_done global_id 4248 payload 824 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f531c0a0e60 msgr2=0x7f531c13d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f531c0a0e60 0x7f531c13d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f531c0a0370 msgr2=0x7f531c1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc03c050 con 0x7f31dc138120 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f31bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: dump: 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.497 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f531c0a0370 0x7f531c1380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.412+0000 7f531affd640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c121810 con 0x7f531c06cb40 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 5 monclient: authenticate success, global_id 4241 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 10 monclient: _renew_subs 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc126870 con 0x7f31dc138120 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f205ad96640 10 monclient: _renew_subs 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f205ad96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054072b20 con 0x7f2054138600 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 10 monclient: _renew_subs 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc073e50 con 0x7f31dc138120 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203c037e10 con 0x7f2054138600 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc048070 con 0x7f31dc138120 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c050060 con 0x7f2054138600 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc041c60 con 0x7f31dc138120 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: dump: 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.499 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 10 monclient: dump: 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f204affd640 4 set_mon_vals no callback set 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31d97fa640 4 set_mon_vals no callback set 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f205ad96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20541389e0 con 0x7f2054138600 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31dc0ab060 con 0x7f31dc138120 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f31cc04d460 con 0x7f31dc138120 2026-02-17T11:45:38.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f203c041870 con 0x7f2054138600 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7fd2ebfff640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c403dcc0 0x7fd2c4040180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40751f0 tx=0x7fd2dc006d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31a803dd60 0x7f31a8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f31cc078370 con 0x7f31dc138120 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f202403dd10 0x7f20240401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7f31a8043be0 0x7f31a8046020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31cc052e50 con 0x7f31a8043be0 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f31cc07f050 con 0x7f31dc138120 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f31bb7fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f203c077ca0 con 0x7f2054138600 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f2024043b80 0x7f2024045fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f203c04be50 con 0x7f2024043b80 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f203c07a230 con 0x7f2054138600 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.413+0000 7f20497fa640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7f205930c640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f2024043b80 0x7f2024045fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7f205930c640 10 monclient: get_auth_request con 0x7f2024043b80 auth_method 0 2026-02-17T11:45:38.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7f31da7fc640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7f31a8043be0 0x7f31a8046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7f31da7fc640 10 monclient: get_auth_request con 0x7f31a8043be0 auth_method 0 2026-02-17T11:45:38.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7f0bcbfff640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0b9c03dcc0 0x7f0b9c040180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8006fd0 tx=0x7f0bb8006d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7fc1e16be640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1ac03dd60 0x7fc1ac040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.414+0000 7fc1e16be640 10 monclient: get_auth_request con 0x7fc1ac03dd60 auth_method 0 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f531affd640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 msgr2=0x7f531c137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f531affd640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c137bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f531000c5d0 tx=0x7f531000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310016020 con 0x7f531c06cb40 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: dump: 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5310012a60 con 0x7f531c06cb40 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310012e50 con 0x7f531c06cb40 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 10 monclient: dump: 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.503 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5318ff9640 4 set_mon_vals no callback set 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 5 monclient: authenticate success, global_id 4248 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 10 monclient: _renew_subs 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c0a6b80 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 10 monclient: _renew_subs 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c121530 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f531001b400 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.415+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f531c121250 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f52e803deb0 0x7f52e8040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f5310052520 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7f52e8043d20 0x7f52e8046160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f0bcb7fe640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f0b9c043b30 0x7f0b9c045f70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f531001eeb0 con 0x7f52e8043d20 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5310059050 con 0x7f531c06cb40 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f52fb7fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T11:45:38.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7fd2f9371640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd2c4043ac0 0x7fd2c4045f00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f531b7fe640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7f52e8043d20 0x7f52e8046160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f531b7fe640 10 monclient: get_auth_request con 0x7f52e8043d20 auth_method 0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.416+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== osd.2 v2:10.20.193.51:6816/1100885920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0b9c046640 con 0x7f0b9c043b30 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.417+0000 7fc1e16be640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1ac03dd60 0x7fc1ac040220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc003ec0 tx=0x7fc1cc007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.417+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== osd.4 v2:10.20.193.142:6810/4031350650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd2e4047e70 con 0x7fd2c4043ac0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.417+0000 7fc1e1ebf640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7fc1ac043bd0 0x7fc1ac046010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.417+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== osd.0 v2:10.20.193.51:6808/3172594222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc1d0053e50 con 0x7fc1ac043bd0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.418+0000 7f31da7fc640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7f31a8043be0 0x7f31a8046020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.418+0000 7f205930c640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f2024043b80 0x7f2024045fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.418+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== osd.1 v2:10.20.193.51:6800/2218006344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f203c04be50 con 0x7f2024043b80 2026-02-17T11:45:38.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.419+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== osd.5 v2:10.20.193.142:6818/1680143311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f31cc052e50 con 0x7f31a8043be0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.420+0000 7f531b7fe640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7f52e8043d20 0x7f52e8046160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.421+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== osd.3 v2:10.20.193.142:6802/3494201988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f531001eeb0 con 0x7f52e8043d20 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.423+0000 7f31daffd640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31a803dd60 0x7f31a8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.423+0000 7f531a7fc640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f52e803deb0 0x7f52e8040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.423+0000 7f2058b0b640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f202403dd10 0x7f20240401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f31daffd640 10 monclient: get_auth_request con 0x7f31a803dd60 auth_method 0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f531a7fc640 10 monclient: get_auth_request con 0x7f52e803deb0 auth_method 0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f2058b0b640 10 monclient: get_auth_request con 0x7f202403dd10 auth_method 0 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 --> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bcc1389e0 con 0x7f0b9c043b30 2026-02-17T11:45:38.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== osd.2 v2:10.20.193.51:6816/1100885920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bcc1389e0 con 0x7f0b9c043b30 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 --> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2f4122a10 con 0x7fd2c4043ac0 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f0b9c043b30 msgr2=0x7f0b9c045f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f0b9c043b30 0x7f0b9c045f70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== osd.4 v2:10.20.193.142:6810/4031350650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2f4122a10 con 0x7fd2c4043ac0 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0b9c03dcc0 msgr2=0x7f0b9c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0b9c03dcc0 0x7f0b9c040180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8006fd0 tx=0x7f0bb8006d40 comp rx=0 tx=0).stop 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 --> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1dc137980 con 0x7fc1ac043bd0 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 10 monclient: shutdown 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 msgr2=0x7f0bcc137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 --2- 10.20.193.51:0/1456656294 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0bcc13d8a0 0x7f0bcc137b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000cb20 tx=0x7f0bc000a060 comp rx=0 tx=0).stop 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd0fb0640 1 -- 10.20.193.51:0/1456656294 reap_dead start 2026-02-17T11:45:38.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bc8ff9640 1 -- 10.20.193.51:0/1456656294 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 0 0 0) 0x7f0bc00581c0 con 0x7f0bcc13d8a0 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bc8ff9640 10 monclient: discarding stray monitor message mon_get_version_reply(handle=1 version=20) 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fc1c9ffb640 1 -- 10.20.193.51:0/639545480 <== osd.0 v2:10.20.193.51:6808/3172594222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc1dc137980 con 0x7fc1ac043bd0 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 shutdown_connections 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 >> 10.20.193.51:0/1456656294 conn(0x7f0bcc0a7460 msgr2=0x7f0bcc13ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd2c4043ac0 msgr2=0x7fd2c4045f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd2c4043ac0 0x7fd2c4045f00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.424+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 shutdown_connections 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c403dcc0 msgr2=0x7fd2c4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c403dcc0 0x7fd2c4040180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40751f0 tx=0x7fd2dc006d90 comp rx=0 tx=0).stop 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 10 monclient: shutdown 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 msgr2=0x7fd2f4137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 --2- 10.20.193.51:0/715939656 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f40a35a0 0x7fd2f4137810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009970 tx=0x7fd2e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7f0bd2a3a640 1 -- 10.20.193.51:0/1456656294 wait complete. 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2f9371640 1 -- 10.20.193.51:0/715939656 reap_dead start 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2e97fa640 1 -- 10.20.193.51:0/715939656 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 0 0 0) 0x7fd2e407e380 con 0x7fd2f40a35a0 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2e97fa640 10 monclient: discarding stray monitor message mon_get_version_reply(handle=1 version=20) 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 shutdown_connections 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 >> 10.20.193.51:0/715939656 conn(0x7fd2f40a7460 msgr2=0x7fd2f40a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 shutdown_connections 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fd2fadfb640 1 -- 10.20.193.51:0/715939656 wait complete. 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7fc1ac043bd0 msgr2=0x7fc1ac046010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7fc1ac043bd0 0x7fc1ac046010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1ac03dd60 msgr2=0x7fc1ac040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1ac03dd60 0x7fc1ac040220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc003ec0 tx=0x7fc1cc007ab0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 10 monclient: shutdown 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 msgr2=0x7fc1dc070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 --2- 10.20.193.51:0/639545480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1dc138600 0x7fc1dc070b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098a0 tx=0x7fc1d00047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e1ebf640 1 -- 10.20.193.51:0/639545480 reap_dead start 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 shutdown_connections 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 >> 10.20.193.51:0/639545480 conn(0x7fc1dc0a7460 msgr2=0x7fc1dc140280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 shutdown_connections 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.425+0000 7fc1e3949640 1 -- 10.20.193.51:0/639545480 wait complete. 2026-02-17T11:45:38.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.426+0000 7f531a7fc640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f52e803deb0 0x7f52e8040370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f531c1403d0 tx=0x7f5304009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.426+0000 7f31daffd640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31a803dd60 0x7f31a8040220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009a70 tx=0x7f31d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.426+0000 7f2058b0b640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f202403dd10 0x7f20240401d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2044005160 tx=0x7f2044007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31dc138c60 con 0x7f31a8043be0 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 --> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20540a70a0 con 0x7f2024043b80 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31bb7fe640 1 -- 10.20.193.51:0/2552637582 <== osd.5 v2:10.20.193.142:6818/1680143311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31dc138c60 con 0x7f31a8043be0 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f20497fa640 1 -- 10.20.193.51:0/2828650451 <== osd.1 v2:10.20.193.51:6800/2218006344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20540a70a0 con 0x7f2024043b80 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7f31a8043be0 msgr2=0x7f31a8046020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7f31a8043be0 0x7f31a8046020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31a803dd60 msgr2=0x7f31a8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31a803dd60 0x7f31a8040220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009a70 tx=0x7f31d0008040 comp rx=0 tx=0).stop 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 10 monclient: shutdown 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 msgr2=0x7f31dc124770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 --2- 10.20.193.51:0/2552637582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31dc138120 0x7f31dc124770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02f640 tx=0x7f31cc004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31db7fe640 1 -- 10.20.193.51:0/2552637582 reap_dead start 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 shutdown_connections 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 >> 10.20.193.51:0/2552637582 conn(0x7f31dc0aa960 msgr2=0x7f31dc071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f2024043b80 msgr2=0x7f2024045fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f2024043b80 0x7f2024045fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 shutdown_connections 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f31e1761640 1 -- 10.20.193.51:0/2552637582 wait complete. 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f202403dd10 msgr2=0x7f20240401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f202403dd10 0x7f20240401d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2044005160 tx=0x7f2044007f30 comp rx=0 tx=0).stop 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 10 monclient: shutdown 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 msgr2=0x7f20541376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 --2- 10.20.193.51:0/2828650451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2054138600 0x7f20541376d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098d0 tx=0x7f203c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205930c640 1 -- 10.20.193.51:0/2828650451 reap_dead start 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 shutdown_connections 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 >> 10.20.193.51:0/2828650451 conn(0x7f20540a7460 msgr2=0x7f20540aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 shutdown_connections 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.427+0000 7f205ad96640 1 -- 10.20.193.51:0/2828650451 wait complete. 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.428+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 --> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f531c0a0750 con 0x7f52e8043d20 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.428+0000 7f52fb7fe640 1 -- 10.20.193.51:0/2288374288 <== osd.3 v2:10.20.193.142:6802/3494201988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f531c0a0750 con 0x7f52e8043d20 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.428+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7f52e8043d20 msgr2=0x7f52e8046160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.428+0000 7f5321640640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7f52e8043d20 0x7f52e8046160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f52e803deb0 msgr2=0x7f52e8040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f52e803deb0 0x7f52e8040370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f531c1403d0 tx=0x7f5304009040 comp rx=0 tx=0).stop 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 10 monclient: shutdown 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 msgr2=0x7f531c137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 --2- 10.20.193.51:0/2288374288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f531c06cb40 0x7f531c137bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f531000c5d0 tx=0x7f531000caa0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f531b7fe640 1 -- 10.20.193.51:0/2288374288 reap_dead start 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 shutdown_connections 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 >> 10.20.193.51:0/2288374288 conn(0x7f531c0aa960 msgr2=0x7f531c0a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 shutdown_connections 2026-02-17T11:45:38.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.429+0000 7f5321640640 1 -- 10.20.193.51:0/2288374288 wait complete. 2026-02-17T11:45:38.513 INFO:teuthology.orchestra.run.trial051.stdout:51539607557 2026-02-17T11:45:38.513 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:38.513 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:38.513 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:45:38.514 INFO:teuthology.orchestra.run.trial051.stdout:51539607557 2026-02-17T11:45:38.514 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:38.514 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:38.514 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:45:38.514 INFO:teuthology.orchestra.run.trial051.stdout:47244640261 2026-02-17T11:45:38.515 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:38.515 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:38.515 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fd946ad3640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fd946ad3640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fd946ad3640 10 monclient: monmap: 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.620768+0000 2026-02-17T11:45:38.621 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.620768+0000 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fb014f90640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fb014f90640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.619+0000 7fb014f90640 10 monclient: monmap: 2026-02-17T11:45:38.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.620879+0000 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.620879+0000 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 Processor -- start 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 -- start start 2026-02-17T11:45:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient: init 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 Processor -- start 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 -- start start 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient: init 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd8b4be6640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd8b4be6640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd8b4be6640 10 monclient: monmap: 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.624 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.621469+0000 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.621469+0000 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fe4563f7640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fe4563f7640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fe4563f7640 10 monclient: monmap: 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.625 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.621479+0000 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.621479+0000 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.626 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd940138600 0x7fd9401389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-c con 0x7fd940138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9400a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fd9400a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd9400a58a0 0x7fd9400a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-a con 0x7fd9400a58a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd9400a6830 con 0x7fd9400a58a0 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd9400a2c00 con 0x7fd940138600 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400a1df0 con 0x7fd9400a35a0 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd946ad3640 10 monclient(hunting): authenticate will time out at 626.239657s 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb0100a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb01009dac0 0x7fb01009fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-c con 0x7fb01009dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0100a0110 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd9400a58a0 0x7fd9400a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9400a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd9400a58a0 0x7fd9400a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52600/0 (socket says 10.20.193.51:52600) 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01006e140 con 0x7fb0100a3bb0 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 -- 10.20.193.51:0/2950249259 learned_addr learned my addr 10.20.193.51:0/2950249259 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): get_auth_request con 0x7fd9400a58a0 auth_method 0 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01009ce60 con 0x7fb0100a0110 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb01009aed0 con 0x7fb01009dac0 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb014f90640 10 monclient(hunting): authenticate will time out at 626.239786s 2026-02-17T11:45:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): get_auth_request con 0x7fd9400a35a0 auth_method 0 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00e575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb0100a3bb0 0x7fb01009f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44262/0 (socket says 10.20.193.51:44262) 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00e575640 1 -- 10.20.193.51:0/3565498056 learned_addr learned my addr 10.20.193.51:0/3565498056 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00dd74640 1 --2- 10.20.193.51:0/3565498056 >> v2:10.20.193.142:3300/0 conn(0x7fb01009dac0 0x7fb01009fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient(hunting): handle_auth_done global_id 4251 payload 274 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 -- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 msgr2=0x7fd9400a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9400a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00dd74640 10 monclient(hunting): get_auth_request con 0x7fb01009dac0 auth_method 0 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fb00dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fe4563f7640 1 Processor -- start 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 -- 10.20.193.51:0/2950249259 >> v2:10.20.193.142:3300/0 conn(0x7fd940138600 msgr2=0x7fd9401389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 --2- 10.20.193.51:0/2950249259 >> v2:10.20.193.142:3300/0 conn(0x7fd940138600 0x7fd9401389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd945049640 1 -- 10.20.193.51:0/2950249259 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd940138f20 con 0x7fd9400a58a0 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd8b4be6640 1 Processor -- start 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.620+0000 7fd937fff640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9400a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 -- start start 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient: init 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 -- start start 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient: init 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: monmap: 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.622066+0000 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.622066+0000 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.635 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient(hunting): handle_auth_done global_id 4207 payload 274 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 1 -- 10.20.193.51:0/3565498056 >> v1:10.20.193.142:6789/0 conn(0x7fb0100a0110 legacy=0x7fb01013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 1 -- 10.20.193.51:0/3565498056 >> v1:10.20.193.51:6789/0 conn(0x7fb0100a3bb0 legacy=0x7fb01009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fb00dd74640 1 -- 10.20.193.51:0/3565498056 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01009a5c0 con 0x7fb01009dac0 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe450138600 0x7fe4501389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-c con 0x7fe450138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 0x7fe4500a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-a con 0x7fe4500a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe4500a58a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4500a1df0 con 0x7fe4500a58a0 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe4500a6830 con 0x7fe4500a35a0 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe4500a2c00 con 0x7fe450138600 2026-02-17T11:45:38.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe4563f7640 10 monclient(hunting): authenticate will time out at 626.240389s 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd8b00a0370 0x7fd8b006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-c con 0x7fd8b00a0370 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd8b00a0750 0x7fd8b00a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-a con 0x7fd8b00a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:38.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd8b0138120 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b00a24c0 con 0x7fd8b0138120 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b00ab740 con 0x7fd8b00a0750 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 0x7fe4500a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b006d080 con 0x7fd8b00a0370 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8b4be6640 10 monclient(hunting): authenticate will time out at 626.240457s 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 0x7fe4500a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52608/0 (socket says 10.20.193.51:52608) 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 1 -- 10.20.193.51:0/2433352818 learned_addr learned my addr 10.20.193.51:0/2433352818 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): get_auth_request con 0x7fe4500a35a0 auth_method 0 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd8b00a0750 0x7fd8b00a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd8b00a0750 0x7fd8b00a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52616/0 (socket says 10.20.193.51:52616) 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 -- 10.20.193.51:0/2803076527 learned_addr learned my addr 10.20.193.51:0/2803076527 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): get_auth_request con 0x7fd8b00a0750 auth_method 0 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 1 Processor -- start 2026-02-17T11:45:38.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 1 -- start start 2026-02-17T11:45:38.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: init 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient(hunting): handle_auth_done global_id 4257 payload 274 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 -- 10.20.193.51:0/2803076527 >> v2:10.20.193.142:3300/0 conn(0x7fd8b00a0370 msgr2=0x7fd8b006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 --2- 10.20.193.51:0/2803076527 >> v2:10.20.193.142:3300/0 conn(0x7fd8b00a0370 0x7fd8b006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 -- 10.20.193.51:0/2803076527 >> v1:10.20.193.51:6789/0 conn(0x7fd8b0138120 legacy=0x7fd8b01385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7fd8add74640 1 -- 10.20.193.51:0/2803076527 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b006d5f0 con 0x7fd8b00a0750 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-b con 0x7f3ce8138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.621+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3ce80a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3ce80a5a70 0x7f3ce8140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-c con 0x7f3ce80a5a70 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce80a1df0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce80a6830 con 0x7f3ce80a5a70 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce80a2c00 con 0x7f3ce8138600 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ced15e640 10 monclient(hunting): authenticate will time out at 626.241029s 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59022/0 (socket says 10.20.193.51:59022) 2026-02-17T11:45:38.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2132490143 learned_addr learned my addr 10.20.193.51:0/2132490143 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): get_auth_request con 0x7f3ce8138600 auth_method 0 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_done global_id 4250 payload 274 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2132490143 >> v2:10.20.193.142:3300/0 conn(0x7f3ce80a5a70 msgr2=0x7f3ce8140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 --2- 10.20.193.51:0/2132490143 >> v2:10.20.193.142:3300/0 conn(0x7f3ce80a5a70 0x7f3ce8140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2132490143 >> v1:10.20.193.142:6789/0 conn(0x7f3ce80a35a0 legacy=0x7f3ce80a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2132490143 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce8138f20 con 0x7f3ce8138600 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f6af27ba640 10 monclient: get_monmap_and_config 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f6af27ba640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.622+0000 7f6af27ba640 10 monclient: monmap: 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:38.623681+0000 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:38.623681+0000 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:38.648 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 Processor -- start 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 -- start start 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient: init 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 --2- 10.20.193.51:0/2433352818 >> v2:10.20.193.142:3300/0 conn(0x7fe450138600 0x7fe4501389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): get_auth_request con 0x7fe450138600 auth_method 0 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient(hunting): handle_auth_done global_id 4210 payload 274 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 -- 10.20.193.51:0/2433352818 >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 msgr2=0x7fe4500a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 --2- 10.20.193.51:0/2433352818 >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 0x7fe4500a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 -- 10.20.193.51:0/2433352818 >> v1:10.20.193.142:6789/0 conn(0x7fe4500a58a0 legacy=0x7fe45013f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fe44ffff640 1 -- 10.20.193.51:0/2433352818 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe450138f20 con 0x7fe450138600 2026-02-17T11:45:38.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2026-02-17T11:45:38.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd945049640 1 -- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 msgr2=0x7fd9400a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd945049640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd9400a5d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9400ab950 tx=0x7fd93c02f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80624fca6b41bd9f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 0x7f6aec06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-b con 0x7f6aec0a0370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6aec0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6aec13d570 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aec0a24c0 con 0x7f6aec13d570 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aec06d5f0 con 0x7f6aec0a0750 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec0ab740 con 0x7f6aec0a0370 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af27ba640 10 monclient(hunting): authenticate will time out at 626.242721s 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af0d30640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6aec13d570 0x7f6aec13f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44274/0 (socket says 10.20.193.51:44274) 2026-02-17T11:45:38.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7f6af0d30640 1 -- 10.20.193.51:0/807858385 learned_addr learned my addr 10.20.193.51:0/807858385 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 1 -- 10.20.193.51:0/2950249259 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c02fe50 con 0x7fd9400a58a0 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fb00dd74640 1 -- 10.20.193.51:0/3565498056 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 msgr2=0x7fb01009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: dump: 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.653 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fb00dd74640 1 --2- 10.20.193.51:0/3565498056 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb01009fbd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faff80098a0 tx=0x7faff8031010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c7442b6b7bf4cbd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 1 -- 10.20.193.51:0/2950249259 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c0373f0 con 0x7fd9400a58a0 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd946ad3640 5 monclient: authenticate success, global_id 4251 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd946ad3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 1 -- 10.20.193.51:0/2950249259 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0377c0 con 0x7fd9400a58a0 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd9377fe640 10 monclient: dump: 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd946ad3640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fd946ad3640 4 set_mon_vals no callback set 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fb00d573640 1 -- 10.20.193.51:0/3565498056 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff803e070 con 0x7fb01009dac0 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.623+0000 7fb00d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: dump: 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 1 -- 10.20.193.51:0/3565498056 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8039440 con 0x7fb01009dac0 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 5 monclient: authenticate success, global_id 4207 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 1 -- 10.20.193.51:0/3565498056 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8039810 con 0x7fb01009dac0 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 4 set_mon_vals no callback set 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb00d573640 10 monclient: dump: 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8add74640 1 -- 10.20.193.51:0/2803076527 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 msgr2=0x7fd8b00a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8add74640 1 --2- 10.20.193.51:0/2803076527 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b00a0b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8b006e070 tx=0x7fd89802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb7e6dfc8507d95 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 10 monclient: shutdown 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 msgr2=0x7fd9400a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd9400a5d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9400ab950 tx=0x7fd93c02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 10 monclient: shutdown 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- 10.20.193.51:0/3565498056 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 msgr2=0x7fb01009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 --2- 10.20.193.51:0/3565498056 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb01009fbd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faff80098a0 tx=0x7faff8031010 comp rx=0 tx=0).stop 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 1 -- 10.20.193.51:0/2803076527 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89803c070 con 0x7fd8b00a0750 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: dump: 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- 10.20.193.51:0/2950249259 shutdown_connections 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd9400a5d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2950249259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9400a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2950249259 >> v2:10.20.193.142:3300/0 conn(0x7fd940138600 0x7fd9401389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- 10.20.193.51:0/2950249259 >> 10.20.193.51:0/2950249259 conn(0x7fd9400a7460 msgr2=0x7fd9400a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 1 -- 10.20.193.51:0/2803076527 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89802fd80 con 0x7fd8b00a0750 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 5 monclient: authenticate success, global_id 4257 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- 10.20.193.51:0/3565498056 shutdown_connections 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 --2- 10.20.193.51:0/3565498056 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb01009fbd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 1 -- 10.20.193.51:0/2803076527 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037660 con 0x7fd8b00a0750 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 4 set_mon_vals no callback set 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- 10.20.193.51:0/3565498056 >> 10.20.193.51:0/3565498056 conn(0x7fb0100a30c0 msgr2=0x7fb0100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- 10.20.193.51:0/2950249259 shutdown_connections 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8ad573640 10 monclient: dump: 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.661 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- 10.20.193.51:0/3565498056 shutdown_connections 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- 10.20.193.51:0/2950249259 wait complete. 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- 10.20.193.51:0/3565498056 wait complete. 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 10 monclient: shutdown 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2803076527 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 msgr2=0x7fd8b00a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2803076527 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b00a0b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8b006e070 tx=0x7fd89802ee60 comp rx=0 tx=0).stop 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 10 monclient: monmap: 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2803076527 shutdown_connections 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2803076527 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b00a0b80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2803076527 >> v2:10.20.193.142:3300/0 conn(0x7fd8b00a0370 0x7fd8b006cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2803076527 >> 10.20.193.51:0/2803076527 conn(0x7fd8b00aa960 msgr2=0x7fd8b00aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 10 monclient: monmap: 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2803076527 shutdown_connections 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2803076527 wait complete. 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2132490143 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 msgr2=0x7f3ce81389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce6d76640 1 --2- 10.20.193.51:0/2132490143 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009970 tx=0x7f3cdc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e5d05dee0e73d72 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 1 --2- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 0x7f6aec06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): get_auth_request con 0x7f6aec0a0370 auth_method 0 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 Processor -- start 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 Processor -- start 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 1 -- start start 2026-02-17T11:45:38.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fb014f90640 10 monclient: init 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 1 -- start start 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7fd946ad3640 10 monclient: init 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 1 -- 10.20.193.51:0/2132490143 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc03c070 con 0x7f3ce8138600 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: dump: 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.666 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 1 -- 10.20.193.51:0/2132490143 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cdc02fdb0 con 0x7f3ce8138600 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ced15e640 5 monclient: authenticate success, global_id 4250 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ced15e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 1 -- 10.20.193.51:0/2132490143 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc037660 con 0x7f3ce8138600 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ced15e640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ced15e640 4 set_mon_vals no callback set 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient(hunting): handle_auth_done global_id 4253 payload 274 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 1 -- 10.20.193.51:0/807858385 >> v1:10.20.193.142:6789/0 conn(0x7f6aec0a0750 legacy=0x7f6aec0a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f3ce5d74640 10 monclient: dump: 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 1 -- 10.20.193.51:0/807858385 >> v1:10.20.193.51:6789/0 conn(0x7f6aec13d570 legacy=0x7f6aec13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.624+0000 7f6aebfff640 1 -- 10.20.193.51:0/807858385 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0a27a0 con 0x7f6aec0a0370 2026-02-17T11:45:38.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb0101caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-b con 0x7fb01009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient: monmap: 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 0x7fb0101bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-c con 0x7fb0100a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): picked mon.noname-a con 0x7fb0100a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100a3f90 con 0x7fb0100a3bb0 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb01009caa0 con 0x7fb01009dac0 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb0100a0540 con 0x7fb0100a0110 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb014f90640 10 monclient(hunting): authenticate will time out at 626.244101s 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9401cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-c con 0x7fd9400a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-a con 0x7fd9400a58a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd940138600 0x7fd940136870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fd940138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400a25b0 con 0x7fd9400a58a0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400a22d0 con 0x7fd940138600 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400a15f0 con 0x7fd9400a35a0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd946ad3640 10 monclient(hunting): authenticate will time out at 626.244149s 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 0x7fb0101bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52622/0 (socket says 10.20.193.51:52622) 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 1 -- 10.20.193.51:0/2363106842 learned_addr learned my addr 10.20.193.51:0/2363106842 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): get_auth_request con 0x7fb0100a3bb0 auth_method 0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): get_auth_request con 0x7fb0100a0110 auth_method 0 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9401cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52630/0 (socket says 10.20.193.51:52630) 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9401cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59052/0 (socket says 10.20.193.51:59052) 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 -- 10.20.193.51:0/2891156832 learned_addr learned my addr 10.20.193.51:0/2891156832 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): get_auth_request con 0x7fd9400a58a0 auth_method 0 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): get_auth_request con 0x7fd9400a35a0 auth_method 0 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 Processor -- start 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd944848640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 -- start start 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient: init 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient(hunting): handle_auth_done global_id 4256 payload 824 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 -- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 msgr2=0x7fb0101caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb0101caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 -- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 msgr2=0x7fb0101bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00dd74640 1 -- 10.20.193.51:0/2363106842 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01009d7b0 con 0x7fb0100a0110 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fb00ed76640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 10 monclient: shutdown 2026-02-17T11:45:38.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient(hunting): handle_auth_done global_id 4263 payload 824 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 -- 10.20.193.51:0/2132490143 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 msgr2=0x7f3ce81389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2132490143 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009970 tx=0x7f3cdc02ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 -- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 msgr2=0x7fd9401cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9401cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 -- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd940138600 msgr2=0x7fd940136870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd940138600 0x7fd940136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd937fff640 1 -- 10.20.193.51:0/2891156832 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd940127a50 con 0x7fd9400a58a0 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 -- 10.20.193.51:0/2132490143 shutdown_connections 2026-02-17T11:45:38.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2132490143 >> v2:10.20.193.142:3300/0 conn(0x7f3ce80a5a70 0x7f3ce8140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2132490143 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce8138600 0x7f3ce81389e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 -- 10.20.193.51:0/2132490143 >> 10.20.193.51:0/2132490143 conn(0x7f3ce80a7460 msgr2=0x7f3ce80a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 -- 10.20.193.51:0/2132490143 shutdown_connections 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 1 -- 10.20.193.51:0/2132490143 wait complete. 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd8b00a0370 0x7fd8b01cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-b con 0x7fd8b00a0370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b01cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-a con 0x7fd8b00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): picked mon.noname-c con 0x7fd8b0138120 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b00a10c0 con 0x7fd8b00a0750 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b00a1f00 con 0x7fd8b00a0370 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00a16e0 con 0x7fd8b0138120 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8b4be6640 10 monclient(hunting): authenticate will time out at 626.244638s 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59060/0 (socket says 10.20.193.51:59060) 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 -- 10.20.193.51:0/2216058171 learned_addr learned my addr 10.20.193.51:0/2216058171 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): get_auth_request con 0x7fd8b0138120 auth_method 0 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient(hunting): handle_auth_done global_id 4262 payload 824 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 -- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd8b00a0370 msgr2=0x7fd8b01cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd8b00a0370 0x7fd8b01cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 -- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 msgr2=0x7fd8b01cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b01cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 monclient: found mon.noname-c 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7fd8aed76640 1 -- 10.20.193.51:0/2216058171 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b0128290 con 0x7fd8b0138120 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.625+0000 7f3ced15e640 10 monclient: monmap: 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 Processor -- start 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 -- start start 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient: init 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-b con 0x7f3ce80a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce80a5a70 0x7f3ce81cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-c con 0x7f3ce80a5a70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ce8138600 0x7f3ce8122070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): picked mon.noname-a con 0x7f3ce8138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce80a25b0 con 0x7f3ce8138600 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44ffff640 1 -- 10.20.193.51:0/2433352818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe450138600 msgr2=0x7fe4501389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44ffff640 1 --2- 10.20.193.51:0/2433352818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe450138600 0x7fe4501389e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4500ab950 tx=0x7fe43c02ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e199d8e6f092fdf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce80a22d0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce80a15f0 con 0x7f3ce80a5a70 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ced15e640 10 monclient(hunting): authenticate will time out at 626.245445s 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:56858/0 (socket says 10.20.193.51:56858) 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2673977165 learned_addr learned my addr 10.20.193.51:0/2673977165 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): get_auth_request con 0x7f3ce80a35a0 auth_method 0 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 1 -- 10.20.193.51:0/2433352818 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c03c070 con 0x7fe450138600 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: dump: 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 1 -- 10.20.193.51:0/2433352818 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c02fbd0 con 0x7fe450138600 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 5 monclient: authenticate success, global_id 4210 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 1 -- 10.20.193.51:0/2433352818 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c037440 con 0x7fe450138600 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe44effd640 10 monclient: dump: 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 4 set_mon_vals no callback set 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 10 monclient: shutdown 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 -- 10.20.193.51:0/2433352818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe450138600 msgr2=0x7fe4501389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 --2- 10.20.193.51:0/2433352818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe450138600 0x7fe4501389e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4500ab950 tx=0x7fe43c02ed50 comp rx=0 tx=0).stop 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient(hunting): handle_auth_done global_id 4213 payload 824 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce80a5a70 msgr2=0x7f3ce81cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce80a5a70 0x7f3ce81cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ce8138600 msgr2=0x7f3ce8122070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ce8138600 0x7f3ce8122070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 monclient: found mon.noname-b 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 -- 10.20.193.51:0/2433352818 shutdown_connections 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2673977165 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce8126000 con 0x7f3ce80a35a0 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 --2- 10.20.193.51:0/2433352818 >> v2:10.20.193.51:3300/0 conn(0x7fe4500a35a0 0x7fe4500a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 --2- 10.20.193.51:0/2433352818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe450138600 0x7fe4501389e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 -- 10.20.193.51:0/2433352818 >> 10.20.193.51:0/2433352818 conn(0x7fe4500a7460 msgr2=0x7fe4500a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 -- 10.20.193.51:0/2433352818 shutdown_connections 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.626+0000 7fe4563f7640 1 -- 10.20.193.51:0/2433352818 wait complete. 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aebfff640 1 -- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 msgr2=0x7f6aec06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aebfff640 1 --2- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 0x7f6aec06cb40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098d0 tx=0x7f6ad802edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f4a7ded8a36cc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 1 -- 10.20.193.51:0/807858385 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad803c070 con 0x7f6aec0a0370 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: dump: 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 1 -- 10.20.193.51:0/807858385 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad802fd20 con 0x7f6aec0a0370 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 1 -- 10.20.193.51:0/807858385 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8037660 con 0x7f6aec0a0370 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 5 monclient: authenticate success, global_id 4253 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 4 set_mon_vals no callback set 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6aeaffd640 10 monclient: dump: 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.683 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient: monmap: 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 Processor -- start 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 -- start start 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb00dd74640 1 -- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 msgr2=0x7fb0101bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb00dd74640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 0x7fb0101bc910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faff803b000 tx=0x7faff80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient: init 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd937fff640 1 -- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 msgr2=0x7fd940136330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd937fff640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd92800ebe0 tx=0x7fd92800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8049020 con 0x7fb0100a0110 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: dump: 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 5 monclient: authenticate success, global_id 4256 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928017070 con 0x7fd9400a58a0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 10 monclient: _renew_subs 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8044940 con 0x7fb0100a0110 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 1 -- 10.20.193.51:0/2363106842 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0101b7df0 con 0x7fb0100a0110 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb00cd72640 4 set_mon_vals no callback set 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: dump: 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92800cdd0 con 0x7fd9400a58a0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd936ffd640 4 set_mon_vals no callback set 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 5 monclient: authenticate success, global_id 4263 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 10 monclient: _renew_subs 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928013690 con 0x7fd9400a58a0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd940127d30 con 0x7fd9400a58a0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 10 monclient: _renew_subs 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fb014f90640 1 -- 10.20.193.51:0/2363106842 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0100a1250 con 0x7fb0100a0110 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 10 monclient: _renew_subs 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9401378c0 con 0x7fd9400a58a0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd9357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd9357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd9357fa640 10 monclient: dump: 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd8aed76640 1 -- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 msgr2=0x7fd8b0124660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fd8aed76640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b9c0 tx=0x7fd8a000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 10 monclient: shutdown 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 -- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 msgr2=0x7f6aec06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 --2- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 0x7f6aec06cb40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098d0 tx=0x7f6ad802edc0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 -- 10.20.193.51:0/807858385 shutdown_connections 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 --2- 10.20.193.51:0/807858385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec0a0370 0x7f6aec06cb40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 -- 10.20.193.51:0/807858385 >> 10.20.193.51:0/807858385 conn(0x7f6aec0aa960 msgr2=0x7f6aec0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 -- 10.20.193.51:0/807858385 shutdown_connections 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7f6af27ba640 1 -- 10.20.193.51:0/807858385 wait complete. 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe4500a35a0 0x7fe4501cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-b con 0x7fe4500a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe4500a58a0 0x7fe4501367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-c con 0x7fe4500a58a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): picked mon.noname-a con 0x7fe450138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe4500a25b0 con 0x7fe450138600 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe4500a22d0 con 0x7fe4500a35a0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe4500a15f0 con 0x7fe4500a58a0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe4563f7640 10 monclient(hunting): authenticate will time out at 626.246835s 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7fe45496d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52660/0 (socket says 10.20.193.51:52660) 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 -- 10.20.193.51:0/1701378458 learned_addr learned my addr 10.20.193.51:0/1701378458 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): get_auth_request con 0x7fe450138600 auth_method 0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe4500a58a0 0x7fe4501367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): get_auth_request con 0x7fe4500a58a0 auth_method 0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44ffff640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe4500a35a0 0x7fe4501cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff803e040 con 0x7fb0100a0110 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.627+0000 7faff6ffd640 10 monclient: dump: 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.688 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44ffff640 10 monclient(hunting): get_auth_request con 0x7fe4500a35a0 auth_method 0 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe44f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient(hunting): handle_auth_done global_id 4266 payload 824 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 -- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe4500a58a0 msgr2=0x7fe4501367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7faff4ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe4500a58a0 0x7fe4501367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 -- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe4500a35a0 msgr2=0x7fe4501cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe4500a35a0 0x7fe4501cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fe45496d640 1 -- 10.20.193.51:0/1701378458 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe450127ec0 con 0x7fe450138600 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7faff4ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0006e60 con 0x7fd8b0138120 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 10 monclient: dump: 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a0010070 con 0x7fd8b0138120 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 5 monclient: authenticate success, global_id 4262 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _renew_subs 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b0126de0 con 0x7fd8b0138120 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _renew_subs 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient: build_initial_monmap 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient: monmap: 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:38.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b0073e70 con 0x7fd8b0138120 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7faff4ff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafcc005180 con 0x7fb0100a0110 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd946ad3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd946ad3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd946ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 Processor -- start 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd928024060 con 0x7fd9400a58a0 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9400a0e30 con 0x7fd9400a58a0 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 -- start start 2026-02-17T11:45:38.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient: init 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faff804e450 con 0x7fb0100a0110 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd9357fa640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 0x7fd910040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fd928052460 con 0x7fd9400a58a0 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b00a5bf0 con 0x7fd8b0138120 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-a con 0x7f6aec0a0370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6aec0a0750 0x7f6aec138600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-b con 0x7f6aec0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:38.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7fd944848640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 0x7fd910040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec13d570 0x7f6aec071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): picked mon.noname-c con 0x7f6aec13d570 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0a16e0 con 0x7f6aec0a0370 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0a1860 con 0x7f6aec0a0750 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec141080 con 0x7f6aec13d570 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd944848640 10 monclient: get_auth_request con 0x7fd91003dd60 auth_method 0 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6af27ba640 10 monclient(hunting): authenticate will time out at 626.247985s 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6aebfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd896ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000cb50 con 0x7fd8b0138120 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd896ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd8acd72640 4 set_mon_vals no callback set 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.628+0000 7f6aebfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52676/0 (socket says 10.20.193.51:52676) 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 -- 10.20.193.51:0/3762933090 learned_addr learned my addr 10.20.193.51:0/3762933090 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): get_auth_request con 0x7f6aec0a0370 auth_method 0 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd896ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fd896ffd640 10 monclient: dump: 2026-02-17T11:45:38.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient(hunting): handle_auth_done global_id 4269 payload 824 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 -- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec13d570 msgr2=0x7f6aec071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec13d570 0x7f6aec071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 -- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6aec0a0750 msgr2=0x7f6aec138600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6aec0a0750 0x7f6aec138600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 monclient: found mon.noname-a 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f6aebfff640 1 -- 10.20.193.51:0/3762933090 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0a6400 con 0x7f6aec0a0370 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ce6d76640 1 -- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 msgr2=0x7f3ce81cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ce6d76640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009aa0 tx=0x7f3cdc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc047020 con 0x7f3ce80a35a0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: dump: 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 5 monclient: authenticate success, global_id 4213 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 10 monclient: _renew_subs 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce80a44b0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 10 monclient: _renew_subs 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce8125a40 con 0x7f3ce80a35a0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cdc042670 con 0x7f3ce80a35a0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc03c040 con 0x7f3ce80a35a0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3ce5573640 4 set_mon_vals no callback set 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7f3cc77fe640 10 monclient: dump: 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3ced15e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3ced15e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3ced15e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce81378f0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3cdc042a20 con 0x7f3ce80a35a0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7fe45496d640 1 -- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 msgr2=0x7fe4501cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7fe45496d640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b990 tx=0x7fe44400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3cc77fe640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 0x7f3cb4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.630+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f3cdc077a90 con 0x7f3ce80a35a0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7faff6ffd640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 0x7fafdc0446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7faff80788b0 con 0x7fb0100a0110 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fb00e575640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 0x7fafdc0446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.629+0000 7fb00e575640 10 monclient: get_auth_request con 0x7fafdc042220 auth_method 0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444006e60 con 0x7fe450138600 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: dump: 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.696 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe444010070 con 0x7fe450138600 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 5 monclient: authenticate success, global_id 4266 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _renew_subs 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe450126c30 con 0x7fe450138600 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb01009d7b0 con 0x7fb0100a0110 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44400cc10 con 0x7fe450138600 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 10 monclient: dump: 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44e7fc640 4 set_mon_vals no callback set 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7faff6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7faff6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _renew_subs 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe450127be0 con 0x7fe450138600 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6aebfff640 1 -- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 msgr2=0x7f6aec1380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6aebfff640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098d0 tx=0x7f6ad80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fd944848640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 0x7fd910040220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd940127c60 tx=0x7fd930009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8046070 con 0x7f6aec0a0370 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: dump: 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd928050fe0 con 0x7fd9400a58a0 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fd9357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fd9357fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8041870 con 0x7f6aec0a0370 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad803c040 con 0x7f6aec0a0370 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6ae8ff9640 10 monclient: dump: 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 5 monclient: authenticate success, global_id 4269 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 10 monclient: _renew_subs 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec121c30 con 0x7f6aec0a0370 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 10 monclient: _renew_subs 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec121670 con 0x7f6aec0a0370 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6aea7fc640 4 set_mon_vals no callback set 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe444004070 con 0x7fe450138600 2026-02-17T11:45:38.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 0x7fe420040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4500a6ea0 con 0x7fe450138600 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fe4440522a0 con 0x7fe450138600 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd8a0004070 con 0x7fd8b0138120 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.631+0000 7f6af27ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6af27ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6af27ba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aec06cb40 con 0x7f6aec0a0370 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6ad8041c60 con 0x7f6aec0a0370 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fb00e575640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 0x7fafdc0446e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb004007fd0 tx=0x7fb004007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fd896ffd640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 0x7fd87c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fe44ffff640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 0x7fe420040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f3ce6575640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 0x7f3cb4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fe44ffff640 10 monclient: get_auth_request con 0x7fe42003dd60 auth_method 0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f3ce6575640 10 monclient: get_auth_request con 0x7f3cb403dd40 auth_method 0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fd8a00526a0 con 0x7fd8b0138120 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6ae8ff9640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 0x7f6ac40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f6ad8077e20 con 0x7f6aec0a0370 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fd8ae575640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 0x7fd87c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7fd8ae575640 10 monclient: get_auth_request con 0x7fd87c03dd60 auth_method 0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6aeb7fe640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 0x7f6ac40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.632+0000 7f6aeb7fe640 10 monclient: get_auth_request con 0x7f6ac403dd10 auth_method 0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fe44ffff640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 0x7fe420040220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4500aba00 tx=0x7fe43c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd8a0004390 con 0x7fd8b0138120 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fd896ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fd896ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3cdc051030 con 0x7f3ce80a35a0 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7f3cc77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7f3cc77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe4500a6ea0 con 0x7fe450138600 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fe44cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7fe44cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.634+0000 7f3ce6575640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 0x7f3cb4040200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0006d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.635+0000 7fd8ae575640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 0x7fd87c040220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40098a0 tx=0x7fd8a4006d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.637+0000 7f6aeb7fe640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 0x7f6ac40401d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6aec074bf0 tx=0x7f6adc007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.637+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6aec0a6400 con 0x7f6aec0a0370 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.637+0000 7f6ae8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:38.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.637+0000 7f6ae8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:38.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff4ff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:38.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff4ff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:38.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff4ff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fafcc005740 con 0x7fb0100a0110 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff6ffd640 1 -- 10.20.193.51:0/2363106842 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faff800e200 con 0x7fb0100a0110 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7faff6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd946ad3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd946ad3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stdout:51539607555 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd946ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd9400a5d10 con 0x7fd9400a58a0 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd9357fa640 1 -- 10.20.193.51:0/2891156832 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd928013d50 con 0x7fd9400a58a0 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd9357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.719+0000 7fd9357fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.721 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:38.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3ced15e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3ced15e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3ced15e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3ce80a5ee0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3cc77fe640 1 -- 10.20.193.51:0/2673977165 <== mon.1 v2:10.20.193.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3cdc03f2d0 con 0x7f3ce80a35a0 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3cc77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7f3cc77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stdout:51539607555 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 msgr2=0x7fafdc0446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 0x7fafdc0446e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb004007fd0 tx=0x7fb004007ba0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 10 monclient: shutdown 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 msgr2=0x7fb0101bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 0x7fb0101bc910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faff803b000 tx=0x7faff80047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 shutdown_connections 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafdc042220 0x7fafdc0446e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0100a3bb0 0x7fb0101bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0100a0110 0x7fb0101bc910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 --2- 10.20.193.51:0/2363106842 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb01009dac0 0x7fb0101caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 >> 10.20.193.51:0/2363106842 conn(0x7fb0100a30c0 msgr2=0x7fb01009e780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 shutdown_connections 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7faff4ff9640 1 -- 10.20.193.51:0/2363106842 wait complete. 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 msgr2=0x7fd910040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 0x7fd910040220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd940127c60 tx=0x7fd930009210 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 10 monclient: shutdown 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 msgr2=0x7fd940136330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd92800ebe0 tx=0x7fd92800c520 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 shutdown_connections 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd91003dd60 0x7fd910040220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd940138600 0x7fd940136870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9400a58a0 0x7fd940136330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 --2- 10.20.193.51:0/2891156832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9400a35a0 0x7fd9401cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 >> 10.20.193.51:0/2891156832 conn(0x7fd9400a7460 msgr2=0x7fd9400a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 shutdown_connections 2026-02-17T11:45:38.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.721+0000 7fd946ad3640 1 -- 10.20.193.51:0/2891156832 wait complete. 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd8b4be6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd8b4be6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd8b4be6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd8b006cb40 con 0x7fd8b0138120 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 msgr2=0x7f3cb4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 0x7f3cb4040200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0006d40 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 10 monclient: shutdown 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 msgr2=0x7f3ce81cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009aa0 tx=0x7f3cdc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 shutdown_connections 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cb403dd40 0x7f3cb4040200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ce8138600 0x7f3ce8122070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ce80a5a70 0x7f3ce81cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 --2- 10.20.193.51:0/2673977165 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ce80a35a0 0x7f3ce81cf9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd896ffd640 1 -- 10.20.193.51:0/2216058171 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8a000cd30 con 0x7fd8b0138120 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd896ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:38.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 >> 10.20.193.51:0/2673977165 conn(0x7f3ce80a7460 msgr2=0x7f3ce80a9080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7fd896ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 shutdown_connections 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.723+0000 7f3ced15e640 1 -- 10.20.193.51:0/2673977165 wait complete. 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6af27ba640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6af27ba640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6af27ba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6aec140ba0 con 0x7f6aec0a0370 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6ae8ff9640 1 -- 10.20.193.51:0/3762933090 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ad8037e10 con 0x7f6aec0a0370 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6ae8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.724+0000 7f6ae8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.726 INFO:teuthology.orchestra.run.trial051.stdout:47244640259 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe4563f7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe4563f7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe4563f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe4500a5360 con 0x7fe450138600 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 msgr2=0x7fd87c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 0x7fd87c040220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40098a0 tx=0x7fd8a4006d90 comp rx=0 tx=0).stop 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 10 monclient: shutdown 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 msgr2=0x7fd8b0124660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b9c0 tx=0x7fd8a000be90 comp rx=0 tx=0).stop 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 shutdown_connections 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd87c03dd60 0x7fd87c040220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8b0138120 0x7fd8b0124660 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd8b00a0750 0x7fd8b01cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe44cff9640 1 -- 10.20.193.51:0/1701378458 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe444050e20 con 0x7fe450138600 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe44cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:38.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fe44cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 --2- 10.20.193.51:0/2216058171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd8b00a0370 0x7fd8b01cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 >> 10.20.193.51:0/2216058171 conn(0x7fd8b00aa960 msgr2=0x7fd8b0071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 shutdown_connections 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.725+0000 7fd8b4be6640 1 -- 10.20.193.51:0/2216058171 wait complete. 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stdout:51539607555 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 msgr2=0x7f6ac40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 0x7f6ac40401d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6aec074bf0 tx=0x7f6adc007ab0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 10 monclient: shutdown 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 msgr2=0x7f6aec1380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098d0 tx=0x7f6ad80047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 shutdown_connections 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ac403dd10 0x7f6ac40401d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6aec13d570 0x7f6aec071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6aec0a0750 0x7f6aec138600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 --2- 10.20.193.51:0/3762933090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6aec0a0370 0x7f6aec1380c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 >> 10.20.193.51:0/3762933090 conn(0x7f6aec0aa960 msgr2=0x7f6aec0a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 shutdown_connections 2026-02-17T11:45:38.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.726+0000 7f6af27ba640 1 -- 10.20.193.51:0/3762933090 wait complete. 2026-02-17T11:45:38.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 msgr2=0x7fe420040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 0x7fe420040220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4500aba00 tx=0x7fe43c033000 comp rx=0 tx=0).stop 2026-02-17T11:45:38.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 10 monclient: shutdown 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 msgr2=0x7fe4501cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b990 tx=0x7fe44400be60 comp rx=0 tx=0).stop 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 shutdown_connections 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe42003dd60 0x7fe420040220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe450138600 0x7fe4501cf400 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe4500a58a0 0x7fe4501367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 --2- 10.20.193.51:0/1701378458 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe4500a35a0 0x7fe4501cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 >> 10.20.193.51:0/1701378458 conn(0x7fe4500a7460 msgr2=0x7fe4500a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 shutdown_connections 2026-02-17T11:45:38.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:38.728+0000 7fe4563f7640 1 -- 10.20.193.51:0/1701378458 wait complete. 2026-02-17T11:45:38.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.5 2026-02-17T11:45:38.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.0 2026-02-17T11:45:38.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.4 2026-02-17T11:45:38.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.1 2026-02-17T11:45:38.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.2 2026-02-17T11:45:38.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.3 2026-02-17T11:45:39.733 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:45:39.733 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:39.734 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:45:39.736 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:39.737 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:39.738 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:39.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.804+0000 7f95660c4640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.804+0000 7f95660c4640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.804+0000 7f95660c4640 10 monclient: monmap: 2026-02-17T11:45:39.808 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.808 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.808 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.805876+0000 2026-02-17T11:45:39.808 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.805876+0000 2026-02-17T11:45:39.808 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.809 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 10 monclient: monmap: 2026-02-17T11:45:39.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.806244+0000 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.806244+0000 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 Processor -- start 2026-02-17T11:45:39.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 -- start start 2026-02-17T11:45:39.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient: init 2026-02-17T11:45:39.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T11:45:39.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 1 Processor -- start 2026-02-17T11:45:39.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f956009e370 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:39.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f956009aa50 0x7f956009ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-c con 0x7f956009aa50 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f956013bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-b con 0x7f9560139950 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600a0980 con 0x7f956009e370 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f956009d600 con 0x7f956009aa50 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f956006d8e0 con 0x7f9560139950 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f95660c4640 10 monclient(hunting): authenticate will time out at 627.424775s 2026-02-17T11:45:39.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 1 -- start start 2026-02-17T11:45:39.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7fd7de1f7640 10 monclient: init 2026-02-17T11:45:39.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f956013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955f7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f956009e370 0x7f956009e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44286/0 (socket says 10.20.193.51:44286) 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955f7fe640 1 -- 10.20.193.51:0/1769818112 learned_addr learned my addr 10.20.193.51:0/1769818112 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): get_auth_request con 0x7f9560139950 auth_method 0 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955effd640 1 --2- 10.20.193.51:0/1769818112 >> v2:10.20.193.142:3300/0 conn(0x7f956009aa50 0x7f956009ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955effd640 10 monclient(hunting): get_auth_request con 0x7f956009aa50 auth_method 0 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.805+0000 7f955effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 10 monclient(hunting): handle_auth_done global_id 4268 payload 274 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 1 -- 10.20.193.51:0/1769818112 >> v2:10.20.193.142:3300/0 conn(0x7f956009aa50 msgr2=0x7f956009ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 1 --2- 10.20.193.51:0/1769818112 >> v2:10.20.193.142:3300/0 conn(0x7f956009aa50 0x7f956009ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 1 -- 10.20.193.51:0/1769818112 >> v1:10.20.193.51:6789/0 conn(0x7f956009e370 legacy=0x7f956009e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 1 monclient: found mon.noname-b 2026-02-17T11:45:39.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7f955ffff640 1 -- 10.20.193.51:0/1769818112 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956009ff30 con 0x7f9560139950 2026-02-17T11:45:39.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T11:45:39.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd7d80a3080 0x7fd7d80a3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-c con 0x7fd7d80a3080 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7d806d9d0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-b con 0x7fd7d809d2e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d806d750 con 0x7fd7d806d9d0 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d806d310 con 0x7fd7d80a3080 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d80a3ee0 con 0x7fd7d809d2e0 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7de1f7640 10 monclient(hunting): authenticate will time out at 627.425221s 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59100/0 (socket says 10.20.193.51:59100) 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2707034403 learned_addr learned my addr 10.20.193.51:0/2707034403 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request con 0x7fd7d809d2e0 auth_method 0 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d77fe640 1 --2- 10.20.193.51:0/2707034403 >> v2:10.20.193.142:3300/0 conn(0x7fd7d80a3080 0x7fd7d80a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request con 0x7fd7d80a3080 auth_method 0 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_done global_id 4271 payload 274 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2707034403 >> v2:10.20.193.142:3300/0 conn(0x7fd7d80a3080 msgr2=0x7fd7d80a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2707034403 >> v2:10.20.193.142:3300/0 conn(0x7fd7d80a3080 0x7fd7d80a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2707034403 >> v1:10.20.193.51:6789/0 conn(0x7fd7d806d9d0 legacy=0x7fd7d8137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 monclient: found mon.noname-b 2026-02-17T11:45:39.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.806+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2707034403 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d809c620 con 0x7fd7d809d2e0 2026-02-17T11:45:39.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.807+0000 7fda11ad3640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.807+0000 7fda11ad3640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.807+0000 7fda11ad3640 10 monclient: monmap: 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.808618+0000 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.808618+0000 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.861 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 Processor -- start 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 -- start start 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient: init 2026-02-17T11:45:39.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fda0c0a0370 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fda0c0a0e60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fda0c13d570 0x7fda0c13f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-c con 0x7fda0c13d570 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0c0a24c0 con 0x7fda0c0a0370 2026-02-17T11:45:39.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fda0c0ab740 con 0x7fda0c13d570 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fda0c06d080 con 0x7fda0c0a0e60 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda11ad3640 10 monclient(hunting): authenticate will time out at 627.427452s 2026-02-17T11:45:39.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955ffff640 1 -- 10.20.193.51:0/1769818112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 msgr2=0x7f956013bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955ffff640 1 --2- 10.20.193.51:0/1769818112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f956013bd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9554009d90 tx=0x7f955402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e399ccd37e4dc8f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59106/0 (socket says 10.20.193.51:59106) 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fda0c13d570 0x7fda0c13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 -- 10.20.193.51:0/540253316 learned_addr learned my addr 10.20.193.51:0/540253316 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): get_auth_request con 0x7fda0c0a0e60 auth_method 0 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): get_auth_request con 0x7fda0c13d570 auth_method 0 2026-02-17T11:45:39.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 1 -- 10.20.193.51:0/1769818112 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955403c070 con 0x7f9560139950 2026-02-17T11:45:39.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:39.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: dump: 2026-02-17T11:45:39.868 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 1 -- 10.20.193.51:0/1769818112 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9554037440 con 0x7f9560139950 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 5 monclient: authenticate success, global_id 4268 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:39.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 1 -- 10.20.193.51:0/1769818112 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554037810 con 0x7f9560139950 2026-02-17T11:45:39.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 4 set_mon_vals no callback set 2026-02-17T11:45:39.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f955e7fc640 10 monclient: dump: 2026-02-17T11:45:39.872 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.872 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.873 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient(hunting): handle_auth_done global_id 4274 payload 274 2026-02-17T11:45:39.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 -- 10.20.193.51:0/540253316 >> v2:10.20.193.142:3300/0 conn(0x7fda0c13d570 msgr2=0x7fda0c13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 --2- 10.20.193.51:0/540253316 >> v2:10.20.193.142:3300/0 conn(0x7fda0c13d570 0x7fda0c13f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 -- 10.20.193.51:0/540253316 >> v1:10.20.193.142:6789/0 conn(0x7fda0c0a0370 legacy=0x7fda0c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 monclient: found mon.noname-b 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fda0affd640 1 -- 10.20.193.51:0/540253316 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c06d5f0 con 0x7fda0c0a0e60 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 10 monclient: shutdown 2026-02-17T11:45:39.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 -- 10.20.193.51:0/1769818112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 msgr2=0x7f956013bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 --2- 10.20.193.51:0/1769818112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f956013bd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9554009d90 tx=0x7f955402f190 comp rx=0 tx=0).stop 2026-02-17T11:45:39.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2707034403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 msgr2=0x7fd7d80a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2707034403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80771c0 tx=0x7fd7cc02f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87709aea45d4dc1c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 -- 10.20.193.51:0/1769818112 shutdown_connections 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 --2- 10.20.193.51:0/1769818112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f956013bd40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 --2- 10.20.193.51:0/1769818112 >> v2:10.20.193.142:3300/0 conn(0x7f956009aa50 0x7f956009ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.808+0000 7f95660c4640 1 -- 10.20.193.51:0/1769818112 >> 10.20.193.51:0/1769818112 conn(0x7f95600a30c0 msgr2=0x7f95600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- 10.20.193.51:0/1769818112 shutdown_connections 2026-02-17T11:45:39.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- 10.20.193.51:0/1769818112 wait complete. 2026-02-17T11:45:39.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 1 -- 10.20.193.51:0/2707034403 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0373f0 con 0x7fd7d809d2e0 2026-02-17T11:45:39.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:39.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: dump: 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 1 -- 10.20.193.51:0/2707034403 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc037590 con 0x7fd7d809d2e0 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 1 -- 10.20.193.51:0/2707034403 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc037960 con 0x7fd7d809d2e0 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 5 monclient: authenticate success, global_id 4271 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7d67fc640 10 monclient: dump: 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.880 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 4 set_mon_vals no callback set 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient: monmap: 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 Processor -- start 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 10 monclient: shutdown 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2707034403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 msgr2=0x7fd7d80a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2707034403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80771c0 tx=0x7fd7cc02f2a0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- start start 2026-02-17T11:45:39.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient: init 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2707034403 shutdown_connections 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2707034403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d80a39a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2707034403 >> v2:10.20.193.142:3300/0 conn(0x7fd7d80a3080 0x7fd7d80a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2707034403 >> 10.20.193.51:0/2707034403 conn(0x7fd7d806ed20 msgr2=0x7fd7d806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2707034403 shutdown_connections 2026-02-17T11:45:39.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2707034403 wait complete. 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f956009aa50 0x7f9560138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-b con 0x7f956009aa50 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f956009e370 0x7f95601393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-a con 0x7f956009e370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): picked mon.noname-c con 0x7f9560139950 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f95600a3e20 con 0x7f956009e370 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f956006e140 con 0x7f956009aa50 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f95600a3fa0 con 0x7f9560139950 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f95660c4640 10 monclient(hunting): authenticate will time out at 627.428886s 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f956009e370 0x7f95601393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59112/0 (socket says 10.20.193.51:59112) 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 1 -- 10.20.193.51:0/3173013258 learned_addr learned my addr 10.20.193.51:0/3173013258 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): get_auth_request con 0x7f9560139950 auth_method 0 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955effd640 10 monclient(hunting): get_auth_request con 0x7f956009e370 auth_method 0 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.809+0000 7f955ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 10 monclient(hunting): handle_auth_done global_id 4277 payload 824 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 -- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f956009aa50 msgr2=0x7f9560138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f956009aa50 0x7f9560138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 -- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f956009e370 msgr2=0x7f95601393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f956009e370 0x7f95601393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 monclient: found mon.noname-c 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7f955ffff640 1 -- 10.20.193.51:0/3173013258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560093b60 con 0x7f9560139950 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient: monmap: 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:39.896 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 Processor -- start 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 -- start start 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient: init 2026-02-17T11:45:39.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7d81cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-b con 0x7fd7d806d9d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d81248a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-c con 0x7fd7d809d2e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): picked mon.noname-a con 0x7fd7d80a3080 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81386f0 con 0x7fd7d80a3080 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d8138570 con 0x7fd7d806d9d0 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d8138870 con 0x7fd7d809d2e0 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7de1f7640 10 monclient(hunting): authenticate will time out at 627.429928s 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7d7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7d7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52696/0 (socket says 10.20.193.51:52696) 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 learned_addr learned my addr 10.20.193.51:0/2358150523 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request con 0x7fd7d80a3080 auth_method 0 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.810+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d77fe640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7d81cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request con 0x7fd7d806d9d0 auth_method 0 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_done global_id 4275 payload 824 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 msgr2=0x7fd7d81248a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7d81248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 msgr2=0x7fd7d81cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7d81cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 monclient: found mon.noname-a 2026-02-17T11:45:39.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d80a1030 con 0x7fd7d80a3080 2026-02-17T11:45:39.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0affd640 1 -- 10.20.193.51:0/540253316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 msgr2=0x7fda0c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0affd640 1 --2- 10.20.193.51:0/540253316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009970 tx=0x7fd9fc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def6129cdeab2d93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 1 -- 10.20.193.51:0/540253316 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03c070 con 0x7fda0c0a0e60 2026-02-17T11:45:39.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: dump: 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 1 -- 10.20.193.51:0/540253316 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc02fcd0 con 0x7fda0c0a0e60 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 1 -- 10.20.193.51:0/540253316 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc037660 con 0x7fda0c0a0e60 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 5 monclient: authenticate success, global_id 4274 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 4 set_mon_vals no callback set 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda0a7fc640 10 monclient: dump: 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 10 monclient: shutdown 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 -- 10.20.193.51:0/540253316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 msgr2=0x7fda0c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 --2- 10.20.193.51:0/540253316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009970 tx=0x7fd9fc02ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 -- 10.20.193.51:0/540253316 shutdown_connections 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 --2- 10.20.193.51:0/540253316 >> v2:10.20.193.142:3300/0 conn(0x7fda0c13d570 0x7fda0c13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 --2- 10.20.193.51:0/540253316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c06cb40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 -- 10.20.193.51:0/540253316 >> 10.20.193.51:0/540253316 conn(0x7fda0c0aa960 msgr2=0x7fda0c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 -- 10.20.193.51:0/540253316 shutdown_connections 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.811+0000 7fda11ad3640 1 -- 10.20.193.51:0/540253316 wait complete. 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient: monmap: 2026-02-17T11:45:39.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f955ffff640 1 -- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 msgr2=0x7f9560090190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f955ffff640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f955402f6a0 tx=0x7f9554004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554045020 con 0x7f9560139950 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: dump: 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 Processor -- start 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955403d040 con 0x7f9560139950 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 5 monclient: authenticate success, global_id 4277 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _renew_subs 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956013e230 con 0x7f9560139950 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955403c070 con 0x7f9560139950 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f955dffb640 4 set_mon_vals no callback set 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 10 monclient: dump: 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.907 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 -- start start 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient: init 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _renew_subs 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560092290 con 0x7f9560139950 2026-02-17T11:45:39.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:39.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda0c0a0370 0x7fda0c1ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-a con 0x7fda0c0a0370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-c con 0x7fda0c0a0e60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda0c13d570 0x7fda0c072a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fda0c13d570 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0a16e0 con 0x7fda0c0a0370 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0a1f00 con 0x7fda0c13d570 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fda0c0a1860 con 0x7fda0c0a0e60 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda11ad3640 10 monclient(hunting): authenticate will time out at 627.431674s 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59124/0 (socket says 10.20.193.51:59124) 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 -- 10.20.193.51:0/172326796 learned_addr learned my addr 10.20.193.51:0/172326796 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): get_auth_request con 0x7fda0c0a0e60 auth_method 0 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient(hunting): handle_auth_done global_id 4280 payload 824 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 -- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda0c13d570 msgr2=0x7fda0c072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda0c13d570 0x7fda0c072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 -- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda0c0a0370 msgr2=0x7fda0c1ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda0c0a0370 0x7fda0c1ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 monclient: found mon.noname-c 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7fda0affd640 1 -- 10.20.193.51:0/172326796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c13f9f0 con 0x7fda0c0a0e60 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f955404a400 con 0x7f9560139950 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.812+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956013dd70 con 0x7f9560139950 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7f953bfff640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 0x7f95300401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f95540781a0 con 0x7f9560139950 2026-02-17T11:45:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 msgr2=0x7fd7d8124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009f50 tx=0x7fd7cc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7f955f7fe640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 0x7f95300401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7f955f7fe640 10 monclient: get_auth_request con 0x7f953003dd10 auth_method 0 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc046020 con 0x7fd7d80a3080 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: dump: 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.914 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc037e10 con 0x7fd7d80a3080 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0373f0 con 0x7fd7d80a3080 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7b3fff640 10 monclient: dump: 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7d5ffb640 4 set_mon_vals no callback set 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 5 monclient: authenticate success, global_id 4275 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _renew_subs 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d80a7100 con 0x7fd7d80a3080 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _renew_subs 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d8128550 con 0x7fd7d80a3080 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.813+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d8137e60 con 0x7fd7d80a3080 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd7cc041450 con 0x7fd7d80a3080 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 msgr2=0x7fd7d8124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 msgr2=0x7fd7d8124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009f50 tx=0x7fd7cc004b40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009f50 tx=0x7fd7cc004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 0x7fd7a80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 msgr2=0x7fd7d8124de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7d80a3080 0x7fd7d8124de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7a80428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): picked mon.b con 0x7fd7d806d9d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 0x7fd7a8045610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): picked mon.a con 0x7fd7a8043180 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7a80480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): picked mon.c con 0x7fd7d809d2e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8048ab0 con 0x7fd7a8043180 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8048c30 con 0x7fd7d806d9d0 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a8048db0 con 0x7fd7d809d2e0 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7b3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 0x7fd7a8045610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request con 0x7fd7a8043180 auth_method 0 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7a80480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d6ffd640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7a80428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request con 0x7fd7d809d2e0 auth_method 0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 0x7fd7a80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d6ffd640 10 monclient(hunting): get_auth_request con 0x7fd7d806d9d0 auth_method 0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): get_auth_request con 0x7fd7a803dd10 auth_method 0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient(hunting): handle_auth_done global_id 4275 payload 293 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 msgr2=0x7fd7a80480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7a80480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 msgr2=0x7fd7a80428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7a80428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 monclient: found mon.a 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7fd7a8048fb0 con 0x7fd7a8043180 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d8137e60 con 0x7fd7a8043180 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.814+0000 7fd7d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda0affd640 1 -- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 msgr2=0x7fda0c138430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda0affd640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009aa0 tx=0x7fd9fc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7f955f7fe640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 0x7f95300401d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f954c007fd0 tx=0x7f954c007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc046020 con 0x7fda0c0a0e60 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: dump: 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc042620 con 0x7fda0c0a0e60 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03c040 con 0x7fda0c0a0e60 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda11ad3640 5 monclient: authenticate success, global_id 4280 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda11ad3640 10 monclient: _renew_subs 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda09ffb640 4 set_mon_vals no callback set 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda11ad3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c0a1b50 con 0x7fda0c0a0e60 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.815+0000 7fd9e7fff640 10 monclient: dump: 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 10 monclient: _renew_subs 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c122dc0 con 0x7fda0c0a0e60 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f955404f020 con 0x7f9560139950 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7f953bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7f953bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd9fc03f030 con 0x7fda0c0a0e60 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd9e7fff640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 0x7fd9dc040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0c06cb40 con 0x7fda0c0a0e60 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fd9fc077480 con 0x7fda0c0a0e60 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7d7fff640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 msgr2=0x7fd7a8045610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7d7fff640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 0x7fd7a8045610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc03fee0 tx=0x7fd7cc033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc042400 con 0x7fd7a8043180 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 10 monclient: dump: 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc058090 con 0x7fd7a8043180 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.816+0000 7fd7d57fa640 4 set_mon_vals no callback set 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.817+0000 7fda0b7fe640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 0x7fd9dc040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.817+0000 7fda0b7fe640 10 monclient: get_auth_request con 0x7fd9dc03dd60 auth_method 0 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.817+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd7cc041c90 con 0x7fd7a8043180 2026-02-17T11:45:39.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.817+0000 7fd7d77fe640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 0x7fd7a80401d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40165c0 tx=0x7fd7c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.817+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 4 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fd7cc0625d0 con 0x7fd7a8043180 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd9fc050070 con 0x7fda0c0a0e60 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd9e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd9e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd7cc050030 con 0x7fd7a8043180 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd7b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fd7b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.819+0000 7fda0b7fe640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 0x7fd9dc040220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8003ec0 tx=0x7fd9f8007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fad808db640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fad808db640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fad808db640 10 monclient: monmap: 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.848689+0000 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.848689+0000 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fed50523640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fed50523640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.847+0000 7fed50523640 10 monclient: monmap: 2026-02-17T11:45:39.925 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.848714+0000 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.848714+0000 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 Processor -- start 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 Processor -- start 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 -- start start 2026-02-17T11:45:39.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient: init 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 -- start start 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient: init 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): picked mon.noname-a con 0x7fad7806d180 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad7809c8a0 0x7fad780a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): picked mon.noname-b con 0x7fad7809c8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fad780a3090 0x7fad7813e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): picked mon.noname-c con 0x7fad780a3090 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:39.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fad7806d560 con 0x7fad7806d180 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fad7809c480 con 0x7fad780a3090 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fad7809b420 con 0x7fad7809c8a0 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad808db640 10 monclient(hunting): authenticate will time out at 627.467483s 2026-02-17T11:45:39.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fed480a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fed480a0750 0x7fed4809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): picked mon.noname-a con 0x7fed480a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): picked mon.noname-b con 0x7fed4813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4806e140 con 0x7fed480a3bb0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fed4809f910 con 0x7fed480a0750 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fed4809ccd0 con 0x7fed4813b760 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed50523640 10 monclient(hunting): authenticate will time out at 627.467562s 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad7809c8a0 0x7fad780a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad7809c8a0 0x7fad780a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59130/0 (socket says 10.20.193.51:59130) 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 1 -- 10.20.193.51:0/1552879321 learned_addr learned my addr 10.20.193.51:0/1552879321 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): get_auth_request con 0x7fad7806d180 auth_method 0 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fed480a0750 0x7fed4809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59136/0 (socket says 10.20.193.51:59136) 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 -- 10.20.193.51:0/780689483 learned_addr learned my addr 10.20.193.51:0/780689483 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): get_auth_request con 0x7fed4813b760 auth_method 0 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): get_auth_request con 0x7fad7809c8a0 auth_method 0 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): get_auth_request con 0x7fed480a0750 auth_method 0 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.142:3300/0 conn(0x7fad780a3090 0x7fad7813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 10 monclient(hunting): get_auth_request con 0x7fad780a3090 auth_method 0 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 10 monclient: get_monmap_and_config 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 10 monclient: monmap: 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:39.849463+0000 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:39.849463+0000 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient(hunting): handle_auth_done global_id 4278 payload 274 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 -- 10.20.193.51:0/780689483 >> v2:10.20.193.51:3300/0 conn(0x7fed480a0750 msgr2=0x7fed4809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad7809c8a0 msgr2=0x7fad780a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad7809c8a0 0x7fad780a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 --2- 10.20.193.51:0/780689483 >> v2:10.20.193.51:3300/0 conn(0x7fed480a0750 0x7fed4809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 -- 10.20.193.51:0/780689483 >> v1:10.20.193.51:6789/0 conn(0x7fed480a3bb0 legacy=0x7fed4809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> v2:10.20.193.142:3300/0 conn(0x7fad780a3090 msgr2=0x7fad7813e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.142:3300/0 conn(0x7fad780a3090 0x7fad7813e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 monclient: found mon.noname-b 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fed4ea99640 1 -- 10.20.193.51:0/780689483 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4809eec0 con 0x7fed4813b760 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 monclient: found mon.noname-a 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7809bbe0 con 0x7fad7806d180 2026-02-17T11:45:39.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7fad7ee51640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.142:3300/0 conn(0x7fad780a3090 0x7fad7813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 1 Processor -- start 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 1 -- start start 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.848+0000 7f3b11a87640 10 monclient: init 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3b0c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c0a0750 0x7f3b0c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-b con 0x7f3b0c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3b0c13b760 0x7f3b0c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-a con 0x7f3b0c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c06e140 con 0x7f3b0c0a3bb0 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c09f910 con 0x7f3b0c13b760 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c09ccd0 con 0x7f3b0c0a0750 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b11a87640 10 monclient(hunting): authenticate will time out at 627.468455s 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b0affd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3b0c0a3bb0 0x7f3b0c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44296/0 (socket says 10.20.193.51:44296) 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.849+0000 7f3b0affd640 1 -- 10.20.193.51:0/128661882 learned_addr learned my addr 10.20.193.51:0/128661882 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4ea99640 1 -- 10.20.193.51:0/780689483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 msgr2=0x7fed4813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4ea99640 1 --2- 10.20.193.51:0/780689483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fed4806f3c0 tx=0x7fed4402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb764a68386fca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 msgr2=0x7fad780a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 msgr2=0x7fad780a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7fad7806e530 tx=0x7fad7002ede0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:39.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/128661882 >> v2:10.20.193.51:3300/0 conn(0x7f3b0c13b760 0x7f3b0c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c0a0750 0x7f3b0c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): get_auth_request con 0x7f3b0c13b760 auth_method 0 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): get_auth_request con 0x7f3b0c0a0750 auth_method 0 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 1 -- 10.20.193.51:0/780689483 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4402fe60 con 0x7fed4813b760 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: dump: 2026-02-17T11:45:39.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 5 monclient: authenticate success, global_id 4283 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 1 -- 10.20.193.51:0/780689483 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed440373f0 con 0x7fed4813b760 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 1 -- 10.20.193.51:0/780689483 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed440377c0 con 0x7fed4813b760 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_done global_id 4284 payload 274 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 4 set_mon_vals no callback set 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed4d296640 10 monclient: dump: 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c0a0750 msgr2=0x7f3b0c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c0a0750 0x7f3b0c09e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/128661882 >> v1:10.20.193.51:6789/0 conn(0x7f3b0c0a3bb0 legacy=0x7f3b0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/128661882 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c09eec0 con 0x7f3b0c13b760 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 10 monclient: shutdown 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 -- 10.20.193.51:0/780689483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 msgr2=0x7fed4813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 --2- 10.20.193.51:0/780689483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fed4806f3c0 tx=0x7fed4402f230 comp rx=0 tx=0).stop 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 -- 10.20.193.51:0/780689483 shutdown_connections 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 --2- 10.20.193.51:0/780689483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed4813db50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 --2- 10.20.193.51:0/780689483 >> v2:10.20.193.51:3300/0 conn(0x7fed480a0750 0x7fed4809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 -- 10.20.193.51:0/780689483 >> 10.20.193.51:0/780689483 conn(0x7fed480a30c0 msgr2=0x7fed480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 -- 10.20.193.51:0/780689483 shutdown_connections 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.851+0000 7fed50523640 1 -- 10.20.193.51:0/780689483 wait complete. 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient: monmap: 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 Processor -- start 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 -- start start 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient: init 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 0x7fed480950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): picked mon.noname-b con 0x7fed480a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fed480a3bb0 0x7fed48095620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): picked mon.noname-a con 0x7fed480a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): picked mon.noname-c con 0x7fed4813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fed480a04b0 con 0x7fed480a3bb0 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fed4809c850 con 0x7fed480a0750 2026-02-17T11:45:39.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fed4809e710 con 0x7fed4813b760 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed50523640 10 monclient(hunting): authenticate will time out at 627.471840s 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fed480a3bb0 0x7fed48095620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59148/0 (socket says 10.20.193.51:59148) 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 1 -- 10.20.193.51:0/3775307188 learned_addr learned my addr 10.20.193.51:0/3775307188 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): get_auth_request con 0x7fed4813b760 auth_method 0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): get_auth_request con 0x7fed480a3bb0 auth_method 0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4ea99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.852+0000 7fed4da97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 10 monclient(hunting): handle_auth_done global_id 4292 payload 824 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4e298640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 0x7fed480950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 -- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 msgr2=0x7fed480950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 0x7fed480950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 -- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fed480a3bb0 msgr2=0x7fed48095620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fed480a3bb0 0x7fed48095620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 monclient: found mon.noname-c 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4ea99640 1 -- 10.20.193.51:0/3775307188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed48098b20 con 0x7fed4813b760 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4e298640 10 monclient: get_auth_request con 0x7fed480a0750 auth_method 0 2026-02-17T11:45:39.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.853+0000 7fed4e298640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 0x7fed480950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c13b760 msgr2=0x7f3b0c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c13b760 0x7f3b0c13db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c09f230 tx=0x7f3afc02f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23b445ed9222b11 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 1 -- 10.20.193.51:0/128661882 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc03c070 con 0x7f3b0c13b760 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: dump: 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 1 -- 10.20.193.51:0/128661882 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc037440 con 0x7f3b0c13b760 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 1 -- 10.20.193.51:0/128661882 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037810 con 0x7f3b0c13b760 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 5 monclient: authenticate success, global_id 4284 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 4 set_mon_vals no callback set 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b09ffb640 10 monclient: dump: 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.940 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 10 monclient: shutdown 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 -- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c13b760 msgr2=0x7f3b0c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c13b760 0x7f3b0c13db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c09f230 tx=0x7f3afc02f130 comp rx=0 tx=0).stop 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 -- 10.20.193.51:0/128661882 shutdown_connections 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c13b760 0x7f3b0c13db50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 --2- 10.20.193.51:0/128661882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c0a0750 0x7f3b0c09e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 -- 10.20.193.51:0/128661882 >> 10.20.193.51:0/128661882 conn(0x7f3b0c0a30c0 msgr2=0x7f3b0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 -- 10.20.193.51:0/128661882 shutdown_connections 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.854+0000 7f3b11a87640 1 -- 10.20.193.51:0/128661882 wait complete. 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient: build_initial_monmap 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient: monmap: 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed4ea99640 1 -- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 msgr2=0x7fed48095b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed4ea99640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed44009f50 tx=0x7fed44004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 Processor -- start 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 -- start start 2026-02-17T11:45:39.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient: init 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44046020 con 0x7fed4813b760 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: dump: 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed44037e40 con 0x7fed4813b760 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44041ab0 con 0x7fed4813b760 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 10 monclient: dump: 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.942 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed4ca95640 4 set_mon_vals no callback set 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 5 monclient: authenticate success, global_id 4292 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 10 monclient: _renew_subs 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed48098e00 con 0x7fed4813b760 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 10 monclient: _renew_subs 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4809d7b0 con 0x7fed4813b760 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 0x7f3b0c09be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-b con 0x7f3b0c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 0x7f3b0c132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-a con 0x7f3b0c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): picked mon.noname-c con 0x7f3b0c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0a04b0 con 0x7f3b0c0a3bb0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c09c850 con 0x7f3b0c0a0750 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c09e710 con 0x7f3b0c13b760 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b11a87640 10 monclient(hunting): authenticate will time out at 627.474676s 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 0x7f3b0c132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59152/0 (socket says 10.20.193.51:59152) 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 0x7f3b0c132630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52758/0 (socket says 10.20.193.51:52758) 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/101412821 learned_addr learned my addr 10.20.193.51:0/101412821 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): get_auth_request con 0x7f3b0c13b760 auth_method 0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): get_auth_request con 0x7f3b0c0a3bb0 auth_method 0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 0x7f3b0c09be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 10 monclient(hunting): get_auth_request con 0x7f3b0c0a0750 auth_method 0 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:39.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient(hunting): handle_auth_done global_id 4295 payload 824 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 msgr2=0x7f3b0c09be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 0x7f3b0c09be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 msgr2=0x7f3b0c132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 0x7f3b0c132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/101412821 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c135fb0 con 0x7f3b0c13b760 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7f3b0affd640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 0x7f3b0c09be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.855+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fed44041cd0 con 0x7fed4813b760 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed50523640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed50523640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed50523640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4809dac0 con 0x7fed4813b760 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed2effd640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 0x7fed180401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fed44078230 con 0x7fed4813b760 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed4e298640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 0x7fed180401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.856+0000 7fed4e298640 10 monclient: get_auth_request con 0x7fed1803dd10 auth_method 0 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b0b7fe640 1 -- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 msgr2=0x7f3b0c132b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:39.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b0b7fe640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e90 tx=0x7f3afc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc03c050 con 0x7f3b0c13b760 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: dump: 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc048070 con 0x7f3b0c13b760 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc041a50 con 0x7f3b0c13b760 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b097fa640 4 set_mon_vals no callback set 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3ae3fff640 10 monclient: dump: 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 5 monclient: authenticate success, global_id 4295 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 10 monclient: _renew_subs 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c134de0 con 0x7f3b0c13b760 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fed44050030 con 0x7fed4813b760 2026-02-17T11:45:39.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7fed2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7fed2effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 10 monclient: _renew_subs 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c135cd0 con 0x7f3b0c13b760 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.858+0000 7fed4e298640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 0x7fed180401d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed38004020 tx=0x7fed38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3afc041bf0 con 0x7f3b0c13b760 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b11a87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b11a87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b11a87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c06a290 con 0x7f3b0c13b760 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3ae3fff640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 0x7f3adc040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f3afc078240 con 0x7f3b0c13b760 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b0affd640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 0x7f3adc040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:39.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.859+0000 7f3b0affd640 10 monclient: get_auth_request con 0x7f3adc03dd60 auth_method 0 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.861+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3b0c06a290 con 0x7f3b0c13b760 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.861+0000 7f3ae3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.861+0000 7f3ae3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.861+0000 7f3b0affd640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 0x7f3adc040220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b00005360 tx=0x7f3b00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.901+0000 7f95660c4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.901+0000 7f95660c4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.901+0000 7f95660c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.901+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f956009dd10 con 0x7f9560139950 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.902+0000 7f953bfff640 1 -- 10.20.193.51:0/3173013258 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9554076d20 con 0x7f9560139950 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.902+0000 7f953bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.902+0000 7f953bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stdout:51539607556 2026-02-17T11:45:39.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 msgr2=0x7f95300401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 0x7f95300401d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f954c007fd0 tx=0x7f954c007ba0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 10 monclient: shutdown 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 msgr2=0x7f9560090190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f955402f6a0 tx=0x7f9554004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 shutdown_connections 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f953003dd10 0x7f95300401d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9560139950 0x7f9560090190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f956009e370 0x7f95601393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 --2- 10.20.193.51:0/3173013258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f956009aa50 0x7f9560138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 >> 10.20.193.51:0/3173013258 conn(0x7f95600a30c0 msgr2=0x7f956009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.903+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 shutdown_connections 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.904+0000 7f95660c4640 1 -- 10.20.193.51:0/3173013258 wait complete. 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.904+0000 7fda11ad3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.904+0000 7fda11ad3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.904+0000 7fda11ad3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.904+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fda0c069780 con 0x7fda0c0a0e60 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.905+0000 7fd9e7fff640 1 -- 10.20.193.51:0/172326796 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9fc03f350 con 0x7fda0c0a0e60 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.905+0000 7fd9e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.905+0000 7fd9e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:39.949 INFO:teuthology.orchestra.run.trial051.stdout:51539607555 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 msgr2=0x7fd9dc040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 0x7fd9dc040220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8003ec0 tx=0x7fd9f8007ab0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 10 monclient: shutdown 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 msgr2=0x7fda0c138430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009aa0 tx=0x7fd9fc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 shutdown_connections 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd9dc03dd60 0x7fd9dc040220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda0c13d570 0x7fda0c072a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda0c0a0e60 0x7fda0c138430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 --2- 10.20.193.51:0/172326796 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda0c0a0370 0x7fda0c1ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 >> 10.20.193.51:0/172326796 conn(0x7fda0c0aa960 msgr2=0x7fda0c13e680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 shutdown_connections 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.907+0000 7fda11ad3640 1 -- 10.20.193.51:0/172326796 wait complete. 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7de1f7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7de1f7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7de1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd7d8069780 con 0x7fd7a8043180 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7b3fff640 1 -- 10.20.193.51:0/2358150523 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7cc0623f0 con 0x7fd7a8043180 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.909+0000 7fd7b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:39.950 INFO:teuthology.orchestra.run.trial051.stdout:51539607555 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 msgr2=0x7fd7a80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 0x7fd7a80401d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40165c0 tx=0x7fd7c4008040 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 10 monclient: shutdown 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 msgr2=0x7fd7a8045610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 0x7fd7a8045610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc03fee0 tx=0x7fd7cc033000 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 shutdown_connections 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7d809d2e0 0x7fd7a80480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7a8043180 0x7fd7a8045610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7d806d9d0 0x7fd7a80428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 --2- 10.20.193.51:0/2358150523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd7a803dd10 0x7fd7a80401d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 >> 10.20.193.51:0/2358150523 conn(0x7fd7d806ed20 msgr2=0x7fd7d809f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 shutdown_connections 2026-02-17T11:45:39.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.911+0000 7fd7de1f7640 1 -- 10.20.193.51:0/2358150523 wait complete. 2026-02-17T11:45:39.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.0 2026-02-17T11:45:39.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.5 2026-02-17T11:45:39.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.4 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3b11a87640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3b11a87640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3b11a87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3b0c09dac0 con 0x7f3b0c13b760 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3ae3fff640 1 -- 10.20.193.51:0/101412821 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3afc076dc0 con 0x7f3b0c13b760 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3ae3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.946+0000 7f3ae3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:39.952 INFO:teuthology.orchestra.run.trial051.stdout:51539607558 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed50523640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed50523640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed50523640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fed48097670 con 0x7fed4813b760 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed2effd640 1 -- 10.20.193.51:0/3775307188 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed44076db0 con 0x7fed4813b760 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7fed2effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stdout:51539607557 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 msgr2=0x7f3adc040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 0x7f3adc040220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b00005360 tx=0x7f3b00009040 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 10 monclient: shutdown 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 msgr2=0x7f3b0c132b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e90 tx=0x7f3afc004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 shutdown_connections 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3adc03dd60 0x7f3adc040220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b0c13b760 0x7f3b0c132b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b0c0a3bb0 0x7f3b0c132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 --2- 10.20.193.51:0/101412821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b0c0a0750 0x7f3b0c09be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.947+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 >> 10.20.193.51:0/101412821 conn(0x7f3b0c0a30c0 msgr2=0x7f3b0c072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.948+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 shutdown_connections 2026-02-17T11:45:39.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.948+0000 7f3b11a87640 1 -- 10.20.193.51:0/101412821 wait complete. 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 msgr2=0x7fed180401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 0x7fed180401d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed38004020 tx=0x7fed38009040 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 10 monclient: shutdown 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 msgr2=0x7fed48095b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed44009f50 tx=0x7fed44004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 shutdown_connections 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fed1803dd10 0x7fed180401d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fed4813b760 0x7fed48095b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fed480a3bb0 0x7fed48095620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 --2- 10.20.193.51:0/3775307188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fed480a0750 0x7fed480950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 >> 10.20.193.51:0/3775307188 conn(0x7fed480a30c0 msgr2=0x7fed4813ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 shutdown_connections 2026-02-17T11:45:39.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:39.949+0000 7fed50523640 1 -- 10.20.193.51:0/3775307188 wait complete. 2026-02-17T11:45:39.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.2 2026-02-17T11:45:39.957 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:39.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.3 2026-02-17T11:45:39.958 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:40.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7e650640 10 monclient: get_auth_request con 0x7fad7806d180 auth_method 0 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7e650640 0 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient: ms_handle_reset current mon v2:10.20.193.51:3300/0 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 msgr2=0x7fad780a2610 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 1 --2- 10.20.193.51:0/1552879321 >> v2:10.20.193.51:3300/0 conn(0x7fad7806d180 0x7fad780a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient: _add_conns ranks=[1,0] 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fad68003600 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fad68007590 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6800b540 con 0x7fad68007590 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6800c740 con 0x7fad68003600 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:40.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.052+0000 7fad7d64e640 10 monclient(hunting): ms_handle_reset stray mon v2:10.20.193.51:3300/0 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 1 -- 10.20.193.51:0/1552879321 >> v1:10.20.193.51:6789/0 conn(0x7fad68007590 legacy=0x7fad68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866551834 0 0) 0x7fad6800b540 con 0x7fad68007590 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): _negotiate 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> v1:10.20.193.51:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fad6800b710 con 0x7fad68007590 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> v1:10.20.193.142:6789/0 conn(0x7fad68003600 legacy=0x7fad68005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1583230325 0 0) 0x7fad6800b710 con 0x7fad68007590 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 >> v1:10.20.193.142:6789/0 conn(0x7fad68003600 legacy=0x7fad68005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6800daa0 con 0x7fad68007590 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _finish_auth 0 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _check_auth_tickets 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fad64009dd0 con 0x7fad68007590 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: dump: 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:40.058 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 >> v1:10.20.193.51:6789/0 conn(0x7fad68007590 legacy=0x7fad68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 1 -- 10.20.193.51:0/1552879321 reap_dead start 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 0x7fad68005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): picked mon.a con 0x7fad6800bec0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800c2a0 0x7fad6800c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): picked mon.c con 0x7fad6800c2a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800d020 0x7fad68006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): picked mon.b con 0x7fad6800d020 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fad68006790 con 0x7fad6800bec0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fad68006940 con 0x7fad6800d020 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fad68006b40 con 0x7fad6800c2a0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7d64e640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 0x7fad68005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): get_auth_request con 0x7fad6800bec0 auth_method 0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800c2a0 0x7fad6800c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): get_auth_request con 0x7fad6800c2a0 auth_method 0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7de4f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800d020 0x7fad68006250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 10 monclient(hunting): get_auth_request con 0x7fad6800d020 auth_method 0 2026-02-17T11:45:40.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7ee51640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient(hunting): handle_auth_done global_id 4278 payload 293 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800c2a0 msgr2=0x7fad6800c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800c2a0 0x7fad6800c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800d020 msgr2=0x7fad68006250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800d020 0x7fad68006250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient: _finish_hunting 0 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 monclient: found mon.a 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6800b710 con 0x7fad6800bec0 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient: _finish_auth 0 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 10 monclient: _check_auth_tickets 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad7e650640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad808db640 5 monclient: authenticate success, global_id 4278 2026-02-17T11:45:40.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.054+0000 7fad808db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:40.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7e650640 1 -- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 msgr2=0x7fad68005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:40.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7e650640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 0x7fad68005a40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad7806e530 tx=0x7fad6800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f20e96c76f7b919 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:40.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70047070 con 0x7fad6800bec0 2026-02-17T11:45:40.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: dump: 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad70038730 con 0x7fad6800bec0 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 1 -- 10.20.193.51:0/1552879321 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7002fdc0 con 0x7fad6800bec0 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad7d64e640 10 monclient: dump: 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad808db640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.056+0000 7fad808db640 4 set_mon_vals no callback set 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 10 monclient: shutdown 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 -- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 msgr2=0x7fad68005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 0x7fad68005a40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad7806e530 tx=0x7fad6800b950 comp rx=0 tx=0).stop 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 -- 10.20.193.51:0/1552879321 shutdown_connections 2026-02-17T11:45:40.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800d020 0x7fad68006250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800c2a0 0x7fad6800c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 --2- 10.20.193.51:0/1552879321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800bec0 0x7fad68005a40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 -- 10.20.193.51:0/1552879321 >> 10.20.193.51:0/1552879321 conn(0x7fad780a7b90 msgr2=0x7fad780a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 -- 10.20.193.51:0/1552879321 shutdown_connections 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.057+0000 7fad808db640 1 -- 10.20.193.51:0/1552879321 wait complete. 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient: build_initial_monmap 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient: monmap: 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 Processor -- start 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 -- start start 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient: init 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 0x7fad781cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): picked mon.noname-c con 0x7fad6800bec0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 0x7fad78099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): picked mon.noname-b con 0x7fad6800c2a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 0x7fad781cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): picked mon.noname-a con 0x7fad6800d020 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fad7809e7c0 con 0x7fad6800d020 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fad7809e640 con 0x7fad6800c2a0 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fad780a34e0 con 0x7fad6800bec0 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad808db640 10 monclient(hunting): authenticate will time out at 627.677510s 2026-02-17T11:45:40.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 0x7fad781cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 0x7fad781cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 0x7fad781cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59168/0 (socket says 10.20.193.51:59168) 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): get_auth_request con 0x7fad6800d020 auth_method 0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 1 -- 10.20.193.51:0/301887884 learned_addr learned my addr 10.20.193.51:0/301887884 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): get_auth_request con 0x7fad6800bec0 auth_method 0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7e650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient(hunting): handle_auth_done global_id 4293 payload 824 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7de4f640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 0x7fad78099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 -- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 msgr2=0x7fad781cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 0x7fad781cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 -- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 msgr2=0x7fad78099fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 0x7fad78099fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient: _finish_hunting 0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 monclient: found mon.noname-a 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7ee51640 1 -- 10.20.193.51:0/301887884 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad78094ff0 con 0x7fad6800d020 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7de4f640 10 monclient: get_auth_request con 0x7fad6800c2a0 auth_method 0 2026-02-17T11:45:40.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.058+0000 7fad7de4f640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 0x7fad78099fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad7ee51640 1 -- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 msgr2=0x7fad781cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad7ee51640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 0x7fad781cebe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad780a3470 tx=0x7fad6c004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c014410 con 0x7fad6800d020 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 10 monclient: dump: 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:40.065 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 5 monclient: authenticate success, global_id 4293 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.060+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c019070 con 0x7fad6800d020 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _renew_subs 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad78097a80 con 0x7fad6800d020 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c014810 con 0x7fad6800d020 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad7ce4d640 4 set_mon_vals no callback set 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 10 monclient: dump: 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _renew_subs 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad780a6230 con 0x7fad6800d020 2026-02-17T11:45:40.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fad6c0149b0 con 0x7fad6800d020 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad780972e0 con 0x7fad6800d020 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 0x7fad48040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.061+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fad6c052af0 con 0x7fad6800d020 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.062+0000 7fad7e650640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 0x7fad48040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.062+0000 7fad7e650640 10 monclient: get_auth_request con 0x7fad4803dd90 auth_method 0 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.064+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fad780972e0 con 0x7fad6800d020 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.064+0000 7fad62ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.064+0000 7fad62ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:40.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.064+0000 7fad7e650640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 0x7fad48040250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad70009660 tx=0x7fad70008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad808db640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad808db640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad808db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fad7809e960 con 0x7fad6800d020 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad62ffd640 1 -- 10.20.193.51:0/301887884 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad6c051670 con 0x7fad6800d020 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad62ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.146+0000 7fad62ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:40.148 INFO:teuthology.orchestra.run.trial051.stdout:47244640261 2026-02-17T11:45:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 msgr2=0x7fad48040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 0x7fad48040250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad70009660 tx=0x7fad70008030 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 10 monclient: shutdown 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 msgr2=0x7fad781cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 0x7fad781cebe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad780a3470 tx=0x7fad6c004a80 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 shutdown_connections 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fad4803dd90 0x7fad48040250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fad6800d020 0x7fad781cebe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fad6800c2a0 0x7fad78099fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 --2- 10.20.193.51:0/301887884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fad6800bec0 0x7fad781cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 >> 10.20.193.51:0/301887884 conn(0x7fad780a7b90 msgr2=0x7fad780a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 shutdown_connections 2026-02-17T11:45:40.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:40.147+0000 7fad808db640 1 -- 10.20.193.51:0/301887884 wait complete. 2026-02-17T11:45:40.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2026-02-17T11:45:40.156 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:40.952 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:40.953 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:45:40.953 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 10 monclient: monmap: 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.022 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.021099+0000 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.021099+0000 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.023 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f4116e2c640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f4116e2c640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f4116e2c640 10 monclient: monmap: 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.021496+0000 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.021496+0000 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.024 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 1 Processor -- start 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 1 -- start start 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7ff659cd5640 10 monclient: init 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f0f3f55b640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f0f3f55b640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f0f3f55b640 10 monclient: monmap: 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.026 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.021732+0000 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.021732+0000 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.027 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.020+0000 7f4116e2c640 1 Processor -- start 2026-02-17T11:45:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 -- start start 2026-02-17T11:45:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient: init 2026-02-17T11:45:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-b con 0x7ff6540a2e00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff65409e8f0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff6540a3720 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65409ef70 con 0x7ff6540a3720 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65409f250 con 0x7ff65409e8f0 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff65406da20 con 0x7ff6540a2e00 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff659cd5640 10 monclient(hunting): authenticate will time out at 628.640164s 2026-02-17T11:45:41.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff6594d4640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff6540a3720 0x7ff654136360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44312/0 (socket says 10.20.193.51:44312) 2026-02-17T11:45:41.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59170/0 (socket says 10.20.193.51:59170) 2026-02-17T11:45:41.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff6594d4640 1 -- 10.20.193.51:0/2542127524 learned_addr learned my addr 10.20.193.51:0/2542127524 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:41.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 Processor -- start 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): get_auth_request con 0x7ff6540a2e00 auth_method 0 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 -- start start 2026-02-17T11:45:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient: init 2026-02-17T11:45:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4110138600 0x7f41101389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-a con 0x7f4110138600 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-b con 0x7f41100a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f41100a58a0 0x7f41100a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-c con 0x7f41100a58a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f41100a6830 con 0x7f4110138600 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient(hunting): handle_auth_done global_id 4301 payload 274 2026-02-17T11:45:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f41100a2c00 con 0x7f41100a58a0 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f41100a1df0 con 0x7f41100a35a0 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 -- 10.20.193.51:0/2542127524 >> v1:10.20.193.142:6789/0 conn(0x7ff65409e8f0 legacy=0x7ff654135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 -- 10.20.193.51:0/2542127524 >> v1:10.20.193.51:6789/0 conn(0x7ff6540a3720 legacy=0x7ff654136360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4116e2c640 10 monclient(hunting): authenticate will time out at 628.640399s 2026-02-17T11:45:41.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7ff658cd3640 1 -- 10.20.193.51:0/2542127524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654136a70 con 0x7ff6540a2e00 2026-02-17T11:45:41.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59182/0 (socket says 10.20.193.51:59182) 2026-02-17T11:45:41.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 -- 10.20.193.51:0/1916150594 learned_addr learned my addr 10.20.193.51:0/1916150594 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): get_auth_request con 0x7f41100a35a0 auth_method 0 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-b con 0x7f0f38138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0f380a35a0 0x7f0f380a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-a con 0x7f0f380a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0f380a58a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f380a1df0 con 0x7f0f380a58a0 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0f380a6830 con 0x7f0f380a35a0 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0f380a2c00 con 0x7f0f38138600 2026-02-17T11:45:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3f55b640 10 monclient(hunting): authenticate will time out at 628.640624s 2026-02-17T11:45:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f41153a2640 1 --2- 10.20.193.51:0/1916150594 >> v2:10.20.193.142:3300/0 conn(0x7f41100a58a0 0x7f41100a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f41153a2640 10 monclient(hunting): get_auth_request con 0x7f41100a58a0 auth_method 0 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f41153a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f41153a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f41153a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 -- 10.20.193.51:0/1916150594 >> v2:10.20.193.142:3300/0 conn(0x7f41100a58a0 msgr2=0x7f41100a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 --2- 10.20.193.51:0/1916150594 >> v2:10.20.193.142:3300/0 conn(0x7f41100a58a0 0x7f41100a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 -- 10.20.193.51:0/1916150594 >> v2:10.20.193.51:3300/0 conn(0x7f4110138600 msgr2=0x7f41101389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 --2- 10.20.193.51:0/1916150594 >> v2:10.20.193.51:3300/0 conn(0x7f4110138600 0x7f41101389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59196/0 (socket says 10.20.193.51:59196) 2026-02-17T11:45:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2552905624 learned_addr learned my addr 10.20.193.51:0/2552905624 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): get_auth_request con 0x7f0f38138600 auth_method 0 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f4107fff640 1 -- 10.20.193.51:0/1916150594 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4110138f20 con 0x7f41100a35a0 2026-02-17T11:45:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_done global_id 4307 payload 274 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2552905624 >> v2:10.20.193.51:3300/0 conn(0x7f0f380a35a0 msgr2=0x7f0f380a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 --2- 10.20.193.51:0/2552905624 >> v2:10.20.193.51:3300/0 conn(0x7f0f380a35a0 0x7f0f380a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2552905624 >> v1:10.20.193.51:6789/0 conn(0x7f0f380a58a0 legacy=0x7f0f3813f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.021+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2552905624 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f38138f20 con 0x7f0f38138600 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff658cd3640 1 -- 10.20.193.51:0/2542127524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 msgr2=0x7ff6540a31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff658cd3640 1 --2- 10.20.193.51:0/2542127524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098d0 tx=0x7ff64402edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b18551528ba220 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 1 -- 10.20.193.51:0/2542127524 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64403c070 con 0x7ff6540a2e00 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 10 monclient: dump: 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.049 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.023+0000 7ff64b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 1 -- 10.20.193.51:0/2542127524 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64402fd20 con 0x7ff6540a2e00 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 5 monclient: authenticate success, global_id 4301 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 1 -- 10.20.193.51:0/2542127524 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644037660 con 0x7ff6540a2e00 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 4 set_mon_vals no callback set 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff64b7fe640 10 monclient: dump: 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.051 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.052 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.052 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.052 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4107fff640 1 -- 10.20.193.51:0/1916150594 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 msgr2=0x7f41100a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4107fff640 1 --2- 10.20.193.51:0/1916150594 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4110075290 tx=0x7f40f802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=463de7e57b90c77d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 1 -- 10.20.193.51:0/1916150594 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f803c070 con 0x7f41100a35a0 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: dump: 2026-02-17T11:45:41.053 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 1 -- 10.20.193.51:0/1916150594 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f802fca0 con 0x7f41100a35a0 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 5 monclient: authenticate success, global_id 4304 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 1 -- 10.20.193.51:0/1916150594 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8037660 con 0x7f41100a35a0 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f41077fe640 10 monclient: dump: 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.055 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 4 set_mon_vals no callback set 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 10 monclient: shutdown 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 -- 10.20.193.51:0/2542127524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 msgr2=0x7ff6540a31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 --2- 10.20.193.51:0/2542127524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098d0 tx=0x7ff64402edc0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2552905624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 msgr2=0x7f0f381389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3d2d0640 1 --2- 10.20.193.51:0/2552905624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009970 tx=0x7f0f2802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d364917d91cb1c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 -- 10.20.193.51:0/2542127524 shutdown_connections 2026-02-17T11:45:41.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 --2- 10.20.193.51:0/2542127524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff6540a31e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 -- 10.20.193.51:0/2542127524 >> 10.20.193.51:0/2542127524 conn(0x7ff6540a7a50 msgr2=0x7ff6540a3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 -- 10.20.193.51:0/2542127524 shutdown_connections 2026-02-17T11:45:41.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 1 -- 10.20.193.51:0/2542127524 wait complete. 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 1 -- 10.20.193.51:0/2552905624 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2803c070 con 0x7f0f38138600 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: dump: 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.059 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 1 -- 10.20.193.51:0/2552905624 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2802fdb0 con 0x7f0f38138600 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 5 monclient: authenticate success, global_id 4307 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 1 -- 10.20.193.51:0/2552905624 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28037660 con 0x7f0f38138600 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f27fff640 10 monclient: dump: 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.060 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 4 set_mon_vals no callback set 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 10 monclient: shutdown 2026-02-17T11:45:41.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 -- 10.20.193.51:0/1916150594 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 msgr2=0x7f41100a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 --2- 10.20.193.51:0/1916150594 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4110075290 tx=0x7f40f802ee60 comp rx=0 tx=0).stop 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 10 monclient: shutdown 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2552905624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 msgr2=0x7f0f381389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2552905624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009970 tx=0x7f0f2802ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 -- 10.20.193.51:0/1916150594 shutdown_connections 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 --2- 10.20.193.51:0/1916150594 >> v2:10.20.193.142:3300/0 conn(0x7f41100a58a0 0x7f41100a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 --2- 10.20.193.51:0/1916150594 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41100a35a0 0x7f41100a5360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 --2- 10.20.193.51:0/1916150594 >> v2:10.20.193.51:3300/0 conn(0x7f4110138600 0x7f41101389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 -- 10.20.193.51:0/1916150594 >> 10.20.193.51:0/1916150594 conn(0x7f41100a7460 msgr2=0x7f41100a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2552905624 shutdown_connections 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2552905624 >> v2:10.20.193.51:3300/0 conn(0x7f0f380a35a0 0x7f0f380a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2552905624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f38138600 0x7f0f381389e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2552905624 >> 10.20.193.51:0/2552905624 conn(0x7f0f380a7460 msgr2=0x7f0f380a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 -- 10.20.193.51:0/1916150594 shutdown_connections 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2552905624 shutdown_connections 2026-02-17T11:45:41.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f4116e2c640 1 -- 10.20.193.51:0/1916150594 wait complete. 2026-02-17T11:45:41.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2552905624 wait complete. 2026-02-17T11:45:41.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.024+0000 7ff659cd5640 10 monclient: monmap: 2026-02-17T11:45:41.065 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.065 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 Processor -- start 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 -- start start 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient: init 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient: monmap: 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient: monmap: 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 Processor -- start 2026-02-17T11:45:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 -- start start 2026-02-17T11:45:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient: init 2026-02-17T11:45:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 Processor -- start 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 0x7ff6541ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-b con 0x7ff65409e8f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-c con 0x7ff6540a2e00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): picked mon.noname-a con 0x7ff6540a3720 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff6540a4870 con 0x7ff6540a3720 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6540a49f0 con 0x7ff65409e8f0 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff6540a01f0 con 0x7ff6540a2e00 2026-02-17T11:45:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff659cd5640 10 monclient(hunting): authenticate will time out at 628.644396s 2026-02-17T11:45:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 -- start start 2026-02-17T11:45:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient: init 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52804/0 (socket says 10.20.193.51:52804) 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59198/0 (socket says 10.20.193.51:59198) 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 -- 10.20.193.51:0/3363101347 learned_addr learned my addr 10.20.193.51:0/3363101347 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): get_auth_request con 0x7ff6540a3720 auth_method 0 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): get_auth_request con 0x7ff6540a2e00 auth_method 0 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-a con 0x7f0f380a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff658cd3640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 0x7ff6541ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f380a58a0 0x7f0f38135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-c con 0x7f0f380a58a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0f38138600 0x7f0f38121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): picked mon.noname-b con 0x7f0f38138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380a25b0 con 0x7f0f380a35a0 2026-02-17T11:45:41.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 -- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 msgr2=0x7ff654135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 -- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 msgr2=0x7ff6541ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380a22d0 con 0x7f0f38138600 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0f380a15f0 con 0x7f0f380a58a0 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 0x7ff6541ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 monclient: found mon.noname-a 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3f55b640 10 monclient(hunting): authenticate will time out at 628.644633s 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff6594d4640 1 -- 10.20.193.51:0/3363101347 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654127590 con 0x7ff6540a3720 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff658cd3640 10 monclient: get_auth_request con 0x7ff65409e8f0 auth_method 0 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff658cd3640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 0x7ff6541ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7ff64bfff640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:41.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f380a58a0 0x7f0f38135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52812/0 (socket says 10.20.193.51:52812) 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2195588188 learned_addr learned my addr 10.20.193.51:0/2195588188 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): get_auth_request con 0x7f0f380a35a0 auth_method 0 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): get_auth_request con 0x7f0f380a58a0 auth_method 0 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41100a35a0 0x7f4110136350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-b con 0x7f41100a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41100a58a0 0x7f4110136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-a con 0x7f41100a58a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): picked mon.noname-c con 0x7f4110138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f41100a25b0 con 0x7f41100a58a0 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41100a22d0 con 0x7f41100a35a0 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f41100a15f0 con 0x7f4110138600 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4116e2c640 10 monclient(hunting): authenticate will time out at 628.644732s 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3cacf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59214/0 (socket says 10.20.193.51:59214) 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 -- 10.20.193.51:0/784975287 learned_addr learned my addr 10.20.193.51:0/784975287 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): get_auth_request con 0x7f4110138600 auth_method 0 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient(hunting): handle_auth_done global_id 4299 payload 824 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f380a58a0 msgr2=0x7f0f38135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f380a58a0 0x7f0f38135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0f38138600 msgr2=0x7f0f38121b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0f38138600 0x7f0f38121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 monclient: found mon.noname-a 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2195588188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f38125100 con 0x7f0f380a35a0 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4114ba1640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41100a35a0 0x7f4110136350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4114ba1640 10 monclient(hunting): get_auth_request con 0x7f41100a35a0 auth_method 0 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4114ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4114ba1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f4114ba1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient(hunting): handle_auth_done global_id 4316 payload 824 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 -- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41100a35a0 msgr2=0x7f4110136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41100a35a0 0x7f4110136350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 -- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41100a58a0 msgr2=0x7f4110136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41100a58a0 0x7f4110136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.025+0000 7f41153a2640 1 -- 10.20.193.51:0/784975287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4110127a70 con 0x7f4110138600 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6594d4640 1 -- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 msgr2=0x7ff6541360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6594d4640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff65000caf0 tx=0x7ff65000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65000ae60 con 0x7ff6540a3720 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: dump: 2026-02-17T11:45:41.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650012400 con 0x7ff6540a3720 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff659cd5640 5 monclient: authenticate success, global_id 4296 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff659cd5640 10 monclient: _renew_subs 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff659cd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6541cd4a0 con 0x7ff6540a3720 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500127d0 con 0x7ff6540a3720 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff64affd640 4 set_mon_vals no callback set 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.027+0000 7ff6497fa640 10 monclient: dump: 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 10 monclient: _renew_subs 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff654073570 con 0x7ff6540a3720 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3d2d0640 1 -- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 msgr2=0x7f0f38135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3d2d0640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009970 tx=0x7f0f280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41153a2640 1 -- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 msgr2=0x7f4110123e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41153a2640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f410c007e40 tx=0x7f410c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c013790 con 0x7f4110138600 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28047070 con 0x7f0f380a35a0 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: dump: 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: dump: 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f28043460 con 0x7f0f380a35a0 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2803c040 con 0x7f0f380a35a0 2026-02-17T11:45:41.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410c019070 con 0x7f4110138600 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 5 monclient: authenticate success, global_id 4316 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _renew_subs 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4110125f00 con 0x7f4110138600 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f25ffb640 10 monclient: dump: 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f277fe640 4 set_mon_vals no callback set 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 5 monclient: authenticate success, global_id 4299 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _renew_subs 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f381259a0 con 0x7f0f380a35a0 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c013b90 con 0x7f4110138600 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 10 monclient: dump: 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41067fc640 4 set_mon_vals no callback set 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _renew_subs 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41100a1ae0 con 0x7f4110138600 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _renew_subs 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f380a8ef0 con 0x7f0f380a35a0 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6540a6ba0 con 0x7ff6540a3720 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f38136980 con 0x7f0f380a35a0 2026-02-17T11:45:41.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff6500129f0 con 0x7ff6540a3720 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f410c01e460 con 0x7f4110138600 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41100a0ac0 con 0x7f4110138600 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.028+0000 7ff6497fa640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 0x7ff624040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7ff650052a00 con 0x7ff6540a3720 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0f28043870 con 0x7f0f380a35a0 2026-02-17T11:45:41.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f41057fa640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 0x7f40e0040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f410c052dd0 con 0x7f4110138600 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f0f25ffb640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 0x7f0f08040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7ff658cd3640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 0x7ff624040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7ff658cd3640 10 monclient: get_auth_request con 0x7ff62403dd40 auth_method 0 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f4114ba1640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 0x7f40e0040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f0f28077c10 con 0x7f0f380a35a0 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f4114ba1640 10 monclient: get_auth_request con 0x7f40e003dd40 auth_method 0 2026-02-17T11:45:41.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f0f3cacf640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 0x7f0f08040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.029+0000 7f0f3cacf640 10 monclient: get_auth_request con 0x7f0f0803dd60 auth_method 0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff650007af0 con 0x7ff6540a3720 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7ff6497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7ff6497fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7ff658cd3640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 0x7ff624040200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff65406e000 tx=0x7ff644033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7f4114ba1640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 0x7f40e0040200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4100009990 tx=0x7f4100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f410c051950 con 0x7f4110138600 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7f41057fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.031+0000 7f41057fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.032+0000 7f0f3cacf640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 0x7f0f08040220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f381371c0 tx=0x7f0f2c009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.033+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0f28043b90 con 0x7f0f380a35a0 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.033+0000 7f0f25ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.033+0000 7f0f25ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff659cd5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff659cd5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff659cd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff6540a31e0 con 0x7ff6540a3720 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff6497fa640 1 -- 10.20.193.51:0/3363101347 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff650010300 con 0x7ff6540a3720 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff6497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.113+0000 7ff6497fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:41.115 INFO:teuthology.orchestra.run.trial051.stdout:51539607557 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 msgr2=0x7ff624040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 0x7ff624040200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff65406e000 tx=0x7ff644033000 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 10 monclient: shutdown 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 msgr2=0x7ff6541360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff65000caf0 tx=0x7ff65000a060 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 shutdown_connections 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff62403dd40 0x7ff624040200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff6540a3720 0x7ff6541360d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff6540a2e00 0x7ff654135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 --2- 10.20.193.51:0/3363101347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff65409e8f0 0x7ff6541ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 >> 10.20.193.51:0/3363101347 conn(0x7ff6540a7a50 msgr2=0x7ff65411da40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 shutdown_connections 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7ff659cd5640 1 -- 10.20.193.51:0/3363101347 wait complete. 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7f4116e2c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7f4116e2c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7f4116e2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.114+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f41100a5d10 con 0x7f4110138600 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.115+0000 7f41057fa640 1 -- 10.20.193.51:0/784975287 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f410c013d30 con 0x7f4110138600 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.115+0000 7f41057fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.115+0000 7f41057fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:41.117 INFO:teuthology.orchestra.run.trial051.stdout:51539607557 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 msgr2=0x7f40e0040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 0x7f40e0040200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4100009990 tx=0x7f4100008040 comp rx=0 tx=0).stop 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 10 monclient: shutdown 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 msgr2=0x7f4110123e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f410c007e40 tx=0x7f410c00e4b0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 shutdown_connections 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f40e003dd40 0x7f40e0040200 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4110138600 0x7f4110123e40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41100a58a0 0x7f4110136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 --2- 10.20.193.51:0/784975287 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41100a35a0 0x7f4110136350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 >> 10.20.193.51:0/784975287 conn(0x7f41100a7460 msgr2=0x7f41100a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 shutdown_connections 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.116+0000 7f4116e2c640 1 -- 10.20.193.51:0/784975287 wait complete. 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f3f55b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f3f55b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f3f55b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0f38069780 con 0x7f0f380a35a0 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f25ffb640 1 -- 10.20.193.51:0/2195588188 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f28054c70 con 0x7f0f380a35a0 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f25ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.117+0000 7f0f25ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:41.119 INFO:teuthology.orchestra.run.trial051.stdout:51539607558 2026-02-17T11:45:41.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 msgr2=0x7f0f08040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 0x7f0f08040220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f381371c0 tx=0x7f0f2c009210 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 10 monclient: shutdown 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 msgr2=0x7f0f38135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009970 tx=0x7f0f280047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 shutdown_connections 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0f0803dd60 0x7f0f08040220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0f38138600 0x7f0f38121b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0f380a58a0 0x7f0f38135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 --2- 10.20.193.51:0/2195588188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0f380a35a0 0x7f0f38135a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 >> 10.20.193.51:0/2195588188 conn(0x7f0f380a7460 msgr2=0x7f0f381bfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 shutdown_connections 2026-02-17T11:45:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.119+0000 7f0f3f55b640 1 -- 10.20.193.51:0/2195588188 wait complete. 2026-02-17T11:45:41.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.4 2026-02-17T11:45:41.126 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:41.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.5 2026-02-17T11:45:41.126 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:41.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.0 2026-02-17T11:45:41.129 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:41.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:45:41.129 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:41.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 10 monclient: monmap: 2026-02-17T11:45:41.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.233451+0000 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.233451+0000 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 1 Processor -- start 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 1 -- start start 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.232+0000 7fe0bd187640 10 monclient: init 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe0b80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 0x7fe0b809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-b con 0x7fe0b80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe0b813b760 0x7fe0b813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-c con 0x7fe0b813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b806e140 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b809f910 con 0x7fe0b813b760 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b809ccd0 con 0x7fe0b80a0750 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0bd187640 10 monclient(hunting): authenticate will time out at 628.852224s 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe0b80a3bb0 0x7fe0b809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44328/0 (socket says 10.20.193.51:44328) 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6d76640 1 -- 10.20.193.51:0/1843397716 learned_addr learned my addr 10.20.193.51:0/1843397716 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 0x7fe0b809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): get_auth_request con 0x7fe0b80a0750 auth_method 0 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b7577640 1 --2- 10.20.193.51:0/1843397716 >> v2:10.20.193.142:3300/0 conn(0x7fe0b813b760 0x7fe0b813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b7577640 10 monclient(hunting): get_auth_request con 0x7fe0b813b760 auth_method 0 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient(hunting): handle_auth_done global_id 4319 payload 274 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 -- 10.20.193.51:0/1843397716 >> v2:10.20.193.142:3300/0 conn(0x7fe0b813b760 msgr2=0x7fe0b813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1843397716 >> v2:10.20.193.142:3300/0 conn(0x7fe0b813b760 0x7fe0b813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 -- 10.20.193.51:0/1843397716 >> v1:10.20.193.51:6789/0 conn(0x7fe0b80a3bb0 legacy=0x7fe0b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.233+0000 7fe0b6575640 1 -- 10.20.193.51:0/1843397716 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b809eec0 con 0x7fe0b80a0750 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b6575640 1 -- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 msgr2=0x7fe0b809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 0x7fe0b809e1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0b809f230 tx=0x7fe0a002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51851be7adc2e1a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 1 -- 10.20.193.51:0/1843397716 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a003c070 con 0x7fe0b80a0750 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 10 monclient: dump: 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.235+0000 7fe0b5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 5 monclient: authenticate success, global_id 4319 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:41.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 1 -- 10.20.193.51:0/1843397716 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a002fbd0 con 0x7fe0b80a0750 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 1 -- 10.20.193.51:0/1843397716 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0037440 con 0x7fe0b80a0750 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0b5d74640 10 monclient: dump: 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 4 set_mon_vals no callback set 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 10 monclient: shutdown 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 -- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 msgr2=0x7fe0b809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 0x7fe0b809e1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0b809f230 tx=0x7fe0a002ed50 comp rx=0 tx=0).stop 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 -- 10.20.193.51:0/1843397716 shutdown_connections 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1843397716 >> v2:10.20.193.142:3300/0 conn(0x7fe0b813b760 0x7fe0b813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1843397716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a0750 0x7fe0b809e1d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 -- 10.20.193.51:0/1843397716 >> 10.20.193.51:0/1843397716 conn(0x7fe0b80a30c0 msgr2=0x7fe0b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 -- 10.20.193.51:0/1843397716 shutdown_connections 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.236+0000 7fe0bd187640 1 -- 10.20.193.51:0/1843397716 wait complete. 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient: monmap: 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 Processor -- start 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 -- start start 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient: init 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-a con 0x7fe0b80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 0x7fe0b81d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-c con 0x7fe0b80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0b813b760 0x7fe0b8132160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): picked mon.noname-b con 0x7fe0b813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b80a04b0 con 0x7fe0b80a0750 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b809c850 con 0x7fe0b813b760 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b809e710 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0bd187640 10 monclient(hunting): authenticate will time out at 628.856583s 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 0x7fe0b81d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52830/0 (socket says 10.20.193.51:52830) 2026-02-17T11:45:41.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 1 -- 10.20.193.51:0/1236338840 learned_addr learned my addr 10.20.193.51:0/1236338840 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): get_auth_request con 0x7fe0b80a0750 auth_method 0 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): get_auth_request con 0x7fe0b80a3bb0 auth_method 0 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient(hunting): handle_auth_done global_id 4322 payload 824 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 -- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0b813b760 msgr2=0x7fe0b8132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0b813b760 0x7fe0b8132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 -- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 msgr2=0x7fe0b81cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6575640 1 -- 10.20.193.51:0/1236338840 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b8135d90 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.237+0000 7fe0b6d76640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:41.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.239+0000 7fe0b6575640 1 -- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 msgr2=0x7fe0b81d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.239+0000 7fe0b6575640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 0x7fe0b81d0010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0b809cea0 tx=0x7fe0a00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.239+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a003c040 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: dump: 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.258 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a0047070 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 5 monclient: authenticate success, global_id 4322 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _renew_subs 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b8136070 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0040a40 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0b5573640 4 set_mon_vals no callback set 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 10 monclient: dump: 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.260 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _renew_subs 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b80a2b60 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe0a003f030 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b809d7b0 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 0x7fe084040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.240+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fe0a00775e0 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.241+0000 7fe0b6d76640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 0x7fe084040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.241+0000 7fe0b6d76640 10 monclient: get_auth_request con 0x7fe08403dd60 auth_method 0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.243+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe0a0076160 con 0x7fe0b80a3bb0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.243+0000 7fe0977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.243+0000 7fe0977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.243+0000 7fe0b6d76640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 0x7fe084040220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007e50 tx=0x7fe0ac007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.326+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0b809dac0 con 0x7fe08403dd60 2026-02-17T11:45:41.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.327+0000 7fe0977fe640 1 -- 10.20.193.51:0/1236338840 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34164 (secure 0 0 0) 0x7fe0b809dac0 con 0x7fe08403dd60 2026-02-17T11:45:41.329 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 msgr2=0x7fe084040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 0x7fe084040220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007e50 tx=0x7fe0ac007da0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 10 monclient: shutdown 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 msgr2=0x7fe0b81d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 0x7fe0b81d0010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0b809cea0 tx=0x7fe0a00047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 shutdown_connections 2026-02-17T11:45:41.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe08403dd60 0x7fe084040220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0b813b760 0x7fe0b8132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0b80a3bb0 0x7fe0b81d0010 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 --2- 10.20.193.51:0/1236338840 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0b80a0750 0x7fe0b81cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 >> 10.20.193.51:0/1236338840 conn(0x7fe0b80a30c0 msgr2=0x7fe0b8138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 shutdown_connections 2026-02-17T11:45:41.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.328+0000 7fe0bd187640 1 -- 10.20.193.51:0/1236338840 wait complete. 2026-02-17T11:45:41.337 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-17T11:45:39.873605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163028,"kb_used_data":1232,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068012,"statfs":{"total":579820584960,"available":579653644288,"internally_reserved":0,"allocated":1261568,"data_stored":1437316,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":165534374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.137058"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745288+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T11:45:37.745288+0000","last_peered":"2026-02-17T11:45:37.745288+0000","last_clean":"2026-02-17T11:45:37.745288+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T11:45:37.745288+0000","last_undegraded":"2026-02-17T11:45:37.745288+0000","last_fullsized":"2026-02-17T11:45:37.745288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745222+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T11:45:37.745222+0000","last_peered":"2026-02-17T11:45:37.745222+0000","last_clean":"2026-02-17T11:45:37.745222+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T11:45:37.745222+0000","last_undegraded":"2026-02-17T11:45:37.745222+0000","last_fullsized":"2026-02-17T11:45:37.745222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745005+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T11:45:37.745005+0000","last_peered":"2026-02-17T11:45:37.745005+0000","last_clean":"2026-02-17T11:45:37.745005+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T11:45:37.745005+0000","last_undegraded":"2026-02-17T11:45:37.745005+0000","last_fullsized":"2026-02-17T11:45:37.745005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745242+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T11:45:37.745242+0000","last_peered":"2026-02-17T11:45:37.745242+0000","last_clean":"2026-02-17T11:45:37.745242+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T11:45:37.745242+0000","last_undegraded":"2026-02-17T11:45:37.745242+0000","last_fullsized":"2026-02-17T11:45:37.745242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.748101+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T11:45:37.748101+0000","last_peered":"2026-02-17T11:45:37.748101+0000","last_clean":"2026-02-17T11:45:37.748101+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T11:45:37.748101+0000","last_undegraded":"2026-02-17T11:45:37.748101+0000","last_fullsized":"2026-02-17T11:45:37.748101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.935784+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T11:45:37.935784+0000","last_peered":"2026-02-17T11:45:37.935784+0000","last_clean":"2026-02-17T11:45:37.935784+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T11:45:37.935784+0000","last_undegraded":"2026-02-17T11:45:37.935784+0000","last_fullsized":"2026-02-17T11:45:37.935784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744965+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T11:45:37.744965+0000","last_peered":"2026-02-17T11:45:37.744965+0000","last_clean":"2026-02-17T11:45:37.744965+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T11:45:37.744965+0000","last_undegraded":"2026-02-17T11:45:37.744965+0000","last_fullsized":"2026-02-17T11:45:37.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.747404+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T11:45:37.747404+0000","last_peered":"2026-02-17T11:45:37.747404+0000","last_clean":"2026-02-17T11:45:37.747404+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T11:45:37.747404+0000","last_undegraded":"2026-02-17T11:45:37.747404+0000","last_fullsized":"2026-02-17T11:45:37.747404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744393+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T11:45:37.744393+0000","last_peered":"2026-02-17T11:45:37.744393+0000","last_clean":"2026-02-17T11:45:37.744393+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T11:45:37.744393+0000","last_undegraded":"2026-02-17T11:45:37.744393+0000","last_fullsized":"2026-02-17T11:45:37.744393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:41.339 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 10 monclient: monmap: 2026-02-17T11:45:41.407 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.406408+0000 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.406408+0000 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.408 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.409 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.409 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 1 Processor -- start 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 1 -- start start 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.405+0000 7f4078c91640 10 monclient: init 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-b con 0x7f4074138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f40740a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f40740a5a70 0x7f4074140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-c con 0x7f40740a5a70 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:41.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40740a1df0 con 0x7f40740a35a0 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f40740a6830 con 0x7f40740a5a70 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f40740a2c00 con 0x7f4074138600 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4078c91640 10 monclient(hunting): authenticate will time out at 629.025477s 2026-02-17T11:45:41.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59240/0 (socket says 10.20.193.51:59240) 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 -- 10.20.193.51:0/2764201590 learned_addr learned my addr 10.20.193.51:0/2764201590 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): get_auth_request con 0x7f4074138600 auth_method 0 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072d76640 1 --2- 10.20.193.51:0/2764201590 >> v2:10.20.193.142:3300/0 conn(0x7f40740a5a70 0x7f4074140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072d76640 10 monclient(hunting): get_auth_request con 0x7f40740a5a70 auth_method 0 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient(hunting): handle_auth_done global_id 4325 payload 274 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 -- 10.20.193.51:0/2764201590 >> v2:10.20.193.142:3300/0 conn(0x7f40740a5a70 msgr2=0x7f4074140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 --2- 10.20.193.51:0/2764201590 >> v2:10.20.193.142:3300/0 conn(0x7f40740a5a70 0x7f4074140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 -- 10.20.193.51:0/2764201590 >> v1:10.20.193.142:6789/0 conn(0x7f40740a35a0 legacy=0x7f40740a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.406+0000 7f4072575640 1 -- 10.20.193.51:0/2764201590 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074138f20 con 0x7f4074138600 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4072575640 1 -- 10.20.193.51:0/2764201590 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 msgr2=0x7f40741389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4072575640 1 --2- 10.20.193.51:0/2764201590 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4068009970 tx=0x7f406802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48003324ea3c0826 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 1 -- 10.20.193.51:0/2764201590 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406803c070 con 0x7f4074138600 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: dump: 2026-02-17T11:45:41.424 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 5 monclient: authenticate success, global_id 4325 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 1 -- 10.20.193.51:0/2764201590 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406802fcd0 con 0x7f4074138600 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 1 -- 10.20.193.51:0/2764201590 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068037660 con 0x7f4074138600 2026-02-17T11:45:41.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 4 set_mon_vals no callback set 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4071573640 10 monclient: dump: 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.427 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 10 monclient: shutdown 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 -- 10.20.193.51:0/2764201590 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 msgr2=0x7f40741389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 --2- 10.20.193.51:0/2764201590 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4068009970 tx=0x7f406802ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 -- 10.20.193.51:0/2764201590 shutdown_connections 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 --2- 10.20.193.51:0/2764201590 >> v2:10.20.193.142:3300/0 conn(0x7f40740a5a70 0x7f4074140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 --2- 10.20.193.51:0/2764201590 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4074138600 0x7f40741389e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 -- 10.20.193.51:0/2764201590 >> 10.20.193.51:0/2764201590 conn(0x7f40740a7460 msgr2=0x7f40740a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 -- 10.20.193.51:0/2764201590 shutdown_connections 2026-02-17T11:45:41.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.409+0000 7f4078c91640 1 -- 10.20.193.51:0/2764201590 wait complete. 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient: monmap: 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.429 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 Processor -- start 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 -- start start 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient: init 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-c con 0x7f40740a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40740a5a70 0x7f40741363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-a con 0x7f40740a5a70 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4074138600 0x7f4074121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): picked mon.noname-b con 0x7f4074138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f40740a25b0 con 0x7f40740a5a70 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f40740a22d0 con 0x7f4074138600 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f40740a15f0 con 0x7f40740a35a0 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4078c91640 10 monclient(hunting): authenticate will time out at 629.029700s 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59250/0 (socket says 10.20.193.51:59250) 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 -- 10.20.193.51:0/1625982647 learned_addr learned my addr 10.20.193.51:0/1625982647 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): get_auth_request con 0x7f40740a35a0 auth_method 0 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40740a5a70 0x7f40741363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): get_auth_request con 0x7f40740a5a70 auth_method 0 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4071d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient(hunting): handle_auth_done global_id 4328 payload 824 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 -- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4074138600 msgr2=0x7f4074121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4074138600 0x7f4074121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 -- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40740a5a70 msgr2=0x7f40741363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40740a5a70 0x7f40741363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.410+0000 7f4072575640 1 -- 10.20.193.51:0/1625982647 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40741256d0 con 0x7f40740a35a0 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4072575640 1 -- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 msgr2=0x7f4074135e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4072575640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40680090b0 tx=0x7f40680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068044020 con 0x7f40740a35a0 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: dump: 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.434 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4068040920 con 0x7f40740a35a0 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406803c040 con 0x7f40740a35a0 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4070d72640 4 set_mon_vals no callback set 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f405affd640 10 monclient: dump: 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.435 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 5 monclient: authenticate success, global_id 4328 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _renew_subs 2026-02-17T11:45:41.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40741259b0 con 0x7f40740a35a0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _renew_subs 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40740a1ae0 con 0x7f40740a35a0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.413+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40740a5ee0 con 0x7f40740a35a0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.414+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f406803f050 con 0x7f40740a35a0 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.414+0000 7f405affd640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 0x7f4040040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.414+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7f40680772e0 con 0x7f40740a35a0 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.414+0000 7f4071d74640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 0x7f4040040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.414+0000 7f4071d74640 10 monclient: get_auth_request con 0x7f404003dd60 auth_method 0 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.416+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f406804e030 con 0x7f40740a35a0 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.416+0000 7f405affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.416+0000 7f405affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.416+0000 7f4071d74640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 0x7f4040040220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40741232c0 tx=0x7f405c007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.497+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40740a43a0 con 0x7f404003dd60 2026-02-17T11:45:41.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f405affd640 1 -- 10.20.193.51:0/1625982647 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34164 (secure 0 0 0) 0x7f40740a43a0 con 0x7f404003dd60 2026-02-17T11:45:41.500 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:41.501 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 msgr2=0x7f4040040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 0x7f4040040220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40741232c0 tx=0x7f405c007f30 comp rx=0 tx=0).stop 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 10 monclient: shutdown 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 msgr2=0x7f4074135e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40680090b0 tx=0x7f40680047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 shutdown_connections 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f404003dd60 0x7f4040040220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4074138600 0x7f4074121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40740a5a70 0x7f40741363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 --2- 10.20.193.51:0/1625982647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40740a35a0 0x7f4074135e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 >> 10.20.193.51:0/1625982647 conn(0x7f40740a7460 msgr2=0x7f40740a9080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 shutdown_connections 2026-02-17T11:45:41.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.498+0000 7f4078c91640 1 -- 10.20.193.51:0/1625982647 wait complete. 2026-02-17T11:45:41.508 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-17T11:45:39.873605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163028,"kb_used_data":1232,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068012,"statfs":{"total":579820584960,"available":579653644288,"internally_reserved":0,"allocated":1261568,"data_stored":1437316,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":165534374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.137058"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745288+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T11:45:37.745288+0000","last_peered":"2026-02-17T11:45:37.745288+0000","last_clean":"2026-02-17T11:45:37.745288+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T11:45:37.745288+0000","last_undegraded":"2026-02-17T11:45:37.745288+0000","last_fullsized":"2026-02-17T11:45:37.745288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745222+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T11:45:37.745222+0000","last_peered":"2026-02-17T11:45:37.745222+0000","last_clean":"2026-02-17T11:45:37.745222+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T11:45:37.745222+0000","last_undegraded":"2026-02-17T11:45:37.745222+0000","last_fullsized":"2026-02-17T11:45:37.745222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745005+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T11:45:37.745005+0000","last_peered":"2026-02-17T11:45:37.745005+0000","last_clean":"2026-02-17T11:45:37.745005+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T11:45:37.745005+0000","last_undegraded":"2026-02-17T11:45:37.745005+0000","last_fullsized":"2026-02-17T11:45:37.745005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745242+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T11:45:37.745242+0000","last_peered":"2026-02-17T11:45:37.745242+0000","last_clean":"2026-02-17T11:45:37.745242+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T11:45:37.745242+0000","last_undegraded":"2026-02-17T11:45:37.745242+0000","last_fullsized":"2026-02-17T11:45:37.745242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.748101+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T11:45:37.748101+0000","last_peered":"2026-02-17T11:45:37.748101+0000","last_clean":"2026-02-17T11:45:37.748101+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T11:45:37.748101+0000","last_undegraded":"2026-02-17T11:45:37.748101+0000","last_fullsized":"2026-02-17T11:45:37.748101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.935784+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T11:45:37.935784+0000","last_peered":"2026-02-17T11:45:37.935784+0000","last_clean":"2026-02-17T11:45:37.935784+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T11:45:37.935784+0000","last_undegraded":"2026-02-17T11:45:37.935784+0000","last_fullsized":"2026-02-17T11:45:37.935784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744965+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T11:45:37.744965+0000","last_peered":"2026-02-17T11:45:37.744965+0000","last_clean":"2026-02-17T11:45:37.744965+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T11:45:37.744965+0000","last_undegraded":"2026-02-17T11:45:37.744965+0000","last_fullsized":"2026-02-17T11:45:37.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.747404+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T11:45:37.747404+0000","last_peered":"2026-02-17T11:45:37.747404+0000","last_clean":"2026-02-17T11:45:37.747404+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T11:45:37.747404+0000","last_undegraded":"2026-02-17T11:45:37.747404+0000","last_fullsized":"2026-02-17T11:45:37.747404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744393+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T11:45:37.744393+0000","last_peered":"2026-02-17T11:45:37.744393+0000","last_clean":"2026-02-17T11:45:37.744393+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T11:45:37.744393+0000","last_undegraded":"2026-02-17T11:45:37.744393+0000","last_fullsized":"2026-02-17T11:45:37.744393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:41.509 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:45:41.509 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:45:41.510 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:45:41.510 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:45:41.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.573+0000 7fe51247c640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.573+0000 7fe51247c640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.573+0000 7fe51247c640 10 monclient: monmap: 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.574830+0000 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.574830+0000 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.576 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.577 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.577 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.577 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.577 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 Processor -- start 2026-02-17T11:45:41.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 -- start start 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient: init 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe50c0a3bb0 0x7fe50c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-c con 0x7fe50c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe50c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe50c13b760 0x7fe50c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-a con 0x7fe50c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c06e140 con 0x7fe50c0a0750 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe50c09f910 con 0x7fe50c13b760 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe50c09ccd0 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe51247c640 10 monclient(hunting): authenticate will time out at 629.193811s 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50b7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe50c0a0750 0x7fe50c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44344/0 (socket says 10.20.193.51:44344) 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50b7fe640 1 -- 10.20.193.51:0/2549916562 learned_addr learned my addr 10.20.193.51:0/2549916562 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2549916562 >> v2:10.20.193.142:3300/0 conn(0x7fe50c0a3bb0 0x7fe50c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50bfff640 10 monclient(hunting): get_auth_request con 0x7fe50c0a3bb0 auth_method 0 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.574+0000 7fe50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient(hunting): handle_auth_done global_id 4249 payload 274 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 1 -- 10.20.193.51:0/2549916562 >> v2:10.20.193.51:3300/0 conn(0x7fe50c13b760 msgr2=0x7fe50c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2549916562 >> v2:10.20.193.51:3300/0 conn(0x7fe50c13b760 0x7fe50c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 1 -- 10.20.193.51:0/2549916562 >> v1:10.20.193.51:6789/0 conn(0x7fe50c0a0750 legacy=0x7fe50c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.575+0000 7fe50bfff640 1 -- 10.20.193.51:0/2549916562 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c09eec0 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50bfff640 1 -- 10.20.193.51:0/2549916562 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 msgr2=0x7fe50c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2549916562 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09dac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06c1c0 tx=0x7fe4f802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47975b69a588b907 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 1 -- 10.20.193.51:0/2549916562 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f803c070 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: dump: 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.589 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe51247c640 5 monclient: authenticate success, global_id 4249 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 1 -- 10.20.193.51:0/2549916562 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f802fcb0 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe51247c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe51247c640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 1 -- 10.20.193.51:0/2549916562 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f802fe60 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe51247c640 4 set_mon_vals no callback set 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.577+0000 7fe50affd640 10 monclient: dump: 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: shutdown 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- 10.20.193.51:0/2549916562 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 msgr2=0x7fe50c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- 10.20.193.51:0/2549916562 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09dac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06c1c0 tx=0x7fe4f802ed50 comp rx=0 tx=0).stop 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- 10.20.193.51:0/2549916562 shutdown_connections 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- 10.20.193.51:0/2549916562 >> v2:10.20.193.51:3300/0 conn(0x7fe50c13b760 0x7fe50c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- 10.20.193.51:0/2549916562 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09dac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- 10.20.193.51:0/2549916562 >> 10.20.193.51:0/2549916562 conn(0x7fe50c0a30c0 msgr2=0x7fe50c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- 10.20.193.51:0/2549916562 shutdown_connections 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- 10.20.193.51:0/2549916562 wait complete. 2026-02-17T11:45:41.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: monmap: 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 Processor -- start 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- start start 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: init 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 0x7fe50c09b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-a con 0x7fe50c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-b con 0x7fe50c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): picked mon.noname-c con 0x7fe50c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0a04b0 con 0x7fe50c0a0750 2026-02-17T11:45:41.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c09c850 con 0x7fe50c0a3bb0 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c09e710 con 0x7fe50c13b760 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.578+0000 7fe51247c640 10 monclient(hunting): authenticate will time out at 629.197996s 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 0x7fe50c09b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59260/0 (socket says 10.20.193.51:59260) 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 -- 10.20.193.51:0/2434485080 learned_addr learned my addr 10.20.193.51:0/2434485080 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): get_auth_request con 0x7fe50c13b760 auth_method 0 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 0x7fe50c09b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52856/0 (socket says 10.20.193.51:52856) 2026-02-17T11:45:41.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): get_auth_request con 0x7fe50c0a0750 auth_method 0 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe50b7fe640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient(hunting): handle_auth_done global_id 4331 payload 824 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 -- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 msgr2=0x7fe50c09bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 -- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 msgr2=0x7fe50c09b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 0x7fe50c09b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.579+0000 7fe5109f2640 1 -- 10.20.193.51:0/2434485080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c134ad0 con 0x7fe50c13b760 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe5109f2640 1 -- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 msgr2=0x7fe50c1311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe5109f2640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe50000ba10 tx=0x7fe50000bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50000c8b0 con 0x7fe50c13b760 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: dump: 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.598 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe500010070 con 0x7fe50c13b760 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 5 monclient: authenticate success, global_id 4331 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _renew_subs 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c134550 con 0x7fe50c13b760 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50000ccb0 con 0x7fe50c13b760 2026-02-17T11:45:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe50a7fc640 4 set_mon_vals no callback set 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe508ff9640 10 monclient: dump: 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _renew_subs 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c0a2650 con 0x7fe50c13b760 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.581+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c08d4a0 con 0x7fe50c13b760 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.582+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe50001d030 con 0x7fe50c13b760 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.582+0000 7fe508ff9640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 0x7fe4dc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.582+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4398+0+0 (secure 0 0 0) 0x7fe500051e90 con 0x7fe50c13b760 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.582+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 0x7fe4dc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.582+0000 7fe50bfff640 10 monclient: get_auth_request con 0x7fe4dc03dd10 auth_method 0 2026-02-17T11:45:41.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.584+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe50c08d4a0 con 0x7fe50c13b760 2026-02-17T11:45:41.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.584+0000 7fe508ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.584+0000 7fe508ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.585+0000 7fe50bfff640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 0x7fe4dc0401d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8036000 tx=0x7fe4f8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe51247c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:45:41.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe51247c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe51247c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe50c09dac0 con 0x7fe50c13b760 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe508ff9640 1 -- 10.20.193.51:0/2434485080 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe500015470 con 0x7fe50c13b760 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe508ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.684+0000 7fe508ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:41.687 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:41.688 INFO:teuthology.orchestra.run.trial051.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 msgr2=0x7fe4dc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 0x7fe4dc0401d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8036000 tx=0x7fe4f8033000 comp rx=0 tx=0).stop 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 10 monclient: shutdown 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 msgr2=0x7fe50c1311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe50000ba10 tx=0x7fe50000bee0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 shutdown_connections 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4dc03dd10 0x7fe4dc0401d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50c13b760 0x7fe50c1311e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe50c0a3bb0 0x7fe50c09bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 --2- 10.20.193.51:0/2434485080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe50c0a0750 0x7fe50c09b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 >> 10.20.193.51:0/2434485080 conn(0x7fe50c0a30c0 msgr2=0x7fe50c13a300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 shutdown_connections 2026-02-17T11:45:41.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.685+0000 7fe51247c640 1 -- 10.20.193.51:0/2434485080 wait complete. 2026-02-17T11:45:41.696 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T11:45:41.696 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-17T11:45:41.720 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-17T11:45:41.720 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:41.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.785+0000 7f2b204fa640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.785+0000 7f2b204fa640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.785+0000 7f2b204fa640 10 monclient: monmap: 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.786627+0000 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.786627+0000 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.790 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 Processor -- start 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 -- start start 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient: init 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2b180a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b1809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-b con 0x7f2b180a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2b1813b760 0x7f2b1813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-c con 0x7f2b1813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b1806e140 con 0x7f2b180a3bb0 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2b1809f910 con 0x7f2b1813b760 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1809ccd0 con 0x7f2b180a0750 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b204fa640 10 monclient(hunting): authenticate will time out at 629.405370s 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1e26f640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f2b180a3bb0 0x7f2b1809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44348/0 (socket says 10.20.193.51:44348) 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1e26f640 1 -- 10.20.193.51:0/4027531793 learned_addr learned my addr 10.20.193.51:0/4027531793 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b1809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): get_auth_request con 0x7f2b180a0750 auth_method 0 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1ea70640 1 --2- 10.20.193.51:0/4027531793 >> v2:10.20.193.142:3300/0 conn(0x7f2b1813b760 0x7f2b1813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1ea70640 10 monclient(hunting): get_auth_request con 0x7f2b1813b760 auth_method 0 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1ea70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1ea70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1ea70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_done global_id 4334 payload 274 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 -- 10.20.193.51:0/4027531793 >> v2:10.20.193.142:3300/0 conn(0x7f2b1813b760 msgr2=0x7f2b1813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/4027531793 >> v2:10.20.193.142:3300/0 conn(0x7f2b1813b760 0x7f2b1813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 -- 10.20.193.51:0/4027531793 >> v1:10.20.193.51:6789/0 conn(0x7f2b180a3bb0 legacy=0x7f2b1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.786+0000 7f2b1da6e640 1 -- 10.20.193.51:0/4027531793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1809eec0 con 0x7f2b180a0750 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1da6e640 1 -- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 msgr2=0x7f2b1809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b1809e1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b1809f230 tx=0x7f2b0c02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a2eb5e8b8bc7cc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 1 -- 10.20.193.51:0/4027531793 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c03c070 con 0x7f2b180a0750 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: dump: 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 1 -- 10.20.193.51:0/4027531793 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c02fbd0 con 0x7f2b180a0750 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 5 monclient: authenticate success, global_id 4334 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 1 -- 10.20.193.51:0/4027531793 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c037440 con 0x7f2b180a0750 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 4 set_mon_vals no callback set 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b1d26d640 10 monclient: dump: 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 10 monclient: shutdown 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 -- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 msgr2=0x7f2b1809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 --2- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b1809e1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b1809f230 tx=0x7f2b0c02ed50 comp rx=0 tx=0).stop 2026-02-17T11:45:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 -- 10.20.193.51:0/4027531793 shutdown_connections 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 --2- 10.20.193.51:0/4027531793 >> v2:10.20.193.142:3300/0 conn(0x7f2b1813b760 0x7f2b1813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 --2- 10.20.193.51:0/4027531793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b1809e1d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 -- 10.20.193.51:0/4027531793 >> 10.20.193.51:0/4027531793 conn(0x7f2b180a30c0 msgr2=0x7f2b180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 -- 10.20.193.51:0/4027531793 shutdown_connections 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 1 -- 10.20.193.51:0/4027531793 wait complete. 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.789+0000 7f2b204fa640 10 monclient: monmap: 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.805 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 Processor -- start 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 -- start start 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient: init 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-c con 0x7f2b180a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 0x7f2b181d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-a con 0x7f2b180a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 0x7f2b18132160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): picked mon.noname-b con 0x7f2b1813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2b180a04b0 con 0x7f2b180a3bb0 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1809c850 con 0x7f2b1813b760 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1809e710 con 0x7f2b180a0750 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b204fa640 10 monclient(hunting): authenticate will time out at 629.409499s 2026-02-17T11:45:41.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59278/0 (socket says 10.20.193.51:59278) 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 -- 10.20.193.51:0/2170718817 learned_addr learned my addr 10.20.193.51:0/2170718817 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): get_auth_request con 0x7f2b180a0750 auth_method 0 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 0x7f2b181d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): get_auth_request con 0x7f2b180a3bb0 auth_method 0 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1ea70640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 0x7f2b18132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient(hunting): handle_auth_done global_id 4337 payload 824 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 -- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 msgr2=0x7f2b18132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 0x7f2b18132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 -- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 msgr2=0x7f2b181d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 0x7f2b181d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 monclient: found mon.noname-c 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1e26f640 1 -- 10.20.193.51:0/2170718817 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b18135d90 con 0x7f2b180a0750 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1ea70640 10 monclient: get_auth_request con 0x7f2b1813b760 auth_method 0 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1ea70640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 0x7f2b18132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.790+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 0x7f2b181d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b1e26f640 1 -- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 msgr2=0x7f2b181cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b1e26f640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c7b0 tx=0x7f2b0800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08005de0 con 0x7f2b180a0750 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: dump: 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08007070 con 0x7f2b180a0750 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b204fa640 5 monclient: authenticate success, global_id 4337 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b204fa640 10 monclient: _renew_subs 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b204fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b18136070 con 0x7f2b180a0750 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08007440 con 0x7f2b180a0750 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2b1ca6c640 4 set_mon_vals no callback set 2026-02-17T11:45:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.792+0000 7f2afeffd640 10 monclient: dump: 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 10 monclient: _renew_subs 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b180a2b60 con 0x7f2b180a0750 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1809d7b0 con 0x7f2b180a0750 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2b080075e0 con 0x7f2b180a0750 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2afeffd640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 0x7f2ae8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f2b080521f0 con 0x7f2b180a0750 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.793+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 0x7f2ae8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.794+0000 7f2b1da6e640 10 monclient: get_auth_request con 0x7f2ae803dd60 auth_method 0 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.796+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2b0800a5e0 con 0x7f2b180a0750 2026-02-17T11:45:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.796+0000 7f2afeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.796+0000 7f2afeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.796+0000 7f2b1da6e640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 0x7f2ae8040220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b1806c1c0 tx=0x7f2b0c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.880+0000 7f2b204fa640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:41.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.880+0000 7f2b204fa640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:41.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.880+0000 7f2b204fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.880+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b1809dac0 con 0x7f2b180a0750 2026-02-17T11:45:41.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.881+0000 7f2afeffd640 1 -- 10.20.193.51:0/2170718817 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+12370 (secure 0 0 0) 0x7f2b08050d80 con 0x7f2b180a0750 2026-02-17T11:45:41.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.881+0000 7f2afeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:45:41.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.881+0000 7f2afeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:41.884 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:41.884 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":21,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T11:45:41.682596+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:45:34.073497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:41.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 msgr2=0x7f2ae8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 0x7f2ae8040220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b1806c1c0 tx=0x7f2b0c033000 comp rx=0 tx=0).stop 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 10 monclient: shutdown 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 msgr2=0x7f2b181cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c7b0 tx=0x7f2b0800cc80 comp rx=0 tx=0).stop 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 shutdown_connections 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ae803dd60 0x7f2ae8040220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b1813b760 0x7f2b18132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b180a3bb0 0x7f2b181d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 --2- 10.20.193.51:0/2170718817 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b180a0750 0x7f2b181cfad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 >> 10.20.193.51:0/2170718817 conn(0x7f2b180a30c0 msgr2=0x7f2b18138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 shutdown_connections 2026-02-17T11:45:41.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.882+0000 7f2b204fa640 1 -- 10.20.193.51:0/2170718817 wait complete. 2026-02-17T11:45:41.893 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T11:45:29.895545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-17T11:45:34.073497+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T11:45:41.894 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-17T11:45:41.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.960+0000 7f6a0e749640 10 monclient: get_monmap_and_config 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.960+0000 7f6a0e749640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.960+0000 7f6a0e749640 10 monclient: monmap: 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:41.961758+0000 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:41.961758+0000 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:41.963 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:41.964 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:41.964 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:41.964 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 Processor -- start 2026-02-17T11:45:41.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 -- start start 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient: init 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-b con 0x7f6a0809fa10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 0x7f6a0809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-a con 0x7f6a0809cdc0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6a0809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a0806db00 con 0x7f6a0809e540 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0806e140 con 0x7f6a0809cdc0 2026-02-17T11:45:41.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0809fdf0 con 0x7f6a0809fa10 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0e749640 10 monclient(hunting): authenticate will time out at 629.580582s 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 0x7f6a0809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59292/0 (socket says 10.20.193.51:59292) 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a0ccbf640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6a0809e540 0x7f6a0813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44356/0 (socket says 10.20.193.51:44356) 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 -- 10.20.193.51:0/164598345 learned_addr learned my addr 10.20.193.51:0/164598345 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): get_auth_request con 0x7f6a0809fa10 auth_method 0 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): get_auth_request con 0x7f6a0809cdc0 auth_method 0 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient(hunting): handle_auth_done global_id 4340 payload 274 2026-02-17T11:45:41.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 -- 10.20.193.51:0/164598345 >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 msgr2=0x7f6a0809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 --2- 10.20.193.51:0/164598345 >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 0x7f6a0809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 -- 10.20.193.51:0/164598345 >> v1:10.20.193.51:6789/0 conn(0x7f6a0809e540 legacy=0x7f6a0813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 monclient: found mon.noname-b 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a07fff640 1 -- 10.20.193.51:0/164598345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0809ec70 con 0x7f6a0809fa10 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.961+0000 7f6a077fe640 1 --2- 10.20.193.51:0/164598345 >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 0x7f6a0809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a07fff640 1 -- 10.20.193.51:0/164598345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 msgr2=0x7f6a0809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a07fff640 1 --2- 10.20.193.51:0/164598345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009970 tx=0x7f69f402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bb154cfdfaaaad6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 1 -- 10.20.193.51:0/164598345 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f403c070 con 0x7f6a0809fa10 2026-02-17T11:45:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: dump: 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.977 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 1 -- 10.20.193.51:0/164598345 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f402fcd0 con 0x7f6a0809fa10 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 1 -- 10.20.193.51:0/164598345 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4037660 con 0x7f6a0809fa10 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a06ffd640 10 monclient: dump: 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 5 monclient: authenticate success, global_id 4340 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 4 set_mon_vals no callback set 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 10 monclient: shutdown 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 -- 10.20.193.51:0/164598345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 msgr2=0x7f6a0809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 --2- 10.20.193.51:0/164598345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009970 tx=0x7f69f402ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 -- 10.20.193.51:0/164598345 shutdown_connections 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 --2- 10.20.193.51:0/164598345 >> v2:10.20.193.51:3300/0 conn(0x7f6a0809cdc0 0x7f6a0809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 --2- 10.20.193.51:0/164598345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a0809dac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 -- 10.20.193.51:0/164598345 >> 10.20.193.51:0/164598345 conn(0x7f6a080a30c0 msgr2=0x7f6a080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 -- 10.20.193.51:0/164598345 shutdown_connections 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.964+0000 7f6a0e749640 1 -- 10.20.193.51:0/164598345 wait complete. 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient: build_initial_monmap 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient: monmap: 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:41.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 Processor -- start 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 -- start start 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient: init 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a0809cdc0 0x7f6a081cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-b con 0x7f6a0809cdc0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-a con 0x7f6a0809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a08099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): picked mon.noname-c con 0x7f6a0809fa10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080a3e20 con 0x7f6a0809e540 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080a0560 con 0x7f6a0809cdc0 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a080a3fa0 con 0x7f6a0809fa10 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.965+0000 7f6a0e749640 10 monclient(hunting): authenticate will time out at 629.584966s 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a08099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52868/0 (socket says 10.20.193.51:52868) 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 -- 10.20.193.51:0/4284838888 learned_addr learned my addr 10.20.193.51:0/4284838888 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): get_auth_request con 0x7f6a0809e540 auth_method 0 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): get_auth_request con 0x7f6a0809fa10 auth_method 0 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a07fff640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a0809cdc0 0x7f6a081cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a07fff640 10 monclient(hunting): get_auth_request con 0x7f6a0809cdc0 auth_method 0 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:41.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient(hunting): handle_auth_done global_id 4317 payload 824 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 -- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 msgr2=0x7f6a08099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a08099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 -- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a0809cdc0 msgr2=0x7f6a081cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a0809cdc0 0x7f6a081cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 monclient: found mon.noname-a 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a077fe640 1 -- 10.20.193.51:0/4284838888 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0806f8f0 con 0x7f6a0809e540 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.966+0000 7f6a0ccbf640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a08099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:41.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a077fe640 1 -- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 msgr2=0x7f6a08099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a077fe640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69f800ec10 tx=0x7f69f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8017070 con 0x7f6a0809e540 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: dump: 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f800ce50 con 0x7f6a0809e540 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8013670 con 0x7f6a0809e540 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a04ff9640 10 monclient: dump: 2026-02-17T11:45:41.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a067fc640 4 set_mon_vals no callback set 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 5 monclient: authenticate success, global_id 4317 2026-02-17T11:45:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 10 monclient: _renew_subs 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0806f410 con 0x7f6a0809e540 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 10 monclient: _renew_subs 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.968+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a08093900 con 0x7f6a0809e540 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a0e749640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a0e749640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a0e749640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a08095030 con 0x7f6a0809e540 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f69f8024060 con 0x7f6a0809e540 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a04ff9640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 0x7f69d8040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f69f8052430 con 0x7f6a0809e540 2026-02-17T11:45:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a07fff640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 0x7f69d8040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.969+0000 7f6a07fff640 10 monclient: get_auth_request con 0x7f69d803dd90 auth_method 0 2026-02-17T11:45:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.971+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f69f8009460 con 0x7f6a0809e540 2026-02-17T11:45:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.971+0000 7f6a04ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.971+0000 7f6a04ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:41.972+0000 7f6a07fff640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 0x7f69d8040250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4036000 tx=0x7f69f4039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a0e749640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a0e749640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a0e749640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a0809dac0 con 0x7f6a0809e540 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a04ff9640 1 -- 10.20.193.51:0/4284838888 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f69f8013d30 con 0x7f6a0809e540 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a04ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T11:45:42.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.053+0000 7f6a04ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:42.057 INFO:teuthology.orchestra.run.trial051.stdout:pg_num: 1 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 msgr2=0x7f69d8040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 0x7f69d8040250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4036000 tx=0x7f69f4039040 comp rx=0 tx=0).stop 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 10 monclient: shutdown 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 msgr2=0x7f6a08099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69f800ec10 tx=0x7f69f800c520 comp rx=0 tx=0).stop 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 shutdown_connections 2026-02-17T11:45:42.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f69d803dd90 0x7f69d8040250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a0809fa10 0x7f6a08099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a0809e540 0x7f6a08099a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 --2- 10.20.193.51:0/4284838888 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a0809cdc0 0x7f6a081cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 >> 10.20.193.51:0/4284838888 conn(0x7f6a080a30c0 msgr2=0x7f6a08072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 shutdown_connections 2026-02-17T11:45:42.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.054+0000 7f6a0e749640 1 -- 10.20.193.51:0/4284838888 wait complete. 2026-02-17T11:45:42.064 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.129+0000 7f1855a76640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.129+0000 7f1855a76640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.129+0000 7f1855a76640 10 monclient: monmap: 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.130821+0000 2026-02-17T11:45:42.134 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.130821+0000 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 Processor -- start 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 -- start start 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient: init 2026-02-17T11:45:42.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-b con 0x7f185009fa10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f185009cdc0 0x7f185009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-c con 0x7f185009cdc0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f185009e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185006db00 con 0x7f185009e540 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f185006e140 con 0x7f185009cdc0 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f185009fdf0 con 0x7f185009fa10 2026-02-17T11:45:42.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f1855a76640 10 monclient(hunting): authenticate will time out at 629.749579s 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59308/0 (socket says 10.20.193.51:59308) 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 -- 10.20.193.51:0/4183839006 learned_addr learned my addr 10.20.193.51:0/4183839006 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): get_auth_request con 0x7f185009fa10 auth_method 0 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184e7fc640 1 --2- 10.20.193.51:0/4183839006 >> v2:10.20.193.142:3300/0 conn(0x7f185009cdc0 0x7f185009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184e7fc640 10 monclient(hunting): get_auth_request con 0x7f185009cdc0 auth_method 0 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient(hunting): handle_auth_done global_id 4346 payload 274 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 -- 10.20.193.51:0/4183839006 >> v2:10.20.193.142:3300/0 conn(0x7f185009cdc0 msgr2=0x7f185009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 --2- 10.20.193.51:0/4183839006 >> v2:10.20.193.142:3300/0 conn(0x7f185009cdc0 0x7f185009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 -- 10.20.193.51:0/4183839006 >> v1:10.20.193.142:6789/0 conn(0x7f185009e540 legacy=0x7f185013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 monclient: found mon.noname-b 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.130+0000 7f184effd640 1 -- 10.20.193.51:0/4183839006 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185009ec70 con 0x7f185009fa10 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184effd640 1 -- 10.20.193.51:0/4183839006 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 msgr2=0x7f185009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184effd640 1 --2- 10.20.193.51:0/4183839006 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1844009970 tx=0x7f184402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4beb802ff4acf259 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 1 -- 10.20.193.51:0/4183839006 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184403c070 con 0x7f185009fa10 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: dump: 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 5 monclient: authenticate success, global_id 4346 2026-02-17T11:45:42.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 1 -- 10.20.193.51:0/4183839006 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184402fcd0 con 0x7f185009fa10 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 1 -- 10.20.193.51:0/4183839006 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844037660 con 0x7f185009fa10 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 4 set_mon_vals no callback set 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f184dffb640 10 monclient: dump: 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 10 monclient: shutdown 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 -- 10.20.193.51:0/4183839006 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 msgr2=0x7f185009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 --2- 10.20.193.51:0/4183839006 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1844009970 tx=0x7f184402ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 -- 10.20.193.51:0/4183839006 shutdown_connections 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 --2- 10.20.193.51:0/4183839006 >> v2:10.20.193.142:3300/0 conn(0x7f185009cdc0 0x7f185009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 --2- 10.20.193.51:0/4183839006 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009fa10 0x7f185009dac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 -- 10.20.193.51:0/4183839006 >> 10.20.193.51:0/4183839006 conn(0x7f18500a30c0 msgr2=0x7f18500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 -- 10.20.193.51:0/4183839006 shutdown_connections 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.133+0000 7f1855a76640 1 -- 10.20.193.51:0/4183839006 wait complete. 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient: monmap: 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.149 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 Processor -- start 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 -- start start 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient: init 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 0x7f185009a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-a con 0x7f185009cdc0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-c con 0x7f185009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 0x7f185009b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): picked mon.noname-b con 0x7f185009fa10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f18500a3e20 con 0x7f185009cdc0 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f18500a0560 con 0x7f185009fa10 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f18500a3fa0 con 0x7f185009e540 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f1855a76640 10 monclient(hunting): authenticate will time out at 629.753796s 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59314/0 (socket says 10.20.193.51:59314) 2026-02-17T11:45:42.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 1 -- 10.20.193.51:0/3976152519 learned_addr learned my addr 10.20.193.51:0/3976152519 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): get_auth_request con 0x7f185009e540 auth_method 0 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 0x7f185009a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): get_auth_request con 0x7f185009cdc0 auth_method 0 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 10 monclient(hunting): handle_auth_done global_id 4349 payload 824 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184e7fc640 1 -- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 msgr2=0x7f185009b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.134+0000 7f184f7fe640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 0x7f185009b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 0x7f185009b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 1 -- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 msgr2=0x7f185009a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 0x7f185009a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184e7fc640 1 -- 10.20.193.51:0/3976152519 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185006f410 con 0x7f185009e540 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184effd640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 0x7f185009a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184f7fe640 10 monclient: get_auth_request con 0x7f185009fa10 auth_method 0 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.135+0000 7f184f7fe640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 0x7f185009b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f184e7fc640 1 -- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 msgr2=0x7f185009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f184e7fc640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f183800e770 tx=0x7f183800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838017020 con 0x7f185009e540 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: dump: 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.154 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1838004440 con 0x7f185009e540 2026-02-17T11:45:42.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 5 monclient: authenticate success, global_id 4349 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _renew_subs 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185009d7b0 con 0x7f185009e540 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800f040 con 0x7f185009e540 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f184d7fa640 4 set_mon_vals no callback set 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 10 monclient: dump: 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.156 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _renew_subs 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18500976b0 con 0x7f185009e540 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185009dac0 con 0x7f185009e540 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.137+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1838012050 con 0x7f185009e540 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.138+0000 7f1827fff640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 0x7f18200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.138+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f18380523f0 con 0x7f185009e540 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.138+0000 7f184effd640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 0x7f18200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.138+0000 7f184effd640 10 monclient: get_auth_request con 0x7f182003dd10 auth_method 0 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.140+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1838021020 con 0x7f185009e540 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.140+0000 7f1827fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.140+0000 7f1827fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.140+0000 7f184effd640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 0x7f18200401d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1844036000 tx=0x7f1844039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1855a76640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T11:45:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1855a76640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T11:45:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1855a76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f1850069830 con 0x7f185009e540 2026-02-17T11:45:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1827fff640 1 -- 10.20.193.51:0/3976152519 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) ==== 92+0+10 (secure 0 0 0) 0x7f1838024da0 con 0x7f185009e540 2026-02-17T11:45:42.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1827fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T11:45:42.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.222+0000 7f1827fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:42.226 INFO:teuthology.orchestra.run.trial051.stdout:pg_num: 8 2026-02-17T11:45:42.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 msgr2=0x7f18200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 0x7f18200401d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1844036000 tx=0x7f1844039040 comp rx=0 tx=0).stop 2026-02-17T11:45:42.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 10 monclient: shutdown 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 msgr2=0x7f185009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f183800e770 tx=0x7f183800ec40 comp rx=0 tx=0).stop 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 shutdown_connections 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f182003dd10 0x7f18200401d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f185009fa10 0x7f185009b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f185009e540 0x7f185009ab30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 --2- 10.20.193.51:0/3976152519 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f185009cdc0 0x7f185009a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 >> 10.20.193.51:0/3976152519 conn(0x7f18500a30c0 msgr2=0x7f1850072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 shutdown_connections 2026-02-17T11:45:42.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.223+0000 7f1855a76640 1 -- 10.20.193.51:0/3976152519 wait complete. 2026-02-17T11:45:42.233 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-17T11:45:42.234 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 10 monclient: monmap: 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.302024+0000 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.302024+0000 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 1 Processor -- start 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 1 -- start start 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.301+0000 7f04dfbce640 10 monclient: init 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f04d8138190 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-b con 0x7f04d8070bf0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f04d813d510 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d8070fd0 con 0x7f04d813d510 2026-02-17T11:45:42.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80a03e0 con 0x7f04d8138190 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f04d806fdc0 con 0x7f04d8070bf0 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dfbce640 10 monclient(hunting): authenticate will time out at 629.921153s 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59322/0 (socket says 10.20.193.51:59322) 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04de144640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f04d813d510 0x7f04d813f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44366/0 (socket says 10.20.193.51:44366) 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 -- 10.20.193.51:0/2557405550 learned_addr learned my addr 10.20.193.51:0/2557405550 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): get_auth_request con 0x7f04d8070bf0 auth_method 0 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient(hunting): handle_auth_done global_id 4352 payload 274 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 -- 10.20.193.51:0/2557405550 >> v1:10.20.193.142:6789/0 conn(0x7f04d8138190 legacy=0x7f04d8138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 -- 10.20.193.51:0/2557405550 >> v1:10.20.193.51:6789/0 conn(0x7f04d813d510 legacy=0x7f04d813f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 monclient: found mon.noname-b 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.302+0000 7f04dd142640 1 -- 10.20.193.51:0/2557405550 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d80700a0 con 0x7f04d8070bf0 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.304+0000 7f04dd142640 1 -- 10.20.193.51:0/2557405550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 msgr2=0x7f04d813cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.304+0000 7f04dd142640 1 --2- 10.20.193.51:0/2557405550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0099a0 tx=0x7f04cc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb3cb8bcd22e028 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.304+0000 7f04dc941640 1 -- 10.20.193.51:0/2557405550 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc03c070 con 0x7f04d8070bf0 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.304+0000 7f04dc941640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: dump: 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.316 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 5 monclient: authenticate success, global_id 4352 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:42.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 1 -- 10.20.193.51:0/2557405550 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc02fdf0 con 0x7f04d8070bf0 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 1 -- 10.20.193.51:0/2557405550 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc037660 con 0x7f04d8070bf0 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dc941640 10 monclient: dump: 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.318 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 4 set_mon_vals no callback set 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 10 monclient: shutdown 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- 10.20.193.51:0/2557405550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 msgr2=0x7f04d813cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2557405550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0099a0 tx=0x7f04cc02ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:42.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- 10.20.193.51:0/2557405550 shutdown_connections 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2557405550 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d8070bf0 0x7f04d813cfd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- 10.20.193.51:0/2557405550 >> 10.20.193.51:0/2557405550 conn(0x7f04d80a3940 msgr2=0x7f04d80a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- 10.20.193.51:0/2557405550 shutdown_connections 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- 10.20.193.51:0/2557405550 wait complete. 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 10 monclient: monmap: 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.320 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 Processor -- start 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 1 -- start start 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.305+0000 7f04dfbce640 10 monclient: init 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04d8070bf0 0x7f04d81cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-b con 0x7f04d8070bf0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-a con 0x7f04d8138190 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): picked mon.noname-c con 0x7f04d813d510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80a4850 con 0x7f04d8138190 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80a46d0 con 0x7f04d8070bf0 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f04d8141020 con 0x7f04d813d510 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dfbce640 10 monclient(hunting): authenticate will time out at 629.925199s 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52892/0 (socket says 10.20.193.51:52892) 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59336/0 (socket says 10.20.193.51:59336) 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 1 -- 10.20.193.51:0/2747614312 learned_addr learned my addr 10.20.193.51:0/2747614312 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): get_auth_request con 0x7f04d8138190 auth_method 0 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): get_auth_request con 0x7f04d813d510 auth_method 0 2026-02-17T11:45:42.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd943640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04d8070bf0 0x7f04d81cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd943640 10 monclient(hunting): get_auth_request con 0x7f04d8070bf0 auth_method 0 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd943640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd943640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd943640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient(hunting): handle_auth_done global_id 4355 payload 824 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 -- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04d8070bf0 msgr2=0x7f04d81cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04d8070bf0 0x7f04d81cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 -- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 msgr2=0x7f04d813bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04de144640 1 -- 10.20.193.51:0/2747614312 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d813aa00 con 0x7f04d813d510 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.306+0000 7f04dd142640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04de144640 1 -- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 msgr2=0x7f04d813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04de144640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f04d400cac0 tx=0x7f04d400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4017070 con 0x7f04d813d510 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: dump: 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.326 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4012400 con 0x7f04d813d510 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d40127f0 con 0x7f04d813d510 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c7fff640 4 set_mon_vals no callback set 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04c67fc640 10 monclient: dump: 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.328 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 5 monclient: authenticate success, global_id 4355 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 10 monclient: _renew_subs 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d813d160 con 0x7f04d813d510 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 10 monclient: _renew_subs 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.308+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81404b0 con 0x7f04d813d510 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dfbce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dfbce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dfbce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8138570 con 0x7f04d813d510 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f04d4007070 con 0x7f04d813d510 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04c67fc640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 0x7f04a8040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f04d4052500 con 0x7f04d813d510 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dd943640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 0x7f04a8040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.309+0000 7f04dd943640 10 monclient: get_auth_request con 0x7f04a803dd40 auth_method 0 2026-02-17T11:45:42.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.311+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f04d4007570 con 0x7f04d813d510 2026-02-17T11:45:42.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.311+0000 7f04c67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.311+0000 7f04c67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.312+0000 7f04dd943640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 0x7f04a8040200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005020 tx=0x7f04c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.392+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04d81cf630 con 0x7f04a803dd40 2026-02-17T11:45:42.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.393+0000 7f04c67fc640 1 -- 10.20.193.51:0/2747614312 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34164 (secure 0 0 0) 0x7f04d81cf630 con 0x7f04a803dd40 2026-02-17T11:45:42.396 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 msgr2=0x7f04a8040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 0x7f04a8040200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005020 tx=0x7f04c8009040 comp rx=0 tx=0).stop 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 10 monclient: shutdown 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 msgr2=0x7f04d813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f04d400cac0 tx=0x7f04d400cf90 comp rx=0 tx=0).stop 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 shutdown_connections 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f04a803dd40 0x7f04a8040200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04d813d510 0x7f04d813c470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04d8138190 0x7f04d813bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 --2- 10.20.193.51:0/2747614312 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04d8070bf0 0x7f04d81cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 >> 10.20.193.51:0/2747614312 conn(0x7f04d80a3940 msgr2=0x7f04d80a5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 shutdown_connections 2026-02-17T11:45:42.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.394+0000 7f04dfbce640 1 -- 10.20.193.51:0/2747614312 wait complete. 2026-02-17T11:45:42.403 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T11:45:41.873752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163028,"kb_used_data":1232,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068012,"statfs":{"total":579820584960,"available":579653644288,"internally_reserved":0,"allocated":1261568,"data_stored":1437316,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":165534374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000440"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745288+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T11:45:37.745288+0000","last_peered":"2026-02-17T11:45:37.745288+0000","last_clean":"2026-02-17T11:45:37.745288+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T11:45:37.745288+0000","last_undegraded":"2026-02-17T11:45:37.745288+0000","last_fullsized":"2026-02-17T11:45:37.745288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745222+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T11:45:37.745222+0000","last_peered":"2026-02-17T11:45:37.745222+0000","last_clean":"2026-02-17T11:45:37.745222+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T11:45:37.745222+0000","last_undegraded":"2026-02-17T11:45:37.745222+0000","last_fullsized":"2026-02-17T11:45:37.745222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745005+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T11:45:37.745005+0000","last_peered":"2026-02-17T11:45:37.745005+0000","last_clean":"2026-02-17T11:45:37.745005+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T11:45:37.745005+0000","last_undegraded":"2026-02-17T11:45:37.745005+0000","last_fullsized":"2026-02-17T11:45:37.745005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745242+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T11:45:37.745242+0000","last_peered":"2026-02-17T11:45:37.745242+0000","last_clean":"2026-02-17T11:45:37.745242+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T11:45:37.745242+0000","last_undegraded":"2026-02-17T11:45:37.745242+0000","last_fullsized":"2026-02-17T11:45:37.745242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.748101+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T11:45:37.748101+0000","last_peered":"2026-02-17T11:45:37.748101+0000","last_clean":"2026-02-17T11:45:37.748101+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T11:45:37.748101+0000","last_undegraded":"2026-02-17T11:45:37.748101+0000","last_fullsized":"2026-02-17T11:45:37.748101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.935784+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T11:45:37.935784+0000","last_peered":"2026-02-17T11:45:37.935784+0000","last_clean":"2026-02-17T11:45:37.935784+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T11:45:37.935784+0000","last_undegraded":"2026-02-17T11:45:37.935784+0000","last_fullsized":"2026-02-17T11:45:37.935784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744965+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T11:45:37.744965+0000","last_peered":"2026-02-17T11:45:37.744965+0000","last_clean":"2026-02-17T11:45:37.744965+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T11:45:37.744965+0000","last_undegraded":"2026-02-17T11:45:37.744965+0000","last_fullsized":"2026-02-17T11:45:37.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.747404+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T11:45:37.747404+0000","last_peered":"2026-02-17T11:45:37.747404+0000","last_clean":"2026-02-17T11:45:37.747404+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T11:45:37.747404+0000","last_undegraded":"2026-02-17T11:45:37.747404+0000","last_fullsized":"2026-02-17T11:45:37.747404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744393+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T11:45:37.744393+0000","last_peered":"2026-02-17T11:45:37.744393+0000","last_clean":"2026-02-17T11:45:37.744393+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T11:45:37.744393+0000","last_undegraded":"2026-02-17T11:45:37.744393+0000","last_fullsized":"2026-02-17T11:45:37.744393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:42.405 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.468+0000 7ff9c0311640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.468+0000 7ff9c0311640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient: monmap: 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.469974+0000 2026-02-17T11:45:42.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.469974+0000 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 Processor -- start 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 -- start start 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient: init 2026-02-17T11:45:42.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff9b80a3bb0 0x7ff9b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-a con 0x7ff9b80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff9b80a0750 0x7ff9b809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-c con 0x7ff9b80a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff9b809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b806e140 con 0x7ff9b809e540 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b80a3f90 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b809f910 con 0x7ff9b80a0750 2026-02-17T11:45:42.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9c0311640 10 monclient(hunting): authenticate will time out at 630.088708s 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff9b80a3bb0 0x7ff9b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be887640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff9b809e540 0x7ff9b813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44382/0 (socket says 10.20.193.51:44382) 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be887640 1 -- 10.20.193.51:0/424762129 learned_addr learned my addr 10.20.193.51:0/424762129 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): get_auth_request con 0x7ff9b80a3bb0 auth_method 0 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9bd885640 1 --2- 10.20.193.51:0/424762129 >> v2:10.20.193.142:3300/0 conn(0x7ff9b80a0750 0x7ff9b809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9be086640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9bd885640 10 monclient(hunting): get_auth_request con 0x7ff9b80a0750 auth_method 0 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9bd885640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9bd885640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.469+0000 7ff9bd885640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 10 monclient(hunting): handle_auth_done global_id 4326 payload 274 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 1 -- 10.20.193.51:0/424762129 >> v2:10.20.193.142:3300/0 conn(0x7ff9b80a0750 msgr2=0x7ff9b809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 1 --2- 10.20.193.51:0/424762129 >> v2:10.20.193.142:3300/0 conn(0x7ff9b80a0750 0x7ff9b809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 1 -- 10.20.193.51:0/424762129 >> v1:10.20.193.51:6789/0 conn(0x7ff9b809e540 legacy=0x7ff9b813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 1 monclient: found mon.noname-a 2026-02-17T11:45:42.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.470+0000 7ff9be086640 1 -- 10.20.193.51:0/424762129 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b809ccd0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9be086640 1 -- 10.20.193.51:0/424762129 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 msgr2=0x7ff9b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9be086640 1 --2- 10.20.193.51:0/424762129 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b809dac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9b806c1c0 tx=0x7ff9a802ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b8a52c11e6fe96 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 1 -- 10.20.193.51:0/424762129 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a803c070 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: dump: 2026-02-17T11:45:42.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9c0311640 5 monclient: authenticate success, global_id 4326 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 1 -- 10.20.193.51:0/424762129 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a802fbb0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 1 -- 10.20.193.51:0/424762129 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8037440 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9bd084640 10 monclient: dump: 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.488 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9c0311640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.472+0000 7ff9c0311640 4 set_mon_vals no callback set 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: shutdown 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- 10.20.193.51:0/424762129 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 msgr2=0x7ff9b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- 10.20.193.51:0/424762129 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b809dac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9b806c1c0 tx=0x7ff9a802ed30 comp rx=0 tx=0).stop 2026-02-17T11:45:42.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- 10.20.193.51:0/424762129 shutdown_connections 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- 10.20.193.51:0/424762129 >> v2:10.20.193.142:3300/0 conn(0x7ff9b80a0750 0x7ff9b809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- 10.20.193.51:0/424762129 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b809dac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- 10.20.193.51:0/424762129 >> 10.20.193.51:0/424762129 conn(0x7ff9b80a30c0 msgr2=0x7ff9b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- 10.20.193.51:0/424762129 shutdown_connections 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- 10.20.193.51:0/424762129 wait complete. 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: monmap: 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.490 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 Processor -- start 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 -- start start 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: init 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9b809e540 0x7ff9b8092b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-b con 0x7ff9b809e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9b80a0750 0x7ff9b80930c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-c con 0x7ff9b80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.473+0000 7ff9c0311640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): picked mon.noname-a con 0x7ff9b80a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80a04b0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b809c850 con 0x7ff9b809e540 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b813de80 con 0x7ff9b80a0750 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9c0311640 10 monclient(hunting): authenticate will time out at 630.093011s 2026-02-17T11:45:42.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52902/0 (socket says 10.20.193.51:52902) 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 -- 10.20.193.51:0/1633845839 learned_addr learned my addr 10.20.193.51:0/1633845839 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9b80a0750 0x7ff9b80930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): get_auth_request con 0x7ff9b80a3bb0 auth_method 0 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): get_auth_request con 0x7ff9b80a0750 auth_method 0 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9bd885640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be086640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9b809e540 0x7ff9b8092b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be086640 10 monclient(hunting): get_auth_request con 0x7ff9b809e540 auth_method 0 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be086640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be086640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be086640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient(hunting): handle_auth_done global_id 4329 payload 824 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 -- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9b80a0750 msgr2=0x7ff9b80930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9b80a0750 0x7ff9b80930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 -- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9b809e540 msgr2=0x7ff9b8092b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9b809e540 0x7ff9b8092b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 monclient: found mon.noname-a 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.474+0000 7ff9be887640 1 -- 10.20.193.51:0/1633845839 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b80966c0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9be887640 1 -- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 msgr2=0x7ff9b8093600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9be887640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400ca40 tx=0x7ff9b400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400add0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: dump: 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.496 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4012400 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40127f0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff99effd640 10 monclient: dump: 2026-02-17T11:45:42.497 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9bc883640 4 set_mon_vals no callback set 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 5 monclient: authenticate success, global_id 4329 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 10 monclient: _renew_subs 2026-02-17T11:45:42.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b806f730 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 10 monclient: _renew_subs 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.476+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b80963e0 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9c0311640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9c0311640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9c0311640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b80a2c70 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff9b4012a10 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff99effd640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 0x7ff988040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7ff9b4052950 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9be086640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 0x7ff988040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.477+0000 7ff9be086640 10 monclient: get_auth_request con 0x7ff98803dd60 auth_method 0 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.479+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9b80a2c70 con 0x7ff9b80a3bb0 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.479+0000 7ff99effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.479+0000 7ff99effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.480+0000 7ff9be086640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 0x7ff988040220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9b809f5f0 tx=0x7ff9a8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.564+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9b80008d0 con 0x7ff98803dd60 2026-02-17T11:45:42.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff99effd640 1 -- 10.20.193.51:0/1633845839 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34164 (secure 0 0 0) 0x7ff9b80008d0 con 0x7ff98803dd60 2026-02-17T11:45:42.568 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T11:45:42.569 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T11:45:42.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 msgr2=0x7ff988040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 0x7ff988040220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9b809f5f0 tx=0x7ff9a8033000 comp rx=0 tx=0).stop 2026-02-17T11:45:42.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 10 monclient: shutdown 2026-02-17T11:45:42.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 msgr2=0x7ff9b8093600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400ca40 tx=0x7ff9b400cf10 comp rx=0 tx=0).stop 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 shutdown_connections 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff98803dd60 0x7ff988040220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9b80a3bb0 0x7ff9b8093600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9b80a0750 0x7ff9b80930c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 --2- 10.20.193.51:0/1633845839 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9b809e540 0x7ff9b8092b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 >> 10.20.193.51:0/1633845839 conn(0x7ff9b80a30c0 msgr2=0x7ff9b8072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 shutdown_connections 2026-02-17T11:45:42.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.566+0000 7ff9c0311640 1 -- 10.20.193.51:0/1633845839 wait complete. 2026-02-17T11:45:42.575 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T11:45:41.873752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163028,"kb_used_data":1232,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068012,"statfs":{"total":579820584960,"available":579653644288,"internally_reserved":0,"allocated":1261568,"data_stored":1437316,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":165534374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000440"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745288+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T11:45:37.745288+0000","last_peered":"2026-02-17T11:45:37.745288+0000","last_clean":"2026-02-17T11:45:37.745288+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T11:45:37.745288+0000","last_undegraded":"2026-02-17T11:45:37.745288+0000","last_fullsized":"2026-02-17T11:45:37.745288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745222+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T11:45:37.745222+0000","last_peered":"2026-02-17T11:45:37.745222+0000","last_clean":"2026-02-17T11:45:37.745222+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T11:45:37.745222+0000","last_undegraded":"2026-02-17T11:45:37.745222+0000","last_fullsized":"2026-02-17T11:45:37.745222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745005+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T11:45:37.745005+0000","last_peered":"2026-02-17T11:45:37.745005+0000","last_clean":"2026-02-17T11:45:37.745005+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T11:45:37.745005+0000","last_undegraded":"2026-02-17T11:45:37.745005+0000","last_fullsized":"2026-02-17T11:45:37.745005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.745242+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T11:45:37.745242+0000","last_peered":"2026-02-17T11:45:37.745242+0000","last_clean":"2026-02-17T11:45:37.745242+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T11:45:37.745242+0000","last_undegraded":"2026-02-17T11:45:37.745242+0000","last_fullsized":"2026-02-17T11:45:37.745242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.748101+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T11:45:37.748101+0000","last_peered":"2026-02-17T11:45:37.748101+0000","last_clean":"2026-02-17T11:45:37.748101+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T11:45:37.748101+0000","last_undegraded":"2026-02-17T11:45:37.748101+0000","last_fullsized":"2026-02-17T11:45:37.748101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.935784+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T11:45:37.935784+0000","last_peered":"2026-02-17T11:45:37.935784+0000","last_clean":"2026-02-17T11:45:37.935784+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T11:45:37.935784+0000","last_undegraded":"2026-02-17T11:45:37.935784+0000","last_fullsized":"2026-02-17T11:45:37.935784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744965+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T11:45:37.744965+0000","last_peered":"2026-02-17T11:45:37.744965+0000","last_clean":"2026-02-17T11:45:37.744965+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T11:45:37.744965+0000","last_undegraded":"2026-02-17T11:45:37.744965+0000","last_fullsized":"2026-02-17T11:45:37.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.747404+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T11:45:37.747404+0000","last_peered":"2026-02-17T11:45:37.747404+0000","last_clean":"2026-02-17T11:45:37.747404+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T11:45:37.747404+0000","last_undegraded":"2026-02-17T11:45:37.747404+0000","last_fullsized":"2026-02-17T11:45:37.747404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:37.744393+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T11:45:37.744393+0000","last_peered":"2026-02-17T11:45:37.744393+0000","last_clean":"2026-02-17T11:45:37.744393+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T11:45:37.744393+0000","last_undegraded":"2026-02-17T11:45:37.744393+0000","last_fullsized":"2026-02-17T11:45:37.744393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":188416,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":249856,"data_stored":592165,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":192512,"data_stored":63256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:42.577 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-17T11:45:42.577 DEBUG:tasks.mon_thrash:Yielding 2026-02-17T11:45:42.578 INFO:teuthology.run_tasks:Running task rados... 2026-02-17T11:45:42.599 INFO:tasks.rados:Beginning rados... 2026-02-17T11:45:42.599 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-17T11:45:42.614 INFO:tasks.rados:joining rados 2026-02-17T11:45:42.614 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-17T11:45:42.614 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771328742, revive delay: 20.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-17T11:45:42.614 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:45:42.614 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:45:42.615 INFO:tasks.rados:clients are ['client.0'] 2026-02-17T11:45:42.615 INFO:tasks.rados:starting run 0 out of 1 2026-02-17T11:45:42.615 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T11:45:42.616 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-17T11:45:42.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.681+0000 7fe9af8b0640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.681+0000 7fe9af8b0640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.681+0000 7fe9af8b0640 10 monclient: monmap: 2026-02-17T11:45:42.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.682905+0000 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.682905+0000 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 Processor -- start 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 -- start start 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient: init 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe9a80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe9a80a0750 0x7fe9a809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-c con 0x7fe9a80a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe9a813b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a806e140 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a809f910 con 0x7fe9a813b760 2026-02-17T11:45:42.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a809ccd0 con 0x7fe9a80a0750 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9af8b0640 10 monclient(hunting): authenticate will time out at 630.301666s 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ad625640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe9a80a3bb0 0x7fe9a809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44386/0 (socket says 10.20.193.51:44386) 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ad625640 1 -- 10.20.193.51:0/456241425 learned_addr learned my addr 10.20.193.51:0/456241425 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ace24640 1 --2- 10.20.193.51:0/456241425 >> v2:10.20.193.142:3300/0 conn(0x7fe9a80a0750 0x7fe9a809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ace24640 10 monclient(hunting): get_auth_request con 0x7fe9a80a0750 auth_method 0 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ace24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ace24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.682+0000 7fe9ace24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient(hunting): handle_auth_done global_id 4270 payload 274 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 1 -- 10.20.193.51:0/456241425 >> v1:10.20.193.142:6789/0 conn(0x7fe9a813b760 legacy=0x7fe9a813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 1 -- 10.20.193.51:0/456241425 >> v1:10.20.193.51:6789/0 conn(0x7fe9a80a3bb0 legacy=0x7fe9a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:42.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.683+0000 7fe9ace24640 1 -- 10.20.193.51:0/456241425 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a809eec0 con 0x7fe9a80a0750 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.685+0000 7fc9da722640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.685+0000 7fc9da722640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.685+0000 7fc9da722640 10 monclient: monmap: 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.686739+0000 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.686739+0000 2026-02-17T11:45:42.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9ace24640 1 -- 10.20.193.51:0/456241425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 msgr2=0x7fe9a809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9ace24640 1 --2- 10.20.193.51:0/456241425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a809e1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0098a0 tx=0x7fe99c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470e3e60540a773b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 Processor -- start 2026-02-17T11:45:42.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 1 -- 10.20.193.51:0/456241425 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c03c070 con 0x7fe9a80a0750 2026-02-17T11:45:42.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 -- start start 2026-02-17T11:45:42.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient: init 2026-02-17T11:45:42.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: dump: 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 1 -- 10.20.193.51:0/456241425 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c02fce0 con 0x7fe9a80a0750 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 5 monclient: authenticate success, global_id 4270 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 4 set_mon_vals no callback set 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 1 -- 10.20.193.51:0/456241425 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c037660 con 0x7fe9a80a0750 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe997fff640 10 monclient: dump: 2026-02-17T11:45:42.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 10 monclient: shutdown 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 -- 10.20.193.51:0/456241425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 msgr2=0x7fe9a809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/456241425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a809e1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0098a0 tx=0x7fe99c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 -- 10.20.193.51:0/456241425 shutdown_connections 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/456241425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a809e1d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 -- 10.20.193.51:0/456241425 >> 10.20.193.51:0/456241425 conn(0x7fe9a80a30c0 msgr2=0x7fe9a80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 -- 10.20.193.51:0/456241425 shutdown_connections 2026-02-17T11:45:42.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 1 -- 10.20.193.51:0/456241425 wait complete. 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc9d40a0370 0x7fc9d40a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-a con 0x7fc9d40a0370 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc9d40a0c90 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc9d4138a40 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:42.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d40aa990 con 0x7fc9d4138a40 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d40a2110 con 0x7fc9d40a0c90 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d40a1590 con 0x7fc9d40a0370 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9da722640 10 monclient(hunting): authenticate will time out at 630.305735s 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc9d40a0370 0x7fc9d40a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d8c98640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc9d4138a40 0x7fc9d4140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44400/0 (socket says 10.20.193.51:44400) 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d8c98640 1 -- 10.20.193.51:0/1929689317 learned_addr learned my addr 10.20.193.51:0/1929689317 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): get_auth_request con 0x7fc9d40a0370 auth_method 0 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fe9af8b0640 10 monclient: monmap: 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.703 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_done global_id 4332 payload 274 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 1 -- 10.20.193.51:0/1929689317 >> v1:10.20.193.142:6789/0 conn(0x7fc9d40a0c90 legacy=0x7fc9d4138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 1 -- 10.20.193.51:0/1929689317 >> v1:10.20.193.51:6789/0 conn(0x7fc9d4138a40 legacy=0x7fc9d4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 1 monclient: found mon.noname-a 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:45:42.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.686+0000 7fc9d3fff640 1 -- 10.20.193.51:0/1929689317 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d40a29b0 con 0x7fc9d40a0370 2026-02-17T11:45:42.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 Processor -- start 2026-02-17T11:45:42.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 -- start start 2026-02-17T11:45:42.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient: init 2026-02-17T11:45:42.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-b con 0x7fe9a80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-c con 0x7fe9a80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9a813b760 0x7fe9a808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): picked mon.noname-a con 0x7fe9a813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a809e710 con 0x7fe9a813b760 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a80a04b0 con 0x7fe9a80a0750 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a809e890 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9af8b0640 10 monclient(hunting): authenticate will time out at 630.306395s 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59366/0 (socket says 10.20.193.51:59366) 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 -- 10.20.193.51:0/815598978 learned_addr learned my addr 10.20.193.51:0/815598978 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): get_auth_request con 0x7fe9a80a3bb0 auth_method 0 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ad625640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ad625640 10 monclient(hunting): get_auth_request con 0x7fe9a80a0750 auth_method 0 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ad625640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ad625640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ad625640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient(hunting): handle_auth_done global_id 4361 payload 824 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 -- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 msgr2=0x7fe9a813abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a813abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 -- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9a813b760 msgr2=0x7fe9a808d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9a813b760 0x7fe9a808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.687+0000 7fe9ace24640 1 -- 10.20.193.51:0/815598978 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a80909f0 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d3fff640 1 -- 10.20.193.51:0/1929689317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 msgr2=0x7fc9d40a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d3fff640 1 --2- 10.20.193.51:0/1929689317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d40a0750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098a0 tx=0x7fc9c002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a69025bbe925dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 1 -- 10.20.193.51:0/1929689317 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c003c070 con 0x7fc9d40a0370 2026-02-17T11:45:42.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: dump: 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.714 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 5 monclient: authenticate success, global_id 4332 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 1 -- 10.20.193.51:0/1929689317 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c002fce0 con 0x7fc9d40a0370 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 4 set_mon_vals no callback set 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 1 -- 10.20.193.51:0/1929689317 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0037660 con 0x7fc9d40a0370 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9d2ffd640 10 monclient: dump: 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.716 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe9ace24640 1 -- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 msgr2=0x7fe9a813b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe9ace24640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0099d0 tx=0x7fe99c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 10 monclient: shutdown 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 -- 10.20.193.51:0/1929689317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 msgr2=0x7fc9d40a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 --2- 10.20.193.51:0/1929689317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d40a0750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098a0 tx=0x7fc9c002ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c047020 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 -- 10.20.193.51:0/1929689317 shutdown_connections 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 --2- 10.20.193.51:0/1929689317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d40a0750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 -- 10.20.193.51:0/1929689317 >> 10.20.193.51:0/1929689317 conn(0x7fc9d40a7670 msgr2=0x7fc9d40a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: dump: 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c042670 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe9af8b0640 5 monclient: authenticate success, global_id 4361 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c03c040 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 -- 10.20.193.51:0/1929689317 shutdown_connections 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe9977fe640 4 set_mon_vals no callback set 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fe995ffb640 10 monclient: dump: 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.721 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _renew_subs 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.689+0000 7fc9da722640 1 -- 10.20.193.51:0/1929689317 wait complete. 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a808ee80 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _renew_subs 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a8090cd0 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fc9da722640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fc9da722640 10 monclient: monmap: 2026-02-17T11:45:42.723 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a813ec00 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe99c042a60 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fc9da722640 1 Processor -- start 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe995ffb640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 0x7fe9780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fc9da722640 1 -- start start 2026-02-17T11:45:42.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fc9da722640 10 monclient: init 2026-02-17T11:45:42.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.690+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7fe99c077ec0 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fe9ad625640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 0x7fe9780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fe9ad625640 10 monclient: get_auth_request con 0x7fe97803dd10 auth_method 0 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-a con 0x7fc9d40a0370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 0x7fc9d41cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-c con 0x7fc9d40a0c90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 0x7fc9d4125180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): picked mon.noname-b con 0x7fc9d4138a40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40a8400 con 0x7fc9d40a0370 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40a10a0 con 0x7fc9d4138a40 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d40a8580 con 0x7fc9d40a0c90 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9da722640 10 monclient(hunting): authenticate will time out at 630.310110s 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 0x7fc9d41cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52916/0 (socket says 10.20.193.51:52916) 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 1 -- 10.20.193.51:0/3381141453 learned_addr learned my addr 10.20.193.51:0/3381141453 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): get_auth_request con 0x7fc9d40a0370 auth_method 0 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): get_auth_request con 0x7fc9d40a0c90 auth_method 0 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d8c98640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 msgr2=0x7fc9d4125180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d8c98640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 msgr2=0x7fc9d4125180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d8c98640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 0x7fc9d4125180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient(hunting): handle_auth_done global_id 4364 payload 824 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d8c98640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 0x7fc9d4125180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 msgr2=0x7fc9d4125180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 0x7fc9d4125180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 msgr2=0x7fc9d41cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d37fe640 1 -- 10.20.193.51:0/3381141453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d4128e30 con 0x7fc9d40a0c90 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.691+0000 7fc9d3fff640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:42.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe99c051030 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fe995ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fe995ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d37fe640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 msgr2=0x7fc9d41cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d37fe640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 0x7fc9d41cfb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c4b0 tx=0x7fc9c400c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4016020 con 0x7fc9d40a0c90 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: dump: 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c4012a60 con 0x7fc9d40a0c90 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 5 monclient: authenticate success, global_id 4364 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 10 monclient: _renew_subs 2026-02-17T11:45:42.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d4127980 con 0x7fc9d40a0c90 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4012e50 con 0x7fc9d40a0c90 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d27fc640 4 set_mon_vals no callback set 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9d0ff9640 10 monclient: dump: 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fe9ad625640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 0x7fe9780401d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe998007340 tx=0x7fe998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 10 monclient: _renew_subs 2026-02-17T11:45:42.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.693+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d4074630 con 0x7fc9d40a0c90 2026-02-17T11:45:42.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc9c401b400 con 0x7fc9d40a0c90 2026-02-17T11:45:42.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9da722640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9da722640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9da722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d406d2b0 con 0x7fc9d40a0c90 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9d0ff9640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 0x7fc9a4040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7fc9c40526f0 con 0x7fc9d40a0c90 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9d3fff640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 0x7fc9a4040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.694+0000 7fc9d3fff640 10 monclient: get_auth_request con 0x7fc9a403deb0 auth_method 0 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.697+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc9c4020020 con 0x7fc9d40a0c90 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.697+0000 7fc9d0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.697+0000 7fc9d0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.697+0000 7fc9d3fff640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 0x7fc9a4040370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9c002edc0 tx=0x7fc9c0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.779+0000 7fc9da722640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T11:45:42.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.779+0000 7fc9da722640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T11:45:42.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.779+0000 7fc9da722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.779+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7fc9d40a3400 con 0x7fc9d40a0c90 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe9af8b0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe9af8b0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe9af8b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9a809dac0 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe995ffb640 1 -- 10.20.193.51:0/815598978 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe99c053300 con 0x7fe9a80a3bb0 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe995ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:42.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.811+0000 7fe995ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:42.814 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 msgr2=0x7fe9780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 0x7fe9780401d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe998007340 tx=0x7fe998009040 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 10 monclient: shutdown 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 msgr2=0x7fe9a813b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0099d0 tx=0x7fe99c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 shutdown_connections 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe97803dd10 0x7fe9780401d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9a813b760 0x7fe9a808d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9a80a3bb0 0x7fe9a813b0f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 --2- 10.20.193.51:0/815598978 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9a80a0750 0x7fe9a813abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 >> 10.20.193.51:0/815598978 conn(0x7fe9a80a30c0 msgr2=0x7fe9a809a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 shutdown_connections 2026-02-17T11:45:42.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.812+0000 7fe9af8b0640 1 -- 10.20.193.51:0/815598978 wait complete. 2026-02-17T11:45:42.823 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:45:42.823 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:45:42.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:45:42.824 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:45:42.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 10 monclient: get_monmap_and_config 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 10 monclient: monmap: 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:42.930472+0000 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:42.930472+0000 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.932 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 1 Processor -- start 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 1 -- start start 2026-02-17T11:45:42.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.929+0000 7f5f9ee5f640 10 monclient: init 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f9806d5d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5f9809fdd0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f5f98073d60 0x7f5f98140090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-c con 0x7f5f98073d60 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:42.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f980a0210 con 0x7f5f9809fdd0 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5f980a24a0 con 0x7f5f98073d60 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f98138260 con 0x7f5f9806d5d0 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9ee5f640 10 monclient(hunting): authenticate will time out at 630.549463s 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59388/0 (socket says 10.20.193.51:59388) 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 -- 10.20.193.51:0/696261684 learned_addr learned my addr 10.20.193.51:0/696261684 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): get_auth_request con 0x7f5f9806d5d0 auth_method 0 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9e65e640 1 --2- 10.20.193.51:0/696261684 >> v2:10.20.193.142:3300/0 conn(0x7f5f98073d60 0x7f5f98140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_done global_id 4367 payload 274 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 -- 10.20.193.51:0/696261684 >> v2:10.20.193.142:3300/0 conn(0x7f5f98073d60 msgr2=0x7f5f98140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/696261684 >> v2:10.20.193.142:3300/0 conn(0x7f5f98073d60 0x7f5f98140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 -- 10.20.193.51:0/696261684 >> v1:10.20.193.142:6789/0 conn(0x7f5f9809fdd0 legacy=0x7f5f98073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 monclient: found mon.noname-b 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.930+0000 7f5f9de5d640 1 -- 10.20.193.51:0/696261684 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f980a1e50 con 0x7f5f9806d5d0 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9de5d640 1 -- 10.20.193.51:0/696261684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 msgr2=0x7f5f9809f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/696261684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009970 tx=0x7f5f8802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0de35f6f5dc1313 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 1 -- 10.20.193.51:0/696261684 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8803c070 con 0x7f5f9806d5d0 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: dump: 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.946 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 1 -- 10.20.193.51:0/696261684 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8802fdb0 con 0x7f5f9806d5d0 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 5 monclient: authenticate success, global_id 4367 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 1 -- 10.20.193.51:0/696261684 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88037660 con 0x7f5f9806d5d0 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 4 set_mon_vals no callback set 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ce5b640 10 monclient: dump: 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.948 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 10 monclient: shutdown 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/696261684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 msgr2=0x7f5f9809f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/696261684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009970 tx=0x7f5f8802ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:42.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/696261684 shutdown_connections 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/696261684 >> v2:10.20.193.142:3300/0 conn(0x7f5f98073d60 0x7f5f98140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/696261684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f9806d5d0 0x7f5f9809f890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/696261684 >> 10.20.193.51:0/696261684 conn(0x7f5f9806cab0 msgr2=0x7f5f9806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/696261684 shutdown_connections 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/696261684 wait complete. 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 10 monclient: build_initial_monmap 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.933+0000 7f5f9ee5f640 10 monclient: monmap: 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:42.950 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 Processor -- start 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 -- start start 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient: init 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f9806d5d0 0x7f5f981cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f9806d5d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 0x7f5f981368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-c con 0x7f5f98073d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809fdd0 0x7f5f98136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): picked mon.noname-a con 0x7f5f9809fdd0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980a0530 con 0x7f5f9809fdd0 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980a0db0 con 0x7f5f9806d5d0 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9806d9b0 con 0x7f5f98073d60 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:42.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9ee5f640 10 monclient(hunting): authenticate will time out at 630.553489s 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 0x7f5f981368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 0x7f5f981368a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59392/0 (socket says 10.20.193.51:59392) 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 -- 10.20.193.51:0/2680075112 learned_addr learned my addr 10.20.193.51:0/2680075112 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): get_auth_request con 0x7f5f98073d60 auth_method 0 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809fdd0 0x7f5f98136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): get_auth_request con 0x7f5f9809fdd0 auth_method 0 2026-02-17T11:45:42.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9e65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient(hunting): handle_auth_done global_id 4370 payload 824 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f9806d5d0 msgr2=0x7f5f981cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f9806d5d0 0x7f5f981cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809fdd0 msgr2=0x7f5f98136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809fdd0 0x7f5f98136de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient: _finish_hunting 0 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 monclient: found mon.noname-c 2026-02-17T11:45:42.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.934+0000 7f5f9d65c640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f98121f70 con 0x7f5f98073d60 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9d65c640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 msgr2=0x7f5f981368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9d65c640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 0x7f5f981368a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c600 tx=0x7f5f8c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c012a40 con 0x7f5f98073d60 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: dump: 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.955 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c017070 con 0x7f5f98073d60 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9ee5f640 5 monclient: authenticate success, global_id 4370 2026-02-17T11:45:42.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9ee5f640 10 monclient: _renew_subs 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9ee5f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f98124260 con 0x7f5f98073d60 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c012e20 con 0x7f5f98073d60 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f867fc640 10 monclient: dump: 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.957 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.936+0000 7f5f87fff640 4 set_mon_vals no callback set 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 10 monclient: _renew_subs 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f981239c0 con 0x7f5f98073d60 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 0x7f5f981202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98069d90 con 0x7f5f9809d560 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 0x7f5f981202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient: get_auth_request con 0x7f5f9809d560 auth_method 0 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5f8c01c460 con 0x7f5f98073d60 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_done global_id 4341 payload 824 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f9de5d640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f981cf5a0 con 0x7f5f9809d560 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f867fc640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5f6803dd60 0x7f5f68040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.937+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f5f8c0522b0 con 0x7f5f98073d60 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.938+0000 7f5f9e65e640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5f6803dd60 0x7f5f68040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.938+0000 7f5f9e65e640 10 monclient: get_auth_request con 0x7f5f6803dd60 auth_method 0 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f9de5d640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 msgr2=0x7f5f981202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 0x7f5f981202d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f98074750 tx=0x7f5f880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88046020 con 0x7f5f9809d560 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.939+0000 7f5f867fc640 10 monclient: dump: 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.960 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f5f88037c20 con 0x7f5f9809d560 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 msgr2=0x7f5f981202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 0x7f5f981202d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f98074750 tx=0x7f5f880047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 msgr2=0x7f5f981202d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:42.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f867fc640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f9809d560 0x7f5f981202d0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f98074750 tx=0x7f5f880047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.940+0000 7f5f9e65e640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5f6803dd60 0x7f5f68040220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f980a1720 tx=0x7f5f940076f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9ee5f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 0x7f5f981da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9ee5f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980741b0 con 0x7f5f98120810 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 0x7f5f981da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient: get_auth_request con 0x7f5f98120810 auth_method 0 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:42.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.943+0000 7f5f9de5d640 1 -- 10.20.193.51:0/2680075112 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f98077060 con 0x7f5f98120810 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f9de5d640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 msgr2=0x7f5f981da3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f9de5d640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 0x7f5f981da3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009970 tx=0x7f5f88008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88046040 con 0x7f5f98120810 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 10 monclient: dump: 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:42.965 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f5f88003e30 con 0x7f5f98120810 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 msgr2=0x7f5f981da3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 0x7f5f981da3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009970 tx=0x7f5f88008030 comp rx=0 tx=0).stop 2026-02-17T11:45:42.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 msgr2=0x7f5f981da3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.945+0000 7f5f867fc640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f98120810 0x7f5f981da3d0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009970 tx=0x7f5f88008030 comp rx=0 tx=0).stop 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 4, 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26266, 2026-02-17T11:45:42.967 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 26, 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:42.968 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:42.969 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:45:42.970 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:42.971 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:42.972 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.973 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:42.974 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:42.975 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:42.976 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:42.977 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:42.978 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:45:42.979 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:45:42.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5f6803dd60 msgr2=0x7f5f68040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5f6803dd60 0x7f5f68040220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f980a1720 tx=0x7f5f940076f0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 10 monclient: shutdown 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 msgr2=0x7f5f981368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 --2- 10.20.193.51:0/2680075112 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f98073d60 0x7f5f981368a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c600 tx=0x7f5f8c00cad0 comp rx=0 tx=0).stop 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9e65e640 1 -- 10.20.193.51:0/2680075112 reap_dead start 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9e65e640 1 -- 10.20.193.51:0/2680075112 reap_dead start 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 shutdown_connections 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 >> 10.20.193.51:0/2680075112 conn(0x7f5f9806cab0 msgr2=0x7f5f980a5100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 shutdown_connections 2026-02-17T11:45:42.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:42.946+0000 7f5f9ee5f640 1 -- 10.20.193.51:0/2680075112 wait complete. 2026-02-17T11:45:42.981 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:45:42.981 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:45:42.982 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.046+0000 7fa62f9d3640 10 monclient: get_monmap_and_config 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.046+0000 7fa62f9d3640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.046+0000 7fa62f9d3640 10 monclient: monmap: 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:43.047745+0000 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:43.047745+0000 2026-02-17T11:45:43.060 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 Processor -- start 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 -- start start 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient: init 2026-02-17T11:45:43.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa6280a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa62813b760 0x7fa62813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-a con 0x7fa62813b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62806e140 con 0x7fa6280a0750 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa62809f910 con 0x7fa62813b760 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa62809ccd0 con 0x7fa6280a3bb0 2026-02-17T11:45:43.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62f9d3640 10 monclient(hunting): authenticate will time out at 630.666479s 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59402/0 (socket says 10.20.193.51:59402) 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 -- 10.20.193.51:0/1814592962 learned_addr learned my addr 10.20.193.51:0/1814592962 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62cf47640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa6280a0750 0x7fa62809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44404/0 (socket says 10.20.193.51:44404) 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): get_auth_request con 0x7fa6280a3bb0 auth_method 0 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 1 --2- 10.20.193.51:0/1814592962 >> v2:10.20.193.51:3300/0 conn(0x7fa62813b760 0x7fa62813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): get_auth_request con 0x7fa62813b760 auth_method 0 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient(hunting): handle_auth_done global_id 4373 payload 274 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 -- 10.20.193.51:0/1814592962 >> v2:10.20.193.51:3300/0 conn(0x7fa62813b760 msgr2=0x7fa62813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 --2- 10.20.193.51:0/1814592962 >> v2:10.20.193.51:3300/0 conn(0x7fa62813b760 0x7fa62813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 -- 10.20.193.51:0/1814592962 >> v1:10.20.193.51:6789/0 conn(0x7fa6280a0750 legacy=0x7fa62809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 monclient: found mon.noname-b 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.047+0000 7fa62d748640 1 -- 10.20.193.51:0/1814592962 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62809eec0 con 0x7fa6280a3bb0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62d748640 1 -- 10.20.193.51:0/1814592962 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 msgr2=0x7fa62809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62d748640 1 --2- 10.20.193.51:0/1814592962 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa62809f230 tx=0x7fa61802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e6d15747dd0d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 1 -- 10.20.193.51:0/1814592962 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61803c070 con 0x7fa6280a3bb0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: dump: 2026-02-17T11:45:43.065 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 1 -- 10.20.193.51:0/1814592962 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61802fcc0 con 0x7fa6280a3bb0 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 5 monclient: authenticate success, global_id 4373 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 1 -- 10.20.193.51:0/1814592962 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618037660 con 0x7fa6280a3bb0 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 4 set_mon_vals no callback set 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa617fff640 10 monclient: dump: 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.067 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 10 monclient: shutdown 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 -- 10.20.193.51:0/1814592962 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 msgr2=0x7fa62809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/1814592962 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa62809f230 tx=0x7fa61802ee80 comp rx=0 tx=0).stop 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 -- 10.20.193.51:0/1814592962 shutdown_connections 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/1814592962 >> v2:10.20.193.51:3300/0 conn(0x7fa62813b760 0x7fa62813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/1814592962 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280a3bb0 0x7fa62809dac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 -- 10.20.193.51:0/1814592962 >> 10.20.193.51:0/1814592962 conn(0x7fa6280a30c0 msgr2=0x7fa6280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 -- 10.20.193.51:0/1814592962 shutdown_connections 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.050+0000 7fa62f9d3640 1 -- 10.20.193.51:0/1814592962 wait complete. 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient: monmap: 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 Processor -- start 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 -- start start 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient: init 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 0x7fa628094dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-a con 0x7fa6280a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6280a3bb0 0x7fa628095300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6280a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): picked mon.noname-c con 0x7fa62813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa6280a04b0 con 0x7fa6280a0750 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa62809c850 con 0x7fa6280a3bb0 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa62809e710 con 0x7fa62813b760 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62f9d3640 10 monclient(hunting): authenticate will time out at 630.670804s 2026-02-17T11:45:43.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 0x7fa628094dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 0x7fa628094dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52968/0 (socket says 10.20.193.51:52968) 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 1 -- 10.20.193.51:0/796222205 learned_addr learned my addr 10.20.193.51:0/796222205 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59418/0 (socket says 10.20.193.51:59418) 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): get_auth_request con 0x7fa6280a0750 auth_method 0 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): get_auth_request con 0x7fa62813b760 auth_method 0 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 10 monclient(hunting): handle_auth_done global_id 4376 payload 824 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6280a3bb0 msgr2=0x7fa628095300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6280a3bb0 0x7fa628095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 msgr2=0x7fa628094dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.051+0000 7fa62df49640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 0x7fa628094dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62df49640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62df49640 1 monclient: found mon.noname-c 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62df49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62df49640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa628098fa0 con 0x7fa62813b760 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.052+0000 7fa62d748640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6280a0750 0x7fa628094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 msgr2=0x7fa628095840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62df49640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa62400efc0 tx=0x7fa62400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624018020 con 0x7fa62813b760 2026-02-17T11:45:43.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: dump: 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6240146a0 con 0x7fa62813b760 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624009b10 con 0x7fa62813b760 2026-02-17T11:45:43.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 10 monclient: dump: 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa6177fe640 4 set_mon_vals no callback set 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 5 monclient: authenticate success, global_id 4376 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 monclient: _renew_subs 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62809bcd0 con 0x7fa62813b760 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 monclient: _renew_subs 2026-02-17T11:45:43.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6280985c0 con 0x7fa62813b760 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 0x7fa6280638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa62809dac0 con 0x7fa6280913b0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 0x7fa6280638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient: get_auth_request con 0x7fa6280913b0 auth_method 0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62df49640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa62400efc0 tx=0x7fa62400c490 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fa624014a90 mgrmap(e 5) 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa624014a90 con 0x7fa62813b760 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 10 monclient(hunting): handle_auth_done global_id 4379 payload 824 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.054+0000 7fa62d748640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa628097f80 con 0x7fa6280913b0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.055+0000 7fa615ffb640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5f803dd10 0x7fa5f80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.055+0000 7fa62cf47640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5f803dd10 0x7fa5f80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.055+0000 7fa62cf47640 10 monclient: get_auth_request con 0x7fa5f803dd10 auth_method 0 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa62d748640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 msgr2=0x7fa6280638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa62d748640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 0x7fa6280638c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6180090b0 tx=0x7fa6180047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618045070 con 0x7fa6280913b0 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 10 monclient: dump: 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fa618041680 con 0x7fa6280913b0 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:43.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 msgr2=0x7fa6280638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 0x7fa6280638c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6180090b0 tx=0x7fa6180047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 msgr2=0x7fa6280638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:43.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa615ffb640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6280913b0 0x7fa6280638c0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6180090b0 tx=0x7fa6180047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.057+0000 7fa62cf47640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5f803dd10 0x7fa5f80401d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa628074fa0 tx=0x7fa61c007ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62f9d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 0x7fa6281d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa6280a20b0 con 0x7fa628091790 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 0x7fa6281d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient: get_auth_request con 0x7fa628091790 auth_method 0 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.060+0000 7fa62d748640 1 -- 10.20.193.51:0/796222205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa6280987c0 con 0x7fa628091790 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62d748640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 msgr2=0x7fa6281d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62d748640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 0x7fa6281d98b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6280683e0 tx=0x7fa618009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618045050 con 0x7fa628091790 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 10 monclient: dump: 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fa618003920 con 0x7fa628091790 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 msgr2=0x7fa6281d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 0x7fa6281d98b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6280683e0 tx=0x7fa618009340 comp rx=0 tx=0).stop 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 msgr2=0x7fa6281d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa628091790 0x7fa6281d98b0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6280683e0 tx=0x7fa618009340 comp rx=0 tx=0).stop 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:43.081 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 4, 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26382, 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 26, 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.082 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:45:43.083 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.084 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:45:43.085 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.086 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:45:43.087 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:45:43.088 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.089 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.089 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:45:43.089 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:45:43.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5f803dd10 msgr2=0x7fa5f80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5f803dd10 0x7fa5f80401d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa628074fa0 tx=0x7fa61c007ae0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 10 monclient: shutdown 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 msgr2=0x7fa628095840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 --2- 10.20.193.51:0/796222205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa62813b760 0x7fa628095840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa62400efc0 tx=0x7fa62400c490 comp rx=0 tx=0).stop 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 reap_dead start 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62df49640 1 -- 10.20.193.51:0/796222205 reap_dead start 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa615ffb640 1 -- 10.20.193.51:0/796222205 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (unknown 0 0 0) 0x7fa624053430 con 0x7fa62813b760 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 shutdown_connections 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 >> 10.20.193.51:0/796222205 conn(0x7fa6280a30c0 msgr2=0x7fa628139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 shutdown_connections 2026-02-17T11:45:43.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.063+0000 7fa62f9d3640 1 -- 10.20.193.51:0/796222205 wait complete. 2026-02-17T11:45:43.090 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:45:43.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:45:43.090 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:45:43.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: get_monmap_and_config 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: monmap: 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:43.156183+0000 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:43.156183+0000 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:43.159 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 Processor -- start 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 -- start start 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: init 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9cd80a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9cd813b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd806e140 con 0x7f9cd813b760 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd809f910 con 0x7f9cd80a3bb0 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd809ccd0 con 0x7f9cd80a0750 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.155+0000 7f9cde596640 10 monclient(hunting): authenticate will time out at 630.774927s 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cdcb0c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9cd813b760 0x7f9cd813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44416/0 (socket says 10.20.193.51:44416) 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59436/0 (socket says 10.20.193.51:59436) 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/1605144176 learned_addr learned my addr 10.20.193.51:0/1605144176 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request con 0x7f9cd80a0750 auth_method 0 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_done global_id 4385 payload 274 2026-02-17T11:45:43.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 -- 10.20.193.51:0/1605144176 >> v1:10.20.193.142:6789/0 conn(0x7f9cd80a3bb0 legacy=0x7f9cd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 -- 10.20.193.51:0/1605144176 >> v1:10.20.193.51:6789/0 conn(0x7f9cd813b760 legacy=0x7f9cd813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 monclient: found mon.noname-b 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.156+0000 7f9cd77fe640 1 -- 10.20.193.51:0/1605144176 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd809eec0 con 0x7f9cd80a0750 2026-02-17T11:45:43.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd77fe640 1 -- 10.20.193.51:0/1605144176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 msgr2=0x7f9cd809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd77fe640 1 --2- 10.20.193.51:0/1605144176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806c1c0 tx=0x7f9cc802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cdb6bd3ff9d034f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 1 -- 10.20.193.51:0/1605144176 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc803c070 con 0x7f9cd80a0750 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: dump: 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.167 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 1 -- 10.20.193.51:0/1605144176 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc802fce0 con 0x7f9cd80a0750 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cde596640 5 monclient: authenticate success, global_id 4385 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cde596640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 1 -- 10.20.193.51:0/1605144176 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8037660 con 0x7f9cd80a0750 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cde596640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cde596640 4 set_mon_vals no callback set 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.158+0000 7f9cd6ffd640 10 monclient: dump: 2026-02-17T11:45:43.168 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: shutdown 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- 10.20.193.51:0/1605144176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 msgr2=0x7f9cd809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 --2- 10.20.193.51:0/1605144176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806c1c0 tx=0x7f9cc802ed80 comp rx=0 tx=0).stop 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- 10.20.193.51:0/1605144176 shutdown_connections 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 --2- 10.20.193.51:0/1605144176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd80a0750 0x7f9cd809e1d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- 10.20.193.51:0/1605144176 >> 10.20.193.51:0/1605144176 conn(0x7f9cd80a30c0 msgr2=0x7f9cd80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- 10.20.193.51:0/1605144176 shutdown_connections 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- 10.20.193.51:0/1605144176 wait complete. 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: monmap: 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 Processor -- start 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- start start 2026-02-17T11:45:43.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: init 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9cd80a0750 0x7f9cd8131130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd80a3bb0 0x7f9cd8131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 0x7f9cd8131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80a04b0 con 0x7f9cd80a0750 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd809c850 con 0x7f9cd80a3bb0 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd809e710 con 0x7f9cd813b760 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.159+0000 7f9cde596640 10 monclient(hunting): authenticate will time out at 630.778998s 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 0x7f9cd8131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9cd80a0750 0x7f9cd8131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 0x7f9cd8131bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59444/0 (socket says 10.20.193.51:59444) 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9cd80a0750 0x7f9cd8131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52982/0 (socket says 10.20.193.51:52982) 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 learned_addr learned my addr 10.20.193.51:0/2118973379 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): get_auth_request con 0x7f9cd813b760 auth_method 0 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request con 0x7f9cd80a0750 auth_method 0 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cd77fe640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd80a3bb0 0x7f9cd8131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient(hunting): handle_auth_done global_id 4388 payload 824 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd80a3bb0 msgr2=0x7f9cd8131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd80a3bb0 0x7f9cd8131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9cd80a0750 msgr2=0x7f9cd8131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9cd80a0750 0x7f9cd8131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 monclient: found mon.noname-c 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.160+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd8133190 con 0x7f9cd813b760 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 msgr2=0x7f9cd8131bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cdcb0c640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 0x7f9cd8131bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00ca40 tx=0x7f9ccc00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00add0 con 0x7f9cd813b760 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc012400 con 0x7f9cd813b760 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0127f0 con 0x7f9cd813b760 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.175 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cd67fc640 4 set_mon_vals no callback set 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 5 monclient: authenticate success, global_id 4388 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 monclient: _renew_subs 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd809d7b0 con 0x7f9cd813b760 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 monclient: _renew_subs 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd8134a50 con 0x7f9cd813b760 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 0x7f9cd812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.162+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd809dac0 con 0x7f9cd812d690 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9ccc012a10 con 0x7f9cd813b760 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 0x7f9cd812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient: get_auth_request con 0x7f9cd812d690 auth_method 0 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd4ff9640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 0x7f9ca8040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f9ccc052960 con 0x7f9cd813b760 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_done global_id 4276 payload 824 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd7fff640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd8133770 con 0x7f9cd812d690 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 0x7f9ca8040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 10 monclient: get_auth_request con 0x7f9ca803dd40 auth_method 0 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 msgr2=0x7f9ca8040200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 msgr2=0x7f9ca8040200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 0x7f9ca8040200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:43.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.163+0000 7f9cd77fe640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 0x7f9ca8040200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:43.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd7fff640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 msgr2=0x7f9cd812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd7fff640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 0x7f9cd812da70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400f7a0 tx=0x7f9cc400fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4018030 con 0x7f9cd812d690 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.165+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9cc400dbc0 con 0x7f9cd812d690 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:43.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 msgr2=0x7f9cd812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 0x7f9cd812da70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400f7a0 tx=0x7f9cc400fc70 comp rx=0 tx=0).stop 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 msgr2=0x7f9cd812da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.166+0000 7f9cd4ff9640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812d690 0x7f9cd812da70 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400f7a0 tx=0x7f9cc400fc70 comp rx=0 tx=0).stop 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cde596640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cde596640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 0x7f9cd81d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cde596640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80008d0 con 0x7f9cd812dfb0 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 0x7f9cd81d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient: get_auth_request con 0x7f9cd812dfb0 auth_method 0 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.169+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_done global_id 4279 payload 824 2026-02-17T11:45:43.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.170+0000 7f9cd7fff640 1 -- 10.20.193.51:0/2118973379 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cd8050ac0 con 0x7f9cd812dfb0 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd7fff640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 msgr2=0x7f9cd81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd7fff640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 0x7f9cd81d98b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018000 tx=0x7f9cc4003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4004000 con 0x7f9cd812dfb0 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f9cc4004000 con 0x7f9cd812dfb0 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 msgr2=0x7f9cd81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 0x7f9cd81d98b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018000 tx=0x7f9cc4003860 comp rx=0 tx=0).stop 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 msgr2=0x7f9cd81d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.172+0000 7f9cd4ff9640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9cd812dfb0 0x7f9cd81d98b0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018000 tx=0x7f9cc4003860 comp rx=0 tx=0).stop 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:45:43.183 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 4, 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26449, 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 26, 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.184 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.185 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:45:43.186 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.187 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.189 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:43.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.191 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:45:43.192 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:45:43.193 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 msgr2=0x7f9ca8040200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ca803dd40 0x7f9ca8040200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 10 monclient: shutdown 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 msgr2=0x7f9cd8131bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 --2- 10.20.193.51:0/2118973379 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9cd813b760 0x7f9cd8131bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00ca40 tx=0x7f9ccc00cf10 comp rx=0 tx=0).stop 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 reap_dead start 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cdcb0c640 1 -- 10.20.193.51:0/2118973379 reap_dead start 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 shutdown_connections 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 >> 10.20.193.51:0/2118973379 conn(0x7f9cd80a30c0 msgr2=0x7f9cd813a520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 shutdown_connections 2026-02-17T11:45:43.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.173+0000 7f9cde596640 1 -- 10.20.193.51:0/2118973379 wait complete. 2026-02-17T11:45:43.195 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:45:43.195 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T11:45:43.195 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:45:43.195 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T11:45:43.195 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:45:43.195 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:45:43.195 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:45:43.205 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:45:43.205 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:45:43.205 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: get_monmap_and_config 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: monmap: 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:43.308999+0000 2026-02-17T11:45:43.310 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:43.308999+0000 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:43.311 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 Processor -- start 2026-02-17T11:45:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 -- start start 2026-02-17T11:45:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: init 2026-02-17T11:45:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 0x7f444c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): picked mon.noname-a con 0x7f444c138600 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f444c0a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): picked mon.noname-b con 0x7f444c0a5a70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c0a1df0 con 0x7f444c0a35a0 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f444c0a6830 con 0x7f444c138600 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f444c0a2c00 con 0x7f444c0a5a70 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4453133640 10 monclient(hunting): authenticate will time out at 630.927838s 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4450ea8640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 msgr2=0x7f444c1389e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f4450ea8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 0x7f444c1389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59476/0 (socket says 10.20.193.51:59476) 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 1 -- 10.20.193.51:0/1938459011 learned_addr learned my addr 10.20.193.51:0/1938459011 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 10 monclient(hunting): get_auth_request con 0x7f444c0a5a70 auth_method 0 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.308+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 10 monclient(hunting): handle_auth_done global_id 4391 payload 274 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 1 -- 10.20.193.51:0/1938459011 >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 msgr2=0x7f444c1389e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 1 --2- 10.20.193.51:0/1938459011 >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 0x7f444c1389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 1 -- 10.20.193.51:0/1938459011 >> v1:10.20.193.142:6789/0 conn(0x7f444c0a35a0 legacy=0x7f444c0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 1 monclient: found mon.noname-b 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.309+0000 7f44516a9640 1 -- 10.20.193.51:0/1938459011 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c138f20 con 0x7f444c0a5a70 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44516a9640 1 -- 10.20.193.51:0/1938459011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 msgr2=0x7f444c140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44516a9640 1 --2- 10.20.193.51:0/1938459011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab16b932157072d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 1 -- 10.20.193.51:0/1938459011 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480373f0 con 0x7f444c0a5a70 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: dump: 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 1 -- 10.20.193.51:0/1938459011 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4448037590 con 0x7f444c0a5a70 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f4453133640 5 monclient: authenticate success, global_id 4391 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f4453133640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 1 -- 10.20.193.51:0/1938459011 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448037960 con 0x7f444c0a5a70 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f4453133640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f4453133640 4 set_mon_vals no callback set 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.311+0000 7f44437fe640 10 monclient: dump: 2026-02-17T11:45:43.325 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 10 monclient: shutdown 2026-02-17T11:45:43.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- 10.20.193.51:0/1938459011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 msgr2=0x7f444c140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 --2- 10.20.193.51:0/1938459011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444802f230 comp rx=0 tx=0).stop 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- 10.20.193.51:0/1938459011 shutdown_connections 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 --2- 10.20.193.51:0/1938459011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c0a5a70 0x7f444c140380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 --2- 10.20.193.51:0/1938459011 >> v2:10.20.193.51:3300/0 conn(0x7f444c138600 0x7f444c1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- 10.20.193.51:0/1938459011 >> 10.20.193.51:0/1938459011 conn(0x7f444c0a7460 msgr2=0x7f444c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- 10.20.193.51:0/1938459011 shutdown_connections 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- 10.20.193.51:0/1938459011 wait complete. 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 10 monclient: build_initial_monmap 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 10 monclient: monmap: 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:43.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 Processor -- start 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 1 -- start start 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.312+0000 7f4453133640 10 monclient: init 2026-02-17T11:45:43.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 0x7f444c1cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): picked mon.noname-a con 0x7f444c0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0a5a70 0x7f444c1364c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): picked mon.noname-b con 0x7f444c0a5a70 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): picked mon.noname-c con 0x7f444c138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f444c0a25b0 con 0x7f444c0a35a0 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f444c0a22d0 con 0x7f444c0a5a70 2026-02-17T11:45:43.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f444c0a15f0 con 0x7f444c138600 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4453133640 10 monclient(hunting): authenticate will time out at 630.932096s 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4450ea8640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 msgr2=0x7f444c1cf390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4450ea8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 0x7f444c1cf390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59478/0 (socket says 10.20.193.51:59478) 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 -- 10.20.193.51:0/3582978593 learned_addr learned my addr 10.20.193.51:0/3582978593 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): get_auth_request con 0x7f444c138600 auth_method 0 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4443fff640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0a5a70 0x7f444c1364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4443fff640 10 monclient(hunting): get_auth_request con 0x7f444c0a5a70 auth_method 0 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4443fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4443fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f4443fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient(hunting): handle_auth_done global_id 4394 payload 824 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 -- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0a5a70 msgr2=0x7f444c1364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0a5a70 0x7f444c1364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 -- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 msgr2=0x7f444c1cf390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 0x7f444c1cf390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient: _finish_hunting 0 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 monclient: found mon.noname-c 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.313+0000 7f44516a9640 1 -- 10.20.193.51:0/3582978593 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c137c70 con 0x7f444c138600 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44516a9640 1 -- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 msgr2=0x7f444c136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44516a9640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4448039040 tx=0x7f4448004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448046020 con 0x7f444c138600 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: dump: 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: _finish_auth 0 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: _check_auth_tickets 2026-02-17T11:45:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4448037e30 con 0x7f444c138600 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 5 monclient: authenticate success, global_id 4394 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 10 monclient: _renew_subs 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c127be0 con 0x7f444c138600 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480373f0 con 0x7f444c138600 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4442ffd640 4 set_mon_vals no callback set 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f44417fa640 10 monclient: dump: 2026-02-17T11:45:43.334 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 10 monclient: _renew_subs 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.315+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c125bd0 con 0x7f444c138600 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4453133640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4453133640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4453133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4448041450 con 0x7f444c138600 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f444c0a5ec0 con 0x7f444c138600 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f44417fa640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 0x7f441c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f4448078610 con 0x7f444c138600 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4450ea8640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 0x7f441c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.316+0000 7f4450ea8640 10 monclient: get_auth_request con 0x7f441c03dd10 auth_method 0 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.318+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4448050030 con 0x7f444c138600 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.318+0000 7f44417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.318+0000 7f44417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.319+0000 7f4450ea8640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 0x7f441c0401d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f443c003a80 tx=0x7f443c009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:43.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f4453133640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f4453133640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f4453133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f444c127740 con 0x7f444c138600 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f44417fa640 1 -- 10.20.193.51:0/3582978593 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f444c137c70 con 0x7f444c138600 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f44417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.433+0000 7f44417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:43.437 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 msgr2=0x7f441c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 0x7f441c0401d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f443c003a80 tx=0x7f443c009270 comp rx=0 tx=0).stop 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 10 monclient: shutdown 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 msgr2=0x7f444c136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4448039040 tx=0x7f4448004b40 comp rx=0 tx=0).stop 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 shutdown_connections 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f441c03dd10 0x7f441c0401d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c138600 0x7f444c136a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0a5a70 0x7f444c1364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 --2- 10.20.193.51:0/3582978593 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0a35a0 0x7f444c1cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 >> 10.20.193.51:0/3582978593 conn(0x7f444c0a7460 msgr2=0x7f444c074090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 shutdown_connections 2026-02-17T11:45:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:43.434+0000 7f4453133640 1 -- 10.20.193.51:0/3582978593 wait complete. 2026-02-17T11:45:45.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:45.692+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:45.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:45.692+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:45.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:45.692+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:45.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:45.692+0000 7fc9af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:46.445 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.508+0000 7f3f10d33640 10 monclient: get_monmap_and_config 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.508+0000 7f3f10d33640 10 monclient: build_initial_monmap 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.508+0000 7f3f10d33640 10 monclient: monmap: 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:46.514 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:46.510783+0000 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:46.510783+0000 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 Processor -- start 2026-02-17T11:45:46.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 -- start start 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient: init 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3f0c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-c con 0x7f3f0c09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 0x7f3f0c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-a con 0x7f3f0c0a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0c06e140 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c09aed0 con 0x7f3f0c0a0110 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c09caa0 con 0x7f3f0c09dac0 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f10d33640 10 monclient(hunting): authenticate will time out at 634.129559s 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f0ad76640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 msgr2=0x7f3f0c13c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f0ad76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 0x7f3f0c13c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:52872/0 (socket says 10.20.193.51:52872) 2026-02-17T11:45:46.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 1 -- 10.20.193.51:0/2206264873 learned_addr learned my addr 10.20.193.51:0/2206264873 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): get_auth_request con 0x7f3f0c09dac0 auth_method 0 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.509+0000 7f3f09d74640 10 monclient(hunting): handle_auth_done global_id 4285 payload 274 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 1 -- 10.20.193.51:0/2206264873 >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 msgr2=0x7f3f0c13c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 1 --2- 10.20.193.51:0/2206264873 >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 0x7f3f0c13c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 1 -- 10.20.193.51:0/2206264873 >> v1:10.20.193.142:6789/0 conn(0x7f3f0c0a3bb0 legacy=0x7f3f0c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:46.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:46.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 1 monclient: found mon.noname-c 2026-02-17T11:45:46.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:46.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:45:46.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.510+0000 7f3f09d74640 1 -- 10.20.193.51:0/2206264873 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c09ce60 con 0x7f3f0c09dac0 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09d74640 1 -- 10.20.193.51:0/2206264873 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c09dac0 msgr2=0x7f3f0c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09d74640 1 --2- 10.20.193.51:0/2206264873 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c09cc20 tx=0x7f3ef402ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce3dfbb355c6075 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 1 -- 10.20.193.51:0/2206264873 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef403c070 con 0x7f3f0c09dac0 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:46.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: dump: 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: _finish_auth 0 2026-02-17T11:45:46.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 1 -- 10.20.193.51:0/2206264873 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef402fd90 con 0x7f3f0c09dac0 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f10d33640 5 monclient: authenticate success, global_id 4285 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f10d33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 1 -- 10.20.193.51:0/2206264873 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4037660 con 0x7f3f0c09dac0 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f10d33640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f10d33640 4 set_mon_vals no callback set 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.512+0000 7f3f09573640 10 monclient: dump: 2026-02-17T11:45:46.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: shutdown 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- 10.20.193.51:0/2206264873 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c09dac0 msgr2=0x7f3f0c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2206264873 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c09cc20 tx=0x7f3ef402ee30 comp rx=0 tx=0).stop 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- 10.20.193.51:0/2206264873 shutdown_connections 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2206264873 >> v2:10.20.193.51:3300/0 conn(0x7f3f0c0a0110 0x7f3f0c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2206264873 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c09fbd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- 10.20.193.51:0/2206264873 >> 10.20.193.51:0/2206264873 conn(0x7f3f0c0a30c0 msgr2=0x7f3f0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- 10.20.193.51:0/2206264873 shutdown_connections 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- 10.20.193.51:0/2206264873 wait complete. 2026-02-17T11:45:46.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: build_initial_monmap 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: monmap: 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:46.531 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 Processor -- start 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- start start 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: init 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-a con 0x7f3f0c09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c0a0110 0x7f3f0c091c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-b con 0x7f3f0c0a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): picked mon.noname-c con 0x7f3f0c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0a0540 con 0x7f3f0c09dac0 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c09a880 con 0x7f3f0c0a0110 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c13cca0 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f10d33640 10 monclient(hunting): authenticate will time out at 634.133907s 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f0a575640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 msgr2=0x7f3f0c099f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f0a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c099f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.513+0000 7f3f0ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38354/0 (socket says 10.20.193.51:38354) 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 -- 10.20.193.51:0/2027080905 learned_addr learned my addr 10.20.193.51:0/2027080905 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): get_auth_request con 0x7f3f0c0a3bb0 auth_method 0 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f09d74640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c0a0110 0x7f3f0c091c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f09d74640 10 monclient(hunting): get_auth_request con 0x7f3f0c0a0110 auth_method 0 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f09d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f09d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f09d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient(hunting): handle_auth_done global_id 4397 payload 824 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 -- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c0a0110 msgr2=0x7f3f0c091c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c0a0110 0x7f3f0c091c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 -- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 msgr2=0x7f3f0c099f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c099f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:45:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 monclient: found mon.noname-c 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.514+0000 7f3f0ad76640 1 -- 10.20.193.51:0/2027080905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c095bc0 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f0ad76640 1 -- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 msgr2=0x7f3f0c092170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f0ad76640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00be90 tx=0x7f3efc00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc006e60 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: dump: 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:46.536 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc010030 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc016870 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3ef2ffd640 10 monclient: dump: 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:46.538 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f08d72640 4 set_mon_vals no callback set 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 5 monclient: authenticate success, global_id 4397 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 10 monclient: _renew_subs 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c09e950 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 10 monclient: _renew_subs 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.516+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c095600 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3efc008070 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f10d33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f10d33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f10d33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0c13d0d0 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3ef2ffd640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 0x7f3ed8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f3efc0525d0 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f0a575640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 0x7f3ed8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.517+0000 7f3f0a575640 10 monclient: get_auth_request con 0x7f3ed803dcc0 auth_method 0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.519+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3efc01b020 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.519+0000 7f3ef2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.519+0000 7f3ef2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:46.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.520+0000 7f3f0a575640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 0x7f3ed8040180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003870 tx=0x7f3f00007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3f10d33640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3f10d33640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3f10d33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3f0c0941b0 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3ef2ffd640 1 -- 10.20.193.51:0/2027080905 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f3efc00ce20 con 0x7f3f0c0a3bb0 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3ef2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.635+0000 7f3ef2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:46.640 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 msgr2=0x7f3ed8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 0x7f3ed8040180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003870 tx=0x7f3f00007b10 comp rx=0 tx=0).stop 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 10 monclient: shutdown 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 msgr2=0x7f3f0c092170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00be90 tx=0x7f3efc00bf90 comp rx=0 tx=0).stop 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 shutdown_connections 2026-02-17T11:45:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ed803dcc0 0x7f3ed8040180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f0c0a3bb0 0x7f3f0c092170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f0c0a0110 0x7f3f0c091c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 --2- 10.20.193.51:0/2027080905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f0c09dac0 0x7f3f0c099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 >> 10.20.193.51:0/2027080905 conn(0x7f3f0c0a30c0 msgr2=0x7f3f0c0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 shutdown_connections 2026-02-17T11:45:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.636+0000 7f3f10d33640 1 -- 10.20.193.51:0/2027080905 wait complete. 2026-02-17T11:45:46.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:46.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:46.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:46.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:47.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:47.690+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:47.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:47.690+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:47.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:47.690+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:48.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:48.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:48.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:48.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:48.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:48.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:49.648 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:45:49.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:49.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:49.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:49.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 10 monclient: get_monmap_and_config 2026-02-17T11:45:49.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 10 monclient: build_initial_monmap 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 10 monclient: monmap: 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:49.715384+0000 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:49.715384+0000 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:49.719 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 1 Processor -- start 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 1 -- start start 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.714+0000 7f0a34f11640 10 monclient: init 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-b con 0x7f0a300a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:49.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 0x7f0a3009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-a con 0x7f0a300a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0a3009e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3006e140 con 0x7f0a3009e540 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0a300a3f90 con 0x7f0a300a0750 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3009f910 con 0x7f0a300a3bb0 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a34f11640 10 monclient(hunting): authenticate will time out at 637.334132s 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2dd74640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 msgr2=0x7f0a3009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2ed76640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f0a3009e540 legacy=0x7f0a3013c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:49.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2dd74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 0x7f0a3009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38370/0 (socket says 10.20.193.51:38370) 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 -- 10.20.193.51:0/4153935947 learned_addr learned my addr 10.20.193.51:0/4153935947 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): get_auth_request con 0x7f0a300a3bb0 auth_method 0 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient(hunting): handle_auth_done global_id 4400 payload 274 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 -- 10.20.193.51:0/4153935947 >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 msgr2=0x7f0a3009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:49.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 --2- 10.20.193.51:0/4153935947 >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 0x7f0a3009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 -- 10.20.193.51:0/4153935947 >> v1:10.20.193.51:6789/0 conn(0x7f0a3009e540 legacy=0x7f0a3013c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 monclient: found mon.noname-b 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.715+0000 7f0a2e575640 1 -- 10.20.193.51:0/4153935947 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3009ccd0 con 0x7f0a300a3bb0 2026-02-17T11:45:49.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.717+0000 7f0a2e575640 1 -- 10.20.193.51:0/4153935947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 msgr2=0x7f0a3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.717+0000 7f0a2e575640 1 --2- 10.20.193.51:0/4153935947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a30069d60 tx=0x7f0a2402eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb42717c814b46f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 1 -- 10.20.193.51:0/4153935947 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2403c070 con 0x7f0a300a3bb0 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: dump: 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.731 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: _finish_auth 0 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: _check_auth_tickets 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 1 -- 10.20.193.51:0/4153935947 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2402fdd0 con 0x7f0a300a3bb0 2026-02-17T11:45:49.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 5 monclient: authenticate success, global_id 4400 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 1 -- 10.20.193.51:0/4153935947 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24037660 con 0x7f0a300a3bb0 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 4 set_mon_vals no callback set 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a2d573640 10 monclient: dump: 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.733 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 10 monclient: shutdown 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 -- 10.20.193.51:0/4153935947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 msgr2=0x7f0a3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 --2- 10.20.193.51:0/4153935947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a30069d60 tx=0x7f0a2402eeb0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 -- 10.20.193.51:0/4153935947 shutdown_connections 2026-02-17T11:45:49.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 --2- 10.20.193.51:0/4153935947 >> v2:10.20.193.51:3300/0 conn(0x7f0a300a0750 0x7f0a3009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 --2- 10.20.193.51:0/4153935947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a3bb0 0x7f0a3009dac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 -- 10.20.193.51:0/4153935947 >> 10.20.193.51:0/4153935947 conn(0x7f0a300a30c0 msgr2=0x7f0a300a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 -- 10.20.193.51:0/4153935947 shutdown_connections 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 1 -- 10.20.193.51:0/4153935947 wait complete. 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 10 monclient: build_initial_monmap 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.718+0000 7f0a34f11640 10 monclient: monmap: 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:49.735 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 Processor -- start 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 -- start start 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient: init 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0a3009e540 0x7f0a30091b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-b con 0x7f0a3009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:49.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-c con 0x7f0a300a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 0x7f0a300925b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): picked mon.noname-a con 0x7f0a300a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0a300a04b0 con 0x7f0a300a3bb0 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3009c850 con 0x7f0a3009e540 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3013de80 con 0x7f0a300a0750 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a34f11640 10 monclient(hunting): authenticate will time out at 637.338522s 2026-02-17T11:45:49.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2ed76640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 msgr2=0x7f0a300925b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 0x7f0a300925b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38374/0 (socket says 10.20.193.51:38374) 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 -- 10.20.193.51:0/1887175177 learned_addr learned my addr 10.20.193.51:0/1887175177 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): get_auth_request con 0x7f0a300a0750 auth_method 0 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:49.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2e575640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0a3009e540 0x7f0a30091b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2e575640 10 monclient(hunting): get_auth_request con 0x7f0a3009e540 auth_method 0 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient(hunting): handle_auth_done global_id 4403 payload 824 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 -- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0a3009e540 msgr2=0x7f0a30091b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0a3009e540 0x7f0a30091b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 -- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 msgr2=0x7f0a300925b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 0x7f0a300925b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:49.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 monclient: found mon.noname-c 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.719+0000 7f0a2dd74640 1 -- 10.20.193.51:0/1887175177 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3006f960 con 0x7f0a300a0750 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.721+0000 7f0a2dd74640 1 -- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 msgr2=0x7f0a30092070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.721+0000 7f0a2dd74640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800b780 tx=0x7f0a1800bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18005270 con 0x7f0a300a0750 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: dump: 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:49.740 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: _finish_auth 0 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a18010070 con 0x7f0a300a0750 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 5 monclient: authenticate success, global_id 4403 2026-02-17T11:45:49.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _renew_subs 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3006f410 con 0x7f0a300a0750 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18005650 con 0x7f0a300a0750 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a2cd72640 4 set_mon_vals no callback set 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 10 monclient: dump: 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.742 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _renew_subs 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a300956c0 con 0x7f0a300a0750 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:49.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3009dac0 con 0x7f0a300a0750 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0a1800c520 con 0x7f0a300a0750 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 0x7f09fc0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.722+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 4370+0+0 (secure 0 0 0) 0x7f0a18051d20 con 0x7f0a300a0750 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.723+0000 7f0a2e575640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 0x7f09fc0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.723+0000 7f0a2e575640 10 monclient: get_auth_request con 0x7f09fc03dcf0 auth_method 0 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.725+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0a3006f960 con 0x7f0a300a0750 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.725+0000 7f0a16ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.725+0000 7f0a16ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:49.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.725+0000 7f0a2e575640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 0x7f09fc0401b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a24036000 tx=0x7f0a24033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.839+0000 7f0a34f11640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.839+0000 7f0a34f11640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.839+0000 7f0a34f11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.839+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0a30093d20 con 0x7f0a300a0750 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a16ffd640 1 -- 10.20.193.51:0/1887175177 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f0a18005870 con 0x7f0a300a0750 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a16ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:49.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a16ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 msgr2=0x7f09fc0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 0x7f09fc0401b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a24036000 tx=0x7f0a24033000 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 10 monclient: shutdown 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 msgr2=0x7f0a30092070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800b780 tx=0x7f0a1800bc50 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 shutdown_connections 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f09fc03dcf0 0x7f09fc0401b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0a300a3bb0 0x7f0a300925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0a300a0750 0x7f0a30092070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 --2- 10.20.193.51:0/1887175177 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0a3009e540 0x7f0a30091b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.840+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 >> 10.20.193.51:0/1887175177 conn(0x7f0a300a30c0 msgr2=0x7f0a300a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.841+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 shutdown_connections 2026-02-17T11:45:49.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:49.841+0000 7f0a34f11640 1 -- 10.20.193.51:0/1887175177 wait complete. 2026-02-17T11:45:50.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:50.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:50.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:50.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:50.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:50.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:51.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:51.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:51.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:52.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:52.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:52.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:52.850 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:45:52.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.916+0000 7f845b8f2640 10 monclient: get_monmap_and_config 2026-02-17T11:45:52.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.916+0000 7f845b8f2640 10 monclient: build_initial_monmap 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.916+0000 7f845b8f2640 10 monclient: monmap: 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:52.917906+0000 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:52.917906+0000 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:52.922 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 Processor -- start 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 -- start start 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient: init 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f84540a3680 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:52.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-b con 0x7f84540a4170 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-c con 0x7f845413d750 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8454074d00 con 0x7f84540a3680 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f845406f5c0 con 0x7f845413d750 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f845406fa90 con 0x7f84540a4170 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f845b8f2640 10 monclient(hunting): authenticate will time out at 640.536767s 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38376/0 (socket says 10.20.193.51:38376) 2026-02-17T11:45:52.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 learned_addr learned my addr 10.20.193.51:0/2467833699 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 10 monclient(hunting): get_auth_request con 0x7f84540a4170 auth_method 0 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8459e68640 10 monclient(hunting): get_auth_request con 0x7f845413d750 auth_method 0 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8459e68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8459e68640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:52.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8459e68640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.917+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.918+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.918+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.918+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.918+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:52.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:52.920+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.142:6789/0 conn(0x7f84540a3680 legacy=0x7f84540a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:53.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:53.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 10 monclient(hunting): get_auth_request con 0x7f84540a4170 auth_method 0 2026-02-17T11:45:53.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:53.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.118+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 10 monclient(hunting): get_auth_request con 0x7f845413d750 auth_method 0 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:53.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:53.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:53.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.119+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:45:53.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 10 monclient(hunting): get_auth_request con 0x7f84540a4170 auth_method 0 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:53.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.519+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:45:53.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:53.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 10 monclient(hunting): get_auth_request con 0x7f845413d750 auth_method 0 2026-02-17T11:45:53.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:53.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:53.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:53.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:53.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:53.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:53.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.520+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:45:53.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:53.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:53.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:53.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:54.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:54.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 10 monclient(hunting): get_auth_request con 0x7f84540a4170 auth_method 0 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:54.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.320+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:45:54.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 10 monclient(hunting): get_auth_request con 0x7f845413d750 auth_method 0 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:45:54.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.321+0000 7f8459e68640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:45:54.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:54.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:54.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:54.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:55.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:55.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:55.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:55.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.691+0000 7fc9af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): tick 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 monclient(hunting): continuing hunt 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 msgr2=0x7f8454070750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f84540a4170 0x7f8454070750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 msgr2=0x7f845413fb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.142:3300/0 conn(0x7f845413d750 0x7f845413fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.142:6789/0 conn(0x7f84540a3680 legacy=0x7f84540a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient: _add_conns ranks=[0,3] 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8438003820 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f84380074b0 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845406fd70 con 0x7f8438003820 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f845406f5c0 con 0x7f84380074b0 2026-02-17T11:45:55.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8442ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:55.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438003820 legacy=0x7f8438005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:55.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 msgr2=0x7f8438009970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:55.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:55.917+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:56.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.118+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438003820 legacy=0x7f8438005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:56.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.118+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 msgr2=0x7f8438009970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:56.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.118+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:45:56.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.519+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 msgr2=0x7f8438009970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:56.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.519+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:45:56.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.519+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438003820 legacy=0x7f8438005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:56.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:56.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:56.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:56.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.320+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 msgr2=0x7f8438009970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.320+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:45:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.320+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438003820 legacy=0x7f8438005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:57.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9af7fe640 10 monclient: tick 2026-02-17T11:45:58.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9d0ff9640 1 -- 10.20.193.51:0/3381141453 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]=0 pool 'unique_pool_0' created v22) ==== 130+0+0 (secure 0 0 0) 0x7fc9c4051280 con 0x7fc9d40a0c90 2026-02-17T11:45:58.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9d0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T11:45:58.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.691+0000 7fc9d0ff9640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' created 2026-02-17T11:45:58.695 INFO:teuthology.orchestra.run.trial051.stderr:pool 'unique_pool_0' created 2026-02-17T11:45:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 msgr2=0x7fc9a4040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 0x7fc9a4040370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9c002edc0 tx=0x7fc9c0033000 comp rx=0 tx=0).stop 2026-02-17T11:45:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 10 monclient: shutdown 2026-02-17T11:45:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 msgr2=0x7fc9d41cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 0x7fc9d41cfb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c4b0 tx=0x7fc9c400c980 comp rx=0 tx=0).stop 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 shutdown_connections 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9a403deb0 0x7fc9a4040370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9d4138a40 0x7fc9d4125180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9d40a0c90 0x7fc9d41cfb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 --2- 10.20.193.51:0/3381141453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9d40a0370 0x7fc9d41cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.695+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 >> 10.20.193.51:0/3381141453 conn(0x7fc9d40a7670 msgr2=0x7fc9d4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.696+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 shutdown_connections 2026-02-17T11:45:58.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.696+0000 7fc9da722640 1 -- 10.20.193.51:0/3381141453 wait complete. 2026-02-17T11:45:58.706 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T11:45:58.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: get_monmap_and_config 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: build_initial_monmap 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: monmap: 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:58.773166+0000 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:58.773166+0000 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:58.776 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 Processor -- start 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 -- start start 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: init 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f883009fce0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f883009ac60 0x7f883006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-a con 0x7f883009ac60 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f883013b6f0 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883009bcc0 con 0x7f883009fce0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300a0980 con 0x7f883013b6f0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f88300a00c0 con 0x7f883009ac60 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f88351a0640 10 monclient(hunting): authenticate will time out at 646.391973s 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f882ed76640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f883009fce0 legacy=0x7f883006c8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.772+0000 7f882e575640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f883009ac60 msgr2=0x7f883006cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.773+0000 7f882e575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f883009ac60 0x7f883006cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.773+0000 7f882f577640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f883013b6f0 0x7f883013dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:52442/0 (socket says 10.20.193.51:52442) 2026-02-17T11:45:58.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.773+0000 7f882f577640 1 -- 10.20.193.51:0/1699577973 learned_addr learned my addr 10.20.193.51:0/1699577973 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:58.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882f577640 1 -- 10.20.193.51:0/1699577973 >> v1:10.20.193.142:6789/0 conn(0x7f883013b6f0 legacy=0x7f883013dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868182314 0 0) 0x7f88300a0980 con 0x7f883013b6f0 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): _negotiate 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): my global_id is 4294 2026-02-17T11:45:58.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f881c003620 con 0x7f883013b6f0 2026-02-17T11:45:58.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 156635138 0 0) 0x7f881c003620 con 0x7f883013b6f0 2026-02-17T11:45:58.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 >> v2:10.20.193.51:3300/0 conn(0x7f883009ac60 msgr2=0x7f883006cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 --2- 10.20.193.51:0/1699577973 >> v2:10.20.193.51:3300/0 conn(0x7f883009ac60 0x7f883006cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 >> v1:10.20.193.51:6789/0 conn(0x7f883009fce0 legacy=0x7f883006c8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883009b700 con 0x7f883013b6f0 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _finish_auth 0 2026-02-17T11:45:58.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f8820003530 con 0x7f883013b6f0 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f88351a0640 5 monclient: authenticate success, global_id 4294 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f88351a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:45:58.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: dump: 2026-02-17T11:45:58.797 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.797 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.797 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.797 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:45:58.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:58.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 >> v1:10.20.193.142:6789/0 conn(0x7f883013b6f0 legacy=0x7f883013dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:58.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c003ab0 0x7f881c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): picked mon.a con 0x7f881c003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 0x7f881c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): picked mon.c con 0x7f881c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f881c0054c0 0x7f881c00bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): picked mon.b con 0x7f881c0054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:58.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f88300a00c0 con 0x7f881c003ab0 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f881c00c400 con 0x7f881c0054c0 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f881c00c600 con 0x7f881c004900 2026-02-17T11:45:58.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882ed76640 1 -- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c003ab0 msgr2=0x7f881c003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882dd74640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f88351a0640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882ed76640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c003ab0 0x7f881c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 0x7f881c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): get_auth_request con 0x7f881c004900 auth_method 0 2026-02-17T11:45:58.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:58.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:58.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:58.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:58.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:58.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.775+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:58.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882f577640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f881c0054c0 0x7f881c00bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 10 monclient(hunting): handle_auth_done global_id 4294 payload 293 2026-02-17T11:45:58.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 -- 10.20.193.51:0/1699577973 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f881c0054c0 msgr2=0x7f881c00bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:58.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f881c0054c0 0x7f881c00bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 -- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c003ab0 msgr2=0x7f881c003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c003ab0 0x7f881c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 monclient: found mon.c 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:58.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 1 -- 10.20.193.51:0/1699577973 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c003620 con 0x7f881c004900 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 10 monclient: _finish_auth 0 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882e575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882f577640 10 monclient: get_auth_request con 0x7f881c0054c0 auth_method 0 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882f577640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f881c0054c0 0x7f881c00bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.776+0000 7f882f577640 1 -- 10.20.193.51:0/1699577973 reap_dead start 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882e575640 1 -- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 msgr2=0x7f881c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882e575640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 0x7f881c004d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88180099f0 tx=0x7f8818033b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2ca38d489bcda0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881803b020 con 0x7f881c004900 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:58.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: dump: 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88180050d0 con 0x7f881c004900 2026-02-17T11:45:58.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 1 -- 10.20.193.51:0/1699577973 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818009a30 con 0x7f881c004900 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f882dd74640 10 monclient: dump: 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.808 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 4 set_mon_vals no callback set 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 10 monclient: shutdown 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 1 -- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 msgr2=0x7f881c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 0x7f881c004d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88180099f0 tx=0x7f8818033b80 comp rx=0 tx=0).stop 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 1 -- 10.20.193.51:0/1699577973 shutdown_connections 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 1 --2- 10.20.193.51:0/1699577973 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f881c004900 0x7f881c004d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.778+0000 7f88351a0640 1 -- 10.20.193.51:0/1699577973 >> 10.20.193.51:0/1699577973 conn(0x7f88300a6550 msgr2=0x7f88300a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- 10.20.193.51:0/1699577973 shutdown_connections 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- 10.20.193.51:0/1699577973 wait complete. 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient: build_initial_monmap 2026-02-17T11:45:58.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient: monmap: 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 Processor -- start 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- start start 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient: init 2026-02-17T11:45:58.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 0x7f8830099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-a con 0x7f881c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-c con 0x7f88300901e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8830090ba0 0x7f88301d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): picked mon.noname-b con 0x7f8830090ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f882ed76640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 msgr2=0x7f8830099b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f883006c8d0 con 0x7f881c004900 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f883009a5c0 con 0x7f8830090ba0 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f883006ca50 con 0x7f88300901e0 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f88351a0640 10 monclient(hunting): authenticate will time out at 646.398963s 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.779+0000 7f882ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 0x7f8830099b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41462/0 (socket says 10.20.193.51:41462) 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 -- 10.20.193.51:0/1181473894 learned_addr learned my addr 10.20.193.51:0/1181473894 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): get_auth_request con 0x7f88300901e0 auth_method 0 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:58.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882f577640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8830090ba0 0x7f88301d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient(hunting): handle_auth_done global_id 4406 payload 824 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 -- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8830090ba0 msgr2=0x7f88301d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8830090ba0 0x7f88301d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 -- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 msgr2=0x7f8830099b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 0x7f8830099b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient: _finish_hunting 0 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 monclient: found mon.noname-c 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.780+0000 7f882e575640 1 -- 10.20.193.51:0/1181473894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88300a1880 con 0x7f88300901e0 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f882e575640 1 -- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 msgr2=0x7f8830090660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f882e575640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8818034090 tx=0x7f8818005b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:58.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881803b030 con 0x7f88300901e0 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: dump: 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818037890 con 0x7f88300901e0 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 5 monclient: authenticate success, global_id 4406 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _renew_subs 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883009a070 con 0x7f88300901e0 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818009a30 con 0x7f88300901e0 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f882d573640 4 set_mon_vals no callback set 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f880f7fe640 10 monclient: dump: 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.815 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _renew_subs 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f883009d740 con 0x7f88300901e0 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.782+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883006cde0 con 0x7f88300901e0 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.783+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8818037c60 con 0x7f88300901e0 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.783+0000 7f880f7fe640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 0x7f87fc0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.783+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4694+0+0 (secure 0 0 0) 0x7f881807c6b0 con 0x7f88300901e0 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.783+0000 7f882ed76640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 0x7f87fc0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.783+0000 7f882ed76640 10 monclient: get_auth_request con 0x7f87fc03dcf0 auth_method 0 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.785+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f883009a070 con 0x7f88300901e0 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.785+0000 7f880f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.785+0000 7f880f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.785+0000 7f882ed76640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 0x7f87fc0401b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8830092970 tx=0x7f88240092b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.869+0000 7f88351a0640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T11:45:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.869+0000 7f88351a0640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T11:45:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.869+0000 7f88351a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.869+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} v 0) -- 0x7f8830092c00 con 0x7f88300901e0 2026-02-17T11:45:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): tick 2026-02-17T11:45:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:45:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 monclient(hunting): continuing hunt 2026-02-17T11:45:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:45:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 msgr2=0x7f8438009970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f84380074b0 0x7f8438009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438003820 legacy=0x7f8438005ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 reap_dead start 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f843800a030 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 0x7f843800a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f843800a500 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8438005ca0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843800b040 con 0x7f8438005ca0 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f845406f5c0 con 0x7f843800a500 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 1 -- 10.20.193.51:0/2467833699 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f845406fa90 con 0x7f843800a030 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8442ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8458e66640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 msgr2=0x7f843800a920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459e68640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438005ca0 legacy=0x7f8438006150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8458e66640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 0x7f843800a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): get_auth_request con 0x7f843800a030 auth_method 0 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient(hunting): handle_auth_done global_id 4409 payload 274 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 msgr2=0x7f843800a920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 0x7f843800a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> v1:10.20.193.51:6789/0 conn(0x7f8438005ca0 legacy=0x7f8438006150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient: _finish_hunting 0 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 monclient: found mon.noname-b 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.918+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845406fd70 con 0x7f843800a030 2026-02-17T11:45:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8459667640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 msgr2=0x7f8438009970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8459667640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84440036c0 tx=0x7f844402f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506cb9fae29a8ca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8459667640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84440036c0 tx=0x7f844402f260 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f8444033070 config(0 keys) 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 1 -- 10.20.193.51:0/2467833699 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444005ac0 con 0x7f843800a030 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: dump: 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.933 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: _finish_auth 0 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 1 -- 10.20.193.51:0/2467833699 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8444033070 con 0x7f843800a030 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f8443fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f845b8f2640 5 monclient: authenticate success, global_id 4409 2026-02-17T11:45:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f845b8f2640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.920+0000 7f845b8f2640 4 set_mon_vals no callback set 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 10 monclient: shutdown 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 -- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 msgr2=0x7f8438009970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84440036c0 tx=0x7f844402f260 comp rx=0 tx=0).stop 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f8443fff640 1 -- 10.20.193.51:0/2467833699 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7f8444005e60 con 0x7f843800a030 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f8443fff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 -- 10.20.193.51:0/2467833699 shutdown_connections 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 --2- 10.20.193.51:0/2467833699 >> v2:10.20.193.51:3300/0 conn(0x7f843800a500 0x7f843800a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 --2- 10.20.193.51:0/2467833699 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f8438009970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 -- 10.20.193.51:0/2467833699 >> 10.20.193.51:0/2467833699 conn(0x7f84540a8c80 msgr2=0x7f84540a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 -- 10.20.193.51:0/2467833699 shutdown_connections 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.921+0000 7f845b8f2640 1 -- 10.20.193.51:0/2467833699 wait complete. 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient: build_initial_monmap 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient: monmap: 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 Processor -- start 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 -- start start 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient: init 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 0x7f845409df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-a con 0x7f8438005ca0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-c con 0x7f843800a030 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 0x7f845409e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): picked mon.noname-b con 0x7f843800a500 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f84540a4b60 con 0x7f8438005ca0 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f84540a49e0 con 0x7f843800a500 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8454070750 con 0x7f843800a030 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f845b8f2640 10 monclient(hunting): authenticate will time out at 646.541612s 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8459667640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 msgr2=0x7f845409df40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8459667640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 0x7f845409df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41486/0 (socket says 10.20.193.51:41486) 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 -- 10.20.193.51:0/1271323310 learned_addr learned my addr 10.20.193.51:0/1271323310 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): get_auth_request con 0x7f843800a030 auth_method 0 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient(hunting): handle_auth_done global_id 4412 payload 824 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8459e68640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 0x7f845409e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 -- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 msgr2=0x7f845409e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 0x7f845409e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 -- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 msgr2=0x7f845409df40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 0x7f845409df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient: _finish_hunting 0 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 monclient: found mon.noname-c 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8458e66640 1 -- 10.20.193.51:0/1271323310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84541252f0 con 0x7f843800a030 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8459e68640 10 monclient: get_auth_request con 0x7f843800a500 auth_method 0 2026-02-17T11:45:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.922+0000 7f8459e68640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 0x7f845409e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.924+0000 7f8458e66640 1 -- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 msgr2=0x7f845409e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.924+0000 7f8458e66640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8448013640 tx=0x7f8448013b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844801c070 con 0x7f843800a030 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: dump: 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: _finish_auth 0 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8448013e60 con 0x7f843800a030 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448011c70 con 0x7f843800a030 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 5 monclient: authenticate success, global_id 4412 2026-02-17T11:45:58.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _renew_subs 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f84437fe640 4 set_mon_vals no callback set 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84541255d0 con 0x7f843800a030 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 10 monclient: dump: 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:58.943 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _renew_subs 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84541258b0 con 0x7f843800a030 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8448016460 con 0x7f843800a030 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:58.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84540a3a60 con 0x7f843800a030 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 0x7f8424040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.925+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4694+0+0 (secure 0 0 0) 0x7f8448052d20 con 0x7f843800a030 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.926+0000 7f8459667640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 0x7f8424040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.926+0000 7f8459667640 10 monclient: get_auth_request con 0x7f842403dd40 auth_method 0 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.928+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8448051770 con 0x7f843800a030 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.928+0000 7f8441ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.928+0000 7f8441ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:58.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:58.928+0000 7f8459667640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 0x7f8424040200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f843800af80 tx=0x7f844403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f845b8f2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:45:59.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f845b8f2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f845b8f2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8454072830 con 0x7f843800a030 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f8441ffb640 1 -- 10.20.193.51:0/1271323310 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1549 (secure 0 0 0) 0x7f84480153c0 con 0x7f843800a030 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f8441ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.042+0000 7f8441ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:59.045 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:45:59.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 msgr2=0x7f8424040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 0x7f8424040200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f843800af80 tx=0x7f844403c040 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 10 monclient: shutdown 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 msgr2=0x7f845409e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8448013640 tx=0x7f8448013b10 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 shutdown_connections 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f842403dd40 0x7f8424040200 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f843800a500 0x7f845409e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f843800a030 0x7f845409e480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 --2- 10.20.193.51:0/1271323310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8438005ca0 0x7f845409df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 >> 10.20.193.51:0/1271323310 conn(0x7f84540a8c80 msgr2=0x7f84540737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 shutdown_connections 2026-02-17T11:45:59.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.043+0000 7f845b8f2640 1 -- 10.20.193.51:0/1271323310 wait complete. 2026-02-17T11:45:59.053 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:45:59.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:45:59.054 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 10 monclient: get_monmap_and_config 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 10 monclient: build_initial_monmap 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 10 monclient: monmap: 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:59.120042+0000 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:59.120042+0000 2026-02-17T11:45:59.121 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:59.122 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 1 Processor -- start 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 1 -- start start 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.119+0000 7f75c9bf7640 10 monclient: init 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f75c4138600 0x7f75c41389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f75c4138600 addr v2:10.20.193.51:3300/0 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f75c40a35a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:45:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f75c40a5a70 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c40a1df0 con 0x7f75c40a35a0 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c4138f20 con 0x7f75c40a5a70 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f75c40a6830 con 0x7f75c4138600 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c37fe640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f75c4138600 msgr2=0x7f75c41389e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c9bf7640 10 monclient(hunting): authenticate will time out at 646.739140s 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f75c4138600 0x7f75c41389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c2ffd640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f75c40a35a0 legacy=0x7f75c40a5360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c3fff640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f75c40a5a70 0x7f75c4140380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:52452/0 (socket says 10.20.193.51:52452) 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.120+0000 7f75c3fff640 1 -- 10.20.193.51:0/1417763374 learned_addr learned my addr 10.20.193.51:0/1417763374 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:45:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c3fff640 1 -- 10.20.193.51:0/1417763374 >> v1:10.20.193.142:6789/0 conn(0x7f75c40a5a70 legacy=0x7f75c4140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000319337 0 0) 0x7f75c4138f20 con 0x7f75c40a5a70 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): _negotiate 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): my global_id is 4297 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a8003620 con 0x7f75c40a5a70 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3538881736 0 0) 0x7f75a8003620 con 0x7f75c40a5a70 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 >> v2:10.20.193.51:3300/0 conn(0x7f75c4138600 msgr2=0x7f75c41389e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 --2- 10.20.193.51:0/1417763374 >> v2:10.20.193.51:3300/0 conn(0x7f75c4138600 0x7f75c41389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 >> v1:10.20.193.51:6789/0 conn(0x7f75c40a35a0 legacy=0x7f75c40a5360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c40a65b0 con 0x7f75c40a5a70 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f75b8003530 con 0x7f75c40a5a70 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c9bf7640 5 monclient: authenticate success, global_id 4297 2026-02-17T11:45:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c9bf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: dump: 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.140 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 >> v1:10.20.193.142:6789/0 conn(0x7f75c40a5a70 legacy=0x7f75c4140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75a8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): picked mon.c con 0x7f75a8003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75a8004900 0x7f75a8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): picked mon.a con 0x7f75a8004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75a80054c0 0x7f75a800bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): picked mon.b con 0x7f75a80054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800c3d0 con 0x7f75a8004900 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800c580 con 0x7f75a80054c0 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f75a800c780 con 0x7f75a8003ab0 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c27fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c9bf7640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c2ffd640 1 -- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75a8004900 msgr2=0x7f75a8004d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.122+0000 7f75c2ffd640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75a8004900 0x7f75a8004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75a8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): get_auth_request con 0x7f75a8003ab0 auth_method 0 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75a80054c0 0x7f75a800bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 10 monclient(hunting): get_auth_request con 0x7f75a80054c0 auth_method 0 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient(hunting): handle_auth_done global_id 4297 payload 293 2026-02-17T11:45:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 -- 10.20.193.51:0/1417763374 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75a80054c0 msgr2=0x7f75a800bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75a80054c0 0x7f75a800bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 -- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75a8004900 msgr2=0x7f75a8004d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75a8004900 0x7f75a8004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 monclient: found mon.c 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 1 -- 10.20.193.51:0/1417763374 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8003620 con 0x7f75a8003ab0 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c3fff640 1 -- 10.20.193.51:0/1417763374 reap_dead start 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient: _finish_auth 0 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:45:59.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.123+0000 7f75c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c37fe640 1 -- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 msgr2=0x7f75a8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c37fe640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75a8003eb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009e30 tx=0x7f75b002f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40693112f285ef83 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0009a30 con 0x7f75a8003ab0 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: dump: 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.145 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c9bf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b0003cb0 con 0x7f75a8003ab0 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 1 -- 10.20.193.51:0/1417763374 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0003e60 con 0x7f75a8003ab0 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c9bf7640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c9bf7640 4 set_mon_vals no callback set 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.125+0000 7f75c27fc640 10 monclient: dump: 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 10 monclient: shutdown 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 -- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 msgr2=0x7f75a8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75a8003eb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009e30 tx=0x7f75b002f660 comp rx=0 tx=0).stop 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 -- 10.20.193.51:0/1417763374 shutdown_connections 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/1417763374 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75a8003eb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 -- 10.20.193.51:0/1417763374 >> 10.20.193.51:0/1417763374 conn(0x7f75c40a7460 msgr2=0x7f75c40a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 -- 10.20.193.51:0/1417763374 shutdown_connections 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 1 -- 10.20.193.51:0/1417763374 wait complete. 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 10 monclient: build_initial_monmap 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.126+0000 7f75c9bf7640 10 monclient: monmap: 2026-02-17T11:45:59.148 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 Processor -- start 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 -- start start 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient: init 2026-02-17T11:45:59.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f75a8003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75c41363a0 0x7f75c4123e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f75c41363a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75c4136820 0x7f75c4124370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f75c4136820 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f75c40a25b0 con 0x7f75c41363a0 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f75c40a2c00 con 0x7f75c4136820 2026-02-17T11:45:59.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f75c40a15f0 con 0x7f75a8003ab0 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c9bf7640 10 monclient(hunting): authenticate will time out at 646.746458s 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c2ffd640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75c41363a0 msgr2=0x7f75c4123e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75c41363a0 0x7f75c4123e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41504/0 (socket says 10.20.193.51:41504) 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 -- 10.20.193.51:0/3213444608 learned_addr learned my addr 10.20.193.51:0/3213444608 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): get_auth_request con 0x7f75a8003ab0 auth_method 0 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient(hunting): handle_auth_done global_id 4415 payload 824 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75c4136820 msgr2=0x7f75c4124370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f75c4136820 0x7f75c4124370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75c41363a0 msgr2=0x7f75c4123e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f75c41363a0 0x7f75c4123e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 monclient: found mon.noname-c 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.127+0000 7f75c37fe640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4127dc0 con 0x7f75a8003ab0 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c37fe640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 msgr2=0x7f75c41cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c37fe640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009f60 tx=0x7f75b0005b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0048070 con 0x7f75a8003ab0 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.153 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: _finish_auth 0 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b003d040 con 0x7f75a8003ab0 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0009a30 con 0x7f75a8003ab0 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:45:59.154 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c1ffb640 4 set_mon_vals no callback set 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 5 monclient: authenticate success, global_id 4415 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 10 monclient: _renew_subs 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c40a9d30 con 0x7f75a8003ab0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 10 monclient: _renew_subs 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.129+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c4127800 con 0x7f75a8003ab0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c37fe640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009f60 tx=0x7f75b0005b10 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f75b0077910 osd_map(22..22 src has 1..22) 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f75b0037430 con 0x7f75a8003ab0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c9bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 0x7f75c4073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f75c4126630 con 0x7f75c41248b0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 0x7f75c4073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient: get_auth_request con 0x7f75c41248b0 auth_method 0 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f759ffff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f759403dcc0 0x7f7594040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_done global_id 4418 payload 824 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c2ffd640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75c40512a0 con 0x7f75c41248b0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c3fff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f759403dcc0 0x7f7594040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.130+0000 7f75c3fff640 10 monclient: get_auth_request con 0x7f759403dcc0 auth_method 0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f75c2ffd640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 msgr2=0x7f75c4073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f75c2ffd640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 0x7f75c4073d20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75b400bd00 tx=0x7f75b4009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b400ce10 con 0x7f75c41248b0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f759ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.132+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f75b4010070 con 0x7f75c41248b0 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 msgr2=0x7f75c4073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 0x7f75c4073d20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75b400bd00 tx=0x7f75b4009f70 comp rx=0 tx=0).stop 2026-02-17T11:45:59.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 msgr2=0x7f75c4073d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:59.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f759ffff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41248b0 0x7f75c4073d20 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75b400bd00 tx=0x7f75b4009f70 comp rx=0 tx=0).stop 2026-02-17T11:45:59.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.133+0000 7f75c3fff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f759403dcc0 0x7f7594040180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75c406f820 tx=0x7f75b8002eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c9bf7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 0x7f75c40638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c9bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f75c40a1ae0 con 0x7f75c41279d0 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 0x7f75c40638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient: get_auth_request con 0x7f75c41279d0 auth_method 0 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 10 monclient(hunting): handle_auth_done global_id 4421 payload 824 2026-02-17T11:45:59.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.136+0000 7f75c2ffd640 1 -- 10.20.193.51:0/3213444608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f75c4124c90 con 0x7f75c41279d0 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c2ffd640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 msgr2=0x7f75c40638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c2ffd640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 0x7f75c40638c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75c41367f0 tx=0x7f75b4005b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4005070 con 0x7f75c41279d0 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4695 (secure 0 0 0) 0x7f75b4005070 con 0x7f75c41279d0 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 msgr2=0x7f75c40638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 0x7f75c40638c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75c41367f0 tx=0x7f75b4005b60 comp rx=0 tx=0).stop 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 msgr2=0x7f75c40638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75c41279d0 0x7f75c40638c0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75c41367f0 tx=0x7f75b4005b60 comp rx=0 tx=0).stop 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:59.163 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 6, 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 42459, 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.164 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.165 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:45:59.166 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:45:59.167 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.168 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:45:59.169 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.170 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:59.171 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:45:59.172 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:45:59.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f759403dcc0 msgr2=0x7f7594040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f759403dcc0 0x7f7594040180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75c406f820 tx=0x7f75b8002eb0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 10 monclient: shutdown 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 msgr2=0x7f75c41cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c3fff640 1 -- 10.20.193.51:0/3213444608 reap_dead start 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009f60 tx=0x7f75b0005b10 comp rx=0 tx=0).stop 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f759ffff640 1 -- 10.20.193.51:0/3213444608 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4694+0+0 (unknown 0 0 0) 0x7f75b0077910 con 0x7f75a8003ab0 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 shutdown_connections 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 --2- 10.20.193.51:0/3213444608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f75a8003ab0 0x7f75c41cefc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 >> 10.20.193.51:0/3213444608 conn(0x7f75c40a7460 msgr2=0x7f75c40a9230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 shutdown_connections 2026-02-17T11:45:59.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.139+0000 7f75c9bf7640 1 -- 10.20.193.51:0/3213444608 wait complete. 2026-02-17T11:45:59.174 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:45:59.174 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:45:59.175 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:45:59.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.240+0000 7f71f7afa640 10 monclient: get_monmap_and_config 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.240+0000 7f71f7afa640 10 monclient: build_initial_monmap 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.240+0000 7f71f7afa640 10 monclient: monmap: 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:45:59.241777+0000 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:45:59.241777+0000 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:45:59.243 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:45:59.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:45:59.244 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:45:59.244 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:45:59.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 Processor -- start 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 -- start start 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient: init 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f71f0138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-b con 0x7f71f00a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 0x7f71f013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-c con 0x7f71f013d8a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00a1df0 con 0x7f71f0138600 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f71f00a6830 con 0x7f71f013d8a0 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f00a2c00 con 0x7f71f00a35a0 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f7afa640 10 monclient(hunting): authenticate will time out at 646.860677s 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41532/0 (socket says 10.20.193.51:41532) 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 -- 10.20.193.51:0/3766162570 learned_addr learned my addr 10.20.193.51:0/3766162570 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): get_auth_request con 0x7f71f00a35a0 auth_method 0 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f6070640 1 --2- 10.20.193.51:0/3766162570 >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 0x7f71f013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f6070640 10 monclient(hunting): get_auth_request con 0x7f71f013d8a0 auth_method 0 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f6070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f6070640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f6070640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient(hunting): handle_auth_done global_id 4424 payload 274 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 -- 10.20.193.51:0/3766162570 >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 msgr2=0x7f71f013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 --2- 10.20.193.51:0/3766162570 >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 0x7f71f013fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 -- 10.20.193.51:0/3766162570 >> v1:10.20.193.142:6789/0 conn(0x7f71f0138600 legacy=0x7f71f01389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 1 monclient: found mon.noname-b 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.241+0000 7f71f506e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.242+0000 7f71f506e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.242+0000 7f71f506e640 1 -- 10.20.193.51:0/3766162570 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f00a65b0 con 0x7f71f00a35a0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.242+0000 7f71f6070640 1 --2- 10.20.193.51:0/3766162570 >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 0x7f71f013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f506e640 1 -- 10.20.193.51:0/3766162570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 msgr2=0x7f71f013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f506e640 1 --2- 10.20.193.51:0/3766162570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009970 tx=0x7f71e402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913373fa4d3b1665 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 1 -- 10.20.193.51:0/3766162570 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e403c070 con 0x7f71f00a35a0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: dump: 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: _finish_auth 0 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: _check_auth_tickets 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 1 -- 10.20.193.51:0/3766162570 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e402fcd0 con 0x7f71f00a35a0 2026-02-17T11:45:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 5 monclient: authenticate success, global_id 4424 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 1 -- 10.20.193.51:0/3766162570 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4037660 con 0x7f71f00a35a0 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 10 monclient: get_monmap_and_config success 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 4 set_mon_vals no callback set 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f486d640 10 monclient: dump: 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.257 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 10 monclient: shutdown 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 -- 10.20.193.51:0/3766162570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 msgr2=0x7f71f013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 --2- 10.20.193.51:0/3766162570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009970 tx=0x7f71e402ee90 comp rx=0 tx=0).stop 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 -- 10.20.193.51:0/3766162570 shutdown_connections 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 --2- 10.20.193.51:0/3766162570 >> v2:10.20.193.142:3300/0 conn(0x7f71f013d8a0 0x7f71f013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 --2- 10.20.193.51:0/3766162570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f00a35a0 0x7f71f013d360 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 -- 10.20.193.51:0/3766162570 >> 10.20.193.51:0/3766162570 conn(0x7f71f00a7460 msgr2=0x7f71f00a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.244+0000 7f71f7afa640 1 -- 10.20.193.51:0/3766162570 shutdown_connections 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 -- 10.20.193.51:0/3766162570 wait complete. 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient: build_initial_monmap 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient: monmap: 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 Processor -- start 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 -- start start 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient: init 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient: _reopen_session rank -1 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f00a35a0 0x7f71f01cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-b con 0x7f71f00a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 0x7f71f01cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-c con 0x7f71f0138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f013d8a0 0x7f71f01cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): picked mon.noname-a con 0x7f71f013d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00a15f0 con 0x7f71f013d8a0 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00a25b0 con 0x7f71f00a35a0 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f00a1770 con 0x7f71f0138600 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): _renew_subs 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f7afa640 10 monclient(hunting): authenticate will time out at 646.864896s 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f6070640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f013d8a0 msgr2=0x7f71f01cfce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f6070640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f013d8a0 0x7f71f01cfce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 0x7f71f01cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 0x7f71f01cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41540/0 (socket says 10.20.193.51:41540) 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 1 -- 10.20.193.51:0/212347068 learned_addr learned my addr 10.20.193.51:0/212347068 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 10 monclient(hunting): get_auth_request con 0x7f71f0138600 auth_method 0 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.245+0000 7f71f506e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f00a35a0 0x7f71f01cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient(hunting): handle_auth_done global_id 4427 payload 824 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f00a35a0 msgr2=0x7f71f01cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f00a35a0 0x7f71f01cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f013d8a0 msgr2=0x7f71f01cfce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f013d8a0 0x7f71f01cfce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient: _finish_hunting 0 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 monclient: found mon.noname-c 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f506e640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0072410 con 0x7f71f0138600 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f586f640 10 monclient: get_auth_request con 0x7f71f00a35a0 auth_method 0 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.246+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f00a35a0 0x7f71f01cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f506e640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 msgr2=0x7f71f01cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f506e640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 0x7f71f01cf7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009aa0 tx=0x7f71e40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4046020 con 0x7f71f0138600 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: dump: 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.263 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: _finish_auth 0 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e4042620 con 0x7f71f0138600 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 5 monclient: authenticate success, global_id 4427 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e403c040 con 0x7f71f0138600 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71dffff640 4 set_mon_vals no callback set 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71de7fc640 10 monclient: dump: 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 monclient: _renew_subs 2026-02-17T11:45:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f013d250 con 0x7f71f0138600 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 monclient: _renew_subs 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f013c800 con 0x7f71f0138600 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 0x7f71f01344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.248+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0072130 con 0x7f71f01340e0 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 0x7f71f01344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient: get_auth_request con 0x7f71f01340e0 auth_method 0 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f71e403f030 con 0x7f71f0138600 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71de7fc640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c003dd10 0x7f71c00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 10 monclient(hunting): handle_auth_done global_id 4303 payload 824 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f586f640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71f01389e0 con 0x7f71f01340e0 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4694+0+0 (secure 0 0 0) 0x7f71e4077980 con 0x7f71f0138600 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f6070640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c003dd10 0x7f71c00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.249+0000 7f71f6070640 10 monclient: get_auth_request con 0x7f71c003dd10 auth_method 0 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71f586f640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 msgr2=0x7f71f01344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 0x7f71f01344c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e000dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e000bb30 con 0x7f71f01340e0 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.251+0000 7f71de7fc640 10 monclient: dump: 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.270 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f71e000bb30 con 0x7f71f01340e0 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 msgr2=0x7f71f01344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 0x7f71f01344c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e000dbf0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 msgr2=0x7f71f01344c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71de7fc640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f01340e0 0x7f71f01344c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e000dbf0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.252+0000 7f71f6070640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c003dd10 0x7f71c00401d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71f006a720 tx=0x7f71ec009970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f7afa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f7afa640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 0x7f71f01da7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f7afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0072650 con 0x7f71f0134a00 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 0x7f71f01da7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient: get_auth_request con 0x7f71f0134a00 auth_method 0 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 10 monclient(hunting): handle_auth_done global_id 4306 payload 824 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.255+0000 7f71f586f640 1 -- 10.20.193.51:0/212347068 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71f0074970 con 0x7f71f0134a00 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71f586f640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 msgr2=0x7f71f01da7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:45:59.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71f586f640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 0x7f71f01da7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e0003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0005490 con 0x7f71f0134a00 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.257+0000 7f71de7fc640 10 monclient: dump: 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:45:59.273 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f71e0005490 con 0x7f71f0134a00 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 msgr2=0x7f71f01da7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 0x7f71f01da7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e0003860 comp rx=0 tx=0).stop 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 msgr2=0x7f71f01da7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71de7fc640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f0134a00 0x7f71f01da7c0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e0003860 comp rx=0 tx=0).stop 2026-02-17T11:45:59.274 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 6, 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 42535, 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:45:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:45:59.277 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:45:59.278 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.279 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.280 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:45:59.282 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.283 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:45:59.284 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:45:59.285 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:45:59.285 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c003dd10 msgr2=0x7f71c00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c003dd10 0x7f71c00401d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71f006a720 tx=0x7f71ec009970 comp rx=0 tx=0).stop 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 10 monclient: shutdown 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 msgr2=0x7f71f01cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 --2- 10.20.193.51:0/212347068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f0138600 0x7f71f01cf7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009aa0 tx=0x7f71e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f6070640 1 -- 10.20.193.51:0/212347068 reap_dead start 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f6070640 1 -- 10.20.193.51:0/212347068 reap_dead start 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 shutdown_connections 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 >> 10.20.193.51:0/212347068 conn(0x7f71f00a7460 msgr2=0x7f71f013dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 shutdown_connections 2026-02-17T11:45:59.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.258+0000 7f71f7afa640 1 -- 10.20.193.51:0/212347068 wait complete. 2026-02-17T11:45:59.286 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:45:59.287 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:45:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.916+0000 7f880f7fe640 1 -- 10.20.193.51:0/1181473894 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]=0 enabled application 'rados' on pool 'unique_pool_0' v23) ==== 197+0+0 (secure 0 0 0) 0x7f88300a1880 con 0x7f88300901e0 2026-02-17T11:45:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.916+0000 7f880f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T11:45:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.916+0000 7f880f7fe640 10 monclient: _finish_command 2 = system:0 enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T11:45:59.919 INFO:teuthology.orchestra.run.trial051.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T11:45:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 msgr2=0x7f87fc0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 0x7f87fc0401b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8830092970 tx=0x7f88240092b0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 10 monclient: shutdown 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 msgr2=0x7f8830090660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8818034090 tx=0x7f8818005b10 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 shutdown_connections 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87fc03dcf0 0x7f87fc0401b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8830090ba0 0x7f88301d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88300901e0 0x7f8830090660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 --2- 10.20.193.51:0/1181473894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f881c004900 0x7f8830099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:45:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 >> 10.20.193.51:0/1181473894 conn(0x7f88300a6550 msgr2=0x7f883009e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:45:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 shutdown_connections 2026-02-17T11:45:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:45:59.921+0000 7f88351a0640 1 -- 10.20.193.51:0/1181473894 wait complete. 2026-02-17T11:46:00.934 DEBUG:teuthology.orchestra.run.trial142:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2026-02-17T11:46:00.967 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight read -> 100 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight write -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight delete -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight snap_create -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight snap_remove -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight rollback -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight copy_from -> 50 2026-02-17T11:46:00.968 INFO:tasks.rados.rados.0.trial142.stdout:adding op weight write_excl -> 50 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout:ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable) 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout:Configuration: 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Number of operations: 4000 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Number of objects: 50 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Max in flight operations: 16 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Object size (in bytes): 4000000 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Write stride min: 400000 2026-02-17T11:46:00.969 INFO:tasks.rados.rados.0.trial142.stdout: Write stride max: 800000 2026-02-17T11:46:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1: write initial oid 1 2026-02-17T11:46:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-17T11:46:02.076 INFO:tasks.rados.rados.0.trial142.stdout:1: writing trial14245205-1 from 416807 to 892056 tid 1 2026-02-17T11:46:02.080 INFO:tasks.rados.rados.0.trial142.stdout:1: writing trial14245205-1 from 1542129 to 2016807 tid 2 2026-02-17T11:46:02.080 INFO:tasks.rados.rados.0.trial142.stdout:2: write initial oid 2 2026-02-17T11:46:02.081 INFO:tasks.rados.rados.0.trial142.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-17T11:46:02.084 INFO:tasks.rados.rados.0.trial142.stdout:2: writing trial14245205-2 from 416807 to 892056 tid 1 2026-02-17T11:46:02.088 INFO:tasks.rados.rados.0.trial142.stdout:2: writing trial14245205-2 from 1542129 to 2016807 tid 2 2026-02-17T11:46:02.088 INFO:tasks.rados.rados.0.trial142.stdout:3: write initial oid 3 2026-02-17T11:46:02.088 INFO:tasks.rados.rados.0.trial142.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-17T11:46:02.092 INFO:tasks.rados.rados.0.trial142.stdout:3: writing trial14245205-3 from 433614 to 984112 tid 1 2026-02-17T11:46:02.096 INFO:tasks.rados.rados.0.trial142.stdout:3: writing trial14245205-3 from 1600611 to 2033614 tid 2 2026-02-17T11:46:02.096 INFO:tasks.rados.rados.0.trial142.stdout:4: write initial oid 4 2026-02-17T11:46:02.096 INFO:tasks.rados.rados.0.trial142.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-17T11:46:02.100 INFO:tasks.rados.rados.0.trial142.stdout:4: writing trial14245205-4 from 450421 to 1076168 tid 1 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:4: writing trial14245205-4 from 1659093 to 2050421 tid 2 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:5: write initial oid 5 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:1: finishing write tid 1 to trial14245205-1 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:1: finishing write tid 2 to trial14245205-1 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:1: finishing write tid 3 to trial14245205-1 2026-02-17T11:46:02.104 INFO:tasks.rados.rados.0.trial142.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-17T11:46:02.108 INFO:tasks.rados.rados.0.trial142.stdout:5: writing trial14245205-5 from 467228 to 1168224 tid 1 2026-02-17T11:46:02.112 INFO:tasks.rados.rados.0.trial142.stdout:5: writing trial14245205-5 from 1717575 to 2067228 tid 2 2026-02-17T11:46:02.112 INFO:tasks.rados.rados.0.trial142.stdout:6: write initial oid 6 2026-02-17T11:46:02.112 INFO:tasks.rados.rados.0.trial142.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-17T11:46:02.116 INFO:tasks.rados.rados.0.trial142.stdout:6: writing trial14245205-6 from 484035 to 1260280 tid 1 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:6: writing trial14245205-6 from 2059704 to 2084035 tid 2 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:7: write initial oid 7 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:1: finishing write tid 4 to trial14245205-1 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:1: oid 1 updating version 0 to 1 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:1: oid 1 updating version 1 to 2 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:1: oid 1 updating version 2 to 3 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-17T11:46:02.120 INFO:tasks.rados.rados.0.trial142.stdout:2: finishing write tid 1 to trial14245205-2 2026-02-17T11:46:02.121 INFO:tasks.rados.rados.0.trial142.stdout:2: finishing write tid 2 to trial14245205-2 2026-02-17T11:46:02.121 INFO:tasks.rados.rados.0.trial142.stdout:2: finishing write tid 3 to trial14245205-2 2026-02-17T11:46:02.121 INFO:tasks.rados.rados.0.trial142.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-17T11:46:02.123 INFO:tasks.rados.rados.0.trial142.stdout:7: writing trial14245205-7 from 500842 to 952336 tid 1 2026-02-17T11:46:02.127 INFO:tasks.rados.rados.0.trial142.stdout:7: writing trial14245205-7 from 1718186 to 2100842 tid 2 2026-02-17T11:46:02.127 INFO:tasks.rados.rados.0.trial142.stdout:1: done (6 left) 2026-02-17T11:46:02.127 INFO:tasks.rados.rados.0.trial142.stdout:8: write initial oid 8 2026-02-17T11:46:02.128 INFO:tasks.rados.rados.0.trial142.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-17T11:46:02.131 INFO:tasks.rados.rados.0.trial142.stdout:8: writing trial14245205-8 from 517649 to 1044392 tid 1 2026-02-17T11:46:02.135 INFO:tasks.rados.rados.0.trial142.stdout:8: writing trial14245205-8 from 1776668 to 2117649 tid 2 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:9: write initial oid 9 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:2: finishing write tid 4 to trial14245205-2 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:2: oid 2 updating version 0 to 1 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:2: oid 2 updating version 1 to 3 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:2: oid 2 version 3 is already newer than 2 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:3: finishing write tid 1 to trial14245205-3 2026-02-17T11:46:02.136 INFO:tasks.rados.rados.0.trial142.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-17T11:46:02.140 INFO:tasks.rados.rados.0.trial142.stdout:9: writing trial14245205-9 from 534456 to 1252801 tid 1 2026-02-17T11:46:02.143 INFO:tasks.rados.rados.0.trial142.stdout:9: writing trial14245205-9 from 1951503 to 2134456 tid 2 2026-02-17T11:46:02.143 INFO:tasks.rados.rados.0.trial142.stdout:2: done (7 left) 2026-02-17T11:46:02.143 INFO:tasks.rados.rados.0.trial142.stdout:10: write initial oid 10 2026-02-17T11:46:02.143 INFO:tasks.rados.rados.0.trial142.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-17T11:46:02.148 INFO:tasks.rados.rados.0.trial142.stdout:10: writing trial14245205-10 from 551263 to 1344857 tid 1 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:10: writing trial14245205-10 from 1893632 to 2151263 tid 2 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:11: write initial oid 11 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: finishing write tid 2 to trial14245205-3 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: finishing write tid 3 to trial14245205-3 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: finishing write tid 4 to trial14245205-3 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: oid 3 updating version 0 to 3 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: oid 3 version 3 is already newer than 1 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:3: oid 3 version 3 is already newer than 2 2026-02-17T11:46:02.152 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-17T11:46:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-17T11:46:02.153 INFO:tasks.rados.rados.0.trial142.stdout:4: finishing write tid 1 to trial14245205-4 2026-02-17T11:46:02.153 INFO:tasks.rados.rados.0.trial142.stdout:4: finishing write tid 2 to trial14245205-4 2026-02-17T11:46:02.153 INFO:tasks.rados.rados.0.trial142.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-17T11:46:02.155 INFO:tasks.rados.rados.0.trial142.stdout:11: writing trial14245205-11 from 568070 to 1036913 tid 1 2026-02-17T11:46:02.159 INFO:tasks.rados.rados.0.trial142.stdout:11: writing trial14245205-11 from 1552114 to 2168070 tid 2 2026-02-17T11:46:02.159 INFO:tasks.rados.rados.0.trial142.stdout:3: done (8 left) 2026-02-17T11:46:02.160 INFO:tasks.rados.rados.0.trial142.stdout:12: write initial oid 12 2026-02-17T11:46:02.160 INFO:tasks.rados.rados.0.trial142.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-17T11:46:02.163 INFO:tasks.rados.rados.0.trial142.stdout:12: writing trial14245205-12 from 584877 to 1128969 tid 1 2026-02-17T11:46:02.167 INFO:tasks.rados.rados.0.trial142.stdout:12: writing trial14245205-12 from 1610596 to 2172599 tid 2 2026-02-17T11:46:02.168 INFO:tasks.rados.rados.0.trial142.stdout:13: write initial oid 13 2026-02-17T11:46:02.168 INFO:tasks.rados.rados.0.trial142.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-17T11:46:02.172 INFO:tasks.rados.rados.0.trial142.stdout:13: writing trial14245205-13 from 601684 to 1221025 tid 1 2026-02-17T11:46:02.176 INFO:tasks.rados.rados.0.trial142.stdout:13: writing trial14245205-13 from 1669078 to 2201684 tid 2 2026-02-17T11:46:02.176 INFO:tasks.rados.rados.0.trial142.stdout:14: write initial oid 14 2026-02-17T11:46:02.176 INFO:tasks.rados.rados.0.trial142.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-17T11:46:02.181 INFO:tasks.rados.rados.0.trial142.stdout:14: writing trial14245205-14 from 618491 to 1313081 tid 1 2026-02-17T11:46:02.184 INFO:tasks.rados.rados.0.trial142.stdout:14: writing trial14245205-14 from 2011207 to 2218491 tid 2 2026-02-17T11:46:02.184 INFO:tasks.rados.rados.0.trial142.stdout:15: write initial oid 15 2026-02-17T11:46:02.184 INFO:tasks.rados.rados.0.trial142.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-17T11:46:02.189 INFO:tasks.rados.rados.0.trial142.stdout:15: writing trial14245205-15 from 635298 to 1405137 tid 1 2026-02-17T11:46:02.193 INFO:tasks.rados.rados.0.trial142.stdout:15: writing trial14245205-15 from 2069689 to 2235298 tid 2 2026-02-17T11:46:02.193 INFO:tasks.rados.rados.0.trial142.stdout:16: write initial oid 16 2026-02-17T11:46:02.193 INFO:tasks.rados.rados.0.trial142.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-17T11:46:02.196 INFO:tasks.rados.rados.0.trial142.stdout:16: writing trial14245205-16 from 652105 to 1097193 tid 1 2026-02-17T11:46:02.201 INFO:tasks.rados.rados.0.trial142.stdout:16: writing trial14245205-16 from 1728171 to 2181159 tid 2 2026-02-17T11:46:02.201 INFO:tasks.rados.rados.0.trial142.stdout:17: write initial oid 17 2026-02-17T11:46:02.201 INFO:tasks.rados.rados.0.trial142.stdout:4: finishing write tid 3 to trial14245205-4 2026-02-17T11:46:02.201 INFO:tasks.rados.rados.0.trial142.stdout:4: finishing write tid 4 to trial14245205-4 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:4: oid 4 updating version 0 to 1 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:4: oid 4 updating version 1 to 3 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:4: oid 4 version 3 is already newer than 2 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:5: finishing write tid 1 to trial14245205-5 2026-02-17T11:46:02.202 INFO:tasks.rados.rados.0.trial142.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-17T11:46:02.205 INFO:tasks.rados.rados.0.trial142.stdout:17: writing trial14245205-17 from 668912 to 1305602 tid 1 2026-02-17T11:46:02.209 INFO:tasks.rados.rados.0.trial142.stdout:17: writing trial14245205-17 from 1903006 to 2268912 tid 2 2026-02-17T11:46:02.209 INFO:tasks.rados.rados.0.trial142.stdout:4: done (13 left) 2026-02-17T11:46:02.209 INFO:tasks.rados.rados.0.trial142.stdout:18: write initial oid 18 2026-02-17T11:46:02.210 INFO:tasks.rados.rados.0.trial142.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-17T11:46:02.214 INFO:tasks.rados.rados.0.trial142.stdout:18: writing trial14245205-18 from 685719 to 1397658 tid 1 2026-02-17T11:46:02.218 INFO:tasks.rados.rados.0.trial142.stdout:18: writing trial14245205-18 from 1845135 to 2285719 tid 2 2026-02-17T11:46:02.218 INFO:tasks.rados.rados.0.trial142.stdout:19: write initial oid 19 2026-02-17T11:46:02.218 INFO:tasks.rados.rados.0.trial142.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-17T11:46:02.223 INFO:tasks.rados.rados.0.trial142.stdout:19: writing trial14245205-19 from 702526 to 1489714 tid 1 2026-02-17T11:46:02.226 INFO:tasks.rados.rados.0.trial142.stdout:19: writing trial14245205-19 from 1903617 to 2302526 tid 2 2026-02-17T11:46:02.226 INFO:tasks.rados.rados.0.trial142.stdout:20: write initial oid 20 2026-02-17T11:46:02.226 INFO:tasks.rados.rados.0.trial142.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-17T11:46:02.230 INFO:tasks.rados.rados.0.trial142.stdout:20: writing trial14245205-20 from 719333 to 1181770 tid 1 2026-02-17T11:46:02.235 INFO:tasks.rados.rados.0.trial142.stdout:20: writing trial14245205-20 from 1962099 to 2319333 tid 2 2026-02-17T11:46:02.235 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.235 INFO:tasks.rados.rados.0.trial142.stdout:5: finishing write tid 2 to trial14245205-5 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: finishing write tid 3 to trial14245205-5 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: finishing write tid 4 to trial14245205-5 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: oid 5 updating version 0 to 3 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: oid 5 version 3 is already newer than 1 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: oid 5 version 3 is already newer than 2 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:7: finishing write tid 1 to trial14245205-7 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:6: finishing write tid 1 to trial14245205-6 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:6: finishing write tid 2 to trial14245205-6 2026-02-17T11:46:02.236 INFO:tasks.rados.rados.0.trial142.stdout:6: finishing write tid 3 to trial14245205-6 2026-02-17T11:46:02.237 INFO:tasks.rados.rados.0.trial142.stdout:5: done (15 left) 2026-02-17T11:46:02.237 INFO:tasks.rados.rados.0.trial142.stdout:21: write initial oid 21 2026-02-17T11:46:02.237 INFO:tasks.rados.rados.0.trial142.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-17T11:46:02.240 INFO:tasks.rados.rados.0.trial142.stdout:21: writing trial14245205-21 from 736140 to 1273826 tid 1 2026-02-17T11:46:02.244 INFO:tasks.rados.rados.0.trial142.stdout:21: writing trial14245205-21 from 2020581 to 2336140 tid 2 2026-02-17T11:46:02.244 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.244 INFO:tasks.rados.rados.0.trial142.stdout:6: finishing write tid 4 to trial14245205-6 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:6: oid 6 updating version 0 to 3 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:6: oid 6 version 3 is already newer than 1 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:6: oid 6 version 3 is already newer than 2 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:7: finishing write tid 2 to trial14245205-7 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:6: done (15 left) 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:22: write initial oid 22 2026-02-17T11:46:02.245 INFO:tasks.rados.rados.0.trial142.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-17T11:46:02.249 INFO:tasks.rados.rados.0.trial142.stdout:22: writing trial14245205-22 from 752947 to 1365882 tid 1 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:22: writing trial14245205-22 from 1962710 to 2352947 tid 2 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:7: finishing write tid 3 to trial14245205-7 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:7: finishing write tid 4 to trial14245205-7 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:7: oid 7 updating version 0 to 5 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:7: oid 7 version 5 is already newer than 4 2026-02-17T11:46:02.253 INFO:tasks.rados.rados.0.trial142.stdout:7: oid 7 updating version 5 to 6 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:8: finishing write tid 1 to trial14245205-8 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:7: done (15 left) 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:23: write initial oid 23 2026-02-17T11:46:02.254 INFO:tasks.rados.rados.0.trial142.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-17T11:46:02.258 INFO:tasks.rados.rados.0.trial142.stdout:23: writing trial14245205-23 from 769754 to 1457938 tid 1 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:23: writing trial14245205-23 from 2021192 to 2369754 tid 2 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: finishing write tid 2 to trial14245205-8 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: finishing write tid 3 to trial14245205-8 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: finishing write tid 4 to trial14245205-8 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: oid 8 updating version 0 to 3 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: oid 8 version 3 is already newer than 1 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: oid 8 version 3 is already newer than 2 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-17T11:46:02.262 INFO:tasks.rados.rados.0.trial142.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:9: finishing write tid 1 to trial14245205-9 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:9: finishing write tid 2 to trial14245205-9 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:9: finishing write tid 3 to trial14245205-9 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:8: done (15 left) 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:24: write initial oid 24 2026-02-17T11:46:02.263 INFO:tasks.rados.rados.0.trial142.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-17T11:46:02.266 INFO:tasks.rados.rados.0.trial142.stdout:24: writing trial14245205-24 from 786561 to 1266347 tid 1 2026-02-17T11:46:02.270 INFO:tasks.rados.rados.0.trial142.stdout:24: writing trial14245205-24 from 1796027 to 2263691 tid 2 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:9: finishing write tid 4 to trial14245205-9 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:9: oid 9 updating version 0 to 7 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:9: oid 9 updating version 7 to 8 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:9: oid 9 updating version 8 to 9 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 9 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-17T11:46:02.271 INFO:tasks.rados.rados.0.trial142.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-17T11:46:02.272 INFO:tasks.rados.rados.0.trial142.stdout:10: finishing write tid 1 to trial14245205-10 2026-02-17T11:46:02.272 INFO:tasks.rados.rados.0.trial142.stdout:9: done (15 left) 2026-02-17T11:46:02.272 INFO:tasks.rados.rados.0.trial142.stdout:25: write initial oid 25 2026-02-17T11:46:02.272 INFO:tasks.rados.rados.0.trial142.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-17T11:46:02.273 INFO:tasks.rados.rados.0.trial142.stdout:25: writing trial14245205-25 from 403368 to 958403 tid 1 2026-02-17T11:46:02.278 INFO:tasks.rados.rados.0.trial142.stdout:25: writing trial14245205-25 from 1454509 to 2182184 tid 2 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: finishing write tid 2 to trial14245205-10 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: finishing write tid 3 to trial14245205-10 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: finishing write tid 4 to trial14245205-10 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: oid 10 updating version 0 to 2 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: oid 10 updating version 2 to 3 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: oid 10 version 3 is already newer than 1 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:11: finishing write tid 1 to trial14245205-11 2026-02-17T11:46:02.279 INFO:tasks.rados.rados.0.trial142.stdout:10: done (15 left) 2026-02-17T11:46:02.280 INFO:tasks.rados.rados.0.trial142.stdout:26: write initial oid 26 2026-02-17T11:46:02.280 INFO:tasks.rados.rados.0.trial142.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-17T11:46:02.282 INFO:tasks.rados.rados.0.trial142.stdout:26: writing trial14245205-26 from 420175 to 1050459 tid 1 2026-02-17T11:46:02.287 INFO:tasks.rados.rados.0.trial142.stdout:26: writing trial14245205-26 from 1796638 to 2267971 tid 2 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: finishing write tid 2 to trial14245205-11 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: finishing write tid 3 to trial14245205-11 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: finishing write tid 4 to trial14245205-11 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: oid 11 updating version 0 to 3 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: oid 11 version 3 is already newer than 1 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: oid 11 version 3 is already newer than 2 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:12: finishing write tid 1 to trial14245205-12 2026-02-17T11:46:02.288 INFO:tasks.rados.rados.0.trial142.stdout:12: finishing write tid 2 to trial14245205-12 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: finishing write tid 3 to trial14245205-12 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: finishing write tid 4 to trial14245205-12 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: oid 12 updating version 0 to 12 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: oid 12 version 12 is already newer than 10 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: oid 12 version 12 is already newer than 11 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 12 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:13: finishing write tid 1 to trial14245205-13 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:13: finishing write tid 2 to trial14245205-13 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:13: finishing write tid 3 to trial14245205-13 2026-02-17T11:46:02.289 INFO:tasks.rados.rados.0.trial142.stdout:13: finishing write tid 4 to trial14245205-13 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:13: oid 13 updating version 0 to 4 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:13: oid 13 updating version 4 to 6 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:13: oid 13 version 6 is already newer than 5 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:14: finishing write tid 1 to trial14245205-14 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:11: done (15 left) 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:12: done (14 left) 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:13: done (13 left) 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:27: write initial oid 27 2026-02-17T11:46:02.290 INFO:tasks.rados.rados.0.trial142.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-17T11:46:02.291 INFO:tasks.rados.rados.0.trial142.stdout:27: writing trial14245205-27 from 436982 to 1142515 tid 1 2026-02-17T11:46:02.296 INFO:tasks.rados.rados.0.trial142.stdout:27: writing trial14245205-27 from 1855120 to 2436982 tid 2 2026-02-17T11:46:02.296 INFO:tasks.rados.rados.0.trial142.stdout:28: write initial oid 28 2026-02-17T11:46:02.296 INFO:tasks.rados.rados.0.trial142.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-17T11:46:02.300 INFO:tasks.rados.rados.0.trial142.stdout:28: writing trial14245205-28 from 453789 to 1234571 tid 1 2026-02-17T11:46:02.305 INFO:tasks.rados.rados.0.trial142.stdout:28: writing trial14245205-28 from 1913602 to 2388604 tid 2 2026-02-17T11:46:02.305 INFO:tasks.rados.rados.0.trial142.stdout:29: write initial oid 29 2026-02-17T11:46:02.305 INFO:tasks.rados.rados.0.trial142.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-17T11:46:02.308 INFO:tasks.rados.rados.0.trial142.stdout:29: writing trial14245205-29 from 470596 to 926627 tid 1 2026-02-17T11:46:02.313 INFO:tasks.rados.rados.0.trial142.stdout:29: writing trial14245205-29 from 1572084 to 2190744 tid 2 2026-02-17T11:46:02.313 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: finishing write tid 2 to trial14245205-14 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: finishing write tid 3 to trial14245205-14 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: finishing write tid 4 to trial14245205-14 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: oid 14 updating version 0 to 13 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: oid 14 updating version 13 to 15 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: oid 14 version 15 is already newer than 14 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 15 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:15: finishing write tid 1 to trial14245205-15 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:15: finishing write tid 2 to trial14245205-15 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:15: finishing write tid 3 to trial14245205-15 2026-02-17T11:46:02.314 INFO:tasks.rados.rados.0.trial142.stdout:15: finishing write tid 4 to trial14245205-15 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:15: oid 15 updating version 0 to 8 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:15: oid 15 updating version 8 to 9 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:15: oid 15 version 9 is already newer than 7 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 9 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:16: finishing write tid 1 to trial14245205-16 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:14: done (15 left) 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:15: done (14 left) 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:30: write initial oid 30 2026-02-17T11:46:02.315 INFO:tasks.rados.rados.0.trial142.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-17T11:46:02.316 INFO:tasks.rados.rados.0.trial142.stdout:30: writing trial14245205-30 from 487403 to 1018683 tid 1 2026-02-17T11:46:02.320 INFO:tasks.rados.rados.0.trial142.stdout:30: writing trial14245205-30 from 1514213 to 1992884 tid 2 2026-02-17T11:46:02.320 INFO:tasks.rados.rados.0.trial142.stdout:31: write initial oid 31 2026-02-17T11:46:02.320 INFO:tasks.rados.rados.0.trial142.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-17T11:46:02.324 INFO:tasks.rados.rados.0.trial142.stdout:31: writing trial14245205-31 from 504210 to 1110739 tid 1 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:31: writing trial14245205-31 from 1572695 to 2195024 tid 2 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: finishing write tid 2 to trial14245205-16 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: finishing write tid 3 to trial14245205-16 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: finishing write tid 4 to trial14245205-16 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: oid 16 updating version 0 to 6 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: oid 16 version 6 is already newer than 4 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: oid 16 version 6 is already newer than 5 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 6 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-17T11:46:02.329 INFO:tasks.rados.rados.0.trial142.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-17T11:46:02.330 INFO:tasks.rados.rados.0.trial142.stdout:17: finishing write tid 1 to trial14245205-17 2026-02-17T11:46:02.330 INFO:tasks.rados.rados.0.trial142.stdout:17: finishing write tid 2 to trial14245205-17 2026-02-17T11:46:02.330 INFO:tasks.rados.rados.0.trial142.stdout:16: done (15 left) 2026-02-17T11:46:02.330 INFO:tasks.rados.rados.0.trial142.stdout:32: write initial oid 32 2026-02-17T11:46:02.330 INFO:tasks.rados.rados.0.trial142.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-17T11:46:02.333 INFO:tasks.rados.rados.0.trial142.stdout:32: writing trial14245205-32 from 521017 to 1319148 tid 1 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:32: writing trial14245205-32 from 1747530 to 2229870 tid 2 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: finishing write tid 3 to trial14245205-17 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: finishing write tid 4 to trial14245205-17 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: oid 17 updating version 0 to 7 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: oid 17 updating version 7 to 8 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: oid 17 updating version 8 to 9 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 9 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:46:02.338 INFO:tasks.rados.rados.0.trial142.stdout:18: finishing write tid 1 to trial14245205-18 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: finishing write tid 2 to trial14245205-18 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: finishing write tid 3 to trial14245205-18 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: finishing write tid 4 to trial14245205-18 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: oid 18 updating version 0 to 18 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: oid 18 version 18 is already newer than 17 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: oid 18 version 18 is already newer than 16 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 18 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:19: finishing write tid 1 to trial14245205-19 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:19: finishing write tid 2 to trial14245205-19 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:19: finishing write tid 3 to trial14245205-19 2026-02-17T11:46:02.339 INFO:tasks.rados.rados.0.trial142.stdout:19: finishing write tid 4 to trial14245205-19 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:19: oid 19 updating version 0 to 5 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:19: oid 19 version 5 is already newer than 4 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:19: oid 19 updating version 5 to 6 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:20: finishing write tid 1 to trial14245205-20 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:20: finishing write tid 2 to trial14245205-20 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:17: done (15 left) 2026-02-17T11:46:02.340 INFO:tasks.rados.rados.0.trial142.stdout:18: done (14 left) 2026-02-17T11:46:02.341 INFO:tasks.rados.rados.0.trial142.stdout:19: done (13 left) 2026-02-17T11:46:02.341 INFO:tasks.rados.rados.0.trial142.stdout:33: write initial oid 33 2026-02-17T11:46:02.341 INFO:tasks.rados.rados.0.trial142.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-17T11:46:02.341 INFO:tasks.rados.rados.0.trial142.stdout:33: writing trial14245205-33 from 537824 to 1011204 tid 1 2026-02-17T11:46:02.346 INFO:tasks.rados.rados.0.trial142.stdout:33: writing trial14245205-33 from 1806012 to 2432010 tid 2 2026-02-17T11:46:02.346 INFO:tasks.rados.rados.0.trial142.stdout:34: write initial oid 34 2026-02-17T11:46:02.346 INFO:tasks.rados.rados.0.trial142.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-17T11:46:02.350 INFO:tasks.rados.rados.0.trial142.stdout:34: writing trial14245205-34 from 554631 to 1103260 tid 1 2026-02-17T11:46:02.354 INFO:tasks.rados.rados.0.trial142.stdout:34: writing trial14245205-34 from 1748141 to 2234150 tid 2 2026-02-17T11:46:02.354 INFO:tasks.rados.rados.0.trial142.stdout:35: write initial oid 35 2026-02-17T11:46:02.355 INFO:tasks.rados.rados.0.trial142.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-17T11:46:02.359 INFO:tasks.rados.rados.0.trial142.stdout:35: writing trial14245205-35 from 571438 to 1195316 tid 1 2026-02-17T11:46:02.364 INFO:tasks.rados.rados.0.trial142.stdout:35: writing trial14245205-35 from 1806623 to 2436290 tid 2 2026-02-17T11:46:02.364 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.364 INFO:tasks.rados.rados.0.trial142.stdout:20: finishing write tid 3 to trial14245205-20 2026-02-17T11:46:02.364 INFO:tasks.rados.rados.0.trial142.stdout:20: finishing write tid 4 to trial14245205-20 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:20: oid 20 updating version 0 to 3 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:20: oid 20 version 3 is already newer than 1 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:20: oid 20 version 3 is already newer than 2 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 3 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: finishing write tid 1 to trial14245205-21 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: finishing write tid 2 to trial14245205-21 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: finishing write tid 3 to trial14245205-21 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: finishing write tid 4 to trial14245205-21 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: oid 21 updating version 0 to 1 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: oid 21 updating version 1 to 2 2026-02-17T11:46:02.365 INFO:tasks.rados.rados.0.trial142.stdout:21: oid 21 updating version 2 to 3 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 3 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:22: finishing write tid 1 to trial14245205-22 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:22: finishing write tid 2 to trial14245205-22 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:22: finishing write tid 3 to trial14245205-22 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:20: done (15 left) 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:21: done (14 left) 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:36: write initial oid 36 2026-02-17T11:46:02.366 INFO:tasks.rados.rados.0.trial142.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-17T11:46:02.368 INFO:tasks.rados.rados.0.trial142.stdout:36: writing trial14245205-36 from 588245 to 1287372 tid 1 2026-02-17T11:46:02.372 INFO:tasks.rados.rados.0.trial142.stdout:36: writing trial14245205-36 from 1865105 to 2354783 tid 2 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:37: write initial oid 37 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:22: finishing write tid 4 to trial14245205-22 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:22: oid 22 updating version 0 to 6 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:22: oid 22 version 6 is already newer than 5 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:22: oid 22 version 6 is already newer than 4 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:23: finishing write tid 1 to trial14245205-23 2026-02-17T11:46:02.373 INFO:tasks.rados.rados.0.trial142.stdout:23: finishing write tid 2 to trial14245205-23 2026-02-17T11:46:02.374 INFO:tasks.rados.rados.0.trial142.stdout:23: finishing write tid 3 to trial14245205-23 2026-02-17T11:46:02.374 INFO:tasks.rados.rados.0.trial142.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-17T11:46:02.377 INFO:tasks.rados.rados.0.trial142.stdout:37: writing trial14245205-37 from 605052 to 1379428 tid 1 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:37: writing trial14245205-37 from 1923587 to 2556923 tid 2 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:22: done (15 left) 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:38: write initial oid 38 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:23: finishing write tid 4 to trial14245205-23 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:23: oid 23 updating version 0 to 7 2026-02-17T11:46:02.382 INFO:tasks.rados.rados.0.trial142.stdout:23: oid 23 updating version 7 to 8 2026-02-17T11:46:02.383 INFO:tasks.rados.rados.0.trial142.stdout:23: oid 23 updating version 8 to 9 2026-02-17T11:46:02.383 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 9 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-17T11:46:02.383 INFO:tasks.rados.rados.0.trial142.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-17T11:46:02.383 INFO:tasks.rados.rados.0.trial142.stdout:24: finishing write tid 1 to trial14245205-24 2026-02-17T11:46:02.383 INFO:tasks.rados.rados.0.trial142.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-17T11:46:02.385 INFO:tasks.rados.rados.0.trial142.stdout:38: writing trial14245205-38 from 621859 to 1071484 tid 1 2026-02-17T11:46:02.391 INFO:tasks.rados.rados.0.trial142.stdout:38: writing trial14245205-38 from 1865716 to 2621859 tid 2 2026-02-17T11:46:02.392 INFO:tasks.rados.rados.0.trial142.stdout:23: done (15 left) 2026-02-17T11:46:02.392 INFO:tasks.rados.rados.0.trial142.stdout:39: write initial oid 39 2026-02-17T11:46:02.392 INFO:tasks.rados.rados.0.trial142.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-17T11:46:02.396 INFO:tasks.rados.rados.0.trial142.stdout:39: writing trial14245205-39 from 638666 to 1163540 tid 1 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:39: writing trial14245205-39 from 1924198 to 2561203 tid 2 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: finishing write tid 2 to trial14245205-24 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: finishing write tid 3 to trial14245205-24 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: finishing write tid 4 to trial14245205-24 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: oid 24 updating version 0 to 2 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: oid 24 version 2 is already newer than 1 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:24: oid 24 updating version 2 to 3 2026-02-17T11:46:02.402 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 3 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: finishing write tid 1 to trial14245205-25 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: finishing write tid 2 to trial14245205-25 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: finishing write tid 3 to trial14245205-25 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: finishing write tid 4 to trial14245205-25 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: oid 25 updating version 0 to 2 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: oid 25 version 2 is already newer than 1 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: oid 25 updating version 2 to 3 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 3 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-17T11:46:02.403 INFO:tasks.rados.rados.0.trial142.stdout:26: finishing write tid 1 to trial14245205-26 2026-02-17T11:46:02.404 INFO:tasks.rados.rados.0.trial142.stdout:24: done (15 left) 2026-02-17T11:46:02.404 INFO:tasks.rados.rados.0.trial142.stdout:25: done (14 left) 2026-02-17T11:46:02.404 INFO:tasks.rados.rados.0.trial142.stdout:40: write initial oid 40 2026-02-17T11:46:02.404 INFO:tasks.rados.rados.0.trial142.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-17T11:46:02.406 INFO:tasks.rados.rados.0.trial142.stdout:40: writing trial14245205-40 from 655473 to 1371949 tid 1 2026-02-17T11:46:02.411 INFO:tasks.rados.rados.0.trial142.stdout:40: writing trial14245205-40 from 2099033 to 2655473 tid 2 2026-02-17T11:46:02.411 INFO:tasks.rados.rados.0.trial142.stdout:41: write initial oid 41 2026-02-17T11:46:02.411 INFO:tasks.rados.rados.0.trial142.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-17T11:46:02.416 INFO:tasks.rados.rados.0.trial142.stdout:41: writing trial14245205-41 from 672280 to 1464005 tid 1 2026-02-17T11:46:02.421 INFO:tasks.rados.rados.0.trial142.stdout:41: writing trial14245205-41 from 2157515 to 2672280 tid 2 2026-02-17T11:46:02.421 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.421 INFO:tasks.rados.rados.0.trial142.stdout:26: finishing write tid 2 to trial14245205-26 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: finishing write tid 3 to trial14245205-26 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: finishing write tid 4 to trial14245205-26 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: oid 26 updating version 0 to 6 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: oid 26 version 6 is already newer than 4 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: oid 26 version 6 is already newer than 5 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 6 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:27: finishing write tid 1 to trial14245205-27 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:26: done (15 left) 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:42: write initial oid 42 2026-02-17T11:46:02.422 INFO:tasks.rados.rados.0.trial142.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-17T11:46:02.425 INFO:tasks.rados.rados.0.trial142.stdout:42: writing trial14245205-42 from 689087 to 1156061 tid 1 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:42: writing trial14245205-42 from 1699644 to 2483976 tid 2 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: finishing write tid 2 to trial14245205-27 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: finishing write tid 3 to trial14245205-27 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: finishing write tid 4 to trial14245205-27 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: oid 27 updating version 0 to 10 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: oid 27 updating version 10 to 12 2026-02-17T11:46:02.431 INFO:tasks.rados.rados.0.trial142.stdout:27: oid 27 version 12 is already newer than 11 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 12 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: finishing write tid 1 to trial14245205-28 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: finishing write tid 2 to trial14245205-28 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: finishing write tid 3 to trial14245205-28 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: finishing write tid 4 to trial14245205-28 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: oid 28 updating version 0 to 6 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: oid 28 version 6 is already newer than 4 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: oid 28 version 6 is already newer than 5 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-17T11:46:02.432 INFO:tasks.rados.rados.0.trial142.stdout:29: finishing write tid 1 to trial14245205-29 2026-02-17T11:46:02.433 INFO:tasks.rados.rados.0.trial142.stdout:27: done (15 left) 2026-02-17T11:46:02.433 INFO:tasks.rados.rados.0.trial142.stdout:28: done (14 left) 2026-02-17T11:46:02.433 INFO:tasks.rados.rados.0.trial142.stdout:43: write initial oid 43 2026-02-17T11:46:02.433 INFO:tasks.rados.rados.0.trial142.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-17T11:46:02.435 INFO:tasks.rados.rados.0.trial142.stdout:43: writing trial14245205-43 from 705894 to 1248117 tid 1 2026-02-17T11:46:02.439 INFO:tasks.rados.rados.0.trial142.stdout:43: writing trial14245205-43 from 1758126 to 2402469 tid 2 2026-02-17T11:46:02.439 INFO:tasks.rados.rados.0.trial142.stdout:44: write initial oid 44 2026-02-17T11:46:02.439 INFO:tasks.rados.rados.0.trial142.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-17T11:46:02.444 INFO:tasks.rados.rados.0.trial142.stdout:44: writing trial14245205-44 from 722701 to 1340173 tid 1 2026-02-17T11:46:02.449 INFO:tasks.rados.rados.0.trial142.stdout:44: writing trial14245205-44 from 1816608 to 2604609 tid 2 2026-02-17T11:46:02.449 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.449 INFO:tasks.rados.rados.0.trial142.stdout:29: finishing write tid 2 to trial14245205-29 2026-02-17T11:46:02.449 INFO:tasks.rados.rados.0.trial142.stdout:29: finishing write tid 3 to trial14245205-29 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: finishing write tid 4 to trial14245205-29 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: oid 29 updating version 0 to 3 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: oid 29 version 3 is already newer than 2 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: oid 29 version 3 is already newer than 1 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 3 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:30: finishing write tid 1 to trial14245205-30 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:29: done (15 left) 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:45: write initial oid 45 2026-02-17T11:46:02.450 INFO:tasks.rados.rados.0.trial142.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-17T11:46:02.454 INFO:tasks.rados.rados.0.trial142.stdout:45: writing trial14245205-45 from 739508 to 1432229 tid 1 2026-02-17T11:46:02.459 INFO:tasks.rados.rados.0.trial142.stdout:45: writing trial14245205-45 from 1875090 to 2523102 tid 2 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: finishing write tid 2 to trial14245205-30 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: finishing write tid 3 to trial14245205-30 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: finishing write tid 4 to trial14245205-30 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: oid 30 updating version 0 to 4 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: oid 30 updating version 4 to 5 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: oid 30 updating version 5 to 6 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-17T11:46:02.460 INFO:tasks.rados.rados.0.trial142.stdout:31: finishing write tid 1 to trial14245205-31 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: finishing write tid 2 to trial14245205-31 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: finishing write tid 3 to trial14245205-31 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: finishing write tid 4 to trial14245205-31 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: oid 31 updating version 0 to 15 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: oid 31 version 15 is already newer than 13 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: oid 31 version 15 is already newer than 14 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 15 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:32: finishing write tid 1 to trial14245205-32 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:32: finishing write tid 2 to trial14245205-32 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:32: finishing write tid 3 to trial14245205-32 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:32: finishing write tid 4 to trial14245205-32 2026-02-17T11:46:02.461 INFO:tasks.rados.rados.0.trial142.stdout:32: oid 32 updating version 0 to 5 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:32: oid 32 updating version 5 to 6 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:32: oid 32 version 6 is already newer than 4 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: finishing write tid 1 to trial14245205-33 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: finishing write tid 2 to trial14245205-33 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: finishing write tid 3 to trial14245205-33 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: finishing write tid 4 to trial14245205-33 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: oid 33 updating version 0 to 17 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: oid 33 version 17 is already newer than 16 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:33: oid 33 updating version 17 to 18 2026-02-17T11:46:02.462 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 18 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:34: finishing write tid 1 to trial14245205-34 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:30: done (15 left) 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:31: done (14 left) 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:32: done (13 left) 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:33: done (12 left) 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:46: write initial oid 46 2026-02-17T11:46:02.463 INFO:tasks.rados.rados.0.trial142.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-17T11:46:02.464 INFO:tasks.rados.rados.0.trial142.stdout:46: writing trial14245205-46 from 756315 to 1524285 tid 1 2026-02-17T11:46:02.468 INFO:tasks.rados.rados.0.trial142.stdout:46: writing trial14245205-46 from 1933572 to 2725242 tid 2 2026-02-17T11:46:02.469 INFO:tasks.rados.rados.0.trial142.stdout:47: write initial oid 47 2026-02-17T11:46:02.469 INFO:tasks.rados.rados.0.trial142.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-17T11:46:02.473 INFO:tasks.rados.rados.0.trial142.stdout:47: writing trial14245205-47 from 773122 to 1332694 tid 1 2026-02-17T11:46:02.478 INFO:tasks.rados.rados.0.trial142.stdout:47: writing trial14245205-47 from 1992054 to 2643735 tid 2 2026-02-17T11:46:02.478 INFO:tasks.rados.rados.0.trial142.stdout:48: write initial oid 48 2026-02-17T11:46:02.478 INFO:tasks.rados.rados.0.trial142.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-17T11:46:02.483 INFO:tasks.rados.rados.0.trial142.stdout:48: writing trial14245205-48 from 789929 to 1424750 tid 1 2026-02-17T11:46:02.489 INFO:tasks.rados.rados.0.trial142.stdout:48: writing trial14245205-48 from 2050536 to 2789929 tid 2 2026-02-17T11:46:02.489 INFO:tasks.rados.rados.0.trial142.stdout:49: write initial oid 49 2026-02-17T11:46:02.489 INFO:tasks.rados.rados.0.trial142.stdout:34: finishing write tid 2 to trial14245205-34 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: finishing write tid 3 to trial14245205-34 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: finishing write tid 4 to trial14245205-34 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: oid 34 updating version 0 to 4 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: oid 34 updating version 4 to 5 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: oid 34 updating version 5 to 6 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:35: finishing write tid 1 to trial14245205-35 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:35: finishing write tid 2 to trial14245205-35 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:35: finishing write tid 3 to trial14245205-35 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:35: finishing write tid 4 to trial14245205-35 2026-02-17T11:46:02.490 INFO:tasks.rados.rados.0.trial142.stdout:35: oid 35 updating version 0 to 19 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:35: oid 35 updating version 19 to 20 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:35: oid 35 updating version 20 to 21 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 21 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: finishing write tid 1 to trial14245205-36 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: finishing write tid 2 to trial14245205-36 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: finishing write tid 3 to trial14245205-36 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: finishing write tid 4 to trial14245205-36 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: oid 36 updating version 0 to 9 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: oid 36 version 9 is already newer than 7 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: oid 36 version 9 is already newer than 8 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 9 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-17T11:46:02.491 INFO:tasks.rados.rados.0.trial142.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-17T11:46:02.492 INFO:tasks.rados.rados.0.trial142.stdout:37: finishing write tid 1 to trial14245205-37 2026-02-17T11:46:02.492 INFO:tasks.rados.rados.0.trial142.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-17T11:46:02.493 INFO:tasks.rados.rados.0.trial142.stdout:49: writing trial14245205-49 from 406736 to 1116806 tid 1 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:49: writing trial14245205-49 from 1709018 to 2364368 tid 2 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:34: done (15 left) 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:35: done (14 left) 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:36: done (13 left) 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:50: write initial oid 50 2026-02-17T11:46:02.498 INFO:tasks.rados.rados.0.trial142.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-17T11:46:02.502 INFO:tasks.rados.rados.0.trial142.stdout:50: writing trial14245205-50 from 423543 to 1208862 tid 1 2026-02-17T11:46:02.510 INFO:tasks.rados.rados.0.trial142.stdout:50: writing trial14245205-50 from 1767500 to 2566508 tid 2 2026-02-17T11:46:02.510 INFO:tasks.rados.rados.0.trial142.stdout:51: copy_from oid 4 from oid 6 current snap is 0 2026-02-17T11:46:02.510 INFO:tasks.rados.rados.0.trial142.stdout:37: finishing write tid 2 to trial14245205-37 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: finishing write tid 3 to trial14245205-37 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: finishing write tid 4 to trial14245205-37 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: oid 37 updating version 0 to 8 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: oid 37 updating version 8 to 9 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: oid 37 version 9 is already newer than 7 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 9 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:38: finishing write tid 1 to trial14245205-38 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:38: finishing write tid 2 to trial14245205-38 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:38: finishing write tid 3 to trial14245205-38 2026-02-17T11:46:02.511 INFO:tasks.rados.rados.0.trial142.stdout:37: done (14 left) 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:52: copy_from oid 31 from oid 19 current snap is 0 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:38: finishing write tid 4 to trial14245205-38 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:38: oid 38 updating version 0 to 3 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:38: oid 38 version 3 is already newer than 2 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:38: oid 38 version 3 is already newer than 1 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:39: finishing write tid 1 to trial14245205-39 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:39: finishing write tid 2 to trial14245205-39 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:39: finishing write tid 3 to trial14245205-39 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:39: finishing write tid 4 to trial14245205-39 2026-02-17T11:46:02.512 INFO:tasks.rados.rados.0.trial142.stdout:39: oid 39 updating version 0 to 6 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:39: oid 39 version 6 is already newer than 5 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:39: oid 39 version 6 is already newer than 4 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:40: finishing write tid 1 to trial14245205-40 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:38: done (14 left) 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:39: done (13 left) 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:53: delete oid 36 current snap is 0 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:40: finishing write tid 2 to trial14245205-40 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:40: finishing write tid 3 to trial14245205-40 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:40: finishing write tid 4 to trial14245205-40 2026-02-17T11:46:02.513 INFO:tasks.rados.rados.0.trial142.stdout:40: oid 40 updating version 0 to 5 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:40: oid 40 version 5 is already newer than 4 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:40: oid 40 updating version 5 to 6 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: finishing write tid 1 to trial14245205-41 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: finishing write tid 2 to trial14245205-41 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: finishing write tid 3 to trial14245205-41 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: finishing write tid 4 to trial14245205-41 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: oid 41 updating version 0 to 4 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: oid 41 updating version 4 to 6 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:41: oid 41 version 6 is already newer than 5 2026-02-17T11:46:02.514 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: finishing write tid 1 to trial14245205-42 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: finishing write tid 2 to trial14245205-42 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: finishing write tid 3 to trial14245205-42 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: finishing write tid 4 to trial14245205-42 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: oid 42 updating version 0 to 10 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: oid 42 updating version 10 to 11 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: oid 42 updating version 11 to 12 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:43: finishing write tid 1 to trial14245205-43 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:43: finishing write tid 2 to trial14245205-43 2026-02-17T11:46:02.515 INFO:tasks.rados.rados.0.trial142.stdout:43: finishing write tid 3 to trial14245205-43 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:43: finishing write tid 4 to trial14245205-43 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:43: oid 43 updating version 0 to 21 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:43: oid 43 version 21 is already newer than 20 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:43: oid 43 version 21 is already newer than 19 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 21 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:44: finishing write tid 1 to trial14245205-44 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:44: finishing write tid 2 to trial14245205-44 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:44: finishing write tid 3 to trial14245205-44 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:44: finishing write tid 4 to trial14245205-44 2026-02-17T11:46:02.516 INFO:tasks.rados.rados.0.trial142.stdout:44: oid 44 updating version 0 to 9 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:44: oid 44 version 9 is already newer than 7 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:44: oid 44 version 9 is already newer than 8 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 9 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: finishing write tid 1 to trial14245205-45 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: finishing write tid 2 to trial14245205-45 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: finishing write tid 3 to trial14245205-45 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: finishing write tid 4 to trial14245205-45 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: oid 45 updating version 0 to 8 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: oid 45 version 8 is already newer than 7 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: oid 45 updating version 8 to 9 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 9 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T11:46:02.517 INFO:tasks.rados.rados.0.trial142.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: finishing write tid 1 to trial14245205-46 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: finishing write tid 2 to trial14245205-46 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: finishing write tid 3 to trial14245205-46 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: finishing write tid 4 to trial14245205-46 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: oid 46 updating version 0 to 23 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: oid 46 updating version 23 to 24 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: oid 46 version 24 is already newer than 22 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 24 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:47: finishing write tid 1 to trial14245205-47 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:47: finishing write tid 2 to trial14245205-47 2026-02-17T11:46:02.518 INFO:tasks.rados.rados.0.trial142.stdout:47: finishing write tid 3 to trial14245205-47 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:47: finishing write tid 4 to trial14245205-47 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:47: oid 47 updating version 0 to 11 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:47: oid 47 updating version 11 to 12 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:47: oid 47 version 12 is already newer than 10 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: finishing write tid 1 to trial14245205-48 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: finishing write tid 2 to trial14245205-48 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: finishing write tid 3 to trial14245205-48 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: finishing write tid 4 to trial14245205-48 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: oid 48 updating version 0 to 8 2026-02-17T11:46:02.519 INFO:tasks.rados.rados.0.trial142.stdout:48: oid 48 version 8 is already newer than 7 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:48: oid 48 updating version 8 to 9 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 9 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: finishing write tid 1 to trial14245205-49 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: finishing write tid 2 to trial14245205-49 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: finishing write tid 3 to trial14245205-49 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: finishing write tid 4 to trial14245205-49 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: oid 49 updating version 0 to 27 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: oid 49 version 27 is already newer than 26 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: oid 49 version 27 is already newer than 25 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 27 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-17T11:46:02.520 INFO:tasks.rados.rados.0.trial142.stdout:50: finishing write tid 1 to trial14245205-50 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:40: done (13 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:41: done (12 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:42: done (11 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:43: done (10 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:44: done (9 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:45: done (8 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:46: done (7 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:47: done (6 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:48: done (5 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:49: done (4 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:53: done (3 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:54: delete oid 10 current snap is 0 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:54: done (3 left) 2026-02-17T11:46:02.521 INFO:tasks.rados.rados.0.trial142.stdout:55: write (excl) oid 5 current snap is 0 2026-02-17T11:46:02.522 INFO:tasks.rados.rados.0.trial142.stdout:55: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-17T11:46:02.523 INFO:tasks.rados.rados.0.trial142.stdout:55: writing trial14245205-5 from 473964 to 1085030 tid 1 2026-02-17T11:46:02.523 INFO:tasks.rados.rados.0.trial142.stdout:55: writing trial14245205-5 from 1826593 to 2372928 tid 2 2026-02-17T11:46:02.523 INFO:tasks.rados.rados.0.trial142.stdout:55: writing trial14245205-5 from 2778819 to 2873964 tid 3 2026-02-17T11:46:02.523 INFO:tasks.rados.rados.0.trial142.stdout:56: write oid 49 current snap is 0 2026-02-17T11:46:02.523 INFO:tasks.rados.rados.0.trial142.stdout:56: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-17T11:46:02.524 INFO:tasks.rados.rados.0.trial142.stdout:56: writing trial14245205-49 from 490771 to 1177086 tid 1 2026-02-17T11:46:02.530 INFO:tasks.rados.rados.0.trial142.stdout:56: writing trial14245205-49 from 1885075 to 2291421 tid 2 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:57: write oid 11 current snap is 0 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: finishing write tid 2 to trial14245205-50 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: finishing write tid 3 to trial14245205-50 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: finishing write tid 4 to trial14245205-50 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: oid 50 updating version 0 to 7 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: oid 50 updating version 7 to 9 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: oid 50 version 9 is already newer than 8 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-17T11:46:02.531 INFO:tasks.rados.rados.0.trial142.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:52: finishing copy_from racing read to trial14245205-31 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:51: finishing copy_from racing read to trial14245205-4 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:51: finishing copy_from to trial14245205-4 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:52: finishing copy_from to trial14245205-31 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: finishing write tid 1 to trial14245205-5 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: finishing write tid 2 to trial14245205-5 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: finishing write tid 3 to trial14245205-5 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: finishing write tid 4 to trial14245205-5 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: finishing write tid 5 to trial14245205-5 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: oid 5 updating version 0 to 11 2026-02-17T11:46:02.532 INFO:tasks.rados.rados.0.trial142.stdout:55: oid 5 updating version 11 to 13 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:55: oid 5 version 13 is already newer than 12 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:55: oid 5 version 13 is already newer than 10 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 13 (ObjNum 52 snap 0 seq_num 52) dirty exists 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:55: left oid 5 (ObjNum 52 snap 0 seq_num 52) 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:56: finishing write tid 1 to trial14245205-49 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:57: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-17T11:46:02.533 INFO:tasks.rados.rados.0.trial142.stdout:57: writing trial14245205-11 from 507578 to 985495 tid 1 2026-02-17T11:46:02.538 INFO:tasks.rados.rados.0.trial142.stdout:57: writing trial14245205-11 from 1543557 to 2093561 tid 2 2026-02-17T11:46:02.541 INFO:tasks.rados.rados.0.trial142.stdout:57: writing trial14245205-11 from 2833665 to 2907578 tid 3 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:50: done (5 left) 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:51: done (4 left) 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:52: done (3 left) 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:55: done (2 left) 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:58: rollback oid 26 current snap is 0 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:58: done (2 left) 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:59: snap_create 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:56: finishing write tid 2 to trial14245205-49 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:56: finishing write tid 3 to trial14245205-49 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:56: finishing write tid 4 to trial14245205-49 2026-02-17T11:46:02.542 INFO:tasks.rados.rados.0.trial142.stdout:56: oid 49 updating version 0 to 31 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:56: oid 49 version 31 is already newer than 29 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:56: oid 49 version 31 is already newer than 30 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 31 (ObjNum 53 snap 0 seq_num 53) dirty exists 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:56: left oid 49 (ObjNum 53 snap 0 seq_num 53) 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:57: finishing write tid 1 to trial14245205-11 2026-02-17T11:46:02.543 INFO:tasks.rados.rados.0.trial142.stdout:57: finishing write tid 2 to trial14245205-11 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: finishing write tid 3 to trial14245205-11 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: finishing write tid 4 to trial14245205-11 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: finishing write tid 5 to trial14245205-11 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: oid 11 updating version 0 to 5 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: oid 11 updating version 5 to 6 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: oid 11 updating version 6 to 7 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: oid 11 version 7 is already newer than 4 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 7 (ObjNum 54 snap 0 seq_num 54) dirty exists 2026-02-17T11:46:02.544 INFO:tasks.rados.rados.0.trial142.stdout:57: left oid 11 (ObjNum 54 snap 0 seq_num 54) 2026-02-17T11:46:03.209 INFO:tasks.rados.rados.0.trial142.stdout:56: done (2 left) 2026-02-17T11:46:03.210 INFO:tasks.rados.rados.0.trial142.stdout:57: done (1 left) 2026-02-17T11:46:03.210 INFO:tasks.rados.rados.0.trial142.stdout:59: done (0 left) 2026-02-17T11:46:03.210 INFO:tasks.rados.rados.0.trial142.stdout:60: copy_from oid 46 from oid 19 current snap is 1 2026-02-17T11:46:03.210 INFO:tasks.rados.rados.0.trial142.stdout:61: snap_remove snap 0 2026-02-17T11:46:04.702 INFO:tasks.rados.rados.0.trial142.stdout:61: done (1 left) 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:62: rollback oid 34 current snap is 1 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:62: done (1 left) 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:63: delete oid 21 current snap is 1 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:60: finishing copy_from racing read to trial14245205-46 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:60: finishing copy_from to trial14245205-46 2026-02-17T11:46:04.703 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-17T11:46:04.705 INFO:tasks.rados.rados.0.trial142.stdout:60: done (1 left) 2026-02-17T11:46:04.705 INFO:tasks.rados.rados.0.trial142.stdout:63: done (0 left) 2026-02-17T11:46:04.705 INFO:tasks.rados.rados.0.trial142.stdout:64: delete oid 2 current snap is 1 2026-02-17T11:46:04.706 INFO:tasks.rados.rados.0.trial142.stdout:64: done (0 left) 2026-02-17T11:46:04.706 INFO:tasks.rados.rados.0.trial142.stdout:65: write oid 26 current snap is 1 2026-02-17T11:46:04.706 INFO:tasks.rados.rados.0.trial142.stdout:65: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-17T11:46:04.711 INFO:tasks.rados.rados.0.trial142.stdout:65: writing trial14245205-26 from 557999 to 1261663 tid 1 2026-02-17T11:46:04.714 INFO:tasks.rados.rados.0.trial142.stdout:65: writing trial14245205-26 from 1719003 to 2132687 tid 2 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:65: writing trial14245205-26 from 2632287 to 2957999 tid 3 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:66: read oid 43 snap -1 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:66: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:67: snap_create 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:65: finishing write tid 1 to trial14245205-26 2026-02-17T11:46:04.718 INFO:tasks.rados.rados.0.trial142.stdout:65: finishing write tid 2 to trial14245205-26 2026-02-17T11:46:04.719 INFO:tasks.rados.rados.0.trial142.stdout:65: finishing write tid 3 to trial14245205-26 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: finishing write tid 4 to trial14245205-26 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: finishing write tid 5 to trial14245205-26 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: oid 26 updating version 0 to 10 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: oid 26 updating version 10 to 11 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: oid 26 updating version 11 to 12 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: oid 26 updating version 12 to 13 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 13 (ObjNum 57 snap 1 seq_num 57) dirty exists 2026-02-17T11:46:04.720 INFO:tasks.rados.rados.0.trial142.stdout:65: left oid 26 (ObjNum 57 snap 1 seq_num 57) 2026-02-17T11:46:04.721 INFO:tasks.rados.rados.0.trial142.stdout:66: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:46:05.215 INFO:tasks.rados.rados.0.trial142.stdout:65: done (2 left) 2026-02-17T11:46:05.215 INFO:tasks.rados.rados.0.trial142.stdout:66: done (1 left) 2026-02-17T11:46:05.215 INFO:tasks.rados.rados.0.trial142.stdout:67: done (0 left) 2026-02-17T11:46:05.215 INFO:tasks.rados.rados.0.trial142.stdout:68: snap_remove snap 1 2026-02-17T11:46:06.215 INFO:tasks.rados.rados.0.trial142.stdout:68: done (0 left) 2026-02-17T11:46:06.216 INFO:tasks.rados.rados.0.trial142.stdout:69: snap_create 2026-02-17T11:46:07.216 INFO:tasks.rados.rados.0.trial142.stdout:69: done (0 left) 2026-02-17T11:46:07.216 INFO:tasks.rados.rados.0.trial142.stdout:70: write (excl) oid 19 current snap is 3 2026-02-17T11:46:07.216 INFO:tasks.rados.rados.0.trial142.stdout:70: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-17T11:46:07.221 INFO:tasks.rados.rados.0.trial142.stdout:70: writing trial14245205-19 from 574806 to 1353719 tid 1 2026-02-17T11:46:07.226 INFO:tasks.rados.rados.0.trial142.stdout:70: writing trial14245205-19 from 2061132 to 2618474 tid 2 2026-02-17T11:46:07.226 INFO:tasks.rados.rados.0.trial142.stdout:71: copy_from oid 48 from oid 43 current snap is 3 2026-02-17T11:46:07.227 INFO:tasks.rados.rados.0.trial142.stdout:70: finishing write tid 1 to trial14245205-19 2026-02-17T11:46:07.227 INFO:tasks.rados.rados.0.trial142.stdout:72: read oid 31 snap -1 2026-02-17T11:46:07.227 INFO:tasks.rados.rados.0.trial142.stdout:72: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:07.227 INFO:tasks.rados.rados.0.trial142.stdout:73: snap_create 2026-02-17T11:46:07.228 INFO:tasks.rados.rados.0.trial142.stdout:70: finishing write tid 2 to trial14245205-19 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: finishing write tid 3 to trial14245205-19 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: finishing write tid 4 to trial14245205-19 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: oid 19 updating version 0 to 15 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: oid 19 updating version 15 to 16 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: oid 19 updating version 16 to 17 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 17 (ObjNum 58 snap 3 seq_num 58) dirty exists 2026-02-17T11:46:07.231 INFO:tasks.rados.rados.0.trial142.stdout:70: left oid 19 (ObjNum 58 snap 3 seq_num 58) 2026-02-17T11:46:07.232 INFO:tasks.rados.rados.0.trial142.stdout:72: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:07.284 INFO:tasks.rados.rados.0.trial142.stdout:71: finishing copy_from racing read to trial14245205-48 2026-02-17T11:46:07.285 INFO:tasks.rados.rados.0.trial142.stdout:71: finishing copy_from to trial14245205-48 2026-02-17T11:46:07.285 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 21 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-17T11:46:08.223 INFO:tasks.rados.rados.0.trial142.stdout:70: done (3 left) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:71: done (2 left) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:72: done (1 left) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:73: done (0 left) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:74: read oid 11 snap -1 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:74: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:75: read oid 29 snap -1 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:75: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:76: rollback oid 9 current snap is 4 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 3 2026-02-17T11:46:08.224 INFO:tasks.rados.rados.0.trial142.stdout:77: snap_create 2026-02-17T11:46:08.225 INFO:tasks.rados.rados.0.trial142.stdout:76: finishing rollback tid 0 to trial14245205-9 2026-02-17T11:46:08.225 INFO:tasks.rados.rados.0.trial142.stdout:76: finishing rollback tid 1 to trial14245205-9 2026-02-17T11:46:08.226 INFO:tasks.rados.rados.0.trial142.stdout:76: finishing rollback tid 2 to trial14245205-9 2026-02-17T11:46:08.226 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 39 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-17T11:46:08.226 INFO:tasks.rados.rados.0.trial142.stdout:75: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-17T11:46:08.285 INFO:tasks.rados.rados.0.trial142.stdout:74: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-17T11:46:09.225 INFO:tasks.rados.rados.0.trial142.stdout:74: done (3 left) 2026-02-17T11:46:09.226 INFO:tasks.rados.rados.0.trial142.stdout:75: done (2 left) 2026-02-17T11:46:09.226 INFO:tasks.rados.rados.0.trial142.stdout:76: done (1 left) 2026-02-17T11:46:09.226 INFO:tasks.rados.rados.0.trial142.stdout:77: done (0 left) 2026-02-17T11:46:09.226 INFO:tasks.rados.rados.0.trial142.stdout:78: write oid 19 current snap is 5 2026-02-17T11:46:09.226 INFO:tasks.rados.rados.0.trial142.stdout:78: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-17T11:46:09.229 INFO:tasks.rados.rados.0.trial142.stdout:78: writing trial14245205-19 from 591613 to 1045775 tid 1 2026-02-17T11:46:09.233 INFO:tasks.rados.rados.0.trial142.stdout:78: writing trial14245205-19 from 1719614 to 2136967 tid 2 2026-02-17T11:46:09.237 INFO:tasks.rados.rados.0.trial142.stdout:78: writing trial14245205-19 from 2570780 to 2991613 tid 3 2026-02-17T11:46:09.237 INFO:tasks.rados.rados.0.trial142.stdout:79: snap_remove snap 2 2026-02-17T11:46:09.237 INFO:tasks.rados.rados.0.trial142.stdout:78: finishing write tid 1 to trial14245205-19 2026-02-17T11:46:09.237 INFO:tasks.rados.rados.0.trial142.stdout:78: finishing write tid 2 to trial14245205-19 2026-02-17T11:46:10.230 INFO:tasks.rados.rados.0.trial142.stdout:79: done (1 left) 2026-02-17T11:46:10.230 INFO:tasks.rados.rados.0.trial142.stdout:80: write (excl) oid 21 current snap is 5 2026-02-17T11:46:10.230 INFO:tasks.rados.rados.0.trial142.stdout:80: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-17T11:46:10.234 INFO:tasks.rados.rados.0.trial142.stdout:80: writing trial14245205-21 from 608420 to 1137831 tid 1 2026-02-17T11:46:10.238 INFO:tasks.rados.rados.0.trial142.stdout:80: writing trial14245205-21 from 1778096 to 2339107 tid 2 2026-02-17T11:46:10.241 INFO:tasks.rados.rados.0.trial142.stdout:80: writing trial14245205-21 from 2881850 to 3008420 tid 3 2026-02-17T11:46:10.241 INFO:tasks.rados.rados.0.trial142.stdout:81: read oid 35 snap -1 2026-02-17T11:46:10.241 INFO:tasks.rados.rados.0.trial142.stdout:81: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:46:10.241 INFO:tasks.rados.rados.0.trial142.stdout:82: snap_create 2026-02-17T11:46:10.241 INFO:tasks.rados.rados.0.trial142.stdout:78: finishing write tid 3 to trial14245205-19 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: finishing write tid 4 to trial14245205-19 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: finishing write tid 5 to trial14245205-19 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: oid 19 updating version 0 to 19 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: oid 19 updating version 19 to 20 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: oid 19 updating version 20 to 21 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: oid 19 updating version 21 to 22 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 22 (ObjNum 59 snap 5 seq_num 59) dirty exists 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:78: left oid 19 (ObjNum 59 snap 5 seq_num 59) 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:80: finishing write tid 1 to trial14245205-21 2026-02-17T11:46:10.242 INFO:tasks.rados.rados.0.trial142.stdout:80: finishing write tid 2 to trial14245205-21 2026-02-17T11:46:10.243 INFO:tasks.rados.rados.0.trial142.stdout:80: finishing write tid 3 to trial14245205-21 2026-02-17T11:46:10.243 INFO:tasks.rados.rados.0.trial142.stdout:80: finishing write tid 4 to trial14245205-21 2026-02-17T11:46:10.243 INFO:tasks.rados.rados.0.trial142.stdout:80: finishing write tid 5 to trial14245205-21 2026-02-17T11:46:10.243 INFO:tasks.rados.rados.0.trial142.stdout:80: oid 21 updating version 0 to 14 2026-02-17T11:46:10.243 INFO:tasks.rados.rados.0.trial142.stdout:80: oid 21 version 14 is already newer than 11 2026-02-17T11:46:10.244 INFO:tasks.rados.rados.0.trial142.stdout:80: oid 21 version 14 is already newer than 12 2026-02-17T11:46:10.244 INFO:tasks.rados.rados.0.trial142.stdout:80: oid 21 version 14 is already newer than 13 2026-02-17T11:46:10.244 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 14 (ObjNum 60 snap 5 seq_num 60) dirty exists 2026-02-17T11:46:10.244 INFO:tasks.rados.rados.0.trial142.stdout:80: left oid 21 (ObjNum 60 snap 5 seq_num 60) 2026-02-17T11:46:10.246 INFO:tasks.rados.rados.0.trial142.stdout:81: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:46:11.231 INFO:tasks.rados.rados.0.trial142.stdout:78: done (3 left) 2026-02-17T11:46:11.231 INFO:tasks.rados.rados.0.trial142.stdout:80: done (2 left) 2026-02-17T11:46:11.231 INFO:tasks.rados.rados.0.trial142.stdout:81: done (1 left) 2026-02-17T11:46:11.231 INFO:tasks.rados.rados.0.trial142.stdout:82: done (0 left) 2026-02-17T11:46:11.231 INFO:tasks.rados.rados.0.trial142.stdout:83: snap_create 2026-02-17T11:46:11.730 INFO:tasks.rados.rados.0.trial142.stdout:83: done (0 left) 2026-02-17T11:46:11.730 INFO:tasks.rados.rados.0.trial142.stdout:84: snap_create 2026-02-17T11:46:12.731 INFO:tasks.rados.rados.0.trial142.stdout:84: done (0 left) 2026-02-17T11:46:12.731 INFO:tasks.rados.rados.0.trial142.stdout:85: delete oid 15 current snap is 8 2026-02-17T11:46:12.734 INFO:tasks.rados.rados.0.trial142.stdout:85: done (0 left) 2026-02-17T11:46:12.734 INFO:tasks.rados.rados.0.trial142.stdout:86: write (excl) oid 8 current snap is 8 2026-02-17T11:46:12.734 INFO:tasks.rados.rados.0.trial142.stdout:86: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-17T11:46:12.739 INFO:tasks.rados.rados.0.trial142.stdout:86: writing trial14245205-8 from 642034 to 1438296 tid 1 2026-02-17T11:46:12.743 INFO:tasks.rados.rados.0.trial142.stdout:86: writing trial14245205-8 from 1895060 to 2459740 tid 2 2026-02-17T11:46:12.743 INFO:tasks.rados.rados.0.trial142.stdout:87: write (excl) oid 26 current snap is 8 2026-02-17T11:46:12.743 INFO:tasks.rados.rados.0.trial142.stdout:86: finishing write tid 1 to trial14245205-8 2026-02-17T11:46:12.743 INFO:tasks.rados.rados.0.trial142.stdout:87: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-17T11:46:12.747 INFO:tasks.rados.rados.0.trial142.stdout:87: writing trial14245205-26 from 658841 to 1130352 tid 1 2026-02-17T11:46:12.751 INFO:tasks.rados.rados.0.trial142.stdout:87: writing trial14245205-26 from 1553542 to 2261880 tid 2 2026-02-17T11:46:12.754 INFO:tasks.rados.rados.0.trial142.stdout:87: writing trial14245205-26 from 2964119 to 3058841 tid 3 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:88: snap_create 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: finishing write tid 2 to trial14245205-8 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: finishing write tid 3 to trial14245205-8 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: finishing write tid 4 to trial14245205-8 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: oid 8 updating version 0 to 27 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: oid 8 updating version 27 to 28 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: oid 8 version 28 is already newer than 26 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 28 (ObjNum 62 snap 8 seq_num 62) dirty exists 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:86: left oid 8 (ObjNum 62 snap 8 seq_num 62) 2026-02-17T11:46:12.755 INFO:tasks.rados.rados.0.trial142.stdout:87: finishing write tid 1 to trial14245205-26 2026-02-17T11:46:12.756 INFO:tasks.rados.rados.0.trial142.stdout:87: finishing write tid 2 to trial14245205-26 2026-02-17T11:46:12.756 INFO:tasks.rados.rados.0.trial142.stdout:87: finishing write tid 3 to trial14245205-26 2026-02-17T11:46:12.756 INFO:tasks.rados.rados.0.trial142.stdout:87: finishing write tid 4 to trial14245205-26 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: finishing write tid 5 to trial14245205-26 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: oid 26 updating version 0 to 16 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: oid 26 updating version 16 to 18 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: oid 26 version 18 is already newer than 17 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: oid 26 version 18 is already newer than 15 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 18 (ObjNum 63 snap 8 seq_num 63) dirty exists 2026-02-17T11:46:12.757 INFO:tasks.rados.rados.0.trial142.stdout:87: left oid 26 (ObjNum 63 snap 8 seq_num 63) 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:86: done (2 left) 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:87: done (1 left) 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:88: done (0 left) 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:89: read oid 17 snap -1 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:89: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:46:13.733 INFO:tasks.rados.rados.0.trial142.stdout:90: delete oid 41 current snap is 9 2026-02-17T11:46:13.736 INFO:tasks.rados.rados.0.trial142.stdout:90: done (1 left) 2026-02-17T11:46:13.736 INFO:tasks.rados.rados.0.trial142.stdout:91: copy_from oid 6 from oid 44 current snap is 9 2026-02-17T11:46:13.736 INFO:tasks.rados.rados.0.trial142.stdout:92: snap_create 2026-02-17T11:46:13.739 INFO:tasks.rados.rados.0.trial142.stdout:89: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:46:13.793 INFO:tasks.rados.rados.0.trial142.stdout:91: finishing copy_from racing read to trial14245205-6 2026-02-17T11:46:13.793 INFO:tasks.rados.rados.0.trial142.stdout:91: finishing copy_from to trial14245205-6 2026-02-17T11:46:13.793 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 9 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:89: done (2 left) 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:91: done (1 left) 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:92: done (0 left) 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:93: copy_from oid 31 from oid 15 current snap is 10 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:94: copy_from oid 32 from oid 2 current snap is 10 2026-02-17T11:46:14.736 INFO:tasks.rados.rados.0.trial142.stdout:95: snap_create 2026-02-17T11:46:14.737 INFO:tasks.rados.rados.0.trial142.stdout:93: finishing copy_from to trial14245205-31 2026-02-17T11:46:14.737 INFO:tasks.rados.rados.0.trial142.stdout:93: got expected ENOENT (src dne) 2026-02-17T11:46:14.737 INFO:tasks.rados.rados.0.trial142.stdout:93: finishing copy_from racing read to trial14245205-31 2026-02-17T11:46:14.743 INFO:tasks.rados.rados.0.trial142.stdout:94: finishing copy_from to trial14245205-32 2026-02-17T11:46:14.743 INFO:tasks.rados.rados.0.trial142.stdout:94: got expected ENOENT (src dne) 2026-02-17T11:46:14.743 INFO:tasks.rados.rados.0.trial142.stdout:94: finishing copy_from racing read to trial14245205-32 2026-02-17T11:46:15.736 INFO:tasks.rados.rados.0.trial142.stdout:93: done (2 left) 2026-02-17T11:46:15.736 INFO:tasks.rados.rados.0.trial142.stdout:94: done (1 left) 2026-02-17T11:46:15.736 INFO:tasks.rados.rados.0.trial142.stdout:95: done (0 left) 2026-02-17T11:46:15.736 INFO:tasks.rados.rados.0.trial142.stdout:96: delete oid 16 current snap is 11 2026-02-17T11:46:15.739 INFO:tasks.rados.rados.0.trial142.stdout:96: done (0 left) 2026-02-17T11:46:15.739 INFO:tasks.rados.rados.0.trial142.stdout:97: rollback oid 45 current snap is 11 2026-02-17T11:46:15.739 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 5 2026-02-17T11:46:15.739 INFO:tasks.rados.rados.0.trial142.stdout:98: delete oid 30 current snap is 11 2026-02-17T11:46:15.740 INFO:tasks.rados.rados.0.trial142.stdout:98: done (1 left) 2026-02-17T11:46:15.740 INFO:tasks.rados.rados.0.trial142.stdout:99: rollback oid 16 current snap is 11 2026-02-17T11:46:15.740 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 6 2026-02-17T11:46:15.740 INFO:tasks.rados.rados.0.trial142.stdout:100: read oid 31 snap -1 2026-02-17T11:46:15.741 INFO:tasks.rados.rados.0.trial142.stdout:100: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:15.741 INFO:tasks.rados.rados.0.trial142.stdout:101: snap_create 2026-02-17T11:46:15.741 INFO:tasks.rados.rados.0.trial142.stdout:97: finishing rollback tid 0 to trial14245205-45 2026-02-17T11:46:15.741 INFO:tasks.rados.rados.0.trial142.stdout:97: finishing rollback tid 1 to trial14245205-45 2026-02-17T11:46:15.741 INFO:tasks.rados.rados.0.trial142.stdout:97: finishing rollback tid 2 to trial14245205-45 2026-02-17T11:46:15.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T11:46:15.742 INFO:tasks.rados.rados.0.trial142.stdout:99: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:46:15.742 INFO:tasks.rados.rados.0.trial142.stdout:99: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:46:15.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 17 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-17T11:46:15.745 INFO:tasks.rados.rados.0.trial142.stdout:100: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:16.740 INFO:tasks.rados.rados.0.trial142.stdout:97: done (3 left) 2026-02-17T11:46:16.741 INFO:tasks.rados.rados.0.trial142.stdout:99: done (2 left) 2026-02-17T11:46:16.741 INFO:tasks.rados.rados.0.trial142.stdout:100: done (1 left) 2026-02-17T11:46:16.741 INFO:tasks.rados.rados.0.trial142.stdout:101: done (0 left) 2026-02-17T11:46:16.741 INFO:tasks.rados.rados.0.trial142.stdout:102: write oid 6 current snap is 12 2026-02-17T11:46:16.741 INFO:tasks.rados.rados.0.trial142.stdout:102: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-17T11:46:16.746 INFO:tasks.rados.rados.0.trial142.stdout:102: writing trial14245205-6 from 726069 to 1498576 tid 1 2026-02-17T11:46:16.751 INFO:tasks.rados.rados.0.trial142.stdout:102: writing trial14245205-6 from 2071117 to 2786793 tid 2 2026-02-17T11:46:16.751 INFO:tasks.rados.rados.0.trial142.stdout:103: write oid 34 current snap is 12 2026-02-17T11:46:16.751 INFO:tasks.rados.rados.0.trial142.stdout:103: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2026-02-17T11:46:16.755 INFO:tasks.rados.rados.0.trial142.stdout:103: writing trial14245205-34 from 742876 to 1190632 tid 1 2026-02-17T11:46:16.761 INFO:tasks.rados.rados.0.trial142.stdout:103: writing trial14245205-34 from 1729599 to 2305286 tid 2 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:103: writing trial14245205-34 from 3101234 to 3142876 tid 3 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:104: read oid 19 snap -1 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:104: expect (ObjNum 59 snap 5 seq_num 59) 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:105: rollback oid 35 current snap is 12 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 3 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:102: finishing write tid 1 to trial14245205-6 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:103: finishing write tid 1 to trial14245205-34 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:102: finishing write tid 2 to trial14245205-6 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:102: finishing write tid 3 to trial14245205-6 2026-02-17T11:46:16.765 INFO:tasks.rados.rados.0.trial142.stdout:102: finishing write tid 4 to trial14245205-6 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:102: oid 6 updating version 0 to 12 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:102: oid 6 version 12 is already newer than 10 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:102: oid 6 version 12 is already newer than 11 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 12 (ObjNum 67 snap 12 seq_num 67) dirty exists 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:102: left oid 6 (ObjNum 67 snap 12 seq_num 67) 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:103: finishing write tid 2 to trial14245205-34 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:102: done (3 left) 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:106: write (excl) oid 36 current snap is 12 2026-02-17T11:46:16.766 INFO:tasks.rados.rados.0.trial142.stdout:106: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2026-02-17T11:46:16.769 INFO:tasks.rados.rados.0.trial142.stdout:106: writing trial14245205-36 from 759683 to 1399041 tid 1 2026-02-17T11:46:16.774 INFO:tasks.rados.rados.0.trial142.stdout:106: writing trial14245205-36 from 1904434 to 2623779 tid 2 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:106: writing trial14245205-36 from 3128657 to 3159683 tid 3 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:107: write (excl) oid 40 current snap is 12 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: finishing write tid 3 to trial14245205-34 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: finishing write tid 4 to trial14245205-34 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: finishing write tid 5 to trial14245205-34 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: oid 34 updating version 0 to 22 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: oid 34 version 22 is already newer than 20 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: oid 34 version 22 is already newer than 21 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: oid 34 updating version 22 to 23 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 23 (ObjNum 68 snap 12 seq_num 68) dirty exists 2026-02-17T11:46:16.777 INFO:tasks.rados.rados.0.trial142.stdout:103: left oid 34 (ObjNum 68 snap 12 seq_num 68) 2026-02-17T11:46:16.778 INFO:tasks.rados.rados.0.trial142.stdout:105: finishing rollback tid 0 to trial14245205-35 2026-02-17T11:46:16.778 INFO:tasks.rados.rados.0.trial142.stdout:105: finishing rollback tid 1 to trial14245205-35 2026-02-17T11:46:16.778 INFO:tasks.rados.rados.0.trial142.stdout:105: finishing rollback tid 2 to trial14245205-35 2026-02-17T11:46:16.778 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 32 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:46:16.778 INFO:tasks.rados.rados.0.trial142.stdout:104: expect (ObjNum 59 snap 5 seq_num 59) 2026-02-17T11:46:16.891 INFO:tasks.rados.rados.0.trial142.stdout:106: finishing write tid 1 to trial14245205-36 2026-02-17T11:46:16.891 INFO:tasks.rados.rados.0.trial142.stdout:106: finishing write tid 2 to trial14245205-36 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: finishing write tid 3 to trial14245205-36 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: finishing write tid 4 to trial14245205-36 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: finishing write tid 5 to trial14245205-36 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: oid 36 updating version 0 to 14 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: oid 36 updating version 14 to 15 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: oid 36 updating version 15 to 16 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: oid 36 updating version 16 to 17 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 17 (ObjNum 69 snap 12 seq_num 69) dirty exists 2026-02-17T11:46:16.892 INFO:tasks.rados.rados.0.trial142.stdout:106: left oid 36 (ObjNum 69 snap 12 seq_num 69) 2026-02-17T11:46:16.893 INFO:tasks.rados.rados.0.trial142.stdout:107: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-17T11:46:16.897 INFO:tasks.rados.rados.0.trial142.stdout:107: writing trial14245205-40 from 776490 to 1491097 tid 1 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:107: writing trial14245205-40 from 2246563 to 2825919 tid 2 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:103: done (4 left) 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:104: done (3 left) 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:105: done (2 left) 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:106: done (1 left) 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:108: write (excl) oid 16 current snap is 12 2026-02-17T11:46:16.902 INFO:tasks.rados.rados.0.trial142.stdout:108: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-17T11:46:16.908 INFO:tasks.rados.rados.0.trial142.stdout:108: writing trial14245205-16 from 793297 to 1583153 tid 1 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:108: writing trial14245205-16 from 2305045 to 3028059 tid 2 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:109: write oid 9 current snap is 12 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: finishing write tid 1 to trial14245205-40 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: finishing write tid 2 to trial14245205-40 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: finishing write tid 3 to trial14245205-40 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: finishing write tid 4 to trial14245205-40 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: oid 40 updating version 0 to 15 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: oid 40 updating version 15 to 16 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: oid 40 version 16 is already newer than 14 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 16 (ObjNum 70 snap 12 seq_num 70) dirty exists 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:107: left oid 40 (ObjNum 70 snap 12 seq_num 70) 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:108: finishing write tid 1 to trial14245205-16 2026-02-17T11:46:16.913 INFO:tasks.rados.rados.0.trial142.stdout:109: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2026-02-17T11:46:16.916 INFO:tasks.rados.rados.0.trial142.stdout:109: writing trial14245205-9 from 410104 to 875209 tid 1 2026-02-17T11:46:16.921 INFO:tasks.rados.rados.0.trial142.stdout:109: writing trial14245205-9 from 1563527 to 2146552 tid 2 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:109: writing trial14245205-9 from 2810926 to 3210104 tid 3 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:107: done (2 left) 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:110: snap_create 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: finishing write tid 2 to trial14245205-16 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: finishing write tid 3 to trial14245205-16 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: finishing write tid 4 to trial14245205-16 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: oid 16 updating version 0 to 21 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: oid 16 version 21 is already newer than 20 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: oid 16 version 21 is already newer than 19 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 21 (ObjNum 71 snap 12 seq_num 71) dirty exists 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:108: left oid 16 (ObjNum 71 snap 12 seq_num 71) 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:109: finishing write tid 1 to trial14245205-9 2026-02-17T11:46:16.925 INFO:tasks.rados.rados.0.trial142.stdout:109: finishing write tid 2 to trial14245205-9 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: finishing write tid 3 to trial14245205-9 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: finishing write tid 4 to trial14245205-9 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: finishing write tid 5 to trial14245205-9 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: oid 9 updating version 0 to 45 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: oid 9 version 45 is already newer than 44 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: oid 9 version 45 is already newer than 43 2026-02-17T11:46:16.926 INFO:tasks.rados.rados.0.trial142.stdout:109: oid 9 updating version 45 to 46 2026-02-17T11:46:16.927 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 46 (ObjNum 72 snap 12 seq_num 72) dirty exists 2026-02-17T11:46:16.927 INFO:tasks.rados.rados.0.trial142.stdout:109: left oid 9 (ObjNum 72 snap 12 seq_num 72) 2026-02-17T11:46:17.744 INFO:tasks.rados.rados.0.trial142.stdout:108: done (2 left) 2026-02-17T11:46:17.744 INFO:tasks.rados.rados.0.trial142.stdout:109: done (1 left) 2026-02-17T11:46:17.744 INFO:tasks.rados.rados.0.trial142.stdout:110: done (0 left) 2026-02-17T11:46:17.744 INFO:tasks.rados.rados.0.trial142.stdout:111: write (excl) oid 17 current snap is 13 2026-02-17T11:46:17.744 INFO:tasks.rados.rados.0.trial142.stdout:111: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-17T11:46:17.747 INFO:tasks.rados.rados.0.trial142.stdout:111: writing trial14245205-17 from 426911 to 967265 tid 1 2026-02-17T11:46:17.752 INFO:tasks.rados.rados.0.trial142.stdout:111: writing trial14245205-17 from 1622009 to 2348692 tid 2 2026-02-17T11:46:17.756 INFO:tasks.rados.rados.0.trial142.stdout:111: writing trial14245205-17 from 3121996 to 3226911 tid 3 2026-02-17T11:46:17.756 INFO:tasks.rados.rados.0.trial142.stdout:112: snap_create 2026-02-17T11:46:17.756 INFO:tasks.rados.rados.0.trial142.stdout:111: finishing write tid 1 to trial14245205-17 2026-02-17T11:46:17.756 INFO:tasks.rados.rados.0.trial142.stdout:111: finishing write tid 2 to trial14245205-17 2026-02-17T11:46:17.757 INFO:tasks.rados.rados.0.trial142.stdout:111: finishing write tid 3 to trial14245205-17 2026-02-17T11:46:17.757 INFO:tasks.rados.rados.0.trial142.stdout:111: finishing write tid 4 to trial14245205-17 2026-02-17T11:46:17.757 INFO:tasks.rados.rados.0.trial142.stdout:111: finishing write tid 5 to trial14245205-17 2026-02-17T11:46:17.757 INFO:tasks.rados.rados.0.trial142.stdout:111: oid 17 updating version 0 to 26 2026-02-17T11:46:17.758 INFO:tasks.rados.rados.0.trial142.stdout:111: oid 17 version 26 is already newer than 24 2026-02-17T11:46:17.758 INFO:tasks.rados.rados.0.trial142.stdout:111: oid 17 version 26 is already newer than 23 2026-02-17T11:46:17.758 INFO:tasks.rados.rados.0.trial142.stdout:111: oid 17 version 26 is already newer than 25 2026-02-17T11:46:17.758 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 26 (ObjNum 73 snap 13 seq_num 73) dirty exists 2026-02-17T11:46:17.758 INFO:tasks.rados.rados.0.trial142.stdout:111: left oid 17 (ObjNum 73 snap 13 seq_num 73) 2026-02-17T11:46:18.746 INFO:tasks.rados.rados.0.trial142.stdout:111: done (1 left) 2026-02-17T11:46:18.746 INFO:tasks.rados.rados.0.trial142.stdout:112: done (0 left) 2026-02-17T11:46:18.746 INFO:tasks.rados.rados.0.trial142.stdout:113: snap_create 2026-02-17T11:46:19.288 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:46:19.288 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T11:46:19.288 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:46:19.288 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:46:19.292 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:46:19.292 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:46:19.292 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 10 monclient: get_monmap_and_config 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 10 monclient: build_initial_monmap 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 10 monclient: monmap: 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:19.362 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:19.361158+0000 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:19.361158+0000 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:19.363 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 1 Processor -- start 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 1 -- start start 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.360+0000 7fd7b27e6640 10 monclient: init 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd7ac138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd7ac0a35a0 0x7fd7ac13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-c con 0x7fd7ac0a35a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7ac13d8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:19.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac0a1df0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac0a65b0 con 0x7fd7ac138600 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7ac0a6830 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b27e6640 10 monclient(hunting): authenticate will time out at 666.980211s 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b0d5c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd7ac13d8a0 0x7fd7ac13fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60124/0 (socket says 10.20.193.51:60124) 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7b0d5c640 1 -- 10.20.193.51:0/3403655616 learned_addr learned my addr 10.20.193.51:0/3403655616 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 1 --2- 10.20.193.51:0/3403655616 >> v2:10.20.193.142:3300/0 conn(0x7fd7ac0a35a0 0x7fd7ac13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): get_auth_request con 0x7fd7ac0a35a0 auth_method 0 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:19.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient(hunting): handle_auth_done global_id 4315 payload 274 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 1 -- 10.20.193.51:0/3403655616 >> v1:10.20.193.142:6789/0 conn(0x7fd7ac138600 legacy=0x7fd7ac1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 1 -- 10.20.193.51:0/3403655616 >> v1:10.20.193.51:6789/0 conn(0x7fd7ac13d8a0 legacy=0x7fd7ac13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 1 monclient: found mon.noname-c 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.361+0000 7fd7ab7fe640 1 -- 10.20.193.51:0/3403655616 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0a22d0 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7ab7fe640 1 -- 10.20.193.51:0/3403655616 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac0a35a0 msgr2=0x7fd7ac13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7ab7fe640 1 --2- 10.20.193.51:0/3403655616 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac13d360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0098a0 tx=0x7fd79c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=298696195fb71dc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 1 -- 10.20.193.51:0/3403655616 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c03c070 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: dump: 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.376 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: _finish_auth 0 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 5 monclient: authenticate success, global_id 4315 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 1 -- 10.20.193.51:0/3403655616 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c02fce0 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 1 -- 10.20.193.51:0/3403655616 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c037660 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 4 set_mon_vals no callback set 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7aaffd640 10 monclient: dump: 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:19.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 10 monclient: shutdown 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 -- 10.20.193.51:0/3403655616 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac0a35a0 msgr2=0x7fd7ac13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/3403655616 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac13d360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0098a0 tx=0x7fd79c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 -- 10.20.193.51:0/3403655616 shutdown_connections 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/3403655616 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac13d360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 -- 10.20.193.51:0/3403655616 >> 10.20.193.51:0/3403655616 conn(0x7fd7ac0a7460 msgr2=0x7fd7ac0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 -- 10.20.193.51:0/3403655616 shutdown_connections 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.364+0000 7fd7b27e6640 1 -- 10.20.193.51:0/3403655616 wait complete. 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient: build_initial_monmap 2026-02-17T11:46:19.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient: monmap: 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 Processor -- start 2026-02-17T11:46:19.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 -- start start 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient: init 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-a con 0x7fd7ac0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac138600 0x7fd7ac137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-b con 0x7fd7ac138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 0x7fd7ac137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): picked mon.noname-c con 0x7fd7ac13d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0a15f0 con 0x7fd7ac0a35a0 2026-02-17T11:46:19.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0a2c00 con 0x7fd7ac138600 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac0a1770 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b27e6640 10 monclient(hunting): authenticate will time out at 666.984807s 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 0x7fd7ac137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33910/0 (socket says 10.20.193.51:33910) 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 -- 10.20.193.51:0/218610243 learned_addr learned my addr 10.20.193.51:0/218610243 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 10 monclient(hunting): get_auth_request con 0x7fd7ac0a35a0 auth_method 0 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:19.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): get_auth_request con 0x7fd7ac13d8a0 auth_method 0 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 msgr2=0x7fd7ac1cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 msgr2=0x7fd7ac1cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7b0d5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.365+0000 7fd7abfff640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:19.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7ab7fe640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac138600 0x7fd7ac137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7ab7fe640 10 monclient(hunting): get_auth_request con 0x7fd7ac138600 auth_method 0 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 10 monclient(hunting): handle_auth_done global_id 4436 payload 824 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac138600 msgr2=0x7fd7ac137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac138600 0x7fd7ac137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 msgr2=0x7fd7ac1cf720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 10 monclient: _finish_hunting 0 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 monclient: found mon.noname-c 2026-02-17T11:46:19.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.366+0000 7fd7b0d5c640 1 -- 10.20.193.51:0/218610243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0a47c0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b0d5c640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 msgr2=0x7fd7ac137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b0d5c640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 0x7fd7ac137d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000caf0 tx=0x7fd7a0005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000adf0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: dump: 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.385 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:19.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 5 monclient: authenticate success, global_id 4436 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a0012400 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _renew_subs 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac0a4300 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00127f0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7aa7fc640 4 set_mon_vals no callback set 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7a8ff9640 10 monclient: dump: 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:19.387 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _renew_subs 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac121190 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.368+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac140670 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.369+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd7a00129d0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.369+0000 7fd7a8ff9640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 0x7fd77c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.369+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 4735+0+0 (secure 0 0 0) 0x7fd7a0052bd0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.369+0000 7fd7abfff640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 0x7fd77c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.369+0000 7fd7abfff640 10 monclient: get_auth_request con 0x7fd77c03dd10 auth_method 0 2026-02-17T11:46:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.371+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd7ac140670 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.371+0000 7fd7a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.371+0000 7fd7a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.372+0000 7fd7abfff640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 0x7fd77c0401d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd798007e10 tx=0x7fd798009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:19.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7b27e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7b27e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7b27e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd7ac138de0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7a8ff9640 1 -- 10.20.193.51:0/218610243 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fd7ac138de0 con 0x7fd7ac13d8a0 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.484+0000 7fd7a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:19.487 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 msgr2=0x7fd77c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 0x7fd77c0401d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd798007e10 tx=0x7fd798009040 comp rx=0 tx=0).stop 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 10 monclient: shutdown 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 msgr2=0x7fd7ac137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 0x7fd7ac137d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000caf0 tx=0x7fd7a0005c70 comp rx=0 tx=0).stop 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 shutdown_connections 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd77c03dd10 0x7fd77c0401d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7ac13d8a0 0x7fd7ac137d50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7ac138600 0x7fd7ac137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 --2- 10.20.193.51:0/218610243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7ac0a35a0 0x7fd7ac1cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:19.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 >> 10.20.193.51:0/218610243 conn(0x7fd7ac0a7460 msgr2=0x7fd7ac13ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:19.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 shutdown_connections 2026-02-17T11:46:19.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:19.485+0000 7fd7b27e6640 1 -- 10.20.193.51:0/218610243 wait complete. 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:113: done (0 left) 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:114: rollback oid 47 current snap is 15 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 6 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:115: read oid 29 snap -1 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:115: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-17T11:46:19.748 INFO:tasks.rados.rados.0.trial142.stdout:116: snap_remove snap 4 2026-02-17T11:46:20.748 INFO:tasks.rados.rados.0.trial142.stdout:116: done (2 left) 2026-02-17T11:46:20.749 INFO:tasks.rados.rados.0.trial142.stdout:117: write oid 13 current snap is 15 2026-02-17T11:46:20.749 INFO:tasks.rados.rados.0.trial142.stdout:117: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-17T11:46:20.753 INFO:tasks.rados.rados.0.trial142.stdout:117: writing trial14245205-13 from 443718 to 1059321 tid 1 2026-02-17T11:46:20.757 INFO:tasks.rados.rados.0.trial142.stdout:117: writing trial14245205-13 from 1564138 to 2034479 tid 2 2026-02-17T11:46:20.762 INFO:tasks.rados.rados.0.trial142.stdout:117: writing trial14245205-13 from 2633066 to 3243718 tid 3 2026-02-17T11:46:20.762 INFO:tasks.rados.rados.0.trial142.stdout:118: snap_remove snap 13 2026-02-17T11:46:21.731 INFO:tasks.rados.rados.0.trial142.stdout:118: done (3 left) 2026-02-17T11:46:21.732 INFO:tasks.rados.rados.0.trial142.stdout:119: copy_from oid 37 from oid 5 current snap is 15 2026-02-17T11:46:21.732 INFO:tasks.rados.rados.0.trial142.stdout:115: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:114: finishing rollback tid 0 to trial14245205-47 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:114: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:115: done (3 left) 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:120: rollback oid 2 current snap is 15 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 6 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:114: finishing rollback tid 2 to trial14245205-47 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 28 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:117: finishing write tid 1 to trial14245205-13 2026-02-17T11:46:21.792 INFO:tasks.rados.rados.0.trial142.stdout:117: finishing write tid 2 to trial14245205-13 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: finishing write tid 3 to trial14245205-13 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: finishing write tid 4 to trial14245205-13 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: finishing write tid 5 to trial14245205-13 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: oid 13 updating version 0 to 39 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: oid 13 updating version 39 to 43 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: oid 13 version 43 is already newer than 42 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: oid 13 version 43 is already newer than 38 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 43 (ObjNum 74 snap 15 seq_num 74) dirty exists 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:117: left oid 13 (ObjNum 74 snap 15 seq_num 74) 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:119: finishing copy_from racing read to trial14245205-37 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:119: finishing copy_from to trial14245205-37 2026-02-17T11:46:21.793 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 13 (ObjNum 52 snap 0 seq_num 52) dirty exists 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:114: done (3 left) 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:117: done (2 left) 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:119: done (1 left) 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:121: read oid 25 snap -1 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:121: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:122: read oid 32 snap 14 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:122: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:123: copy_from oid 8 from oid 42 current snap is 15 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:124: rollback oid 34 current snap is 15 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 34 to 5 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:125: write (excl) oid 40 current snap is 15 2026-02-17T11:46:21.794 INFO:tasks.rados.rados.0.trial142.stdout:125: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2026-02-17T11:46:21.795 INFO:tasks.rados.rados.0.trial142.stdout:125: writing trial14245205-40 from 460525 to 1151377 tid 1 2026-02-17T11:46:21.799 INFO:tasks.rados.rados.0.trial142.stdout:125: writing trial14245205-40 from 1622620 to 2352972 tid 2 2026-02-17T11:46:21.803 INFO:tasks.rados.rados.0.trial142.stdout:125: writing trial14245205-40 from 3060489 to 3260525 tid 3 2026-02-17T11:46:21.803 INFO:tasks.rados.rados.0.trial142.stdout:126: delete oid 19 current snap is 15 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:120: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 0 (ObjNum 97 snap 0 seq_num 321779749) dirty dne 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:124: finishing rollback tid 0 to trial14245205-34 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:124: finishing rollback tid 1 to trial14245205-34 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:124: finishing rollback tid 2 to trial14245205-34 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 31 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-17T11:46:21.804 INFO:tasks.rados.rados.0.trial142.stdout:121: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T11:46:21.857 INFO:tasks.rados.rados.0.trial142.stdout:122: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T11:46:21.916 INFO:tasks.rados.rados.0.trial142.stdout:125: finishing write tid 1 to trial14245205-40 2026-02-17T11:46:21.916 INFO:tasks.rados.rados.0.trial142.stdout:120: done (6 left) 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:121: done (5 left) 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:122: done (4 left) 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:124: done (3 left) 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:126: done (2 left) 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:127: rollback oid 11 current snap is 15 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 5 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:125: finishing write tid 2 to trial14245205-40 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:123: finishing copy_from racing read to trial14245205-8 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:123: finishing copy_from to trial14245205-8 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T11:46:21.917 INFO:tasks.rados.rados.0.trial142.stdout:125: finishing write tid 3 to trial14245205-40 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: finishing write tid 4 to trial14245205-40 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: finishing write tid 5 to trial14245205-40 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: oid 40 updating version 0 to 25 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: oid 40 version 25 is already newer than 23 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: oid 40 version 25 is already newer than 22 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: oid 40 version 25 is already newer than 24 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 25 (ObjNum 75 snap 15 seq_num 75) dirty exists 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: left oid 40 (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:123: done (2 left) 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:125: done (1 left) 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:128: read oid 36 snap -1 2026-02-17T11:46:21.918 INFO:tasks.rados.rados.0.trial142.stdout:128: expect (ObjNum 69 snap 12 seq_num 69) 2026-02-17T11:46:21.919 INFO:tasks.rados.rados.0.trial142.stdout:129: snap_remove snap 10 2026-02-17T11:46:22.496 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:46:22.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 10 monclient: get_monmap_and_config 2026-02-17T11:46:22.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 10 monclient: build_initial_monmap 2026-02-17T11:46:22.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 10 monclient: monmap: 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:22.560479+0000 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:22.560479+0000 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:22.564 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 1 Processor -- start 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 1 -- start start 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.559+0000 7f7f17da8640 10 monclient: init 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-b con 0x7f7f100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:22.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f100a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7f1013b760 0x7f7f1013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-c con 0x7f7f1013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1006e140 con 0x7f7f100a0750 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f1009f910 con 0x7f7f1013b760 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1009ccd0 con 0x7f7f100a3bb0 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f17da8640 10 monclient(hunting): authenticate will time out at 670.179227s 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:22.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54548/0 (socket says 10.20.193.51:54548) 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 -- 10.20.193.51:0/540109182 learned_addr learned my addr 10.20.193.51:0/540109182 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): get_auth_request con 0x7f7f100a3bb0 auth_method 0 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f1631e640 1 --2- 10.20.193.51:0/540109182 >> v2:10.20.193.142:3300/0 conn(0x7f7f1013b760 0x7f7f1013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f1631e640 10 monclient(hunting): get_auth_request con 0x7f7f1013b760 auth_method 0 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f1631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:22.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f1631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f1631e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient(hunting): handle_auth_done global_id 4439 payload 274 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 -- 10.20.193.51:0/540109182 >> v2:10.20.193.142:3300/0 conn(0x7f7f1013b760 msgr2=0x7f7f1013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/540109182 >> v2:10.20.193.142:3300/0 conn(0x7f7f1013b760 0x7f7f1013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 -- 10.20.193.51:0/540109182 >> v1:10.20.193.142:6789/0 conn(0x7f7f100a0750 legacy=0x7f7f1009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient: _finish_hunting 0 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 monclient: found mon.noname-b 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.560+0000 7f7f15b1d640 1 -- 10.20.193.51:0/540109182 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1009eec0 con 0x7f7f100a3bb0 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f15b1d640 1 -- 10.20.193.51:0/540109182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 msgr2=0x7f7f1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/540109182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f1009f230 tx=0x7f7f0002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb2a14b083019b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 1 -- 10.20.193.51:0/540109182 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0003c070 con 0x7f7f100a3bb0 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: dump: 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.575 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: _finish_auth 0 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: _check_auth_tickets 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 1 -- 10.20.193.51:0/540109182 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0002fcc0 con 0x7f7f100a3bb0 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 5 monclient: authenticate success, global_id 4439 2026-02-17T11:46:22.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 1 -- 10.20.193.51:0/540109182 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00037660 con 0x7f7f100a3bb0 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 4 set_mon_vals no callback set 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f14b1b640 10 monclient: dump: 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:22.577 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 10 monclient: shutdown 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 -- 10.20.193.51:0/540109182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 msgr2=0x7f7f1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 --2- 10.20.193.51:0/540109182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f1009f230 tx=0x7f7f0002ee80 comp rx=0 tx=0).stop 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 -- 10.20.193.51:0/540109182 shutdown_connections 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 --2- 10.20.193.51:0/540109182 >> v2:10.20.193.142:3300/0 conn(0x7f7f1013b760 0x7f7f1013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 --2- 10.20.193.51:0/540109182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f100a3bb0 0x7f7f1009dac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 -- 10.20.193.51:0/540109182 >> 10.20.193.51:0/540109182 conn(0x7f7f100a30c0 msgr2=0x7f7f100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 -- 10.20.193.51:0/540109182 shutdown_connections 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 1 -- 10.20.193.51:0/540109182 wait complete. 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 10 monclient: build_initial_monmap 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.563+0000 7f7f17da8640 10 monclient: monmap: 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:22.579 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 Processor -- start 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 -- start start 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient: init 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-a con 0x7f7f100a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f100a3bb0 0x7f7f10090b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-b con 0x7f7f100a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): picked mon.noname-c con 0x7f7f1013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f100a04b0 con 0x7f7f100a0750 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1009c850 con 0x7f7f100a3bb0 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1009e710 con 0x7f7f1013b760 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f17da8640 10 monclient(hunting): authenticate will time out at 670.183390s 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54554/0 (socket says 10.20.193.51:54554) 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 -- 10.20.193.51:0/1948049704 learned_addr learned my addr 10.20.193.51:0/1948049704 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): get_auth_request con 0x7f7f1013b760 auth_method 0 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 10 monclient(hunting): get_auth_request con 0x7f7f100a0750 auth_method 0 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:22.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 msgr2=0x7f7f10099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 msgr2=0x7f7f10099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient(hunting): handle_auth_done global_id 4442 payload 824 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f100a3bb0 msgr2=0x7f7f10090b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f100a3bb0 0x7f7f10090b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 msgr2=0x7f7f10099f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient: _finish_hunting 0 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 monclient: found mon.noname-c 2026-02-17T11:46:22.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.564+0000 7f7f1631e640 1 -- 10.20.193.51:0/1948049704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f10093260 con 0x7f7f1013b760 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f1631e640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 msgr2=0x7f7f10091070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f1631e640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c007d90 tx=0x7f7f0c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c014620 con 0x7f7f1013b760 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: dump: 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:22.584 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: _finish_auth 0 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c019070 con 0x7f7f1013b760 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 5 monclient: authenticate success, global_id 4442 2026-02-17T11:46:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 10 monclient: _renew_subs 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1009d7b0 con 0x7f7f1013b760 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c014a20 con 0x7f7f1013b760 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efffff640 4 set_mon_vals no callback set 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7efe7fc640 10 monclient: dump: 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:22.586 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 10 monclient: _renew_subs 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.566+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f10094860 con 0x7f7f1013b760 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7f17da8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7f17da8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7f17da8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7f0c01e460 con 0x7f7f1013b760 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f10139ab0 con 0x7f7f1013b760 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7efe7fc640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 0x7f7ee0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.567+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 4807+0+0 (secure 0 0 0) 0x7f7f0c053080 con 0x7f7f1013b760 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.568+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 0x7f7ee0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.568+0000 7f7f15b1d640 10 monclient: get_auth_request con 0x7f7ee003dd60 auth_method 0 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.570+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f10139ab0 con 0x7f7f1013b760 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.570+0000 7f7efe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.570+0000 7f7efe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.570+0000 7f7f15b1d640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 0x7f7ee0040220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f00036000 tx=0x7f7f00039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:22.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7f17da8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7f17da8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7f17da8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f1009dac0 con 0x7f7f1013b760 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7efe7fc640 1 -- 10.20.193.51:0/1948049704 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f7f0c051a60 con 0x7f7f1013b760 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7efe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.684+0000 7f7efe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:22.687 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 msgr2=0x7f7ee0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 0x7f7ee0040220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f00036000 tx=0x7f7f00039040 comp rx=0 tx=0).stop 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 10 monclient: shutdown 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 msgr2=0x7f7f10091070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c007d90 tx=0x7f7f0c00e4b0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 shutdown_connections 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee003dd60 0x7f7ee0040220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1013b760 0x7f7f10091070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f100a3bb0 0x7f7f10090b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 --2- 10.20.193.51:0/1948049704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f100a0750 0x7f7f10099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:22.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 >> 10.20.193.51:0/1948049704 conn(0x7f7f100a30c0 msgr2=0x7f7f1013a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:22.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 shutdown_connections 2026-02-17T11:46:22.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:22.685+0000 7f7f17da8640 1 -- 10.20.193.51:0/1948049704 wait complete. 2026-02-17T11:46:22.737 INFO:tasks.rados.rados.0.trial142.stdout:129: done (2 left) 2026-02-17T11:46:22.737 INFO:tasks.rados.rados.0.trial142.stdout:130: write (excl) oid 38 current snap is 15 2026-02-17T11:46:22.738 INFO:tasks.rados.rados.0.trial142.stdout:130: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2026-02-17T11:46:22.741 INFO:tasks.rados.rados.0.trial142.stdout:130: writing trial14245205-38 from 494139 to 1051842 tid 1 2026-02-17T11:46:22.745 INFO:tasks.rados.rados.0.trial142.stdout:130: writing trial14245205-38 from 1455937 to 2189958 tid 2 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:130: writing trial14245205-38 from 2948041 to 3294139 tid 3 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:131: read oid 2 snap -1 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:131: expect deleted 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:132: delete oid 22 current snap is 15 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:127: finishing rollback tid 0 to trial14245205-11 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:127: finishing rollback tid 1 to trial14245205-11 2026-02-17T11:46:22.750 INFO:tasks.rados.rados.0.trial142.stdout:127: finishing rollback tid 2 to trial14245205-11 2026-02-17T11:46:22.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 11 (ObjNum 54 snap 0 seq_num 54) dirty exists 2026-02-17T11:46:22.751 INFO:tasks.rados.rados.0.trial142.stdout:128: expect (ObjNum 69 snap 12 seq_num 69) 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:130: finishing write tid 1 to trial14245205-38 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:127: done (4 left) 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:128: done (3 left) 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:132: done (2 left) 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:133: read oid 47 snap -1 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:133: expect (ObjNum 46 snap 0 seq_num 46) 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:134: write (excl) oid 10 current snap is 15 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:130: finishing write tid 2 to trial14245205-38 2026-02-17T11:46:22.825 INFO:tasks.rados.rados.0.trial142.stdout:134: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-17T11:46:22.829 INFO:tasks.rados.rados.0.trial142.stdout:134: writing trial14245205-10 from 527753 to 1235954 tid 1 2026-02-17T11:46:22.834 INFO:tasks.rados.rados.0.trial142.stdout:134: writing trial14245205-10 from 1856548 to 2594238 tid 2 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:134: writing trial14245205-10 from 3286534 to 3327753 tid 3 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:131: done (3 left) 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:135: copy_from oid 27 from oid 18 current snap is 15 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:130: finishing write tid 3 to trial14245205-38 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:130: finishing write tid 4 to trial14245205-38 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:130: finishing write tid 5 to trial14245205-38 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:130: oid 38 updating version 0 to 7 2026-02-17T11:46:22.838 INFO:tasks.rados.rados.0.trial142.stdout:130: oid 38 version 7 is already newer than 6 2026-02-17T11:46:22.839 INFO:tasks.rados.rados.0.trial142.stdout:130: oid 38 updating version 7 to 8 2026-02-17T11:46:22.839 INFO:tasks.rados.rados.0.trial142.stdout:130: oid 38 version 8 is already newer than 5 2026-02-17T11:46:22.839 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 8 (ObjNum 77 snap 15 seq_num 77) dirty exists 2026-02-17T11:46:22.839 INFO:tasks.rados.rados.0.trial142.stdout:130: left oid 38 (ObjNum 77 snap 15 seq_num 77) 2026-02-17T11:46:22.839 INFO:tasks.rados.rados.0.trial142.stdout:133: expect (ObjNum 46 snap 0 seq_num 46) 2026-02-17T11:46:22.905 INFO:tasks.rados.rados.0.trial142.stdout:134: finishing write tid 1 to trial14245205-10 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: finishing write tid 2 to trial14245205-10 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: finishing write tid 3 to trial14245205-10 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: finishing write tid 4 to trial14245205-10 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: finishing write tid 5 to trial14245205-10 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: oid 10 updating version 0 to 42 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: oid 10 version 42 is already newer than 41 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: oid 10 updating version 42 to 43 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: oid 10 updating version 43 to 44 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 44 (ObjNum 79 snap 15 seq_num 79) dirty exists 2026-02-17T11:46:22.906 INFO:tasks.rados.rados.0.trial142.stdout:134: left oid 10 (ObjNum 79 snap 15 seq_num 79) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:135: finishing copy_from racing read to trial14245205-27 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:135: finishing copy_from to trial14245205-27 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 18 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:130: done (3 left) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:133: done (2 left) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:134: done (1 left) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:135: done (0 left) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:136: read oid 11 snap 3 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:136: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:137: write (excl) oid 5 current snap is 15 2026-02-17T11:46:22.907 INFO:tasks.rados.rados.0.trial142.stdout:137: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2026-02-17T11:46:22.910 INFO:tasks.rados.rados.0.trial142.stdout:137: writing trial14245205-5 from 544560 to 1328010 tid 1 2026-02-17T11:46:22.914 INFO:tasks.rados.rados.0.trial142.stdout:137: writing trial14245205-5 from 1915030 to 2396378 tid 2 2026-02-17T11:46:22.917 INFO:tasks.rados.rados.0.trial142.stdout:137: writing trial14245205-5 from 2797604 to 3277365 tid 3 2026-02-17T11:46:22.918 INFO:tasks.rados.rados.0.trial142.stdout:138: read oid 9 snap -1 2026-02-17T11:46:22.918 INFO:tasks.rados.rados.0.trial142.stdout:138: expect (ObjNum 72 snap 12 seq_num 72) 2026-02-17T11:46:22.918 INFO:tasks.rados.rados.0.trial142.stdout:139: write (excl) oid 36 current snap is 15 2026-02-17T11:46:22.918 INFO:tasks.rados.rados.0.trial142.stdout:139: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2026-02-17T11:46:22.921 INFO:tasks.rados.rados.0.trial142.stdout:139: writing trial14245205-36 from 561367 to 1020066 tid 1 2026-02-17T11:46:22.926 INFO:tasks.rados.rados.0.trial142.stdout:139: writing trial14245205-36 from 1573512 to 2314871 tid 2 2026-02-17T11:46:22.930 INFO:tasks.rados.rados.0.trial142.stdout:139: writing trial14245205-36 from 2941380 to 3361367 tid 3 2026-02-17T11:46:22.930 INFO:tasks.rados.rados.0.trial142.stdout:140: read oid 32 snap -1 2026-02-17T11:46:22.930 INFO:tasks.rados.rados.0.trial142.stdout:140: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T11:46:22.930 INFO:tasks.rados.rados.0.trial142.stdout:141: rollback oid 44 current snap is 15 2026-02-17T11:46:22.930 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 3 2026-02-17T11:46:22.931 INFO:tasks.rados.rados.0.trial142.stdout:136: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: finishing write tid 1 to trial14245205-5 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: finishing write tid 2 to trial14245205-5 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: finishing write tid 3 to trial14245205-5 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: finishing write tid 4 to trial14245205-5 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: finishing write tid 5 to trial14245205-5 2026-02-17T11:46:23.028 INFO:tasks.rados.rados.0.trial142.stdout:137: oid 5 updating version 0 to 39 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:137: oid 5 version 39 is already newer than 37 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:137: oid 5 version 39 is already newer than 38 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:137: oid 5 version 39 is already newer than 36 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 39 (ObjNum 80 snap 15 seq_num 80) dirty exists 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:137: left oid 5 (ObjNum 80 snap 15 seq_num 80) 2026-02-17T11:46:23.029 INFO:tasks.rados.rados.0.trial142.stdout:138: expect (ObjNum 72 snap 12 seq_num 72) 2026-02-17T11:46:23.126 INFO:tasks.rados.rados.0.trial142.stdout:139: finishing write tid 1 to trial14245205-36 2026-02-17T11:46:23.126 INFO:tasks.rados.rados.0.trial142.stdout:139: finishing write tid 2 to trial14245205-36 2026-02-17T11:46:23.127 INFO:tasks.rados.rados.0.trial142.stdout:136: done (5 left) 2026-02-17T11:46:23.127 INFO:tasks.rados.rados.0.trial142.stdout:137: done (4 left) 2026-02-17T11:46:23.127 INFO:tasks.rados.rados.0.trial142.stdout:138: done (3 left) 2026-02-17T11:46:23.127 INFO:tasks.rados.rados.0.trial142.stdout:142: write oid 12 current snap is 15 2026-02-17T11:46:23.127 INFO:tasks.rados.rados.0.trial142.stdout:142: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-17T11:46:23.130 INFO:tasks.rados.rados.0.trial142.stdout:142: writing trial14245205-12 from 578174 to 1112122 tid 1 2026-02-17T11:46:23.133 INFO:tasks.rados.rados.0.trial142.stdout:142: writing trial14245205-12 from 1515641 to 2000658 tid 2 2026-02-17T11:46:23.139 INFO:tasks.rados.rados.0.trial142.stdout:142: writing trial14245205-12 from 2736097 to 3238402 tid 3 2026-02-17T11:46:23.139 INFO:tasks.rados.rados.0.trial142.stdout:143: write (excl) oid 3 current snap is 15 2026-02-17T11:46:23.140 INFO:tasks.rados.rados.0.trial142.stdout:143: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2026-02-17T11:46:23.143 INFO:tasks.rados.rados.0.trial142.stdout:143: writing trial14245205-3 from 594981 to 1204178 tid 1 2026-02-17T11:46:23.148 INFO:tasks.rados.rados.0.trial142.stdout:143: writing trial14245205-3 from 1974123 to 2719151 tid 2 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:143: writing trial14245205-3 from 3279873 to 3394981 tid 3 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:144: delete oid 41 current snap is 15 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:141: finishing rollback tid 0 to trial14245205-44 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: finishing write tid 3 to trial14245205-36 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: finishing write tid 4 to trial14245205-36 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:141: finishing rollback tid 1 to trial14245205-44 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: finishing write tid 5 to trial14245205-36 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: oid 36 updating version 0 to 21 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: oid 36 updating version 21 to 22 2026-02-17T11:46:23.152 INFO:tasks.rados.rados.0.trial142.stdout:139: oid 36 version 22 is already newer than 19 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:139: oid 36 version 22 is already newer than 20 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 22 (ObjNum 81 snap 15 seq_num 81) dirty exists 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:139: left oid 36 (ObjNum 81 snap 15 seq_num 81) 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:141: finishing rollback tid 2 to trial14245205-44 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-17T11:46:23.153 INFO:tasks.rados.rados.0.trial142.stdout:140: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T11:46:23.211 INFO:tasks.rados.rados.0.trial142.stdout:142: finishing write tid 1 to trial14245205-12 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:142: finishing write tid 2 to trial14245205-12 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:139: done (5 left) 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:140: done (4 left) 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:141: done (3 left) 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:144: done (2 left) 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:145: write (excl) oid 10 current snap is 15 2026-02-17T11:46:23.212 INFO:tasks.rados.rados.0.trial142.stdout:145: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-17T11:46:23.216 INFO:tasks.rados.rados.0.trial142.stdout:145: writing trial14245205-10 from 628595 to 1104643 tid 1 2026-02-17T11:46:23.222 INFO:tasks.rados.rados.0.trial142.stdout:145: writing trial14245205-10 from 1807440 to 2439784 tid 2 2026-02-17T11:46:23.225 INFO:tasks.rados.rados.0.trial142.stdout:145: writing trial14245205-10 from 2934719 to 3387193 tid 3 2026-02-17T11:46:23.226 INFO:tasks.rados.rados.0.trial142.stdout:146: read oid 47 snap 14 2026-02-17T11:46:23.226 INFO:tasks.rados.rados.0.trial142.stdout:146: expect (ObjNum 46 snap 0 seq_num 46) 2026-02-17T11:46:23.226 INFO:tasks.rados.rados.0.trial142.stdout:147: read oid 22 snap 11 2026-02-17T11:46:23.226 INFO:tasks.rados.rados.0.trial142.stdout:147: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T11:46:23.226 INFO:tasks.rados.rados.0.trial142.stdout:148: snap_remove snap 12 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:148: done (5 left) 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:149: read oid 26 snap -1 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:149: expect (ObjNum 63 snap 8 seq_num 63) 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:150: read oid 17 snap -1 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:150: expect (ObjNum 73 snap 13 seq_num 73) 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:151: read oid 23 snap 9 2026-02-17T11:46:23.740 INFO:tasks.rados.rados.0.trial142.stdout:151: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-17T11:46:23.741 INFO:tasks.rados.rados.0.trial142.stdout:152: read oid 39 snap 14 2026-02-17T11:46:23.741 INFO:tasks.rados.rados.0.trial142.stdout:152: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T11:46:23.741 INFO:tasks.rados.rados.0.trial142.stdout:153: snap_remove snap 5 2026-02-17T11:46:24.741 INFO:tasks.rados.rados.0.trial142.stdout:153: done (9 left) 2026-02-17T11:46:24.741 INFO:tasks.rados.rados.0.trial142.stdout:154: read oid 46 snap -1 2026-02-17T11:46:24.741 INFO:tasks.rados.rados.0.trial142.stdout:154: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:24.741 INFO:tasks.rados.rados.0.trial142.stdout:155: snap_remove snap 7 2026-02-17T11:46:25.696 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:46:25.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 10 monclient: get_monmap_and_config 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 10 monclient: build_initial_monmap 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 10 monclient: monmap: 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:25.763281+0000 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:25.763281+0000 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:25.767 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 1 Processor -- start 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 1 -- start start 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.762+0000 7fe82ffff640 10 monclient: init 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe83009d870 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-b con 0x7fe83009e360 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:25.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe83013a4d0 0x7fe83013c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-c con 0x7fe83013a4d0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe83009f6e0 con 0x7fe83009d870 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe83009f0b0 con 0x7fe83013a4d0 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe8300a1230 con 0x7fe83009e360 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82ffff640 10 monclient(hunting): authenticate will time out at 673.382133s 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43246/0 (socket says 10.20.193.51:43246) 2026-02-17T11:46:25.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 -- 10.20.193.51:0/692421716 learned_addr learned my addr 10.20.193.51:0/692421716 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): get_auth_request con 0x7fe83009e360 auth_method 0 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82f7fe640 1 --2- 10.20.193.51:0/692421716 >> v2:10.20.193.142:3300/0 conn(0x7fe83013a4d0 0x7fe83013c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82f7fe640 10 monclient(hunting): get_auth_request con 0x7fe83013a4d0 auth_method 0 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient(hunting): handle_auth_done global_id 4445 payload 274 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 -- 10.20.193.51:0/692421716 >> v2:10.20.193.142:3300/0 conn(0x7fe83013a4d0 msgr2=0x7fe83013c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 --2- 10.20.193.51:0/692421716 >> v2:10.20.193.142:3300/0 conn(0x7fe83013a4d0 0x7fe83013c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 -- 10.20.193.51:0/692421716 >> v1:10.20.193.142:6789/0 conn(0x7fe83009d870 legacy=0x7fe83009dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 monclient: found mon.noname-b 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.763+0000 7fe82e7fc640 1 -- 10.20.193.51:0/692421716 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83006d660 con 0x7fe83009e360 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.765+0000 7fe82e7fc640 1 -- 10.20.193.51:0/692421716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 msgr2=0x7fe830139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.765+0000 7fe82e7fc640 1 --2- 10.20.193.51:0/692421716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe818009970 tx=0x7fe81802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f892e4cb05ae67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 1 -- 10.20.193.51:0/692421716 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81803c070 con 0x7fe83009e360 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:25.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: dump: 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.779 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: _finish_auth 0 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 1 -- 10.20.193.51:0/692421716 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81802fcd0 con 0x7fe83009e360 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 5 monclient: authenticate success, global_id 4445 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 1 -- 10.20.193.51:0/692421716 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818037660 con 0x7fe83009e360 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 4 set_mon_vals no callback set 2026-02-17T11:46:25.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82dffb640 10 monclient: dump: 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.781 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 10 monclient: shutdown 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 -- 10.20.193.51:0/692421716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 msgr2=0x7fe830139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 --2- 10.20.193.51:0/692421716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe818009970 tx=0x7fe81802ee90 comp rx=0 tx=0).stop 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 -- 10.20.193.51:0/692421716 shutdown_connections 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 --2- 10.20.193.51:0/692421716 >> v2:10.20.193.142:3300/0 conn(0x7fe83013a4d0 0x7fe83013c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 --2- 10.20.193.51:0/692421716 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009e360 0x7fe830139f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 -- 10.20.193.51:0/692421716 >> 10.20.193.51:0/692421716 conn(0x7fe83006cab0 msgr2=0x7fe83006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 -- 10.20.193.51:0/692421716 shutdown_connections 2026-02-17T11:46:25.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 1 -- 10.20.193.51:0/692421716 wait complete. 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 10 monclient: build_initial_monmap 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.766+0000 7fe82ffff640 10 monclient: monmap: 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:25.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 Processor -- start 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 -- start start 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient: init 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-c con 0x7fe83009d870 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe83009e360 0x7fe830071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-b con 0x7fe83009e360 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:25.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe83013a4d0 0x7fe830072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): picked mon.noname-a con 0x7fe83013a4d0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe8300a2b60 con 0x7fe83013a4d0 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe8300a29e0 con 0x7fe83009e360 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe83009eaa0 con 0x7fe83009d870 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82ffff640 10 monclient(hunting): authenticate will time out at 673.386456s 2026-02-17T11:46:25.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43260/0 (socket says 10.20.193.51:43260) 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 -- 10.20.193.51:0/503677866 learned_addr learned my addr 10.20.193.51:0/503677866 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): get_auth_request con 0x7fe83009d870 auth_method 0 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe83013a4d0 0x7fe830072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): get_auth_request con 0x7fe83013a4d0 auth_method 0 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient(hunting): handle_auth_done global_id 4448 payload 824 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 -- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe83009e360 msgr2=0x7fe830071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe83009e360 0x7fe830071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 -- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe83013a4d0 msgr2=0x7fe830072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe83013a4d0 0x7fe830072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient: _finish_hunting 0 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 monclient: found mon.noname-c 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.767+0000 7fe82effd640 1 -- 10.20.193.51:0/503677866 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe830121dd0 con 0x7fe83009d870 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82effd640 1 -- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 msgr2=0x7fe8300717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82effd640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c5d0 tx=0x7fe82400caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824016020 con 0x7fe83009d870 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 10 monclient: dump: 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.788 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:25.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824012a60 con 0x7fe83009d870 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82ffff640 5 monclient: authenticate success, global_id 4448 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82ffff640 10 monclient: _renew_subs 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82ffff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.769+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8301220b0 con 0x7fe83009d870 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824012e50 con 0x7fe83009d870 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82d7fa640 4 set_mon_vals no callback set 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 10 monclient: dump: 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.790 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 10 monclient: _renew_subs 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8300a5280 con 0x7fe83009d870 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:25.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83006d9c0 con 0x7fe83009d870 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe82401b400 con 0x7fe83009d870 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 0x7fe7fc040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.770+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 4795+0+0 (secure 0 0 0) 0x7fe8240526b0 con 0x7fe83009d870 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.771+0000 7fe82e7fc640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 0x7fe7fc040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.771+0000 7fe82e7fc640 10 monclient: get_auth_request con 0x7fe7fc03deb0 auth_method 0 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.773+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe824020030 con 0x7fe83009d870 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.773+0000 7fe80f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.773+0000 7fe80f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:25.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.773+0000 7fe82e7fc640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 0x7fe7fc040370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe818036000 tx=0x7fe818039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:25.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe82ffff640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:46:25.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe82ffff640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe82ffff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe830077060 con 0x7fe83009d870 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe80f7fe640 1 -- 10.20.193.51:0/503677866 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe82401b9b0 con 0x7fe83009d870 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe80f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.891+0000 7fe80f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:25.894 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 msgr2=0x7fe7fc040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 0x7fe7fc040370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe818036000 tx=0x7fe818039040 comp rx=0 tx=0).stop 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 10 monclient: shutdown 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 msgr2=0x7fe8300717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c5d0 tx=0x7fe82400caa0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 shutdown_connections 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7fc03deb0 0x7fe7fc040370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe83013a4d0 0x7fe830072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe83009e360 0x7fe830071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 --2- 10.20.193.51:0/503677866 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe83009d870 0x7fe8300717b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 >> 10.20.193.51:0/503677866 conn(0x7fe83006cab0 msgr2=0x7fe830133240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:25.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 shutdown_connections 2026-02-17T11:46:25.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.892+0000 7fe82ffff640 1 -- 10.20.193.51:0/503677866 wait complete. 2026-02-17T11:46:25.898 INFO:tasks.rados.rados.0.trial142.stdout:155: done (10 left) 2026-02-17T11:46:25.898 INFO:tasks.rados.rados.0.trial142.stdout:156: rollback oid 5 current snap is 15 2026-02-17T11:46:25.898 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 5 to 9 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: finishing write tid 3 to trial14245205-12 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: finishing write tid 4 to trial14245205-12 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: finishing write tid 5 to trial14245205-12 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: oid 12 updating version 0 to 53 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: oid 12 version 53 is already newer than 52 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: oid 12 updating version 53 to 55 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: oid 12 version 55 is already newer than 54 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 55 (ObjNum 82 snap 15 seq_num 82) dirty exists 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:142: left oid 12 (ObjNum 82 snap 15 seq_num 82) 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:143: finishing write tid 1 to trial14245205-3 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:143: finishing write tid 2 to trial14245205-3 2026-02-17T11:46:25.899 INFO:tasks.rados.rados.0.trial142.stdout:143: finishing write tid 3 to trial14245205-3 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:142: done (10 left) 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:157: read oid 48 snap 14 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:157: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:158: snap_create 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: finishing write tid 4 to trial14245205-3 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: finishing write tid 5 to trial14245205-3 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: oid 3 updating version 0 to 17 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: oid 3 updating version 17 to 18 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: oid 3 version 18 is already newer than 16 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: oid 3 version 18 is already newer than 15 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 18 (ObjNum 83 snap 15 seq_num 83) dirty exists 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:143: left oid 3 (ObjNum 83 snap 15 seq_num 83) 2026-02-17T11:46:25.900 INFO:tasks.rados.rados.0.trial142.stdout:145: finishing write tid 1 to trial14245205-10 2026-02-17T11:46:25.901 INFO:tasks.rados.rados.0.trial142.stdout:145: finishing write tid 2 to trial14245205-10 2026-02-17T11:46:25.901 INFO:tasks.rados.rados.0.trial142.stdout:147: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T11:46:25.904 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:46:25.904 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:46:25.904 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: finishing write tid 3 to trial14245205-10 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: finishing write tid 4 to trial14245205-10 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: finishing write tid 5 to trial14245205-10 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: oid 10 updating version 0 to 45 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: oid 10 updating version 45 to 47 2026-02-17T11:46:25.953 INFO:tasks.rados.rados.0.trial142.stdout:145: oid 10 updating version 47 to 48 2026-02-17T11:46:25.954 INFO:tasks.rados.rados.0.trial142.stdout:145: oid 10 version 48 is already newer than 46 2026-02-17T11:46:25.954 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 48 (ObjNum 85 snap 15 seq_num 85) dirty exists 2026-02-17T11:46:25.954 INFO:tasks.rados.rados.0.trial142.stdout:145: left oid 10 (ObjNum 85 snap 15 seq_num 85) 2026-02-17T11:46:25.954 INFO:tasks.rados.rados.0.trial142.stdout:146: expect (ObjNum 46 snap 0 seq_num 46) 2026-02-17T11:46:25.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: get_monmap_and_config 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: build_initial_monmap 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: monmap: 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:25.972089+0000 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:25.972089+0000 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:25.973 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:25.974 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:25.974 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:25.974 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:25.974 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 Processor -- start 2026-02-17T11:46:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 -- start start 2026-02-17T11:46:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: init 2026-02-17T11:46:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd2f00a3bb0 0x7fd2f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd2f009e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f006e140 con 0x7fd2f009e540 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f00a3f90 con 0x7fd2f00a3bb0 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f009f910 con 0x7fd2f00a0750 2026-02-17T11:46:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f843a640 10 monclient(hunting): authenticate will time out at 673.590890s 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f69b0640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd2f009e540 0x7fd2f013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:43824/0 (socket says 10.20.193.51:43824) 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f69b0640 1 -- 10.20.193.51:0/3345612684 learned_addr learned my addr 10.20.193.51:0/3345612684 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.971+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): get_auth_request con 0x7fd2f00a0750 auth_method 0 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f61af640 1 --2- 10.20.193.51:0/3345612684 >> v2:10.20.193.142:3300/0 conn(0x7fd2f00a3bb0 0x7fd2f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f61af640 10 monclient(hunting): get_auth_request con 0x7fd2f00a3bb0 auth_method 0 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f61af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f61af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f61af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_done global_id 4451 payload 274 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 1 -- 10.20.193.51:0/3345612684 >> v2:10.20.193.142:3300/0 conn(0x7fd2f00a3bb0 msgr2=0x7fd2f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/3345612684 >> v2:10.20.193.142:3300/0 conn(0x7fd2f00a3bb0 0x7fd2f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 1 -- 10.20.193.51:0/3345612684 >> v1:10.20.193.51:6789/0 conn(0x7fd2f009e540 legacy=0x7fd2f013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient: _finish_hunting 0 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 1 monclient: found mon.noname-b 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.972+0000 7fd2f59ae640 1 -- 10.20.193.51:0/3345612684 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f009ccd0 con 0x7fd2f00a0750 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f59ae640 1 -- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 msgr2=0x7fd2f009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f009e000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd2f006c1c0 tx=0x7fd2e402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d69360f574a4c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 1 -- 10.20.193.51:0/3345612684 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403c070 con 0x7fd2f00a0750 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: dump: 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: _finish_auth 0 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: _check_auth_tickets 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 1 -- 10.20.193.51:0/3345612684 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e402fbd0 con 0x7fd2f00a0750 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f843a640 5 monclient: authenticate success, global_id 4451 2026-02-17T11:46:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 1 -- 10.20.193.51:0/3345612684 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037440 con 0x7fd2f00a0750 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f843a640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f843a640 4 set_mon_vals no callback set 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.974+0000 7fd2f51ad640 10 monclient: dump: 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 10 monclient: shutdown 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 msgr2=0x7fd2f009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 --2- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f009e000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd2f006c1c0 tx=0x7fd2e402ed50 comp rx=0 tx=0).stop 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- 10.20.193.51:0/3345612684 shutdown_connections 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 --2- 10.20.193.51:0/3345612684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f009e000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 --2- 10.20.193.51:0/3345612684 >> v2:10.20.193.142:3300/0 conn(0x7fd2f00a3bb0 0x7fd2f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- 10.20.193.51:0/3345612684 >> 10.20.193.51:0/3345612684 conn(0x7fd2f00a30c0 msgr2=0x7fd2f00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- 10.20.193.51:0/3345612684 shutdown_connections 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- 10.20.193.51:0/3345612684 wait complete. 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 10 monclient: build_initial_monmap 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 10 monclient: monmap: 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 Processor -- start 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 1 -- start start 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.975+0000 7fd2f843a640 10 monclient: init 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f009e540 0x7fd2f012bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f012c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f00a3bb0 0x7fd2f012c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f00a04b0 con 0x7fd2f009e540 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f009c850 con 0x7fd2f00a3bb0 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f013de80 con 0x7fd2f00a0750 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f843a640 10 monclient(hunting): authenticate will time out at 673.595227s 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f009e540 0x7fd2f012bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f012c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f009e540 0x7fd2f012bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45174/0 (socket says 10.20.193.51:45174) 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 learned_addr learned my addr 10.20.193.51:0/1502229358 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): get_auth_request con 0x7fd2f00a0750 auth_method 0 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): get_auth_request con 0x7fd2f009e540 auth_method 0 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient(hunting): handle_auth_done global_id 4454 payload 824 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f00a3bb0 msgr2=0x7fd2f012c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd2f00a3bb0 0x7fd2f012c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f009e540 msgr2=0x7fd2f012bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f009e540 0x7fd2f012bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient: _finish_hunting 0 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 monclient: found mon.noname-c 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.976+0000 7fd2f59ae640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f012d560 con 0x7fd2f00a0750 2026-02-17T11:46:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f59ae640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 msgr2=0x7fd2f012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f59ae640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f012c050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4036000 tx=0x7fd2e40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4046020 con 0x7fd2f00a0750 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: dump: 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.997 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4037e50 con 0x7fd2f00a0750 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403c040 con 0x7fd2f00a0750 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2d6ffd640 10 monclient: dump: 2026-02-17T11:46:25.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f49ac640 4 set_mon_vals no callback set 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 5 monclient: authenticate success, global_id 4454 2026-02-17T11:46:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 10 monclient: _renew_subs 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f012efb0 con 0x7fd2f00a0750 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 10 monclient: _renew_subs 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.978+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f012e300 con 0x7fd2f00a0750 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f843a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f843a640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 0x7fd2f01cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f012e0c0 con 0x7fd2f01cd1a0 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 0x7fd2f01cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient: get_auth_request con 0x7fd2f01cd1a0 auth_method 0 2026-02-17T11:46:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd2e403f030 con 0x7fd2f00a0750 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 10 monclient(hunting): handle_auth_done global_id 34104 payload 824 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2f006f410 con 0x7fd2f01cd1a0 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2d6ffd640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c003dd10 0x7fd2c00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 4811+0+0 (secure 0 0 0) 0x7fd2e4076f80 con 0x7fd2f00a0750 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f69b0640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c003dd10 0x7fd2c00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.979+0000 7fd2f69b0640 10 monclient: get_auth_request con 0x7fd2c003dd10 auth_method 0 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 msgr2=0x7fd2f01cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 0x7fd2f01cd580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0019070 con 0x7fd2f01cd1a0 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 10 monclient: dump: 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.002 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd2e000fe50 con 0x7fd2f01cd1a0 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 msgr2=0x7fd2f01cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 0x7fd2f01cd580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0011c30 comp rx=0 tx=0).stop 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 msgr2=0x7fd2f01cd580 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.981+0000 7fd2d6ffd640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cd1a0 0x7fd2f01cd580 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0011c30 comp rx=0 tx=0).stop 2026-02-17T11:46:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.982+0000 7fd2f69b0640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c003dd10 0x7fd2c00401d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005b30 tx=0x7fd2ec005150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f843a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f843a640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f843a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f009dac0 con 0x7fd2f01cdac0 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 msgr2=0x7fd2f01d84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 msgr2=0x7fd2f01d84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:25.984+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:26.022 INFO:tasks.rados.rados.0.trial142.stdout:151: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-17T11:46:26.078 INFO:tasks.rados.rados.0.trial142.stdout:152: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T11:46:26.141 INFO:tasks.rados.rados.0.trial142.stdout:150: expect (ObjNum 73 snap 13 seq_num 73) 2026-02-17T11:46:26.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient: get_auth_request con 0x7fd2f01cdac0 auth_method 0 2026-02-17T11:46:26.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 10 monclient(hunting): handle_auth_done global_id 34107 payload 824 2026-02-17T11:46:26.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.185+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd2f00008d0 con 0x7fd2f01cdac0 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2f61af640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 msgr2=0x7fd2f01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2f61af640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e002d020 con 0x7fd2f01cdac0 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 10 monclient: dump: 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.190 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fd2e001ea70 con 0x7fd2f01cdac0 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:26.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 msgr2=0x7fd2f01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0004830 comp rx=0 tx=0).stop 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 msgr2=0x7fd2f01d84f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.187+0000 7fd2d6ffd640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2f01cdac0 0x7fd2f01d84f0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011830 tx=0x7fd2e0004830 comp rx=0 tx=0).stop 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:46:26.192 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 6832, 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:26.193 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:26.194 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.195 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:26.196 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.197 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.198 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.199 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:26.200 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.201 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.202 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.203 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.204 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:26.205 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c003dd10 msgr2=0x7fd2c00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2c003dd10 0x7fd2c00401d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005b30 tx=0x7fd2ec005150 comp rx=0 tx=0).stop 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 10 monclient: shutdown 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 msgr2=0x7fd2f012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 --2- 10.20.193.51:0/1502229358 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2f00a0750 0x7fd2f012c050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4036000 tx=0x7fd2e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f69b0640 1 -- 10.20.193.51:0/1502229358 reap_dead start 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f69b0640 1 -- 10.20.193.51:0/1502229358 reap_dead start 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 shutdown_connections 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 >> 10.20.193.51:0/1502229358 conn(0x7fd2f00a30c0 msgr2=0x7fd2f00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 shutdown_connections 2026-02-17T11:46:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.188+0000 7fd2f843a640 1 -- 10.20.193.51:0/1502229358 wait complete. 2026-02-17T11:46:26.208 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:26.208 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:46:26.208 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:46:26.246 INFO:tasks.rados.rados.0.trial142.stdout:149: expect (ObjNum 63 snap 8 seq_num 63) 2026-02-17T11:46:26.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 10 monclient: get_monmap_and_config 2026-02-17T11:46:26.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 10 monclient: monmap: 2026-02-17T11:46:26.278 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.278 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:26.275351+0000 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:26.275351+0000 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:26.279 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 1 Processor -- start 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 1 -- start start 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.274+0000 7fcc7cb22640 10 monclient: init 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fcc780a3bb0 0x7fcc7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-c con 0x7fcc780a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-b con 0x7fcc780a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcc7809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:26.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7806e140 con 0x7fcc7809e540 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780a3f90 con 0x7fcc780a3bb0 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7809f910 con 0x7fcc780a0750 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc7cb22640 10 monclient(hunting): authenticate will time out at 673.894100s 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43276/0 (socket says 10.20.193.51:43276) 2026-02-17T11:46:26.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 -- 10.20.193.51:0/2033249495 learned_addr learned my addr 10.20.193.51:0/2033249495 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): get_auth_request con 0x7fcc780a0750 auth_method 0 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc76575640 1 --2- 10.20.193.51:0/2033249495 >> v2:10.20.193.142:3300/0 conn(0x7fcc780a3bb0 0x7fcc7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc76575640 10 monclient(hunting): get_auth_request con 0x7fcc780a3bb0 auth_method 0 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient(hunting): handle_auth_done global_id 4457 payload 274 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 -- 10.20.193.51:0/2033249495 >> v2:10.20.193.142:3300/0 conn(0x7fcc780a3bb0 msgr2=0x7fcc7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 --2- 10.20.193.51:0/2033249495 >> v2:10.20.193.142:3300/0 conn(0x7fcc780a3bb0 0x7fcc7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 -- 10.20.193.51:0/2033249495 >> v1:10.20.193.142:6789/0 conn(0x7fcc7809e540 legacy=0x7fcc7813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 monclient: found mon.noname-b 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.275+0000 7fcc75d74640 1 -- 10.20.193.51:0/2033249495 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7809ccd0 con 0x7fcc780a0750 2026-02-17T11:46:26.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.277+0000 7fcc75d74640 1 -- 10.20.193.51:0/2033249495 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 msgr2=0x7fcc7809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.277+0000 7fcc75d74640 1 --2- 10.20.193.51:0/2033249495 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806c1c0 tx=0x7fcc6002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b999511b1adbb94 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 1 -- 10.20.193.51:0/2033249495 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6003c070 con 0x7fcc780a0750 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: dump: 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.293 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 1 -- 10.20.193.51:0/2033249495 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6002fca0 con 0x7fcc780a0750 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 1 -- 10.20.193.51:0/2033249495 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60037660 con 0x7fcc780a0750 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 5 monclient: authenticate success, global_id 4457 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc75573640 10 monclient: dump: 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.294 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 4 set_mon_vals no callback set 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 10 monclient: shutdown 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 -- 10.20.193.51:0/2033249495 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 msgr2=0x7fcc7809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/2033249495 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806c1c0 tx=0x7fcc6002ee60 comp rx=0 tx=0).stop 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 -- 10.20.193.51:0/2033249495 shutdown_connections 2026-02-17T11:46:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/2033249495 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc780a0750 0x7fcc7809e000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/2033249495 >> v2:10.20.193.142:3300/0 conn(0x7fcc780a3bb0 0x7fcc7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 -- 10.20.193.51:0/2033249495 >> 10.20.193.51:0/2033249495 conn(0x7fcc780a30c0 msgr2=0x7fcc780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 -- 10.20.193.51:0/2033249495 shutdown_connections 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 -- 10.20.193.51:0/2033249495 wait complete. 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 10 monclient: monmap: 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:26.296 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.278+0000 7fcc7cb22640 1 Processor -- start 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 -- start start 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient: init 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc7809e540 0x7fcc781381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-c con 0x7fcc7809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-a con 0x7fcc780a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc780a3bb0 0x7fcc78130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): picked mon.noname-b con 0x7fcc780a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780a04b0 con 0x7fcc780a0750 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7809c850 con 0x7fcc780a3bb0 2026-02-17T11:46:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7813de80 con 0x7fcc7809e540 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc7cb22640 10 monclient(hunting): authenticate will time out at 673.898299s 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc7809e540 0x7fcc781381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc7809e540 0x7fcc781381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43292/0 (socket says 10.20.193.51:43292) 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45208/0 (socket says 10.20.193.51:45208) 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 1 -- 10.20.193.51:0/560821712 learned_addr learned my addr 10.20.193.51:0/560821712 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): get_auth_request con 0x7fcc7809e540 auth_method 0 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): get_auth_request con 0x7fcc780a0750 auth_method 0 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76d76640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc780a3bb0 0x7fcc78130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76d76640 10 monclient(hunting): get_auth_request con 0x7fcc780a3bb0 auth_method 0 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc76d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient(hunting): handle_auth_done global_id 34110 payload 824 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc7809e540 msgr2=0x7fcc781381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc7809e540 0x7fcc781381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc780a3bb0 msgr2=0x7fcc78130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc780a3bb0 0x7fcc78130530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 monclient: found mon.noname-a 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.279+0000 7fcc75d74640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc781337a0 con 0x7fcc780a0750 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc75d74640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 msgr2=0x7fcc7812fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc75d74640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc7809fa90 tx=0x7fcc60004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6003c040 con 0x7fcc780a0750 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: dump: 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.300 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60047070 con 0x7fcc780a0750 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc600428d0 con 0x7fcc780a0750 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc74d72640 4 set_mon_vals no callback set 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc5effd640 10 monclient: dump: 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.301 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 5 monclient: authenticate success, global_id 34110 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 10 monclient: _renew_subs 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc78131f10 con 0x7fcc780a0750 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 10 monclient: _renew_subs 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.281+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7809d7b0 con 0x7fcc780a0750 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc7cb22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 0x7fcc78139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7806f410 con 0x7fcc78130a70 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 0x7fcc78139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient: get_auth_request con 0x7fcc78130a70 auth_method 0 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcc60042ab0 con 0x7fcc780a0750 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc76575640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc78131a70 con 0x7fcc78130a70 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc5effd640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc4403dd10 0x7fcc440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.282+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4811+0+0 (secure 0 0 0) 0x7fcc600778e0 con 0x7fcc780a0750 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.283+0000 7fcc76d76640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc4403dd10 0x7fcc440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.283+0000 7fcc76d76640 10 monclient: get_auth_request con 0x7fcc4403dd10 auth_method 0 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.284+0000 7fcc76575640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 msgr2=0x7fcc78139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.284+0000 7fcc76575640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 0x7fcc78139960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c011830 tx=0x7fcc6c011c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c019070 con 0x7fcc78130a70 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 10 monclient: dump: 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fcc6c00fe50 con 0x7fcc78130a70 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 msgr2=0x7fcc78139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 0x7fcc78139960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c011830 tx=0x7fcc6c011c30 comp rx=0 tx=0).stop 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 msgr2=0x7fcc78139960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc5effd640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78130a70 0x7fcc78139960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.285+0000 7fcc76d76640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc4403dd10 0x7fcc440401d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e160 tx=0x7fcc68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc7cb22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 0x7fcc7813a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc7cb22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc78130e50 con 0x7fcc78139ea0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 0x7fcc7813a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient: get_auth_request con 0x7fcc78139ea0 auth_method 0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 10 monclient(hunting): handle_auth_done global_id 4466 payload 824 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.288+0000 7fcc76575640 1 -- 10.20.193.51:0/560821712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc7809dac0 con 0x7fcc78139ea0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc76575640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 msgr2=0x7fcc7813a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc76575640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 0x7fcc7813a2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c011830 tx=0x7fcc6c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00f040 con 0x7fcc78139ea0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 10 monclient: dump: 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fcc6c0143e0 con 0x7fcc78139ea0 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 msgr2=0x7fcc7813a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 0x7fcc7813a2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c011830 tx=0x7fcc6c004830 comp rx=0 tx=0).stop 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 msgr2=0x7fcc7813a2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc5effd640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc78139ea0 0x7fcc7813a2b0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c011830 tx=0x7fcc6c004830 comp rx=0 tx=0).stop 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 69609, 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.307 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.308 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.309 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.310 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.311 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:26.315 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc4403dd10 msgr2=0x7fcc440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc4403dd10 0x7fcc440401d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e160 tx=0x7fcc68009040 comp rx=0 tx=0).stop 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 10 monclient: shutdown 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 msgr2=0x7fcc7812fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc7809fa90 tx=0x7fcc60004830 comp rx=0 tx=0).stop 2026-02-17T11:46:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.290+0000 7fcc76d76640 1 -- 10.20.193.51:0/560821712 reap_dead start 2026-02-17T11:46:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.291+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 shutdown_connections 2026-02-17T11:46:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.291+0000 7fcc7cb22640 1 --2- 10.20.193.51:0/560821712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc780a0750 0x7fcc7812fff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.291+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 >> 10.20.193.51:0/560821712 conn(0x7fcc780a30c0 msgr2=0x7fcc780a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.291+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 shutdown_connections 2026-02-17T11:46:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.291+0000 7fcc7cb22640 1 -- 10.20.193.51:0/560821712 wait complete. 2026-02-17T11:46:26.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:26.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:46:26.317 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:46:26.380 INFO:tasks.rados.rados.0.trial142.stdout:154: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.382+0000 7f47100fb640 10 monclient: get_monmap_and_config 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.382+0000 7f47100fb640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.382+0000 7f47100fb640 10 monclient: monmap: 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:26.383873+0000 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:26.383873+0000 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:26.384 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 Processor -- start 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 -- start start 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient: init 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47080a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f470809dac0 0x7f470809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-c con 0x7f470809dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-b con 0x7f47080a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470806e140 con 0x7f47080a3bb0 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f470809aed0 con 0x7f470809dac0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f470809caa0 con 0x7f47080a0110 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f47100fb640 10 monclient(hunting): authenticate will time out at 674.002654s 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470de70640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f47080a3bb0 0x7f470809f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:43826/0 (socket says 10.20.193.51:43826) 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470de70640 1 -- 10.20.193.51:0/3849542242 learned_addr learned my addr 10.20.193.51:0/3849542242 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 --2- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): get_auth_request con 0x7f47080a0110 auth_method 0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470d66f640 1 --2- 10.20.193.51:0/3849542242 >> v2:10.20.193.142:3300/0 conn(0x7f470809dac0 0x7f470809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470d66f640 10 monclient(hunting): get_auth_request con 0x7f470809dac0 auth_method 0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470d66f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470d66f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470d66f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient(hunting): handle_auth_done global_id 4469 payload 274 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 -- 10.20.193.51:0/3849542242 >> v2:10.20.193.142:3300/0 conn(0x7f470809dac0 msgr2=0x7f470809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 --2- 10.20.193.51:0/3849542242 >> v2:10.20.193.142:3300/0 conn(0x7f470809dac0 0x7f470809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 -- 10.20.193.51:0/3849542242 >> v1:10.20.193.51:6789/0 conn(0x7f47080a3bb0 legacy=0x7f470809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 monclient: found mon.noname-b 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.383+0000 7f470e671640 1 -- 10.20.193.51:0/3849542242 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470809ce60 con 0x7f47080a0110 2026-02-17T11:46:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470e671640 1 -- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 msgr2=0x7f470813c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470e671640 1 --2- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813c760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4704009d90 tx=0x7f470402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3f413ac8acda57 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 1 -- 10.20.193.51:0/3849542242 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470403c070 con 0x7f47080a0110 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: dump: 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 5 monclient: authenticate success, global_id 4469 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 1 -- 10.20.193.51:0/3849542242 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4704037440 con 0x7f47080a0110 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 1 -- 10.20.193.51:0/3849542242 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704037810 con 0x7f47080a0110 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 4 set_mon_vals no callback set 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f470ce6e640 10 monclient: dump: 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.389 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 10 monclient: shutdown 2026-02-17T11:46:26.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 -- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 msgr2=0x7f470813c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 --2- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813c760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4704009d90 tx=0x7f470402f190 comp rx=0 tx=0).stop 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 -- 10.20.193.51:0/3849542242 shutdown_connections 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 --2- 10.20.193.51:0/3849542242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813c760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 --2- 10.20.193.51:0/3849542242 >> v2:10.20.193.142:3300/0 conn(0x7f470809dac0 0x7f470809fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 -- 10.20.193.51:0/3849542242 >> 10.20.193.51:0/3849542242 conn(0x7f47080a30c0 msgr2=0x7f47080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 -- 10.20.193.51:0/3849542242 shutdown_connections 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.386+0000 7f47100fb640 1 -- 10.20.193.51:0/3849542242 wait complete. 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient: monmap: 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 Processor -- start 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 -- start start 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient: init 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f470809dac0 0x7f470813c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-a con 0x7f470809dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-c con 0x7f47080a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47080a3bb0 0x7f470813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): picked mon.noname-b con 0x7f47080a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f470809a880 con 0x7f470809dac0 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47080a0540 con 0x7f47080a3bb0 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f470813cca0 con 0x7f47080a0110 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f47100fb640 10 monclient(hunting): authenticate will time out at 674.006692s 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43324/0 (socket says 10.20.193.51:43324) 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f470809dac0 0x7f470813c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 -- 10.20.193.51:0/1628097614 learned_addr learned my addr 10.20.193.51:0/1628097614 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): get_auth_request con 0x7f47080a0110 auth_method 0 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): get_auth_request con 0x7f470809dac0 auth_method 0 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient(hunting): handle_auth_done global_id 4472 payload 824 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47080a3bb0 msgr2=0x7f470813e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47080a3bb0 0x7f470813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f470809dac0 msgr2=0x7f470813c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f470809dac0 0x7f470813c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 monclient: found mon.noname-c 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.387+0000 7f470d66f640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470809f5d0 con 0x7f47080a0110 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470d66f640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 msgr2=0x7f470813dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470d66f640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813dcb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00e770 tx=0x7f46fc00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc017070 con 0x7f47080a0110 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: dump: 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc00cae0 con 0x7f47080a0110 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00f040 con 0x7f47080a0110 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 10 monclient: dump: 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f7fff640 4 set_mon_vals no callback set 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 5 monclient: authenticate success, global_id 4472 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 monclient: _renew_subs 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470812c580 con 0x7f47080a0110 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 monclient: _renew_subs 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f470812cb40 con 0x7f47080a0110 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 0x7f4708071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47080a3fc0 con 0x7f470813e730 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f46fc012050 con 0x7f47080a0110 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 0x7f4708071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient: get_auth_request con 0x7f470813e730 auth_method 0 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.390+0000 7f46f67fc640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f46d803dd60 0x7f46d8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.391+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 4811+0+0 (secure 0 0 0) 0x7f46fc052330 con 0x7f47080a0110 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.391+0000 7f470de70640 10 monclient(hunting): handle_auth_done global_id 4339 payload 824 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.391+0000 7f470de70640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f470813eb10 con 0x7f470813e730 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.391+0000 7f470e671640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f46d803dd60 0x7f46d8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.391+0000 7f470e671640 10 monclient: get_auth_request con 0x7f46d803dd60 auth_method 0 2026-02-17T11:46:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f470de70640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 msgr2=0x7f4708071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f470de70640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 0x7f4708071420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f800ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f800cbf0 con 0x7f470813e730 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 10 monclient: dump: 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f46f8019070 con 0x7f470813e730 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 msgr2=0x7f4708071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 0x7f4708071420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f800ef70 comp rx=0 tx=0).stop 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 msgr2=0x7f4708071420 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f46f67fc640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f470813e730 0x7f4708071420 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f800ef70 comp rx=0 tx=0).stop 2026-02-17T11:46:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.393+0000 7f470e671640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f46d803dd60 0x7f46d8040220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f470806c1c0 tx=0x7f4704031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f47100fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f47100fb640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 0x7f4708071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f47100fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f470813d100 con 0x7f4708071960 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 0x7f4708071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient: get_auth_request con 0x7f4708071960 auth_method 0 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.396+0000 7f470de70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.397+0000 7f470de70640 10 monclient(hunting): handle_auth_done global_id 4342 payload 824 2026-02-17T11:46:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.397+0000 7f470de70640 1 -- 10.20.193.51:0/1628097614 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f470813f550 con 0x7f4708071960 2026-02-17T11:46:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f470de70640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 msgr2=0x7f4708071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f470de70640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 0x7f4708071d70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f801e250 con 0x7f4708071960 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 10 monclient: dump: 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f46f801e250 con 0x7f4708071960 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 msgr2=0x7f4708071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 0x7f4708071d70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f8004a40 comp rx=0 tx=0).stop 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 msgr2=0x7f4708071d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f46f67fc640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4708071960 0x7f4708071d70 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eaa0 tx=0x7f46f8004a40 comp rx=0 tx=0).stop 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:26.401 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 69676, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:26.402 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.403 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.404 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:26.405 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f46d803dd60 msgr2=0x7f46d8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f46d803dd60 0x7f46d8040220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f470806c1c0 tx=0x7f4704031000 comp rx=0 tx=0).stop 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 10 monclient: shutdown 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 msgr2=0x7f470813dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 --2- 10.20.193.51:0/1628097614 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47080a0110 0x7f470813dcb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00e770 tx=0x7f46fc00ec40 comp rx=0 tx=0).stop 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f470e671640 1 -- 10.20.193.51:0/1628097614 reap_dead start 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f470e671640 1 -- 10.20.193.51:0/1628097614 reap_dead start 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 shutdown_connections 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 >> 10.20.193.51:0/1628097614 conn(0x7f47080a30c0 msgr2=0x7f47080a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 shutdown_connections 2026-02-17T11:46:26.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.399+0000 7f47100fb640 1 -- 10.20.193.51:0/1628097614 wait complete. 2026-02-17T11:46:26.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:26.406 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:46:26.406 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:46:26.432 INFO:tasks.rados.rados.0.trial142.stdout:156: finishing rollback tid 0 to trial14245205-5 2026-02-17T11:46:26.432 INFO:tasks.rados.rados.0.trial142.stdout:157: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: get_monmap_and_config 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: monmap: 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.472 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:26.472146+0000 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:26.472146+0000 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 Processor -- start 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 -- start start 2026-02-17T11:46:26.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: init 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 0x7fde4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-b con 0x7fde440a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fde440a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde4413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4406e140 con 0x7fde4413b760 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4409f910 con 0x7fde440a0750 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde4409ccd0 con 0x7fde440a3bb0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4c8e8640 10 monclient(hunting): authenticate will time out at 674.090876s 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4a65d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 0x7fde4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4ae5e640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fde4413b760 0x7fde4413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:43830/0 (socket says 10.20.193.51:43830) 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4ae5e640 1 -- 10.20.193.51:0/2112826539 learned_addr learned my addr 10.20.193.51:0/2112826539 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4a65d640 10 monclient(hunting): get_auth_request con 0x7fde440a3bb0 auth_method 0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4a65d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4a65d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.471+0000 7fde4a65d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient(hunting): handle_auth_done global_id 4475 payload 274 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 1 -- 10.20.193.51:0/2112826539 >> v1:10.20.193.142:6789/0 conn(0x7fde440a0750 legacy=0x7fde4409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 1 -- 10.20.193.51:0/2112826539 >> v1:10.20.193.51:6789/0 conn(0x7fde4413b760 legacy=0x7fde4413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 1 monclient: found mon.noname-b 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.472+0000 7fde4a65d640 1 -- 10.20.193.51:0/2112826539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4409eec0 con 0x7fde440a3bb0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4a65d640 1 -- 10.20.193.51:0/2112826539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 msgr2=0x7fde4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4a65d640 1 --2- 10.20.193.51:0/2112826539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 0x7fde4409dac0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde44069d60 tx=0x7fde3c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa67c8d77dca27c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 1 -- 10.20.193.51:0/2112826539 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03c070 con 0x7fde440a3bb0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: dump: 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 1 -- 10.20.193.51:0/2112826539 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c02fce0 con 0x7fde440a3bb0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4c8e8640 5 monclient: authenticate success, global_id 4475 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4c8e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 1 -- 10.20.193.51:0/2112826539 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c037660 con 0x7fde440a3bb0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4c8e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4c8e8640 4 set_mon_vals no callback set 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.474+0000 7fde4965b640 10 monclient: dump: 2026-02-17T11:46:26.476 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.477 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: shutdown 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2112826539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 msgr2=0x7fde4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2112826539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 0x7fde4409dac0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde44069d60 tx=0x7fde3c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2112826539 shutdown_connections 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2112826539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a3bb0 0x7fde4409dac0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2112826539 >> 10.20.193.51:0/2112826539 conn(0x7fde440a30c0 msgr2=0x7fde440a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2112826539 shutdown_connections 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2112826539 wait complete. 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: build_initial_monmap 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: monmap: 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 Processor -- start 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- start start 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: init 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-c con 0x7fde440a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 0x7fde441315c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-a con 0x7fde440a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 0x7fde44131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): picked mon.noname-b con 0x7fde4413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fde440a04b0 con 0x7fde440a3bb0 2026-02-17T11:46:26.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fde4409c850 con 0x7fde4413b760 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde4409e710 con 0x7fde440a0750 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.475+0000 7fde4c8e8640 10 monclient(hunting): authenticate will time out at 674.094973s 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43342/0 (socket says 10.20.193.51:43342) 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 -- 10.20.193.51:0/2501469337 learned_addr learned my addr 10.20.193.51:0/2501469337 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): get_auth_request con 0x7fde440a0750 auth_method 0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 0x7fde441315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): get_auth_request con 0x7fde440a3bb0 auth_method 0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4ae5e640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 0x7fde44131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient(hunting): handle_auth_done global_id 4478 payload 824 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 -- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 msgr2=0x7fde44131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 0x7fde44131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 -- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 msgr2=0x7fde441315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 0x7fde441315c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient: _finish_hunting 0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 monclient: found mon.noname-c 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4a65d640 1 -- 10.20.193.51:0/2501469337 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde44133100 con 0x7fde440a0750 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde49e5c640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 0x7fde441315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4ae5e640 10 monclient: get_auth_request con 0x7fde4413b760 auth_method 0 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.476+0000 7fde4ae5e640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 0x7fde44131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.478+0000 7fde4a65d640 1 -- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 msgr2=0x7fde44131080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:26.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.478+0000 7fde4a65d640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009820 tx=0x7fde3c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c046070 con 0x7fde440a0750 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: dump: 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: _finish_auth 0 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c041870 con 0x7fde440a0750 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 5 monclient: authenticate success, global_id 4478 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _renew_subs 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4409d7b0 con 0x7fde440a0750 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03c040 con 0x7fde440a0750 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde2effd640 10 monclient: dump: 2026-02-17T11:46:26.482 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde48e5a640 4 set_mon_vals no callback set 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _renew_subs 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441329b0 con 0x7fde440a0750 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.480+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4409dac0 con 0x7fde440a0750 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.481+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fde3c041c60 con 0x7fde440a0750 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.481+0000 7fde2effd640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 0x7fde14040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.481+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 4811+0+0 (secure 0 0 0) 0x7fde3c077e90 con 0x7fde440a0750 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.481+0000 7fde49e5c640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 0x7fde14040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:26.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.481+0000 7fde49e5c640 10 monclient: get_auth_request con 0x7fde1403dd60 auth_method 0 2026-02-17T11:46:26.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.483+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde4409d7b0 con 0x7fde440a0750 2026-02-17T11:46:26.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.483+0000 7fde2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:26.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.483+0000 7fde2effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:26.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.484+0000 7fde49e5c640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 0x7fde14040220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde44132630 tx=0x7fde30007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:26.496 INFO:tasks.rados.rados.0.trial142.stdout:156: finishing rollback tid 1 to trial14245205-5 2026-02-17T11:46:26.496 INFO:tasks.rados.rados.0.trial142.stdout:156: finishing rollback tid 2 to trial14245205-5 2026-02-17T11:46:26.496 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 52 (ObjNum 52 snap 0 seq_num 52) dirty exists 2026-02-17T11:46:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.597+0000 7fde4c8e8640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:46:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.597+0000 7fde4c8e8640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:46:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.597+0000 7fde4c8e8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:46:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.597+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fde441344e0 con 0x7fde440a0750 2026-02-17T11:46:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.598+0000 7fde2effd640 1 -- 10.20.193.51:0/2501469337 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fde3c037e10 con 0x7fde440a0750 2026-02-17T11:46:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.598+0000 7fde2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:46:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.598+0000 7fde2effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=8,config=2,health=12,kv=12,logm=66} crc {auth=2922647891,config=692619927,health=861809967,kv=643764953,logm=2516742661}) 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2218939389,config=692619927,health=906682742,kv=643764953,logm=560646387}) 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=8,config=2,health=12,kv=12,logm=66} crc {auth=2922647891,config=692619927,health=861809967,kv=643764953,logm=2516742661}) 2026-02-17T11:46:26.601 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.598+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=9,config=2,health=10,kv=12,logm=67} crc {auth=349005415,config=692619927,health=3160794046,kv=643764953,logm=1850057232}) 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 msgr2=0x7fde14040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 0x7fde14040220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde44132630 tx=0x7fde30007f30 comp rx=0 tx=0).stop 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 10 monclient: shutdown 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 msgr2=0x7fde44131080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009820 tx=0x7fde3c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 shutdown_connections 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1403dd60 0x7fde14040220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4413b760 0x7fde44131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde440a3bb0 0x7fde441315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 --2- 10.20.193.51:0/2501469337 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde440a0750 0x7fde44131080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 >> 10.20.193.51:0/2501469337 conn(0x7fde440a30c0 msgr2=0x7fde44139ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 shutdown_connections 2026-02-17T11:46:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:26.599+0000 7fde4c8e8640 1 -- 10.20.193.51:0/2501469337 wait complete. 2026-02-17T11:46:26.604 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.604 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=395418139}) 2026-02-17T11:46:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=219020639}) 2026-02-17T11:46:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=395418139}) 2026-02-17T11:46:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.600+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1317334043}) 2026-02-17T11:46:26.609 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:46:26.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358616843}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1776361484}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358616843}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4225866303}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=938844814}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2036858700}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=938844814}) 2026-02-17T11:46:26.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.713+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=902370915}) 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=5,osdmap=30} crc {logm=2564123395,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3354876321,mon_config_key=1590488355,monmap=263989209,osd_metadata=2265321291,osd_pg_creating=1873612897,osd_snap=1298927099,osdmap=1318248849}) 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=21,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=5,osdmap=29} crc {logm=2540757964,mdsmap=1949618592,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3354876321,mon_config_key=829000412,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1873612897,osd_snap=1298927099,osdmap=3525793721}) 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=5,osdmap=30} crc {logm=2564123395,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3354876321,mon_config_key=1590488355,monmap=263989209,osd_metadata=2265321291,osd_pg_creating=1873612897,osd_snap=1298927099,osdmap=1318248849}) 2026-02-17T11:46:26.718 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.714+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=5,osdmap=30} crc {logm=1563842697,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3354876321,mon_config_key=829000412,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=1873612897,osd_snap=1298927099,osdmap=3182903196}) 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=57} crc {osdmap=1388503117}) 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=1077174583}) 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=57} crc {osdmap=1388503117}) 2026-02-17T11:46:26.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:46:26.715+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=52} crc {osdmap=474867991}) 2026-02-17T11:46:26.908 INFO:tasks.rados.rados.0.trial142.stdout:143: done (11 left) 2026-02-17T11:46:26.913 INFO:tasks.rados.rados.0.trial142.stdout:145: done (10 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:146: done (9 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:147: done (8 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:149: done (7 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:150: done (6 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:151: done (5 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:152: done (4 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:154: done (3 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:156: done (2 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:157: done (1 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:158: done (0 left) 2026-02-17T11:46:26.914 INFO:tasks.rados.rados.0.trial142.stdout:159: write oid 10 current snap is 16 2026-02-17T11:46:26.915 INFO:tasks.rados.rados.0.trial142.stdout:159: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-17T11:46:26.915 INFO:tasks.rados.rados.0.trial142.stdout:159: writing trial14245205-10 from 645402 to 1196699 tid 1 2026-02-17T11:46:26.916 INFO:tasks.rados.rados.0.trial142.stdout:159: writing trial14245205-10 from 1749569 to 2241924 tid 2 2026-02-17T11:46:26.921 INFO:tasks.rados.rados.0.trial142.stdout:159: writing trial14245205-10 from 2845789 to 3445402 tid 3 2026-02-17T11:46:26.921 INFO:tasks.rados.rados.0.trial142.stdout:160: rollback oid 21 current snap is 16 2026-02-17T11:46:26.921 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 14 2026-02-17T11:46:26.921 INFO:tasks.rados.rados.0.trial142.stdout:159: finishing write tid 1 to trial14245205-10 2026-02-17T11:46:26.922 INFO:tasks.rados.rados.0.trial142.stdout:159: finishing write tid 2 to trial14245205-10 2026-02-17T11:46:26.922 INFO:tasks.rados.rados.0.trial142.stdout:161: read oid 24 snap -1 2026-02-17T11:46:26.922 INFO:tasks.rados.rados.0.trial142.stdout:161: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-17T11:46:26.922 INFO:tasks.rados.rados.0.trial142.stdout:162: snap_create 2026-02-17T11:46:26.923 INFO:tasks.rados.rados.0.trial142.stdout:159: finishing write tid 3 to trial14245205-10 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: finishing write tid 4 to trial14245205-10 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: finishing write tid 5 to trial14245205-10 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: oid 10 updating version 0 to 64 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: oid 10 updating version 64 to 65 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: oid 10 version 65 is already newer than 63 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:159: oid 10 version 65 is already newer than 62 2026-02-17T11:46:26.924 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 65 (ObjNum 86 snap 16 seq_num 86) dirty exists 2026-02-17T11:46:26.925 INFO:tasks.rados.rados.0.trial142.stdout:159: left oid 10 (ObjNum 86 snap 16 seq_num 86) 2026-02-17T11:46:26.925 INFO:tasks.rados.rados.0.trial142.stdout:160: finishing rollback tid 0 to trial14245205-21 2026-02-17T11:46:26.925 INFO:tasks.rados.rados.0.trial142.stdout:160: finishing rollback tid 1 to trial14245205-21 2026-02-17T11:46:26.925 INFO:tasks.rados.rados.0.trial142.stdout:160: finishing rollback tid 2 to trial14245205-21 2026-02-17T11:46:26.925 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 49 (ObjNum 60 snap 5 seq_num 60) dirty exists 2026-02-17T11:46:26.926 INFO:tasks.rados.rados.0.trial142.stdout:161: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-17T11:46:27.610 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:46:27.610 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:46:27.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 10 monclient: get_monmap_and_config 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 10 monclient: monmap: 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:27.676281+0000 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:27.676281+0000 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:27.680 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 1 Processor -- start 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 1 -- start start 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.675+0000 7f70e8f07640 10 monclient: init 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e40a5280 0x7f70e40a5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-b con 0x7f70e40a5280 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f70e40a3150 0x7f70e40a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-a con 0x7f70e40a3150 addr v2:10.20.193.51:3300/0 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f70e4138040 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e40a2750 con 0x7f70e4138040 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f70e40a2220 con 0x7f70e40a3150 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40a60e0 con 0x7f70e40a5280 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e8f07640 10 monclient(hunting): authenticate will time out at 675.295100s 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f70e40a3150 0x7f70e40a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e40a5280 0x7f70e40a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f70e40a3150 0x7f70e40a5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45228/0 (socket says 10.20.193.51:45228) 2026-02-17T11:46:27.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3692104060 learned_addr learned my addr 10.20.193.51:0/3692104060 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): get_auth_request con 0x7f70e40a3150 auth_method 0 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): get_auth_request con 0x7f70e40a5280 auth_method 0 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_done global_id 34119 payload 274 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e40a5280 msgr2=0x7f70e40a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 --2- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e40a5280 0x7f70e40a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3692104060 >> v1:10.20.193.142:6789/0 conn(0x7f70e4138040 legacy=0x7f70e41384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.676+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3692104060 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e40a14f0 con 0x7f70e40a3150 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.678+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a3150 msgr2=0x7f70e40a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.678+0000 7f70e2ffd640 1 --2- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a3150 0x7f70e40a5ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009970 tx=0x7f70d402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f09ddc7e559d214 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 1 -- 10.20.193.51:0/3692104060 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d403c070 con 0x7f70e40a3150 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: dump: 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 1 -- 10.20.193.51:0/3692104060 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d402fd70 con 0x7f70e40a3150 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 5 monclient: authenticate success, global_id 34119 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 1 -- 10.20.193.51:0/3692104060 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4037660 con 0x7f70e40a3150 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 4 set_mon_vals no callback set 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e27fc640 10 monclient: dump: 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.693 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 10 monclient: shutdown 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 -- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a3150 msgr2=0x7f70e40a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a3150 0x7f70e40a5ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009970 tx=0x7f70d402eef0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 -- 10.20.193.51:0/3692104060 shutdown_connections 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a3150 0x7f70e40a5ba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3692104060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e40a5280 0x7f70e40a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 -- 10.20.193.51:0/3692104060 >> 10.20.193.51:0/3692104060 conn(0x7f70e40aaca0 msgr2=0x7f70e40ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 -- 10.20.193.51:0/3692104060 shutdown_connections 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 1 -- 10.20.193.51:0/3692104060 wait complete. 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.679+0000 7f70e8f07640 10 monclient: monmap: 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:27.695 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 Processor -- start 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 -- start start 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient: init 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:46:27.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f70e40a3150 0x7f70e41371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-b con 0x7f70e40a3150 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-a con 0x7f70e40a5280 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e4138040 0x7f70e4120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): picked mon.noname-c con 0x7f70e4138040 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40a0b40 con 0x7f70e40a5280 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40a6420 con 0x7f70e40a3150 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40a0cc0 con 0x7f70e4138040 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e8f07640 10 monclient(hunting): authenticate will time out at 675.299529s 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45234/0 (socket says 10.20.193.51:45234) 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3793801363 learned_addr learned my addr 10.20.193.51:0/3793801363 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): get_auth_request con 0x7f70e40a5280 auth_method 0 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e4138040 0x7f70e4120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): get_auth_request con 0x7f70e4138040 auth_method 0 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient(hunting): handle_auth_done global_id 34122 payload 824 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e37fe640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f70e40a3150 0x7f70e41371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e4138040 msgr2=0x7f70e4120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e4138040 0x7f70e4120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f70e40a3150 msgr2=0x7f70e41371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f70e40a3150 0x7f70e41371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.680+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3793801363 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e40a8f90 con 0x7f70e40a5280 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e2ffd640 1 -- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 msgr2=0x7f70e4137730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e2ffd640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009970 tx=0x7f70d4004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d403c040 con 0x7f70e40a5280 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 10 monclient: dump: 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d4047070 con 0x7f70e40a5280 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e8f07640 5 monclient: authenticate success, global_id 34122 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e8f07640 10 monclient: _renew_subs 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e8f07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.682+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e4074430 con 0x7f70e40a5280 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4042670 con 0x7f70e40a5280 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 10 monclient: dump: 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.702 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e1ffb640 4 set_mon_vals no callback set 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 10 monclient: _renew_subs 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e41245f0 con 0x7f70e40a5280 2026-02-17T11:46:27.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e40a5e20 con 0x7f70e40a5280 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f70d4042810 con 0x7f70e40a5280 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 0x7f70b4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.683+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4783+0+0 (secure 0 0 0) 0x7f70d40776e0 con 0x7f70e40a5280 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.684+0000 7f70e37fe640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 0x7f70b4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.684+0000 7f70e37fe640 10 monclient: get_auth_request con 0x7f70b403dd60 auth_method 0 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.686+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f70e40a5e20 con 0x7f70e40a5280 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.686+0000 7f70bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.686+0000 7f70bffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:27.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.686+0000 7f70e37fe640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 0x7f70b4040220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009b10 tx=0x7f70d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70e8f07640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70e8f07640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70e8f07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f70e4138c10 con 0x7f70e40a5280 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70bffff640 1 -- 10.20.193.51:0/3793801363 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f70d4035340 con 0x7f70e40a5280 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70bffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.801+0000 7f70bffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:27.804 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 msgr2=0x7f70b4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 0x7f70b4040220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009b10 tx=0x7f70d0008040 comp rx=0 tx=0).stop 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 10 monclient: shutdown 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 msgr2=0x7f70e4137730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009970 tx=0x7f70d4004830 comp rx=0 tx=0).stop 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 shutdown_connections 2026-02-17T11:46:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70b403dd60 0x7f70b4040220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f70e4138040 0x7f70e4120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f70e40a5280 0x7f70e4137730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 --2- 10.20.193.51:0/3793801363 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f70e40a3150 0x7f70e41371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 >> 10.20.193.51:0/3793801363 conn(0x7f70e40aaca0 msgr2=0x7f70e40a7310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 shutdown_connections 2026-02-17T11:46:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.802+0000 7f70e8f07640 1 -- 10.20.193.51:0/3793801363 wait complete. 2026-02-17T11:46:27.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:46:27.812 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:46:27.812 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:46:27.812 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 10 monclient: get_monmap_and_config 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 10 monclient: monmap: 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:27.880491+0000 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:27.880491+0000 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:27.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 1 Processor -- start 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 1 -- start start 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.879+0000 7f553d276640 10 monclient: init 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): picked mon.noname-b con 0x7f55380a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f55380a0750 0x7f553809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): picked mon.noname-c con 0x7f55380a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 0x7f553813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): picked mon.noname-a con 0x7f553809e540 addr v2:10.20.193.51:3300/0 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f55380a3f90 con 0x7f553809e540 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f553806e140 con 0x7f55380a0750 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f553809f910 con 0x7f55380a3bb0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f553d276640 10 monclient(hunting): authenticate will time out at 675.499257s 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43364/0 (socket says 10.20.193.51:43364) 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 0x7f553813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 -- 10.20.193.51:0/226531571 learned_addr learned my addr 10.20.193.51:0/226531571 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): get_auth_request con 0x7f55380a3bb0 auth_method 0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): get_auth_request con 0x7f553809e540 auth_method 0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536575640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.142:3300/0 conn(0x7f55380a0750 0x7f553809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536575640 10 monclient(hunting): get_auth_request con 0x7f55380a0750 auth_method 0 2026-02-17T11:46:27.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient(hunting): handle_auth_done global_id 4487 payload 274 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 -- 10.20.193.51:0/226531571 >> v2:10.20.193.142:3300/0 conn(0x7f55380a0750 msgr2=0x7f553809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.142:3300/0 conn(0x7f55380a0750 0x7f553809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 -- 10.20.193.51:0/226531571 >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 msgr2=0x7f553813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 0x7f553813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 monclient: found mon.noname-b 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5536d76640 1 -- 10.20.193.51:0/226531571 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553809ccd0 con 0x7f55380a3bb0 2026-02-17T11:46:27.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.880+0000 7f5537577640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 0x7f553813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5536d76640 1 -- 10.20.193.51:0/226531571 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 msgr2=0x7f553809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5536d76640 1 --2- 10.20.193.51:0/226531571 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5538069d60 tx=0x7f552c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91d09237e152d8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 1 -- 10.20.193.51:0/226531571 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c03c070 con 0x7f55380a3bb0 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: dump: 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 1 -- 10.20.193.51:0/226531571 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c02fca0 con 0x7f55380a3bb0 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 5 monclient: authenticate success, global_id 4487 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 1 -- 10.20.193.51:0/226531571 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c037660 con 0x7f55380a3bb0 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 4 set_mon_vals no callback set 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f5535d74640 10 monclient: dump: 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.888 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 10 monclient: shutdown 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 -- 10.20.193.51:0/226531571 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 msgr2=0x7f553809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 --2- 10.20.193.51:0/226531571 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5538069d60 tx=0x7f552c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 -- 10.20.193.51:0/226531571 shutdown_connections 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.51:3300/0 conn(0x7f553809e540 0x7f553813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 --2- 10.20.193.51:0/226531571 >> v2:10.20.193.142:3300/0 conn(0x7f55380a0750 0x7f553809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 --2- 10.20.193.51:0/226531571 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f55380a3bb0 0x7f553809dac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 -- 10.20.193.51:0/226531571 >> 10.20.193.51:0/226531571 conn(0x7f55380a30c0 msgr2=0x7f55380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 -- 10.20.193.51:0/226531571 shutdown_connections 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.883+0000 7f553d276640 1 -- 10.20.193.51:0/226531571 wait complete. 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient: monmap: 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:27.889 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 Processor -- start 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 -- start start 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient: init 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 0x7f553808d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): picked mon.noname-c con 0x7f553809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 0x7f553808dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): picked mon.noname-a con 0x7f55380a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f55380a3bb0 0x7f55381cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): picked mon.noname-b con 0x7f55380a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f55380a04b0 con 0x7f55380a0750 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f553809c850 con 0x7f55380a3bb0 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f553813cca0 con 0x7f553809e540 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f553d276640 10 monclient(hunting): authenticate will time out at 675.503473s 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 0x7f553808d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 0x7f553808dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 0x7f553808d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43380/0 (socket says 10.20.193.51:43380) 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 1 -- 10.20.193.51:0/389964569 learned_addr learned my addr 10.20.193.51:0/389964569 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): get_auth_request con 0x7f55380a0750 auth_method 0 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): get_auth_request con 0x7f553809e540 auth_method 0 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient(hunting): handle_auth_done global_id 34128 payload 824 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 msgr2=0x7f553808d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 0x7f553808d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f55380a3bb0 msgr2=0x7f55381cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f55380a3bb0 0x7f55381cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 monclient: found mon.noname-a 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536575640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553809d7b0 con 0x7f55380a0750 2026-02-17T11:46:27.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.884+0000 7f5536d76640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f553809e540 0x7f553808d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:46:27.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f5536575640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 msgr2=0x7f553808dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f5536575640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 0x7f553808dde0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f552000e7e0 tx=0x7f552000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017020 con 0x7f55380a0750 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: dump: 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520004440 con 0x7f55380a0750 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f553d276640 5 monclient: authenticate success, global_id 34128 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f553d276640 10 monclient: _renew_subs 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f553d276640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55380a2e70 con 0x7f55380a0750 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f55380a0750 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f55177fe640 10 monclient: dump: 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.886+0000 7f5535573640 4 set_mon_vals no callback set 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 10 monclient: _renew_subs 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553813c9b0 con 0x7f55380a0750 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 0x7f55381cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f553808fdf0 con 0x7f553808e320 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5520012050 con 0x7f55380a0750 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 0x7f55381cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient: get_auth_request con 0x7f553808e320 auth_method 0 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 10 monclient(hunting): handle_auth_done global_id 34131 payload 824 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5536d76640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f553809dac0 con 0x7f553808e320 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f55177fe640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f550403dd10 0x7f55040401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4783+0+0 (secure 0 0 0) 0x7f5520052360 con 0x7f55380a0750 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5537577640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f550403dd10 0x7f55040401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.887+0000 7f5537577640 10 monclient: get_auth_request con 0x7f550403dd10 auth_method 0 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f5536d76640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 msgr2=0x7f55381cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f5536d76640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 0x7f55381cd3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f552c02eea0 tx=0x7f552c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c045070 con 0x7f553808e320 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f55177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f55177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.889+0000 7f55177fe640 10 monclient: dump: 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f552c02fe50 con 0x7f553808e320 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 msgr2=0x7f55381cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 0x7f55381cd3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f552c02eea0 tx=0x7f552c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 msgr2=0x7f55381cd3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f55177fe640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f553808e320 0x7f55381cd3c0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f552c02eea0 tx=0x7f552c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.890+0000 7f5537577640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f550403dd10 0x7f55040401d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5538098470 tx=0x7f552800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f553d276640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f553d276640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 0x7f55381d81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f553d276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f55381cdd10 con 0x7f55381cd900 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 0x7f55381d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient: get_auth_request con 0x7f55381cd900 auth_method 0 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 10 monclient(hunting): handle_auth_done global_id 34134 payload 824 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.893+0000 7f5536d76640 1 -- 10.20.193.51:0/389964569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5538090510 con 0x7f55381cd900 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.895+0000 7f5536d76640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 msgr2=0x7f55381d81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.895+0000 7f5536d76640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 0x7f55381d81f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55380683e0 tx=0x7f552c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c045040 con 0x7f55381cd900 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 10 monclient: dump: 2026-02-17T11:46:27.898 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f552c04aaf0 con 0x7f55381cd900 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 msgr2=0x7f55381d81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 0x7f55381d81f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55380683e0 tx=0x7f552c009340 comp rx=0 tx=0).stop 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 msgr2=0x7f55381d81f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f55177fe640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55381cd900 0x7f55381d81f0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55380683e0 tx=0x7f552c009340 comp rx=0 tx=0).stop 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:27.899 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 8541, 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:27.900 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:27.901 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.902 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:27.904 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:27.905 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:27.906 INFO:tasks.rados.rados.0.trial142.stdout:159: done (3 left) 2026-02-17T11:46:27.906 INFO:tasks.rados.rados.0.trial142.stdout:160: done (2 left) 2026-02-17T11:46:27.906 INFO:tasks.rados.rados.0.trial142.stdout:161: done (1 left) 2026-02-17T11:46:27.906 INFO:tasks.rados.rados.0.trial142.stdout:162: done (0 left) 2026-02-17T11:46:27.906 INFO:tasks.rados.rados.0.trial142.stdout:163: snap_create 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f550403dd10 msgr2=0x7f55040401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f550403dd10 0x7f55040401d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5538098470 tx=0x7f552800b040 comp rx=0 tx=0).stop 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 10 monclient: shutdown 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 msgr2=0x7f553808dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 --2- 10.20.193.51:0/389964569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f55380a0750 0x7f553808dde0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f552000e7e0 tx=0x7f552000ecb0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f5537577640 1 -- 10.20.193.51:0/389964569 reap_dead start 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f5537577640 1 -- 10.20.193.51:0/389964569 reap_dead start 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 shutdown_connections 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 >> 10.20.193.51:0/389964569 conn(0x7f55380a30c0 msgr2=0x7f5538072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 shutdown_connections 2026-02-17T11:46:27.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.896+0000 7f553d276640 1 -- 10.20.193.51:0/389964569 wait complete. 2026-02-17T11:46:27.906 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:27.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:46:27.907 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 10 monclient: get_monmap_and_config 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 10 monclient: monmap: 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:27.974438+0000 2026-02-17T11:46:27.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:27.974438+0000 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:27.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 1 Processor -- start 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 1 -- start start 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.973+0000 7fd1f372c640 10 monclient: init 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 0x7fd1ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-a con 0x7fd1ec0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd1ec0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd1ec13b760 0x7fd1ec13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-c con 0x7fd1ec13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec06e140 con 0x7fd1ec0a0750 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec09f910 con 0x7fd1ec0a3bb0 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec09ccd0 con 0x7fd1ec13b760 2026-02-17T11:46:27.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f372c640 10 monclient(hunting): authenticate will time out at 675.593205s 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 0x7fd1ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 0x7fd1ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45286/0 (socket says 10.20.193.51:45286) 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 1 -- 10.20.193.51:0/33091026 learned_addr learned my addr 10.20.193.51:0/33091026 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request con 0x7fd1ec0a3bb0 auth_method 0 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/33091026 >> v2:10.20.193.142:3300/0 conn(0x7fd1ec13b760 0x7fd1ec13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): get_auth_request con 0x7fd1ec13b760 auth_method 0 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_done global_id 4348 payload 274 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/33091026 >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 msgr2=0x7fd1ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/33091026 >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 0x7fd1ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/33091026 >> v1:10.20.193.51:6789/0 conn(0x7fd1ec0a0750 legacy=0x7fd1ec09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 monclient: found mon.noname-c 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:46:27.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.974+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/33091026 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec09eec0 con 0x7fd1ec13b760 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/33091026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec13b760 msgr2=0x7fd1ec13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/33091026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec13b760 0x7fd1ec13db50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec09f5f0 tx=0x7fd1e802f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c27bfe462af8aa37 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 1 -- 10.20.193.51:0/33091026 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e803c070 con 0x7fd1ec13b760 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: dump: 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 1 -- 10.20.193.51:0/33091026 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e8037440 con 0x7fd1ec13b760 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 5 monclient: authenticate success, global_id 4348 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 1 -- 10.20.193.51:0/33091026 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8037810 con 0x7fd1ec13b760 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 4 set_mon_vals no callback set 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1dbfff640 10 monclient: dump: 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 10 monclient: shutdown 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 -- 10.20.193.51:0/33091026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec13b760 msgr2=0x7fd1ec13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 --2- 10.20.193.51:0/33091026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec13b760 0x7fd1ec13db50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec09f5f0 tx=0x7fd1e802f130 comp rx=0 tx=0).stop 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 -- 10.20.193.51:0/33091026 shutdown_connections 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 --2- 10.20.193.51:0/33091026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec13b760 0x7fd1ec13db50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 --2- 10.20.193.51:0/33091026 >> v2:10.20.193.51:3300/0 conn(0x7fd1ec0a3bb0 0x7fd1ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 -- 10.20.193.51:0/33091026 >> 10.20.193.51:0/33091026 conn(0x7fd1ec0a30c0 msgr2=0x7fd1ec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 -- 10.20.193.51:0/33091026 shutdown_connections 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.977+0000 7fd1f372c640 1 -- 10.20.193.51:0/33091026 wait complete. 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient: build_initial_monmap 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient: monmap: 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:27.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 Processor -- start 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 -- start start 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient: init 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec0a0750 0x7fd1ec138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-c con 0x7fd1ec0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec0a3bb0 0x7fd1ec130b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-b con 0x7fd1ec0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 0x7fd1ec1310a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): picked mon.noname-a con 0x7fd1ec13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:27.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec0a04b0 con 0x7fd1ec13b760 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec09c850 con 0x7fd1ec0a3bb0 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec09e710 con 0x7fd1ec0a0750 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f372c640 10 monclient(hunting): authenticate will time out at 675.597577s 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 0x7fd1ec1310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 0x7fd1ec1310a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45298/0 (socket says 10.20.193.51:45298) 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 learned_addr learned my addr 10.20.193.51:0/1525248397 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): get_auth_request con 0x7fd1ec13b760 auth_method 0 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec0a0750 0x7fd1ec138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request con 0x7fd1ec0a0750 auth_method 0 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f0ca0640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec0a3bb0 0x7fd1ec130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient(hunting): handle_auth_done global_id 34140 payload 824 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec0a0750 msgr2=0x7fd1ec138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec0a0750 0x7fd1ec138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec0a3bb0 msgr2=0x7fd1ec130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1ec0a3bb0 0x7fd1ec130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient: _finish_hunting 0 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 monclient: found mon.noname-a 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.978+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec134810 con 0x7fd1ec13b760 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.980+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 msgr2=0x7fd1ec1310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.980+0000 7fd1f1ca2640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 0x7fd1ec1310a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1e802f640 tx=0x7fd1e8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e803c040 con 0x7fd1ec13b760 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: dump: 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 5 monclient: authenticate success, global_id 34140 2026-02-17T11:46:27.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e8048070 con 0x7fd1ec13b760 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 monclient: _renew_subs 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec0a20f0 con 0x7fd1ec13b760 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80375f0 con 0x7fd1ec13b760 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 10 monclient: dump: 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1daffd640 4 set_mon_vals no callback set 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 monclient: _renew_subs 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec1315e0 con 0x7fd1ec13b760 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 0x7fd1ec12da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec1335a0 con 0x7fd1ec12d690 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 0x7fd1ec12da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient: get_auth_request con 0x7fd1ec12d690 auth_method 0 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd1e80377d0 con 0x7fd1ec13b760 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_done global_id 4496 payload 824 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.981+0000 7fd1f14a1640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1ec09dac0 con 0x7fd1ec12d690 2026-02-17T11:46:27.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.982+0000 7fd1d9ffb640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1bc03dd10 0x7fd1bc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.982+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4783+0+0 (secure 0 0 0) 0x7fd1e8077fa0 con 0x7fd1ec13b760 2026-02-17T11:46:27.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.982+0000 7fd1f0ca0640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1bc03dd10 0x7fd1bc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.982+0000 7fd1f0ca0640 10 monclient: get_auth_request con 0x7fd1bc03dd10 auth_method 0 2026-02-17T11:46:27.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1f14a1640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 msgr2=0x7fd1ec12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1f14a1640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 0x7fd1ec12da70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc006fd0 tx=0x7fd1dc00f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc019070 con 0x7fd1ec12d690 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 10 monclient: dump: 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd1dc00fe80 con 0x7fd1ec12d690 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 msgr2=0x7fd1ec12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 0x7fd1ec12da70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc006fd0 tx=0x7fd1dc00f610 comp rx=0 tx=0).stop 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 msgr2=0x7fd1ec12da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1d9ffb640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12d690 0x7fd1ec12da70 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc006fd0 tx=0x7fd1dc00f610 comp rx=0 tx=0).stop 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.984+0000 7fd1f0ca0640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1bc03dd10 0x7fd1bc0401d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec133d30 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f372c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f372c640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 0x7fd1ec1d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f372c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec0a2640 con 0x7fd1ec12dfb0 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 0x7fd1ec1d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient: get_auth_request con 0x7fd1ec12dfb0 auth_method 0 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:27.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 10 monclient(hunting): handle_auth_done global_id 4499 payload 824 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.987+0000 7fd1f14a1640 1 -- 10.20.193.51:0/1525248397 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1ec09d7b0 con 0x7fd1ec12dfb0 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1f14a1640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 msgr2=0x7fd1ec1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1f14a1640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 0x7fd1ec1d98b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc01b000 tx=0x7fd1dc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc019040 con 0x7fd1ec12dfb0 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 10 monclient: dump: 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:27.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fd1dc003e10 con 0x7fd1ec12dfb0 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 msgr2=0x7fd1ec1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 0x7fd1ec1d98b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc01b000 tx=0x7fd1dc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 msgr2=0x7fd1ec1d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.989+0000 7fd1d9ffb640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1ec12dfb0 0x7fd1ec1d98b0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc01b000 tx=0x7fd1dc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 71308, 2026-02-17T11:46:27.999 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.000 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:28.001 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.002 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:28.004 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.006 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:28.007 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:28.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1bc03dd10 msgr2=0x7fd1bc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1bc03dd10 0x7fd1bc0401d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec133d30 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2026-02-17T11:46:28.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 10 monclient: shutdown 2026-02-17T11:46:28.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:28.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 msgr2=0x7fd1ec1310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 --2- 10.20.193.51:0/1525248397 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1ec13b760 0x7fd1ec1310a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1e802f640 tx=0x7fd1e8004b40 comp rx=0 tx=0).stop 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 reap_dead start 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f1ca2640 1 -- 10.20.193.51:0/1525248397 reap_dead start 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 shutdown_connections 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 >> 10.20.193.51:0/1525248397 conn(0x7fd1ec0a30c0 msgr2=0x7fd1ec139c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 shutdown_connections 2026-02-17T11:46:28.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:27.990+0000 7fd1f372c640 1 -- 10.20.193.51:0/1525248397 wait complete. 2026-02-17T11:46:28.009 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:28.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:46:28.009 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:46:28.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.075+0000 7f82eaaa0640 10 monclient: get_monmap_and_config 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.075+0000 7f82eaaa0640 10 monclient: build_initial_monmap 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.075+0000 7f82eaaa0640 10 monclient: monmap: 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:28.076724+0000 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:28.076724+0000 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 Processor -- start 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 -- start start 2026-02-17T11:46:28.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient: init 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f82e40a3bb0 0x7f82e409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-c con 0x7f82e40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f82e409dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-b con 0x7f82e40a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e406e140 con 0x7f82e409dac0 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f82e409aed0 con 0x7f82e40a3bb0 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f82e409caa0 con 0x7f82e40a0110 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82eaaa0640 10 monclient(hunting): authenticate will time out at 675.695518s 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82dbfff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f82e409dac0 0x7f82e409fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:43860/0 (socket says 10.20.193.51:43860) 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82dbfff640 1 -- 10.20.193.51:0/1348188606 learned_addr learned my addr 10.20.193.51:0/1348188606 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 --2- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): get_auth_request con 0x7f82e40a0110 auth_method 0 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e8815640 1 --2- 10.20.193.51:0/1348188606 >> v2:10.20.193.142:3300/0 conn(0x7f82e40a3bb0 0x7f82e409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e8815640 10 monclient(hunting): get_auth_request con 0x7f82e40a3bb0 auth_method 0 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e8815640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e8815640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e8815640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient(hunting): handle_auth_done global_id 4502 payload 274 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 -- 10.20.193.51:0/1348188606 >> v2:10.20.193.142:3300/0 conn(0x7f82e40a3bb0 msgr2=0x7f82e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 --2- 10.20.193.51:0/1348188606 >> v2:10.20.193.142:3300/0 conn(0x7f82e40a3bb0 0x7f82e409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 -- 10.20.193.51:0/1348188606 >> v1:10.20.193.51:6789/0 conn(0x7f82e409dac0 legacy=0x7f82e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient: _finish_hunting 0 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 monclient: found mon.noname-b 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:46:28.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.076+0000 7f82e9016640 1 -- 10.20.193.51:0/1348188606 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e409ce60 con 0x7f82e40a0110 2026-02-17T11:46:28.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82e9016640 1 -- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 msgr2=0x7f82e413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82e9016640 1 --2- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e413c760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009d90 tx=0x7f82e002f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26c44715a55560d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 1 -- 10.20.193.51:0/1348188606 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e003c070 con 0x7f82e40a0110 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: dump: 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: _finish_auth 0 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:46:28.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 1 -- 10.20.193.51:0/1348188606 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e0037440 con 0x7f82e40a0110 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 5 monclient: authenticate success, global_id 4502 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 1 -- 10.20.193.51:0/1348188606 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0037810 con 0x7f82e40a0110 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82db7fe640 10 monclient: dump: 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 4 set_mon_vals no callback set 2026-02-17T11:46:28.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 10 monclient: shutdown 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 msgr2=0x7f82e413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e413c760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009d90 tx=0x7f82e002f190 comp rx=0 tx=0).stop 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1348188606 shutdown_connections 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1348188606 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e413c760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1348188606 >> v2:10.20.193.142:3300/0 conn(0x7f82e40a3bb0 0x7f82e409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1348188606 >> 10.20.193.51:0/1348188606 conn(0x7f82e40a30c0 msgr2=0x7f82e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1348188606 shutdown_connections 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.079+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1348188606 wait complete. 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient: build_initial_monmap 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient: monmap: 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:28.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 Processor -- start 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 -- start start 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient: init 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 0x7f82e408d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-a con 0x7f82e409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e408dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-c con 0x7f82e40a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e40a3bb0 0x7f82e408e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): picked mon.noname-b con 0x7f82e40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f82e409a880 con 0x7f82e409dac0 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40a0540 con 0x7f82e40a3bb0 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f82e413cca0 con 0x7f82e40a0110 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82eaaa0640 10 monclient(hunting): authenticate will time out at 675.699658s 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e408dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 0x7f82e408d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e408dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43420/0 (socket says 10.20.193.51:43420) 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 1 -- 10.20.193.51:0/1609510524 learned_addr learned my addr 10.20.193.51:0/1609510524 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): get_auth_request con 0x7f82e409dac0 auth_method 0 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): get_auth_request con 0x7f82e40a0110 auth_method 0 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e9016640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e40a3bb0 0x7f82e408e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e9016640 10 monclient(hunting): get_auth_request con 0x7f82e40a3bb0 auth_method 0 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e9016640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e9016640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e9016640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient(hunting): handle_auth_done global_id 34143 payload 824 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 msgr2=0x7f82e408dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e408dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e40a3bb0 msgr2=0x7f82e408e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e40a3bb0 0x7f82e408e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient: _finish_hunting 0 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 monclient: found mon.noname-a 2026-02-17T11:46:28.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82e8815640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e408fa80 con 0x7f82e409dac0 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.080+0000 7f82dbfff640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82e40a0110 0x7f82e408dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82e8815640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 msgr2=0x7f82e408d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82e8815640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 0x7f82e408d830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f82d400e810 tx=0x7f82d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4017070 con 0x7f82e409dac0 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: dump: 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: _finish_auth 0 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d400cae0 con 0x7f82e409dac0 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d400f040 con 0x7f82e409dac0 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82daffd640 4 set_mon_vals no callback set 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 10 monclient: dump: 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.094 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 5 monclient: authenticate success, global_id 34143 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 monclient: _renew_subs 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e40a19b0 con 0x7f82e409dac0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 monclient: _renew_subs 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e4091060 con 0x7f82e409dac0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f82d4012050 con 0x7f82e409dac0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 0x7f82e41cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40a3fc0 con 0x7f82e41cbe20 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82dbfff640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 0x7f82e41cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82d97fa640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82b403ffa0 0x7f82b4042460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82dbfff640 10 monclient: get_auth_request con 0x7f82e41cbe20 auth_method 0 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.083+0000 7f82dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4783+0+0 (secure 0 0 0) 0x7f82d40523e0 con 0x7f82e409dac0 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82e9016640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82b403ffa0 0x7f82b4042460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82e9016640 10 monclient: get_auth_request con 0x7f82b403ffa0 auth_method 0 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82dbfff640 10 monclient(hunting): handle_auth_done global_id 4357 payload 824 2026-02-17T11:46:28.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.084+0000 7f82dbfff640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82e4069830 con 0x7f82e41cbe20 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82dbfff640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 msgr2=0x7f82e41cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82dbfff640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 0x7f82e41cc200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82cc007fd0 tx=0x7f82cc00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00fe50 con 0x7f82e41cbe20 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 10 monclient: dump: 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.098 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82e9016640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82b403ffa0 0x7f82b4042460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82e406dc20 tx=0x7f82e0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f82cc00fe50 con 0x7f82e41cbe20 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 msgr2=0x7f82e41cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 0x7f82e41cc200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82cc007fd0 tx=0x7f82cc00f5a0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 msgr2=0x7f82e41cc200 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.086+0000 7f82d97fa640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cbe20 0x7f82e41cc200 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82cc007fd0 tx=0x7f82cc00f5a0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82eaaa0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 0x7f82e41d7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82eaaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82e4050ac0 con 0x7f82e41cc740 2026-02-17T11:46:28.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 0x7f82e41d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient: get_auth_request con 0x7f82e41cc740 auth_method 0 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 10 monclient(hunting): handle_auth_done global_id 4360 payload 824 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.090+0000 7f82dbfff640 1 -- 10.20.193.51:0/1609510524 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f82e4090020 con 0x7f82e41cc740 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82dbfff640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 msgr2=0x7f82e41d7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82dbfff640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 0x7f82e41d7170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82cc006fd0 tx=0x7f82cc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc006240 con 0x7f82e41cc740 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82d97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.092+0000 7f82d97fa640 10 monclient: dump: 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:28.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f82cc006240 con 0x7f82e41cc740 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 msgr2=0x7f82e41d7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 0x7f82e41d7170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82cc006fd0 tx=0x7f82cc004a40 comp rx=0 tx=0).stop 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 msgr2=0x7f82e41d7170 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82d97fa640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f82e41cc740 0x7f82e41d7170 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82cc006fd0 tx=0x7f82cc004a40 comp rx=0 tx=0).stop 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:28.101 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 10, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 71370, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.102 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.103 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:28.104 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.105 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.106 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.107 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.108 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:28.109 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:28.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82b403ffa0 msgr2=0x7f82b4042460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82b403ffa0 0x7f82b4042460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82e406dc20 tx=0x7f82e0033000 comp rx=0 tx=0).stop 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 10 monclient: shutdown 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82e9016640 1 -- 10.20.193.51:0/1609510524 reap_dead start 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 msgr2=0x7f82e408d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 0x7f82e408d830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f82d400e810 tx=0x7f82d400ece0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 shutdown_connections 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 --2- 10.20.193.51:0/1609510524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82e409dac0 0x7f82e408d830 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 >> 10.20.193.51:0/1609510524 conn(0x7f82e40a30c0 msgr2=0x7f82e406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 shutdown_connections 2026-02-17T11:46:28.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:28.093+0000 7f82eaaa0640 1 -- 10.20.193.51:0/1609510524 wait complete. 2026-02-17T11:46:28.111 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:46:28.111 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:46:28.111 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-17T11:46:28.111 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:46:28.112 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:46:28.112 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:46:28.112 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:46:28.121 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:46:28.121 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T11:46:28.121 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T11:46:28.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:46:43.122 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T11:46:43.123 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T11:46:43.123 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:46:43.123 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:46:43.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.190+0000 7f47851e4640 10 monclient: get_monmap_and_config 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.190+0000 7f47851e4640 10 monclient: build_initial_monmap 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.190+0000 7f47851e4640 10 monclient: monmap: 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:43.191591+0000 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:43.191591+0000 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:43.195 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 Processor -- start 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 -- start start 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient: init 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-b con 0x7f47800a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:43.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47800a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-a con 0x7f478013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478006e140 con 0x7f47800a0750 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f478009f910 con 0x7f478013b760 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f478009ccd0 con 0x7f47800a3bb0 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f47851e4640 10 monclient(hunting): authenticate will time out at 690.810396s 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477ed76640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 msgr2=0x7f478009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477ed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:43.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477e575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f47800a0750 0x7f478009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38236/0 (socket says 10.20.193.51:38236) 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477e575640 1 -- 10.20.193.51:0/1294300126 learned_addr learned my addr 10.20.193.51:0/1294300126 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54758/0 (socket says 10.20.193.51:54758) 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 10 monclient(hunting): get_auth_request con 0x7f478013b760 auth_method 0 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:43.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.191+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:43.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.193+0000 7f477e575640 1 -- 10.20.193.51:0/1294300126 >> v1:10.20.193.51:6789/0 conn(0x7f47800a0750 legacy=0x7f478009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:43.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 msgr2=0x7f478009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:43.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:46:43.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:43.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 10 monclient(hunting): get_auth_request con 0x7f478013b760 auth_method 0 2026-02-17T11:46:43.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:43.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.392+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:46:43.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 msgr2=0x7f478009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:43.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:46:43.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 10 monclient(hunting): get_auth_request con 0x7f478013b760 auth_method 0 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:46:43.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:43.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:43.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:43.792+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:46:44.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 msgr2=0x7f478009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 10 monclient(hunting): get_auth_request con 0x7f478013b760 auth_method 0 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:44.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:44.593+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:46:46.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): tick 2026-02-17T11:46:46.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 monclient(hunting): continuing hunt 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 msgr2=0x7f478009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47800a3bb0 0x7f478009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 msgr2=0x7f478013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.51:3300/0 conn(0x7f478013b760 0x7f478013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 -- 10.20.193.51:0/1294300126 >> v1:10.20.193.51:6789/0 conn(0x7f47800a0750 legacy=0x7f478009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient: _add_conns ranks=[4,1] 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:46.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): picked mon.noname-c con 0x7f4764003840 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f47640063b0 addr v1:10.20.193.142:6789/0 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 -- 10.20.193.51:0/1294300126 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478009eec0 con 0x7f47640063b0 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 1 -- 10.20.193.51:0/1294300126 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f478009f910 con 0x7f4764003840 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477cd72640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f4764003840 auth_method 0 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:46:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:46.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:46.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.191+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:46.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.192+0000 7f477e575640 1 -- 10.20.193.51:0/1294300126 >> v1:10.20.193.142:6789/0 conn(0x7f47640063b0 legacy=0x7f4764008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f4764003840 auth_method 0 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:46:46.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:46.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:46.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.392+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:46:46.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f4764003840 auth_method 0 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:46.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:46.793+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:46:47.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:47.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f4764003840 auth_method 0 2026-02-17T11:46:47.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:46:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:47.594+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393566729 0 0) 0x7f478009eec0 con 0x7f47640063b0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient(hunting): _negotiate 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient(hunting): my global_id is 4363 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c003620 con 0x7f47640063b0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 408337755 0 0) 0x7f476c003620 con 0x7f47640063b0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 msgr2=0x7f4764005cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 --2- 10.20.193.51:0/1294300126 >> v2:10.20.193.142:3300/0 conn(0x7f4764003840 0x7f4764005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476400b1c0 con 0x7f47640063b0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f4768003180 con 0x7f47640063b0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: dump: 2026-02-17T11:46:48.137 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 >> v1:10.20.193.142:6789/0 conn(0x7f47640063b0 legacy=0x7f4764008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 reap_dead start 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.134+0000 7f477dd74640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 0x7f476c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): picked mon.b con 0x7f476c003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c004900 0x7f476c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): picked mon.a con 0x7f476c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f476c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): picked mon.c con 0x7f476c005390 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f478009f910 con 0x7f476c004900 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f476c00c2e0 con 0x7f476c003ab0 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f476c00c4e0 con 0x7f476c005390 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477dd74640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477f577640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 msgr2=0x7f476c00bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477f577640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f476c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 0x7f476c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f476c003ab0 auth_method 0 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient(hunting): handle_auth_done global_id 4363 payload 293 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 msgr2=0x7f476c00bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f476c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c004900 msgr2=0x7f476c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:48.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c004900 0x7f476c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 monclient: found mon.b 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c003620 con 0x7f476c003ab0 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f477ed76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f47851e4640 5 monclient: authenticate success, global_id 4363 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.135+0000 7f47851e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477ed76640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 msgr2=0x7f476c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477ed76640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 0x7f476c003eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4774009e00 tx=0x7f477402ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d45b42b216b2d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774036070 con 0x7f476c003ab0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: dump: 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774030a00 con 0x7f476c003ab0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 1 -- 10.20.193.51:0/1294300126 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774009a00 con 0x7f476c003ab0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 4 set_mon_vals no callback set 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f477dd74640 10 monclient: dump: 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 10 monclient: shutdown 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 -- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 msgr2=0x7f476c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 0x7f476c003eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4774009e00 tx=0x7f477402ffd0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 -- 10.20.193.51:0/1294300126 shutdown_connections 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f476c00bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c004900 0x7f476c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 --2- 10.20.193.51:0/1294300126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c003ab0 0x7f476c003eb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 -- 10.20.193.51:0/1294300126 >> 10.20.193.51:0/1294300126 conn(0x7f47800a30c0 msgr2=0x7f47800a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 -- 10.20.193.51:0/1294300126 shutdown_connections 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.138+0000 7f47851e4640 1 -- 10.20.193.51:0/1294300126 wait complete. 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient: build_initial_monmap 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient: monmap: 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 Processor -- start 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 -- start start 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient: init 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-a con 0x7f476c003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 0x7f478009be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-b con 0x7f476c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f4780095b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): picked mon.noname-c con 0x7f476c005390 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f47800a04b0 con 0x7f476c003ab0 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f478009c850 con 0x7f476c004900 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f478009dac0 con 0x7f476c005390 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f47851e4640 10 monclient(hunting): authenticate will time out at 695.758737s 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477f577640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 msgr2=0x7f4780095b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477f577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f4780095b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49084/0 (socket says 10.20.193.51:49084) 2026-02-17T11:46:48.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 -- 10.20.193.51:0/4081148608 learned_addr learned my addr 10.20.193.51:0/4081148608 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): get_auth_request con 0x7f476c003ab0 auth_method 0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient(hunting): handle_auth_done global_id 34146 payload 824 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 -- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 msgr2=0x7f4780095b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f4780095b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 -- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 msgr2=0x7f478009be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477e575640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 0x7f478009be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 0x7f478009be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 monclient: found mon.noname-a 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477ed76640 1 -- 10.20.193.51:0/4081148608 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4780073f30 con 0x7f476c003ab0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477e575640 10 monclient: get_auth_request con 0x7f476c004900 auth_method 0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.139+0000 7f477e575640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 0x7f478009be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f477ed76640 1 -- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 msgr2=0x7f47801ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f477ed76640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4774030010 tx=0x7f4774005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774009a00 con 0x7f476c003ab0 2026-02-17T11:46:48.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: dump: 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774042840 con 0x7f476c003ab0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 5 monclient: authenticate success, global_id 34146 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _renew_subs 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47801cf260 con 0x7f476c003ab0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774042c30 con 0x7f476c003ab0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f477d573640 4 set_mon_vals no callback set 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f475f7fe640 10 monclient: dump: 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _renew_subs 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4780074460 con 0x7f476c003ab0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.142+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478009d7b0 con 0x7f476c003ab0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.143+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4774043070 con 0x7f476c003ab0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.143+0000 7f475f7fe640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 0x7f474c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.143+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4783+0+0 (secure 0 0 0) 0x7f4774077c50 con 0x7f476c003ab0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.143+0000 7f477e575640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 0x7f474c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.143+0000 7f477e575640 10 monclient: get_auth_request con 0x7f474c03dcc0 auth_method 0 2026-02-17T11:46:48.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.145+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4780073f30 con 0x7f476c003ab0 2026-02-17T11:46:48.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.145+0000 7f475f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.145+0000 7f475f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:48.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.145+0000 7f477e575640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 0x7f474c040180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47800a2f40 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f47851e4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:46:48.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f47851e4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:48.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f47851e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f478009eec0 con 0x7f476c003ab0 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f475f7fe640 1 -- 10.20.193.51:0/4081148608 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f477404c360 con 0x7f476c003ab0 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f475f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.262+0000 7f475f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":12,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 msgr2=0x7f474c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 0x7f474c040180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47800a2f40 tx=0x7f4768009040 comp rx=0 tx=0).stop 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 10 monclient: shutdown 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 msgr2=0x7f47801ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4774030010 tx=0x7f4774005e40 comp rx=0 tx=0).stop 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 shutdown_connections 2026-02-17T11:46:48.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f474c03dcc0 0x7f474c040180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f476c005390 0x7f4780095b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f476c004900 0x7f478009be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 --2- 10.20.193.51:0/4081148608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f476c003ab0 0x7f47801ced20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 >> 10.20.193.51:0/4081148608 conn(0x7f47800a30c0 msgr2=0x7f478013a980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 shutdown_connections 2026-02-17T11:46:48.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.263+0000 7f47851e4640 1 -- 10.20.193.51:0/4081148608 wait complete. 2026-02-17T11:46:48.272 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:46:48.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:46:48.272 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:46:48.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: get_monmap_and_config 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: build_initial_monmap 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: monmap: 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:48.338254+0000 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:48.338254+0000 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:48.339 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 1 Processor -- start 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 1 -- start start 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: init 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9f280a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 0x7f9f2813d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2813b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9f2813dcb0 0x7f9f281400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-c con 0x7f9f2813dcb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.337+0000 7f9f2cc1a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28135430 con 0x7f9f280a3bb0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2809a5c0 con 0x7f9f2813dcb0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2809b520 con 0x7f9f2813b380 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f2cc1a640 10 monclient(hunting): authenticate will time out at 695.957009s 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f25d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 msgr2=0x7f9f2813d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f25d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 0x7f9f2813d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9f280a3bb0 0x7f9f2809cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55996/0 (socket says 10.20.193.51:55996) 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26575640 1 -- 10.20.193.51:0/160030149 learned_addr learned my addr 10.20.193.51:0/160030149 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 --2- 10.20.193.51:0/160030149 >> v2:10.20.193.142:3300/0 conn(0x7f9f2813dcb0 0x7f9f281400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): get_auth_request con 0x7f9f2813dcb0 auth_method 0 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient(hunting): handle_auth_done global_id 4366 payload 274 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 -- 10.20.193.51:0/160030149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 msgr2=0x7f9f2813d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:46:48.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 --2- 10.20.193.51:0/160030149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 0x7f9f2813d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 -- 10.20.193.51:0/160030149 >> v1:10.20.193.51:6789/0 conn(0x7f9f280a3bb0 legacy=0x7f9f2809cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 monclient: found mon.noname-c 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:46:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.338+0000 7f9f26d76640 1 -- 10.20.193.51:0/160030149 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2809af60 con 0x7f9f2813dcb0 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.340+0000 7f9f26d76640 1 -- 10.20.193.51:0/160030149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 msgr2=0x7f9f281400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.340+0000 7f9f26d76640 1 --2- 10.20.193.51:0/160030149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281400a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9f28077290 tx=0x7f9f1802ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eefe646d42f98f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 1 -- 10.20.193.51:0/160030149 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1803c070 con 0x7f9f2813dcb0 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: dump: 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.342 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 5 monclient: authenticate success, global_id 4366 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 1 -- 10.20.193.51:0/160030149 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1802fcd0 con 0x7f9f2813dcb0 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 1 -- 10.20.193.51:0/160030149 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18037660 con 0x7f9f2813dcb0 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 4 set_mon_vals no callback set 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f25573640 10 monclient: dump: 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.343 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 10 monclient: shutdown 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/160030149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 msgr2=0x7f9f281400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/160030149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281400a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9f28077290 tx=0x7f9f1802ed70 comp rx=0 tx=0).stop 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/160030149 shutdown_connections 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/160030149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281400a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/160030149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2813b380 0x7f9f2813d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/160030149 >> 10.20.193.51:0/160030149 conn(0x7f9f280a30c0 msgr2=0x7f9f280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/160030149 shutdown_connections 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/160030149 wait complete. 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 10 monclient: build_initial_monmap 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 10 monclient: monmap: 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:48.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.341+0000 7f9f2cc1a640 1 Processor -- start 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 -- start start 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient: init 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f280a3bb0 0x7f9f281cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-c con 0x7f9f280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 0x7f9f2813a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-a con 0x7f9f2813b380 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2813dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28135040 con 0x7f9f2813b380 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28074ac0 con 0x7f9f2813dcb0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f281351c0 con 0x7f9f280a3bb0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f2cc1a640 10 monclient(hunting): authenticate will time out at 695.961282s 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f280a3bb0 msgr2=0x7f9f281cca10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f280a3bb0 0x7f9f281cca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 0x7f9f2813a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 0x7f9f2813a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49100/0 (socket says 10.20.193.51:49100) 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 -- 10.20.193.51:0/1589161429 learned_addr learned my addr 10.20.193.51:0/1589161429 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): get_auth_request con 0x7f9f2813b380 auth_method 0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26d76640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26d76640 10 monclient(hunting): get_auth_request con 0x7f9f2813dcb0 auth_method 0 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f26d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient(hunting): handle_auth_done global_id 34149 payload 824 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f280a3bb0 msgr2=0x7f9f281cca10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f280a3bb0 0x7f9f281cca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 msgr2=0x7f9f281cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2813dcb0 0x7f9f281cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 monclient: found mon.noname-a 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.342+0000 7f9f25d74640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2809d7b0 con 0x7f9f2813b380 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f25d74640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 msgr2=0x7f9f2813a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f25d74640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 0x7f9f2813a4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b7b0 tx=0x7f9f1000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10005270 con 0x7f9f2813b380 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: dump: 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.346 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f10010070 con 0x7f9f2813b380 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 5 monclient: authenticate success, global_id 34149 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 10 monclient: _renew_subs 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281386f0 con 0x7f9f2813b380 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10005630 con 0x7f9f2813b380 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f0effd640 10 monclient: dump: 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f24d72640 4 set_mon_vals no callback set 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 10 monclient: _renew_subs 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.344+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2813aa00 con 0x7f9f2813b380 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f2cc1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 0x7f9f281cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2809d560 con 0x7f9f28137790 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9f1000c520 con 0x7f9f2813b380 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 0x7f9f281cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient: get_auth_request con 0x7f9f28137790 auth_method 0 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 10 monclient(hunting): handle_auth_done global_id 34152 payload 824 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26575640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f28074db0 con 0x7f9f28137790 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f0effd640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ef403dcc0 0x7f9ef4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4783+0+0 (secure 0 0 0) 0x7f9f10051ec0 con 0x7f9f2813b380 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26d76640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ef403dcc0 0x7f9ef4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.345+0000 7f9f26d76640 10 monclient: get_auth_request con 0x7f9ef403dcc0 auth_method 0 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f26575640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 msgr2=0x7f9f281cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f26575640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 0x7f9f281cf970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c012400 con 0x7f9f28137790 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.347+0000 7f9f0effd640 10 monclient: dump: 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9f1c00ae80 con 0x7f9f28137790 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:48.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 msgr2=0x7f9f281cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 0x7f9f281cf970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c00cec0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 msgr2=0x7f9f281cf970 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:48.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f0effd640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f28137790 0x7f9f281cf970 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c00cec0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.348+0000 7f9f26d76640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ef403dcc0 0x7f9ef4040180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f18036000 tx=0x7f9f18033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f2cc1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 0x7f9f281da780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f2cc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f281d02c0 con 0x7f9f281cfeb0 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 0x7f9f281da780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient: get_auth_request con 0x7f9f281cfeb0 auth_method 0 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 10 monclient(hunting): handle_auth_done global_id 34155 payload 824 2026-02-17T11:46:48.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.351+0000 7f9f26575640 1 -- 10.20.193.51:0/1589161429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f28138a80 con 0x7f9f281cfeb0 2026-02-17T11:46:48.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f26575640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 msgr2=0x7f9f281da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f26575640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 0x7f9f281da780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c012aa0 con 0x7f9f281cfeb0 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 10 monclient: dump: 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7f9f1c012aa0 con 0x7f9f281cfeb0 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 msgr2=0x7f9f281da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 0x7f9f281da780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c004db0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 msgr2=0x7f9f281da780 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f0effd640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f281cfeb0 0x7f9f281da780 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c9f0 tx=0x7f9f1c004db0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:46:48.355 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 12, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28999, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:48.356 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.357 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.358 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:48.359 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ef403dcc0 msgr2=0x7f9ef4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ef403dcc0 0x7f9ef4040180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f18036000 tx=0x7f9f18033000 comp rx=0 tx=0).stop 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 10 monclient: shutdown 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 msgr2=0x7f9f2813a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f2cc1a640 1 --2- 10.20.193.51:0/1589161429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2813b380 0x7f9f2813a4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b7b0 tx=0x7f9f1000bc80 comp rx=0 tx=0).stop 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f26d76640 1 -- 10.20.193.51:0/1589161429 reap_dead start 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.353+0000 7f9f26d76640 1 -- 10.20.193.51:0/1589161429 reap_dead start 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.354+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 shutdown_connections 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.354+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 >> 10.20.193.51:0/1589161429 conn(0x7f9f280a30c0 msgr2=0x7f9f28099850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.354+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 shutdown_connections 2026-02-17T11:46:48.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.354+0000 7f9f2cc1a640 1 -- 10.20.193.51:0/1589161429 wait complete. 2026-02-17T11:46:48.362 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:46:48.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:46:48.362 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:46:48.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.428+0000 7f93e0561640 10 monclient: get_monmap_and_config 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.428+0000 7f93e0561640 10 monclient: build_initial_monmap 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.428+0000 7f93e0561640 10 monclient: monmap: 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:46:48.429694+0000 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:46:48.429694+0000 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 Processor -- start 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 -- start start 2026-02-17T11:46:48.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient: init 2026-02-17T11:46:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-17T11:46:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f93d80a3bb0 0x7f93d809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-c con 0x7f93d80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:46:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93d809d270 0x7f93d8138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-a con 0x7f93d809d270 addr v2:10.20.193.51:3300/0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f93d81385b0 addr v1:10.20.193.51:6789/0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d8135430 con 0x7f93d81385b0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f93d809a5c0 con 0x7f93d809d270 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93d809b520 con 0x7f93d80a3bb0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93e0561640 10 monclient(hunting): authenticate will time out at 696.048502s 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93d809d270 0x7f93d8138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93dead7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f93d81385b0 0x7f93d813f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:56006/0 (socket says 10.20.193.51:56006) 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93dead7640 1 -- 10.20.193.51:0/4207918420 learned_addr learned my addr 10.20.193.51:0/4207918420 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): get_auth_request con 0x7f93d809d270 auth_method 0 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93de2d6640 1 --2- 10.20.193.51:0/4207918420 >> v2:10.20.193.142:3300/0 conn(0x7f93d80a3bb0 0x7f93d809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93de2d6640 10 monclient(hunting): get_auth_request con 0x7f93d80a3bb0 auth_method 0 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93de2d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93de2d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93de2d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient(hunting): handle_auth_done global_id 34158 payload 274 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 -- 10.20.193.51:0/4207918420 >> v2:10.20.193.142:3300/0 conn(0x7f93d80a3bb0 msgr2=0x7f93d809cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 --2- 10.20.193.51:0/4207918420 >> v2:10.20.193.142:3300/0 conn(0x7f93d80a3bb0 0x7f93d809cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 -- 10.20.193.51:0/4207918420 >> v1:10.20.193.51:6789/0 conn(0x7f93d81385b0 legacy=0x7f93d813f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 monclient: found mon.noname-a 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.429+0000 7f93ddad5640 1 -- 10.20.193.51:0/4207918420 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d809af60 con 0x7f93d809d270 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93ddad5640 1 -- 10.20.193.51:0/4207918420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d809d270 msgr2=0x7f93d8138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93ddad5640 1 --2- 10.20.193.51:0/4207918420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d809d270 0x7f93d8138070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93d80694e0 tx=0x7f93cc02ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a120b742513f783 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 1 -- 10.20.193.51:0/4207918420 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc03c070 con 0x7f93d809d270 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: dump: 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.439 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 1 -- 10.20.193.51:0/4207918420 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc02fbb0 con 0x7f93d809d270 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 5 monclient: authenticate success, global_id 34158 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 1 -- 10.20.193.51:0/4207918420 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc037440 con 0x7f93d809d270 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 10 monclient: get_monmap_and_config success 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 4 set_mon_vals no callback set 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93dd2d4640 10 monclient: dump: 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 10 monclient: shutdown 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 -- 10.20.193.51:0/4207918420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d809d270 msgr2=0x7f93d8138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 --2- 10.20.193.51:0/4207918420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d809d270 0x7f93d8138070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93d80694e0 tx=0x7f93cc02ed30 comp rx=0 tx=0).stop 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 -- 10.20.193.51:0/4207918420 shutdown_connections 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 --2- 10.20.193.51:0/4207918420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d809d270 0x7f93d8138070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 --2- 10.20.193.51:0/4207918420 >> v2:10.20.193.142:3300/0 conn(0x7f93d80a3bb0 0x7f93d809cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 -- 10.20.193.51:0/4207918420 >> 10.20.193.51:0/4207918420 conn(0x7f93d80a30c0 msgr2=0x7f93d80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 -- 10.20.193.51:0/4207918420 shutdown_connections 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.432+0000 7f93e0561640 1 -- 10.20.193.51:0/4207918420 wait complete. 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient: build_initial_monmap 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient: monmap: 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 Processor -- start 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 -- start start 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient: init 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient: _reopen_session rank -1 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809d270 0x7f93d81cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-b con 0x7f93d809d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d80a3bb0 0x7f93d81cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-c con 0x7f93d80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 0x7f93d81cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): picked mon.noname-a con 0x7f93d81385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f93d8074ac0 con 0x7f93d81385b0 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93d80a3f90 con 0x7f93d809d270 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93d8135040 con 0x7f93d80a3bb0 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): _renew_subs 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93e0561640 10 monclient(hunting): authenticate will time out at 696.052675s 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93ddad5640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d80a3bb0 msgr2=0x7f93d81cef90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93ddad5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d80a3bb0 0x7f93d81cef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 0x7f93d81cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 0x7f93d81cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49132/0 (socket says 10.20.193.51:49132) 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 learned_addr learned my addr 10.20.193.51:0/2909634613 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): get_auth_request con 0x7f93d81385b0 auth_method 0 2026-02-17T11:46:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93de2d6640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809d270 0x7f93d81cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93de2d6640 10 monclient(hunting): get_auth_request con 0x7f93d809d270 auth_method 0 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93de2d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93de2d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93de2d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient(hunting): handle_auth_done global_id 34161 payload 824 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d80a3bb0 msgr2=0x7f93d81cef90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d80a3bb0 0x7f93d81cef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809d270 msgr2=0x7f93d81cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809d270 0x7f93d81cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient: _finish_hunting 0 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 monclient: found mon.noname-a 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.433+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d8131350 con 0x7f93d81385b0 2026-02-17T11:46:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.436+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 msgr2=0x7f93d81cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.436+0000 7f93dead7640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 0x7f93d81cf7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93d400ca70 tx=0x7f93d400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.436+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:46:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d400ae50 con 0x7f93d81385b0 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: dump: 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: _finish_auth 0 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: _check_auth_tickets 2026-02-17T11:46:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d4012400 con 0x7f93d81385b0 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40127d0 con 0x7f93d81385b0 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 10 monclient: dump: 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 5 monclient: authenticate success, global_id 34161 2026-02-17T11:46:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93dcad3640 4 set_mon_vals no callback set 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 monclient: _renew_subs 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d809d7b0 con 0x7f93d81385b0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 monclient: _renew_subs 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d8131070 con 0x7f93d81385b0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 0x7f93d81d0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93d8130cf0 con 0x7f93d81cfd30 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f93d40129b0 con 0x7f93d81385b0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 0x7f93d81d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient: get_auth_request con 0x7f93d81cfd30 auth_method 0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a803deb0 0x7f93a8040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4783+0+0 (secure 0 0 0) 0x7f93d4052c90 con 0x7f93d81385b0 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.438+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.439+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.439+0000 7f93de2d6640 10 monclient(hunting): handle_auth_done global_id 4378 payload 824 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.439+0000 7f93de2d6640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93d80a1650 con 0x7f93d81cfd30 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.439+0000 7f93ddad5640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a803deb0 0x7f93a8040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.439+0000 7f93ddad5640 10 monclient: get_auth_request con 0x7f93a803deb0 auth_method 0 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93de2d6640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 msgr2=0x7f93d81d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93de2d6640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 0x7f93d81d0110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c8010d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c801a030 con 0x7f93d81cfd30 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 10 monclient: dump: 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93ddad5640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a803deb0 0x7f93a8040370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d809ac40 tx=0x7f93cc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f93c800eb80 con 0x7f93d81cfd30 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 msgr2=0x7f93d81d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 0x7f93d81d0110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c8010d00 comp rx=0 tx=0).stop 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 msgr2=0x7f93d81d0110 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.441+0000 7f93beffd640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d81cfd30 0x7f93d81d0110 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c8010d00 comp rx=0 tx=0).stop 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.444+0000 7f93e0561640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.444+0000 7f93e0561640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 0x7f93d81dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.444+0000 7f93e0561640 10 monclient(hunting): start opening mon connection 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.444+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93d812d480 con 0x7f93d809e9d0 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 0x7f93d81dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient: get_auth_request con 0x7f93d809e9d0 auth_method 0 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:46:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:46:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:46:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:46:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2026-02-17T11:46:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.445+0000 7f93de2d6640 1 -- 10.20.193.51:0/2909634613 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f93d81d0650 con 0x7f93d809e9d0 2026-02-17T11:46:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93de2d6640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 msgr2=0x7f93d81dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93de2d6640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 0x7f93d81dab40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c800f040 con 0x7f93d809e9d0 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 10 monclient: dump: 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4863 (secure 0 0 0) 0x7f93c8004030 con 0x7f93d809e9d0 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:46:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 msgr2=0x7f93d81dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 0x7f93d81dab40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c80047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 msgr2=0x7f93d81dab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.447+0000 7f93beffd640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d809e9d0 0x7f93d81dab40 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010830 tx=0x7f93c80047c0 comp rx=0 tx=0).stop 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 12, 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 91724, 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:46:48.455 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:46:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:46:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:46:48.462 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:46:48.463 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:46:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a803deb0 msgr2=0x7f93a8040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a803deb0 0x7f93a8040370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d809ac40 tx=0x7f93cc033000 comp rx=0 tx=0).stop 2026-02-17T11:46:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 10 monclient: shutdown 2026-02-17T11:46:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:46:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 msgr2=0x7f93d81cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 --2- 10.20.193.51:0/2909634613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d81385b0 0x7f93d81cf7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93d400ca70 tx=0x7f93d400cf40 comp rx=0 tx=0).stop 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 reap_dead start 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93dead7640 1 -- 10.20.193.51:0/2909634613 reap_dead start 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 shutdown_connections 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 >> 10.20.193.51:0/2909634613 conn(0x7f93d80a30c0 msgr2=0x7f93d8132cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 shutdown_connections 2026-02-17T11:46:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:46:48.448+0000 7f93e0561640 1 -- 10.20.193.51:0/2909634613 wait complete. 2026-02-17T11:46:48.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:46:48.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:46:49.137 INFO:tasks.rados.rados.0.trial142.stdout:163: done (0 left) 2026-02-17T11:46:49.137 INFO:tasks.rados.rados.0.trial142.stdout:164: copy_from oid 34 from oid 42 current snap is 18 2026-02-17T11:46:49.137 INFO:tasks.rados.rados.0.trial142.stdout:165: copy_from oid 20 from oid 27 current snap is 18 2026-02-17T11:46:49.137 INFO:tasks.rados.rados.0.trial142.stdout:166: snap_remove snap 6 2026-02-17T11:46:49.362 INFO:tasks.rados.rados.0.trial142.stdout:166: done (2 left) 2026-02-17T11:46:49.362 INFO:tasks.rados.rados.0.trial142.stdout:167: write (excl) oid 13 current snap is 18 2026-02-17T11:46:49.362 INFO:tasks.rados.rados.0.trial142.stdout:167: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-17T11:46:49.367 INFO:tasks.rados.rados.0.trial142.stdout:167: writing trial14245205-13 from 662209 to 1288755 tid 1 2026-02-17T11:46:49.371 INFO:tasks.rados.rados.0.trial142.stdout:167: writing trial14245205-13 from 1808051 to 2444064 tid 2 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:167: writing trial14245205-13 from 2873212 to 3462209 tid 3 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:168: write oid 23 current snap is 18 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:164: finishing copy_from racing read to trial14245205-34 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:165: finishing copy_from racing read to trial14245205-20 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:164: finishing copy_from to trial14245205-34 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:165: finishing copy_from to trial14245205-20 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 18 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:46:49.376 INFO:tasks.rados.rados.0.trial142.stdout:167: finishing write tid 1 to trial14245205-13 2026-02-17T11:46:49.377 INFO:tasks.rados.rados.0.trial142.stdout:167: finishing write tid 2 to trial14245205-13 2026-02-17T11:46:49.377 INFO:tasks.rados.rados.0.trial142.stdout:168: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-17T11:46:49.380 INFO:tasks.rados.rados.0.trial142.stdout:168: writing trial14245205-23 from 679016 to 1380811 tid 1 2026-02-17T11:46:49.384 INFO:tasks.rados.rados.0.trial142.stdout:168: writing trial14245205-23 from 1866533 to 2362557 tid 2 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:168: writing trial14245205-23 from 2900635 to 3303278 tid 3 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:164: done (3 left) 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:165: done (2 left) 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:169: delete oid 27 current snap is 18 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:167: finishing write tid 3 to trial14245205-13 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:167: finishing write tid 4 to trial14245205-13 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:167: finishing write tid 5 to trial14245205-13 2026-02-17T11:46:49.388 INFO:tasks.rados.rados.0.trial142.stdout:167: oid 13 updating version 0 to 94 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:167: oid 13 updating version 94 to 95 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:167: oid 13 version 95 is already newer than 93 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:167: oid 13 updating version 95 to 96 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 96 (ObjNum 87 snap 18 seq_num 87) dirty exists 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:167: left oid 13 (ObjNum 87 snap 18 seq_num 87) 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:168: finishing write tid 1 to trial14245205-23 2026-02-17T11:46:49.389 INFO:tasks.rados.rados.0.trial142.stdout:168: finishing write tid 2 to trial14245205-23 2026-02-17T11:46:49.390 INFO:tasks.rados.rados.0.trial142.stdout:168: finishing write tid 3 to trial14245205-23 2026-02-17T11:46:49.390 INFO:tasks.rados.rados.0.trial142.stdout:168: finishing write tid 4 to trial14245205-23 2026-02-17T11:46:49.390 INFO:tasks.rados.rados.0.trial142.stdout:168: finishing write tid 5 to trial14245205-23 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: oid 23 updating version 0 to 73 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: oid 23 updating version 73 to 74 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: oid 23 version 74 is already newer than 72 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: oid 23 version 74 is already newer than 71 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 74 (ObjNum 88 snap 18 seq_num 88) dirty exists 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: left oid 23 (ObjNum 88 snap 18 seq_num 88) 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:167: done (2 left) 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:168: done (1 left) 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:169: done (0 left) 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:170: read oid 23 snap -1 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:170: expect (ObjNum 88 snap 18 seq_num 88) 2026-02-17T11:46:49.391 INFO:tasks.rados.rados.0.trial142.stdout:171: copy_from oid 49 from oid 29 current snap is 18 2026-02-17T11:46:49.392 INFO:tasks.rados.rados.0.trial142.stdout:172: copy_from oid 26 from oid 17 current snap is 18 2026-02-17T11:46:49.392 INFO:tasks.rados.rados.0.trial142.stdout:173: delete oid 46 current snap is 18 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:173: done (3 left) 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:174: read oid 42 snap 17 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:174: expect (ObjNum 41 snap 0 seq_num 41) 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:175: rollback oid 8 current snap is 18 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 15 2026-02-17T11:46:49.393 INFO:tasks.rados.rados.0.trial142.stdout:176: snap_remove snap 11 2026-02-17T11:46:50.367 INFO:tasks.rados.rados.0.trial142.stdout:176: done (5 left) 2026-02-17T11:46:50.367 INFO:tasks.rados.rados.0.trial142.stdout:177: snap_create 2026-02-17T11:46:50.367 INFO:tasks.rados.rados.0.trial142.stdout:174: expect (ObjNum 41 snap 0 seq_num 41) 2026-02-17T11:46:50.431 INFO:tasks.rados.rados.0.trial142.stdout:170: expect (ObjNum 88 snap 18 seq_num 88) 2026-02-17T11:46:50.548 INFO:tasks.rados.rados.0.trial142.stdout:171: finishing copy_from racing read to trial14245205-49 2026-02-17T11:46:50.548 INFO:tasks.rados.rados.0.trial142.stdout:175: finishing rollback tid 0 to trial14245205-8 2026-02-17T11:46:50.548 INFO:tasks.rados.rados.0.trial142.stdout:175: finishing rollback tid 1 to trial14245205-8 2026-02-17T11:46:50.548 INFO:tasks.rados.rados.0.trial142.stdout:171: finishing copy_from to trial14245205-49 2026-02-17T11:46:50.548 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-17T11:46:50.549 INFO:tasks.rados.rados.0.trial142.stdout:175: finishing rollback tid 2 to trial14245205-8 2026-02-17T11:46:50.549 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 102 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T11:46:50.549 INFO:tasks.rados.rados.0.trial142.stdout:172: finishing copy_from racing read to trial14245205-26 2026-02-17T11:46:50.549 INFO:tasks.rados.rados.0.trial142.stdout:172: finishing copy_from to trial14245205-26 2026-02-17T11:46:50.549 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 26 (ObjNum 73 snap 13 seq_num 73) dirty exists 2026-02-17T11:46:51.873 INFO:tasks.rados.rados.0.trial142.stdout:170: done (5 left) 2026-02-17T11:46:51.873 INFO:tasks.rados.rados.0.trial142.stdout:171: done (4 left) 2026-02-17T11:46:51.873 INFO:tasks.rados.rados.0.trial142.stdout:172: done (3 left) 2026-02-17T11:46:51.873 INFO:tasks.rados.rados.0.trial142.stdout:174: done (2 left) 2026-02-17T11:46:51.873 INFO:tasks.rados.rados.0.trial142.stdout:175: done (1 left) 2026-02-17T11:46:51.874 INFO:tasks.rados.rados.0.trial142.stdout:177: done (0 left) 2026-02-17T11:46:51.874 INFO:tasks.rados.rados.0.trial142.stdout:178: snap_remove snap 15 2026-02-17T11:46:52.371 INFO:tasks.rados.rados.0.trial142.stdout:178: done (0 left) 2026-02-17T11:46:52.371 INFO:tasks.rados.rados.0.trial142.stdout:179: snap_remove snap 3 2026-02-17T11:46:53.933 INFO:tasks.rados.rados.0.trial142.stdout:179: done (0 left) 2026-02-17T11:46:53.934 INFO:tasks.rados.rados.0.trial142.stdout:180: read oid 20 snap -1 2026-02-17T11:46:53.934 INFO:tasks.rados.rados.0.trial142.stdout:180: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-17T11:46:53.934 INFO:tasks.rados.rados.0.trial142.stdout:181: write oid 48 current snap is 19 2026-02-17T11:46:53.934 INFO:tasks.rados.rados.0.trial142.stdout:181: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-17T11:46:53.938 INFO:tasks.rados.rados.0.trial142.stdout:181: writing trial14245205-48 from 729437 to 1256979 tid 1 2026-02-17T11:46:53.943 INFO:tasks.rados.rados.0.trial142.stdout:181: writing trial14245205-48 from 1925626 to 2568977 tid 2 2026-02-17T11:46:53.947 INFO:tasks.rados.rados.0.trial142.stdout:181: writing trial14245205-48 from 3266551 to 3529437 tid 3 2026-02-17T11:46:53.947 INFO:tasks.rados.rados.0.trial142.stdout:182: snap_remove snap 17 2026-02-17T11:46:54.895 INFO:tasks.rados.rados.0.trial142.stdout:182: done (2 left) 2026-02-17T11:46:54.896 INFO:tasks.rados.rados.0.trial142.stdout:183: delete oid 13 current snap is 19 2026-02-17T11:46:54.896 INFO:tasks.rados.rados.0.trial142.stdout:180: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-17T11:46:54.947 INFO:tasks.rados.rados.0.trial142.stdout:181: finishing write tid 1 to trial14245205-48 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: finishing write tid 2 to trial14245205-48 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: finishing write tid 3 to trial14245205-48 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: finishing write tid 4 to trial14245205-48 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: finishing write tid 5 to trial14245205-48 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: oid 48 updating version 0 to 27 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: oid 48 updating version 27 to 32 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: oid 48 version 32 is already newer than 31 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:181: oid 48 version 32 is already newer than 30 2026-02-17T11:46:54.948 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 32 (ObjNum 91 snap 19 seq_num 91) dirty exists 2026-02-17T11:46:54.949 INFO:tasks.rados.rados.0.trial142.stdout:181: left oid 48 (ObjNum 91 snap 19 seq_num 91) 2026-02-17T11:46:54.949 INFO:tasks.rados.rados.0.trial142.stdout:180: done (2 left) 2026-02-17T11:46:54.949 INFO:tasks.rados.rados.0.trial142.stdout:181: done (1 left) 2026-02-17T11:46:54.949 INFO:tasks.rados.rados.0.trial142.stdout:183: done (0 left) 2026-02-17T11:46:54.949 INFO:tasks.rados.rados.0.trial142.stdout:184: snap_remove snap 18 2026-02-17T11:46:55.897 INFO:tasks.rados.rados.0.trial142.stdout:184: done (0 left) 2026-02-17T11:46:55.897 INFO:tasks.rados.rados.0.trial142.stdout:185: delete oid 32 current snap is 19 2026-02-17T11:46:55.899 INFO:tasks.rados.rados.0.trial142.stdout:185: done (0 left) 2026-02-17T11:46:55.899 INFO:tasks.rados.rados.0.trial142.stdout:186: snap_remove snap 14 2026-02-17T11:46:56.898 INFO:tasks.rados.rados.0.trial142.stdout:186: done (0 left) 2026-02-17T11:46:56.898 INFO:tasks.rados.rados.0.trial142.stdout:187: read oid 3 snap -1 2026-02-17T11:46:56.898 INFO:tasks.rados.rados.0.trial142.stdout:187: expect (ObjNum 83 snap 15 seq_num 83) 2026-02-17T11:46:56.898 INFO:tasks.rados.rados.0.trial142.stdout:188: read oid 15 snap 8 2026-02-17T11:46:56.899 INFO:tasks.rados.rados.0.trial142.stdout:188: expect deleted 2026-02-17T11:46:56.899 INFO:tasks.rados.rados.0.trial142.stdout:189: snap_create 2026-02-17T11:46:56.905 INFO:tasks.rados.rados.0.trial142.stdout:187: expect (ObjNum 83 snap 15 seq_num 83) 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:187: done (2 left) 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:188: done (1 left) 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:189: done (0 left) 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:190: read oid 30 snap -1 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:190: expect deleted 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:191: rollback oid 3 current snap is 20 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 8 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:192: write oid 13 current snap is 20 2026-02-17T11:46:57.902 INFO:tasks.rados.rados.0.trial142.stdout:192: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2026-02-17T11:46:57.906 INFO:tasks.rados.rados.0.trial142.stdout:192: writing trial14245205-13 from 779858 to 1249500 tid 1 2026-02-17T11:46:57.909 INFO:tasks.rados.rados.0.trial142.stdout:192: writing trial14245205-13 from 1817425 to 2324456 tid 2 2026-02-17T11:46:57.913 INFO:tasks.rados.rados.0.trial142.stdout:192: writing trial14245205-13 from 2781526 to 3368154 tid 3 2026-02-17T11:46:57.913 INFO:tasks.rados.rados.0.trial142.stdout:193: rollback oid 50 current snap is 20 2026-02-17T11:46:57.913 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 9 2026-02-17T11:46:57.913 INFO:tasks.rados.rados.0.trial142.stdout:191: finishing rollback tid 0 to trial14245205-3 2026-02-17T11:46:57.913 INFO:tasks.rados.rados.0.trial142.stdout:191: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:46:57.914 INFO:tasks.rados.rados.0.trial142.stdout:190: done (3 left) 2026-02-17T11:46:57.914 INFO:tasks.rados.rados.0.trial142.stdout:194: snap_create 2026-02-17T11:46:57.914 INFO:tasks.rados.rados.0.trial142.stdout:191: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:46:57.914 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 50 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-17T11:46:57.915 INFO:tasks.rados.rados.0.trial142.stdout:193: finishing rollback tid 0 to trial14245205-50 2026-02-17T11:46:57.916 INFO:tasks.rados.rados.0.trial142.stdout:193: finishing rollback tid 1 to trial14245205-50 2026-02-17T11:46:57.916 INFO:tasks.rados.rados.0.trial142.stdout:193: finishing rollback tid 2 to trial14245205-50 2026-02-17T11:46:57.916 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 42 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-17T11:46:57.917 INFO:tasks.rados.rados.0.trial142.stdout:192: finishing write tid 1 to trial14245205-13 2026-02-17T11:46:57.917 INFO:tasks.rados.rados.0.trial142.stdout:192: finishing write tid 2 to trial14245205-13 2026-02-17T11:46:57.917 INFO:tasks.rados.rados.0.trial142.stdout:192: finishing write tid 3 to trial14245205-13 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: finishing write tid 4 to trial14245205-13 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: finishing write tid 5 to trial14245205-13 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: oid 13 updating version 0 to 144 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: oid 13 version 144 is already newer than 143 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: oid 13 updating version 144 to 145 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: oid 13 updating version 145 to 146 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 146 (ObjNum 94 snap 20 seq_num 94) dirty exists 2026-02-17T11:46:57.918 INFO:tasks.rados.rados.0.trial142.stdout:192: left oid 13 (ObjNum 94 snap 20 seq_num 94) 2026-02-17T11:46:59.609 INFO:tasks.rados.rados.0.trial142.stdout:191: done (3 left) 2026-02-17T11:46:59.609 INFO:tasks.rados.rados.0.trial142.stdout:192: done (2 left) 2026-02-17T11:46:59.609 INFO:tasks.rados.rados.0.trial142.stdout:193: done (1 left) 2026-02-17T11:46:59.609 INFO:tasks.rados.rados.0.trial142.stdout:194: done (0 left) 2026-02-17T11:46:59.609 INFO:tasks.rados.rados.0.trial142.stdout:195: delete oid 38 current snap is 21 2026-02-17T11:46:59.613 INFO:tasks.rados.rados.0.trial142.stdout:195: done (0 left) 2026-02-17T11:46:59.613 INFO:tasks.rados.rados.0.trial142.stdout:196: rollback oid 29 current snap is 21 2026-02-17T11:46:59.613 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 8 2026-02-17T11:46:59.613 INFO:tasks.rados.rados.0.trial142.stdout:197: delete oid 24 current snap is 21 2026-02-17T11:46:59.614 INFO:tasks.rados.rados.0.trial142.stdout:196: finishing rollback tid 0 to trial14245205-29 2026-02-17T11:46:59.614 INFO:tasks.rados.rados.0.trial142.stdout:196: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:46:59.614 INFO:tasks.rados.rados.0.trial142.stdout:197: done (1 left) 2026-02-17T11:46:59.614 INFO:tasks.rados.rados.0.trial142.stdout:198: snap_remove snap 16 2026-02-17T11:47:00.613 INFO:tasks.rados.rados.0.trial142.stdout:198: done (1 left) 2026-02-17T11:47:00.613 INFO:tasks.rados.rados.0.trial142.stdout:199: rollback oid 17 current snap is 21 2026-02-17T11:47:00.613 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 8 2026-02-17T11:47:00.613 INFO:tasks.rados.rados.0.trial142.stdout:196: finishing rollback tid 2 to trial14245205-29 2026-02-17T11:47:00.614 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 42 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-17T11:47:00.614 INFO:tasks.rados.rados.0.trial142.stdout:196: done (1 left) 2026-02-17T11:47:00.614 INFO:tasks.rados.rados.0.trial142.stdout:200: read oid 33 snap 20 2026-02-17T11:47:00.614 INFO:tasks.rados.rados.0.trial142.stdout:200: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-17T11:47:00.614 INFO:tasks.rados.rados.0.trial142.stdout:201: delete oid 47 current snap is 21 2026-02-17T11:47:00.615 INFO:tasks.rados.rados.0.trial142.stdout:201: done (2 left) 2026-02-17T11:47:00.615 INFO:tasks.rados.rados.0.trial142.stdout:202: read oid 2 snap -1 2026-02-17T11:47:00.615 INFO:tasks.rados.rados.0.trial142.stdout:202: expect deleted 2026-02-17T11:47:00.615 INFO:tasks.rados.rados.0.trial142.stdout:203: write oid 34 current snap is 21 2026-02-17T11:47:00.615 INFO:tasks.rados.rados.0.trial142.stdout:203: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2026-02-17T11:47:00.620 INFO:tasks.rados.rados.0.trial142.stdout:203: writing trial14245205-34 from 447086 to 1217724 tid 1 2026-02-17T11:47:00.626 INFO:tasks.rados.rados.0.trial142.stdout:203: writing trial14245205-34 from 1935000 to 2733016 tid 2 2026-02-17T11:47:00.630 INFO:tasks.rados.rados.0.trial142.stdout:203: writing trial14245205-34 from 3458512 to 3647086 tid 3 2026-02-17T11:47:00.630 INFO:tasks.rados.rados.0.trial142.stdout:204: read oid 18 snap 8 2026-02-17T11:47:00.630 INFO:tasks.rados.rados.0.trial142.stdout:204: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-17T11:47:00.630 INFO:tasks.rados.rados.0.trial142.stdout:205: read oid 38 snap 20 2026-02-17T11:47:00.630 INFO:tasks.rados.rados.0.trial142.stdout:205: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-17T11:47:00.631 INFO:tasks.rados.rados.0.trial142.stdout:206: write (excl) oid 44 current snap is 21 2026-02-17T11:47:00.631 INFO:tasks.rados.rados.0.trial142.stdout:206: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-17T11:47:00.634 INFO:tasks.rados.rados.0.trial142.stdout:206: writing trial14245205-44 from 463893 to 1026133 tid 1 2026-02-17T11:47:00.638 INFO:tasks.rados.rados.0.trial142.stdout:206: writing trial14245205-44 from 1593482 to 2251509 tid 2 2026-02-17T11:47:00.642 INFO:tasks.rados.rados.0.trial142.stdout:206: writing trial14245205-44 from 2685935 to 3245276 tid 3 2026-02-17T11:47:00.642 INFO:tasks.rados.rados.0.trial142.stdout:207: copy_from oid 32 from oid 45 current snap is 21 2026-02-17T11:47:00.642 INFO:tasks.rados.rados.0.trial142.stdout:199: finishing rollback tid 0 to trial14245205-17 2026-02-17T11:47:00.643 INFO:tasks.rados.rados.0.trial142.stdout:199: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:47:00.643 INFO:tasks.rados.rados.0.trial142.stdout:208: write (excl) oid 6 current snap is 21 2026-02-17T11:47:00.643 INFO:tasks.rados.rados.0.trial142.stdout:208: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2026-02-17T11:47:00.646 INFO:tasks.rados.rados.0.trial142.stdout:208: writing trial14245205-6 from 480700 to 1118189 tid 1 2026-02-17T11:47:00.649 INFO:tasks.rados.rados.0.trial142.stdout:208: writing trial14245205-6 from 1651964 to 2053649 tid 2 2026-02-17T11:47:00.655 INFO:tasks.rados.rados.0.trial142.stdout:208: writing trial14245205-6 from 2713358 to 3483971 tid 3 2026-02-17T11:47:00.655 INFO:tasks.rados.rados.0.trial142.stdout:209: write oid 39 current snap is 21 2026-02-17T11:47:00.655 INFO:tasks.rados.rados.0.trial142.stdout:209: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2026-02-17T11:47:00.659 INFO:tasks.rados.rados.0.trial142.stdout:209: writing trial14245205-39 from 497507 to 1210245 tid 1 2026-02-17T11:47:00.664 INFO:tasks.rados.rados.0.trial142.stdout:209: writing trial14245205-39 from 1710446 to 2372142 tid 2 2026-02-17T11:47:00.669 INFO:tasks.rados.rados.0.trial142.stdout:209: writing trial14245205-39 from 3140781 to 3697507 tid 3 2026-02-17T11:47:00.669 INFO:tasks.rados.rados.0.trial142.stdout:210: copy_from oid 31 from oid 46 current snap is 21 2026-02-17T11:47:00.669 INFO:tasks.rados.rados.0.trial142.stdout:199: finishing rollback tid 2 to trial14245205-17 2026-02-17T11:47:00.669 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 82 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:47:00.669 INFO:tasks.rados.rados.0.trial142.stdout:200: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-17T11:47:00.731 INFO:tasks.rados.rados.0.trial142.stdout:203: finishing write tid 1 to trial14245205-34 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:203: finishing write tid 2 to trial14245205-34 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:199: done (10 left) 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:200: done (9 left) 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:202: done (8 left) 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:211: write (excl) oid 10 current snap is 21 2026-02-17T11:47:00.732 INFO:tasks.rados.rados.0.trial142.stdout:211: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2026-02-17T11:47:00.736 INFO:tasks.rados.rados.0.trial142.stdout:211: writing trial14245205-10 from 514314 to 1302301 tid 1 2026-02-17T11:47:00.739 INFO:tasks.rados.rados.0.trial142.stdout:211: writing trial14245205-10 from 1768928 to 2174282 tid 2 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:211: writing trial14245205-10 from 2768204 to 3277714 tid 3 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:212: copy_from oid 27 from oid 22 current snap is 21 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:203: finishing write tid 3 to trial14245205-34 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:203: finishing write tid 4 to trial14245205-34 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:203: finishing write tid 5 to trial14245205-34 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:203: oid 34 updating version 0 to 79 2026-02-17T11:47:00.744 INFO:tasks.rados.rados.0.trial142.stdout:203: oid 34 updating version 79 to 81 2026-02-17T11:47:00.745 INFO:tasks.rados.rados.0.trial142.stdout:203: oid 34 updating version 81 to 82 2026-02-17T11:47:00.745 INFO:tasks.rados.rados.0.trial142.stdout:203: oid 34 version 82 is already newer than 80 2026-02-17T11:47:00.745 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 82 (ObjNum 98 snap 21 seq_num 98) dirty exists 2026-02-17T11:47:00.745 INFO:tasks.rados.rados.0.trial142.stdout:203: left oid 34 (ObjNum 98 snap 21 seq_num 98) 2026-02-17T11:47:00.745 INFO:tasks.rados.rados.0.trial142.stdout:204: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-17T11:47:00.799 INFO:tasks.rados.rados.0.trial142.stdout:205: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:206: finishing write tid 1 to trial14245205-44 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:206: finishing write tid 2 to trial14245205-44 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:206: finishing write tid 3 to trial14245205-44 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:206: finishing write tid 4 to trial14245205-44 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:203: done (9 left) 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:204: done (8 left) 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:205: done (7 left) 2026-02-17T11:47:00.902 INFO:tasks.rados.rados.0.trial142.stdout:213: read oid 47 snap -1 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:213: expect deleted 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:214: read oid 12 snap -1 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:214: expect (ObjNum 82 snap 15 seq_num 82) 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:215: read oid 9 snap -1 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:215: expect (ObjNum 72 snap 12 seq_num 72) 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:216: snap_create 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:206: finishing write tid 5 to trial14245205-44 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:206: oid 44 updating version 0 to 47 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:206: oid 44 version 47 is already newer than 45 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:206: oid 44 updating version 47 to 48 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:206: oid 44 version 48 is already newer than 46 2026-02-17T11:47:00.903 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 48 (ObjNum 99 snap 21 seq_num 99) dirty exists 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:206: left oid 44 (ObjNum 99 snap 21 seq_num 99) 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:207: finishing copy_from racing read to trial14245205-32 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:207: finishing copy_from to trial14245205-32 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: finishing write tid 1 to trial14245205-6 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: finishing write tid 2 to trial14245205-6 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: finishing write tid 3 to trial14245205-6 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: finishing write tid 4 to trial14245205-6 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: finishing write tid 5 to trial14245205-6 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: oid 6 updating version 0 to 57 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: oid 6 updating version 57 to 58 2026-02-17T11:47:00.904 INFO:tasks.rados.rados.0.trial142.stdout:208: oid 6 version 58 is already newer than 55 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:208: oid 6 version 58 is already newer than 56 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 58 (ObjNum 100 snap 21 seq_num 100) dirty exists 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:208: left oid 6 (ObjNum 100 snap 21 seq_num 100) 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: finishing write tid 1 to trial14245205-39 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: finishing write tid 2 to trial14245205-39 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:210: finishing copy_from to trial14245205-31 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:210: got expected ENOENT (src dne) 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:210: finishing copy_from racing read to trial14245205-31 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: finishing write tid 3 to trial14245205-39 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: finishing write tid 4 to trial14245205-39 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: finishing write tid 5 to trial14245205-39 2026-02-17T11:47:00.905 INFO:tasks.rados.rados.0.trial142.stdout:209: oid 39 updating version 0 to 13 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:209: oid 39 updating version 13 to 14 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:209: oid 39 updating version 14 to 15 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:209: oid 39 version 15 is already newer than 12 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 15 (ObjNum 101 snap 21 seq_num 101) dirty exists 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:209: left oid 39 (ObjNum 101 snap 21 seq_num 101) 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:211: finishing write tid 1 to trial14245205-10 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:211: finishing write tid 2 to trial14245205-10 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:212: finishing copy_from to trial14245205-27 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:212: got expected ENOENT (src dne) 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:212: finishing copy_from racing read to trial14245205-27 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:211: finishing write tid 3 to trial14245205-10 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:211: finishing write tid 4 to trial14245205-10 2026-02-17T11:47:00.906 INFO:tasks.rados.rados.0.trial142.stdout:211: finishing write tid 5 to trial14245205-10 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:211: oid 10 updating version 0 to 106 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:211: oid 10 version 106 is already newer than 105 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:211: oid 10 version 106 is already newer than 104 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:211: oid 10 updating version 106 to 107 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 107 (ObjNum 102 snap 21 seq_num 102) dirty exists 2026-02-17T11:47:00.907 INFO:tasks.rados.rados.0.trial142.stdout:211: left oid 10 (ObjNum 102 snap 21 seq_num 102) 2026-02-17T11:47:00.908 INFO:tasks.rados.rados.0.trial142.stdout:214: expect (ObjNum 82 snap 15 seq_num 82) 2026-02-17T11:47:01.017 INFO:tasks.rados.rados.0.trial142.stdout:215: expect (ObjNum 72 snap 12 seq_num 72) 2026-02-17T11:47:01.618 INFO:tasks.rados.rados.0.trial142.stdout:206: done (10 left) 2026-02-17T11:47:01.618 INFO:tasks.rados.rados.0.trial142.stdout:207: done (9 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:208: done (8 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:209: done (7 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:210: done (6 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:211: done (5 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:212: done (4 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:213: done (3 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:214: done (2 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:215: done (1 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:216: done (0 left) 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:217: write oid 11 current snap is 22 2026-02-17T11:47:01.619 INFO:tasks.rados.rados.0.trial142.stdout:217: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-17T11:47:01.621 INFO:tasks.rados.rados.0.trial142.stdout:217: writing trial14245205-11 from 531121 to 994357 tid 1 2026-02-17T11:47:01.626 INFO:tasks.rados.rados.0.trial142.stdout:217: writing trial14245205-11 from 1711057 to 2376422 tid 2 2026-02-17T11:47:01.631 INFO:tasks.rados.rados.0.trial142.stdout:217: writing trial14245205-11 from 3079274 to 3731121 tid 3 2026-02-17T11:47:01.631 INFO:tasks.rados.rados.0.trial142.stdout:218: delete oid 12 current snap is 22 2026-02-17T11:47:01.631 INFO:tasks.rados.rados.0.trial142.stdout:217: finishing write tid 1 to trial14245205-11 2026-02-17T11:47:01.632 INFO:tasks.rados.rados.0.trial142.stdout:217: finishing write tid 2 to trial14245205-11 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: finishing write tid 3 to trial14245205-11 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: finishing write tid 4 to trial14245205-11 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: finishing write tid 5 to trial14245205-11 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: oid 11 updating version 0 to 29 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: oid 11 updating version 29 to 32 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: oid 11 version 32 is already newer than 31 2026-02-17T11:47:01.634 INFO:tasks.rados.rados.0.trial142.stdout:217: oid 11 version 32 is already newer than 30 2026-02-17T11:47:01.635 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 32 (ObjNum 103 snap 22 seq_num 103) dirty exists 2026-02-17T11:47:01.635 INFO:tasks.rados.rados.0.trial142.stdout:217: left oid 11 (ObjNum 103 snap 22 seq_num 103) 2026-02-17T11:47:01.635 INFO:tasks.rados.rados.0.trial142.stdout:217: done (1 left) 2026-02-17T11:47:01.636 INFO:tasks.rados.rados.0.trial142.stdout:218: done (0 left) 2026-02-17T11:47:01.636 INFO:tasks.rados.rados.0.trial142.stdout:219: read oid 39 snap -1 2026-02-17T11:47:01.636 INFO:tasks.rados.rados.0.trial142.stdout:219: expect (ObjNum 101 snap 21 seq_num 101) 2026-02-17T11:47:01.636 INFO:tasks.rados.rados.0.trial142.stdout:220: write oid 44 current snap is 22 2026-02-17T11:47:01.636 INFO:tasks.rados.rados.0.trial142.stdout:220: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2026-02-17T11:47:01.639 INFO:tasks.rados.rados.0.trial142.stdout:220: writing trial14245205-44 from 564735 to 1178469 tid 1 2026-02-17T11:47:01.643 INFO:tasks.rados.rados.0.trial142.stdout:220: writing trial14245205-44 from 1828021 to 2497055 tid 2 2026-02-17T11:47:01.649 INFO:tasks.rados.rados.0.trial142.stdout:220: writing trial14245205-44 from 3134120 to 3764735 tid 3 2026-02-17T11:47:01.649 INFO:tasks.rados.rados.0.trial142.stdout:221: rollback oid 15 current snap is 22 2026-02-17T11:47:01.649 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 19 2026-02-17T11:47:01.649 INFO:tasks.rados.rados.0.trial142.stdout:220: finishing write tid 1 to trial14245205-44 2026-02-17T11:47:01.649 INFO:tasks.rados.rados.0.trial142.stdout:219: expect (ObjNum 101 snap 21 seq_num 101) 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:220: finishing write tid 2 to trial14245205-44 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:221: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 0 (ObjNum 33 snap 0 seq_num 1213577216) dirty dne 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:220: finishing write tid 3 to trial14245205-44 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:219: done (2 left) 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:221: done (1 left) 2026-02-17T11:47:01.762 INFO:tasks.rados.rados.0.trial142.stdout:222: snap_create 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: finishing write tid 4 to trial14245205-44 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: finishing write tid 5 to trial14245205-44 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: oid 44 updating version 0 to 50 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: oid 44 updating version 50 to 53 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: oid 44 version 53 is already newer than 52 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: oid 44 version 53 is already newer than 51 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 53 (ObjNum 105 snap 22 seq_num 105) dirty exists 2026-02-17T11:47:01.763 INFO:tasks.rados.rados.0.trial142.stdout:220: left oid 44 (ObjNum 105 snap 22 seq_num 105) 2026-02-17T11:47:02.739 INFO:tasks.rados.rados.0.trial142.stdout:220: done (1 left) 2026-02-17T11:47:02.739 INFO:tasks.rados.rados.0.trial142.stdout:222: done (0 left) 2026-02-17T11:47:02.739 INFO:tasks.rados.rados.0.trial142.stdout:223: write (excl) oid 10 current snap is 23 2026-02-17T11:47:02.740 INFO:tasks.rados.rados.0.trial142.stdout:223: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2026-02-17T11:47:02.743 INFO:tasks.rados.rados.0.trial142.stdout:223: writing trial14245205-10 from 581542 to 1270525 tid 1 2026-02-17T11:47:02.747 INFO:tasks.rados.rados.0.trial142.stdout:223: writing trial14245205-10 from 1886503 to 2299195 tid 2 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:223: writing trial14245205-10 from 2761543 to 3432494 tid 3 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:224: read oid 36 snap 22 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:224: expect (ObjNum 81 snap 15 seq_num 81) 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:225: snap_create 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:223: finishing write tid 1 to trial14245205-10 2026-02-17T11:47:02.752 INFO:tasks.rados.rados.0.trial142.stdout:223: finishing write tid 2 to trial14245205-10 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: finishing write tid 3 to trial14245205-10 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: finishing write tid 4 to trial14245205-10 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: finishing write tid 5 to trial14245205-10 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: oid 10 updating version 0 to 109 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: oid 10 updating version 109 to 111 2026-02-17T11:47:02.754 INFO:tasks.rados.rados.0.trial142.stdout:223: oid 10 version 111 is already newer than 110 2026-02-17T11:47:02.755 INFO:tasks.rados.rados.0.trial142.stdout:223: oid 10 updating version 111 to 112 2026-02-17T11:47:02.755 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 112 (ObjNum 106 snap 23 seq_num 106) dirty exists 2026-02-17T11:47:02.755 INFO:tasks.rados.rados.0.trial142.stdout:223: left oid 10 (ObjNum 106 snap 23 seq_num 106) 2026-02-17T11:47:02.756 INFO:tasks.rados.rados.0.trial142.stdout:224: expect (ObjNum 81 snap 15 seq_num 81) 2026-02-17T11:47:03.622 INFO:tasks.rados.rados.0.trial142.stdout:223: done (2 left) 2026-02-17T11:47:03.623 INFO:tasks.rados.rados.0.trial142.stdout:224: done (1 left) 2026-02-17T11:47:03.623 INFO:tasks.rados.rados.0.trial142.stdout:225: done (0 left) 2026-02-17T11:47:03.623 INFO:tasks.rados.rados.0.trial142.stdout:226: delete oid 9 current snap is 24 2026-02-17T11:47:03.625 INFO:tasks.rados.rados.0.trial142.stdout:226: done (0 left) 2026-02-17T11:47:03.625 INFO:tasks.rados.rados.0.trial142.stdout:227: snap_create 2026-02-17T11:47:04.363 INFO:tasks.rados.rados.0.trial142.stdout:227: done (0 left) 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:228: rollback oid 43 current snap is 25 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 19 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:229: copy_from oid 1 from oid 40 current snap is 25 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:230: read oid 19 snap -1 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:230: expect deleted 2026-02-17T11:47:04.364 INFO:tasks.rados.rados.0.trial142.stdout:231: delete oid 39 current snap is 25 2026-02-17T11:47:04.365 INFO:tasks.rados.rados.0.trial142.stdout:228: finishing rollback tid 0 to trial14245205-43 2026-02-17T11:47:04.365 INFO:tasks.rados.rados.0.trial142.stdout:228: finishing rollback tid 1 to trial14245205-43 2026-02-17T11:47:04.366 INFO:tasks.rados.rados.0.trial142.stdout:228: finishing rollback tid 2 to trial14245205-43 2026-02-17T11:47:04.366 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 115 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:228: done (3 left) 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:230: done (2 left) 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:231: done (1 left) 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:232: read oid 35 snap -1 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:232: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:47:04.367 INFO:tasks.rados.rados.0.trial142.stdout:233: snap_create 2026-02-17T11:47:04.370 INFO:tasks.rados.rados.0.trial142.stdout:232: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:47:04.432 INFO:tasks.rados.rados.0.trial142.stdout:229: finishing copy_from racing read to trial14245205-1 2026-02-17T11:47:04.432 INFO:tasks.rados.rados.0.trial142.stdout:229: finishing copy_from to trial14245205-1 2026-02-17T11:47:04.432 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 25 (ObjNum 75 snap 15 seq_num 75) dirty exists 2026-02-17T11:47:05.363 INFO:tasks.rados.rados.0.trial142.stdout:229: done (2 left) 2026-02-17T11:47:05.363 INFO:tasks.rados.rados.0.trial142.stdout:232: done (1 left) 2026-02-17T11:47:05.363 INFO:tasks.rados.rados.0.trial142.stdout:233: done (0 left) 2026-02-17T11:47:05.364 INFO:tasks.rados.rados.0.trial142.stdout:234: copy_from oid 14 from oid 5 current snap is 26 2026-02-17T11:47:05.364 INFO:tasks.rados.rados.0.trial142.stdout:235: snap_remove snap 19 2026-02-17T11:47:06.365 INFO:tasks.rados.rados.0.trial142.stdout:235: done (1 left) 2026-02-17T11:47:06.365 INFO:tasks.rados.rados.0.trial142.stdout:236: copy_from oid 2 from oid 45 current snap is 26 2026-02-17T11:47:06.365 INFO:tasks.rados.rados.0.trial142.stdout:234: finishing copy_from racing read to trial14245205-14 2026-02-17T11:47:06.365 INFO:tasks.rados.rados.0.trial142.stdout:234: finishing copy_from to trial14245205-14 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 52 (ObjNum 52 snap 0 seq_num 52) dirty exists 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:234: done (1 left) 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:237: copy_from oid 31 from oid 32 current snap is 26 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:238: rollback oid 4 current snap is 26 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 20 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:239: write (excl) oid 12 current snap is 26 2026-02-17T11:47:06.366 INFO:tasks.rados.rados.0.trial142.stdout:239: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2026-02-17T11:47:06.370 INFO:tasks.rados.rados.0.trial142.stdout:239: writing trial14245205-12 from 631963 to 1263046 tid 1 2026-02-17T11:47:06.376 INFO:tasks.rados.rados.0.trial142.stdout:239: writing trial14245205-12 from 2061949 to 2621968 tid 2 2026-02-17T11:47:06.380 INFO:tasks.rados.rados.0.trial142.stdout:239: writing trial14245205-12 from 3243812 to 3748579 tid 3 2026-02-17T11:47:06.380 INFO:tasks.rados.rados.0.trial142.stdout:240: read oid 1 snap -1 2026-02-17T11:47:06.381 INFO:tasks.rados.rados.0.trial142.stdout:240: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:06.381 INFO:tasks.rados.rados.0.trial142.stdout:241: write oid 9 current snap is 26 2026-02-17T11:47:06.381 INFO:tasks.rados.rados.0.trial142.stdout:238: finishing rollback tid 0 to trial14245205-4 2026-02-17T11:47:06.381 INFO:tasks.rados.rados.0.trial142.stdout:241: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-17T11:47:06.385 INFO:tasks.rados.rados.0.trial142.stdout:241: writing trial14245205-9 from 648770 to 1355102 tid 1 2026-02-17T11:47:06.390 INFO:tasks.rados.rados.0.trial142.stdout:241: writing trial14245205-9 from 2120431 to 2540461 tid 2 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:241: writing trial14245205-9 from 3271235 to 3703627 tid 3 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:242: snap_create 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:238: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:238: finishing rollback tid 2 to trial14245205-4 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 121 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:47:06.395 INFO:tasks.rados.rados.0.trial142.stdout:239: finishing write tid 1 to trial14245205-12 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:237: finishing copy_from racing read to trial14245205-31 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:237: finishing copy_from to trial14245205-31 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:236: finishing copy_from racing read to trial14245205-2 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:239: finishing write tid 2 to trial14245205-12 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:236: finishing copy_from to trial14245205-2 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:239: finishing write tid 3 to trial14245205-12 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:239: finishing write tid 4 to trial14245205-12 2026-02-17T11:47:06.396 INFO:tasks.rados.rados.0.trial142.stdout:239: finishing write tid 5 to trial14245205-12 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:239: oid 12 updating version 0 to 133 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:239: oid 12 version 133 is already newer than 131 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:239: oid 12 version 133 is already newer than 132 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:239: oid 12 version 133 is already newer than 130 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 133 (ObjNum 109 snap 26 seq_num 109) dirty exists 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:239: left oid 12 (ObjNum 109 snap 26 seq_num 109) 2026-02-17T11:47:06.397 INFO:tasks.rados.rados.0.trial142.stdout:240: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:06.523 INFO:tasks.rados.rados.0.trial142.stdout:241: finishing write tid 1 to trial14245205-9 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: finishing write tid 2 to trial14245205-9 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: finishing write tid 3 to trial14245205-9 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: finishing write tid 4 to trial14245205-9 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: finishing write tid 5 to trial14245205-9 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: oid 9 updating version 0 to 137 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: oid 9 version 137 is already newer than 134 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: oid 9 version 137 is already newer than 135 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: oid 9 version 137 is already newer than 136 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 137 (ObjNum 110 snap 26 seq_num 110) dirty exists 2026-02-17T11:47:06.524 INFO:tasks.rados.rados.0.trial142.stdout:241: left oid 9 (ObjNum 110 snap 26 seq_num 110) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:236: done (6 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:237: done (5 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:238: done (4 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:239: done (3 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:240: done (2 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:241: done (1 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:242: done (0 left) 2026-02-17T11:47:07.369 INFO:tasks.rados.rados.0.trial142.stdout:243: snap_remove snap 26 2026-02-17T11:47:08.371 INFO:tasks.rados.rados.0.trial142.stdout:243: done (0 left) 2026-02-17T11:47:08.372 INFO:tasks.rados.rados.0.trial142.stdout:244: write (excl) oid 48 current snap is 27 2026-02-17T11:47:08.372 INFO:tasks.rados.rados.0.trial142.stdout:244: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-17T11:47:08.377 INFO:tasks.rados.rados.0.trial142.stdout:244: writing trial14245205-48 from 665577 to 1447158 tid 1 2026-02-17T11:47:08.382 INFO:tasks.rados.rados.0.trial142.stdout:244: writing trial14245205-48 from 2062560 to 2626248 tid 2 2026-02-17T11:47:08.386 INFO:tasks.rados.rados.0.trial142.stdout:244: writing trial14245205-48 from 3182305 to 3825969 tid 3 2026-02-17T11:47:08.387 INFO:tasks.rados.rados.0.trial142.stdout:245: snap_remove snap 25 2026-02-17T11:47:08.387 INFO:tasks.rados.rados.0.trial142.stdout:244: finishing write tid 1 to trial14245205-48 2026-02-17T11:47:08.466 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:47:08.466 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:47:08.466 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:47:08.467 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:47:08.469 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:47:08.470 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T11:47:08.470 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T11:47:08.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:47:23.471 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T11:47:23.471 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T11:47:23.471 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:47:23.472 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:47:23.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.540+0000 7fc58b0bf640 10 monclient: get_monmap_and_config 2026-02-17T11:47:23.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.540+0000 7fc58b0bf640 10 monclient: build_initial_monmap 2026-02-17T11:47:23.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.540+0000 7fc58b0bf640 10 monclient: monmap: 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:23.541919+0000 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:23.541919+0000 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:23.543 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 Processor -- start 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 -- start start 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient: init 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5840a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-b con 0x7fc5840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc58413b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58406e140 con 0x7fc5840a3bb0 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58409f910 con 0x7fc58413b760 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc58409ccd0 con 0x7fc5840a0750 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc58b0bf640 10 monclient(hunting): authenticate will time out at 731.160677s 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc588e34640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc5840a3bb0 0x7fc58409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38292/0 (socket says 10.20.193.51:38292) 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc588e34640 1 -- 10.20.193.51:0/1304733558 learned_addr learned my addr 10.20.193.51:0/1304733558 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 10 monclient(hunting): get_auth_request con 0x7fc5840a0750 auth_method 0 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:47:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.541+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.543+0000 7fc588e34640 1 -- 10.20.193.51:0/1304733558 >> v1:10.20.193.51:6789/0 conn(0x7fc5840a3bb0 legacy=0x7fc58409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.544+0000 7fc589635640 1 -- 10.20.193.51:0/1304733558 >> v1:10.20.193.142:6789/0 conn(0x7fc58413b760 legacy=0x7fc58413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 10 monclient(hunting): get_auth_request con 0x7fc5840a0750 auth_method 0 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:47:23.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:23.742+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 10 monclient(hunting): get_auth_request con 0x7fc5840a0750 auth_method 0 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:47:24.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.143+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:47:24.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841512319 0 0) 0x7fc58406e140 con 0x7fc5840a3bb0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 10 monclient(hunting): my global_id is 34164 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.295+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc570003620 con 0x7fc5840a3bb0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4004307079 0 0) 0x7fc570003620 con 0x7fc5840a3bb0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc58409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc58409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 >> v1:10.20.193.142:6789/0 conn(0x7fc58413b760 legacy=0x7fc58413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58409eec0 con 0x7fc5840a3bb0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fc5740031a0 con 0x7fc5840a3bb0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc58b0bf640 5 monclient: authenticate success, global_id 34164 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc58b0bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: dump: 2026-02-17T11:47:24.299 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 >> v1:10.20.193.51:6789/0 conn(0x7fc5840a3bb0 legacy=0x7fc58409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc570003c00 0x7fc570004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): picked mon.a con 0x7fc570003c00 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc570004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): picked mon.c con 0x7fc5840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc570004ff0 0x7fc57000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): picked mon.b con 0x7fc570004ff0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc58409ccd0 con 0x7fc570003c00 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc57000c000 con 0x7fc570004ff0 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc57000c180 con 0x7fc5840a0750 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc58b0bf640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc570004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc570003c00 0x7fc570004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): get_auth_request con 0x7fc5840a0750 auth_method 0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): get_auth_request con 0x7fc570003c00 auth_method 0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient(hunting): handle_auth_done global_id 34164 payload 293 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc570004ff0 msgr2=0x7fc57000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc589635640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc570004ff0 0x7fc57000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc570004ff0 0x7fc57000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc570003c00 msgr2=0x7fc570004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc570003c00 0x7fc570004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 monclient: found mon.c 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc570003620 con 0x7fc5840a0750 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc57bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc588e34640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc570003c00 0x7fc570004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc589635640 10 monclient: get_auth_request con 0x7fc570004ff0 auth_method 0 2026-02-17T11:47:24.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.296+0000 7fc589635640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc570004ff0 0x7fc57000bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57bfff640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc570004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc570004900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc56c010920 tx=0x7fc56c02f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c088e817b65d457 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00f040 con 0x7fc5840a0750 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 10 monclient: dump: 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc570004900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc56c010920 tx=0x7fc56c02f730 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fc56c0043f0 mon_map magic: 0 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c004020 con 0x7fc5840a0750 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 4 set_mon_vals no callback set 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 10 monclient: shutdown 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc570004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1304733558 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc570004900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc56c010920 tx=0x7fc56c02f730 comp rx=0 tx=0).stop 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc589635640 1 -- 10.20.193.51:0/1304733558 reap_dead start 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 1 -- 10.20.193.51:0/1304733558 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7fc56c0043f0 con 0x7fc5840a0750 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc57b7fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1304733558 shutdown_connections 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1304733558 >> 10.20.193.51:0/1304733558 conn(0x7fc5840a30c0 msgr2=0x7fc5840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1304733558 shutdown_connections 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.299+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1304733558 wait complete. 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient: monmap: 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:24.304 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 Processor -- start 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 -- start start 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient: init 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-c con 0x7fc5840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 0x7fc5841ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-a con 0x7fc5841cdd80 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc584090da0 0x7fc584091220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): picked mon.noname-b con 0x7fc584090da0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840a04b0 con 0x7fc5841cdd80 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc58409c890 con 0x7fc584090da0 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc58409e1d0 con 0x7fc5840a0750 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc58b0bf640 10 monclient(hunting): authenticate will time out at 731.919746s 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 0x7fc5841ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57460/0 (socket says 10.20.193.51:57460) 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 -- 10.20.193.51:0/1965396051 learned_addr learned my addr 10.20.193.51:0/1965396051 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): get_auth_request con 0x7fc5840a0750 auth_method 0 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): get_auth_request con 0x7fc5841cdd80 auth_method 0 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient(hunting): handle_auth_done global_id 44099 payload 824 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 -- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc584090da0 msgr2=0x7fc584091220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc584090da0 0x7fc584091220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 -- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 msgr2=0x7fc5841ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 0x7fc5841ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 monclient: found mon.noname-c 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc588e34640 1 -- 10.20.193.51:0/1965396051 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58406f410 con 0x7fc5840a0750 2026-02-17T11:47:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.300+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 0x7fc5841ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc588e34640 1 -- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc5841cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc588e34640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc574007310 tx=0x7fc5740077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57400ce40 con 0x7fc5840a0750 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: dump: 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.307 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc574018070 con 0x7fc5840a0750 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 5 monclient: authenticate success, global_id 44099 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _renew_subs 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58409d7b0 con 0x7fc5840a0750 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740135f0 con 0x7fc5840a0750 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc57affd640 4 set_mon_vals no callback set 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 10 monclient: dump: 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _renew_subs 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc584094950 con 0x7fc5840a0750 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc574013790 con 0x7fc5840a0750 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc584094470 con 0x7fc5840a0750 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.303+0000 7fc5797fa640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 0x7fc5540401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.304+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 4751+0+0 (secure 0 0 0) 0x7fc574052a10 con 0x7fc5840a0750 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.304+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 0x7fc5540401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.304+0000 7fc57bfff640 10 monclient: get_auth_request con 0x7fc55403dd10 auth_method 0 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.306+0000 7fc57bfff640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 0x7fc5540401d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5840a0b70 tx=0x7fc56c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.306+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc574051430 con 0x7fc5840a0750 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.306+0000 7fc5797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.306+0000 7fc5797fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc58b0bf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc58b0bf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc58b0bf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc58409e5b0 con 0x7fc5840a0750 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc5797fa640 1 -- 10.20.193.51:0/1965396051 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fc57401cc60 con 0x7fc5840a0750 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc5797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.419+0000 7fc5797fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:24.421 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 msgr2=0x7fc5540401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 0x7fc5540401d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5840a0b70 tx=0x7fc56c033000 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 10 monclient: shutdown 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 msgr2=0x7fc5841cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc574007310 tx=0x7fc5740077e0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 shutdown_connections 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc55403dd10 0x7fc5540401d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc584090da0 0x7fc584091220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5841cdd80 0x7fc5841ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 --2- 10.20.193.51:0/1965396051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5840a0750 0x7fc5841cd840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 >> 10.20.193.51:0/1965396051 conn(0x7fc5840a30c0 msgr2=0x7fc58413ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 shutdown_connections 2026-02-17T11:47:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.420+0000 7fc58b0bf640 1 -- 10.20.193.51:0/1965396051 wait complete. 2026-02-17T11:47:24.429 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:47:24.429 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:47:24.429 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.496+0000 7ff0b880c640 10 monclient: get_monmap_and_config 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.496+0000 7ff0b880c640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient: monmap: 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.498 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:24.497971+0000 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:24.497971+0000 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:24.499 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 Processor -- start 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 -- start start 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient: init 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff0b00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff0b013b380 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 0x7ff0b0141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-b con 0x7ff0b013ee90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b0135430 con 0x7ff0b013b380 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b009af60 con 0x7ff0b00a3bb0 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b009a5c0 con 0x7ff0b013ee90 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b880c640 10 monclient(hunting): authenticate will time out at 732.116742s 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 0x7ff0b0141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b5d80640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff0b013b380 0x7ff0b013d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38298/0 (socket says 10.20.193.51:38298) 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1616457901 learned_addr learned my addr 10.20.193.51:0/1616457901 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): get_auth_request con 0x7ff0b013ee90 auth_method 0 2026-02-17T11:47:24.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.497+0000 7ff0b6d82640 10 monclient(hunting): handle_auth_done global_id 44102 payload 274 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1616457901 >> v1:10.20.193.142:6789/0 conn(0x7ff0b00a3bb0 legacy=0x7ff0b009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1616457901 >> v1:10.20.193.51:6789/0 conn(0x7ff0b013b380 legacy=0x7ff0b013d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 1 monclient: found mon.noname-b 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.498+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1616457901 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b009b240 con 0x7ff0b013ee90 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1616457901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 msgr2=0x7ff0b0141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b6d82640 1 --2- 10.20.193.51:0/1616457901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 0x7ff0b0141280 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009dc0 tx=0x7ff0a402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2707e7aa5400322 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 1 -- 10.20.193.51:0/1616457901 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a403c070 con 0x7ff0b013ee90 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: dump: 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 1 -- 10.20.193.51:0/1616457901 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a4037640 con 0x7ff0b013ee90 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 1 -- 10.20.193.51:0/1616457901 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4037a10 con 0x7ff0b013ee90 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 5 monclient: authenticate success, global_id 44102 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 4 set_mon_vals no callback set 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b557f640 10 monclient: dump: 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 10 monclient: shutdown 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 -- 10.20.193.51:0/1616457901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 msgr2=0x7ff0b0141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1616457901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 0x7ff0b0141280 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009dc0 tx=0x7ff0a402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 -- 10.20.193.51:0/1616457901 shutdown_connections 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1616457901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013ee90 0x7ff0b0141280 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 -- 10.20.193.51:0/1616457901 >> 10.20.193.51:0/1616457901 conn(0x7ff0b00a30c0 msgr2=0x7ff0b00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 -- 10.20.193.51:0/1616457901 shutdown_connections 2026-02-17T11:47:24.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.500+0000 7ff0b880c640 1 -- 10.20.193.51:0/1616457901 wait complete. 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient: monmap: 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 Processor -- start 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 -- start start 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient: init 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00a3bb0 0x7ff0b013a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-a con 0x7ff0b00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 0x7ff0b01cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-c con 0x7ff0b013b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff0b013ee90 0x7ff0b01cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): picked mon.noname-b con 0x7ff0b013ee90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0135040 con 0x7ff0b00a3bb0 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b00a3f90 con 0x7ff0b013ee90 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b01351c0 con 0x7ff0b013b380 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b880c640 10 monclient(hunting): authenticate will time out at 732.120859s 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 0x7ff0b01cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 0x7ff0b01cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57482/0 (socket says 10.20.193.51:57482) 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1644397572 learned_addr learned my addr 10.20.193.51:0/1644397572 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): get_auth_request con 0x7ff0b013b380 auth_method 0 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00a3bb0 0x7ff0b013a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): get_auth_request con 0x7ff0b00a3bb0 auth_method 0 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b5d80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.501+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 10 monclient(hunting): handle_auth_done global_id 44105 payload 824 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff0b013ee90 msgr2=0x7ff0b01cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff0b013ee90 0x7ff0b01cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00a3bb0 msgr2=0x7ff0b013a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00a3bb0 0x7ff0b013a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 monclient: found mon.noname-c 2026-02-17T11:47:24.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.502+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0139d10 con 0x7ff0b013b380 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b5d80640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 msgr2=0x7ff0b01cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b5d80640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 0x7ff0b01cf340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00c6d0 tx=0x7ff09c00cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c005de0 con 0x7ff0b013b380 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: dump: 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c007070 con 0x7ff0b013b380 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 5 monclient: authenticate success, global_id 44105 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 monclient: _renew_subs 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b0138580 con 0x7ff0b013b380 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c007440 con 0x7ff0b013b380 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b4d7e640 4 set_mon_vals no callback set 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 10 monclient: dump: 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 monclient: _renew_subs 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b0139470 con 0x7ff0b013b380 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 0x7ff0b00994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01396b0 con 0x7ff0b01cfdc0 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b6581640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 0x7ff0b00994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff09c007620 con 0x7ff0b013b380 2026-02-17T11:47:24.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b6581640 10 monclient: get_auth_request con 0x7ff0b01cfdc0 auth_method 0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b6581640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b6581640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.504+0000 7ff0b6581640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6581640 10 monclient(hunting): handle_auth_done global_id 34173 payload 824 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6581640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0b01d01a0 con 0x7ff0b01cfdc0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff09affd640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff08003dd10 0x7ff0800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 4751+0+0 (secure 0 0 0) 0x7ff09c052350 con 0x7ff0b013b380 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6d82640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff08003dd10 0x7ff0800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.505+0000 7ff0b6d82640 10 monclient: get_auth_request con 0x7ff08003dd10 auth_method 0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff0b6581640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 msgr2=0x7ff0b00994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff0b6581640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 0x7ff0b00994b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a8009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8016020 con 0x7ff0b01cfdc0 2026-02-17T11:47:24.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 10 monclient: dump: 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff0a800ea30 con 0x7ff0b01cfdc0 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 msgr2=0x7ff0b00994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 0x7ff0b00994b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a8009b10 comp rx=0 tx=0).stop 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 msgr2=0x7ff0b00994b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff09affd640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b01cfdc0 0x7ff0b00994b0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a8009b10 comp rx=0 tx=0).stop 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.507+0000 7ff0b6d82640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff08003dd10 0x7ff0800401d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00694e0 tx=0x7ff0a4031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b880c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:24.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 0x7ff0b01da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b880c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b009cd30 con 0x7ff0b00999f0 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 0x7ff0b01da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient: get_auth_request con 0x7ff0b00999f0 auth_method 0 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 10 monclient(hunting): handle_auth_done global_id 34176 payload 824 2026-02-17T11:47:24.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.510+0000 7ff0b6581640 1 -- 10.20.193.51:0/1644397572 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0b0074db0 con 0x7ff0b00999f0 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff0b6581640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 msgr2=0x7ff0b01da8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff0b6581640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 0x7ff0b01da8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8016050 con 0x7ff0b00999f0 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff09affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff09affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.512+0000 7ff09affd640 10 monclient: dump: 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.514 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7ff0a801b630 con 0x7ff0b00999f0 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 msgr2=0x7ff0b01da8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 0x7ff0b01da8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a80047f0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 msgr2=0x7ff0b01da8a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff09affd640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff0b00999f0 0x7ff0b01da8a0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009640 tx=0x7ff0a80047f0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 65157, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:47:24.515 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.516 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.517 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:24.518 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.520 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff08003dd10 msgr2=0x7ff0800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff08003dd10 0x7ff0800401d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00694e0 tx=0x7ff0a4031000 comp rx=0 tx=0).stop 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 10 monclient: shutdown 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 msgr2=0x7ff0b01cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 --2- 10.20.193.51:0/1644397572 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff0b013b380 0x7ff0b01cf340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00c6d0 tx=0x7ff09c00cba0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1644397572 reap_dead start 2026-02-17T11:47:24.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b6d82640 1 -- 10.20.193.51:0/1644397572 reap_dead start 2026-02-17T11:47:24.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 shutdown_connections 2026-02-17T11:47:24.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 >> 10.20.193.51:0/1644397572 conn(0x7ff0b00a30c0 msgr2=0x7ff0b0133610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 shutdown_connections 2026-02-17T11:47:24.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.513+0000 7ff0b880c640 1 -- 10.20.193.51:0/1644397572 wait complete. 2026-02-17T11:47:24.522 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:24.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:47:24.522 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:47:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.588+0000 7fbc4fa7c640 10 monclient: get_monmap_and_config 2026-02-17T11:47:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.588+0000 7fbc4fa7c640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.588+0000 7fbc4fa7c640 10 monclient: monmap: 2026-02-17T11:47:24.592 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:24.589827+0000 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:24.589827+0000 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 Processor -- start 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 -- start start 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient: init 2026-02-17T11:47:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbc480a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbc4809dac0 0x7fbc4809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-a con 0x7fbc4809dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbc480a0110 0x7fbc4813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-c con 0x7fbc480a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4806e140 con 0x7fbc480a3bb0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4809aed0 con 0x7fbc4809dac0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4809caa0 con 0x7fbc480a0110 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4fa7c640 10 monclient(hunting): authenticate will time out at 732.208647s 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbc4809dac0 0x7fbc4809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbc4809dac0 0x7fbc4809fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36848/0 (socket says 10.20.193.51:36848) 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 -- 10.20.193.51:0/2189313989 learned_addr learned my addr 10.20.193.51:0/2189313989 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): get_auth_request con 0x7fbc4809dac0 auth_method 0 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4dff2640 1 --2- 10.20.193.51:0/2189313989 >> v2:10.20.193.142:3300/0 conn(0x7fbc480a0110 0x7fbc4813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4dff2640 10 monclient(hunting): get_auth_request con 0x7fbc480a0110 auth_method 0 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4dff2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4dff2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4dff2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_done global_id 34179 payload 274 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 -- 10.20.193.51:0/2189313989 >> v2:10.20.193.142:3300/0 conn(0x7fbc480a0110 msgr2=0x7fbc4813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 --2- 10.20.193.51:0/2189313989 >> v2:10.20.193.142:3300/0 conn(0x7fbc480a0110 0x7fbc4813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 -- 10.20.193.51:0/2189313989 >> v1:10.20.193.142:6789/0 conn(0x7fbc480a3bb0 legacy=0x7fbc4809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 monclient: found mon.noname-a 2026-02-17T11:47:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.589+0000 7fbc4cff0640 1 -- 10.20.193.51:0/2189313989 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4809ce60 con 0x7fbc4809dac0 2026-02-17T11:47:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4cff0640 1 -- 10.20.193.51:0/2189313989 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc4809dac0 msgr2=0x7fbc4809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4cff0640 1 --2- 10.20.193.51:0/2189313989 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc4809dac0 0x7fbc4809fbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc4809cc20 tx=0x7fbc3c02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df322d29b1a10193 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 1 -- 10.20.193.51:0/2189313989 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c03c070 con 0x7fbc4809dac0 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: dump: 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 1 -- 10.20.193.51:0/2189313989 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c02fc90 con 0x7fbc4809dac0 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 5 monclient: authenticate success, global_id 34179 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 1 -- 10.20.193.51:0/2189313989 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037660 con 0x7fbc4809dac0 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 4 set_mon_vals no callback set 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc37fff640 10 monclient: dump: 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 10 monclient: shutdown 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/2189313989 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc4809dac0 msgr2=0x7fbc4809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/2189313989 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc4809dac0 0x7fbc4809fbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc4809cc20 tx=0x7fbc3c02ee10 comp rx=0 tx=0).stop 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/2189313989 shutdown_connections 2026-02-17T11:47:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/2189313989 >> v2:10.20.193.142:3300/0 conn(0x7fbc480a0110 0x7fbc4813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/2189313989 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc4809dac0 0x7fbc4809fbd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/2189313989 >> 10.20.193.51:0/2189313989 conn(0x7fbc480a30c0 msgr2=0x7fbc480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/2189313989 shutdown_connections 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.592+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/2189313989 wait complete. 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient: monmap: 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 Processor -- start 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 -- start start 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient: init 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc4809dac0 0x7fbc481cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-c con 0x7fbc4809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-a con 0x7fbc480a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc480a3bb0 0x7fbc481c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): picked mon.noname-b con 0x7fbc480a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480a0540 con 0x7fbc480a0110 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4809a880 con 0x7fbc480a3bb0 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4813cca0 con 0x7fbc4809dac0 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4fa7c640 10 monclient(hunting): authenticate will time out at 732.212835s 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36858/0 (socket says 10.20.193.51:36858) 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 -- 10.20.193.51:0/1048799263 learned_addr learned my addr 10.20.193.51:0/1048799263 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc4809dac0 0x7fbc481cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): get_auth_request con 0x7fbc480a0110 auth_method 0 2026-02-17T11:47:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): get_auth_request con 0x7fbc4809dac0 auth_method 0 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 10 monclient(hunting): handle_auth_done global_id 34182 payload 824 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc4809dac0 msgr2=0x7fbc481cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc4809dac0 0x7fbc481cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.593+0000 7fbc4cff0640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc480a3bb0 msgr2=0x7fbc481c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc480a3bb0 0x7fbc481c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 1 monclient: found mon.noname-a 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.594+0000 7fbc4cff0640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4809edb0 con 0x7fbc480a0110 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4cff0640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 msgr2=0x7fbc48135e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4cff0640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c002410 tx=0x7fbc3c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c03c040 con 0x7fbc480a0110 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: dump: 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c047070 con 0x7fbc480a0110 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c042890 con 0x7fbc480a0110 2026-02-17T11:47:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc377fe640 4 set_mon_vals no callback set 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 10 monclient: dump: 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 5 monclient: authenticate success, global_id 34182 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 monclient: _renew_subs 2026-02-17T11:47:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4809d7b0 con 0x7fbc480a0110 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 monclient: _renew_subs 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4813b430 con 0x7fbc480a0110 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 0x7fbc481ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbc481caa90 con 0x7fbc481ca170 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 0x7fbc481ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient: get_auth_request con 0x7fbc481ca170 auth_method 0 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbc3c042a30 con 0x7fbc480a0110 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_done global_id 44111 payload 824 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.596+0000 7fbc4d7f1640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc481ce060 con 0x7fbc481ca170 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.597+0000 7fbc35ffb640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc1803dd10 0x7fbc180401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.597+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4751+0+0 (secure 0 0 0) 0x7fbc3c0778f0 con 0x7fbc480a0110 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.597+0000 7fbc4dff2640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc1803dd10 0x7fbc180401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.597+0000 7fbc4dff2640 10 monclient: get_auth_request con 0x7fbc1803dd10 auth_method 0 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc4d7f1640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 msgr2=0x7fbc481ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc4d7f1640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 0x7fbc481ca550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800f7a0 tx=0x7fbc3800fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38018030 con 0x7fbc481ca170 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 10 monclient: dump: 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fbc3800dbc0 con 0x7fbc481ca170 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 msgr2=0x7fbc481ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 0x7fbc481ca550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800f7a0 tx=0x7fbc3800fc70 comp rx=0 tx=0).stop 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 msgr2=0x7fbc481ca550 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc35ffb640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc481ca170 0x7fbc481ca550 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800f7a0 tx=0x7fbc3800fc70 comp rx=0 tx=0).stop 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.599+0000 7fbc4dff2640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc1803dd10 0x7fbc180401d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc4813c5a0 tx=0x7fbc440096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4fa7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 0x7fbc481d8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4fa7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4813a3b0 con 0x7fbc48072430 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 0x7fbc481d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient: get_auth_request con 0x7fbc48072430 auth_method 0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 10 monclient(hunting): handle_auth_done global_id 44114 payload 824 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.602+0000 7fbc4d7f1640 1 -- 10.20.193.51:0/1048799263 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbc4809e990 con 0x7fbc48072430 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4d7f1640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 msgr2=0x7fbc481d8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4d7f1640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 0x7fbc481d8480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc38018000 tx=0x7fbc38003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38004230 con 0x7fbc48072430 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 10 monclient: dump: 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.612 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fbc38004230 con 0x7fbc48072430 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 msgr2=0x7fbc481d8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 0x7fbc481d8480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc38018000 tx=0x7fbc38003860 comp rx=0 tx=0).stop 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 msgr2=0x7fbc481d8480 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc35ffb640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc48072430 0x7fbc481d8480 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc38018000 tx=0x7fbc38003860 comp rx=0 tx=0).stop 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 16077, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.613 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.614 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.615 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.616 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc1803dd10 msgr2=0x7fbc180401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc1803dd10 0x7fbc180401d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc4813c5a0 tx=0x7fbc440096a0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 10 monclient: shutdown 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 msgr2=0x7fbc48135e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4dff2640 1 -- 10.20.193.51:0/1048799263 reap_dead start 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c002410 tx=0x7fbc3c004830 comp rx=0 tx=0).stop 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 shutdown_connections 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 --2- 10.20.193.51:0/1048799263 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc480a0110 0x7fbc48135e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 >> 10.20.193.51:0/1048799263 conn(0x7fbc480a30c0 msgr2=0x7fbc4806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 shutdown_connections 2026-02-17T11:47:24.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.605+0000 7fbc4fa7c640 1 -- 10.20.193.51:0/1048799263 wait complete. 2026-02-17T11:47:24.618 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:24.618 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:47:24.618 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:47:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.681+0000 7f9dc044d640 10 monclient: get_monmap_and_config 2026-02-17T11:47:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.681+0000 7f9dc044d640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.681+0000 7f9dc044d640 10 monclient: monmap: 2026-02-17T11:47:24.683 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.683 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:24.682954+0000 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:24.682954+0000 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:24.684 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 Processor -- start 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 -- start start 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient: init 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9db80a3bb0 0x7f9db809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-a con 0x7f9db80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9db80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 0x7f9db813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-b con 0x7f9db813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db806e140 con 0x7f9db80a0750 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9db809f910 con 0x7f9db80a3bb0 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9db809ccd0 con 0x7f9db813b760 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.682+0000 7f9dc044d640 10 monclient(hunting): authenticate will time out at 732.301966s 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9db80a3bb0 0x7f9db809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbd9c1640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9db80a0750 0x7f9db809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38306/0 (socket says 10.20.193.51:38306) 2026-02-17T11:47:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbd9c1640 1 -- 10.20.193.51:0/1843370658 learned_addr learned my addr 10.20.193.51:0/1843370658 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): get_auth_request con 0x7f9db80a3bb0 auth_method 0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 0x7f9db813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): get_auth_request con 0x7f9db813b760 auth_method 0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_done global_id 34185 payload 274 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 msgr2=0x7f9db813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 0x7f9db813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/1843370658 >> v1:10.20.193.51:6789/0 conn(0x7f9db80a0750 legacy=0x7f9db809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 monclient: found mon.noname-a 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/1843370658 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db809eec0 con 0x7f9db80a3bb0 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.683+0000 7f9dbe9c3640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 0x7f9db813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:24.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db80a3bb0 msgr2=0x7f9db809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbe1c2640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db80a3bb0 0x7f9db809dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9db806c1c0 tx=0x7f9da802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773e4582d593e36d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 1 -- 10.20.193.51:0/1843370658 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da803c070 con 0x7f9db80a3bb0 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: dump: 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.687 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 1 -- 10.20.193.51:0/1843370658 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da802fbd0 con 0x7f9db80a3bb0 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dc044d640 5 monclient: authenticate success, global_id 34185 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dc044d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 1 -- 10.20.193.51:0/1843370658 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8037440 con 0x7f9db80a3bb0 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dc044d640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dc044d640 4 set_mon_vals no callback set 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.685+0000 7f9dbd1c0640 10 monclient: dump: 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 10 monclient: shutdown 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db80a3bb0 msgr2=0x7f9db809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db80a3bb0 0x7f9db809dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9db806c1c0 tx=0x7f9da802ed50 comp rx=0 tx=0).stop 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- 10.20.193.51:0/1843370658 shutdown_connections 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db813b760 0x7f9db813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 --2- 10.20.193.51:0/1843370658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db80a3bb0 0x7f9db809dac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- 10.20.193.51:0/1843370658 >> 10.20.193.51:0/1843370658 conn(0x7f9db80a30c0 msgr2=0x7f9db80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- 10.20.193.51:0/1843370658 shutdown_connections 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- 10.20.193.51:0/1843370658 wait complete. 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 10 monclient: monmap: 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 Processor -- start 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 1 -- start start 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.686+0000 7f9dc044d640 10 monclient: init 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-c con 0x7f9db80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db80a3bb0 0x7f9db8099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-b con 0x7f9db80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db813b760 0x7f9db81ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): picked mon.noname-a con 0x7f9db813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9db80a04b0 con 0x7f9db813b760 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9db809c850 con 0x7f9db80a3bb0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9db809e710 con 0x7f9db80a0750 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dc044d640 10 monclient(hunting): authenticate will time out at 732.306152s 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57546/0 (socket says 10.20.193.51:57546) 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db813b760 0x7f9db81ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/3069459529 learned_addr learned my addr 10.20.193.51:0/3069459529 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): get_auth_request con 0x7f9db80a0750 auth_method 0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): get_auth_request con 0x7f9db813b760 auth_method 0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db80a3bb0 0x7f9db8099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient(hunting): handle_auth_done global_id 44120 payload 824 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db80a3bb0 msgr2=0x7f9db8099ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db80a3bb0 0x7f9db8099ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db813b760 msgr2=0x7f9db81ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db813b760 0x7f9db81ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 monclient: found mon.noname-c 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db80a2400 con 0x7f9db80a0750 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbd9c1640 10 monclient: get_auth_request con 0x7f9db80a3bb0 auth_method 0 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db80a3bb0 0x7f9db8099ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:47:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.687+0000 7f9dbe9c3640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9db813b760 0x7f9db81ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dbe1c2640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 msgr2=0x7f9db81c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dbe1c2640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9da8002410 tx=0x7f9da80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8046070 con 0x7f9db80a0750 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: dump: 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da8041680 con 0x7f9db80a0750 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 5 monclient: authenticate success, global_id 44120 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 10 monclient: _renew_subs 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db8094730 con 0x7f9db80a0750 2026-02-17T11:47:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da803c040 con 0x7f9db80a0750 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dbc9bf640 4 set_mon_vals no callback set 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9d9effd640 10 monclient: dump: 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 10 monclient: _renew_subs 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.689+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db809d7b0 con 0x7f9db80a0750 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dc044d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dc044d640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 0x7f9db81cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9db809dac0 con 0x7f9db809a1e0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9da8041a70 con 0x7f9db80a0750 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 0x7f9db81cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient: get_auth_request con 0x7f9db809a1e0 auth_method 0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9d9effd640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d8803dd40 0x7f9d88040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 4751+0+0 (secure 0 0 0) 0x7f9da8077d80 con 0x7f9db80a0750 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbe9c3640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d8803dd40 0x7f9d88040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbe9c3640 10 monclient: get_auth_request con 0x7f9d8803dd40 auth_method 0 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.690+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.691+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_done global_id 4387 payload 824 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.691+0000 7f9dbd9c1640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9db8092440 con 0x7f9db809a1e0 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9dbe9c3640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d8803dd40 0x7f9d88040200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9db806dab0 tx=0x7f9db400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9dbd9c1640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 msgr2=0x7f9db81cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 0x7f9db81cd320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac00dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac005de0 con 0x7f9db809a1e0 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9d9effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.693+0000 7f9d9effd640 10 monclient: dump: 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9dac017070 con 0x7f9db809a1e0 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 msgr2=0x7f9db81cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 0x7f9db81cd320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac00dbc0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 msgr2=0x7f9db81cd320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.694+0000 7f9d9effd640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db809a1e0 0x7f9db81cd320 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac00dbc0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.696+0000 7f9dc044d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.696+0000 7f9dc044d640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 0x7f9db81d8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.696+0000 7f9dc044d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.696+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81cdc70 con 0x7f9db81cd860 2026-02-17T11:47:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 0x7f9db81d8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient: get_auth_request con 0x7f9db81cd860 auth_method 0 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 10 monclient(hunting): handle_auth_done global_id 4390 payload 824 2026-02-17T11:47:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.697+0000 7f9dbd9c1640 1 -- 10.20.193.51:0/3069459529 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9db80931c0 con 0x7f9db81cd860 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9dbd9c1640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 msgr2=0x7f9db81d8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9dbd9c1640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 0x7f9db81d8190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bb40 con 0x7f9db81cd860 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9d9effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.699+0000 7f9d9effd640 10 monclient: dump: 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.701 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f9dac00bb40 con 0x7f9db81cd860 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 msgr2=0x7f9db81d8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 0x7f9db81d8190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac004a40 comp rx=0 tx=0).stop 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 msgr2=0x7f9db81d8190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9d9effd640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9db81cd860 0x7f9db81d8190 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00d6f0 tx=0x7f9dac004a40 comp rx=0 tx=0).stop 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 127977, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.702 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:24.703 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.704 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.706 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:24.707 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d8803dd40 msgr2=0x7f9d88040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d8803dd40 0x7f9d88040200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9db806dab0 tx=0x7f9db400b040 comp rx=0 tx=0).stop 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 10 monclient: shutdown 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 msgr2=0x7f9db81c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dbe9c3640 1 -- 10.20.193.51:0/3069459529 reap_dead start 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9da8002410 tx=0x7f9da80047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 shutdown_connections 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 --2- 10.20.193.51:0/3069459529 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9db80a0750 0x7f9db81c98e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 >> 10.20.193.51:0/3069459529 conn(0x7f9db80a30c0 msgr2=0x7f9db8072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 shutdown_connections 2026-02-17T11:47:24.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.700+0000 7f9dc044d640 1 -- 10.20.193.51:0/3069459529 wait complete. 2026-02-17T11:47:24.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:24.709 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:47:24.709 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:47:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 10 monclient: get_monmap_and_config 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 10 monclient: monmap: 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:24.775367+0000 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:24.775367+0000 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:24.776 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 1 Processor -- start 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 1 -- start start 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.774+0000 7fe3dc4d1640 10 monclient: init 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-b con 0x7fe3d406c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe3d4074d60 0x7fe3d406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-c con 0x7fe3d4074d60 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe3d406d1f0 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d40a0210 con 0x7fe3d406d1f0 2026-02-17T11:47:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d40a07d0 con 0x7fe3d4074d60 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d40a04f0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3dc4d1640 10 monclient(hunting): authenticate will time out at 732.394157s 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57560/0 (socket says 10.20.193.51:57560) 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3daa47640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe3d406d1f0 0x7fe3d409d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38308/0 (socket says 10.20.193.51:38308) 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 -- 10.20.193.51:0/3124655902 learned_addr learned my addr 10.20.193.51:0/3124655902 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): get_auth_request con 0x7fe3d406c8d0 auth_method 0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3d9a45640 1 --2- 10.20.193.51:0/3124655902 >> v2:10.20.193.142:3300/0 conn(0x7fe3d4074d60 0x7fe3d406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3d9a45640 10 monclient(hunting): get_auth_request con 0x7fe3d4074d60 auth_method 0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3d9a45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3d9a45640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3d9a45640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient(hunting): handle_auth_done global_id 44123 payload 274 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 -- 10.20.193.51:0/3124655902 >> v2:10.20.193.142:3300/0 conn(0x7fe3d4074d60 msgr2=0x7fe3d406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 --2- 10.20.193.51:0/3124655902 >> v2:10.20.193.142:3300/0 conn(0x7fe3d4074d60 0x7fe3d406ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 -- 10.20.193.51:0/3124655902 >> v1:10.20.193.51:6789/0 conn(0x7fe3d406d1f0 legacy=0x7fe3d409d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 monclient: found mon.noname-b 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.775+0000 7fe3da246640 1 -- 10.20.193.51:0/3124655902 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d409ecd0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.777+0000 7fe3da246640 1 -- 10.20.193.51:0/3124655902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 msgr2=0x7fe3d40a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.777+0000 7fe3da246640 1 --2- 10.20.193.51:0/3124655902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009970 tx=0x7fe3c402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6446878813bf746a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 1 -- 10.20.193.51:0/3124655902 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c403c070 con 0x7fe3d406c8d0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: dump: 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 1 -- 10.20.193.51:0/3124655902 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c402fcd0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 5 monclient: authenticate success, global_id 44123 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 1 -- 10.20.193.51:0/3124655902 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4037660 con 0x7fe3d406c8d0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 4 set_mon_vals no callback set 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3d9244640 10 monclient: dump: 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 10 monclient: shutdown 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3124655902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 msgr2=0x7fe3d40a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3124655902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009970 tx=0x7fe3c402ee90 comp rx=0 tx=0).stop 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3124655902 shutdown_connections 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3124655902 >> v2:10.20.193.142:3300/0 conn(0x7fe3d4074d60 0x7fe3d406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3124655902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d406c8d0 0x7fe3d40a13b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3124655902 >> 10.20.193.51:0/3124655902 conn(0x7fe3d40aaa60 msgr2=0x7fe3d40aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3124655902 shutdown_connections 2026-02-17T11:47:24.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3124655902 wait complete. 2026-02-17T11:47:24.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 10 monclient: build_initial_monmap 2026-02-17T11:47:24.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.778+0000 7fe3dc4d1640 10 monclient: monmap: 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 Processor -- start 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 -- start start 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient: init 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-a con 0x7fe3d406c8d0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3d406d1f0 0x7fe3d4130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-b con 0x7fe3d406d1f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d4074d60 0x7fe3d41305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): picked mon.noname-c con 0x7fe3d4074d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d40ab970 con 0x7fe3d406c8d0 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d40ab7f0 con 0x7fe3d406d1f0 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d409e0d0 con 0x7fe3d4074d60 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3dc4d1640 10 monclient(hunting): authenticate will time out at 732.398406s 2026-02-17T11:47:24.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d4074d60 0x7fe3d41305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36874/0 (socket says 10.20.193.51:36874) 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 -- 10.20.193.51:0/3247120488 learned_addr learned my addr 10.20.193.51:0/3247120488 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): get_auth_request con 0x7fe3d406c8d0 auth_method 0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): get_auth_request con 0x7fe3d4074d60 auth_method 0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3d9a45640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3d406d1f0 0x7fe3d4130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3daa47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3d9a45640 10 monclient(hunting): get_auth_request con 0x7fe3d406d1f0 auth_method 0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3d9a45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3d9a45640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3d9a45640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient(hunting): handle_auth_done global_id 34191 payload 824 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 -- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d4074d60 msgr2=0x7fe3d41305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d4074d60 0x7fe3d41305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 -- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3d406d1f0 msgr2=0x7fe3d4130060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3d406d1f0 0x7fe3d4130060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient: _finish_hunting 0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 monclient: found mon.noname-a 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.779+0000 7fe3da246640 1 -- 10.20.193.51:0/3247120488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d40a7dd0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3da246640 1 -- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 msgr2=0x7fe3d412fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3da246640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4002410 tx=0x7fe3c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4046070 con 0x7fe3d406c8d0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: dump: 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: _finish_auth 0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 5 monclient: authenticate success, global_id 34191 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c4041680 con 0x7fe3d406c8d0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 10 monclient: _renew_subs 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d41325f0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c403c040 con 0x7fe3d406c8d0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3d8a43640 4 set_mon_vals no callback set 2026-02-17T11:47:24.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3baffd640 10 monclient: dump: 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 10 monclient: _renew_subs 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.781+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d41328d0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3dc4d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3dc4d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3dc4d1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4135f20 con 0x7fe3d406c8d0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe3c4041a70 con 0x7fe3d406c8d0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3baffd640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 0x7fe3a40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4751+0+0 (secure 0 0 0) 0x7fe3c4077e30 con 0x7fe3d406c8d0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3d9a45640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 0x7fe3a40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.782+0000 7fe3d9a45640 10 monclient: get_auth_request con 0x7fe3a403dd10 auth_method 0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.785+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe3d40a7dd0 con 0x7fe3d406c8d0 2026-02-17T11:47:24.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.785+0000 7fe3baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:24.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.785+0000 7fe3baffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:24.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.785+0000 7fe3d9a45640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 0x7fe3a40401d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4132800 tx=0x7fe3c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.898+0000 7fe3dc4d1640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:47:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.898+0000 7fe3dc4d1640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:47:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.898+0000 7fe3dc4d1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.898+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe3d409e500 con 0x7fe3d406c8d0 2026-02-17T11:47:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.899+0000 7fe3baffd640 1 -- 10.20.193.51:0/3247120488 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe3c404ae40 con 0x7fe3d406c8d0 2026-02-17T11:47:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.899+0000 7fe3baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:47:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.899+0000 7fe3baffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 msgr2=0x7fe3a40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 0x7fe3a40401d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4132800 tx=0x7fe3c8008040 comp rx=0 tx=0).stop 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 10 monclient: shutdown 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 msgr2=0x7fe3d412fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4002410 tx=0x7fe3c40047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 shutdown_connections 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3a403dd10 0x7fe3a40401d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3d4074d60 0x7fe3d41305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3d406d1f0 0x7fe3d4130060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 --2- 10.20.193.51:0/3247120488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3d406c8d0 0x7fe3d412fb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 >> 10.20.193.51:0/3247120488 conn(0x7fe3d40aaa60 msgr2=0x7fe3d40a3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 shutdown_connections 2026-02-17T11:47:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:24.901+0000 7fe3dc4d1640 1 -- 10.20.193.51:0/3247120488 wait complete. 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=12,logm=64} crc {auth=2439070434,config=692619927,health=3523135250,kv=643764953,logm=3111968872}) 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=12,kv=11,logm=65} crc {auth=1609774163,config=692619927,health=3897446751,kv=1982221976,logm=487836762}) 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=12,logm=64} crc {auth=2439070434,config=692619927,health=3523135250,kv=643764953,logm=3111968872}) 2026-02-17T11:47:24.906 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.901+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=1389754094,config=692619927,health=3897446751,kv=1884803035,logm=2093950763}) 2026-02-17T11:47:24.908 INFO:tasks.rados.rados.0.trial142.stdout:245: done (1 left) 2026-02-17T11:47:24.908 INFO:tasks.rados.rados.0.trial142.stdout:246: write oid 39 current snap is 27 2026-02-17T11:47:24.909 INFO:tasks.rados.rados.0.trial142.stdout:244: finishing write tid 2 to trial14245205-48 2026-02-17T11:47:24.909 INFO:tasks.rados.rados.0.trial142.stdout:246: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2026-02-17T11:47:24.909 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:24.909 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=478587621}) 2026-02-17T11:47:24.909 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3978059299}) 2026-02-17T11:47:24.910 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:24.910 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=478587621}) 2026-02-17T11:47:24.910 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:24.907+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3942880070}) 2026-02-17T11:47:24.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:47:24.912 INFO:tasks.rados.rados.0.trial142.stdout:246: writing trial14245205-39 from 682384 to 1139214 tid 1 2026-02-17T11:47:24.916 INFO:tasks.rados.rados.0.trial142.stdout:246: writing trial14245205-39 from 1721042 to 2144741 tid 2 2026-02-17T11:47:24.920 INFO:tasks.rados.rados.0.trial142.stdout:246: writing trial14245205-39 from 2809728 to 3264664 tid 3 2026-02-17T11:47:24.923 INFO:tasks.rados.rados.0.trial142.stdout:246: writing trial14245205-39 from 3731357 to 3882384 tid 4 2026-02-17T11:47:24.923 INFO:tasks.rados.rados.0.trial142.stdout:247: write oid 49 current snap is 27 2026-02-17T11:47:24.923 INFO:tasks.rados.rados.0.trial142.stdout:247: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2026-02-17T11:47:24.928 INFO:tasks.rados.rados.0.trial142.stdout:247: writing trial14245205-49 from 699191 to 1231270 tid 1 2026-02-17T11:47:24.932 INFO:tasks.rados.rados.0.trial142.stdout:247: writing trial14245205-49 from 1779524 to 2346881 tid 2 2026-02-17T11:47:24.936 INFO:tasks.rados.rados.0.trial142.stdout:247: writing trial14245205-49 from 2837151 to 3503359 tid 3 2026-02-17T11:47:24.936 INFO:tasks.rados.rados.0.trial142.stdout:248: snap_remove snap 22 2026-02-17T11:47:25.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386323314}) 2026-02-17T11:47:25.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3258595067}) 2026-02-17T11:47:25.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386323314}) 2026-02-17T11:47:25.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.473+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1728478505}) 2026-02-17T11:47:25.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=986781553}) 2026-02-17T11:47:25.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2659782867}) 2026-02-17T11:47:25.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=986781553}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3045114742}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=135610999}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2935967629}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=135610999}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=541951141}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=99,mdsmap=1} crc {logm=3513819748,mdsmap=3122707571}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3918837532}) 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.685 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=99,mdsmap=1} crc {logm=3513819748,mdsmap=3122707571}) 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.681+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3968545798}) 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=9,osdmap=49} crc {mdsmap=3140514009,mgr=2354395411,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=909712793,mon_config_key=829000412,monmap=263989209,osd_metadata=2557680352,osd_pg_creating=3965751285,osd_snap=4217778827,osdmap=2922129339}) 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mdsmap=1,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=7,osdmap=53} crc {mdsmap=1228700967,mgr=1646349784,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1449597373,mon_config_key=829000412,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3965751285,osd_snap=4267388552,osdmap=1936902864}) 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=9,osdmap=49} crc {mdsmap=3140514009,mgr=2354395411,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=909712793,mon_config_key=829000412,monmap=263989209,osd_metadata=2557680352,osd_pg_creating=3965751285,osd_snap=4217778827,osdmap=2922129339}) 2026-02-17T11:47:25.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.682+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=9,osdmap=50} crc {mdsmap=3140514009,mgr=1646349784,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1449597373,mon_config_key=799756952,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3965751285,osd_snap=4217778827,osdmap=114411343}) 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=75} crc {osdmap=2099340224}) 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=73} crc {osdmap=3944834476}) 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=75} crc {osdmap=2099340224}) 2026-02-17T11:47:25.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:47:25.684+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=2781634634}) 2026-02-17T11:47:25.907 INFO:tasks.rados.rados.0.trial142.stdout:248: done (3 left) 2026-02-17T11:47:25.908 INFO:tasks.rados.rados.0.trial142.stdout:249: write (excl) oid 13 current snap is 27 2026-02-17T11:47:25.908 INFO:tasks.rados.rados.0.trial142.stdout:244: finishing write tid 3 to trial14245205-48 2026-02-17T11:47:25.908 INFO:tasks.rados.rados.0.trial142.stdout:244: finishing write tid 4 to trial14245205-48 2026-02-17T11:47:25.908 INFO:tasks.rados.rados.0.trial142.stdout:249: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2026-02-17T11:47:25.912 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:47:25.912 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:47:25.913 INFO:tasks.rados.rados.0.trial142.stdout:249: writing trial14245205-13 from 715998 to 1323326 tid 1 2026-02-17T11:47:25.916 INFO:tasks.rados.rados.0.trial142.stdout:249: writing trial14245205-13 from 1838006 to 2265374 tid 2 2026-02-17T11:47:25.920 INFO:tasks.rados.rados.0.trial142.stdout:249: writing trial14245205-13 from 2864574 to 3342054 tid 3 2026-02-17T11:47:25.924 INFO:tasks.rados.rados.0.trial142.stdout:249: writing trial14245205-13 from 3863835 to 3915998 tid 4 2026-02-17T11:47:25.925 INFO:tasks.rados.rados.0.trial142.stdout:250: snap_create 2026-02-17T11:47:25.925 INFO:tasks.rados.rados.0.trial142.stdout:244: finishing write tid 5 to trial14245205-48 2026-02-17T11:47:25.925 INFO:tasks.rados.rados.0.trial142.stdout:244: oid 48 updating version 0 to 51 2026-02-17T11:47:25.925 INFO:tasks.rados.rados.0.trial142.stdout:244: oid 48 updating version 51 to 53 2026-02-17T11:47:25.925 INFO:tasks.rados.rados.0.trial142.stdout:244: oid 48 version 53 is already newer than 52 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:244: oid 48 version 53 is already newer than 50 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 53 (ObjNum 111 snap 27 seq_num 111) dirty exists 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:244: left oid 48 (ObjNum 111 snap 27 seq_num 111) 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 1 to trial14245205-39 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 2 to trial14245205-39 2026-02-17T11:47:25.926 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 3 to trial14245205-39 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 4 to trial14245205-39 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 5 to trial14245205-39 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: finishing write tid 6 to trial14245205-39 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: oid 39 updating version 0 to 23 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: oid 39 updating version 23 to 24 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: oid 39 updating version 24 to 25 2026-02-17T11:47:25.927 INFO:tasks.rados.rados.0.trial142.stdout:246: oid 39 version 25 is already newer than 22 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:246: oid 39 updating version 25 to 26 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 26 (ObjNum 112 snap 27 seq_num 112) dirty exists 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:246: left oid 39 (ObjNum 112 snap 27 seq_num 112) 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:247: finishing write tid 1 to trial14245205-49 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:247: finishing write tid 2 to trial14245205-49 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:247: finishing write tid 3 to trial14245205-49 2026-02-17T11:47:25.928 INFO:tasks.rados.rados.0.trial142.stdout:247: finishing write tid 4 to trial14245205-49 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:247: finishing write tid 5 to trial14245205-49 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:247: oid 49 updating version 0 to 146 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:247: oid 49 version 146 is already newer than 144 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:247: oid 49 version 146 is already newer than 145 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:247: oid 49 version 146 is already newer than 143 2026-02-17T11:47:25.929 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 146 (ObjNum 113 snap 27 seq_num 113) dirty exists 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:247: left oid 49 (ObjNum 113 snap 27 seq_num 113) 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 1 to trial14245205-13 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 2 to trial14245205-13 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 3 to trial14245205-13 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 4 to trial14245205-13 2026-02-17T11:47:25.930 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 5 to trial14245205-13 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: finishing write tid 6 to trial14245205-13 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: oid 13 updating version 0 to 163 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: oid 13 version 163 is already newer than 161 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: oid 13 updating version 163 to 164 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: oid 13 version 164 is already newer than 162 2026-02-17T11:47:25.931 INFO:tasks.rados.rados.0.trial142.stdout:249: oid 13 version 164 is already newer than 160 2026-02-17T11:47:25.932 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 164 (ObjNum 114 snap 27 seq_num 114) dirty exists 2026-02-17T11:47:25.932 INFO:tasks.rados.rados.0.trial142.stdout:249: left oid 13 (ObjNum 114 snap 27 seq_num 114) 2026-02-17T11:47:25.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: get_monmap_and_config 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: build_initial_monmap 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: monmap: 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:25.980231+0000 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:25.980231+0000 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:25.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 Processor -- start 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 -- start start 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: init 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faf2c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faf2c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faf2c13c770 0x7faf2c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): picked mon.noname-a con 0x7faf2c13c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c09e8e0 con 0x7faf2c0a3bb0 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c06e140 con 0x7faf2c0a0750 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7faf2c09f910 con 0x7faf2c13c770 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.979+0000 7faf33761640 10 monclient(hunting): authenticate will time out at 733.598967s 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf314d6640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7faf2c0a3bb0 0x7faf2c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37234/0 (socket says 10.20.193.51:37234) 2026-02-17T11:47:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf314d6640 1 -- 10.20.193.51:0/3843534440 learned_addr learned my addr 10.20.193.51:0/3843534440 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 1 --2- 10.20.193.51:0/3843534440 >> v2:10.20.193.51:3300/0 conn(0x7faf2c13c770 0x7faf2c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): get_auth_request con 0x7faf2c13c770 auth_method 0 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient(hunting): handle_auth_done global_id 34194 payload 274 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 1 -- 10.20.193.51:0/3843534440 >> v1:10.20.193.142:6789/0 conn(0x7faf2c0a0750 legacy=0x7faf2c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 1 -- 10.20.193.51:0/3843534440 >> v1:10.20.193.51:6789/0 conn(0x7faf2c0a3bb0 legacy=0x7faf2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient: _finish_hunting 0 2026-02-17T11:47:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 1 monclient: found mon.noname-a 2026-02-17T11:47:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.980+0000 7faf31cd7640 1 -- 10.20.193.51:0/3843534440 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c09ccd0 con 0x7faf2c13c770 2026-02-17T11:47:25.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf31cd7640 1 -- 10.20.193.51:0/3843534440 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c13c770 msgr2=0x7faf2c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf31cd7640 1 --2- 10.20.193.51:0/3843534440 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c13c770 0x7faf2c13eb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf28009d90 tx=0x7faf2802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f784de338a20656a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 1 -- 10.20.193.51:0/3843534440 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2803c070 con 0x7faf2c13c770 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: dump: 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:25.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: _finish_auth 0 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf33761640 5 monclient: authenticate success, global_id 34194 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 1 -- 10.20.193.51:0/3843534440 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28037640 con 0x7faf2c13c770 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf33761640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:25.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 1 -- 10.20.193.51:0/3843534440 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28037a10 con 0x7faf2c13c770 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf33761640 4 set_mon_vals no callback set 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.982+0000 7faf1bfff640 10 monclient: dump: 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:25.996 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: shutdown 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- 10.20.193.51:0/3843534440 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c13c770 msgr2=0x7faf2c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 --2- 10.20.193.51:0/3843534440 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c13c770 0x7faf2c13eb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf28009d90 tx=0x7faf2802f190 comp rx=0 tx=0).stop 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- 10.20.193.51:0/3843534440 shutdown_connections 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 --2- 10.20.193.51:0/3843534440 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c13c770 0x7faf2c13eb60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- 10.20.193.51:0/3843534440 >> 10.20.193.51:0/3843534440 conn(0x7faf2c0a30c0 msgr2=0x7faf2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- 10.20.193.51:0/3843534440 shutdown_connections 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- 10.20.193.51:0/3843534440 wait complete. 2026-02-17T11:47:25.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: build_initial_monmap 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: monmap: 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 Processor -- start 2026-02-17T11:47:25.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- start start 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: init 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): picked mon.noname-a con 0x7faf2c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 0x7faf2c0903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): picked mon.noname-b con 0x7faf2c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf2c13c770 0x7faf2c090930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): picked mon.noname-c con 0x7faf2c13c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c09c850 con 0x7faf2c0a0750 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c09ebe0 con 0x7faf2c0a3bb0 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:25.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faf2c0a04b0 con 0x7faf2c13c770 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf33761640 10 monclient(hunting): authenticate will time out at 733.602904s 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35328/0 (socket says 10.20.193.51:35328) 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 1 -- 10.20.193.51:0/1892975318 learned_addr learned my addr 10.20.193.51:0/1892975318 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 10 monclient(hunting): get_auth_request con 0x7faf2c0a0750 auth_method 0 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf314d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.983+0000 7faf31cd7640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf2c13c770 0x7faf2c090930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): get_auth_request con 0x7faf2c13c770 auth_method 0 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf31cd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf30cd5640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 0x7faf2c0903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient(hunting): handle_auth_done global_id 34197 payload 824 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 -- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf2c13c770 msgr2=0x7faf2c090930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf2c13c770 0x7faf2c090930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 -- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 msgr2=0x7faf2c0903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 0x7faf2c0903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 monclient: found mon.noname-a 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf314d6640 1 -- 10.20.193.51:0/1892975318 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c0938b0 con 0x7faf2c0a0750 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf30cd5640 10 monclient: get_auth_request con 0x7faf2c0a3bb0 auth_method 0 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.984+0000 7faf30cd5640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 0x7faf2c0903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf314d6640 1 -- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 msgr2=0x7faf2c0998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf314d6640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c750 tx=0x7faf1c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c005de0 con 0x7faf2c0a0750 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: dump: 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c007070 con 0x7faf2c0a0750 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 5 monclient: authenticate success, global_id 34197 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _renew_subs 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c093b90 con 0x7faf2c0a0750 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c007440 con 0x7faf2c0a0750 2026-02-17T11:47:26.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf1b7fe640 4 set_mon_vals no callback set 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf19ffb640 10 monclient: dump: 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _renew_subs 2026-02-17T11:47:26.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c13cb50 con 0x7faf2c0a0750 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.986+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c09dac0 con 0x7faf2c0a0750 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.987+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faf1c007660 con 0x7faf2c0a0750 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.987+0000 7faf19ffb640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 0x7faefc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.987+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7faf1c0523b0 con 0x7faf2c0a0750 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.987+0000 7faf30cd5640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 0x7faefc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.987+0000 7faf30cd5640 10 monclient: get_auth_request con 0x7faefc03dd10 auth_method 0 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.989+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faf1c0119e0 con 0x7faf2c0a0750 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.989+0000 7faf19ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.989+0000 7faf19ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:26.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:25.990+0000 7faf30cd5640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 0x7faefc0401d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a2790 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf33761640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf33761640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf33761640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf2c0926d0 con 0x7faf2c0a0750 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf19ffb640 1 -- 10.20.193.51:0/1892975318 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7faf1c0520c0 con 0x7faf2c0a0750 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf19ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.104+0000 7faf19ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 msgr2=0x7faefc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 0x7faefc0401d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a2790 tx=0x7faf20008040 comp rx=0 tx=0).stop 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 10 monclient: shutdown 2026-02-17T11:47:26.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 msgr2=0x7faf2c0998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c750 tx=0x7faf1c00cc20 comp rx=0 tx=0).stop 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 shutdown_connections 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faefc03dd10 0x7faefc0401d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf2c13c770 0x7faf2c090930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf2c0a3bb0 0x7faf2c0903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 --2- 10.20.193.51:0/1892975318 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf2c0a0750 0x7faf2c0998d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 >> 10.20.193.51:0/1892975318 conn(0x7faf2c0a30c0 msgr2=0x7faf2c0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 shutdown_connections 2026-02-17T11:47:26.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.105+0000 7faf33761640 1 -- 10.20.193.51:0/1892975318 wait complete. 2026-02-17T11:47:26.114 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:47:26.114 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:47:26.114 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:47:26.114 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.197+0000 7f2c2fdb4640 10 monclient: get_monmap_and_config 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.197+0000 7f2c2fdb4640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.197+0000 7f2c2fdb4640 10 monclient: monmap: 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:26.198906+0000 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:26.198906+0000 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.199 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 Processor -- start 2026-02-17T11:47:26.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 -- start start 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient: init 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-b con 0x7f2c280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2c280a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2c2813b760 0x7f2c2813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-c con 0x7f2c2813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2806e140 con 0x7f2c280a0750 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2809f910 con 0x7f2c2813b760 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2809ccd0 con 0x7f2c280a3bb0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2fdb4640 10 monclient(hunting): authenticate will time out at 733.817653s 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39436/0 (socket says 10.20.193.51:39436) 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 -- 10.20.193.51:0/1505027655 learned_addr learned my addr 10.20.193.51:0/1505027655 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): get_auth_request con 0x7f2c280a3bb0 auth_method 0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2e32a640 1 --2- 10.20.193.51:0/1505027655 >> v2:10.20.193.142:3300/0 conn(0x7f2c2813b760 0x7f2c2813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2e32a640 10 monclient(hunting): get_auth_request con 0x7f2c2813b760 auth_method 0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2e32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2e32a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2e32a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient(hunting): handle_auth_done global_id 44132 payload 274 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 -- 10.20.193.51:0/1505027655 >> v2:10.20.193.142:3300/0 conn(0x7f2c2813b760 msgr2=0x7f2c2813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 --2- 10.20.193.51:0/1505027655 >> v2:10.20.193.142:3300/0 conn(0x7f2c2813b760 0x7f2c2813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 -- 10.20.193.51:0/1505027655 >> v1:10.20.193.142:6789/0 conn(0x7f2c280a0750 legacy=0x7f2c2809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 monclient: found mon.noname-b 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.198+0000 7f2c2db29640 1 -- 10.20.193.51:0/1505027655 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2809eec0 con 0x7f2c280a3bb0 2026-02-17T11:47:26.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2db29640 1 -- 10.20.193.51:0/1505027655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 msgr2=0x7f2c2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2db29640 1 --2- 10.20.193.51:0/1505027655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c2809f230 tx=0x7f2c1802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7abf85e47ce267b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 1 -- 10.20.193.51:0/1505027655 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1803c070 con 0x7f2c280a3bb0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: dump: 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 5 monclient: authenticate success, global_id 44132 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 1 -- 10.20.193.51:0/1505027655 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1802fcc0 con 0x7f2c280a3bb0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 1 -- 10.20.193.51:0/1505027655 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18037660 con 0x7f2c280a3bb0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2cb27640 10 monclient: dump: 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.203 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:26.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 4 set_mon_vals no callback set 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 10 monclient: shutdown 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/1505027655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 msgr2=0x7f2c2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/1505027655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c2809f230 tx=0x7f2c1802ee80 comp rx=0 tx=0).stop 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/1505027655 shutdown_connections 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/1505027655 >> v2:10.20.193.142:3300/0 conn(0x7f2c2813b760 0x7f2c2813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/1505027655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a3bb0 0x7f2c2809dac0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/1505027655 >> 10.20.193.51:0/1505027655 conn(0x7f2c280a30c0 msgr2=0x7f2c280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.201+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/1505027655 shutdown_connections 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/1505027655 wait complete. 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient: monmap: 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 Processor -- start 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 -- start start 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient: init 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 0x7f2c28095280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-c con 0x7f2c280a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a3bb0 0x7f2c280957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-a con 0x7f2c280a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c2813b760 0x7f2c28095d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): picked mon.noname-b con 0x7f2c2813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2c280a04b0 con 0x7f2c280a3bb0 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2809c850 con 0x7f2c2813b760 2026-02-17T11:47:26.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2809e710 con 0x7f2c280a0750 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2fdb4640 10 monclient(hunting): authenticate will time out at 733.821878s 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 0x7f2c28095280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 0x7f2c28095280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39442/0 (socket says 10.20.193.51:39442) 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 1 -- 10.20.193.51:0/3511304087 learned_addr learned my addr 10.20.193.51:0/3511304087 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): get_auth_request con 0x7f2c280a0750 auth_method 0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a3bb0 0x7f2c280957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2db29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2d328640 10 monclient(hunting): get_auth_request con 0x7f2c280a3bb0 auth_method 0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2d328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2d328640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.202+0000 7f2c2d328640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 10 monclient(hunting): handle_auth_done global_id 44135 payload 824 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c2813b760 msgr2=0x7f2c28095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c2813b760 0x7f2c28095d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a3bb0 msgr2=0x7f2c280957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a3bb0 0x7f2c280957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 monclient: found mon.noname-c 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2db29640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2809b9c0 con 0x7f2c280a0750 2026-02-17T11:47:26.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.203+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a3bb0 0x7f2c280957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2db29640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 msgr2=0x7f2c28095280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2db29640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 0x7f2c28095280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c18002410 tx=0x7f2c18004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1803c040 con 0x7f2c280a0750 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: dump: 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c18047070 con 0x7f2c280a0750 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 5 monclient: authenticate success, global_id 44135 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 monclient: _renew_subs 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c28098d70 con 0x7f2c280a0750 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18042890 con 0x7f2c280a0750 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c17fff640 4 set_mon_vals no callback set 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 10 monclient: dump: 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.207 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 monclient: _renew_subs 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c280984d0 con 0x7f2c280a0750 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 0x7f2c280a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2c18042a70 con 0x7f2c280a0750 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.205+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2806f6a0 con 0x7f2c280986a0 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 0x7f2c280a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient: get_auth_request con 0x7f2c280986a0 auth_method 0 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c167fc640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2bf803dd10 0x7f2bf80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 10 monclient(hunting): handle_auth_done global_id 34203 payload 824 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7f2c180779c0 con 0x7f2c280a0750 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2d328640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c28139ab0 con 0x7f2c280986a0 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2e32a640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2bf803dd10 0x7f2bf80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.206+0000 7f2c2e32a640 10 monclient: get_auth_request con 0x7f2bf803dd10 auth_method 0 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c2d328640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 msgr2=0x7f2c280a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 0x7f2c280a0ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00c910 con 0x7f2c280986a0 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 10 monclient: dump: 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f2c1c00c910 con 0x7f2c280986a0 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 msgr2=0x7f2c280a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 0x7f2c280a0ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c00eba0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 msgr2=0x7f2c280a0ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.208+0000 7f2c167fc640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280986a0 0x7f2c280a0ec0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c00eba0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.209+0000 7f2c2e32a640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2bf803dd10 0x7f2bf80401d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009fa0 tx=0x7f2c240096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2fdb4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 0x7f2c280a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2809dac0 con 0x7f2c280a1400 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 0x7f2c280a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient: get_auth_request con 0x7f2c280a1400 auth_method 0 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.211+0000 7f2c2d328640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.212+0000 7f2c2d328640 10 monclient(hunting): handle_auth_done global_id 34206 payload 824 2026-02-17T11:47:26.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.212+0000 7f2c2d328640 1 -- 10.20.193.51:0/3511304087 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c280008d0 con 0x7f2c280a1400 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2d328640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 msgr2=0x7f2c280a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2d328640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 0x7f2c280a1810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c01ea80 con 0x7f2c280a1400 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 10 monclient: dump: 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f2c1c007030 con 0x7f2c280a1400 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 msgr2=0x7f2c280a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 0x7f2c280a1810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c003860 comp rx=0 tx=0).stop 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 msgr2=0x7f2c280a1810 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c167fc640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c280a1400 0x7f2c280a1810 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c280a2240 tx=0x7f2c1c003860 comp rx=0 tx=0).stop 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 66859, 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:26.217 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:26.218 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.220 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2bf803dd10 msgr2=0x7f2bf80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2bf803dd10 0x7f2bf80401d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009fa0 tx=0x7f2c240096a0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 10 monclient: shutdown 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 msgr2=0x7f2c28095280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 --2- 10.20.193.51:0/3511304087 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c280a0750 0x7f2c28095280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c18002410 tx=0x7f2c18004830 comp rx=0 tx=0).stop 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2e32a640 1 -- 10.20.193.51:0/3511304087 reap_dead start 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2e32a640 1 -- 10.20.193.51:0/3511304087 reap_dead start 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 shutdown_connections 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 >> 10.20.193.51:0/3511304087 conn(0x7f2c280a30c0 msgr2=0x7f2c2813a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 shutdown_connections 2026-02-17T11:47:26.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.214+0000 7f2c2fdb4640 1 -- 10.20.193.51:0/3511304087 wait complete. 2026-02-17T11:47:26.222 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:26.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:47:26.223 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:47:26.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: get_monmap_and_config 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: monmap: 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:26.294251+0000 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:26.294251+0000 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:26.295 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 1 Processor -- start 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 1 -- start start 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: init 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd6400a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-b con 0x7fd6400a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.293+0000 7fd6456ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd64013b760 0x7fd64013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-a con 0x7fd64013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64006e140 con 0x7fd6400a3bb0 2026-02-17T11:47:26.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd64009f910 con 0x7fd64013b760 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd64009ccd0 con 0x7fd6400a0750 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd6456ca640 10 monclient(hunting): authenticate will time out at 733.913019s 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39448/0 (socket says 10.20.193.51:39448) 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3945931090 learned_addr learned my addr 10.20.193.51:0/3945931090 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): get_auth_request con 0x7fd6400a0750 auth_method 0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 1 --2- 10.20.193.51:0/3945931090 >> v2:10.20.193.51:3300/0 conn(0x7fd64013b760 0x7fd64013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): get_auth_request con 0x7fd64013b760 auth_method 0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_done global_id 44138 payload 274 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3945931090 >> v2:10.20.193.51:3300/0 conn(0x7fd64013b760 msgr2=0x7fd64013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 --2- 10.20.193.51:0/3945931090 >> v2:10.20.193.51:3300/0 conn(0x7fd64013b760 0x7fd64013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3945931090 >> v1:10.20.193.142:6789/0 conn(0x7fd6400a3bb0 legacy=0x7fd64009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 monclient: found mon.noname-b 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.294+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3945931090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64009eec0 con 0x7fd6400a0750 2026-02-17T11:47:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3945931090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 msgr2=0x7fd64009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63e7fc640 1 --2- 10.20.193.51:0/3945931090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd64009f230 tx=0x7fd62802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e48a0150b27852 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 1 -- 10.20.193.51:0/3945931090 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62803c070 con 0x7fd6400a0750 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: dump: 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd6456ca640 5 monclient: authenticate success, global_id 44138 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 1 -- 10.20.193.51:0/3945931090 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62802fca0 con 0x7fd6400a0750 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd6456ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 1 -- 10.20.193.51:0/3945931090 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628037660 con 0x7fd6400a0750 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd6456ca640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd6456ca640 4 set_mon_vals no callback set 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.296+0000 7fd63dffb640 10 monclient: dump: 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.299 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 10 monclient: shutdown 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- 10.20.193.51:0/3945931090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 msgr2=0x7fd64009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3945931090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd64009f230 tx=0x7fd62802ee60 comp rx=0 tx=0).stop 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- 10.20.193.51:0/3945931090 shutdown_connections 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3945931090 >> v2:10.20.193.51:3300/0 conn(0x7fd64013b760 0x7fd64013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3945931090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a0750 0x7fd64009e1d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- 10.20.193.51:0/3945931090 >> 10.20.193.51:0/3945931090 conn(0x7fd6400a30c0 msgr2=0x7fd6400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- 10.20.193.51:0/3945931090 shutdown_connections 2026-02-17T11:47:26.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- 10.20.193.51:0/3945931090 wait complete. 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 10 monclient: monmap: 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 Processor -- start 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 1 -- start start 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.297+0000 7fd6456ca640 10 monclient: init 2026-02-17T11:47:26.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6400a0750 0x7fd6401cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-b con 0x7fd6400a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 0x7fd6401d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-c con 0x7fd6400a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd64013b760 0x7fd640132160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): picked mon.noname-a con 0x7fd64013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400a04b0 con 0x7fd64013b760 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd64009c850 con 0x7fd6400a0750 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd64009e710 con 0x7fd6400a3bb0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd6456ca640 10 monclient(hunting): authenticate will time out at 733.917177s 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 0x7fd6401d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 0x7fd6401d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39450/0 (socket says 10.20.193.51:39450) 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3380152315 learned_addr learned my addr 10.20.193.51:0/3380152315 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): get_auth_request con 0x7fd6400a3bb0 auth_method 0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd64013b760 0x7fd640132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): get_auth_request con 0x7fd64013b760 auth_method 0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63effd640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6400a0750 0x7fd6401cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63effd640 10 monclient(hunting): get_auth_request con 0x7fd6400a0750 auth_method 0 2026-02-17T11:47:26.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient(hunting): handle_auth_done global_id 44141 payload 824 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6400a0750 msgr2=0x7fd6401cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6400a0750 0x7fd6401cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd64013b760 msgr2=0x7fd640132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd64013b760 0x7fd640132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.298+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd640135d90 con 0x7fd6400a3bb0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd63e7fc640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 msgr2=0x7fd6401d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd63e7fc640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 0x7fd6401d0010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd62802f370 tx=0x7fd628004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628047070 con 0x7fd6400a3bb0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: dump: 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62802fe50 con 0x7fd6400a3bb0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62803c040 con 0x7fd6400a3bb0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd61f7fe640 10 monclient: dump: 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd63d7fa640 4 set_mon_vals no callback set 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 5 monclient: authenticate success, global_id 44141 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 10 monclient: _renew_subs 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd640136070 con 0x7fd6400a3bb0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 10 monclient: _renew_subs 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6400a2b60 con 0x7fd6400a3bb0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.300+0000 7fd6456ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 0x7fd640132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd64009d7b0 con 0x7fd6401326a0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 0x7fd640132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient: get_auth_request con 0x7fd6401326a0 auth_method 0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd62803f9f0 con 0x7fd6400a3bb0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 10 monclient(hunting): handle_auth_done global_id 44144 payload 824 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63effd640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd64009dac0 con 0x7fd6401326a0 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd61f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd60c03dd10 0x7fd60c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7fd6280772a0 con 0x7fd6400a3bb0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd60c03dd10 0x7fd60c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.301+0000 7fd63f7fe640 10 monclient: get_auth_request con 0x7fd60c03dd10 auth_method 0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd63effd640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 msgr2=0x7fd640132a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd63effd640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 0x7fd640132a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e730 tx=0x7fd63400ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634006ae0 con 0x7fd6401326a0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 10 monclient: dump: 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd634006ae0 con 0x7fd6401326a0 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:26.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 msgr2=0x7fd640132a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 0x7fd640132a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e730 tx=0x7fd63400ec00 comp rx=0 tx=0).stop 2026-02-17T11:47:26.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 msgr2=0x7fd640132a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.303+0000 7fd61f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6401326a0 0x7fd640132a80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e730 tx=0x7fd63400ec00 comp rx=0 tx=0).stop 2026-02-17T11:47:26.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.304+0000 7fd63f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd60c03dd10 0x7fd60c0401d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6300113e0 tx=0x7fd63000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd6456ca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 0x7fd6401daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd6456ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd6401341a0 con 0x7fd640132fc0 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 0x7fd6401daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient: get_auth_request con 0x7fd640132fc0 auth_method 0 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.306+0000 7fd63effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.307+0000 7fd63effd640 10 monclient(hunting): handle_auth_done global_id 44147 payload 824 2026-02-17T11:47:26.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.307+0000 7fd63effd640 1 -- 10.20.193.51:0/3380152315 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6400008d0 con 0x7fd640132fc0 2026-02-17T11:47:26.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd63effd640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 msgr2=0x7fd6401daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd63effd640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 0x7fd6401daad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd634018000 tx=0x7fd634003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63400c930 con 0x7fd640132fc0 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 10 monclient: dump: 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fd634006e50 con 0x7fd640132fc0 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 msgr2=0x7fd6401daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 0x7fd6401daad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd634018000 tx=0x7fd634003860 comp rx=0 tx=0).stop 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 msgr2=0x7fd6401daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd61f7fe640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd640132fc0 0x7fd6401daad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 17781, 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:26.311 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:26.312 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.313 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.314 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.315 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd60c03dd10 msgr2=0x7fd60c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd60c03dd10 0x7fd60c0401d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6300113e0 tx=0x7fd63000b040 comp rx=0 tx=0).stop 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 10 monclient: shutdown 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 msgr2=0x7fd6401d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 --2- 10.20.193.51:0/3380152315 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6400a3bb0 0x7fd6401d0010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd62802f370 tx=0x7fd628004830 comp rx=0 tx=0).stop 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd63f7fe640 1 -- 10.20.193.51:0/3380152315 reap_dead start 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd63f7fe640 1 -- 10.20.193.51:0/3380152315 reap_dead start 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 shutdown_connections 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 >> 10.20.193.51:0/3380152315 conn(0x7fd6400a30c0 msgr2=0x7fd640138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 shutdown_connections 2026-02-17T11:47:26.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.309+0000 7fd6456ca640 1 -- 10.20.193.51:0/3380152315 wait complete. 2026-02-17T11:47:26.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:26.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:47:26.317 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:47:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: get_monmap_and_config 2026-02-17T11:47:26.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: monmap: 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:26.383147+0000 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:26.383147+0000 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 Processor -- start 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 -- start start 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: init 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient: _add_conns ranks=[4,3,2,0,1] 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 0x7f74f009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-c con 0x7f74f00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74f009dac0 0x7f74f009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-a con 0x7f74f009dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-b con 0x7f74f009ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f74f009aed0 con 0x7f74f009dac0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f74f009caa0 con 0x7f74f00a3bb0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00a3f90 con 0x7f74f009ff40 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74f623a640 10 monclient(hunting): authenticate will time out at 734.001870s 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74f009dac0 0x7f74f009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74effff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74f009dac0 0x7f74f009fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35380/0 (socket says 10.20.193.51:35380) 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 1 -- 10.20.193.51:0/688385061 learned_addr learned my addr 10.20.193.51:0/688385061 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 10 monclient(hunting): get_auth_request con 0x7f74f009dac0 auth_method 0 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.382+0000 7f74eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): get_auth_request con 0x7f74f009ff40 auth_method 0 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/688385061 >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 0x7f74f009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient(hunting): handle_auth_done global_id 34215 payload 274 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 -- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 msgr2=0x7f74f013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 --2- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 -- 10.20.193.51:0/688385061 >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 msgr2=0x7f74f009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 --2- 10.20.193.51:0/688385061 >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 0x7f74f009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 monclient: found mon.noname-a 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74eeffd640 1 -- 10.20.193.51:0/688385061 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f006e140 con 0x7f74f009dac0 2026-02-17T11:47:26.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74ef7fe640 10 monclient: get_auth_request con 0x7f74f00a3bb0 auth_method 0 2026-02-17T11:47:26.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.383+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/688385061 >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 0x7f74f009f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74eeffd640 1 -- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f009dac0 msgr2=0x7f74f009fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74eeffd640 1 --2- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f009dac0 0x7f74f009fa00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74f006c1c0 tx=0x7f74e002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102b07e8317c534c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 1 -- 10.20.193.51:0/688385061 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e003c070 con 0x7f74f009dac0 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: dump: 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.393 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 1 -- 10.20.193.51:0/688385061 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e002fca0 con 0x7f74f009dac0 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74f623a640 5 monclient: authenticate success, global_id 34215 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 1 -- 10.20.193.51:0/688385061 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0037660 con 0x7f74f009dac0 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74ee7fc640 10 monclient: dump: 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74f623a640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.385+0000 7f74f623a640 4 set_mon_vals no callback set 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 10 monclient: shutdown 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f009dac0 msgr2=0x7f74f009fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 --2- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f009dac0 0x7f74f009fa00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74f006c1c0 tx=0x7f74e002ee60 comp rx=0 tx=0).stop 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- 10.20.193.51:0/688385061 shutdown_connections 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 --2- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 --2- 10.20.193.51:0/688385061 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f009dac0 0x7f74f009fa00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 --2- 10.20.193.51:0/688385061 >> v2:10.20.193.142:3300/0 conn(0x7f74f00a3bb0 0x7f74f009f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- 10.20.193.51:0/688385061 >> 10.20.193.51:0/688385061 conn(0x7f74f00a30c0 msgr2=0x7f74f00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- 10.20.193.51:0/688385061 shutdown_connections 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- 10.20.193.51:0/688385061 wait complete. 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 10 monclient: monmap: 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.395 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 Processor -- start 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 1 -- start start 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.386+0000 7f74f623a640 10 monclient: init 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f009dac0 0x7f74f01ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-b con 0x7f74f009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f01bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-c con 0x7f74f009ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 0x7f74f01b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): picked mon.noname-a con 0x7f74f00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00a0370 con 0x7f74f00a3bb0 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f74f009a880 con 0x7f74f009dac0 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00a04f0 con 0x7f74f009ff40 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74f623a640 10 monclient(hunting): authenticate will time out at 734.006141s 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 0x7f74f01b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f01bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 0x7f74f01b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35388/0 (socket says 10.20.193.51:35388) 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 1 -- 10.20.193.51:0/2886016160 learned_addr learned my addr 10.20.193.51:0/2886016160 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): get_auth_request con 0x7f74f009ff40 auth_method 0 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): get_auth_request con 0x7f74f00a3bb0 auth_method 0 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient(hunting): handle_auth_done global_id 44153 payload 824 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f009dac0 0x7f74f01ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f009dac0 msgr2=0x7f74f01ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f009dac0 0x7f74f01ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 msgr2=0x7f74f01b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 0x7f74f01b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 monclient: found mon.noname-c 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74eeffd640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f01cd090 con 0x7f74f009ff40 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74effff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74f00a3bb0 0x7f74f01b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74ef7fe640 10 monclient: get_auth_request con 0x7f74f009dac0 auth_method 0 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.387+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f009dac0 0x7f74f01ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74eeffd640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 msgr2=0x7f74f01bd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74eeffd640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f01bd7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74f0051340 tx=0x7f74e0004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0047070 con 0x7f74f009ff40 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.398 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e002fe50 con 0x7f74f009ff40 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 5 monclient: authenticate success, global_id 44153 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 10 monclient: _renew_subs 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f01b63e0 con 0x7f74f009ff40 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e003c040 con 0x7f74f009ff40 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74edffb640 4 set_mon_vals no callback set 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.399 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 10 monclient: _renew_subs 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.389+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f006d490 con 0x7f74f009ff40 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74f623a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74f623a640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 0x7f74f01b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f74f009f4c0 con 0x7f74f01bdce0 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f74e003fa30 con 0x7f74f009ff40 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 0x7f74f01b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient: get_auth_request con 0x7f74f01bdce0 auth_method 0 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74cbfff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd10 0x7f74c00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7f74e00771d0 con 0x7f74f009ff40 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74effff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd10 0x7f74c00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74effff640 10 monclient: get_auth_request con 0x7f74c003dd10 auth_method 0 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2026-02-17T11:47:26.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.390+0000 7f74ef7fe640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74f0069830 con 0x7f74f01bdce0 2026-02-17T11:47:26.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74effff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd10 0x7f74c00401d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009fd0 tx=0x7f74e400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74ef7fe640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 msgr2=0x7f74f01b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 0x7f74f01b7bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00d720 tx=0x7f74dc00dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc016070 con 0x7f74f01bdce0 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f74dc008d20 con 0x7f74f01bdce0 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 msgr2=0x7f74f01b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.393+0000 7f74cbfff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 0x7f74f01b7bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00d720 tx=0x7f74dc00dbf0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.394+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 msgr2=0x7f74f01b7bd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.394+0000 7f74cbfff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01bdce0 0x7f74f01b7bd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74f623a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74f623a640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 0x7f74f01d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74f623a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0050ac0 con 0x7f74f01b48f0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 0x7f74f01d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient: get_auth_request con 0x7f74f01b48f0 auth_method 0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_done global_id 4408 payload 824 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.397+0000 7f74ef7fe640 1 -- 10.20.193.51:0/2886016160 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74f01b4d00 con 0x7f74f01b48f0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74ef7fe640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 msgr2=0x7f74f01d7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 0x7f74f01d7ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74dc018000 tx=0x7f74dc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc01b740 con 0x7f74f01b48f0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:47:26.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f74dc026420 con 0x7f74f01b48f0 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 msgr2=0x7f74f01d7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 0x7f74f01d7ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74dc018000 tx=0x7f74dc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 msgr2=0x7f74f01d7ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:26.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74cbfff640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f01b48f0 0x7f74f01d7ee0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74dc018000 tx=0x7f74dc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 16, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 129677, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.406 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.407 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:26.408 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.409 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:26.410 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:26.411 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.412 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:26.413 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:26.414 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:26.414 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:26.414 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:26.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd10 msgr2=0x7f74c00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd10 0x7f74c00401d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009fd0 tx=0x7f74e400b040 comp rx=0 tx=0).stop 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 10 monclient: shutdown 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 msgr2=0x7f74f01bd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 --2- 10.20.193.51:0/2886016160 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f009ff40 0x7f74f01bd7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74f0051340 tx=0x7f74e0004830 comp rx=0 tx=0).stop 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74effff640 1 -- 10.20.193.51:0/2886016160 reap_dead start 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74effff640 1 -- 10.20.193.51:0/2886016160 reap_dead start 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 shutdown_connections 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 >> 10.20.193.51:0/2886016160 conn(0x7f74f00a30c0 msgr2=0x7f74f009e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 shutdown_connections 2026-02-17T11:47:26.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.400+0000 7f74f623a640 1 -- 10.20.193.51:0/2886016160 wait complete. 2026-02-17T11:47:26.415 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:47:26.415 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T11:47:26.415 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:47:26.416 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T11:47:26.416 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:47:26.416 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T11:47:26.416 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:47:26.426 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T11:47:26.426 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:47:26.426 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:47:26.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.490+0000 7f17cb8ca640 10 monclient: get_monmap_and_config 2026-02-17T11:47:26.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.490+0000 7f17cb8ca640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.490+0000 7f17cb8ca640 10 monclient: monmap: 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:26.491884+0000 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:26.491884+0000 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 Processor -- start 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 -- start start 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient: init 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17c40a3bb0 0x7f17c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-a con 0x7f17c40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f17c40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c413b760 0x7f17c413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-b con 0x7f17c413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c406e140 con 0x7f17c40a0750 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f17c409f910 con 0x7f17c40a3bb0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17c409ccd0 con 0x7f17c413b760 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17cb8ca640 10 monclient(hunting): authenticate will time out at 734.110688s 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17c40a3bb0 0x7f17c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c8e3e640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f17c40a0750 legacy=0x7f17c409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c413b760 0x7f17c413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17b3fff640 1 -- DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17c40a3bb0 0x7f17c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35392/0 (socket says 10.20.193.51:35392) 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 -- 10.20.193.51:0/2075026062 learned_addr learned my addr 10.20.193.51:0/2075026062 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): get_auth_request con 0x7f17c40a3bb0 auth_method 0 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): get_auth_request con 0x7f17c413b760 auth_method 0 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c9e40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient(hunting): handle_auth_done global_id 34221 payload 274 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 -- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c413b760 msgr2=0x7f17c413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 --2- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c413b760 0x7f17c413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 -- 10.20.193.51:0/2075026062 >> v1:10.20.193.142:6789/0 conn(0x7f17c40a0750 legacy=0x7f17c409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 monclient: found mon.noname-a 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:26.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.491+0000 7f17c963f640 1 -- 10.20.193.51:0/2075026062 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c409eec0 con 0x7f17c40a3bb0 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17c963f640 1 -- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 msgr2=0x7f17c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17c963f640 1 --2- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c409dac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c406c1c0 tx=0x7f17b402ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d5f781ad821e2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 1 -- 10.20.193.51:0/2075026062 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b403c070 con 0x7f17c40a3bb0 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: dump: 2026-02-17T11:47:26.501 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 1 -- 10.20.193.51:0/2075026062 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b402fcc0 con 0x7f17c40a3bb0 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 5 monclient: authenticate success, global_id 34221 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 1 -- 10.20.193.51:0/2075026062 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4037660 con 0x7f17c40a3bb0 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:26.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 4 set_mon_vals no callback set 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17b3fff640 10 monclient: dump: 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 10 monclient: shutdown 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 1 -- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 msgr2=0x7f17c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c409dac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c406c1c0 tx=0x7f17b402ee80 comp rx=0 tx=0).stop 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 1 -- 10.20.193.51:0/2075026062 shutdown_connections 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c413b760 0x7f17c413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.494+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/2075026062 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c409dac0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 1 -- 10.20.193.51:0/2075026062 >> 10.20.193.51:0/2075026062 conn(0x7f17c40a30c0 msgr2=0x7f17c40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 1 -- 10.20.193.51:0/2075026062 shutdown_connections 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 1 -- 10.20.193.51:0/2075026062 wait complete. 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 10 monclient: build_initial_monmap 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 10 monclient: monmap: 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 1 Processor -- start 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 1 -- start start 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.495+0000 7f17cb8ca640 10 monclient: init 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:26.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-c con 0x7f17c40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c4095a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-a con 0x7f17c40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 0x7f17c4095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): picked mon.noname-b con 0x7f17c413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f17c40a04b0 con 0x7f17c40a3bb0 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17c409c850 con 0x7f17c413b760 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17c409e710 con 0x7f17c40a0750 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17cb8ca640 10 monclient(hunting): authenticate will time out at 734.115118s 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39502/0 (socket says 10.20.193.51:39502) 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 -- 10.20.193.51:0/1876439070 learned_addr learned my addr 10.20.193.51:0/1876439070 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c4095a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): get_auth_request con 0x7f17c40a0750 auth_method 0 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): get_auth_request con 0x7f17c40a3bb0 auth_method 0 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c9e40640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 msgr2=0x7f17c4095fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c9e40640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 0x7f17c4095fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient(hunting): handle_auth_done global_id 44159 payload 824 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 msgr2=0x7f17c4095fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 0x7f17c4095fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 msgr2=0x7f17c4095a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c4095a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient: _finish_hunting 0 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 monclient: found mon.noname-c 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c963f640 1 -- 10.20.193.51:0/1876439070 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40a2b60 con 0x7f17c40a0750 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.496+0000 7f17c8e3e640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c4095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17c963f640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 msgr2=0x7f17c4095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17c963f640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009a70 tx=0x7f17b40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4046020 con 0x7f17c40a0750 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: dump: 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.507 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 5 monclient: authenticate success, global_id 44159 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4042640 con 0x7f17c40a0750 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 10 monclient: _renew_subs 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c40989e0 con 0x7f17c40a0750 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b403c040 con 0x7f17c40a0750 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b1ffb640 10 monclient: dump: 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:26.508 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17b37fe640 4 set_mon_vals no callback set 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 10 monclient: _renew_subs 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.498+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c4097150 con 0x7f17c40a0750 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f17b403f030 con 0x7f17c40a0750 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17cb8ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17cb8ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17cb8ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c409dac0 con 0x7f17c40a0750 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17b1ffb640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 0x7f1794040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7f17b40774f0 con 0x7f17c40a0750 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17c8e3e640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 0x7f1794040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:26.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.499+0000 7f17c8e3e640 10 monclient: get_auth_request con 0x7f179403dcc0 auth_method 0 2026-02-17T11:47:26.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.501+0000 7f17c8e3e640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 0x7f1794040180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17b8006f20 tx=0x7f17b8006e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:26.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.502+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f17b4050070 con 0x7f17c40a0750 2026-02-17T11:47:26.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.502+0000 7f17b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:26.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.502+0000 7f17b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17cb8ca640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17cb8ca640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17cb8ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f17c40008d0 con 0x7f17c40a0750 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17b1ffb640 1 -- 10.20.193.51:0/1876439070 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f17c40a2b60 con 0x7f17c40a0750 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.615+0000 7f17b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:26.619 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 msgr2=0x7f1794040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 0x7f1794040180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17b8006f20 tx=0x7f17b8006e70 comp rx=0 tx=0).stop 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 10 monclient: shutdown 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 msgr2=0x7f17c4095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009a70 tx=0x7f17b40047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 shutdown_connections 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f179403dcc0 0x7f1794040180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17c413b760 0x7f17c4095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17c40a3bb0 0x7f17c4095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 --2- 10.20.193.51:0/1876439070 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c40a0750 0x7f17c4095520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:26.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 >> 10.20.193.51:0/1876439070 conn(0x7f17c40a30c0 msgr2=0x7f17c413adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:26.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 shutdown_connections 2026-02-17T11:47:26.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:26.616+0000 7f17cb8ca640 1 -- 10.20.193.51:0/1876439070 wait complete. 2026-02-17T11:47:29.627 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: get_monmap_and_config 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: build_initial_monmap 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: monmap: 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:29.697233+0000 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:29.697233+0000 2026-02-17T11:47:29.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 Processor -- start 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 -- start start 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: init 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:29.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 0x7fdf8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdf800a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdf800a0750 0x7fdf8009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-a con 0x7fdf800a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 0x7fdf8013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-b con 0x7fdf8009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fdf800a3f90 con 0x7fdf800a0750 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdf8006e140 con 0x7fdf800a3bb0 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8009f910 con 0x7fdf8009e540 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.696+0000 7fdf883b6640 10 monclient(hunting): authenticate will time out at 737.315964s 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8612b640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 msgr2=0x7fdf8009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8612b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 0x7fdf8009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdf800a0750 0x7fdf8009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 0x7fdf8013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdf800a0750 0x7fdf8009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35398/0 (socket says 10.20.193.51:35398) 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 -- 10.20.193.51:0/1477186525 learned_addr learned my addr 10.20.193.51:0/1477186525 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): get_auth_request con 0x7fdf800a0750 auth_method 0 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:29.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): get_auth_request con 0x7fdf8009e540 auth_method 0 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient(hunting): handle_auth_done global_id 34227 payload 274 2026-02-17T11:47:29.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 -- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 msgr2=0x7fdf8013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 0x7fdf8013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 -- 10.20.193.51:0/1477186525 >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 msgr2=0x7fdf8009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 --2- 10.20.193.51:0/1477186525 >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 0x7fdf8009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient: _finish_hunting 0 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 monclient: found mon.noname-a 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8592a640 1 -- 10.20.193.51:0/1477186525 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8009ccd0 con 0x7fdf800a0750 2026-02-17T11:47:29.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.697+0000 7fdf8692c640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 0x7fdf8013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:29.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf8592a640 1 -- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf800a0750 msgr2=0x7fdf8009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf8592a640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf800a0750 0x7fdf8009e000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf8006c1c0 tx=0x7fdf7402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb060084224947 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 1 -- 10.20.193.51:0/1477186525 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7403c070 con 0x7fdf800a0750 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: dump: 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.714 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: _finish_auth 0 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: _check_auth_tickets 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 1 -- 10.20.193.51:0/1477186525 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7402fcd0 con 0x7fdf800a0750 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 1 -- 10.20.193.51:0/1477186525 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74037660 con 0x7fdf800a0750 2026-02-17T11:47:29.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf883b6640 5 monclient: authenticate success, global_id 34227 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf883b6640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf883b6640 4 set_mon_vals no callback set 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.699+0000 7fdf85129640 10 monclient: dump: 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 10 monclient: shutdown 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 -- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf800a0750 msgr2=0x7fdf8009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf800a0750 0x7fdf8009e000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf8006c1c0 tx=0x7fdf7402ee90 comp rx=0 tx=0).stop 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 -- 10.20.193.51:0/1477186525 shutdown_connections 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf8009e540 0x7fdf8013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 --2- 10.20.193.51:0/1477186525 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf800a0750 0x7fdf8009e000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 --2- 10.20.193.51:0/1477186525 >> v2:10.20.193.142:3300/0 conn(0x7fdf800a3bb0 0x7fdf8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 -- 10.20.193.51:0/1477186525 >> 10.20.193.51:0/1477186525 conn(0x7fdf800a30c0 msgr2=0x7fdf800a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 -- 10.20.193.51:0/1477186525 shutdown_connections 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 -- 10.20.193.51:0/1477186525 wait complete. 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 10 monclient: build_initial_monmap 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 10 monclient: monmap: 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.700+0000 7fdf883b6640 1 Processor -- start 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 -- start start 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient: init 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 0x7fdf801cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-a con 0x7fdf8009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 0x7fdf80098aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-b con 0x7fdf800a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 0x7fdf801cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdf800a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdf800a04b0 con 0x7fdf8009e540 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8009c850 con 0x7fdf800a0750 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8013cca0 con 0x7fdf800a3bb0 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf883b6640 10 monclient(hunting): authenticate will time out at 737.320306s 2026-02-17T11:47:29.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 0x7fdf801cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 0x7fdf801cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 0x7fdf801cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35412/0 (socket says 10.20.193.51:35412) 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8592a640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 msgr2=0x7fdf80098aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): get_auth_request con 0x7fdf800a3bb0 auth_method 0 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 1 -- 10.20.193.51:0/3454728420 learned_addr learned my addr 10.20.193.51:0/3454728420 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): get_auth_request con 0x7fdf8009e540 auth_method 0 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:29.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8592a640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 0x7fdf80098aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8612b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient(hunting): handle_auth_done global_id 44165 payload 824 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 -- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 msgr2=0x7fdf80098aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 0x7fdf80098aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 -- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 msgr2=0x7fdf801cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:29.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 0x7fdf801cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient: _finish_hunting 0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 monclient: found mon.noname-c 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.701+0000 7fdf8692c640 1 -- 10.20.193.51:0/3454728420 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf80092050 con 0x7fdf800a3bb0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf8692c640 1 -- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 msgr2=0x7fdf801cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf8692c640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 0x7fdf801cf300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00efc0 tx=0x7fdf7c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c018030 con 0x7fdf800a3bb0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: dump: 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:29.723 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: _finish_auth 0 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:29.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c003a90 con 0x7fdf800a3bb0 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c003e60 con 0x7fdf800a3bb0 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf84928640 4 set_mon_vals no callback set 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf66ffd640 10 monclient: dump: 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:29.725 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 5 monclient: authenticate success, global_id 44165 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 10 monclient: _renew_subs 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf800a2480 con 0x7fdf800a3bb0 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 10 monclient: _renew_subs 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.703+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf80092f70 con 0x7fdf800a3bb0 2026-02-17T11:47:29.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf883b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf883b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf883b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf8009dac0 con 0x7fdf800a3bb0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdf7c025060 con 0x7fdf800a3bb0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf66ffd640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 0x7fdf50040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7fdf7c052fb0 con 0x7fdf800a3bb0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf8612b640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 0x7fdf50040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.704+0000 7fdf8612b640 10 monclient: get_auth_request con 0x7fdf5003dcc0 auth_method 0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.707+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdf7c010040 con 0x7fdf800a3bb0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.707+0000 7fdf66ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.707+0000 7fdf66ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:29.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.707+0000 7fdf8612b640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 0x7fdf50040180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf70006fd0 tx=0x7fdf70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf883b6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf883b6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf883b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdf800932e0 con 0x7fdf800a3bb0 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf66ffd640 1 -- 10.20.193.51:0/3454728420 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fdf7c0099d0 con 0x7fdf800a3bb0 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf66ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:29.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.821+0000 7fdf66ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:29.825 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 msgr2=0x7fdf50040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 0x7fdf50040180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf70006fd0 tx=0x7fdf70008040 comp rx=0 tx=0).stop 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 10 monclient: shutdown 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 msgr2=0x7fdf801cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 0x7fdf801cf300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00efc0 tx=0x7fdf7c00c490 comp rx=0 tx=0).stop 2026-02-17T11:47:29.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 shutdown_connections 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf5003dcc0 0x7fdf50040180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf800a3bb0 0x7fdf801cf300 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf800a0750 0x7fdf80098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 --2- 10.20.193.51:0/3454728420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf8009e540 0x7fdf801cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 >> 10.20.193.51:0/3454728420 conn(0x7fdf800a30c0 msgr2=0x7fdf8013a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 shutdown_connections 2026-02-17T11:47:29.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:29.822+0000 7fdf883b6640 1 -- 10.20.193.51:0/3454728420 wait complete. 2026-02-17T11:47:32.832 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:47:32.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.899+0000 7f9601b49640 10 monclient: get_monmap_and_config 2026-02-17T11:47:32.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.899+0000 7f9601b49640 10 monclient: build_initial_monmap 2026-02-17T11:47:32.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.899+0000 7f9601b49640 10 monclient: monmap: 2026-02-17T11:47:32.903 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:32.900910+0000 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:32.900910+0000 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:32.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 Processor -- start 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 -- start start 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient: init 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f95fc138600 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f95fc0a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-c con 0x7f95fc13ea80 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95fc0a1df0 con 0x7f95fc138600 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95fc0a65b0 con 0x7f95fc0a35a0 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:32.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f95fc0a6830 con 0x7f95fc13ea80 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f9601b49640 10 monclient(hunting): authenticate will time out at 740.519772s 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f95faffd640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f95fc0a35a0 legacy=0x7f95fc13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f95fbfff640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 msgr2=0x7f95fc140e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f95fb7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f95fc138600 0x7f95fc1389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37246/0 (socket says 10.20.193.51:37246) 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f95fb7fe640 1 -- 10.20.193.51:0/956142215 learned_addr learned my addr 10.20.193.51:0/956142215 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:32.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.900+0000 7f95fbfff640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:32.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:32.902+0000 7f95fb7fe640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.51:6789/0 conn(0x7f95fc138600 legacy=0x7f95fc1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:33.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.101+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.142:6789/0 conn(0x7f95fc0a35a0 legacy=0x7f95fc13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:33.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.101+0000 7f95fbfff640 1 -- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 msgr2=0x7f95fc140e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:33.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.101+0000 7f95fbfff640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:47:33.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.502+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.142:6789/0 conn(0x7f95fc0a35a0 legacy=0x7f95fc13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:33.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.502+0000 7f95fbfff640 1 -- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 msgr2=0x7f95fc140e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:33.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:33.502+0000 7f95fbfff640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:47:34.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:34.303+0000 7f95fbfff640 1 -- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 msgr2=0x7f95fc140e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:34.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:34.303+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.142:6789/0 conn(0x7f95fc0a35a0 legacy=0x7f95fc13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:34.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:34.303+0000 7f95fbfff640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:47:35.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): tick 2026-02-17T11:47:35.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 monclient(hunting): continuing hunt 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 -- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 msgr2=0x7f95fc140e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.142:3300/0 conn(0x7f95fc13ea80 0x7f95fc140e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.142:6789/0 conn(0x7f95fc0a35a0 legacy=0x7f95fc13d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 -- 10.20.193.51:0/956142215 >> v1:10.20.193.51:6789/0 conn(0x7f95fc138600 legacy=0x7f95fc1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient: _add_conns ranks=[3,2] 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.51:3300/0 conn(0x7f95d8003840 0x7f95d8005cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f95d8003840 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 --2- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 0x7f95d80087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f95d8006330 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 -- 10.20.193.51:0/956142215 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f95d8008ea0 con 0x7f95d8003840 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 1 -- 10.20.193.51:0/956142215 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f95d8009050 con 0x7f95d8006330 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95f97fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.51:3300/0 conn(0x7f95d8003840 0x7f95d8005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 1 --2- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 0x7f95d80087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): get_auth_request con 0x7f95d8003840 auth_method 0 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:35.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): get_auth_request con 0x7f95d8006330 auth_method 0 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient(hunting): handle_auth_done global_id 44168 payload 274 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 >> v2:10.20.193.51:3300/0 conn(0x7f95d8003840 msgr2=0x7f95d8005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:35.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.51:3300/0 conn(0x7f95d8003840 0x7f95d8005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient: _finish_hunting 0 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 1 monclient: found mon.noname-b 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0a22d0 con 0x7f95d8006330 2026-02-17T11:47:35.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.901+0000 7f95fb7fe640 1 --2- 10.20.193.51:0/956142215 >> v2:10.20.193.51:3300/0 conn(0x7f95d8003840 0x7f95d8005cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95faffd640 1 -- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 msgr2=0x7f95d80087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95faffd640 1 --2- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 0x7f95d80087f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95ec003a30 tx=0x7f95ec02f4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbaaed22b6c54967 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 1 -- 10.20.193.51:0/956142215 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005480 con 0x7f95d8006330 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: dump: 2026-02-17T11:47:35.915 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:35.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 1 -- 10.20.193.51:0/956142215 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ec005640 con 0x7f95d8006330 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f9601b49640 5 monclient: authenticate success, global_id 44168 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f9601b49640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 1 -- 10.20.193.51:0/956142215 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005a30 con 0x7f95d8006330 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f9601b49640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f9601b49640 4 set_mon_vals no callback set 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:35.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.903+0000 7f95fa7fc640 10 monclient: dump: 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:35.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 10 monclient: shutdown 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 -- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 msgr2=0x7f95d80087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 --2- 10.20.193.51:0/956142215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95d8006330 0x7f95d80087f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95ec003a30 tx=0x7f95ec02f4b0 comp rx=0 tx=0).stop 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f95fbfff640 1 -- 10.20.193.51:0/956142215 reap_dead start 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 -- 10.20.193.51:0/956142215 shutdown_connections 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 -- 10.20.193.51:0/956142215 >> 10.20.193.51:0/956142215 conn(0x7f95fc0a7460 msgr2=0x7f95fc0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 -- 10.20.193.51:0/956142215 shutdown_connections 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.904+0000 7f9601b49640 1 -- 10.20.193.51:0/956142215 wait complete. 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient: build_initial_monmap 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient: monmap: 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:35.919 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 Processor -- start 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 -- start start 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient: init 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:35.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 0x7f95fc06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-b con 0x7f95d8006330 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-c con 0x7f95fc0700c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 0x7f95fc1cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): picked mon.noname-a con 0x7f95fc1cf270 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0a15f0 con 0x7f95fc1cf270 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0a2c00 con 0x7f95d8006330 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:35.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0a1770 con 0x7f95fc0700c0 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f9601b49640 10 monclient(hunting): authenticate will time out at 743.524769s 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fb7fe640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 msgr2=0x7f95fc06fb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fb7fe640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 0x7f95fc06fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60874/0 (socket says 10.20.193.51:60874) 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 0x7f95fc1cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 -- 10.20.193.51:0/1875385682 learned_addr learned my addr 10.20.193.51:0/1875385682 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 10 monclient(hunting): get_auth_request con 0x7f95fc0700c0 auth_method 0 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:35.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): get_auth_request con 0x7f95fc1cf270 auth_method 0 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 msgr2=0x7f95fc070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 msgr2=0x7f95fc070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95faffd640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:35.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.905+0000 7f95fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 10 monclient(hunting): handle_auth_done global_id 34236 payload 824 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 msgr2=0x7f95fc070500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 msgr2=0x7f95fc06fb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 0x7f95fc06fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 monclient: found mon.noname-a 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:35.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.906+0000 7f95fbfff640 1 -- 10.20.193.51:0/1875385682 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0a1ae0 con 0x7f95fc1cf270 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95fbfff640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 msgr2=0x7f95fc1cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95fbfff640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 0x7f95fc1cf720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0aba00 tx=0x7f95f000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00064e0 con 0x7f95fc1cf270 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: dump: 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:35.925 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: _finish_auth 0 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f0010030 con 0x7f95fc1cf270 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:35.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00068e0 con 0x7f95fc1cf270 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95d7fff640 10 monclient: dump: 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:35.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f95f9ffb640 4 set_mon_vals no callback set 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 5 monclient: authenticate success, global_id 34236 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 10 monclient: _renew_subs 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc073120 con 0x7f95fc1cf270 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 10 monclient: _renew_subs 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.908+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc072410 con 0x7f95fc1cf270 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f9601b49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f9601b49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f9601b49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:35.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc1389e0 con 0x7f95fc1cf270 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f95f00153e0 con 0x7f95fc1cf270 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f95d7fff640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 0x7f95cc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4795+0+0 (secure 0 0 0) 0x7f95f0052b10 con 0x7f95fc1cf270 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f95fb7fe640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 0x7f95cc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.909+0000 7f95fb7fe640 10 monclient: get_auth_request con 0x7f95cc03dcc0 auth_method 0 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.911+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f95f0051500 con 0x7f95fc1cf270 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.911+0000 7f95d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.911+0000 7f95d7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:35.912+0000 7f95fb7fe640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 0x7f95cc040180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95e8002410 tx=0x7f95e8002c70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:36.026+0000 7f9601b49640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:47:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:36.026+0000 7f9601b49640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:36.026+0000 7f9601b49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:47:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:36.026+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f95fc069780 con 0x7f95fc1cf270 2026-02-17T11:47:38.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:38.904+0000 7f95d6ffd640 10 monclient: tick 2026-02-17T11:47:38.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:38.904+0000 7f95d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:38.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:38.904+0000 7f95d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:38.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:38.904+0000 7f95d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:39.905+0000 7f95d6ffd640 10 monclient: tick 2026-02-17T11:47:39.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:39.905+0000 7f95d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:39.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:39.905+0000 7f95d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:40.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.905+0000 7f95d6ffd640 10 monclient: tick 2026-02-17T11:47:40.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.905+0000 7f95d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:40.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.905+0000 7f95d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.907+0000 7f95d7fff640 1 -- 10.20.193.51:0/1875385682 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f95f0013d60 con 0x7f95fc1cf270 2026-02-17T11:47:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.907+0000 7f95d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:47:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.907+0000 7f95d7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:40.909 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":20,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 msgr2=0x7f95cc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 0x7f95cc040180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95e8002410 tx=0x7f95e8002c70 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 10 monclient: shutdown 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 msgr2=0x7f95fc1cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 0x7f95fc1cf720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0aba00 tx=0x7f95f000be60 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 shutdown_connections 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f95cc03dcc0 0x7f95cc040180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95fc1cf270 0x7f95fc1cf720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95fc0700c0 0x7f95fc070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 --2- 10.20.193.51:0/1875385682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95d8006330 0x7f95fc06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 >> 10.20.193.51:0/1875385682 conn(0x7f95fc0a7460 msgr2=0x7f95fc0a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 shutdown_connections 2026-02-17T11:47:40.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.910+0000 7f9601b49640 1 -- 10.20.193.51:0/1875385682 wait complete. 2026-02-17T11:47:40.921 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:47:40.921 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:47:40.922 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:47:40.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.989+0000 7f7b6c379640 10 monclient: get_monmap_and_config 2026-02-17T11:47:40.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.989+0000 7f7b6c379640 10 monclient: build_initial_monmap 2026-02-17T11:47:40.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.989+0000 7f7b6c379640 10 monclient: monmap: 2026-02-17T11:47:40.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:40.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:40.990761+0000 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:40.990761+0000 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:40.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 Processor -- start 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 -- start start 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient: init 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b640a3bb0 0x7f7b6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-a con 0x7f7b640a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7b640a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-b con 0x7f7b6413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6406e140 con 0x7f7b640a0750 2026-02-17T11:47:40.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6409f910 con 0x7f7b640a3bb0 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6409ccd0 con 0x7f7b6413b760 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6c379640 10 monclient(hunting): authenticate will time out at 748.609485s 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b698ed640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f7b640a0750 legacy=0x7f7b6409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b640a3bb0 0x7f7b6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60876/0 (socket says 10.20.193.51:60876) 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/2786117820 learned_addr learned my addr 10.20.193.51:0/2786117820 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:40.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): get_auth_request con 0x7f7b6413b760 auth_method 0 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): get_auth_request con 0x7f7b640a3bb0 auth_method 0 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:40.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_done global_id 44171 payload 274 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/2786117820 >> v2:10.20.193.51:3300/0 conn(0x7f7b640a3bb0 msgr2=0x7f7b6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 --2- 10.20.193.51:0/2786117820 >> v2:10.20.193.51:3300/0 conn(0x7f7b640a3bb0 0x7f7b6409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/2786117820 >> v1:10.20.193.142:6789/0 conn(0x7f7b640a0750 legacy=0x7f7b6409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient: _finish_hunting 0 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 monclient: found mon.noname-b 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:47:40.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.990+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/2786117820 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6409eec0 con 0x7f7b6413b760 2026-02-17T11:47:41.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/2786117820 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 msgr2=0x7f7b6413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6a8ef640 1 --2- 10.20.193.51:0/2786117820 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b6406c1c0 tx=0x7f7b6002f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0de877f1fac7e09 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 1 -- 10.20.193.51:0/2786117820 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600373f0 con 0x7f7b6413b760 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: dump: 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.010 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: _finish_auth 0 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: _check_auth_tickets 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 1 -- 10.20.193.51:0/2786117820 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b60037590 con 0x7f7b6413b760 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:41.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 1 -- 10.20.193.51:0/2786117820 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60037960 con 0x7f7b6413b760 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b690ec640 10 monclient: dump: 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.012 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 5 monclient: authenticate success, global_id 44171 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 4 set_mon_vals no callback set 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 10 monclient: shutdown 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 -- 10.20.193.51:0/2786117820 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 msgr2=0x7f7b6413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 --2- 10.20.193.51:0/2786117820 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b6406c1c0 tx=0x7f7b6002f200 comp rx=0 tx=0).stop 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 -- 10.20.193.51:0/2786117820 shutdown_connections 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 --2- 10.20.193.51:0/2786117820 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413db50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 --2- 10.20.193.51:0/2786117820 >> v2:10.20.193.51:3300/0 conn(0x7f7b640a3bb0 0x7f7b6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 -- 10.20.193.51:0/2786117820 >> 10.20.193.51:0/2786117820 conn(0x7f7b640a30c0 msgr2=0x7f7b640a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 -- 10.20.193.51:0/2786117820 shutdown_connections 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.993+0000 7f7b6c379640 1 -- 10.20.193.51:0/2786117820 wait complete. 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient: build_initial_monmap 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient: monmap: 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:41.014 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 Processor -- start 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 -- start start 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient: init 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b640a0750 0x7f7b6409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-b con 0x7f7b640a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b640a3bb0 0x7f7b6413a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-a con 0x7f7b640a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:41.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): picked mon.noname-c con 0x7f7b6413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640a04b0 con 0x7f7b640a3bb0 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6409c850 con 0x7f7b640a0750 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6409e710 con 0x7f7b6413b760 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6c379640 10 monclient(hunting): authenticate will time out at 748.613642s 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a0ee640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b640a0750 msgr2=0x7f7b6409b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a0ee640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b640a0750 0x7f7b6409b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b640a3bb0 0x7f7b6413a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60884/0 (socket says 10.20.193.51:60884) 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 learned_addr learned my addr 10.20.193.51:0/1118391567 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): get_auth_request con 0x7f7b6413b760 auth_method 0 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): get_auth_request con 0x7f7b640a3bb0 auth_method 0 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b698ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient(hunting): handle_auth_done global_id 44174 payload 824 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b640a0750 msgr2=0x7f7b6409b3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b640a0750 0x7f7b6409b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b640a3bb0 msgr2=0x7f7b6413a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b640a3bb0 0x7f7b6413a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient: _finish_hunting 0 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 monclient: found mon.noname-c 2026-02-17T11:47:41.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.994+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b64098970 con 0x7f7b6413b760 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.996+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 msgr2=0x7f7b6413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.996+0000 7f7b6a8ef640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009f50 tx=0x7f7b60004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60046020 con 0x7f7b6413b760 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: dump: 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.019 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: _finish_auth 0 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b60041870 con 0x7f7b6413b760 2026-02-17T11:47:41.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 5 monclient: authenticate success, global_id 44174 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 monclient: _renew_subs 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6409ac60 con 0x7f7b6413b760 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600373f0 con 0x7f7b6413b760 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b688eb640 4 set_mon_vals no callback set 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 10 monclient: dump: 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.021 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 monclient: _renew_subs 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6413b1f0 con 0x7f7b6413b760 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 0x7f7b640970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b64098250 con 0x7f7b64096cf0 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7b6004b410 con 0x7f7b6413b760 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 0x7f7b640970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient: get_auth_request con 0x7f7b64096cf0 auth_method 0 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b3403dd40 0x7f7b34040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 4767+0+0 (secure 0 0 0) 0x7f7b600780c0 con 0x7f7b6413b760 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_done global_id 34245 payload 824 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.997+0000 7f7b6a0ee640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b6409d7b0 con 0x7f7b64096cf0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.998+0000 7f7b698ed640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b3403dd40 0x7f7b34040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:40.998+0000 7f7b698ed640 10 monclient: get_auth_request con 0x7f7b3403dd40 auth_method 0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b6a0ee640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 msgr2=0x7f7b640970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b6a0ee640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 0x7f7b640970d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e8b0 tx=0x7f7b5400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54017070 con 0x7f7b64096cf0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 10 monclient: dump: 2026-02-17T11:47:41.024 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7b5400cbc0 con 0x7f7b64096cf0 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:41.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 msgr2=0x7f7b640970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 0x7f7b640970d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e8b0 tx=0x7f7b5400ed80 comp rx=0 tx=0).stop 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 msgr2=0x7f7b640970d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b4affd640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64096cf0 0x7f7b640970d0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e8b0 tx=0x7f7b5400ed80 comp rx=0 tx=0).stop 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.000+0000 7f7b698ed640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b3403dd40 0x7f7b34040200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009470 tx=0x7f7b58009400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6c379640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6c379640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 0x7f7b641da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6409dac0 con 0x7f7b64097610 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 0x7f7b641da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient: get_auth_request con 0x7f7b64097610 auth_method 0 2026-02-17T11:47:41.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 10 monclient(hunting): handle_auth_done global_id 34248 payload 824 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.003+0000 7f7b6a0ee640 1 -- 10.20.193.51:0/1118391567 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b640008d0 con 0x7f7b64097610 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.005+0000 7f7b6a0ee640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 msgr2=0x7f7b641da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.005+0000 7f7b6a0ee640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 0x7f7b641da8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b54018000 tx=0x7f7b54004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54017070 con 0x7f7b64097610 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:41.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 10 monclient: dump: 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7f7b54004610 con 0x7f7b64097610 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:41.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 msgr2=0x7f7b641da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 0x7f7b641da8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b54018000 tx=0x7f7b54004830 comp rx=0 tx=0).stop 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 msgr2=0x7f7b641da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b4affd640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b64097610 0x7f7b641da8c0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b54018000 tx=0x7f7b54004830 comp rx=0 tx=0).stop 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:41.029 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 20, 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 81652, 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.030 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.031 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:41.032 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.033 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.034 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.035 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.036 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:41.037 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:41.038 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:47:41.039 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.040 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.040 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.040 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:41.040 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b3403dd40 msgr2=0x7f7b34040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b3403dd40 0x7f7b34040200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009470 tx=0x7f7b58009400 comp rx=0 tx=0).stop 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 10 monclient: shutdown 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 msgr2=0x7f7b6413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6a8ef640 1 -- 10.20.193.51:0/1118391567 reap_dead start 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009f50 tx=0x7f7b60004b40 comp rx=0 tx=0).stop 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 shutdown_connections 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 --2- 10.20.193.51:0/1118391567 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b6413b760 0x7f7b6413acb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 >> 10.20.193.51:0/1118391567 conn(0x7f7b640a30c0 msgr2=0x7f7b64072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 shutdown_connections 2026-02-17T11:47:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.006+0000 7f7b6c379640 1 -- 10.20.193.51:0/1118391567 wait complete. 2026-02-17T11:47:41.042 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:47:41.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:47:41.042 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:47:41.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: get_monmap_and_config 2026-02-17T11:47:41.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: build_initial_monmap 2026-02-17T11:47:41.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: monmap: 2026-02-17T11:47:41.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:47:41.109055+0000 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:47:41.109055+0000 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:47:41.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 Processor -- start 2026-02-17T11:47:41.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 -- start start 2026-02-17T11:47:41.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: init 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f167006d180 0x7f16700a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-a con 0x7f167006d180 addr v2:10.20.193.51:3300/0 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f167009c8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 0x7f167013f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-c con 0x7f16700a3260 addr v2:10.20.193.142:3300/0 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167009c480 con 0x7f167009c8a0 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f16700a3670 con 0x7f167006d180 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f167006d560 con 0x7f16700a3260 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f16765f7640 10 monclient(hunting): authenticate will time out at 748.727805s 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f167006d180 0x7f16700a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f1674b6d640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 msgr2=0x7f167013f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166f7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f167009c8a0 0x7f16700a2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39110/0 (socket says 10.20.193.51:39110) 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166f7fe640 1 -- 10.20.193.51:0/1880114171 learned_addr learned my addr 10.20.193.51:0/1880114171 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): get_auth_request con 0x7f167006d180 auth_method 0 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f1674b6d640 1 --2- 10.20.193.51:0/1880114171 >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 0x7f167013f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166effd640 1 -- 10.20.193.51:0/1880114171 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166f7fe640 1 -- 10.20.193.51:0/1880114171 >> v1:10.20.193.51:6789/0 conn(0x7f167009c8a0 legacy=0x7f16700a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166f7fe640 1 -- 10.20.193.51:0/1880114171 >> v1:10.20.193.51:6789/0 conn(0x7f167009c8a0 legacy=0x7f16700a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166f7fe640 1 --1- 10.20.193.51:0/1880114171 >> v1:10.20.193.51:6789/0 conn(0x7f167009c8a0 0x7f16700a2b50 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.108+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 10 monclient(hunting): handle_auth_done global_id 34251 payload 274 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 1 -- 10.20.193.51:0/1880114171 >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 msgr2=0x7f167013f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:41.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 1 --2- 10.20.193.51:0/1880114171 >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 0x7f167013f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 1 -- 10.20.193.51:0/1880114171 >> v1:10.20.193.51:6789/0 conn(0x7f167009c8a0 legacy=0x7f16700a2b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 1 monclient: found mon.noname-a 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:47:41.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.109+0000 7f166ffff640 1 -- 10.20.193.51:0/1880114171 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167009b420 con 0x7f167006d180 2026-02-17T11:47:41.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166ffff640 1 -- 10.20.193.51:0/1880114171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 msgr2=0x7f16700a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166ffff640 1 --2- 10.20.193.51:0/1880114171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f16700a2610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16700a3fa0 tx=0x7f165c02ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb94b39050e1a6df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 1 -- 10.20.193.51:0/1880114171 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c03c070 con 0x7f167006d180 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: dump: 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.121 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: _finish_auth 0 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: _check_auth_tickets 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 1 -- 10.20.193.51:0/1880114171 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c02fcd0 con 0x7f167006d180 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f16765f7640 5 monclient: authenticate success, global_id 34251 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 1 -- 10.20.193.51:0/1880114171 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c037660 con 0x7f167006d180 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f166effd640 10 monclient: dump: 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f16765f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.111+0000 7f16765f7640 4 set_mon_vals no callback set 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 10 monclient: shutdown 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- 10.20.193.51:0/1880114171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 msgr2=0x7f16700a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 --2- 10.20.193.51:0/1880114171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f16700a2610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16700a3fa0 tx=0x7f165c02ed70 comp rx=0 tx=0).stop 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- 10.20.193.51:0/1880114171 shutdown_connections 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 --2- 10.20.193.51:0/1880114171 >> v2:10.20.193.142:3300/0 conn(0x7f16700a3260 0x7f167013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 --2- 10.20.193.51:0/1880114171 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f16700a2610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- 10.20.193.51:0/1880114171 >> 10.20.193.51:0/1880114171 conn(0x7f16700a7b90 msgr2=0x7f16700a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- 10.20.193.51:0/1880114171 shutdown_connections 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- 10.20.193.51:0/1880114171 wait complete. 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 10 monclient: build_initial_monmap 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 10 monclient: monmap: 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 Processor -- start 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 1 -- start start 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.112+0000 7f16765f7640 10 monclient: init 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f1670099f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-a con 0x7f167006d180 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 0x7f167009a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-c con 0x7f167009c8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16700a3260 0x7f1670093a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): picked mon.noname-b con 0x7f16700a3260 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f167009e640 con 0x7f167006d180 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f167006dd20 con 0x7f16700a3260 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f167009e7c0 con 0x7f167009c8a0 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f16765f7640 10 monclient(hunting): authenticate will time out at 748.732084s 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f1670099f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 0x7f167009a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f1670099f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38280/0 (socket says 10.20.193.51:38280) 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 1 -- 10.20.193.51:0/876755005 learned_addr learned my addr 10.20.193.51:0/876755005 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:47:41.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): get_auth_request con 0x7f167009c8a0 auth_method 0 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f1674b6d640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16700a3260 msgr2=0x7f1670093a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): get_auth_request con 0x7f167006d180 auth_method 0 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f1674b6d640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16700a3260 0x7f1670093a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient(hunting): handle_auth_done global_id 44177 payload 824 2026-02-17T11:47:41.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16700a3260 msgr2=0x7f1670093a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16700a3260 0x7f1670093a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 msgr2=0x7f1670099f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f1670099f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166f7fe640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1670097740 con 0x7f167009c8a0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.113+0000 7f166ffff640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f167006d180 0x7f1670099f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166f7fe640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 msgr2=0x7f167009a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166f7fe640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 0x7f167009a4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f166000c4a0 tx=0x7f166000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660007070 con 0x7f167009c8a0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: dump: 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.127 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: _finish_auth 0 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1660007210 con 0x7f167009c8a0 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660007600 con 0x7f167009c8a0 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:41.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166cff9640 10 monclient: dump: 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f166e7fc640 4 set_mon_vals no callback set 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 5 monclient: authenticate success, global_id 44177 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 10 monclient: _renew_subs 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1670097a20 con 0x7f167009c8a0 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 10 monclient: _renew_subs 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.115+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16701cf040 con 0x7f167009c8a0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f16765f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f16765f7640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 0x7f16700943b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f167009a9e0 con 0x7f1670093fd0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f166001b400 con 0x7f167009c8a0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 0x7f16700943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient: get_auth_request con 0x7f1670093fd0 auth_method 0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 10 monclient(hunting): handle_auth_done global_id 44180 payload 824 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166ffff640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16700948f0 con 0x7f1670093fd0 2026-02-17T11:47:41.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166cff9640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f164003dcc0 0x7f1640040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 4767+0+0 (secure 0 0 0) 0x7f16600522e0 con 0x7f167009c8a0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f1674b6d640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f164003dcc0 0x7f1640040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.116+0000 7f1674b6d640 10 monclient: get_auth_request con 0x7f164003dcc0 auth_method 0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166ffff640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 msgr2=0x7f16700943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166ffff640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 0x7f16700943b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f165c002410 tx=0x7f165c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c049070 con 0x7f1670093fd0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 10 monclient: dump: 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.131 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f165c043870 con 0x7f1670093fd0 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 msgr2=0x7f16700943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 0x7f16700943b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f165c002410 tx=0x7f165c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 msgr2=0x7f16700943b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.118+0000 7f166cff9640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670093fd0 0x7f16700943b0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f165c002410 tx=0x7f165c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.119+0000 7f1674b6d640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f164003dcc0 0x7f1640040180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1664003db0 tx=0x7f1664009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f16765f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f16765f7640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 0x7f16701da120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f16765f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f16700960c0 con 0x7f1670072de0 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 0x7f16701da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient: get_auth_request con 0x7f1670072de0 auth_method 0 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 10 monclient(hunting): handle_auth_done global_id 44183 payload 824 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.121+0000 7f166ffff640 1 -- 10.20.193.51:0/876755005 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16700a2610 con 0x7f1670072de0 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166ffff640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 msgr2=0x7f16701da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166ffff640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 0x7f16701da120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f165c02edb0 tx=0x7f165c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c03c040 con 0x7f1670072de0 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 10 monclient: dump: 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:47:41.135 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4863 (secure 0 0 0) 0x7f165c04edb0 con 0x7f1670072de0 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 msgr2=0x7f16701da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 0x7f16701da120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f165c02edb0 tx=0x7f165c009290 comp rx=0 tx=0).stop 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 msgr2=0x7f16701da120 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f166cff9640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1670072de0 0x7f16701da120 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f165c02edb0 tx=0x7f165c009290 comp rx=0 tx=0).stop 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:41.136 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 20, 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 32597, 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.137 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.138 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:47:41.139 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:47:41.140 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.141 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:47:41.144 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:47:41.145 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:47:41.146 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:47:41.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f164003dcc0 msgr2=0x7f1640040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f164003dcc0 0x7f1640040180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1664003db0 tx=0x7f1664009270 comp rx=0 tx=0).stop 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 10 monclient: shutdown 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 msgr2=0x7f167009a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 0x7f167009a4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f166000c4a0 tx=0x7f166000c970 comp rx=0 tx=0).stop 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f1674b6d640 1 -- 10.20.193.51:0/876755005 reap_dead start 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 shutdown_connections 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 --2- 10.20.193.51:0/876755005 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f167009c8a0 0x7f167009a4a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 >> 10.20.193.51:0/876755005 conn(0x7f16700a7b90 msgr2=0x7f16700a41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 shutdown_connections 2026-02-17T11:47:41.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:47:41.124+0000 7f16765f7640 1 -- 10.20.193.51:0/876755005 wait complete. 2026-02-17T11:47:41.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:47:41.148 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:244: done (4 left) 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:246: done (3 left) 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:247: done (2 left) 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:249: done (1 left) 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:250: done (0 left) 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:251: read oid 46 snap -1 2026-02-17T11:47:41.919 INFO:tasks.rados.rados.0.trial142.stdout:251: expect deleted 2026-02-17T11:47:41.920 INFO:tasks.rados.rados.0.trial142.stdout:252: copy_from oid 5 from oid 27 current snap is 28 2026-02-17T11:47:41.920 INFO:tasks.rados.rados.0.trial142.stdout:253: copy_from oid 13 from oid 35 current snap is 28 2026-02-17T11:47:41.920 INFO:tasks.rados.rados.0.trial142.stdout:254: read oid 43 snap -1 2026-02-17T11:47:41.920 INFO:tasks.rados.rados.0.trial142.stdout:254: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:47:41.920 INFO:tasks.rados.rados.0.trial142.stdout:255: delete oid 32 current snap is 28 2026-02-17T11:47:41.921 INFO:tasks.rados.rados.0.trial142.stdout:251: done (4 left) 2026-02-17T11:47:41.921 INFO:tasks.rados.rados.0.trial142.stdout:255: done (3 left) 2026-02-17T11:47:41.921 INFO:tasks.rados.rados.0.trial142.stdout:256: write (excl) oid 24 current snap is 28 2026-02-17T11:47:41.921 INFO:tasks.rados.rados.0.trial142.stdout:256: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-17T11:47:41.925 INFO:tasks.rados.rados.0.trial142.stdout:256: writing trial14245205-24 from 749612 to 1223791 tid 1 2026-02-17T11:47:41.930 INFO:tasks.rados.rados.0.trial142.stdout:256: writing trial14245205-24 from 1954970 to 2386007 tid 2 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:256: writing trial14245205-24 from 2919420 to 3535797 tid 3 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:257: read oid 6 snap -1 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:257: expect (ObjNum 100 snap 21 seq_num 100) 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:258: rollback oid 36 current snap is 28 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 27 2026-02-17T11:47:41.935 INFO:tasks.rados.rados.0.trial142.stdout:252: finishing copy_from to trial14245205-5 2026-02-17T11:47:41.936 INFO:tasks.rados.rados.0.trial142.stdout:252: got expected ENOENT (src dne) 2026-02-17T11:47:41.936 INFO:tasks.rados.rados.0.trial142.stdout:253: finishing copy_from racing read to trial14245205-13 2026-02-17T11:47:41.936 INFO:tasks.rados.rados.0.trial142.stdout:252: finishing copy_from racing read to trial14245205-5 2026-02-17T11:47:41.936 INFO:tasks.rados.rados.0.trial142.stdout:254: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:253: finishing copy_from to trial14245205-13 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 32 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:256: finishing write tid 1 to trial14245205-24 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:252: done (5 left) 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:253: done (4 left) 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:254: done (3 left) 2026-02-17T11:47:42.005 INFO:tasks.rados.rados.0.trial142.stdout:259: write (excl) oid 29 current snap is 28 2026-02-17T11:47:42.006 INFO:tasks.rados.rados.0.trial142.stdout:256: finishing write tid 2 to trial14245205-24 2026-02-17T11:47:42.006 INFO:tasks.rados.rados.0.trial142.stdout:256: finishing write tid 3 to trial14245205-24 2026-02-17T11:47:42.006 INFO:tasks.rados.rados.0.trial142.stdout:258: finishing rollback tid 0 to trial14245205-36 2026-02-17T11:47:42.006 INFO:tasks.rados.rados.0.trial142.stdout:259: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2026-02-17T11:47:42.009 INFO:tasks.rados.rados.0.trial142.stdout:259: writing trial14245205-29 from 766419 to 1315847 tid 1 2026-02-17T11:47:42.014 INFO:tasks.rados.rados.0.trial142.stdout:259: writing trial14245205-29 from 2013452 to 2588147 tid 2 2026-02-17T11:47:42.019 INFO:tasks.rados.rados.0.trial142.stdout:259: writing trial14245205-29 from 3346843 to 3774492 tid 3 2026-02-17T11:47:42.019 INFO:tasks.rados.rados.0.trial142.stdout:260: snap_remove snap 20 2026-02-17T11:47:42.920 INFO:tasks.rados.rados.0.trial142.stdout:260: done (4 left) 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:261: copy_from oid 14 from oid 32 current snap is 28 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: finishing write tid 4 to trial14245205-24 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: finishing write tid 5 to trial14245205-24 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: oid 24 updating version 0 to 29 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: oid 24 updating version 29 to 31 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: oid 24 updating version 31 to 32 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: oid 24 version 32 is already newer than 30 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 32 (ObjNum 116 snap 28 seq_num 116) dirty exists 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: left oid 24 (ObjNum 116 snap 28 seq_num 116) 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:258: finishing rollback tid 1 to trial14245205-36 2026-02-17T11:47:42.921 INFO:tasks.rados.rados.0.trial142.stdout:256: done (4 left) 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:262: read oid 39 snap 27 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:262: expect (ObjNum 112 snap 27 seq_num 112) 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:263: write oid 5 current snap is 28 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:258: finishing rollback tid 2 to trial14245205-36 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 55 (ObjNum 81 snap 15 seq_num 81) dirty exists 2026-02-17T11:47:42.922 INFO:tasks.rados.rados.0.trial142.stdout:257: expect (ObjNum 100 snap 21 seq_num 100) 2026-02-17T11:47:43.059 INFO:tasks.rados.rados.0.trial142.stdout:259: finishing write tid 1 to trial14245205-29 2026-02-17T11:47:43.059 INFO:tasks.rados.rados.0.trial142.stdout:259: finishing write tid 2 to trial14245205-29 2026-02-17T11:47:43.059 INFO:tasks.rados.rados.0.trial142.stdout:259: finishing write tid 3 to trial14245205-29 2026-02-17T11:47:43.059 INFO:tasks.rados.rados.0.trial142.stdout:263: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2026-02-17T11:47:43.063 INFO:tasks.rados.rados.0.trial142.stdout:263: writing trial14245205-5 from 783226 to 1407903 tid 1 2026-02-17T11:47:43.068 INFO:tasks.rados.rados.0.trial142.stdout:263: writing trial14245205-5 from 2071934 to 2506640 tid 2 2026-02-17T11:47:43.072 INFO:tasks.rados.rados.0.trial142.stdout:263: writing trial14245205-5 from 2974266 to 3613187 tid 3 2026-02-17T11:47:43.072 INFO:tasks.rados.rados.0.trial142.stdout:257: done (5 left) 2026-02-17T11:47:43.072 INFO:tasks.rados.rados.0.trial142.stdout:258: done (4 left) 2026-02-17T11:47:43.072 INFO:tasks.rados.rados.0.trial142.stdout:264: write (excl) oid 2 current snap is 28 2026-02-17T11:47:43.072 INFO:tasks.rados.rados.0.trial142.stdout:264: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-17T11:47:43.076 INFO:tasks.rados.rados.0.trial142.stdout:264: writing trial14245205-2 from 400033 to 1099959 tid 1 2026-02-17T11:47:43.080 INFO:tasks.rados.rados.0.trial142.stdout:264: writing trial14245205-2 from 1614063 to 2000033 tid 2 2026-02-17T11:47:43.080 INFO:tasks.rados.rados.0.trial142.stdout:265: write oid 30 current snap is 28 2026-02-17T11:47:43.080 INFO:tasks.rados.rados.0.trial142.stdout:265: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-17T11:47:43.084 INFO:tasks.rados.rados.0.trial142.stdout:265: writing trial14245205-30 from 416840 to 1192015 tid 1 2026-02-17T11:47:43.087 INFO:tasks.rados.rados.0.trial142.stdout:265: writing trial14245205-30 from 1672545 to 2016840 tid 2 2026-02-17T11:47:43.087 INFO:tasks.rados.rados.0.trial142.stdout:266: write oid 10 current snap is 28 2026-02-17T11:47:43.087 INFO:tasks.rados.rados.0.trial142.stdout:259: finishing write tid 4 to trial14245205-29 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: finishing write tid 5 to trial14245205-29 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: oid 29 updating version 0 to 61 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: oid 29 version 61 is already newer than 59 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: oid 29 version 61 is already newer than 60 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: oid 29 updating version 61 to 62 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 62 (ObjNum 117 snap 28 seq_num 117) dirty exists 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:259: left oid 29 (ObjNum 117 snap 28 seq_num 117) 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:261: finishing copy_from to trial14245205-14 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:261: got expected ENOENT (src dne) 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:261: finishing copy_from racing read to trial14245205-14 2026-02-17T11:47:43.088 INFO:tasks.rados.rados.0.trial142.stdout:262: expect (ObjNum 112 snap 27 seq_num 112) 2026-02-17T11:47:43.180 INFO:tasks.rados.rados.0.trial142.stdout:263: finishing write tid 1 to trial14245205-5 2026-02-17T11:47:43.181 INFO:tasks.rados.rados.0.trial142.stdout:263: finishing write tid 2 to trial14245205-5 2026-02-17T11:47:43.181 INFO:tasks.rados.rados.0.trial142.stdout:263: finishing write tid 3 to trial14245205-5 2026-02-17T11:47:43.181 INFO:tasks.rados.rados.0.trial142.stdout:263: finishing write tid 4 to trial14245205-5 2026-02-17T11:47:43.181 INFO:tasks.rados.rados.0.trial142.stdout:266: seq_num 121 ranges {433647=450424,1331027=582033} 2026-02-17T11:47:43.184 INFO:tasks.rados.rados.0.trial142.stdout:266: writing trial14245205-10 from 433647 to 884071 tid 1 2026-02-17T11:47:43.188 INFO:tasks.rados.rados.0.trial142.stdout:266: writing trial14245205-10 from 1331027 to 1913060 tid 2 2026-02-17T11:47:43.189 INFO:tasks.rados.rados.0.trial142.stdout:259: done (6 left) 2026-02-17T11:47:43.189 INFO:tasks.rados.rados.0.trial142.stdout:261: done (5 left) 2026-02-17T11:47:43.189 INFO:tasks.rados.rados.0.trial142.stdout:262: done (4 left) 2026-02-17T11:47:43.189 INFO:tasks.rados.rados.0.trial142.stdout:267: snap_remove snap 23 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:267: done (4 left) 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:268: copy_from oid 39 from oid 4 current snap is 28 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: finishing write tid 5 to trial14245205-5 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: oid 5 updating version 0 to 88 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: oid 5 updating version 88 to 91 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: oid 5 version 91 is already newer than 89 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: oid 5 version 91 is already newer than 90 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 91 (ObjNum 118 snap 28 seq_num 118) dirty exists 2026-02-17T11:47:43.925 INFO:tasks.rados.rados.0.trial142.stdout:263: left oid 5 (ObjNum 118 snap 28 seq_num 118) 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: finishing write tid 1 to trial14245205-2 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:265: finishing write tid 1 to trial14245205-30 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: finishing write tid 2 to trial14245205-2 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: finishing write tid 3 to trial14245205-2 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: finishing write tid 4 to trial14245205-2 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: oid 2 updating version 0 to 25 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: oid 2 updating version 25 to 26 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: oid 2 version 26 is already newer than 24 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 26 (ObjNum 119 snap 28 seq_num 119) dirty exists 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:264: left oid 2 (ObjNum 119 snap 28 seq_num 119) 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:265: finishing write tid 2 to trial14245205-30 2026-02-17T11:47:43.926 INFO:tasks.rados.rados.0.trial142.stdout:265: finishing write tid 3 to trial14245205-30 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: finishing write tid 4 to trial14245205-30 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: oid 30 updating version 0 to 68 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: oid 30 updating version 68 to 69 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: oid 30 version 69 is already newer than 67 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 69 (ObjNum 120 snap 28 seq_num 120) dirty exists 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: left oid 30 (ObjNum 120 snap 28 seq_num 120) 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:266: finishing write tid 1 to trial14245205-10 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:263: done (4 left) 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:264: done (3 left) 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:265: done (2 left) 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:269: read oid 25 snap 21 2026-02-17T11:47:43.927 INFO:tasks.rados.rados.0.trial142.stdout:269: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:270: copy_from oid 8 from oid 22 current snap is 28 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: finishing write tid 2 to trial14245205-10 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: finishing write tid 3 to trial14245205-10 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: finishing write tid 4 to trial14245205-10 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: oid 10 updating version 0 to 126 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: oid 10 version 126 is already newer than 125 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: oid 10 version 126 is already newer than 124 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 126 (ObjNum 121 snap 28 seq_num 121) dirty exists 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: left oid 10 (ObjNum 121 snap 28 seq_num 121) 2026-02-17T11:47:43.928 INFO:tasks.rados.rados.0.trial142.stdout:266: done (3 left) 2026-02-17T11:47:43.929 INFO:tasks.rados.rados.0.trial142.stdout:271: snap_create 2026-02-17T11:47:43.929 INFO:tasks.rados.rados.0.trial142.stdout:270: finishing copy_from to trial14245205-8 2026-02-17T11:47:43.930 INFO:tasks.rados.rados.0.trial142.stdout:270: got expected ENOENT (src dne) 2026-02-17T11:47:43.930 INFO:tasks.rados.rados.0.trial142.stdout:270: finishing copy_from racing read to trial14245205-8 2026-02-17T11:47:43.930 INFO:tasks.rados.rados.0.trial142.stdout:269: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T11:47:43.983 INFO:tasks.rados.rados.0.trial142.stdout:268: finishing copy_from racing read to trial14245205-39 2026-02-17T11:47:43.984 INFO:tasks.rados.rados.0.trial142.stdout:268: finishing copy_from to trial14245205-39 2026-02-17T11:47:43.984 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 121 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:47:44.365 INFO:tasks.rados.rados.0.trial142.stdout:268: done (3 left) 2026-02-17T11:47:44.365 INFO:tasks.rados.rados.0.trial142.stdout:269: done (2 left) 2026-02-17T11:47:44.365 INFO:tasks.rados.rados.0.trial142.stdout:270: done (1 left) 2026-02-17T11:47:44.366 INFO:tasks.rados.rados.0.trial142.stdout:271: done (0 left) 2026-02-17T11:47:44.366 INFO:tasks.rados.rados.0.trial142.stdout:272: copy_from oid 1 from oid 22 current snap is 29 2026-02-17T11:47:44.366 INFO:tasks.rados.rados.0.trial142.stdout:273: snap_remove snap 21 2026-02-17T11:47:45.366 INFO:tasks.rados.rados.0.trial142.stdout:273: done (1 left) 2026-02-17T11:47:45.366 INFO:tasks.rados.rados.0.trial142.stdout:274: snap_create 2026-02-17T11:47:45.366 INFO:tasks.rados.rados.0.trial142.stdout:272: finishing copy_from to trial14245205-1 2026-02-17T11:47:45.366 INFO:tasks.rados.rados.0.trial142.stdout:272: got expected ENOENT (src dne) 2026-02-17T11:47:45.366 INFO:tasks.rados.rados.0.trial142.stdout:272: finishing copy_from racing read to trial14245205-1 2026-02-17T11:47:46.367 INFO:tasks.rados.rados.0.trial142.stdout:272: done (1 left) 2026-02-17T11:47:46.367 INFO:tasks.rados.rados.0.trial142.stdout:274: done (0 left) 2026-02-17T11:47:46.367 INFO:tasks.rados.rados.0.trial142.stdout:275: snap_create 2026-02-17T11:47:47.368 INFO:tasks.rados.rados.0.trial142.stdout:275: done (0 left) 2026-02-17T11:47:47.368 INFO:tasks.rados.rados.0.trial142.stdout:276: write oid 14 current snap is 31 2026-02-17T11:47:47.368 INFO:tasks.rados.rados.0.trial142.stdout:276: seq_num 122 ranges {450454=642026,1505862=544592} 2026-02-17T11:47:47.372 INFO:tasks.rados.rados.0.trial142.stdout:276: writing trial14245205-14 from 450454 to 1092480 tid 1 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:276: writing trial14245205-14 from 1505862 to 2050454 tid 2 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:277: rollback oid 17 current snap is 31 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 28 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:276: finishing write tid 1 to trial14245205-14 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:278: rollback oid 40 current snap is 31 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 28 2026-02-17T11:47:47.376 INFO:tasks.rados.rados.0.trial142.stdout:279: snap_create 2026-02-17T11:47:47.377 INFO:tasks.rados.rados.0.trial142.stdout:276: finishing write tid 2 to trial14245205-14 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: finishing write tid 3 to trial14245205-14 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: finishing write tid 4 to trial14245205-14 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: oid 14 updating version 0 to 193 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: oid 14 version 193 is already newer than 192 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: oid 14 updating version 193 to 194 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 194 (ObjNum 122 snap 31 seq_num 122) dirty exists 2026-02-17T11:47:47.378 INFO:tasks.rados.rados.0.trial142.stdout:276: left oid 14 (ObjNum 122 snap 31 seq_num 122) 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:277: finishing rollback tid 0 to trial14245205-17 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:277: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:277: finishing rollback tid 2 to trial14245205-17 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 99 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:278: finishing rollback tid 0 to trial14245205-40 2026-02-17T11:47:47.379 INFO:tasks.rados.rados.0.trial142.stdout:278: finishing rollback tid 1 to trial14245205-40 2026-02-17T11:47:47.380 INFO:tasks.rados.rados.0.trial142.stdout:278: finishing rollback tid 2 to trial14245205-40 2026-02-17T11:47:47.380 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 66 (ObjNum 75 snap 15 seq_num 75) dirty exists 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:276: done (3 left) 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:277: done (2 left) 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:278: done (1 left) 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:279: done (0 left) 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:280: rollback oid 4 current snap is 32 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 30 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:281: write (excl) oid 21 current snap is 32 2026-02-17T11:47:48.370 INFO:tasks.rados.rados.0.trial142.stdout:281: seq_num 123 ranges {467261=717275,1847991=219270} 2026-02-17T11:47:48.376 INFO:tasks.rados.rados.0.trial142.stdout:281: writing trial14245205-21 from 467261 to 1184536 tid 1 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:281: writing trial14245205-21 from 1847991 to 2067261 tid 2 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:282: rollback oid 8 current snap is 32 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 31 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:283: rollback oid 46 current snap is 32 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 27 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:284: rollback oid 39 current snap is 32 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 8 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:285: read oid 45 snap -1 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:285: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:286: write (excl) oid 27 current snap is 32 2026-02-17T11:47:48.379 INFO:tasks.rados.rados.0.trial142.stdout:286: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-17T11:47:48.384 INFO:tasks.rados.rados.0.trial142.stdout:286: writing trial14245205-27 from 484068 to 1276592 tid 1 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:286: writing trial14245205-27 from 1906473 to 2084068 tid 2 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:287: read oid 41 snap 24 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:287: expect deleted 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:288: delete oid 14 current snap is 32 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:280: finishing rollback tid 0 to trial14245205-4 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:280: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:280: finishing rollback tid 2 to trial14245205-4 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 198 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:283: finishing rollback tid 1 to trial14245205-46 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 67 (ObjNum 129 snap 0 seq_num 1214027616) dirty dne 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:284: finishing rollback tid 0 to trial14245205-39 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:284: finishing rollback tid 1 to trial14245205-39 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:284: finishing rollback tid 2 to trial14245205-39 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 124 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:282: finishing rollback tid 0 to trial14245205-8 2026-02-17T11:47:48.387 INFO:tasks.rados.rados.0.trial142.stdout:282: finishing rollback tid 1 to trial14245205-8 2026-02-17T11:47:48.388 INFO:tasks.rados.rados.0.trial142.stdout:285: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-17T11:47:48.451 INFO:tasks.rados.rados.0.trial142.stdout:281: finishing write tid 1 to trial14245205-21 2026-02-17T11:47:48.451 INFO:tasks.rados.rados.0.trial142.stdout:280: done (8 left) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:283: done (7 left) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:284: done (6 left) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:285: done (5 left) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:288: done (4 left) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:289: read oid 49 snap -1 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:289: expect (ObjNum 113 snap 27 seq_num 113) 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:290: write oid 25 current snap is 32 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:281: finishing write tid 2 to trial14245205-21 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:281: finishing write tid 3 to trial14245205-21 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:281: finishing write tid 4 to trial14245205-21 2026-02-17T11:47:48.452 INFO:tasks.rados.rados.0.trial142.stdout:281: oid 21 updating version 0 to 88 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:281: oid 21 updating version 88 to 89 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:281: oid 21 updating version 89 to 90 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 90 (ObjNum 123 snap 32 seq_num 123) dirty exists 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:281: left oid 21 (ObjNum 123 snap 32 seq_num 123) 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:282: finishing rollback tid 2 to trial14245205-8 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 182 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:286: finishing write tid 1 to trial14245205-27 2026-02-17T11:47:48.453 INFO:tasks.rados.rados.0.trial142.stdout:290: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-17T11:47:48.455 INFO:tasks.rados.rados.0.trial142.stdout:290: writing trial14245205-25 from 517682 to 1060704 tid 1 2026-02-17T11:47:48.459 INFO:tasks.rados.rados.0.trial142.stdout:290: writing trial14245205-25 from 1623437 to 2117682 tid 2 2026-02-17T11:47:48.459 INFO:tasks.rados.rados.0.trial142.stdout:281: done (5 left) 2026-02-17T11:47:48.459 INFO:tasks.rados.rados.0.trial142.stdout:282: done (4 left) 2026-02-17T11:47:48.459 INFO:tasks.rados.rados.0.trial142.stdout:291: write (excl) oid 8 current snap is 32 2026-02-17T11:47:48.460 INFO:tasks.rados.rados.0.trial142.stdout:291: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-17T11:47:48.463 INFO:tasks.rados.rados.0.trial142.stdout:291: writing trial14245205-8 from 534489 to 1152760 tid 1 2026-02-17T11:47:48.467 INFO:tasks.rados.rados.0.trial142.stdout:291: writing trial14245205-8 from 1565566 to 2134489 tid 2 2026-02-17T11:47:48.467 INFO:tasks.rados.rados.0.trial142.stdout:292: delete oid 33 current snap is 32 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: finishing write tid 2 to trial14245205-27 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: finishing write tid 3 to trial14245205-27 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: finishing write tid 4 to trial14245205-27 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: oid 27 updating version 0 to 184 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: oid 27 version 184 is already newer than 183 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: oid 27 updating version 184 to 185 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 185 (ObjNum 124 snap 32 seq_num 124) dirty exists 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:286: left oid 27 (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:47:48.468 INFO:tasks.rados.rados.0.trial142.stdout:289: expect (ObjNum 113 snap 27 seq_num 113) 2026-02-17T11:47:48.594 INFO:tasks.rados.rados.0.trial142.stdout:290: finishing write tid 1 to trial14245205-25 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: finishing write tid 2 to trial14245205-25 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: finishing write tid 3 to trial14245205-25 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: finishing write tid 4 to trial14245205-25 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: oid 25 updating version 0 to 52 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: oid 25 version 52 is already newer than 51 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: oid 25 version 52 is already newer than 50 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 52 (ObjNum 126 snap 32 seq_num 126) dirty exists 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:290: left oid 25 (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:291: finishing write tid 1 to trial14245205-8 2026-02-17T11:47:48.595 INFO:tasks.rados.rados.0.trial142.stdout:291: finishing write tid 2 to trial14245205-8 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:286: done (5 left) 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:287: done (4 left) 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:289: done (3 left) 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:290: done (2 left) 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:292: done (1 left) 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:293: rollback oid 48 current snap is 32 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 30 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:291: finishing write tid 3 to trial14245205-8 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:291: finishing write tid 4 to trial14245205-8 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:291: oid 8 updating version 0 to 187 2026-02-17T11:47:48.596 INFO:tasks.rados.rados.0.trial142.stdout:291: oid 8 version 187 is already newer than 186 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:291: oid 8 updating version 187 to 188 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 188 (ObjNum 127 snap 32 seq_num 127) dirty exists 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:291: left oid 8 (ObjNum 127 snap 32 seq_num 127) 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:291: done (1 left) 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:294: write (excl) oid 16 current snap is 32 2026-02-17T11:47:48.597 INFO:tasks.rados.rados.0.trial142.stdout:294: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-17T11:47:48.599 INFO:tasks.rados.rados.0.trial142.stdout:294: writing trial14245205-16 from 568103 to 1336872 tid 1 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:294: writing trial14245205-16 from 2082530 to 2168103 tid 2 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:295: rollback oid 17 current snap is 32 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 27 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:293: finishing rollback tid 0 to trial14245205-48 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:293: finishing rollback tid 1 to trial14245205-48 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:293: finishing rollback tid 2 to trial14245205-48 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 81 (ObjNum 111 snap 27 seq_num 111) dirty exists 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:294: finishing write tid 1 to trial14245205-16 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:293: done (2 left) 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:296: read oid 35 snap -1 2026-02-17T11:47:48.603 INFO:tasks.rados.rados.0.trial142.stdout:296: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:47:48.604 INFO:tasks.rados.rados.0.trial142.stdout:297: delete oid 32 current snap is 32 2026-02-17T11:47:48.604 INFO:tasks.rados.rados.0.trial142.stdout:297: done (3 left) 2026-02-17T11:47:48.604 INFO:tasks.rados.rados.0.trial142.stdout:298: read oid 4 snap -1 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:298: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:299: read oid 50 snap -1 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:299: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:300: read oid 1 snap -1 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:300: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:48.605 INFO:tasks.rados.rados.0.trial142.stdout:301: snap_remove snap 24 2026-02-17T11:47:49.368 INFO:tasks.rados.rados.0.trial142.stdout:301: done (6 left) 2026-02-17T11:47:49.368 INFO:tasks.rados.rados.0.trial142.stdout:302: snap_create 2026-02-17T11:47:49.369 INFO:tasks.rados.rados.0.trial142.stdout:300: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:49.497 INFO:tasks.rados.rados.0.trial142.stdout:296: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:47:49.556 INFO:tasks.rados.rados.0.trial142.stdout:294: finishing write tid 2 to trial14245205-16 2026-02-17T11:47:49.556 INFO:tasks.rados.rados.0.trial142.stdout:294: finishing write tid 3 to trial14245205-16 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:294: finishing write tid 4 to trial14245205-16 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:294: oid 16 updating version 0 to 102 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:294: oid 16 updating version 102 to 103 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:294: oid 16 version 103 is already newer than 101 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 103 (ObjNum 129 snap 32 seq_num 129) dirty exists 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:294: left oid 16 (ObjNum 129 snap 32 seq_num 129) 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:295: finishing rollback tid 0 to trial14245205-17 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:295: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:295: finishing rollback tid 2 to trial14245205-17 2026-02-17T11:47:49.557 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 107 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:47:49.558 INFO:tasks.rados.rados.0.trial142.stdout:298: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T11:47:49.607 INFO:tasks.rados.rados.0.trial142.stdout:299: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-17T11:47:50.369 INFO:tasks.rados.rados.0.trial142.stdout:294: done (6 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:295: done (5 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:296: done (4 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:298: done (3 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:299: done (2 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:300: done (1 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:302: done (0 left) 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:303: rollback oid 4 current snap is 33 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 30 2026-02-17T11:47:50.370 INFO:tasks.rados.rados.0.trial142.stdout:304: snap_create 2026-02-17T11:47:50.371 INFO:tasks.rados.rados.0.trial142.stdout:303: finishing rollback tid 0 to trial14245205-4 2026-02-17T11:47:50.372 INFO:tasks.rados.rados.0.trial142.stdout:303: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:47:50.372 INFO:tasks.rados.rados.0.trial142.stdout:303: finishing rollback tid 2 to trial14245205-4 2026-02-17T11:47:50.372 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 213 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T11:47:51.368 INFO:tasks.rados.rados.0.trial142.stdout:303: done (1 left) 2026-02-17T11:47:51.369 INFO:tasks.rados.rados.0.trial142.stdout:304: done (0 left) 2026-02-17T11:47:51.369 INFO:tasks.rados.rados.0.trial142.stdout:305: write oid 42 current snap is 34 2026-02-17T11:47:51.369 INFO:tasks.rados.rados.0.trial142.stdout:305: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-17T11:47:51.373 INFO:tasks.rados.rados.0.trial142.stdout:305: writing trial14245205-42 from 601717 to 1237337 tid 1 2026-02-17T11:47:51.377 INFO:tasks.rados.rados.0.trial142.stdout:305: writing trial14245205-42 from 1799494 to 2201717 tid 2 2026-02-17T11:47:51.378 INFO:tasks.rados.rados.0.trial142.stdout:306: read oid 25 snap -1 2026-02-17T11:47:51.378 INFO:tasks.rados.rados.0.trial142.stdout:306: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:47:51.378 INFO:tasks.rados.rados.0.trial142.stdout:307: write oid 43 current snap is 34 2026-02-17T11:47:51.378 INFO:tasks.rados.rados.0.trial142.stdout:307: seq_num 132 ranges {618524=710869,1857976=360548} 2026-02-17T11:47:51.382 INFO:tasks.rados.rados.0.trial142.stdout:307: writing trial14245205-43 from 618524 to 1329393 tid 1 2026-02-17T11:47:51.386 INFO:tasks.rados.rados.0.trial142.stdout:307: writing trial14245205-43 from 1857976 to 2218524 tid 2 2026-02-17T11:47:51.386 INFO:tasks.rados.rados.0.trial142.stdout:308: read oid 22 snap -1 2026-02-17T11:47:51.386 INFO:tasks.rados.rados.0.trial142.stdout:308: expect deleted 2026-02-17T11:47:51.386 INFO:tasks.rados.rados.0.trial142.stdout:309: copy_from oid 29 from oid 47 current snap is 34 2026-02-17T11:47:51.386 INFO:tasks.rados.rados.0.trial142.stdout:305: finishing write tid 1 to trial14245205-42 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: finishing write tid 2 to trial14245205-42 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: finishing write tid 3 to trial14245205-42 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: finishing write tid 4 to trial14245205-42 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: oid 42 updating version 0 to 72 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: oid 42 updating version 72 to 74 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: oid 42 version 74 is already newer than 73 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 74 (ObjNum 131 snap 34 seq_num 131) dirty exists 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:305: left oid 42 (ObjNum 131 snap 34 seq_num 131) 2026-02-17T11:47:51.387 INFO:tasks.rados.rados.0.trial142.stdout:306: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:47:51.451 INFO:tasks.rados.rados.0.trial142.stdout:307: finishing write tid 1 to trial14245205-43 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:309: finishing copy_from to trial14245205-29 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:309: got expected ENOENT (src dne) 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: finishing write tid 2 to trial14245205-43 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:309: finishing copy_from racing read to trial14245205-29 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: finishing write tid 3 to trial14245205-43 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: finishing write tid 4 to trial14245205-43 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: oid 43 updating version 0 to 215 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: oid 43 updating version 215 to 216 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: oid 43 updating version 216 to 217 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 217 (ObjNum 132 snap 34 seq_num 132) dirty exists 2026-02-17T11:47:51.452 INFO:tasks.rados.rados.0.trial142.stdout:307: left oid 43 (ObjNum 132 snap 34 seq_num 132) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:305: done (4 left) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:306: done (3 left) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:307: done (2 left) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:308: done (1 left) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:309: done (0 left) 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:310: copy_from oid 34 from oid 40 current snap is 34 2026-02-17T11:47:51.453 INFO:tasks.rados.rados.0.trial142.stdout:311: snap_remove snap 33 2026-02-17T11:47:52.373 INFO:tasks.rados.rados.0.trial142.stdout:311: done (1 left) 2026-02-17T11:47:52.373 INFO:tasks.rados.rados.0.trial142.stdout:312: copy_from oid 2 from oid 17 current snap is 34 2026-02-17T11:47:52.374 INFO:tasks.rados.rados.0.trial142.stdout:310: finishing copy_from racing read to trial14245205-34 2026-02-17T11:47:52.374 INFO:tasks.rados.rados.0.trial142.stdout:310: finishing copy_from to trial14245205-34 2026-02-17T11:47:52.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 66 (ObjNum 75 snap 15 seq_num 75) dirty exists 2026-02-17T11:47:52.374 INFO:tasks.rados.rados.0.trial142.stdout:310: done (1 left) 2026-02-17T11:47:52.374 INFO:tasks.rados.rados.0.trial142.stdout:313: snap_create 2026-02-17T11:47:52.384 INFO:tasks.rados.rados.0.trial142.stdout:312: finishing copy_from racing read to trial14245205-2 2026-02-17T11:47:52.387 INFO:tasks.rados.rados.0.trial142.stdout:312: finishing copy_from to trial14245205-2 2026-02-17T11:47:52.387 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 107 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:47:53.374 INFO:tasks.rados.rados.0.trial142.stdout:312: done (1 left) 2026-02-17T11:47:53.374 INFO:tasks.rados.rados.0.trial142.stdout:313: done (0 left) 2026-02-17T11:47:53.374 INFO:tasks.rados.rados.0.trial142.stdout:314: write (excl) oid 32 current snap is 35 2026-02-17T11:47:53.375 INFO:tasks.rados.rados.0.trial142.stdout:314: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-17T11:47:53.380 INFO:tasks.rados.rados.0.trial142.stdout:314: writing trial14245205-32 from 635331 to 1421449 tid 1 2026-02-17T11:47:53.383 INFO:tasks.rados.rados.0.trial142.stdout:314: writing trial14245205-32 from 1916458 to 2235331 tid 2 2026-02-17T11:47:53.383 INFO:tasks.rados.rados.0.trial142.stdout:315: write oid 42 current snap is 35 2026-02-17T11:47:53.383 INFO:tasks.rados.rados.0.trial142.stdout:315: seq_num 134 ranges {652138=461367,1574940=677198} 2026-02-17T11:47:53.387 INFO:tasks.rados.rados.0.trial142.stdout:315: writing trial14245205-42 from 652138 to 1113505 tid 1 2026-02-17T11:47:53.391 INFO:tasks.rados.rados.0.trial142.stdout:315: writing trial14245205-42 from 1574940 to 2252138 tid 2 2026-02-17T11:47:53.391 INFO:tasks.rados.rados.0.trial142.stdout:316: write (excl) oid 8 current snap is 35 2026-02-17T11:47:53.391 INFO:tasks.rados.rados.0.trial142.stdout:316: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-17T11:47:53.395 INFO:tasks.rados.rados.0.trial142.stdout:316: writing trial14245205-8 from 668945 to 1205561 tid 1 2026-02-17T11:47:53.399 INFO:tasks.rados.rados.0.trial142.stdout:316: writing trial14245205-8 from 1633422 to 2124785 tid 2 2026-02-17T11:47:53.399 INFO:tasks.rados.rados.0.trial142.stdout:317: delete oid 30 current snap is 35 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: finishing write tid 1 to trial14245205-32 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: finishing write tid 2 to trial14245205-32 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: finishing write tid 3 to trial14245205-32 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: finishing write tid 4 to trial14245205-32 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: oid 32 updating version 0 to 79 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: oid 32 version 79 is already newer than 78 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: oid 32 version 79 is already newer than 77 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 79 (ObjNum 133 snap 35 seq_num 133) dirty exists 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:314: left oid 32 (ObjNum 133 snap 35 seq_num 133) 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:315: finishing write tid 1 to trial14245205-42 2026-02-17T11:47:53.400 INFO:tasks.rados.rados.0.trial142.stdout:315: finishing write tid 2 to trial14245205-42 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: finishing write tid 3 to trial14245205-42 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: finishing write tid 4 to trial14245205-42 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: oid 42 updating version 0 to 82 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: oid 42 version 82 is already newer than 81 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: oid 42 updating version 82 to 83 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 83 (ObjNum 134 snap 35 seq_num 134) dirty exists 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:315: left oid 42 (ObjNum 134 snap 35 seq_num 134) 2026-02-17T11:47:53.401 INFO:tasks.rados.rados.0.trial142.stdout:316: finishing write tid 1 to trial14245205-8 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: finishing write tid 2 to trial14245205-8 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: finishing write tid 3 to trial14245205-8 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: finishing write tid 4 to trial14245205-8 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: oid 8 updating version 0 to 202 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: oid 8 version 202 is already newer than 200 2026-02-17T11:47:53.403 INFO:tasks.rados.rados.0.trial142.stdout:316: oid 8 version 202 is already newer than 201 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 202 (ObjNum 135 snap 35 seq_num 135) dirty exists 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:316: left oid 8 (ObjNum 135 snap 35 seq_num 135) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:314: done (3 left) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:315: done (2 left) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:316: done (1 left) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:317: done (0 left) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:318: read oid 7 snap -1 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:318: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:319: read oid 26 snap -1 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:319: expect (ObjNum 73 snap 13 seq_num 73) 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:320: read oid 4 snap -1 2026-02-17T11:47:53.404 INFO:tasks.rados.rados.0.trial142.stdout:320: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:321: copy_from oid 43 from oid 35 current snap is 35 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:322: read oid 42 snap -1 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:322: expect (ObjNum 134 snap 35 seq_num 134) 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:323: copy_from oid 24 from oid 8 current snap is 35 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:324: read oid 6 snap -1 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:324: expect (ObjNum 100 snap 21 seq_num 100) 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:325: read oid 34 snap -1 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:325: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:53.405 INFO:tasks.rados.rados.0.trial142.stdout:326: snap_create 2026-02-17T11:47:53.406 INFO:tasks.rados.rados.0.trial142.stdout:318: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T11:47:53.456 INFO:tasks.rados.rados.0.trial142.stdout:322: expect (ObjNum 134 snap 35 seq_num 134) 2026-02-17T11:47:53.521 INFO:tasks.rados.rados.0.trial142.stdout:324: expect (ObjNum 100 snap 21 seq_num 100) 2026-02-17T11:47:53.656 INFO:tasks.rados.rados.0.trial142.stdout:320: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T11:47:53.709 INFO:tasks.rados.rados.0.trial142.stdout:323: finishing copy_from racing read to trial14245205-24 2026-02-17T11:47:53.710 INFO:tasks.rados.rados.0.trial142.stdout:323: finishing copy_from to trial14245205-24 2026-02-17T11:47:53.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 202 (ObjNum 135 snap 35 seq_num 135) dirty exists 2026-02-17T11:47:53.710 INFO:tasks.rados.rados.0.trial142.stdout:325: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:53.842 INFO:tasks.rados.rados.0.trial142.stdout:319: expect (ObjNum 73 snap 13 seq_num 73) 2026-02-17T11:47:53.941 INFO:tasks.rados.rados.0.trial142.stdout:321: finishing copy_from racing read to trial14245205-43 2026-02-17T11:47:53.941 INFO:tasks.rados.rados.0.trial142.stdout:321: finishing copy_from to trial14245205-43 2026-02-17T11:47:53.941 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 32 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:318: done (8 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:319: done (7 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:320: done (6 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:321: done (5 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:322: done (4 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:323: done (3 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:324: done (2 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:325: done (1 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:326: done (0 left) 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:327: write oid 24 current snap is 36 2026-02-17T11:47:54.448 INFO:tasks.rados.rados.0.trial142.stdout:327: seq_num 137 ranges {702559=403467,1750386=495032} 2026-02-17T11:47:54.452 INFO:tasks.rados.rados.0.trial142.stdout:327: writing trial14245205-24 from 702559 to 1106026 tid 1 2026-02-17T11:47:54.456 INFO:tasks.rados.rados.0.trial142.stdout:327: writing trial14245205-24 from 1750386 to 2245418 tid 2 2026-02-17T11:47:54.456 INFO:tasks.rados.rados.0.trial142.stdout:328: snap_create 2026-02-17T11:47:54.456 INFO:tasks.rados.rados.0.trial142.stdout:327: finishing write tid 1 to trial14245205-24 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: finishing write tid 2 to trial14245205-24 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: finishing write tid 3 to trial14245205-24 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: finishing write tid 4 to trial14245205-24 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: oid 24 updating version 0 to 204 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: oid 24 updating version 204 to 205 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: oid 24 version 205 is already newer than 203 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 205 (ObjNum 137 snap 36 seq_num 137) dirty exists 2026-02-17T11:47:54.458 INFO:tasks.rados.rados.0.trial142.stdout:327: left oid 24 (ObjNum 137 snap 36 seq_num 137) 2026-02-17T11:47:55.449 INFO:tasks.rados.rados.0.trial142.stdout:327: done (1 left) 2026-02-17T11:47:55.449 INFO:tasks.rados.rados.0.trial142.stdout:328: done (0 left) 2026-02-17T11:47:55.449 INFO:tasks.rados.rados.0.trial142.stdout:329: snap_create 2026-02-17T11:47:56.449 INFO:tasks.rados.rados.0.trial142.stdout:329: done (0 left) 2026-02-17T11:47:56.449 INFO:tasks.rados.rados.0.trial142.stdout:330: delete oid 22 current snap is 38 2026-02-17T11:47:56.451 INFO:tasks.rados.rados.0.trial142.stdout:330: done (0 left) 2026-02-17T11:47:56.451 INFO:tasks.rados.rados.0.trial142.stdout:331: delete oid 44 current snap is 38 2026-02-17T11:47:56.454 INFO:tasks.rados.rados.0.trial142.stdout:331: done (0 left) 2026-02-17T11:47:56.454 INFO:tasks.rados.rados.0.trial142.stdout:332: read oid 40 snap -1 2026-02-17T11:47:56.454 INFO:tasks.rados.rados.0.trial142.stdout:332: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:56.454 INFO:tasks.rados.rados.0.trial142.stdout:333: write oid 39 current snap is 38 2026-02-17T11:47:56.454 INFO:tasks.rados.rados.0.trial142.stdout:333: seq_num 140 ranges {752980=629214,1809479=543501} 2026-02-17T11:47:56.459 INFO:tasks.rados.rados.0.trial142.stdout:333: writing trial14245205-39 from 752980 to 1382194 tid 1 2026-02-17T11:47:56.463 INFO:tasks.rados.rados.0.trial142.stdout:333: writing trial14245205-39 from 1809479 to 2352980 tid 2 2026-02-17T11:47:56.463 INFO:tasks.rados.rados.0.trial142.stdout:334: read oid 2 snap -1 2026-02-17T11:47:56.463 INFO:tasks.rados.rados.0.trial142.stdout:334: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:47:56.464 INFO:tasks.rados.rados.0.trial142.stdout:335: write oid 19 current snap is 38 2026-02-17T11:47:56.464 INFO:tasks.rados.rados.0.trial142.stdout:335: seq_num 141 ranges {769787=704463,2267961=101826} 2026-02-17T11:47:56.468 INFO:tasks.rados.rados.0.trial142.stdout:335: writing trial14245205-19 from 769787 to 1474250 tid 1 2026-02-17T11:47:56.472 INFO:tasks.rados.rados.0.trial142.stdout:335: writing trial14245205-19 from 2267961 to 2369787 tid 2 2026-02-17T11:47:56.472 INFO:tasks.rados.rados.0.trial142.stdout:336: rollback oid 10 current snap is 38 2026-02-17T11:47:56.472 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 10 to 30 2026-02-17T11:47:56.472 INFO:tasks.rados.rados.0.trial142.stdout:332: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:47:56.601 INFO:tasks.rados.rados.0.trial142.stdout:333: finishing write tid 1 to trial14245205-39 2026-02-17T11:47:56.601 INFO:tasks.rados.rados.0.trial142.stdout:334: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:47:56.655 INFO:tasks.rados.rados.0.trial142.stdout:333: finishing write tid 2 to trial14245205-39 2026-02-17T11:47:56.655 INFO:tasks.rados.rados.0.trial142.stdout:333: finishing write tid 3 to trial14245205-39 2026-02-17T11:47:56.655 INFO:tasks.rados.rados.0.trial142.stdout:333: finishing write tid 4 to trial14245205-39 2026-02-17T11:47:56.655 INFO:tasks.rados.rados.0.trial142.stdout:333: oid 39 updating version 0 to 206 2026-02-17T11:47:56.655 INFO:tasks.rados.rados.0.trial142.stdout:333: oid 39 updating version 206 to 208 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:333: oid 39 version 208 is already newer than 207 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 208 (ObjNum 140 snap 38 seq_num 140) dirty exists 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:333: left oid 39 (ObjNum 140 snap 38 seq_num 140) 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: finishing write tid 1 to trial14245205-19 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: finishing write tid 2 to trial14245205-19 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: finishing write tid 3 to trial14245205-19 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:336: finishing rollback tid 0 to trial14245205-10 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: finishing write tid 4 to trial14245205-19 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: oid 19 updating version 0 to 135 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: oid 19 version 135 is already newer than 134 2026-02-17T11:47:56.656 INFO:tasks.rados.rados.0.trial142.stdout:335: oid 19 version 135 is already newer than 133 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 135 (ObjNum 141 snap 38 seq_num 141) dirty exists 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:335: left oid 19 (ObjNum 141 snap 38 seq_num 141) 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:336: finishing rollback tid 1 to trial14245205-10 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:336: finishing rollback tid 2 to trial14245205-10 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 139 (ObjNum 121 snap 28 seq_num 121) dirty exists 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:332: done (4 left) 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:333: done (3 left) 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:334: done (2 left) 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:335: done (1 left) 2026-02-17T11:47:56.657 INFO:tasks.rados.rados.0.trial142.stdout:336: done (0 left) 2026-02-17T11:47:56.658 INFO:tasks.rados.rados.0.trial142.stdout:337: delete oid 8 current snap is 38 2026-02-17T11:47:56.658 INFO:tasks.rados.rados.0.trial142.stdout:337: done (0 left) 2026-02-17T11:47:56.658 INFO:tasks.rados.rados.0.trial142.stdout:338: read oid 38 snap -1 2026-02-17T11:47:56.659 INFO:tasks.rados.rados.0.trial142.stdout:338: expect deleted 2026-02-17T11:47:56.659 INFO:tasks.rados.rados.0.trial142.stdout:339: write (excl) oid 46 current snap is 38 2026-02-17T11:47:56.659 INFO:tasks.rados.rados.0.trial142.stdout:339: seq_num 143 ranges {403401=454961,1584925=506039} 2026-02-17T11:47:56.659 INFO:tasks.rados.rados.0.trial142.stdout:339: writing trial14245205-46 from 403401 to 858362 tid 1 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:339: writing trial14245205-46 from 1584925 to 2090964 tid 2 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:340: rollback oid 20 current snap is 38 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 8 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:339: finishing write tid 1 to trial14245205-46 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:338: done (2 left) 2026-02-17T11:47:56.665 INFO:tasks.rados.rados.0.trial142.stdout:341: delete oid 26 current snap is 38 2026-02-17T11:47:56.666 INFO:tasks.rados.rados.0.trial142.stdout:341: done (2 left) 2026-02-17T11:47:56.666 INFO:tasks.rados.rados.0.trial142.stdout:342: copy_from oid 31 from oid 2 current snap is 38 2026-02-17T11:47:56.666 INFO:tasks.rados.rados.0.trial142.stdout:343: write (excl) oid 24 current snap is 38 2026-02-17T11:47:56.666 INFO:tasks.rados.rados.0.trial142.stdout:343: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-17T11:47:56.670 INFO:tasks.rados.rados.0.trial142.stdout:343: writing trial14245205-24 from 437015 to 1158827 tid 1 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:343: writing trial14245205-24 from 1701889 to 2211597 tid 2 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:344: snap_create 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:339: finishing write tid 2 to trial14245205-46 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:340: finishing rollback tid 0 to trial14245205-20 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:339: finishing write tid 3 to trial14245205-46 2026-02-17T11:47:56.675 INFO:tasks.rados.rados.0.trial142.stdout:340: finishing rollback tid 1 to trial14245205-20 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:339: finishing write tid 4 to trial14245205-46 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:339: oid 46 updating version 0 to 223 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:339: oid 46 updating version 223 to 224 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:339: oid 46 version 224 is already newer than 222 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 224 (ObjNum 143 snap 38 seq_num 143) dirty exists 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:339: left oid 46 (ObjNum 143 snap 38 seq_num 143) 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:340: finishing rollback tid 2 to trial14245205-20 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 87 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:343: finishing write tid 1 to trial14245205-24 2026-02-17T11:47:56.676 INFO:tasks.rados.rados.0.trial142.stdout:342: finishing copy_from racing read to trial14245205-31 2026-02-17T11:47:56.677 INFO:tasks.rados.rados.0.trial142.stdout:342: finishing copy_from to trial14245205-31 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 107 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: finishing write tid 2 to trial14245205-24 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: finishing write tid 3 to trial14245205-24 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: finishing write tid 4 to trial14245205-24 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: oid 24 updating version 0 to 210 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: oid 24 updating version 210 to 211 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: oid 24 version 211 is already newer than 209 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 211 (ObjNum 145 snap 38 seq_num 145) dirty exists 2026-02-17T11:47:56.678 INFO:tasks.rados.rados.0.trial142.stdout:343: left oid 24 (ObjNum 145 snap 38 seq_num 145) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:339: done (4 left) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:340: done (3 left) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:342: done (2 left) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:343: done (1 left) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:344: done (0 left) 2026-02-17T11:47:57.456 INFO:tasks.rados.rados.0.trial142.stdout:345: copy_from oid 29 from oid 39 current snap is 39 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:346: rollback oid 48 current snap is 39 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 35 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:347: read oid 50 snap -1 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:347: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:348: write (excl) oid 23 current snap is 39 2026-02-17T11:47:57.457 INFO:tasks.rados.rados.0.trial142.stdout:348: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-17T11:47:57.460 INFO:tasks.rados.rados.0.trial142.stdout:348: writing trial14245205-23 from 453822 to 1250883 tid 1 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:348: writing trial14245205-23 from 1760371 to 2413737 tid 2 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:349: read oid 8 snap -1 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:349: expect deleted 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:350: snap_create 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:346: finishing rollback tid 0 to trial14245205-48 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:346: finishing rollback tid 1 to trial14245205-48 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:346: finishing rollback tid 2 to trial14245205-48 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 91 (ObjNum 111 snap 27 seq_num 111) dirty exists 2026-02-17T11:47:57.465 INFO:tasks.rados.rados.0.trial142.stdout:347: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: finishing write tid 1 to trial14245205-23 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: finishing write tid 2 to trial14245205-23 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: finishing write tid 3 to trial14245205-23 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: finishing write tid 4 to trial14245205-23 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: oid 23 updating version 0 to 143 2026-02-17T11:47:57.527 INFO:tasks.rados.rados.0.trial142.stdout:348: oid 23 version 143 is already newer than 141 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:348: oid 23 version 143 is already newer than 142 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 143 (ObjNum 146 snap 39 seq_num 146) dirty exists 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:348: left oid 23 (ObjNum 146 snap 39 seq_num 146) 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:345: finishing copy_from racing read to trial14245205-29 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:345: finishing copy_from to trial14245205-29 2026-02-17T11:47:57.528 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 208 (ObjNum 140 snap 38 seq_num 140) dirty exists 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:345: done (5 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:346: done (4 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:347: done (3 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:348: done (2 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:349: done (1 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:350: done (0 left) 2026-02-17T11:47:58.458 INFO:tasks.rados.rados.0.trial142.stdout:351: rollback oid 24 current snap is 40 2026-02-17T11:47:58.459 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 31 2026-02-17T11:47:58.459 INFO:tasks.rados.rados.0.trial142.stdout:352: rollback oid 3 current snap is 40 2026-02-17T11:47:58.459 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 30 2026-02-17T11:47:58.459 INFO:tasks.rados.rados.0.trial142.stdout:353: write oid 26 current snap is 40 2026-02-17T11:47:58.459 INFO:tasks.rados.rados.0.trial142.stdout:353: seq_num 147 ranges {470629=472310,1418853=513377} 2026-02-17T11:47:58.462 INFO:tasks.rados.rados.0.trial142.stdout:353: writing trial14245205-26 from 470629 to 942939 tid 1 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:353: writing trial14245205-26 from 1418853 to 1932230 tid 2 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:354: snap_create 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:352: finishing rollback tid 0 to trial14245205-3 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:352: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:352: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 58 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:351: finishing rollback tid 0 to trial14245205-24 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:351: finishing rollback tid 1 to trial14245205-24 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:351: finishing rollback tid 2 to trial14245205-24 2026-02-17T11:47:58.466 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 214 (ObjNum 116 snap 28 seq_num 116) dirty exists 2026-02-17T11:47:58.467 INFO:tasks.rados.rados.0.trial142.stdout:353: finishing write tid 1 to trial14245205-26 2026-02-17T11:47:58.467 INFO:tasks.rados.rados.0.trial142.stdout:353: finishing write tid 2 to trial14245205-26 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: finishing write tid 3 to trial14245205-26 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: finishing write tid 4 to trial14245205-26 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: oid 26 updating version 0 to 58 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: oid 26 version 58 is already newer than 57 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: oid 26 updating version 58 to 59 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 59 (ObjNum 147 snap 40 seq_num 147) dirty exists 2026-02-17T11:47:58.468 INFO:tasks.rados.rados.0.trial142.stdout:353: left oid 26 (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:47:59.369 INFO:tasks.rados.rados.0.trial142.stdout:351: done (3 left) 2026-02-17T11:47:59.369 INFO:tasks.rados.rados.0.trial142.stdout:352: done (2 left) 2026-02-17T11:47:59.369 INFO:tasks.rados.rados.0.trial142.stdout:353: done (1 left) 2026-02-17T11:47:59.369 INFO:tasks.rados.rados.0.trial142.stdout:354: done (0 left) 2026-02-17T11:47:59.369 INFO:tasks.rados.rados.0.trial142.stdout:355: delete oid 9 current snap is 41 2026-02-17T11:47:59.372 INFO:tasks.rados.rados.0.trial142.stdout:355: done (0 left) 2026-02-17T11:47:59.372 INFO:tasks.rados.rados.0.trial142.stdout:356: snap_create 2026-02-17T11:48:00.371 INFO:tasks.rados.rados.0.trial142.stdout:356: done (0 left) 2026-02-17T11:48:00.371 INFO:tasks.rados.rados.0.trial142.stdout:357: read oid 3 snap 41 2026-02-17T11:48:00.371 INFO:tasks.rados.rados.0.trial142.stdout:357: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T11:48:00.371 INFO:tasks.rados.rados.0.trial142.stdout:358: rollback oid 6 current snap is 42 2026-02-17T11:48:00.372 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 40 2026-02-17T11:48:00.372 INFO:tasks.rados.rados.0.trial142.stdout:359: write (excl) oid 45 current snap is 42 2026-02-17T11:48:00.372 INFO:tasks.rados.rados.0.trial142.stdout:359: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-17T11:48:00.375 INFO:tasks.rados.rados.0.trial142.stdout:359: writing trial14245205-45 from 504243 to 1127051 tid 1 2026-02-17T11:48:00.380 INFO:tasks.rados.rados.0.trial142.stdout:359: writing trial14245205-45 from 1819464 to 2336510 tid 2 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:360: delete oid 32 current snap is 42 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:358: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:358: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:358: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 72 (ObjNum 100 snap 21 seq_num 100) dirty exists 2026-02-17T11:48:00.381 INFO:tasks.rados.rados.0.trial142.stdout:357: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T11:48:00.429 INFO:tasks.rados.rados.0.trial142.stdout:359: finishing write tid 1 to trial14245205-45 2026-02-17T11:48:00.429 INFO:tasks.rados.rados.0.trial142.stdout:359: finishing write tid 2 to trial14245205-45 2026-02-17T11:48:00.429 INFO:tasks.rados.rados.0.trial142.stdout:359: finishing write tid 3 to trial14245205-45 2026-02-17T11:48:00.429 INFO:tasks.rados.rados.0.trial142.stdout:357: done (3 left) 2026-02-17T11:48:00.429 INFO:tasks.rados.rados.0.trial142.stdout:358: done (2 left) 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:360: done (1 left) 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:361: copy_from oid 11 from oid 48 current snap is 42 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: finishing write tid 4 to trial14245205-45 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: oid 45 updating version 0 to 99 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: oid 45 updating version 99 to 100 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: oid 45 version 100 is already newer than 98 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 100 (ObjNum 149 snap 42 seq_num 149) dirty exists 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: left oid 45 (ObjNum 149 snap 42 seq_num 149) 2026-02-17T11:48:00.430 INFO:tasks.rados.rados.0.trial142.stdout:359: done (1 left) 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:362: copy_from oid 42 from oid 27 current snap is 42 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:363: read oid 1 snap -1 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:363: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:364: read oid 14 snap -1 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:364: expect deleted 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:365: read oid 49 snap 8 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:365: expect (ObjNum 53 snap 0 seq_num 53) 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:366: write (excl) oid 13 current snap is 42 2026-02-17T11:48:00.431 INFO:tasks.rados.rados.0.trial142.stdout:366: seq_num 151 ranges {537857=773306,1936428=520715} 2026-02-17T11:48:00.433 INFO:tasks.rados.rados.0.trial142.stdout:366: writing trial14245205-13 from 537857 to 1311163 tid 1 2026-02-17T11:48:00.438 INFO:tasks.rados.rados.0.trial142.stdout:366: writing trial14245205-13 from 1936428 to 2457143 tid 2 2026-02-17T11:48:00.438 INFO:tasks.rados.rados.0.trial142.stdout:367: copy_from oid 41 from oid 39 current snap is 42 2026-02-17T11:48:00.438 INFO:tasks.rados.rados.0.trial142.stdout:363: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:48:00.569 INFO:tasks.rados.rados.0.trial142.stdout:365: expect (ObjNum 53 snap 0 seq_num 53) 2026-02-17T11:48:00.669 INFO:tasks.rados.rados.0.trial142.stdout:362: finishing copy_from racing read to trial14245205-42 2026-02-17T11:48:00.669 INFO:tasks.rados.rados.0.trial142.stdout:363: done (6 left) 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:364: done (5 left) 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:365: done (4 left) 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:368: write (excl) oid 28 current snap is 42 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:362: finishing copy_from to trial14245205-42 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 185 (ObjNum 124 snap 32 seq_num 124) dirty exists 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:366: finishing write tid 1 to trial14245205-13 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:366: finishing write tid 2 to trial14245205-13 2026-02-17T11:48:00.670 INFO:tasks.rados.rados.0.trial142.stdout:368: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-17T11:48:00.673 INFO:tasks.rados.rados.0.trial142.stdout:368: writing trial14245205-28 from 554664 to 1003219 tid 1 2026-02-17T11:48:00.677 INFO:tasks.rados.rados.0.trial142.stdout:368: writing trial14245205-28 from 1478557 to 2142930 tid 2 2026-02-17T11:48:00.678 INFO:tasks.rados.rados.0.trial142.stdout:362: done (4 left) 2026-02-17T11:48:00.678 INFO:tasks.rados.rados.0.trial142.stdout:369: snap_remove snap 31 2026-02-17T11:48:01.149 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:48:01.149 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T11:48:01.149 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:48:01.149 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T11:48:01.153 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:48:01.153 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:48:01.153 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:01.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: get_monmap_and_config 2026-02-17T11:48:01.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: build_initial_monmap 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: monmap: 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:01.224284+0000 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:01.224284+0000 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:01.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 1 Processor -- start 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 1 -- start start 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: init 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.223+0000 7f01617a7640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-b con 0x7f015c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f015c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f015c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c06e140 con 0x7f015c13b760 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c09f910 con 0x7f015c0a0750 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f015c09ccd0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f01617a7640 10 monclient(hunting): authenticate will time out at 768.843065s 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60120/0 (socket says 10.20.193.51:60120) 2026-02-17T11:48:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015b7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f015c13b760 0x7f015c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46890/0 (socket says 10.20.193.51:46890) 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 -- 10.20.193.51:0/991770440 learned_addr learned my addr 10.20.193.51:0/991770440 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): get_auth_request con 0x7f015c0a3bb0 auth_method 0 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient(hunting): handle_auth_done global_id 44186 payload 274 2026-02-17T11:48:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 -- 10.20.193.51:0/991770440 >> v1:10.20.193.142:6789/0 conn(0x7f015c0a0750 legacy=0x7f015c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 -- 10.20.193.51:0/991770440 >> v1:10.20.193.51:6789/0 conn(0x7f015c13b760 legacy=0x7f015c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 monclient: found mon.noname-b 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.224+0000 7f015affd640 1 -- 10.20.193.51:0/991770440 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c09eec0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f015affd640 1 -- 10.20.193.51:0/991770440 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 msgr2=0x7f015c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f015affd640 1 --2- 10.20.193.51:0/991770440 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f015c069d60 tx=0x7f015002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b333aca141e6ce server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f0159ffb640 1 -- 10.20.193.51:0/991770440 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015003c070 con 0x7f015c0a3bb0 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f0159ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f0159ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.226+0000 7f0159ffb640 10 monclient: dump: 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.240 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 5 monclient: authenticate success, global_id 44186 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 1 -- 10.20.193.51:0/991770440 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015002fdb0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 1 -- 10.20.193.51:0/991770440 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150037660 con 0x7f015c0a3bb0 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f0159ffb640 10 monclient: dump: 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 4 set_mon_vals no callback set 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 10 monclient: shutdown 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 -- 10.20.193.51:0/991770440 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 msgr2=0x7f015c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 --2- 10.20.193.51:0/991770440 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f015c069d60 tx=0x7f015002ee90 comp rx=0 tx=0).stop 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 -- 10.20.193.51:0/991770440 shutdown_connections 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 --2- 10.20.193.51:0/991770440 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a3bb0 0x7f015c09dac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 -- 10.20.193.51:0/991770440 >> 10.20.193.51:0/991770440 conn(0x7f015c0a30c0 msgr2=0x7f015c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 -- 10.20.193.51:0/991770440 shutdown_connections 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 1 -- 10.20.193.51:0/991770440 wait complete. 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 10 monclient: build_initial_monmap 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.227+0000 7f01617a7640 10 monclient: monmap: 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 Processor -- start 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 -- start start 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient: init 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a0750 0x7f015c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-c con 0x7f015c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:01.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-a con 0x7f015c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 0x7f015c0951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): picked mon.noname-b con 0x7f015c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0a04b0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f015c09c850 con 0x7f015c13b760 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f015c09e710 con 0x7f015c0a0750 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f01617a7640 10 monclient(hunting): authenticate will time out at 768.847308s 2026-02-17T11:48:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a0750 0x7f015c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:57404/0 (socket says 10.20.193.51:57404) 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 -- 10.20.193.51:0/1581580625 learned_addr learned my addr 10.20.193.51:0/1581580625 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): get_auth_request con 0x7f015c0a3bb0 auth_method 0 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): get_auth_request con 0x7f015c0a0750 auth_method 0 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient(hunting): handle_auth_done global_id 34257 payload 824 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 -- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a0750 msgr2=0x7f015c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a0750 0x7f015c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 -- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 msgr2=0x7f015c0951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015b7fe640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 0x7f015c0951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 0x7f015c0951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 monclient: found mon.noname-a 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015a7fc640 1 -- 10.20.193.51:0/1581580625 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c0a2d20 con 0x7f015c0a3bb0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015b7fe640 10 monclient: get_auth_request con 0x7f015c13b760 auth_method 0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.228+0000 7f015b7fe640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 0x7f015c0951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f015a7fc640 1 -- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 msgr2=0x7f015c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f015a7fc640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f014400c500 tx=0x7f014400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0144012a40 con 0x7f015c0a3bb0 2026-02-17T11:48:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: dump: 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0144017070 con 0x7f015c0a3bb0 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0144012e40 con 0x7f015c0a3bb0 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01597fa640 4 set_mon_vals no callback set 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f013b7fe640 10 monclient: dump: 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 5 monclient: authenticate success, global_id 34257 2026-02-17T11:48:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 10 monclient: _renew_subs 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c098d90 con 0x7f015c0a3bb0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 10 monclient: _renew_subs 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.230+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c09d7b0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f01617a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f01617a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f01617a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f014401c460 con 0x7f015c0a3bb0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015c09dac0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f013b7fe640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 0x7f0128040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(96..96 src has 47..96) ==== 4707+0+0 (secure 0 0 0) 0x7f01440523c0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f015affd640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 0x7f0128040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.231+0000 7f015affd640 10 monclient: get_auth_request con 0x7f012803dd40 auth_method 0 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.234+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f015c0a2d20 con 0x7f015c0a3bb0 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.234+0000 7f013b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.234+0000 7f013b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.234+0000 7f015affd640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 0x7f0128040200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0150036000 tx=0x7f0150033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f01617a7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f01617a7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f01617a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f015c0973f0 con 0x7f015c0a3bb0 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f013b7fe640 1 -- 10.20.193.51:0/1581580625 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f0144050e00 con 0x7f015c0a3bb0 2026-02-17T11:48:01.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f013b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:01.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.348+0000 7f013b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:01.352 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":20,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 msgr2=0x7f0128040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 0x7f0128040200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0150036000 tx=0x7f0150033000 comp rx=0 tx=0).stop 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 10 monclient: shutdown 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 msgr2=0x7f015c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f014400c500 tx=0x7f014400c9d0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 shutdown_connections 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f012803dd40 0x7f0128040200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f015c13b760 0x7f015c0951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f015c0a3bb0 0x7f015c1d0010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 --2- 10.20.193.51:0/1581580625 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f015c0a0750 0x7f015c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 >> 10.20.193.51:0/1581580625 conn(0x7f015c0a30c0 msgr2=0x7f015c13ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 shutdown_connections 2026-02-17T11:48:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:01.349+0000 7f01617a7640 1 -- 10.20.193.51:0/1581580625 wait complete. 2026-02-17T11:48:01.461 INFO:tasks.rados.rados.0.trial142.stdout:369: done (4 left) 2026-02-17T11:48:01.461 INFO:tasks.rados.rados.0.trial142.stdout:370: copy_from oid 47 from oid 27 current snap is 42 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: finishing write tid 3 to trial14245205-13 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:361: finishing copy_from racing read to trial14245205-11 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: finishing write tid 4 to trial14245205-13 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: oid 13 updating version 0 to 209 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: oid 13 version 209 is already newer than 208 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: oid 13 updating version 209 to 210 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 210 (ObjNum 151 snap 42 seq_num 151) dirty exists 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:366: left oid 13 (ObjNum 151 snap 42 seq_num 151) 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:361: finishing copy_from to trial14245205-11 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 91 (ObjNum 111 snap 27 seq_num 111) dirty exists 2026-02-17T11:48:01.462 INFO:tasks.rados.rados.0.trial142.stdout:367: finishing copy_from racing read to trial14245205-41 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:367: finishing copy_from to trial14245205-41 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 208 (ObjNum 140 snap 38 seq_num 140) dirty exists 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: finishing write tid 1 to trial14245205-28 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: finishing write tid 2 to trial14245205-28 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: finishing write tid 3 to trial14245205-28 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: finishing write tid 4 to trial14245205-28 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: oid 28 updating version 0 to 60 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: oid 28 updating version 60 to 62 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: oid 28 version 62 is already newer than 61 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 62 (ObjNum 152 snap 42 seq_num 152) dirty exists 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:368: left oid 28 (ObjNum 152 snap 42 seq_num 152) 2026-02-17T11:48:01.463 INFO:tasks.rados.rados.0.trial142.stdout:361: done (4 left) 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:366: done (3 left) 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:367: done (2 left) 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:368: done (1 left) 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:371: write oid 48 current snap is 42 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:371: seq_num 153 ranges {571471=640157,1653392=524384} 2026-02-17T11:48:01.464 INFO:tasks.rados.rados.0.trial142.stdout:371: writing trial14245205-48 from 571471 to 1211628 tid 1 2026-02-17T11:48:01.468 INFO:tasks.rados.rados.0.trial142.stdout:371: writing trial14245205-48 from 1653392 to 2177776 tid 2 2026-02-17T11:48:01.468 INFO:tasks.rados.rados.0.trial142.stdout:370: finishing copy_from racing read to trial14245205-47 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:370: finishing copy_from to trial14245205-47 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 185 (ObjNum 124 snap 32 seq_num 124) dirty exists 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:372: read oid 28 snap -1 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:372: expect (ObjNum 152 snap 42 seq_num 152) 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:370: done (2 left) 2026-02-17T11:48:01.469 INFO:tasks.rados.rados.0.trial142.stdout:373: snap_create 2026-02-17T11:48:01.470 INFO:tasks.rados.rados.0.trial142.stdout:371: finishing write tid 1 to trial14245205-48 2026-02-17T11:48:01.470 INFO:tasks.rados.rados.0.trial142.stdout:371: finishing write tid 2 to trial14245205-48 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: finishing write tid 3 to trial14245205-48 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: finishing write tid 4 to trial14245205-48 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: oid 48 updating version 0 to 209 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: oid 48 updating version 209 to 210 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: oid 48 updating version 210 to 211 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 211 (ObjNum 153 snap 42 seq_num 153) dirty exists 2026-02-17T11:48:01.471 INFO:tasks.rados.rados.0.trial142.stdout:371: left oid 48 (ObjNum 153 snap 42 seq_num 153) 2026-02-17T11:48:01.472 INFO:tasks.rados.rados.0.trial142.stdout:372: expect (ObjNum 152 snap 42 seq_num 152) 2026-02-17T11:48:02.462 INFO:tasks.rados.rados.0.trial142.stdout:371: done (2 left) 2026-02-17T11:48:02.463 INFO:tasks.rados.rados.0.trial142.stdout:372: done (1 left) 2026-02-17T11:48:02.463 INFO:tasks.rados.rados.0.trial142.stdout:373: done (0 left) 2026-02-17T11:48:02.463 INFO:tasks.rados.rados.0.trial142.stdout:374: snap_remove snap 27 2026-02-17T11:48:03.462 INFO:tasks.rados.rados.0.trial142.stdout:374: done (0 left) 2026-02-17T11:48:03.463 INFO:tasks.rados.rados.0.trial142.stdout:375: snap_remove snap 37 2026-02-17T11:48:04.360 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:04.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.428+0000 7ff2198da640 10 monclient: get_monmap_and_config 2026-02-17T11:48:04.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.428+0000 7ff2198da640 10 monclient: build_initial_monmap 2026-02-17T11:48:04.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.428+0000 7ff2198da640 10 monclient: monmap: 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:04.429572+0000 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:04.429572+0000 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:04.433 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 Processor -- start 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 -- start start 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient: init 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff2140a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 0x7ff21409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-b con 0x7ff21409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff2140a0110 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21406e140 con 0x7ff2140a0110 2026-02-17T11:48:04.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21409ce60 con 0x7ff2140a3bb0 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff21409aed0 con 0x7ff21409dac0 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2198da640 10 monclient(hunting): authenticate will time out at 772.048365s 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 0x7ff21409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2137fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff2140a0110 0x7ff21413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46902/0 (socket says 10.20.193.51:46902) 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2137fe640 1 -- 10.20.193.51:0/3307618039 learned_addr learned my addr 10.20.193.51:0/3307618039 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): get_auth_request con 0x7ff21409dac0 auth_method 0 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:04.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient(hunting): handle_auth_done global_id 44192 payload 274 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 1 -- 10.20.193.51:0/3307618039 >> v1:10.20.193.142:6789/0 conn(0x7ff2140a3bb0 legacy=0x7ff21409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 1 -- 10.20.193.51:0/3307618039 >> v1:10.20.193.51:6789/0 conn(0x7ff2140a0110 legacy=0x7ff21413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient: _finish_hunting 0 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 1 monclient: found mon.noname-b 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:04.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.429+0000 7ff2127fc640 1 -- 10.20.193.51:0/3307618039 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21409a5c0 con 0x7ff21409dac0 2026-02-17T11:48:04.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2127fc640 1 -- 10.20.193.51:0/3307618039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 msgr2=0x7ff21409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:04.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2127fc640 1 --2- 10.20.193.51:0/3307618039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 0x7ff21409fbd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff21406e310 tx=0x7ff1fc02eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59534a54711e1c26 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:04.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 1 -- 10.20.193.51:0/3307618039 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc03c070 con 0x7ff21409dac0 2026-02-17T11:48:04.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: dump: 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:04.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 5 monclient: authenticate success, global_id 44192 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 1 -- 10.20.193.51:0/3307618039 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc02fd00 con 0x7ff21409dac0 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 4 set_mon_vals no callback set 2026-02-17T11:48:04.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 1 -- 10.20.193.51:0/3307618039 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc037660 con 0x7ff21409dac0 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff211ffb640 10 monclient: dump: 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:04.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 10 monclient: shutdown 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 -- 10.20.193.51:0/3307618039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 msgr2=0x7ff21409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 --2- 10.20.193.51:0/3307618039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 0x7ff21409fbd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff21406e310 tx=0x7ff1fc02eda0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 -- 10.20.193.51:0/3307618039 shutdown_connections 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 --2- 10.20.193.51:0/3307618039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff21409dac0 0x7ff21409fbd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 -- 10.20.193.51:0/3307618039 >> 10.20.193.51:0/3307618039 conn(0x7ff2140a30c0 msgr2=0x7ff2140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 -- 10.20.193.51:0/3307618039 shutdown_connections 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.432+0000 7ff2198da640 1 -- 10.20.193.51:0/3307618039 wait complete. 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient: build_initial_monmap 2026-02-17T11:48:04.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient: monmap: 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 Processor -- start 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 -- start start 2026-02-17T11:48:04.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient: init 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-a con 0x7ff21409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff2140a0110 0x7ff21408edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-b con 0x7ff2140a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff2140a3bb0 0x7ff21408f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): picked mon.noname-c con 0x7ff2140a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140a0540 con 0x7ff21409dac0 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140a3f90 con 0x7ff2140a0110 2026-02-17T11:48:04.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff21413de80 con 0x7ff2140a3bb0 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2198da640 10 monclient(hunting): authenticate will time out at 772.052549s 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:57410/0 (socket says 10.20.193.51:57410) 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 -- 10.20.193.51:0/3675150747 learned_addr learned my addr 10.20.193.51:0/3675150747 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): get_auth_request con 0x7ff21409dac0 auth_method 0 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:04.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff2140a3bb0 0x7ff21408f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): get_auth_request con 0x7ff2140a3bb0 auth_method 0 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2127fc640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff2140a0110 0x7ff21408edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:04.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2127fc640 10 monclient(hunting): get_auth_request con 0x7ff2140a0110 auth_method 0 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff2127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient(hunting): handle_auth_done global_id 34260 payload 824 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 -- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff2140a3bb0 msgr2=0x7ff21408f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff2140a3bb0 0x7ff21408f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 -- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff2140a0110 msgr2=0x7ff21408edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff2140a0110 0x7ff21408edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 monclient: found mon.noname-a 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:04.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.433+0000 7ff212ffd640 1 -- 10.20.193.51:0/3675150747 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff214091b10 con 0x7ff21409dac0 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.435+0000 7ff212ffd640 1 -- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 msgr2=0x7ff21408e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.435+0000 7ff212ffd640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c5d0 tx=0x7ff20800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208016020 con 0x7ff21409dac0 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: dump: 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:04.453 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: _finish_auth 0 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff208012a60 con 0x7ff21409dac0 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 5 monclient: authenticate success, global_id 34260 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _renew_subs 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:04.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2140a2020 con 0x7ff21409dac0 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208012e50 con 0x7ff21409dac0 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2117fa640 4 set_mon_vals no callback set 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 10 monclient: dump: 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:04.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _renew_subs 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff214090330 con 0x7ff21409dac0 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff20801b400 con 0x7ff21409dac0 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:04.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff214074250 con 0x7ff21409dac0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.436+0000 7ff1ebfff640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 0x7ff1e4040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.437+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(99..99 src has 47..99) ==== 4779+0+0 (secure 0 0 0) 0x7ff2080526a0 con 0x7ff21409dac0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.437+0000 7ff2127fc640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 0x7ff1e4040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.437+0000 7ff2127fc640 10 monclient: get_auth_request con 0x7ff1e403deb0 auth_method 0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.439+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff208020030 con 0x7ff21409dac0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.439+0000 7ff1ebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.439+0000 7ff1ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:04.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.439+0000 7ff2127fc640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 0x7ff1e4040370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff214076590 tx=0x7ff1fc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:04.464 INFO:tasks.rados.rados.0.trial142.stdout:375: done (0 left) 2026-02-17T11:48:04.464 INFO:tasks.rados.rados.0.trial142.stdout:376: write (excl) oid 29 current snap is 43 2026-02-17T11:48:04.464 INFO:tasks.rados.rados.0.trial142.stdout:376: seq_num 154 ranges {588278=715406,1711874=668042} 2026-02-17T11:48:04.468 INFO:tasks.rados.rados.0.trial142.stdout:376: writing trial14245205-29 from 588278 to 1303684 tid 1 2026-02-17T11:48:04.473 INFO:tasks.rados.rados.0.trial142.stdout:376: writing trial14245205-29 from 1711874 to 2379916 tid 2 2026-02-17T11:48:04.473 INFO:tasks.rados.rados.0.trial142.stdout:377: snap_create 2026-02-17T11:48:04.473 INFO:tasks.rados.rados.0.trial142.stdout:376: finishing write tid 1 to trial14245205-29 2026-02-17T11:48:04.474 INFO:tasks.rados.rados.0.trial142.stdout:376: finishing write tid 2 to trial14245205-29 2026-02-17T11:48:04.475 INFO:tasks.rados.rados.0.trial142.stdout:376: finishing write tid 3 to trial14245205-29 2026-02-17T11:48:04.475 INFO:tasks.rados.rados.0.trial142.stdout:376: finishing write tid 4 to trial14245205-29 2026-02-17T11:48:04.475 INFO:tasks.rados.rados.0.trial142.stdout:376: oid 29 updating version 0 to 214 2026-02-17T11:48:04.475 INFO:tasks.rados.rados.0.trial142.stdout:376: oid 29 version 214 is already newer than 212 2026-02-17T11:48:04.475 INFO:tasks.rados.rados.0.trial142.stdout:376: oid 29 version 214 is already newer than 213 2026-02-17T11:48:04.476 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 214 (ObjNum 154 snap 43 seq_num 154) dirty exists 2026-02-17T11:48:04.476 INFO:tasks.rados.rados.0.trial142.stdout:376: left oid 29 (ObjNum 154 snap 43 seq_num 154) 2026-02-17T11:48:04.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff2198da640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:04.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff2198da640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:04.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff2198da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:04.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff21409f4c0 con 0x7ff21409dac0 2026-02-17T11:48:04.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff1ebfff640 1 -- 10.20.193.51:0/3675150747 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7ff2080510a0 con 0x7ff21409dac0 2026-02-17T11:48:04.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff1ebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:04.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.555+0000 7ff1ebfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:04.558 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":20,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:04.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 msgr2=0x7ff1e4040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 0x7ff1e4040370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff214076590 tx=0x7ff1fc033000 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 10 monclient: shutdown 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 msgr2=0x7ff21408e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c5d0 tx=0x7ff20800caa0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 shutdown_connections 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff1e403deb0 0x7ff1e4040370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff2140a3bb0 0x7ff21408f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff2140a0110 0x7ff21408edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 --2- 10.20.193.51:0/3675150747 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff21409dac0 0x7ff21408e880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:04.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 >> 10.20.193.51:0/3675150747 conn(0x7ff2140a30c0 msgr2=0x7ff2140996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:04.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 shutdown_connections 2026-02-17T11:48:04.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:04.556+0000 7ff2198da640 1 -- 10.20.193.51:0/3675150747 wait complete. 2026-02-17T11:48:05.471 INFO:tasks.rados.rados.0.trial142.stdout:376: done (1 left) 2026-02-17T11:48:05.471 INFO:tasks.rados.rados.0.trial142.stdout:377: done (0 left) 2026-02-17T11:48:05.471 INFO:tasks.rados.rados.0.trial142.stdout:378: delete oid 27 current snap is 44 2026-02-17T11:48:05.474 INFO:tasks.rados.rados.0.trial142.stdout:378: done (0 left) 2026-02-17T11:48:05.474 INFO:tasks.rados.rados.0.trial142.stdout:379: write (excl) oid 48 current snap is 44 2026-02-17T11:48:05.474 INFO:tasks.rados.rados.0.trial142.stdout:379: seq_num 156 ranges {621892=465904,1712485=671711} 2026-02-17T11:48:05.478 INFO:tasks.rados.rados.0.trial142.stdout:379: writing trial14245205-48 from 621892 to 1087796 tid 1 2026-02-17T11:48:05.483 INFO:tasks.rados.rados.0.trial142.stdout:379: writing trial14245205-48 from 1712485 to 2384196 tid 2 2026-02-17T11:48:05.483 INFO:tasks.rados.rados.0.trial142.stdout:380: snap_remove snap 32 2026-02-17T11:48:06.479 INFO:tasks.rados.rados.0.trial142.stdout:380: done (1 left) 2026-02-17T11:48:06.480 INFO:tasks.rados.rados.0.trial142.stdout:381: read oid 47 snap -1 2026-02-17T11:48:06.480 INFO:tasks.rados.rados.0.trial142.stdout:381: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:06.480 INFO:tasks.rados.rados.0.trial142.stdout:382: write oid 37 current snap is 44 2026-02-17T11:48:06.480 INFO:tasks.rados.rados.0.trial142.stdout:382: seq_num 157 ranges {638699=541153,1770967=531722} 2026-02-17T11:48:06.483 INFO:tasks.rados.rados.0.trial142.stdout:382: writing trial14245205-37 from 638699 to 1179852 tid 1 2026-02-17T11:48:06.487 INFO:tasks.rados.rados.0.trial142.stdout:382: writing trial14245205-37 from 1770967 to 2302689 tid 2 2026-02-17T11:48:06.488 INFO:tasks.rados.rados.0.trial142.stdout:383: snap_remove snap 28 2026-02-17T11:48:07.483 INFO:tasks.rados.rados.0.trial142.stdout:383: done (3 left) 2026-02-17T11:48:07.483 INFO:tasks.rados.rados.0.trial142.stdout:384: write oid 45 current snap is 44 2026-02-17T11:48:07.483 INFO:tasks.rados.rados.0.trial142.stdout:379: finishing write tid 1 to trial14245205-48 2026-02-17T11:48:07.483 INFO:tasks.rados.rados.0.trial142.stdout:384: seq_num 158 ranges {655506=616402,1829449=675380} 2026-02-17T11:48:07.487 INFO:tasks.rados.rados.0.trial142.stdout:384: writing trial14245205-45 from 655506 to 1271908 tid 1 2026-02-17T11:48:07.492 INFO:tasks.rados.rados.0.trial142.stdout:384: writing trial14245205-45 from 1829449 to 2504829 tid 2 2026-02-17T11:48:07.492 INFO:tasks.rados.rados.0.trial142.stdout:385: write oid 41 current snap is 44 2026-02-17T11:48:07.492 INFO:tasks.rados.rados.0.trial142.stdout:385: seq_num 159 ranges {672313=691651,1887931=419038} 2026-02-17T11:48:07.497 INFO:tasks.rados.rados.0.trial142.stdout:385: writing trial14245205-41 from 672313 to 1363964 tid 1 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:385: writing trial14245205-41 from 1887931 to 2306969 tid 2 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:386: read oid 33 snap -1 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:386: expect deleted 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:387: write (excl) oid 1 current snap is 44 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:379: finishing write tid 2 to trial14245205-48 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:379: finishing write tid 3 to trial14245205-48 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:379: finishing write tid 4 to trial14245205-48 2026-02-17T11:48:07.502 INFO:tasks.rados.rados.0.trial142.stdout:379: oid 48 updating version 0 to 217 2026-02-17T11:48:07.503 INFO:tasks.rados.rados.0.trial142.stdout:379: oid 48 version 217 is already newer than 216 2026-02-17T11:48:07.503 INFO:tasks.rados.rados.0.trial142.stdout:379: oid 48 version 217 is already newer than 215 2026-02-17T11:48:07.503 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 217 (ObjNum 156 snap 44 seq_num 156) dirty exists 2026-02-17T11:48:07.503 INFO:tasks.rados.rados.0.trial142.stdout:379: left oid 48 (ObjNum 156 snap 44 seq_num 156) 2026-02-17T11:48:07.503 INFO:tasks.rados.rados.0.trial142.stdout:381: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:07.551 INFO:tasks.rados.rados.0.trial142.stdout:382: finishing write tid 1 to trial14245205-37 2026-02-17T11:48:07.551 INFO:tasks.rados.rados.0.trial142.stdout:387: seq_num 160 ranges {689120=483253,1946413=679049} 2026-02-17T11:48:07.555 INFO:tasks.rados.rados.0.trial142.stdout:387: writing trial14245205-1 from 689120 to 1172373 tid 1 2026-02-17T11:48:07.564 INFO:tasks.rados.rados.0.trial142.stdout:387: writing trial14245205-1 from 1946413 to 2625462 tid 2 2026-02-17T11:48:07.564 INFO:tasks.rados.rados.0.trial142.stdout:379: done (6 left) 2026-02-17T11:48:07.564 INFO:tasks.rados.rados.0.trial142.stdout:381: done (5 left) 2026-02-17T11:48:07.564 INFO:tasks.rados.rados.0.trial142.stdout:388: read oid 44 snap -1 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:388: expect deleted 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:389: copy_from oid 21 from oid 42 current snap is 44 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:382: finishing write tid 2 to trial14245205-37 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:382: finishing write tid 3 to trial14245205-37 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:382: finishing write tid 4 to trial14245205-37 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:382: oid 37 updating version 0 to 81 2026-02-17T11:48:07.565 INFO:tasks.rados.rados.0.trial142.stdout:382: oid 37 version 81 is already newer than 80 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:382: oid 37 updating version 81 to 82 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 82 (ObjNum 157 snap 44 seq_num 157) dirty exists 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:382: left oid 37 (ObjNum 157 snap 44 seq_num 157) 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:384: finishing write tid 1 to trial14245205-45 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:384: finishing write tid 2 to trial14245205-45 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:384: finishing write tid 3 to trial14245205-45 2026-02-17T11:48:07.566 INFO:tasks.rados.rados.0.trial142.stdout:384: finishing write tid 4 to trial14245205-45 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:384: oid 45 updating version 0 to 128 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:384: oid 45 version 128 is already newer than 127 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:384: oid 45 version 128 is already newer than 124 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 128 (ObjNum 158 snap 44 seq_num 158) dirty exists 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:384: left oid 45 (ObjNum 158 snap 44 seq_num 158) 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:385: finishing write tid 1 to trial14245205-41 2026-02-17T11:48:07.567 INFO:tasks.rados.rados.0.trial142.stdout:385: finishing write tid 2 to trial14245205-41 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: finishing write tid 3 to trial14245205-41 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: finishing write tid 4 to trial14245205-41 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: oid 41 updating version 0 to 210 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: oid 41 updating version 210 to 211 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: oid 41 version 211 is already newer than 209 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 211 (ObjNum 159 snap 44 seq_num 159) dirty exists 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:385: left oid 41 (ObjNum 159 snap 44 seq_num 159) 2026-02-17T11:48:07.568 INFO:tasks.rados.rados.0.trial142.stdout:387: finishing write tid 1 to trial14245205-1 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:382: done (6 left) 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:384: done (5 left) 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:385: done (4 left) 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:386: done (3 left) 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:390: copy_from oid 48 from oid 46 current snap is 44 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:391: read oid 32 snap -1 2026-02-17T11:48:07.569 INFO:tasks.rados.rados.0.trial142.stdout:391: expect deleted 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:392: snap_create 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: finishing write tid 2 to trial14245205-1 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: finishing write tid 3 to trial14245205-1 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: finishing write tid 4 to trial14245205-1 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: oid 1 updating version 0 to 88 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: oid 1 updating version 88 to 89 2026-02-17T11:48:07.570 INFO:tasks.rados.rados.0.trial142.stdout:387: oid 1 updating version 89 to 90 2026-02-17T11:48:07.571 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 90 (ObjNum 160 snap 44 seq_num 160) dirty exists 2026-02-17T11:48:07.571 INFO:tasks.rados.rados.0.trial142.stdout:387: left oid 1 (ObjNum 160 snap 44 seq_num 160) 2026-02-17T11:48:07.571 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:07.572 INFO:tasks.rados.rados.0.trial142.stdout:389: finishing copy_from racing read to trial14245205-21 2026-02-17T11:48:07.572 INFO:tasks.rados.rados.0.trial142.stdout:390: finishing copy_from racing read to trial14245205-48 2026-02-17T11:48:07.573 INFO:tasks.rados.rados.0.trial142.stdout:389: finishing copy_from to trial14245205-21 2026-02-17T11:48:07.573 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 185 (ObjNum 124 snap 32 seq_num 124) dirty exists 2026-02-17T11:48:07.573 INFO:tasks.rados.rados.0.trial142.stdout:390: finishing copy_from to trial14245205-48 2026-02-17T11:48:07.573 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 224 (ObjNum 143 snap 38 seq_num 143) dirty exists 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.639+0000 7f6effd33640 10 monclient: get_monmap_and_config 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.639+0000 7f6effd33640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.639+0000 7f6effd33640 10 monclient: monmap: 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:07.640608+0000 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:07.640608+0000 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:07.641 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 Processor -- start 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 -- start start 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient: init 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6ef80a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6ef809dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 0x7f6ef813d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-c con 0x7f6ef80a02e0 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef806e140 con 0x7f6ef809dac0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef809ce60 con 0x7f6ef80a3bb0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef809aed0 con 0x7f6ef80a02e0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6effd33640 10 monclient(hunting): authenticate will time out at 775.259349s 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efd2a7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6ef809dac0 0x7f6ef809fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46728/0 (socket says 10.20.193.51:46728) 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efd2a7640 1 -- 10.20.193.51:0/624916915 learned_addr learned my addr 10.20.193.51:0/624916915 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 0x7f6ef813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request con 0x7f6ef80a02e0 auth_method 0 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 msgr2=0x7f6ef813d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:48:07.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 msgr2=0x7f6ef813d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:07.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 0x7f6ef813d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:07.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.640+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 0x7f6ef813d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:07.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efd2a7640 1 -- 10.20.193.51:0/624916915 >> v1:10.20.193.51:6789/0 conn(0x7f6ef809dac0 legacy=0x7f6ef809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974647427 0 0) 0x7f6ef806e140 con 0x7f6ef809dac0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): _negotiate 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): my global_id is 34263 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee0003620 con 0x7f6ef809dac0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1600829690 0 0) 0x7f6ee0003620 con 0x7f6ef809dac0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 msgr2=0x7f6ef813d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 --2- 10.20.193.51:0/624916915 >> v2:10.20.193.142:3300/0 conn(0x7f6ef80a02e0 0x7f6ef813d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 >> v1:10.20.193.142:6789/0 conn(0x7f6ef80a3bb0 legacy=0x7f6ef809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efdaa8640 1 -- 10.20.193.51:0/624916915 >> v1:10.20.193.142:6789/0 conn(0x7f6ef80a3bb0 legacy=0x7f6ef809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef809a5c0 con 0x7f6ef809dac0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f6eec0031b0 con 0x7f6ef809dac0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: dump: 2026-02-17T11:48:07.645 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 >> v1:10.20.193.51:6789/0 conn(0x7f6ef809dac0 legacy=0x7f6ef809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0003c20 0x7f6ee0004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): picked mon.b con 0x7f6ee0003c20 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ee0004900 0x7f6ee0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): picked mon.c con 0x7f6ee0004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 0x7f6ee000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): picked mon.a con 0x7f6ee0009ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef809aed0 con 0x7f6ee0009ab0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee000c4c0 con 0x7f6ee0003c20 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee000c6c0 con 0x7f6ee0004900 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.642+0000 7f6efcaa6640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ee0004900 0x7f6ee0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 0x7f6ee000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): get_auth_request con 0x7f6ee0004900 auth_method 0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request con 0x7f6ee0009ab0 auth_method 0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0003c20 0x7f6ee0004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): get_auth_request con 0x7f6ee0003c20 auth_method 0 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efdaa8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_done global_id 34263 payload 293 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ee0004900 msgr2=0x7f6ee0004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ee0004900 0x7f6ee0004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0003c20 msgr2=0x7f6ee0004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0003c20 0x7f6ee0004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 monclient: found mon.a 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0003620 con 0x7f6ee0009ab0 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6effd33640 5 monclient: authenticate success, global_id 34263 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6effd33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:07.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.643+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 reap_dead start 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efe2a9640 1 -- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 msgr2=0x7f6ee000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 0x7f6ee000bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009fd0 tx=0x7f6ef402f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ee7bca8a49b764 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef403b070 con 0x7f6ee0009ab0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: dump: 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef4034730 con 0x7f6ee0009ab0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6effd33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 1 -- 10.20.193.51:0/624916915 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009bd0 con 0x7f6ee0009ab0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6effd33640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6effd33640 4 set_mon_vals no callback set 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.645+0000 7f6efcaa6640 10 monclient: dump: 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.648 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 10 monclient: shutdown 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 -- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 msgr2=0x7f6ee000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 0x7f6ee000bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009fd0 tx=0x7f6ef402f760 comp rx=0 tx=0).stop 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 -- 10.20.193.51:0/624916915 shutdown_connections 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 --2- 10.20.193.51:0/624916915 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ee0009ab0 0x7f6ee000bea0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 -- 10.20.193.51:0/624916915 >> 10.20.193.51:0/624916915 conn(0x7f6ef80a30c0 msgr2=0x7f6ef80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 -- 10.20.193.51:0/624916915 shutdown_connections 2026-02-17T11:48:07.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 1 -- 10.20.193.51:0/624916915 wait complete. 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.646+0000 7f6effd33640 10 monclient: monmap: 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 Processor -- start 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 -- start start 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient: init 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0009ab0 0x7f6ef8093f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-b con 0x7f6ee0009ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-c con 0x7f6ef80944d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 0x7f6ef81cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): picked mon.noname-a con 0x7f6ef81cf4a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef80a3f90 con 0x7f6ef81cf4a0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef809caa0 con 0x7f6ee0009ab0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef809f4c0 con 0x7f6ef80944d0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6effd33640 10 monclient(hunting): authenticate will time out at 775.266462s 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 0x7f6ef81cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37606/0 (socket says 10.20.193.51:37606) 2026-02-17T11:48:07.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 -- 10.20.193.51:0/2465517118 learned_addr learned my addr 10.20.193.51:0/2465517118 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): get_auth_request con 0x7f6ef80944d0 auth_method 0 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request con 0x7f6ef81cf4a0 auth_method 0 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient(hunting): handle_auth_done global_id 44198 payload 824 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 -- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0009ab0 msgr2=0x7f6ef8093f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0009ab0 0x7f6ef8093f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 -- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 msgr2=0x7f6ef81cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 0x7f6ef81cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 monclient: found mon.noname-c 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efd2a7640 1 -- 10.20.193.51:0/2465517118 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef8096510 con 0x7f6ef80944d0 2026-02-17T11:48:07.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.647+0000 7f6efe2a9640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 0x7f6ef81cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6efd2a7640 1 -- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 msgr2=0x7f6ef8094950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6efd2a7640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6eec003320 tx=0x7f6eec0077b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00fb40 con 0x7f6ef80944d0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: dump: 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec018070 con 0x7f6ef80944d0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 5 monclient: authenticate success, global_id 44198 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 10 monclient: _renew_subs 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef8097f20 con 0x7f6ef80944d0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0133f0 con 0x7f6ef80944d0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee7fff640 4 set_mon_vals no callback set 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6ee67fc640 10 monclient: dump: 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 10 monclient: _renew_subs 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.649+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef806cd60 con 0x7f6ef80944d0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6effd33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6effd33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6effd33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef809f7f0 con 0x7f6ef80944d0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6eec013590 con 0x7f6ef80944d0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.650+0000 7f6ee67fc640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 0x7f6ec80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.651+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(103..103 src has 47..103) ==== 4795+0+0 (secure 0 0 0) 0x7f6eec052540 con 0x7f6ef80944d0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.651+0000 7f6efdaa8640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 0x7f6ec80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.651+0000 7f6efdaa8640 10 monclient: get_auth_request con 0x7f6ec803dd10 auth_method 0 2026-02-17T11:48:07.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.653+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6eec012de0 con 0x7f6ef80944d0 2026-02-17T11:48:07.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.653+0000 7f6ee67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:07.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.653+0000 7f6ee67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:07.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.653+0000 7f6efdaa8640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 0x7f6ec80401d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8002410 tx=0x7f6ee8006a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6effd33640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:07.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6effd33640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:07.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6effd33640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6ef80008d0 con 0x7f6ef80944d0 2026-02-17T11:48:07.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6ee67fc640 1 -- 10.20.193.51:0/2465517118 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f6eec01cc70 con 0x7f6ef80944d0 2026-02-17T11:48:07.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6ee67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:07.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.767+0000 7f6ee67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:07.770 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:07.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 msgr2=0x7f6ec80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 0x7f6ec80401d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8002410 tx=0x7f6ee8006a10 comp rx=0 tx=0).stop 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 10 monclient: shutdown 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 msgr2=0x7f6ef8094950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6eec003320 tx=0x7f6eec0077b0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 shutdown_connections 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6ec803dd10 0x7f6ec80401d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6ef81cf4a0 0x7f6ef81cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6ef80944d0 0x7f6ef8094950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 --2- 10.20.193.51:0/2465517118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6ee0009ab0 0x7f6ef8093f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 >> 10.20.193.51:0/2465517118 conn(0x7f6ef80a30c0 msgr2=0x7f6ef8073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:07.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 shutdown_connections 2026-02-17T11:48:07.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.768+0000 7f6effd33640 1 -- 10.20.193.51:0/2465517118 wait complete. 2026-02-17T11:48:07.778 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:48:07.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:48:07.778 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:48:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: get_monmap_and_config 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: monmap: 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:07.848235+0000 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:07.848235+0000 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 Processor -- start 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 -- start start 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: init 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd5040a3bb0 0x7fd50409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-a con 0x7fd5040a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:07.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd5040a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd50413b760 0x7fd50413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-c con 0x7fd50413b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50406e140 con 0x7fd5040a0750 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd50409f910 con 0x7fd5040a3bb0 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd50409ccd0 con 0x7fd50413b760 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.847+0000 7fd509f61640 10 monclient(hunting): authenticate will time out at 775.466971s 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd5040a3bb0 0x7fd50409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd5040a3bb0 0x7fd50409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51260/0 (socket says 10.20.193.51:51260) 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 -- 10.20.193.51:0/3903033204 learned_addr learned my addr 10.20.193.51:0/3903033204 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): get_auth_request con 0x7fd5040a3bb0 auth_method 0 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd503fff640 1 --2- 10.20.193.51:0/3903033204 >> v2:10.20.193.142:3300/0 conn(0x7fd50413b760 0x7fd50413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd503fff640 10 monclient(hunting): get_auth_request con 0x7fd50413b760 auth_method 0 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd503fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd503fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient(hunting): handle_auth_done global_id 34269 payload 274 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 -- 10.20.193.51:0/3903033204 >> v2:10.20.193.142:3300/0 conn(0x7fd50413b760 msgr2=0x7fd50413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 --2- 10.20.193.51:0/3903033204 >> v2:10.20.193.142:3300/0 conn(0x7fd50413b760 0x7fd50413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 -- 10.20.193.51:0/3903033204 >> v1:10.20.193.142:6789/0 conn(0x7fd5040a0750 legacy=0x7fd50409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd502ffd640 1 -- 10.20.193.51:0/3903033204 >> v1:10.20.193.142:6789/0 conn(0x7fd5040a0750 legacy=0x7fd50409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd502ffd640 1 -- 10.20.193.51:0/3903033204 >> v1:10.20.193.142:6789/0 conn(0x7fd5040a0750 legacy=0x7fd50409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd502ffd640 1 --1- 10.20.193.51:0/3903033204 >> v1:10.20.193.142:6789/0 conn(0x7fd5040a0750 0x7fd50409e000 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 monclient: found mon.noname-a 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.848+0000 7fd5037fe640 1 -- 10.20.193.51:0/3903033204 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50409eec0 con 0x7fd5040a3bb0 2026-02-17T11:48:07.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5037fe640 1 -- 10.20.193.51:0/3903033204 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 msgr2=0x7fd50409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5037fe640 1 --2- 10.20.193.51:0/3903033204 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd50409dac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd50409f5f0 tx=0x7fd4f002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3185038e6145a8c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 1 -- 10.20.193.51:0/3903033204 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f003c070 con 0x7fd5040a3bb0 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: dump: 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.867 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 1 -- 10.20.193.51:0/3903033204 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f002fca0 con 0x7fd5040a3bb0 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd509f61640 5 monclient: authenticate success, global_id 34269 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd509f61640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 1 -- 10.20.193.51:0/3903033204 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0037660 con 0x7fd5040a3bb0 2026-02-17T11:48:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd509f61640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd509f61640 4 set_mon_vals no callback set 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.850+0000 7fd5027fc640 10 monclient: dump: 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 10 monclient: shutdown 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- 10.20.193.51:0/3903033204 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 msgr2=0x7fd50409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 --2- 10.20.193.51:0/3903033204 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd50409dac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd50409f5f0 tx=0x7fd4f002ee60 comp rx=0 tx=0).stop 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- 10.20.193.51:0/3903033204 shutdown_connections 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 --2- 10.20.193.51:0/3903033204 >> v2:10.20.193.142:3300/0 conn(0x7fd50413b760 0x7fd50413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 --2- 10.20.193.51:0/3903033204 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd50409dac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- 10.20.193.51:0/3903033204 >> 10.20.193.51:0/3903033204 conn(0x7fd5040a30c0 msgr2=0x7fd5040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- 10.20.193.51:0/3903033204 shutdown_connections 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- 10.20.193.51:0/3903033204 wait complete. 2026-02-17T11:48:07.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 10 monclient: monmap: 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 Processor -- start 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 1 -- start start 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.851+0000 7fd509f61640 10 monclient: init 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5040a0750 0x7fd504131240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-b con 0x7fd5040a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd504131780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-a con 0x7fd5040a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 0x7fd504131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): picked mon.noname-c con 0x7fd50413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040a04b0 con 0x7fd5040a3bb0 2026-02-17T11:48:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd50409c850 con 0x7fd5040a0750 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd50409e710 con 0x7fd50413b760 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd509f61640 10 monclient(hunting): authenticate will time out at 775.471095s 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd504131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 0x7fd504131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd504131780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51266/0 (socket says 10.20.193.51:51266) 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 1 -- 10.20.193.51:0/1637687987 learned_addr learned my addr 10.20.193.51:0/1637687987 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): get_auth_request con 0x7fd50413b760 auth_method 0 2026-02-17T11:48:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): get_auth_request con 0x7fd5040a3bb0 auth_method 0 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd5037fe640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5040a0750 0x7fd504131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd5037fe640 10 monclient(hunting): get_auth_request con 0x7fd5040a0750 auth_method 0 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd5037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd5037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd5037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient(hunting): handle_auth_done global_id 44201 payload 824 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5040a0750 msgr2=0x7fd504131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5040a0750 0x7fd504131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 msgr2=0x7fd504131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd504131780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 monclient: found mon.noname-c 2026-02-17T11:48:07.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd504133380 con 0x7fd50413b760 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.852+0000 7fd502ffd640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd5040a3bb0 0x7fd504131780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 msgr2=0x7fd504131cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd503fff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 0x7fd504131cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007d10 tx=0x7fd4f800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8003a90 con 0x7fd50413b760 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: dump: 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f8003c50 con 0x7fd50413b760 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 5 monclient: authenticate success, global_id 44201 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 10 monclient: _renew_subs 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50409d7b0 con 0x7fd50413b760 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8004020 con 0x7fd50413b760 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd501ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd4dffff640 10 monclient: dump: 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 10 monclient: _renew_subs 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.854+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd504134f20 con 0x7fd50413b760 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd4f8004200 con 0x7fd50413b760 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd509f61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd509f61640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 0x7fd50412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040a27b0 con 0x7fd50412d690 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 0x7fd50412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient: get_auth_request con 0x7fd50412d690 auth_method 0 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd4dffff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd4d403dd40 0x7fd4d4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(103..103 src has 47..103) ==== 4795+0+0 (secure 0 0 0) 0x7fd4f80529e0 con 0x7fd50413b760 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 10 monclient(hunting): handle_auth_done global_id 34275 payload 824 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd5037fe640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5040a2260 con 0x7fd50412d690 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd502ffd640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd4d403dd40 0x7fd4d4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.855+0000 7fd502ffd640 10 monclient: get_auth_request con 0x7fd4d403dd40 auth_method 0 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.857+0000 7fd5037fe640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 msgr2=0x7fd50412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.857+0000 7fd5037fe640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 0x7fd50412da70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd50406f3c0 tx=0x7fd4f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0047070 con 0x7fd50412d690 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 10 monclient: dump: 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd4f002fe50 con 0x7fd50412d690 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 msgr2=0x7fd50412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 0x7fd50412da70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd50406f3c0 tx=0x7fd4f00047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 msgr2=0x7fd50412da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd4dffff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412d690 0x7fd50412da70 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd50406f3c0 tx=0x7fd4f00047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.858+0000 7fd502ffd640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd4d403dd40 0x7fd4d4040200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5041382b0 tx=0x7fd4f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd509f61640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd509f61640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 0x7fd5041d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd509f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd504134d60 con 0x7fd50412dfb0 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 0x7fd5041d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient: get_auth_request con 0x7fd50412dfb0 auth_method 0 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 10 monclient(hunting): handle_auth_done global_id 34278 payload 824 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.861+0000 7fd5037fe640 1 -- 10.20.193.51:0/1637687987 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd50409dac0 con 0x7fd50412dfb0 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd5037fe640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 msgr2=0x7fd5041d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd5037fe640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 0x7fd5041d98b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd504077e80 tx=0x7fd4f0009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f003c040 con 0x7fd50412dfb0 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd4dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd4dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.863+0000 7fd4dffff640 10 monclient: dump: 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fd4f0043670 con 0x7fd50412dfb0 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 msgr2=0x7fd5041d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 0x7fd5041d98b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd504077e80 tx=0x7fd4f0009340 comp rx=0 tx=0).stop 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 msgr2=0x7fd5041d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:07.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd4dffff640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd50412dfb0 0x7fd5041d98b0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd504077e80 tx=0x7fd4f0009340 comp rx=0 tx=0).stop 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 108508, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:48:07.886 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:07.887 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:07.888 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:07.889 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:07.890 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:07.891 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:07.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:07.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:07.894 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.895 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:07.896 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:07.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd4d403dd40 msgr2=0x7fd4d4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd4d403dd40 0x7fd4d4040200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5041382b0 tx=0x7fd4f4009040 comp rx=0 tx=0).stop 2026-02-17T11:48:07.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 10 monclient: shutdown 2026-02-17T11:48:07.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 msgr2=0x7fd504131cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 --2- 10.20.193.51:0/1637687987 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd50413b760 0x7fd504131cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007d10 tx=0x7fd4f800e4b0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 reap_dead start 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd503fff640 1 -- 10.20.193.51:0/1637687987 reap_dead start 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 shutdown_connections 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 >> 10.20.193.51:0/1637687987 conn(0x7fd5040a30c0 msgr2=0x7fd504139fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 shutdown_connections 2026-02-17T11:48:07.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.864+0000 7fd509f61640 1 -- 10.20.193.51:0/1637687987 wait complete. 2026-02-17T11:48:07.898 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:07.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:48:07.898 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:48:07.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 10 monclient: get_monmap_and_config 2026-02-17T11:48:07.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 10 monclient: monmap: 2026-02-17T11:48:07.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:07.963329+0000 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:07.963329+0000 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:07.979 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 1 Processor -- start 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 1 -- start start 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 10 monclient: init 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.962+0000 7ff9c5b11640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-17T11:48:07.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-c con 0x7ff9c00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff9c00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff9c013b760 0x7ff9c013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-a con 0x7ff9c013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c006e140 con 0x7ff9c00a0750 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c009f910 con 0x7ff9c013b760 2026-02-17T11:48:07.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c009ccd0 con 0x7ff9c00a3bb0 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9c5b11640 10 monclient(hunting): authenticate will time out at 775.582179s 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9beffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff9c00a0750 0x7ff9c009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46744/0 (socket says 10.20.193.51:46744) 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9beffd640 1 -- 10.20.193.51:0/2284961367 learned_addr learned my addr 10.20.193.51:0/2284961367 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.51:3300/0 conn(0x7ff9c013b760 0x7ff9c013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): get_auth_request con 0x7ff9c013b760 auth_method 0 2026-02-17T11:48:07.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request con 0x7ff9c00a3bb0 auth_method 0 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 msgr2=0x7ff9c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 msgr2=0x7ff9c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient(hunting): handle_auth_done global_id 34281 payload 274 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 -- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 msgr2=0x7ff9c009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:07.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 -- 10.20.193.51:0/2284961367 >> v1:10.20.193.51:6789/0 conn(0x7ff9c00a0750 legacy=0x7ff9c009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 monclient: found mon.noname-a 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.963+0000 7ff9bffff640 1 -- 10.20.193.51:0/2284961367 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c009eec0 con 0x7ff9c013b760 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9bffff640 1 -- 10.20.193.51:0/2284961367 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 msgr2=0x7ff9c013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9bffff640 1 --2- 10.20.193.51:0/2284961367 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c013db50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9c006c1c0 tx=0x7ff9b402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d0b384463270d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 1 -- 10.20.193.51:0/2284961367 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b403c070 con 0x7ff9c013b760 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: dump: 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:07.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 1 -- 10.20.193.51:0/2284961367 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4037440 con 0x7ff9c013b760 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 1 -- 10.20.193.51:0/2284961367 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4037810 con 0x7ff9c013b760 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 5 monclient: authenticate success, global_id 34281 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 4 set_mon_vals no callback set 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9be7fc640 10 monclient: dump: 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 10 monclient: shutdown 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 -- 10.20.193.51:0/2284961367 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 msgr2=0x7ff9c013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/2284961367 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c013db50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9c006c1c0 tx=0x7ff9b402f130 comp rx=0 tx=0).stop 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 -- 10.20.193.51:0/2284961367 shutdown_connections 2026-02-17T11:48:07.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/2284961367 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c013db50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/2284961367 >> v2:10.20.193.142:3300/0 conn(0x7ff9c00a3bb0 0x7ff9c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 -- 10.20.193.51:0/2284961367 >> 10.20.193.51:0/2284961367 conn(0x7ff9c00a30c0 msgr2=0x7ff9c00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 -- 10.20.193.51:0/2284961367 shutdown_connections 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.966+0000 7ff9c5b11640 1 -- 10.20.193.51:0/2284961367 wait complete. 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient: build_initial_monmap 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient: monmap: 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:07.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:07.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 Processor -- start 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 -- start start 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient: init 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9c00a0750 0x7ff9c013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-b con 0x7ff9c00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c00a3bb0 0x7ff9c013aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-c con 0x7ff9c00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:07.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): picked mon.noname-a con 0x7ff9c013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00a04b0 con 0x7ff9c013b760 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c009c850 con 0x7ff9c00a0750 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c009e710 con 0x7ff9c00a3bb0 2026-02-17T11:48:07.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9c5b11640 10 monclient(hunting): authenticate will time out at 775.586655s 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c00a3bb0 0x7ff9c013aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51300/0 (socket says 10.20.193.51:51300) 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 learned_addr learned my addr 10.20.193.51:0/4066303896 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): get_auth_request con 0x7ff9c013b760 auth_method 0 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): get_auth_request con 0x7ff9c00a3bb0 auth_method 0 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:07.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9beffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9c00a0750 0x7ff9c013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request con 0x7ff9c00a0750 auth_method 0 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient(hunting): handle_auth_done global_id 34284 payload 824 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c00a3bb0 msgr2=0x7ff9c013aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c00a3bb0 0x7ff9c013aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9c00a0750 msgr2=0x7ff9c013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff9c00a0750 0x7ff9c013a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 monclient: found mon.noname-a 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.967+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c00a2400 con 0x7ff9c013b760 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 msgr2=0x7ff9c0096f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bffff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b402f640 tx=0x7ff9b4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b403c040 con 0x7ff9c013b760 2026-02-17T11:48:07.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: dump: 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:07.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: _finish_auth 0 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4048070 con 0x7ff9c013b760 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40375f0 con 0x7ff9c013b760 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bdffb640 4 set_mon_vals no callback set 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 10 monclient: dump: 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.001 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 5 monclient: authenticate success, global_id 34284 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 monclient: _renew_subs 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0098b60 con 0x7ff9c013b760 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 monclient: _renew_subs 2026-02-17T11:48:08.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c0098340 con 0x7ff9c013b760 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 0x7ff9c0091900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c009dac0 con 0x7ff9c009a7f0 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff9b4037790 con 0x7ff9c013b760 2026-02-17T11:48:08.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 0x7ff9c0091900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient: get_auth_request con 0x7ff9c009a7f0 auth_method 0 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff99003dd60 0x7ff990040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_done global_id 44207 payload 824 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(103..103 src has 47..103) ==== 4795+0+0 (secure 0 0 0) 0x7ff9b4077fd0 con 0x7ff9c013b760 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.970+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9c0099440 con 0x7ff9c009a7f0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.971+0000 7ff9beffd640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff99003dd60 0x7ff990040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.971+0000 7ff9beffd640 10 monclient: get_auth_request con 0x7ff99003dd60 auth_method 0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 msgr2=0x7ff9c0091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 0x7ff9c0091900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00f780 tx=0x7ff9ac00fc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac019070 con 0x7ff9c009a7f0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:08.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 10 monclient: dump: 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff9ac00dbc0 con 0x7ff9c009a7f0 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 msgr2=0x7ff9c0091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 0x7ff9c0091900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00f780 tx=0x7ff9ac00fc50 comp rx=0 tx=0).stop 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 msgr2=0x7ff9c0091900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.973+0000 7ff99bfff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c009a7f0 0x7ff9c0091900 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00f780 tx=0x7ff9ac00fc50 comp rx=0 tx=0).stop 2026-02-17T11:48:08.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.974+0000 7ff9beffd640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff99003dd60 0x7ff990040220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007d90 tx=0x7ff9b0007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.976+0000 7ff9c5b11640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:08.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.976+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 0x7ff9c01da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.976+0000 7ff9c5b11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.976+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c009abd0 con 0x7ff9c0091e40 2026-02-17T11:48:08.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 0x7ff9c01da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient: get_auth_request con 0x7ff9c0091e40 auth_method 0 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 10 monclient(hunting): handle_auth_done global_id 44210 payload 824 2026-02-17T11:48:08.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.977+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/4066303896 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9c00008d0 con 0x7ff9c0091e40 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9bf7fe640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 msgr2=0x7ff9c01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9bf7fe640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 0x7ff9c01da8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01b000 tx=0x7ff9ac004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac003230 con 0x7ff9c0091e40 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 10 monclient: dump: 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7ff9ac003230 con 0x7ff9c0091e40 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 msgr2=0x7ff9c01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 0x7ff9c01da8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01b000 tx=0x7ff9ac004830 comp rx=0 tx=0).stop 2026-02-17T11:48:08.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 msgr2=0x7ff9c01da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff99bfff640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff9c0091e40 0x7ff9c01da8c0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01b000 tx=0x7ff9ac004830 comp rx=0 tx=0).stop 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:08.015 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 59451, 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:08.016 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:08.017 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.018 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.019 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:08.020 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff99003dd60 msgr2=0x7ff990040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff99003dd60 0x7ff990040220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007d90 tx=0x7ff9b0007ce0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 10 monclient: shutdown 2026-02-17T11:48:08.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 msgr2=0x7ff9c0096f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b402f640 tx=0x7ff9b4004b40 comp rx=0 tx=0).stop 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9bffff640 1 -- 10.20.193.51:0/4066303896 reap_dead start 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 shutdown_connections 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 --2- 10.20.193.51:0/4066303896 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff9c013b760 0x7ff9c0096f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 >> 10.20.193.51:0/4066303896 conn(0x7ff9c00a30c0 msgr2=0x7ff9c00a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 shutdown_connections 2026-02-17T11:48:08.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:07.979+0000 7ff9c5b11640 1 -- 10.20.193.51:0/4066303896 wait complete. 2026-02-17T11:48:08.022 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:08.022 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:48:08.022 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:48:08.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: get_monmap_and_config 2026-02-17T11:48:08.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: build_initial_monmap 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: monmap: 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:08.087090+0000 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:08.087090+0000 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:08.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 1 Processor -- start 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 1 -- start start 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: init 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.086+0000 7fd7cdc4c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-b con 0x7fd7c8138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 0x7fd7c80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-c con 0x7fd7c80a35a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7c80a58a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c80a1df0 con 0x7fd7c80a58a0 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c80a6830 con 0x7fd7c80a35a0 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80a2c00 con 0x7fd7c8138600 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7cdc4c640 10 monclient(hunting): authenticate will time out at 775.706045s 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37656/0 (socket says 10.20.193.51:37656) 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 -- 10.20.193.51:0/2574614701 learned_addr learned my addr 10.20.193.51:0/2574614701 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): get_auth_request con 0x7fd7c8138600 auth_method 0 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_done global_id 44213 payload 274 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/2574614701 >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 0x7fd7c80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 -- 10.20.193.51:0/2574614701 >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 msgr2=0x7fd7c80a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 --2- 10.20.193.51:0/2574614701 >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 0x7fd7c80a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 -- 10.20.193.51:0/2574614701 >> v1:10.20.193.51:6789/0 conn(0x7fd7c80a58a0 legacy=0x7fd7c813f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 monclient: found mon.noname-b 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c77fe640 1 -- 10.20.193.51:0/2574614701 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c8138f20 con 0x7fd7c8138600 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c80a35a0 auth_method 0 2026-02-17T11:48:08.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.087+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/2574614701 >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 0x7fd7c80a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:08.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c77fe640 1 -- 10.20.193.51:0/2574614701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 msgr2=0x7fd7c81389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:08.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c77fe640 1 --2- 10.20.193.51:0/2574614701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009970 tx=0x7fd7b402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ccb59be21c0fa1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 1 -- 10.20.193.51:0/2574614701 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b403c070 con 0x7fd7c8138600 2026-02-17T11:48:08.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: dump: 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7cdc4c640 5 monclient: authenticate success, global_id 44213 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7cdc4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 1 -- 10.20.193.51:0/2574614701 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b402fdb0 con 0x7fd7c8138600 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 1 -- 10.20.193.51:0/2574614701 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4037660 con 0x7fd7c8138600 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7cdc4c640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7cdc4c640 4 set_mon_vals no callback set 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.089+0000 7fd7c67fc640 10 monclient: dump: 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: shutdown 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/2574614701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 msgr2=0x7fd7c81389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/2574614701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009970 tx=0x7fd7b402ee90 comp rx=0 tx=0).stop 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/2574614701 shutdown_connections 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/2574614701 >> v2:10.20.193.142:3300/0 conn(0x7fd7c80a35a0 0x7fd7c80a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/2574614701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c8138600 0x7fd7c81389e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/2574614701 >> 10.20.193.51:0/2574614701 conn(0x7fd7c80a7460 msgr2=0x7fd7c80a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/2574614701 shutdown_connections 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/2574614701 wait complete. 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: build_initial_monmap 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: monmap: 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 Processor -- start 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- start start 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: init 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-c con 0x7fd7c80a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c80a58a0 0x7fd7c8136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-b con 0x7fd7c80a58a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7c8138600 0x7fd7c8124180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): picked mon.noname-a con 0x7fd7c8138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80a25b0 con 0x7fd7c8138600 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80a22d0 con 0x7fd7c80a58a0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80a15f0 con 0x7fd7c80a35a0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7cdc4c640 10 monclient(hunting): authenticate will time out at 775.709966s 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.090+0000 7fd7c77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37662/0 (socket says 10.20.193.51:37662) 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 -- 10.20.193.51:0/1419528592 learned_addr learned my addr 10.20.193.51:0/1419528592 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): get_auth_request con 0x7fd7c80a35a0 auth_method 0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7c8138600 0x7fd7c8124180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): get_auth_request con 0x7fd7c8138600 auth_method 0 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c80a58a0 0x7fd7c8136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient(hunting): handle_auth_done global_id 44216 payload 824 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c80a58a0 msgr2=0x7fd7c8136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c80a58a0 0x7fd7c8136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7c8138600 msgr2=0x7fd7c8124180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7c8138600 0x7fd7c8124180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 monclient: found mon.noname-c 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c77fe640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c8138010 con 0x7fd7c80a35a0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c80a58a0 auth_method 0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.091+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c80a58a0 0x7fd7c8136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7c77fe640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 msgr2=0x7fd7c81cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7c77fe640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40090b0 tx=0x7fd7b4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b403c050 con 0x7fd7c80a35a0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: dump: 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.098 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: _finish_auth 0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b4048070 con 0x7fd7c80a35a0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 5 monclient: authenticate success, global_id 44216 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4041a90 con 0x7fd7c80a35a0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7a3fff640 10 monclient: dump: 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7c5ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 10 monclient: _renew_subs 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c80a1ae0 con 0x7fd7c80a35a0 2026-02-17T11:48:08.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 10 monclient: _renew_subs 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.093+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c81d0200 con 0x7fd7c80a35a0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd7b4041c30 con 0x7fd7c80a35a0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7cdc4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80a5360 con 0x7fd7c8136c50 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7a3fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 0x7fd798040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(103..103 src has 47..103) ==== 4795+0+0 (secure 0 0 0) 0x7fd7b4077ce0 con 0x7fd7c80a35a0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8136c50 auth_method 0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c7fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 0x7fd798040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.094+0000 7fd7c7fff640 10 monclient: get_auth_request con 0x7fd79803dd60 auth_method 0 2026-02-17T11:48:08.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.097+0000 7fd7c7fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 0x7fd798040220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00f2e0 tx=0x7fd7bc0042b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8136c50 auth_method 0 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:08.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.295+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:08.486 INFO:tasks.rados.rados.0.trial142.stdout:387: done (5 left) 2026-02-17T11:48:08.486 INFO:tasks.rados.rados.0.trial142.stdout:388: done (4 left) 2026-02-17T11:48:08.486 INFO:tasks.rados.rados.0.trial142.stdout:389: done (3 left) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:390: done (2 left) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:391: done (1 left) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:392: done (0 left) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:393: read oid 16 snap -1 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:393: expect (ObjNum 129 snap 32 seq_num 129) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:394: read oid 36 snap 42 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:394: expect (ObjNum 81 snap 15 seq_num 81) 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:395: write (excl) oid 38 current snap is 45 2026-02-17T11:48:08.487 INFO:tasks.rados.rados.0.trial142.stdout:395: seq_num 161 ranges {705927=558502,2004895=422707} 2026-02-17T11:48:08.490 INFO:tasks.rados.rados.0.trial142.stdout:395: writing trial14245205-38 from 705927 to 1264429 tid 1 2026-02-17T11:48:08.495 INFO:tasks.rados.rados.0.trial142.stdout:395: writing trial14245205-38 from 2004895 to 2427602 tid 2 2026-02-17T11:48:08.495 INFO:tasks.rados.rados.0.trial142.stdout:396: snap_remove snap 36 2026-02-17T11:48:08.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:08.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8136c50 auth_method 0 2026-02-17T11:48:08.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:08.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:08.696+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:48:09.370 INFO:tasks.rados.rados.0.trial142.stdout:396: done (3 left) 2026-02-17T11:48:09.370 INFO:tasks.rados.rados.0.trial142.stdout:397: read oid 26 snap 43 2026-02-17T11:48:09.370 INFO:tasks.rados.rados.0.trial142.stdout:397: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:48:09.370 INFO:tasks.rados.rados.0.trial142.stdout:398: snap_create 2026-02-17T11:48:09.370 INFO:tasks.rados.rados.0.trial142.stdout:394: expect (ObjNum 81 snap 15 seq_num 81) 2026-02-17T11:48:09.485 INFO:tasks.rados.rados.0.trial142.stdout:393: expect (ObjNum 129 snap 32 seq_num 129) 2026-02-17T11:48:09.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:09.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8136c50 auth_method 0 2026-02-17T11:48:09.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:09.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:09.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:09.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:48:09.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:09.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:09.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:09.497+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:48:09.572 INFO:tasks.rados.rados.0.trial142.stdout:395: finishing write tid 1 to trial14245205-38 2026-02-17T11:48:09.572 INFO:tasks.rados.rados.0.trial142.stdout:395: finishing write tid 2 to trial14245205-38 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: finishing write tid 3 to trial14245205-38 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: finishing write tid 4 to trial14245205-38 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: oid 38 updating version 0 to 31 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: oid 38 updating version 31 to 33 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: oid 38 version 33 is already newer than 32 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 33 (ObjNum 161 snap 45 seq_num 161) dirty exists 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:395: left oid 38 (ObjNum 161 snap 45 seq_num 161) 2026-02-17T11:48:09.573 INFO:tasks.rados.rados.0.trial142.stdout:397: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:48:10.370 INFO:tasks.rados.rados.0.trial142.stdout:393: done (4 left) 2026-02-17T11:48:10.370 INFO:tasks.rados.rados.0.trial142.stdout:394: done (3 left) 2026-02-17T11:48:10.370 INFO:tasks.rados.rados.0.trial142.stdout:395: done (2 left) 2026-02-17T11:48:10.371 INFO:tasks.rados.rados.0.trial142.stdout:397: done (1 left) 2026-02-17T11:48:10.371 INFO:tasks.rados.rados.0.trial142.stdout:398: done (0 left) 2026-02-17T11:48:10.371 INFO:tasks.rados.rados.0.trial142.stdout:399: snap_create 2026-02-17T11:48:11.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.091+0000 7fd7a2ffd640 10 monclient: tick 2026-02-17T11:48:11.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.091+0000 7fd7a2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:11.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.091+0000 7fd7a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:11.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.091+0000 7fd7a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8136c50 auth_method 0 2026-02-17T11:48:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:48:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:11.099+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:48:11.819 INFO:tasks.rados.rados.0.trial142.stdout:399: done (0 left) 2026-02-17T11:48:11.819 INFO:tasks.rados.rados.0.trial142.stdout:400: write (excl) oid 16 current snap is 47 2026-02-17T11:48:11.820 INFO:tasks.rados.rados.0.trial142.stdout:400: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-17T11:48:11.824 INFO:tasks.rados.rados.0.trial142.stdout:400: writing trial14245205-16 from 722734 to 1356485 tid 1 2026-02-17T11:48:11.829 INFO:tasks.rados.rados.0.trial142.stdout:400: writing trial14245205-16 from 2063377 to 2722734 tid 2 2026-02-17T11:48:11.829 INFO:tasks.rados.rados.0.trial142.stdout:401: snap_remove snap 39 2026-02-17T11:48:11.830 INFO:tasks.rados.rados.0.trial142.stdout:400: finishing write tid 1 to trial14245205-16 2026-02-17T11:48:12.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 10 monclient: tick 2026-02-17T11:48:12.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:12.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:12.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:48:12.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 0x7fd794005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 msgr2=0x7fd7c8127d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8136c50 0x7fd7c8127d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7a2ffd640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80a5360 con 0x7fd794003640 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 0x7fd794005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd794003640 auth_method 0 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:12.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_done global_id 54100 payload 824 2026-02-17T11:48:12.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.091+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7940061b0 con 0x7fd794003640 2026-02-17T11:48:12.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 msgr2=0x7fd794005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:12.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 0x7fd794005ad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81ccec0 tx=0x7fd7b8015790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800be10 con 0x7fd794003640 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 10 monclient: dump: 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.098 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd7b800be10 con 0x7fd794003640 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 msgr2=0x7fd794005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 0x7fd794005ad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81ccec0 tx=0x7fd7b8015790 comp rx=0 tx=0).stop 2026-02-17T11:48:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 msgr2=0x7fd794005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:12.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.094+0000 7fd7a3fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd794003640 0x7fd794005ad0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81ccec0 tx=0x7fd7b8015790 comp rx=0 tx=0).stop 2026-02-17T11:48:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.097+0000 7fd7cdc4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.097+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 0x7fd7c81da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.097+0000 7fd7cdc4c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.097+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8069780 con 0x7fd7c8072570 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 0x7fd7c81da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient: get_auth_request con 0x7fd7c8072570 auth_method 0 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 10 monclient(hunting): handle_auth_done global_id 54103 payload 824 2026-02-17T11:48:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.098+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd7c8126aa0 con 0x7fd7c8072570 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7c6ffd640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 msgr2=0x7fd7c81da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7c6ffd640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 0x7fd7c81da6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81ccec0 tx=0x7fd7b8006f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b802e070 con 0x7fd7c8072570 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.100+0000 7fd7a3fff640 10 monclient: dump: 2026-02-17T11:48:12.104 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fd7b8003030 con 0x7fd7c8072570 2026-02-17T11:48:12.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 msgr2=0x7fd7c81da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 0x7fd7c81da6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81ccec0 tx=0x7fd7b8006f90 comp rx=0 tx=0).stop 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 msgr2=0x7fd7c81da6b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7a3fff640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7c8072570 0x7fd7c81da6b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7c7fff640 1 -- 10.20.193.51:0/1419528592 reap_dead start 2026-02-17T11:48:12.106 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10890, 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:12.107 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:12.108 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:12.109 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:12.110 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:12.111 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:12.112 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:12.113 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:12.114 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:12.115 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:12.116 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.117 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.118 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.120 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.121 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:12.122 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:12.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 msgr2=0x7fd798040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 0x7fd798040220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00f2e0 tx=0x7fd7bc0042b0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 10 monclient: shutdown 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 msgr2=0x7fd7c81cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40090b0 tx=0x7fd7b4004830 comp rx=0 tx=0).stop 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 shutdown_connections 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79803dd60 0x7fd798040220 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 --2- 10.20.193.51:0/1419528592 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7c80a35a0 0x7fd7c81cf300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 >> 10.20.193.51:0/1419528592 conn(0x7fd7c80a7460 msgr2=0x7fd7c806fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:12.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 shutdown_connections 2026-02-17T11:48:12.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.101+0000 7fd7cdc4c640 1 -- 10.20.193.51:0/1419528592 wait complete. 2026-02-17T11:48:12.126 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:12.126 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:48:12.126 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:48:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.190+0000 7f3cd19f5640 10 monclient: get_monmap_and_config 2026-02-17T11:48:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.190+0000 7f3cd19f5640 10 monclient: build_initial_monmap 2026-02-17T11:48:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.190+0000 7f3cd19f5640 10 monclient: monmap: 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:12.191653+0000 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:12.191653+0000 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:12.193 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:12.194 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:12.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 Processor -- start 2026-02-17T11:48:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 -- start start 2026-02-17T11:48:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient: init 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3ccc0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3ccc09dac0 0x7f3ccc09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-a con 0x7f3ccc09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3ccc0a0110 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ccc06e140 con 0x7f3ccc0a3bb0 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ccc09ce60 con 0x7f3ccc0a0110 2026-02-17T11:48:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3ccc09aed0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cd19f5640 10 monclient(hunting): authenticate will time out at 779.810496s 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3ccc09dac0 0x7f3ccc09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3ccaffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3ccc0a3bb0 0x7f3ccc09f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46760/0 (socket says 10.20.193.51:46760) 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3ccaffd640 1 -- 10.20.193.51:0/1104359472 learned_addr learned my addr 10.20.193.51:0/1104359472 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): get_auth_request con 0x7f3ccc09dac0 auth_method 0 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_done global_id 34290 payload 274 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 1 -- 10.20.193.51:0/1104359472 >> v1:10.20.193.142:6789/0 conn(0x7f3ccc0a0110 legacy=0x7f3ccc13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 1 -- 10.20.193.51:0/1104359472 >> v1:10.20.193.51:6789/0 conn(0x7f3ccc0a3bb0 legacy=0x7f3ccc09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 1 monclient: found mon.noname-a 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.191+0000 7f3cca7fc640 1 -- 10.20.193.51:0/1104359472 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc09a5c0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cca7fc640 1 -- 10.20.193.51:0/1104359472 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 msgr2=0x7f3ccc09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cca7fc640 1 --2- 10.20.193.51:0/1104359472 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc09fbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098a0 tx=0x7f3cb402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b871b55980c4d58 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 1 -- 10.20.193.51:0/1104359472 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb403c070 con 0x7f3ccc09dac0 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: dump: 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 1 -- 10.20.193.51:0/1104359472 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb402fce0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 1 -- 10.20.193.51:0/1104359472 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4037660 con 0x7f3ccc09dac0 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 5 monclient: authenticate success, global_id 34290 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 4 set_mon_vals no callback set 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cc9ffb640 10 monclient: dump: 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 10 monclient: shutdown 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 -- 10.20.193.51:0/1104359472 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 msgr2=0x7f3ccc09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/1104359472 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc09fbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098a0 tx=0x7f3cb402ed80 comp rx=0 tx=0).stop 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 -- 10.20.193.51:0/1104359472 shutdown_connections 2026-02-17T11:48:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/1104359472 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc09fbd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 -- 10.20.193.51:0/1104359472 >> 10.20.193.51:0/1104359472 conn(0x7f3ccc0a30c0 msgr2=0x7f3ccc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 -- 10.20.193.51:0/1104359472 shutdown_connections 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.194+0000 7f3cd19f5640 1 -- 10.20.193.51:0/1104359472 wait complete. 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient: build_initial_monmap 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient: monmap: 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:12.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 Processor -- start 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 -- start start 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient: init 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:48:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-a con 0x7f3ccc09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ccc0a0110 0x7f3ccc099e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-c con 0x7f3ccc0a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ccc0a3bb0 0x7f3ccc094530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): picked mon.noname-b con 0x7f3ccc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc0a3f90 con 0x7f3ccc09dac0 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc09caa0 con 0x7f3ccc0a3bb0 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc0a0540 con 0x7f3ccc0a0110 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cd19f5640 10 monclient(hunting): authenticate will time out at 779.814886s 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51326/0 (socket says 10.20.193.51:51326) 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 1 -- 10.20.193.51:0/2991188770 learned_addr learned my addr 10.20.193.51:0/2991188770 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): get_auth_request con 0x7f3ccc09dac0 auth_method 0 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cca7fc640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ccc0a0110 0x7f3ccc099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cca7fc640 10 monclient(hunting): get_auth_request con 0x7f3ccc0a0110 auth_method 0 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3cca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.195+0000 7f3ccaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3cca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 10 monclient(hunting): handle_auth_done global_id 34293 payload 824 2026-02-17T11:48:12.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 -- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ccc0a0110 msgr2=0x7f3ccc099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ccc0a0110 0x7f3ccc099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 -- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ccc0a3bb0 msgr2=0x7f3ccc094530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ccc0a3bb0 0x7f3ccc094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 monclient: found mon.noname-a 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.196+0000 7f3ccaffd640 1 -- 10.20.193.51:0/2991188770 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc09d7b0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ccaffd640 1 -- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 msgr2=0x7f3ccc099950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ccaffd640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000c750 tx=0x7f3cc000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:12.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0005de0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: dump: 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.216 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: _finish_auth 0 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc0007070 con 0x7f3ccc09dac0 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0007440 con 0x7f3ccc09dac0 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 5 monclient: authenticate success, global_id 34293 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:12.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cc97fa640 4 set_mon_vals no callback set 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3ca3fff640 10 monclient: dump: 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:12.218 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _renew_subs 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc097e60 con 0x7f3ccc09dac0 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _renew_subs 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc0a2a30 con 0x7f3ccc09dac0 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.198+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc09eee0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.199+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3cc0007620 con 0x7f3ccc09dac0 2026-02-17T11:48:12.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.199+0000 7f3ca3fff640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 0x7f3c9c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:12.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.199+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(107..107 src has 47..107) ==== 4767+0+0 (secure 0 0 0) 0x7f3cc0052380 con 0x7f3ccc09dac0 2026-02-17T11:48:12.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.199+0000 7f3cca7fc640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 0x7f3c9c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:12.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.199+0000 7f3cca7fc640 10 monclient: get_auth_request con 0x7f3c9c03dd10 auth_method 0 2026-02-17T11:48:12.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.201+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3ccc09d7b0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.201+0000 7f3ca3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:12.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.201+0000 7f3ca3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:12.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.201+0000 7f3cca7fc640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 0x7f3c9c0401d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc06c1c0 tx=0x7f3cb4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3cd19f5640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3cd19f5640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3cd19f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3ccc09f4c0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3ca3fff640 1 -- 10.20.193.51:0/2991188770 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3cc000a8d0 con 0x7f3ccc09dac0 2026-02-17T11:48:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3ca3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:48:12.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.315+0000 7f3ca3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=1432662458,config=692619927,health=2157093694,kv=1415544013,logm=23994270}) 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=2832587141,config=692619927,health=1524676307,kv=643764953,logm=1627047028}) 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=1432662458,config=692619927,health=2157093694,kv=1415544013,logm=23994270}) 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.315+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=1,health=11,kv=11,logm=65} crc {auth=2832587141,config=3678701417,health=1886805112,kv=4179589687,logm=3007992583}) 2026-02-17T11:48:12.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=939849361}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2503448681}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=939849361}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2067904408}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190841146}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=421810590}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190841146}) 2026-02-17T11:48:12.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.316+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=432336698}) 2026-02-17T11:48:12.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 msgr2=0x7f3c9c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 0x7f3c9c0401d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc06c1c0 tx=0x7f3cb4033000 comp rx=0 tx=0).stop 2026-02-17T11:48:12.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 10 monclient: shutdown 2026-02-17T11:48:12.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 msgr2=0x7f3ccc099950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000c750 tx=0x7f3cc000cc20 comp rx=0 tx=0).stop 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 shutdown_connections 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3c9c03dd10 0x7f3c9c0401d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3ccc0a3bb0 0x7f3ccc094530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3ccc0a0110 0x7f3ccc099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 --2- 10.20.193.51:0/2991188770 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3ccc09dac0 0x7f3ccc099950 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 >> 10.20.193.51:0/2991188770 conn(0x7f3ccc0a30c0 msgr2=0x7f3ccc073960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 shutdown_connections 2026-02-17T11:48:12.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:12.316+0000 7f3cd19f5640 1 -- 10.20.193.51:0/2991188770 wait complete. 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40573018}) 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1813281447}) 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40573018}) 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=700450985}) 2026-02-17T11:48:12.324 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136931903}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1973910539}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136931903}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.317+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1448297777}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2740664552}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=45158408}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2740664552}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3151983084}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1548523193}) 2026-02-17T11:48:12.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4169355134}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1548523193}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3448946522}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2467182705}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3550702000}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2467182705}) 2026-02-17T11:48:12.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.318+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4191336173}) 2026-02-17T11:48:12.327 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:48:12.819 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.820 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=34,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=7} crc {logm=1166185940,mdsmap=3207544932,mgr=1312948032,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2430531469,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1214128274,osd_snap=2982027580,osdmap=1227859654}) 2026-02-17T11:48:12.820 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=35,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=7} crc {logm=2066842526,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=357317749,mon_config_key=4138928500,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1214128274,osd_snap=3106258406,osdmap=1227859654}) 2026-02-17T11:48:12.820 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.820 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=34,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=7} crc {logm=1166185940,mdsmap=3207544932,mgr=1312948032,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2430531469,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1214128274,osd_snap=2982027580,osdmap=1227859654}) 2026-02-17T11:48:12.820 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.817+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=15,osdmap=10} crc {logm=3828826092,mdsmap=4128456003,mgr=2119775468,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=575886,mon_config_key=2316896916,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1214128274,osd_snap=2635010156,osdmap=2783080339}) 2026-02-17T11:48:12.821 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=1362456918}) 2026-02-17T11:48:12.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=95} crc {osdmap=3200174006}) 2026-02-17T11:48:12.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:48:12.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=1362456918}) 2026-02-17T11:48:12.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:48:12.819+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=96} crc {osdmap=1181820673}) 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:401: done (1 left) 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:402: rollback oid 45 current snap is 47 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 42 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: finishing write tid 2 to trial14245205-16 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: finishing write tid 3 to trial14245205-16 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: finishing write tid 4 to trial14245205-16 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: oid 16 updating version 0 to 131 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: oid 16 version 131 is already newer than 130 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: oid 16 version 131 is already newer than 129 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 131 (ObjNum 162 snap 47 seq_num 162) dirty exists 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: left oid 16 (ObjNum 162 snap 47 seq_num 162) 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:400: done (1 left) 2026-02-17T11:48:12.931 INFO:tasks.rados.rados.0.trial142.stdout:403: delete oid 15 current snap is 47 2026-02-17T11:48:12.934 INFO:tasks.rados.rados.0.trial142.stdout:403: done (1 left) 2026-02-17T11:48:12.934 INFO:tasks.rados.rados.0.trial142.stdout:404: snap_remove snap 44 2026-02-17T11:48:13.328 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:48:13.329 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:13.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.393+0000 7f53c44e8640 10 monclient: get_monmap_and_config 2026-02-17T11:48:13.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.393+0000 7f53c44e8640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.393+0000 7f53c44e8640 10 monclient: monmap: 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:13.394794+0000 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:13.394794+0000 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:13.399 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 Processor -- start 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 -- start start 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient: init 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f53bc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53bc09dac0 0x7f53bc09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-a con 0x7f53bc09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:13.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 0x7f53bc13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-c con 0x7f53bc0a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53bc06e140 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f53bc09aed0 con 0x7f53bc09dac0 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f53bc09caa0 con 0x7f53bc0a0110 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c44e8640 10 monclient(hunting): authenticate will time out at 781.013544s 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53bc09dac0 0x7f53bc09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53bc09dac0 0x7f53bc09fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51334/0 (socket says 10.20.193.51:51334) 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 -- 10.20.193.51:0/1249493142 learned_addr learned my addr 10.20.193.51:0/1249493142 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): get_auth_request con 0x7f53bc09dac0 auth_method 0 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c2a5e640 1 --2- 10.20.193.51:0/1249493142 >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 0x7f53bc13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient(hunting): handle_auth_done global_id 34296 payload 274 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 -- 10.20.193.51:0/1249493142 >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 msgr2=0x7f53bc13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 --2- 10.20.193.51:0/1249493142 >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 0x7f53bc13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 -- 10.20.193.51:0/1249493142 >> v1:10.20.193.142:6789/0 conn(0x7f53bc0a3bb0 legacy=0x7f53bc09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c1a5c640 1 -- 10.20.193.51:0/1249493142 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc09ce60 con 0x7f53bc09dac0 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c2a5e640 10 monclient: get_auth_request con 0x7f53bc0a0110 auth_method 0 2026-02-17T11:48:13.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.394+0000 7f53c2a5e640 1 --2- 10.20.193.51:0/1249493142 >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 0x7f53bc13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:13.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c1a5c640 1 -- 10.20.193.51:0/1249493142 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc09dac0 msgr2=0x7f53bc09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c1a5c640 1 --2- 10.20.193.51:0/1249493142 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc09dac0 0x7f53bc09fbd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f53bc09cc20 tx=0x7f53b002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1391e56f50c0d20 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 1 -- 10.20.193.51:0/1249493142 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b003c070 con 0x7f53bc09dac0 2026-02-17T11:48:13.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: dump: 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 1 -- 10.20.193.51:0/1249493142 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b002fd70 con 0x7f53bc09dac0 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 5 monclient: authenticate success, global_id 34296 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 1 -- 10.20.193.51:0/1249493142 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0037660 con 0x7f53bc09dac0 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:13.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 4 set_mon_vals no callback set 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c125b640 10 monclient: dump: 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.415 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 10 monclient: shutdown 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 -- 10.20.193.51:0/1249493142 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc09dac0 msgr2=0x7f53bc09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1249493142 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc09dac0 0x7f53bc09fbd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f53bc09cc20 tx=0x7f53b002ee10 comp rx=0 tx=0).stop 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 -- 10.20.193.51:0/1249493142 shutdown_connections 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1249493142 >> v2:10.20.193.142:3300/0 conn(0x7f53bc0a0110 0x7f53bc13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1249493142 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc09dac0 0x7f53bc09fbd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 -- 10.20.193.51:0/1249493142 >> 10.20.193.51:0/1249493142 conn(0x7f53bc0a30c0 msgr2=0x7f53bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 -- 10.20.193.51:0/1249493142 shutdown_connections 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.397+0000 7f53c44e8640 1 -- 10.20.193.51:0/1249493142 wait complete. 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient: monmap: 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.417 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 Processor -- start 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 -- start start 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient: init 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53bc09dac0 0x7f53bc1ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-c con 0x7f53bc09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53bc0a0110 0x7f53bc099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-b con 0x7f53bc0a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): picked mon.noname-a con 0x7f53bc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc0a0540 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc09a880 con 0x7f53bc0a0110 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc13cca0 con 0x7f53bc09dac0 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c44e8640 10 monclient(hunting): authenticate will time out at 781.017672s 2026-02-17T11:48:13.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51350/0 (socket says 10.20.193.51:51350) 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53bc09dac0 0x7f53bc1ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 -- 10.20.193.51:0/1353309324 learned_addr learned my addr 10.20.193.51:0/1353309324 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): get_auth_request con 0x7f53bc0a3bb0 auth_method 0 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): get_auth_request con 0x7f53bc09dac0 auth_method 0 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c225d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c1a5c640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53bc0a0110 0x7f53bc099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c1a5c640 10 monclient(hunting): get_auth_request con 0x7f53bc0a0110 auth_method 0 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c1a5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c1a5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c1a5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient(hunting): handle_auth_done global_id 34299 payload 824 2026-02-17T11:48:13.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 -- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53bc09dac0 msgr2=0x7f53bc1ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53bc09dac0 0x7f53bc1ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 -- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53bc0a0110 msgr2=0x7f53bc099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53bc0a0110 0x7f53bc099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.398+0000 7f53c2a5e640 1 -- 10.20.193.51:0/1353309324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc098040 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c2a5e640 1 -- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 msgr2=0x7f53bc099d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c2a5e640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ce40 tx=0x7f53b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b801a070 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: dump: 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b800da50 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b800de40 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 5 monclient: authenticate success, global_id 34299 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _renew_subs 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c0a5a640 4 set_mon_vals no callback set 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc1cf2d0 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 10 monclient: dump: 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _renew_subs 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc09e530 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53bc096080 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f53b801e3b0 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 0x7f538c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.401+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f53b8053100 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.402+0000 7f53c225d640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 0x7f538c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.402+0000 7f53c225d640 10 monclient: get_auth_request con 0x7f538c03dd10 auth_method 0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.404+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f53b801eba0 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.404+0000 7f53a2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.404+0000 7f53a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:13.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.404+0000 7f53c225d640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 0x7f538c0401d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005160 tx=0x7f53ac007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53c44e8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53c44e8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53c44e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f53bc09d7b0 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53a2ffd640 1 -- 10.20.193.51:0/1353309324 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f53b8014cc0 con 0x7f53bc0a3bb0 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53a2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.517+0000 7f53a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:13.519 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 msgr2=0x7f538c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 0x7f538c0401d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005160 tx=0x7f53ac007f30 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 10 monclient: shutdown 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 msgr2=0x7f53bc099d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ce40 tx=0x7f53b800a710 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 shutdown_connections 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f538c03dd10 0x7f538c0401d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53bc0a3bb0 0x7f53bc099d70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53bc0a0110 0x7f53bc099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 --2- 10.20.193.51:0/1353309324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53bc09dac0 0x7f53bc1ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 >> 10.20.193.51:0/1353309324 conn(0x7f53bc0a30c0 msgr2=0x7f53bc073550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 shutdown_connections 2026-02-17T11:48:13.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.518+0000 7f53c44e8640 1 -- 10.20.193.51:0/1353309324 wait complete. 2026-02-17T11:48:13.527 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:48:13.527 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:48:13.527 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:48:13.527 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 10 monclient: get_monmap_and_config 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 10 monclient: monmap: 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:13.594499+0000 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:13.594499+0000 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.595 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 1 Processor -- start 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 1 -- start start 2026-02-17T11:48:13.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.593+0000 7f7ac12e8640 10 monclient: init 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7abc0a3bb0 0x7f7abc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-a con 0x7f7abc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7abc0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7abc13b760 0x7f7abc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-c con 0x7f7abc13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7abc06e140 con 0x7f7abc0a0750 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc09f910 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc09ccd0 con 0x7f7abc13b760 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7ac12e8640 10 monclient(hunting): authenticate will time out at 781.213232s 2026-02-17T11:48:13.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7abc0a3bb0 0x7f7abc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7abc0a3bb0 0x7f7abc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51366/0 (socket says 10.20.193.51:51366) 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 -- 10.20.193.51:0/2369897898 learned_addr learned my addr 10.20.193.51:0/2369897898 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): get_auth_request con 0x7f7abc0a3bb0 auth_method 0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abb7fe640 1 --2- 10.20.193.51:0/2369897898 >> v2:10.20.193.142:3300/0 conn(0x7f7abc13b760 0x7f7abc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abb7fe640 10 monclient(hunting): get_auth_request con 0x7f7abc13b760 auth_method 0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient(hunting): handle_auth_done global_id 34302 payload 274 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 -- 10.20.193.51:0/2369897898 >> v2:10.20.193.142:3300/0 conn(0x7f7abc13b760 msgr2=0x7f7abc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 --2- 10.20.193.51:0/2369897898 >> v2:10.20.193.142:3300/0 conn(0x7f7abc13b760 0x7f7abc13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 -- 10.20.193.51:0/2369897898 >> v1:10.20.193.142:6789/0 conn(0x7f7abc0a0750 legacy=0x7f7abc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.594+0000 7f7abaffd640 1 -- 10.20.193.51:0/2369897898 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc09eec0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7abaffd640 1 -- 10.20.193.51:0/2369897898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 msgr2=0x7f7abc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7abaffd640 1 --2- 10.20.193.51:0/2369897898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc09dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7abc09f5f0 tx=0x7f7ab002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5371838835203b26 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 1 -- 10.20.193.51:0/2369897898 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003c070 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: dump: 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.605 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 1 -- 10.20.193.51:0/2369897898 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab002fca0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 5 monclient: authenticate success, global_id 34302 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 1 -- 10.20.193.51:0/2369897898 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0037660 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 4 set_mon_vals no callback set 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ab9ffb640 10 monclient: dump: 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 10 monclient: shutdown 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 -- 10.20.193.51:0/2369897898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 msgr2=0x7f7abc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/2369897898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc09dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7abc09f5f0 tx=0x7f7ab002ee60 comp rx=0 tx=0).stop 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 -- 10.20.193.51:0/2369897898 shutdown_connections 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/2369897898 >> v2:10.20.193.142:3300/0 conn(0x7f7abc13b760 0x7f7abc13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/2369897898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc09dac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 -- 10.20.193.51:0/2369897898 >> 10.20.193.51:0/2369897898 conn(0x7f7abc0a30c0 msgr2=0x7f7abc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 -- 10.20.193.51:0/2369897898 shutdown_connections 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.597+0000 7f7ac12e8640 1 -- 10.20.193.51:0/2369897898 wait complete. 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient: monmap: 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 Processor -- start 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 -- start start 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient: init 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7abc0a0750 0x7f7abc1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-b con 0x7f7abc0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-a con 0x7f7abc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7abc13b760 0x7f7abc096500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): picked mon.noname-c con 0x7f7abc13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc0a04b0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc09c850 con 0x7f7abc0a0750 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc09e710 con 0x7f7abc13b760 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7ac12e8640 10 monclient(hunting): authenticate will time out at 781.217568s 2026-02-17T11:48:13.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51378/0 (socket says 10.20.193.51:51378) 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 -- 10.20.193.51:0/3454187130 learned_addr learned my addr 10.20.193.51:0/3454187130 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): get_auth_request con 0x7f7abc0a3bb0 auth_method 0 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7abc13b760 0x7f7abc096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): get_auth_request con 0x7f7abc13b760 auth_method 0 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient(hunting): handle_auth_done global_id 34305 payload 824 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7abc0a0750 0x7f7abc1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7abc13b760 msgr2=0x7f7abc096500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7abc13b760 0x7f7abc096500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7abc0a0750 msgr2=0x7f7abc1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7abc0a0750 0x7f7abc1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7aba7fc640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc06f4a0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abaffd640 10 monclient: get_auth_request con 0x7f7abc0a0750 auth_method 0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.598+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7abc0a0750 0x7f7abc1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.600+0000 7f7aba7fc640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 msgr2=0x7f7abc1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.600+0000 7f7aba7fc640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c5d0 tx=0x7f7aa400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4016020 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: dump: 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.610 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4012a60 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4012e50 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ab97fa640 4 set_mon_vals no callback set 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 10 monclient: dump: 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 5 monclient: authenticate success, global_id 34305 2026-02-17T11:48:13.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 monclient: _renew_subs 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc09d7b0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 monclient: _renew_subs 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc099a10 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 0x7f7abc08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc06fe20 con 0x7f7abc097200 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 0x7f7abc08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient: get_auth_request con 0x7f7abc097200 auth_method 0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7aa401b400 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 10 monclient(hunting): handle_auth_done global_id 34308 payload 824 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.601+0000 7f7abaffd640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7abc09dac0 con 0x7f7abc097200 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.602+0000 7f7a9b7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a8803deb0 0x7f7a88040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.602+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f7aa40529d0 con 0x7f7abc0a3bb0 2026-02-17T11:48:13.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.602+0000 7f7abb7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a8803deb0 0x7f7a88040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.602+0000 7f7abb7fe640 10 monclient: get_auth_request con 0x7f7a8803deb0 auth_method 0 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7abaffd640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 msgr2=0x7f7abc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 0x7f7abc08d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06f3c0 tx=0x7f7ab0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003c040 con 0x7f7abc097200 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 10 monclient: dump: 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.614 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7ab002fe50 con 0x7f7abc097200 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 msgr2=0x7f7abc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 0x7f7abc08d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06f3c0 tx=0x7f7ab0004830 comp rx=0 tx=0).stop 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 msgr2=0x7f7abc08d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7a9b7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc097200 0x7f7abc08d3f0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06f3c0 tx=0x7f7ab0004830 comp rx=0 tx=0).stop 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.604+0000 7f7abb7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a8803deb0 0x7f7a88040370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7abc09c090 tx=0x7f7aac009770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7ac12e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 0x7f7abc1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7ac12e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc0a22a0 con 0x7f7abc0975e0 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 0x7f7abc1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient: get_auth_request con 0x7f7abc0975e0 auth_method 0 2026-02-17T11:48:13.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 10 monclient(hunting): handle_auth_done global_id 34311 payload 824 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.607+0000 7f7abaffd640 1 -- 10.20.193.51:0/3454187130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7abc099d80 con 0x7f7abc0975e0 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7abaffd640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 msgr2=0x7f7abc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7abaffd640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 0x7f7abc1daad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00090b0 tx=0x7f7ab00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003c040 con 0x7f7abc0975e0 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.609+0000 7f7a9b7fe640 10 monclient: dump: 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f7ab0003710 con 0x7f7abc0975e0 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 msgr2=0x7f7abc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 0x7f7abc1daad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00090b0 tx=0x7f7ab00047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 msgr2=0x7f7abc1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7a9b7fe640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0975e0 0x7f7abc1daad0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00090b0 tx=0x7f7ab00047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 114254, 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:13.617 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:13.619 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.625 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:13.625 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:13.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a8803deb0 msgr2=0x7f7a88040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a8803deb0 0x7f7a88040370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7abc09c090 tx=0x7f7aac009770 comp rx=0 tx=0).stop 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 10 monclient: shutdown 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 msgr2=0x7f7abc1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c5d0 tx=0x7f7aa400caa0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7abb7fe640 1 -- 10.20.193.51:0/3454187130 reap_dead start 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 shutdown_connections 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 --2- 10.20.193.51:0/3454187130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7abc0a3bb0 0x7f7abc1d0010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 >> 10.20.193.51:0/3454187130 conn(0x7f7abc0a30c0 msgr2=0x7f7abc13ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 shutdown_connections 2026-02-17T11:48:13.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.610+0000 7f7ac12e8640 1 -- 10.20.193.51:0/3454187130 wait complete. 2026-02-17T11:48:13.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:13.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:48:13.626 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 10 monclient: get_monmap_and_config 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 10 monclient: monmap: 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:13.692385+0000 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:13.692385+0000 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:13.693 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 1 Processor -- start 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 1 -- start start 2026-02-17T11:48:13.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.691+0000 7ff3a5832640 10 monclient: init 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-b con 0x7ff3a00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 0x7ff3a009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-a con 0x7ff3a00a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff3a009e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a006e140 con 0x7ff3a009e540 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a00a3f90 con 0x7ff3a00a0750 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a009f910 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff3a5832640 10 monclient(hunting): authenticate will time out at 781.311159s 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 0x7ff3a009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37702/0 (socket says 10.20.193.51:37702) 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 -- 10.20.193.51:0/3297522848 learned_addr learned my addr 10.20.193.51:0/3297522848 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): get_auth_request con 0x7ff3a00a3bb0 auth_method 0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): get_auth_request con 0x7ff3a00a0750 auth_method 0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient(hunting): handle_auth_done global_id 44228 payload 274 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 -- 10.20.193.51:0/3297522848 >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 msgr2=0x7ff3a009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 --2- 10.20.193.51:0/3297522848 >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 0x7ff3a009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 -- 10.20.193.51:0/3297522848 >> v1:10.20.193.142:6789/0 conn(0x7ff3a009e540 legacy=0x7ff3a013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 monclient: found mon.noname-b 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39effd640 1 -- 10.20.193.51:0/3297522848 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a009ccd0 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.692+0000 7ff39e7fc640 1 --2- 10.20.193.51:0/3297522848 >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 0x7ff3a009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.694+0000 7ff39effd640 1 -- 10.20.193.51:0/3297522848 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 msgr2=0x7ff3a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.694+0000 7ff39effd640 1 --2- 10.20.193.51:0/3297522848 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0069d60 tx=0x7ff39402ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f6d826fff82015 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 1 -- 10.20.193.51:0/3297522848 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39403c070 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: dump: 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 5 monclient: authenticate success, global_id 44228 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:13.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 1 -- 10.20.193.51:0/3297522848 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39402fcc0 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 1 -- 10.20.193.51:0/3297522848 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394037660 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 4 set_mon_vals no callback set 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff39dffb640 10 monclient: dump: 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 10 monclient: shutdown 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 -- 10.20.193.51:0/3297522848 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 msgr2=0x7ff3a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3297522848 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0069d60 tx=0x7ff39402ee80 comp rx=0 tx=0).stop 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 -- 10.20.193.51:0/3297522848 shutdown_connections 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3297522848 >> v2:10.20.193.51:3300/0 conn(0x7ff3a00a0750 0x7ff3a009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3297522848 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a009dac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 -- 10.20.193.51:0/3297522848 >> 10.20.193.51:0/3297522848 conn(0x7ff3a00a30c0 msgr2=0x7ff3a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 -- 10.20.193.51:0/3297522848 shutdown_connections 2026-02-17T11:48:13.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 1 -- 10.20.193.51:0/3297522848 wait complete. 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.695+0000 7ff3a5832640 10 monclient: monmap: 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 Processor -- start 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 -- start start 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient: init 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff3a009e540 0x7ff3a0099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-b con 0x7ff3a009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 0x7ff3a009a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-a con 0x7ff3a00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a008e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): picked mon.noname-c con 0x7ff3a00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00a04b0 con 0x7ff3a00a0750 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a009c850 con 0x7ff3a009e540 2026-02-17T11:48:13.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a013de80 con 0x7ff3a00a3bb0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff3a5832640 10 monclient(hunting): authenticate will time out at 781.315518s 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 0x7ff3a009a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a008e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 0x7ff3a009a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51418/0 (socket says 10.20.193.51:51418) 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 -- 10.20.193.51:0/3079849507 learned_addr learned my addr 10.20.193.51:0/3079849507 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): get_auth_request con 0x7ff3a00a0750 auth_method 0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): get_auth_request con 0x7ff3a00a3bb0 auth_method 0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39effd640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff3a009e540 0x7ff3a0099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39effd640 10 monclient(hunting): get_auth_request con 0x7ff3a009e540 auth_method 0 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient(hunting): handle_auth_done global_id 34317 payload 824 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 msgr2=0x7ff3a008e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a00a3bb0 0x7ff3a008e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff3a009e540 msgr2=0x7ff3a0099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff3a009e540 0x7ff3a0099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.696+0000 7ff39e7fc640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a0092160 con 0x7ff3a00a0750 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.698+0000 7ff39e7fc640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 msgr2=0x7ff3a009a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.698+0000 7ff39e7fc640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 0x7ff3a009a080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff38800ebb0 tx=0x7ff38800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.698+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388017070 con 0x7ff3a00a0750 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: dump: 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38800ce50 con 0x7ff3a00a0750 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 5 monclient: authenticate success, global_id 34317 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 monclient: _renew_subs 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a00905f0 con 0x7ff3a00a0750 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388013690 con 0x7ff3a00a0750 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39d7fa640 4 set_mon_vals no callback set 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 10 monclient: dump: 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.705 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 monclient: _renew_subs 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a006f960 con 0x7ff3a00a0750 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 0x7ff3a008efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a006f410 con 0x7ff3a008ebe0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 0x7ff3a008efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient: get_auth_request con 0x7ff3a008ebe0 auth_method 0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff388024060 con 0x7ff3a00a0750 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 10 monclient(hunting): handle_auth_done global_id 44234 payload 824 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff39effd640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3a009dac0 con 0x7ff3a008ebe0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff37003dd10 0x7ff3700401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.699+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7ff3880526b0 con 0x7ff3a00a0750 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.700+0000 7ff39f7fe640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff37003dd10 0x7ff3700401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.700+0000 7ff39f7fe640 10 monclient: get_auth_request con 0x7ff37003dd10 auth_method 0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.701+0000 7ff39effd640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 msgr2=0x7ff3a008efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.701+0000 7ff39effd640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 0x7ff3a008efc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3a009f230 tx=0x7ff394004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39403c040 con 0x7ff3a008ebe0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 10 monclient: dump: 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff394037d70 con 0x7ff3a008ebe0 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 msgr2=0x7ff3a008efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 0x7ff3a008efc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3a009f230 tx=0x7ff394004830 comp rx=0 tx=0).stop 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 msgr2=0x7ff3a008efc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff377fff640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008ebe0 0x7ff3a008efc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.702+0000 7ff39f7fe640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff37003dd10 0x7ff3700401d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3a01cde40 tx=0x7ff39000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff3a5832640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 0x7ff3a01d8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff3a5832640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a00008d0 con 0x7ff3a008f500 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 0x7ff3a01d8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient: get_auth_request con 0x7ff3a008f500 auth_method 0 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 10 monclient(hunting): handle_auth_done global_id 44237 payload 824 2026-02-17T11:48:13.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.705+0000 7ff39effd640 1 -- 10.20.193.51:0/3079849507 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff3a0050ac0 con 0x7ff3a008f500 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff39effd640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 msgr2=0x7ff3a01d8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff39effd640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 0x7ff3a01d8180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff394002410 tx=0x7ff3940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394052070 con 0x7ff3a008f500 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 10 monclient: dump: 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.709 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7ff39404c970 con 0x7ff3a008f500 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 msgr2=0x7ff3a01d8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 0x7ff3a01d8180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff394002410 tx=0x7ff3940047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 msgr2=0x7ff3a01d8180 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff377fff640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff3a008f500 0x7ff3a01d8180 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff394002410 tx=0x7ff3940047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:13.710 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 65180, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:13.711 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:13.712 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.713 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.714 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.715 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:13.716 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff37003dd10 msgr2=0x7ff3700401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff37003dd10 0x7ff3700401d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3a01cde40 tx=0x7ff39000d040 comp rx=0 tx=0).stop 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 10 monclient: shutdown 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 msgr2=0x7ff3a009a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 --2- 10.20.193.51:0/3079849507 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff3a00a0750 0x7ff3a009a080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff38800ebb0 tx=0x7ff38800c520 comp rx=0 tx=0).stop 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff39f7fe640 1 -- 10.20.193.51:0/3079849507 reap_dead start 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff39f7fe640 1 -- 10.20.193.51:0/3079849507 reap_dead start 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 shutdown_connections 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 >> 10.20.193.51:0/3079849507 conn(0x7ff3a00a30c0 msgr2=0x7ff3a0073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 shutdown_connections 2026-02-17T11:48:13.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.708+0000 7ff3a5832640 1 -- 10.20.193.51:0/3079849507 wait complete. 2026-02-17T11:48:13.717 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:13.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:48:13.718 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.790+0000 7fd9772c9640 10 monclient: get_monmap_and_config 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.790+0000 7fd9772c9640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.790+0000 7fd9772c9640 10 monclient: monmap: 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:13.791855+0000 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:13.791855+0000 2026-02-17T11:48:13.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 Processor -- start 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 -- start start 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient: init 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd9700a3bb0 0x7fd97009cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-c con 0x7fd9700a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd97009d270 0x7fd970138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd97009d270 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd970138a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd9701385b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd97009a5c0 con 0x7fd97009d270 2026-02-17T11:48:13.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd97009b520 con 0x7fd9700a3bb0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700a3f90 con 0x7fd9701385b0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd9772c9640 10 monclient(hunting): authenticate will time out at 781.410620s 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd97009d270 0x7fd970138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd970138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd97009d270 0x7fd970138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51424/0 (socket says 10.20.193.51:51424) 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 -- 10.20.193.51:0/3962456165 learned_addr learned my addr 10.20.193.51:0/3962456165 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): get_auth_request con 0x7fd97009d270 auth_method 0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): get_auth_request con 0x7fd9701385b0 auth_method 0 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97503e640 1 --2- 10.20.193.51:0/3962456165 >> v2:10.20.193.142:3300/0 conn(0x7fd9700a3bb0 0x7fd97009cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97503e640 10 monclient(hunting): get_auth_request con 0x7fd9700a3bb0 auth_method 0 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97503e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97503e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97503e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient(hunting): handle_auth_done global_id 34320 payload 274 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 -- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 msgr2=0x7fd970138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd970138a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 -- 10.20.193.51:0/3962456165 >> v2:10.20.193.142:3300/0 conn(0x7fd9700a3bb0 msgr2=0x7fd97009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 --2- 10.20.193.51:0/3962456165 >> v2:10.20.193.142:3300/0 conn(0x7fd9700a3bb0 0x7fd97009cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97483d640 1 -- 10.20.193.51:0/3962456165 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd970135430 con 0x7fd97009d270 2026-02-17T11:48:13.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.791+0000 7fd97583f640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd970138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd97483d640 1 -- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd97009d270 msgr2=0x7fd970138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd97483d640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd97009d270 0x7fd970138070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd97009b6a0 tx=0x7fd96402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5f4ea04cccb2f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 1 -- 10.20.193.51:0/3962456165 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96403c070 con 0x7fd97009d270 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: dump: 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.801 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 1 -- 10.20.193.51:0/3962456165 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96402fc90 con 0x7fd97009d270 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 5 monclient: authenticate success, global_id 34320 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 1 -- 10.20.193.51:0/3962456165 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964037660 con 0x7fd97009d270 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 4 set_mon_vals no callback set 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd95ffff640 10 monclient: dump: 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.802 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 10 monclient: shutdown 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 -- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd97009d270 msgr2=0x7fd970138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd97009d270 0x7fd970138070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd97009b6a0 tx=0x7fd96402ee10 comp rx=0 tx=0).stop 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 -- 10.20.193.51:0/3962456165 shutdown_connections 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd970138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 --2- 10.20.193.51:0/3962456165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd97009d270 0x7fd970138070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 --2- 10.20.193.51:0/3962456165 >> v2:10.20.193.142:3300/0 conn(0x7fd9700a3bb0 0x7fd97009cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 -- 10.20.193.51:0/3962456165 >> 10.20.193.51:0/3962456165 conn(0x7fd9700a30c0 msgr2=0x7fd9700a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 -- 10.20.193.51:0/3962456165 shutdown_connections 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.794+0000 7fd9772c9640 1 -- 10.20.193.51:0/3962456165 wait complete. 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient: monmap: 2026-02-17T11:48:13.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 Processor -- start 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 -- start start 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient: init 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd97009d270 0x7fd97009d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd97009d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd9700a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd97009e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): picked mon.noname-c con 0x7fd9701385b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd970074ac0 con 0x7fd9700a3bb0 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd97009b240 con 0x7fd97009d270 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd970135040 con 0x7fd9701385b0 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd9772c9640 10 monclient(hunting): authenticate will time out at 781.414839s 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51432/0 (socket says 10.20.193.51:51432) 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 1 -- 10.20.193.51:0/2563404344 learned_addr learned my addr 10.20.193.51:0/2563404344 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): get_auth_request con 0x7fd9700a3bb0 auth_method 0 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd97009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): get_auth_request con 0x7fd9701385b0 auth_method 0 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97483d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.795+0000 7fd97583f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 10 monclient(hunting): handle_auth_done global_id 34323 payload 824 2026-02-17T11:48:13.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 msgr2=0x7fd97009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9701385b0 0x7fd97009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd97009d270 msgr2=0x7fd97009d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd97009d270 0x7fd97009d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.796+0000 7fd97483d640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97012b680 con 0x7fd9700a3bb0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97483d640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 msgr2=0x7fd97009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97483d640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd964002410 tx=0x7fd964004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964047070 con 0x7fd9700a3bb0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: dump: 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96403f7b0 con 0x7fd9700a3bb0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 5 monclient: authenticate success, global_id 34323 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 monclient: _renew_subs 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97009f300 con 0x7fd9700a3bb0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96403c040 con 0x7fd9700a3bb0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 10 monclient: dump: 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95f7fe640 4 set_mon_vals no callback set 2026-02-17T11:48:13.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 monclient: _renew_subs 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97012bcd0 con 0x7fd9700a3bb0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 0x7fd9701cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd97009cd30 con 0x7fd9701cf270 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd964037ce0 con 0x7fd9700a3bb0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97503e640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 0x7fd9701cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97503e640 10 monclient: get_auth_request con 0x7fd9701cf270 auth_method 0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97503e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97503e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.798+0000 7fd97503e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd95dffb640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd94003dd10 0x7fd9400401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7fd964077010 con 0x7fd9700a3bb0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97503e640 10 monclient(hunting): handle_auth_done global_id 54118 payload 824 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97503e640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd970074db0 con 0x7fd9701cf270 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97583f640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd94003dd10 0x7fd9400401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.799+0000 7fd97583f640 10 monclient: get_auth_request con 0x7fd94003dd10 auth_method 0 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd97503e640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 msgr2=0x7fd9701cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd97503e640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 0x7fd9701cf650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd96000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960017070 con 0x7fd9701cf270 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 10 monclient: dump: 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd96000cb50 con 0x7fd9701cf270 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 msgr2=0x7fd9701cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 0x7fd9701cf650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd96000ec10 comp rx=0 tx=0).stop 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 msgr2=0x7fd9701cf650 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.801+0000 7fd95dffb640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cf270 0x7fd9701cf650 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd96000ec10 comp rx=0 tx=0).stop 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.802+0000 7fd97583f640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd94003dd10 0x7fd9400401d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd96c011420 tx=0x7fd96c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.804+0000 7fd9772c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.804+0000 7fd9772c9640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 0x7fd9701da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd9772c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd97009fe60 con 0x7fd9701cfb90 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 0x7fd9701da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient: get_auth_request con 0x7fd9701cfb90 auth_method 0 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 10 monclient(hunting): handle_auth_done global_id 54121 payload 824 2026-02-17T11:48:13.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.805+0000 7fd97503e640 1 -- 10.20.193.51:0/2563404344 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9700008d0 con 0x7fd9701cfb90 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd97503e640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 msgr2=0x7fd9701da5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd97503e640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 0x7fd9701da5c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd9600047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96000f040 con 0x7fd9701cfb90 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 10 monclient: dump: 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fd960003c10 con 0x7fd9701cfb90 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 msgr2=0x7fd9701da5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 0x7fd9701da5c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd9600047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 msgr2=0x7fd9701da5c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:13.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd95dffb640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd9701cfb90 0x7fd9701da5c0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e740 tx=0x7fd9600047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 22, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12597, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.813 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.814 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:13.815 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.816 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.817 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.818 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:13.819 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:13.820 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd94003dd10 msgr2=0x7fd9400401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd94003dd10 0x7fd9400401d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd96c011420 tx=0x7fd96c00b040 comp rx=0 tx=0).stop 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 10 monclient: shutdown 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 msgr2=0x7fd97009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd964002410 tx=0x7fd964004830 comp rx=0 tx=0).stop 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd97583f640 1 -- 10.20.193.51:0/2563404344 reap_dead start 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 shutdown_connections 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 --2- 10.20.193.51:0/2563404344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9700a3bb0 0x7fd97009dcf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 >> 10.20.193.51:0/2563404344 conn(0x7fd9700a30c0 msgr2=0x7fd97006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 shutdown_connections 2026-02-17T11:48:13.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.808+0000 7fd9772c9640 1 -- 10.20.193.51:0/2563404344 wait complete. 2026-02-17T11:48:13.821 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:13.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T11:48:13.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:48:13.822 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T11:48:13.822 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:48:13.822 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T11:48:13.822 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:48:13.834 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T11:48:13.835 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:48:13.835 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:13.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 10 monclient: get_monmap_and_config 2026-02-17T11:48:13.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 10 monclient: monmap: 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:13.902510+0000 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:13.902510+0000 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 1 Processor -- start 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 1 -- start start 2026-02-17T11:48:13.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.901+0000 7f9afacc7640 10 monclient: init 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9af40a3bb0 0x7f9af409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-a con 0x7f9af40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9af40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:13.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af413b760 0x7f9af413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-b con 0x7f9af413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af406e140 con 0x7f9af40a0750 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9af409f910 con 0x7f9af40a3bb0 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9af409ccd0 con 0x7f9af413b760 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9afacc7640 10 monclient(hunting): authenticate will time out at 781.521274s 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9af40a3bb0 0x7f9af409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9af40a3bb0 0x7f9af409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51444/0 (socket says 10.20.193.51:51444) 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af413b760 0x7f9af413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 -- 10.20.193.51:0/2206964344 learned_addr learned my addr 10.20.193.51:0/2206964344 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): get_auth_request con 0x7f9af40a3bb0 auth_method 0 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): get_auth_request con 0x7f9af413b760 auth_method 0 2026-02-17T11:48:13.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9aebfff640 1 -- 10.20.193.51:0/2206964344 >> v1:10.20.193.142:6789/0 conn(0x7f9af40a0750 legacy=0x7f9af409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af923d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_done global_id 34326 payload 274 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 -- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af413b760 msgr2=0x7f9af413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 --2- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af413b760 0x7f9af413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 -- 10.20.193.51:0/2206964344 >> v1:10.20.193.142:6789/0 conn(0x7f9af40a0750 legacy=0x7f9af409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.902+0000 7f9af8a3c640 1 -- 10.20.193.51:0/2206964344 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af409eec0 con 0x7f9af40a3bb0 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9af8a3c640 1 -- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a3bb0 msgr2=0x7f9af409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9af8a3c640 1 --2- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a3bb0 0x7f9af409dac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9af406c1c0 tx=0x7f9ae402ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8399cd51bec14e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 1 -- 10.20.193.51:0/2206964344 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae403c070 con 0x7f9af40a3bb0 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: dump: 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 1 -- 10.20.193.51:0/2206964344 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae402fcc0 con 0x7f9af40a3bb0 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 1 -- 10.20.193.51:0/2206964344 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4037660 con 0x7f9af40a3bb0 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9aeb7fe640 10 monclient: dump: 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 5 monclient: authenticate success, global_id 34326 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 4 set_mon_vals no callback set 2026-02-17T11:48:13.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 10 monclient: shutdown 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 -- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a3bb0 msgr2=0x7f9af409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 --2- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a3bb0 0x7f9af409dac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9af406c1c0 tx=0x7f9ae402ee80 comp rx=0 tx=0).stop 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 -- 10.20.193.51:0/2206964344 shutdown_connections 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 --2- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af413b760 0x7f9af413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 --2- 10.20.193.51:0/2206964344 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a3bb0 0x7f9af409dac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 -- 10.20.193.51:0/2206964344 >> 10.20.193.51:0/2206964344 conn(0x7f9af40a30c0 msgr2=0x7f9af40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 -- 10.20.193.51:0/2206964344 shutdown_connections 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 1 -- 10.20.193.51:0/2206964344 wait complete. 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 10 monclient: build_initial_monmap 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.905+0000 7f9afacc7640 10 monclient: monmap: 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:13.914 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 Processor -- start 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 -- start start 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient: init 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-a con 0x7f9af40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af40a3bb0 0x7f9af4095a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-c con 0x7f9af40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 0x7f9af4095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): picked mon.noname-b con 0x7f9af413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40a04b0 con 0x7f9af40a0750 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9af409c850 con 0x7f9af413b760 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9af409e710 con 0x7f9af40a3bb0 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9afacc7640 10 monclient(hunting): authenticate will time out at 781.525374s 2026-02-17T11:48:13.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:51454/0 (socket says 10.20.193.51:51454) 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 -- 10.20.193.51:0/4148579553 learned_addr learned my addr 10.20.193.51:0/4148579553 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): get_auth_request con 0x7f9af40a0750 auth_method 0 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af40a3bb0 0x7f9af4095a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af923d640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 msgr2=0x7f9af4095fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af923d640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 0x7f9af4095fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): get_auth_request con 0x7f9af40a3bb0 auth_method 0 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9aebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient(hunting): handle_auth_done global_id 34329 payload 824 2026-02-17T11:48:13.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af40a3bb0 msgr2=0x7f9af4095a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af40a3bb0 0x7f9af4095a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 msgr2=0x7f9af4095fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 0x7f9af4095fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient: _finish_hunting 0 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 monclient: found mon.noname-a 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.906+0000 7f9af8a3c640 1 -- 10.20.193.51:0/4148579553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40a2b60 con 0x7f9af40a0750 2026-02-17T11:48:13.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.908+0000 7f9af8a3c640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 msgr2=0x7f9af4095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:13.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.908+0000 7f9af8a3c640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009a70 tx=0x7f9ae40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:13.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.908+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:48:13.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4046020 con 0x7f9af40a0750 2026-02-17T11:48:13.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: dump: 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: _finish_auth 0 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4042640 con 0x7f9af40a0750 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 5 monclient: authenticate success, global_id 34329 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 10 monclient: _renew_subs 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af40989e0 con 0x7f9af40a0750 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:13.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae403c040 con 0x7f9af40a0750 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9aeaffd640 4 set_mon_vals no callback set 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9ae97fa640 10 monclient: dump: 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 10 monclient: _renew_subs 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.910+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4097150 con 0x7f9af40a0750 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9afacc7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9afacc7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9afacc7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af409dac0 con 0x7f9af40a0750 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9ae403f030 con 0x7f9af40a0750 2026-02-17T11:48:13.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9ae97fa640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 0x7f9ac40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.911+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f9ae40773f0 con 0x7f9af40a0750 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.912+0000 7f9aebfff640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 0x7f9ac40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.912+0000 7f9aebfff640 10 monclient: get_auth_request con 0x7f9ac403dd10 auth_method 0 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.914+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ae4050070 con 0x7f9af40a0750 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.914+0000 7f9ae97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.914+0000 7f9ae97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:13.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:13.914+0000 7f9aebfff640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 0x7f9ac40401d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009470 tx=0x7f9adc009400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9afacc7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9afacc7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9afacc7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9af40008d0 con 0x7f9af40a0750 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9ae97fa640 1 -- 10.20.193.51:0/4148579553 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f9af40a2b60 con 0x7f9af40a0750 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9ae97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.030+0000 7f9ae97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:14.032 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 msgr2=0x7f9ac40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 0x7f9ac40401d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009470 tx=0x7f9adc009400 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 10 monclient: shutdown 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 msgr2=0x7f9af4095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009a70 tx=0x7f9ae40047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 shutdown_connections 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ac403dd10 0x7f9ac40401d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9af413b760 0x7f9af4095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9af40a3bb0 0x7f9af4095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 --2- 10.20.193.51:0/4148579553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9af40a0750 0x7f9af4095520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 >> 10.20.193.51:0/4148579553 conn(0x7f9af40a30c0 msgr2=0x7f9af413adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 shutdown_connections 2026-02-17T11:48:14.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:14.031+0000 7f9afacc7640 1 -- 10.20.193.51:0/4148579553 wait complete. 2026-02-17T11:48:17.041 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:17.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: get_monmap_and_config 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: build_initial_monmap 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: monmap: 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:17.109987+0000 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:17.109987+0000 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.114 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 Processor -- start 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 -- start start 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: init 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T11:48:17.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f22980a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f229813d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): picked mon.noname-b con 0x7f229813b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f229813dcb0 0x7f22981400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): picked mon.noname-a con 0x7f229813dcb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2298135430 con 0x7f22980a3bb0 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f229809a5c0 con 0x7f229813dcb0 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f229809b520 con 0x7f229813b380 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f229deda640 10 monclient(hunting): authenticate will time out at 784.728757s 2026-02-17T11:48:17.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f22977fe640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f22980a3bb0 legacy=0x7f229809cd30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f229813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f229813dcb0 0x7f22981400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f229813d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57208/0 (socket says 10.20.193.51:57208) 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 1 -- 10.20.193.51:0/1932474858 learned_addr learned my addr 10.20.193.51:0/1932474858 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): get_auth_request con 0x7f229813b380 auth_method 0 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x7f229813dcb0 auth_method 0 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:17.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.109+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 34332 payload 274 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 1 -- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 msgr2=0x7f229813d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 1 --2- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f229813d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 1 -- 10.20.193.51:0/1932474858 >> v1:10.20.193.142:6789/0 conn(0x7f22980a3bb0 legacy=0x7f229809cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:17.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 1 monclient: found mon.noname-a 2026-02-17T11:48:17.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:17.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.110+0000 7f2297fff640 1 -- 10.20.193.51:0/1932474858 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229809af60 con 0x7f229813dcb0 2026-02-17T11:48:17.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f2297fff640 1 -- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 msgr2=0x7f22981400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f2297fff640 1 --2- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981400a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2298077290 tx=0x7f228c02f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba5762f697b544 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 1 -- 10.20.193.51:0/1932474858 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03c070 con 0x7f229813dcb0 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: dump: 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:17.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 5 monclient: authenticate success, global_id 34332 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 1 -- 10.20.193.51:0/1932474858 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c037440 con 0x7f229813dcb0 2026-02-17T11:48:17.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 1 -- 10.20.193.51:0/1932474858 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c037810 con 0x7f229813dcb0 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 4 set_mon_vals no callback set 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f22967fc640 10 monclient: dump: 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:17.128 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 10 monclient: shutdown 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 -- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 msgr2=0x7f22981400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 --2- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981400a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2298077290 tx=0x7f228c02f150 comp rx=0 tx=0).stop 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 -- 10.20.193.51:0/1932474858 shutdown_connections 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 --2- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981400a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 --2- 10.20.193.51:0/1932474858 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f229813d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 -- 10.20.193.51:0/1932474858 >> 10.20.193.51:0/1932474858 conn(0x7f22980a30c0 msgr2=0x7f22980a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 -- 10.20.193.51:0/1932474858 shutdown_connections 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.112+0000 7f229deda640 1 -- 10.20.193.51:0/1932474858 wait complete. 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 10 monclient: build_initial_monmap 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 10 monclient: monmap: 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:17.130 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 1 Processor -- start 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 1 -- start start 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 10 monclient: init 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.113+0000 7f229deda640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 0x7f229813a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): picked mon.noname-b con 0x7f22980a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): picked mon.noname-c con 0x7f229813b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:17.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): picked mon.noname-a con 0x7f229813dcb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2298135040 con 0x7f229813dcb0 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2298074ac0 con 0x7f22980a3bb0 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f22981351c0 con 0x7f229813b380 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f229deda640 10 monclient(hunting): authenticate will time out at 784.733048s 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:17.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f22977fe640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 msgr2=0x7f229813a6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57220/0 (socket says 10.20.193.51:57220) 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 1 -- 10.20.193.51:0/2436141051 learned_addr learned my addr 10.20.193.51:0/2436141051 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): get_auth_request con 0x7f229813b380 auth_method 0 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x7f229813dcb0 auth_method 0 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f22977fe640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 0x7f229813a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:17.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 34335 payload 824 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 -- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 msgr2=0x7f22981cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 -- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 msgr2=0x7f229813a6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 0x7f229813a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:17.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 monclient: found mon.noname-a 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2297fff640 1 -- 10.20.193.51:0/2436141051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229809d7b0 con 0x7f229813dcb0 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.114+0000 7f2296ffd640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2297fff640 1 -- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 msgr2=0x7f22981cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2297fff640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981cc370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f228c036000 tx=0x7f228c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c047030 con 0x7f229813dcb0 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: dump: 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:17.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: _finish_auth 0 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:17.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c042470 con 0x7f229813dcb0 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 5 monclient: authenticate success, global_id 34335 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 10 monclient: _renew_subs 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2298138f90 con 0x7f229813dcb0 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03c040 con 0x7f229813dcb0 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2295ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f2273fff640 10 monclient: dump: 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:17.137 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 10 monclient: _renew_subs 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.116+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2298139c40 con 0x7f229813dcb0 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f229deda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:17.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f229deda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f229deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f228c0428a0 con 0x7f229813dcb0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f229809d560 con 0x7f229813dcb0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f2273fff640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 0x7f22680401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f228c078010 con 0x7f229813dcb0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f22977fe640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 0x7f22680401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.117+0000 7f22977fe640 10 monclient: get_auth_request con 0x7f226803dcf0 auth_method 0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.119+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f228c051070 con 0x7f229813dcb0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.119+0000 7f2273fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.119+0000 7f2273fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:17.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.120+0000 7f22977fe640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 0x7f22680401b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2284003a30 tx=0x7f2284009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:17.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f229deda640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:17.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f229deda640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:17.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f229deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:17.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2298074d80 con 0x7f229813dcb0 2026-02-17T11:48:17.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f2273fff640 1 -- 10.20.193.51:0/2436141051 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f228c035340 con 0x7f229813dcb0 2026-02-17T11:48:17.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f2273fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:17.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.233+0000 7f2273fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:17.236 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:17.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 msgr2=0x7f22680401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:17.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 0x7f22680401b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2284003a30 tx=0x7f2284009270 comp rx=0 tx=0).stop 2026-02-17T11:48:17.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 10 monclient: shutdown 2026-02-17T11:48:17.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 msgr2=0x7f22981cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981cc370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f228c036000 tx=0x7f228c004b40 comp rx=0 tx=0).stop 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 shutdown_connections 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dcf0 0x7f22680401b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f229813dcb0 0x7f22981cc370 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229813b380 0x7f22981cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 --2- 10.20.193.51:0/2436141051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a3bb0 0x7f229813a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 >> 10.20.193.51:0/2436141051 conn(0x7f22980a30c0 msgr2=0x7f22980996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 shutdown_connections 2026-02-17T11:48:17.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:17.234+0000 7f229deda640 1 -- 10.20.193.51:0/2436141051 wait complete. 2026-02-17T11:48:20.244 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:20.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 10 monclient: get_monmap_and_config 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 10 monclient: build_initial_monmap 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 10 monclient: monmap: 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:20.312481+0000 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:20.312481+0000 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:20.316 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 1 Processor -- start 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 1 -- start start 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.311+0000 7fac135fb640 10 monclient: init 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-b con 0x7fac0c138190 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:20.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fac0c138570 0x7fac0c0a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-a con 0x7fac0c138570 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 0x7fac0c0a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-c con 0x7fac0c0a2d90 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fac0c0a03e0 con 0x7fac0c138570 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fac0c06fdc0 con 0x7fac0c0a2d90 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c0700a0 con 0x7fac0c138190 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac135fb640 10 monclient(hunting): authenticate will time out at 787.931302s 2026-02-17T11:48:20.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fac0c138570 0x7fac0c0a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11b71640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 msgr2=0x7fac0c0a3220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57230/0 (socket says 10.20.193.51:57230) 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11b71640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 0x7fac0c0a3220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fac0c138570 0x7fac0c0a2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37136/0 (socket says 10.20.193.51:37136) 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 1 -- 10.20.193.51:0/876909843 learned_addr learned my addr 10.20.193.51:0/876909843 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): get_auth_request con 0x7fac0c138190 auth_method 0 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): get_auth_request con 0x7fac0c138570 auth_method 0 2026-02-17T11:48:20.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient(hunting): handle_auth_done global_id 34338 payload 274 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 -- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 msgr2=0x7fac0c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 -- 10.20.193.51:0/876909843 >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 msgr2=0x7fac0c0a3220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 --2- 10.20.193.51:0/876909843 >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 0x7fac0c0a3220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient: _finish_hunting 0 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 monclient: found mon.noname-a 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac10b6f640 1 -- 10.20.193.51:0/876909843 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c137c70 con 0x7fac0c138570 2026-02-17T11:48:20.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.312+0000 7fac11370640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.314+0000 7fac10b6f640 1 -- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c138570 msgr2=0x7fac0c0a2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.314+0000 7fac10b6f640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c138570 0x7fac0c0a2850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0a7ee0 tx=0x7fac0002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6292d35ba09a984e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 1 -- 10.20.193.51:0/876909843 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0003c070 con 0x7fac0c138570 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: dump: 2026-02-17T11:48:20.328 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: _finish_auth 0 2026-02-17T11:48:20.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 1 -- 10.20.193.51:0/876909843 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0002fc90 con 0x7fac0c138570 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 1 -- 10.20.193.51:0/876909843 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00037660 con 0x7fac0c138570 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fabfbfff640 10 monclient: dump: 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.330 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 5 monclient: authenticate success, global_id 34338 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 4 set_mon_vals no callback set 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 10 monclient: shutdown 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 -- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c138570 msgr2=0x7fac0c0a2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:20.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c138570 0x7fac0c0a2850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0a7ee0 tx=0x7fac0002ee10 comp rx=0 tx=0).stop 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 -- 10.20.193.51:0/876909843 shutdown_connections 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 --2- 10.20.193.51:0/876909843 >> v2:10.20.193.142:3300/0 conn(0x7fac0c0a2d90 0x7fac0c0a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c138570 0x7fac0c0a2850 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 --2- 10.20.193.51:0/876909843 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 -- 10.20.193.51:0/876909843 >> 10.20.193.51:0/876909843 conn(0x7fac0c0a3940 msgr2=0x7fac0c0a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 -- 10.20.193.51:0/876909843 shutdown_connections 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.315+0000 7fac135fb640 1 -- 10.20.193.51:0/876909843 wait complete. 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient: build_initial_monmap 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient: monmap: 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:20.332 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 Processor -- start 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 -- start start 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient: init 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:20.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-a con 0x7fac0c0a2d90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-c con 0x7fac0c138190 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 0x7fac0c138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): picked mon.noname-b con 0x7fac0c138570 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c138ad0 con 0x7fac0c0a2d90 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c138950 con 0x7fac0c138570 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c13efe0 con 0x7fac0c138190 2026-02-17T11:48:20.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac135fb640 10 monclient(hunting): authenticate will time out at 787.935451s 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37152/0 (socket says 10.20.193.51:37152) 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 1 -- 10.20.193.51:0/1407811045 learned_addr learned my addr 10.20.193.51:0/1407811045 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): get_auth_request con 0x7fac0c138190 auth_method 0 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): get_auth_request con 0x7fac0c0a2d90 auth_method 0 2026-02-17T11:48:20.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11b71640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 msgr2=0x7fac0c138d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11b71640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 0x7fac0c138d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient(hunting): handle_auth_done global_id 44261 payload 824 2026-02-17T11:48:20.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 msgr2=0x7fac0c138d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 0x7fac0c138d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 msgr2=0x7fac0c13dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient: _finish_hunting 0 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 monclient: found mon.noname-c 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac10b6f640 1 -- 10.20.193.51:0/1407811045 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c13b270 con 0x7fac0c138190 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.316+0000 7fac11370640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac10b6f640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 msgr2=0x7fac0c13e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac10b6f640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c13e4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac00036000 tx=0x7fac000047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0003c040 con 0x7fac0c138190 2026-02-17T11:48:20.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: dump: 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:20.338 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0002fa90 con 0x7fac0c138190 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 5 monclient: authenticate success, global_id 44261 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 10 monclient: _renew_subs 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c13b490 con 0x7fac0c138190 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00040840 con 0x7fac0c138190 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:20.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabf9ffb640 10 monclient: dump: 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fabfb7fe640 4 set_mon_vals no callback set 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 10 monclient: _renew_subs 2026-02-17T11:48:20.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.318+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c0a2700 con 0x7fac0c138190 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fac0003f030 con 0x7fac0c138190 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fac135fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fac135fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fac135fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c070bf0 con 0x7fac0c138190 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fabf9ffb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 0x7fabdc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7fac000774b0 con 0x7fac0c138190 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.319+0000 7fac11370640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 0x7fabdc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.320+0000 7fac11370640 10 monclient: get_auth_request con 0x7fabdc03dcc0 auth_method 0 2026-02-17T11:48:20.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.322+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fac0002fc40 con 0x7fac0c138190 2026-02-17T11:48:20.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.322+0000 7fabf9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:20.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.322+0000 7fabf9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:20.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.322+0000 7fac11370640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 0x7fabdc040180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0113d0 tx=0x7fabfc009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.436+0000 7fac135fb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.436+0000 7fac135fb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.436+0000 7fac135fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.436+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fac0c13aff0 con 0x7fac0c138190 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.437+0000 7fabf9ffb640 1 -- 10.20.193.51:0/1407811045 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fac00075e90 con 0x7fac0c138190 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.437+0000 7fabf9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:20.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.437+0000 7fabf9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:20.440 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 msgr2=0x7fabdc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 0x7fabdc040180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0113d0 tx=0x7fabfc009340 comp rx=0 tx=0).stop 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 10 monclient: shutdown 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 msgr2=0x7fac0c13e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c13e4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac00036000 tx=0x7fac000047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 shutdown_connections 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fabdc03dcc0 0x7fabdc040180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fac0c138570 0x7fac0c138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fac0c138190 0x7fac0c13e4e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 --2- 10.20.193.51:0/1407811045 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fac0c0a2d90 0x7fac0c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 >> 10.20.193.51:0/1407811045 conn(0x7fac0c0a3940 msgr2=0x7fac0c0732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 shutdown_connections 2026-02-17T11:48:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:20.438+0000 7fac135fb640 1 -- 10.20.193.51:0/1407811045 wait complete. 2026-02-17T11:48:23.449 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 10 monclient: get_monmap_and_config 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 10 monclient: build_initial_monmap 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 10 monclient: monmap: 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:23.518523+0000 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:23.518523+0000 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:23.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 1 Processor -- start 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 1 -- start start 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.517+0000 7f67be2c9640 10 monclient: init 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-c con 0x7f67b809e370 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-b con 0x7f67b809aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f67b80994b0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b80a0980 con 0x7f67b80994b0 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f67b809d600 con 0x7f67b809e370 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f67b806d8e0 con 0x7f67b809aa50 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67be2c9640 10 monclient(hunting): authenticate will time out at 791.137460s 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67bc83f640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f67b80994b0 legacy=0x7f67b80998c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b7fff640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 msgr2=0x7f67b809e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:23.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b7fff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57254/0 (socket says 10.20.193.51:57254) 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 learned_addr learned my addr 10.20.193.51:0/2168741467 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67b809aa50 auth_method 0 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:23.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.518+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:23.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67bc83f640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.142:6789/0 conn(0x7f67b80994b0 legacy=0x7f67b80998c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b7fff640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 msgr2=0x7f67b809e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67b809aa50 auth_method 0 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:48:23.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:23.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:23.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:23.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67bc83f640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.142:6789/0 conn(0x7f67b80994b0 legacy=0x7f67b80998c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b7fff640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 msgr2=0x7f67b809e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67b809aa50 auth_method 0 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:48:24.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:24.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:24.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67bc83f640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.142:6789/0 conn(0x7f67b80994b0 legacy=0x7f67b80998c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b7fff640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 msgr2=0x7f67b809e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67b809aa50 auth_method 0 2026-02-17T11:48:24.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:24.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:24.921+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:48:26.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): tick 2026-02-17T11:48:26.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 msgr2=0x7f67b809ec90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f67b809aa50 0x7f67b809ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 msgr2=0x7f67b809e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.142:3300/0 conn(0x7f67b809e370 0x7f67b809e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.142:6789/0 conn(0x7f67b80994b0 legacy=0x7f67b80998c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient: _add_conns ranks=[0,3] 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f67940037a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:26.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f67940074f0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 -- 10.20.193.51:0/2168741467 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b809ff30 con 0x7f67940037a0 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 1 -- 10.20.193.51:0/2168741467 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f67b809d600 con 0x7f67940074f0 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b5ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67940074f0 auth_method 0 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:26.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.518+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.520+0000 7f67b7fff640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.51:6789/0 conn(0x7f67940037a0 legacy=0x7f6794005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67940074f0 auth_method 0 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:26.719+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:27.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:27.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67940074f0 auth_method 0 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:27.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.120+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:48:27.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:27.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f67940074f0 auth_method 0 2026-02-17T11:48:27.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:27.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:27.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:27.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:48:27.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:48:27.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:27.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:27.920+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67496612 0 0) 0x7f67b809ff30 con 0x7f67940037a0 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): my global_id is 34344 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f679c0058b0 con 0x7f67940037a0 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 273832770 0 0) 0x7f679c0058b0 con 0x7f67940037a0 2026-02-17T11:48:28.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 msgr2=0x7f67940099b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 --2- 10.20.193.51:0/2168741467 >> v2:10.20.193.51:3300/0 conn(0x7f67940074f0 0x7f67940099b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b80a0980 con 0x7f67940037a0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f67a40044a0 con 0x7f67940037a0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: dump: 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.031 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 >> v1:10.20.193.51:6789/0 conn(0x7f67940037a0 legacy=0x7f6794005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67bc83f640 1 -- 10.20.193.51:0/2168741467 reap_dead start 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f679c006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): picked mon.c con 0x7f679c005d40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f679c007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): picked mon.a con 0x7f679c006b90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f679c00dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): picked mon.b con 0x7f679c007620 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f67b809d600 con 0x7f679c006b90 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00e570 con 0x7f679c007620 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f679c00e770 con 0x7f679c005d40 2026-02-17T11:48:28.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f679c007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f679c006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f679c006b90 auth_method 0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67bc83f640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 msgr2=0x7f679c00dd50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): get_auth_request con 0x7f679c005d40 auth_method 0 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67bc83f640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f679c00dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient(hunting): handle_auth_done global_id 34344 payload 293 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 msgr2=0x7f679c006140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:28.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f679c006140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 msgr2=0x7f679c00dd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f679c00dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 monclient: found mon.a 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.016+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0058b0 con 0x7f679c006b90 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.017+0000 7f67b77fe640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.017+0000 7f67b77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.017+0000 7f67b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.017+0000 7f67be2c9640 5 monclient: authenticate success, global_id 34344 2026-02-17T11:48:28.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.017+0000 7f67be2c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b77fe640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 msgr2=0x7f679c007010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f679c007010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f67a8006fd0 tx=0x7f67a80303d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3ff48bf8a0b526 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8003710 con 0x7f679c006b90 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: dump: 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67be2c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a8030e10 con 0x7f679c006b90 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 1 -- 10.20.193.51:0/2168741467 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8012650 con 0x7f679c006b90 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67b6ffd640 10 monclient: dump: 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.038 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67be2c9640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.019+0000 7f67be2c9640 4 set_mon_vals no callback set 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 10 monclient: shutdown 2026-02-17T11:48:28.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 -- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 msgr2=0x7f679c007010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f679c007010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f67a8006fd0 tx=0x7f67a80303d0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 -- 10.20.193.51:0/2168741467 shutdown_connections 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f679c00dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f679c007010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2168741467 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f679c006140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 -- 10.20.193.51:0/2168741467 >> 10.20.193.51:0/2168741467 conn(0x7f67b80a30c0 msgr2=0x7f67b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 -- 10.20.193.51:0/2168741467 shutdown_connections 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 1 -- 10.20.193.51:0/2168741467 wait complete. 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 10 monclient: build_initial_monmap 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.020+0000 7f67be2c9640 10 monclient: monmap: 2026-02-17T11:48:28.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 Processor -- start 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 -- start start 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient: init 2026-02-17T11:48:28.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-c con 0x7f679c005d40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f67b81cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-a con 0x7f679c006b90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f67b81cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): picked mon.noname-b con 0x7f679c007620 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80a3e20 con 0x7f679c006b90 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f67b806e140 con 0x7f679c007620 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f67b80a3fa0 con 0x7f679c005d40 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67be2c9640 10 monclient(hunting): authenticate will time out at 795.641359s 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f67b81cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44260/0 (socket says 10.20.193.51:44260) 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 -- 10.20.193.51:0/2999244585 learned_addr learned my addr 10.20.193.51:0/2999244585 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): get_auth_request con 0x7f679c005d40 auth_method 0 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): get_auth_request con 0x7f679c006b90 auth_method 0 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67bc83f640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 msgr2=0x7f67b81cbfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67bc83f640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f67b81cbfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient(hunting): handle_auth_done global_id 44264 payload 824 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 msgr2=0x7f67b81cbfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f67b81cbfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 msgr2=0x7f67b81cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f67b81cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 monclient: found mon.noname-c 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b7fff640 1 -- 10.20.193.51:0/2999244585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b8096cd0 con 0x7f679c005d40 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.021+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f67b81cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b7fff640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 msgr2=0x7f67b81cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b7fff640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f67a400f9f0 tx=0x7f67a400fec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a40065b0 con 0x7f679c005d40 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: dump: 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.046 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a4018070 con 0x7f679c005d40 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 5 monclient: authenticate success, global_id 44264 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 10 monclient: _renew_subs 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b809d7b0 con 0x7f679c005d40 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a400da30 con 0x7f679c005d40 2026-02-17T11:48:28.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b67fc640 4 set_mon_vals no callback set 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67b4ff9640 10 monclient: dump: 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 10 monclient: _renew_subs 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.023+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b8097570 con 0x7f679c005d40 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f67a400dc10 con 0x7f679c005d40 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67be2c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67be2c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67be2c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b80971f0 con 0x7f679c005d40 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67b4ff9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 0x7f6788040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f67a40527c0 con 0x7f679c005d40 2026-02-17T11:48:28.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.024+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 0x7f6788040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.025+0000 7f67b77fe640 10 monclient: get_auth_request con 0x7f678803deb0 auth_method 0 2026-02-17T11:48:28.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.027+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f67b8096cd0 con 0x7f679c005d40 2026-02-17T11:48:28.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.027+0000 7f67b4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.027+0000 7f67b4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:28.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.027+0000 7f67b77fe640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 0x7f6788040370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67a8006f00 tx=0x7f67a8034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67be2c9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:28.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67be2c9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67be2c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67b80008d0 con 0x7f679c005d40 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67b4ff9640 1 -- 10.20.193.51:0/2999244585 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f67a40511a0 con 0x7f679c005d40 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67b4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.142+0000 7f67b4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:28.146 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:28.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 msgr2=0x7f6788040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 0x7f6788040370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67a8006f00 tx=0x7f67a8034000 comp rx=0 tx=0).stop 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 10 monclient: shutdown 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 msgr2=0x7f67b81cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f67a400f9f0 tx=0x7f67a400fec0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 shutdown_connections 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f678803deb0 0x7f6788040370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f679c007620 0x7f67b81cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f679c006b90 0x7f67b81cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 --2- 10.20.193.51:0/2999244585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f679c005d40 0x7f67b81cb540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 >> 10.20.193.51:0/2999244585 conn(0x7f67b80a30c0 msgr2=0x7f67b809b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 shutdown_connections 2026-02-17T11:48:28.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.143+0000 7f67be2c9640 1 -- 10.20.193.51:0/2999244585 wait complete. 2026-02-17T11:48:28.155 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:48:28.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:48:28.155 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:48:28.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.221+0000 7fafc9fcc640 10 monclient: get_monmap_and_config 2026-02-17T11:48:28.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.221+0000 7fafc9fcc640 10 monclient: build_initial_monmap 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.221+0000 7fafc9fcc640 10 monclient: monmap: 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:28.223933+0000 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:28.223933+0000 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:28.225 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:28.226 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:28.226 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 Processor -- start 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 -- start start 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient: init 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fafc40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 0x7fafc409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-c con 0x7fafc40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 0x7fafc413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-b con 0x7fafc413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc406e140 con 0x7fafc40a3bb0 2026-02-17T11:48:28.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fafc409f910 con 0x7fafc40a0750 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fafc409ccd0 con 0x7fafc413b760 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc9fcc640 10 monclient(hunting): authenticate will time out at 795.842715s 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fafc40a3bb0 0x7fafc409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:43458/0 (socket says 10.20.193.51:43458) 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc2ffd640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 msgr2=0x7fafc409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc37fe640 1 -- 10.20.193.51:0/2661021054 learned_addr learned my addr 10.20.193.51:0/2661021054 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc2ffd640 1 --2- 10.20.193.51:0/2661021054 >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 0x7fafc409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 1 --2- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 0x7fafc413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): get_auth_request con 0x7fafc413b760 auth_method 0 2026-02-17T11:48:28.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.222+0000 7fafc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 10 monclient(hunting): handle_auth_done global_id 44267 payload 274 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 1 -- 10.20.193.51:0/2661021054 >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 msgr2=0x7fafc409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 1 --2- 10.20.193.51:0/2661021054 >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 0x7fafc409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 1 -- 10.20.193.51:0/2661021054 >> v1:10.20.193.51:6789/0 conn(0x7fafc40a3bb0 legacy=0x7fafc409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 1 monclient: found mon.noname-b 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.223+0000 7fafc3fff640 1 -- 10.20.193.51:0/2661021054 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc409eec0 con 0x7fafc413b760 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc3fff640 1 -- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 msgr2=0x7fafc413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc3fff640 1 --2- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 0x7fafc413db50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafc406f3c0 tx=0x7fafb802f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55805cc26693b606 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 1 -- 10.20.193.51:0/2661021054 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb803c070 con 0x7fafc413b760 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: dump: 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 1 -- 10.20.193.51:0/2661021054 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb8037640 con 0x7fafc413b760 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 1 -- 10.20.193.51:0/2661021054 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8037a10 con 0x7fafc413b760 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 5 monclient: authenticate success, global_id 44267 2026-02-17T11:48:28.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 4 set_mon_vals no callback set 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc27fc640 10 monclient: dump: 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 10 monclient: shutdown 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 -- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 msgr2=0x7fafc413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 0x7fafc413db50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafc406f3c0 tx=0x7fafb802f150 comp rx=0 tx=0).stop 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 -- 10.20.193.51:0/2661021054 shutdown_connections 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/2661021054 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc413b760 0x7fafc413db50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/2661021054 >> v2:10.20.193.142:3300/0 conn(0x7fafc40a0750 0x7fafc409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 -- 10.20.193.51:0/2661021054 >> 10.20.193.51:0/2661021054 conn(0x7fafc40a30c0 msgr2=0x7fafc40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.225+0000 7fafc9fcc640 1 -- 10.20.193.51:0/2661021054 shutdown_connections 2026-02-17T11:48:28.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 -- 10.20.193.51:0/2661021054 wait complete. 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient: build_initial_monmap 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient: monmap: 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:28.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 Processor -- start 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 -- start start 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient: init 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 0x7fafc41cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-c con 0x7fafc40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40a3bb0 0x7fafc41d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-a con 0x7fafc40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fafc413b760 0x7fafc4096110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): picked mon.noname-b con 0x7fafc413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:28.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40a04b0 con 0x7fafc40a3bb0 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fafc409c850 con 0x7fafc413b760 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fafc409e710 con 0x7fafc40a0750 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc9fcc640 10 monclient(hunting): authenticate will time out at 795.846819s 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 0x7fafc41cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40a3bb0 0x7fafc41d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 0x7fafc41cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44288/0 (socket says 10.20.193.51:44288) 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 1 -- 10.20.193.51:0/3931171401 learned_addr learned my addr 10.20.193.51:0/3931171401 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): get_auth_request con 0x7fafc40a0750 auth_method 0 2026-02-17T11:48:28.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc3fff640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fafc413b760 msgr2=0x7fafc4096110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): get_auth_request con 0x7fafc40a3bb0 auth_method 0 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc3fff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fafc413b760 0x7fafc4096110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.226+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 10 monclient(hunting): handle_auth_done global_id 44270 payload 824 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fafc413b760 msgr2=0x7fafc4096110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fafc413b760 0x7fafc4096110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40a3bb0 msgr2=0x7fafc41d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40a3bb0 0x7fafc41d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 monclient: found mon.noname-c 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.227+0000 7fafc37fe640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc409a060 con 0x7fafc40a0750 2026-02-17T11:48:28.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc37fe640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 msgr2=0x7fafc41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc37fe640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 0x7fafc41cfad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c750 tx=0x7fafb000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0005de0 con 0x7fafc40a0750 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: dump: 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0007070 con 0x7fafc40a0750 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 5 monclient: authenticate success, global_id 44270 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 monclient: _renew_subs 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc4073fb0 con 0x7fafc40a0750 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0007440 con 0x7fafc40a0750 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7faf9ffff640 10 monclient: dump: 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc1ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 monclient: _renew_subs 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc4099aa0 con 0x7fafc40a0750 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 0x7fafc4091900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fafc4099470 con 0x7fafc4096e10 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc2ffd640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 0x7fafc4091900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc2ffd640 10 monclient: get_auth_request con 0x7fafc4096e10 auth_method 0 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.229+0000 7fafc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fafb0007660 con 0x7fafc40a0750 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_done global_id 34353 payload 824 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc2ffd640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafc409dac0 con 0x7fafc4096e10 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7faf9ffff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf9403dd10 0x7faf940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7fafb0052310 con 0x7fafc40a0750 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc3fff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf9403dd10 0x7faf940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.230+0000 7fafc3fff640 10 monclient: get_auth_request con 0x7faf9403dd10 auth_method 0 2026-02-17T11:48:28.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7fafc2ffd640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 msgr2=0x7fafc4091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7fafc2ffd640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 0x7fafc4091900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafc4097970 tx=0x7fafb4005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4016070 con 0x7fafc4096e10 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 10 monclient: dump: 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.253 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fafb400eb30 con 0x7fafc4096e10 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 msgr2=0x7fafc4091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 0x7fafc4091900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafc4097970 tx=0x7fafb4005a60 comp rx=0 tx=0).stop 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 msgr2=0x7fafc4091900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.232+0000 7faf9ffff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc4096e10 0x7fafc4091900 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafc4097970 tx=0x7fafb4005a60 comp rx=0 tx=0).stop 2026-02-17T11:48:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.233+0000 7fafc3fff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf9403dd10 0x7faf940401d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafc406c1c0 tx=0x7fafb8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc9fcc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 0x7fafc41dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc9fcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fafc4092fc0 con 0x7fafc40971f0 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 0x7fafc41dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient: get_auth_request con 0x7fafc40971f0 auth_method 0 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 10 monclient(hunting): handle_auth_done global_id 34356 payload 824 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.235+0000 7fafc2ffd640 1 -- 10.20.193.51:0/3931171401 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fafc40008d0 con 0x7fafc40971f0 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.237+0000 7fafc2ffd640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 msgr2=0x7fafc41dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.237+0000 7fafc2ffd640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 0x7fafc41dab40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fafb4018000 tx=0x7fafb4005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4016040 con 0x7fafc40971f0 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 10 monclient: dump: 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.258 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7fafb401b450 con 0x7fafc40971f0 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 msgr2=0x7fafc41dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 0x7fafc41dab40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fafb4018000 tx=0x7fafb4005ad0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 msgr2=0x7fafc41dab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7faf9ffff640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fafc40971f0 0x7fafc41dab40 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fafb4018000 tx=0x7fafb4005ad0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 26, 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 128884, 2026-02-17T11:48:28.260 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.261 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.262 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:28.263 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.264 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.265 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.266 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.267 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.268 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.269 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.270 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.271 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:28.271 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf9403dd10 msgr2=0x7faf940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf9403dd10 0x7faf940401d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafc406c1c0 tx=0x7fafb8033000 comp rx=0 tx=0).stop 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 10 monclient: shutdown 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 msgr2=0x7fafc41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 --2- 10.20.193.51:0/3931171401 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fafc40a0750 0x7fafc41cfad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c750 tx=0x7fafb000cc20 comp rx=0 tx=0).stop 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc3fff640 1 -- 10.20.193.51:0/3931171401 reap_dead start 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc3fff640 1 -- 10.20.193.51:0/3931171401 reap_dead start 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 shutdown_connections 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 >> 10.20.193.51:0/3931171401 conn(0x7fafc40a30c0 msgr2=0x7fafc413ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 shutdown_connections 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.238+0000 7fafc9fcc640 1 -- 10.20.193.51:0/3931171401 wait complete. 2026-02-17T11:48:28.273 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:48:28.273 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:48:28.273 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.340+0000 7f68fe800640 10 monclient: get_monmap_and_config 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.340+0000 7f68fe800640 10 monclient: build_initial_monmap 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.340+0000 7f68fe800640 10 monclient: monmap: 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:28.342470+0000 2026-02-17T11:48:28.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:28.342470+0000 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:28.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.340+0000 7f68fe800640 1 Processor -- start 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 -- start start 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient: init 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-b con 0x7f68f809e370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f68f809aa50 0x7f68f809ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-a con 0x7f68f809aa50 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f68f80994b0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:28.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f80a0980 con 0x7f68f80994b0 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f68f809d600 con 0x7f68f809aa50 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f68f806d8e0 con 0x7f68f809e370 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fe800640 10 monclient(hunting): authenticate will time out at 795.961386s 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68fcd76640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f68f80994b0 legacy=0x7f68f80998c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f68f809aa50 0x7f68f809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44290/0 (socket says 10.20.193.51:44290) 2026-02-17T11:48:28.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 -- 10.20.193.51:0/1979674948 learned_addr learned my addr 10.20.193.51:0/1979674948 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): get_auth_request con 0x7f68f809e370 auth_method 0 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): get_auth_request con 0x7f68f809aa50 auth_method 0 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient(hunting): handle_auth_done global_id 44273 payload 274 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 -- 10.20.193.51:0/1979674948 >> v2:10.20.193.51:3300/0 conn(0x7f68f809aa50 msgr2=0x7f68f809ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 --2- 10.20.193.51:0/1979674948 >> v2:10.20.193.51:3300/0 conn(0x7f68f809aa50 0x7f68f809ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 -- 10.20.193.51:0/1979674948 >> v1:10.20.193.142:6789/0 conn(0x7f68f80994b0 legacy=0x7f68f80998c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 monclient: found mon.noname-b 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.341+0000 7f68f7fff640 1 -- 10.20.193.51:0/1979674948 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f809ff30 con 0x7f68f809e370 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f7fff640 1 -- 10.20.193.51:0/1979674948 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 msgr2=0x7f68f809e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f7fff640 1 --2- 10.20.193.51:0/1979674948 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68e400ab50 tx=0x7f68e40302e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8179519681d6fd3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 1 -- 10.20.193.51:0/1979674948 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e403d070 con 0x7f68f809e370 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: dump: 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.359 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 1 -- 10.20.193.51:0/1979674948 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e4038640 con 0x7f68f809e370 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 1 -- 10.20.193.51:0/1979674948 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4038a10 con 0x7f68f809e370 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 5 monclient: authenticate success, global_id 44273 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:28.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 4 set_mon_vals no callback set 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68f6ffd640 10 monclient: dump: 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.361 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 10 monclient: shutdown 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 -- 10.20.193.51:0/1979674948 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 msgr2=0x7f68f809e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 --2- 10.20.193.51:0/1979674948 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68e400ab50 tx=0x7f68e40302e0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 -- 10.20.193.51:0/1979674948 shutdown_connections 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 --2- 10.20.193.51:0/1979674948 >> v2:10.20.193.51:3300/0 conn(0x7f68f809aa50 0x7f68f809ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 --2- 10.20.193.51:0/1979674948 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f809e370 0x7f68f809e750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 -- 10.20.193.51:0/1979674948 >> 10.20.193.51:0/1979674948 conn(0x7f68f80a30c0 msgr2=0x7f68f80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 -- 10.20.193.51:0/1979674948 shutdown_connections 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.344+0000 7f68fe800640 1 -- 10.20.193.51:0/1979674948 wait complete. 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient: build_initial_monmap 2026-02-17T11:48:28.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient: monmap: 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 Processor -- start 2026-02-17T11:48:28.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 -- start start 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient: init 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 0x7f68f81cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-c con 0x7f68f80994b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-a con 0x7f68f809aa50 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f68f809e370 0x7f68f8091be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): picked mon.noname-b con 0x7f68f809e370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f68f80a06a0 con 0x7f68f809aa50 2026-02-17T11:48:28.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f68f806e140 con 0x7f68f809e370 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80a3e20 con 0x7f68f80994b0 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fe800640 10 monclient(hunting): authenticate will time out at 795.965761s 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 0x7f68f81cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41382/0 (socket says 10.20.193.51:41382) 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 -- 10.20.193.51:0/888553596 learned_addr learned my addr 10.20.193.51:0/888553596 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): get_auth_request con 0x7f68f809aa50 auth_method 0 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 0x7f68f81cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44292/0 (socket says 10.20.193.51:44292) 2026-02-17T11:48:28.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): get_auth_request con 0x7f68f80994b0 auth_method 0 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fcd76640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f68f809e370 msgr2=0x7f68f8091be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68fcd76640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f68f809e370 0x7f68f8091be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient(hunting): handle_auth_done global_id 34362 payload 824 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 msgr2=0x7f68f81cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 0x7f68f81cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f68f809e370 msgr2=0x7f68f8091be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f68f809e370 0x7f68f8091be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 monclient: found mon.noname-a 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f77fe640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f8095510 con 0x7f68f809aa50 2026-02-17T11:48:28.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.345+0000 7f68f7fff640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80994b0 0x7f68f81cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f77fe640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 msgr2=0x7f68f81cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f77fe640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68e800ebe0 tx=0x7f68e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8017070 con 0x7f68f809aa50 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: dump: 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.368 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e800ce50 con 0x7f68f809aa50 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 5 monclient: authenticate success, global_id 34362 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 monclient: _renew_subs 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f809bfb0 con 0x7f68f809aa50 2026-02-17T11:48:28.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e80136b0 con 0x7f68f809aa50 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f67fc640 4 set_mon_vals no callback set 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 10 monclient: dump: 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.370 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 monclient: _renew_subs 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f809d7b0 con 0x7f68f809aa50 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 0x7f68f808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f68f8068450 con 0x7f68f80928e0 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 0x7f68f808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient: get_auth_request con 0x7f68f80928e0 auth_method 0 2026-02-17T11:48:28.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f68e8024060 con 0x7f68f809aa50 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 10 monclient(hunting): handle_auth_done global_id 44279 payload 824 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.348+0000 7f68f7fff640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68f808eab0 con 0x7f68f80928e0 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.349+0000 7f68f4ff9640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68c803dcc0 0x7f68c8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.349+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(108..108 src has 47..108) ==== 4811+0+0 (secure 0 0 0) 0x7f68e8052750 con 0x7f68f809aa50 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.349+0000 7f68fcd76640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68c803dcc0 0x7f68c8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.349+0000 7f68fcd76640 10 monclient: get_auth_request con 0x7f68c803dcc0 auth_method 0 2026-02-17T11:48:28.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f7fff640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 msgr2=0x7f68f808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f7fff640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 0x7f68f808d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68f809ae30 tx=0x7f68e40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4047070 con 0x7f68f80928e0 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 10 monclient: dump: 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.373 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f68e4042660 con 0x7f68f80928e0 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 msgr2=0x7f68f808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 0x7f68f808d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68f809ae30 tx=0x7f68e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 msgr2=0x7f68f808d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68f4ff9640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f80928e0 0x7f68f808d3f0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68f809ae30 tx=0x7f68e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.351+0000 7f68fcd76640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68c803dcc0 0x7f68c8040180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68f80939d0 tx=0x7f68ec007180 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68fe800640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68fe800640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 0x7f68f81d8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68fe800640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80008d0 con 0x7f68f8092cc0 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 0x7f68f81d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient: get_auth_request con 0x7f68f8092cc0 auth_method 0 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:28.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 10 monclient(hunting): handle_auth_done global_id 44282 payload 824 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.354+0000 7f68f7fff640 1 -- 10.20.193.51:0/888553596 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68f8050ac0 con 0x7f68f8092cc0 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f7fff640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 msgr2=0x7f68f81d8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f7fff640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 0x7f68f81d8760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68e4002410 tx=0x7f68e4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e403d040 con 0x7f68f8092cc0 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 10 monclient: dump: 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:28.377 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4863 (secure 0 0 0) 0x7f68e40433f0 con 0x7f68f8092cc0 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 msgr2=0x7f68f81d8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 0x7f68f81d8760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68e4002410 tx=0x7f68e4008040 comp rx=0 tx=0).stop 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 msgr2=0x7f68f81d8760 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:28.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.356+0000 7f68f4ff9640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68f8092cc0 0x7f68f81d8760 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68e4002410 tx=0x7f68e4008040 comp rx=0 tx=0).stop 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 26, 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 79829, 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.379 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:28.380 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:28.381 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:28.382 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.383 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.384 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.385 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.386 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:28.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.388 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:28.389 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68c803dcc0 msgr2=0x7f68c8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68c803dcc0 0x7f68c8040180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68f80939d0 tx=0x7f68ec007180 comp rx=0 tx=0).stop 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 10 monclient: shutdown 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 msgr2=0x7f68f81cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68e800ebe0 tx=0x7f68e800c520 comp rx=0 tx=0).stop 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fcd76640 1 -- 10.20.193.51:0/888553596 reap_dead start 2026-02-17T11:48:28.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 shutdown_connections 2026-02-17T11:48:28.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 --2- 10.20.193.51:0/888553596 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68f809aa50 0x7f68f81cdc30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:28.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 >> 10.20.193.51:0/888553596 conn(0x7f68f80a30c0 msgr2=0x7f68f80739f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:28.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 shutdown_connections 2026-02-17T11:48:28.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:28.357+0000 7f68fe800640 1 -- 10.20.193.51:0/888553596 wait complete. 2026-02-17T11:48:28.391 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:48:28.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:48:29.425 INFO:tasks.rados.rados.0.trial142.stdout:404: done (1 left) 2026-02-17T11:48:29.425 INFO:tasks.rados.rados.0.trial142.stdout:405: snap_remove snap 41 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:402: finishing rollback tid 0 to trial14245205-45 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:405: done (1 left) 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:406: rollback oid 47 current snap is 47 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 40 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:402: finishing rollback tid 1 to trial14245205-45 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:402: finishing rollback tid 2 to trial14245205-45 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 188 (ObjNum 149 snap 42 seq_num 149) dirty exists 2026-02-17T11:48:30.373 INFO:tasks.rados.rados.0.trial142.stdout:402: done (1 left) 2026-02-17T11:48:30.374 INFO:tasks.rados.rados.0.trial142.stdout:407: read oid 48 snap -1 2026-02-17T11:48:30.374 INFO:tasks.rados.rados.0.trial142.stdout:407: expect (ObjNum 143 snap 38 seq_num 143) 2026-02-17T11:48:30.374 INFO:tasks.rados.rados.0.trial142.stdout:408: read oid 5 snap 45 2026-02-17T11:48:30.374 INFO:tasks.rados.rados.0.trial142.stdout:408: expect (ObjNum 118 snap 28 seq_num 118) 2026-02-17T11:48:30.374 INFO:tasks.rados.rados.0.trial142.stdout:409: snap_create 2026-02-17T11:48:30.376 INFO:tasks.rados.rados.0.trial142.stdout:406: finishing rollback tid 0 to trial14245205-47 2026-02-17T11:48:30.376 INFO:tasks.rados.rados.0.trial142.stdout:406: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:48:30.376 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 187 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T11:48:30.378 INFO:tasks.rados.rados.0.trial142.stdout:407: expect (ObjNum 143 snap 38 seq_num 143) 2026-02-17T11:48:30.436 INFO:tasks.rados.rados.0.trial142.stdout:408: expect (ObjNum 118 snap 28 seq_num 118) 2026-02-17T11:48:31.373 INFO:tasks.rados.rados.0.trial142.stdout:406: done (3 left) 2026-02-17T11:48:31.373 INFO:tasks.rados.rados.0.trial142.stdout:407: done (2 left) 2026-02-17T11:48:31.373 INFO:tasks.rados.rados.0.trial142.stdout:408: done (1 left) 2026-02-17T11:48:31.373 INFO:tasks.rados.rados.0.trial142.stdout:409: done (0 left) 2026-02-17T11:48:31.373 INFO:tasks.rados.rados.0.trial142.stdout:410: snap_create 2026-02-17T11:48:32.376 INFO:tasks.rados.rados.0.trial142.stdout:410: done (0 left) 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:411: copy_from oid 28 from oid 2 current snap is 49 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:412: copy_from oid 12 from oid 20 current snap is 49 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:413: read oid 23 snap -1 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:413: expect (ObjNum 146 snap 39 seq_num 146) 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:414: copy_from oid 10 from oid 34 current snap is 49 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:415: write (excl) oid 3 current snap is 49 2026-02-17T11:48:32.377 INFO:tasks.rados.rados.0.trial142.stdout:415: seq_num 164 ranges {756348=784249,2063988=686387} 2026-02-17T11:48:32.382 INFO:tasks.rados.rados.0.trial142.stdout:415: writing trial14245205-3 from 756348 to 1540597 tid 1 2026-02-17T11:48:32.386 INFO:tasks.rados.rados.0.trial142.stdout:415: writing trial14245205-3 from 2063988 to 2750375 tid 2 2026-02-17T11:48:32.386 INFO:tasks.rados.rados.0.trial142.stdout:416: rollback oid 18 current snap is 49 2026-02-17T11:48:32.386 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 48 2026-02-17T11:48:32.387 INFO:tasks.rados.rados.0.trial142.stdout:413: expect (ObjNum 146 snap 39 seq_num 146) 2026-02-17T11:48:32.486 INFO:tasks.rados.rados.0.trial142.stdout:412: finishing copy_from racing read to trial14245205-12 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:411: finishing copy_from racing read to trial14245205-28 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:415: finishing write tid 1 to trial14245205-3 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:414: finishing copy_from racing read to trial14245205-10 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:413: done (5 left) 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:417: write oid 7 current snap is 49 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:414: finishing copy_from to trial14245205-10 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 66 (ObjNum 75 snap 15 seq_num 75) dirty exists 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:412: finishing copy_from to trial14245205-12 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 87 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-17T11:48:32.487 INFO:tasks.rados.rados.0.trial142.stdout:411: finishing copy_from to trial14245205-28 2026-02-17T11:48:32.488 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 107 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:48:32.488 INFO:tasks.rados.rados.0.trial142.stdout:416: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:48:32.488 INFO:tasks.rados.rados.0.trial142.stdout:417: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2026-02-17T11:48:32.491 INFO:tasks.rados.rados.0.trial142.stdout:417: writing trial14245205-7 from 773155 to 1232653 tid 1 2026-02-17T11:48:32.494 INFO:tasks.rados.rados.0.trial142.stdout:417: writing trial14245205-7 from 1722470 to 2152515 tid 2 2026-02-17T11:48:32.496 INFO:tasks.rados.rados.0.trial142.stdout:417: writing trial14245205-7 from 2648676 to 2773155 tid 3 2026-02-17T11:48:32.496 INFO:tasks.rados.rados.0.trial142.stdout:411: done (5 left) 2026-02-17T11:48:32.496 INFO:tasks.rados.rados.0.trial142.stdout:412: done (4 left) 2026-02-17T11:48:32.496 INFO:tasks.rados.rados.0.trial142.stdout:414: done (3 left) 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:418: write oid 16 current snap is 49 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:416: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:415: finishing write tid 2 to trial14245205-3 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:416: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 268 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:415: finishing write tid 3 to trial14245205-3 2026-02-17T11:48:32.497 INFO:tasks.rados.rados.0.trial142.stdout:418: seq_num 166 ranges {789962=534747,1780952=690056} 2026-02-17T11:48:32.501 INFO:tasks.rados.rados.0.trial142.stdout:418: writing trial14245205-16 from 789962 to 1324709 tid 1 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:418: writing trial14245205-16 from 1780952 to 2471008 tid 2 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:416: done (3 left) 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:419: rollback oid 20 current snap is 49 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 34 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:415: finishing write tid 4 to trial14245205-3 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:415: oid 3 updating version 0 to 109 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:415: oid 3 updating version 109 to 110 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:415: oid 3 version 110 is already newer than 106 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 110 (ObjNum 164 snap 49 seq_num 164) dirty exists 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:415: left oid 3 (ObjNum 164 snap 49 seq_num 164) 2026-02-17T11:48:32.506 INFO:tasks.rados.rados.0.trial142.stdout:417: finishing write tid 1 to trial14245205-7 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: finishing write tid 2 to trial14245205-7 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: finishing write tid 3 to trial14245205-7 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: finishing write tid 4 to trial14245205-7 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: finishing write tid 5 to trial14245205-7 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: oid 7 updating version 0 to 271 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: oid 7 version 271 is already newer than 270 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: oid 7 updating version 271 to 272 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: oid 7 updating version 272 to 273 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 273 (ObjNum 165 snap 49 seq_num 165) dirty exists 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: left oid 7 (ObjNum 165 snap 49 seq_num 165) 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:418: finishing write tid 1 to trial14245205-16 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:415: done (3 left) 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:417: done (2 left) 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:420: rollback oid 23 current snap is 49 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 30 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:421: copy_from oid 40 from oid 32 current snap is 49 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:422: snap_create 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:421: finishing copy_from to trial14245205-40 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:421: got expected ENOENT (src dne) 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:419: finishing rollback tid 0 to trial14245205-20 2026-02-17T11:48:32.507 INFO:tasks.rados.rados.0.trial142.stdout:421: finishing copy_from racing read to trial14245205-40 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:419: finishing rollback tid 1 to trial14245205-20 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:419: finishing rollback tid 2 to trial14245205-20 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 188 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: finishing write tid 2 to trial14245205-16 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: finishing write tid 3 to trial14245205-16 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: finishing write tid 4 to trial14245205-16 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: oid 16 updating version 0 to 140 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: oid 16 updating version 140 to 141 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: oid 16 version 141 is already newer than 139 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 141 (ObjNum 166 snap 49 seq_num 166) dirty exists 2026-02-17T11:48:32.508 INFO:tasks.rados.rados.0.trial142.stdout:418: left oid 16 (ObjNum 166 snap 49 seq_num 166) 2026-02-17T11:48:32.509 INFO:tasks.rados.rados.0.trial142.stdout:420: finishing rollback tid 0 to trial14245205-23 2026-02-17T11:48:32.509 INFO:tasks.rados.rados.0.trial142.stdout:420: finishing rollback tid 1 to trial14245205-23 2026-02-17T11:48:32.509 INFO:tasks.rados.rados.0.trial142.stdout:420: finishing rollback tid 2 to trial14245205-23 2026-02-17T11:48:32.509 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 190 (ObjNum 88 snap 18 seq_num 88) dirty exists 2026-02-17T11:48:33.381 INFO:tasks.rados.rados.0.trial142.stdout:418: done (4 left) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:419: done (3 left) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:420: done (2 left) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:421: done (1 left) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:422: done (0 left) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:423: read oid 13 snap -1 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:423: expect (ObjNum 151 snap 42 seq_num 151) 2026-02-17T11:48:33.382 INFO:tasks.rados.rados.0.trial142.stdout:424: delete oid 48 current snap is 50 2026-02-17T11:48:33.384 INFO:tasks.rados.rados.0.trial142.stdout:424: done (1 left) 2026-02-17T11:48:33.384 INFO:tasks.rados.rados.0.trial142.stdout:425: read oid 27 snap -1 2026-02-17T11:48:33.384 INFO:tasks.rados.rados.0.trial142.stdout:425: expect deleted 2026-02-17T11:48:33.385 INFO:tasks.rados.rados.0.trial142.stdout:426: snap_create 2026-02-17T11:48:33.387 INFO:tasks.rados.rados.0.trial142.stdout:423: expect (ObjNum 151 snap 42 seq_num 151) 2026-02-17T11:48:34.372 INFO:tasks.rados.rados.0.trial142.stdout:423: done (2 left) 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:425: done (1 left) 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:426: done (0 left) 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:427: read oid 39 snap -1 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:427: expect (ObjNum 140 snap 38 seq_num 140) 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:428: write (excl) oid 42 current snap is 51 2026-02-17T11:48:34.373 INFO:tasks.rados.rados.0.trial142.stdout:428: seq_num 168 ranges {423576=401598,1497916=693725} 2026-02-17T11:48:34.375 INFO:tasks.rados.rados.0.trial142.stdout:428: writing trial14245205-42 from 423576 to 825174 tid 1 2026-02-17T11:48:34.381 INFO:tasks.rados.rados.0.trial142.stdout:428: writing trial14245205-42 from 1497916 to 2191641 tid 2 2026-02-17T11:48:34.381 INFO:tasks.rados.rados.0.trial142.stdout:429: delete oid 48 current snap is 51 2026-02-17T11:48:34.381 INFO:tasks.rados.rados.0.trial142.stdout:427: expect (ObjNum 140 snap 38 seq_num 140) 2026-02-17T11:48:34.448 INFO:tasks.rados.rados.0.trial142.stdout:428: finishing write tid 1 to trial14245205-42 2026-02-17T11:48:34.448 INFO:tasks.rados.rados.0.trial142.stdout:428: finishing write tid 2 to trial14245205-42 2026-02-17T11:48:34.448 INFO:tasks.rados.rados.0.trial142.stdout:428: finishing write tid 3 to trial14245205-42 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: finishing write tid 4 to trial14245205-42 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: oid 42 updating version 0 to 191 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: oid 42 version 191 is already newer than 190 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: oid 42 version 191 is already newer than 189 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 191 (ObjNum 168 snap 51 seq_num 168) dirty exists 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: left oid 42 (ObjNum 168 snap 51 seq_num 168) 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:427: done (2 left) 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:428: done (1 left) 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:429: done (0 left) 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:430: write (excl) oid 50 current snap is 51 2026-02-17T11:48:34.449 INFO:tasks.rados.rados.0.trial142.stdout:430: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-17T11:48:34.452 INFO:tasks.rados.rados.0.trial142.stdout:430: writing trial14245205-50 from 457190 to 1009286 tid 1 2026-02-17T11:48:34.456 INFO:tasks.rados.rados.0.trial142.stdout:430: writing trial14245205-50 from 1614880 to 2195921 tid 2 2026-02-17T11:48:34.459 INFO:tasks.rados.rados.0.trial142.stdout:430: writing trial14245205-50 from 2785791 to 2857190 tid 3 2026-02-17T11:48:34.459 INFO:tasks.rados.rados.0.trial142.stdout:431: write (excl) oid 1 current snap is 51 2026-02-17T11:48:34.459 INFO:tasks.rados.rados.0.trial142.stdout:430: finishing write tid 1 to trial14245205-50 2026-02-17T11:48:34.459 INFO:tasks.rados.rados.0.trial142.stdout:431: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2026-02-17T11:48:34.463 INFO:tasks.rados.rados.0.trial142.stdout:431: writing trial14245205-1 from 473997 to 1101342 tid 1 2026-02-17T11:48:34.467 INFO:tasks.rados.rados.0.trial142.stdout:431: writing trial14245205-1 from 1673362 to 2114414 tid 2 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:431: writing trial14245205-1 from 2529567 to 2873997 tid 3 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:432: delete oid 41 current snap is 51 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:430: finishing write tid 2 to trial14245205-50 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:430: finishing write tid 3 to trial14245205-50 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:430: finishing write tid 4 to trial14245205-50 2026-02-17T11:48:34.471 INFO:tasks.rados.rados.0.trial142.stdout:430: finishing write tid 5 to trial14245205-50 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:430: oid 50 updating version 0 to 80 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:430: oid 50 updating version 80 to 82 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:430: oid 50 version 82 is already newer than 79 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:430: oid 50 version 82 is already newer than 81 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 82 (ObjNum 170 snap 51 seq_num 170) dirty exists 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:430: left oid 50 (ObjNum 170 snap 51 seq_num 170) 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:431: finishing write tid 1 to trial14245205-1 2026-02-17T11:48:34.472 INFO:tasks.rados.rados.0.trial142.stdout:431: finishing write tid 2 to trial14245205-1 2026-02-17T11:48:34.473 INFO:tasks.rados.rados.0.trial142.stdout:431: finishing write tid 3 to trial14245205-1 2026-02-17T11:48:34.473 INFO:tasks.rados.rados.0.trial142.stdout:431: finishing write tid 4 to trial14245205-1 2026-02-17T11:48:34.473 INFO:tasks.rados.rados.0.trial142.stdout:431: finishing write tid 5 to trial14245205-1 2026-02-17T11:48:34.473 INFO:tasks.rados.rados.0.trial142.stdout:431: oid 1 updating version 0 to 100 2026-02-17T11:48:34.473 INFO:tasks.rados.rados.0.trial142.stdout:431: oid 1 updating version 100 to 103 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:431: oid 1 version 103 is already newer than 102 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:431: oid 1 version 103 is already newer than 101 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 103 (ObjNum 171 snap 51 seq_num 171) dirty exists 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:431: left oid 1 (ObjNum 171 snap 51 seq_num 171) 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:430: done (2 left) 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:431: done (1 left) 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:432: done (0 left) 2026-02-17T11:48:34.474 INFO:tasks.rados.rados.0.trial142.stdout:433: snap_remove snap 40 2026-02-17T11:48:35.912 INFO:tasks.rados.rados.0.trial142.stdout:433: done (0 left) 2026-02-17T11:48:35.912 INFO:tasks.rados.rados.0.trial142.stdout:434: snap_remove snap 34 2026-02-17T11:48:36.914 INFO:tasks.rados.rados.0.trial142.stdout:434: done (0 left) 2026-02-17T11:48:36.914 INFO:tasks.rados.rados.0.trial142.stdout:435: snap_remove snap 8 2026-02-17T11:48:37.914 INFO:tasks.rados.rados.0.trial142.stdout:435: done (0 left) 2026-02-17T11:48:37.914 INFO:tasks.rados.rados.0.trial142.stdout:436: write (excl) oid 5 current snap is 51 2026-02-17T11:48:37.914 INFO:tasks.rados.rados.0.trial142.stdout:436: seq_num 173 ranges {507611=777843,2073973=444721} 2026-02-17T11:48:37.920 INFO:tasks.rados.rados.0.trial142.stdout:436: writing trial14245205-5 from 507611 to 1285454 tid 1 2026-02-17T11:48:37.925 INFO:tasks.rados.rados.0.trial142.stdout:436: writing trial14245205-5 from 2073973 to 2518694 tid 2 2026-02-17T11:48:37.926 INFO:tasks.rados.rados.0.trial142.stdout:437: delete oid 13 current snap is 51 2026-02-17T11:48:37.926 INFO:tasks.rados.rados.0.trial142.stdout:436: finishing write tid 1 to trial14245205-5 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:437: done (1 left) 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:438: read oid 21 snap 49 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:438: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:439: read oid 23 snap -1 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:439: expect (ObjNum 88 snap 18 seq_num 88) 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:440: write (excl) oid 29 current snap is 51 2026-02-17T11:48:37.928 INFO:tasks.rados.rados.0.trial142.stdout:440: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-17T11:48:37.932 INFO:tasks.rados.rados.0.trial142.stdout:440: writing trial14245205-29 from 541225 to 1185919 tid 1 2026-02-17T11:48:37.937 INFO:tasks.rados.rados.0.trial142.stdout:440: writing trial14245205-29 from 1907290 to 2355680 tid 2 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:441: read oid 25 snap -1 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:441: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:442: snap_remove snap 9 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: finishing write tid 2 to trial14245205-5 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: finishing write tid 3 to trial14245205-5 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: finishing write tid 4 to trial14245205-5 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: oid 5 updating version 0 to 153 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: oid 5 updating version 153 to 155 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: oid 5 version 155 is already newer than 154 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 155 (ObjNum 173 snap 51 seq_num 173) dirty exists 2026-02-17T11:48:37.938 INFO:tasks.rados.rados.0.trial142.stdout:436: left oid 5 (ObjNum 173 snap 51 seq_num 173) 2026-02-17T11:48:37.939 INFO:tasks.rados.rados.0.trial142.stdout:438: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:37.986 INFO:tasks.rados.rados.0.trial142.stdout:439: expect (ObjNum 88 snap 18 seq_num 88) 2026-02-17T11:48:38.103 INFO:tasks.rados.rados.0.trial142.stdout:440: finishing write tid 1 to trial14245205-29 2026-02-17T11:48:38.919 INFO:tasks.rados.rados.0.trial142.stdout:436: done (5 left) 2026-02-17T11:48:38.919 INFO:tasks.rados.rados.0.trial142.stdout:438: done (4 left) 2026-02-17T11:48:38.919 INFO:tasks.rados.rados.0.trial142.stdout:439: done (3 left) 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:442: done (2 left) 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:443: copy_from oid 48 from oid 21 current snap is 51 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: finishing write tid 2 to trial14245205-29 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: finishing write tid 3 to trial14245205-29 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: finishing write tid 4 to trial14245205-29 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: oid 29 updating version 0 to 228 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: oid 29 version 228 is already newer than 227 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: oid 29 version 228 is already newer than 226 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 228 (ObjNum 175 snap 51 seq_num 175) dirty exists 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:440: left oid 29 (ObjNum 175 snap 51 seq_num 175) 2026-02-17T11:48:38.920 INFO:tasks.rados.rados.0.trial142.stdout:441: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:48:38.985 INFO:tasks.rados.rados.0.trial142.stdout:443: finishing copy_from racing read to trial14245205-48 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:443: finishing copy_from to trial14245205-48 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 185 (ObjNum 124 snap 32 seq_num 124) dirty exists 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:440: done (2 left) 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:441: done (1 left) 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:443: done (0 left) 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:444: read oid 34 snap -1 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:444: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:48:38.986 INFO:tasks.rados.rados.0.trial142.stdout:445: snap_remove snap 30 2026-02-17T11:48:39.372 INFO:tasks.rados.rados.0.trial142.stdout:445: done (1 left) 2026-02-17T11:48:39.372 INFO:tasks.rados.rados.0.trial142.stdout:446: copy_from oid 9 from oid 3 current snap is 51 2026-02-17T11:48:39.372 INFO:tasks.rados.rados.0.trial142.stdout:444: expect (ObjNum 75 snap 15 seq_num 75) 2026-02-17T11:48:39.508 INFO:tasks.rados.rados.0.trial142.stdout:446: finishing copy_from racing read to trial14245205-9 2026-02-17T11:48:39.508 INFO:tasks.rados.rados.0.trial142.stdout:446: finishing copy_from to trial14245205-9 2026-02-17T11:48:39.508 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 110 (ObjNum 164 snap 49 seq_num 164) dirty exists 2026-02-17T11:48:39.508 INFO:tasks.rados.rados.0.trial142.stdout:444: done (1 left) 2026-02-17T11:48:39.509 INFO:tasks.rados.rados.0.trial142.stdout:446: done (0 left) 2026-02-17T11:48:39.509 INFO:tasks.rados.rados.0.trial142.stdout:447: read oid 25 snap -1 2026-02-17T11:48:39.509 INFO:tasks.rados.rados.0.trial142.stdout:447: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:48:39.509 INFO:tasks.rados.rados.0.trial142.stdout:448: snap_remove snap 45 2026-02-17T11:48:40.727 INFO:tasks.rados.rados.0.trial142.stdout:448: done (1 left) 2026-02-17T11:48:40.727 INFO:tasks.rados.rados.0.trial142.stdout:449: copy_from oid 3 from oid 22 current snap is 51 2026-02-17T11:48:40.727 INFO:tasks.rados.rados.0.trial142.stdout:447: expect (ObjNum 126 snap 32 seq_num 126) 2026-02-17T11:48:40.791 INFO:tasks.rados.rados.0.trial142.stdout:449: finishing copy_from to trial14245205-3 2026-02-17T11:48:40.791 INFO:tasks.rados.rados.0.trial142.stdout:449: got expected ENOENT (src dne) 2026-02-17T11:48:40.792 INFO:tasks.rados.rados.0.trial142.stdout:449: finishing copy_from racing read to trial14245205-3 2026-02-17T11:48:40.792 INFO:tasks.rados.rados.0.trial142.stdout:447: done (1 left) 2026-02-17T11:48:40.792 INFO:tasks.rados.rados.0.trial142.stdout:449: done (0 left) 2026-02-17T11:48:40.792 INFO:tasks.rados.rados.0.trial142.stdout:450: write oid 11 current snap is 51 2026-02-17T11:48:40.792 INFO:tasks.rados.rados.0.trial142.stdout:450: seq_num 176 ranges {558032=719943,1849419=592048} 2026-02-17T11:48:40.796 INFO:tasks.rados.rados.0.trial142.stdout:450: writing trial14245205-11 from 558032 to 1277975 tid 1 2026-02-17T11:48:40.801 INFO:tasks.rados.rados.0.trial142.stdout:450: writing trial14245205-11 from 1849419 to 2441467 tid 2 2026-02-17T11:48:40.801 INFO:tasks.rados.rados.0.trial142.stdout:451: write (excl) oid 1 current snap is 51 2026-02-17T11:48:40.801 INFO:tasks.rados.rados.0.trial142.stdout:450: finishing write tid 1 to trial14245205-11 2026-02-17T11:48:40.801 INFO:tasks.rados.rados.0.trial142.stdout:451: seq_num 177 ranges {574839=795192,1907901=452059} 2026-02-17T11:48:40.806 INFO:tasks.rados.rados.0.trial142.stdout:451: writing trial14245205-1 from 574839 to 1370031 tid 1 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:451: writing trial14245205-1 from 1907901 to 2359960 tid 2 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:452: read oid 16 snap 47 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:452: expect (ObjNum 162 snap 47 seq_num 162) 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:453: delete oid 44 current snap is 51 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:450: finishing write tid 2 to trial14245205-11 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:450: finishing write tid 3 to trial14245205-11 2026-02-17T11:48:40.811 INFO:tasks.rados.rados.0.trial142.stdout:450: finishing write tid 4 to trial14245205-11 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:450: oid 11 updating version 0 to 92 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:450: oid 11 updating version 92 to 93 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:450: oid 11 updating version 93 to 94 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 94 (ObjNum 176 snap 51 seq_num 176) dirty exists 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:450: left oid 11 (ObjNum 176 snap 51 seq_num 176) 2026-02-17T11:48:40.812 INFO:tasks.rados.rados.0.trial142.stdout:451: finishing write tid 1 to trial14245205-1 2026-02-17T11:48:40.813 INFO:tasks.rados.rados.0.trial142.stdout:451: finishing write tid 2 to trial14245205-1 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: finishing write tid 3 to trial14245205-1 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: finishing write tid 4 to trial14245205-1 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: oid 1 updating version 0 to 128 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: oid 1 updating version 128 to 130 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: oid 1 version 130 is already newer than 129 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 130 (ObjNum 177 snap 51 seq_num 177) dirty exists 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: left oid 1 (ObjNum 177 snap 51 seq_num 177) 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:450: done (3 left) 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:451: done (2 left) 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:453: done (1 left) 2026-02-17T11:48:40.814 INFO:tasks.rados.rados.0.trial142.stdout:454: rollback oid 14 current snap is 51 2026-02-17T11:48:40.815 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 38 2026-02-17T11:48:40.815 INFO:tasks.rados.rados.0.trial142.stdout:455: snap_create 2026-02-17T11:48:40.815 INFO:tasks.rados.rados.0.trial142.stdout:454: finishing rollback tid 1 to trial14245205-14 2026-02-17T11:48:40.815 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 201 (ObjNum 129 snap 0 seq_num 1213887168) dirty dne 2026-02-17T11:48:40.816 INFO:tasks.rados.rados.0.trial142.stdout:452: expect (ObjNum 162 snap 47 seq_num 162) 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:452: done (2 left) 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:454: done (1 left) 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:455: done (0 left) 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:456: read oid 38 snap 48 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:456: expect (ObjNum 161 snap 45 seq_num 161) 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:457: copy_from oid 8 from oid 35 current snap is 52 2026-02-17T11:48:41.730 INFO:tasks.rados.rados.0.trial142.stdout:458: snap_remove snap 29 2026-02-17T11:48:42.731 INFO:tasks.rados.rados.0.trial142.stdout:458: done (2 left) 2026-02-17T11:48:42.731 INFO:tasks.rados.rados.0.trial142.stdout:459: rollback oid 2 current snap is 52 2026-02-17T11:48:42.731 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 43 2026-02-17T11:48:42.731 INFO:tasks.rados.rados.0.trial142.stdout:456: expect (ObjNum 161 snap 45 seq_num 161) 2026-02-17T11:48:42.797 INFO:tasks.rados.rados.0.trial142.stdout:457: finishing copy_from racing read to trial14245205-8 2026-02-17T11:48:42.797 INFO:tasks.rados.rados.0.trial142.stdout:456: done (2 left) 2026-02-17T11:48:42.797 INFO:tasks.rados.rados.0.trial142.stdout:460: write (excl) oid 22 current snap is 52 2026-02-17T11:48:42.797 INFO:tasks.rados.rados.0.trial142.stdout:460: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2026-02-17T11:48:42.801 INFO:tasks.rados.rados.0.trial142.stdout:460: writing trial14245205-22 from 608453 to 1154143 tid 1 2026-02-17T11:48:42.805 INFO:tasks.rados.rados.0.trial142.stdout:460: writing trial14245205-22 from 1624865 to 2080593 tid 2 2026-02-17T11:48:42.808 INFO:tasks.rados.rados.0.trial142.stdout:460: writing trial14245205-22 from 2632598 to 3008453 tid 3 2026-02-17T11:48:42.809 INFO:tasks.rados.rados.0.trial142.stdout:461: snap_remove snap 49 2026-02-17T11:48:43.735 INFO:tasks.rados.rados.0.trial142.stdout:461: done (3 left) 2026-02-17T11:48:43.735 INFO:tasks.rados.rados.0.trial142.stdout:462: copy_from oid 21 from oid 13 current snap is 52 2026-02-17T11:48:43.735 INFO:tasks.rados.rados.0.trial142.stdout:457: finishing copy_from to trial14245205-8 2026-02-17T11:48:43.735 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 32 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:48:43.735 INFO:tasks.rados.rados.0.trial142.stdout:459: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:459: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:459: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 215 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: finishing write tid 1 to trial14245205-22 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: finishing write tid 2 to trial14245205-22 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: finishing write tid 3 to trial14245205-22 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: finishing write tid 4 to trial14245205-22 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: finishing write tid 5 to trial14245205-22 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: oid 22 updating version 0 to 137 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: oid 22 version 137 is already newer than 136 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: oid 22 updating version 137 to 138 2026-02-17T11:48:43.736 INFO:tasks.rados.rados.0.trial142.stdout:460: oid 22 updating version 138 to 139 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 139 (ObjNum 179 snap 52 seq_num 179) dirty exists 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:460: left oid 22 (ObjNum 179 snap 52 seq_num 179) 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:457: done (3 left) 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:459: done (2 left) 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:460: done (1 left) 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:463: write (excl) oid 8 current snap is 52 2026-02-17T11:48:43.737 INFO:tasks.rados.rados.0.trial142.stdout:463: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2026-02-17T11:48:43.739 INFO:tasks.rados.rados.0.trial142.stdout:463: writing trial14245205-8 from 625260 to 1246199 tid 1 2026-02-17T11:48:43.743 INFO:tasks.rados.rados.0.trial142.stdout:463: writing trial14245205-8 from 1683347 to 2282733 tid 2 2026-02-17T11:48:43.746 INFO:tasks.rados.rados.0.trial142.stdout:463: writing trial14245205-8 from 2943668 to 3025260 tid 3 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:464: rollback oid 39 current snap is 52 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 48 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:462: finishing copy_from to trial14245205-21 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:462: got expected ENOENT (src dne) 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:462: finishing copy_from racing read to trial14245205-21 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:463: finishing write tid 1 to trial14245205-8 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:463: finishing write tid 2 to trial14245205-8 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:462: done (2 left) 2026-02-17T11:48:43.747 INFO:tasks.rados.rados.0.trial142.stdout:465: delete oid 49 current snap is 52 2026-02-17T11:48:43.748 INFO:tasks.rados.rados.0.trial142.stdout:463: finishing write tid 3 to trial14245205-8 2026-02-17T11:48:43.748 INFO:tasks.rados.rados.0.trial142.stdout:463: finishing write tid 4 to trial14245205-8 2026-02-17T11:48:43.748 INFO:tasks.rados.rados.0.trial142.stdout:463: finishing write tid 5 to trial14245205-8 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:463: oid 8 updating version 0 to 327 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:463: oid 8 updating version 327 to 328 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:463: oid 8 updating version 328 to 330 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:463: oid 8 version 330 is already newer than 329 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 330 (ObjNum 180 snap 52 seq_num 180) dirty exists 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:463: left oid 8 (ObjNum 180 snap 52 seq_num 180) 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:464: finishing rollback tid 0 to trial14245205-39 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:464: finishing rollback tid 1 to trial14245205-39 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:464: finishing rollback tid 2 to trial14245205-39 2026-02-17T11:48:43.749 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 217 (ObjNum 140 snap 38 seq_num 140) dirty exists 2026-02-17T11:48:43.750 INFO:tasks.rados.rados.0.trial142.stdout:463: done (2 left) 2026-02-17T11:48:43.750 INFO:tasks.rados.rados.0.trial142.stdout:464: done (1 left) 2026-02-17T11:48:43.750 INFO:tasks.rados.rados.0.trial142.stdout:465: done (0 left) 2026-02-17T11:48:43.750 INFO:tasks.rados.rados.0.trial142.stdout:466: write oid 41 current snap is 52 2026-02-17T11:48:43.750 INFO:tasks.rados.rados.0.trial142.stdout:466: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-17T11:48:43.755 INFO:tasks.rados.rados.0.trial142.stdout:466: writing trial14245205-41 from 658874 to 1430311 tid 1 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:466: writing trial14245205-41 from 2083958 to 2687013 tid 2 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:467: copy_from oid 11 from oid 42 current snap is 52 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:466: finishing write tid 1 to trial14245205-41 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:468: copy_from oid 46 from oid 37 current snap is 52 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:469: rollback oid 31 current snap is 52 2026-02-17T11:48:43.760 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 31 to 47 2026-02-17T11:48:43.761 INFO:tasks.rados.rados.0.trial142.stdout:470: snap_remove snap 43 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:470: done (4 left) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:471: copy_from oid 8 from oid 26 current snap is 52 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:469: finishing rollback tid 0 to trial14245205-31 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:469: finishing rollback tid 1 to trial14245205-31 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:469: finishing rollback tid 2 to trial14245205-31 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 334 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: finishing write tid 2 to trial14245205-41 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: finishing write tid 3 to trial14245205-41 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: finishing write tid 4 to trial14245205-41 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: oid 41 updating version 0 to 217 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: oid 41 updating version 217 to 218 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: oid 41 version 218 is already newer than 216 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 218 (ObjNum 182 snap 52 seq_num 182) dirty exists 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: left oid 41 (ObjNum 182 snap 52 seq_num 182) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:468: finishing copy_from racing read to trial14245205-46 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:467: finishing copy_from racing read to trial14245205-11 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:468: finishing copy_from to trial14245205-46 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 82 (ObjNum 157 snap 44 seq_num 157) dirty exists 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:467: finishing copy_from to trial14245205-11 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 191 (ObjNum 168 snap 51 seq_num 168) dirty exists 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:466: done (4 left) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:467: done (3 left) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:468: done (2 left) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:469: done (1 left) 2026-02-17T11:48:44.374 INFO:tasks.rados.rados.0.trial142.stdout:472: snap_create 2026-02-17T11:48:44.382 INFO:tasks.rados.rados.0.trial142.stdout:471: finishing copy_from racing read to trial14245205-8 2026-02-17T11:48:44.383 INFO:tasks.rados.rados.0.trial142.stdout:471: finishing copy_from to trial14245205-8 2026-02-17T11:48:44.383 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 59 (ObjNum 147 snap 40 seq_num 147) dirty exists 2026-02-17T11:48:45.373 INFO:tasks.rados.rados.0.trial142.stdout:471: done (1 left) 2026-02-17T11:48:45.374 INFO:tasks.rados.rados.0.trial142.stdout:472: done (0 left) 2026-02-17T11:48:45.374 INFO:tasks.rados.rados.0.trial142.stdout:473: snap_remove snap 50 2026-02-17T11:48:46.374 INFO:tasks.rados.rados.0.trial142.stdout:473: done (0 left) 2026-02-17T11:48:46.375 INFO:tasks.rados.rados.0.trial142.stdout:474: snap_remove snap 42 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:474: done (0 left) 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:475: read oid 16 snap 51 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:475: expect (ObjNum 166 snap 49 seq_num 166) 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:476: read oid 38 snap -1 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:476: expect (ObjNum 161 snap 45 seq_num 161) 2026-02-17T11:48:47.378 INFO:tasks.rados.rados.0.trial142.stdout:477: snap_create 2026-02-17T11:48:47.382 INFO:tasks.rados.rados.0.trial142.stdout:476: expect (ObjNum 161 snap 45 seq_num 161) 2026-02-17T11:48:47.450 INFO:tasks.rados.rados.0.trial142.stdout:475: expect (ObjNum 166 snap 49 seq_num 166) 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:475: done (2 left) 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:476: done (1 left) 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:477: done (0 left) 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:478: read oid 30 snap -1 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:478: expect deleted 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:479: read oid 48 snap -1 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:479: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:48.378 INFO:tasks.rados.rados.0.trial142.stdout:480: write (excl) oid 41 current snap is 54 2026-02-17T11:48:48.379 INFO:tasks.rados.rados.0.trial142.stdout:480: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2026-02-17T11:48:48.383 INFO:tasks.rados.rados.0.trial142.stdout:480: writing trial14245205-41 from 675681 to 1238720 tid 1 2026-02-17T11:48:48.388 INFO:tasks.rados.rados.0.trial142.stdout:480: writing trial14245205-41 from 1858793 to 2605506 tid 2 2026-02-17T11:48:48.390 INFO:tasks.rados.rados.0.trial142.stdout:480: writing trial14245205-41 from 3025937 to 3075681 tid 3 2026-02-17T11:48:48.390 INFO:tasks.rados.rados.0.trial142.stdout:481: read oid 29 snap -1 2026-02-17T11:48:48.390 INFO:tasks.rados.rados.0.trial142.stdout:481: expect (ObjNum 175 snap 51 seq_num 175) 2026-02-17T11:48:48.390 INFO:tasks.rados.rados.0.trial142.stdout:482: read oid 27 snap -1 2026-02-17T11:48:48.390 INFO:tasks.rados.rados.0.trial142.stdout:482: expect deleted 2026-02-17T11:48:48.391 INFO:tasks.rados.rados.0.trial142.stdout:483: snap_remove snap 46 2026-02-17T11:48:48.392 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:48:48.392 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T11:48:48.392 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:48:48.392 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T11:48:48.395 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:48:48.395 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:48:48.395 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:48.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.461+0000 7f76c01a9640 10 monclient: get_monmap_and_config 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.461+0000 7f76c01a9640 10 monclient: build_initial_monmap 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.461+0000 7f76c01a9640 10 monclient: monmap: 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:48.462886+0000 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:48.462886+0000 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.464 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:48.465 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:48.465 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:48.465 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:48.465 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 Processor -- start 2026-02-17T11:48:48.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 -- start start 2026-02-17T11:48:48.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient: init 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f76b809e370 0x7f76b809e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-c con 0x7f76b809e370 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-b con 0x7f76b809aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-a con 0x7f76b80994b0 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f76b809d600 con 0x7f76b80994b0 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f76b80a0980 con 0x7f76b809e370 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f76b806d8e0 con 0x7f76b809aa50 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76c01a9640 10 monclient(hunting): authenticate will time out at 816.081828s 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49796/0 (socket says 10.20.193.51:49796) 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53756/0 (socket says 10.20.193.51:53756) 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 1 -- 10.20.193.51:0/448187746 learned_addr learned my addr 10.20.193.51:0/448187746 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 10 monclient(hunting): get_auth_request con 0x7f76b809aa50 auth_method 0 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76bd71d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 10 monclient(hunting): get_auth_request con 0x7f76b80994b0 auth_method 0 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:48.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.462+0000 7f76be71f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76be71f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76be71f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76be71f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bdf1e640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.142:3300/0 conn(0x7f76b809e370 0x7f76b809e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bdf1e640 10 monclient(hunting): get_auth_request con 0x7f76b809e370 auth_method 0 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bdf1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bdf1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:48.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bdf1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient(hunting): handle_auth_done global_id 44285 payload 274 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 -- 10.20.193.51:0/448187746 >> v2:10.20.193.142:3300/0 conn(0x7f76b809e370 msgr2=0x7f76b809e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.142:3300/0 conn(0x7f76b809e370 0x7f76b809e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 -- 10.20.193.51:0/448187746 >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 msgr2=0x7f76b80998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient: _finish_hunting 0 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 monclient: found mon.noname-b 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76bd71d640 1 -- 10.20.193.51:0/448187746 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b809ff30 con 0x7f76b809aa50 2026-02-17T11:48:48.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.463+0000 7f76be71f640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bd71d640 1 -- 10.20.193.51:0/448187746 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 msgr2=0x7f76b809ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bd71d640 1 --2- 10.20.193.51:0/448187746 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76b80a0100 tx=0x7f76ac02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702480be98706dd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 1 -- 10.20.193.51:0/448187746 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac03c070 con 0x7f76b809aa50 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: dump: 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:48.481 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: _finish_auth 0 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: _check_auth_tickets 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:48.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76c01a9640 5 monclient: authenticate success, global_id 44285 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 1 -- 10.20.193.51:0/448187746 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac02fc90 con 0x7f76b809aa50 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76c01a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 1 -- 10.20.193.51:0/448187746 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac037660 con 0x7f76b809aa50 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76c01a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76c01a9640 4 set_mon_vals no callback set 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.465+0000 7f76bcf1c640 10 monclient: dump: 2026-02-17T11:48:48.483 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: shutdown 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:48.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- 10.20.193.51:0/448187746 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 msgr2=0x7f76b809ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- 10.20.193.51:0/448187746 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76b80a0100 tx=0x7f76ac02ee10 comp rx=0 tx=0).stop 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- 10.20.193.51:0/448187746 shutdown_connections 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.51:3300/0 conn(0x7f76b80994b0 0x7f76b80998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- 10.20.193.51:0/448187746 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b809ec90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- 10.20.193.51:0/448187746 >> v2:10.20.193.142:3300/0 conn(0x7f76b809e370 0x7f76b809e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- 10.20.193.51:0/448187746 >> 10.20.193.51:0/448187746 conn(0x7f76b80a30c0 msgr2=0x7f76b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- 10.20.193.51:0/448187746 shutdown_connections 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- 10.20.193.51:0/448187746 wait complete. 2026-02-17T11:48:48.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: build_initial_monmap 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: monmap: 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 Processor -- start 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- start start 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: init 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-a con 0x7f76b80994b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b813cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-c con 0x7f76b809aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76b809e370 0x7f76b813d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): picked mon.noname-b con 0x7f76b809e370 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:48.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80a06a0 con 0x7f76b80994b0 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f76b806e140 con 0x7f76b809e370 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f76b80a3e20 con 0x7f76b809aa50 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.466+0000 7f76c01a9640 10 monclient(hunting): authenticate will time out at 816.085959s 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b813cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53762/0 (socket says 10.20.193.51:53762) 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 -- 10.20.193.51:0/3621868152 learned_addr learned my addr 10.20.193.51:0/3621868152 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:48.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): get_auth_request con 0x7f76b80994b0 auth_method 0 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): get_auth_request con 0x7f76b809aa50 auth_method 0 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:48.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient(hunting): handle_auth_done global_id 34368 payload 824 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 -- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 msgr2=0x7f76b813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b813cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 -- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76b809e370 msgr2=0x7f76b813d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76b809e370 0x7f76b813d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient: _finish_hunting 0 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 monclient: found mon.noname-a 2026-02-17T11:48:48.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bdf1e640 1 -- 10.20.193.51:0/3621868152 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b80a2c80 con 0x7f76b80994b0 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.467+0000 7f76bd71d640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b813cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76bdf1e640 1 -- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 msgr2=0x7f76b80726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76bdf1e640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a800e7c0 tx=0x7f76a800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8017070 con 0x7f76b80994b0 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: dump: 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:48.491 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:48.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a800ca60 con 0x7f76b80994b0 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 5 monclient: authenticate success, global_id 34368 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 10 monclient: _renew_subs 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b809d7b0 con 0x7f76b80994b0 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a800f040 con 0x7f76b80994b0 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:48.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a67fc640 10 monclient: dump: 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:48.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76a7fff640 4 set_mon_vals no callback set 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 10 monclient: _renew_subs 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b80732b0 con 0x7f76b80994b0 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.469+0000 7f76c01a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76c01a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76c01a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b80998c0 con 0x7f76b80994b0 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f76a8012050 con 0x7f76b80994b0 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76a67fc640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 0x7f76880401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:48.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(129..129 src has 47..129) ==== 4799+0+0 (secure 0 0 0) 0x7f76a80523f0 con 0x7f76b80994b0 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76bd71d640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 0x7f76880401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.470+0000 7f76bd71d640 10 monclient: get_auth_request con 0x7f768803dd10 auth_method 0 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.472+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f76a8023d80 con 0x7f76b80994b0 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.472+0000 7f76a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.472+0000 7f76a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:48.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.473+0000 7f76bd71d640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 0x7f76880401d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f76ac036000 tx=0x7f76ac033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:48.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.585+0000 7f76c01a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:48.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76c01a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:48.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76c01a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:48.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f76b813eb00 con 0x7f76b80994b0 2026-02-17T11:48:48.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76a67fc640 1 -- 10.20.193.51:0/3621868152 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f76a8052080 con 0x7f76b80994b0 2026-02-17T11:48:48.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76a67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:48.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.586+0000 7f76a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:48.589 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:48.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 msgr2=0x7f76880401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 0x7f76880401d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f76ac036000 tx=0x7f76ac033000 comp rx=0 tx=0).stop 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 10 monclient: shutdown 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 msgr2=0x7f76b80726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a800e7c0 tx=0x7f76a800ec90 comp rx=0 tx=0).stop 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 shutdown_connections 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f768803dd10 0x7f76880401d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76b809e370 0x7f76b813d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f76b809aa50 0x7f76b813cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 --2- 10.20.193.51:0/3621868152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76b80994b0 0x7f76b80726a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:48.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 >> 10.20.193.51:0/3621868152 conn(0x7f76b80a30c0 msgr2=0x7f76b813bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:48.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 shutdown_connections 2026-02-17T11:48:48.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:48.587+0000 7f76c01a9640 1 -- 10.20.193.51:0/3621868152 wait complete. 2026-02-17T11:48:49.376 INFO:tasks.rados.rados.0.trial142.stdout:483: done (5 left) 2026-02-17T11:48:49.376 INFO:tasks.rados.rados.0.trial142.stdout:484: read oid 17 snap -1 2026-02-17T11:48:49.376 INFO:tasks.rados.rados.0.trial142.stdout:484: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:48:49.376 INFO:tasks.rados.rados.0.trial142.stdout:485: write (excl) oid 8 current snap is 54 2026-02-17T11:48:49.376 INFO:tasks.rados.rados.0.trial142.stdout:485: seq_num 184 ranges {692488=638288,1917275=606724} 2026-02-17T11:48:49.381 INFO:tasks.rados.rados.0.trial142.stdout:485: writing trial14245205-8 from 692488 to 1330776 tid 1 2026-02-17T11:48:49.385 INFO:tasks.rados.rados.0.trial142.stdout:485: writing trial14245205-8 from 1917275 to 2523999 tid 2 2026-02-17T11:48:49.386 INFO:tasks.rados.rados.0.trial142.stdout:486: snap_remove snap 48 2026-02-17T11:48:50.382 INFO:tasks.rados.rados.0.trial142.stdout:486: done (7 left) 2026-02-17T11:48:50.382 INFO:tasks.rados.rados.0.trial142.stdout:487: copy_from oid 4 from oid 2 current snap is 54 2026-02-17T11:48:50.382 INFO:tasks.rados.rados.0.trial142.stdout:479: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:50.431 INFO:tasks.rados.rados.0.trial142.stdout:480: finishing write tid 1 to trial14245205-41 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: finishing write tid 2 to trial14245205-41 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: finishing write tid 3 to trial14245205-41 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: finishing write tid 4 to trial14245205-41 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: finishing write tid 5 to trial14245205-41 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: oid 41 updating version 0 to 221 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: oid 41 version 221 is already newer than 220 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: oid 41 version 221 is already newer than 219 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: oid 41 updating version 221 to 222 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 222 (ObjNum 183 snap 54 seq_num 183) dirty exists 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:480: left oid 41 (ObjNum 183 snap 54 seq_num 183) 2026-02-17T11:48:50.432 INFO:tasks.rados.rados.0.trial142.stdout:481: expect (ObjNum 175 snap 51 seq_num 175) 2026-02-17T11:48:50.554 INFO:tasks.rados.rados.0.trial142.stdout:484: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:48:50.608 INFO:tasks.rados.rados.0.trial142.stdout:485: finishing write tid 1 to trial14245205-8 2026-02-17T11:48:50.608 INFO:tasks.rados.rados.0.trial142.stdout:485: finishing write tid 2 to trial14245205-8 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: finishing write tid 3 to trial14245205-8 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: finishing write tid 4 to trial14245205-8 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: oid 8 updating version 0 to 358 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: oid 8 version 358 is already newer than 357 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: oid 8 updating version 358 to 359 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 359 (ObjNum 184 snap 54 seq_num 184) dirty exists 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:485: left oid 8 (ObjNum 184 snap 54 seq_num 184) 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:487: finishing copy_from racing read to trial14245205-4 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:487: finishing copy_from to trial14245205-4 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 215 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:48:50.609 INFO:tasks.rados.rados.0.trial142.stdout:478: done (7 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:479: done (6 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:480: done (5 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:481: done (4 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:482: done (3 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:484: done (2 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:485: done (1 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:487: done (0 left) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:488: read oid 9 snap -1 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:488: expect (ObjNum 164 snap 49 seq_num 164) 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:489: rollback oid 15 current snap is 54 2026-02-17T11:48:50.610 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 35 2026-02-17T11:48:50.611 INFO:tasks.rados.rados.0.trial142.stdout:490: write oid 34 current snap is 54 2026-02-17T11:48:50.611 INFO:tasks.rados.rados.0.trial142.stdout:490: seq_num 185 ranges {709295=713537,1859404=750382} 2026-02-17T11:48:50.614 INFO:tasks.rados.rados.0.trial142.stdout:490: writing trial14245205-34 from 709295 to 1422832 tid 1 2026-02-17T11:48:50.619 INFO:tasks.rados.rados.0.trial142.stdout:490: writing trial14245205-34 from 1859404 to 2609786 tid 2 2026-02-17T11:48:50.619 INFO:tasks.rados.rados.0.trial142.stdout:491: write (excl) oid 25 current snap is 54 2026-02-17T11:48:50.619 INFO:tasks.rados.rados.0.trial142.stdout:489: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:48:50.619 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 0 (ObjNum 129 snap 0 seq_num 1213848040) dirty dne 2026-02-17T11:48:50.619 INFO:tasks.rados.rados.0.trial142.stdout:491: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2026-02-17T11:48:50.624 INFO:tasks.rados.rados.0.trial142.stdout:491: writing trial14245205-25 from 726102 to 1514888 tid 1 2026-02-17T11:48:50.628 INFO:tasks.rados.rados.0.trial142.stdout:491: writing trial14245205-25 from 1917886 to 2528279 tid 2 2026-02-17T11:48:50.630 INFO:tasks.rados.rados.0.trial142.stdout:491: writing trial14245205-25 from 3108206 to 3126102 tid 3 2026-02-17T11:48:50.630 INFO:tasks.rados.rados.0.trial142.stdout:489: done (3 left) 2026-02-17T11:48:50.630 INFO:tasks.rados.rados.0.trial142.stdout:492: delete oid 8 current snap is 54 2026-02-17T11:48:50.631 INFO:tasks.rados.rados.0.trial142.stdout:488: expect (ObjNum 164 snap 49 seq_num 164) 2026-02-17T11:48:50.716 INFO:tasks.rados.rados.0.trial142.stdout:490: finishing write tid 1 to trial14245205-34 2026-02-17T11:48:50.716 INFO:tasks.rados.rados.0.trial142.stdout:488: done (3 left) 2026-02-17T11:48:50.716 INFO:tasks.rados.rados.0.trial142.stdout:492: done (2 left) 2026-02-17T11:48:50.716 INFO:tasks.rados.rados.0.trial142.stdout:493: delete oid 10 current snap is 54 2026-02-17T11:48:50.716 INFO:tasks.rados.rados.0.trial142.stdout:490: finishing write tid 2 to trial14245205-34 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: finishing write tid 3 to trial14245205-34 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: finishing write tid 4 to trial14245205-34 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: oid 34 updating version 0 to 196 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: oid 34 version 196 is already newer than 195 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: oid 34 version 196 is already newer than 194 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 196 (ObjNum 185 snap 54 seq_num 185) dirty exists 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:490: left oid 34 (ObjNum 185 snap 54 seq_num 185) 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:491: finishing write tid 1 to trial14245205-25 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:491: finishing write tid 2 to trial14245205-25 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:491: finishing write tid 3 to trial14245205-25 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:491: finishing write tid 4 to trial14245205-25 2026-02-17T11:48:50.717 INFO:tasks.rados.rados.0.trial142.stdout:491: finishing write tid 5 to trial14245205-25 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: oid 25 updating version 0 to 131 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: oid 25 version 131 is already newer than 130 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: oid 25 version 131 is already newer than 128 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: oid 25 version 131 is already newer than 129 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 131 (ObjNum 186 snap 54 seq_num 186) dirty exists 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: left oid 25 (ObjNum 186 snap 54 seq_num 186) 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:490: done (2 left) 2026-02-17T11:48:50.718 INFO:tasks.rados.rados.0.trial142.stdout:491: done (1 left) 2026-02-17T11:48:50.719 INFO:tasks.rados.rados.0.trial142.stdout:493: done (0 left) 2026-02-17T11:48:50.719 INFO:tasks.rados.rados.0.trial142.stdout:494: delete oid 16 current snap is 54 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:494: done (0 left) 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:495: read oid 7 snap -1 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:495: expect (ObjNum 165 snap 49 seq_num 165) 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:496: read oid 24 snap -1 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:496: expect (ObjNum 116 snap 28 seq_num 116) 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:497: write (excl) oid 17 current snap is 54 2026-02-17T11:48:50.720 INFO:tasks.rados.rados.0.trial142.stdout:497: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2026-02-17T11:48:50.725 INFO:tasks.rados.rados.0.trial142.stdout:497: writing trial14245205-17 from 793330 to 1483112 tid 1 2026-02-17T11:48:50.729 INFO:tasks.rados.rados.0.trial142.stdout:497: writing trial14245205-17 from 2035461 to 2653192 tid 2 2026-02-17T11:48:50.731 INFO:tasks.rados.rados.0.trial142.stdout:497: writing trial14245205-17 from 3101545 to 3193330 tid 3 2026-02-17T11:48:50.731 INFO:tasks.rados.rados.0.trial142.stdout:498: read oid 32 snap 47 2026-02-17T11:48:50.731 INFO:tasks.rados.rados.0.trial142.stdout:498: expect deleted 2026-02-17T11:48:50.732 INFO:tasks.rados.rados.0.trial142.stdout:499: snap_remove snap 52 2026-02-17T11:48:51.386 INFO:tasks.rados.rados.0.trial142.stdout:499: done (4 left) 2026-02-17T11:48:51.386 INFO:tasks.rados.rados.0.trial142.stdout:500: delete oid 4 current snap is 54 2026-02-17T11:48:51.386 INFO:tasks.rados.rados.0.trial142.stdout:495: expect (ObjNum 165 snap 49 seq_num 165) 2026-02-17T11:48:51.476 INFO:tasks.rados.rados.0.trial142.stdout:496: expect (ObjNum 116 snap 28 seq_num 116) 2026-02-17T11:48:51.571 INFO:tasks.rados.rados.0.trial142.stdout:497: finishing write tid 1 to trial14245205-17 2026-02-17T11:48:51.571 INFO:tasks.rados.rados.0.trial142.stdout:497: finishing write tid 2 to trial14245205-17 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: finishing write tid 3 to trial14245205-17 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: finishing write tid 4 to trial14245205-17 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: finishing write tid 5 to trial14245205-17 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: oid 17 updating version 0 to 202 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: oid 17 updating version 202 to 203 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: oid 17 version 203 is already newer than 201 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: oid 17 updating version 203 to 204 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 204 (ObjNum 190 snap 54 seq_num 190) dirty exists 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:497: left oid 17 (ObjNum 190 snap 54 seq_num 190) 2026-02-17T11:48:51.572 INFO:tasks.rados.rados.0.trial142.stdout:495: done (4 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:496: done (3 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:497: done (2 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:498: done (1 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:500: done (0 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:501: delete oid 12 current snap is 54 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:501: done (0 left) 2026-02-17T11:48:51.573 INFO:tasks.rados.rados.0.trial142.stdout:502: snap_create 2026-02-17T11:48:51.597 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:51.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.664+0000 7f5b32dcc640 10 monclient: get_monmap_and_config 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.664+0000 7f5b32dcc640 10 monclient: build_initial_monmap 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient: monmap: 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:51.665956+0000 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:51.665956+0000 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.670 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 Processor -- start 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 -- start start 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient: init 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:51.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-b con 0x7f5b2c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f5b2c09d270 0x7f5b2c138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-c con 0x7f5b2c09d270 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b2c1385b0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2c135430 con 0x7f5b2c1385b0 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c09a5c0 con 0x7f5b2c09d270 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:51.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c09b520 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b32dcc640 10 monclient(hunting): authenticate will time out at 819.284775s 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b31342640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f5b2c1385b0 0x7f5b2c13f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37108/0 (socket says 10.20.193.51:37108) 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b31342640 1 -- 10.20.193.51:0/3063415169 learned_addr learned my addr 10.20.193.51:0/3063415169 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49830/0 (socket says 10.20.193.51:49830) 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): get_auth_request con 0x7f5b2c0a3bb0 auth_method 0 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:51.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.665+0000 7f5b23fff640 1 --2- 10.20.193.51:0/3063415169 >> v2:10.20.193.142:3300/0 conn(0x7f5b2c09d270 0x7f5b2c138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b23fff640 10 monclient(hunting): get_auth_request con 0x7f5b2c09d270 auth_method 0 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 10 monclient(hunting): handle_auth_done global_id 44291 payload 274 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 1 -- 10.20.193.51:0/3063415169 >> v2:10.20.193.142:3300/0 conn(0x7f5b2c09d270 msgr2=0x7f5b2c138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3063415169 >> v2:10.20.193.142:3300/0 conn(0x7f5b2c09d270 0x7f5b2c138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 1 -- 10.20.193.51:0/3063415169 >> v1:10.20.193.51:6789/0 conn(0x7f5b2c1385b0 legacy=0x7f5b2c13f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:51.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 10 monclient: _finish_hunting 0 2026-02-17T11:48:51.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 1 monclient: found mon.noname-b 2026-02-17T11:48:51.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:51.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.666+0000 7f5b30b41640 1 -- 10.20.193.51:0/3063415169 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c09af60 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b30b41640 1 -- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 msgr2=0x7f5b2c09cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0098a0 tx=0x7f5b1c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70912af7d2f50f66 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 1 -- 10.20.193.51:0/3063415169 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c03c070 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: dump: 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.682 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: _finish_auth 0 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 1 -- 10.20.193.51:0/3063415169 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c02fc00 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b32dcc640 5 monclient: authenticate success, global_id 44291 2026-02-17T11:48:51.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b32dcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 1 -- 10.20.193.51:0/3063415169 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c037440 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b237fe640 10 monclient: dump: 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:51.684 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b32dcc640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.668+0000 7f5b32dcc640 4 set_mon_vals no callback set 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 10 monclient: shutdown 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 msgr2=0x7f5b2c09cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0098a0 tx=0x7f5b1c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3063415169 shutdown_connections 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3063415169 >> v2:10.20.193.142:3300/0 conn(0x7f5b2c09d270 0x7f5b2c138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3063415169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c0a3bb0 0x7f5b2c09cd30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3063415169 >> 10.20.193.51:0/3063415169 conn(0x7f5b2c0a30c0 msgr2=0x7f5b2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3063415169 shutdown_connections 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3063415169 wait complete. 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 10 monclient: build_initial_monmap 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 10 monclient: monmap: 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:51.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 Processor -- start 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 1 -- start start 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.669+0000 7f5b32dcc640 10 monclient: init 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:51.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-c con 0x7f5b2c09d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b2c0a3bb0 0x7f5b2c1cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-b con 0x7f5b2c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b2c1385b0 0x7f5b2c1d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): picked mon.noname-a con 0x7f5b2c1385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c074ac0 con 0x7f5b2c1385b0 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c0a3f90 con 0x7f5b2c0a3bb0 2026-02-17T11:48:51.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c135040 con 0x7f5b2c09d270 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b32dcc640 10 monclient(hunting): authenticate will time out at 819.289075s 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49832/0 (socket says 10.20.193.51:49832) 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 -- 10.20.193.51:0/3221568884 learned_addr learned my addr 10.20.193.51:0/3221568884 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b2c1385b0 0x7f5b2c1d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): get_auth_request con 0x7f5b2c09d270 auth_method 0 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:51.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): get_auth_request con 0x7f5b2c1385b0 auth_method 0 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b31342640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:51.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b23fff640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b2c0a3bb0 0x7f5b2c1cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient(hunting): handle_auth_done global_id 44294 payload 824 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 -- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b2c0a3bb0 msgr2=0x7f5b2c1cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b2c0a3bb0 0x7f5b2c1cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 -- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b2c1385b0 msgr2=0x7f5b2c1d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b2c1385b0 0x7f5b2c1d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient: _finish_hunting 0 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 monclient: found mon.noname-c 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.670+0000 7f5b30b41640 1 -- 10.20.193.51:0/3221568884 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c09d7b0 con 0x7f5b2c09d270 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b30b41640 1 -- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 msgr2=0x7f5b2c1cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b30b41640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0099d0 tx=0x7f5b1c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c03c040 con 0x7f5b2c09d270 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: dump: 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:51.692 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: _finish_auth 0 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: _check_auth_tickets 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 5 monclient: authenticate success, global_id 44294 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c047070 con 0x7f5b2c09d270 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 10 monclient: _renew_subs 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c130a80 con 0x7f5b2c09d270 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c040a40 con 0x7f5b2c09d270 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b22ffd640 4 set_mon_vals no callback set 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b217fa640 10 monclient: dump: 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:51.694 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 10 monclient: _renew_subs 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.672+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c131ab0 con 0x7f5b2c09d270 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b32dcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5b1c03f030 con 0x7f5b2c09d270 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b32dcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b32dcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c134790 con 0x7f5b2c09d270 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b217fa640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 0x7f5afc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:51.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(132..132 src has 47..132) ==== 4827+0+0 (secure 0 0 0) 0x7f5b1c077900 con 0x7f5b2c09d270 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b23fff640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 0x7f5afc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.673+0000 7f5b23fff640 10 monclient: get_auth_request con 0x7f5afc03dd10 auth_method 0 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.676+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b2c134790 con 0x7f5b2c09d270 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.676+0000 7f5b217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.676+0000 7f5b217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:51.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.676+0000 7f5b23fff640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 0x7f5afc0401d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006fd0 tx=0x7f5b14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.794+0000 7f5b32dcc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.794+0000 7f5b32dcc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.794+0000 7f5b32dcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.794+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5b2c0a18e0 con 0x7f5b2c09d270 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.795+0000 7f5b217fa640 1 -- 10.20.193.51:0/3221568884 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f5b2c0a18e0 con 0x7f5b2c09d270 2026-02-17T11:48:51.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.795+0000 7f5b217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:51.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.795+0000 7f5b217fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:51.798 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:51.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 msgr2=0x7f5afc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:51.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 0x7f5afc0401d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006fd0 tx=0x7f5b14008040 comp rx=0 tx=0).stop 2026-02-17T11:48:51.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 10 monclient: shutdown 2026-02-17T11:48:51.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:51.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 msgr2=0x7f5b2c1cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0099d0 tx=0x7f5b1c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 shutdown_connections 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5afc03dd10 0x7f5afc0401d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b2c1385b0 0x7f5b2c1d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b2c0a3bb0 0x7f5b2c1cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 --2- 10.20.193.51:0/3221568884 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b2c09d270 0x7f5b2c1cf7c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 >> 10.20.193.51:0/3221568884 conn(0x7f5b2c0a30c0 msgr2=0x7f5b2c0a1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 shutdown_connections 2026-02-17T11:48:51.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:51.796+0000 7f5b32dcc640 1 -- 10.20.193.51:0/3221568884 wait complete. 2026-02-17T11:48:52.391 INFO:tasks.rados.rados.0.trial142.stdout:502: done (0 left) 2026-02-17T11:48:52.392 INFO:tasks.rados.rados.0.trial142.stdout:503: read oid 28 snap -1 2026-02-17T11:48:52.392 INFO:tasks.rados.rados.0.trial142.stdout:503: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:48:52.392 INFO:tasks.rados.rados.0.trial142.stdout:504: delete oid 46 current snap is 55 2026-02-17T11:48:52.393 INFO:tasks.rados.rados.0.trial142.stdout:504: done (1 left) 2026-02-17T11:48:52.393 INFO:tasks.rados.rados.0.trial142.stdout:505: snap_create 2026-02-17T11:48:52.395 INFO:tasks.rados.rados.0.trial142.stdout:503: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:48:53.393 INFO:tasks.rados.rados.0.trial142.stdout:503: done (1 left) 2026-02-17T11:48:53.393 INFO:tasks.rados.rados.0.trial142.stdout:505: done (0 left) 2026-02-17T11:48:53.394 INFO:tasks.rados.rados.0.trial142.stdout:506: snap_remove snap 54 2026-02-17T11:48:54.374 INFO:tasks.rados.rados.0.trial142.stdout:506: done (0 left) 2026-02-17T11:48:54.374 INFO:tasks.rados.rados.0.trial142.stdout:507: rollback oid 38 current snap is 56 2026-02-17T11:48:54.374 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 53 2026-02-17T11:48:54.374 INFO:tasks.rados.rados.0.trial142.stdout:508: delete oid 21 current snap is 56 2026-02-17T11:48:54.376 INFO:tasks.rados.rados.0.trial142.stdout:508: done (1 left) 2026-02-17T11:48:54.377 INFO:tasks.rados.rados.0.trial142.stdout:509: write oid 47 current snap is 56 2026-02-17T11:48:54.377 INFO:tasks.rados.rados.0.trial142.stdout:509: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2026-02-17T11:48:54.381 INFO:tasks.rados.rados.0.trial142.stdout:509: writing trial14245205-47 from 477365 to 1259745 tid 1 2026-02-17T11:48:54.387 INFO:tasks.rados.rados.0.trial142.stdout:509: writing trial14245205-47 from 1927871 to 2696598 tid 2 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:509: writing trial14245205-47 from 3122307 to 3277365 tid 3 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:510: rollback oid 2 current snap is 56 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 47 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:507: finishing rollback tid 0 to trial14245205-38 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:507: finishing rollback tid 1 to trial14245205-38 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:507: finishing rollback tid 2 to trial14245205-38 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 41 (ObjNum 161 snap 45 seq_num 161) dirty exists 2026-02-17T11:48:54.392 INFO:tasks.rados.rados.0.trial142.stdout:509: finishing write tid 1 to trial14245205-47 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:509: finishing write tid 2 to trial14245205-47 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:507: done (2 left) 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:511: read oid 44 snap -1 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:511: expect deleted 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:512: read oid 49 snap -1 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:512: expect deleted 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:513: rollback oid 33 current snap is 56 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 38 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:514: delete oid 22 current snap is 56 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:513: finishing rollback tid 1 to trial14245205-33 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 0 (ObjNum 929 snap 0 seq_num 1213688080) dirty dne 2026-02-17T11:48:54.393 INFO:tasks.rados.rados.0.trial142.stdout:509: finishing write tid 3 to trial14245205-47 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: finishing write tid 4 to trial14245205-47 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: finishing write tid 5 to trial14245205-47 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: oid 47 updating version 0 to 241 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: oid 47 version 241 is already newer than 240 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: oid 47 version 241 is already newer than 238 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: oid 47 version 241 is already newer than 239 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 241 (ObjNum 195 snap 56 seq_num 195) dirty exists 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: left oid 47 (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:510: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:509: done (5 left) 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:511: done (4 left) 2026-02-17T11:48:54.394 INFO:tasks.rados.rados.0.trial142.stdout:512: done (3 left) 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:513: done (2 left) 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:514: done (1 left) 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:515: copy_from oid 39 from oid 14 current snap is 56 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:516: snap_create 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:510: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:510: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:48:54.395 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 225 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:48:54.396 INFO:tasks.rados.rados.0.trial142.stdout:515: finishing copy_from to trial14245205-39 2026-02-17T11:48:54.396 INFO:tasks.rados.rados.0.trial142.stdout:515: got expected ENOENT (src dne) 2026-02-17T11:48:54.396 INFO:tasks.rados.rados.0.trial142.stdout:515: finishing copy_from racing read to trial14245205-39 2026-02-17T11:48:54.806 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.871+0000 7f3783985640 10 monclient: get_monmap_and_config 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.871+0000 7f3783985640 10 monclient: build_initial_monmap 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.871+0000 7f3783985640 10 monclient: monmap: 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:54.872760+0000 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:54.872760+0000 2026-02-17T11:48:54.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 Processor -- start 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 -- start start 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient: init 2026-02-17T11:48:54.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f377c138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f377c0a35a0 0x7f377c13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): picked mon.noname-c con 0x7f377c0a35a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): picked mon.noname-b con 0x7f377c13d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c0a1df0 con 0x7f377c138600 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f377c0a6830 con 0x7f377c0a35a0 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:54.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f377c0a2c00 con 0x7f377c13d8a0 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3783985640 10 monclient(hunting): authenticate will time out at 822.491665s 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49840/0 (socket says 10.20.193.51:49840) 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 -- 10.20.193.51:0/580778939 learned_addr learned my addr 10.20.193.51:0/580778939 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): get_auth_request con 0x7f377c13d8a0 auth_method 0 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:54.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3780ef9640 1 --2- 10.20.193.51:0/580778939 >> v2:10.20.193.142:3300/0 conn(0x7f377c0a35a0 0x7f377c13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient(hunting): handle_auth_done global_id 44297 payload 274 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 -- 10.20.193.51:0/580778939 >> v2:10.20.193.142:3300/0 conn(0x7f377c0a35a0 msgr2=0x7f377c13d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 --2- 10.20.193.51:0/580778939 >> v2:10.20.193.142:3300/0 conn(0x7f377c0a35a0 0x7f377c13d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 -- 10.20.193.51:0/580778939 >> v1:10.20.193.142:6789/0 conn(0x7f377c138600 legacy=0x7f377c1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient: _finish_hunting 0 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 monclient: found mon.noname-b 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.872+0000 7f3781efb640 1 -- 10.20.193.51:0/580778939 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c0a65b0 con 0x7f377c13d8a0 2026-02-17T11:48:54.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3781efb640 1 -- 10.20.193.51:0/580778939 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 msgr2=0x7f377c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3781efb640 1 --2- 10.20.193.51:0/580778939 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f377c0a2d80 tx=0x7f377802f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a2b008a91ce025 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 1 -- 10.20.193.51:0/580778939 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780373f0 con 0x7f377c13d8a0 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: dump: 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: _finish_auth 0 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 1 -- 10.20.193.51:0/580778939 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3778037590 con 0x7f377c13d8a0 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 5 monclient: authenticate success, global_id 44297 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 1 -- 10.20.193.51:0/580778939 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778037960 con 0x7f377c13d8a0 2026-02-17T11:48:54.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 4 set_mon_vals no callback set 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f376bfff640 10 monclient: dump: 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:54.889 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 10 monclient: shutdown 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 -- 10.20.193.51:0/580778939 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 msgr2=0x7f377c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 --2- 10.20.193.51:0/580778939 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f377c0a2d80 tx=0x7f377802f200 comp rx=0 tx=0).stop 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 -- 10.20.193.51:0/580778939 shutdown_connections 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 --2- 10.20.193.51:0/580778939 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c13fc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:54.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 --2- 10.20.193.51:0/580778939 >> v2:10.20.193.142:3300/0 conn(0x7f377c0a35a0 0x7f377c13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 -- 10.20.193.51:0/580778939 >> 10.20.193.51:0/580778939 conn(0x7f377c0a7460 msgr2=0x7f377c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 -- 10.20.193.51:0/580778939 shutdown_connections 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.875+0000 7f3783985640 1 -- 10.20.193.51:0/580778939 wait complete. 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient: build_initial_monmap 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient: monmap: 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.891 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 Processor -- start 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 -- start start 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient: init 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f377c0a35a0 0x7f377c1cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): picked mon.noname-b con 0x7f377c0a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 0x7f377c1373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): picked mon.noname-a con 0x7f377c138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): picked mon.noname-c con 0x7f377c13d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f377c0a15f0 con 0x7f377c138600 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f377c0a25b0 con 0x7f377c0a35a0 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f377c0a1770 con 0x7f377c13d8a0 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3783985640 10 monclient(hunting): authenticate will time out at 822.495819s 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 0x7f377c1373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49842/0 (socket says 10.20.193.51:49842) 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 0x7f377c1373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53782/0 (socket says 10.20.193.51:53782) 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 1 -- 10.20.193.51:0/2180825498 learned_addr learned my addr 10.20.193.51:0/2180825498 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): get_auth_request con 0x7f377c13d8a0 auth_method 0 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): get_auth_request con 0x7f377c138600 auth_method 0 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:54.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3781efb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f37816fa640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f377c0a35a0 0x7f377c1cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f3780ef9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f37816fa640 10 monclient(hunting): get_auth_request con 0x7f377c0a35a0 auth_method 0 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f37816fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f37816fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.876+0000 7f37816fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 10 monclient(hunting): handle_auth_done global_id 44300 payload 824 2026-02-17T11:48:54.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 -- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f377c0a35a0 msgr2=0x7f377c1cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f377c0a35a0 0x7f377c1cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 -- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 msgr2=0x7f377c1373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 0x7f377c1373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 10 monclient: _finish_hunting 0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 monclient: found mon.noname-c 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.877+0000 7f3781efb640 1 -- 10.20.193.51:0/2180825498 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c121d60 con 0x7f377c13d8a0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3781efb640 1 -- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 msgr2=0x7f377c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3781efb640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3778039040 tx=0x7f3778004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778047020 con 0x7f377c13d8a0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:54.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: dump: 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: _finish_auth 0 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3778007d60 con 0x7f377c13d8a0 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780373f0 con 0x7f377c13d8a0 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 10 monclient: dump: 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.898 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f376b7fe640 4 set_mon_vals no callback set 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 5 monclient: authenticate success, global_id 44300 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _renew_subs 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c0a8860 con 0x7f377c13d8a0 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _renew_subs 2026-02-17T11:48:54.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c121040 con 0x7f377c13d8a0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377c1389e0 con 0x7f377c13d8a0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.879+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f37780436b0 con 0x7f377c13d8a0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.880+0000 7f3769ffb640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 0x7f374c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.880+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(135..135 src has 47..135) ==== 4843+0+0 (secure 0 0 0) 0x7f3778078660 con 0x7f377c13d8a0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.880+0000 7f37816fa640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 0x7f374c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.880+0000 7f37816fa640 10 monclient: get_auth_request con 0x7f374c03dd60 auth_method 0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.882+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3778051070 con 0x7f377c13d8a0 2026-02-17T11:48:54.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.882+0000 7f3769ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:54.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.882+0000 7f3769ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:54.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.883+0000 7f37816fa640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 0x7f374c040220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f377c074d30 tx=0x7f376c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:54.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3783985640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3783985640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3783985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f377c0a1ae0 con 0x7f377c13d8a0 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3769ffb640 1 -- 10.20.193.51:0/2180825498 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f37780439d0 con 0x7f377c13d8a0 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3769ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:48:54.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.996+0000 7f3769ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:55.000 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 msgr2=0x7f374c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 0x7f374c040220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f377c074d30 tx=0x7f376c009040 comp rx=0 tx=0).stop 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 10 monclient: shutdown 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 msgr2=0x7f377c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3778039040 tx=0x7f3778004b40 comp rx=0 tx=0).stop 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 shutdown_connections 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f374c03dd60 0x7f374c040220 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f377c13d8a0 0x7f377c071b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f377c138600 0x7f377c1373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 --2- 10.20.193.51:0/2180825498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f377c0a35a0 0x7f377c1cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 >> 10.20.193.51:0/2180825498 conn(0x7f377c0a7460 msgr2=0x7f377c13dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 shutdown_connections 2026-02-17T11:48:55.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:54.997+0000 7f3783985640 1 -- 10.20.193.51:0/2180825498 wait complete. 2026-02-17T11:48:55.007 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:48:55.007 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:48:55.008 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:48:55.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 10 monclient: get_monmap_and_config 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 10 monclient: monmap: 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:55.074326+0000 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:55.074326+0000 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.077 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 1 Processor -- start 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 1 -- start start 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.073+0000 7fb50c9be640 10 monclient: init 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-17T11:48:55.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb5040a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5040a0750 0x7fb50409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-a con 0x7fb5040a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb50413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50406e140 con 0x7fb50413b760 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50409f910 con 0x7fb5040a3bb0 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb50409ccd0 con 0x7fb5040a0750 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50c9be640 10 monclient(hunting): authenticate will time out at 822.693076s 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5040a0750 0x7fb50409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50af34640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb50413b760 0x7fb50413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37118/0 (socket says 10.20.193.51:37118) 2026-02-17T11:48:55.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb50af34640 1 -- 10.20.193.51:0/129878910 learned_addr learned my addr 10.20.193.51:0/129878910 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): get_auth_request con 0x7fb5040a0750 auth_method 0 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient(hunting): handle_auth_done global_id 34377 payload 274 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 1 -- 10.20.193.51:0/129878910 >> v1:10.20.193.142:6789/0 conn(0x7fb5040a3bb0 legacy=0x7fb50409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 1 -- 10.20.193.51:0/129878910 >> v1:10.20.193.51:6789/0 conn(0x7fb50413b760 legacy=0x7fb50413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 1 monclient: found mon.noname-a 2026-02-17T11:48:55.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.074+0000 7fb509f32640 1 -- 10.20.193.51:0/129878910 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50409eec0 con 0x7fb5040a0750 2026-02-17T11:48:55.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.076+0000 7fb509f32640 1 -- 10.20.193.51:0/129878910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a0750 msgr2=0x7fb50409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.076+0000 7fb509f32640 1 --2- 10.20.193.51:0/129878910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a0750 0x7fb50409e1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098a0 tx=0x7fb4f002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8f1ad9281cd555 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 1 -- 10.20.193.51:0/129878910 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f003c070 con 0x7fb5040a0750 2026-02-17T11:48:55.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: dump: 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 1 -- 10.20.193.51:0/129878910 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f002fce0 con 0x7fb5040a0750 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 1 -- 10.20.193.51:0/129878910 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0037660 con 0x7fb5040a0750 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb509731640 10 monclient: dump: 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.091 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 5 monclient: authenticate success, global_id 34377 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 4 set_mon_vals no callback set 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 10 monclient: shutdown 2026-02-17T11:48:55.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 -- 10.20.193.51:0/129878910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a0750 msgr2=0x7fb50409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 --2- 10.20.193.51:0/129878910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a0750 0x7fb50409e1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098a0 tx=0x7fb4f002ed80 comp rx=0 tx=0).stop 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 -- 10.20.193.51:0/129878910 shutdown_connections 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 --2- 10.20.193.51:0/129878910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a0750 0x7fb50409e1d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 -- 10.20.193.51:0/129878910 >> 10.20.193.51:0/129878910 conn(0x7fb5040a30c0 msgr2=0x7fb5040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 -- 10.20.193.51:0/129878910 shutdown_connections 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 1 -- 10.20.193.51:0/129878910 wait complete. 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.077+0000 7fb50c9be640 10 monclient: monmap: 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:55.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 Processor -- start 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 -- start start 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient: init 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5040a0750 0x7fb5041cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-b con 0x7fb5040a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-a con 0x7fb5040a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb50413b760 0x7fb50409ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): picked mon.noname-c con 0x7fb50413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040a04b0 con 0x7fb5040a3bb0 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb50409c850 con 0x7fb5040a0750 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb50409e710 con 0x7fb50413b760 2026-02-17T11:48:55.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50c9be640 10 monclient(hunting): authenticate will time out at 822.697317s 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53800/0 (socket says 10.20.193.51:53800) 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 -- 10.20.193.51:0/1748095792 learned_addr learned my addr 10.20.193.51:0/1748095792 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): get_auth_request con 0x7fb5040a3bb0 auth_method 0 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb50413b760 0x7fb50409ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 10 monclient(hunting): get_auth_request con 0x7fb50413b760 auth_method 0 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50a733640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5040a0750 0x7fb5041cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50a733640 10 monclient(hunting): get_auth_request con 0x7fb5040a0750 auth_method 0 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50a733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50a733640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50a733640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient(hunting): handle_auth_done global_id 34380 payload 824 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb50413b760 msgr2=0x7fb50409ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb50413b760 0x7fb50409ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5040a0750 msgr2=0x7fb5041cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5040a0750 0x7fb5041cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 monclient: found mon.noname-a 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb509f32640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50406f6c0 con 0x7fb5040a3bb0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.078+0000 7fb50af34640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb50413b760 0x7fb50409ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb509f32640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 msgr2=0x7fb50409a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb509f32640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00099d0 tx=0x7fb4f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0047020 con 0x7fb5040a3bb0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:55.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: dump: 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f0042670 con 0x7fb5040a3bb0 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f003c040 con 0x7fb5040a3bb0 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb4eeffd640 10 monclient: dump: 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb508f30640 4 set_mon_vals no callback set 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 5 monclient: authenticate success, global_id 34380 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 10 monclient: _renew_subs 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5040a28c0 con 0x7fb5040a3bb0 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 10 monclient: _renew_subs 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.080+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb504133e60 con 0x7fb5040a3bb0 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50c9be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50c9be640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 0x7fb50409b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb50409d840 con 0x7fb504134030 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 0x7fb50409b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient: get_auth_request con 0x7fb504134030 auth_method 0 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb4f0042a60 con 0x7fb5040a3bb0 2026-02-17T11:48:55.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 10 monclient(hunting): handle_auth_done global_id 34383 payload 824 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50a733640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb50409dac0 con 0x7fb504134030 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb4eeffd640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4d403dd60 0x7fb4d4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(135..135 src has 47..135) ==== 4843+0+0 (secure 0 0 0) 0x7fb4f0077dd0 con 0x7fb5040a3bb0 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50af34640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4d403dd60 0x7fb4d4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.081+0000 7fb50af34640 10 monclient: get_auth_request con 0x7fb4d403dd60 auth_method 0 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb50a733640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 msgr2=0x7fb50409b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb50a733640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 0x7fb50409b040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc006ae0 con 0x7fb504134030 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 10 monclient: dump: 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb4fc006ae0 con 0x7fb504134030 2026-02-17T11:48:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 msgr2=0x7fb50409b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 0x7fb50409b040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc00ec00 comp rx=0 tx=0).stop 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 msgr2=0x7fb50409b040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.083+0000 7fb4eeffd640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb504134030 0x7fb50409b040 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc00ec00 comp rx=0 tx=0).stop 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.084+0000 7fb50af34640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4d403dd60 0x7fb4d4040220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb50406dab0 tx=0x7fb4f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50c9be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50c9be640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 0x7fb5041daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50c9be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb5041335c0 con 0x7fb5041d0360 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 0x7fb5041daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient: get_auth_request con 0x7fb5041d0360 auth_method 0 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 10 monclient(hunting): handle_auth_done global_id 34386 payload 824 2026-02-17T11:48:55.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.087+0000 7fb50a733640 1 -- 10.20.193.51:0/1748095792 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb50409c0a0 con 0x7fb5041d0360 2026-02-17T11:48:55.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50a733640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 msgr2=0x7fb5041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50a733640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 0x7fb5041daad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00c930 con 0x7fb5041d0360 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 10 monclient: dump: 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.108 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fb4fc00c930 con 0x7fb5041d0360 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 msgr2=0x7fb5041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 0x7fb5041daad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc003860 comp rx=0 tx=0).stop 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 msgr2=0x7fb5041daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb4eeffd640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5041d0360 0x7fb5041daad0 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e730 tx=0x7fb4fc003860 comp rx=0 tx=0).stop 2026-02-17T11:48:55.109 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 155735, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:48:55.110 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.111 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.112 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:55.113 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.114 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.115 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:55.116 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.117 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:55.118 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:55.119 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.120 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:55.121 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:55.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4d403dd60 msgr2=0x7fb4d4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4d403dd60 0x7fb4d4040220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb50406dab0 tx=0x7fb4f8009040 comp rx=0 tx=0).stop 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 10 monclient: shutdown 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 msgr2=0x7fb50409a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00099d0 tx=0x7fb4f00047c0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50af34640 1 -- 10.20.193.51:0/1748095792 reap_dead start 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 shutdown_connections 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 --2- 10.20.193.51:0/1748095792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5040a3bb0 0x7fb50409a5c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 >> 10.20.193.51:0/1748095792 conn(0x7fb5040a30c0 msgr2=0x7fb504072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 shutdown_connections 2026-02-17T11:48:55.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.089+0000 7fb50c9be640 1 -- 10.20.193.51:0/1748095792 wait complete. 2026-02-17T11:48:55.123 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:55.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:48:55.124 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: get_monmap_and_config 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: monmap: 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:55.190279+0000 2026-02-17T11:48:55.193 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:55.190279+0000 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 1 Processor -- start 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 1 -- start start 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: init 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.189+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93240a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:48:55.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93240a0750 0x7f932409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-a con 0x7f93240a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-b con 0x7f932413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f932406e140 con 0x7f93240a3bb0 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f932409f910 con 0x7f93240a0750 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f932409ccd0 con 0x7f932413b760 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9329e9f640 10 monclient(hunting): authenticate will time out at 822.809041s 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93240a0750 0x7f932409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57004/0 (socket says 10.20.193.51:57004) 2026-02-17T11:48:55.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 -- 10.20.193.51:0/835849340 learned_addr learned my addr 10.20.193.51:0/835849340 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): get_auth_request con 0x7f932413b760 auth_method 0 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): get_auth_request con 0x7f93240a0750 auth_method 0 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9322ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient(hunting): handle_auth_done global_id 44306 payload 274 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 -- 10.20.193.51:0/835849340 >> v2:10.20.193.51:3300/0 conn(0x7f93240a0750 msgr2=0x7f932409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 --2- 10.20.193.51:0/835849340 >> v2:10.20.193.51:3300/0 conn(0x7f93240a0750 0x7f932409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 -- 10.20.193.51:0/835849340 >> v1:10.20.193.142:6789/0 conn(0x7f93240a3bb0 legacy=0x7f932409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 monclient: found mon.noname-b 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.190+0000 7f9323fff640 1 -- 10.20.193.51:0/835849340 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932409eec0 con 0x7f932413b760 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.192+0000 7f9323fff640 1 -- 10.20.193.51:0/835849340 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 msgr2=0x7f932413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.192+0000 7f9323fff640 1 --2- 10.20.193.51:0/835849340 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f932406f3c0 tx=0x7f931802f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12748cfe79d751a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 1 -- 10.20.193.51:0/835849340 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93180373f0 con 0x7f932413b760 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: dump: 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.204 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f9329e9f640 5 monclient: authenticate success, global_id 44306 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f9329e9f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 1 -- 10.20.193.51:0/835849340 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9318037590 con 0x7f932413b760 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 1 -- 10.20.193.51:0/835849340 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318037960 con 0x7f932413b760 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f93227fc640 10 monclient: dump: 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f9329e9f640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.194+0000 7f9329e9f640 4 set_mon_vals no callback set 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 10 monclient: shutdown 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- 10.20.193.51:0/835849340 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 msgr2=0x7f932413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 --2- 10.20.193.51:0/835849340 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f932406f3c0 tx=0x7f931802f200 comp rx=0 tx=0).stop 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- 10.20.193.51:0/835849340 shutdown_connections 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 --2- 10.20.193.51:0/835849340 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932413b760 0x7f932413db50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 --2- 10.20.193.51:0/835849340 >> v2:10.20.193.51:3300/0 conn(0x7f93240a0750 0x7f932409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- 10.20.193.51:0/835849340 >> 10.20.193.51:0/835849340 conn(0x7f93240a30c0 msgr2=0x7f93240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- 10.20.193.51:0/835849340 shutdown_connections 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- 10.20.193.51:0/835849340 wait complete. 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 10 monclient: monmap: 2026-02-17T11:48:55.207 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 Processor -- start 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 1 -- start start 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.195+0000 7f9329e9f640 10 monclient: init 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93240a0750 0x7f93241cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-c con 0x7f93240a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93240a3bb0 0x7f93241d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-b con 0x7f93240a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 0x7f932409a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): picked mon.noname-a con 0x7f932413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f93240a04b0 con 0x7f932413b760 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f932409c850 con 0x7f93240a3bb0 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f932409e710 con 0x7f93240a0750 2026-02-17T11:48:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9329e9f640 10 monclient(hunting): authenticate will time out at 822.815279s 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 0x7f932409a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 0x7f932409a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43268/0 (socket says 10.20.193.51:43268) 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 learned_addr learned my addr 10.20.193.51:0/694869762 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): get_auth_request con 0x7f932413b760 auth_method 0 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93240a0750 0x7f93241cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): get_auth_request con 0x7f93240a0750 auth_method 0 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient(hunting): handle_auth_done global_id 34392 payload 824 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93240a0750 msgr2=0x7f93241cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93240a0750 0x7f93241cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93240a3bb0 msgr2=0x7f93241d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9322ffd640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93240a3bb0 0x7f93241d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93240a3bb0 0x7f93241d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 monclient: found mon.noname-a 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.196+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9324097e60 con 0x7f932413b760 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 msgr2=0x7f932409a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9323fff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 0x7f932409a5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9318009f50 tx=0x7f9318004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318046020 con 0x7f932413b760 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: dump: 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.212 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9318041870 con 0x7f932413b760 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 5 monclient: authenticate success, global_id 34392 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 10 monclient: _renew_subs 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93240a2cd0 con 0x7f932413b760 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93180373f0 con 0x7f932413b760 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9321ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f92fffff640 10 monclient: dump: 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 10 monclient: _renew_subs 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.198+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9324097b80 con 0x7f932413b760 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9329e9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9329e9f640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 0x7f932408d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f932409d7b0 con 0x7f932409b2c0 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 0x7f932408d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient: get_auth_request con 0x7f932409b2c0 auth_method 0 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9318042400 con 0x7f932413b760 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 10 monclient(hunting): handle_auth_done global_id 44312 payload 824 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f93237fe640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93240981b0 con 0x7f932409b2c0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f92fffff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f92f403dd10 0x7f92f40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(135..135 src has 47..135) ==== 4843+0+0 (secure 0 0 0) 0x7f9318078390 con 0x7f932413b760 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9322ffd640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f92f403dd10 0x7f92f40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.199+0000 7f9322ffd640 10 monclient: get_auth_request con 0x7f92f403dd10 auth_method 0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f93237fe640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 msgr2=0x7f932408d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f93237fe640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 0x7f932408d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93100096d0 tx=0x7f9310009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310016070 con 0x7f932409b2c0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 10 monclient: dump: 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.216 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f931000ea30 con 0x7f932409b2c0 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 msgr2=0x7f932408d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 0x7f932408d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93100096d0 tx=0x7f9310009ba0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 msgr2=0x7f932408d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.201+0000 7f92fffff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b2c0 0x7f932408d3f0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93100096d0 tx=0x7f9310009ba0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.202+0000 7f9322ffd640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f92f403dd10 0x7f92f40401d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93240a25e0 tx=0x7f9314008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f9329e9f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f9329e9f640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 0x7f93241daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f9329e9f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93240a2400 con 0x7f932409b6a0 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 0x7f93241daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient: get_auth_request con 0x7f932409b6a0 auth_method 0 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.204+0000 7f93237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.205+0000 7f93237fe640 10 monclient(hunting): handle_auth_done global_id 44315 payload 824 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.205+0000 7f93237fe640 1 -- 10.20.193.51:0/694869762 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f932409dac0 con 0x7f932409b6a0 2026-02-17T11:48:55.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f93237fe640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 msgr2=0x7f93241daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f93237fe640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 0x7f93241daad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9310002fd0 tx=0x7f9310004850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310016050 con 0x7f932409b6a0 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 10 monclient: dump: 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.221 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f9310005c70 con 0x7f932409b6a0 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 msgr2=0x7f93241daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 0x7f93241daad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9310002fd0 tx=0x7f9310004850 comp rx=0 tx=0).stop 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 msgr2=0x7f93241daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f92fffff640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f932409b6a0 0x7f93241daad0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9310002fd0 tx=0x7f9310004850 comp rx=0 tx=0).stop 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:55.222 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 106679, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:55.223 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.224 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:55.225 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:55.226 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.227 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:55.228 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.229 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:55.230 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.231 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:55.232 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:55.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f92f403dd10 msgr2=0x7f92f40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f92f403dd10 0x7f92f40401d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93240a25e0 tx=0x7f9314008040 comp rx=0 tx=0).stop 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 10 monclient: shutdown 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 msgr2=0x7f932409a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 --2- 10.20.193.51:0/694869762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f932413b760 0x7f932409a5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9318009f50 tx=0x7f9318004b40 comp rx=0 tx=0).stop 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 reap_dead start 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9323fff640 1 -- 10.20.193.51:0/694869762 reap_dead start 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 shutdown_connections 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 >> 10.20.193.51:0/694869762 conn(0x7f93240a30c0 msgr2=0x7f932413ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 shutdown_connections 2026-02-17T11:48:55.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.207+0000 7f9329e9f640 1 -- 10.20.193.51:0/694869762 wait complete. 2026-02-17T11:48:55.234 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:55.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:48:55.234 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:48:55.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.299+0000 7fa8b9d53640 10 monclient: get_monmap_and_config 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.299+0000 7fa8b9d53640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.299+0000 7fa8b9d53640 10 monclient: monmap: 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:48:55.300828+0000 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:48:55.300828+0000 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 Processor -- start 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 -- start start 2026-02-17T11:48:55.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient: init 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8b40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 0x7fa8b409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-b con 0x7fa8b409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa8b40a0110 0x7fa8b413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-c con 0x7fa8b40a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b406e140 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b409aed0 con 0x7fa8b40a0110 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b409caa0 con 0x7fa8b409dac0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b9d53640 10 monclient(hunting): authenticate will time out at 822.919609s 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa8b40a3bb0 0x7fa8b409f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54966/0 (socket says 10.20.193.51:54966) 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b37fe640 1 -- 10.20.193.51:0/316469886 learned_addr learned my addr 10.20.193.51:0/316469886 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 0x7fa8b409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): get_auth_request con 0x7fa8b409dac0 auth_method 0 2026-02-17T11:48:55.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient(hunting): handle_auth_done global_id 44318 payload 274 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 -- 10.20.193.51:0/316469886 >> v2:10.20.193.142:3300/0 conn(0x7fa8b40a0110 msgr2=0x7fa8b413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/316469886 >> v2:10.20.193.142:3300/0 conn(0x7fa8b40a0110 0x7fa8b413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 -- 10.20.193.51:0/316469886 >> v1:10.20.193.51:6789/0 conn(0x7fa8b40a3bb0 legacy=0x7fa8b409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.300+0000 7fa8b2ffd640 1 -- 10.20.193.51:0/316469886 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b409ce60 con 0x7fa8b409dac0 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b2ffd640 1 -- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 msgr2=0x7fa8b409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 0x7fa8b409fbd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40098a0 tx=0x7fa8a402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891b4ed99b406f8d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 1 -- 10.20.193.51:0/316469886 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a403c070 con 0x7fa8b409dac0 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: dump: 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.310 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 1 -- 10.20.193.51:0/316469886 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a402fce0 con 0x7fa8b409dac0 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 5 monclient: authenticate success, global_id 44318 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 1 -- 10.20.193.51:0/316469886 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4037660 con 0x7fa8b409dac0 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b27fc640 10 monclient: dump: 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.311 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 10 monclient: get_monmap_and_config success 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 4 set_mon_vals no callback set 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 10 monclient: shutdown 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 -- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 msgr2=0x7fa8b409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 0x7fa8b409fbd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40098a0 tx=0x7fa8a402ed80 comp rx=0 tx=0).stop 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 -- 10.20.193.51:0/316469886 shutdown_connections 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/316469886 >> v2:10.20.193.142:3300/0 conn(0x7fa8b40a0110 0x7fa8b413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/316469886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b409dac0 0x7fa8b409fbd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 -- 10.20.193.51:0/316469886 >> 10.20.193.51:0/316469886 conn(0x7fa8b40a30c0 msgr2=0x7fa8b40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 -- 10.20.193.51:0/316469886 shutdown_connections 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.303+0000 7fa8b9d53640 1 -- 10.20.193.51:0/316469886 wait complete. 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient: build_initial_monmap 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient: monmap: 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 Processor -- start 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 -- start start 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient: init 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient: _reopen_session rank -1 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8b409dac0 0x7fa8b41cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-a con 0x7fa8b409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b40a0110 0x7fa8b41bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-b con 0x7fa8b40a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): picked mon.noname-c con 0x7fa8b40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40a0540 con 0x7fa8b409dac0 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b409a880 con 0x7fa8b40a0110 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b409e370 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): _renew_subs 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b9d53640 10 monclient(hunting): authenticate will time out at 822.923552s 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8b409dac0 0x7fa8b41cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8b409dac0 0x7fa8b41cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43280/0 (socket says 10.20.193.51:43280) 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57040/0 (socket says 10.20.193.51:57040) 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 learned_addr learned my addr 10.20.193.51:0/1283295277 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request con 0x7fa8b409dac0 auth_method 0 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): get_auth_request con 0x7fa8b40a3bb0 auth_method 0 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient(hunting): handle_auth_done global_id 44321 payload 824 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b40a0110 msgr2=0x7fa8b41bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b40a0110 0x7fa8b41bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b40a0110 0x7fa8b41bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8b409dac0 msgr2=0x7fa8b41cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8b409dac0 0x7fa8b41cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 monclient: found mon.noname-c 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:48:55.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b3fff640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b409d7b0 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b2ffd640 10 monclient: get_auth_request con 0x7fa8b40a0110 auth_method 0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.304+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b40a0110 0x7fa8b41bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.306+0000 7fa8b3fff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 msgr2=0x7fa8b41bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.306+0000 7fa8b3fff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800be20 tx=0x7fa8a800bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.306+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800cbe0 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: dump: 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: _finish_auth 0 2026-02-17T11:48:55.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a8010070 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80040f0 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 10 monclient: dump: 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b1ffb640 4 set_mon_vals no callback set 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 5 monclient: authenticate success, global_id 44321 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 monclient: _renew_subs 2026-02-17T11:48:55.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b409c0b0 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 monclient: _renew_subs 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b41b7010 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bd000 con 0x7fa8b41b3320 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa8a80042d0 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa8b41b3320 auth_method 0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 0x7fa884040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(135..135 src has 47..135) ==== 4843+0+0 (secure 0 0 0) 0x7fa8a8052740 con 0x7fa8b40a3bb0 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:55.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:55.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.307+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 0x7fa884040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.308+0000 7fa8b2ffd640 10 monclient: get_auth_request con 0x7fa88403dd40 auth_method 0 2026-02-17T11:48:55.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.310+0000 7fa8b2ffd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 0x7fa884040200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8b406c1c0 tx=0x7fa8a4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:55.377 INFO:tasks.rados.rados.0.trial142.stdout:510: done (2 left) 2026-02-17T11:48:55.377 INFO:tasks.rados.rados.0.trial142.stdout:515: done (1 left) 2026-02-17T11:48:55.377 INFO:tasks.rados.rados.0.trial142.stdout:516: done (0 left) 2026-02-17T11:48:55.377 INFO:tasks.rados.rados.0.trial142.stdout:517: snap_create 2026-02-17T11:48:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa8b41b3320 auth_method 0 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.508+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:55.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:55.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa8b41b3320 auth_method 0 2026-02-17T11:48:55.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:55.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:55.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:55.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:55.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:55.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:55.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:55.909+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:48:56.378 INFO:tasks.rados.rados.0.trial142.stdout:517: done (0 left) 2026-02-17T11:48:56.378 INFO:tasks.rados.rados.0.trial142.stdout:518: read oid 48 snap -1 2026-02-17T11:48:56.378 INFO:tasks.rados.rados.0.trial142.stdout:518: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:56.378 INFO:tasks.rados.rados.0.trial142.stdout:519: write (excl) oid 36 current snap is 58 2026-02-17T11:48:56.378 INFO:tasks.rados.rados.0.trial142.stdout:519: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2026-02-17T11:48:56.382 INFO:tasks.rados.rados.0.trial142.stdout:519: writing trial14245205-36 from 510979 to 1043857 tid 1 2026-02-17T11:48:56.387 INFO:tasks.rados.rados.0.trial142.stdout:519: writing trial14245205-36 from 1528482 to 2300878 tid 2 2026-02-17T11:48:56.391 INFO:tasks.rados.rados.0.trial142.stdout:519: writing trial14245205-36 from 3060800 to 3310979 tid 3 2026-02-17T11:48:56.392 INFO:tasks.rados.rados.0.trial142.stdout:520: write oid 16 current snap is 58 2026-02-17T11:48:56.392 INFO:tasks.rados.rados.0.trial142.stdout:520: seq_num 198 ranges {527786=724480,1703317=516054,2804576=435035} 2026-02-17T11:48:56.397 INFO:tasks.rados.rados.0.trial142.stdout:520: writing trial14245205-16 from 527786 to 1252266 tid 1 2026-02-17T11:48:56.400 INFO:tasks.rados.rados.0.trial142.stdout:520: writing trial14245205-16 from 1703317 to 2219371 tid 2 2026-02-17T11:48:56.404 INFO:tasks.rados.rados.0.trial142.stdout:520: writing trial14245205-16 from 2804576 to 3239611 tid 3 2026-02-17T11:48:56.404 INFO:tasks.rados.rados.0.trial142.stdout:521: snap_remove snap 56 2026-02-17T11:48:56.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:56.710+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:56.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:56.710+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:56.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:56.710+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:56.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:56.710+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:56.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:56.710+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:48:57.396 INFO:tasks.rados.rados.0.trial142.stdout:521: done (3 left) 2026-02-17T11:48:57.396 INFO:tasks.rados.rados.0.trial142.stdout:522: copy_from oid 4 from oid 42 current snap is 58 2026-02-17T11:48:57.396 INFO:tasks.rados.rados.0.trial142.stdout:518: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:519: finishing write tid 1 to trial14245205-36 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:519: finishing write tid 2 to trial14245205-36 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:519: finishing write tid 3 to trial14245205-36 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:518: done (3 left) 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:523: snap_create 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:519: finishing write tid 4 to trial14245205-36 2026-02-17T11:48:57.446 INFO:tasks.rados.rados.0.trial142.stdout:519: finishing write tid 5 to trial14245205-36 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:519: oid 36 updating version 0 to 198 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:519: oid 36 version 198 is already newer than 195 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:519: oid 36 version 198 is already newer than 197 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:519: oid 36 version 198 is already newer than 196 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 198 (ObjNum 197 snap 58 seq_num 197) dirty exists 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:519: left oid 36 (ObjNum 197 snap 58 seq_num 197) 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: finishing write tid 1 to trial14245205-16 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: finishing write tid 2 to trial14245205-16 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: finishing write tid 3 to trial14245205-16 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: finishing write tid 4 to trial14245205-16 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: finishing write tid 5 to trial14245205-16 2026-02-17T11:48:57.447 INFO:tasks.rados.rados.0.trial142.stdout:520: oid 16 updating version 0 to 209 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:520: oid 16 updating version 209 to 212 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:520: oid 16 version 212 is already newer than 211 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:520: oid 16 version 212 is already newer than 210 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 212 (ObjNum 198 snap 58 seq_num 198) dirty exists 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:520: left oid 16 (ObjNum 198 snap 58 seq_num 198) 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:522: finishing copy_from racing read to trial14245205-4 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:522: finishing copy_from to trial14245205-4 2026-02-17T11:48:57.448 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 191 (ObjNum 168 snap 51 seq_num 168) dirty exists 2026-02-17T11:48:58.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.305+0000 7fa88effd640 10 monclient: tick 2026-02-17T11:48:58.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.305+0000 7fa88effd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:58.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.305+0000 7fa88effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:58.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.305+0000 7fa88effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa8b41b3320 auth_method 0 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:58.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:58.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:58.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:58.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:58.312+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:48:59.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 10 monclient: tick 2026-02-17T11:48:59.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 10 monclient: _check_auth_tickets 2026-02-17T11:48:59.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:48:59.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 msgr2=0x7fa8b41b3700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3320 0x7fa8b41b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa88effd640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bd000 con 0x7fa880003640 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa880003640 auth_method 0 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:59.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:59.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:59.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:59.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:59.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.305+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:48:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa880003640 auth_method 0 2026-02-17T11:48:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:48:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.506+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:48:59.606 INFO:tasks.rados.rados.0.trial142.stdout:519: done (3 left) 2026-02-17T11:48:59.606 INFO:tasks.rados.rados.0.trial142.stdout:520: done (2 left) 2026-02-17T11:48:59.606 INFO:tasks.rados.rados.0.trial142.stdout:522: done (1 left) 2026-02-17T11:48:59.606 INFO:tasks.rados.rados.0.trial142.stdout:523: done (0 left) 2026-02-17T11:48:59.606 INFO:tasks.rados.rados.0.trial142.stdout:524: rollback oid 18 current snap is 59 2026-02-17T11:48:59.607 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 55 2026-02-17T11:48:59.607 INFO:tasks.rados.rados.0.trial142.stdout:525: snap_remove snap 51 2026-02-17T11:48:59.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:59.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa880003640 auth_method 0 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_done global_id 64099 payload 824 2026-02-17T11:48:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.907+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8800061b0 con 0x7fa880003640 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0019ad0 tx=0x7fa8a00173d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0023470 con 0x7fa880003640 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 10 monclient: dump: 2026-02-17T11:48:59.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fa8a0023470 con 0x7fa880003640 2026-02-17T11:48:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:48:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:48:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0019ad0 tx=0x7fa8a00173d0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 msgr2=0x7fa880005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.910+0000 7fa88ffff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa880003640 0x7fa880005ad0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0019ad0 tx=0x7fa8a00173d0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.913+0000 7fa8b9d53640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:48:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.913+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 0x7fa8b41d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:48:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.913+0000 7fa8b9d53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:48:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.913+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41b4cb0 con 0x7fa8b41b3c40 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 0x7fa8b41d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient: get_auth_request con 0x7fa8b41b3c40 auth_method 0 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 10 monclient(hunting): handle_auth_done global_id 64102 payload 824 2026-02-17T11:48:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.914+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8b41b5810 con 0x7fa8b41b3c40 2026-02-17T11:48:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b37fe640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 msgr2=0x7fa8b41d5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:48:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b37fe640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 0x7fa8b41d5e80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0019ad0 tx=0x7fa8a0004c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:48:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0028ab0 con 0x7fa8b41b3c40 2026-02-17T11:48:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 10 monclient: dump: 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:48:59.920 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fa8a00223d0 con 0x7fa8b41b3c40 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 msgr2=0x7fa8b41d5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 0x7fa8b41d5e80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0019ad0 tx=0x7fa8a0004c40 comp rx=0 tx=0).stop 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 msgr2=0x7fa8b41d5e80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b3fff640 1 -- 10.20.193.51:0/1283295277 reap_dead start 2026-02-17T11:48:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa88ffff640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8b41b3c40 0x7fa8b41d5e80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:48:59.922 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 11463, 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:59.923 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:48:59.924 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.925 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:48:59.926 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:48:59.927 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:48:59.928 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.929 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:59.930 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:48:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:48:59.934 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:48:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:48:59.935 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:48:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 msgr2=0x7fa884040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 0x7fa884040200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8b406c1c0 tx=0x7fa8a4033000 comp rx=0 tx=0).stop 2026-02-17T11:48:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 10 monclient: shutdown 2026-02-17T11:48:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 msgr2=0x7fa8b41bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800be20 tx=0x7fa8a800bf20 comp rx=0 tx=0).stop 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 shutdown_connections 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88403dd40 0x7fa884040200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 --2- 10.20.193.51:0/1283295277 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8b40a3bb0 0x7fa8b41bcac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 >> 10.20.193.51:0/1283295277 conn(0x7fa8b40a30c0 msgr2=0x7fa8b409ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 shutdown_connections 2026-02-17T11:48:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:48:59.917+0000 7fa8b9d53640 1 -- 10.20.193.51:0/1283295277 wait complete. 2026-02-17T11:48:59.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:48:59.938 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:48:59.938 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:49:00.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 10 monclient: get_monmap_and_config 2026-02-17T11:49:00.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 10 monclient: build_initial_monmap 2026-02-17T11:49:00.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 10 monclient: monmap: 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:00.003413+0000 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:00.003413+0000 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:00.005 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 1 Processor -- start 2026-02-17T11:49:00.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 1 -- start start 2026-02-17T11:49:00.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.002+0000 7f3a1f534640 10 monclient: init 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a180a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a180a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a1813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-b con 0x7f3a1813c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1809e8e0 con 0x7f3a180a3bb0 2026-02-17T11:49:00.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1806e140 con 0x7f3a180a0750 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1809f910 con 0x7f3a1813c770 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1f534640 10 monclient(hunting): authenticate will time out at 827.622182s 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1d2a9640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3a180a3bb0 0x7f3a1809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54968/0 (socket says 10.20.193.51:54968) 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1d2a9640 1 -- 10.20.193.51:0/1226704419 learned_addr learned my addr 10.20.193.51:0/1226704419 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a1813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): get_auth_request con 0x7f3a1813c770 auth_method 0 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:00.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_done global_id 44324 payload 274 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 1 -- 10.20.193.51:0/1226704419 >> v1:10.20.193.142:6789/0 conn(0x7f3a180a0750 legacy=0x7f3a1809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 1 -- 10.20.193.51:0/1226704419 >> v1:10.20.193.51:6789/0 conn(0x7f3a180a3bb0 legacy=0x7f3a1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient: _finish_hunting 0 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 1 monclient: found mon.noname-b 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.003+0000 7f3a1daaa640 1 -- 10.20.193.51:0/1226704419 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1809ccd0 con 0x7f3a1813c770 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1daaa640 1 -- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 msgr2=0x7f3a1813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:00.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a1813eb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009dc0 tx=0x7f3a1402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d5f1365848fd5d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 1 -- 10.20.193.51:0/1226704419 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1403c070 con 0x7f3a1813c770 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: dump: 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:00.017 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: _finish_auth 0 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: _check_auth_tickets 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 1 -- 10.20.193.51:0/1226704419 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14037640 con 0x7f3a1813c770 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 1 -- 10.20.193.51:0/1226704419 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14037a10 con 0x7f3a1813c770 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 5 monclient: authenticate success, global_id 44324 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 4 set_mon_vals no callback set 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:00.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a07fff640 10 monclient: dump: 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 10 monclient: shutdown 2026-02-17T11:49:00.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 -- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 msgr2=0x7f3a1813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 --2- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a1813eb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009dc0 tx=0x7f3a1402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 -- 10.20.193.51:0/1226704419 shutdown_connections 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 --2- 10.20.193.51:0/1226704419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a1813eb60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 -- 10.20.193.51:0/1226704419 >> 10.20.193.51:0/1226704419 conn(0x7f3a180a30c0 msgr2=0x7f3a180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 -- 10.20.193.51:0/1226704419 shutdown_connections 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.006+0000 7f3a1f534640 1 -- 10.20.193.51:0/1226704419 wait complete. 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient: build_initial_monmap 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient: monmap: 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:00.020 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 Processor -- start 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 -- start start 2026-02-17T11:49:00.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient: init 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 0x7f3a180998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-a con 0x7f3a180a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a180a3bb0 0x7f3a180901c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-b con 0x7f3a180a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a18090700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): picked mon.noname-c con 0x7f3a1813c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1809c850 con 0x7f3a180a0750 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:00.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1809eef0 con 0x7f3a180a3bb0 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a180a04b0 con 0x7f3a1813c770 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1f534640 10 monclient(hunting): authenticate will time out at 827.626578s 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 0x7f3a180998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 0x7f3a180998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43292/0 (socket says 10.20.193.51:43292) 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 1 -- 10.20.193.51:0/2053248081 learned_addr learned my addr 10.20.193.51:0/2053248081 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): get_auth_request con 0x7f3a180a0750 auth_method 0 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a18090700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:00.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): get_auth_request con 0x7f3a1813c770 auth_method 0 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1d2a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient(hunting): handle_auth_done global_id 44327 payload 824 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 -- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a180a3bb0 msgr2=0x7f3a180901c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:00.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a180a3bb0 0x7f3a180901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 -- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 msgr2=0x7f3a180998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 0x7f3a180998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient: _finish_hunting 0 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 monclient: found mon.noname-c 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.007+0000 7f3a1daaa640 1 -- 10.20.193.51:0/2053248081 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a180940b0 con 0x7f3a1813c770 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.009+0000 7f3a1daaa640 1 -- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 msgr2=0x7f3a18090700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.009+0000 7f3a1daaa640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a18090700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a14004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14047020 con 0x7f3a1813c770 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:00.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: dump: 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: _finish_auth 0 2026-02-17T11:49:00.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 5 monclient: authenticate success, global_id 44327 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14042880 con 0x7f3a1813c770 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _renew_subs 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1809d7b0 con 0x7f3a1813c770 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1403c040 con 0x7f3a1813c770 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 10 monclient: dump: 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:00.027 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a077fe640 4 set_mon_vals no callback set 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _renew_subs 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a18093dd0 con 0x7f3a1813c770 2026-02-17T11:49:00.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1809dac0 con 0x7f3a1813c770 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.010+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a14042cb0 con 0x7f3a1813c770 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.011+0000 7f3a05ffb640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.011+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(139..139 src has 47..139) ==== 4831+0+0 (secure 0 0 0) 0x7f3a14078460 con 0x7f3a1813c770 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.011+0000 7f3a1d2a9640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:00.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.011+0000 7f3a1d2a9640 10 monclient: get_auth_request con 0x7f39e803dd10 auth_method 0 2026-02-17T11:49:00.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.013+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3a14051030 con 0x7f3a1813c770 2026-02-17T11:49:00.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.013+0000 7f3a05ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:00.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.013+0000 7f3a05ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:00.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.014+0000 7f3a1d2a9640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a08007e50 tx=0x7f3a08007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.126+0000 7f3a1f534640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:49:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.126+0000 7f3a1f534640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:49:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.126+0000 7f3a1f534640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.126+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3a180926a0 con 0x7f3a1813c770 2026-02-17T11:49:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.127+0000 7f3a05ffb640 1 -- 10.20.193.51:0/2053248081 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3a14036e20 con 0x7f3a1813c770 2026-02-17T11:49:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.127+0000 7f3a05ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:49:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.127+0000 7f3a05ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:00.131 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=9,kv=11,logm=66} crc {auth=2245587101,config=692619927,health=2090147895,kv=1982221976,logm=1347884959}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=1,health=12,kv=12,logm=62} crc {auth=225363019,config=1228700967,health=1535303502,kv=643764953,logm=2164581336}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=9,kv=11,logm=66} crc {auth=2245587101,config=692619927,health=2090147895,kv=1982221976,logm=1347884959}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=1,health=12,kv=11,logm=63} crc {auth=2043679782,config=1228700967,health=1535303502,kv=4179589687,logm=2606799166}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1642362585}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2348562995}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1642362585}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1634775885}) 2026-02-17T11:49:00.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=708396672}) 2026-02-17T11:49:00.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2558664029}) 2026-02-17T11:49:00.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.127+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=708396672}) 2026-02-17T11:49:00.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2149093735}) 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 msgr2=0x7f39e80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a08007e50 tx=0x7f3a08007da0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 10 monclient: shutdown 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 msgr2=0x7f3a18090700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a18090700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a14004b40 comp rx=0 tx=0).stop 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 shutdown_connections 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a1813c770 0x7f3a18090700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a180a3bb0 0x7f3a180901c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 --2- 10.20.193.51:0/2053248081 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a0750 0x7f3a180998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 >> 10.20.193.51:0/2053248081 conn(0x7f3a180a30c0 msgr2=0x7f3a1813dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 shutdown_connections 2026-02-17T11:49:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:00.128+0000 7f3a1f534640 1 -- 10.20.193.51:0/2053248081 wait complete. 2026-02-17T11:49:00.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2798650895}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2756647219}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2798650895}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=967886734}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923034837}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1076867567}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923034837}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.128+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1595196395}) 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339012624}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2937457214}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339012624}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1563711864}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253134024}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3386437317}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253134024}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2368230357}) 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4046403359}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3680230157}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4046403359}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.129+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=488869238}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2699365017}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=989234663}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2699365017}) 2026-02-17T11:49:00.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.130+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1280035566}) 2026-02-17T11:49:00.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860956570}) 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3509745383}) 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860956570}) 2026-02-17T11:49:00.144 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.141+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4110166281}) 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13} crc {logm=2827191367,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=587577634,mon_config_key=3390328712}) 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=66,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=1} crc {logm=1106914367,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2184204006,mon_config_key=4138928500,monmap=2917003991}) 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13} crc {logm=2827191367,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=587577634,mon_config_key=3390328712}) 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=62,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=1} crc {logm=2838060908,mdsmap=3207544932,mgr=1312948032,mgr_command_descs=1238205435,mgr_metadata=3312392844,mgrstat=587577634,mon_config_key=2698701517,monmap=263989209,osd_metadata=384969676}) 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=22,osdmap=68} crc {monmap=263989209,osd_metadata=126250839,osd_pg_creating=360349153,osd_snap=3350191806,osdmap=3158383073}) 2026-02-17T11:49:00.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=22,osdmap=69} crc {monmap=263989209,osd_metadata=2265321291,osd_pg_creating=360349153,osd_snap=3638219466,osdmap=610757871}) 2026-02-17T11:49:00.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=22,osdmap=68} crc {monmap=263989209,osd_metadata=126250839,osd_pg_creating=360349153,osd_snap=3350191806,osdmap=3158383073}) 2026-02-17T11:49:00.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.223+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=20,osdmap=70} crc {monmap=263989209,osd_metadata=3956758304,osd_pg_creating=360349153,osd_snap=1368705510,osdmap=3466510974}) 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=82} crc {osdmap=2736276103}) 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=82} crc {osdmap=3122968031}) 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=82} crc {osdmap=2736276103}) 2026-02-17T11:49:00.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:00.226+0000 7fcd4f102640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=85} crc {osdmap=3245995415}) 2026-02-17T11:49:00.612 INFO:tasks.rados.rados.0.trial142.stdout:525: done (1 left) 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:526: read oid 43 snap -1 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:526: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:527: snap_create 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:524: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:524: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:524: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:49:00.613 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 427 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:49:00.616 INFO:tasks.rados.rados.0.trial142.stdout:526: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:49:01.142 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:49:01.143 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:49:01.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: get_monmap_and_config 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: monmap: 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:01.207063+0000 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:01.207063+0000 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:01.208 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 Processor -- start 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 -- start start 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: init 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea900a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fea900a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fea9013c770 0x7fea9013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-c con 0x7fea9013c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9009e8e0 con 0x7fea900a3bb0 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9006e140 con 0x7fea900a0750 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fea9009f910 con 0x7fea9013c770 2026-02-17T11:49:01.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea96bee640 10 monclient(hunting): authenticate will time out at 828.825814s 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea94963640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fea900a3bb0 0x7fea9009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54980/0 (socket says 10.20.193.51:54980) 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea94963640 1 -- 10.20.193.51:0/963413173 learned_addr learned my addr 10.20.193.51:0/963413173 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.206+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> v2:10.20.193.142:3300/0 conn(0x7fea9013c770 0x7fea9013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): get_auth_request con 0x7fea9013c770 auth_method 0 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.207+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.208+0000 7fea94963640 1 -- 10.20.193.51:0/963413173 >> v1:10.20.193.51:6789/0 conn(0x7fea900a3bb0 legacy=0x7fea9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825214162 0 0) 0x7fea9009e8e0 con 0x7fea900a3bb0 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): _negotiate 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): my global_id is 34401 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea7c003620 con 0x7fea900a3bb0 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2518068897 0 0) 0x7fea7c003620 con 0x7fea900a3bb0 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 1 -- 10.20.193.51:0/963413173 >> v1:10.20.193.142:6789/0 conn(0x7fea900a0750 legacy=0x7fea9009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 >> v2:10.20.193.142:3300/0 conn(0x7fea9013c770 msgr2=0x7fea9013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> v2:10.20.193.142:3300/0 conn(0x7fea9013c770 0x7fea9013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 >> v1:10.20.193.142:6789/0 conn(0x7fea900a0750 legacy=0x7fea9009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9009ccd0 con 0x7fea900a3bb0 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fea80003270 con 0x7fea900a3bb0 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea96bee640 5 monclient: authenticate success, global_id 34401 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea96bee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: dump: 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.214 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 >> v1:10.20.193.51:6789/0 conn(0x7fea900a3bb0 legacy=0x7fea9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 0x7fea7c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): picked mon.a con 0x7fea7c003b50 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c004900 0x7fea7c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): picked mon.b con 0x7fea7c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): picked mon.c con 0x7fea7c0054c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fea9009f910 con 0x7fea7c003b50 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c00c330 con 0x7fea7c004900 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c00c530 con 0x7fea7c0054c0 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea877fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea96bee640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 0x7fea7c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 10 monclient(hunting): get_auth_request con 0x7fea7c003b50 auth_method 0 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 msgr2=0x7fea7c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 msgr2=0x7fea7c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 0x7fea7c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): get_auth_request con 0x7fea7c0054c0 auth_method 0 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea94963640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 0x7fea7c003f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c004900 0x7fea7c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): get_auth_request con 0x7fea7c004900 auth_method 0 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient(hunting): handle_auth_done global_id 34401 payload 293 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c004900 msgr2=0x7fea7c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c004900 0x7fea7c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 msgr2=0x7fea7c003f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003b50 0x7fea7c003f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 monclient: found mon.c 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c003620 con 0x7fea7c0054c0 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.209+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 reap_dead start 2026-02-17T11:49:01.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.211+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 msgr2=0x7fea7c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.211+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009f90 tx=0x7fea8c02f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c96492faae7240a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 msgr2=0x7fea7c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 msgr2=0x7fea7c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009f90 tx=0x7fea8c02f5b0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009f90 tx=0x7fea8c02f5b0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 msgr2=0x7fea7c00bac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c0054c0 0x7fea7c00bac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:49:01.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 0x7fea7c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): picked mon.a con 0x7fea7c003f70 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea7c007f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): picked mon.c con 0x7fea7c007b50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c0086c0 0x7fea7c008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): picked mon.b con 0x7fea7c0086c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c009430 con 0x7fea7c003f70 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0095e0 con 0x7fea7c0086c0 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c0097e0 con 0x7fea7c007b50 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea877fe640 10 monclient(hunting): ms_handle_reset hunted mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 0x7fea7c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): get_auth_request con 0x7fea7c003f70 auth_method 0 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea7c007f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): get_auth_request con 0x7fea7c007b50 auth_method 0 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c0086c0 0x7fea7c008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 10 monclient(hunting): get_auth_request con 0x7fea7c0086c0 auth_method 0 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea95164640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient(hunting): handle_auth_done global_id 34401 payload 293 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c0086c0 msgr2=0x7fea7c008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c0086c0 0x7fea7c008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 msgr2=0x7fea7c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 0x7fea7c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 monclient: found mon.c 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 1 -- 10.20.193.51:0/963413173 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=2+}) -- 0x7fea9009e8e0 con 0x7fea7c007b50 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.212+0000 7fea94963640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 0x7fea7c004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea87fff640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 msgr2=0x7fea7c007f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea87fff640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea7c007f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea78006d10 tx=0x7fea8c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6247548fe8e58d08 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78019070 con 0x7fea7c007b50 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 10 monclient: dump: 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.234 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 1 -- 10.20.193.51:0/963413173 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780058c0 con 0x7fea7c007b50 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 4 set_mon_vals no callback set 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 10 monclient: shutdown 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 1 -- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 msgr2=0x7fea7c007f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.214+0000 7fea96bee640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea7c007f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea78006d10 tx=0x7fea8c00b040 comp rx=0 tx=0).stop 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 -- 10.20.193.51:0/963413173 shutdown_connections 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c0086c0 0x7fea7c008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea7c007f30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 --2- 10.20.193.51:0/963413173 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c003f70 0x7fea7c004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 -- 10.20.193.51:0/963413173 >> 10.20.193.51:0/963413173 conn(0x7fea900a30c0 msgr2=0x7fea900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 -- 10.20.193.51:0/963413173 shutdown_connections 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 -- 10.20.193.51:0/963413173 wait complete. 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 10 monclient: monmap: 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:01.236 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 Processor -- start 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 1 -- start start 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 10 monclient: init 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.215+0000 7fea96bee640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 0x7fea900943a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-b con 0x7fea7c003f70 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-c con 0x7fea7c007b50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c0086c0 0x7fea90094e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): picked mon.noname-a con 0x7fea7c0086c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fea9009c850 con 0x7fea7c0086c0 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea9009ebe0 con 0x7fea7c003f70 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fea900a04b0 con 0x7fea7c007b50 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea96bee640 10 monclient(hunting): authenticate will time out at 828.835079s 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57118/0 (socket says 10.20.193.51:57118) 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 -- 10.20.193.51:0/983488148 learned_addr learned my addr 10.20.193.51:0/983488148 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): get_auth_request con 0x7fea7c007b50 auth_method 0 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c0086c0 0x7fea90094e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): get_auth_request con 0x7fea7c0086c0 auth_method 0 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea95164640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient(hunting): handle_auth_done global_id 44330 payload 824 2026-02-17T11:49:01.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 -- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 msgr2=0x7fea900943a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea94963640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 0x7fea900943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 0x7fea900943a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 -- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c0086c0 msgr2=0x7fea90094e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c0086c0 0x7fea90094e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 monclient: found mon.noname-c 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea87fff640 1 -- 10.20.193.51:0/983488148 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea900a2d00 con 0x7fea7c007b50 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea94963640 10 monclient: get_auth_request con 0x7fea7c003f70 auth_method 0 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.216+0000 7fea94963640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 0x7fea900943a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea87fff640 1 -- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 msgr2=0x7fea900948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea87fff640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0099b0 tx=0x7fea78002d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78024070 con 0x7fea7c007b50 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: dump: 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7801a040 con 0x7fea7c007b50 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 5 monclient: authenticate success, global_id 44330 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 10 monclient: _renew_subs 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9009d7b0 con 0x7fea7c007b50 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78019070 con 0x7fea7c007b50 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea86ffd640 4 set_mon_vals no callback set 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 10 monclient: dump: 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 10 monclient: _renew_subs 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea900974b0 con 0x7fea7c007b50 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.218+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fea78013c70 con 0x7fea7c007b50 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea96bee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea96bee640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea96bee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9009db50 con 0x7fea7c007b50 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea857fa640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 0x7fea600401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(140..140 src has 47..140) ==== 4843+0+0 (secure 0 0 0) 0x7fea78052e70 con 0x7fea7c007b50 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea94963640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 0x7fea600401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.219+0000 7fea94963640 10 monclient: get_auth_request con 0x7fea6003dd10 auth_method 0 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.221+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fea78051830 con 0x7fea7c007b50 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.221+0000 7fea857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.221+0000 7fea857fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:01.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.221+0000 7fea94963640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 0x7fea600401d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea80002ce0 tx=0x7fea80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.339+0000 7fea96bee640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:49:01.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.339+0000 7fea96bee640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:01.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.339+0000 7fea96bee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.339+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fea900008d0 con 0x7fea7c007b50 2026-02-17T11:49:01.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea857fa640 1 -- 10.20.193.51:0/983488148 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fea7802e630 con 0x7fea7c007b50 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea857fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 msgr2=0x7fea600401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 0x7fea600401d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea80002ce0 tx=0x7fea80009040 comp rx=0 tx=0).stop 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 10 monclient: shutdown 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 msgr2=0x7fea900948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0099b0 tx=0x7fea78002d30 comp rx=0 tx=0).stop 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 shutdown_connections 2026-02-17T11:49:01.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fea6003dd10 0x7fea600401d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea7c0086c0 0x7fea90094e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea7c007b50 0x7fea900948e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 --2- 10.20.193.51:0/983488148 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea7c003f70 0x7fea900943a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 >> 10.20.193.51:0/983488148 conn(0x7fea900a30c0 msgr2=0x7fea90072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.340+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 shutdown_connections 2026-02-17T11:49:01.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.341+0000 7fea96bee640 1 -- 10.20.193.51:0/983488148 wait complete. 2026-02-17T11:49:01.349 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:49:01.349 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:49:01.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:49:01.349 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.414+0000 7f8a5fd2c640 10 monclient: get_monmap_and_config 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.414+0000 7f8a5fd2c640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.414+0000 7f8a5fd2c640 10 monclient: monmap: 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:01.415558+0000 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:01.415558+0000 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:01.416 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:01.417 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.414+0000 7f8a5fd2c640 1 Processor -- start 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 -- start start 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient: init 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8a580a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a580a0750 0x7f8a5809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-a con 0x7f8a580a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8a5813b760 0x7f8a5813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-c con 0x7f8a5813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5806e140 con 0x7f8a580a3bb0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5809f910 con 0x7f8a580a0750 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5809ccd0 con 0x7f8a5813b760 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5fd2c640 10 monclient(hunting): authenticate will time out at 829.034300s 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a580a0750 0x7f8a5809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a580a0750 0x7f8a5809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43324/0 (socket says 10.20.193.51:43324) 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/1095139580 learned_addr learned my addr 10.20.193.51:0/1095139580 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): get_auth_request con 0x7f8a580a0750 auth_method 0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5e2a2640 1 --2- 10.20.193.51:0/1095139580 >> v2:10.20.193.142:3300/0 conn(0x7f8a5813b760 0x7f8a5813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5e2a2640 10 monclient(hunting): get_auth_request con 0x7f8a5813b760 auth_method 0 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5e2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5e2a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5e2a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_done global_id 34407 payload 274 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/1095139580 >> v2:10.20.193.142:3300/0 conn(0x7f8a5813b760 msgr2=0x7f8a5813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 --2- 10.20.193.51:0/1095139580 >> v2:10.20.193.142:3300/0 conn(0x7f8a5813b760 0x7f8a5813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/1095139580 >> v1:10.20.193.142:6789/0 conn(0x7f8a580a3bb0 legacy=0x7f8a5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 monclient: found mon.noname-a 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.415+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/1095139580 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5809eec0 con 0x7f8a580a0750 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/1095139580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a0750 msgr2=0x7f8a5809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5d2a0640 1 --2- 10.20.193.51:0/1095139580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a0750 0x7f8a5809e1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a5809f5f0 tx=0x7f8a4c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57562384531471fc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 1 -- 10.20.193.51:0/1095139580 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c03c070 con 0x7f8a580a0750 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: dump: 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 1 -- 10.20.193.51:0/1095139580 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c02fca0 con 0x7f8a580a0750 2026-02-17T11:49:01.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 5 monclient: authenticate success, global_id 34407 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 1 -- 10.20.193.51:0/1095139580 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c037660 con 0x7f8a580a0750 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 4 set_mon_vals no callback set 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5ca9f640 10 monclient: dump: 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 10 monclient: shutdown 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/1095139580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a0750 msgr2=0x7f8a5809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/1095139580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a0750 0x7f8a5809e1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a5809f5f0 tx=0x7f8a4c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/1095139580 shutdown_connections 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/1095139580 >> v2:10.20.193.142:3300/0 conn(0x7f8a5813b760 0x7f8a5813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/1095139580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a0750 0x7f8a5809e1d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/1095139580 >> 10.20.193.51:0/1095139580 conn(0x7f8a580a30c0 msgr2=0x7f8a580a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/1095139580 shutdown_connections 2026-02-17T11:49:01.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/1095139580 wait complete. 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.418+0000 7f8a5fd2c640 10 monclient: monmap: 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 Processor -- start 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 -- start start 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient: init 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a580a0750 0x7f8a58138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-c con 0x7f8a580a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 0x7f8a58139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-a con 0x7f8a580a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a5813b760 0x7f8a580953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580a04b0 con 0x7f8a580a3bb0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5809c850 con 0x7f8a5813b760 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5809e710 con 0x7f8a580a0750 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5fd2c640 10 monclient(hunting): authenticate will time out at 829.038426s 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 0x7f8a58139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a580a0750 0x7f8a58138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 0x7f8a58139000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43334/0 (socket says 10.20.193.51:43334) 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/3566543935 learned_addr learned my addr 10.20.193.51:0/3566543935 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): get_auth_request con 0x7f8a580a3bb0 auth_method 0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): get_auth_request con 0x7f8a580a0750 auth_method 0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5e2a2640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a5813b760 0x7f8a580953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5e2a2640 10 monclient(hunting): get_auth_request con 0x7f8a5813b760 auth_method 0 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5e2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5e2a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5e2a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient(hunting): handle_auth_done global_id 34410 payload 824 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a580a0750 msgr2=0x7f8a58138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a580a0750 0x7f8a58138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a5813b760 msgr2=0x7f8a580953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a5813b760 0x7f8a580953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 monclient: found mon.noname-a 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.419+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580a2290 con 0x7f8a580a3bb0 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5d2a0640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 msgr2=0x7f8a58139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5d2a0640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 0x7f8a58139000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009a70 tx=0x7f8a4c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c046020 con 0x7f8a580a3bb0 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: dump: 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.426 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c02fe50 con 0x7f8a580a3bb0 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5fd2c640 5 monclient: authenticate success, global_id 34410 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c03c040 con 0x7f8a580a3bb0 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a47fff640 4 set_mon_vals no callback set 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a467fc640 10 monclient: dump: 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5fd2c640 10 monclient: _renew_subs 2026-02-17T11:49:01.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5fd2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.421+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a58099310 con 0x7f8a580a3bb0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 10 monclient: _renew_subs 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a58098d50 con 0x7f8a580a3bb0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 0x7f8a58095cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58077c20 con 0x7f8a58095910 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 0x7f8a58095cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient: get_auth_request con 0x7f8a58095910 auth_method 0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8a4c03f030 con 0x7f8a580a3bb0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_done global_id 34413 payload 824 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a5daa1640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a5809dac0 con 0x7f8a58095910 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a467fc640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a2803dd10 0x7f8a280401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.422+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(140..140 src has 47..140) ==== 4843+0+0 (secure 0 0 0) 0x7f8a4c077a40 con 0x7f8a580a3bb0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.423+0000 7f8a5e2a2640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a2803dd10 0x7f8a280401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.423+0000 7f8a5e2a2640 10 monclient: get_auth_request con 0x7f8a2803dd10 auth_method 0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.424+0000 7f8a5daa1640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 msgr2=0x7f8a58095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.424+0000 7f8a5daa1640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 0x7f8a58095cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a480096d0 tx=0x7f8a48009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48016070 con 0x7f8a58095910 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 10 monclient: dump: 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.428 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8a4800ea30 con 0x7f8a58095910 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 msgr2=0x7f8a58095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 0x7f8a58095cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a480096d0 tx=0x7f8a48009ba0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 msgr2=0x7f8a58095cf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a467fc640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58095910 0x7f8a58095cf0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a480096d0 tx=0x7f8a48009ba0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.425+0000 7f8a5e2a2640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a2803dd10 0x7f8a280401d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806dab0 tx=0x7f8a5400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5fd2c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 0x7f8a581dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5fd2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58097470 con 0x7f8a58096230 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 0x7f8a581dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient: get_auth_request con 0x7f8a58096230 auth_method 0 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 10 monclient(hunting): handle_auth_done global_id 34416 payload 824 2026-02-17T11:49:01.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.428+0000 7f8a5daa1640 1 -- 10.20.193.51:0/3566543935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a580008d0 con 0x7f8a58096230 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a5daa1640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 msgr2=0x7f8a581dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a5daa1640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 0x7f8a581dace0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a48002fd0 tx=0x7f8a48004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48016050 con 0x7f8a58096230 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 10 monclient: dump: 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.432 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f8a48012800 con 0x7f8a58096230 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 msgr2=0x7f8a581dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 0x7f8a581dace0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a48002fd0 tx=0x7f8a48004850 comp rx=0 tx=0).stop 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 msgr2=0x7f8a581dace0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.430+0000 7f8a467fc640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a58096230 0x7f8a581dace0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a48002fd0 tx=0x7f8a48004850 comp rx=0 tx=0).stop 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 162075, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 7, 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:01.433 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:01.434 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.435 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.437 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.438 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a2803dd10 msgr2=0x7f8a280401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a2803dd10 0x7f8a280401d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806dab0 tx=0x7f8a5400b040 comp rx=0 tx=0).stop 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 10 monclient: shutdown 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 msgr2=0x7f8a58139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 --2- 10.20.193.51:0/3566543935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a580a3bb0 0x7f8a58139000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009a70 tx=0x7f8a4c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5e2a2640 1 -- 10.20.193.51:0/3566543935 reap_dead start 2026-02-17T11:49:01.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5e2a2640 1 -- 10.20.193.51:0/3566543935 reap_dead start 2026-02-17T11:49:01.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 shutdown_connections 2026-02-17T11:49:01.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 >> 10.20.193.51:0/3566543935 conn(0x7f8a580a30c0 msgr2=0x7f8a5813abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 shutdown_connections 2026-02-17T11:49:01.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.431+0000 7f8a5fd2c640 1 -- 10.20.193.51:0/3566543935 wait complete. 2026-02-17T11:49:01.440 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:01.440 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:49:01.440 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.504+0000 7f1837bbe640 10 monclient: get_monmap_and_config 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.504+0000 7f1837bbe640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.504+0000 7f1837bbe640 10 monclient: monmap: 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:01.505669+0000 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:01.505669+0000 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:01.506 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:01.507 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:01.507 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 Processor -- start 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 -- start start 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient: init 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-b con 0x7f18300a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f18300a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f183013b760 0x7f183013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-c con 0x7f183013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183006e140 con 0x7f18300a0750 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f183009f910 con 0x7f183013b760 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f183009ccd0 con 0x7f18300a3bb0 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1837bbe640 10 monclient(hunting): authenticate will time out at 829.124442s 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57142/0 (socket says 10.20.193.51:57142) 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 -- 10.20.193.51:0/3911135559 learned_addr learned my addr 10.20.193.51:0/3911135559 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): get_auth_request con 0x7f18300a3bb0 auth_method 0 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient(hunting): handle_auth_done global_id 44336 payload 274 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 -- 10.20.193.51:0/3911135559 >> v2:10.20.193.142:3300/0 conn(0x7f183013b760 msgr2=0x7f183013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 --2- 10.20.193.51:0/3911135559 >> v2:10.20.193.142:3300/0 conn(0x7f183013b760 0x7f183013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 -- 10.20.193.51:0/3911135559 >> v1:10.20.193.142:6789/0 conn(0x7f18300a0750 legacy=0x7f183009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 monclient: found mon.noname-b 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.505+0000 7f1835933640 1 -- 10.20.193.51:0/3911135559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183009eec0 con 0x7f18300a3bb0 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1835933640 1 -- 10.20.193.51:0/3911135559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 msgr2=0x7f183009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1835933640 1 --2- 10.20.193.51:0/3911135559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f183009f230 tx=0x7f182002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65be7665dfa5da8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 1 -- 10.20.193.51:0/3911135559 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182003c070 con 0x7f18300a3bb0 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: dump: 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.510 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 1 -- 10.20.193.51:0/3911135559 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182002fda0 con 0x7f18300a3bb0 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 5 monclient: authenticate success, global_id 44336 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 1 -- 10.20.193.51:0/3911135559 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820037660 con 0x7f18300a3bb0 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 4 set_mon_vals no callback set 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1834931640 10 monclient: dump: 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 10 monclient: shutdown 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 -- 10.20.193.51:0/3911135559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 msgr2=0x7f183009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 --2- 10.20.193.51:0/3911135559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f183009f230 tx=0x7f182002ee80 comp rx=0 tx=0).stop 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 -- 10.20.193.51:0/3911135559 shutdown_connections 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 --2- 10.20.193.51:0/3911135559 >> v2:10.20.193.142:3300/0 conn(0x7f183013b760 0x7f183013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 --2- 10.20.193.51:0/3911135559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f183009dac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 -- 10.20.193.51:0/3911135559 >> 10.20.193.51:0/3911135559 conn(0x7f18300a30c0 msgr2=0x7f18300a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 -- 10.20.193.51:0/3911135559 shutdown_connections 2026-02-17T11:49:01.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.508+0000 7f1837bbe640 1 -- 10.20.193.51:0/3911135559 wait complete. 2026-02-17T11:49:01.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient: monmap: 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 Processor -- start 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 -- start start 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient: init 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18300a0750 0x7f1830092e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-b con 0x7f18300a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f1830093360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-c con 0x7f18300a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f183013b760 0x7f18300938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): picked mon.noname-a con 0x7f183013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f18300a04b0 con 0x7f183013b760 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f183009c850 con 0x7f18300a0750 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f183009e710 con 0x7f18300a3bb0 2026-02-17T11:49:01.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1837bbe640 10 monclient(hunting): authenticate will time out at 829.128721s 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f1830093360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f1830093360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57144/0 (socket says 10.20.193.51:57144) 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 -- 10.20.193.51:0/2018270463 learned_addr learned my addr 10.20.193.51:0/2018270463 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): get_auth_request con 0x7f18300a3bb0 auth_method 0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f183013b760 0x7f18300938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): get_auth_request con 0x7f183013b760 auth_method 0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1836134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835933640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18300a0750 0x7f1830092e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835933640 10 monclient(hunting): get_auth_request con 0x7f18300a0750 auth_method 0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835933640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835933640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835933640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient(hunting): handle_auth_done global_id 44339 payload 824 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18300a0750 msgr2=0x7f1830092e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18300a0750 0x7f1830092e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f183013b760 msgr2=0x7f18300938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f183013b760 0x7f18300938a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 monclient: found mon.noname-c 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.509+0000 7f1835132640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1830096a30 con 0x7f18300a3bb0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835132640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 msgr2=0x7f1830093360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835132640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f1830093360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f182400c500 tx=0x7f182400c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824012a40 con 0x7f18300a3bb0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: dump: 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1824017070 con 0x7f18300a3bb0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824012e40 con 0x7f18300a3bb0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 5 monclient: authenticate success, global_id 44339 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181ffff640 4 set_mon_vals no callback set 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 monclient: _renew_subs 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18300a2300 con 0x7f18300a3bb0 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 10 monclient: dump: 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 monclient: _renew_subs 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1830096190 con 0x7f18300a3bb0 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 0x7f1830071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f18300946d0 con 0x7f18300963d0 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f182401c460 con 0x7f18300a3bb0 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 0x7f1830071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient: get_auth_request con 0x7f18300963d0 auth_method 0 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.512+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f1835933640 10 monclient(hunting): handle_auth_done global_id 44342 payload 824 2026-02-17T11:49:01.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f1835933640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f183009dac0 con 0x7f18300963d0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f181e7fc640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f180003dd10 0x7f18000401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(140..140 src has 47..140) ==== 4843+0+0 (secure 0 0 0) 0x7f18240524b0 con 0x7f18300a3bb0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f1836134640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f180003dd10 0x7f18000401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.513+0000 7f1836134640 10 monclient: get_auth_request con 0x7f180003dd10 auth_method 0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f1835933640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 msgr2=0x7f1830071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f1835933640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 0x7f1830071f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1830069d60 tx=0x7f18200047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820047070 con 0x7f18300963d0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 10 monclient: dump: 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1820037d70 con 0x7f18300963d0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 msgr2=0x7f1830071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 0x7f1830071f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1830069d60 tx=0x7f18200047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 msgr2=0x7f1830071f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f181e7fc640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300963d0 0x7f1830071f00 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1830069d60 tx=0x7f18200047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.515+0000 7f1836134640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f180003dd10 0x7f18000401d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f182c009fb0 tx=0x7f182c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1837bbe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1837bbe640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 0x7f1830063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1837bbe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f18300967b0 con 0x7f18300638c0 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 0x7f1830063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient: get_auth_request con 0x7f18300638c0 auth_method 0 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 10 monclient(hunting): handle_auth_done global_id 44345 payload 824 2026-02-17T11:49:01.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.518+0000 7f1835933640 1 -- 10.20.193.51:0/2018270463 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1830072440 con 0x7f18300638c0 2026-02-17T11:49:01.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1835933640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 msgr2=0x7f1830063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1835933640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 0x7f1830063ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f182002eec0 tx=0x7f1820009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182003c040 con 0x7f18300638c0 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 10 monclient: dump: 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f1820043460 con 0x7f18300638c0 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 msgr2=0x7f1830063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 0x7f1830063ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f182002eec0 tx=0x7f1820009340 comp rx=0 tx=0).stop 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 msgr2=0x7f1830063ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f181e7fc640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300638c0 0x7f1830063ca0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f182002eec0 tx=0x7f1820009340 comp rx=0 tx=0).stop 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:01.523 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 112993, 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 7, 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.524 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.525 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.526 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.527 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.528 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:01.529 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f180003dd10 msgr2=0x7f18000401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f180003dd10 0x7f18000401d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f182c009fb0 tx=0x7f182c00d040 comp rx=0 tx=0).stop 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 10 monclient: shutdown 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 msgr2=0x7f1830093360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 --2- 10.20.193.51:0/2018270463 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18300a3bb0 0x7f1830093360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f182400c500 tx=0x7f182400c9d0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1836134640 1 -- 10.20.193.51:0/2018270463 reap_dead start 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1836134640 1 -- 10.20.193.51:0/2018270463 reap_dead start 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 shutdown_connections 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 >> 10.20.193.51:0/2018270463 conn(0x7f18300a30c0 msgr2=0x7f183013a950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 shutdown_connections 2026-02-17T11:49:01.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.521+0000 7f1837bbe640 1 -- 10.20.193.51:0/2018270463 wait complete. 2026-02-17T11:49:01.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:01.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:49:01.531 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.597+0000 7f2272fa9640 10 monclient: get_monmap_and_config 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.597+0000 7f2272fa9640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.597+0000 7f2272fa9640 10 monclient: monmap: 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:01.598651+0000 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:01.598651+0000 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:01.599 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:01.600 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:01.600 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:01.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 Processor -- start 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 -- start start 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient: init 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-b con 0x7f226c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f226c09dac0 0x7f226c09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-c con 0x7f226c09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f226c09ff40 0x7f226c13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-a con 0x7f226c09ff40 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f226c09aed0 con 0x7f226c09ff40 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f226c09caa0 con 0x7f226c09dac0 2026-02-17T11:49:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f226c0a3f90 con 0x7f226c0a3bb0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2272fa9640 10 monclient(hunting): authenticate will time out at 829.217605s 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57162/0 (socket says 10.20.193.51:57162) 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 -- 10.20.193.51:0/2668646917 learned_addr learned my addr 10.20.193.51:0/2668646917 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): get_auth_request con 0x7f226c0a3bb0 auth_method 0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.51:3300/0 conn(0x7f226c09ff40 0x7f226c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): get_auth_request con 0x7f226c09ff40 auth_method 0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2263fff640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.142:3300/0 conn(0x7f226c09dac0 0x7f226c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2263fff640 10 monclient(hunting): get_auth_request con 0x7f226c09dac0 auth_method 0 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient(hunting): handle_auth_done global_id 44348 payload 274 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 -- 10.20.193.51:0/2668646917 >> v2:10.20.193.142:3300/0 conn(0x7f226c09dac0 msgr2=0x7f226c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.142:3300/0 conn(0x7f226c09dac0 0x7f226c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 -- 10.20.193.51:0/2668646917 >> v2:10.20.193.51:3300/0 conn(0x7f226c09ff40 msgr2=0x7f226c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.51:3300/0 conn(0x7f226c09ff40 0x7f226c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 monclient: found mon.noname-b 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.598+0000 7f2270d1e640 1 -- 10.20.193.51:0/2668646917 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c06e140 con 0x7f226c0a3bb0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2270d1e640 1 -- 10.20.193.51:0/2668646917 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 msgr2=0x7f226c09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2668646917 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f226c06e310 tx=0x7f225c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420a87dffa943117 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 1 -- 10.20.193.51:0/2668646917 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c03c070 con 0x7f226c0a3bb0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: dump: 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 1 -- 10.20.193.51:0/2668646917 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c02fd30 con 0x7f226c0a3bb0 2026-02-17T11:49:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 5 monclient: authenticate success, global_id 44348 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 1 -- 10.20.193.51:0/2668646917 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c037660 con 0x7f226c0a3bb0 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 4 set_mon_vals no callback set 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f22637fe640 10 monclient: dump: 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 10 monclient: shutdown 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 -- 10.20.193.51:0/2668646917 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 msgr2=0x7f226c09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2668646917 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f226c06e310 tx=0x7f225c02eeb0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 -- 10.20.193.51:0/2668646917 shutdown_connections 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.51:3300/0 conn(0x7f226c09ff40 0x7f226c13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2668646917 >> v2:10.20.193.142:3300/0 conn(0x7f226c09dac0 0x7f226c09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2668646917 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c0a3bb0 0x7f226c09f4c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 -- 10.20.193.51:0/2668646917 >> 10.20.193.51:0/2668646917 conn(0x7f226c0a30c0 msgr2=0x7f226c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 -- 10.20.193.51:0/2668646917 shutdown_connections 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.601+0000 7f2272fa9640 1 -- 10.20.193.51:0/2668646917 wait complete. 2026-02-17T11:49:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient: build_initial_monmap 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient: monmap: 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 Processor -- start 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 -- start start 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient: init 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c09dac0 0x7f226c1ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-b con 0x7f226c09dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c09ff40 0x7f226c1bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-c con 0x7f226c09ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): picked mon.noname-a con 0x7f226c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f226c09a880 con 0x7f226c0a3bb0 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f226c09a5c0 con 0x7f226c09dac0 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f226c0a0350 con 0x7f226c09ff40 2026-02-17T11:49:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2272fa9640 10 monclient(hunting): authenticate will time out at 829.221790s 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43392/0 (socket says 10.20.193.51:43392) 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 learned_addr learned my addr 10.20.193.51:0/2122817391 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c09ff40 0x7f226c1bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): get_auth_request con 0x7f226c0a3bb0 auth_method 0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): get_auth_request con 0x7f226c09ff40 auth_method 0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient(hunting): handle_auth_done global_id 34425 payload 824 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c09ff40 msgr2=0x7f226c1bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f226c09ff40 0x7f226c1bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c09dac0 0x7f226c1ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c09dac0 msgr2=0x7f226c1ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c09dac0 0x7f226c1ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 10 monclient: _finish_hunting 0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 1 monclient: found mon.noname-a 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.602+0000 7f227151f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.603+0000 7f227151f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.603+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c0a2390 con 0x7f226c0a3bb0 2026-02-17T11:49:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.603+0000 7f2270d1e640 10 monclient: get_auth_request con 0x7f226c09dac0 auth_method 0 2026-02-17T11:49:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.603+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c09dac0 0x7f226c1ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 msgr2=0x7f226c1bdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f227151f640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f226800efc0 tx=0x7f226800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268018020 con 0x7f226c0a3bb0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: dump: 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: _finish_auth 0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: _check_auth_tickets 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268014680 con 0x7f226c0a3bb0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268014a70 con 0x7f226c0a3bb0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 10 monclient: dump: 2026-02-17T11:49:01.610 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2262ffd640 4 set_mon_vals no callback set 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 5 monclient: authenticate success, global_id 34425 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 monclient: _renew_subs 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c1cd120 con 0x7f226c0a3bb0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 monclient: _renew_subs 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c09d7b0 con 0x7f226c0a3bb0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 0x7f226c1b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f226c09f4c0 con 0x7f226c1b7a40 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.605+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2268014c10 con 0x7f226c0a3bb0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 0x7f226c1b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient: get_auth_request con 0x7f226c1b7a40 auth_method 0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f22617fa640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f224403dd10 0x7f22440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(140..140 src has 47..140) ==== 4843+0+0 (secure 0 0 0) 0x7f2268053680 con 0x7f226c0a3bb0 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2263fff640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f224403dd10 0x7f22440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2263fff640 10 monclient: get_auth_request con 0x7f224403dd10 auth_method 0 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 10 monclient(hunting): handle_auth_done global_id 64120 payload 824 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.606+0000 7f2270d1e640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f226c1b64c0 con 0x7f226c1b7a40 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.608+0000 7f2263fff640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f224403dd10 0x7f22440401d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f226c0a1430 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f2270d1e640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 msgr2=0x7f226c1b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 0x7f226c1b4280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f225c039000 tx=0x7f225c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c03c040 con 0x7f226c1b7a40 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 10 monclient: dump: 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.612 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f225c037c10 con 0x7f226c1b7a40 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 msgr2=0x7f226c1b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 0x7f226c1b4280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f225c039000 tx=0x7f225c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 msgr2=0x7f226c1b4280 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.609+0000 7f22617fa640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b7a40 0x7f226c1b4280 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f225c039000 tx=0x7f225c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2272fa9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 0x7f226c1d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2272fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f226c050ac0 con 0x7f226c1b47c0 2026-02-17T11:49:01.614 INFO:tasks.rados.rados.0.trial142.stdout:524: done (2 left) 2026-02-17T11:49:01.614 INFO:tasks.rados.rados.0.trial142.stdout:526: done (1 left) 2026-02-17T11:49:01.614 INFO:tasks.rados.rados.0.trial142.stdout:527: done (0 left) 2026-02-17T11:49:01.614 INFO:tasks.rados.rados.0.trial142.stdout:528: snap_remove snap 58 2026-02-17T11:49:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 0x7f226c1d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2270d1e640 10 monclient: get_auth_request con 0x7f226c1b47c0 auth_method 0 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2270d1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2270d1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.612+0000 7f2270d1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.613+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.613+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.613+0000 7f2270d1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.613+0000 7f2270d1e640 10 monclient(hunting): handle_auth_done global_id 64123 payload 824 2026-02-17T11:49:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.613+0000 7f2270d1e640 1 -- 10.20.193.51:0/2122817391 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f226c1b7e20 con 0x7f226c1b47c0 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f2270d1e640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 msgr2=0x7f226c1d7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f2270d1e640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 0x7f226c1d7f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f226c09d280 tx=0x7f225c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c03c040 con 0x7f226c1b47c0 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f22617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f22617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.615+0000 7f22617fa640 10 monclient: dump: 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:01.617 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f225c003db0 con 0x7f226c1b47c0 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 msgr2=0x7f226c1d7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 0x7f226c1d7f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f226c09d280 tx=0x7f225c008030 comp rx=0 tx=0).stop 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 msgr2=0x7f226c1d7f90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f22617fa640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f226c1b47c0 0x7f226c1d7f90 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f226c09d280 tx=0x7f225c008030 comp rx=0 tx=0).stop 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 28, 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 13162, 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:01.618 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 7, 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.619 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.620 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.622 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:01.623 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f224403dd10 msgr2=0x7f22440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f224403dd10 0x7f22440401d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f226c0a1430 tx=0x7f2258008040 comp rx=0 tx=0).stop 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 10 monclient: shutdown 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 msgr2=0x7f226c1bdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f227151f640 1 -- 10.20.193.51:0/2122817391 reap_dead start 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f226800efc0 tx=0x7f226800c490 comp rx=0 tx=0).stop 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 shutdown_connections 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 --2- 10.20.193.51:0/2122817391 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f226c0a3bb0 0x7f226c1bdbf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 >> 10.20.193.51:0/2122817391 conn(0x7f226c0a30c0 msgr2=0x7f226c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 shutdown_connections 2026-02-17T11:49:01.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:01.616+0000 7f2272fa9640 1 -- 10.20.193.51:0/2122817391 wait complete. 2026-02-17T11:49:01.625 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:01.625 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T11:49:01.625 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-17T11:49:01.625 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T11:49:01.625 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:49:01.625 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:49:01.625 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:49:01.635 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:49:01.635 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-17T11:49:01.635 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-17T11:49:01.635 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:49:16.636 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-17T11:49:16.637 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-17T11:49:16.637 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:49:16.637 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:49:16.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: get_monmap_and_config 2026-02-17T11:49:16.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: build_initial_monmap 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: monmap: 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:16.706116+0000 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:16.706116+0000 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:16.710 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 Processor -- start 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 -- start start 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: init 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-c con 0x7f69c40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:16.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-a con 0x7f69c40a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-b con 0x7f69c409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f69c40a3f90 con 0x7f69c40a0750 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f69c406e140 con 0x7f69c40a3bb0 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f69c409f910 con 0x7f69c409e540 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69caa39640 10 monclient(hunting): authenticate will time out at 844.324908s 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69c37fe640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 msgr2=0x7f69c409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:16.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.705+0000 7f69c37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46510/0 (socket says 10.20.193.51:46510) 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 learned_addr learned my addr 10.20.193.51:0/1255716398 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 10 monclient(hunting): get_auth_request con 0x7f69c409e540 auth_method 0 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 10 monclient(hunting): get_auth_request con 0x7f69c40a3bb0 auth_method 0 2026-02-17T11:49:16.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:16.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.706+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:16.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 msgr2=0x7f69c409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:16.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:49:16.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:16.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 10 monclient(hunting): get_auth_request con 0x7f69c409e540 auth_method 0 2026-02-17T11:49:16.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 10 monclient(hunting): get_auth_request con 0x7f69c40a3bb0 auth_method 0 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:16.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:49:16.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:16.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:16.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:16.907+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 msgr2=0x7f69c409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 10 monclient(hunting): get_auth_request con 0x7f69c409e540 auth_method 0 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:17.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 10 monclient(hunting): get_auth_request con 0x7f69c40a3bb0 auth_method 0 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:17.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:17.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:17.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:17.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:17.307+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 msgr2=0x7f69c409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 10 monclient(hunting): get_auth_request con 0x7f69c409e540 auth_method 0 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:18.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 10 monclient(hunting): get_auth_request con 0x7f69c40a3bb0 auth_method 0 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:18.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:49:18.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:18.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:18.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:18.108+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 10 monclient(hunting): tick 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 msgr2=0x7f69c413c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69c409e540 0x7f69c413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:19.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.142:3300/0 conn(0x7f69c40a3bb0 0x7f69c409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 -- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 msgr2=0x7f69c409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 1 --2- 10.20.193.51:0/1255716398 >> v2:10.20.193.51:3300/0 conn(0x7f69c40a0750 0x7f69c409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 10 monclient: _add_conns ranks=[1,0] 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.705+0000 7f69c1ffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f69a0003770 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.706+0000 7f69c1ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f69a00074c0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.706+0000 7f69c1ffb640 1 -- 10.20.193.51:0/1255716398 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c409ccd0 con 0x7f69a00074c0 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.706+0000 7f69c1ffb640 1 -- 10.20.193.51:0/1255716398 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a000c200 con 0x7f69a0003770 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.706+0000 7f69c1ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:19.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.706+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.51:6789/0 conn(0x7f69a00074c0 legacy=0x7f69a0009980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:49:19.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.708+0000 7f69c3fff640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.142:6789/0 conn(0x7f69a0003770 legacy=0x7f69a0005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:19.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.708+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:49:19.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:19.907+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.51:6789/0 conn(0x7f69a00074c0 legacy=0x7f69a0009980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:49:20.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:20.308+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.51:6789/0 conn(0x7f69a00074c0 legacy=0x7f69a0009980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:49:21.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.109+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.51:6789/0 conn(0x7f69a00074c0 legacy=0x7f69a0009980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:49:21.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.640+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096852884 0 0) 0x7f69a000c200 con 0x7f69a0003770 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): my global_id is 64126 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a8003620 con 0x7f69a0003770 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 95493646 0 0) 0x7f69a8003620 con 0x7f69a0003770 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.51:6789/0 conn(0x7f69a00074c0 legacy=0x7f69a0009980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a000d4c0 con 0x7f69a0003770 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f69b000f040 con 0x7f69a0003770 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: dump: 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.649 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 >> v1:10.20.193.142:6789/0 conn(0x7f69a0003770 legacy=0x7f69a0005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 reap_dead start 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69a8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): picked mon.b con 0x7f69a8003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69a8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): picked mon.c con 0x7f69a8004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69a800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): picked mon.a con 0x7f69a80054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f69a800c320 con 0x7f69a80054c0 2026-02-17T11:49:21.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69a800c4d0 con 0x7f69a8003ab0 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f69a800c6d0 con 0x7f69a8004900 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c8faf640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 msgr2=0x7f69a800bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69a8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c8faf640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69a800bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): get_auth_request con 0x7f69a8004900 auth_method 0 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c3fff640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69a8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c3fff640 10 monclient(hunting): get_auth_request con 0x7f69a8003ab0 auth_method 0 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 10 monclient(hunting): handle_auth_done global_id 64126 payload 293 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 msgr2=0x7f69a8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69a8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 msgr2=0x7f69a800bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.641+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69a800bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 1 monclient: found mon.c 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a8003620 con 0x7f69a8004900 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69caa39640 5 monclient: authenticate success, global_id 64126 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.642+0000 7f69caa39640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c37fe640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 msgr2=0x7f69a8004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c37fe640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69a8004d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69b4007d60 tx=0x7f69b402f6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c02a6f3f4358a1a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4008040 con 0x7f69a8004900 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: dump: 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.655 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4037630 con 0x7f69a8004900 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 1 -- 10.20.193.51:0/1255716398 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4037a20 con 0x7f69a8004900 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69caa39640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69caa39640 4 set_mon_vals no callback set 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.644+0000 7f69c2ffd640 10 monclient: dump: 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 10 monclient: shutdown 2026-02-17T11:49:21.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 -- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 msgr2=0x7f69a8004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69a8004d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69b4007d60 tx=0x7f69b402f6c0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 -- 10.20.193.51:0/1255716398 shutdown_connections 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69a800bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69a8004d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 --2- 10.20.193.51:0/1255716398 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69a8003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 -- 10.20.193.51:0/1255716398 >> 10.20.193.51:0/1255716398 conn(0x7f69c40a30c0 msgr2=0x7f69c40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 -- 10.20.193.51:0/1255716398 shutdown_connections 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 1 -- 10.20.193.51:0/1255716398 wait complete. 2026-02-17T11:49:21.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 10 monclient: build_initial_monmap 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.645+0000 7f69caa39640 10 monclient: monmap: 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:21.659 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 Processor -- start 2026-02-17T11:49:21.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 -- start start 2026-02-17T11:49:21.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient: init 2026-02-17T11:49:21.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:21.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69c409afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-b con 0x7f69a8003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-c con 0x7f69a8004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69c4095ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): picked mon.noname-a con 0x7f69a80054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f69c409c850 con 0x7f69a80054c0 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69c409ef20 con 0x7f69a8003ab0 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f69c40a04b0 con 0x7f69a8004900 2026-02-17T11:49:21.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69caa39640 10 monclient(hunting): authenticate will time out at 849.265494s 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c8faf640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 msgr2=0x7f69c4095ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c8faf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69c4095ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46550/0 (socket says 10.20.193.51:46550) 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 -- 10.20.193.51:0/396678957 learned_addr learned my addr 10.20.193.51:0/396678957 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): get_auth_request con 0x7f69a8004900 auth_method 0 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c3fff640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69c409afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient(hunting): handle_auth_done global_id 44354 payload 824 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 -- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 msgr2=0x7f69c409afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69c409afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 -- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 msgr2=0x7f69c4095ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69c4095ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 monclient: found mon.noname-c 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c37fe640 1 -- 10.20.193.51:0/396678957 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c4073f00 con 0x7f69a8004900 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c3fff640 10 monclient: get_auth_request con 0x7f69a8003ab0 auth_method 0 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.646+0000 7f69c3fff640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69c409afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c37fe640 1 -- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 msgr2=0x7f69c4095960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c37fe640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69b4007e90 tx=0x7f69b4006020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4048070 con 0x7f69a8004900 2026-02-17T11:49:21.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: dump: 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.670 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b403d040 con 0x7f69a8004900 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69caa39640 5 monclient: authenticate success, global_id 44354 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69caa39640 10 monclient: _renew_subs 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69caa39640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c40992b0 con 0x7f69a8004900 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4037e40 con 0x7f69a8004900 2026-02-17T11:49:21.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.648+0000 7f69c27fc640 4 set_mon_vals no callback set 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c0ff9640 10 monclient: dump: 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 10 monclient: _renew_subs 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c4099870 con 0x7f69a8004900 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f69b40423e0 con 0x7f69a8004900 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c0ff9640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 0x7f6994040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c41cf720 con 0x7f69a8004900 2026-02-17T11:49:21.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(141..141 src has 47..141) ==== 4815+0+0 (secure 0 0 0) 0x7f69b4077730 con 0x7f69a8004900 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c3fff640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 0x7f6994040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.649+0000 7f69c3fff640 10 monclient: get_auth_request con 0x7f699403dcc0 auth_method 0 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.652+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f69c41cf720 con 0x7f69a8004900 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.652+0000 7f69c0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.652+0000 7f69c0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:21.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.652+0000 7f69c3fff640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 0x7f6994040180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006de0 tx=0x7f69b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.696 INFO:tasks.rados.rados.0.trial142.stdout:528: done (0 left) 2026-02-17T11:49:21.696 INFO:tasks.rados.rados.0.trial142.stdout:529: rollback oid 33 current snap is 60 2026-02-17T11:49:21.697 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 38 2026-02-17T11:49:21.697 INFO:tasks.rados.rados.0.trial142.stdout:530: read oid 5 snap -1 2026-02-17T11:49:21.697 INFO:tasks.rados.rados.0.trial142.stdout:530: expect (ObjNum 173 snap 51 seq_num 173) 2026-02-17T11:49:21.697 INFO:tasks.rados.rados.0.trial142.stdout:531: snap_remove snap 53 2026-02-17T11:49:21.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69caa39640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69caa39640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69caa39640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f69c4097580 con 0x7f69a8004900 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69c0ff9640 1 -- 10.20.193.51:0/396678957 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f69b4076110 con 0x7f69a8004900 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69c0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:21.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.769+0000 7f69c0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:21.773 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 msgr2=0x7f6994040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 0x7f6994040180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006de0 tx=0x7f69b0008040 comp rx=0 tx=0).stop 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 10 monclient: shutdown 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 msgr2=0x7f69c4095960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69b4007e90 tx=0x7f69b4006020 comp rx=0 tx=0).stop 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 shutdown_connections 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f699403dcc0 0x7f6994040180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69a80054c0 0x7f69c4095ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f69a8004900 0x7f69c4095960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 --2- 10.20.193.51:0/396678957 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69a8003ab0 0x7f69c409afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 >> 10.20.193.51:0/396678957 conn(0x7f69c40a30c0 msgr2=0x7f69c409bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 shutdown_connections 2026-02-17T11:49:21.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.771+0000 7f69caa39640 1 -- 10.20.193.51:0/396678957 wait complete. 2026-02-17T11:49:21.782 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:49:21.782 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:49:21.782 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:49:21.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 10 monclient: get_monmap_and_config 2026-02-17T11:49:21.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 10 monclient: build_initial_monmap 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 10 monclient: monmap: 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:21.849477+0000 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:21.849477+0000 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:21.853 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 1 Processor -- start 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 1 -- start start 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.848+0000 7fa5d8cb0640 10 monclient: init 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient: _add_conns ranks=[2,4,1,0,3] 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-b con 0x7fa5d40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 0x7fa5d409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-c con 0x7fa5d40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa5d409e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5d406e140 con 0x7fa5d409e540 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa5d40a3f90 con 0x7fa5d40a0750 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d409f910 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d8cb0640 10 monclient(hunting): authenticate will time out at 849.468244s 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46558/0 (socket says 10.20.193.51:46558) 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 -- 10.20.193.51:0/337297333 learned_addr learned my addr 10.20.193.51:0/337297333 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:21.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): get_auth_request con 0x7fa5d40a3bb0 auth_method 0 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/337297333 >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 0x7fa5d409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient(hunting): handle_auth_done global_id 44357 payload 274 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 -- 10.20.193.51:0/337297333 >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 msgr2=0x7fa5d409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 --2- 10.20.193.51:0/337297333 >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 0x7fa5d409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 -- 10.20.193.51:0/337297333 >> v1:10.20.193.142:6789/0 conn(0x7fa5d409e540 legacy=0x7fa5d413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 monclient: found mon.noname-b 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d2575640 1 -- 10.20.193.51:0/337297333 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d409ccd0 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d1d74640 10 monclient: get_auth_request con 0x7fa5d40a0750 auth_method 0 2026-02-17T11:49:21.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.849+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/337297333 >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 0x7fa5d409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d2575640 1 -- 10.20.193.51:0/337297333 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 msgr2=0x7fa5d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d2575640 1 --2- 10.20.193.51:0/337297333 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4069d60 tx=0x7fa5c802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25428cc1d3445df3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 1 -- 10.20.193.51:0/337297333 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c803c070 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:21.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: dump: 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 1 -- 10.20.193.51:0/337297333 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c802fd80 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 5 monclient: authenticate success, global_id 44357 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 1 -- 10.20.193.51:0/337297333 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8037660 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 4 set_mon_vals no callback set 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d1573640 10 monclient: dump: 2026-02-17T11:49:21.869 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 10 monclient: shutdown 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:21.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/337297333 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 msgr2=0x7fa5d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/337297333 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4069d60 tx=0x7fa5c802ee60 comp rx=0 tx=0).stop 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/337297333 shutdown_connections 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/337297333 >> v2:10.20.193.142:3300/0 conn(0x7fa5d40a0750 0x7fa5d409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/337297333 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d40a3bb0 0x7fa5d409dac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/337297333 >> 10.20.193.51:0/337297333 conn(0x7fa5d40a30c0 msgr2=0x7fa5d40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/337297333 shutdown_connections 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/337297333 wait complete. 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 10 monclient: build_initial_monmap 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.852+0000 7fa5d8cb0640 10 monclient: monmap: 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:21.871 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 Processor -- start 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 -- start start 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient: init 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-c con 0x7fa5d409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa5d40a0750 0x7fa5d412fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-a con 0x7fa5d40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa5d40a3bb0 0x7fa5d41300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): picked mon.noname-b con 0x7fa5d40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d40a04b0 con 0x7fa5d40a0750 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d409c850 con 0x7fa5d40a3bb0 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d413de80 con 0x7fa5d409e540 2026-02-17T11:49:21.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d8cb0640 10 monclient(hunting): authenticate will time out at 849.472362s 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d1d74640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa5d40a0750 msgr2=0x7fa5d412fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d1d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa5d40a0750 0x7fa5d412fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46560/0 (socket says 10.20.193.51:46560) 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 -- 10.20.193.51:0/3003290042 learned_addr learned my addr 10.20.193.51:0/3003290042 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): get_auth_request con 0x7fa5d409e540 auth_method 0 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient(hunting): handle_auth_done global_id 44360 payload 824 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa5d40a3bb0 msgr2=0x7fa5d41300d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa5d40a3bb0 0x7fa5d41300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa5d40a0750 msgr2=0x7fa5d412fb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa5d40a0750 0x7fa5d412fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 monclient: found mon.noname-c 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.853+0000 7fa5d2575640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d4138410 con 0x7fa5d409e540 2026-02-17T11:49:21.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d2575640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 msgr2=0x7fa5d4137ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d2575640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009a70 tx=0x7fa5c8004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d2575640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009a70 tx=0x7fa5c8004830 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fa5c803f870 config(0 keys) 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8047070 con 0x7fa5d409e540 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: dump: 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.876 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c803f870 con 0x7fa5d409e540 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 5 monclient: authenticate success, global_id 44360 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 10 monclient: _renew_subs 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d4131bf0 con 0x7fa5d409e540 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d0d72640 4 set_mon_vals no callback set 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 10 monclient: _renew_subs 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.855+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d4133a40 con 0x7fa5d409e540 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d8cb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 0x7fa5d41333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d406f930 con 0x7fa5d4130610 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 0x7fa5d41333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient: get_auth_request con 0x7fa5d4130610 auth_method 0 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c803c040 con 0x7fa5d409e540 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 10 monclient: dump: 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.879 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa5c803fca0 con 0x7fa5d409e540 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_done global_id 44363 payload 824 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d1d74640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5d409dac0 con 0x7fa5d4130610 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5baffd640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5a003dcc0 0x7fa5a0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d2d76640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5a003dcc0 0x7fa5a0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.856+0000 7fa5d2d76640 10 monclient: get_auth_request con 0x7fa5a003dcc0 auth_method 0 2026-02-17T11:49:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5d1d74640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 msgr2=0x7fa5d41333e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 0x7fa5d41333e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4131370 tx=0x7fa5bc00cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc007ad0 con 0x7fa5d4130610 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.858+0000 7fa5baffd640 10 monclient: dump: 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fa5bc007ad0 con 0x7fa5d4130610 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 msgr2=0x7fa5d41333e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 0x7fa5d41333e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4131370 tx=0x7fa5bc00cb20 comp rx=0 tx=0).stop 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 msgr2=0x7fa5d41333e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5baffd640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4130610 0x7fa5d41333e0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4131370 tx=0x7fa5bc00cb20 comp rx=0 tx=0).stop 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.859+0000 7fa5d2d76640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5a003dcc0 0x7fa5a0040180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4132480 tx=0x7fa5c4003fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d8cb0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 0x7fa5d41d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d8cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d41309f0 con 0x7fa5d4139980 2026-02-17T11:49:21.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 0x7fa5d41d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient: get_auth_request con 0x7fa5d4139980 auth_method 0 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 10 monclient(hunting): handle_auth_done global_id 44366 payload 824 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.862+0000 7fa5d1d74640 1 -- 10.20.193.51:0/3003290042 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5d40008d0 con 0x7fa5d4139980 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d1d74640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 msgr2=0x7fa5d41d9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d1d74640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 0x7fa5d41d9d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc004240 con 0x7fa5d4139980 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 10 monclient: dump: 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7fa5bc004240 con 0x7fa5d4139980 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:21.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 msgr2=0x7fa5d41d9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 0x7fa5d41d9d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc004830 comp rx=0 tx=0).stop 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 msgr2=0x7fa5d41d9d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d4139980 0x7fa5d41d9d50 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc004830 comp rx=0 tx=0).stop 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 30, 2026-02-17T11:49:21.885 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 133337, 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.886 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.887 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:21.888 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.889 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:21.890 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:21.891 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.892 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:21.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:21.894 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.895 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:21.896 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5a003dcc0 msgr2=0x7fa5a0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5a003dcc0 0x7fa5a0040180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4132480 tx=0x7fa5c4003fc0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 10 monclient: shutdown 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 msgr2=0x7fa5d4137ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 1 --2- 10.20.193.51:0/3003290042 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa5d409e540 0x7fa5d4137ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009a70 tx=0x7fa5c8004830 comp rx=0 tx=0).stop 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d2d76640 1 -- 10.20.193.51:0/3003290042 reap_dead start 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5baffd640 1 -- 10.20.193.51:0/3003290042 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(142..142 src has 47..142) ==== 4859+0+0 (unknown 0 0 0) 0x7fa5c8077650 con 0x7fa5d409e540 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d2d76640 1 -- 10.20.193.51:0/3003290042 reap_dead start 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.864+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 shutdown_connections 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.865+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 >> 10.20.193.51:0/3003290042 conn(0x7fa5d40a30c0 msgr2=0x7fa5d4073000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.865+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 shutdown_connections 2026-02-17T11:49:21.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.865+0000 7fa5d8cb0640 1 -- 10.20.193.51:0/3003290042 wait complete. 2026-02-17T11:49:21.898 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:49:21.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:49:21.898 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: get_monmap_and_config 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: build_initial_monmap 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: monmap: 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:21.965113+0000 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:21.965113+0000 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:21.967 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 Processor -- start 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 -- start start 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: init 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2b5c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2b5c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2b5c13c770 0x7f2b5c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-a con 0x7f2b5c13c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c09e8e0 con 0x7f2b5c0a3bb0 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c06e140 con 0x7f2b5c0a0750 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5c09f910 con 0x7f2b5c13c770 2026-02-17T11:49:21.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b63c22640 10 monclient(hunting): authenticate will time out at 849.583829s 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b61997640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f2b5c0a3bb0 legacy=0x7f2b5c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b62198640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f2b5c13c770 msgr2=0x7f2b5c13eb60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b62198640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2b5c13c770 0x7f2b5c13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.964+0000 7f2b61196640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f2b5c0a0750 0x7f2b5c09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:36714/0 (socket says 10.20.193.51:36714) 2026-02-17T11:49:21.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.965+0000 7f2b61196640 1 -- 10.20.193.51:0/533028417 learned_addr learned my addr 10.20.193.51:0/533028417 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:21.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61196640 1 -- 10.20.193.51:0/533028417 >> v1:10.20.193.142:6789/0 conn(0x7f2b5c0a0750 legacy=0x7f2b5c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072289608 0 0) 0x7f2b5c06e140 con 0x7f2b5c0a0750 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): _negotiate 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): my global_id is 64129 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b44003620 con 0x7f2b5c0a0750 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1490121023 0 0) 0x7f2b44003620 con 0x7f2b5c0a0750 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 >> v2:10.20.193.51:3300/0 conn(0x7f2b5c13c770 msgr2=0x7f2b5c13eb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 --2- 10.20.193.51:0/533028417 >> v2:10.20.193.51:3300/0 conn(0x7f2b5c13c770 0x7f2b5c13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 >> v1:10.20.193.51:6789/0 conn(0x7f2b5c0a3bb0 legacy=0x7f2b5c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c09ccd0 con 0x7f2b5c0a0750 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f2b500031b0 con 0x7f2b5c0a0750 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: dump: 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 >> v1:10.20.193.142:6789/0 conn(0x7f2b5c0a0750 legacy=0x7f2b5c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 0x7f2b44003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): picked mon.c con 0x7f2b44003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44004900 0x7f2b44004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): picked mon.b con 0x7f2b44004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b440054c0 0x7f2b4400bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): picked mon.a con 0x7f2b440054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c09f910 con 0x7f2b440054c0 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4400c400 con 0x7f2b44004900 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4400c600 con 0x7f2b44003ab0 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b60995640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b62198640 1 -- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b440054c0 msgr2=0x7f2b4400bb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b62198640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b440054c0 0x7f2b4400bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 0x7f2b44003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): get_auth_request con 0x7f2b44003ab0 auth_method 0 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient(hunting): handle_auth_done global_id 64129 payload 293 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 -- 10.20.193.51:0/533028417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44004900 msgr2=0x7f2b44004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44004900 0x7f2b44004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 -- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b440054c0 msgr2=0x7f2b4400bb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b440054c0 0x7f2b4400bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 monclient: found mon.c 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b62198640 1 -- 10.20.193.51:0/533028417 reap_dead start 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 1 -- 10.20.193.51:0/533028417 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b44003620 con 0x7f2b44003ab0 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b61997640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b63c22640 5 monclient: authenticate success, global_id 64129 2026-02-17T11:49:21.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.967+0000 7f2b63c22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b61997640 1 -- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 msgr2=0x7f2b44003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b61997640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 0x7f2b44003eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009e30 tx=0x7f2b4c02f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6960c182f900f58 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c009a30 con 0x7f2b44003ab0 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: dump: 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.981 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c003cb0 con 0x7f2b44003ab0 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 1 -- 10.20.193.51:0/533028417 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c003e60 con 0x7f2b44003ab0 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 4 set_mon_vals no callback set 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b60995640 10 monclient: dump: 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.982 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 10 monclient: shutdown 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 -- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 msgr2=0x7f2b44003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 0x7f2b44003eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009e30 tx=0x7f2b4c02f660 comp rx=0 tx=0).stop 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 -- 10.20.193.51:0/533028417 shutdown_connections 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 --2- 10.20.193.51:0/533028417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b44003ab0 0x7f2b44003eb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 -- 10.20.193.51:0/533028417 >> 10.20.193.51:0/533028417 conn(0x7f2b5c0a30c0 msgr2=0x7f2b5c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.970+0000 7f2b63c22640 1 -- 10.20.193.51:0/533028417 shutdown_connections 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 1 -- 10.20.193.51:0/533028417 wait complete. 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 10 monclient: build_initial_monmap 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 10 monclient: monmap: 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:21.983 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 1 Processor -- start 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 1 -- start start 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.971+0000 7f2b63c22640 10 monclient: init 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44003ab0 0x7f2b5c0960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-b con 0x7f2b44003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b5c096610 0x7f2b5c096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-a con 0x7f2b5c096610 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): picked mon.noname-c con 0x7f2b5c096fb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c09c850 con 0x7f2b5c096610 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c09ebe0 con 0x7f2b44003ab0 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c0a04b0 con 0x7f2b5c096fb0 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b63c22640 10 monclient(hunting): authenticate will time out at 849.591159s 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61196640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b5c096610 msgr2=0x7f2b5c096a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61196640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b5c096610 0x7f2b5c096a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46602/0 (socket says 10.20.193.51:46602) 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 learned_addr learned my addr 10.20.193.51:0/4221836086 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): get_auth_request con 0x7f2b5c096fb0 auth_method 0 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61997640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44003ab0 0x7f2b5c0960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61997640 10 monclient(hunting): get_auth_request con 0x7f2b44003ab0 auth_method 0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61997640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b61997640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient(hunting): handle_auth_done global_id 44369 payload 824 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44003ab0 msgr2=0x7f2b5c0960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b44003ab0 0x7f2b5c0960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b5c096610 msgr2=0x7f2b5c096a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2b5c096610 0x7f2b5c096a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient: _finish_hunting 0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 monclient: found mon.noname-c 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.972+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c09baa0 con 0x7f2b5c096fb0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 msgr2=0x7f2b5c1d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b62198640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800bb10 tx=0x7f2b5800c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580067d0 con 0x7f2b5c096fb0 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: dump: 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 5 monclient: authenticate success, global_id 44369 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b58006970 con 0x7f2b5c096fb0 2026-02-17T11:49:21.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58015390 con 0x7f2b5c096fb0 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4bfff640 4 set_mon_vals no callback set 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b4a7fc640 10 monclient: dump: 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 10 monclient: _renew_subs 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c099b10 con 0x7f2b5c096fb0 2026-02-17T11:49:21.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 10 monclient: _renew_subs 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.974+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c06f480 con 0x7f2b5c096fb0 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b63c22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b63c22640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 0x7f2b5c0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c098490 con 0x7f2b5c092a80 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b62198640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800bb10 tx=0x7f2b5800c400 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f2b58052e70 osd_map(142..142 src has 47..142) 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2b580155b0 con 0x7f2b5c096fb0 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 0x7f2b5c0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient: get_auth_request con 0x7f2b5c092a80 auth_method 0 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b4a7fc640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b2c03dcc0 0x7f2b2c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 10 monclient(hunting): handle_auth_done global_id 64135 payload 824 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61997640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b5c0a2ab0 con 0x7f2b5c092a80 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61196640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b2c03dcc0 0x7f2b2c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.975+0000 7f2b61196640 10 monclient: get_auth_request con 0x7f2b2c03dcc0 auth_method 0 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.977+0000 7f2b61997640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 msgr2=0x7f2b5c0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.977+0000 7f2b61997640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 0x7f2b5c0638c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c037000 tx=0x7f2b4c005b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c047070 con 0x7f2b5c092a80 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 10 monclient: dump: 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f2b4c03d040 con 0x7f2b5c092a80 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 msgr2=0x7f2b5c0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 0x7f2b5c0638c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c037000 tx=0x7f2b4c005b10 comp rx=0 tx=0).stop 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 msgr2=0x7f2b5c0638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b4a7fc640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092a80 0x7f2b5c0638c0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c037000 tx=0x7f2b4c005b10 comp rx=0 tx=0).stop 2026-02-17T11:49:21.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.978+0000 7f2b61196640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b2c03dcc0 0x7f2b2c040180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b50002da0 tx=0x7f2b50003670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b63c22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:21.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b63c22640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 0x7f2b5c1d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:21.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b63c22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c09d7b0 con 0x7f2b5c092e60 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 0x7f2b5c1d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient: get_auth_request con 0x7f2b5c092e60 auth_method 0 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 10 monclient(hunting): handle_auth_done global_id 64138 payload 824 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.981+0000 7f2b61997640 1 -- 10.20.193.51:0/4221836086 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b5c09db50 con 0x7f2b5c092e60 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.983+0000 7f2b61997640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 msgr2=0x7f2b5c1d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.983+0000 7f2b61997640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 0x7f2b5c1d9df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009e30 tx=0x7f2b4c033000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c04ccf0 con 0x7f2b5c092e60 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:21.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 10 monclient: dump: 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7f2b4c037430 con 0x7f2b5c092e60 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 msgr2=0x7f2b5c1d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 0x7f2b5c1d9df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009e30 tx=0x7f2b4c033000 comp rx=0 tx=0).stop 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 msgr2=0x7f2b5c1d9df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:21.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2b5c092e60 0x7f2b5c1d9df0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009e30 tx=0x7f2b4c033000 comp rx=0 tx=0).stop 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 30, 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 33531, 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:21.995 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.996 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:21.997 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:21.998 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:21.999 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:22.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.001 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.002 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:22.003 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:22.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b2c03dcc0 msgr2=0x7f2b2c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b2c03dcc0 0x7f2b2c040180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b50002da0 tx=0x7f2b50003670 comp rx=0 tx=0).stop 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 10 monclient: shutdown 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 msgr2=0x7f2b5c1d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 --2- 10.20.193.51:0/4221836086 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2b5c096fb0 0x7f2b5c1d5890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800bb10 tx=0x7f2b5800c400 comp rx=0 tx=0).stop 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 reap_dead start 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b62198640 1 -- 10.20.193.51:0/4221836086 reap_dead start 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b4a7fc640 1 -- 10.20.193.51:0/4221836086 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(142..142 src has 47..142) ==== 4859+0+0 (unknown 0 0 0) 0x7f2b58052e70 con 0x7f2b5c096fb0 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 shutdown_connections 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 >> 10.20.193.51:0/4221836086 conn(0x7f2b5c0a30c0 msgr2=0x7f2b5c13bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 shutdown_connections 2026-02-17T11:49:22.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:21.984+0000 7f2b63c22640 1 -- 10.20.193.51:0/4221836086 wait complete. 2026-02-17T11:49:22.005 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:49:22.006 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:49:22.701 INFO:tasks.rados.rados.0.trial142.stdout:531: done (2 left) 2026-02-17T11:49:22.701 INFO:tasks.rados.rados.0.trial142.stdout:532: read oid 48 snap -1 2026-02-17T11:49:22.701 INFO:tasks.rados.rados.0.trial142.stdout:532: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:49:22.702 INFO:tasks.rados.rados.0.trial142.stdout:533: copy_from oid 40 from oid 28 current snap is 60 2026-02-17T11:49:22.702 INFO:tasks.rados.rados.0.trial142.stdout:529: finishing rollback tid 1 to trial14245205-33 2026-02-17T11:49:22.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:49:22.702 INFO:tasks.rados.rados.0.trial142.stdout:530: expect (ObjNum 173 snap 51 seq_num 173) 2026-02-17T11:49:22.847 INFO:tasks.rados.rados.0.trial142.stdout:532: expect (ObjNum 124 snap 32 seq_num 124) 2026-02-17T11:49:22.895 INFO:tasks.rados.rados.0.trial142.stdout:533: finishing copy_from racing read to trial14245205-40 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:529: done (3 left) 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:530: done (2 left) 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:532: done (1 left) 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:534: delete oid 32 current snap is 60 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:533: finishing copy_from to trial14245205-40 2026-02-17T11:49:22.896 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 107 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:49:22.897 INFO:tasks.rados.rados.0.trial142.stdout:533: done (1 left) 2026-02-17T11:49:22.897 INFO:tasks.rados.rados.0.trial142.stdout:534: done (0 left) 2026-02-17T11:49:22.897 INFO:tasks.rados.rados.0.trial142.stdout:535: read oid 42 snap -1 2026-02-17T11:49:22.897 INFO:tasks.rados.rados.0.trial142.stdout:535: expect (ObjNum 168 snap 51 seq_num 168) 2026-02-17T11:49:22.897 INFO:tasks.rados.rados.0.trial142.stdout:536: snap_remove snap 35 2026-02-17T11:49:23.461 INFO:tasks.rados.rados.0.trial142.stdout:536: done (1 left) 2026-02-17T11:49:23.461 INFO:tasks.rados.rados.0.trial142.stdout:537: snap_create 2026-02-17T11:49:23.461 INFO:tasks.rados.rados.0.trial142.stdout:535: expect (ObjNum 168 snap 51 seq_num 168) 2026-02-17T11:49:24.462 INFO:tasks.rados.rados.0.trial142.stdout:535: done (1 left) 2026-02-17T11:49:24.462 INFO:tasks.rados.rados.0.trial142.stdout:537: done (0 left) 2026-02-17T11:49:24.463 INFO:tasks.rados.rados.0.trial142.stdout:538: rollback oid 16 current snap is 61 2026-02-17T11:49:24.463 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 38 2026-02-17T11:49:24.463 INFO:tasks.rados.rados.0.trial142.stdout:539: write (excl) oid 12 current snap is 61 2026-02-17T11:49:24.463 INFO:tasks.rados.rados.0.trial142.stdout:539: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-17T11:49:24.466 INFO:tasks.rados.rados.0.trial142.stdout:539: writing trial14245205-12 from 561400 to 1036378 tid 1 2026-02-17T11:49:24.471 INFO:tasks.rados.rados.0.trial142.stdout:539: writing trial14245205-12 from 1820281 to 2340004 tid 2 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:539: writing trial14245205-12 from 2859422 to 3317001 tid 3 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:540: snap_create 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:538: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:538: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:538: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 230 (ObjNum 129 snap 32 seq_num 129) dirty exists 2026-02-17T11:49:24.475 INFO:tasks.rados.rados.0.trial142.stdout:539: finishing write tid 1 to trial14245205-12 2026-02-17T11:49:24.476 INFO:tasks.rados.rados.0.trial142.stdout:539: finishing write tid 2 to trial14245205-12 2026-02-17T11:49:24.476 INFO:tasks.rados.rados.0.trial142.stdout:539: finishing write tid 3 to trial14245205-12 2026-02-17T11:49:24.476 INFO:tasks.rados.rados.0.trial142.stdout:539: finishing write tid 4 to trial14245205-12 2026-02-17T11:49:24.476 INFO:tasks.rados.rados.0.trial142.stdout:539: finishing write tid 5 to trial14245205-12 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:539: oid 12 updating version 0 to 461 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:539: oid 12 updating version 461 to 462 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:539: oid 12 updating version 462 to 463 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:539: oid 12 version 463 is already newer than 460 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 463 (ObjNum 200 snap 61 seq_num 200) dirty exists 2026-02-17T11:49:24.477 INFO:tasks.rados.rados.0.trial142.stdout:539: left oid 12 (ObjNum 200 snap 61 seq_num 200) 2026-02-17T11:49:25.462 INFO:tasks.rados.rados.0.trial142.stdout:538: done (2 left) 2026-02-17T11:49:25.462 INFO:tasks.rados.rados.0.trial142.stdout:539: done (1 left) 2026-02-17T11:49:25.463 INFO:tasks.rados.rados.0.trial142.stdout:540: done (0 left) 2026-02-17T11:49:25.463 INFO:tasks.rados.rados.0.trial142.stdout:541: delete oid 30 current snap is 62 2026-02-17T11:49:25.465 INFO:tasks.rados.rados.0.trial142.stdout:541: done (0 left) 2026-02-17T11:49:25.465 INFO:tasks.rados.rados.0.trial142.stdout:542: write oid 37 current snap is 62 2026-02-17T11:49:25.465 INFO:tasks.rados.rados.0.trial142.stdout:542: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2026-02-17T11:49:25.469 INFO:tasks.rados.rados.0.trial142.stdout:542: writing trial14245205-37 from 595014 to 1220490 tid 1 2026-02-17T11:49:25.474 INFO:tasks.rados.rados.0.trial142.stdout:542: writing trial14245205-37 from 1820892 to 2344284 tid 2 2026-02-17T11:49:25.478 INFO:tasks.rados.rados.0.trial142.stdout:542: writing trial14245205-37 from 2797915 to 3394391 tid 3 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:543: copy_from oid 34 from oid 18 current snap is 62 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:542: finishing write tid 1 to trial14245205-37 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:542: finishing write tid 2 to trial14245205-37 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:544: read oid 11 snap 47 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:544: expect (ObjNum 111 snap 27 seq_num 111) 2026-02-17T11:49:25.479 INFO:tasks.rados.rados.0.trial142.stdout:545: snap_remove snap 38 2026-02-17T11:49:26.466 INFO:tasks.rados.rados.0.trial142.stdout:545: done (3 left) 2026-02-17T11:49:26.467 INFO:tasks.rados.rados.0.trial142.stdout:546: write (excl) oid 4 current snap is 62 2026-02-17T11:49:26.467 INFO:tasks.rados.rados.0.trial142.stdout:546: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2026-02-17T11:49:26.472 INFO:tasks.rados.rados.0.trial142.stdout:546: writing trial14245205-4 from 611821 to 1312546 tid 1 2026-02-17T11:49:26.477 INFO:tasks.rados.rados.0.trial142.stdout:546: writing trial14245205-4 from 1879374 to 2662777 tid 2 2026-02-17T11:49:26.480 INFO:tasks.rados.rados.0.trial142.stdout:546: writing trial14245205-4 from 3341691 to 3411821 tid 3 2026-02-17T11:49:26.480 INFO:tasks.rados.rados.0.trial142.stdout:547: snap_create 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: finishing write tid 3 to trial14245205-37 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: finishing write tid 4 to trial14245205-37 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: finishing write tid 5 to trial14245205-37 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: oid 37 updating version 0 to 180 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: oid 37 version 180 is already newer than 179 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: oid 37 version 180 is already newer than 178 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: oid 37 updating version 180 to 181 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 181 (ObjNum 202 snap 62 seq_num 202) dirty exists 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:542: left oid 37 (ObjNum 202 snap 62 seq_num 202) 2026-02-17T11:49:26.481 INFO:tasks.rados.rados.0.trial142.stdout:544: expect (ObjNum 111 snap 27 seq_num 111) 2026-02-17T11:49:26.644 INFO:tasks.rados.rados.0.trial142.stdout:543: finishing copy_from racing read to trial14245205-34 2026-02-17T11:49:26.644 INFO:tasks.rados.rados.0.trial142.stdout:543: finishing copy_from to trial14245205-34 2026-02-17T11:49:26.644 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 427 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:49:26.644 INFO:tasks.rados.rados.0.trial142.stdout:546: finishing write tid 1 to trial14245205-4 2026-02-17T11:49:26.644 INFO:tasks.rados.rados.0.trial142.stdout:546: finishing write tid 2 to trial14245205-4 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: finishing write tid 3 to trial14245205-4 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: finishing write tid 4 to trial14245205-4 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: finishing write tid 5 to trial14245205-4 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: oid 4 updating version 0 to 478 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: oid 4 version 478 is already newer than 465 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: oid 4 updating version 478 to 482 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: oid 4 version 482 is already newer than 481 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 482 (ObjNum 203 snap 62 seq_num 203) dirty exists 2026-02-17T11:49:26.645 INFO:tasks.rados.rados.0.trial142.stdout:546: left oid 4 (ObjNum 203 snap 62 seq_num 203) 2026-02-17T11:49:27.469 INFO:tasks.rados.rados.0.trial142.stdout:542: done (4 left) 2026-02-17T11:49:27.469 INFO:tasks.rados.rados.0.trial142.stdout:543: done (3 left) 2026-02-17T11:49:27.469 INFO:tasks.rados.rados.0.trial142.stdout:544: done (2 left) 2026-02-17T11:49:27.469 INFO:tasks.rados.rados.0.trial142.stdout:546: done (1 left) 2026-02-17T11:49:27.470 INFO:tasks.rados.rados.0.trial142.stdout:547: done (0 left) 2026-02-17T11:49:27.470 INFO:tasks.rados.rados.0.trial142.stdout:548: delete oid 29 current snap is 63 2026-02-17T11:49:27.472 INFO:tasks.rados.rados.0.trial142.stdout:548: done (0 left) 2026-02-17T11:49:27.472 INFO:tasks.rados.rados.0.trial142.stdout:549: snap_create 2026-02-17T11:49:28.461 INFO:tasks.rados.rados.0.trial142.stdout:549: done (0 left) 2026-02-17T11:49:28.461 INFO:tasks.rados.rados.0.trial142.stdout:550: snap_create 2026-02-17T11:49:29.462 INFO:tasks.rados.rados.0.trial142.stdout:550: done (0 left) 2026-02-17T11:49:29.462 INFO:tasks.rados.rados.0.trial142.stdout:551: snap_remove snap 57 2026-02-17T11:49:30.462 INFO:tasks.rados.rados.0.trial142.stdout:551: done (0 left) 2026-02-17T11:49:30.462 INFO:tasks.rados.rados.0.trial142.stdout:552: snap_create 2026-02-17T11:49:31.465 INFO:tasks.rados.rados.0.trial142.stdout:552: done (0 left) 2026-02-17T11:49:31.466 INFO:tasks.rados.rados.0.trial142.stdout:553: rollback oid 49 current snap is 66 2026-02-17T11:49:31.466 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 55 2026-02-17T11:49:31.466 INFO:tasks.rados.rados.0.trial142.stdout:554: snap_remove snap 60 2026-02-17T11:49:32.467 INFO:tasks.rados.rados.0.trial142.stdout:554: done (1 left) 2026-02-17T11:49:32.467 INFO:tasks.rados.rados.0.trial142.stdout:555: write (excl) oid 35 current snap is 66 2026-02-17T11:49:32.467 INFO:tasks.rados.rados.0.trial142.stdout:555: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2026-02-17T11:49:32.471 INFO:tasks.rados.rados.0.trial142.stdout:555: writing trial14245205-35 from 645435 to 1096658 tid 1 2026-02-17T11:49:32.477 INFO:tasks.rados.rados.0.trial142.stdout:555: writing trial14245205-35 from 1879985 to 2667057 tid 2 2026-02-17T11:49:32.480 INFO:tasks.rados.rados.0.trial142.stdout:555: writing trial14245205-35 from 3280184 to 3445435 tid 3 2026-02-17T11:49:32.480 INFO:tasks.rados.rados.0.trial142.stdout:556: write oid 12 current snap is 66 2026-02-17T11:49:32.481 INFO:tasks.rados.rados.0.trial142.stdout:556: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2026-02-17T11:49:32.485 INFO:tasks.rados.rados.0.trial142.stdout:556: writing trial14245205-12 from 662242 to 1305067 tid 1 2026-02-17T11:49:32.490 INFO:tasks.rados.rados.0.trial142.stdout:556: writing trial14245205-12 from 2054820 to 2585550 tid 2 2026-02-17T11:49:32.493 INFO:tasks.rados.rados.0.trial142.stdout:556: writing trial14245205-12 from 3307607 to 3462242 tid 3 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:557: write oid 25 current snap is 66 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:553: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 365 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:555: finishing write tid 1 to trial14245205-35 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:555: finishing write tid 2 to trial14245205-35 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:555: finishing write tid 3 to trial14245205-35 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:555: finishing write tid 4 to trial14245205-35 2026-02-17T11:49:32.494 INFO:tasks.rados.rados.0.trial142.stdout:557: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2026-02-17T11:49:32.498 INFO:tasks.rados.rados.0.trial142.stdout:557: writing trial14245205-25 from 679049 to 1397123 tid 1 2026-02-17T11:49:32.504 INFO:tasks.rados.rados.0.trial142.stdout:557: writing trial14245205-25 from 2113302 to 2787690 tid 2 2026-02-17T11:49:32.506 INFO:tasks.rados.rados.0.trial142.stdout:557: writing trial14245205-25 from 3335030 to 3479049 tid 3 2026-02-17T11:49:32.506 INFO:tasks.rados.rados.0.trial142.stdout:553: done (3 left) 2026-02-17T11:49:32.507 INFO:tasks.rados.rados.0.trial142.stdout:558: snap_remove snap 62 2026-02-17T11:49:33.462 INFO:tasks.rados.rados.0.trial142.stdout:558: done (3 left) 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:559: delete oid 42 current snap is 66 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: finishing write tid 5 to trial14245205-35 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: oid 35 updating version 0 to 388 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: oid 35 updating version 388 to 389 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: oid 35 updating version 389 to 390 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: oid 35 updating version 390 to 391 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 391 (ObjNum 205 snap 66 seq_num 205) dirty exists 2026-02-17T11:49:33.463 INFO:tasks.rados.rados.0.trial142.stdout:555: left oid 35 (ObjNum 205 snap 66 seq_num 205) 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: finishing write tid 1 to trial14245205-12 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: finishing write tid 2 to trial14245205-12 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: finishing write tid 3 to trial14245205-12 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: finishing write tid 4 to trial14245205-12 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: finishing write tid 5 to trial14245205-12 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: oid 12 updating version 0 to 490 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: oid 12 version 490 is already newer than 487 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: oid 12 updating version 490 to 491 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: oid 12 updating version 491 to 492 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 492 (ObjNum 206 snap 66 seq_num 206) dirty exists 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:556: left oid 12 (ObjNum 206 snap 66 seq_num 206) 2026-02-17T11:49:33.464 INFO:tasks.rados.rados.0.trial142.stdout:557: finishing write tid 1 to trial14245205-25 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: finishing write tid 2 to trial14245205-25 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: finishing write tid 3 to trial14245205-25 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: finishing write tid 4 to trial14245205-25 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: finishing write tid 5 to trial14245205-25 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: oid 25 updating version 0 to 149 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: oid 25 updating version 149 to 151 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: oid 25 updating version 151 to 152 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: oid 25 version 152 is already newer than 150 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 152 (ObjNum 207 snap 66 seq_num 207) dirty exists 2026-02-17T11:49:33.465 INFO:tasks.rados.rados.0.trial142.stdout:557: left oid 25 (ObjNum 207 snap 66 seq_num 207) 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:555: done (3 left) 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:556: done (2 left) 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:557: done (1 left) 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:559: done (0 left) 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:560: read oid 49 snap -1 2026-02-17T11:49:33.466 INFO:tasks.rados.rados.0.trial142.stdout:560: expect deleted 2026-02-17T11:49:33.467 INFO:tasks.rados.rados.0.trial142.stdout:561: snap_create 2026-02-17T11:49:34.465 INFO:tasks.rados.rados.0.trial142.stdout:560: done (1 left) 2026-02-17T11:49:34.466 INFO:tasks.rados.rados.0.trial142.stdout:561: done (0 left) 2026-02-17T11:49:34.466 INFO:tasks.rados.rados.0.trial142.stdout:562: snap_create 2026-02-17T11:49:35.466 INFO:tasks.rados.rados.0.trial142.stdout:562: done (0 left) 2026-02-17T11:49:35.466 INFO:tasks.rados.rados.0.trial142.stdout:563: write oid 10 current snap is 68 2026-02-17T11:49:35.466 INFO:tasks.rados.rados.0.trial142.stdout:563: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2026-02-17T11:49:35.470 INFO:tasks.rados.rados.0.trial142.stdout:563: writing trial14245205-10 from 712663 to 1181235 tid 1 2026-02-17T11:49:35.475 INFO:tasks.rados.rados.0.trial142.stdout:563: writing trial14245205-10 from 1713913 to 2391970 tid 2 2026-02-17T11:49:35.479 INFO:tasks.rados.rados.0.trial142.stdout:563: writing trial14245205-10 from 2873523 to 3465256 tid 3 2026-02-17T11:49:35.479 INFO:tasks.rados.rados.0.trial142.stdout:564: read oid 2 snap -1 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:564: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:565: copy_from oid 7 from oid 42 current snap is 68 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:563: finishing write tid 1 to trial14245205-10 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:563: finishing write tid 2 to trial14245205-10 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:566: read oid 36 snap -1 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:566: expect (ObjNum 197 snap 58 seq_num 197) 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:567: write (excl) oid 33 current snap is 68 2026-02-17T11:49:35.480 INFO:tasks.rados.rados.0.trial142.stdout:567: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2026-02-17T11:49:35.484 INFO:tasks.rados.rados.0.trial142.stdout:567: writing trial14245205-33 from 729470 to 1273291 tid 1 2026-02-17T11:49:35.487 INFO:tasks.rados.rados.0.trial142.stdout:567: writing trial14245205-33 from 1772395 to 2310463 tid 2 2026-02-17T11:49:35.491 INFO:tasks.rados.rados.0.trial142.stdout:567: writing trial14245205-33 from 2900946 to 3303951 tid 3 2026-02-17T11:49:35.492 INFO:tasks.rados.rados.0.trial142.stdout:568: write oid 13 current snap is 68 2026-02-17T11:49:35.492 INFO:tasks.rados.rados.0.trial142.stdout:563: finishing write tid 3 to trial14245205-10 2026-02-17T11:49:35.492 INFO:tasks.rados.rados.0.trial142.stdout:563: finishing write tid 4 to trial14245205-10 2026-02-17T11:49:35.492 INFO:tasks.rados.rados.0.trial142.stdout:568: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2026-02-17T11:49:35.496 INFO:tasks.rados.rados.0.trial142.stdout:568: writing trial14245205-13 from 746277 to 1365347 tid 1 2026-02-17T11:49:35.500 INFO:tasks.rados.rados.0.trial142.stdout:568: writing trial14245205-13 from 1830877 to 2512603 tid 2 2026-02-17T11:49:35.505 INFO:tasks.rados.rados.0.trial142.stdout:568: writing trial14245205-13 from 2928369 to 3546277 tid 3 2026-02-17T11:49:35.505 INFO:tasks.rados.rados.0.trial142.stdout:569: write (excl) oid 6 current snap is 68 2026-02-17T11:49:35.505 INFO:tasks.rados.rados.0.trial142.stdout:569: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2026-02-17T11:49:35.510 INFO:tasks.rados.rados.0.trial142.stdout:569: writing trial14245205-6 from 763084 to 1457403 tid 1 2026-02-17T11:49:35.513 INFO:tasks.rados.rados.0.trial142.stdout:569: writing trial14245205-6 from 1889359 to 2431096 tid 2 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:569: writing trial14245205-6 from 2955792 to 3497694 tid 3 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:570: snap_create 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: finishing write tid 5 to trial14245205-10 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: oid 10 updating version 0 to 255 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: oid 10 updating version 255 to 256 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: oid 10 version 256 is already newer than 254 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: oid 10 updating version 256 to 257 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 257 (ObjNum 209 snap 68 seq_num 209) dirty exists 2026-02-17T11:49:35.518 INFO:tasks.rados.rados.0.trial142.stdout:563: left oid 10 (ObjNum 209 snap 68 seq_num 209) 2026-02-17T11:49:35.519 INFO:tasks.rados.rados.0.trial142.stdout:565: finishing copy_from to trial14245205-7 2026-02-17T11:49:35.519 INFO:tasks.rados.rados.0.trial142.stdout:565: got expected ENOENT (src dne) 2026-02-17T11:49:35.519 INFO:tasks.rados.rados.0.trial142.stdout:565: finishing copy_from racing read to trial14245205-7 2026-02-17T11:49:35.519 INFO:tasks.rados.rados.0.trial142.stdout:566: expect (ObjNum 197 snap 58 seq_num 197) 2026-02-17T11:49:35.649 INFO:tasks.rados.rados.0.trial142.stdout:564: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:49:35.703 INFO:tasks.rados.rados.0.trial142.stdout:567: finishing write tid 1 to trial14245205-33 2026-02-17T11:49:35.703 INFO:tasks.rados.rados.0.trial142.stdout:567: finishing write tid 2 to trial14245205-33 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: finishing write tid 3 to trial14245205-33 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: finishing write tid 4 to trial14245205-33 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: finishing write tid 5 to trial14245205-33 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: oid 33 updating version 0 to 394 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: oid 33 updating version 394 to 396 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: oid 33 version 396 is already newer than 395 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: oid 33 updating version 396 to 397 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 397 (ObjNum 210 snap 68 seq_num 210) dirty exists 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:567: left oid 33 (ObjNum 210 snap 68 seq_num 210) 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:568: finishing write tid 1 to trial14245205-13 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:568: finishing write tid 2 to trial14245205-13 2026-02-17T11:49:35.704 INFO:tasks.rados.rados.0.trial142.stdout:568: finishing write tid 3 to trial14245205-13 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: finishing write tid 4 to trial14245205-13 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: finishing write tid 5 to trial14245205-13 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: oid 13 updating version 0 to 399 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: oid 13 version 399 is already newer than 398 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: oid 13 updating version 399 to 401 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: oid 13 version 401 is already newer than 400 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 401 (ObjNum 211 snap 68 seq_num 211) dirty exists 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:568: left oid 13 (ObjNum 211 snap 68 seq_num 211) 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: finishing write tid 1 to trial14245205-6 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: finishing write tid 2 to trial14245205-6 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: finishing write tid 3 to trial14245205-6 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: finishing write tid 4 to trial14245205-6 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: finishing write tid 5 to trial14245205-6 2026-02-17T11:49:35.705 INFO:tasks.rados.rados.0.trial142.stdout:569: oid 6 updating version 0 to 129 2026-02-17T11:49:35.706 INFO:tasks.rados.rados.0.trial142.stdout:569: oid 6 version 129 is already newer than 126 2026-02-17T11:49:35.706 INFO:tasks.rados.rados.0.trial142.stdout:569: oid 6 version 129 is already newer than 127 2026-02-17T11:49:35.706 INFO:tasks.rados.rados.0.trial142.stdout:569: oid 6 version 129 is already newer than 128 2026-02-17T11:49:35.706 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 129 (ObjNum 212 snap 68 seq_num 212) dirty exists 2026-02-17T11:49:35.706 INFO:tasks.rados.rados.0.trial142.stdout:569: left oid 6 (ObjNum 212 snap 68 seq_num 212) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:563: done (7 left) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:564: done (6 left) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:565: done (5 left) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:566: done (4 left) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:567: done (3 left) 2026-02-17T11:49:36.472 INFO:tasks.rados.rados.0.trial142.stdout:568: done (2 left) 2026-02-17T11:49:36.473 INFO:tasks.rados.rados.0.trial142.stdout:569: done (1 left) 2026-02-17T11:49:36.473 INFO:tasks.rados.rados.0.trial142.stdout:570: done (0 left) 2026-02-17T11:49:36.473 INFO:tasks.rados.rados.0.trial142.stdout:571: write (excl) oid 45 current snap is 69 2026-02-17T11:49:36.473 INFO:tasks.rados.rados.0.trial142.stdout:571: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2026-02-17T11:49:36.476 INFO:tasks.rados.rados.0.trial142.stdout:571: writing trial14245205-45 from 779891 to 1265812 tid 1 2026-02-17T11:49:36.481 INFO:tasks.rados.rados.0.trial142.stdout:571: writing trial14245205-45 from 1947841 to 2633236 tid 2 2026-02-17T11:49:36.485 INFO:tasks.rados.rados.0.trial142.stdout:571: writing trial14245205-45 from 3383215 to 3579891 tid 3 2026-02-17T11:49:36.485 INFO:tasks.rados.rados.0.trial142.stdout:572: write (excl) oid 35 current snap is 69 2026-02-17T11:49:36.485 INFO:tasks.rados.rados.0.trial142.stdout:572: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2026-02-17T11:49:36.490 INFO:tasks.rados.rados.0.trial142.stdout:572: writing trial14245205-35 from 796698 to 1357868 tid 1 2026-02-17T11:49:36.494 INFO:tasks.rados.rados.0.trial142.stdout:572: writing trial14245205-35 from 2006323 to 2551729 tid 2 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:572: writing trial14245205-35 from 3126991 to 3596698 tid 3 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:573: copy_from oid 15 from oid 39 current snap is 69 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:571: finishing write tid 1 to trial14245205-45 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:571: finishing write tid 2 to trial14245205-45 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:571: finishing write tid 3 to trial14245205-45 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:571: finishing write tid 4 to trial14245205-45 2026-02-17T11:49:36.499 INFO:tasks.rados.rados.0.trial142.stdout:571: finishing write tid 5 to trial14245205-45 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: oid 45 updating version 0 to 431 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: oid 45 version 431 is already newer than 429 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: oid 45 version 431 is already newer than 430 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: oid 45 version 431 is already newer than 428 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 431 (ObjNum 213 snap 69 seq_num 213) dirty exists 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: left oid 45 (ObjNum 213 snap 69 seq_num 213) 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:572: finishing write tid 1 to trial14245205-35 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:572: finishing write tid 2 to trial14245205-35 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:571: done (2 left) 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:574: rollback oid 19 current snap is 69 2026-02-17T11:49:36.500 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 47 2026-02-17T11:49:36.501 INFO:tasks.rados.rados.0.trial142.stdout:575: snap_remove snap 64 2026-02-17T11:49:37.474 INFO:tasks.rados.rados.0.trial142.stdout:575: done (3 left) 2026-02-17T11:49:37.474 INFO:tasks.rados.rados.0.trial142.stdout:576: rollback oid 34 current snap is 69 2026-02-17T11:49:37.474 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 34 to 66 2026-02-17T11:49:37.474 INFO:tasks.rados.rados.0.trial142.stdout:572: finishing write tid 3 to trial14245205-35 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: finishing write tid 4 to trial14245205-35 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:574: finishing rollback tid 0 to trial14245205-19 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: finishing write tid 5 to trial14245205-35 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: oid 35 updating version 0 to 403 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: oid 35 updating version 403 to 406 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: oid 35 version 406 is already newer than 405 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: oid 35 version 406 is already newer than 404 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 406 (ObjNum 214 snap 69 seq_num 214) dirty exists 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:572: left oid 35 (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:574: finishing rollback tid 1 to trial14245205-19 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:574: finishing rollback tid 2 to trial14245205-19 2026-02-17T11:49:37.475 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 261 (ObjNum 141 snap 38 seq_num 141) dirty exists 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:573: finishing copy_from racing read to trial14245205-15 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:573: finishing copy_from to trial14245205-15 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 217 (ObjNum 140 snap 38 seq_num 140) dirty exists 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:572: done (3 left) 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:573: done (2 left) 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:574: done (1 left) 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:577: rollback oid 44 current snap is 69 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 68 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:578: copy_from oid 24 from oid 20 current snap is 69 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:579: delete oid 23 current snap is 69 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:577: finishing rollback tid 1 to trial14245205-44 2026-02-17T11:49:37.476 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 0 (ObjNum 49 snap 0 seq_num 1212463768) dirty dne 2026-02-17T11:49:37.477 INFO:tasks.rados.rados.0.trial142.stdout:576: finishing rollback tid 0 to trial14245205-34 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:576: finishing rollback tid 1 to trial14245205-34 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:576: finishing rollback tid 2 to trial14245205-34 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 434 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:576: done (3 left) 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:577: done (2 left) 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:579: done (1 left) 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:580: write (excl) oid 27 current snap is 69 2026-02-17T11:49:37.478 INFO:tasks.rados.rados.0.trial142.stdout:580: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2026-02-17T11:49:37.480 INFO:tasks.rados.rados.0.trial142.stdout:580: writing trial14245205-27 from 430312 to 1141980 tid 1 2026-02-17T11:49:37.485 INFO:tasks.rados.rados.0.trial142.stdout:580: writing trial14245205-27 from 1723287 to 2272362 tid 2 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:580: writing trial14245205-27 from 2781837 to 3485180 tid 3 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:581: snap_create 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:578: finishing copy_from racing read to trial14245205-24 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:580: finishing write tid 1 to trial14245205-27 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:578: finishing copy_from to trial14245205-24 2026-02-17T11:49:37.490 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 188 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:49:37.491 INFO:tasks.rados.rados.0.trial142.stdout:580: finishing write tid 2 to trial14245205-27 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: finishing write tid 3 to trial14245205-27 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: finishing write tid 4 to trial14245205-27 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: finishing write tid 5 to trial14245205-27 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: oid 27 updating version 0 to 410 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: oid 27 updating version 410 to 413 2026-02-17T11:49:37.492 INFO:tasks.rados.rados.0.trial142.stdout:580: oid 27 version 413 is already newer than 412 2026-02-17T11:49:37.493 INFO:tasks.rados.rados.0.trial142.stdout:580: oid 27 version 413 is already newer than 411 2026-02-17T11:49:37.493 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 413 (ObjNum 216 snap 69 seq_num 216) dirty exists 2026-02-17T11:49:37.493 INFO:tasks.rados.rados.0.trial142.stdout:580: left oid 27 (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:49:38.463 INFO:tasks.rados.rados.0.trial142.stdout:578: done (2 left) 2026-02-17T11:49:38.463 INFO:tasks.rados.rados.0.trial142.stdout:580: done (1 left) 2026-02-17T11:49:38.463 INFO:tasks.rados.rados.0.trial142.stdout:581: done (0 left) 2026-02-17T11:49:38.463 INFO:tasks.rados.rados.0.trial142.stdout:582: read oid 16 snap 69 2026-02-17T11:49:38.463 INFO:tasks.rados.rados.0.trial142.stdout:582: expect (ObjNum 129 snap 32 seq_num 129) 2026-02-17T11:49:38.464 INFO:tasks.rados.rados.0.trial142.stdout:583: write oid 25 current snap is 70 2026-02-17T11:49:38.464 INFO:tasks.rados.rados.0.trial142.stdout:583: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2026-02-17T11:49:38.468 INFO:tasks.rados.rados.0.trial142.stdout:583: writing trial14245205-25 from 447119 to 1234036 tid 1 2026-02-17T11:49:38.472 INFO:tasks.rados.rados.0.trial142.stdout:583: writing trial14245205-25 from 1665416 to 2358149 tid 2 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:583: writing trial14245205-25 from 2976554 to 3491169 tid 3 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:584: read oid 6 snap -1 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:584: expect (ObjNum 212 snap 68 seq_num 212) 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:585: read oid 27 snap -1 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:585: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:586: snap_create 2026-02-17T11:49:38.477 INFO:tasks.rados.rados.0.trial142.stdout:582: expect (ObjNum 129 snap 32 seq_num 129) 2026-02-17T11:49:38.563 INFO:tasks.rados.rados.0.trial142.stdout:583: finishing write tid 1 to trial14245205-25 2026-02-17T11:49:38.563 INFO:tasks.rados.rados.0.trial142.stdout:583: finishing write tid 2 to trial14245205-25 2026-02-17T11:49:38.563 INFO:tasks.rados.rados.0.trial142.stdout:583: finishing write tid 3 to trial14245205-25 2026-02-17T11:49:38.563 INFO:tasks.rados.rados.0.trial142.stdout:583: finishing write tid 4 to trial14245205-25 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: finishing write tid 5 to trial14245205-25 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: oid 25 updating version 0 to 159 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: oid 25 version 159 is already newer than 158 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: oid 25 updating version 159 to 161 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: oid 25 version 161 is already newer than 160 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 161 (ObjNum 217 snap 70 seq_num 217) dirty exists 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:583: left oid 25 (ObjNum 217 snap 70 seq_num 217) 2026-02-17T11:49:38.564 INFO:tasks.rados.rados.0.trial142.stdout:585: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:49:38.644 INFO:tasks.rados.rados.0.trial142.stdout:584: expect (ObjNum 212 snap 68 seq_num 212) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:582: done (4 left) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:583: done (3 left) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:584: done (2 left) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:585: done (1 left) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:586: done (0 left) 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:587: write (excl) oid 41 current snap is 71 2026-02-17T11:49:39.478 INFO:tasks.rados.rados.0.trial142.stdout:587: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2026-02-17T11:49:39.481 INFO:tasks.rados.rados.0.trial142.stdout:587: writing trial14245205-41 from 463926 to 926092 tid 1 2026-02-17T11:49:39.486 INFO:tasks.rados.rados.0.trial142.stdout:587: writing trial14245205-41 from 1723898 to 2160289 tid 2 2026-02-17T11:49:39.491 INFO:tasks.rados.rados.0.trial142.stdout:587: writing trial14245205-41 from 2603977 to 3329864 tid 3 2026-02-17T11:49:39.491 INFO:tasks.rados.rados.0.trial142.stdout:588: delete oid 16 current snap is 71 2026-02-17T11:49:39.491 INFO:tasks.rados.rados.0.trial142.stdout:587: finishing write tid 1 to trial14245205-41 2026-02-17T11:49:39.491 INFO:tasks.rados.rados.0.trial142.stdout:587: finishing write tid 2 to trial14245205-41 2026-02-17T11:49:39.493 INFO:tasks.rados.rados.0.trial142.stdout:588: done (1 left) 2026-02-17T11:49:39.493 INFO:tasks.rados.rados.0.trial142.stdout:589: read oid 47 snap -1 2026-02-17T11:49:39.493 INFO:tasks.rados.rados.0.trial142.stdout:589: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:49:39.493 INFO:tasks.rados.rados.0.trial142.stdout:590: read oid 19 snap -1 2026-02-17T11:49:39.493 INFO:tasks.rados.rados.0.trial142.stdout:590: expect (ObjNum 141 snap 38 seq_num 141) 2026-02-17T11:49:39.494 INFO:tasks.rados.rados.0.trial142.stdout:591: write oid 32 current snap is 71 2026-02-17T11:49:39.494 INFO:tasks.rados.rados.0.trial142.stdout:591: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2026-02-17T11:49:39.497 INFO:tasks.rados.rados.0.trial142.stdout:591: writing trial14245205-32 from 497540 to 1110204 tid 1 2026-02-17T11:49:39.501 INFO:tasks.rados.rados.0.trial142.stdout:591: writing trial14245205-32 from 1840862 to 2280922 tid 2 2026-02-17T11:49:39.506 INFO:tasks.rados.rados.0.trial142.stdout:591: writing trial14245205-32 from 3058823 to 3523607 tid 3 2026-02-17T11:49:39.506 INFO:tasks.rados.rados.0.trial142.stdout:592: snap_remove snap 59 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:592: done (4 left) 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:593: delete oid 49 current snap is 71 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: finishing write tid 3 to trial14245205-41 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: finishing write tid 4 to trial14245205-41 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: finishing write tid 5 to trial14245205-41 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: oid 41 updating version 0 to 227 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: oid 41 updating version 227 to 228 2026-02-17T11:49:40.483 INFO:tasks.rados.rados.0.trial142.stdout:587: oid 41 updating version 228 to 229 2026-02-17T11:49:40.484 INFO:tasks.rados.rados.0.trial142.stdout:587: oid 41 version 229 is already newer than 226 2026-02-17T11:49:40.484 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 229 (ObjNum 218 snap 71 seq_num 218) dirty exists 2026-02-17T11:49:40.484 INFO:tasks.rados.rados.0.trial142.stdout:587: left oid 41 (ObjNum 218 snap 71 seq_num 218) 2026-02-17T11:49:40.484 INFO:tasks.rados.rados.0.trial142.stdout:589: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:49:40.557 INFO:tasks.rados.rados.0.trial142.stdout:591: finishing write tid 1 to trial14245205-32 2026-02-17T11:49:40.557 INFO:tasks.rados.rados.0.trial142.stdout:590: expect (ObjNum 141 snap 38 seq_num 141) 2026-02-17T11:49:40.616 INFO:tasks.rados.rados.0.trial142.stdout:591: finishing write tid 2 to trial14245205-32 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: finishing write tid 3 to trial14245205-32 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: finishing write tid 4 to trial14245205-32 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: finishing write tid 5 to trial14245205-32 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: oid 32 updating version 0 to 229 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: oid 32 updating version 229 to 231 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: oid 32 version 231 is already newer than 228 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: oid 32 version 231 is already newer than 230 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 231 (ObjNum 220 snap 71 seq_num 220) dirty exists 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:591: left oid 32 (ObjNum 220 snap 71 seq_num 220) 2026-02-17T11:49:40.617 INFO:tasks.rados.rados.0.trial142.stdout:587: done (4 left) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:589: done (3 left) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:590: done (2 left) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:591: done (1 left) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:593: done (0 left) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:594: read oid 32 snap -1 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:594: expect (ObjNum 220 snap 71 seq_num 220) 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:595: rollback oid 18 current snap is 71 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 70 2026-02-17T11:49:40.618 INFO:tasks.rados.rados.0.trial142.stdout:596: delete oid 10 current snap is 71 2026-02-17T11:49:40.619 INFO:tasks.rados.rados.0.trial142.stdout:596: done (2 left) 2026-02-17T11:49:40.619 INFO:tasks.rados.rados.0.trial142.stdout:597: snap_remove snap 55 2026-02-17T11:49:41.485 INFO:tasks.rados.rados.0.trial142.stdout:597: done (2 left) 2026-02-17T11:49:41.485 INFO:tasks.rados.rados.0.trial142.stdout:598: read oid 31 snap -1 2026-02-17T11:49:41.485 INFO:tasks.rados.rados.0.trial142.stdout:598: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:49:41.485 INFO:tasks.rados.rados.0.trial142.stdout:599: snap_remove snap 61 2026-02-17T11:49:42.006 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:49:42.006 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T11:49:42.006 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:49:42.006 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:49:42.009 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:49:42.010 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-17T11:49:42.010 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-17T11:49:42.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:49:54.321 INFO:tasks.rados.rados.0.trial142.stdout:599: done (3 left) 2026-02-17T11:49:54.321 INFO:tasks.rados.rados.0.trial142.stdout:600: write oid 28 current snap is 71 2026-02-17T11:49:54.321 INFO:tasks.rados.rados.0.trial142.stdout:595: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:49:54.321 INFO:tasks.rados.rados.0.trial142.stdout:600: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2026-02-17T11:49:54.325 INFO:tasks.rados.rados.0.trial142.stdout:600: writing trial14245205-28 from 547961 to 1102725 tid 1 2026-02-17T11:49:54.329 INFO:tasks.rados.rados.0.trial142.stdout:600: writing trial14245205-28 from 1616308 to 2320048 tid 2 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:600: writing trial14245205-28 from 2741092 to 3439692 tid 3 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:601: delete oid 34 current snap is 71 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:595: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:595: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 503 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:49:54.334 INFO:tasks.rados.rados.0.trial142.stdout:594: expect (ObjNum 220 snap 71 seq_num 220) 2026-02-17T11:49:54.423 INFO:tasks.rados.rados.0.trial142.stdout:598: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: finishing write tid 1 to trial14245205-28 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: finishing write tid 2 to trial14245205-28 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: finishing write tid 3 to trial14245205-28 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: finishing write tid 4 to trial14245205-28 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: finishing write tid 5 to trial14245205-28 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: oid 28 updating version 0 to 199 2026-02-17T11:49:54.477 INFO:tasks.rados.rados.0.trial142.stdout:600: oid 28 updating version 199 to 201 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:600: oid 28 version 201 is already newer than 200 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:600: oid 28 updating version 201 to 202 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 202 (ObjNum 223 snap 71 seq_num 223) dirty exists 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:600: left oid 28 (ObjNum 223 snap 71 seq_num 223) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:594: done (4 left) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:595: done (3 left) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:598: done (2 left) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:600: done (1 left) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:601: done (0 left) 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:602: write oid 2 current snap is 71 2026-02-17T11:49:54.478 INFO:tasks.rados.rados.0.trial142.stdout:602: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-17T11:49:54.481 INFO:tasks.rados.rados.0.trial142.stdout:602: writing trial14245205-2 from 581575 to 1286837 tid 1 2026-02-17T11:49:54.486 INFO:tasks.rados.rados.0.trial142.stdout:602: writing trial14245205-2 from 1733272 to 2440681 tid 2 2026-02-17T11:49:54.491 INFO:tasks.rados.rados.0.trial142.stdout:602: writing trial14245205-2 from 3195938 to 3633435 tid 3 2026-02-17T11:49:54.491 INFO:tasks.rados.rados.0.trial142.stdout:603: snap_create 2026-02-17T11:49:54.491 INFO:tasks.rados.rados.0.trial142.stdout:602: finishing write tid 1 to trial14245205-2 2026-02-17T11:49:54.491 INFO:tasks.rados.rados.0.trial142.stdout:602: finishing write tid 2 to trial14245205-2 2026-02-17T11:49:54.492 INFO:tasks.rados.rados.0.trial142.stdout:602: finishing write tid 3 to trial14245205-2 2026-02-17T11:49:54.492 INFO:tasks.rados.rados.0.trial142.stdout:602: finishing write tid 4 to trial14245205-2 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: finishing write tid 5 to trial14245205-2 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: oid 2 updating version 0 to 233 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: oid 2 version 233 is already newer than 232 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: oid 2 version 233 is already newer than 230 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: oid 2 version 233 is already newer than 231 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 233 (ObjNum 225 snap 71 seq_num 225) dirty exists 2026-02-17T11:49:54.493 INFO:tasks.rados.rados.0.trial142.stdout:602: left oid 2 (ObjNum 225 snap 71 seq_num 225) 2026-02-17T11:49:55.323 INFO:tasks.rados.rados.0.trial142.stdout:602: done (1 left) 2026-02-17T11:49:55.324 INFO:tasks.rados.rados.0.trial142.stdout:603: done (0 left) 2026-02-17T11:49:55.324 INFO:tasks.rados.rados.0.trial142.stdout:604: rollback oid 8 current snap is 72 2026-02-17T11:49:55.324 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 67 2026-02-17T11:49:55.324 INFO:tasks.rados.rados.0.trial142.stdout:605: snap_create 2026-02-17T11:49:55.466 INFO:tasks.rados.rados.0.trial142.stdout:604: finishing rollback tid 1 to trial14245205-8 2026-02-17T11:49:55.467 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 0 (ObjNum 129 snap 0 seq_num 1213688344) dirty dne 2026-02-17T11:49:56.324 INFO:tasks.rados.rados.0.trial142.stdout:604: done (1 left) 2026-02-17T11:49:56.324 INFO:tasks.rados.rados.0.trial142.stdout:605: done (0 left) 2026-02-17T11:49:56.324 INFO:tasks.rados.rados.0.trial142.stdout:606: read oid 11 snap -1 2026-02-17T11:49:56.324 INFO:tasks.rados.rados.0.trial142.stdout:606: expect (ObjNum 168 snap 51 seq_num 168) 2026-02-17T11:49:56.325 INFO:tasks.rados.rados.0.trial142.stdout:607: rollback oid 38 current snap is 73 2026-02-17T11:49:56.325 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 67 2026-02-17T11:49:56.325 INFO:tasks.rados.rados.0.trial142.stdout:608: delete oid 46 current snap is 73 2026-02-17T11:49:56.610 INFO:tasks.rados.rados.0.trial142.stdout:608: done (2 left) 2026-02-17T11:49:56.610 INFO:tasks.rados.rados.0.trial142.stdout:609: snap_create 2026-02-17T11:49:56.611 INFO:tasks.rados.rados.0.trial142.stdout:607: finishing rollback tid 0 to trial14245205-38 2026-02-17T11:49:56.611 INFO:tasks.rados.rados.0.trial142.stdout:607: finishing rollback tid 1 to trial14245205-38 2026-02-17T11:49:56.611 INFO:tasks.rados.rados.0.trial142.stdout:607: finishing rollback tid 2 to trial14245205-38 2026-02-17T11:49:56.612 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 51 (ObjNum 161 snap 45 seq_num 161) dirty exists 2026-02-17T11:49:56.615 INFO:tasks.rados.rados.0.trial142.stdout:606: expect (ObjNum 168 snap 51 seq_num 168) 2026-02-17T11:49:57.011 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-17T11:49:57.011 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-17T11:49:57.012 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:49:57.012 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:49:57.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.078+0000 7fcebc3be640 10 monclient: get_monmap_and_config 2026-02-17T11:49:57.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.078+0000 7fcebc3be640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.078+0000 7fcebc3be640 10 monclient: monmap: 2026-02-17T11:49:57.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.083 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:57.079839+0000 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:57.079839+0000 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 Processor -- start 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 -- start start 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient: init 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fceb40a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-c con 0x7fceb40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-b con 0x7fceb413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb406e140 con 0x7fceb40a3bb0 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fceb409f910 con 0x7fceb40a0750 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fceb409ccd0 con 0x7fceb413b760 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fcebc3be640 10 monclient(hunting): authenticate will time out at 884.698618s 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48164/0 (socket says 10.20.193.51:48164) 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 learned_addr learned my addr 10.20.193.51:0/1427351652 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 10 monclient(hunting): get_auth_request con 0x7fceb413b760 auth_method 0 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 10 monclient(hunting): get_auth_request con 0x7fceb40a0750 auth_method 0 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fceb413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fceb413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 1 -- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 msgr2=0x7fceb409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 1 -- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 msgr2=0x7fceb409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.079+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.081+0000 7fceba133640 1 -- 10.20.193.51:0/1427351652 >> v1:10.20.193.142:6789/0 conn(0x7fceb40a3bb0 legacy=0x7fceb409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 10 monclient(hunting): get_auth_request con 0x7fceb413b760 auth_method 0 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fceb413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fceb413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:57.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 10 monclient(hunting): get_auth_request con 0x7fceb40a0750 auth_method 0 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 1 -- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 msgr2=0x7fceb409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 1 -- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 msgr2=0x7fceb409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:49:57.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.280+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:49:57.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319080789 0 0) 0x7fceb406e140 con 0x7fceb40a3bb0 2026-02-17T11:49:57.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 10 monclient(hunting): _negotiate 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 10 monclient(hunting): my global_id is 64141 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.428+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce9c003620 con 0x7fceb40a3bb0 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 603327555 0 0) 0x7fce9c003620 con 0x7fceb40a3bb0 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fceb413db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fceb413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 msgr2=0x7fceb409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 --2- 10.20.193.51:0/1427351652 >> v2:10.20.193.142:3300/0 conn(0x7fceb40a0750 0x7fceb409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb409eec0 con 0x7fceb40a3bb0 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fcea40032b0 con 0x7fceb40a3bb0 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: dump: 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.439 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 >> v1:10.20.193.142:6789/0 conn(0x7fceb40a3bb0 legacy=0x7fceb409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce9c003b00 0x7fce9c003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): picked mon.b con 0x7fce9c003b00 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce9c004900 0x7fce9c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): picked mon.a con 0x7fce9c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fce9c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): picked mon.c con 0x7fceb413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fceb409f910 con 0x7fce9c004900 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fceb409ccd0 con 0x7fce9c003b00 2026-02-17T11:49:57.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c005650 con 0x7fceb413b760 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9131640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce9c004900 0x7fce9c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fce9c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): get_auth_request con 0x7fce9c004900 auth_method 0 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): get_auth_request con 0x7fceb413b760 auth_method 0 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba133640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce9c003b00 0x7fce9c003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba133640 10 monclient(hunting): get_auth_request con 0x7fce9c003b00 auth_method 0 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba133640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba133640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient(hunting): handle_auth_done global_id 64141 payload 293 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce9c003b00 msgr2=0x7fce9c003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce9c003b00 0x7fce9c003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce9c004900 msgr2=0x7fce9c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce9c004900 0x7fce9c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 monclient: found mon.c 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c003620 con 0x7fceb413b760 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceba934640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fcebc3be640 5 monclient: authenticate success, global_id 64141 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fceb9932640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce9c004900 0x7fce9c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.429+0000 7fcebc3be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fce9c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceba934640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fce9c00bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fceb00096d0 tx=0x7fceb002f6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6871d3a871c8ab server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb003d070 con 0x7fceb413b760 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: dump: 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.445 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0038410 con 0x7fceb413b760 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 1 -- 10.20.193.51:0/1427351652 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00098e0 con 0x7fceb413b760 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceb9131640 10 monclient: dump: 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.447 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 4 set_mon_vals no callback set 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 10 monclient: shutdown 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 -- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 msgr2=0x7fce9c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 --2- 10.20.193.51:0/1427351652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb413b760 0x7fce9c00bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fceb00096d0 tx=0x7fceb002f6f0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fceba934640 1 -- 10.20.193.51:0/1427351652 reap_dead start 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 -- 10.20.193.51:0/1427351652 shutdown_connections 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 -- 10.20.193.51:0/1427351652 >> 10.20.193.51:0/1427351652 conn(0x7fceb40a30c0 msgr2=0x7fceb40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 -- 10.20.193.51:0/1427351652 shutdown_connections 2026-02-17T11:49:57.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.432+0000 7fcebc3be640 1 -- 10.20.193.51:0/1427351652 wait complete. 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient: monmap: 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 Processor -- start 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 -- start start 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient: init 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fceb4099f60 0x7fceb4091a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-a con 0x7fceb4099f60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-c con 0x7fceb4091f80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fceb41d1860 0x7fceb41d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): picked mon.noname-b con 0x7fceb41d1860 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fceb40a04b0 con 0x7fceb4099f60 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fceb409c850 con 0x7fceb41d1860 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fceb409e710 con 0x7fceb4091f80 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fcebc3be640 10 monclient(hunting): authenticate will time out at 885.052837s 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48214/0 (socket says 10.20.193.51:48214) 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 1 -- 10.20.193.51:0/679889966 learned_addr learned my addr 10.20.193.51:0/679889966 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fceb4099f60 0x7fceb4091a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): get_auth_request con 0x7fceb4091f80 auth_method 0 2026-02-17T11:49:57.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): get_auth_request con 0x7fceb4099f60 auth_method 0 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceb9932640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.433+0000 7fceba133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 10 monclient(hunting): handle_auth_done global_id 44372 payload 824 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 -- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fceb41d1860 msgr2=0x7fceb41d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fceb41d1860 0x7fceb41d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 -- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fceb4099f60 msgr2=0x7fceb4091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fceb4099f60 0x7fceb4091a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 monclient: found mon.noname-c 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.434+0000 7fceb9932640 1 -- 10.20.193.51:0/679889966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb4094820 con 0x7fceb4091f80 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fceb9932640 1 -- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 msgr2=0x7fceb4092360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fceb9932640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009800 tx=0x7fcea8009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8019030 con 0x7fceb4091f80 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: dump: 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.456 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea8009e10 con 0x7fceb4091f80 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 5 monclient: authenticate success, global_id 44372 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _renew_subs 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb4093b80 con 0x7fceb4091f80 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8012c40 con 0x7fceb4091f80 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 10 monclient: dump: 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.458 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fceb8930640 4 set_mon_vals no callback set 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _renew_subs 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb40a2a80 con 0x7fceb4091f80 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcea801e410 con 0x7fceb4091f80 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.436+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb409dac0 con 0x7fceb4091f80 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.437+0000 7fce9affd640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 0x7fce840401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.437+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(165..165 src has 47..165) ==== 4767+0+0 (secure 0 0 0) 0x7fcea8052aa0 con 0x7fceb4091f80 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.437+0000 7fceba133640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 0x7fce840401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.437+0000 7fceba133640 10 monclient: get_auth_request con 0x7fce8403dd10 auth_method 0 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.439+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcea8023030 con 0x7fceb4091f80 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.439+0000 7fce9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.439+0000 7fce9affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:57.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.439+0000 7fceba133640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 0x7fce840401d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcea4002410 tx=0x7fcea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fcebc3be640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:49:57.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fcebc3be640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:57.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fcebc3be640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fceb4095930 con 0x7fceb4091f80 2026-02-17T11:49:57.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fce9affd640 1 -- 10.20.193.51:0/679889966 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fcea80514b0 con 0x7fceb4091f80 2026-02-17T11:49:57.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fce9affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:57.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.560+0000 7fce9affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:57.563 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:49:57.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 msgr2=0x7fce840401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 0x7fce840401d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcea4002410 tx=0x7fcea4009040 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 10 monclient: shutdown 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 msgr2=0x7fceb4092360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009800 tx=0x7fcea8009cd0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 shutdown_connections 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce8403dd10 0x7fce840401d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fceb41d1860 0x7fceb41d3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fceb4091f80 0x7fceb4092360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 --2- 10.20.193.51:0/679889966 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fceb4099f60 0x7fceb4091a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 >> 10.20.193.51:0/679889966 conn(0x7fceb40a30c0 msgr2=0x7fceb413ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 shutdown_connections 2026-02-17T11:49:57.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.561+0000 7fcebc3be640 1 -- 10.20.193.51:0/679889966 wait complete. 2026-02-17T11:49:57.571 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:49:57.571 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:49:57.572 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:49:57.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.638+0000 7f3d7679e640 10 monclient: get_monmap_and_config 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.638+0000 7f3d7679e640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.638+0000 7f3d7679e640 10 monclient: monmap: 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:57.639912+0000 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:57.639912+0000 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 Processor -- start 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 -- start start 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient: init 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2026-02-17T11:49:57.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-b con 0x7f3d700a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3d700a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d7013b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7006e140 con 0x7f3d7013b760 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7009f910 con 0x7f3d700a0750 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7009ccd0 con 0x7f3d700a3bb0 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d7679e640 10 monclient(hunting): authenticate will time out at 885.258645s 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48230/0 (socket says 10.20.193.51:48230) 2026-02-17T11:49:57.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 -- 10.20.193.51:0/2045674198 learned_addr learned my addr 10.20.193.51:0/2045674198 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): get_auth_request con 0x7f3d700a3bb0 auth_method 0 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_done global_id 44375 payload 274 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 -- 10.20.193.51:0/2045674198 >> v1:10.20.193.142:6789/0 conn(0x7f3d700a0750 legacy=0x7f3d7009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 -- 10.20.193.51:0/2045674198 >> v1:10.20.193.51:6789/0 conn(0x7f3d7013b760 legacy=0x7f3d7013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 monclient: found mon.noname-b 2026-02-17T11:49:57.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.639+0000 7f3d6ffff640 1 -- 10.20.193.51:0/2045674198 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7009eec0 con 0x7f3d700a3bb0 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6ffff640 1 -- 10.20.193.51:0/2045674198 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 msgr2=0x7f3d7009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/2045674198 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d70069d60 tx=0x7f3d5c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606fec0d2626cfa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 1 -- 10.20.193.51:0/2045674198 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c03c070 con 0x7f3d700a3bb0 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: dump: 2026-02-17T11:49:57.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 5 monclient: authenticate success, global_id 44375 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 1 -- 10.20.193.51:0/2045674198 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c02fdb0 con 0x7f3d700a3bb0 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 1 -- 10.20.193.51:0/2045674198 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c037660 con 0x7f3d700a3bb0 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 4 set_mon_vals no callback set 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d6effd640 10 monclient: dump: 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 10 monclient: shutdown 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 -- 10.20.193.51:0/2045674198 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 msgr2=0x7f3d7009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 --2- 10.20.193.51:0/2045674198 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d70069d60 tx=0x7f3d5c02ee90 comp rx=0 tx=0).stop 2026-02-17T11:49:57.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 -- 10.20.193.51:0/2045674198 shutdown_connections 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 --2- 10.20.193.51:0/2045674198 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d700a3bb0 0x7f3d7009dac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 -- 10.20.193.51:0/2045674198 >> 10.20.193.51:0/2045674198 conn(0x7f3d700a30c0 msgr2=0x7f3d700a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 -- 10.20.193.51:0/2045674198 shutdown_connections 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.642+0000 7f3d7679e640 1 -- 10.20.193.51:0/2045674198 wait complete. 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient: monmap: 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.659 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 Processor -- start 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 -- start start 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient: init 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3d700a0750 0x7f3d70131090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-b con 0x7f3d700a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d700a3bb0 0x7f3d701315d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-a con 0x7f3d700a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 0x7f3d70131b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): picked mon.noname-c con 0x7f3d7013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3d700a04b0 con 0x7f3d700a3bb0 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7009c850 con 0x7f3d700a0750 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7009e710 con 0x7f3d7013b760 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d7679e640 10 monclient(hunting): authenticate will time out at 885.262743s 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 0x7f3d70131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d700a3bb0 0x7f3d701315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 0x7f3d70131b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48240/0 (socket says 10.20.193.51:48240) 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 learned_addr learned my addr 10.20.193.51:0/262650799 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): get_auth_request con 0x7f3d7013b760 auth_method 0 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): get_auth_request con 0x7f3d700a3bb0 auth_method 0 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3d700a0750 0x7f3d70131090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient(hunting): handle_auth_done global_id 44378 payload 824 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3d700a0750 msgr2=0x7f3d70131090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3d700a0750 0x7f3d70131090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d700a3bb0 msgr2=0x7f3d701315d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d700a3bb0 0x7f3d701315d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 monclient: found mon.noname-c 2026-02-17T11:49:57.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d70133110 con 0x7f3d7013b760 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6ffff640 10 monclient: get_auth_request con 0x7f3d700a0750 auth_method 0 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.643+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3d700a0750 0x7f3d70131090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 msgr2=0x7f3d70131b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d74d14640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 0x7f3d70131b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400cb60 tx=0x7f3d6400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64016020 con 0x7f3d7013b760 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: dump: 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.664 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 5 monclient: authenticate success, global_id 44378 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d64012420 con 0x7f3d7013b760 2026-02-17T11:49:57.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 monclient: _renew_subs 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d701350d0 con 0x7f3d7013b760 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64012810 con 0x7f3d7013b760 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6e7fc640 4 set_mon_vals no callback set 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 10 monclient: dump: 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.666 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 monclient: _renew_subs 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d700a24c0 con 0x7f3d7013b760 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 0x7f3d7012da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70134560 con 0x7f3d7012d690 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3d640129f0 con 0x7f3d7013b760 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 0x7f3d7012da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient: get_auth_request con 0x7f3d7012d690 auth_method 0 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_done global_id 74103 payload 824 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.646+0000 7f3d6ffff640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d7009dac0 con 0x7f3d7012d690 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.647+0000 7f3d6cff9640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d4003dd10 0x7f3d400401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.647+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(165..165 src has 47..165) ==== 4767+0+0 (secure 0 0 0) 0x7f3d64052f80 con 0x7f3d7013b760 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.647+0000 7f3d6f7fe640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d4003dd10 0x7f3d400401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.647+0000 7f3d6f7fe640 10 monclient: get_auth_request con 0x7f3d4003dd10 auth_method 0 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6ffff640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 msgr2=0x7f3d7012da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 0x7f3d7012da70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d7009f230 tx=0x7f3d5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c047070 con 0x7f3d7012d690 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 10 monclient: dump: 2026-02-17T11:49:57.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3d5c037d50 con 0x7f3d7012d690 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:57.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 msgr2=0x7f3d7012da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 0x7f3d7012da70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d7009f230 tx=0x7f3d5c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 msgr2=0x7f3d7012da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6cff9640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012d690 0x7f3d7012da70 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d7009f230 tx=0x7f3d5c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.649+0000 7f3d6f7fe640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d4003dd10 0x7f3d400401d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d70134ec0 tx=0x7f3d60007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d7679e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d7679e640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 0x7f3d701d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d7679e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3d700008d0 con 0x7f3d7012dfb0 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 0x7f3d701d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient: get_auth_request con 0x7f3d7012dfb0 auth_method 0 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 10 monclient(hunting): handle_auth_done global_id 74106 payload 824 2026-02-17T11:49:57.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.652+0000 7f3d6ffff640 1 -- 10.20.193.51:0/262650799 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d70050ac0 con 0x7f3d7012dfb0 2026-02-17T11:49:57.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6ffff640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 msgr2=0x7f3d701d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6ffff640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 0x7f3d701d98b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c006d80 tx=0x7f3d5c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c03c040 con 0x7f3d7012dfb0 2026-02-17T11:49:57.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 10 monclient: dump: 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4542 (secure 0 0 0) 0x7f3d5c003e20 con 0x7f3d7012dfb0 2026-02-17T11:49:57.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 msgr2=0x7f3d701d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 0x7f3d701d98b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c006d80 tx=0x7f3d5c009340 comp rx=0 tx=0).stop 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 msgr2=0x7f3d701d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d6cff9640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3d7012dfb0 0x7f3d701d98b0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c006d80 tx=0x7f3d5c009340 comp rx=0 tx=0).stop 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:57.675 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 15586, 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.676 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.677 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:57.678 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.679 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:57.680 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.681 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.682 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.683 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.684 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.685 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:57.686 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d4003dd10 msgr2=0x7f3d400401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d4003dd10 0x7f3d400401d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d70134ec0 tx=0x7f3d60007f30 comp rx=0 tx=0).stop 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 10 monclient: shutdown 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 msgr2=0x7f3d70131b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 --2- 10.20.193.51:0/262650799 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3d7013b760 0x7f3d70131b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400cb60 tx=0x7f3d6400a430 comp rx=0 tx=0).stop 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 reap_dead start 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d74d14640 1 -- 10.20.193.51:0/262650799 reap_dead start 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 shutdown_connections 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 >> 10.20.193.51:0/262650799 conn(0x7f3d700a30c0 msgr2=0x7f3d70139ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 shutdown_connections 2026-02-17T11:49:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.655+0000 7f3d7679e640 1 -- 10.20.193.51:0/262650799 wait complete. 2026-02-17T11:49:57.688 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:57.688 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:49:57.688 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:49:57.752 INFO:tasks.rados.rados.0.trial142.stdout:606: done (2 left) 2026-02-17T11:49:57.752 INFO:tasks.rados.rados.0.trial142.stdout:607: done (1 left) 2026-02-17T11:49:57.752 INFO:tasks.rados.rados.0.trial142.stdout:609: done (0 left) 2026-02-17T11:49:57.752 INFO:tasks.rados.rados.0.trial142.stdout:610: write (excl) oid 37 current snap is 74 2026-02-17T11:49:57.752 INFO:tasks.rados.rados.0.trial142.stdout:610: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2026-02-17T11:49:57.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.754+0000 7f8878a63640 10 monclient: get_monmap_and_config 2026-02-17T11:49:57.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.754+0000 7f8878a63640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.754+0000 7f8878a63640 10 monclient: monmap: 2026-02-17T11:49:57.756 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:57.755743+0000 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:57.755743+0000 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:57.757 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.758 INFO:tasks.rados.rados.0.trial142.stdout:610: writing trial14245205-37 from 615189 to 1070949 tid 1 2026-02-17T11:49:57.763 INFO:tasks.rados.rados.0.trial142.stdout:610: writing trial14245205-37 from 1733883 to 2444961 tid 2 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 Processor -- start 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 -- start start 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient: init 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88740a79b0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f88740a58b0 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:57.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-b con 0x7f88740a5cc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88740a2cd0 con 0x7f88740a79b0 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88740a6950 con 0x7f88740a58b0 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88740a2710 con 0x7f88740a5cc0 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8878a63640 10 monclient(hunting): authenticate will time out at 885.374554s 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8872d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f88740a79b0 0x7f88740a51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38934/0 (socket says 10.20.193.51:38934) 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8872d76640 1 -- 10.20.193.51:0/419052603 learned_addr learned my addr 10.20.193.51:0/419052603 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 1 --2- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): get_auth_request con 0x7f88740a5cc0 auth_method 0 2026-02-17T11:49:57.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient(hunting): handle_auth_done global_id 44381 payload 274 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 1 -- 10.20.193.51:0/419052603 >> v1:10.20.193.142:6789/0 conn(0x7f88740a58b0 legacy=0x7f887413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 1 -- 10.20.193.51:0/419052603 >> v1:10.20.193.51:6789/0 conn(0x7f88740a79b0 legacy=0x7f88740a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 1 monclient: found mon.noname-b 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.755+0000 7f8873577640 1 -- 10.20.193.51:0/419052603 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88740a61f0 con 0x7f88740a5cc0 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8873577640 1 -- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 msgr2=0x7f8874140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8873577640 1 --2- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874140ae0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8864009dc0 tx=0x7f886402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1081f42ec584f52c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 1 -- 10.20.193.51:0/419052603 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886403c070 con 0x7f88740a5cc0 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: dump: 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.772 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 1 -- 10.20.193.51:0/419052603 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8864037640 con 0x7f88740a5cc0 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 5 monclient: authenticate success, global_id 44381 2026-02-17T11:49:57.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 1 -- 10.20.193.51:0/419052603 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864037a10 con 0x7f88740a5cc0 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8871d74640 10 monclient: dump: 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.774 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 4 set_mon_vals no callback set 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 10 monclient: shutdown 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 -- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 msgr2=0x7f8874140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 --2- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874140ae0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8864009dc0 tx=0x7f886402f230 comp rx=0 tx=0).stop 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 -- 10.20.193.51:0/419052603 shutdown_connections 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 --2- 10.20.193.51:0/419052603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874140ae0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 -- 10.20.193.51:0/419052603 >> 10.20.193.51:0/419052603 conn(0x7f88740aaec0 msgr2=0x7f88740a72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 -- 10.20.193.51:0/419052603 shutdown_connections 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.758+0000 7f8878a63640 1 -- 10.20.193.51:0/419052603 wait complete. 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient: monmap: 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:57.776 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 Processor -- start 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 -- start start 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient: init 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88740a58b0 0x7f88741ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-b con 0x7f88740a58b0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-c con 0x7f88740a5cc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 0x7f887413d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): picked mon.noname-a con 0x7f88740a79b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f88740a6690 con 0x7f88740a79b0 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88740a6510 con 0x7f88740a58b0 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88740a1ea0 con 0x7f88740a5cc0 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8878a63640 10 monclient(hunting): authenticate will time out at 885.378742s 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 0x7f887413d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48260/0 (socket says 10.20.193.51:48260) 2026-02-17T11:49:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 0x7f887413d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52000/0 (socket says 10.20.193.51:52000) 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 -- 10.20.193.51:0/1230186898 learned_addr learned my addr 10.20.193.51:0/1230186898 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): get_auth_request con 0x7f88740a5cc0 auth_method 0 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): get_auth_request con 0x7f88740a79b0 auth_method 0 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88740a58b0 0x7f88741ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient(hunting): handle_auth_done global_id 44384 payload 824 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88740a58b0 msgr2=0x7f88741ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88740a58b0 0x7f88741ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 msgr2=0x7f887413d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 0x7f887413d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 monclient: found mon.noname-c 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872575640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88741219f0 con 0x7f88740a5cc0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872d76640 10 monclient: get_auth_request con 0x7f88740a58b0 auth_method 0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88740a58b0 0x7f88741ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.759+0000 7f8873577640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88740a79b0 0x7f887413d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872575640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 msgr2=0x7f8874138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872575640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874138350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f885c00b580 tx=0x7f885c00ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c0026e0 con 0x7f88740a5cc0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: dump: 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c014070 con 0x7f88740a5cc0 2026-02-17T11:49:57.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c002ac0 con 0x7f88740a5cc0 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8871573640 4 set_mon_vals no callback set 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 10 monclient: dump: 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 5 monclient: authenticate success, global_id 44384 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 monclient: _renew_subs 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8874121cd0 con 0x7f88740a5cc0 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 monclient: _renew_subs 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8874121710 con 0x7f88740a5cc0 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 0x7f887413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88740a1a00 con 0x7f887413d860 2026-02-17T11:49:57.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 0x7f887413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient: get_auth_request con 0x7f887413d860 auth_method 0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f885c002ce0 con 0x7f88740a5cc0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 10 monclient(hunting): handle_auth_done global_id 44387 payload 824 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f8872d76640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f887413e180 con 0x7f887413d860 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.762+0000 7f88537fe640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f884003dd10 0x7f88400401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.763+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(166..166 src has 47..166) ==== 4767+0+0 (secure 0 0 0) 0x7f885c052100 con 0x7f88740a5cc0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.763+0000 7f8873577640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f884003dd10 0x7f88400401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.763+0000 7f8873577640 10 monclient: get_auth_request con 0x7f884003dd10 auth_method 0 2026-02-17T11:49:57.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f8872d76640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 msgr2=0x7f887413dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 0x7f887413dc40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f886800dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868005d40 con 0x7f887413d860 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 10 monclient: dump: 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8868017070 con 0x7f887413d860 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 msgr2=0x7f887413dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 0x7f887413dc40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f886800dbc0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 msgr2=0x7f887413dc40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f88537fe640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f887413d860 0x7f887413dc40 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f886800dbc0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.765+0000 7f8873577640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f884003dd10 0x7f88400401d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88740a7fe0 tx=0x7f8864033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:610: writing trial14245205-37 from 3134431 to 3594472 tid 3 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:611: write (excl) oid 11 current snap is 74 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:610: finishing write tid 1 to trial14245205-37 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:611: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:611: writing trial14245205-11 from 631996 to 1163005 tid 1 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:611: writing trial14245205-11 from 1792365 to 2247101 tid 2 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:611: writing trial14245205-11 from 2761854 to 3433167 tid 3 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:612: rollback oid 47 current snap is 74 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 65 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:610: finishing write tid 2 to trial14245205-37 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:610: finishing write tid 3 to trial14245205-37 2026-02-17T11:49:57.789 INFO:tasks.rados.rados.0.trial142.stdout:610: finishing write tid 4 to trial14245205-37 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: finishing write tid 5 to trial14245205-37 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: oid 37 updating version 0 to 206 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: oid 37 version 206 is already newer than 204 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: oid 37 updating version 206 to 207 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: oid 37 version 207 is already newer than 205 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 207 (ObjNum 227 snap 74 seq_num 227) dirty exists 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: left oid 37 (ObjNum 227 snap 74 seq_num 227) 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:610: done (2 left) 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:613: delete oid 2 current snap is 74 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:611: finishing write tid 1 to trial14245205-11 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:611: finishing write tid 2 to trial14245205-11 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:613: done (2 left) 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:614: write (excl) oid 48 current snap is 74 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:614: seq_num 230 ranges {665610=797860,1909329=458405,2816700=410210} 2026-02-17T11:49:57.790 INFO:tasks.rados.rados.0.trial142.stdout:614: writing trial14245205-48 from 665610 to 1463470 tid 1 2026-02-17T11:49:57.791 INFO:tasks.rados.rados.0.trial142.stdout:614: writing trial14245205-48 from 1909329 to 2367734 tid 2 2026-02-17T11:49:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8878a63640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8878a63640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 0x7f88741da230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8878a63640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88740a51a0 con 0x7f8874139390 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 0x7f88741da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient: get_auth_request con 0x7f8874139390 auth_method 0 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 10 monclient(hunting): handle_auth_done global_id 44390 payload 824 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.768+0000 7f8872d76640 1 -- 10.20.193.51:0/1230186898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88741cfd70 con 0x7f8874139390 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f8872d76640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 msgr2=0x7f88741da230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f8872d76640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 0x7f88741da230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f8868004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886800bc20 con 0x7f8874139390 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 10 monclient: dump: 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f886800bc20 con 0x7f8874139390 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 msgr2=0x7f88741da230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 0x7f88741da230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f8868004a40 comp rx=0 tx=0).stop 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 msgr2=0x7f88741da230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.770+0000 7f88537fe640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8874139390 0x7f88741da230 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f886800d6f0 tx=0x7f8868004a40 comp rx=0 tx=0).stop 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:57.795 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 169242, 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.796 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.797 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:57.798 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.799 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:57.800 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.802 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.803 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:57.804 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f884003dd10 msgr2=0x7f88400401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f884003dd10 0x7f88400401d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88740a7fe0 tx=0x7f8864033000 comp rx=0 tx=0).stop 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 10 monclient: shutdown 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 msgr2=0x7f8874138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 --2- 10.20.193.51:0/1230186898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88740a5cc0 0x7f8874138350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f885c00b580 tx=0x7f885c00ba50 comp rx=0 tx=0).stop 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8873577640 1 -- 10.20.193.51:0/1230186898 reap_dead start 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8873577640 1 -- 10.20.193.51:0/1230186898 reap_dead start 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 shutdown_connections 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 >> 10.20.193.51:0/1230186898 conn(0x7f88740aaec0 msgr2=0x7f88740a8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 shutdown_connections 2026-02-17T11:49:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.771+0000 7f8878a63640 1 -- 10.20.193.51:0/1230186898 wait complete. 2026-02-17T11:49:57.807 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:57.807 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:49:57.807 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:49:57.807 INFO:tasks.rados.rados.0.trial142.stdout:614: writing trial14245205-48 from 2816700 to 3226910 tid 3 2026-02-17T11:49:57.807 INFO:tasks.rados.rados.0.trial142.stdout:615: write (excl) oid 19 current snap is 74 2026-02-17T11:49:57.807 INFO:tasks.rados.rados.0.trial142.stdout:611: finishing write tid 3 to trial14245205-11 2026-02-17T11:49:57.807 INFO:tasks.rados.rados.0.trial142.stdout:611: finishing write tid 4 to trial14245205-11 2026-02-17T11:49:57.807 INFO:tasks.rados.rados.0.trial142.stdout:612: finishing rollback tid 0 to trial14245205-47 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: finishing write tid 5 to trial14245205-11 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: oid 11 updating version 0 to 192 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: oid 11 updating version 192 to 195 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: oid 11 version 195 is already newer than 193 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: oid 11 version 195 is already newer than 194 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: left oid 11 (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:612: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:615: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:615: writing trial14245205-19 from 682417 to 1155526 tid 1 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:615: writing trial14245205-19 from 1567811 to 2169874 tid 2 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:615: writing trial14245205-19 from 2844123 to 3465605 tid 3 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:611: done (3 left) 2026-02-17T11:49:57.808 INFO:tasks.rados.rados.0.trial142.stdout:616: snap_remove snap 68 2026-02-17T11:49:57.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.875+0000 7f8196990640 10 monclient: get_monmap_and_config 2026-02-17T11:49:57.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.875+0000 7f8196990640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.875+0000 7f8196990640 10 monclient: monmap: 2026-02-17T11:49:57.877 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.877 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:57.876916+0000 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:57.876916+0000 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:57.878 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 Processor -- start 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 -- start start 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient: init 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient: _add_conns ranks=[1,3,2,4,0] 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8190138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f81900a35a0 0x7f819013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): picked mon.noname-a con 0x7f81900a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f819013d8a0 0x7f819013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): picked mon.noname-b con 0x7f819013d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81900a1df0 con 0x7f8190138600 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f81900a6830 con 0x7f81900a35a0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f81900a2c00 con 0x7f819013d8a0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.876+0000 7f8196990640 10 monclient(hunting): authenticate will time out at 885.495985s 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f81900a35a0 0x7f819013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f819013d8a0 0x7f819013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f81900a35a0 0x7f819013d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52014/0 (socket says 10.20.193.51:52014) 2026-02-17T11:49:57.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 -- 10.20.193.51:0/1538464200 learned_addr learned my addr 10.20.193.51:0/1538464200 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): get_auth_request con 0x7f81900a35a0 auth_method 0 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): get_auth_request con 0x7f819013d8a0 auth_method 0 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f8194f06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient(hunting): handle_auth_done global_id 74112 payload 274 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 -- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f819013d8a0 msgr2=0x7f819013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 --2- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f819013d8a0 0x7f819013fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 -- 10.20.193.51:0/1538464200 >> v1:10.20.193.142:6789/0 conn(0x7f8190138600 legacy=0x7f81901389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:57.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.877+0000 7f818f7fe640 1 -- 10.20.193.51:0/1538464200 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81900a65b0 con 0x7f81900a35a0 2026-02-17T11:49:57.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818f7fe640 1 -- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 msgr2=0x7f819013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818f7fe640 1 --2- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f819013d360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81900a2d80 tx=0x7f818002ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c875094fd5bf62c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 1 -- 10.20.193.51:0/1538464200 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818003c070 con 0x7f81900a35a0 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: dump: 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 1 -- 10.20.193.51:0/1538464200 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818002fcc0 con 0x7f81900a35a0 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 1 -- 10.20.193.51:0/1538464200 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180037660 con 0x7f81900a35a0 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f818effd640 10 monclient: dump: 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f8196990640 5 monclient: authenticate success, global_id 74112 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f8196990640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.879+0000 7f8196990640 4 set_mon_vals no callback set 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 10 monclient: shutdown 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 -- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 msgr2=0x7f819013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 --2- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f819013d360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81900a2d80 tx=0x7f818002ee80 comp rx=0 tx=0).stop 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 -- 10.20.193.51:0/1538464200 shutdown_connections 2026-02-17T11:49:57.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 --2- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f819013d8a0 0x7f819013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 --2- 10.20.193.51:0/1538464200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f819013d360 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 -- 10.20.193.51:0/1538464200 >> 10.20.193.51:0/1538464200 conn(0x7f81900a7460 msgr2=0x7f81900a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 -- 10.20.193.51:0/1538464200 shutdown_connections 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 1 -- 10.20.193.51:0/1538464200 wait complete. 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.880+0000 7f8196990640 10 monclient: monmap: 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 Processor -- start 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 -- start start 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient: init 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f81901cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): picked mon.noname-a con 0x7f81900a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8190138600 0x7f8190137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): picked mon.noname-c con 0x7f8190138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013d8a0 0x7f8190071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): picked mon.noname-b con 0x7f819013d8a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f81900a15f0 con 0x7f81900a35a0 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81900a25b0 con 0x7f819013d8a0 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f81900a1770 con 0x7f8190138600 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8196990640 10 monclient(hunting): authenticate will time out at 885.500332s 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f81901cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8190138600 0x7f8190137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f81901cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52026/0 (socket says 10.20.193.51:52026) 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 -- 10.20.193.51:0/2132219561 learned_addr learned my addr 10.20.193.51:0/2132219561 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): get_auth_request con 0x7f81900a35a0 auth_method 0 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): get_auth_request con 0x7f8190138600 auth_method 0 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient(hunting): handle_auth_done global_id 74115 payload 824 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8190138600 msgr2=0x7f8190137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8190138600 0x7f8190137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013d8a0 msgr2=0x7f8190071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8194f06640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013d8a0 0x7f8190071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013d8a0 0x7f8190071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 monclient: found mon.noname-a 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818ffff640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8190121840 con 0x7f81900a35a0 2026-02-17T11:49:57.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f818f7fe640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8190138600 0x7f8190137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:57.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8194f06640 10 monclient: get_auth_request con 0x7f819013d8a0 auth_method 0 2026-02-17T11:49:57.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.881+0000 7f8194f06640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013d8a0 0x7f8190071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818ffff640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 msgr2=0x7f81901cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818ffff640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f81901cf180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c5d0 tx=0x7f817c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c016020 con 0x7f81900a35a0 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: dump: 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c012a60 con 0x7f81900a35a0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c012e50 con 0x7f81900a35a0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 5 monclient: authenticate success, global_id 74115 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 10 monclient: _renew_subs 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818e7fc640 4 set_mon_vals no callback set 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8190121b20 con 0x7f81900a35a0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f818cff9640 10 monclient: dump: 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.893 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 10 monclient: _renew_subs 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.883+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8190074010 con 0x7f81900a35a0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f8196990640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f8196990640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 0x7f8190072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81900728c0 con 0x7f8190071fa0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f817c01b400 con 0x7f81900a35a0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 0x7f8190072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient: get_auth_request con 0x7f8190071fa0 auth_method 0 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818cff9640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f816003df00 0x7f81600403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 10 monclient(hunting): handle_auth_done global_id 64144 payload 824 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(166..166 src has 47..166) ==== 4767+0+0 (secure 0 0 0) 0x7f817c0525c0 con 0x7f81900a35a0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.884+0000 7f818f7fe640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81900a8910 con 0x7f8190071fa0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.885+0000 7f8194f06640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f816003df00 0x7f81600403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.885+0000 7f8194f06640 10 monclient: get_auth_request con 0x7f816003df00 auth_method 0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818f7fe640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 msgr2=0x7f8190072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818f7fe640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 0x7f8190072380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81900ab950 tx=0x7f81800047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818003c050 con 0x7f8190071fa0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 10 monclient: dump: 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f818003d040 con 0x7f8190071fa0 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 msgr2=0x7f8190072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 0x7f8190072380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81900ab950 tx=0x7f81800047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 msgr2=0x7f8190072380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f818cff9640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8190071fa0 0x7f8190072380 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81900ab950 tx=0x7f81800047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.887+0000 7f8194f06640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f816003df00 0x7f81600403c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8190137e90 tx=0x7f818400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f8196990640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f8196990640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 0x7f81901da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f8196990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81900a4500 con 0x7f819013b100 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f818f7fe640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 0x7f81901da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f818f7fe640 10 monclient: get_auth_request con 0x7f819013b100 auth_method 0 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f818f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f818f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.890+0000 7f818f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.891+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.891+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.891+0000 7f818f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.891+0000 7f818f7fe640 10 monclient(hunting): handle_auth_done global_id 64147 payload 824 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.891+0000 7f818f7fe640 1 -- 10.20.193.51:0/2132219561 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f81900a1ae0 con 0x7f819013b100 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818f7fe640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 msgr2=0x7f81901da4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818f7fe640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 0x7f81901da4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8190072a40 tx=0x7f8180009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180056640 con 0x7f819013b100 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 10 monclient: dump: 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.898 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7f8180056640 con 0x7f819013b100 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 msgr2=0x7f81901da4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 0x7f81901da4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8190072a40 tx=0x7f8180009340 comp rx=0 tx=0).stop 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 msgr2=0x7f81901da4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.893+0000 7f818cff9640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f819013b100 0x7f81901da4f0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8190072a40 tx=0x7f8180009340 comp rx=0 tx=0).stop 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 69441, 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:57.899 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:57.900 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:57.901 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.902 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.903 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.904 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:57.906 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:57.907 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f816003df00 msgr2=0x7f81600403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f816003df00 0x7f81600403c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8190137e90 tx=0x7f818400b040 comp rx=0 tx=0).stop 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 10 monclient: shutdown 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 msgr2=0x7f81901cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 --2- 10.20.193.51:0/2132219561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81900a35a0 0x7f81901cf180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c5d0 tx=0x7f817c00caa0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8194f06640 1 -- 10.20.193.51:0/2132219561 reap_dead start 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8194f06640 1 -- 10.20.193.51:0/2132219561 reap_dead start 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 shutdown_connections 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 >> 10.20.193.51:0/2132219561 conn(0x7f81900a7460 msgr2=0x7f81900a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 shutdown_connections 2026-02-17T11:49:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.894+0000 7f8196990640 1 -- 10.20.193.51:0/2132219561 wait complete. 2026-02-17T11:49:57.909 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:57.909 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:49:57.909 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:49:57.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: get_monmap_and_config 2026-02-17T11:49:57.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: monmap: 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:57.976094+0000 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:57.976094+0000 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:57.977 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 Processor -- start 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 -- start start 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: init 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe6080a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe6080a0750 0x7fe60809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-c con 0x7fe6080a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe60813b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60806e140 con 0x7fe60813b760 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60809f910 con 0x7fe6080a3bb0 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe60809ccd0 con 0x7fe6080a0750 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe60dede640 10 monclient(hunting): authenticate will time out at 885.594808s 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe607fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe60813b760 0x7fe60813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38940/0 (socket says 10.20.193.51:38940) 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe607fff640 1 -- 10.20.193.51:0/678875035 learned_addr learned my addr 10.20.193.51:0/678875035 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.975+0000 7fe606ffd640 1 --2- 10.20.193.51:0/678875035 >> v2:10.20.193.142:3300/0 conn(0x7fe6080a0750 0x7fe60809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): get_auth_request con 0x7fe6080a0750 auth_method 0 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient(hunting): handle_auth_done global_id 64150 payload 274 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 1 -- 10.20.193.51:0/678875035 >> v1:10.20.193.142:6789/0 conn(0x7fe6080a3bb0 legacy=0x7fe60809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 1 -- 10.20.193.51:0/678875035 >> v1:10.20.193.51:6789/0 conn(0x7fe60813b760 legacy=0x7fe60813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 1 monclient: found mon.noname-c 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:49:57.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.976+0000 7fe606ffd640 1 -- 10.20.193.51:0/678875035 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60809eec0 con 0x7fe6080a0750 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe606ffd640 1 -- 10.20.193.51:0/678875035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a0750 msgr2=0x7fe60809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe606ffd640 1 --2- 10.20.193.51:0/678875035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a0750 0x7fe60809e1d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098a0 tx=0x7fe5f802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c43924b77651dd4f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 1 -- 10.20.193.51:0/678875035 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f803c070 con 0x7fe6080a0750 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 10 monclient: dump: 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe6067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe60dede640 5 monclient: authenticate success, global_id 64150 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.978+0000 7fe60dede640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 1 -- 10.20.193.51:0/678875035 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f802fce0 con 0x7fe6080a0750 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 1 -- 10.20.193.51:0/678875035 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8037660 con 0x7fe6080a0750 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe6067fc640 10 monclient: dump: 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 4 set_mon_vals no callback set 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 10 monclient: shutdown 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 -- 10.20.193.51:0/678875035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a0750 msgr2=0x7fe60809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 --2- 10.20.193.51:0/678875035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a0750 0x7fe60809e1d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098a0 tx=0x7fe5f802ed80 comp rx=0 tx=0).stop 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 -- 10.20.193.51:0/678875035 shutdown_connections 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 --2- 10.20.193.51:0/678875035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a0750 0x7fe60809e1d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 -- 10.20.193.51:0/678875035 >> 10.20.193.51:0/678875035 conn(0x7fe6080a30c0 msgr2=0x7fe6080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 -- 10.20.193.51:0/678875035 shutdown_connections 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 1 -- 10.20.193.51:0/678875035 wait complete. 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 10 monclient: build_initial_monmap 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.979+0000 7fe60dede640 10 monclient: monmap: 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:57.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 Processor -- start 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 -- start start 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient: init 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-a con 0x7fe6080a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a3bb0 0x7fe60809a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-b con 0x7fe6080a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 0x7fe60809ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): picked mon.noname-c con 0x7fe60813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080a04b0 con 0x7fe6080a0750 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe60809c850 con 0x7fe6080a3bb0 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe60809e710 con 0x7fe60813b760 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:57.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe60dede640 10 monclient(hunting): authenticate will time out at 885.599386s 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 0x7fe60809ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52042/0 (socket says 10.20.193.51:52042) 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 1 -- 10.20.193.51:0/4010620768 learned_addr learned my addr 10.20.193.51:0/4010620768 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): get_auth_request con 0x7fe6080a0750 auth_method 0 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): get_auth_request con 0x7fe60813b760 auth_method 0 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a3bb0 0x7fe60809a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): get_auth_request con 0x7fe6080a3bb0 auth_method 0 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe606ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient(hunting): handle_auth_done global_id 44399 payload 824 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 -- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a3bb0 msgr2=0x7fe60809a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a3bb0 0x7fe60809a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 -- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 msgr2=0x7fe6081cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 monclient: found mon.noname-c 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe607fff640 1 -- 10.20.193.51:0/4010620768 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60806f6c0 con 0x7fe60813b760 2026-02-17T11:49:57.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.980+0000 7fe6077fe640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe607fff640 1 -- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 msgr2=0x7fe60809ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe607fff640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 0x7fe60809ab00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00caf0 tx=0x7fe5fc005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00ad50 con 0x7fe60813b760 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: dump: 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: _finish_auth 0 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc012400 con 0x7fe60813b760 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 5 monclient: authenticate success, global_id 44399 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 10 monclient: _renew_subs 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6080a28c0 con 0x7fe60813b760 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0127f0 con 0x7fe60813b760 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:57.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe5e3fff640 10 monclient: dump: 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe605ffb640 4 set_mon_vals no callback set 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 10 monclient: _renew_subs 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.982+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe608133e60 con 0x7fe60813b760 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe60dede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe60dede640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe60dede640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60809dac0 con 0x7fe60813b760 2026-02-17T11:49:57.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe5fc012990 con 0x7fe60813b760 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe5e3fff640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 0x7fe5d80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.983+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(166..166 src has 47..166) ==== 4767+0+0 (secure 0 0 0) 0x7fe5fc0529f0 con 0x7fe60813b760 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.984+0000 7fe6077fe640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 0x7fe5d80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.984+0000 7fe6077fe640 10 monclient: get_auth_request con 0x7fe5d803dd10 auth_method 0 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.986+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe5fc011df0 con 0x7fe60813b760 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.986+0000 7fe5e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.986+0000 7fe5e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:57.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:57.986+0000 7fe6077fe640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 0x7fe5d80401d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4004670 tx=0x7fe5f4003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:58.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.100+0000 7fe60dede640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:49:58.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.100+0000 7fe60dede640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:49:58.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.100+0000 7fe60dede640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:58.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.100+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe6081335c0 con 0x7fe60813b760 2026-02-17T11:49:58.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=10,kv=11,logm=63} crc {auth=1178628513,config=692619927,health=132062201,kv=4179589687,logm=1032348960}) 2026-02-17T11:49:58.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=11,kv=12,logm=64} crc {auth=1484123815,config=692619927,health=2040907363,kv=643764953,logm=3133082614}) 2026-02-17T11:49:58.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=10,kv=11,logm=63} crc {auth=1178628513,config=692619927,health=132062201,kv=4179589687,logm=1032348960}) 2026-02-17T11:49:58.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=12,kv=10,logm=64} crc {auth=2455145378,config=692619927,health=260409864,kv=2266914380,logm=3762968758}) 2026-02-17T11:49:58.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.101+0000 7fe5e3fff640 1 -- 10.20.193.51:0/4010620768 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe5fc019d90 con 0x7fe60813b760 2026-02-17T11:49:58.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.101+0000 7fe5e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:49:58.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.101+0000 7fe5e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1727552826}) 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=487292665}) 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1727552826}) 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.101+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3124428071}) 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=727215340}) 2026-02-17T11:49:58.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1975020585}) 2026-02-17T11:49:58.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=727215340}) 2026-02-17T11:49:58.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3144527565}) 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 msgr2=0x7fe5d80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 0x7fe5d80401d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4004670 tx=0x7fe5f4003960 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 10 monclient: shutdown 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 msgr2=0x7fe60809ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 0x7fe60809ab00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00caf0 tx=0x7fe5fc005bc0 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 shutdown_connections 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe5d803dd10 0x7fe5d80401d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe60813b760 0x7fe60809ab00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6080a3bb0 0x7fe60809a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 --2- 10.20.193.51:0/4010620768 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6080a0750 0x7fe6081cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:58.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 >> 10.20.193.51:0/4010620768 conn(0x7fe6080a30c0 msgr2=0x7fe608072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:58.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 shutdown_connections 2026-02-17T11:49:58.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:58.102+0000 7fe60dede640 1 -- 10.20.193.51:0/4010620768 wait complete. 2026-02-17T11:49:58.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277657983}) 2026-02-17T11:49:58.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=625759519}) 2026-02-17T11:49:58.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277657983}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2108305313}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733186754}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.102+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=43005638}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733186754}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=407509677}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1318341711}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=17270277}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1318341711}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3047693902}) 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3650752809}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3623979483}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3650752809}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.103+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3042020943}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1710993845}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2655244457}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1710993845}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2256024785}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=161330417}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=961001647}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=161330417}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1594792381}) 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1224038305}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=419854522}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1224038305}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.104+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3903758858}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049814710}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2885743834}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049814710}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2948160248}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4031573844}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=892809688}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4031573844}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1508393653}) 2026-02-17T11:49:58.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205910472}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1827549489}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205910472}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.105+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4188016231}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=3,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=12,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=23,osdmap=28} crc {logm=925730909,mdsmap=3207544932,mgr=2354395410,mgr_metadata=3312392843,mgrstat=3776983210,mon_config_key=829000412,monmap=1614227248,osd_metadata=3459703289,osd_pg_creating=974750279,osd_snap=1856510632,osdmap=2703910861}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=2,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=25,osdmap=31} crc {logm=4153757803,mdsmap=3207544932,mgr=2045898028,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=428145406,mon_config_key=3012375200,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=974750279,osd_snap=1584815164,osdmap=3461532457}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=3,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=12,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=23,osdmap=28} crc {logm=925730909,mdsmap=3207544932,mgr=2354395410,mgr_metadata=3312392843,mgrstat=3776983210,mon_config_key=829000412,monmap=1614227248,osd_metadata=3459703289,osd_pg_creating=974750279,osd_snap=1856510632,osdmap=2703910861}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=3,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=23,osdmap=25} crc {logm=925730909,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3776983210,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=974750279,osd_snap=2759789500,osdmap=390142308}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2115714319}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2545374596}) 2026-02-17T11:49:58.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2115714319}) 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.106+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2356186810}) 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1000404732}) 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=3555419099}) 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1000404732}) 2026-02-17T11:49:58.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:49:58.108+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=63} crc {osdmap=3423985699}) 2026-02-17T11:49:58.117 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:49:58.757 INFO:tasks.rados.rados.0.trial142.stdout:616: done (3 left) 2026-02-17T11:49:58.757 INFO:tasks.rados.rados.0.trial142.stdout:617: snap_remove snap 73 2026-02-17T11:49:59.118 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:49:59.118 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:49:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: get_monmap_and_config 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: monmap: 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:59.187988+0000 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:59.187988+0000 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.189 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:59.190 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:59.190 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:59.190 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:59.190 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 Processor -- start 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 -- start start 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: init 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd124138190 0x7fd124070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-c con 0x7fd124138190 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd124138570 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd1240a2f60 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1240a03e0 con 0x7fd124138570 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12406fdc0 con 0x7fd1240a2f60 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd1240700a0 con 0x7fd124138190 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd12c153640 10 monclient(hunting): authenticate will time out at 886.806824s 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd1296c7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd124138570 0x7fd1240a2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38954/0 (socket says 10.20.193.51:38954) 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd1296c7640 1 -- 10.20.193.51:0/1781170381 learned_addr learned my addr 10.20.193.51:0/1781170381 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:59.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.187+0000 7fd129ec8640 1 --2- 10.20.193.51:0/1781170381 >> v2:10.20.193.142:3300/0 conn(0x7fd124138190 0x7fd124070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): get_auth_request con 0x7fd124138190 auth_method 0 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient(hunting): handle_auth_done global_id 64156 payload 274 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 1 -- 10.20.193.51:0/1781170381 >> v1:10.20.193.142:6789/0 conn(0x7fd1240a2f60 legacy=0x7fd12413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 1 -- 10.20.193.51:0/1781170381 >> v1:10.20.193.51:6789/0 conn(0x7fd124138570 legacy=0x7fd1240a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.188+0000 7fd129ec8640 1 -- 10.20.193.51:0/1781170381 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd124137c70 con 0x7fd124138190 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.190+0000 7fd129ec8640 1 -- 10.20.193.51:0/1781170381 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd124138190 msgr2=0x7fd124070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.190+0000 7fd129ec8640 1 --2- 10.20.193.51:0/1781170381 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd124138190 0x7fd124070bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1140098a0 tx=0x7fd11402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bdb1b11ac3aa96 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 1 -- 10.20.193.51:0/1781170381 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11403c070 con 0x7fd124138190 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: dump: 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.203 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 1 -- 10.20.193.51:0/1781170381 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11402fd70 con 0x7fd124138190 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 5 monclient: authenticate success, global_id 64156 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 1 -- 10.20.193.51:0/1781170381 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114037660 con 0x7fd124138190 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 4 set_mon_vals no callback set 2026-02-17T11:49:59.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd128ec6640 10 monclient: dump: 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.205 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 10 monclient: shutdown 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 -- 10.20.193.51:0/1781170381 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd124138190 msgr2=0x7fd124070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 --2- 10.20.193.51:0/1781170381 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd124138190 0x7fd124070bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1140098a0 tx=0x7fd11402ee10 comp rx=0 tx=0).stop 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 -- 10.20.193.51:0/1781170381 shutdown_connections 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 --2- 10.20.193.51:0/1781170381 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd124138190 0x7fd124070bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 -- 10.20.193.51:0/1781170381 >> 10.20.193.51:0/1781170381 conn(0x7fd1240a3940 msgr2=0x7fd1240a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 -- 10.20.193.51:0/1781170381 shutdown_connections 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 1 -- 10.20.193.51:0/1781170381 wait complete. 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.191+0000 7fd12c153640 10 monclient: monmap: 2026-02-17T11:49:59.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 Processor -- start 2026-02-17T11:49:59.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 -- start start 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient: init 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 0x7fd1241348c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-b con 0x7fd1240a2f60 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-a con 0x7fd124138190 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 0x7fd1241cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): picked mon.noname-c con 0x7fd124138570 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd124138b00 con 0x7fd124138190 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd124138980 con 0x7fd1240a2f60 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1240a33b0 con 0x7fd124138570 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12c153640 10 monclient(hunting): authenticate will time out at 886.811560s 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52048/0 (socket says 10.20.193.51:52048) 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 1 -- 10.20.193.51:0/184948076 learned_addr learned my addr 10.20.193.51:0/184948076 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): get_auth_request con 0x7fd124138190 auth_method 0 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 0x7fd1241cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): get_auth_request con 0x7fd124138570 auth_method 0 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 0x7fd1241348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 10 monclient(hunting): get_auth_request con 0x7fd1240a2f60 auth_method 0 2026-02-17T11:49:59.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient(hunting): handle_auth_done global_id 44402 payload 824 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 -- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 msgr2=0x7fd1241348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 0x7fd1241348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 -- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 msgr2=0x7fd124131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd12a6c9640 1 -- 10.20.193.51:0/184948076 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1241204d0 con 0x7fd124138570 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd1296c7640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.192+0000 7fd129ec8640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 0x7fd1241348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.194+0000 7fd12a6c9640 1 -- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 msgr2=0x7fd1241cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.194+0000 7fd12a6c9640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 0x7fd1241cede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12000cb10 tx=0x7fd12000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120016020 con 0x7fd124138570 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: dump: 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.212 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd120012420 con 0x7fd124138570 2026-02-17T11:49:59.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 5 monclient: authenticate success, global_id 44402 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _renew_subs 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd124135b00 con 0x7fd124138570 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120012810 con 0x7fd124138570 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd113fff640 4 set_mon_vals no callback set 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 10 monclient: dump: 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _renew_subs 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd124074db0 con 0x7fd124138570 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd124135550 con 0x7fd124138570 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.195+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd120012a70 con 0x7fd124138570 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.196+0000 7fd1127fc640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 0x7fd0f4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.196+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7fd120052fa0 con 0x7fd124138570 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.196+0000 7fd129ec8640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 0x7fd0f4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.196+0000 7fd129ec8640 10 monclient: get_auth_request con 0x7fd0f403dd40 auth_method 0 2026-02-17T11:49:59.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.198+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd120020020 con 0x7fd124138570 2026-02-17T11:49:59.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.198+0000 7fd1127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.198+0000 7fd1127fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:59.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.198+0000 7fd129ec8640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 0x7fd0f4040200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd114036000 tx=0x7fd114033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd12c153640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:49:59.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd12c153640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:59.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd12c153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd124070bd0 con 0x7fd124138570 2026-02-17T11:49:59.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd1127fc640 1 -- 10.20.193.51:0/184948076 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fd120010d60 con 0x7fd124138570 2026-02-17T11:49:59.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd1127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:59.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.312+0000 7fd1127fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:59.315 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:49:59.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 msgr2=0x7fd0f4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 0x7fd0f4040200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd114036000 tx=0x7fd114033000 comp rx=0 tx=0).stop 2026-02-17T11:49:59.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 10 monclient: shutdown 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 msgr2=0x7fd1241cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 0x7fd1241cede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12000cb10 tx=0x7fd12000a060 comp rx=0 tx=0).stop 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 shutdown_connections 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd0f403dd40 0x7fd0f4040200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd124138570 0x7fd1241cede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd124138190 0x7fd124131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 --2- 10.20.193.51:0/184948076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1240a2f60 0x7fd1241348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 >> 10.20.193.51:0/184948076 conn(0x7fd1240a3940 msgr2=0x7fd1241c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 shutdown_connections 2026-02-17T11:49:59.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.313+0000 7fd12c153640 1 -- 10.20.193.51:0/184948076 wait complete. 2026-02-17T11:49:59.322 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:49:59.322 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:49:59.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:49:59.323 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 10 monclient: get_monmap_and_config 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 10 monclient: monmap: 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:59.390352+0000 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:59.390352+0000 2026-02-17T11:49:59.391 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:59.392 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 1 Processor -- start 2026-02-17T11:49:59.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 1 -- start start 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.389+0000 7f3a34d72640 10 monclient: init 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a300a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 0x7f3a3009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-b con 0x7f3a300a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a3013b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3006e140 con 0x7f3a300a3bb0 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3009f910 con 0x7f3a3013b760 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3009ccd0 con 0x7f3a300a0750 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a34d72640 10 monclient(hunting): authenticate will time out at 887.009115s 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2e575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3a300a3bb0 0x7f3a3009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38970/0 (socket says 10.20.193.51:38970) 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2e575640 1 -- 10.20.193.51:0/3585108727 learned_addr learned my addr 10.20.193.51:0/3585108727 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 1 --2- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 0x7f3a3009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): get_auth_request con 0x7f3a300a0750 auth_method 0 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_done global_id 44405 payload 274 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3585108727 >> v1:10.20.193.142:6789/0 conn(0x7f3a3013b760 legacy=0x7f3a3013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3585108727 >> v1:10.20.193.51:6789/0 conn(0x7f3a300a3bb0 legacy=0x7f3a3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 1 monclient: found mon.noname-b 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.390+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3585108727 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3009eec0 con 0x7f3a300a0750 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 msgr2=0x7f3a3009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2dd74640 1 --2- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 0x7f3a3009e1d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a3009f230 tx=0x7f3a1802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b706d9b5696597e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 1 -- 10.20.193.51:0/3585108727 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1803c070 con 0x7f3a300a0750 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: dump: 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.404 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 1 -- 10.20.193.51:0/3585108727 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1802fce0 con 0x7f3a300a0750 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 1 -- 10.20.193.51:0/3585108727 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18037660 con 0x7f3a300a0750 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a34d72640 5 monclient: authenticate success, global_id 44405 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a34d72640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a34d72640 4 set_mon_vals no callback set 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.392+0000 7f3a2d573640 10 monclient: dump: 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.406 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 10 monclient: shutdown 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 -- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 msgr2=0x7f3a3009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 0x7f3a3009e1d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a3009f230 tx=0x7f3a1802ed80 comp rx=0 tx=0).stop 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 -- 10.20.193.51:0/3585108727 shutdown_connections 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3585108727 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a0750 0x7f3a3009e1d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 -- 10.20.193.51:0/3585108727 >> 10.20.193.51:0/3585108727 conn(0x7f3a300a30c0 msgr2=0x7f3a300a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 -- 10.20.193.51:0/3585108727 shutdown_connections 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 -- 10.20.193.51:0/3585108727 wait complete. 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 10 monclient: monmap: 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:59.408 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.393+0000 7f3a34d72640 1 Processor -- start 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 -- start start 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient: init 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a300a0750 0x7f3a30090c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-a con 0x7f3a300a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-c con 0x7f3a300a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a3013b760 0x7f3a30091680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): picked mon.noname-b con 0x7f3a3013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:59.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300a04b0 con 0x7f3a300a0750 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3009c850 con 0x7f3a3013b760 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3009e710 con 0x7f3a300a3bb0 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a34d72640 10 monclient(hunting): authenticate will time out at 887.013286s 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a300a0750 0x7f3a30090c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48340/0 (socket says 10.20.193.51:48340) 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3081597357 learned_addr learned my addr 10.20.193.51:0/3081597357 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): get_auth_request con 0x7f3a300a3bb0 auth_method 0 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): get_auth_request con 0x7f3a300a0750 auth_method 0 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2ed76640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a3013b760 0x7f3a30091680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient(hunting): handle_auth_done global_id 44408 payload 824 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a3013b760 msgr2=0x7f3a30091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a3013b760 0x7f3a30091680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a300a0750 msgr2=0x7f3a30090c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a300a0750 0x7f3a30090c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.394+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30094640 con 0x7f3a300a3bb0 2026-02-17T11:49:59.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a2dd74640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 msgr2=0x7f3a30091140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a2dd74640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009820 tx=0x7f3a180047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18046070 con 0x7f3a300a3bb0 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: dump: 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.413 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18041870 con 0x7f3a300a3bb0 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1803c040 con 0x7f3a300a3bb0 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a16ffd640 10 monclient: dump: 2026-02-17T11:49:59.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a2cd72640 4 set_mon_vals no callback set 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 5 monclient: authenticate success, global_id 44408 2026-02-17T11:49:59.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 10 monclient: _renew_subs 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a30094920 con 0x7f3a300a3bb0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 10 monclient: _renew_subs 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.396+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3006f580 con 0x7f3a300a3bb0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a34d72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 0x7f3a3008d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300933b0 con 0x7f3a30091bc0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 0x7f3a3008d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient: get_auth_request con 0x7f3a30091bc0 auth_method 0 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a18041c60 con 0x7f3a300a3bb0 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 10 monclient(hunting): handle_auth_done global_id 74127 payload 824 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2e575640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a300a2530 con 0x7f3a30091bc0 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a16ffd640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39fc03dd90 0x7f39fc040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f3a18077e40 con 0x7f3a300a3bb0 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.397+0000 7f3a2ed76640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39fc03dd90 0x7f39fc040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.398+0000 7f3a2ed76640 10 monclient: get_auth_request con 0x7f39fc03dd90 auth_method 0 2026-02-17T11:49:59.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a2e575640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 msgr2=0x7f3a3008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a2e575640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 0x7f3a3008d3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24006050 con 0x7f3a30091bc0 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a16ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.399+0000 7f3a16ffd640 10 monclient: dump: 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.421 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3a24018070 con 0x7f3a30091bc0 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 msgr2=0x7f3a3008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 0x7f3a3008d3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24005430 comp rx=0 tx=0).stop 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 msgr2=0x7f3a3008d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a16ffd640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a30091bc0 0x7f3a3008d3f0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24005430 comp rx=0 tx=0).stop 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.400+0000 7f3a2ed76640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39fc03dd90 0x7f39fc040250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a30093610 tx=0x7f3a20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a34d72640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:59.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 0x7f3a3008dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a34d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300926c0 con 0x7f3a3008d930 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 0x7f3a3008dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient: get_auth_request con 0x7f3a3008d930 auth_method 0 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 10 monclient(hunting): handle_auth_done global_id 74130 payload 824 2026-02-17T11:49:59.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.403+0000 7f3a2e575640 1 -- 10.20.193.51:0/3081597357 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a3009dac0 con 0x7f3a3008d930 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a2e575640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 msgr2=0x7f3a3008dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a2e575640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 0x7f3a3008dd10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a240067d0 con 0x7f3a3008d930 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 10 monclient: dump: 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.424 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4542 (secure 0 0 0) 0x7f3a240067d0 con 0x7f3a3008d930 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 msgr2=0x7f3a3008dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 0x7f3a3008dd10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24004a40 comp rx=0 tx=0).stop 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 msgr2=0x7f3a3008dd10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a16ffd640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a3008d930 0x7f3a3008dd10 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3a24005030 tx=0x7f3a24004a40 comp rx=0 tx=0).stop 2026-02-17T11:49:59.425 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 17336, 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:59.426 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.427 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.428 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.429 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.430 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.431 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.432 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.433 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.434 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.435 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:59.436 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:59.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39fc03dd90 msgr2=0x7f39fc040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39fc03dd90 0x7f39fc040250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a30093610 tx=0x7f3a20009040 comp rx=0 tx=0).stop 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 10 monclient: shutdown 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 msgr2=0x7f3a30091140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a2ed76640 1 -- 10.20.193.51:0/3081597357 reap_dead start 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.405+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009820 tx=0x7f3a180047c0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.406+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 shutdown_connections 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.406+0000 7f3a34d72640 1 --2- 10.20.193.51:0/3081597357 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a300a3bb0 0x7f3a30091140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.406+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 >> 10.20.193.51:0/3081597357 conn(0x7f3a300a30c0 msgr2=0x7f3a3013aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.406+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 shutdown_connections 2026-02-17T11:49:59.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.406+0000 7f3a34d72640 1 -- 10.20.193.51:0/3081597357 wait complete. 2026-02-17T11:49:59.438 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:59.439 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:49:59.439 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 10 monclient: get_monmap_and_config 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 10 monclient: monmap: 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:59.505432+0000 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:59.505432+0000 2026-02-17T11:49:59.508 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 1 Processor -- start 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 1 -- start start 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.504+0000 7f340b8da640 10 monclient: init 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f34040a3bb0 0x7f340409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-c con 0x7f34040a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f340409d270 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3404138780 addr v1:10.20.193.51:6789/0 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3404135430 con 0x7f3404138780 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340409af60 con 0x7f340409d270 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f340409a5c0 con 0x7f34040a3bb0 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340b8da640 10 monclient(hunting): authenticate will time out at 887.124177s 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f3409e50640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3404138780 0x7f34041403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38976/0 (socket says 10.20.193.51:38976) 2026-02-17T11:49:59.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f3409e50640 1 -- 10.20.193.51:0/907723342 learned_addr learned my addr 10.20.193.51:0/907723342 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 1 --2- 10.20.193.51:0/907723342 >> v2:10.20.193.142:3300/0 conn(0x7f34040a3bb0 0x7f340409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): get_auth_request con 0x7f34040a3bb0 auth_method 0 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient(hunting): handle_auth_done global_id 64162 payload 274 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 1 -- 10.20.193.51:0/907723342 >> v1:10.20.193.142:6789/0 conn(0x7f340409d270 legacy=0x7f3404138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 1 -- 10.20.193.51:0/907723342 >> v1:10.20.193.51:6789/0 conn(0x7f3404138780 legacy=0x7f34041403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:49:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.505+0000 7f340964f640 1 -- 10.20.193.51:0/907723342 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340409b240 con 0x7f34040a3bb0 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340964f640 1 -- 10.20.193.51:0/907723342 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34040a3bb0 msgr2=0x7f340409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340964f640 1 --2- 10.20.193.51:0/907723342 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34040a3bb0 0x7f340409cd30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34040694e0 tx=0x7f33f402ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406330225e4e9878 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 1 -- 10.20.193.51:0/907723342 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f403c070 con 0x7f34040a3bb0 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: dump: 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.521 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 5 monclient: authenticate success, global_id 64162 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 1 -- 10.20.193.51:0/907723342 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f402fcb0 con 0x7f34040a3bb0 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 1 -- 10.20.193.51:0/907723342 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f402fe60 con 0x7f34040a3bb0 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 4 set_mon_vals no callback set 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f33f3fff640 10 monclient: dump: 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.523 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 10 monclient: shutdown 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 -- 10.20.193.51:0/907723342 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34040a3bb0 msgr2=0x7f340409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 --2- 10.20.193.51:0/907723342 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34040a3bb0 0x7f340409cd30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34040694e0 tx=0x7f33f402ed50 comp rx=0 tx=0).stop 2026-02-17T11:49:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 -- 10.20.193.51:0/907723342 shutdown_connections 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 --2- 10.20.193.51:0/907723342 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34040a3bb0 0x7f340409cd30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 -- 10.20.193.51:0/907723342 >> 10.20.193.51:0/907723342 conn(0x7f34040a30c0 msgr2=0x7f34040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 -- 10.20.193.51:0/907723342 shutdown_connections 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.508+0000 7f340b8da640 1 -- 10.20.193.51:0/907723342 wait complete. 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient: monmap: 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.525 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 Processor -- start 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 -- start start 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient: init 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f340409d270 0x7f3404130ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-b con 0x7f340409d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-c con 0x7f34040a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3404138780 0x7f340412d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): picked mon.noname-a con 0x7f3404138780 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f34040a3f90 con 0x7f3404138780 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f340409b520 con 0x7f340409d270 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3404135040 con 0x7f34040a3bb0 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f340b8da640 10 monclient(hunting): authenticate will time out at 887.128595s 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3404138780 0x7f340412d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48342/0 (socket says 10.20.193.51:48342) 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 -- 10.20.193.51:0/3784360986 learned_addr learned my addr 10.20.193.51:0/3784360986 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): get_auth_request con 0x7f34040a3bb0 auth_method 0 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): get_auth_request con 0x7f3404138780 auth_method 0 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient(hunting): handle_auth_done global_id 44411 payload 824 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f340409d270 msgr2=0x7f3404130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f340409d270 0x7f3404130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3404138780 msgr2=0x7f340412d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3404138780 0x7f340412d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3408e4e640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34040a2780 con 0x7f34040a3bb0 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.509+0000 7f3409e50640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3404138780 0x7f340412d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f3408e4e640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 msgr2=0x7f340412cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f3408e4e640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b550 tx=0x7f33f800ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8013020 con 0x7f34040a3bb0 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: dump: 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.530 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80026e0 con 0x7f34040a3bb0 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8002ad0 con 0x7f34040a3bb0 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f37fe640 4 set_mon_vals no callback set 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 10 monclient: dump: 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.532 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 5 monclient: authenticate success, global_id 44411 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 monclient: _renew_subs 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3404130aa0 con 0x7f34040a3bb0 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 monclient: _renew_subs 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3404130200 con 0x7f34040a3bb0 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 0x7f340409eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f340412f140 con 0x7f340412d610 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f33f8018400 con 0x7f34040a3bb0 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 0x7f340409eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient: get_auth_request con 0x7f340412d610 auth_method 0 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.512+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f340964f640 10 monclient(hunting): handle_auth_done global_id 44414 payload 824 2026-02-17T11:49:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f340964f640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34041383d0 con 0x7f340412d610 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f33f1ffb640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33d403dd40 0x7f33d4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f33f8052530 con 0x7f34040a3bb0 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f3409e50640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33d403dd40 0x7f33d4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.513+0000 7f3409e50640 10 monclient: get_auth_request con 0x7f33d403dd40 auth_method 0 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f340964f640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 msgr2=0x7f340409eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f340964f640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 0x7f340409eb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f340409ac40 tx=0x7f33f40095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4046070 con 0x7f340412d610 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 10 monclient: dump: 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.535 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f33f4041c20 con 0x7f340412d610 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 msgr2=0x7f340409eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 0x7f340409eb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f340409ac40 tx=0x7f33f40095f0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 msgr2=0x7f340409eb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f33f1ffb640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f340412d610 0x7f340409eb40 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f340409ac40 tx=0x7f33f40095f0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.515+0000 7f3409e50640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33d403dd40 0x7f33d4040200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3404132ee0 tx=0x7f3400009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340b8da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340b8da640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 0x7f3404063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3404138cd0 con 0x7f34040638c0 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 0x7f3404063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient: get_auth_request con 0x7f34040638c0 auth_method 0 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 10 monclient(hunting): handle_auth_done global_id 44417 payload 824 2026-02-17T11:49:59.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.518+0000 7f340964f640 1 -- 10.20.193.51:0/3784360986 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3404130880 con 0x7f34040638c0 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f340964f640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 msgr2=0x7f3404063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f340964f640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 0x7f3404063cd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33f402ed90 tx=0x7f33f4033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f403c040 con 0x7f34040638c0 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f33f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f33f1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.520+0000 7f33f1ffb640 10 monclient: dump: 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f33f4037e10 con 0x7f34040638c0 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 msgr2=0x7f3404063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 0x7f3404063cd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33f402ed90 tx=0x7f33f4033000 comp rx=0 tx=0).stop 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 msgr2=0x7f3404063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f33f1ffb640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040638c0 0x7f3404063cd0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33f402ed90 tx=0x7f33f4033000 comp rx=0 tx=0).stop 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 170992, 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:59.541 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.542 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.543 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:59.544 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.545 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.546 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.547 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:59.548 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.549 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.550 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:59.551 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:59.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33d403dd40 msgr2=0x7f33d4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33d403dd40 0x7f33d4040200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3404132ee0 tx=0x7f3400009040 comp rx=0 tx=0).stop 2026-02-17T11:49:59.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 10 monclient: shutdown 2026-02-17T11:49:59.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 msgr2=0x7f340412cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b550 tx=0x7f33f800ba20 comp rx=0 tx=0).stop 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f3409e50640 1 -- 10.20.193.51:0/3784360986 reap_dead start 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 shutdown_connections 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 --2- 10.20.193.51:0/3784360986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34040a3bb0 0x7f340412cb90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 >> 10.20.193.51:0/3784360986 conn(0x7f34040a30c0 msgr2=0x7f340409c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 shutdown_connections 2026-02-17T11:49:59.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.521+0000 7f340b8da640 1 -- 10.20.193.51:0/3784360986 wait complete. 2026-02-17T11:49:59.553 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:59.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:49:59.553 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 10 monclient: get_monmap_and_config 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 10 monclient: monmap: 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:59.620507+0000 2026-02-17T11:49:59.621 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:59.620507+0000 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:59.622 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 1 Processor -- start 2026-02-17T11:49:59.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 1 -- start start 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.619+0000 7f9a0015b640 10 monclient: init 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f99f806d180 0x7f99f80a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-c con 0x7f99f806d180 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-b con 0x7f99f809c8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 0x7f99f813e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-a con 0x7f99f80a3090 addr v2:10.20.193.51:3300/0 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f99f806d560 con 0x7f99f80a3090 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f99f809c480 con 0x7f99f806d180 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f99f809b420 con 0x7f99f809c8a0 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f9a0015b640 10 monclient(hunting): authenticate will time out at 887.239248s 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 0x7f99f813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48376/0 (socket says 10.20.193.51:48376) 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 -- 10.20.193.51:0/1855461733 learned_addr learned my addr 10.20.193.51:0/1855461733 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): get_auth_request con 0x7f99f809c8a0 auth_method 0 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 1 --2- 10.20.193.51:0/1855461733 >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 0x7f99f813e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52076/0 (socket says 10.20.193.51:52076) 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): get_auth_request con 0x7f99f80a3090 auth_method 0 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_done global_id 44420 payload 274 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 -- 10.20.193.51:0/1855461733 >> v2:10.20.193.142:3300/0 conn(0x7f99f806d180 msgr2=0x7f99f80a2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/1855461733 >> v2:10.20.193.142:3300/0 conn(0x7f99f806d180 0x7f99f80a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 -- 10.20.193.51:0/1855461733 >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 msgr2=0x7f99f813e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/1855461733 >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 0x7f99f813e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 monclient: found mon.noname-b 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.620+0000 7f99fd6cf640 1 -- 10.20.193.51:0/1855461733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f809bbe0 con 0x7f99f809c8a0 2026-02-17T11:49:59.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.622+0000 7f99fd6cf640 1 -- 10.20.193.51:0/1855461733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 msgr2=0x7f99f80a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.622+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/1855461733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99f80768b0 tx=0x7f99ec02eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9ece42fb741f5e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 1 -- 10.20.193.51:0/1855461733 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec03c070 con 0x7f99f809c8a0 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: dump: 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.635 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 1 -- 10.20.193.51:0/1855461733 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec02fd50 con 0x7f99f809c8a0 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 1 -- 10.20.193.51:0/1855461733 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec037660 con 0x7f99f809c8a0 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:49:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f99fcece640 10 monclient: dump: 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 5 monclient: authenticate success, global_id 44420 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:59.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 4 set_mon_vals no callback set 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 10 monclient: shutdown 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 -- 10.20.193.51:0/1855461733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 msgr2=0x7f99f80a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 --2- 10.20.193.51:0/1855461733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99f80768b0 tx=0x7f99ec02eed0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 -- 10.20.193.51:0/1855461733 shutdown_connections 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 --2- 10.20.193.51:0/1855461733 >> v2:10.20.193.51:3300/0 conn(0x7f99f80a3090 0x7f99f813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 --2- 10.20.193.51:0/1855461733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f809c8a0 0x7f99f80a2b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 --2- 10.20.193.51:0/1855461733 >> v2:10.20.193.142:3300/0 conn(0x7f99f806d180 0x7f99f80a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 -- 10.20.193.51:0/1855461733 >> 10.20.193.51:0/1855461733 conn(0x7f99f80a7b90 msgr2=0x7f99f80a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 -- 10.20.193.51:0/1855461733 shutdown_connections 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 1 -- 10.20.193.51:0/1855461733 wait complete. 2026-02-17T11:49:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.623+0000 7f9a0015b640 10 monclient: monmap: 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 Processor -- start 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 -- start start 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient: init 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f806d180 0x7f99f8099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-b con 0x7f99f806d180 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 0x7f99f809a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-a con 0x7f99f809c8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f80a3090 0x7f99f8091b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): picked mon.noname-c con 0x7f99f80a3090 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f99f809e7c0 con 0x7f99f809c8a0 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99f809e640 con 0x7f99f806d180 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f99f80a34e0 con 0x7f99f80a3090 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f9a0015b640 10 monclient(hunting): authenticate will time out at 887.243505s 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f80a3090 0x7f99f8091b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 0x7f99f809a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f80a3090 0x7f99f8091b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48392/0 (socket says 10.20.193.51:48392) 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 0x7f99f809a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52088/0 (socket says 10.20.193.51:52088) 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 1 -- 10.20.193.51:0/2828673513 learned_addr learned my addr 10.20.193.51:0/2828673513 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): get_auth_request con 0x7f99f80a3090 auth_method 0 2026-02-17T11:49:59.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): get_auth_request con 0x7f99f809c8a0 auth_method 0 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fe6d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fded0640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f806d180 0x7f99f8099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fded0640 10 monclient(hunting): get_auth_request con 0x7f99f806d180 auth_method 0 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fded0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fded0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fded0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient(hunting): handle_auth_done global_id 74139 payload 824 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f80a3090 msgr2=0x7f99f8091b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f99f80a3090 0x7f99f8091b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f806d180 msgr2=0x7f99f8099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f806d180 0x7f99f8099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 monclient: found mon.noname-a 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.624+0000 7f99fd6cf640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f8094cf0 con 0x7f99f809c8a0 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.626+0000 7f99fd6cf640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 msgr2=0x7f99f809a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.626+0000 7f99fd6cf640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 0x7f99f809a360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f809b5a0 tx=0x7f99ec004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec03c040 con 0x7f99f809c8a0 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: dump: 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec047070 con 0x7f99f809c8a0 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec042670 con 0x7f99f809c8a0 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 10 monclient: dump: 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.646 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e7fff640 4 set_mon_vals no callback set 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 5 monclient: authenticate success, global_id 74139 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 monclient: _renew_subs 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f80a66b0 con 0x7f99f809c8a0 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 monclient: _renew_subs 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f80946a0 con 0x7f99f809c8a0 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 0x7f99f8095260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80a2610 con 0x7f99f81cf200 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f99ec042890 con 0x7f99f809c8a0 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.627+0000 7f99e67fc640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f99c803dd10 0x7f99c80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f99ec077810 con 0x7f99f809c8a0 2026-02-17T11:49:59.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 0x7f99f8095260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient: get_auth_request con 0x7f99f81cf200 auth_method 0 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fe6d1640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f99c803dd10 0x7f99c80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fe6d1640 10 monclient: get_auth_request con 0x7f99c803dd10 auth_method 0 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 10 monclient(hunting): handle_auth_done global_id 64168 payload 824 2026-02-17T11:49:59.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.628+0000 7f99fded0640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99f80008d0 con 0x7f99f81cf200 2026-02-17T11:49:59.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.630+0000 7f99fe6d1640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f99c803dd10 0x7f99c80401d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009a40 tx=0x7f99f400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.630+0000 7f99fded0640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 msgr2=0x7f99f8095260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.630+0000 7f99fded0640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 0x7f99f8095260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80044f0 con 0x7f99f81cf200 2026-02-17T11:49:59.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 10 monclient: dump: 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.653 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f99e8017070 con 0x7f99f81cf200 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 msgr2=0x7f99f8095260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 0x7f99f8095260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e800dc00 comp rx=0 tx=0).stop 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 msgr2=0x7f99f8095260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.631+0000 7f99e67fc640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f81cf200 0x7f99f8095260 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e800dc00 comp rx=0 tx=0).stop 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f9a0015b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f9a0015b640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 0x7f99f81da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f9a0015b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80924b0 con 0x7f99f80920a0 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 0x7f99f81da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient: get_auth_request con 0x7f99f80920a0 auth_method 0 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 10 monclient(hunting): handle_auth_done global_id 64171 payload 824 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.634+0000 7f99fded0640 1 -- 10.20.193.51:0/2828673513 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99f8092660 con 0x7f99f80920a0 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99fded0640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 msgr2=0x7f99f81da2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99fded0640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 0x7f99f81da2e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e8004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80028e0 con 0x7f99f80920a0 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 10 monclient: dump: 2026-02-17T11:49:59.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7f99e80028e0 con 0x7f99f80920a0 2026-02-17T11:49:59.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 msgr2=0x7f99f81da2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 0x7f99f81da2e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e8004830 comp rx=0 tx=0).stop 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 msgr2=0x7f99f81da2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99e67fc640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f99f80920a0 0x7f99f81da2e0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d730 tx=0x7f99e8004830 comp rx=0 tx=0).stop 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:59.657 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 38, 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 71184, 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.658 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.659 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:49:59.660 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:49:59.661 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:49:59.662 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:49:59.663 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:49:59.664 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:49:59.666 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:49:59.667 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:49:59.667 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:49:59.667 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:49:59.667 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f99c803dd10 msgr2=0x7f99c80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f99c803dd10 0x7f99c80401d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009a40 tx=0x7f99f400b040 comp rx=0 tx=0).stop 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 10 monclient: shutdown 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 msgr2=0x7f99f809a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 1 --2- 10.20.193.51:0/2828673513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f99f809c8a0 0x7f99f809a360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f809b5a0 tx=0x7f99ec004830 comp rx=0 tx=0).stop 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99fe6d1640 1 -- 10.20.193.51:0/2828673513 reap_dead start 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f99fe6d1640 1 -- 10.20.193.51:0/2828673513 reap_dead start 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.637+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 shutdown_connections 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.638+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 >> 10.20.193.51:0/2828673513 conn(0x7f99f80a7b90 msgr2=0x7f99f81c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.638+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 shutdown_connections 2026-02-17T11:49:59.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.638+0000 7f9a0015b640 1 -- 10.20.193.51:0/2828673513 wait complete. 2026-02-17T11:49:59.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:49:59.669 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:49:59.669 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:49:59.669 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:49:59.669 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:49:59.669 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:49:59.669 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:49:59.679 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:49:59.679 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:49:59.680 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:49:59.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: get_monmap_and_config 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: monmap: 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:49:59.785108+0000 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:49:59.785108+0000 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:49:59.788 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 Processor -- start 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 -- start start 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: init 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 0x7f4d9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-b con 0x7f4d9c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4d9c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4d9c13b760 0x7f4d9c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-c con 0x7f4d9c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c06e140 con 0x7f4d9c0a0750 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9c09f910 con 0x7f4d9c13b760 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c09ccd0 con 0x7f4d9c0a3bb0 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4da29f7640 10 monclient(hunting): authenticate will time out at 887.403858s 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4d9bfff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 msgr2=0x7f4d9c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.784+0000 7f4d9bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 0x7f4d9c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:59.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4d9b7fe640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f4d9c0a0750 0x7f4d9c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:58540/0 (socket says 10.20.193.51:58540) 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4d9b7fe640 1 -- 10.20.193.51:0/3645635959 learned_addr learned my addr 10.20.193.51:0/3645635959 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4da0f6d640 1 --2- 10.20.193.51:0/3645635959 >> v2:10.20.193.142:3300/0 conn(0x7f4d9c13b760 0x7f4d9c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4da0f6d640 10 monclient(hunting): get_auth_request con 0x7f4d9c13b760 auth_method 0 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4da0f6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4da0f6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.785+0000 7f4da0f6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4d9b7fe640 1 -- 10.20.193.51:0/3645635959 >> v1:10.20.193.142:6789/0 conn(0x7f4d9c0a0750 legacy=0x7f4d9c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient(hunting): handle_auth_done global_id 64174 payload 274 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 1 -- 10.20.193.51:0/3645635959 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 msgr2=0x7f4d9c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 1 --2- 10.20.193.51:0/3645635959 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 0x7f4d9c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 1 -- 10.20.193.51:0/3645635959 >> v1:10.20.193.142:6789/0 conn(0x7f4d9c0a0750 legacy=0x7f4d9c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 1 monclient: found mon.noname-c 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.787+0000 7f4da0f6d640 1 -- 10.20.193.51:0/3645635959 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c09eec0 con 0x7f4d9c13b760 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da0f6d640 1 -- 10.20.193.51:0/3645635959 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c13b760 msgr2=0x7f4d9c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da0f6d640 1 --2- 10.20.193.51:0/3645635959 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c13b760 0x7f4d9c13db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009e10 tx=0x7f4d9002f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e3bd02658cf45e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 1 -- 10.20.193.51:0/3645635959 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9003c070 con 0x7f4d9c13b760 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: dump: 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 5 monclient: authenticate success, global_id 64174 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 1 -- 10.20.193.51:0/3645635959 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d90037640 con 0x7f4d9c13b760 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 1 -- 10.20.193.51:0/3645635959 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90037a10 con 0x7f4d9c13b760 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4d9affd640 10 monclient: dump: 2026-02-17T11:49:59.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 4 set_mon_vals no callback set 2026-02-17T11:49:59.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 10 monclient: shutdown 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 -- 10.20.193.51:0/3645635959 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c13b760 msgr2=0x7f4d9c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3645635959 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c13b760 0x7f4d9c13db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009e10 tx=0x7f4d9002f200 comp rx=0 tx=0).stop 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 -- 10.20.193.51:0/3645635959 shutdown_connections 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3645635959 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c13b760 0x7f4d9c13db50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3645635959 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c0a3bb0 0x7f4d9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 -- 10.20.193.51:0/3645635959 >> 10.20.193.51:0/3645635959 conn(0x7f4d9c0a30c0 msgr2=0x7f4d9c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 -- 10.20.193.51:0/3645635959 shutdown_connections 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.790+0000 7f4da29f7640 1 -- 10.20.193.51:0/3645635959 wait complete. 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient: build_initial_monmap 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient: monmap: 2026-02-17T11:49:59.804 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 Processor -- start 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 -- start start 2026-02-17T11:49:59.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient: init 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-a con 0x7f4d9c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 0x7f4d9c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-b con 0x7f4d9c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 0x7f4d9c13b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): picked mon.noname-c con 0x7f4d9c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c0a04b0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c09c850 con 0x7f4d9c0a3bb0 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c09e710 con 0x7f4d9c13b760 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da29f7640 10 monclient(hunting): authenticate will time out at 887.410488s 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da0f6d640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 msgr2=0x7f4d9c13b1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4da0f6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 0x7f4d9c13b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52114/0 (socket says 10.20.193.51:52114) 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 -- 10.20.193.51:0/3211316248 learned_addr learned my addr 10.20.193.51:0/3211316248 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): get_auth_request con 0x7f4d9c0a0750 auth_method 0 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 0x7f4d9c13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 10 monclient(hunting): get_auth_request con 0x7f4d9c0a3bb0 auth_method 0 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient(hunting): handle_auth_done global_id 74142 payload 824 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 -- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 msgr2=0x7f4d9c13b1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:49:59.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 0x7f4d9c13b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 -- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 msgr2=0x7f4d9c13acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 0x7f4d9c13acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 monclient: found mon.noname-a 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9bfff640 1 -- 10.20.193.51:0/3211316248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c09a9b0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.791+0000 7f4d9b7fe640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 0x7f4d9c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d9bfff640 1 -- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 msgr2=0x7f4d9c13a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d9bfff640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800b780 tx=0x7f4d8800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880052d0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 10 monclient: dump: 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.810 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 10 monclient: _finish_auth 0 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.793+0000 7f4d98ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88010070 con 0x7f4d9c0a0750 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 5 monclient: authenticate success, global_id 74142 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _renew_subs 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c099280 con 0x7f4d9c0a0750 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880056d0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:49:59.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d9a7fc640 4 set_mon_vals no callback set 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 10 monclient: dump: 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:49:59.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _renew_subs 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c0a29f0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c0a2190 con 0x7f4d9c0a0750 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4d88015470 con 0x7f4d9c0a0750 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 0x7f4d6c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.794+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f4d88051fb0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.795+0000 7f4d9b7fe640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 0x7f4d6c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.795+0000 7f4d9b7fe640 10 monclient: get_auth_request con 0x7f4d6c03dcc0 auth_method 0 2026-02-17T11:49:59.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.797+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4d8801a060 con 0x7f4d9c0a0750 2026-02-17T11:49:59.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.797+0000 7f4d98ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:49:59.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.797+0000 7f4d98ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:49:59.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.797+0000 7f4d9b7fe640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 0x7f4d6c040180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c098550 tx=0x7f4d8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:49:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4da29f7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:49:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4da29f7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4da29f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:49:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d9c09d7b0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4d98ff9640 1 -- 10.20.193.51:0/3211316248 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f4d880058b0 con 0x7f4d9c0a0750 2026-02-17T11:49:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4d98ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:49:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.915+0000 7f4d98ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:49:59.918 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:49:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 msgr2=0x7f4d6c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 0x7f4d6c040180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c098550 tx=0x7f4d8c009040 comp rx=0 tx=0).stop 2026-02-17T11:49:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 10 monclient: shutdown 2026-02-17T11:49:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:49:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 msgr2=0x7f4d9c13a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800b780 tx=0x7f4d8800bc50 comp rx=0 tx=0).stop 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 shutdown_connections 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4d6c03dcc0 0x7f4d6c040180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d9c13b760 0x7f4d9c13b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d9c0a3bb0 0x7f4d9c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 --2- 10.20.193.51:0/3211316248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d9c0a0750 0x7f4d9c13a770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 >> 10.20.193.51:0/3211316248 conn(0x7f4d9c0a30c0 msgr2=0x7f4d9c072ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 shutdown_connections 2026-02-17T11:49:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:49:59.916+0000 7f4da29f7640 1 -- 10.20.193.51:0/3211316248 wait complete. 2026-02-17T11:50:02.926 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:03.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.995+0000 7f31e5891640 10 monclient: get_monmap_and_config 2026-02-17T11:50:03.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.995+0000 7f31e5891640 10 monclient: build_initial_monmap 2026-02-17T11:50:03.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.995+0000 7f31e5891640 10 monclient: monmap: 2026-02-17T11:50:03.000 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:03.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:02.996693+0000 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:02.996693+0000 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 Processor -- start 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 -- start start 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient: init 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f31e00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 0x7f31e009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-b con 0x7f31e00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31e013b760 0x7f31e013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-a con 0x7f31e013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e006e140 con 0x7f31e00a3bb0 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f31e009f910 con 0x7f31e013b760 2026-02-17T11:50:03.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31e009ccd0 con 0x7f31e00a0750 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31e5891640 10 monclient(hunting): authenticate will time out at 890.615497s 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31de7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 msgr2=0x7f31e009e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31de7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 0x7f31e009e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31e013b760 0x7f31e013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31e013b760 0x7f31e013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52120/0 (socket says 10.20.193.51:52120) 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 -- 10.20.193.51:0/2397393573 learned_addr learned my addr 10.20.193.51:0/2397393573 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): get_auth_request con 0x7f31e013b760 auth_method 0 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:03.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient(hunting): handle_auth_done global_id 74145 payload 274 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 -- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 msgr2=0x7f31e009e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 --2- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 0x7f31e009e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 -- 10.20.193.51:0/2397393573 >> v1:10.20.193.142:6789/0 conn(0x7f31e00a3bb0 legacy=0x7f31e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 monclient: found mon.noname-a 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.996+0000 7f31df7fe640 1 -- 10.20.193.51:0/2397393573 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e009eec0 con 0x7f31e013b760 2026-02-17T11:50:03.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31df7fe640 1 -- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 msgr2=0x7f31e013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:03.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31df7fe640 1 --2- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e013db50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31e009f230 tx=0x7f31d002f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06fb5e6aa6350e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:03.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 1 -- 10.20.193.51:0/2397393573 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00373f0 con 0x7f31e013b760 2026-02-17T11:50:03.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: dump: 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:03.012 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 1 -- 10.20.193.51:0/2397393573 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0037590 con 0x7f31e013b760 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 5 monclient: authenticate success, global_id 74145 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 1 -- 10.20.193.51:0/2397393573 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0037960 con 0x7f31e013b760 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31ddffb640 10 monclient: dump: 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:03.013 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 4 set_mon_vals no callback set 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 10 monclient: shutdown 2026-02-17T11:50:03.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 -- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 msgr2=0x7f31e013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 --2- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e013db50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31e009f230 tx=0x7f31d002f200 comp rx=0 tx=0).stop 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 -- 10.20.193.51:0/2397393573 shutdown_connections 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 --2- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e013db50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 --2- 10.20.193.51:0/2397393573 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a0750 0x7f31e009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 -- 10.20.193.51:0/2397393573 >> 10.20.193.51:0/2397393573 conn(0x7f31e00a30c0 msgr2=0x7f31e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 -- 10.20.193.51:0/2397393573 shutdown_connections 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:02.999+0000 7f31e5891640 1 -- 10.20.193.51:0/2397393573 wait complete. 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient: build_initial_monmap 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient: monmap: 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:03.015 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 Processor -- start 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 -- start start 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient: init 2026-02-17T11:50:03.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31e00a0750 0x7f31e013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-b con 0x7f31e00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 0x7f31e013aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-c con 0x7f31e00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): picked mon.noname-a con 0x7f31e013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00a04b0 con 0x7f31e013b760 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31e009c850 con 0x7f31e00a0750 2026-02-17T11:50:03.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31e009e710 con 0x7f31e00a3bb0 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31e5891640 10 monclient(hunting): authenticate will time out at 890.619916s 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31de7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 msgr2=0x7f31e013aee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31de7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 0x7f31e013aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52122/0 (socket says 10.20.193.51:52122) 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 1 -- 10.20.193.51:0/4006623929 learned_addr learned my addr 10.20.193.51:0/4006623929 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 10 monclient(hunting): get_auth_request con 0x7f31e013b760 auth_method 0 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:03.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.000+0000 7f31df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31deffd640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31e00a0750 0x7f31e013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31deffd640 10 monclient(hunting): get_auth_request con 0x7f31e00a0750 auth_method 0 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient(hunting): handle_auth_done global_id 74148 payload 824 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 -- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 msgr2=0x7f31e013aee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 0x7f31e013aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 -- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31e00a0750 msgr2=0x7f31e013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:03.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31e00a0750 0x7f31e013a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 monclient: found mon.noname-a 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.001+0000 7f31df7fe640 1 -- 10.20.193.51:0/4006623929 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e009ade0 con 0x7f31e013b760 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31df7fe640 1 -- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 msgr2=0x7f31e0096ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31df7fe640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31d00093e0 tx=0x7f31d0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0046030 con 0x7f31e013b760 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: dump: 2026-02-17T11:50:03.020 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: _finish_auth 0 2026-02-17T11:50:03.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0041870 con 0x7f31e013b760 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 5 monclient: authenticate success, global_id 74148 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _renew_subs 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e00a2200 con 0x7f31e013b760 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0041a40 con 0x7f31e013b760 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31dd7fa640 4 set_mon_vals no callback set 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31b7fff640 10 monclient: dump: 2026-02-17T11:50:03.022 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _renew_subs 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e00993d0 con 0x7f31e013b760 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.003+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e009dac0 con 0x7f31e013b760 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.004+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f31d0041c20 con 0x7f31e013b760 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.004+0000 7f31b7fff640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 0x7f31b0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.004+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f31d0077c80 con 0x7f31e013b760 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.004+0000 7f31deffd640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 0x7f31b0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.004+0000 7f31deffd640 10 monclient: get_auth_request con 0x7f31b003dcc0 auth_method 0 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.006+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f31d003fdd0 con 0x7f31e013b760 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.006+0000 7f31b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:03.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.006+0000 7f31b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:03.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.007+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:50:03.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.007+0000 7f31deffd640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 0x7f31b0040180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005020 tx=0x7f31d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:03.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31e5891640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31e5891640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31e5891640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f31e00a2a50 con 0x7f31e013b760 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31b7fff640 1 -- 10.20.193.51:0/4006623929 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f31d0037470 con 0x7f31e013b760 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.120+0000 7f31b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:03.123 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:03.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 msgr2=0x7f31b0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 0x7f31b0040180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005020 tx=0x7f31d4009040 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 10 monclient: shutdown 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 msgr2=0x7f31e0096ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31d00093e0 tx=0x7f31d0004b40 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 shutdown_connections 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31b003dcc0 0x7f31b0040180 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31e013b760 0x7f31e0096ea0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31e00a3bb0 0x7f31e013aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 --2- 10.20.193.51:0/4006623929 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31e00a0750 0x7f31e013a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:03.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 >> 10.20.193.51:0/4006623929 conn(0x7f31e00a30c0 msgr2=0x7f31e00a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:03.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 shutdown_connections 2026-02-17T11:50:03.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:03.121+0000 7f31e5891640 1 -- 10.20.193.51:0/4006623929 wait complete. 2026-02-17T11:50:06.133 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: get_monmap_and_config 2026-02-17T11:50:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: build_initial_monmap 2026-02-17T11:50:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: monmap: 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:06.202205+0000 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:06.202205+0000 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:06.206 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 Processor -- start 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 -- start start 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: init 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbb180a3bb0 0x7fbb1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-c con 0x7fbb180a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 0x7fbb1809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-b con 0x7fbb180a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb1809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1806e140 con 0x7fbb1809e540 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbb180a3f90 con 0x7fbb180a3bb0 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1809f910 con 0x7fbb180a0750 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb1e351640 10 monclient(hunting): authenticate will time out at 893.820978s 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.201+0000 7fbb177fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 msgr2=0x7fbb1809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb177fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 0x7fbb1809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb1c8c7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fbb1809e540 0x7fbb1813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53760/0 (socket says 10.20.193.51:53760) 2026-02-17T11:50:06.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb1c8c7640 1 -- 10.20.193.51:0/2507997580 learned_addr learned my addr 10.20.193.51:0/2507997580 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 --2- 10.20.193.51:0/2507997580 >> v2:10.20.193.142:3300/0 conn(0x7fbb180a3bb0 0x7fbb1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): get_auth_request con 0x7fbb180a3bb0 auth_method 0 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient(hunting): handle_auth_done global_id 64183 payload 274 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 -- 10.20.193.51:0/2507997580 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 msgr2=0x7fbb1809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 --2- 10.20.193.51:0/2507997580 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 0x7fbb1809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 -- 10.20.193.51:0/2507997580 >> v1:10.20.193.51:6789/0 conn(0x7fbb1809e540 legacy=0x7fbb1813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient: _finish_hunting 0 2026-02-17T11:50:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 monclient: found mon.noname-c 2026-02-17T11:50:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.202+0000 7fbb17fff640 1 -- 10.20.193.51:0/2507997580 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1809ccd0 con 0x7fbb180a3bb0 2026-02-17T11:50:06.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb17fff640 1 -- 10.20.193.51:0/2507997580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a3bb0 msgr2=0x7fbb1809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:06.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb17fff640 1 --2- 10.20.193.51:0/2507997580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a3bb0 0x7fbb1809dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806c1c0 tx=0x7fbb0402ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad95420f8e09853 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:06.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 1 -- 10.20.193.51:0/2507997580 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0403c070 con 0x7fbb180a3bb0 2026-02-17T11:50:06.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:06.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:06.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: dump: 2026-02-17T11:50:06.225 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:06.225 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:06.226 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:06.227 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:06.227 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: _finish_auth 0 2026-02-17T11:50:06.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:06.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 1 -- 10.20.193.51:0/2507997580 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0402fcd0 con 0x7fbb180a3bb0 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 5 monclient: authenticate success, global_id 64183 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 1 -- 10.20.193.51:0/2507997580 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04037660 con 0x7fbb180a3bb0 2026-02-17T11:50:06.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 4 set_mon_vals no callback set 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb16ffd640 10 monclient: dump: 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:06.229 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:06.230 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:06.231 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:06.231 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 10 monclient: shutdown 2026-02-17T11:50:06.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:06.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 -- 10.20.193.51:0/2507997580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a3bb0 msgr2=0x7fbb1809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 --2- 10.20.193.51:0/2507997580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a3bb0 0x7fbb1809dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806c1c0 tx=0x7fbb0402ed70 comp rx=0 tx=0).stop 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 -- 10.20.193.51:0/2507997580 shutdown_connections 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 --2- 10.20.193.51:0/2507997580 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a0750 0x7fbb1809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 --2- 10.20.193.51:0/2507997580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a3bb0 0x7fbb1809dac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 -- 10.20.193.51:0/2507997580 >> 10.20.193.51:0/2507997580 conn(0x7fbb180a30c0 msgr2=0x7fbb180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 -- 10.20.193.51:0/2507997580 shutdown_connections 2026-02-17T11:50:06.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.205+0000 7fbb1e351640 1 -- 10.20.193.51:0/2507997580 wait complete. 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient: build_initial_monmap 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient: monmap: 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:06.233 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 Processor -- start 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 -- start start 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient: init 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a0750 0x7fbb1813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-b con 0x7fbb180a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 0x7fbb1813c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): picked mon.noname-c con 0x7fbb180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbb180a04b0 con 0x7fbb1809e540 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1809c850 con 0x7fbb180a0750 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1813de80 con 0x7fbb180a3bb0 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1e351640 10 monclient(hunting): authenticate will time out at 893.825827s 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1c8c7640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 msgr2=0x7fbb1813c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb1c8c7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 0x7fbb1813c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:06.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32776/0 (socket says 10.20.193.51:32776) 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 1 -- 10.20.193.51:0/1870174728 learned_addr learned my addr 10.20.193.51:0/1870174728 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): get_auth_request con 0x7fbb1809e540 auth_method 0 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.206+0000 7fbb17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb177fe640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a0750 0x7fbb1813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb177fe640 10 monclient(hunting): get_auth_request con 0x7fbb180a0750 auth_method 0 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:06.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 10 monclient(hunting): handle_auth_done global_id 74151 payload 824 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 -- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 msgr2=0x7fbb1813c480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 0x7fbb1813c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 -- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a0750 msgr2=0x7fbb1813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a0750 0x7fbb1813bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 10 monclient: _finish_hunting 0 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 monclient: found mon.noname-a 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.207+0000 7fbb17fff640 1 -- 10.20.193.51:0/1870174728 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1809c2c0 con 0x7fbb1809e540 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb17fff640 1 -- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 msgr2=0x7fbb18095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb17fff640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb04002410 tx=0x7fbb040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb17fff640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb04002410 tx=0x7fbb040047c0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fbb04046070 mon_map magic: 0 2026-02-17T11:50:06.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04046070 con 0x7fbb1809e540 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: dump: 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: _finish_auth 0 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04041890 con 0x7fbb1809e540 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 5 monclient: authenticate success, global_id 74151 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 10 monclient: _renew_subs 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1809a750 con 0x7fbb1809e540 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb167fc640 4 set_mon_vals no callback set 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 10 monclient: _renew_subs 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb180a2430 con 0x7fbb1809e540 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0403c040 con 0x7fbb1809e540 2026-02-17T11:50:06.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 10 monclient: dump: 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.209+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbb04041c80 con 0x7fbb1809e540 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb1e351640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:06.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb1e351640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb1e351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1809d7b0 con 0x7fbb1809e540 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb14ff9640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 0x7fbae8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb177fe640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 0x7fbae8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.210+0000 7fbb177fe640 10 monclient: get_auth_request con 0x7fbae803dcc0 auth_method 0 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.212+0000 7fbb17fff640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb04002410 tx=0x7fbb040047c0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fbb04050070 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-17T11:50:06.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.213+0000 7fbb177fe640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 0x7fbae8040180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb1813d750 tx=0x7fbb08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:06.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:06.833+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7fbb04077c60 con 0x7fbb1809e540 2026-02-17T11:50:07.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.040+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb04050070 con 0x7fbb1809e540 2026-02-17T11:50:07.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.040+0000 7fbb14ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:07.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.040+0000 7fbb14ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb1e351640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb1e351640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb1e351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbb1809dac0 con 0x7fbb1809e540 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb14ff9640 1 -- 10.20.193.51:0/1870174728 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fbb040363a0 con 0x7fbb1809e540 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb14ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:07.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.154+0000 7fbb14ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:07.158 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:07.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 msgr2=0x7fbae8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:07.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 0x7fbae8040180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb1813d750 tx=0x7fbb08008040 comp rx=0 tx=0).stop 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 10 monclient: shutdown 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 msgr2=0x7fbb18095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb04002410 tx=0x7fbb040047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 shutdown_connections 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbae803dcc0 0x7fbae8040180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb180a3bb0 0x7fbb1813c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb180a0750 0x7fbb1813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:07.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 --2- 10.20.193.51:0/1870174728 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb1809e540 0x7fbb18095e50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:07.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 >> 10.20.193.51:0/1870174728 conn(0x7fbb180a30c0 msgr2=0x7fbb180996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:07.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 shutdown_connections 2026-02-17T11:50:07.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:07.155+0000 7fbb1e351640 1 -- 10.20.193.51:0/1870174728 wait complete. 2026-02-17T11:50:10.166 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:10.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.232+0000 7f0c32091640 10 monclient: get_monmap_and_config 2026-02-17T11:50:10.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.232+0000 7f0c32091640 10 monclient: build_initial_monmap 2026-02-17T11:50:10.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.232+0000 7f0c32091640 10 monclient: monmap: 2026-02-17T11:50:10.236 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:10.236 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:10.233852+0000 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:10.233852+0000 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:10.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 Processor -- start 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 -- start start 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient: init 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0c2c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-b con 0x7f0c2c13b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0c2c13dcb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c135430 con 0x7f0c2c0a3bb0 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c09af60 con 0x7f0c2c13dcb0 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:10.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c09a5c0 con 0x7f0c2c13b380 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c32091640 10 monclient(hunting): authenticate will time out at 897.852637s 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c2affd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 msgr2=0x7f0c2c13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c2affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c2b7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f0c2c0a3bb0 0x7f0c2c09cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53776/0 (socket says 10.20.193.51:53776) 2026-02-17T11:50:10.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.233+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 learned_addr learned my addr 10.20.193.51:0/2187917115 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:10.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.235+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v1:10.20.193.51:6789/0 conn(0x7f0c2c0a3bb0 legacy=0x7f0c2c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:10.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.236+0000 7f0c2bfff640 1 -- 10.20.193.51:0/2187917115 >> v1:10.20.193.142:6789/0 conn(0x7f0c2c13dcb0 legacy=0x7f0c2c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:10.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.434+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 msgr2=0x7f0c2c13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:10.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.434+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:10.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.835+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 msgr2=0x7f0c2c13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:10.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:10.835+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:50:11.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:11.636+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 msgr2=0x7f0c2c13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:11.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:11.636+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:50:13.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): tick 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 monclient(hunting): continuing hunt 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 msgr2=0x7f0c2c13d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c2c13b380 0x7f0c2c13d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 -- 10.20.193.51:0/2187917115 >> v1:10.20.193.142:6789/0 conn(0x7f0c2c13dcb0 legacy=0x7f0c2c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 -- 10.20.193.51:0/2187917115 >> v1:10.20.193.51:6789/0 conn(0x7f0c2c0a3bb0 legacy=0x7f0c2c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient: _add_conns ranks=[3,4] 2026-02-17T11:50:13.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0c08003910 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0c08006440 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 -- 10.20.193.51:0/2187917115 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c09a5c0 con 0x7f0c08003910 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 1 -- 10.20.193.51:0/2187917115 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0c08008fc0 con 0x7f0c08006440 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c297fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request con 0x7f0c08003910 auth_method 0 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 msgr2=0x7f0c08005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 msgr2=0x7f0c08005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2affd640 10 monclient(hunting): get_auth_request con 0x7f0c08006440 auth_method 0 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:13.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.233+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:13.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.234+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 msgr2=0x7f0c08008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:50:13.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.234+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 msgr2=0x7f0c08008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:13.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.234+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:13.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.234+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request con 0x7f0c08003910 auth_method 0 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 msgr2=0x7f0c08005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:13.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 msgr2=0x7f0c08005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.434+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 10 monclient(hunting): get_auth_request con 0x7f0c08006440 auth_method 0 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 msgr2=0x7f0c08008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 msgr2=0x7f0c08008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:13.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.435+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.51:3300/0 conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request con 0x7f0c08003910 auth_method 0 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:13.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_done global_id 74154 payload 274 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 msgr2=0x7f0c08008900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> v2:10.20.193.142:3300/0 conn(0x7f0c08006440 0x7f0c08008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.835+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c09b240 con 0x7f0c08003910 2026-02-17T11:50:13.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2b7fe640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c08003910 msgr2=0x7f0c08005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:13.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c08003910 0x7f0c08005d50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c08006410 tx=0x7f0c1802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eef0e32655ea58a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 1 -- 10.20.193.51:0/2187917115 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18035070 con 0x7f0c08003910 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: dump: 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:13.847 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:13.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 1 -- 10.20.193.51:0/2187917115 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1802fe40 con 0x7f0c08003910 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 1 -- 10.20.193.51:0/2187917115 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18039640 con 0x7f0c08003910 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c32091640 5 monclient: authenticate success, global_id 74154 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c32091640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c32091640 4 set_mon_vals no callback set 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.837+0000 7f0c2a7fc640 10 monclient: dump: 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:13.849 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 10 monclient: shutdown 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:13.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 -- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c08003910 msgr2=0x7f0c08005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c08003910 0x7f0c08005d50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c08006410 tx=0x7f0c1802f420 comp rx=0 tx=0).stop 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c2bfff640 1 -- 10.20.193.51:0/2187917115 reap_dead start 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 -- 10.20.193.51:0/2187917115 shutdown_connections 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 --2- 10.20.193.51:0/2187917115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c08003910 0x7f0c08005d50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 -- 10.20.193.51:0/2187917115 >> 10.20.193.51:0/2187917115 conn(0x7f0c2c0a30c0 msgr2=0x7f0c2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 -- 10.20.193.51:0/2187917115 shutdown_connections 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 1 -- 10.20.193.51:0/2187917115 wait complete. 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 10 monclient: build_initial_monmap 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.838+0000 7f0c32091640 10 monclient: monmap: 2026-02-17T11:50:13.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:13.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 Processor -- start 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 -- start start 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient: init 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 0x7f0c2c137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-c con 0x7f0c08003910 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-a con 0x7f0c2c137dc0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0c2c1386e0 0x7f0c2c1d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): picked mon.noname-b con 0x7f0c2c1386e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:13.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c135040 con 0x7f0c2c137dc0 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a3f90 con 0x7f0c2c1386e0 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c1351c0 con 0x7f0c08003910 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c32091640 10 monclient(hunting): authenticate will time out at 901.458467s 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 msgr2=0x7f0c2c137880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 0x7f0c2c137880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:13.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32818/0 (socket says 10.20.193.51:32818) 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 -- 10.20.193.51:0/2848347821 learned_addr learned my addr 10.20.193.51:0/2848347821 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): get_auth_request con 0x7f0c2c137dc0 auth_method 0 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient(hunting): handle_auth_done global_id 74157 payload 824 2026-02-17T11:50:13.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 -- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 msgr2=0x7f0c2c137880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 0x7f0c2c137880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 -- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0c2c1386e0 msgr2=0x7f0c2c1d5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0c2c1386e0 0x7f0c2c1d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient: _finish_hunting 0 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 monclient: found mon.noname-a 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.839+0000 7f0c2affd640 1 -- 10.20.193.51:0/2848347821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c139d10 con 0x7f0c2c137dc0 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c2affd640 1 -- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 msgr2=0x7f0c2c1381a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c2affd640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00baf0 tx=0x7f0c1c0072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:13.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c01a070 con 0x7f0c2c137dc0 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: dump: 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.857 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: _finish_auth 0 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0155f0 con 0x7f0c2c137dc0 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:13.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0159e0 con 0x7f0c2c137dc0 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c07fff640 10 monclient: dump: 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:13.859 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c29ffb640 4 set_mon_vals no callback set 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c32091640 5 monclient: authenticate success, global_id 74157 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c32091640 10 monclient: _renew_subs 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c32091640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.841+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c12bb70 con 0x7f0c2c137dc0 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 10 monclient: _renew_subs 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c13d810 con 0x7f0c2c137dc0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c09d560 con 0x7f0c2c137dc0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0c1c014070 con 0x7f0c2c137dc0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c07fff640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 0x7f0bfc0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.842+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7f0c1c052680 con 0x7f0c2c137dc0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.843+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 0x7f0bfc0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:13.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.843+0000 7f0c2b7fe640 10 monclient: get_auth_request con 0x7f0bfc03dcf0 auth_method 0 2026-02-17T11:50:13.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.845+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0c1c012070 con 0x7f0c2c137dc0 2026-02-17T11:50:13.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.845+0000 7f0c07fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:13.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.845+0000 7f0c07fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:13.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.845+0000 7f0c2b7fe640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 0x7f0bfc0401b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0c080038a0 tx=0x7f0c18010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.958+0000 7f0c32091640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.958+0000 7f0c32091640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.958+0000 7f0c32091640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.958+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0c2c139890 con 0x7f0c2c137dc0 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c07fff640 1 -- 10.20.193.51:0/2848347821 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f0c1c01ee40 con 0x7f0c2c137dc0 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c07fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:13.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c07fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:13.962 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:13.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 msgr2=0x7f0bfc0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 0x7f0bfc0401b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0c080038a0 tx=0x7f0c18010040 comp rx=0 tx=0).stop 2026-02-17T11:50:13.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 10 monclient: shutdown 2026-02-17T11:50:13.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:13.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 msgr2=0x7f0c2c1381a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.959+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00baf0 tx=0x7f0c1c0072b0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 shutdown_connections 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0bfc03dcf0 0x7f0bfc0401b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0c2c1386e0 0x7f0c2c1d5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0c2c137dc0 0x7f0c2c1381a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 --2- 10.20.193.51:0/2848347821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0c08003910 0x7f0c2c137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 >> 10.20.193.51:0/2848347821 conn(0x7f0c2c0a30c0 msgr2=0x7f0c2c09c700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 shutdown_connections 2026-02-17T11:50:13.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:13.960+0000 7f0c32091640 1 -- 10.20.193.51:0/2848347821 wait complete. 2026-02-17T11:50:13.970 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:50:13.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:50:13.971 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.035+0000 7f010c56a640 10 monclient: get_monmap_and_config 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.035+0000 7f010c56a640 10 monclient: build_initial_monmap 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.035+0000 7f010c56a640 10 monclient: monmap: 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:14.036621+0000 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:14.036621+0000 2026-02-17T11:50:14.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 Processor -- start 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 -- start start 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient: init 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:14.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f01040a3bb0 0x7f010409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-c con 0x7f01040a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f01040a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f010413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010406e140 con 0x7f010413b760 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010409f910 con 0x7f01040a0750 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f010409ccd0 con 0x7f01040a3bb0 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010c56a640 10 monclient(hunting): authenticate will time out at 901.655417s 2026-02-17T11:50:14.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010aae0640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f010413b760 0x7f010413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53778/0 (socket says 10.20.193.51:53778) 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010aae0640 1 -- 10.20.193.51:0/93974291 learned_addr learned my addr 10.20.193.51:0/93974291 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 1 --2- 10.20.193.51:0/93974291 >> v2:10.20.193.142:3300/0 conn(0x7f01040a3bb0 0x7f010409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): get_auth_request con 0x7f01040a3bb0 auth_method 0 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.036+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010aae0640 1 -- 10.20.193.51:0/93974291 >> v1:10.20.193.51:6789/0 conn(0x7f010413b760 legacy=0x7f010413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 1 -- 10.20.193.51:0/93974291 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652205682 0 0) 0x7f010406e140 con 0x7f010413b760 2026-02-17T11:50:14.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 10 monclient(hunting): _negotiate 2026-02-17T11:50:14.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f0109ade640 1 -- 10.20.193.51:0/93974291 >> v1:10.20.193.142:6789/0 conn(0x7f01040a0750 legacy=0x7f010409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 10 monclient(hunting): my global_id is 74160 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f01092dd640 1 -- 10.20.193.51:0/93974291 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00ec003620 con 0x7f010413b760 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 10 monclient(hunting): handle_auth_done global_id 64189 payload 274 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 1 -- 10.20.193.51:0/93974291 >> v1:10.20.193.142:6789/0 conn(0x7f01040a0750 legacy=0x7f010409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 1 -- 10.20.193.51:0/93974291 >> v1:10.20.193.51:6789/0 conn(0x7f010413b760 legacy=0x7f010413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 10 monclient: _finish_hunting 0 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 1 monclient: found mon.noname-c 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:14.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.038+0000 7f010a2df640 1 -- 10.20.193.51:0/93974291 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010409eec0 con 0x7f01040a3bb0 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010a2df640 1 -- 10.20.193.51:0/93974291 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01040a3bb0 msgr2=0x7f010409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010a2df640 1 --2- 10.20.193.51:0/93974291 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01040a3bb0 0x7f010409dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f40099a0 tx=0x7f00f402eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab1e97841e99726 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 1 -- 10.20.193.51:0/93974291 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f403c070 con 0x7f01040a3bb0 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: dump: 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.053 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: _finish_auth 0 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 1 -- 10.20.193.51:0/93974291 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f402fe00 con 0x7f01040a3bb0 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:14.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 1 -- 10.20.193.51:0/93974291 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4037660 con 0x7f01040a3bb0 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f01092dd640 10 monclient: dump: 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 5 monclient: authenticate success, global_id 64189 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 4 set_mon_vals no callback set 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 10 monclient: shutdown 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 1 -- 10.20.193.51:0/93974291 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01040a3bb0 msgr2=0x7f010409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.041+0000 7f010c56a640 1 --2- 10.20.193.51:0/93974291 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01040a3bb0 0x7f010409dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f40099a0 tx=0x7f00f402eee0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- 10.20.193.51:0/93974291 shutdown_connections 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 --2- 10.20.193.51:0/93974291 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01040a3bb0 0x7f010409dac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- 10.20.193.51:0/93974291 >> 10.20.193.51:0/93974291 conn(0x7f01040a30c0 msgr2=0x7f01040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- 10.20.193.51:0/93974291 shutdown_connections 2026-02-17T11:50:14.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- 10.20.193.51:0/93974291 wait complete. 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient: build_initial_monmap 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient: monmap: 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:14.057 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 Processor -- start 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- start start 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient: init 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01040a0750 0x7f01041cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-c con 0x7f01040a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-a con 0x7f01040a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f010413b760 0x7f0104130d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): picked mon.noname-b con 0x7f010413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:14.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f01040a04b0 con 0x7f01040a3bb0 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f010409c850 con 0x7f010413b760 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f010409e710 con 0x7f01040a0750 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010c56a640 10 monclient(hunting): authenticate will time out at 901.661986s 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.042+0000 7f010a2df640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01040a0750 msgr2=0x7f01041cfad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010a2df640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01040a0750 0x7f01041cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32830/0 (socket says 10.20.193.51:32830) 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 -- 10.20.193.51:0/1971162720 learned_addr learned my addr 10.20.193.51:0/1971162720 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): get_auth_request con 0x7f01040a3bb0 auth_method 0 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010aae0640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f010413b760 0x7f0104130d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010aae0640 10 monclient(hunting): get_auth_request con 0x7f010413b760 auth_method 0 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010aae0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010aae0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f010aae0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient(hunting): handle_auth_done global_id 74163 payload 824 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01040a0750 msgr2=0x7f01041cfad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01040a0750 0x7f01041cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f010413b760 msgr2=0x7f0104130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f010413b760 0x7f0104130d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient: _finish_hunting 0 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 monclient: found mon.noname-a 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.043+0000 7f0109ade640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104134cb0 con 0x7f01040a3bb0 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f0109ade640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 msgr2=0x7f01041d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f0109ade640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c730 tx=0x7f00f800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8017070 con 0x7f01040a3bb0 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: dump: 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.062 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: _finish_auth 0 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8005cd0 con 0x7f01040a3bb0 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f80072b0 con 0x7f01040a3bb0 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 5 monclient: authenticate success, global_id 74163 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f0108adc640 4 set_mon_vals no callback set 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:14.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f00eaffd640 10 monclient: dump: 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 monclient: _renew_subs 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01040a2360 con 0x7f01040a3bb0 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 monclient: _renew_subs 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041329c0 con 0x7f01040a3bb0 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 0x7f0104131260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.045+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f010409dac0 con 0x7f0104134870 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 0x7f0104131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f0109ade640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c730 tx=0x7f00f800cc00 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f00f8007450 mgrmap(e 5) 2026-02-17T11:50:14.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient: get_auth_request con 0x7f0104134870 auth_method 0 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f00f8007450 con 0x7f01040a3bb0 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 10 monclient(hunting): handle_auth_done global_id 74166 payload 824 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010a2df640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01041337f0 con 0x7f0104134870 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f00eaffd640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dcc0 0x7f00d4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010aae0640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dcc0 0x7f00d4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.046+0000 7f010aae0640 10 monclient: get_auth_request con 0x7f00d403dcc0 auth_method 0 2026-02-17T11:50:14.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f010a2df640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 msgr2=0x7f0104131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f010a2df640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 0x7f0104131260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f010409f5f0 tx=0x7f00f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f403c040 con 0x7f0104134870 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 10 monclient: dump: 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.067 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f00f4042470 con 0x7f0104134870 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 msgr2=0x7f0104131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 0x7f0104131260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f010409f5f0 tx=0x7f00f40047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 msgr2=0x7f0104131260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f00eaffd640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0104134870 0x7f0104131260 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f010409f5f0 tx=0x7f00f40047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.048+0000 7f010aae0640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dcc0 0x7f00d4040180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0104133e50 tx=0x7f0100009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010c56a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:14.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010c56a640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 0x7f01041daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010c56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0104133520 con 0x7f01041317a0 2026-02-17T11:50:14.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010a2df640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 0x7f01041daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010a2df640 10 monclient: get_auth_request con 0x7f01041317a0 auth_method 0 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010a2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010a2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.051+0000 7f010a2df640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.052+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.052+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.052+0000 7f010a2df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.052+0000 7f010a2df640 10 monclient(hunting): handle_auth_done global_id 74169 payload 824 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.052+0000 7f010a2df640 1 -- 10.20.193.51:0/1971162720 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f01040008d0 con 0x7f01041317a0 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010a2df640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 msgr2=0x7f01041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010a2df640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 0x7f01041daad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00f40099a0 tx=0x7f00f4009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f404f070 con 0x7f01041317a0 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 10 monclient: dump: 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.073 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7f00f4003460 con 0x7f01041317a0 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 msgr2=0x7f01041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 0x7f01041daad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00f40099a0 tx=0x7f00f4009290 comp rx=0 tx=0).stop 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 msgr2=0x7f01041daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01041317a0 0x7f01041daad0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00f40099a0 tx=0x7f00f4009290 comp rx=0 tx=0).stop 2026-02-17T11:50:14.074 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 42, 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 31986, 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:50:14.075 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.076 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.077 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:14.078 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:14.079 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:14.080 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.081 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.082 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.083 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.084 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:14.085 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dcc0 msgr2=0x7f00d4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dcc0 0x7f00d4040180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0104133e50 tx=0x7f0100009040 comp rx=0 tx=0).stop 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 10 monclient: shutdown 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 msgr2=0x7f01041d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c730 tx=0x7f00f800cc00 comp rx=0 tx=0).stop 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010aae0640 1 -- 10.20.193.51:0/1971162720 reap_dead start 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f00eaffd640 1 -- 10.20.193.51:0/1971162720 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (unknown 0 0 0) 0x7f00f8051c70 con 0x7f01040a3bb0 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 shutdown_connections 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 --2- 10.20.193.51:0/1971162720 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01040a3bb0 0x7f01041d0010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 >> 10.20.193.51:0/1971162720 conn(0x7f01040a30c0 msgr2=0x7f010413a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 shutdown_connections 2026-02-17T11:50:14.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.054+0000 7f010c56a640 1 -- 10.20.193.51:0/1971162720 wait complete. 2026-02-17T11:50:14.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:50:14.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:50:14.088 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:50:14.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 10 monclient: get_monmap_and_config 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 10 monclient: build_initial_monmap 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 10 monclient: monmap: 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:14.155295+0000 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:14.155295+0000 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:14.156 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 1 Processor -- start 2026-02-17T11:50:14.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 1 -- start start 2026-02-17T11:50:14.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 10 monclient: init 2026-02-17T11:50:14.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.154+0000 7efc3ef61640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efc380a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7efc380a0750 0x7efc3809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-c con 0x7efc380a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efc3813b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3806e140 con 0x7efc3813b760 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3809f910 con 0x7efc380a3bb0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7efc3809ccd0 con 0x7efc380a0750 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3ef61640 10 monclient(hunting): authenticate will time out at 901.774072s 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3d4d7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7efc3813b760 0x7efc3813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53792/0 (socket says 10.20.193.51:53792) 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc3d4d7640 1 -- 10.20.193.51:0/2474802463 learned_addr learned my addr 10.20.193.51:0/2474802463 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 1 --2- 10.20.193.51:0/2474802463 >> v2:10.20.193.142:3300/0 conn(0x7efc380a0750 0x7efc3809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): get_auth_request con 0x7efc380a0750 auth_method 0 2026-02-17T11:50:14.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient(hunting): handle_auth_done global_id 64198 payload 274 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 1 -- 10.20.193.51:0/2474802463 >> v1:10.20.193.142:6789/0 conn(0x7efc380a3bb0 legacy=0x7efc3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 1 -- 10.20.193.51:0/2474802463 >> v1:10.20.193.51:6789/0 conn(0x7efc3813b760 legacy=0x7efc3813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 1 monclient: found mon.noname-c 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:14.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.155+0000 7efc2ffff640 1 -- 10.20.193.51:0/2474802463 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3809eec0 con 0x7efc380a0750 2026-02-17T11:50:14.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2ffff640 1 -- 10.20.193.51:0/2474802463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a0750 msgr2=0x7efc3809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2ffff640 1 --2- 10.20.193.51:0/2474802463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a0750 0x7efc3809e1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc200098a0 tx=0x7efc2002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b87c393ee54a944 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2f7fe640 1 -- 10.20.193.51:0/2474802463 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2003c070 con 0x7efc380a0750 2026-02-17T11:50:14.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:14.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.159+0000 7efc2f7fe640 10 monclient: dump: 2026-02-17T11:50:14.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:14.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 1 -- 10.20.193.51:0/2474802463 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2002fce0 con 0x7efc380a0750 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 1 -- 10.20.193.51:0/2474802463 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20037660 con 0x7efc380a0750 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc2f7fe640 10 monclient: dump: 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.169 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 5 monclient: authenticate success, global_id 64198 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 4 set_mon_vals no callback set 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 10 monclient: shutdown 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 -- 10.20.193.51:0/2474802463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a0750 msgr2=0x7efc3809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 --2- 10.20.193.51:0/2474802463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a0750 0x7efc3809e1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc200098a0 tx=0x7efc2002ed80 comp rx=0 tx=0).stop 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 -- 10.20.193.51:0/2474802463 shutdown_connections 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 --2- 10.20.193.51:0/2474802463 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a0750 0x7efc3809e1d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 -- 10.20.193.51:0/2474802463 >> 10.20.193.51:0/2474802463 conn(0x7efc380a30c0 msgr2=0x7efc380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 -- 10.20.193.51:0/2474802463 shutdown_connections 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 -- 10.20.193.51:0/2474802463 wait complete. 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 10 monclient: build_initial_monmap 2026-02-17T11:50:14.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 10 monclient: monmap: 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.160+0000 7efc3ef61640 1 Processor -- start 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 -- start start 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient: init 2026-02-17T11:50:14.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efc380a0750 0x7efc381cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-c con 0x7efc380a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a3bb0 0x7efc3809a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-b con 0x7efc380a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 0x7efc3809ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): picked mon.noname-a con 0x7efc3813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7efc380a04b0 con 0x7efc3813b760 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc3809c850 con 0x7efc380a3bb0 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7efc3809e710 con 0x7efc380a0750 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ef61640 10 monclient(hunting): authenticate will time out at 901.780291s 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ccd6640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efc380a0750 msgr2=0x7efc381cfe20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3ccd6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efc380a0750 0x7efc381cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 0x7efc3809ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 0x7efc3809ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32848/0 (socket says 10.20.193.51:32848) 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 learned_addr learned my addr 10.20.193.51:0/718315345 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): get_auth_request con 0x7efc3813b760 auth_method 0 2026-02-17T11:50:14.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient(hunting): handle_auth_done global_id 74172 payload 824 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc2ffff640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a3bb0 0x7efc3809a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efc380a0750 msgr2=0x7efc381cfe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efc380a0750 0x7efc381cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a3bb0 msgr2=0x7efc3809a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a3bb0 0x7efc3809a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient: _finish_hunting 0 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 monclient: found mon.noname-a 2026-02-17T11:50:14.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3806f6c0 con 0x7efc3813b760 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc2ffff640 10 monclient: get_auth_request con 0x7efc380a3bb0 auth_method 0 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.161+0000 7efc2ffff640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc380a3bb0 0x7efc3809a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 msgr2=0x7efc3809ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3d4d7640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 0x7efc3809ab00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3400caf0 tx=0x7efc34005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34017070 con 0x7efc3813b760 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: dump: 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.175 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3400adf0 con 0x7efc3813b760 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 5 monclient: authenticate success, global_id 74172 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34012640 con 0x7efc3813b760 2026-02-17T11:50:14.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2effd640 4 set_mon_vals no callback set 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc2d7fa640 10 monclient: dump: 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 10 monclient: _renew_subs 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc380a28c0 con 0x7efc3813b760 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 10 monclient: _renew_subs 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.163+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc38133e60 con 0x7efc3813b760 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ef61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ef61640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 0x7efc3809b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc3809dac0 con 0x7efc381d0360 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7efc3401b3b0 con 0x7efc3813b760 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 0x7efc3809b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient: get_auth_request con 0x7efc381d0360 auth_method 0 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc2d7fa640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efc0803dcc0 0x7efc08040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(167..167 src has 47..167) ==== 4811+0+0 (secure 0 0 0) 0x7efc340525f0 con 0x7efc3813b760 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.164+0000 7efc2ffff640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efc0803dcc0 0x7efc08040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.165+0000 7efc2ffff640 10 monclient: get_auth_request con 0x7efc0803dcc0 auth_method 0 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.165+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_done global_id 64201 payload 824 2026-02-17T11:50:14.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.165+0000 7efc3ccd6640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc381335c0 con 0x7efc381d0360 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc3ccd6640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 msgr2=0x7efc3809b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc3ccd6640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 0x7efc3809b040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc2800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2ffff640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efc0803dcc0 0x7efc08040180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc20036000 tx=0x7efc20033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28017070 con 0x7efc381d0360 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 10 monclient: dump: 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7efc28007070 con 0x7efc381d0360 2026-02-17T11:50:14.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 msgr2=0x7efc3809b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 0x7efc3809b040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc2800c900 comp rx=0 tx=0).stop 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 msgr2=0x7efc3809b040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.167+0000 7efc2d7fa640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc381d0360 0x7efc3809b040 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc2800c900 comp rx=0 tx=0).stop 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.170+0000 7efc3ef61640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.170+0000 7efc3ef61640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 0x7efc381daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.170+0000 7efc3ef61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.170+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc3809b990 con 0x7efc3809b580 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 0x7efc381daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient: get_auth_request con 0x7efc3809b580 auth_method 0 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:14.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 10 monclient(hunting): handle_auth_done global_id 64204 payload 824 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.171+0000 7efc3ccd6640 1 -- 10.20.193.51:0/718315345 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efc3809c0a0 con 0x7efc3809b580 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc3ccd6640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 msgr2=0x7efc381daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc3ccd6640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 0x7efc381daad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc280038e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28017030 con 0x7efc3809b580 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc2d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.173+0000 7efc2d7fa640 10 monclient: dump: 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:14.185 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4863 (secure 0 0 0) 0x7efc28022450 con 0x7efc3809b580 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 msgr2=0x7efc381daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 0x7efc381daad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c430 tx=0x7efc280038e0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 msgr2=0x7efc381daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc2d7fa640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efc3809b580 0x7efc381daad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 42, 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 85720, 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:14.187 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.188 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.189 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:14.190 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:14.191 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.192 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.193 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.194 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.195 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.196 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:14.197 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:14.198 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:14.198 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efc0803dcc0 msgr2=0x7efc08040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efc0803dcc0 0x7efc08040180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc20036000 tx=0x7efc20033000 comp rx=0 tx=0).stop 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 10 monclient: shutdown 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 msgr2=0x7efc3809ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 --2- 10.20.193.51:0/718315345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efc3813b760 0x7efc3809ab00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3400caf0 tx=0x7efc34005c50 comp rx=0 tx=0).stop 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 reap_dead start 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3d4d7640 1 -- 10.20.193.51:0/718315345 reap_dead start 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 shutdown_connections 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 >> 10.20.193.51:0/718315345 conn(0x7efc380a30c0 msgr2=0x7efc38072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 shutdown_connections 2026-02-17T11:50:14.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:14.174+0000 7efc3ef61640 1 -- 10.20.193.51:0/718315345 wait complete. 2026-02-17T11:50:14.200 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:50:14.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:50:14.765 INFO:tasks.rados.rados.0.trial142.stdout:617: done (3 left) 2026-02-17T11:50:14.765 INFO:tasks.rados.rados.0.trial142.stdout:618: write oid 4 current snap is 74 2026-02-17T11:50:14.765 INFO:tasks.rados.rados.0.trial142.stdout:612: finishing rollback tid 2 to trial14245205-47 2026-02-17T11:50:14.766 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 283 (ObjNum 195 snap 56 seq_num 195) dirty exists 2026-02-17T11:50:14.766 INFO:tasks.rados.rados.0.trial142.stdout:618: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2026-02-17T11:50:14.770 INFO:tasks.rados.rados.0.trial142.stdout:618: writing trial14245205-4 from 699224 to 1247582 tid 1 2026-02-17T11:50:14.774 INFO:tasks.rados.rados.0.trial142.stdout:618: writing trial14245205-4 from 2026293 to 2488367 tid 2 2026-02-17T11:50:14.779 INFO:tasks.rados.rados.0.trial142.stdout:618: writing trial14245205-4 from 3271546 to 3704300 tid 3 2026-02-17T11:50:14.780 INFO:tasks.rados.rados.0.trial142.stdout:612: done (3 left) 2026-02-17T11:50:14.780 INFO:tasks.rados.rados.0.trial142.stdout:619: write oid 39 current snap is 74 2026-02-17T11:50:14.780 INFO:tasks.rados.rados.0.trial142.stdout:619: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2026-02-17T11:50:14.785 INFO:tasks.rados.rados.0.trial142.stdout:619: writing trial14245205-39 from 716031 to 1339638 tid 1 2026-02-17T11:50:14.790 INFO:tasks.rados.rados.0.trial142.stdout:619: writing trial14245205-39 from 2084775 to 2690507 tid 2 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:619: writing trial14245205-39 from 3298969 to 3916031 tid 3 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:620: snap_remove snap 47 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:614: finishing write tid 1 to trial14245205-48 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:614: finishing write tid 2 to trial14245205-48 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:614: finishing write tid 3 to trial14245205-48 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:614: finishing write tid 4 to trial14245205-48 2026-02-17T11:50:14.795 INFO:tasks.rados.rados.0.trial142.stdout:614: finishing write tid 5 to trial14245205-48 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:614: oid 48 updating version 0 to 240 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:614: oid 48 version 240 is already newer than 237 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:614: oid 48 version 240 is already newer than 238 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:614: oid 48 version 240 is already newer than 239 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 240 (ObjNum 230 snap 74 seq_num 230) dirty exists 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:614: left oid 48 (ObjNum 230 snap 74 seq_num 230) 2026-02-17T11:50:14.796 INFO:tasks.rados.rados.0.trial142.stdout:615: finishing write tid 1 to trial14245205-19 2026-02-17T11:50:15.770 INFO:tasks.rados.rados.0.trial142.stdout:614: done (4 left) 2026-02-17T11:50:15.770 INFO:tasks.rados.rados.0.trial142.stdout:620: done (3 left) 2026-02-17T11:50:15.770 INFO:tasks.rados.rados.0.trial142.stdout:621: write (excl) oid 33 current snap is 74 2026-02-17T11:50:15.770 INFO:tasks.rados.rados.0.trial142.stdout:621: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2026-02-17T11:50:15.776 INFO:tasks.rados.rados.0.trial142.stdout:621: writing trial14245205-33 from 732838 to 1431694 tid 1 2026-02-17T11:50:15.780 INFO:tasks.rados.rados.0.trial142.stdout:621: writing trial14245205-33 from 2026904 to 2492647 tid 2 2026-02-17T11:50:15.787 INFO:tasks.rados.rados.0.trial142.stdout:621: writing trial14245205-33 from 3210039 to 3781690 tid 3 2026-02-17T11:50:15.787 INFO:tasks.rados.rados.0.trial142.stdout:622: rollback oid 27 current snap is 74 2026-02-17T11:50:15.787 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 69 2026-02-17T11:50:15.787 INFO:tasks.rados.rados.0.trial142.stdout:615: finishing write tid 2 to trial14245205-19 2026-02-17T11:50:15.787 INFO:tasks.rados.rados.0.trial142.stdout:615: finishing write tid 3 to trial14245205-19 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: finishing write tid 4 to trial14245205-19 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: finishing write tid 5 to trial14245205-19 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: oid 19 updating version 0 to 288 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: oid 19 version 288 is already newer than 285 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: oid 19 version 288 is already newer than 286 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: oid 19 version 288 is already newer than 287 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 288 (ObjNum 231 snap 74 seq_num 231) dirty exists 2026-02-17T11:50:15.788 INFO:tasks.rados.rados.0.trial142.stdout:615: left oid 19 (ObjNum 231 snap 74 seq_num 231) 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: finishing write tid 1 to trial14245205-4 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: finishing write tid 2 to trial14245205-4 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: finishing write tid 3 to trial14245205-4 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:615: done (4 left) 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:623: rollback oid 9 current snap is 74 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 71 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: finishing write tid 4 to trial14245205-4 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: finishing write tid 5 to trial14245205-4 2026-02-17T11:50:15.789 INFO:tasks.rados.rados.0.trial142.stdout:618: oid 4 updating version 0 to 517 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:618: oid 4 updating version 517 to 518 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:618: oid 4 version 518 is already newer than 516 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:618: oid 4 updating version 518 to 519 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 519 (ObjNum 232 snap 74 seq_num 232) dirty exists 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:618: left oid 4 (ObjNum 232 snap 74 seq_num 232) 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:619: finishing write tid 1 to trial14245205-39 2026-02-17T11:50:15.790 INFO:tasks.rados.rados.0.trial142.stdout:619: finishing write tid 2 to trial14245205-39 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: finishing write tid 3 to trial14245205-39 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: finishing write tid 4 to trial14245205-39 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: finishing write tid 5 to trial14245205-39 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: oid 39 updating version 0 to 220 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: oid 39 version 220 is already newer than 219 2026-02-17T11:50:15.791 INFO:tasks.rados.rados.0.trial142.stdout:619: oid 39 updating version 220 to 221 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:619: oid 39 version 221 is already newer than 218 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 221 (ObjNum 233 snap 74 seq_num 233) dirty exists 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:619: left oid 39 (ObjNum 233 snap 74 seq_num 233) 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:621: finishing write tid 1 to trial14245205-33 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:618: done (4 left) 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:619: done (3 left) 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:624: write (excl) oid 24 current snap is 74 2026-02-17T11:50:15.792 INFO:tasks.rados.rados.0.trial142.stdout:624: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-17T11:50:15.793 INFO:tasks.rados.rados.0.trial142.stdout:624: writing trial14245205-24 from 749645 to 1523750 tid 1 2026-02-17T11:50:15.795 INFO:tasks.rados.rados.0.trial142.stdout:624: writing trial14245205-24 from 2085386 to 2694787 tid 2 2026-02-17T11:50:15.800 INFO:tasks.rados.rados.0.trial142.stdout:624: writing trial14245205-24 from 3237462 to 3949645 tid 3 2026-02-17T11:50:15.800 INFO:tasks.rados.rados.0.trial142.stdout:625: snap_remove snap 67 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:625: done (4 left) 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:626: delete oid 10 current snap is 74 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:621: finishing write tid 2 to trial14245205-33 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:623: finishing rollback tid 0 to trial14245205-9 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:623: finishing rollback tid 1 to trial14245205-9 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:623: finishing rollback tid 2 to trial14245205-9 2026-02-17T11:50:16.774 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 535 (ObjNum 164 snap 49 seq_num 164) dirty exists 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: finishing write tid 3 to trial14245205-33 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: finishing write tid 4 to trial14245205-33 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: finishing write tid 5 to trial14245205-33 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: oid 33 updating version 0 to 431 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: oid 33 updating version 431 to 432 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: oid 33 version 432 is already newer than 430 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: oid 33 version 432 is already newer than 429 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 432 (ObjNum 234 snap 74 seq_num 234) dirty exists 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:621: left oid 33 (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:622: finishing rollback tid 0 to trial14245205-27 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:622: finishing rollback tid 1 to trial14245205-27 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:622: finishing rollback tid 2 to trial14245205-27 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 436 (ObjNum 216 snap 69 seq_num 216) dirty exists 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:624: finishing write tid 1 to trial14245205-24 2026-02-17T11:50:16.775 INFO:tasks.rados.rados.0.trial142.stdout:624: finishing write tid 2 to trial14245205-24 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: finishing write tid 3 to trial14245205-24 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: finishing write tid 4 to trial14245205-24 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: finishing write tid 5 to trial14245205-24 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: oid 24 updating version 0 to 223 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: oid 24 updating version 223 to 225 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: oid 24 version 225 is already newer than 224 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: oid 24 version 225 is already newer than 222 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 225 (ObjNum 235 snap 74 seq_num 235) dirty exists 2026-02-17T11:50:16.776 INFO:tasks.rados.rados.0.trial142.stdout:624: left oid 24 (ObjNum 235 snap 74 seq_num 235) 2026-02-17T11:50:16.777 INFO:tasks.rados.rados.0.trial142.stdout:621: done (4 left) 2026-02-17T11:50:16.777 INFO:tasks.rados.rados.0.trial142.stdout:622: done (3 left) 2026-02-17T11:50:16.777 INFO:tasks.rados.rados.0.trial142.stdout:623: done (2 left) 2026-02-17T11:50:16.777 INFO:tasks.rados.rados.0.trial142.stdout:624: done (1 left) 2026-02-17T11:50:16.777 INFO:tasks.rados.rados.0.trial142.stdout:626: done (0 left) 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:627: copy_from oid 39 from oid 31 current snap is 74 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:628: rollback oid 32 current snap is 74 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 70 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:629: read oid 36 snap -1 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:629: expect (ObjNum 197 snap 58 seq_num 197) 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:630: delete oid 10 current snap is 74 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:630: done (3 left) 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:631: write oid 38 current snap is 74 2026-02-17T11:50:16.778 INFO:tasks.rados.rados.0.trial142.stdout:631: seq_num 238 ranges {400066=716205,1860832=139234} 2026-02-17T11:50:16.780 INFO:tasks.rados.rados.0.trial142.stdout:631: writing trial14245205-38 from 400066 to 1116271 tid 1 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:631: writing trial14245205-38 from 1860832 to 2000066 tid 2 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:632: snap_create 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:628: finishing rollback tid 0 to trial14245205-32 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:628: finishing rollback tid 1 to trial14245205-32 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 248 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:50:16.784 INFO:tasks.rados.rados.0.trial142.stdout:629: expect (ObjNum 197 snap 58 seq_num 197) 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:627: finishing copy_from racing read to trial14245205-39 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:627: finishing copy_from to trial14245205-39 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 334 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:631: finishing write tid 1 to trial14245205-38 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:631: finishing write tid 2 to trial14245205-38 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:631: finishing write tid 3 to trial14245205-38 2026-02-17T11:50:16.915 INFO:tasks.rados.rados.0.trial142.stdout:631: finishing write tid 4 to trial14245205-38 2026-02-17T11:50:16.916 INFO:tasks.rados.rados.0.trial142.stdout:631: oid 38 updating version 0 to 58 2026-02-17T11:50:16.916 INFO:tasks.rados.rados.0.trial142.stdout:631: oid 38 updating version 58 to 60 2026-02-17T11:50:16.916 INFO:tasks.rados.rados.0.trial142.stdout:631: oid 38 version 60 is already newer than 59 2026-02-17T11:50:16.916 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 60 (ObjNum 238 snap 74 seq_num 238) dirty exists 2026-02-17T11:50:16.916 INFO:tasks.rados.rados.0.trial142.stdout:631: left oid 38 (ObjNum 238 snap 74 seq_num 238) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:627: done (4 left) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:628: done (3 left) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:629: done (2 left) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:631: done (1 left) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:632: done (0 left) 2026-02-17T11:50:17.076 INFO:tasks.rados.rados.0.trial142.stdout:633: delete oid 12 current snap is 75 2026-02-17T11:50:17.079 INFO:tasks.rados.rados.0.trial142.stdout:633: done (0 left) 2026-02-17T11:50:17.079 INFO:tasks.rados.rados.0.trial142.stdout:634: write (excl) oid 4 current snap is 75 2026-02-17T11:50:17.079 INFO:tasks.rados.rados.0.trial142.stdout:634: seq_num 240 ranges {433680=466703,1577796=455884} 2026-02-17T11:50:17.082 INFO:tasks.rados.rados.0.trial142.stdout:634: writing trial14245205-4 from 433680 to 900383 tid 1 2026-02-17T11:50:17.087 INFO:tasks.rados.rados.0.trial142.stdout:634: writing trial14245205-4 from 1577796 to 2033680 tid 2 2026-02-17T11:50:17.087 INFO:tasks.rados.rados.0.trial142.stdout:634: finishing write tid 1 to trial14245205-4 2026-02-17T11:50:17.087 INFO:tasks.rados.rados.0.trial142.stdout:635: read oid 40 snap -1 2026-02-17T11:50:17.087 INFO:tasks.rados.rados.0.trial142.stdout:635: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:17.087 INFO:tasks.rados.rados.0.trial142.stdout:636: snap_remove snap 72 2026-02-17T11:50:18.293 INFO:tasks.rados.rados.0.trial142.stdout:636: done (2 left) 2026-02-17T11:50:18.293 INFO:tasks.rados.rados.0.trial142.stdout:637: rollback oid 25 current snap is 75 2026-02-17T11:50:18.293 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 25 to 69 2026-02-17T11:50:18.293 INFO:tasks.rados.rados.0.trial142.stdout:635: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:18.347 INFO:tasks.rados.rados.0.trial142.stdout:634: finishing write tid 2 to trial14245205-4 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: finishing write tid 3 to trial14245205-4 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: finishing write tid 4 to trial14245205-4 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: oid 4 updating version 0 to 547 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: oid 4 version 547 is already newer than 546 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: oid 4 version 547 is already newer than 545 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 547 (ObjNum 240 snap 75 seq_num 240) dirty exists 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: left oid 4 (ObjNum 240 snap 75 seq_num 240) 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:637: finishing rollback tid 0 to trial14245205-25 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:637: finishing rollback tid 1 to trial14245205-25 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:637: finishing rollback tid 2 to trial14245205-25 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 179 (ObjNum 207 snap 66 seq_num 207) dirty exists 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:634: done (2 left) 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:635: done (1 left) 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:637: done (0 left) 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:638: rollback oid 19 current snap is 75 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 66 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:639: read oid 33 snap -1 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:639: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:50:18.348 INFO:tasks.rados.rados.0.trial142.stdout:640: snap_create 2026-02-17T11:50:18.349 INFO:tasks.rados.rados.0.trial142.stdout:638: finishing rollback tid 0 to trial14245205-19 2026-02-17T11:50:18.349 INFO:tasks.rados.rados.0.trial142.stdout:638: finishing rollback tid 1 to trial14245205-19 2026-02-17T11:50:18.349 INFO:tasks.rados.rados.0.trial142.stdout:638: finishing rollback tid 2 to trial14245205-19 2026-02-17T11:50:18.349 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 322 (ObjNum 141 snap 38 seq_num 141) dirty exists 2026-02-17T11:50:18.356 INFO:tasks.rados.rados.0.trial142.stdout:639: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:50:19.296 INFO:tasks.rados.rados.0.trial142.stdout:638: done (2 left) 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:639: done (1 left) 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:640: done (0 left) 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:641: rollback oid 15 current snap is 76 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 63 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:642: write oid 22 current snap is 76 2026-02-17T11:50:19.297 INFO:tasks.rados.rados.0.trial142.stdout:642: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-17T11:50:19.300 INFO:tasks.rados.rados.0.trial142.stdout:642: writing trial14245205-22 from 450487 to 992439 tid 1 2026-02-17T11:50:19.304 INFO:tasks.rados.rados.0.trial142.stdout:642: writing trial14245205-22 from 1636278 to 2050487 tid 2 2026-02-17T11:50:19.304 INFO:tasks.rados.rados.0.trial142.stdout:643: rollback oid 49 current snap is 76 2026-02-17T11:50:19.304 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 74 2026-02-17T11:50:19.304 INFO:tasks.rados.rados.0.trial142.stdout:641: finishing rollback tid 0 to trial14245205-15 2026-02-17T11:50:19.304 INFO:tasks.rados.rados.0.trial142.stdout:641: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:50:19.305 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 445 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:50:19.305 INFO:tasks.rados.rados.0.trial142.stdout:642: finishing write tid 1 to trial14245205-22 2026-02-17T11:50:19.305 INFO:tasks.rados.rados.0.trial142.stdout:641: done (2 left) 2026-02-17T11:50:19.305 INFO:tasks.rados.rados.0.trial142.stdout:644: snap_create 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:642: finishing write tid 2 to trial14245205-22 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:642: finishing write tid 3 to trial14245205-22 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:643: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:642: finishing write tid 4 to trial14245205-22 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:642: oid 22 updating version 0 to 168 2026-02-17T11:50:19.306 INFO:tasks.rados.rados.0.trial142.stdout:642: oid 22 version 168 is already newer than 167 2026-02-17T11:50:19.307 INFO:tasks.rados.rados.0.trial142.stdout:642: oid 22 version 168 is already newer than 166 2026-02-17T11:50:19.307 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 168 (ObjNum 241 snap 76 seq_num 241) dirty exists 2026-02-17T11:50:19.307 INFO:tasks.rados.rados.0.trial142.stdout:642: left oid 22 (ObjNum 241 snap 76 seq_num 241) 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:642: done (2 left) 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:643: done (1 left) 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:644: done (0 left) 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:645: read oid 29 snap 69 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:645: expect deleted 2026-02-17T11:50:20.298 INFO:tasks.rados.rados.0.trial142.stdout:646: snap_remove snap 76 2026-02-17T11:50:21.299 INFO:tasks.rados.rados.0.trial142.stdout:646: done (1 left) 2026-02-17T11:50:21.299 INFO:tasks.rados.rados.0.trial142.stdout:647: snap_remove snap 63 2026-02-17T11:50:22.299 INFO:tasks.rados.rados.0.trial142.stdout:647: done (1 left) 2026-02-17T11:50:22.300 INFO:tasks.rados.rados.0.trial142.stdout:648: read oid 22 snap 71 2026-02-17T11:50:22.300 INFO:tasks.rados.rados.0.trial142.stdout:648: expect deleted 2026-02-17T11:50:22.300 INFO:tasks.rados.rados.0.trial142.stdout:649: read oid 40 snap 65 2026-02-17T11:50:22.300 INFO:tasks.rados.rados.0.trial142.stdout:649: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:22.300 INFO:tasks.rados.rados.0.trial142.stdout:650: snap_create 2026-02-17T11:50:22.303 INFO:tasks.rados.rados.0.trial142.stdout:649: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:645: done (3 left) 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:648: done (2 left) 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:649: done (1 left) 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:650: done (0 left) 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:651: read oid 15 snap -1 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:651: expect deleted 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:652: write (excl) oid 28 current snap is 78 2026-02-17T11:50:23.084 INFO:tasks.rados.rados.0.trial142.stdout:652: seq_num 242 ranges {467294=617201,1578407=488887} 2026-02-17T11:50:23.089 INFO:tasks.rados.rados.0.trial142.stdout:652: writing trial14245205-28 from 467294 to 1084495 tid 1 2026-02-17T11:50:23.092 INFO:tasks.rados.rados.0.trial142.stdout:652: writing trial14245205-28 from 1578407 to 2067294 tid 2 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:653: read oid 31 snap -1 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:653: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:654: read oid 29 snap -1 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:654: expect deleted 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:655: rollback oid 14 current snap is 78 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 75 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:651: done (4 left) 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:656: delete oid 9 current snap is 78 2026-02-17T11:50:23.093 INFO:tasks.rados.rados.0.trial142.stdout:652: finishing write tid 1 to trial14245205-28 2026-02-17T11:50:23.094 INFO:tasks.rados.rados.0.trial142.stdout:655: finishing rollback tid 1 to trial14245205-14 2026-02-17T11:50:23.094 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:654: done (4 left) 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:655: done (3 left) 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:656: done (2 left) 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:657: read oid 1 snap -1 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:657: expect (ObjNum 177 snap 51 seq_num 177) 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:658: read oid 39 snap -1 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:658: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:659: snap_create 2026-02-17T11:50:23.095 INFO:tasks.rados.rados.0.trial142.stdout:652: finishing write tid 2 to trial14245205-28 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: finishing write tid 3 to trial14245205-28 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: finishing write tid 4 to trial14245205-28 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: oid 28 updating version 0 to 233 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: oid 28 version 233 is already newer than 232 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: oid 28 version 233 is already newer than 231 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 233 (ObjNum 242 snap 78 seq_num 242) dirty exists 2026-02-17T11:50:23.096 INFO:tasks.rados.rados.0.trial142.stdout:652: left oid 28 (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:50:23.100 INFO:tasks.rados.rados.0.trial142.stdout:658: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:23.153 INFO:tasks.rados.rados.0.trial142.stdout:657: expect (ObjNum 177 snap 51 seq_num 177) 2026-02-17T11:50:23.308 INFO:tasks.rados.rados.0.trial142.stdout:653: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:652: done (4 left) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:653: done (3 left) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:657: done (2 left) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:658: done (1 left) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:659: done (0 left) 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:660: write oid 40 current snap is 79 2026-02-17T11:50:24.078 INFO:tasks.rados.rados.0.trial142.stdout:660: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-17T11:50:24.081 INFO:tasks.rados.rados.0.trial142.stdout:660: writing trial14245205-40 from 500908 to 984960 tid 1 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:660: writing trial14245205-40 from 1411724 to 2100908 tid 2 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:661: rollback oid 17 current snap is 79 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 71 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:660: finishing write tid 1 to trial14245205-40 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:662: copy_from oid 16 from oid 4 current snap is 79 2026-02-17T11:50:24.086 INFO:tasks.rados.rados.0.trial142.stdout:663: snap_remove snap 77 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:663: done (3 left) 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:664: copy_from oid 24 from oid 28 current snap is 79 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:661: finishing rollback tid 0 to trial14245205-17 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:661: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: finishing write tid 2 to trial14245205-40 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:661: finishing rollback tid 2 to trial14245205-17 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 260 (ObjNum 190 snap 54 seq_num 190) dirty exists 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: finishing write tid 3 to trial14245205-40 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: finishing write tid 4 to trial14245205-40 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: oid 40 updating version 0 to 153 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: oid 40 version 153 is already newer than 152 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: oid 40 version 153 is already newer than 151 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 153 (ObjNum 244 snap 79 seq_num 244) dirty exists 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: left oid 40 (ObjNum 244 snap 79 seq_num 244) 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:662: finishing copy_from racing read to trial14245205-16 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:662: finishing copy_from to trial14245205-16 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 547 (ObjNum 240 snap 75 seq_num 240) dirty exists 2026-02-17T11:50:25.081 INFO:tasks.rados.rados.0.trial142.stdout:660: done (3 left) 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:661: done (2 left) 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:662: done (1 left) 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:665: copy_from oid 19 from oid 39 current snap is 79 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:666: copy_from oid 30 from oid 45 current snap is 79 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:667: write (excl) oid 31 current snap is 79 2026-02-17T11:50:25.082 INFO:tasks.rados.rados.0.trial142.stdout:667: seq_num 245 ranges {517715=559301,1870206=247509} 2026-02-17T11:50:25.084 INFO:tasks.rados.rados.0.trial142.stdout:667: writing trial14245205-31 from 517715 to 1077016 tid 1 2026-02-17T11:50:25.088 INFO:tasks.rados.rados.0.trial142.stdout:667: writing trial14245205-31 from 1870206 to 2117715 tid 2 2026-02-17T11:50:25.088 INFO:tasks.rados.rados.0.trial142.stdout:668: delete oid 38 current snap is 79 2026-02-17T11:50:25.089 INFO:tasks.rados.rados.0.trial142.stdout:665: finishing copy_from racing read to trial14245205-19 2026-02-17T11:50:25.089 INFO:tasks.rados.rados.0.trial142.stdout:665: finishing copy_from to trial14245205-19 2026-02-17T11:50:25.089 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 334 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T11:50:25.089 INFO:tasks.rados.rados.0.trial142.stdout:667: finishing write tid 1 to trial14245205-31 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:665: done (4 left) 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:668: done (3 left) 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:669: read oid 13 snap -1 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:669: expect (ObjNum 211 snap 68 seq_num 211) 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:670: rollback oid 19 current snap is 79 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 74 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:671: read oid 10 snap -1 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:671: expect deleted 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:672: write (excl) oid 22 current snap is 79 2026-02-17T11:50:25.090 INFO:tasks.rados.rados.0.trial142.stdout:672: seq_num 247 ranges {551329=709799,1870817=280512} 2026-02-17T11:50:25.094 INFO:tasks.rados.rados.0.trial142.stdout:672: writing trial14245205-22 from 551329 to 1261128 tid 1 2026-02-17T11:50:25.099 INFO:tasks.rados.rados.0.trial142.stdout:672: writing trial14245205-22 from 1870817 to 2151329 tid 2 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:673: read oid 25 snap 78 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:673: expect (ObjNum 207 snap 66 seq_num 207) 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:674: write (excl) oid 17 current snap is 79 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:666: finishing copy_from racing read to trial14245205-30 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:670: finishing rollback tid 0 to trial14245205-19 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:670: finishing rollback tid 1 to trial14245205-19 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:666: finishing copy_from to trial14245205-30 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 431 (ObjNum 213 snap 69 seq_num 213) dirty exists 2026-02-17T11:50:25.100 INFO:tasks.rados.rados.0.trial142.stdout:670: finishing rollback tid 2 to trial14245205-19 2026-02-17T11:50:25.101 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 337 (ObjNum 231 snap 74 seq_num 231) dirty exists 2026-02-17T11:50:25.101 INFO:tasks.rados.rados.0.trial142.stdout:664: finishing copy_from racing read to trial14245205-24 2026-02-17T11:50:25.101 INFO:tasks.rados.rados.0.trial142.stdout:674: seq_num 248 ranges {568136=785048,1929299=238837} 2026-02-17T11:50:25.103 INFO:tasks.rados.rados.0.trial142.stdout:674: writing trial14245205-17 from 568136 to 1353184 tid 1 2026-02-17T11:50:25.106 INFO:tasks.rados.rados.0.trial142.stdout:674: writing trial14245205-17 from 1929299 to 2168136 tid 2 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:666: done (8 left) 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:670: done (7 left) 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:671: done (6 left) 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:675: read oid 48 snap -1 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:675: expect (ObjNum 230 snap 74 seq_num 230) 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:676: write oid 5 current snap is 79 2026-02-17T11:50:25.107 INFO:tasks.rados.rados.0.trial142.stdout:676: seq_num 249 ranges {584943=460297,1587781=597162} 2026-02-17T11:50:25.110 INFO:tasks.rados.rados.0.trial142.stdout:676: writing trial14245205-5 from 584943 to 1045240 tid 1 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:676: writing trial14245205-5 from 1587781 to 2184943 tid 2 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:677: read oid 27 snap 74 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:677: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:678: delete oid 38 current snap is 79 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:664: finishing copy_from to trial14245205-24 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 233 (ObjNum 242 snap 78 seq_num 242) dirty exists 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:667: finishing write tid 2 to trial14245205-31 2026-02-17T11:50:25.115 INFO:tasks.rados.rados.0.trial142.stdout:667: finishing write tid 3 to trial14245205-31 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:667: finishing write tid 4 to trial14245205-31 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:667: oid 31 updating version 0 to 450 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:667: oid 31 updating version 450 to 451 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:667: oid 31 version 451 is already newer than 449 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 451 (ObjNum 245 snap 79 seq_num 245) dirty exists 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:667: left oid 31 (ObjNum 245 snap 79 seq_num 245) 2026-02-17T11:50:25.116 INFO:tasks.rados.rados.0.trial142.stdout:669: expect (ObjNum 211 snap 68 seq_num 211) 2026-02-17T11:50:25.194 INFO:tasks.rados.rados.0.trial142.stdout:672: finishing write tid 1 to trial14245205-22 2026-02-17T11:50:25.194 INFO:tasks.rados.rados.0.trial142.stdout:672: finishing write tid 2 to trial14245205-22 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: finishing write tid 3 to trial14245205-22 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: finishing write tid 4 to trial14245205-22 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: oid 22 updating version 0 to 172 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: oid 22 version 172 is already newer than 171 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: oid 22 version 172 is already newer than 170 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 172 (ObjNum 247 snap 79 seq_num 247) dirty exists 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:672: left oid 22 (ObjNum 247 snap 79 seq_num 247) 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:674: finishing write tid 1 to trial14245205-17 2026-02-17T11:50:25.195 INFO:tasks.rados.rados.0.trial142.stdout:673: expect (ObjNum 207 snap 66 seq_num 207) 2026-02-17T11:50:25.356 INFO:tasks.rados.rados.0.trial142.stdout:674: finishing write tid 2 to trial14245205-17 2026-02-17T11:50:25.356 INFO:tasks.rados.rados.0.trial142.stdout:674: finishing write tid 3 to trial14245205-17 2026-02-17T11:50:25.356 INFO:tasks.rados.rados.0.trial142.stdout:674: finishing write tid 4 to trial14245205-17 2026-02-17T11:50:25.356 INFO:tasks.rados.rados.0.trial142.stdout:674: oid 17 updating version 0 to 549 2026-02-17T11:50:25.357 INFO:tasks.rados.rados.0.trial142.stdout:674: oid 17 version 549 is already newer than 548 2026-02-17T11:50:25.357 INFO:tasks.rados.rados.0.trial142.stdout:674: oid 17 updating version 549 to 550 2026-02-17T11:50:25.357 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 550 (ObjNum 248 snap 79 seq_num 248) dirty exists 2026-02-17T11:50:25.357 INFO:tasks.rados.rados.0.trial142.stdout:674: left oid 17 (ObjNum 248 snap 79 seq_num 248) 2026-02-17T11:50:25.357 INFO:tasks.rados.rados.0.trial142.stdout:675: expect (ObjNum 230 snap 74 seq_num 230) 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: finishing write tid 1 to trial14245205-5 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: finishing write tid 2 to trial14245205-5 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: finishing write tid 3 to trial14245205-5 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: finishing write tid 4 to trial14245205-5 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: oid 5 updating version 0 to 553 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: oid 5 version 553 is already newer than 552 2026-02-17T11:50:25.489 INFO:tasks.rados.rados.0.trial142.stdout:676: oid 5 version 553 is already newer than 551 2026-02-17T11:50:25.490 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 553 (ObjNum 249 snap 79 seq_num 249) dirty exists 2026-02-17T11:50:25.490 INFO:tasks.rados.rados.0.trial142.stdout:676: left oid 5 (ObjNum 249 snap 79 seq_num 249) 2026-02-17T11:50:25.490 INFO:tasks.rados.rados.0.trial142.stdout:677: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:50:25.571 INFO:tasks.rados.rados.0.trial142.stdout:664: done (9 left) 2026-02-17T11:50:25.571 INFO:tasks.rados.rados.0.trial142.stdout:667: done (8 left) 2026-02-17T11:50:25.571 INFO:tasks.rados.rados.0.trial142.stdout:669: done (7 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:672: done (6 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:673: done (5 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:674: done (4 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:675: done (3 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:676: done (2 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:677: done (1 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:678: done (0 left) 2026-02-17T11:50:25.572 INFO:tasks.rados.rados.0.trial142.stdout:679: snap_create 2026-02-17T11:50:26.085 INFO:tasks.rados.rados.0.trial142.stdout:679: done (0 left) 2026-02-17T11:50:26.085 INFO:tasks.rados.rados.0.trial142.stdout:680: delete oid 20 current snap is 80 2026-02-17T11:50:26.087 INFO:tasks.rados.rados.0.trial142.stdout:680: done (0 left) 2026-02-17T11:50:26.087 INFO:tasks.rados.rados.0.trial142.stdout:681: write (excl) oid 22 current snap is 80 2026-02-17T11:50:26.087 INFO:tasks.rados.rados.0.trial142.stdout:681: seq_num 252 ranges {635364=402397,1763227=472137} 2026-02-17T11:50:26.091 INFO:tasks.rados.rados.0.trial142.stdout:681: writing trial14245205-22 from 635364 to 1037761 tid 1 2026-02-17T11:50:26.095 INFO:tasks.rados.rados.0.trial142.stdout:681: writing trial14245205-22 from 1763227 to 2235364 tid 2 2026-02-17T11:50:26.096 INFO:tasks.rados.rados.0.trial142.stdout:682: write oid 20 current snap is 80 2026-02-17T11:50:26.096 INFO:tasks.rados.rados.0.trial142.stdout:681: finishing write tid 1 to trial14245205-22 2026-02-17T11:50:26.096 INFO:tasks.rados.rados.0.trial142.stdout:682: seq_num 253 ranges {652171=477646,1821709=430462} 2026-02-17T11:50:26.100 INFO:tasks.rados.rados.0.trial142.stdout:682: writing trial14245205-20 from 652171 to 1129817 tid 1 2026-02-17T11:50:26.105 INFO:tasks.rados.rados.0.trial142.stdout:682: writing trial14245205-20 from 1821709 to 2252171 tid 2 2026-02-17T11:50:26.105 INFO:tasks.rados.rados.0.trial142.stdout:683: write (excl) oid 31 current snap is 80 2026-02-17T11:50:26.105 INFO:tasks.rados.rados.0.trial142.stdout:681: finishing write tid 2 to trial14245205-22 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: finishing write tid 3 to trial14245205-22 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: finishing write tid 4 to trial14245205-22 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: oid 22 updating version 0 to 176 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: oid 22 version 176 is already newer than 174 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: oid 22 version 176 is already newer than 175 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 176 (ObjNum 252 snap 80 seq_num 252) dirty exists 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:681: left oid 22 (ObjNum 252 snap 80 seq_num 252) 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:682: finishing write tid 1 to trial14245205-20 2026-02-17T11:50:26.106 INFO:tasks.rados.rados.0.trial142.stdout:683: seq_num 254 ranges {668978=552895,1763838=505140} 2026-02-17T11:50:26.109 INFO:tasks.rados.rados.0.trial142.stdout:683: writing trial14245205-31 from 668978 to 1221873 tid 1 2026-02-17T11:50:26.113 INFO:tasks.rados.rados.0.trial142.stdout:683: writing trial14245205-31 from 1763838 to 2268978 tid 2 2026-02-17T11:50:26.113 INFO:tasks.rados.rados.0.trial142.stdout:681: done (2 left) 2026-02-17T11:50:26.113 INFO:tasks.rados.rados.0.trial142.stdout:684: write oid 37 current snap is 80 2026-02-17T11:50:26.113 INFO:tasks.rados.rados.0.trial142.stdout:684: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-17T11:50:26.118 INFO:tasks.rados.rados.0.trial142.stdout:684: writing trial14245205-37 from 685785 to 1313929 tid 1 2026-02-17T11:50:26.122 INFO:tasks.rados.rados.0.trial142.stdout:684: writing trial14245205-37 from 1822320 to 2285785 tid 2 2026-02-17T11:50:26.122 INFO:tasks.rados.rados.0.trial142.stdout:685: read oid 26 snap 78 2026-02-17T11:50:26.122 INFO:tasks.rados.rados.0.trial142.stdout:685: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:50:26.122 INFO:tasks.rados.rados.0.trial142.stdout:686: write (excl) oid 22 current snap is 80 2026-02-17T11:50:26.122 INFO:tasks.rados.rados.0.trial142.stdout:686: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-17T11:50:26.126 INFO:tasks.rados.rados.0.trial142.stdout:686: writing trial14245205-22 from 702592 to 1405985 tid 1 2026-02-17T11:50:26.131 INFO:tasks.rados.rados.0.trial142.stdout:686: writing trial14245205-22 from 1880802 to 2302592 tid 2 2026-02-17T11:50:26.131 INFO:tasks.rados.rados.0.trial142.stdout:687: read oid 13 snap -1 2026-02-17T11:50:26.131 INFO:tasks.rados.rados.0.trial142.stdout:687: expect (ObjNum 211 snap 68 seq_num 211) 2026-02-17T11:50:26.131 INFO:tasks.rados.rados.0.trial142.stdout:688: read oid 47 snap -1 2026-02-17T11:50:26.131 INFO:tasks.rados.rados.0.trial142.stdout:688: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:50:26.132 INFO:tasks.rados.rados.0.trial142.stdout:689: read oid 24 snap 79 2026-02-17T11:50:26.132 INFO:tasks.rados.rados.0.trial142.stdout:689: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:50:26.132 INFO:tasks.rados.rados.0.trial142.stdout:690: write (excl) oid 8 current snap is 80 2026-02-17T11:50:26.132 INFO:tasks.rados.rados.0.trial142.stdout:690: seq_num 257 ranges {719399=778642,1939284=380115} 2026-02-17T11:50:26.135 INFO:tasks.rados.rados.0.trial142.stdout:690: writing trial14245205-8 from 719399 to 1498041 tid 1 2026-02-17T11:50:26.139 INFO:tasks.rados.rados.0.trial142.stdout:690: writing trial14245205-8 from 1939284 to 2319399 tid 2 2026-02-17T11:50:26.139 INFO:tasks.rados.rados.0.trial142.stdout:691: write oid 48 current snap is 80 2026-02-17T11:50:26.139 INFO:tasks.rados.rados.0.trial142.stdout:682: finishing write tid 2 to trial14245205-20 2026-02-17T11:50:26.139 INFO:tasks.rados.rados.0.trial142.stdout:691: seq_num 258 ranges {736206=453891,1881413=454793} 2026-02-17T11:50:26.143 INFO:tasks.rados.rados.0.trial142.stdout:691: writing trial14245205-48 from 736206 to 1190097 tid 1 2026-02-17T11:50:26.148 INFO:tasks.rados.rados.0.trial142.stdout:691: writing trial14245205-48 from 1881413 to 2336206 tid 2 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:692: snap_create 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:682: finishing write tid 3 to trial14245205-20 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:682: finishing write tid 4 to trial14245205-20 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:682: oid 20 updating version 0 to 257 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:682: oid 20 version 257 is already newer than 255 2026-02-17T11:50:26.149 INFO:tasks.rados.rados.0.trial142.stdout:682: oid 20 version 257 is already newer than 256 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 257 (ObjNum 253 snap 80 seq_num 253) dirty exists 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:682: left oid 20 (ObjNum 253 snap 80 seq_num 253) 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: finishing write tid 1 to trial14245205-31 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: finishing write tid 2 to trial14245205-31 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: finishing write tid 3 to trial14245205-31 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: finishing write tid 4 to trial14245205-31 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: oid 31 updating version 0 to 454 2026-02-17T11:50:26.150 INFO:tasks.rados.rados.0.trial142.stdout:683: oid 31 version 454 is already newer than 453 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:683: oid 31 updating version 454 to 455 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 455 (ObjNum 254 snap 80 seq_num 254) dirty exists 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:683: left oid 31 (ObjNum 254 snap 80 seq_num 254) 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:684: finishing write tid 1 to trial14245205-37 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:684: finishing write tid 2 to trial14245205-37 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:684: finishing write tid 3 to trial14245205-37 2026-02-17T11:50:26.151 INFO:tasks.rados.rados.0.trial142.stdout:684: finishing write tid 4 to trial14245205-37 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:684: oid 37 updating version 0 to 239 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:684: oid 37 version 239 is already newer than 238 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:684: oid 37 version 239 is already newer than 237 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 239 (ObjNum 255 snap 80 seq_num 255) dirty exists 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:684: left oid 37 (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:50:26.152 INFO:tasks.rados.rados.0.trial142.stdout:685: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: finishing write tid 1 to trial14245205-22 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: finishing write tid 2 to trial14245205-22 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: finishing write tid 3 to trial14245205-22 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: finishing write tid 4 to trial14245205-22 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: oid 22 updating version 0 to 177 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: oid 22 updating version 177 to 178 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: oid 22 updating version 178 to 179 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 179 (ObjNum 256 snap 80 seq_num 256) dirty exists 2026-02-17T11:50:26.210 INFO:tasks.rados.rados.0.trial142.stdout:686: left oid 22 (ObjNum 256 snap 80 seq_num 256) 2026-02-17T11:50:26.211 INFO:tasks.rados.rados.0.trial142.stdout:689: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:50:26.282 INFO:tasks.rados.rados.0.trial142.stdout:687: expect (ObjNum 211 snap 68 seq_num 211) 2026-02-17T11:50:26.364 INFO:tasks.rados.rados.0.trial142.stdout:688: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: finishing write tid 1 to trial14245205-8 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: finishing write tid 2 to trial14245205-8 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: finishing write tid 3 to trial14245205-8 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: finishing write tid 4 to trial14245205-8 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: oid 8 updating version 0 to 456 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: oid 8 updating version 456 to 458 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: oid 8 version 458 is already newer than 457 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 458 (ObjNum 257 snap 80 seq_num 257) dirty exists 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:690: left oid 8 (ObjNum 257 snap 80 seq_num 257) 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: finishing write tid 1 to trial14245205-48 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: finishing write tid 2 to trial14245205-48 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: finishing write tid 3 to trial14245205-48 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: finishing write tid 4 to trial14245205-48 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: oid 48 updating version 0 to 433 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: oid 48 version 433 is already newer than 432 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:691: oid 48 updating version 433 to 434 2026-02-17T11:50:26.438 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 434 (ObjNum 258 snap 80 seq_num 258) dirty exists 2026-02-17T11:50:26.439 INFO:tasks.rados.rados.0.trial142.stdout:691: left oid 48 (ObjNum 258 snap 80 seq_num 258) 2026-02-17T11:50:27.080 INFO:tasks.rados.rados.0.trial142.stdout:682: done (10 left) 2026-02-17T11:50:27.080 INFO:tasks.rados.rados.0.trial142.stdout:683: done (9 left) 2026-02-17T11:50:27.080 INFO:tasks.rados.rados.0.trial142.stdout:684: done (8 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:685: done (7 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:686: done (6 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:687: done (5 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:688: done (4 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:689: done (3 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:690: done (2 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:691: done (1 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:692: done (0 left) 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:693: write oid 1 current snap is 81 2026-02-17T11:50:27.081 INFO:tasks.rados.rados.0.trial142.stdout:693: seq_num 259 ranges {753013=645493,2056248=296765} 2026-02-17T11:50:27.085 INFO:tasks.rados.rados.0.trial142.stdout:693: writing trial14245205-1 from 753013 to 1398506 tid 1 2026-02-17T11:50:27.088 INFO:tasks.rados.rados.0.trial142.stdout:693: writing trial14245205-1 from 2056248 to 2353013 tid 2 2026-02-17T11:50:27.088 INFO:tasks.rados.rados.0.trial142.stdout:694: delete oid 7 current snap is 81 2026-02-17T11:50:27.089 INFO:tasks.rados.rados.0.trial142.stdout:693: finishing write tid 1 to trial14245205-1 2026-02-17T11:50:27.090 INFO:tasks.rados.rados.0.trial142.stdout:693: finishing write tid 2 to trial14245205-1 2026-02-17T11:50:27.090 INFO:tasks.rados.rados.0.trial142.stdout:694: done (1 left) 2026-02-17T11:50:27.090 INFO:tasks.rados.rados.0.trial142.stdout:695: write oid 29 current snap is 81 2026-02-17T11:50:27.091 INFO:tasks.rados.rados.0.trial142.stdout:695: seq_num 261 ranges {786627=795991,2173212=213415} 2026-02-17T11:50:27.096 INFO:tasks.rados.rados.0.trial142.stdout:695: writing trial14245205-29 from 786627 to 1582618 tid 1 2026-02-17T11:50:27.099 INFO:tasks.rados.rados.0.trial142.stdout:695: writing trial14245205-29 from 2173212 to 2386627 tid 2 2026-02-17T11:50:27.099 INFO:tasks.rados.rados.0.trial142.stdout:696: delete oid 49 current snap is 81 2026-02-17T11:50:27.099 INFO:tasks.rados.rados.0.trial142.stdout:693: finishing write tid 3 to trial14245205-1 2026-02-17T11:50:27.099 INFO:tasks.rados.rados.0.trial142.stdout:693: finishing write tid 4 to trial14245205-1 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:693: oid 1 updating version 0 to 182 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:693: oid 1 version 182 is already newer than 181 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:693: oid 1 updating version 182 to 183 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 183 (ObjNum 259 snap 81 seq_num 259) dirty exists 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:693: left oid 1 (ObjNum 259 snap 81 seq_num 259) 2026-02-17T11:50:27.100 INFO:tasks.rados.rados.0.trial142.stdout:695: finishing write tid 1 to trial14245205-29 2026-02-17T11:50:27.101 INFO:tasks.rados.rados.0.trial142.stdout:693: done (2 left) 2026-02-17T11:50:27.101 INFO:tasks.rados.rados.0.trial142.stdout:696: done (1 left) 2026-02-17T11:50:27.101 INFO:tasks.rados.rados.0.trial142.stdout:697: snap_create 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: finishing write tid 2 to trial14245205-29 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: finishing write tid 3 to trial14245205-29 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: finishing write tid 4 to trial14245205-29 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: oid 29 updating version 0 to 436 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: oid 29 version 436 is already newer than 435 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: oid 29 updating version 436 to 437 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 437 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-17T11:50:27.102 INFO:tasks.rados.rados.0.trial142.stdout:695: left oid 29 (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:695: done (1 left) 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:697: done (0 left) 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:698: copy_from oid 35 from oid 10 current snap is 82 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:699: rollback oid 7 current snap is 82 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 70 2026-02-17T11:50:28.090 INFO:tasks.rados.rados.0.trial142.stdout:700: delete oid 42 current snap is 82 2026-02-17T11:50:28.091 INFO:tasks.rados.rados.0.trial142.stdout:698: finishing copy_from to trial14245205-35 2026-02-17T11:50:28.091 INFO:tasks.rados.rados.0.trial142.stdout:698: got expected ENOENT (src dne) 2026-02-17T11:50:28.091 INFO:tasks.rados.rados.0.trial142.stdout:698: finishing copy_from racing read to trial14245205-35 2026-02-17T11:50:28.091 INFO:tasks.rados.rados.0.trial142.stdout:699: finishing rollback tid 1 to trial14245205-7 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:699: finishing rollback tid 2 to trial14245205-7 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 570 (ObjNum 165 snap 49 seq_num 165) dirty exists 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:698: done (2 left) 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:699: done (1 left) 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:700: done (0 left) 2026-02-17T11:50:28.092 INFO:tasks.rados.rados.0.trial142.stdout:701: snap_create 2026-02-17T11:50:29.092 INFO:tasks.rados.rados.0.trial142.stdout:701: done (0 left) 2026-02-17T11:50:29.092 INFO:tasks.rados.rados.0.trial142.stdout:702: write (excl) oid 17 current snap is 83 2026-02-17T11:50:29.093 INFO:tasks.rados.rados.0.trial142.stdout:702: seq_num 264 ranges {437048=621738,1832305=404425} 2026-02-17T11:50:29.096 INFO:tasks.rados.rados.0.trial142.stdout:702: writing trial14245205-17 from 437048 to 1058786 tid 1 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:702: writing trial14245205-17 from 1832305 to 2236730 tid 2 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:703: read oid 20 snap -1 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:703: expect (ObjNum 253 snap 80 seq_num 253) 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:704: rollback oid 13 current snap is 83 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 13 to 71 2026-02-17T11:50:29.101 INFO:tasks.rados.rados.0.trial142.stdout:702: finishing write tid 1 to trial14245205-17 2026-02-17T11:50:29.102 INFO:tasks.rados.rados.0.trial142.stdout:705: write oid 10 current snap is 83 2026-02-17T11:50:29.102 INFO:tasks.rados.rados.0.trial142.stdout:705: seq_num 265 ranges {453855=696987,1890787=548083} 2026-02-17T11:50:29.104 INFO:tasks.rados.rados.0.trial142.stdout:705: writing trial14245205-10 from 453855 to 1150842 tid 1 2026-02-17T11:50:29.110 INFO:tasks.rados.rados.0.trial142.stdout:705: writing trial14245205-10 from 1890787 to 2438870 tid 2 2026-02-17T11:50:29.110 INFO:tasks.rados.rados.0.trial142.stdout:706: copy_from oid 11 from oid 23 current snap is 83 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: finishing write tid 2 to trial14245205-17 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: finishing write tid 3 to trial14245205-17 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: finishing write tid 4 to trial14245205-17 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: oid 17 updating version 0 to 554 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: oid 17 updating version 554 to 555 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:702: oid 17 updating version 555 to 556 2026-02-17T11:50:29.111 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 556 (ObjNum 264 snap 83 seq_num 264) dirty exists 2026-02-17T11:50:29.112 INFO:tasks.rados.rados.0.trial142.stdout:702: left oid 17 (ObjNum 264 snap 83 seq_num 264) 2026-02-17T11:50:29.112 INFO:tasks.rados.rados.0.trial142.stdout:704: finishing rollback tid 0 to trial14245205-13 2026-02-17T11:50:29.112 INFO:tasks.rados.rados.0.trial142.stdout:702: done (4 left) 2026-02-17T11:50:29.112 INFO:tasks.rados.rados.0.trial142.stdout:707: write (excl) oid 39 current snap is 83 2026-02-17T11:50:29.112 INFO:tasks.rados.rados.0.trial142.stdout:707: seq_num 266 ranges {470662=772236,1832916=408094} 2026-02-17T11:50:29.114 INFO:tasks.rados.rados.0.trial142.stdout:707: writing trial14245205-39 from 470662 to 1242898 tid 1 2026-02-17T11:50:29.118 INFO:tasks.rados.rados.0.trial142.stdout:707: writing trial14245205-39 from 1832916 to 2241010 tid 2 2026-02-17T11:50:29.119 INFO:tasks.rados.rados.0.trial142.stdout:708: delete oid 36 current snap is 83 2026-02-17T11:50:29.119 INFO:tasks.rados.rados.0.trial142.stdout:704: finishing rollback tid 1 to trial14245205-13 2026-02-17T11:50:29.119 INFO:tasks.rados.rados.0.trial142.stdout:704: finishing rollback tid 2 to trial14245205-13 2026-02-17T11:50:29.119 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 462 (ObjNum 211 snap 68 seq_num 211) dirty exists 2026-02-17T11:50:29.119 INFO:tasks.rados.rados.0.trial142.stdout:703: expect (ObjNum 253 snap 80 seq_num 253) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: finishing write tid 1 to trial14245205-10 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:706: finishing copy_from to trial14245205-11 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:706: got expected ENOENT (src dne) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:706: finishing copy_from racing read to trial14245205-11 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: finishing write tid 2 to trial14245205-10 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: finishing write tid 3 to trial14245205-10 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: finishing write tid 4 to trial14245205-10 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: oid 10 updating version 0 to 340 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: oid 10 version 340 is already newer than 338 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: oid 10 version 340 is already newer than 339 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 340 (ObjNum 265 snap 83 seq_num 265) dirty exists 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: left oid 10 (ObjNum 265 snap 83 seq_num 265) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: finishing write tid 1 to trial14245205-39 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: finishing write tid 2 to trial14245205-39 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:703: done (5 left) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:704: done (4 left) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:705: done (3 left) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:706: done (2 left) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:708: done (1 left) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:709: read oid 36 snap -1 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:709: expect deleted 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:710: read oid 10 snap -1 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:710: expect (ObjNum 265 snap 83 seq_num 265) 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:711: delete oid 31 current snap is 83 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: finishing write tid 3 to trial14245205-39 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: finishing write tid 4 to trial14245205-39 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: oid 39 updating version 0 to 336 2026-02-17T11:50:29.173 INFO:tasks.rados.rados.0.trial142.stdout:707: oid 39 version 336 is already newer than 335 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:707: oid 39 updating version 336 to 337 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 337 (ObjNum 266 snap 83 seq_num 266) dirty exists 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:707: left oid 39 (ObjNum 266 snap 83 seq_num 266) 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:707: done (3 left) 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:709: done (2 left) 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:711: done (1 left) 2026-02-17T11:50:29.174 INFO:tasks.rados.rados.0.trial142.stdout:712: snap_create 2026-02-17T11:50:29.177 INFO:tasks.rados.rados.0.trial142.stdout:710: expect (ObjNum 265 snap 83 seq_num 265) 2026-02-17T11:50:30.096 INFO:tasks.rados.rados.0.trial142.stdout:710: done (1 left) 2026-02-17T11:50:30.096 INFO:tasks.rados.rados.0.trial142.stdout:712: done (0 left) 2026-02-17T11:50:30.096 INFO:tasks.rados.rados.0.trial142.stdout:713: write oid 13 current snap is 84 2026-02-17T11:50:30.096 INFO:tasks.rados.rados.0.trial142.stdout:713: seq_num 269 ranges {521083=714336,1724715=555421} 2026-02-17T11:50:30.100 INFO:tasks.rados.rados.0.trial142.stdout:713: writing trial14245205-13 from 521083 to 1235419 tid 1 2026-02-17T11:50:30.105 INFO:tasks.rados.rados.0.trial142.stdout:713: writing trial14245205-13 from 1724715 to 2280136 tid 2 2026-02-17T11:50:30.105 INFO:tasks.rados.rados.0.trial142.stdout:714: read oid 2 snap -1 2026-02-17T11:50:30.105 INFO:tasks.rados.rados.0.trial142.stdout:714: expect deleted 2026-02-17T11:50:30.105 INFO:tasks.rados.rados.0.trial142.stdout:715: snap_create 2026-02-17T11:50:30.106 INFO:tasks.rados.rados.0.trial142.stdout:713: finishing write tid 1 to trial14245205-13 2026-02-17T11:50:30.106 INFO:tasks.rados.rados.0.trial142.stdout:713: finishing write tid 2 to trial14245205-13 2026-02-17T11:50:30.107 INFO:tasks.rados.rados.0.trial142.stdout:713: finishing write tid 3 to trial14245205-13 2026-02-17T11:50:30.107 INFO:tasks.rados.rados.0.trial142.stdout:713: finishing write tid 4 to trial14245205-13 2026-02-17T11:50:30.107 INFO:tasks.rados.rados.0.trial142.stdout:713: oid 13 updating version 0 to 466 2026-02-17T11:50:30.107 INFO:tasks.rados.rados.0.trial142.stdout:713: oid 13 updating version 466 to 468 2026-02-17T11:50:30.107 INFO:tasks.rados.rados.0.trial142.stdout:713: oid 13 version 468 is already newer than 467 2026-02-17T11:50:30.108 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 468 (ObjNum 269 snap 84 seq_num 269) dirty exists 2026-02-17T11:50:30.108 INFO:tasks.rados.rados.0.trial142.stdout:713: left oid 13 (ObjNum 269 snap 84 seq_num 269) 2026-02-17T11:50:31.097 INFO:tasks.rados.rados.0.trial142.stdout:713: done (2 left) 2026-02-17T11:50:31.097 INFO:tasks.rados.rados.0.trial142.stdout:714: done (1 left) 2026-02-17T11:50:31.097 INFO:tasks.rados.rados.0.trial142.stdout:715: done (0 left) 2026-02-17T11:50:31.097 INFO:tasks.rados.rados.0.trial142.stdout:716: write (excl) oid 18 current snap is 85 2026-02-17T11:50:31.097 INFO:tasks.rados.rados.0.trial142.stdout:716: seq_num 270 ranges {537890=789585,1783197=699079} 2026-02-17T11:50:31.102 INFO:tasks.rados.rados.0.trial142.stdout:716: writing trial14245205-18 from 537890 to 1327475 tid 1 2026-02-17T11:50:31.107 INFO:tasks.rados.rados.0.trial142.stdout:716: writing trial14245205-18 from 1783197 to 2482276 tid 2 2026-02-17T11:50:31.107 INFO:tasks.rados.rados.0.trial142.stdout:717: write (excl) oid 19 current snap is 85 2026-02-17T11:50:31.107 INFO:tasks.rados.rados.0.trial142.stdout:716: finishing write tid 1 to trial14245205-18 2026-02-17T11:50:31.107 INFO:tasks.rados.rados.0.trial142.stdout:717: seq_num 271 ranges {554697=464834,1725326=559090} 2026-02-17T11:50:31.110 INFO:tasks.rados.rados.0.trial142.stdout:717: writing trial14245205-19 from 554697 to 1019531 tid 1 2026-02-17T11:50:31.115 INFO:tasks.rados.rados.0.trial142.stdout:717: writing trial14245205-19 from 1725326 to 2284416 tid 2 2026-02-17T11:50:31.115 INFO:tasks.rados.rados.0.trial142.stdout:718: write (excl) oid 14 current snap is 85 2026-02-17T11:50:31.115 INFO:tasks.rados.rados.0.trial142.stdout:718: seq_num 272 ranges {571504=540083,1783808=702748} 2026-02-17T11:50:31.119 INFO:tasks.rados.rados.0.trial142.stdout:718: writing trial14245205-14 from 571504 to 1111587 tid 1 2026-02-17T11:50:31.125 INFO:tasks.rados.rados.0.trial142.stdout:718: writing trial14245205-14 from 1783808 to 2486556 tid 2 2026-02-17T11:50:31.125 INFO:tasks.rados.rados.0.trial142.stdout:719: snap_create 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: finishing write tid 2 to trial14245205-18 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: finishing write tid 3 to trial14245205-18 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: finishing write tid 4 to trial14245205-18 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: oid 18 updating version 0 to 573 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: oid 18 updating version 573 to 574 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: oid 18 version 574 is already newer than 572 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 574 (ObjNum 270 snap 85 seq_num 270) dirty exists 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:716: left oid 18 (ObjNum 270 snap 85 seq_num 270) 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:717: finishing write tid 1 to trial14245205-19 2026-02-17T11:50:31.126 INFO:tasks.rados.rados.0.trial142.stdout:717: finishing write tid 2 to trial14245205-19 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: finishing write tid 3 to trial14245205-19 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: finishing write tid 4 to trial14245205-19 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: oid 19 updating version 0 to 343 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: oid 19 version 343 is already newer than 341 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: oid 19 version 343 is already newer than 342 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 343 (ObjNum 271 snap 85 seq_num 271) dirty exists 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:717: left oid 19 (ObjNum 271 snap 85 seq_num 271) 2026-02-17T11:50:31.127 INFO:tasks.rados.rados.0.trial142.stdout:718: finishing write tid 1 to trial14245205-14 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: finishing write tid 2 to trial14245205-14 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: finishing write tid 3 to trial14245205-14 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: finishing write tid 4 to trial14245205-14 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: oid 14 updating version 0 to 575 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: oid 14 updating version 575 to 577 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:718: oid 14 version 577 is already newer than 576 2026-02-17T11:50:31.128 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 577 (ObjNum 272 snap 85 seq_num 272) dirty exists 2026-02-17T11:50:31.129 INFO:tasks.rados.rados.0.trial142.stdout:718: left oid 14 (ObjNum 272 snap 85 seq_num 272) 2026-02-17T11:50:32.096 INFO:tasks.rados.rados.0.trial142.stdout:716: done (3 left) 2026-02-17T11:50:32.096 INFO:tasks.rados.rados.0.trial142.stdout:717: done (2 left) 2026-02-17T11:50:32.096 INFO:tasks.rados.rados.0.trial142.stdout:718: done (1 left) 2026-02-17T11:50:32.096 INFO:tasks.rados.rados.0.trial142.stdout:719: done (0 left) 2026-02-17T11:50:32.097 INFO:tasks.rados.rados.0.trial142.stdout:720: snap_create 2026-02-17T11:50:33.079 INFO:tasks.rados.rados.0.trial142.stdout:720: done (0 left) 2026-02-17T11:50:33.080 INFO:tasks.rados.rados.0.trial142.stdout:721: delete oid 18 current snap is 87 2026-02-17T11:50:33.083 INFO:tasks.rados.rados.0.trial142.stdout:721: done (0 left) 2026-02-17T11:50:33.083 INFO:tasks.rados.rados.0.trial142.stdout:722: read oid 23 snap 86 2026-02-17T11:50:33.083 INFO:tasks.rados.rados.0.trial142.stdout:722: expect deleted 2026-02-17T11:50:33.083 INFO:tasks.rados.rados.0.trial142.stdout:723: snap_create 2026-02-17T11:50:34.080 INFO:tasks.rados.rados.0.trial142.stdout:722: done (1 left) 2026-02-17T11:50:34.080 INFO:tasks.rados.rados.0.trial142.stdout:723: done (0 left) 2026-02-17T11:50:34.080 INFO:tasks.rados.rados.0.trial142.stdout:724: snap_create 2026-02-17T11:50:34.200 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:50:34.200 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:50:34.200 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:50:34.201 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:50:34.204 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:50:34.204 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:50:34.204 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: get_monmap_and_config 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: build_initial_monmap 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: monmap: 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:34.270038+0000 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:34.270038+0000 2026-02-17T11:50:34.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 Processor -- start 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 -- start start 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: init 2026-02-17T11:50:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc48806d180 0x7fc4880a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-a con 0x7fc48806d180 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc48809c8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-b con 0x7fc4880a3260 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48809c480 con 0x7fc48809c8a0 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc4880a3690 con 0x7fc48806d180 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc48806d560 con 0x7fc4880a3260 2026-02-17T11:50:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48f385640 10 monclient(hunting): authenticate will time out at 921.888826s 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc48806d180 0x7fc4880a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc48806d180 0x7fc4880a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37262/0 (socket says 10.20.193.51:37262) 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1188679882 learned_addr learned my addr 10.20.193.51:0/1188679882 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): get_auth_request con 0x7fc48806d180 auth_method 0 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 10 monclient(hunting): get_auth_request con 0x7fc4880a3260 auth_method 0 2026-02-17T11:50:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d0fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 msgr2=0x7fc48813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 msgr2=0x7fc48813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.269+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 10 monclient(hunting): handle_auth_done global_id 74175 payload 274 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 msgr2=0x7fc48813f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1188679882 >> v1:10.20.193.51:6789/0 conn(0x7fc48809c8a0 legacy=0x7fc4880a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 10 monclient: _finish_hunting 0 2026-02-17T11:50:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 1 monclient: found mon.noname-a 2026-02-17T11:50:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.270+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1188679882 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48809b420 con 0x7fc48806d180 2026-02-17T11:50:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc48806d180 msgr2=0x7fc4880a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc48806d180 0x7fc4880a2610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4780099a0 tx=0x7fc47802ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c1a730ca8c397d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 1 -- 10.20.193.51:0/1188679882 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47803c070 con 0x7fc48806d180 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: dump: 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: _finish_auth 0 2026-02-17T11:50:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 5 monclient: authenticate success, global_id 74175 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 1 -- 10.20.193.51:0/1188679882 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47802fd90 con 0x7fc48806d180 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 1 -- 10.20.193.51:0/1188679882 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478037660 con 0x7fc48806d180 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 4 set_mon_vals no callback set 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc477fff640 10 monclient: dump: 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.285 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 10 monclient: shutdown 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 -- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc48806d180 msgr2=0x7fc4880a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc48806d180 0x7fc4880a2610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4780099a0 tx=0x7fc47802ef50 comp rx=0 tx=0).stop 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 -- 10.20.193.51:0/1188679882 shutdown_connections 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc4880a3260 0x7fc48813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 --2- 10.20.193.51:0/1188679882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc48806d180 0x7fc4880a2610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 -- 10.20.193.51:0/1188679882 >> 10.20.193.51:0/1188679882 conn(0x7fc4880a7b90 msgr2=0x7fc4880a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 -- 10.20.193.51:0/1188679882 shutdown_connections 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.272+0000 7fc48f385640 1 -- 10.20.193.51:0/1188679882 wait complete. 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient: build_initial_monmap 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient: monmap: 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 Processor -- start 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 -- start start 2026-02-17T11:50:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient: init 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-c con 0x7fc48806d180 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc48809c8a0 0x7fc488099df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-b con 0x7fc48809c8a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 0x7fc48809a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): picked mon.noname-a con 0x7fc4880a3260 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc48809e640 con 0x7fc4880a3260 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc48806dd20 con 0x7fc48809c8a0 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc48809e7c0 con 0x7fc48806d180 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48f385640 10 monclient(hunting): authenticate will time out at 921.892729s 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48838/0 (socket says 10.20.193.51:48838) 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1437334124 learned_addr learned my addr 10.20.193.51:0/1437334124 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 10 monclient(hunting): get_auth_request con 0x7fc48806d180 auth_method 0 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 0x7fc48809a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): get_auth_request con 0x7fc4880a3260 auth_method 0 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 msgr2=0x7fc4881cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 msgr2=0x7fc4881cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient(hunting): handle_auth_done global_id 74178 payload 824 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 msgr2=0x7fc4881cf130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc48809c8a0 msgr2=0x7fc488099df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc48809c8a0 0x7fc488099df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient: _finish_hunting 0 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 monclient: found mon.noname-a 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.273+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1437334124 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc488093870 con 0x7fc4880a3260 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48d8fb640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 msgr2=0x7fc48809a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48d8fb640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 0x7fc48809a330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc484007cf0 tx=0x7fc48400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484003a90 con 0x7fc4880a3260 2026-02-17T11:50:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: dump: 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc484003c70 con 0x7fc4880a3260 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484004260 con 0x7fc4880a3260 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 5 monclient: authenticate success, global_id 74178 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _renew_subs 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4880a65f0 con 0x7fc4880a3260 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc4777fe640 4 set_mon_vals no callback set 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 10 monclient: dump: 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:34.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _renew_subs 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4880932b0 con 0x7fc4880a3260 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc484002c20 con 0x7fc4880a3260 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.276+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4880a2610 con 0x7fc4880a3260 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.277+0000 7fc475ffb640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 0x7fc458040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.277+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(188..188 src has 47..188) ==== 4707+0+0 (secure 0 0 0) 0x7fc484052a90 con 0x7fc4880a3260 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.277+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 0x7fc458040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.277+0000 7fc48d0fa640 10 monclient: get_auth_request con 0x7fc45803dd60 auth_method 0 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.279+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc484022020 con 0x7fc4880a3260 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.279+0000 7fc475ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.279+0000 7fc475ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.279+0000 7fc48d0fa640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 0x7fc458040220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc47802ef90 tx=0x7fc478039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.394+0000 7fc48f385640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.394+0000 7fc48f385640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.394+0000 7fc48f385640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.394+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc4880919e0 con 0x7fc4880a3260 2026-02-17T11:50:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.395+0000 7fc475ffb640 1 -- 10.20.193.51:0/1437334124 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fc4840122e0 con 0x7fc4880a3260 2026-02-17T11:50:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.395+0000 7fc475ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.395+0000 7fc475ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:34.397 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 msgr2=0x7fc458040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 0x7fc458040220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc47802ef90 tx=0x7fc478039040 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 10 monclient: shutdown 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 msgr2=0x7fc48809a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 0x7fc48809a330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc484007cf0 tx=0x7fc48400e4b0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 shutdown_connections 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc45803dd60 0x7fc458040220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc4880a3260 0x7fc48809a330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc48809c8a0 0x7fc488099df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 --2- 10.20.193.51:0/1437334124 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc48806d180 0x7fc4881cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 >> 10.20.193.51:0/1437334124 conn(0x7fc4880a7b90 msgr2=0x7fc4880a4270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 shutdown_connections 2026-02-17T11:50:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:34.396+0000 7fc48f385640 1 -- 10.20.193.51:0/1437334124 wait complete. 2026-02-17T11:50:35.082 INFO:tasks.rados.rados.0.trial142.stdout:724: done (0 left) 2026-02-17T11:50:35.082 INFO:tasks.rados.rados.0.trial142.stdout:725: read oid 39 snap -1 2026-02-17T11:50:35.083 INFO:tasks.rados.rados.0.trial142.stdout:725: expect (ObjNum 266 snap 83 seq_num 266) 2026-02-17T11:50:35.083 INFO:tasks.rados.rados.0.trial142.stdout:726: snap_create 2026-02-17T11:50:35.090 INFO:tasks.rados.rados.0.trial142.stdout:725: expect (ObjNum 266 snap 83 seq_num 266) 2026-02-17T11:50:36.086 INFO:tasks.rados.rados.0.trial142.stdout:725: done (1 left) 2026-02-17T11:50:36.086 INFO:tasks.rados.rados.0.trial142.stdout:726: done (0 left) 2026-02-17T11:50:36.086 INFO:tasks.rados.rados.0.trial142.stdout:727: snap_create 2026-02-17T11:50:37.306 INFO:tasks.rados.rados.0.trial142.stdout:727: done (0 left) 2026-02-17T11:50:37.307 INFO:tasks.rados.rados.0.trial142.stdout:728: read oid 40 snap -1 2026-02-17T11:50:37.307 INFO:tasks.rados.rados.0.trial142.stdout:728: expect (ObjNum 244 snap 79 seq_num 244) 2026-02-17T11:50:37.307 INFO:tasks.rados.rados.0.trial142.stdout:729: delete oid 31 current snap is 91 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:729: done (1 left) 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:730: copy_from oid 30 from oid 23 current snap is 91 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:731: copy_from oid 36 from oid 31 current snap is 91 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:732: read oid 44 snap -1 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:732: expect deleted 2026-02-17T11:50:37.308 INFO:tasks.rados.rados.0.trial142.stdout:733: snap_remove snap 88 2026-02-17T11:50:37.406 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 10 monclient: get_monmap_and_config 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 10 monclient: build_initial_monmap 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 10 monclient: monmap: 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:37.470439+0000 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:37.470439+0000 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:37.471 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:37.472 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:37.472 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 1 Processor -- start 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 1 -- start start 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.469+0000 7fd7d383b640 10 monclient: init 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd7cc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7cc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd7cc13c770 0x7fd7cc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-a con 0x7fd7cc13c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc09e8e0 con 0x7fd7cc0a0750 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc06e140 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc09f910 con 0x7fd7cc13c770 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d383b640 10 monclient(hunting): authenticate will time out at 925.089183s 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd7cc13c770 0x7fd7cc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd7cc13c770 0x7fd7cc13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42374/0 (socket says 10.20.193.51:42374) 2026-02-17T11:50:37.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 -- 10.20.193.51:0/2277475722 learned_addr learned my addr 10.20.193.51:0/2277475722 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d0daf640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd7cc0a0750 0x7fd7cc09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34224/0 (socket says 10.20.193.51:34224) 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): get_auth_request con 0x7fd7cc13c770 auth_method 0 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient(hunting): handle_auth_done global_id 74181 payload 274 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 -- 10.20.193.51:0/2277475722 >> v1:10.20.193.142:6789/0 conn(0x7fd7cc0a3bb0 legacy=0x7fd7cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 -- 10.20.193.51:0/2277475722 >> v1:10.20.193.51:6789/0 conn(0x7fd7cc0a0750 legacy=0x7fd7cc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient: _finish_hunting 0 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 monclient: found mon.noname-a 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.470+0000 7fd7d1db1640 1 -- 10.20.193.51:0/2277475722 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc09ccd0 con 0x7fd7cc13c770 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d1db1640 1 -- 10.20.193.51:0/2277475722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc13c770 msgr2=0x7fd7cc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d1db1640 1 --2- 10.20.193.51:0/2277475722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc13c770 0x7fd7cc13eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009e50 tx=0x7fd7c802f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dc1f1dcd8fb9d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 1 -- 10.20.193.51:0/2277475722 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80373f0 con 0x7fd7cc13c770 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: dump: 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: _finish_auth 0 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:37.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d383b640 5 monclient: authenticate success, global_id 74181 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d383b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 1 -- 10.20.193.51:0/2277475722 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c8037590 con 0x7fd7cc13c770 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 1 -- 10.20.193.51:0/2277475722 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8037960 con 0x7fd7cc13c770 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d383b640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7d383b640 4 set_mon_vals no callback set 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.472+0000 7fd7bbfff640 10 monclient: dump: 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:37.478 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 10 monclient: shutdown 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 -- 10.20.193.51:0/2277475722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc13c770 msgr2=0x7fd7cc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2277475722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc13c770 0x7fd7cc13eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009e50 tx=0x7fd7c802f260 comp rx=0 tx=0).stop 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 -- 10.20.193.51:0/2277475722 shutdown_connections 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2277475722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc13c770 0x7fd7cc13eb60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 -- 10.20.193.51:0/2277475722 >> 10.20.193.51:0/2277475722 conn(0x7fd7cc0a30c0 msgr2=0x7fd7cc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 -- 10.20.193.51:0/2277475722 shutdown_connections 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 -- 10.20.193.51:0/2277475722 wait complete. 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 10 monclient: build_initial_monmap 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 10 monclient: monmap: 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:37.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.473+0000 7fd7d383b640 1 Processor -- start 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 -- start start 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient: init 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-c con 0x7fd7cc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-a con 0x7fd7cc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7cc13c770 0x7fd7cc09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): picked mon.noname-b con 0x7fd7cc13c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc09c850 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc09ebe0 con 0x7fd7cc13c770 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0a04b0 con 0x7fd7cc0a0750 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d383b640 10 monclient(hunting): authenticate will time out at 925.093291s 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:37.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42380/0 (socket says 10.20.193.51:42380) 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 -- 10.20.193.51:0/2629559762 learned_addr learned my addr 10.20.193.51:0/2629559762 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): get_auth_request con 0x7fd7cc0a3bb0 auth_method 0 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 10 monclient(hunting): get_auth_request con 0x7fd7cc0a0750 auth_method 0 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 msgr2=0x7fd7cc099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 msgr2=0x7fd7cc099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:37.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient(hunting): handle_auth_done global_id 74184 payload 824 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d15b0640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 msgr2=0x7fd7cc099d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7cc13c770 msgr2=0x7fd7cc09ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7cc13c770 0x7fd7cc09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient: _finish_hunting 0 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 monclient: found mon.noname-a 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.474+0000 7fd7d0daf640 1 -- 10.20.193.51:0/2629559762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc095d60 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d0daf640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 msgr2=0x7fd7cc09a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d0daf640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c550 tx=0x7fd7c000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0017070 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: dump: 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:37.484 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c0007070 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 5 monclient: authenticate success, global_id 74184 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 10 monclient: _renew_subs 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc0a25b0 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0007460 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7b9ffb640 10 monclient: dump: 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:37.485 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7bb7fe640 4 set_mon_vals no callback set 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 10 monclient: _renew_subs 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.476+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc09c290 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d383b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d383b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d383b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc09dac0 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd7c001c440 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7b9ffb640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 0x7fd79c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(191..191 src has 47..191) ==== 4707+0+0 (secure 0 0 0) 0x7fd7c0051d20 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d15b0640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 0x7fd79c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.477+0000 7fd7d15b0640 10 monclient: get_auth_request con 0x7fd79c03dd10 auth_method 0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.479+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd7c001ac60 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.479+0000 7fd7b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.479+0000 7fd7b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:37.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.480+0000 7fd7d15b0640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 0x7fd79c0401d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc007d50 tx=0x7fd7bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.598+0000 7fd7d383b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.598+0000 7fd7d383b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.598+0000 7fd7d383b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.598+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd7cc094b90 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7b9ffb640 1 -- 10.20.193.51:0/2629559762 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fd7c0007640 con 0x7fd7cc0a3bb0 2026-02-17T11:50:37.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 msgr2=0x7fd79c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 0x7fd79c0401d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc007d50 tx=0x7fd7bc009040 comp rx=0 tx=0).stop 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 10 monclient: shutdown 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 msgr2=0x7fd7cc09a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.599+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c550 tx=0x7fd7c000ca20 comp rx=0 tx=0).stop 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 shutdown_connections 2026-02-17T11:50:37.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd79c03dd10 0x7fd79c0401d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd7cc13c770 0x7fd7cc09ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd7cc0a3bb0 0x7fd7cc09a5f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 --2- 10.20.193.51:0/2629559762 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd7cc0a0750 0x7fd7cc099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 >> 10.20.193.51:0/2629559762 conn(0x7fd7cc0a30c0 msgr2=0x7fd7cc13d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 shutdown_connections 2026-02-17T11:50:37.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:37.600+0000 7fd7d383b640 1 -- 10.20.193.51:0/2629559762 wait complete. 2026-02-17T11:50:38.316 INFO:tasks.rados.rados.0.trial142.stdout:733: done (4 left) 2026-02-17T11:50:38.316 INFO:tasks.rados.rados.0.trial142.stdout:734: write (excl) oid 50 current snap is 91 2026-02-17T11:50:38.316 INFO:tasks.rados.rados.0.trial142.stdout:734: seq_num 275 ranges {621925=482183,1559254=566428} 2026-02-17T11:50:38.320 INFO:tasks.rados.rados.0.trial142.stdout:734: writing trial14245205-50 from 621925 to 1104108 tid 1 2026-02-17T11:50:38.324 INFO:tasks.rados.rados.0.trial142.stdout:734: writing trial14245205-50 from 1559254 to 2125682 tid 2 2026-02-17T11:50:38.325 INFO:tasks.rados.rados.0.trial142.stdout:735: snap_remove snap 90 2026-02-17T11:50:39.319 INFO:tasks.rados.rados.0.trial142.stdout:735: done (5 left) 2026-02-17T11:50:39.319 INFO:tasks.rados.rados.0.trial142.stdout:736: snap_create 2026-02-17T11:50:39.319 INFO:tasks.rados.rados.0.trial142.stdout:731: finishing copy_from to trial14245205-36 2026-02-17T11:50:39.319 INFO:tasks.rados.rados.0.trial142.stdout:731: got expected ENOENT (src dne) 2026-02-17T11:50:39.320 INFO:tasks.rados.rados.0.trial142.stdout:730: finishing copy_from to trial14245205-30 2026-02-17T11:50:39.320 INFO:tasks.rados.rados.0.trial142.stdout:730: got expected ENOENT (src dne) 2026-02-17T11:50:39.320 INFO:tasks.rados.rados.0.trial142.stdout:731: finishing copy_from racing read to trial14245205-36 2026-02-17T11:50:39.320 INFO:tasks.rados.rados.0.trial142.stdout:730: finishing copy_from racing read to trial14245205-30 2026-02-17T11:50:39.320 INFO:tasks.rados.rados.0.trial142.stdout:728: expect (ObjNum 244 snap 79 seq_num 244) 2026-02-17T11:50:39.379 INFO:tasks.rados.rados.0.trial142.stdout:734: finishing write tid 1 to trial14245205-50 2026-02-17T11:50:39.379 INFO:tasks.rados.rados.0.trial142.stdout:734: finishing write tid 2 to trial14245205-50 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: finishing write tid 3 to trial14245205-50 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: finishing write tid 4 to trial14245205-50 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: oid 50 updating version 0 to 183 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: oid 50 updating version 183 to 185 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: oid 50 version 185 is already newer than 184 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 185 (ObjNum 275 snap 91 seq_num 275) dirty exists 2026-02-17T11:50:39.380 INFO:tasks.rados.rados.0.trial142.stdout:734: left oid 50 (ObjNum 275 snap 91 seq_num 275) 2026-02-17T11:50:40.610 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:40.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 10 monclient: get_monmap_and_config 2026-02-17T11:50:40.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 10 monclient: monmap: 2026-02-17T11:50:40.681 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.681 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:40.678371+0000 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:40.678371+0000 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:40.682 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 1 Processor -- start 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 1 -- start start 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.677+0000 7f650c1cc640 10 monclient: init 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f65040a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f650413b380 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f650413ee90 0x7f6504141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-a con 0x7f650413ee90 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6504135430 con 0x7f65040a3bb0 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650409af60 con 0x7f650413b380 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f650409a5c0 con 0x7f650413ee90 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650c1cc640 10 monclient(hunting): authenticate will time out at 928.297134s 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f6509f41640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f65040a3bb0 0x7f650409cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34230/0 (socket says 10.20.193.51:34230) 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f6509f41640 1 -- 10.20.193.51:0/1537995321 learned_addr learned my addr 10.20.193.51:0/1537995321 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 1 --2- 10.20.193.51:0/1537995321 >> v2:10.20.193.51:3300/0 conn(0x7f650413ee90 0x7f6504141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): get_auth_request con 0x7f650413ee90 auth_method 0 2026-02-17T11:50:40.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient(hunting): handle_auth_done global_id 74187 payload 274 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 1 -- 10.20.193.51:0/1537995321 >> v1:10.20.193.142:6789/0 conn(0x7f650413b380 legacy=0x7f650413d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 1 -- 10.20.193.51:0/1537995321 >> v1:10.20.193.51:6789/0 conn(0x7f65040a3bb0 legacy=0x7f650409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 1 monclient: found mon.noname-a 2026-02-17T11:50:40.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.678+0000 7f650a742640 1 -- 10.20.193.51:0/1537995321 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650409b240 con 0x7f650413ee90 2026-02-17T11:50:40.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.680+0000 7f650a742640 1 -- 10.20.193.51:0/1537995321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 msgr2=0x7f6504141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.680+0000 7f650a742640 1 --2- 10.20.193.51:0/1537995321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f6504141280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65040694e0 tx=0x7f650002f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc13d5ac8416de11 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 1 -- 10.20.193.51:0/1537995321 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650003c070 con 0x7f650413ee90 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: dump: 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 1 -- 10.20.193.51:0/1537995321 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6500037640 con 0x7f650413ee90 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 1 -- 10.20.193.51:0/1537995321 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500037a10 con 0x7f650413ee90 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 5 monclient: authenticate success, global_id 74187 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 4 set_mon_vals no callback set 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f6508f3f640 10 monclient: dump: 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 10 monclient: shutdown 2026-02-17T11:50:40.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- 10.20.193.51:0/1537995321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 msgr2=0x7f6504141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1537995321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f6504141280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65040694e0 tx=0x7f650002f130 comp rx=0 tx=0).stop 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- 10.20.193.51:0/1537995321 shutdown_connections 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1537995321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f6504141280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- 10.20.193.51:0/1537995321 >> 10.20.193.51:0/1537995321 conn(0x7f65040a30c0 msgr2=0x7f65040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- 10.20.193.51:0/1537995321 shutdown_connections 2026-02-17T11:50:40.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- 10.20.193.51:0/1537995321 wait complete. 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 10 monclient: monmap: 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.700 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 Processor -- start 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 1 -- start start 2026-02-17T11:50:40.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.681+0000 7f650c1cc640 10 monclient: init 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65040a3bb0 0x7f65041cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-b con 0x7f65040a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-c con 0x7f650413b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): picked mon.noname-a con 0x7f650413ee90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6504135040 con 0x7f650413ee90 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65040a3f90 con 0x7f65040a3bb0 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f65041351c0 con 0x7f650413b380 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650c1cc640 10 monclient(hunting): authenticate will time out at 928.301152s 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42404/0 (socket says 10.20.193.51:42404) 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 -- 10.20.193.51:0/1175635441 learned_addr learned my addr 10.20.193.51:0/1175635441 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:40.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): get_auth_request con 0x7f650413ee90 auth_method 0 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 10 monclient(hunting): get_auth_request con 0x7f650413b380 auth_method 0 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 msgr2=0x7f650413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 msgr2=0x7f650413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509f41640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65040a3bb0 0x7f65041cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509740640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509f41640 10 monclient(hunting): get_auth_request con 0x7f65040a3bb0 auth_method 0 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509f41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509f41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f6509f41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient(hunting): handle_auth_done global_id 74190 payload 824 2026-02-17T11:50:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 msgr2=0x7f650413a1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65040a3bb0 msgr2=0x7f65041cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65040a3bb0 0x7f65041cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 monclient: found mon.noname-a 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.682+0000 7f650a742640 1 -- 10.20.193.51:0/1175635441 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6504137990 con 0x7f650413ee90 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650a742640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 msgr2=0x7f650413a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650a742640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6500009e90 tx=0x7f6500004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500047020 con 0x7f650413ee90 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: dump: 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.707 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6500042880 con 0x7f650413ee90 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650003c040 con 0x7f650413ee90 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f3fff640 4 set_mon_vals no callback set 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f64f27fc640 10 monclient: dump: 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.708 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 5 monclient: authenticate success, global_id 74190 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 10 monclient: _renew_subs 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650409d7b0 con 0x7f650413ee90 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 10 monclient: _renew_subs 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.684+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65041373d0 con 0x7f650413ee90 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f650c1cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f650c1cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f650c1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650409cd30 con 0x7f650413ee90 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6500043420 con 0x7f650413ee90 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f64f27fc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 0x7f64d4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(193..193 src has 47..193) ==== 4779+0+0 (secure 0 0 0) 0x7f6500078510 con 0x7f650413ee90 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f6509f41640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 0x7f64d4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.685+0000 7f6509f41640 10 monclient: get_auth_request con 0x7f64d403dd60 auth_method 0 2026-02-17T11:50:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.687+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6500051070 con 0x7f650413ee90 2026-02-17T11:50:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.687+0000 7f64f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.687+0000 7f64f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.688+0000 7f6509f41640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 0x7f64d4040220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009910 tx=0x7f64f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.807+0000 7f650c1cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.807+0000 7f650c1cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.807+0000 7f650c1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.807+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6504137610 con 0x7f650413ee90 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f64f27fc640 1 -- 10.20.193.51:0/1175635441 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f6500036e20 con 0x7f650413ee90 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f64f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:40.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f64f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:40.811 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 msgr2=0x7f64d4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 0x7f64d4040220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009910 tx=0x7f64f4008040 comp rx=0 tx=0).stop 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 10 monclient: shutdown 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 msgr2=0x7f650413a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6500009e90 tx=0x7f6500004b40 comp rx=0 tx=0).stop 2026-02-17T11:50:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 shutdown_connections 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f64d403dd60 0x7f64d4040220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f650413ee90 0x7f650413a6f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f650413b380 0x7f650413a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 --2- 10.20.193.51:0/1175635441 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65040a3bb0 0x7f65041cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.808+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 >> 10.20.193.51:0/1175635441 conn(0x7f65040a30c0 msgr2=0x7f650409f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.809+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 shutdown_connections 2026-02-17T11:50:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.809+0000 7f650c1cc640 1 -- 10.20.193.51:0/1175635441 wait complete. 2026-02-17T11:50:40.818 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:50:40.819 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:50:40.819 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.885+0000 7f59aa153640 10 monclient: get_monmap_and_config 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.885+0000 7f59aa153640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.885+0000 7f59aa153640 10 monclient: monmap: 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:40.886919+0000 2026-02-17T11:50:40.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:40.886919+0000 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 Processor -- start 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 -- start start 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient: init 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f59a4138600 0x7f59a41389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-c con 0x7f59a4138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-b con 0x7f59a40a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f59a40a58a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a40a1df0 con 0x7f59a40a58a0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f59a40a6830 con 0x7f59a4138600 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f59a40a2c00 con 0x7f59a40a35a0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59aa153640 10 monclient(hunting): authenticate will time out at 928.505871s 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a3fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f59a40a58a0 0x7f59a413f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34246/0 (socket says 10.20.193.51:34246) 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a3fff640 1 -- 10.20.193.51:0/2289920118 learned_addr learned my addr 10.20.193.51:0/2289920118 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a2ffd640 10 monclient(hunting): get_auth_request con 0x7f59a40a35a0 auth_method 0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.886+0000 7f59a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2289920118 >> v2:10.20.193.142:3300/0 conn(0x7f59a4138600 0x7f59a41389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 msgr2=0x7f59a40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 msgr2=0x7f59a40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a2ffd640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a2ffd640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): get_auth_request con 0x7f59a4138600 auth_method 0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient(hunting): handle_auth_done global_id 64210 payload 274 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 -- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 msgr2=0x7f59a40a5360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 -- 10.20.193.51:0/2289920118 >> v1:10.20.193.51:6789/0 conn(0x7f59a40a58a0 legacy=0x7f59a413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 monclient: found mon.noname-c 2026-02-17T11:50:40.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:40.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.887+0000 7f59a37fe640 1 -- 10.20.193.51:0/2289920118 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a4138f20 con 0x7f59a4138600 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a37fe640 1 -- 10.20.193.51:0/2289920118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a4138600 msgr2=0x7f59a41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a4138600 0x7f59a41389e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f599002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5a1bd88e4d9de1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 1 -- 10.20.193.51:0/2289920118 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599003c070 con 0x7f59a4138600 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: dump: 2026-02-17T11:50:40.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 5 monclient: authenticate success, global_id 64210 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 1 -- 10.20.193.51:0/2289920118 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599002fc00 con 0x7f59a4138600 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 1 -- 10.20.193.51:0/2289920118 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990037440 con 0x7f59a4138600 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59a27fc640 10 monclient: dump: 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:40.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 4 set_mon_vals no callback set 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 10 monclient: shutdown 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 -- 10.20.193.51:0/2289920118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a4138600 msgr2=0x7f59a41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a4138600 0x7f59a41389e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f599002ed80 comp rx=0 tx=0).stop 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 -- 10.20.193.51:0/2289920118 shutdown_connections 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a40a35a0 0x7f59a40a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 --2- 10.20.193.51:0/2289920118 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a4138600 0x7f59a41389e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 -- 10.20.193.51:0/2289920118 >> 10.20.193.51:0/2289920118 conn(0x7f59a40a7460 msgr2=0x7f59a40a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 -- 10.20.193.51:0/2289920118 shutdown_connections 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.890+0000 7f59aa153640 1 -- 10.20.193.51:0/2289920118 wait complete. 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient: monmap: 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 Processor -- start 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 -- start start 2026-02-17T11:50:40.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient: init 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a40a35a0 0x7f59a4136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-b con 0x7f59a40a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 0x7f59a41cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-a con 0x7f59a40a58a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): picked mon.noname-c con 0x7f59a4138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40a25b0 con 0x7f59a40a58a0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40a22d0 con 0x7f59a40a35a0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f59a40a15f0 con 0x7f59a4138600 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59aa153640 10 monclient(hunting): authenticate will time out at 928.510872s 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 0x7f59a41cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60092/0 (socket says 10.20.193.51:60092) 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 -- 10.20.193.51:0/2637536582 learned_addr learned my addr 10.20.193.51:0/2637536582 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 0x7f59a41cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42420/0 (socket says 10.20.193.51:42420) 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 10 monclient(hunting): get_auth_request con 0x7f59a4138600 auth_method 0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 10 monclient(hunting): get_auth_request con 0x7f59a40a58a0 auth_method 0 2026-02-17T11:50:40.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 msgr2=0x7f59a41cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 msgr2=0x7f59a41cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.891+0000 7f59a3fff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a3fff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient(hunting): handle_auth_done global_id 74193 payload 824 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a40a35a0 0x7f59a4136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 msgr2=0x7f59a41cf8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59a4138600 0x7f59a41cf8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a40a35a0 msgr2=0x7f59a4136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a40a35a0 0x7f59a4136690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a4125620 con 0x7f59a40a58a0 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a37fe640 10 monclient: get_auth_request con 0x7f59a40a35a0 auth_method 0 2026-02-17T11:50:40.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.892+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59a40a35a0 0x7f59a4136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59a2ffd640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 msgr2=0x7f59a41cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59a2ffd640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 0x7f59a41cf370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f599400e7e0 tx=0x7f599400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994017070 con 0x7f59a40a58a0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: dump: 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599400cae0 con 0x7f59a40a58a0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 5 monclient: authenticate success, global_id 74193 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 monclient: _renew_subs 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a4128090 con 0x7f59a40a58a0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599400f040 con 0x7f59a40a58a0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59a1ffb640 4 set_mon_vals no callback set 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 10 monclient: dump: 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 monclient: _renew_subs 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a4125da0 con 0x7f59a40a58a0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 0x7f59a4136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40a6ae0 con 0x7f59a41277f0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5994012050 con 0x7f59a40a58a0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.894+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 0x7f59a4136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient: get_auth_request con 0x7f59a41277f0 auth_method 0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 10 monclient(hunting): handle_auth_done global_id 74196 payload 824 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a37fe640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59a40a5360 con 0x7f59a41277f0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f597ffff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f597403dd10 0x7f59740401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(193..193 src has 47..193) ==== 4779+0+0 (secure 0 0 0) 0x7f5994052040 con 0x7f59a40a58a0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a3fff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f597403dd10 0x7f59740401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.895+0000 7f59a3fff640 10 monclient: get_auth_request con 0x7f597403dd10 auth_method 0 2026-02-17T11:50:40.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f59a37fe640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 msgr2=0x7f59a4136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 0x7f59a4136bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5990039000 tx=0x7f59900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599003c040 con 0x7f59a41277f0 2026-02-17T11:50:40.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 10 monclient: dump: 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f5990037de0 con 0x7f59a41277f0 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 msgr2=0x7f59a4136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 0x7f59a4136bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5990039000 tx=0x7f59900047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 msgr2=0x7f59a4136bd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.897+0000 7f597ffff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41277f0 0x7f59a4136bd0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5990039000 tx=0x7f59900047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.898+0000 7f59a3fff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f597403dd10 0x7f59740401d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5998005320 tx=0x7f5998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59aa153640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59aa153640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 0x7f59a41da720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59aa153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f59a41d0200 con 0x7f59a41cfdf0 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 0x7f59a41da720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient: get_auth_request con 0x7f59a41cfdf0 auth_method 0 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.900+0000 7f59a37fe640 10 monclient(hunting): handle_auth_done global_id 74199 payload 824 2026-02-17T11:50:40.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.901+0000 7f59a37fe640 1 -- 10.20.193.51:0/2637536582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59a41cc8f0 con 0x7f59a41cfdf0 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59a37fe640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 msgr2=0x7f59a41da720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59a37fe640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 0x7f59a41da720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f5990008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990050070 con 0x7f59a41cfdf0 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 10 monclient: dump: 2026-02-17T11:50:40.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f599004c3f0 con 0x7f59a41cfdf0 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 msgr2=0x7f59a41da720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 0x7f59a41da720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f5990008030 comp rx=0 tx=0).stop 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 msgr2=0x7f59a41da720 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f597ffff640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a41cfdf0 0x7f59a41da720 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f5990008030 comp rx=0 tx=0).stop 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 58834, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:40.905 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:40.906 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f597403dd10 msgr2=0x7f59740401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f597403dd10 0x7f59740401d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5998005320 tx=0x7f5998009040 comp rx=0 tx=0).stop 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 10 monclient: shutdown 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 msgr2=0x7f59a41cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 --2- 10.20.193.51:0/2637536582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59a40a58a0 0x7f59a41cf370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f599400e7e0 tx=0x7f599400ecb0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59a3fff640 1 -- 10.20.193.51:0/2637536582 reap_dead start 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59a3fff640 1 -- 10.20.193.51:0/2637536582 reap_dead start 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 shutdown_connections 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 >> 10.20.193.51:0/2637536582 conn(0x7f59a40a7460 msgr2=0x7f59a40a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 shutdown_connections 2026-02-17T11:50:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.903+0000 7f59aa153640 1 -- 10.20.193.51:0/2637536582 wait complete. 2026-02-17T11:50:40.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:40.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:50:40.911 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.974+0000 7f1a7cc54640 10 monclient: get_monmap_and_config 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.974+0000 7f1a7cc54640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.974+0000 7f1a7cc54640 10 monclient: monmap: 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:40.975859+0000 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:40.975859+0000 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:40.978 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 Processor -- start 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 -- start start 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient: init 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1a780a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f1a7809dac0 0x7f1a7809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-c con 0x7f1a7809dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a780a0110 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7806e140 con 0x7f1a780a0110 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7809ce60 con 0x7f1a780a3bb0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7809aed0 con 0x7f1a7809dac0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a7cc54640 10 monclient(hunting): authenticate will time out at 928.594669s 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a76d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f1a780a0110 0x7f1a7813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34260/0 (socket says 10.20.193.51:34260) 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a76d76640 1 -- 10.20.193.51:0/2709388476 learned_addr learned my addr 10.20.193.51:0/2709388476 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 1 --2- 10.20.193.51:0/2709388476 >> v2:10.20.193.142:3300/0 conn(0x7f1a7809dac0 0x7f1a7809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 10 monclient(hunting): get_auth_request con 0x7f1a7809dac0 auth_method 0 2026-02-17T11:50:40.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.975+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 10 monclient(hunting): handle_auth_done global_id 64213 payload 274 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 1 -- 10.20.193.51:0/2709388476 >> v1:10.20.193.142:6789/0 conn(0x7f1a780a3bb0 legacy=0x7f1a7809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 1 -- 10.20.193.51:0/2709388476 >> v1:10.20.193.51:6789/0 conn(0x7f1a780a0110 legacy=0x7f1a7813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 1 monclient: found mon.noname-c 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:40.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.976+0000 7f1a75d74640 1 -- 10.20.193.51:0/2709388476 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7809a5c0 con 0x7f1a7809dac0 2026-02-17T11:50:40.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75d74640 1 -- 10.20.193.51:0/2709388476 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a7809dac0 msgr2=0x7f1a7809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75d74640 1 --2- 10.20.193.51:0/2709388476 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a7809dac0 0x7f1a7809fbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a600098a0 tx=0x7f1a6002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43b5a63f86c12f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 1 -- 10.20.193.51:0/2709388476 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6003c070 con 0x7f1a7809dac0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: dump: 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 1 -- 10.20.193.51:0/2709388476 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6002fce0 con 0x7f1a7809dac0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 5 monclient: authenticate success, global_id 64213 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 1 -- 10.20.193.51:0/2709388476 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60037660 con 0x7f1a7809dac0 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 4 set_mon_vals no callback set 2026-02-17T11:50:40.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a75573640 10 monclient: dump: 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 10 monclient: shutdown 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 1 -- 10.20.193.51:0/2709388476 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a7809dac0 msgr2=0x7f1a7809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/2709388476 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a7809dac0 0x7f1a7809fbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a600098a0 tx=0x7f1a6002ed80 comp rx=0 tx=0).stop 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 1 -- 10.20.193.51:0/2709388476 shutdown_connections 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/2709388476 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a7809dac0 0x7f1a7809fbd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.980+0000 7f1a7cc54640 1 -- 10.20.193.51:0/2709388476 >> 10.20.193.51:0/2709388476 conn(0x7f1a780a30c0 msgr2=0x7f1a780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 1 -- 10.20.193.51:0/2709388476 shutdown_connections 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 1 -- 10.20.193.51:0/2709388476 wait complete. 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient: build_initial_monmap 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient: monmap: 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:40.984 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:40.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 1 Processor -- start 2026-02-17T11:50:40.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 1 -- start start 2026-02-17T11:50:40.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient: init 2026-02-17T11:50:40.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:40.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 0x7f1a781cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.981+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-c con 0x7f1a7809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-a con 0x7f1a780a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a780a3bb0 0x7f1a78099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): picked mon.noname-b con 0x7f1a780a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780a3f90 con 0x7f1a780a0110 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7809caa0 con 0x7f1a780a3bb0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780a0540 con 0x7f1a7809dac0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a7cc54640 10 monclient(hunting): authenticate will time out at 928.601024s 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 0x7f1a781cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42432/0 (socket says 10.20.193.51:42432) 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 -- 10.20.193.51:0/3099632345 learned_addr learned my addr 10.20.193.51:0/3099632345 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 10 monclient(hunting): get_auth_request con 0x7f1a7809dac0 auth_method 0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): get_auth_request con 0x7f1a780a0110 auth_method 0 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 msgr2=0x7f1a781cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 msgr2=0x7f1a781cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 0x7f1a781cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 0x7f1a781cf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76d76640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a780a3bb0 0x7f1a78099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76d76640 10 monclient(hunting): get_auth_request con 0x7f1a780a3bb0 auth_method 0 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a76d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient(hunting): handle_auth_done global_id 74202 payload 824 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 msgr2=0x7f1a781cf160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7809dac0 0x7f1a781cf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a780a3bb0 msgr2=0x7f1a78099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a780a3bb0 0x7f1a78099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient: _finish_hunting 0 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 monclient: found mon.noname-a 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.982+0000 7f1a75d74640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a780900f0 con 0x7f1a780a0110 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a75d74640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 msgr2=0x7f1a780999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:40.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a75d74640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a600098a0 tx=0x7f1a600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60046070 con 0x7f1a780a0110 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: dump: 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: _finish_auth 0 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 5 monclient: authenticate success, global_id 74202 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60041870 con 0x7f1a780a0110 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 10 monclient: _renew_subs 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7809d7b0 con 0x7f1a780a0110 2026-02-17T11:50:40.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a74d72640 4 set_mon_vals no callback set 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6003c040 con 0x7f1a780a0110 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a5effd640 10 monclient: dump: 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 10 monclient: _renew_subs 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.984+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a78092170 con 0x7f1a780a0110 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a7cc54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7809e570 con 0x7f1a7808e6d0 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1a60041c60 con 0x7f1a780a0110 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808e6d0 auth_method 0 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a5effd640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(193..193 src has 47..193) ==== 4779+0+0 (secure 0 0 0) 0x7f1a60077ec0 con 0x7f1a780a0110 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76d76640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:40.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.985+0000 7f1a76d76640 10 monclient: get_auth_request con 0x7f1a4403dd10 auth_method 0 2026-02-17T11:50:40.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:40.987+0000 7f1a76d76640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007c90 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:728: done (5 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:730: done (4 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:731: done (3 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:732: done (2 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:734: done (1 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:736: done (0 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:737: delete oid 22 current snap is 92 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:737: done (0 left) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:738: rollback oid 36 current snap is 92 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 69 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:739: read oid 48 snap -1 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:739: expect (ObjNum 258 snap 80 seq_num 258) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:740: read oid 29 snap -1 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:740: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:50:40.993 INFO:tasks.rados.rados.0.trial142.stdout:741: snap_remove snap 80 2026-02-17T11:50:41.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808e6d0 auth_method 0 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:41.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.186+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808e6d0 auth_method 0 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:41.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:41.587+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:741: done (3 left) 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:742: copy_from oid 50 from oid 21 current snap is 92 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:738: finishing rollback tid 1 to trial14245205-36 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:738: finishing rollback tid 2 to trial14245205-36 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 262 (ObjNum 197 snap 58 seq_num 197) dirty exists 2026-02-17T11:50:41.996 INFO:tasks.rados.rados.0.trial142.stdout:739: expect (ObjNum 258 snap 80 seq_num 258) 2026-02-17T11:50:42.075 INFO:tasks.rados.rados.0.trial142.stdout:740: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:50:42.132 INFO:tasks.rados.rados.0.trial142.stdout:742: finishing copy_from to trial14245205-50 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:742: got expected ENOENT (src dne) 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:742: finishing copy_from racing read to trial14245205-50 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:738: done (3 left) 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:739: done (2 left) 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:740: done (1 left) 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:742: done (0 left) 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:743: write oid 40 current snap is 92 2026-02-17T11:50:42.133 INFO:tasks.rados.rados.0.trial142.stdout:743: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-17T11:50:42.137 INFO:tasks.rados.rados.0.trial142.stdout:743: writing trial14245205-40 from 655539 to 1288220 tid 1 2026-02-17T11:50:42.142 INFO:tasks.rados.rados.0.trial142.stdout:743: writing trial14245205-40 from 2076218 to 2646315 tid 2 2026-02-17T11:50:42.142 INFO:tasks.rados.rados.0.trial142.stdout:744: write oid 25 current snap is 92 2026-02-17T11:50:42.142 INFO:tasks.rados.rados.0.trial142.stdout:744: seq_num 278 ranges {672346=707930,2134700=537646} 2026-02-17T11:50:42.147 INFO:tasks.rados.rados.0.trial142.stdout:744: writing trial14245205-25 from 672346 to 1380276 tid 1 2026-02-17T11:50:42.152 INFO:tasks.rados.rados.0.trial142.stdout:744: writing trial14245205-25 from 2134700 to 2672346 tid 2 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:745: read oid 20 snap -1 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:745: expect (ObjNum 253 snap 80 seq_num 253) 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:746: snap_remove snap 69 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: finishing write tid 1 to trial14245205-40 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: finishing write tid 2 to trial14245205-40 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: finishing write tid 3 to trial14245205-40 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: finishing write tid 4 to trial14245205-40 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: oid 40 updating version 0 to 157 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: oid 40 updating version 157 to 158 2026-02-17T11:50:42.153 INFO:tasks.rados.rados.0.trial142.stdout:743: oid 40 updating version 158 to 159 2026-02-17T11:50:42.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 159 (ObjNum 277 snap 92 seq_num 277) dirty exists 2026-02-17T11:50:42.154 INFO:tasks.rados.rados.0.trial142.stdout:743: left oid 40 (ObjNum 277 snap 92 seq_num 277) 2026-02-17T11:50:42.154 INFO:tasks.rados.rados.0.trial142.stdout:744: finishing write tid 1 to trial14245205-25 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808e6d0 auth_method 0 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:42.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:42.388+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:50:43.005 INFO:tasks.rados.rados.0.trial142.stdout:743: done (3 left) 2026-02-17T11:50:43.005 INFO:tasks.rados.rados.0.trial142.stdout:746: done (2 left) 2026-02-17T11:50:43.005 INFO:tasks.rados.rados.0.trial142.stdout:747: read oid 15 snap 84 2026-02-17T11:50:43.005 INFO:tasks.rados.rados.0.trial142.stdout:747: expect deleted 2026-02-17T11:50:43.006 INFO:tasks.rados.rados.0.trial142.stdout:748: snap_create 2026-02-17T11:50:43.006 INFO:tasks.rados.rados.0.trial142.stdout:745: expect (ObjNum 253 snap 80 seq_num 253) 2026-02-17T11:50:43.061 INFO:tasks.rados.rados.0.trial142.stdout:744: finishing write tid 2 to trial14245205-25 2026-02-17T11:50:43.061 INFO:tasks.rados.rados.0.trial142.stdout:744: finishing write tid 3 to trial14245205-25 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:744: finishing write tid 4 to trial14245205-25 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:744: oid 25 updating version 0 to 191 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:744: oid 25 updating version 191 to 193 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:744: oid 25 version 193 is already newer than 192 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 193 (ObjNum 278 snap 92 seq_num 278) dirty exists 2026-02-17T11:50:43.062 INFO:tasks.rados.rados.0.trial142.stdout:744: left oid 25 (ObjNum 278 snap 92 seq_num 278) 2026-02-17T11:50:43.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.982+0000 7f1a5dffb640 10 monclient: tick 2026-02-17T11:50:43.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.982+0000 7f1a5dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:43.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.982+0000 7f1a5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:43.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.982+0000 7f1a5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808e6d0 auth_method 0 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:50:43.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:43.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:43.990+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:50:44.006 INFO:tasks.rados.rados.0.trial142.stdout:744: done (3 left) 2026-02-17T11:50:44.006 INFO:tasks.rados.rados.0.trial142.stdout:745: done (2 left) 2026-02-17T11:50:44.007 INFO:tasks.rados.rados.0.trial142.stdout:747: done (1 left) 2026-02-17T11:50:44.007 INFO:tasks.rados.rados.0.trial142.stdout:748: done (0 left) 2026-02-17T11:50:44.007 INFO:tasks.rados.rados.0.trial142.stdout:749: snap_remove snap 91 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 10 monclient: tick 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:44.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 0x7f1a3c005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 msgr2=0x7f1a7808eab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808e6d0 0x7f1a7808eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a5dffb640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7809e570 con 0x7f1a3c003640 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 0x7f1a3c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a3c003640 auth_method 0 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:44.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:44.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:44.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 10 monclient(hunting): handle_auth_done global_id 84101 payload 824 2026-02-17T11:50:44.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.982+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a3c0061b0 con 0x7f1a3c003640 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 msgr2=0x7f1a3c005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 0x7f1a3c005ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c017e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c003d80 con 0x7f1a3c003640 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:44.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.984+0000 7f1a5effd640 10 monclient: dump: 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:44.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1a6c01c070 con 0x7f1a3c003640 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 msgr2=0x7f1a3c005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 0x7f1a3c005ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c017e40 comp rx=0 tx=0).stop 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 msgr2=0x7f1a3c005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:44.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.985+0000 7f1a5effd640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a3c003640 0x7f1a3c005ad0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c017e40 comp rx=0 tx=0).stop 2026-02-17T11:50:44.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a7cc54640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 0x7f1a781da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a7cc54640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a78090c50 con 0x7f1a7808eff0 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 0x7f1a781da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient: get_auth_request con 0x7f1a7808eff0 auth_method 0 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:44.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:44.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:44.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 10 monclient(hunting): handle_auth_done global_id 84104 payload 824 2026-02-17T11:50:44.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.988+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a780008d0 con 0x7f1a7808eff0 2026-02-17T11:50:44.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a76575640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 msgr2=0x7f1a781da4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:44.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a76575640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 0x7f1a781da4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c0037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:44.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c013aa0 con 0x7f1a7808eff0 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 10 monclient: dump: 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:44.995 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f1a6c013aa0 con 0x7f1a7808eff0 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 msgr2=0x7f1a781da4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 0x7f1a781da4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c0037f0 comp rx=0 tx=0).stop 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 msgr2=0x7f1a781da4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a5effd640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a7808eff0 0x7f1a781da4b0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c017970 tx=0x7f1a6c0037f0 comp rx=0 tx=0).stop 2026-02-17T11:50:44.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a76d76640 1 -- 10.20.193.51:0/3099632345 reap_dead start 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10728, 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:44.997 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:44.998 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:44.999 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:45.001 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:45.002 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:45.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.004 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:45.007 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.008 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:45.009 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:45.010 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.011 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.011 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.011 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:45.011 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 msgr2=0x7f1a440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007c90 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 10 monclient: shutdown 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 msgr2=0x7f1a780999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a600098a0 tx=0x7f1a600047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 shutdown_connections 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 --2- 10.20.193.51:0/3099632345 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a780a0110 0x7f1a780999e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 >> 10.20.193.51:0/3099632345 conn(0x7f1a780a30c0 msgr2=0x7f1a7813bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 shutdown_connections 2026-02-17T11:50:45.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:44.991+0000 7f1a7cc54640 1 -- 10.20.193.51:0/3099632345 wait complete. 2026-02-17T11:50:45.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:45.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:50:45.015 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:50:45.016 INFO:tasks.rados.rados.0.trial142.stdout:749: done (0 left) 2026-02-17T11:50:45.016 INFO:tasks.rados.rados.0.trial142.stdout:750: write oid 2 current snap is 93 2026-02-17T11:50:45.016 INFO:tasks.rados.rados.0.trial142.stdout:750: seq_num 279 ranges {689153=783179,2076829=457413} 2026-02-17T11:50:45.021 INFO:tasks.rados.rados.0.trial142.stdout:750: writing trial14245205-2 from 689153 to 1472332 tid 1 2026-02-17T11:50:45.026 INFO:tasks.rados.rados.0.trial142.stdout:750: writing trial14245205-2 from 2076829 to 2534242 tid 2 2026-02-17T11:50:45.026 INFO:tasks.rados.rados.0.trial142.stdout:751: write oid 19 current snap is 93 2026-02-17T11:50:45.026 INFO:tasks.rados.rados.0.trial142.stdout:750: finishing write tid 1 to trial14245205-2 2026-02-17T11:50:45.026 INFO:tasks.rados.rados.0.trial142.stdout:751: seq_num 280 ranges {705960=458428,1735311=717424} 2026-02-17T11:50:45.030 INFO:tasks.rados.rados.0.trial142.stdout:751: writing trial14245205-19 from 705960 to 1164388 tid 1 2026-02-17T11:50:45.035 INFO:tasks.rados.rados.0.trial142.stdout:751: writing trial14245205-19 from 1735311 to 2452735 tid 2 2026-02-17T11:50:45.035 INFO:tasks.rados.rados.0.trial142.stdout:752: copy_from oid 5 from oid 31 current snap is 93 2026-02-17T11:50:45.035 INFO:tasks.rados.rados.0.trial142.stdout:750: finishing write tid 2 to trial14245205-2 2026-02-17T11:50:45.035 INFO:tasks.rados.rados.0.trial142.stdout:750: finishing write tid 3 to trial14245205-2 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: finishing write tid 4 to trial14245205-2 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: oid 2 updating version 0 to 237 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: oid 2 version 237 is already newer than 236 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: oid 2 version 237 is already newer than 235 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 237 (ObjNum 279 snap 93 seq_num 279) dirty exists 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: left oid 2 (ObjNum 279 snap 93 seq_num 279) 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:750: done (2 left) 2026-02-17T11:50:45.036 INFO:tasks.rados.rados.0.trial142.stdout:753: delete oid 21 current snap is 93 2026-02-17T11:50:45.037 INFO:tasks.rados.rados.0.trial142.stdout:752: finishing copy_from to trial14245205-5 2026-02-17T11:50:45.037 INFO:tasks.rados.rados.0.trial142.stdout:752: got expected ENOENT (src dne) 2026-02-17T11:50:45.037 INFO:tasks.rados.rados.0.trial142.stdout:752: finishing copy_from racing read to trial14245205-5 2026-02-17T11:50:45.037 INFO:tasks.rados.rados.0.trial142.stdout:752: done (2 left) 2026-02-17T11:50:45.038 INFO:tasks.rados.rados.0.trial142.stdout:753: done (1 left) 2026-02-17T11:50:45.038 INFO:tasks.rados.rados.0.trial142.stdout:754: write oid 41 current snap is 93 2026-02-17T11:50:45.038 INFO:tasks.rados.rados.0.trial142.stdout:754: seq_num 282 ranges {739574=725279,1968628=721093} 2026-02-17T11:50:45.042 INFO:tasks.rados.rados.0.trial142.stdout:754: writing trial14245205-41 from 739574 to 1464853 tid 1 2026-02-17T11:50:45.047 INFO:tasks.rados.rados.0.trial142.stdout:754: writing trial14245205-41 from 1968628 to 2689721 tid 2 2026-02-17T11:50:45.047 INFO:tasks.rados.rados.0.trial142.stdout:755: snap_remove snap 79 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 10 monclient: get_monmap_and_config 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 10 monclient: build_initial_monmap 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 10 monclient: monmap: 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:45.083142+0000 2026-02-17T11:50:45.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:45.083142+0000 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:45.085 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 1 Processor -- start 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 1 -- start start 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.082+0000 7faffc5d3640 10 monclient: init 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-b con 0x7faff4138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faff40a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 0x7faff4140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-a con 0x7faff40a5a70 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:45.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff40a1df0 con 0x7faff40a35a0 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7faff40a6830 con 0x7faff40a5a70 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faff40a2c00 con 0x7faff4138600 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffc5d3640 10 monclient(hunting): authenticate will time out at 932.702230s 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 0x7faff4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60192/0 (socket says 10.20.193.51:60192) 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 -- 10.20.193.51:0/4250650424 learned_addr learned my addr 10.20.193.51:0/4250650424 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:45.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): get_auth_request con 0x7faff4138600 auth_method 0 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): get_auth_request con 0x7faff40a5a70 auth_method 0 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient(hunting): handle_auth_done global_id 84107 payload 274 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 -- 10.20.193.51:0/4250650424 >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 msgr2=0x7faff4140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 --2- 10.20.193.51:0/4250650424 >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 0x7faff4140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 -- 10.20.193.51:0/4250650424 >> v1:10.20.193.142:6789/0 conn(0x7faff40a35a0 legacy=0x7faff40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient: _finish_hunting 0 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 monclient: found mon.noname-b 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffa348640 1 -- 10.20.193.51:0/4250650424 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4138f20 con 0x7faff4138600 2026-02-17T11:50:45.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.083+0000 7faffab49640 1 --2- 10.20.193.51:0/4250650424 >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 0x7faff4140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffa348640 1 -- 10.20.193.51:0/4250650424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 msgr2=0x7faff41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffa348640 1 --2- 10.20.193.51:0/4250650424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009970 tx=0x7fafe402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594969e7606b759a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 1 -- 10.20.193.51:0/4250650424 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe403c070 con 0x7faff4138600 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: dump: 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: _finish_auth 0 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: _check_auth_tickets 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 1 -- 10.20.193.51:0/4250650424 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe402fcd0 con 0x7faff4138600 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 5 monclient: authenticate success, global_id 84107 2026-02-17T11:50:45.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 1 -- 10.20.193.51:0/4250650424 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4037660 con 0x7faff4138600 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faff9346640 10 monclient: dump: 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.102 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 4 set_mon_vals no callback set 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 10 monclient: shutdown 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 -- 10.20.193.51:0/4250650424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 msgr2=0x7faff41389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 --2- 10.20.193.51:0/4250650424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009970 tx=0x7fafe402ee90 comp rx=0 tx=0).stop 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 -- 10.20.193.51:0/4250650424 shutdown_connections 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 --2- 10.20.193.51:0/4250650424 >> v2:10.20.193.51:3300/0 conn(0x7faff40a5a70 0x7faff4140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 --2- 10.20.193.51:0/4250650424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff41389e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 -- 10.20.193.51:0/4250650424 >> 10.20.193.51:0/4250650424 conn(0x7faff40a7460 msgr2=0x7faff40a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 -- 10.20.193.51:0/4250650424 shutdown_connections 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 1 -- 10.20.193.51:0/4250650424 wait complete. 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 10 monclient: build_initial_monmap 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.086+0000 7faffc5d3640 10 monclient: monmap: 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:45.104 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 Processor -- start 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 -- start start 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient: init 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 0x7faff41352e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-a con 0x7faff40a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff40a5a70 0x7faff40728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-b con 0x7faff40a5a70 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff4072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): picked mon.noname-c con 0x7faff4138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faff40a25b0 con 0x7faff40a35a0 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faff40a22d0 con 0x7faff40a5a70 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faff40a15f0 con 0x7faff4138600 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:45.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffc5d3640 10 monclient(hunting): authenticate will time out at 932.706315s 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 0x7faff41352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff4072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff4072df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60196/0 (socket says 10.20.193.51:60196) 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 learned_addr learned my addr 10.20.193.51:0/209832212 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): get_auth_request con 0x7faff4138600 auth_method 0 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 0x7faff41352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42466/0 (socket says 10.20.193.51:42466) 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): get_auth_request con 0x7faff40a35a0 auth_method 0 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient(hunting): handle_auth_done global_id 84110 payload 824 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff40a5a70 msgr2=0x7faff40728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff40a5a70 0x7faff40728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 msgr2=0x7faff41352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 0x7faff41352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient: _finish_hunting 0 2026-02-17T11:50:45.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 monclient: found mon.noname-c 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4122a30 con 0x7faff4138600 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.087+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faff40a35a0 0x7faff41352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 msgr2=0x7faff4072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffab49640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff4072df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faff000efc0 tx=0x7faff000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0018030 con 0x7faff4138600 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: dump: 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.109 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: _finish_auth 0 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff000ce00 con 0x7faff4138600 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 5 monclient: authenticate success, global_id 84110 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 10 monclient: _renew_subs 2026-02-17T11:50:45.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff4137e80 con 0x7faff4138600 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0003cb0 con 0x7faff4138600 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7fafdaffd640 10 monclient: dump: 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.111 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faff8b45640 4 set_mon_vals no callback set 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 10 monclient: _renew_subs 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.089+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faff4122750 con 0x7faff4138600 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffc5d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffc5d3640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 0x7faff41c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faff40a4440 con 0x7faff4135820 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faff0014690 con 0x7faff4138600 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 0x7faff41c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient: get_auth_request con 0x7faff4135820 auth_method 0 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7fafdaffd640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafc403dd10 0x7fafc40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(198..198 src has 47..198) ==== 4811+0+0 (secure 0 0 0) 0x7faff0053320 con 0x7faff4138600 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 10 monclient(hunting): handle_auth_done global_id 64219 payload 824 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faffa348640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faff40a5ee0 con 0x7faff4135820 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faff9b47640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafc403dd10 0x7fafc40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.090+0000 7faff9b47640 10 monclient: get_auth_request con 0x7fafc403dd10 auth_method 0 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7faffa348640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 msgr2=0x7faff41c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 0x7faff41c1d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faff406f820 tx=0x7fafe4004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4047070 con 0x7faff4135820 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 10 monclient: dump: 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7faff9b47640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafc403dd10 0x7fafc40401d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faff4122c40 tx=0x7fafe8007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fafe4042650 con 0x7faff4135820 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 msgr2=0x7faff41c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 0x7faff41c1d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faff406f820 tx=0x7fafe4004830 comp rx=0 tx=0).stop 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 msgr2=0x7faff41c1d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:45.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.093+0000 7fafdaffd640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff4135820 0x7faff41c1d50 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faff406f820 tx=0x7fafe4004830 comp rx=0 tx=0).stop 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffc5d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffc5d3640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 0x7faff41da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffc5d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faff4121230 con 0x7faff41c2290 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 0x7faff41da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient: get_auth_request con 0x7faff41c2290 auth_method 0 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 10 monclient(hunting): handle_auth_done global_id 64222 payload 824 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.096+0000 7faffa348640 1 -- 10.20.193.51:0/209832212 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faff4069780 con 0x7faff41c2290 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffa348640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 msgr2=0x7faff41da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffa348640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 0x7faff41da4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafe402eed0 tx=0x7fafe40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4047050 con 0x7faff41c2290 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 10 monclient: dump: 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.118 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7fafe4042e50 con 0x7faff41c2290 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 msgr2=0x7faff41da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 0x7faff41da4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafe402eed0 tx=0x7fafe40047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 msgr2=0x7faff41da4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7fafdaffd640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faff41c2290 0x7faff41da4c0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafe402eed0 tx=0x7fafe40047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:45.119 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 116646, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:45.120 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:45.121 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:45.122 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:45.123 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:45.124 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.125 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:45.126 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.127 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:45.128 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:45.129 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:45.129 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafc403dd10 msgr2=0x7fafc40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fafc403dd10 0x7fafc40401d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faff4122c40 tx=0x7fafe8007ab0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 10 monclient: shutdown 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 msgr2=0x7faff4072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 --2- 10.20.193.51:0/209832212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faff4138600 0x7faff4072df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faff000efc0 tx=0x7faff000c490 comp rx=0 tx=0).stop 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 reap_dead start 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffab49640 1 -- 10.20.193.51:0/209832212 reap_dead start 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 shutdown_connections 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 >> 10.20.193.51:0/209832212 conn(0x7faff40a7460 msgr2=0x7faff40a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 shutdown_connections 2026-02-17T11:50:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.099+0000 7faffc5d3640 1 -- 10.20.193.51:0/209832212 wait complete. 2026-02-17T11:50:45.130 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:45.130 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:50:45.131 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.196+0000 7ffa58256640 10 monclient: get_monmap_and_config 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.196+0000 7ffa58256640 10 monclient: build_initial_monmap 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.196+0000 7ffa58256640 10 monclient: monmap: 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:45.197941+0000 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:45.197941+0000 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.201 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 Processor -- start 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 -- start start 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient: init 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffa500a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-b con 0x7ffa5013b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:45.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 0x7ffa501400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-c con 0x7ffa5013dcb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa50135430 con 0x7ffa500a3bb0 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ffa5009a5c0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5009b520 con 0x7ffa5013b380 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa58256640 10 monclient(hunting): authenticate will time out at 932.816721s 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46158/0 (socket says 10.20.193.51:46158) 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 -- 10.20.193.51:0/3837676946 learned_addr learned my addr 10.20.193.51:0/3837676946 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): get_auth_request con 0x7ffa5013b380 auth_method 0 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 10 monclient(hunting): handle_auth_done global_id 84113 payload 274 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 -- 10.20.193.51:0/3837676946 >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 msgr2=0x7ffa501400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa567cc640 1 --2- 10.20.193.51:0/3837676946 >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 0x7ffa501400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 --2- 10.20.193.51:0/3837676946 >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 0x7ffa501400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.197+0000 7ffa557ca640 1 -- 10.20.193.51:0/3837676946 >> v1:10.20.193.142:6789/0 conn(0x7ffa500a3bb0 legacy=0x7ffa5009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa557ca640 10 monclient: _finish_hunting 0 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa557ca640 1 monclient: found mon.noname-b 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa557ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa557ca640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa557ca640 1 -- 10.20.193.51:0/3837676946 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5009af60 con 0x7ffa5013b380 2026-02-17T11:50:45.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa567cc640 10 monclient: get_auth_request con 0x7ffa5013dcb0 auth_method 0 2026-02-17T11:50:45.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.198+0000 7ffa567cc640 1 --2- 10.20.193.51:0/3837676946 >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 0x7ffa501400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa557ca640 1 -- 10.20.193.51:0/3837676946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 msgr2=0x7ffa5013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa557ca640 1 --2- 10.20.193.51:0/3837676946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa50077290 tx=0x7ffa4402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be922de963c292aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 1 -- 10.20.193.51:0/3837676946 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4403c070 con 0x7ffa5013b380 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: dump: 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: _finish_auth 0 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: _check_auth_tickets 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 1 -- 10.20.193.51:0/3837676946 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4402fd80 con 0x7ffa5013b380 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 1 -- 10.20.193.51:0/3837676946 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44037660 con 0x7ffa5013b380 2026-02-17T11:50:45.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa54fc9640 10 monclient: dump: 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 5 monclient: authenticate success, global_id 84113 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:45.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 4 set_mon_vals no callback set 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 10 monclient: shutdown 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 -- 10.20.193.51:0/3837676946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 msgr2=0x7ffa5013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 --2- 10.20.193.51:0/3837676946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa50077290 tx=0x7ffa4402ee60 comp rx=0 tx=0).stop 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 -- 10.20.193.51:0/3837676946 shutdown_connections 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 --2- 10.20.193.51:0/3837676946 >> v2:10.20.193.142:3300/0 conn(0x7ffa5013dcb0 0x7ffa501400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 --2- 10.20.193.51:0/3837676946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013b380 0x7ffa5013d770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 -- 10.20.193.51:0/3837676946 >> 10.20.193.51:0/3837676946 conn(0x7ffa500a30c0 msgr2=0x7ffa500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 -- 10.20.193.51:0/3837676946 shutdown_connections 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.200+0000 7ffa58256640 1 -- 10.20.193.51:0/3837676946 wait complete. 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient: build_initial_monmap 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient: monmap: 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:45.213 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 Processor -- start 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 -- start start 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient: init 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa500a3bb0 0x7ffa501cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-b con 0x7ffa500a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:45.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-a con 0x7ffa5013b380 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): picked mon.noname-c con 0x7ffa5013dcb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50135040 con 0x7ffa5013b380 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50074ac0 con 0x7ffa500a3bb0 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffa501351c0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa58256640 10 monclient(hunting): authenticate will time out at 932.820909s 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46164/0 (socket says 10.20.193.51:46164) 2026-02-17T11:50:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53952/0 (socket says 10.20.193.51:53952) 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 1 -- 10.20.193.51:0/164314117 learned_addr learned my addr 10.20.193.51:0/164314117 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 10 monclient(hunting): get_auth_request con 0x7ffa5013dcb0 auth_method 0 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa567cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 10 monclient(hunting): get_auth_request con 0x7ffa5013b380 auth_method 0 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.201+0000 7ffa557ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa55fcb640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa500a3bb0 0x7ffa501cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa557ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa55fcb640 10 monclient(hunting): get_auth_request con 0x7ffa500a3bb0 auth_method 0 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa55fcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa55fcb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa55fcb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient(hunting): handle_auth_done global_id 84116 payload 824 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 -- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa500a3bb0 msgr2=0x7ffa501cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa500a3bb0 0x7ffa501cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 -- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 msgr2=0x7ffa50131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient: _finish_hunting 0 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 monclient: found mon.noname-c 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa567cc640 1 -- 10.20.193.51:0/164314117 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa501cc820 con 0x7ffa5013dcb0 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.202+0000 7ffa557ca640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa567cc640 1 -- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 msgr2=0x7ffa501cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa567cc640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00ce40 tx=0x7ffa4c00a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c01a070 con 0x7ffa5013dcb0 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: dump: 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.218 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00da50 con 0x7ffa5013dcb0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00de40 con 0x7ffa5013dcb0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 5 monclient: authenticate success, global_id 84116 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 10 monclient: _renew_subs 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5012b820 con 0x7ffa5013dcb0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3ffff640 4 set_mon_vals no callback set 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 10 monclient: dump: 2026-02-17T11:50:45.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 10 monclient: _renew_subs 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa50139960 con 0x7ffa5013dcb0 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.204+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ffa4c01e3b0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa58256640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:45.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa58256640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa58256640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5009d560 con 0x7ffa5013dcb0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa3e7fc640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 0x7ffa20040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(198..198 src has 47..198) ==== 4811+0+0 (secure 0 0 0) 0x7ffa4c0530f0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa55fcb640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 0x7ffa20040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.205+0000 7ffa55fcb640 10 monclient: get_auth_request con 0x7ffa2003dd60 auth_method 0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.207+0000 7ffa55fcb640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 0x7ffa20040220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006fd0 tx=0x7ffa40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.207+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffa501cc820 con 0x7ffa5013dcb0 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.207+0000 7ffa3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:45.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.207+0000 7ffa3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:45.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa58256640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:50:45.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa58256640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:50:45.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa58256640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:45.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ffa501392a0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa3e7fc640 1 -- 10.20.193.51:0/164314117 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ffa4c051ad0 con 0x7ffa5013dcb0 2026-02-17T11:50:45.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:50:45.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.321+0000 7ffa3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:45.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.325 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=4000786498,config=692619927,health=1993131081,kv=4015639851,logm=1948126454}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=2227503085,config=692619927,health=1791238353,kv=325559514,logm=2541567902}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=4000786498,config=692619927,health=1993131081,kv=4015639851,logm=1948126454}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=2634283256,config=692619927,health=1535303502,kv=643764953,logm=1622552842}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134345704}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=929758024}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134345704}) 2026-02-17T11:50:45.326 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2060408852}) 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 msgr2=0x7ffa20040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 0x7ffa20040220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006fd0 tx=0x7ffa40008040 comp rx=0 tx=0).stop 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 10 monclient: shutdown 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 msgr2=0x7ffa501cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00ce40 tx=0x7ffa4c00a710 comp rx=0 tx=0).stop 2026-02-17T11:50:45.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088052090}) 2026-02-17T11:50:45.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=686583274}) 2026-02-17T11:50:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 shutdown_connections 2026-02-17T11:50:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffa2003dd60 0x7ffa20040220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa5013dcb0 0x7ffa501cf2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa5013b380 0x7ffa50131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088052090}) 2026-02-17T11:50:45.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.322+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4258997479}) 2026-02-17T11:50:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 --2- 10.20.193.51:0/164314117 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa500a3bb0 0x7ffa501cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 >> 10.20.193.51:0/164314117 conn(0x7ffa500a30c0 msgr2=0x7ffa5009c700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 shutdown_connections 2026-02-17T11:50:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:45.322+0000 7ffa58256640 1 -- 10.20.193.51:0/164314117 wait complete. 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998614740}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=586331946}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998614740}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2972502344}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770451505}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4062757458}) 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770451505}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2036475225}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078438226}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1409025915}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078438226}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.323+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3501815763}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=664538935}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2350495620}) 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=664538935}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1506156720}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=967495711}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1912942171}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=967495711}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3312155921}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4201132552}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892937659}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4201132552}) 2026-02-17T11:50:45.335 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.324+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3439189405}) 2026-02-17T11:50:45.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:50:45.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.331+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.331+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2658957773}) 2026-02-17T11:50:45.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.332+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=226489604}) 2026-02-17T11:50:45.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.332+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:45.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.332+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2658957773}) 2026-02-17T11:50:45.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:45.332+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1574291458}) 2026-02-17T11:50:46.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1570507157}) 2026-02-17T11:50:46.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1278524903}) 2026-02-17T11:50:46.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1570507157}) 2026-02-17T11:50:46.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.013+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1024243348}) 2026-02-17T11:50:46.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1728708109}) 2026-02-17T11:50:46.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=119147571}) 2026-02-17T11:50:46.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1728708109}) 2026-02-17T11:50:46.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.016+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2975520011}) 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353227535}) 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=325572470}) 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353227535}) 2026-02-17T11:50:46.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3976747251}) 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:755: done (2 left) 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:756: read oid 29 snap -1 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:756: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:757: read oid 9 snap -1 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:757: expect deleted 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:758: read oid 15 snap 75 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:758: expect (ObjNum 140 snap 38 seq_num 140) 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:759: delete oid 14 current snap is 93 2026-02-17T11:50:46.023 INFO:tasks.rados.rados.0.trial142.stdout:751: finishing write tid 1 to trial14245205-19 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: finishing write tid 2 to trial14245205-19 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: finishing write tid 3 to trial14245205-19 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: finishing write tid 4 to trial14245205-19 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: oid 19 updating version 0 to 351 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: oid 19 updating version 351 to 352 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: oid 19 version 352 is already newer than 350 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 352 (ObjNum 280 snap 93 seq_num 280) dirty exists 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:751: left oid 19 (ObjNum 280 snap 93 seq_num 280) 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:754: finishing write tid 1 to trial14245205-41 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:754: finishing write tid 2 to trial14245205-41 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:754: finishing write tid 3 to trial14245205-41 2026-02-17T11:50:46.024 INFO:tasks.rados.rados.0.trial142.stdout:754: finishing write tid 4 to trial14245205-41 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:754: oid 41 updating version 0 to 238 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:754: oid 41 updating version 238 to 239 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:754: oid 41 updating version 239 to 240 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 240 (ObjNum 282 snap 93 seq_num 282) dirty exists 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:754: left oid 41 (ObjNum 282 snap 93 seq_num 282) 2026-02-17T11:50:46.025 INFO:tasks.rados.rados.0.trial142.stdout:756: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:50:46.079 INFO:tasks.rados.rados.0.trial142.stdout:758: expect (ObjNum 140 snap 38 seq_num 140) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:751: done (5 left) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:754: done (4 left) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:756: done (3 left) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:757: done (2 left) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:758: done (1 left) 2026-02-17T11:50:46.141 INFO:tasks.rados.rados.0.trial142.stdout:759: done (0 left) 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:760: read oid 42 snap -1 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:760: expect deleted 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:761: read oid 34 snap -1 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:761: expect deleted 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:762: read oid 28 snap -1 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:762: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:50:46.142 INFO:tasks.rados.rados.0.trial142.stdout:763: snap_remove snap 86 2026-02-17T11:50:46.176 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.177 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2158797914}) 2026-02-17T11:50:46.177 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2743302219}) 2026-02-17T11:50:46.177 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.177 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2158797914}) 2026-02-17T11:50:46.177 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.175+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=909203716}) 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022740705}) 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1202924758}) 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022740705}) 2026-02-17T11:50:46.184 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.183+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1456635193}) 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3480576281}) 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=984238114}) 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3480576281}) 2026-02-17T11:50:46.188 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1322561637}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=87,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=3666112907,mdsmap=3207544932,mgr=386329862,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1116067492}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=93,mdsmap=3,mgr=4} crc {logm=3864587611,mdsmap=3207544932,mgr=760247256}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=87,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=3666112907,mdsmap=3207544932,mgr=386329862,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1116067492}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.187+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=86,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=2511173805,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1116067492}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=29,osdmap=39} crc {mgrstat=957808306,mon_config_key=2551492584,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=351180295,osd_snap=2153626470,osdmap=2648453612}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=9,mon_config_key=13,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=29,osdmap=40} crc {mgrstat=3589907668,mon_config_key=3390328712,monmap=1614227249,osd_metadata=3956758304,osd_pg_creating=351180295,osd_snap=2093818397,osdmap=2586401754}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=29,osdmap=39} crc {mgrstat=957808306,mon_config_key=2551492584,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=351180295,osd_snap=2153626470,osdmap=2648453612}) 2026-02-17T11:50:46.189 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=31,osdmap=37} crc {mgrstat=957808306,mon_config_key=3390328712,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=351180295,osd_snap=781452773,osdmap=2350784083}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=616157736}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=326698793}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=616157736}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.188+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1603206001}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3811494657}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=170091278}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3811494657}) 2026-02-17T11:50:46.190 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:50:46.189+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2012551379}) 2026-02-17T11:50:46.337 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:50:46.338 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:46.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 10 monclient: get_monmap_and_config 2026-02-17T11:50:46.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 10 monclient: monmap: 2026-02-17T11:50:46.411 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:46.407305+0000 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:46.407305+0000 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:46.412 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 1 Processor -- start 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 1 -- start start 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.406+0000 7f524cf87640 10 monclient: init 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-b con 0x7f52480a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52480a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f524813b760 0x7f524813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-a con 0x7f524813b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524806e140 con 0x7f52480a0750 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f524809f910 con 0x7f524813b760 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f524809ccd0 con 0x7f52480a3bb0 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f524cf87640 10 monclient(hunting): authenticate will time out at 934.026109s 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f524813b760 0x7f524813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46168/0 (socket says 10.20.193.51:46168) 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 1 -- 10.20.193.51:0/3471637712 learned_addr learned my addr 10.20.193.51:0/3471637712 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): get_auth_request con 0x7f52480a3bb0 auth_method 0 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): get_auth_request con 0x7f524813b760 auth_method 0 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient(hunting): handle_auth_done global_id 74214 payload 274 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 -- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 msgr2=0x7f524809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 -- 10.20.193.51:0/3471637712 >> v1:10.20.193.142:6789/0 conn(0x7f52480a0750 legacy=0x7f524809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 monclient: found mon.noname-a 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246d76640 1 -- 10.20.193.51:0/3471637712 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524809eec0 con 0x7f524813b760 2026-02-17T11:50:46.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.407+0000 7f5246575640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.409+0000 7f5246d76640 1 -- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 msgr2=0x7f524813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.409+0000 7f5246d76640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f524813db50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f524809f230 tx=0x7f523802f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d51f178a88d63 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 1 -- 10.20.193.51:0/3471637712 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523803c070 con 0x7f524813b760 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: dump: 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 1 -- 10.20.193.51:0/3471637712 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5238037440 con 0x7f524813b760 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 1 -- 10.20.193.51:0/3471637712 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238037810 con 0x7f524813b760 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 5 monclient: authenticate success, global_id 74214 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 4 set_mon_vals no callback set 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f5245573640 10 monclient: dump: 2026-02-17T11:50:46.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 10 monclient: shutdown 2026-02-17T11:50:46.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 -- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 msgr2=0x7f524813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f524813db50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f524809f230 tx=0x7f523802f150 comp rx=0 tx=0).stop 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 -- 10.20.193.51:0/3471637712 shutdown_connections 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f524813db50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 --2- 10.20.193.51:0/3471637712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f524809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 -- 10.20.193.51:0/3471637712 >> 10.20.193.51:0/3471637712 conn(0x7f52480a30c0 msgr2=0x7f52480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 -- 10.20.193.51:0/3471637712 shutdown_connections 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 1 -- 10.20.193.51:0/3471637712 wait complete. 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.410+0000 7f524cf87640 10 monclient: monmap: 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 Processor -- start 2026-02-17T11:50:46.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 -- start start 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient: init 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f52480a0750 0x7f5248097230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-b con 0x7f52480a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-c con 0x7f52480a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): picked mon.noname-a con 0x7f524813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f52480a04b0 con 0x7f524813b760 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f524809c850 con 0x7f52480a0750 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f524809e710 con 0x7f52480a3bb0 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f524cf87640 10 monclient(hunting): authenticate will time out at 934.030449s 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53960/0 (socket says 10.20.193.51:53960) 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 1 -- 10.20.193.51:0/1838259015 learned_addr learned my addr 10.20.193.51:0/1838259015 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46184/0 (socket says 10.20.193.51:46184) 2026-02-17T11:50:46.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): get_auth_request con 0x7f52480a3bb0 auth_method 0 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): get_auth_request con 0x7f524813b760 auth_method 0 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246575640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f52480a0750 0x7f5248097230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246575640 10 monclient(hunting): get_auth_request con 0x7f52480a0750 auth_method 0 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient(hunting): handle_auth_done global_id 84122 payload 824 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 -- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f52480a0750 msgr2=0x7f5248097230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f52480a0750 0x7f5248097230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 -- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 msgr2=0x7f5248094750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 monclient: found mon.noname-c 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5245d74640 1 -- 10.20.193.51:0/1838259015 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52480a2ac0 con 0x7f52480a3bb0 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.411+0000 7f5246d76640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f5245d74640 1 -- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 msgr2=0x7f5248094210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f5245d74640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5248074fa0 tx=0x7f523000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230016020 con 0x7f52480a3bb0 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: dump: 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f524cf87640 5 monclient: authenticate success, global_id 84122 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5230012a60 con 0x7f52480a3bb0 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230012e50 con 0x7f52480a3bb0 2026-02-17T11:50:46.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f522effd640 10 monclient: dump: 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f5244d72640 4 set_mon_vals no callback set 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f524cf87640 10 monclient: _renew_subs 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f524cf87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.413+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524809d7b0 con 0x7f52480a3bb0 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 10 monclient: _renew_subs 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5248097b60 con 0x7f52480a3bb0 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248095e30 con 0x7f52480a3bb0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f523001b400 con 0x7f52480a3bb0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f522effd640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 0x7f5214040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.414+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f5230052630 con 0x7f52480a3bb0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.415+0000 7f5246575640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 0x7f5214040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.415+0000 7f5246575640 10 monclient: get_auth_request con 0x7f521403deb0 auth_method 0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.417+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5248095e30 con 0x7f52480a3bb0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.417+0000 7f522effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.417+0000 7f522effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:46.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.417+0000 7f5246575640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 0x7f5214040370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5248095a30 tx=0x7f523c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f524cf87640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f524cf87640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f524cf87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f524809dac0 con 0x7f52480a3bb0 2026-02-17T11:50:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f522effd640 1 -- 10.20.193.51:0/1838259015 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f523003f020 con 0x7f52480a3bb0 2026-02-17T11:50:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f522effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:46.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.530+0000 7f522effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:46.533 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 msgr2=0x7f5214040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 0x7f5214040370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5248095a30 tx=0x7f523c008040 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 10 monclient: shutdown 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 msgr2=0x7f5248094210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5248074fa0 tx=0x7f523000c8f0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 shutdown_connections 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f521403deb0 0x7f5214040370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f524813b760 0x7f5248094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f52480a3bb0 0x7f5248094210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 --2- 10.20.193.51:0/1838259015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f52480a0750 0x7f5248097230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 >> 10.20.193.51:0/1838259015 conn(0x7f52480a30c0 msgr2=0x7f524809bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 shutdown_connections 2026-02-17T11:50:46.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.531+0000 7f524cf87640 1 -- 10.20.193.51:0/1838259015 wait complete. 2026-02-17T11:50:46.541 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:50:46.541 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:50:46.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:50:46.541 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:50:46.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.608+0000 7f693971c640 10 monclient: get_monmap_and_config 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.608+0000 7f693971c640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.608+0000 7f693971c640 10 monclient: monmap: 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:46.609928+0000 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:46.609928+0000 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.623 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 Processor -- start 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 -- start start 2026-02-17T11:50:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient: init 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): picked mon.noname-a con 0x7f69340a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f693409dac0 0x7f693409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): picked mon.noname-c con 0x7f693409dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): picked mon.noname-b con 0x7f693409ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f693409aed0 con 0x7f69340a3bb0 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f693409caa0 con 0x7f693409dac0 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f69340a3f90 con 0x7f693409ff40 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f693971c640 10 monclient(hunting): authenticate will time out at 934.228677s 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46186/0 (socket says 10.20.193.51:46186) 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53966/0 (socket says 10.20.193.51:53966) 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 -- 10.20.193.51:0/1881608766 learned_addr learned my addr 10.20.193.51:0/1881608766 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): get_auth_request con 0x7f693409ff40 auth_method 0 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): get_auth_request con 0x7f69340a3bb0 auth_method 0 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69327fc640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.142:3300/0 conn(0x7f693409dac0 0x7f693409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69327fc640 10 monclient(hunting): get_auth_request con 0x7f693409dac0 auth_method 0 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient(hunting): handle_auth_done global_id 84125 payload 274 2026-02-17T11:50:46.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 -- 10.20.193.51:0/1881608766 >> v2:10.20.193.142:3300/0 conn(0x7f693409dac0 msgr2=0x7f693409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.142:3300/0 conn(0x7f693409dac0 0x7f693409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 -- 10.20.193.51:0/1881608766 >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 msgr2=0x7f693409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 monclient: found mon.noname-b 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f69337fe640 1 -- 10.20.193.51:0/1881608766 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693406e140 con 0x7f693409ff40 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.609+0000 7f6932ffd640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f69337fe640 1 -- 10.20.193.51:0/1881608766 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 msgr2=0x7f693413b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f69337fe640 1 --2- 10.20.193.51:0/1881608766 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f693406dc20 tx=0x7f692402f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b99a7f05b5c640c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 1 -- 10.20.193.51:0/1881608766 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692402fe50 con 0x7f693409ff40 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: dump: 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.630 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 5 monclient: authenticate success, global_id 84125 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 1 -- 10.20.193.51:0/1881608766 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69240373f0 con 0x7f693409ff40 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 1 -- 10.20.193.51:0/1881608766 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69240377c0 con 0x7f693409ff40 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 4 set_mon_vals no callback set 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f6931ffb640 10 monclient: dump: 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.632 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 10 monclient: shutdown 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 -- 10.20.193.51:0/1881608766 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 msgr2=0x7f693413b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 --2- 10.20.193.51:0/1881608766 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f693406dc20 tx=0x7f692402f1e0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 -- 10.20.193.51:0/1881608766 shutdown_connections 2026-02-17T11:50:46.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 --2- 10.20.193.51:0/1881608766 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f693413b750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.142:3300/0 conn(0x7f693409dac0 0x7f693409fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 --2- 10.20.193.51:0/1881608766 >> v2:10.20.193.51:3300/0 conn(0x7f69340a3bb0 0x7f693409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 -- 10.20.193.51:0/1881608766 >> 10.20.193.51:0/1881608766 conn(0x7f69340a30c0 msgr2=0x7f69340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 -- 10.20.193.51:0/1881608766 shutdown_connections 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.612+0000 7f693971c640 1 -- 10.20.193.51:0/1881608766 wait complete. 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient: monmap: 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:46.634 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 Processor -- start 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 -- start start 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient: init 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f693409dac0 0x7f69341cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): picked mon.noname-b con 0x7f693409dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f69341cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): picked mon.noname-c con 0x7f693409ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): picked mon.noname-a con 0x7f69340a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f69340a0370 con 0x7f69340a3bb0 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f693409a880 con 0x7f693409dac0 2026-02-17T11:50:46.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f69340a04f0 con 0x7f693409ff40 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f693971c640 10 monclient(hunting): authenticate will time out at 934.232811s 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f69341cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53968/0 (socket says 10.20.193.51:53968) 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 learned_addr learned my addr 10.20.193.51:0/740445824 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): get_auth_request con 0x7f69340a3bb0 auth_method 0 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): get_auth_request con 0x7f693409ff40 auth_method 0 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69327fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f693409dac0 0x7f69341cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient(hunting): handle_auth_done global_id 74223 payload 824 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 msgr2=0x7f69341cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f693409ff40 0x7f69341cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f693409dac0 msgr2=0x7f69341cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f693409dac0 0x7f69341cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 monclient: found mon.noname-a 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.613+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693409d7b0 con 0x7f69340a3bb0 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.614+0000 7f6932ffd640 10 monclient: get_auth_request con 0x7f693409dac0 auth_method 0 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.614+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f693409dac0 0x7f69341cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:46.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 msgr2=0x7f69340947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69337fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6924009f50 tx=0x7f6924004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924046020 con 0x7f69340a3bb0 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: dump: 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.640 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6924041450 con 0x7f69340a3bb0 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 5 monclient: authenticate success, global_id 74223 2026-02-17T11:50:46.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 monclient: _renew_subs 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69340980f0 con 0x7f69340a3bb0 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924041840 con 0x7f69340a3bb0 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69317fa640 4 set_mon_vals no callback set 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 10 monclient: dump: 2026-02-17T11:50:46.642 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 monclient: _renew_subs 2026-02-17T11:50:46.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693409f910 con 0x7f69340a3bb0 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 0x7f693408f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f693409e370 con 0x7f69341cfd10 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 0x7f693408f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient: get_auth_request con 0x7f69341cfd10 auth_method 0 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.616+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6924053060 con 0x7f69340a3bb0 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f6932ffd640 10 monclient(hunting): handle_auth_done global_id 74226 payload 824 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f6932ffd640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69340963c0 con 0x7f69341cfd10 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f69137fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f690003dd40 0x7f6900040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f6924077cd0 con 0x7f69340a3bb0 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f69327fc640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f690003dd40 0x7f6900040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.617+0000 7f69327fc640 10 monclient: get_auth_request con 0x7f690003dd40 auth_method 0 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f6932ffd640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 msgr2=0x7f693408f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 0x7f693408f400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69280107c0 tx=0x7f6928010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692800f040 con 0x7f69341cfd10 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 10 monclient: dump: 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f692801c400 con 0x7f69341cfd10 2026-02-17T11:50:46.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 msgr2=0x7f693408f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 0x7f693408f400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69280107c0 tx=0x7f6928010c90 comp rx=0 tx=0).stop 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 msgr2=0x7f693408f400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.619+0000 7f69137fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69341cfd10 0x7f693408f400 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69280107c0 tx=0x7f6928010c90 comp rx=0 tx=0).stop 2026-02-17T11:50:46.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.620+0000 7f69327fc640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f690003dd40 0x7f6900040200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6934097d40 tx=0x7f691c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f693971c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f693971c640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 0x7f69341da3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f693971c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f69340a1c30 con 0x7f693408f940 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 0x7f69341da3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient: get_auth_request con 0x7f693408f940 auth_method 0 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 10 monclient(hunting): handle_auth_done global_id 74229 payload 824 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.622+0000 7f6932ffd640 1 -- 10.20.193.51:0/740445824 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69340008d0 con 0x7f693408f940 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f6932ffd640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 msgr2=0x7f69341da3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f6932ffd640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 0x7f69341da3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f692801b000 tx=0x7f69280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928003230 con 0x7f693408f940 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 10 monclient: dump: 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.651 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f6928003230 con 0x7f693408f940 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 msgr2=0x7f69341da3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 0x7f69341da3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f692801b000 tx=0x7f69280047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 msgr2=0x7f69341da3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69137fe640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f693408f940 0x7f69341da3b0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f692801b000 tx=0x7f69280047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 64556, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:46.653 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.654 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:46.655 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.656 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:46.657 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.658 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:46.659 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.660 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.661 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:46.662 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.663 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.663 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.663 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:46.663 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f690003dd40 msgr2=0x7f6900040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f690003dd40 0x7f6900040200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6934097d40 tx=0x7f691c008040 comp rx=0 tx=0).stop 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 10 monclient: shutdown 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 msgr2=0x7f69340947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6924009f50 tx=0x7f6924004b40 comp rx=0 tx=0).stop 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f69337fe640 1 -- 10.20.193.51:0/740445824 reap_dead start 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 shutdown_connections 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 --2- 10.20.193.51:0/740445824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69340a3bb0 0x7f69340947a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 >> 10.20.193.51:0/740445824 conn(0x7f69340a30c0 msgr2=0x7f6934073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 shutdown_connections 2026-02-17T11:50:46.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.625+0000 7f693971c640 1 -- 10.20.193.51:0/740445824 wait complete. 2026-02-17T11:50:46.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:46.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:50:46.665 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.732+0000 7feddf351640 10 monclient: get_monmap_and_config 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.732+0000 7feddf351640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.732+0000 7feddf351640 10 monclient: monmap: 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:46.733625+0000 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:46.733625+0000 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.734 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:46.735 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 Processor -- start 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 -- start start 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient: init 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fedd80a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fedd80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fedd813c770 0x7fedd813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): picked mon.noname-c con 0x7fedd813c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd809e8e0 con 0x7fedd80a0750 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd806e140 con 0x7fedd80a3bb0 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fedd809f910 con 0x7fedd813c770 2026-02-17T11:50:46.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddf351640 10 monclient(hunting): authenticate will time out at 934.352434s 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddc8c5640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fedd80a0750 0x7fedd809e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58294/0 (socket says 10.20.193.51:58294) 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddc8c5640 1 -- 10.20.193.51:0/3485403519 learned_addr learned my addr 10.20.193.51:0/3485403519 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddd8c7640 1 --2- 10.20.193.51:0/3485403519 >> v2:10.20.193.142:3300/0 conn(0x7fedd813c770 0x7fedd813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddd8c7640 10 monclient(hunting): get_auth_request con 0x7fedd813c770 auth_method 0 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddd8c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddd8c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.733+0000 7feddd8c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddc8c5640 1 -- 10.20.193.51:0/3485403519 >> v1:10.20.193.51:6789/0 conn(0x7fedd80a0750 legacy=0x7fedd809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd0c6640 1 -- 10.20.193.51:0/3485403519 >> v1:10.20.193.142:6789/0 conn(0x7fedd80a3bb0 legacy=0x7fedd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 1 -- 10.20.193.51:0/3485403519 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887034014 0 0) 0x7fedd809e8e0 con 0x7fedd80a0750 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 10 monclient(hunting): _negotiate 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 10 monclient(hunting): my global_id is 74232 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7fedc7fff640 1 -- 10.20.193.51:0/3485403519 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0003620 con 0x7fedd80a0750 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient(hunting): handle_auth_done global_id 64234 payload 274 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 1 -- 10.20.193.51:0/3485403519 >> v1:10.20.193.142:6789/0 conn(0x7fedd80a3bb0 legacy=0x7fedd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 1 -- 10.20.193.51:0/3485403519 >> v1:10.20.193.51:6789/0 conn(0x7fedd80a0750 legacy=0x7fedd809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 1 monclient: found mon.noname-c 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:46.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.735+0000 7feddd8c7640 1 -- 10.20.193.51:0/3485403519 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd809ccd0 con 0x7fedd813c770 2026-02-17T11:50:46.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7feddd8c7640 1 -- 10.20.193.51:0/3485403519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 msgr2=0x7fedd813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7feddd8c7640 1 --2- 10.20.193.51:0/3485403519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd813eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009e90 tx=0x7fedd402f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9647c4822a4ffaeb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 1 -- 10.20.193.51:0/3485403519 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0031b0 con 0x7fedd813c770 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: dump: 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.743 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 1 -- 10.20.193.51:0/3485403519 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd4037440 con 0x7fedd813c770 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7feddf351640 5 monclient: authenticate success, global_id 64234 2026-02-17T11:50:46.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 1 -- 10.20.193.51:0/3485403519 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4037810 con 0x7fedd813c770 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7feddf351640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7feddf351640 4 set_mon_vals no callback set 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.738+0000 7fedc7fff640 10 monclient: dump: 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 10 monclient: shutdown 2026-02-17T11:50:46.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- 10.20.193.51:0/3485403519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 msgr2=0x7fedd813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 --2- 10.20.193.51:0/3485403519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd813eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009e90 tx=0x7fedd402f260 comp rx=0 tx=0).stop 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- 10.20.193.51:0/3485403519 shutdown_connections 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 --2- 10.20.193.51:0/3485403519 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd813eb60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- 10.20.193.51:0/3485403519 >> 10.20.193.51:0/3485403519 conn(0x7fedd80a30c0 msgr2=0x7fedd80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- 10.20.193.51:0/3485403519 shutdown_connections 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- 10.20.193.51:0/3485403519 wait complete. 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 10 monclient: monmap: 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.746 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 Processor -- start 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 1 -- start start 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.739+0000 7feddf351640 10 monclient: init 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 0x7fedd80994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): picked mon.noname-a con 0x7fedd80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80a3bb0 0x7fedd8099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): picked mon.noname-c con 0x7fedd80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd8090060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): picked mon.noname-b con 0x7fedd813c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fedd809c850 con 0x7fedd80a0750 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fedd809ebe0 con 0x7fedd813c770 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80a04b0 con 0x7fedd80a3bb0 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddf351640 10 monclient(hunting): authenticate will time out at 934.359136s 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 0x7fedd80994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 0x7fedd80994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54004/0 (socket says 10.20.193.51:54004) 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 -- 10.20.193.51:0/1951751335 learned_addr learned my addr 10.20.193.51:0/1951751335 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): get_auth_request con 0x7fedd80a0750 auth_method 0 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80a3bb0 0x7fedd8099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): get_auth_request con 0x7fedd80a3bb0 auth_method 0 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd8c7640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd8090060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient(hunting): handle_auth_done global_id 74235 payload 824 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80a3bb0 msgr2=0x7fedd8099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80a3bb0 0x7fedd8099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 msgr2=0x7fedd8090060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedd813c770 0x7fedd8090060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 monclient: found mon.noname-a 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.740+0000 7feddd0c6640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd813e530 con 0x7fedd80a0750 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddd0c6640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 msgr2=0x7fedd80994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddd0c6640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 0x7fedd80994c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedc800c730 tx=0x7fedc800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8017070 con 0x7fedd80a0750 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: dump: 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.754 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc8005cd0 con 0x7fedd80a0750 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 5 monclient: authenticate success, global_id 74235 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 10 monclient: _renew_subs 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd8093990 con 0x7fedd80a0750 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8007290 con 0x7fedd80a0750 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc5ffb640 10 monclient: dump: 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7fedc77fe640 4 set_mon_vals no callback set 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 10 monclient: _renew_subs 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.742+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd8092540 con 0x7fedd80a0750 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddf351640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddf351640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 0x7fedd8090980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fedd8092830 con 0x7fedd80905a0 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 0x7fedd8090980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient: get_auth_request con 0x7fedd80905a0 auth_method 0 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 10 monclient(hunting): handle_auth_done global_id 84134 payload 824 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddc8c5640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedd8090ec0 con 0x7fedd80905a0 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fedc80074b0 con 0x7fedd80a0750 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7fedc5ffb640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feda803dd10 0x7feda80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7fedc8051d10 con 0x7fedd80a0750 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddd8c7640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feda803dd10 0x7feda80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.743+0000 7feddd8c7640 10 monclient: get_auth_request con 0x7feda803dd10 auth_method 0 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7feddc8c5640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 msgr2=0x7fedd8090980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7feddc8c5640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 0x7fedd8090980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedd813c740 tx=0x7fedcc007730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00fc00 con 0x7fedd80905a0 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 10 monclient: dump: 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.758 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fedcc018070 con 0x7fedd80905a0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 msgr2=0x7fedd8090980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 0x7fedd8090980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedd813c740 tx=0x7fedcc007730 comp rx=0 tx=0).stop 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 msgr2=0x7fedd8090980 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.745+0000 7fedc5ffb640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80905a0 0x7fedd8090980 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedd813c740 tx=0x7fedcc007730 comp rx=0 tx=0).stop 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.746+0000 7feddd8c7640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feda803dd10 0x7feda80401d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fedd4038000 tx=0x7fedd4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddf351640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddf351640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 0x7fedd81d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddf351640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80936b0 con 0x7fedd80724a0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddc8c5640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 0x7fedd81d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddc8c5640 10 monclient: get_auth_request con 0x7fedd80724a0 auth_method 0 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddc8c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddc8c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.748+0000 7feddc8c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.749+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.749+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.749+0000 7feddc8c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.749+0000 7feddc8c5640 10 monclient(hunting): handle_auth_done global_id 84137 payload 824 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.749+0000 7feddc8c5640 1 -- 10.20.193.51:0/1951751335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fedd809dac0 con 0x7fedd80724a0 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddc8c5640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 msgr2=0x7fedd81d7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddc8c5640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 0x7fedd81d7e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fedcc014000 tx=0x7fedcc002c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc013810 con 0x7fedd80724a0 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 10 monclient: dump: 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.760 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fedcc013810 con 0x7fedd80724a0 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 msgr2=0x7fedd81d7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 0x7fedd81d7e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fedcc014000 tx=0x7fedcc002c70 comp rx=0 tx=0).stop 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 msgr2=0x7fedd81d7e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7fedc5ffb640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedd80724a0 0x7fedd81d7e50 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fedcc014000 tx=0x7fedcc002c70 comp rx=0 tx=0).stop 2026-02-17T11:50:46.761 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12488, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.762 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.763 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.764 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.765 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.766 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.767 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.768 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.769 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.770 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.771 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.771 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:46.771 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feda803dd10 msgr2=0x7feda80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feda803dd10 0x7feda80401d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fedd4038000 tx=0x7fedd4033000 comp rx=0 tx=0).stop 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 10 monclient: shutdown 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 msgr2=0x7fedd80994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 --2- 10.20.193.51:0/1951751335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedd80a0750 0x7fedd80994c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedc800c730 tx=0x7fedc800cc00 comp rx=0 tx=0).stop 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddd8c7640 1 -- 10.20.193.51:0/1951751335 reap_dead start 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddd8c7640 1 -- 10.20.193.51:0/1951751335 reap_dead start 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 shutdown_connections 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 >> 10.20.193.51:0/1951751335 conn(0x7fedd80a30c0 msgr2=0x7fedd80a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 shutdown_connections 2026-02-17T11:50:46.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.751+0000 7feddf351640 1 -- 10.20.193.51:0/1951751335 wait complete. 2026-02-17T11:50:46.773 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:46.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:50:46.773 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 10 monclient: get_monmap_and_config 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 10 monclient: monmap: 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:46.839421+0000 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:46.839421+0000 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:46.842 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 1 Processor -- start 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 1 -- start start 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.838+0000 7f60933a8640 10 monclient: init 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f608c0a3bb0 0x7f608c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-a con 0x7f608c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f608c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-b con 0x7f608c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608c06e140 con 0x7f608c0a0750 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f608c09f910 con 0x7f608c0a3bb0 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f608c09ccd0 con 0x7f608c13b760 2026-02-17T11:50:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f60933a8640 10 monclient(hunting): authenticate will time out at 934.458198s 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f608c0a3bb0 0x7f608c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609091c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f608c0a0750 0x7f608c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58304/0 (socket says 10.20.193.51:58304) 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609091c640 1 -- 10.20.193.51:0/3631195598 learned_addr learned my addr 10.20.193.51:0/3631195598 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): get_auth_request con 0x7f608c0a3bb0 auth_method 0 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): get_auth_request con 0x7f608c13b760 auth_method 0 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient(hunting): handle_auth_done global_id 74238 payload 274 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 -- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 msgr2=0x7f608c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 -- 10.20.193.51:0/3631195598 >> v1:10.20.193.51:6789/0 conn(0x7f608c0a0750 legacy=0x7f608c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 monclient: found mon.noname-a 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609111d640 1 -- 10.20.193.51:0/3631195598 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c09eec0 con 0x7f608c0a3bb0 2026-02-17T11:50:46.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.839+0000 7f609191e640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:46.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f609111d640 1 -- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 msgr2=0x7f608c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f609111d640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c09dac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f608c06c1c0 tx=0x7f607c02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c89b595b7c72f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 1 -- 10.20.193.51:0/3631195598 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c03c070 con 0x7f608c0a3bb0 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: dump: 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 1 -- 10.20.193.51:0/3631195598 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c02fbd0 con 0x7f608c0a3bb0 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 5 monclient: authenticate success, global_id 74238 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 1 -- 10.20.193.51:0/3631195598 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c037440 con 0x7f608c0a3bb0 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f607bfff640 10 monclient: dump: 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 4 set_mon_vals no callback set 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 10 monclient: shutdown 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 -- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 msgr2=0x7f608c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c09dac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f608c06c1c0 tx=0x7f607c02ed50 comp rx=0 tx=0).stop 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 -- 10.20.193.51:0/3631195598 shutdown_connections 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 --2- 10.20.193.51:0/3631195598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c09dac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 -- 10.20.193.51:0/3631195598 >> 10.20.193.51:0/3631195598 conn(0x7f608c0a30c0 msgr2=0x7f608c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 -- 10.20.193.51:0/3631195598 shutdown_connections 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 1 -- 10.20.193.51:0/3631195598 wait complete. 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.842+0000 7f60933a8640 10 monclient: monmap: 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 Processor -- start 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 -- start start 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient: init 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c0a0750 0x7f608c138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-b con 0x7f608c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c130e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-a con 0x7f608c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c131360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): picked mon.noname-c con 0x7f608c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f608c0a04b0 con 0x7f608c0a3bb0 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f608c09c850 con 0x7f608c0a0750 2026-02-17T11:50:46.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f608c09e710 con 0x7f608c13b760 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f60933a8640 10 monclient(hunting): authenticate will time out at 934.462436s 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c131360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c130e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54016/0 (socket says 10.20.193.51:54016) 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 1 -- 10.20.193.51:0/1053854192 learned_addr learned my addr 10.20.193.51:0/1053854192 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): get_auth_request con 0x7f608c0a3bb0 auth_method 0 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): get_auth_request con 0x7f608c13b760 auth_method 0 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient(hunting): handle_auth_done global_id 84143 payload 824 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c0a0750 0x7f608c138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c0a0750 msgr2=0x7f608c138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c0a0750 0x7f608c138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 msgr2=0x7f608c130e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c130e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient: _finish_hunting 0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 monclient: found mon.noname-c 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c134340 con 0x7f608c13b760 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609091c640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f608c0a3bb0 0x7f608c130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609111d640 10 monclient: get_auth_request con 0x7f608c0a0750 auth_method 0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.843+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c0a0750 0x7f608c138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 msgr2=0x7f608c131360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f609191e640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c131360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f608800ef90 tx=0x7f608800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088018030 con 0x7f608c13b760 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: dump: 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: _finish_auth 0 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088003a90 con 0x7f608c13b760 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f60933a8640 5 monclient: authenticate success, global_id 84143 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f60933a8640 10 monclient: _renew_subs 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f60933a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c134900 con 0x7f608c13b760 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:46.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088003e60 con 0x7f608c13b760 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f607b7fe640 4 set_mon_vals no callback set 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.845+0000 7f6079ffb640 10 monclient: dump: 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 10 monclient: _renew_subs 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c132970 con 0x7f608c13b760 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 0x7f608c12d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f608c131c80 con 0x7f608c1318a0 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6088025060 con 0x7f608c13b760 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 0x7f608c12d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient: get_auth_request con 0x7f608c1318a0 auth_method 0 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f6079ffb640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f605c03dd10 0x7f605c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f6088052f90 con 0x7f608c13b760 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 10 monclient(hunting): handle_auth_done global_id 64240 payload 824 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.846+0000 7f609111d640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f608c134cf0 con 0x7f608c1318a0 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.847+0000 7f609091c640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f605c03dd10 0x7f605c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.847+0000 7f609091c640 10 monclient: get_auth_request con 0x7f605c03dd10 auth_method 0 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f609111d640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 msgr2=0x7f608c12d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 0x7f608c12d690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f608c06f3c0 tx=0x7f607c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c047070 con 0x7f608c1318a0 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 10 monclient: dump: 2026-02-17T11:50:46.860 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f609091c640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f605c03dd10 0x7f605c0401d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6080007e50 tx=0x7f6080007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f607c037d30 con 0x7f608c1318a0 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 msgr2=0x7f608c12d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 0x7f608c12d690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f608c06f3c0 tx=0x7f607c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 msgr2=0x7f608c12d690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.849+0000 7f6079ffb640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c1318a0 0x7f608c12d690 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f608c06f3c0 tx=0x7f607c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f60933a8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:50:46.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f60933a8640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 0x7f608c12dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f60933a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f608c132d90 con 0x7f608c12dbd0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 0x7f608c12dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient: get_auth_request con 0x7f608c12dbd0 auth_method 0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 10 monclient(hunting): handle_auth_done global_id 64243 payload 824 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.853+0000 7f609111d640 1 -- 10.20.193.51:0/1053854192 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f608c134ad0 con 0x7f608c12dbd0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.855+0000 7f609111d640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 msgr2=0x7f608c12dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.855+0000 7f609111d640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 0x7f608c12dfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f607c006de0 tx=0x7f607c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c03c040 con 0x7f608c12dbd0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 10 monclient: dump: 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:46.862 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f607c04c450 con 0x7f608c12dbd0 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 msgr2=0x7f608c12dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 0x7f608c12dfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f607c006de0 tx=0x7f607c008030 comp rx=0 tx=0).stop 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 msgr2=0x7f608c12dfb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:50:46.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f6079ffb640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f608c12dbd0 0x7f608c12dfb0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f607c006de0 tx=0x7f607c008030 comp rx=0 tx=0).stop 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 44, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 118403, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.864 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.865 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:50:46.866 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.867 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.868 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:50:46.869 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.870 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.871 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:50:46.872 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:50:46.873 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:50:46.873 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:50:46.873 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f605c03dd10 msgr2=0x7f605c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f605c03dd10 0x7f605c0401d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6080007e50 tx=0x7f6080007dc0 comp rx=0 tx=0).stop 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 10 monclient: shutdown 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 msgr2=0x7f608c131360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 --2- 10.20.193.51:0/1053854192 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f608c13b760 0x7f608c131360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f608800ef90 tx=0x7f608800c490 comp rx=0 tx=0).stop 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 reap_dead start 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f609191e640 1 -- 10.20.193.51:0/1053854192 reap_dead start 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 shutdown_connections 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 >> 10.20.193.51:0/1053854192 conn(0x7f608c0a30c0 msgr2=0x7f608c13a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 shutdown_connections 2026-02-17T11:50:46.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.856+0000 7f60933a8640 1 -- 10.20.193.51:0/1053854192 wait complete. 2026-02-17T11:50:46.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:50:46.875 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:50:46.875 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:50:46.875 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:50:46.875 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:50:46.875 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:50:46.875 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:46.882 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:50:46.882 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:50:46.883 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:46.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.986+0000 7fd87cf2a640 10 monclient: get_monmap_and_config 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.986+0000 7fd87cf2a640 10 monclient: build_initial_monmap 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.986+0000 7fd87cf2a640 10 monclient: monmap: 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:46.987837+0000 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:46.987837+0000 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:46.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:46.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:46.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 Processor -- start 2026-02-17T11:50:46.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 -- start start 2026-02-17T11:50:46.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient: init 2026-02-17T11:50:46.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:46.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd878138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd87813d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-b con 0x7fd8780a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd87813d8a0 0x7fd87813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-a con 0x7fd87813d8a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8780a1df0 con 0x7fd878138600 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd8780a6830 con 0x7fd87813d8a0 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd8780a2c00 con 0x7fd8780a35a0 2026-02-17T11:50:47.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd87cf2a640 10 monclient(hunting): authenticate will time out at 934.606704s 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd875d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 msgr2=0x7fd87813d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd875d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd87813d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd87813d8a0 0x7fd87813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd87813d8a0 0x7fd87813fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54024/0 (socket says 10.20.193.51:54024) 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 1 -- 10.20.193.51:0/2619562544 learned_addr learned my addr 10.20.193.51:0/2619562544 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): get_auth_request con 0x7fd87813d8a0 auth_method 0 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:47.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 10 monclient(hunting): handle_auth_done global_id 74244 payload 274 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 1 -- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 msgr2=0x7fd87813d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.987+0000 7fd876d76640 1 --2- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd87813d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 1 -- 10.20.193.51:0/2619562544 >> v1:10.20.193.142:6789/0 conn(0x7fd878138600 legacy=0x7fd8781389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 10 monclient: _finish_hunting 0 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 1 monclient: found mon.noname-a 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.988+0000 7fd876d76640 1 -- 10.20.193.51:0/2619562544 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8780a65b0 con 0x7fd87813d8a0 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd876d76640 1 -- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 msgr2=0x7fd87813fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd876d76640 1 --2- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd87813fc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd868009e50 tx=0x7fd86802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1b4e96391e3716 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 1 -- 10.20.193.51:0/2619562544 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680373f0 con 0x7fd87813d8a0 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: dump: 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:47.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: _finish_auth 0 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: _check_auth_tickets 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 5 monclient: authenticate success, global_id 74244 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 1 -- 10.20.193.51:0/2619562544 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd868037590 con 0x7fd87813d8a0 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:47.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 1 -- 10.20.193.51:0/2619562544 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868037960 con 0x7fd87813d8a0 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 4 set_mon_vals no callback set 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd875573640 10 monclient: dump: 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:47.005 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 10 monclient: shutdown 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 1 -- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 msgr2=0x7fd87813fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.990+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd87813fc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd868009e50 tx=0x7fd86802f230 comp rx=0 tx=0).stop 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- 10.20.193.51:0/2619562544 shutdown_connections 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd87813fc90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/2619562544 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd87813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- 10.20.193.51:0/2619562544 >> 10.20.193.51:0/2619562544 conn(0x7fd8780a7460 msgr2=0x7fd8780a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- 10.20.193.51:0/2619562544 shutdown_connections 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- 10.20.193.51:0/2619562544 wait complete. 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient: build_initial_monmap 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient: monmap: 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:47.007 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 Processor -- start 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- start start 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient: init 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd8781cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-c con 0x7fd8780a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:47.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 0x7fd8781376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-b con 0x7fd878138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): picked mon.noname-a con 0x7fd87813d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd8780a15f0 con 0x7fd87813d8a0 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd8780a25b0 con 0x7fd878138600 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd8780a1770 con 0x7fd8780a35a0 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd87cf2a640 10 monclient(hunting): authenticate will time out at 934.610853s 2026-02-17T11:50:47.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 msgr2=0x7fd8781cf420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd8781cf420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54036/0 (socket says 10.20.193.51:54036) 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 1 -- 10.20.193.51:0/3726058243 learned_addr learned my addr 10.20.193.51:0/3726058243 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): get_auth_request con 0x7fd87813d8a0 auth_method 0 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.991+0000 7fd876d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:47.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 10 monclient(hunting): handle_auth_done global_id 74247 payload 824 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd875d74640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 0x7fd8781376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 -- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 msgr2=0x7fd8781cf420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd8781cf420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 -- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 msgr2=0x7fd8781376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 0x7fd8781376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 10 monclient: _finish_hunting 0 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 monclient: found mon.noname-a 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd876d76640 1 -- 10.20.193.51:0/3726058243 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8781d0340 con 0x7fd87813d8a0 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd875d74640 10 monclient: get_auth_request con 0x7fd878138600 auth_method 0 2026-02-17T11:50:47.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.992+0000 7fd875d74640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 0x7fd8781376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd876d76640 1 -- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 msgr2=0x7fd878071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd876d76640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd868009e50 tx=0x7fd868004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868046020 con 0x7fd87813d8a0 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: dump: 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:47.012 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: _finish_auth 0 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd868037e30 con 0x7fd87813d8a0 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868007d40 con 0x7fd87813d8a0 2026-02-17T11:50:47.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd85effd640 10 monclient: dump: 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:47.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd874d72640 4 set_mon_vals no callback set 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 5 monclient: authenticate success, global_id 74247 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 10 monclient: _renew_subs 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd878121d80 con 0x7fd87813d8a0 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 10 monclient: _renew_subs 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8780a0c50 con 0x7fd87813d8a0 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.994+0000 7fd87cf2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd87cf2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd87cf2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8780a9b90 con 0x7fd87813d8a0 2026-02-17T11:50:47.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd868041450 con 0x7fd87813d8a0 2026-02-17T11:50:47.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd85effd640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 0x7fd8440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:47.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7fd8680788c0 con 0x7fd87813d8a0 2026-02-17T11:50:47.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd876575640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 0x7fd8440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:47.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.995+0000 7fd876575640 10 monclient: get_auth_request con 0x7fd84403dd10 auth_method 0 2026-02-17T11:50:47.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.998+0000 7fd876575640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 0x7fd8440401d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd86c003870 tx=0x7fd86c007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:47.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.998+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd8780a9b90 con 0x7fd87813d8a0 2026-02-17T11:50:47.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.998+0000 7fd85effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:47.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:46.998+0000 7fd85effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd87cf2a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd87cf2a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd87cf2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8780a3050 con 0x7fd87813d8a0 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd85effd640 1 -- 10.20.193.51:0/3726058243 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fd8780a3050 con 0x7fd87813d8a0 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd85effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:47.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.112+0000 7fd85effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:47.115 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:47.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 msgr2=0x7fd8440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 0x7fd8440401d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd86c003870 tx=0x7fd86c007b10 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 10 monclient: shutdown 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 msgr2=0x7fd878071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd868009e50 tx=0x7fd868004b40 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 shutdown_connections 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd84403dd10 0x7fd8440401d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd87813d8a0 0x7fd878071f00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd878138600 0x7fd8781376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 --2- 10.20.193.51:0/3726058243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd8780a35a0 0x7fd8781cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 >> 10.20.193.51:0/3726058243 conn(0x7fd8780a7460 msgr2=0x7fd87813dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 shutdown_connections 2026-02-17T11:50:47.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:47.113+0000 7fd87cf2a640 1 -- 10.20.193.51:0/3726058243 wait complete. 2026-02-17T11:50:50.123 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.190+0000 7f8a38fce640 10 monclient: get_monmap_and_config 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.190+0000 7f8a38fce640 10 monclient: build_initial_monmap 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.190+0000 7f8a38fce640 10 monclient: monmap: 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:50.191553+0000 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:50.191553+0000 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:50.192 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.190+0000 7f8a38fce640 1 Processor -- start 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 -- start start 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient: init 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-a con 0x7f8a340a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-b con 0x7f8a340a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:50.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8a3409e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3406e140 con 0x7f8a3409e540 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8a340a3f90 con 0x7f8a340a3bb0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3409f910 con 0x7f8a340a0750 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a38fce640 10 monclient(hunting): authenticate will time out at 937.810312s 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a31d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 msgr2=0x7f8a3409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a31d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54052/0 (socket says 10.20.193.51:54052) 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 -- 10.20.193.51:0/230329947 learned_addr learned my addr 10.20.193.51:0/230329947 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): get_auth_request con 0x7f8a340a3bb0 auth_method 0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient(hunting): handle_auth_done global_id 74250 payload 274 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 -- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 msgr2=0x7f8a3409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 --2- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 -- 10.20.193.51:0/230329947 >> v1:10.20.193.142:6789/0 conn(0x7f8a3409e540 legacy=0x7f8a3413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient: _finish_hunting 0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 monclient: found mon.noname-a 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.191+0000 7f8a32575640 1 -- 10.20.193.51:0/230329947 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3409ccd0 con 0x7f8a340a3bb0 2026-02-17T11:50:50.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a32575640 1 -- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:50.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a32575640 1 --2- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406c1c0 tx=0x7f8a2802ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82683fe88ad8c404 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 1 -- 10.20.193.51:0/230329947 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803c070 con 0x7f8a340a3bb0 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: dump: 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: _finish_auth 0 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: _check_auth_tickets 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 5 monclient: authenticate success, global_id 74250 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 1 -- 10.20.193.51:0/230329947 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2802fda0 con 0x7f8a340a3bb0 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 1 -- 10.20.193.51:0/230329947 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037660 con 0x7f8a340a3bb0 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a31573640 10 monclient: dump: 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 4 set_mon_vals no callback set 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 10 monclient: shutdown 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 -- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 --2- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406c1c0 tx=0x7f8a2802ee80 comp rx=0 tx=0).stop 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 -- 10.20.193.51:0/230329947 shutdown_connections 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 --2- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 --2- 10.20.193.51:0/230329947 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 -- 10.20.193.51:0/230329947 >> 10.20.193.51:0/230329947 conn(0x7f8a340a30c0 msgr2=0x7f8a340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 -- 10.20.193.51:0/230329947 shutdown_connections 2026-02-17T11:50:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.194+0000 7f8a38fce640 1 -- 10.20.193.51:0/230329947 wait complete. 2026-02-17T11:50:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient: build_initial_monmap 2026-02-17T11:50:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient: monmap: 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 Processor -- start 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 -- start start 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient: init 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-a con 0x7f8a3409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a34096960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-c con 0x7f8a340a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 0x7f8a34096ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): picked mon.noname-b con 0x7f8a340a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a340a04b0 con 0x7f8a3409e540 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3409c850 con 0x7f8a340a3bb0 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3413de80 con 0x7f8a340a0750 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a38fce640 10 monclient(hunting): authenticate will time out at 937.814600s 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a31d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 msgr2=0x7f8a34096960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a31d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a34096960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54054/0 (socket says 10.20.193.51:54054) 2026-02-17T11:50:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 -- 10.20.193.51:0/77466857 learned_addr learned my addr 10.20.193.51:0/77466857 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): get_auth_request con 0x7f8a3409e540 auth_method 0 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient(hunting): handle_auth_done global_id 74253 payload 824 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 -- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 msgr2=0x7f8a34096960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32d76640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 0x7f8a34096ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a34096960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 -- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a34096ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 0x7f8a34096ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient: _finish_hunting 0 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 monclient: found mon.noname-a 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32575640 1 -- 10.20.193.51:0/77466857 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a341cd480 con 0x7f8a3409e540 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32d76640 10 monclient: get_auth_request con 0x7f8a340a3bb0 auth_method 0 2026-02-17T11:50:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.195+0000 7f8a32d76640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 0x7f8a34096ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.197+0000 7f8a32575640 1 -- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 msgr2=0x7f8a341ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.197+0000 7f8a32575640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a28002410 tx=0x7f8a280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28046020 con 0x7f8a3409e540 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a32575640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a28002410 tx=0x7f8a280047c0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f8a28042640 config(0 keys) 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: dump: 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: _finish_auth 0 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28042640 con 0x7f8a3409e540 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 5 monclient: authenticate success, global_id 74253 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _renew_subs 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a340a2960 con 0x7f8a3409e540 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a30d72640 4 set_mon_vals no callback set 2026-02-17T11:50:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _renew_subs 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3408ee10 con 0x7f8a3409e540 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3413db10 con 0x7f8a3409e540 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803c040 con 0x7f8a3409e540 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 10 monclient: dump: 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.198+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8a2803f030 con 0x7f8a3409e540 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.199+0000 7f8a1affd640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 0x7f8a000401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.199+0000 7f8a31d74640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 0x7f8a000401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.199+0000 7f8a31d74640 10 monclient: get_auth_request con 0x7f8a0003dcf0 auth_method 0 2026-02-17T11:50:50.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.201+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f8a28077910 con 0x7f8a3409e540 2026-02-17T11:50:50.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.202+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:50:50.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.202+0000 7f8a31d74640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 0x7f8a000401b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a3413de50 tx=0x7f8a1c006db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.821+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8a28050030 con 0x7f8a3409e540 2026-02-17T11:50:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.821+0000 7f8a1affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.821+0000 7f8a1affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:50.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a38fce640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:50.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a38fce640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:50.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a38fce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:50.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8a3409dac0 con 0x7f8a3409e540 2026-02-17T11:50:50.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a1affd640 1 -- 10.20.193.51:0/77466857 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f8a280762f0 con 0x7f8a3409e540 2026-02-17T11:50:50.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a1affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:50.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.934+0000 7f8a1affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:50.937 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:50.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 msgr2=0x7f8a000401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:50.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 0x7f8a000401b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a3413de50 tx=0x7f8a1c006db0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 10 monclient: shutdown 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 msgr2=0x7f8a341ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a28002410 tx=0x7f8a280047c0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 shutdown_connections 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dcf0 0x7f8a000401b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a340a3bb0 0x7f8a34096ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a0750 0x7f8a34096960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 --2- 10.20.193.51:0/77466857 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a3409e540 0x7f8a341ccf40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 >> 10.20.193.51:0/77466857 conn(0x7f8a340a30c0 msgr2=0x7f8a340996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 shutdown_connections 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:50.935+0000 7f8a38fce640 1 -- 10.20.193.51:0/77466857 wait complete. 2026-02-17T11:50:53.945 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:54.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.012+0000 7f83283f7640 10 monclient: get_monmap_and_config 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.012+0000 7f83283f7640 10 monclient: build_initial_monmap 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.012+0000 7f83283f7640 10 monclient: monmap: 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:54.013562+0000 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:54.013562+0000 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.017 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.012+0000 7f83283f7640 1 Processor -- start 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 -- start start 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient: init 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:54.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f83200a3bb0 0x7f832009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-c con 0x7f83200a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 0x7f832009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-b con 0x7f83200a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f832009e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832006e140 con 0x7f832009e540 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f83200a3f90 con 0x7f83200a3bb0 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f832009f910 con 0x7f83200a0750 2026-02-17T11:50:54.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f83283f7640 10 monclient(hunting): authenticate will time out at 941.632302s 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832596b640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 msgr2=0x7f832009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832596b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 0x7f832009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832696d640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f832009e540 0x7f832013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58320/0 (socket says 10.20.193.51:58320) 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832696d640 1 -- 10.20.193.51:0/1138679480 learned_addr learned my addr 10.20.193.51:0/1138679480 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 --2- 10.20.193.51:0/1138679480 >> v2:10.20.193.142:3300/0 conn(0x7f83200a3bb0 0x7f832009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): get_auth_request con 0x7f83200a3bb0 auth_method 0 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:54.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient(hunting): handle_auth_done global_id 64246 payload 274 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 -- 10.20.193.51:0/1138679480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 msgr2=0x7f832009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 --2- 10.20.193.51:0/1138679480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 0x7f832009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 -- 10.20.193.51:0/1138679480 >> v1:10.20.193.51:6789/0 conn(0x7f832009e540 legacy=0x7f832013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient: _finish_hunting 0 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 monclient: found mon.noname-c 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:50:54.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.013+0000 7f832616c640 1 -- 10.20.193.51:0/1138679480 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832009ccd0 con 0x7f83200a3bb0 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832616c640 1 -- 10.20.193.51:0/1138679480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83200a3bb0 msgr2=0x7f832009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832616c640 1 --2- 10.20.193.51:0/1138679480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83200a3bb0 0x7f832009dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f832006c1c0 tx=0x7f831002ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b116e0f3e5bca55f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 1 -- 10.20.193.51:0/1138679480 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831003c070 con 0x7f83200a3bb0 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:50:54.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: dump: 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: _finish_auth 0 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: _check_auth_tickets 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f83283f7640 5 monclient: authenticate success, global_id 64246 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f83283f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 1 -- 10.20.193.51:0/1138679480 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831002fcd0 con 0x7f83200a3bb0 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 1 -- 10.20.193.51:0/1138679480 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310037660 con 0x7f83200a3bb0 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f83283f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f83283f7640 4 set_mon_vals no callback set 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:50:54.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.016+0000 7f832516a640 10 monclient: dump: 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: shutdown 2026-02-17T11:50:54.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- 10.20.193.51:0/1138679480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83200a3bb0 msgr2=0x7f832009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 --2- 10.20.193.51:0/1138679480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83200a3bb0 0x7f832009dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f832006c1c0 tx=0x7f831002ed70 comp rx=0 tx=0).stop 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- 10.20.193.51:0/1138679480 shutdown_connections 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 --2- 10.20.193.51:0/1138679480 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a0750 0x7f832009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 --2- 10.20.193.51:0/1138679480 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83200a3bb0 0x7f832009dac0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- 10.20.193.51:0/1138679480 >> 10.20.193.51:0/1138679480 conn(0x7f83200a30c0 msgr2=0x7f83200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- 10.20.193.51:0/1138679480 shutdown_connections 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- 10.20.193.51:0/1138679480 wait complete. 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: build_initial_monmap 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: monmap: 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:50:54.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 Processor -- start 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 -- start start 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: init 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:54.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f832009e540 0x7f83201ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-b con 0x7f832009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.017+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-a con 0x7f83200a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 0x7f8320096ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): picked mon.noname-c con 0x7f83200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f83200a04b0 con 0x7f83200a0750 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f832009c850 con 0x7f832009e540 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f832013de80 con 0x7f83200a3bb0 2026-02-17T11:50:54.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f83283f7640 10 monclient(hunting): authenticate will time out at 941.637014s 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832696d640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 msgr2=0x7f8320096ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832696d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 0x7f8320096ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54066/0 (socket says 10.20.193.51:54066) 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 -- 10.20.193.51:0/3830677865 learned_addr learned my addr 10.20.193.51:0/3830677865 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): get_auth_request con 0x7f83200a0750 auth_method 0 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:54.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832616c640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f832009e540 0x7f83201ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832616c640 10 monclient(hunting): get_auth_request con 0x7f832009e540 auth_method 0 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832616c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832616c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832616c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient(hunting): handle_auth_done global_id 74256 payload 824 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 -- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 msgr2=0x7f8320096ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 0x7f8320096ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 -- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f832009e540 msgr2=0x7f83201ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:54.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f832009e540 0x7f83201ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient: _finish_hunting 0 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 monclient: found mon.noname-a 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.018+0000 7f832596b640 1 -- 10.20.193.51:0/3830677865 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83201cd480 con 0x7f83200a0750 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f832596b640 1 -- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 msgr2=0x7f8320096960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f832596b640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f831400b750 tx=0x7f831400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314005270 con 0x7f83200a0750 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: dump: 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:54.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: _finish_auth 0 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 5 monclient: authenticate success, global_id 74256 2026-02-17T11:50:54.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 10 monclient: _renew_subs 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83200a2960 con 0x7f83200a0750 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314010070 con 0x7f83200a0750 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314005630 con 0x7f83200a0750 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8306ffd640 10 monclient: dump: 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f8324969640 4 set_mon_vals no callback set 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 10 monclient: _renew_subs 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.020+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832008ee10 con 0x7f83200a0750 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f831400c520 con 0x7f83200a0750 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f83283f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:54.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f83283f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f83283f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f832009dac0 con 0x7f83200a0750 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f8306ffd640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 0x7f82f00401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f8314051e40 con 0x7f83200a0750 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f832616c640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 0x7f82f00401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.021+0000 7f832616c640 10 monclient: get_auth_request con 0x7f82f003dcf0 auth_method 0 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.023+0000 7f832596b640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f831400b750 tx=0x7f831400bc20 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f8314050820 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-17T11:50:54.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.024+0000 7f832616c640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 0x7f82f00401b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f832009f230 tx=0x7f8310033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:50:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.852+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8314050820 con 0x7f83200a0750 2026-02-17T11:50:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.852+0000 7f8306ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:50:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.852+0000 7f8306ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:50:54.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f83283f7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f83283f7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f83283f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f832013db10 con 0x7f83200a0750 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f8306ffd640 1 -- 10.20.193.51:0/3830677865 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f83140139d0 con 0x7f83200a0750 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f8306ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:50:54.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.966+0000 7f8306ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:50:54.970 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 msgr2=0x7f82f00401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 0x7f82f00401b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f832009f230 tx=0x7f8310033000 comp rx=0 tx=0).stop 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 10 monclient: shutdown 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 msgr2=0x7f8320096960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f831400b750 tx=0x7f831400bc20 comp rx=0 tx=0).stop 2026-02-17T11:50:54.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 shutdown_connections 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f82f003dcf0 0x7f82f00401b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83200a3bb0 0x7f8320096ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83200a0750 0x7f8320096960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 --2- 10.20.193.51:0/3830677865 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f832009e540 0x7f83201ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 >> 10.20.193.51:0/3830677865 conn(0x7f83200a30c0 msgr2=0x7f83200996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 shutdown_connections 2026-02-17T11:50:54.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:54.967+0000 7f83283f7640 1 -- 10.20.193.51:0/3830677865 wait complete. 2026-02-17T11:50:57.977 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.044+0000 7f092633e640 10 monclient: get_monmap_and_config 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.044+0000 7f092633e640 10 monclient: build_initial_monmap 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.044+0000 7f092633e640 10 monclient: monmap: 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:50:58.046575+0000 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:50:58.046575+0000 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:50:58.049 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.044+0000 7f092633e640 1 Processor -- start 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 -- start start 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient: init 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient: _reopen_session rank -1 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:50:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): picked mon.noname-b con 0x7f09200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f09200a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): picked mon.noname-c con 0x7f092013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f092006e140 con 0x7f09200a0750 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f092009f910 con 0x7f092013b760 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f092009ccd0 con 0x7f09200a3bb0 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): _renew_subs 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f092633e640 10 monclient(hunting): authenticate will time out at 945.665308s 2026-02-17T11:50:58.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f091ffff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f092009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f091ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f091f7fe640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f09200a0750 0x7f092009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:39522/0 (socket says 10.20.193.51:39522) 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 learned_addr learned my addr 10.20.193.51:0/1835540704 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f09248b4640 10 monclient(hunting): get_auth_request con 0x7f092013b760 auth_method 0 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f09248b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f09248b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:58.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.045+0000 7f09248b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:50:58.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.047+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 >> v1:10.20.193.142:6789/0 conn(0x7f09200a0750 legacy=0x7f092009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:50:58.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.047+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:50:58.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.047+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:58.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.047+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:58.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.047+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:50:58.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.246+0000 7f091ffff640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f092009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:58.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.246+0000 7f091ffff640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:58.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:58.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 10 monclient(hunting): get_auth_request con 0x7f092013b760 auth_method 0 2026-02-17T11:50:58.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:58.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:58.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:58.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:58.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:58.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:58.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.248+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:50:58.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.647+0000 7f091ffff640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f092009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:58.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.647+0000 7f091ffff640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 10 monclient(hunting): get_auth_request con 0x7f092013b760 auth_method 0 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:58.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:58.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:58.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:58.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:58.649+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:50:59.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.448+0000 7f091ffff640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f092009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:50:59.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.448+0000 7f091ffff640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:50:59.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:50:59.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 10 monclient(hunting): get_auth_request con 0x7f092013b760 auth_method 0 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:50:59.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:50:59.450+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:51:01.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008139638 0 0) 0x7f092006e140 con 0x7f09200a0750 2026-02-17T11:51:01.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient(hunting): _negotiate 2026-02-17T11:51:01.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient(hunting): my global_id is 64252 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0904003620 con 0x7f09200a0750 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1631483974 0 0) 0x7f0904003620 con 0x7f09200a0750 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f092009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f092009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 msgr2=0x7f092013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 --2- 10.20.193.51:0/1835540704 >> v2:10.20.193.142:3300/0 conn(0x7f092013b760 0x7f092013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092009eec0 con 0x7f09200a0750 2026-02-17T11:51:01.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f0910003160 con 0x7f09200a0750 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.026+0000 7f091effd640 10 monclient: dump: 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 >> v1:10.20.193.142:6789/0 conn(0x7f09200a0750 legacy=0x7f092009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f0904003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): picked mon.c con 0x7f09200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 0x7f0904004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): picked mon.a con 0x7f0904004100 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004e40 0x7f09040052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): picked mon.b con 0x7f0904004e40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f092009f910 con 0x7f0904004100 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f092009ccd0 con 0x7f0904004e40 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f090400bdd0 con 0x7f09200a3bb0 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:51:01.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091ffff640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f0904003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091ffff640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f0904003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 0x7f0904004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): get_auth_request con 0x7f0904004100 auth_method 0 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f09248b4640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004e40 0x7f09040052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:51:01.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f09248b4640 10 monclient(hunting): get_auth_request con 0x7f0904004e40 auth_method 0 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f09248b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f09248b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f09248b4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient(hunting): handle_auth_done global_id 64252 payload 293 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 msgr2=0x7f0904003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09200a3bb0 0x7f0904003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004e40 msgr2=0x7f09040052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004e40 0x7f09040052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 monclient: found mon.a 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0904003620 con 0x7f0904004100 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f091f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f092633e640 5 monclient: authenticate success, global_id 64252 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.027+0000 7f092633e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091f7fe640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 msgr2=0x7f0904004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091f7fe640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 0x7f0904004900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0910003380 tx=0x7f091002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34585435d4a0b29a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091000c0e0 con 0x7f0904004100 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: dump: 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.046 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0910005bf0 con 0x7f0904004100 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 1 -- 10.20.193.51:0/1835540704 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910007070 con 0x7f0904004100 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f091effd640 10 monclient: dump: 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.047 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 4 set_mon_vals no callback set 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 10 monclient: shutdown 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 -- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 msgr2=0x7f0904004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 --2- 10.20.193.51:0/1835540704 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0904004100 0x7f0904004900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0910003380 tx=0x7f091002f610 comp rx=0 tx=0).stop 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f09248b4640 1 -- 10.20.193.51:0/1835540704 reap_dead start 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 -- 10.20.193.51:0/1835540704 shutdown_connections 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 -- 10.20.193.51:0/1835540704 >> 10.20.193.51:0/1835540704 conn(0x7f09200a30c0 msgr2=0x7f09200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 -- 10.20.193.51:0/1835540704 shutdown_connections 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.030+0000 7f092633e640 1 -- 10.20.193.51:0/1835540704 wait complete. 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient: build_initial_monmap 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient: monmap: 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:01.049 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 Processor -- start 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 -- start start 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient: init 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 0x7f0920138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): picked mon.noname-b con 0x7f0904004100 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:01.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): picked mon.noname-a con 0x7f09201cfad0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 0x7f0920131130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): picked mon.noname-c con 0x7f09201d0450 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f09200a04b0 con 0x7f09201cfad0 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f092009c850 con 0x7f0904004100 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f092009e710 con 0x7f09201d0450 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f092633e640 10 monclient(hunting): authenticate will time out at 948.650847s 2026-02-17T11:51:01.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f09248b4640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 msgr2=0x7f0920131130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f09248b4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 0x7f0920131130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56060/0 (socket says 10.20.193.51:56060) 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 1 -- 10.20.193.51:0/3300268914 learned_addr learned my addr 10.20.193.51:0/3300268914 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): get_auth_request con 0x7f09201cfad0 auth_method 0 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.031+0000 7f091f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 10 monclient(hunting): handle_auth_done global_id 74259 payload 824 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091ffff640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 0x7f0920138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 -- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 msgr2=0x7f0920131130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 0x7f0920131130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 -- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 msgr2=0x7f0920138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 0x7f0920138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091f7fe640 1 -- 10.20.193.51:0/3300268914 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09200a24d0 con 0x7f09201cfad0 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091ffff640 10 monclient: get_auth_request con 0x7f0904004100 auth_method 0 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.032+0000 7f091ffff640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 0x7f0920138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:51:01.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091f7fe640 1 -- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 msgr2=0x7f09201cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091f7fe640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f091000c480 tx=0x7f0920076660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09100078d0 con 0x7f09201cfad0 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: dump: 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.054 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0910002bb0 con 0x7f09201cfad0 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910004b20 con 0x7f09201cfad0 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091cff9640 10 monclient: dump: 2026-02-17T11:51:01.055 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f091e7fc640 4 set_mon_vals no callback set 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 5 monclient: authenticate success, global_id 74259 2026-02-17T11:51:01.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _renew_subs 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092009d7b0 con 0x7f09201cfad0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _renew_subs 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09201350a0 con 0x7f09201cfad0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.034+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092009dac0 con 0x7f09201cfad0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.035+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f091004d030 con 0x7f09201cfad0 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.035+0000 7f091cff9640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 0x7f08f0040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.035+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f0910076b20 con 0x7f09201cfad0 2026-02-17T11:51:01.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.035+0000 7f091ffff640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 0x7f08f0040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.035+0000 7f091ffff640 10 monclient: get_auth_request con 0x7f08f003dd40 auth_method 0 2026-02-17T11:51:01.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.037+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0910043e10 con 0x7f09201cfad0 2026-02-17T11:51:01.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.037+0000 7f091cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.037+0000 7f091cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:01.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.038+0000 7f091ffff640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 0x7f08f0040200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f090c003b40 tx=0x7f090c0082b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f092633e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f092633e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f092633e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f09200008d0 con 0x7f09201cfad0 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f091cff9640 1 -- 10.20.193.51:0/3300268914 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f0910004d70 con 0x7f09201cfad0 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f091cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:01.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.153+0000 7f091cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:01.157 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 msgr2=0x7f08f0040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 0x7f08f0040200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f090c003b40 tx=0x7f090c0082b0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 10 monclient: shutdown 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 msgr2=0x7f09201cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f091000c480 tx=0x7f0920076660 comp rx=0 tx=0).stop 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 shutdown_connections 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f08f003dd40 0x7f08f0040200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f09201d0450 0x7f0920131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f09201cfad0 0x7f09201cff10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 --2- 10.20.193.51:0/3300268914 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0904004100 0x7f0920138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 >> 10.20.193.51:0/3300268914 conn(0x7f09200a30c0 msgr2=0x7f092013a310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 shutdown_connections 2026-02-17T11:51:01.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.155+0000 7f092633e640 1 -- 10.20.193.51:0/3300268914 wait complete. 2026-02-17T11:51:01.165 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:51:01.166 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:51:01.166 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 10 monclient: get_monmap_and_config 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 10 monclient: build_initial_monmap 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 10 monclient: monmap: 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:01.234101+0000 2026-02-17T11:51:01.235 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:01.234101+0000 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:01.236 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 1 Processor -- start 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 1 -- start start 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.233+0000 7f2fdfe1a640 10 monclient: init 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient: _add_conns ranks=[4,2,3,0,1] 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2fd8138600 0x7f2fd81389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-c con 0x7f2fd8138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 0x7f2fd80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-b con 0x7f2fd80a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fd80a58a0 0x7f2fd80a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-a con 0x7f2fd80a58a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd80a6830 con 0x7f2fd80a58a0 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd80a2c00 con 0x7f2fd8138600 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd80a1df0 con 0x7f2fd80a35a0 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdfe1a640 10 monclient(hunting): authenticate will time out at 948.853149s 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdd38e640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 msgr2=0x7f2fd80a5360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fdd38e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 0x7f2fd80a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fd80a58a0 0x7f2fd80a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2fd80a58a0 0x7f2fd80a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56076/0 (socket says 10.20.193.51:56076) 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 -- 10.20.193.51:0/1248553336 learned_addr learned my addr 10.20.193.51:0/1248553336 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): get_auth_request con 0x7f2fd80a58a0 auth_method 0 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fddb8f640 1 --2- 10.20.193.51:0/1248553336 >> v2:10.20.193.142:3300/0 conn(0x7f2fd8138600 0x7f2fd81389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fddb8f640 10 monclient(hunting): get_auth_request con 0x7f2fd8138600 auth_method 0 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fddb8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fddb8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fddb8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient(hunting): handle_auth_done global_id 74262 payload 274 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 -- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 msgr2=0x7f2fd80a5360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 --2- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 0x7f2fd80a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 -- 10.20.193.51:0/1248553336 >> v2:10.20.193.142:3300/0 conn(0x7f2fd8138600 msgr2=0x7f2fd81389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 --2- 10.20.193.51:0/1248553336 >> v2:10.20.193.142:3300/0 conn(0x7f2fd8138600 0x7f2fd81389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 monclient: found mon.noname-a 2026-02-17T11:51:01.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.234+0000 7f2fde390640 1 -- 10.20.193.51:0/1248553336 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd8138f20 con 0x7f2fd80a58a0 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.236+0000 7f2fde390640 1 -- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a58a0 msgr2=0x7f2fd80a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.236+0000 7f2fde390640 1 --2- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a58a0 0x7f2fd80a5d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ab950 tx=0x7f2fd402f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da0d4c6fd610f38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 1 -- 10.20.193.51:0/1248553336 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40373f0 con 0x7f2fd80a58a0 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: dump: 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.251 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 5 monclient: authenticate success, global_id 74262 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 1 -- 10.20.193.51:0/1248553336 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4037590 con 0x7f2fd80a58a0 2026-02-17T11:51:01.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 1 -- 10.20.193.51:0/1248553336 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4037960 con 0x7f2fd80a58a0 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 4 set_mon_vals no callback set 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdcb8d640 10 monclient: dump: 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.253 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 10 monclient: shutdown 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a58a0 msgr2=0x7f2fd80a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a58a0 0x7f2fd80a5d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ab950 tx=0x7f2fd402f200 comp rx=0 tx=0).stop 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/1248553336 shutdown_connections 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a58a0 0x7f2fd80a5d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/1248553336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd80a35a0 0x7f2fd80a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/1248553336 >> v2:10.20.193.142:3300/0 conn(0x7f2fd8138600 0x7f2fd81389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/1248553336 >> 10.20.193.51:0/1248553336 conn(0x7f2fd80a7460 msgr2=0x7f2fd80a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/1248553336 shutdown_connections 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/1248553336 wait complete. 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 10 monclient: build_initial_monmap 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 10 monclient: monmap: 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:01.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 Processor -- start 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 1 -- start start 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.237+0000 7f2fdfe1a640 10 monclient: init 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 0x7f2fd81cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-a con 0x7f2fd80a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:01.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fd80a58a0 0x7f2fd8136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-b con 0x7f2fd80a58a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd8138600 0x7f2fd81368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): picked mon.noname-c con 0x7f2fd8138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd80a25b0 con 0x7f2fd80a35a0 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd80a22d0 con 0x7f2fd80a58a0 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd80a15f0 con 0x7f2fd8138600 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdfe1a640 10 monclient(hunting): authenticate will time out at 948.857214s 2026-02-17T11:51:01.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fde390640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd8138600 msgr2=0x7f2fd81368c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fde390640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd8138600 0x7f2fd81368c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 0x7f2fd81cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 0x7f2fd81cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56088/0 (socket says 10.20.193.51:56088) 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 -- 10.20.193.51:0/197643229 learned_addr learned my addr 10.20.193.51:0/197643229 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): get_auth_request con 0x7f2fd80a35a0 auth_method 0 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient(hunting): handle_auth_done global_id 74265 payload 824 2026-02-17T11:51:01.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd8138600 msgr2=0x7f2fd81368c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2fd8138600 0x7f2fd81368c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fd80a58a0 msgr2=0x7f2fd8136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fd80a58a0 0x7f2fd8136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fd80a58a0 0x7f2fd8136380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 monclient: found mon.noname-a 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fddb8f640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd8125f50 con 0x7f2fd80a35a0 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdd38e640 10 monclient: get_auth_request con 0x7f2fd80a58a0 auth_method 0 2026-02-17T11:51:01.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.238+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2fd80a58a0 0x7f2fd8136380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fddb8f640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 msgr2=0x7f2fd81cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fddb8f640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 0x7f2fd81cf2c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800e7c0 tx=0x7f2fc800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8017070 con 0x7f2fd80a35a0 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: dump: 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc800cb00 con 0x7f2fd80a35a0 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 5 monclient: authenticate success, global_id 74265 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 10 monclient: _renew_subs 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd8137870 con 0x7f2fd80a35a0 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800f040 con 0x7f2fd80a35a0 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc7fff640 4 set_mon_vals no callback set 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fc67fc640 10 monclient: dump: 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.262 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 10 monclient: _renew_subs 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.240+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd81277e0 con 0x7f2fd80a35a0 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdfe1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 0x7f2fd81245d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd80a5d10 con 0x7f2fd8127a20 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 0x7f2fd81245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient: get_auth_request con 0x7f2fd8127a20 auth_method 0 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2fc8012050 con 0x7f2fd80a35a0 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_done global_id 74268 payload 824 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fdd38e640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fd8127e20 con 0x7f2fd8127a20 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fc67fc640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fa803dcc0 0x7f2fa8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f2fc8052520 con 0x7f2fd80a35a0 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fde390640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fa803dcc0 0x7f2fa8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.241+0000 7f2fde390640 10 monclient: get_auth_request con 0x7f2fa803dcc0 auth_method 0 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fdd38e640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 msgr2=0x7f2fd81245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 0x7f2fd81245d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc003a80 tx=0x7f2fcc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc005d40 con 0x7f2fd8127a20 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 10 monclient: dump: 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.265 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f2fcc005d40 con 0x7f2fd8127a20 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 msgr2=0x7f2fd81245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 0x7f2fd81245d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc003a80 tx=0x7f2fcc00cae0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 msgr2=0x7f2fd81245d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.243+0000 7f2fc67fc640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8127a20 0x7f2fd81245d0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc003a80 tx=0x7f2fcc00cae0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.244+0000 7f2fde390640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fa803dcc0 0x7f2fa8040180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8075290 tx=0x7f2fd4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdfe1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 0x7f2fd81da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdfe1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd8069780 con 0x7f2fd8072ba0 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 0x7f2fd81da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient: get_auth_request con 0x7f2fd8072ba0 auth_method 0 2026-02-17T11:51:01.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.246+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.247+0000 7f2fdd38e640 10 monclient(hunting): handle_auth_done global_id 74271 payload 824 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.247+0000 7f2fdd38e640 1 -- 10.20.193.51:0/197643229 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fd8124b10 con 0x7f2fd8072ba0 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdd38e640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 msgr2=0x7f2fd81da3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdd38e640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 0x7f2fd81da3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc014000 tx=0x7f2fcc005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc01a880 con 0x7f2fd8072ba0 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 10 monclient: dump: 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7f2fcc01a880 con 0x7f2fd8072ba0 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:01.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 msgr2=0x7f2fd81da3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 0x7f2fd81da3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc014000 tx=0x7f2fcc005ad0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 msgr2=0x7f2fd81da3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fc67fc640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd8072ba0 0x7f2fd81da3e0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc014000 tx=0x7f2fcc005ad0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:01.272 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 48, 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 79181, 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.273 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.274 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:01.275 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.276 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.277 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.278 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.279 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.280 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.281 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.282 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:01.283 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fa803dcc0 msgr2=0x7f2fa8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2fa803dcc0 0x7f2fa8040180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8075290 tx=0x7f2fd4033000 comp rx=0 tx=0).stop 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 10 monclient: shutdown 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 msgr2=0x7f2fd81cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 --2- 10.20.193.51:0/197643229 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2fd80a35a0 0x7f2fd81cf2c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800e7c0 tx=0x7f2fc800ec90 comp rx=0 tx=0).stop 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fde390640 1 -- 10.20.193.51:0/197643229 reap_dead start 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fde390640 1 -- 10.20.193.51:0/197643229 reap_dead start 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 shutdown_connections 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 >> 10.20.193.51:0/197643229 conn(0x7f2fd80a7460 msgr2=0x7f2fd80a9520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 shutdown_connections 2026-02-17T11:51:01.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.249+0000 7f2fdfe1a640 1 -- 10.20.193.51:0/197643229 wait complete. 2026-02-17T11:51:01.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:51:01.285 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:51:01.285 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:51:01.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.350+0000 7f11c4288640 10 monclient: get_monmap_and_config 2026-02-17T11:51:01.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.350+0000 7f11c4288640 10 monclient: build_initial_monmap 2026-02-17T11:51:01.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.350+0000 7f11c4288640 10 monclient: monmap: 2026-02-17T11:51:01.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:01.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:01.351615+0000 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:01.351615+0000 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 Processor -- start 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 -- start start 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient: init 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2026-02-17T11:51:01.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f11bc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f11bc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11bc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-b con 0x7f11bc13c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc09e8e0 con 0x7f11bc0a0750 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc06e140 con 0x7f11bc0a3bb0 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc09f910 con 0x7f11bc13c770 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c4288640 10 monclient(hunting): authenticate will time out at 948.970406s 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c27fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 msgr2=0x7f11bc13eb60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c27fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11bc13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c17fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f11bc0a0750 0x7f11bc09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:41496/0 (socket says 10.20.193.51:41496) 2026-02-17T11:51:01.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.351+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 learned_addr learned my addr 10.20.193.51:0/3999815779 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 >> v1:10.20.193.51:6789/0 conn(0x7f11bc0a0750 legacy=0x7f11bc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3999815779 >> v1:10.20.193.142:6789/0 conn(0x7f11bc0a3bb0 legacy=0x7f11bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178721795 0 0) 0x7f11bc09e8e0 con 0x7f11bc0a0750 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): my global_id is 74274 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11a4003620 con 0x7f11bc0a0750 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2410019335 0 0) 0x7f11a4003620 con 0x7f11bc0a0750 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 msgr2=0x7f11bc13eb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11bc13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 >> v1:10.20.193.142:6789/0 conn(0x7f11bc0a3bb0 legacy=0x7f11bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc09ccd0 con 0x7f11bc0a0750 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f11b00031b0 con 0x7f11bc0a0750 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: dump: 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 >> v1:10.20.193.51:6789/0 conn(0x7f11bc0a0750 legacy=0x7f11bc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11a4003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): picked mon.c con 0x7f11bc13c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 0x7f11a4004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): picked mon.a con 0x7f11a4004220 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11a4004f90 0x7f11a400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): picked mon.b con 0x7f11a4004f90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc09f910 con 0x7f11a4004220 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11a400c000 con 0x7f11a4004f90 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f11a400c180 con 0x7f11bc13c770 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c0ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 msgr2=0x7f11a4003ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.353+0000 7f11c1ffd640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11a4003ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 0x7f11a4004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): get_auth_request con 0x7f11a4004220 auth_method 0 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11a4004f90 0x7f11a400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 10 monclient(hunting): get_auth_request con 0x7f11a4004f90 auth_method 0 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient(hunting): handle_auth_done global_id 74274 payload 293 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 msgr2=0x7f11a4003ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:01.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11bc13c770 0x7f11a4003ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11a4004f90 msgr2=0x7f11a400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11a4004f90 0x7f11a400bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 monclient: found mon.a 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a4003620 con 0x7f11a4004220 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c17fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c4288640 5 monclient: authenticate success, global_id 74274 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c4288640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.354+0000 7f11c27fe640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11a4004f90 0x7f11a400bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c17fc640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 msgr2=0x7f11a4004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 0x7f11a4004900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f11b0002ce0 tx=0x7f11b002f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ff3963e2282cda server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b000c180 con 0x7f11a4004220 2026-02-17T11:51:01.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: dump: 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0005cb0 con 0x7f11a4004220 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 1 -- 10.20.193.51:0/3999815779 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00072b0 con 0x7f11a4004220 2026-02-17T11:51:01.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c4288640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c4288640 4 set_mon_vals no callback set 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.356+0000 7f11c0ffb640 10 monclient: dump: 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.368 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: shutdown 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 msgr2=0x7f11a4004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 --2- 10.20.193.51:0/3999815779 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11a4004220 0x7f11a4004900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f11b0002ce0 tx=0x7f11b002f740 comp rx=0 tx=0).stop 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c27fe640 1 -- 10.20.193.51:0/3999815779 reap_dead start 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- 10.20.193.51:0/3999815779 shutdown_connections 2026-02-17T11:51:01.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- 10.20.193.51:0/3999815779 >> 10.20.193.51:0/3999815779 conn(0x7f11bc0a30c0 msgr2=0x7f11bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- 10.20.193.51:0/3999815779 shutdown_connections 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- 10.20.193.51:0/3999815779 wait complete. 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: build_initial_monmap 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: monmap: 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:01.370 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 Processor -- start 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- start start 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: init 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11a4004220 0x7f11bc09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-c con 0x7f11a4004220 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc093320 0x7f11bc093760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-b con 0x7f11bc093320 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): picked mon.noname-a con 0x7f11bc093ca0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc09c850 con 0x7f11bc093ca0 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc09ebe0 con 0x7f11bc093320 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc0a04b0 con 0x7f11a4004220 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c4288640 10 monclient(hunting): authenticate will time out at 948.976967s 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c1ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11a4004220 msgr2=0x7f11bc09b3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.357+0000 7f11c1ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11a4004220 0x7f11bc09b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56116/0 (socket says 10.20.193.51:56116) 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 learned_addr learned my addr 10.20.193.51:0/3421105158 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): get_auth_request con 0x7f11bc093ca0 auth_method 0 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc093320 0x7f11bc093760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c17fc640 10 monclient(hunting): get_auth_request con 0x7f11bc093320 auth_method 0 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c17fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c17fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c17fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient(hunting): handle_auth_done global_id 74277 payload 824 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11a4004220 msgr2=0x7f11bc09b3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11a4004220 0x7f11bc09b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc093320 msgr2=0x7f11bc093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc093320 0x7f11bc093760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 monclient: found mon.noname-a 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:01.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.358+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc096bc0 con 0x7f11bc093ca0 2026-02-17T11:51:01.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 msgr2=0x7f11bc1d5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c27fe640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06dd20 tx=0x7f11b800b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b800e600 con 0x7f11bc093ca0 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: dump: 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.378 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 5 monclient: authenticate success, global_id 74277 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b800e7c0 con 0x7f11bc093ca0 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b800ebb0 con 0x7f11bc093ca0 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11aa7fc640 10 monclient: dump: 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.379 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11abfff640 4 set_mon_vals no callback set 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 10 monclient: _renew_subs 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc09d7b0 con 0x7f11bc093ca0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 10 monclient: _renew_subs 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.360+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc073fe0 con 0x7f11bc093ca0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c4288640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c4288640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 0x7f11bc0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc094120 con 0x7f11bc071cf0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 0x7f11bc0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient: get_auth_request con 0x7f11bc071cf0 auth_method 0 2026-02-17T11:51:01.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f11b80163f0 con 0x7f11bc093ca0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11aa7fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f118c03dcf0 0x7f118c0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_done global_id 64264 payload 824 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f11b8052a10 con 0x7f11bc093ca0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11bc09dac0 con 0x7f11bc071cf0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f118c03dcf0 0x7f118c0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.361+0000 7f11c17fc640 10 monclient: get_auth_request con 0x7f118c03dcf0 auth_method 0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.363+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 msgr2=0x7f11bc0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.363+0000 7f11c1ffd640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 0x7f11bc0638c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac00cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.363+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac017070 con 0x7f11bc071cf0 2026-02-17T11:51:01.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.363+0000 7f11aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.363+0000 7f11aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 10 monclient: dump: 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f11ac00ce70 con 0x7f11bc071cf0 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 msgr2=0x7f11bc0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 0x7f11bc0638c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac00cb20 comp rx=0 tx=0).stop 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 msgr2=0x7f11bc0638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11aa7fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc071cf0 0x7f11bc0638c0 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac00cb20 comp rx=0 tx=0).stop 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.364+0000 7f11c17fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f118c03dcf0 0x7f118c0401b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11b0032000 tx=0x7f11b003a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c4288640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c4288640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 0x7f11bc1d9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c4288640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc095220 con 0x7f11bc0720d0 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 0x7f11bc1d9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient: get_auth_request con 0x7f11bc0720d0 auth_method 0 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 10 monclient(hunting): handle_auth_done global_id 64267 payload 824 2026-02-17T11:51:01.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.367+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3421105158 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11bc0972c0 con 0x7f11bc0720d0 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c1ffd640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 msgr2=0x7f11bc1d9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c1ffd640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 0x7f11bc1d9e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac002b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac017040 con 0x7f11bc0720d0 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 10 monclient: dump: 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:01.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f11ac0193c0 con 0x7f11bc0720d0 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 msgr2=0x7f11bc1d9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 0x7f11bc1d9e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac002b60 comp rx=0 tx=0).stop 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 msgr2=0x7f11bc1d9e80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11aa7fc640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11bc0720d0 0x7f11bc1d9e80 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002bd0 tx=0x7f11ac002b60 comp rx=0 tx=0).stop 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 48, 2026-02-17T11:51:01.385 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 132917, 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.386 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:01.387 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:01.388 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:01.390 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:01.392 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.393 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:01.394 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f118c03dcf0 msgr2=0x7f118c0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f118c03dcf0 0x7f118c0401b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11b0032000 tx=0x7f11b003a040 comp rx=0 tx=0).stop 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 10 monclient: shutdown 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 msgr2=0x7f11bc1d5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06dd20 tx=0x7f11b800b310 comp rx=0 tx=0).stop 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c27fe640 1 -- 10.20.193.51:0/3421105158 reap_dead start 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 shutdown_connections 2026-02-17T11:51:01.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 --2- 10.20.193.51:0/3421105158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11bc093ca0 0x7f11bc1d5920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:01.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 >> 10.20.193.51:0/3421105158 conn(0x7f11bc0a30c0 msgr2=0x7f11bc09be40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:01.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 shutdown_connections 2026-02-17T11:51:01.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:01.370+0000 7f11c4288640 1 -- 10.20.193.51:0/3421105158 wait complete. 2026-02-17T11:51:01.396 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:51:01.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:51:02.029 INFO:tasks.rados.rados.0.trial142.stdout:763: done (3 left) 2026-02-17T11:51:02.029 INFO:tasks.rados.rados.0.trial142.stdout:764: delete oid 47 current snap is 93 2026-02-17T11:51:02.029 INFO:tasks.rados.rados.0.trial142.stdout:762: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:51:02.101 INFO:tasks.rados.rados.0.trial142.stdout:760: done (3 left) 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:761: done (2 left) 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:762: done (1 left) 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:764: done (0 left) 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:765: read oid 7 snap -1 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:765: expect (ObjNum 165 snap 49 seq_num 165) 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:766: copy_from oid 25 from oid 6 current snap is 93 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:767: write (excl) oid 1 current snap is 93 2026-02-17T11:51:02.102 INFO:tasks.rados.rados.0.trial142.stdout:767: seq_num 285 ranges {789995=551026,2027721=468420} 2026-02-17T11:51:02.106 INFO:tasks.rados.rados.0.trial142.stdout:767: writing trial14245205-1 from 789995 to 1341021 tid 1 2026-02-17T11:51:02.111 INFO:tasks.rados.rados.0.trial142.stdout:767: writing trial14245205-1 from 2027721 to 2496141 tid 2 2026-02-17T11:51:02.111 INFO:tasks.rados.rados.0.trial142.stdout:768: write oid 24 current snap is 93 2026-02-17T11:51:02.111 INFO:tasks.rados.rados.0.trial142.stdout:768: seq_num 286 ranges {406802=626275,1686203=728431} 2026-02-17T11:51:02.115 INFO:tasks.rados.rados.0.trial142.stdout:768: writing trial14245205-24 from 406802 to 1033077 tid 1 2026-02-17T11:51:02.120 INFO:tasks.rados.rados.0.trial142.stdout:768: writing trial14245205-24 from 1686203 to 2414634 tid 2 2026-02-17T11:51:02.120 INFO:tasks.rados.rados.0.trial142.stdout:769: read oid 22 snap -1 2026-02-17T11:51:02.121 INFO:tasks.rados.rados.0.trial142.stdout:769: expect deleted 2026-02-17T11:51:02.121 INFO:tasks.rados.rados.0.trial142.stdout:770: copy_from oid 14 from oid 11 current snap is 93 2026-02-17T11:51:02.121 INFO:tasks.rados.rados.0.trial142.stdout:765: expect (ObjNum 165 snap 49 seq_num 165) 2026-02-17T11:51:02.209 INFO:tasks.rados.rados.0.trial142.stdout:767: finishing write tid 1 to trial14245205-1 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:766: finishing copy_from racing read to trial14245205-25 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: finishing write tid 2 to trial14245205-1 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:765: done (5 left) 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:771: delete oid 17 current snap is 93 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: finishing write tid 3 to trial14245205-1 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: finishing write tid 4 to trial14245205-1 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: oid 1 updating version 0 to 201 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: oid 1 updating version 201 to 203 2026-02-17T11:51:02.210 INFO:tasks.rados.rados.0.trial142.stdout:767: oid 1 version 203 is already newer than 202 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 203 (ObjNum 285 snap 93 seq_num 285) dirty exists 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:767: left oid 1 (ObjNum 285 snap 93 seq_num 285) 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:766: finishing copy_from to trial14245205-25 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 129 (ObjNum 212 snap 68 seq_num 212) dirty exists 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: finishing write tid 1 to trial14245205-24 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: finishing write tid 2 to trial14245205-24 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: finishing write tid 3 to trial14245205-24 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: finishing write tid 4 to trial14245205-24 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: oid 24 updating version 0 to 338 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: oid 24 updating version 338 to 340 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: oid 24 version 340 is already newer than 339 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 340 (ObjNum 286 snap 93 seq_num 286) dirty exists 2026-02-17T11:51:02.211 INFO:tasks.rados.rados.0.trial142.stdout:768: left oid 24 (ObjNum 286 snap 93 seq_num 286) 2026-02-17T11:51:02.212 INFO:tasks.rados.rados.0.trial142.stdout:770: finishing copy_from racing read to trial14245205-14 2026-02-17T11:51:02.212 INFO:tasks.rados.rados.0.trial142.stdout:770: finishing copy_from to trial14245205-14 2026-02-17T11:51:02.212 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:766: done (5 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:767: done (4 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:768: done (3 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:769: done (2 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:770: done (1 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:771: done (0 left) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:772: read oid 1 snap -1 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:772: expect (ObjNum 285 snap 93 seq_num 285) 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:773: read oid 21 snap -1 2026-02-17T11:51:02.213 INFO:tasks.rados.rados.0.trial142.stdout:773: expect deleted 2026-02-17T11:51:02.214 INFO:tasks.rados.rados.0.trial142.stdout:774: delete oid 40 current snap is 93 2026-02-17T11:51:02.214 INFO:tasks.rados.rados.0.trial142.stdout:773: done (2 left) 2026-02-17T11:51:02.214 INFO:tasks.rados.rados.0.trial142.stdout:774: done (1 left) 2026-02-17T11:51:02.214 INFO:tasks.rados.rados.0.trial142.stdout:775: delete oid 44 current snap is 93 2026-02-17T11:51:02.214 INFO:tasks.rados.rados.0.trial142.stdout:772: expect (ObjNum 285 snap 93 seq_num 285) 2026-02-17T11:51:02.378 INFO:tasks.rados.rados.0.trial142.stdout:772: done (1 left) 2026-02-17T11:51:02.378 INFO:tasks.rados.rados.0.trial142.stdout:775: done (0 left) 2026-02-17T11:51:02.379 INFO:tasks.rados.rados.0.trial142.stdout:776: write oid 10 current snap is 93 2026-02-17T11:51:02.379 INFO:tasks.rados.rados.0.trial142.stdout:776: seq_num 290 ranges {474030=643624,1520131=735769} 2026-02-17T11:51:02.383 INFO:tasks.rados.rados.0.trial142.stdout:776: writing trial14245205-10 from 474030 to 1117654 tid 1 2026-02-17T11:51:02.387 INFO:tasks.rados.rados.0.trial142.stdout:776: writing trial14245205-10 from 1520131 to 2255900 tid 2 2026-02-17T11:51:02.388 INFO:tasks.rados.rados.0.trial142.stdout:777: snap_remove snap 65 2026-02-17T11:51:03.308 INFO:tasks.rados.rados.0.trial142.stdout:777: done (1 left) 2026-02-17T11:51:03.308 INFO:tasks.rados.rados.0.trial142.stdout:778: write oid 41 current snap is 93 2026-02-17T11:51:03.308 INFO:tasks.rados.rados.0.trial142.stdout:778: seq_num 291 ranges {490837=718873,1862260=479427,2875032=15805} 2026-02-17T11:51:03.313 INFO:tasks.rados.rados.0.trial142.stdout:778: writing trial14245205-41 from 490837 to 1209710 tid 1 2026-02-17T11:51:03.318 INFO:tasks.rados.rados.0.trial142.stdout:778: writing trial14245205-41 from 1862260 to 2341687 tid 2 2026-02-17T11:51:03.321 INFO:tasks.rados.rados.0.trial142.stdout:778: writing trial14245205-41 from 2875032 to 2890837 tid 3 2026-02-17T11:51:03.322 INFO:tasks.rados.rados.0.trial142.stdout:779: rollback oid 18 current snap is 93 2026-02-17T11:51:03.322 INFO:tasks.rados.rados.0.trial142.stdout:776: finishing write tid 1 to trial14245205-10 2026-02-17T11:51:03.322 INFO:tasks.rados.rados.0.trial142.stdout:776: finishing write tid 2 to trial14245205-10 2026-02-17T11:51:03.322 INFO:tasks.rados.rados.0.trial142.stdout:776: finishing write tid 3 to trial14245205-10 2026-02-17T11:51:03.322 INFO:tasks.rados.rados.0.trial142.stdout:776: finishing write tid 4 to trial14245205-10 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:776: oid 10 updating version 0 to 362 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:776: oid 10 version 362 is already newer than 360 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:776: oid 10 version 362 is already newer than 361 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 362 (ObjNum 290 snap 93 seq_num 290) dirty exists 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:776: left oid 10 (ObjNum 290 snap 93 seq_num 290) 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:778: finishing write tid 1 to trial14245205-41 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 70 2026-02-17T11:51:03.323 INFO:tasks.rados.rados.0.trial142.stdout:778: finishing write tid 2 to trial14245205-41 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:776: done (2 left) 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:780: rollback oid 2 current snap is 93 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 83 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:781: read oid 27 snap 74 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:781: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:782: delete oid 49 current snap is 93 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: finishing write tid 3 to trial14245205-41 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: finishing write tid 4 to trial14245205-41 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: finishing write tid 5 to trial14245205-41 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: oid 41 updating version 0 to 241 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: oid 41 updating version 241 to 244 2026-02-17T11:51:03.324 INFO:tasks.rados.rados.0.trial142.stdout:778: oid 41 version 244 is already newer than 243 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:778: oid 41 version 244 is already newer than 242 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 244 (ObjNum 291 snap 93 seq_num 291) dirty exists 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:778: left oid 41 (ObjNum 291 snap 93 seq_num 291) 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:780: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:780: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:51:03.325 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 246 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T11:51:03.326 INFO:tasks.rados.rados.0.trial142.stdout:779: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:51:03.326 INFO:tasks.rados.rados.0.trial142.stdout:779: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:51:03.326 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 606 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:51:03.326 INFO:tasks.rados.rados.0.trial142.stdout:778: done (4 left) 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:779: done (3 left) 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:780: done (2 left) 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:782: done (1 left) 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:783: read oid 6 snap 81 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:783: expect (ObjNum 212 snap 68 seq_num 212) 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:784: snap_create 2026-02-17T11:51:03.327 INFO:tasks.rados.rados.0.trial142.stdout:781: expect (ObjNum 216 snap 69 seq_num 216) 2026-02-17T11:51:03.405 INFO:tasks.rados.rados.0.trial142.stdout:783: expect (ObjNum 212 snap 68 seq_num 212) 2026-02-17T11:51:04.088 INFO:tasks.rados.rados.0.trial142.stdout:781: done (2 left) 2026-02-17T11:51:04.088 INFO:tasks.rados.rados.0.trial142.stdout:783: done (1 left) 2026-02-17T11:51:04.088 INFO:tasks.rados.rados.0.trial142.stdout:784: done (0 left) 2026-02-17T11:51:04.088 INFO:tasks.rados.rados.0.trial142.stdout:785: write (excl) oid 3 current snap is 94 2026-02-17T11:51:04.088 INFO:tasks.rados.rados.0.trial142.stdout:785: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2026-02-17T11:51:04.091 INFO:tasks.rados.rados.0.trial142.stdout:785: writing trial14245205-3 from 524451 to 993822 tid 1 2026-02-17T11:51:04.095 INFO:tasks.rados.rados.0.trial142.stdout:785: writing trial14245205-3 from 1579224 to 2062320 tid 2 2026-02-17T11:51:04.098 INFO:tasks.rados.rados.0.trial142.stdout:785: writing trial14245205-3 from 2529878 to 2924451 tid 3 2026-02-17T11:51:04.099 INFO:tasks.rados.rados.0.trial142.stdout:786: write (excl) oid 16 current snap is 94 2026-02-17T11:51:04.099 INFO:tasks.rados.rados.0.trial142.stdout:786: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2026-02-17T11:51:04.103 INFO:tasks.rados.rados.0.trial142.stdout:786: writing trial14245205-16 from 541258 to 1085878 tid 1 2026-02-17T11:51:04.108 INFO:tasks.rados.rados.0.trial142.stdout:786: writing trial14245205-16 from 1637706 to 2264460 tid 2 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:786: writing trial14245205-16 from 2840948 to 2941258 tid 3 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:787: delete oid 25 current snap is 94 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:785: finishing write tid 1 to trial14245205-3 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:785: finishing write tid 2 to trial14245205-3 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:785: finishing write tid 3 to trial14245205-3 2026-02-17T11:51:04.111 INFO:tasks.rados.rados.0.trial142.stdout:785: finishing write tid 4 to trial14245205-3 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: finishing write tid 5 to trial14245205-3 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: oid 3 updating version 0 to 253 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: oid 3 version 253 is already newer than 251 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: oid 3 version 253 is already newer than 252 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: oid 3 updating version 253 to 254 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 254 (ObjNum 293 snap 94 seq_num 293) dirty exists 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:785: left oid 3 (ObjNum 293 snap 94 seq_num 293) 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:786: finishing write tid 1 to trial14245205-16 2026-02-17T11:51:04.112 INFO:tasks.rados.rados.0.trial142.stdout:786: finishing write tid 2 to trial14245205-16 2026-02-17T11:51:04.113 INFO:tasks.rados.rados.0.trial142.stdout:786: finishing write tid 3 to trial14245205-16 2026-02-17T11:51:04.113 INFO:tasks.rados.rados.0.trial142.stdout:786: finishing write tid 4 to trial14245205-16 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: finishing write tid 5 to trial14245205-16 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: oid 16 updating version 0 to 561 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: oid 16 version 561 is already newer than 559 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: oid 16 version 561 is already newer than 558 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: oid 16 version 561 is already newer than 560 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 561 (ObjNum 294 snap 94 seq_num 294) dirty exists 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: left oid 16 (ObjNum 294 snap 94 seq_num 294) 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:785: done (2 left) 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:786: done (1 left) 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:787: done (0 left) 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:788: copy_from oid 39 from oid 47 current snap is 94 2026-02-17T11:51:04.114 INFO:tasks.rados.rados.0.trial142.stdout:789: snap_remove snap 92 2026-02-17T11:51:05.088 INFO:tasks.rados.rados.0.trial142.stdout:789: done (1 left) 2026-02-17T11:51:05.088 INFO:tasks.rados.rados.0.trial142.stdout:790: snap_create 2026-02-17T11:51:05.088 INFO:tasks.rados.rados.0.trial142.stdout:788: finishing copy_from to trial14245205-39 2026-02-17T11:51:05.088 INFO:tasks.rados.rados.0.trial142.stdout:788: got expected ENOENT (src dne) 2026-02-17T11:51:05.088 INFO:tasks.rados.rados.0.trial142.stdout:788: finishing copy_from racing read to trial14245205-39 2026-02-17T11:51:06.093 INFO:tasks.rados.rados.0.trial142.stdout:788: done (1 left) 2026-02-17T11:51:06.093 INFO:tasks.rados.rados.0.trial142.stdout:790: done (0 left) 2026-02-17T11:51:06.093 INFO:tasks.rados.rados.0.trial142.stdout:791: copy_from oid 42 from oid 43 current snap is 95 2026-02-17T11:51:06.093 INFO:tasks.rados.rados.0.trial142.stdout:792: write oid 31 current snap is 95 2026-02-17T11:51:06.094 INFO:tasks.rados.rados.0.trial142.stdout:792: seq_num 296 ranges {574872=695118,2038317=630423} 2026-02-17T11:51:06.098 INFO:tasks.rados.rados.0.trial142.stdout:792: writing trial14245205-31 from 574872 to 1269990 tid 1 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:792: writing trial14245205-31 from 2038317 to 2668740 tid 2 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:793: delete oid 49 current snap is 95 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:791: finishing copy_from racing read to trial14245205-42 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:791: finishing copy_from to trial14245205-42 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 32 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T11:51:06.104 INFO:tasks.rados.rados.0.trial142.stdout:792: finishing write tid 1 to trial14245205-31 2026-02-17T11:51:06.105 INFO:tasks.rados.rados.0.trial142.stdout:791: done (2 left) 2026-02-17T11:51:06.105 INFO:tasks.rados.rados.0.trial142.stdout:793: done (1 left) 2026-02-17T11:51:06.105 INFO:tasks.rados.rados.0.trial142.stdout:794: delete oid 50 current snap is 95 2026-02-17T11:51:06.106 INFO:tasks.rados.rados.0.trial142.stdout:792: finishing write tid 2 to trial14245205-31 2026-02-17T11:51:06.106 INFO:tasks.rados.rados.0.trial142.stdout:792: finishing write tid 3 to trial14245205-31 2026-02-17T11:51:06.106 INFO:tasks.rados.rados.0.trial142.stdout:792: finishing write tid 4 to trial14245205-31 2026-02-17T11:51:06.106 INFO:tasks.rados.rados.0.trial142.stdout:792: oid 31 updating version 0 to 492 2026-02-17T11:51:06.106 INFO:tasks.rados.rados.0.trial142.stdout:792: oid 31 updating version 492 to 493 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:792: oid 31 updating version 493 to 494 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 494 (ObjNum 296 snap 95 seq_num 296) dirty exists 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:792: left oid 31 (ObjNum 296 snap 95 seq_num 296) 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:792: done (1 left) 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:794: done (0 left) 2026-02-17T11:51:06.107 INFO:tasks.rados.rados.0.trial142.stdout:795: snap_create 2026-02-17T11:51:07.093 INFO:tasks.rados.rados.0.trial142.stdout:795: done (0 left) 2026-02-17T11:51:07.094 INFO:tasks.rados.rados.0.trial142.stdout:796: write (excl) oid 10 current snap is 96 2026-02-17T11:51:07.094 INFO:tasks.rados.rados.0.trial142.stdout:796: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2026-02-17T11:51:07.099 INFO:tasks.rados.rados.0.trial142.stdout:796: writing trial14245205-10 from 625293 to 1262511 tid 1 2026-02-17T11:51:07.103 INFO:tasks.rados.rados.0.trial142.stdout:796: writing trial14245205-10 from 1813763 to 2307866 tid 2 2026-02-17T11:51:07.105 INFO:tasks.rados.rados.0.trial142.stdout:796: writing trial14245205-10 from 2978063 to 3025293 tid 3 2026-02-17T11:51:07.105 INFO:tasks.rados.rados.0.trial142.stdout:797: snap_create 2026-02-17T11:51:07.105 INFO:tasks.rados.rados.0.trial142.stdout:796: finishing write tid 1 to trial14245205-10 2026-02-17T11:51:07.106 INFO:tasks.rados.rados.0.trial142.stdout:796: finishing write tid 2 to trial14245205-10 2026-02-17T11:51:07.106 INFO:tasks.rados.rados.0.trial142.stdout:796: finishing write tid 3 to trial14245205-10 2026-02-17T11:51:07.106 INFO:tasks.rados.rados.0.trial142.stdout:796: finishing write tid 4 to trial14245205-10 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: finishing write tid 5 to trial14245205-10 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: oid 10 updating version 0 to 378 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: oid 10 version 378 is already newer than 376 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: oid 10 version 378 is already newer than 377 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: oid 10 updating version 378 to 379 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 379 (ObjNum 299 snap 96 seq_num 299) dirty exists 2026-02-17T11:51:07.107 INFO:tasks.rados.rados.0.trial142.stdout:796: left oid 10 (ObjNum 299 snap 96 seq_num 299) 2026-02-17T11:51:08.097 INFO:tasks.rados.rados.0.trial142.stdout:796: done (1 left) 2026-02-17T11:51:08.098 INFO:tasks.rados.rados.0.trial142.stdout:797: done (0 left) 2026-02-17T11:51:08.098 INFO:tasks.rados.rados.0.trial142.stdout:798: write oid 7 current snap is 97 2026-02-17T11:51:08.098 INFO:tasks.rados.rados.0.trial142.stdout:798: seq_num 300 ranges {642100=712467,1872245=637761} 2026-02-17T11:51:08.102 INFO:tasks.rados.rados.0.trial142.stdout:798: writing trial14245205-7 from 642100 to 1354567 tid 1 2026-02-17T11:51:08.107 INFO:tasks.rados.rados.0.trial142.stdout:798: writing trial14245205-7 from 1872245 to 2510006 tid 2 2026-02-17T11:51:08.107 INFO:tasks.rados.rados.0.trial142.stdout:799: snap_remove snap 70 2026-02-17T11:51:09.099 INFO:tasks.rados.rados.0.trial142.stdout:799: done (1 left) 2026-02-17T11:51:09.099 INFO:tasks.rados.rados.0.trial142.stdout:800: copy_from oid 2 from oid 38 current snap is 97 2026-02-17T11:51:09.099 INFO:tasks.rados.rados.0.trial142.stdout:798: finishing write tid 1 to trial14245205-7 2026-02-17T11:51:09.099 INFO:tasks.rados.rados.0.trial142.stdout:798: finishing write tid 2 to trial14245205-7 2026-02-17T11:51:09.099 INFO:tasks.rados.rados.0.trial142.stdout:798: finishing write tid 3 to trial14245205-7 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: finishing write tid 4 to trial14245205-7 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: oid 7 updating version 0 to 623 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: oid 7 version 623 is already newer than 622 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: oid 7 updating version 623 to 624 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 624 (ObjNum 300 snap 97 seq_num 300) dirty exists 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: left oid 7 (ObjNum 300 snap 97 seq_num 300) 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:798: done (1 left) 2026-02-17T11:51:09.100 INFO:tasks.rados.rados.0.trial142.stdout:801: snap_create 2026-02-17T11:51:09.101 INFO:tasks.rados.rados.0.trial142.stdout:800: finishing copy_from to trial14245205-2 2026-02-17T11:51:09.101 INFO:tasks.rados.rados.0.trial142.stdout:800: got expected ENOENT (src dne) 2026-02-17T11:51:09.101 INFO:tasks.rados.rados.0.trial142.stdout:800: finishing copy_from racing read to trial14245205-2 2026-02-17T11:51:10.102 INFO:tasks.rados.rados.0.trial142.stdout:800: done (1 left) 2026-02-17T11:51:10.102 INFO:tasks.rados.rados.0.trial142.stdout:801: done (0 left) 2026-02-17T11:51:10.102 INFO:tasks.rados.rados.0.trial142.stdout:802: delete oid 42 current snap is 98 2026-02-17T11:51:10.104 INFO:tasks.rados.rados.0.trial142.stdout:802: done (0 left) 2026-02-17T11:51:10.104 INFO:tasks.rados.rados.0.trial142.stdout:803: snap_create 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:803: done (0 left) 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:804: read oid 37 snap 85 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:804: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:805: read oid 16 snap 87 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:805: expect (ObjNum 240 snap 75 seq_num 240) 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:806: write (excl) oid 30 current snap is 99 2026-02-17T11:51:11.104 INFO:tasks.rados.rados.0.trial142.stdout:806: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2026-02-17T11:51:11.108 INFO:tasks.rados.rados.0.trial142.stdout:806: writing trial14245205-30 from 675714 to 1138679 tid 1 2026-02-17T11:51:11.112 INFO:tasks.rados.rados.0.trial142.stdout:806: writing trial14245205-30 from 1589209 to 2230639 tid 2 2026-02-17T11:51:11.116 INFO:tasks.rados.rados.0.trial142.stdout:806: writing trial14245205-30 from 2943979 to 3075714 tid 3 2026-02-17T11:51:11.116 INFO:tasks.rados.rados.0.trial142.stdout:807: delete oid 4 current snap is 99 2026-02-17T11:51:11.116 INFO:tasks.rados.rados.0.trial142.stdout:804: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:51:11.218 INFO:tasks.rados.rados.0.trial142.stdout:805: expect (ObjNum 240 snap 75 seq_num 240) 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:806: finishing write tid 1 to trial14245205-30 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:806: finishing write tid 2 to trial14245205-30 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:804: done (3 left) 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:805: done (2 left) 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:807: done (1 left) 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:808: write (excl) oid 17 current snap is 99 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:806: finishing write tid 3 to trial14245205-30 2026-02-17T11:51:11.306 INFO:tasks.rados.rados.0.trial142.stdout:808: seq_num 304 ranges {709328=613463,1989820=645099} 2026-02-17T11:51:11.311 INFO:tasks.rados.rados.0.trial142.stdout:808: writing trial14245205-17 from 709328 to 1322791 tid 1 2026-02-17T11:51:11.316 INFO:tasks.rados.rados.0.trial142.stdout:808: writing trial14245205-17 from 1989820 to 2634919 tid 2 2026-02-17T11:51:11.316 INFO:tasks.rados.rados.0.trial142.stdout:809: snap_remove snap 97 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:809: done (2 left) 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:810: rollback oid 16 current snap is 99 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 95 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: finishing write tid 4 to trial14245205-30 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: finishing write tid 5 to trial14245205-30 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: oid 30 updating version 0 to 440 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: oid 30 version 440 is already newer than 439 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: oid 30 updating version 440 to 441 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: oid 30 version 441 is already newer than 438 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 441 (ObjNum 302 snap 99 seq_num 302) dirty exists 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:806: left oid 30 (ObjNum 302 snap 99 seq_num 302) 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:808: finishing write tid 1 to trial14245205-17 2026-02-17T11:51:12.083 INFO:tasks.rados.rados.0.trial142.stdout:808: finishing write tid 2 to trial14245205-17 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: finishing write tid 3 to trial14245205-17 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: finishing write tid 4 to trial14245205-17 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: oid 17 updating version 0 to 562 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: oid 17 updating version 562 to 564 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: oid 17 version 564 is already newer than 563 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 564 (ObjNum 304 snap 99 seq_num 304) dirty exists 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: left oid 17 (ObjNum 304 snap 99 seq_num 304) 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:806: done (2 left) 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:808: done (1 left) 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:811: write (excl) oid 17 current snap is 99 2026-02-17T11:51:12.084 INFO:tasks.rados.rados.0.trial142.stdout:811: seq_num 305 ranges {726135=405065,1764655=788757,3026248=99887} 2026-02-17T11:51:12.087 INFO:tasks.rados.rados.0.trial142.stdout:811: writing trial14245205-17 from 726135 to 1131200 tid 1 2026-02-17T11:51:12.093 INFO:tasks.rados.rados.0.trial142.stdout:811: writing trial14245205-17 from 1764655 to 2553412 tid 2 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:811: writing trial14245205-17 from 3026248 to 3126135 tid 3 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:812: read oid 23 snap -1 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:812: expect deleted 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:813: read oid 37 snap 87 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:813: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:814: read oid 15 snap 81 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:814: expect deleted 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:815: copy_from oid 12 from oid 28 current snap is 99 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:810: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:810: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:810: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 567 (ObjNum 294 snap 94 seq_num 294) dirty exists 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:811: finishing write tid 1 to trial14245205-17 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:810: done (5 left) 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:816: read oid 34 snap 82 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:816: expect deleted 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:817: rollback oid 26 current snap is 99 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 89 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:818: rollback oid 1 current snap is 99 2026-02-17T11:51:12.095 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 83 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:819: delete oid 44 current snap is 99 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: finishing write tid 2 to trial14245205-17 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: finishing write tid 3 to trial14245205-17 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: finishing write tid 4 to trial14245205-17 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: finishing write tid 5 to trial14245205-17 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: oid 17 updating version 0 to 568 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: oid 17 updating version 568 to 569 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: oid 17 updating version 569 to 570 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: oid 17 updating version 570 to 571 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 571 (ObjNum 305 snap 99 seq_num 305) dirty exists 2026-02-17T11:51:12.096 INFO:tasks.rados.rados.0.trial142.stdout:811: left oid 17 (ObjNum 305 snap 99 seq_num 305) 2026-02-17T11:51:12.097 INFO:tasks.rados.rados.0.trial142.stdout:813: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:51:12.200 INFO:tasks.rados.rados.0.trial142.stdout:817: finishing rollback tid 0 to trial14245205-26 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:817: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:817: finishing rollback tid 2 to trial14245205-26 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 227 (ObjNum 147 snap 40 seq_num 147) dirty exists 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:818: finishing rollback tid 0 to trial14245205-1 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:818: finishing rollback tid 1 to trial14245205-1 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:818: finishing rollback tid 2 to trial14245205-1 2026-02-17T11:51:12.201 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 214 (ObjNum 259 snap 81 seq_num 259) dirty exists 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:811: done (8 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:812: done (7 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:813: done (6 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:814: done (5 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:816: done (4 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:817: done (3 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:818: done (2 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:819: done (1 left) 2026-02-17T11:51:12.202 INFO:tasks.rados.rados.0.trial142.stdout:820: snap_remove snap 96 2026-02-17T11:51:13.108 INFO:tasks.rados.rados.0.trial142.stdout:820: done (1 left) 2026-02-17T11:51:13.108 INFO:tasks.rados.rados.0.trial142.stdout:821: delete oid 15 current snap is 99 2026-02-17T11:51:13.109 INFO:tasks.rados.rados.0.trial142.stdout:815: finishing copy_from racing read to trial14245205-12 2026-02-17T11:51:13.109 INFO:tasks.rados.rados.0.trial142.stdout:815: finishing copy_from to trial14245205-12 2026-02-17T11:51:13.109 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 233 (ObjNum 242 snap 78 seq_num 242) dirty exists 2026-02-17T11:51:13.111 INFO:tasks.rados.rados.0.trial142.stdout:815: done (1 left) 2026-02-17T11:51:13.112 INFO:tasks.rados.rados.0.trial142.stdout:821: done (0 left) 2026-02-17T11:51:13.112 INFO:tasks.rados.rados.0.trial142.stdout:822: write (excl) oid 5 current snap is 99 2026-02-17T11:51:13.112 INFO:tasks.rados.rados.0.trial142.stdout:822: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-17T11:51:13.117 INFO:tasks.rados.rados.0.trial142.stdout:822: writing trial14245205-5 from 776556 to 1407368 tid 1 2026-02-17T11:51:13.121 INFO:tasks.rados.rados.0.trial142.stdout:822: writing trial14245205-5 from 1823748 to 2476185 tid 2 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:822: writing trial14245205-5 from 3108517 to 3176556 tid 3 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:823: copy_from oid 8 from oid 17 current snap is 99 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:822: finishing write tid 1 to trial14245205-5 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:822: finishing write tid 2 to trial14245205-5 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:824: rollback oid 14 current snap is 99 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 89 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:825: read oid 10 snap -1 2026-02-17T11:51:13.125 INFO:tasks.rados.rados.0.trial142.stdout:825: expect (ObjNum 299 snap 96 seq_num 299) 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:826: read oid 33 snap -1 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:826: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:827: copy_from oid 42 from oid 29 current snap is 99 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:828: copy_from oid 3 from oid 1 current snap is 99 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:829: read oid 46 snap -1 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:829: expect deleted 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:830: copy_from oid 47 from oid 4 current snap is 99 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:831: read oid 12 snap 93 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:831: expect deleted 2026-02-17T11:51:13.126 INFO:tasks.rados.rados.0.trial142.stdout:832: snap_remove snap 85 2026-02-17T11:51:14.114 INFO:tasks.rados.rados.0.trial142.stdout:832: done (10 left) 2026-02-17T11:51:14.114 INFO:tasks.rados.rados.0.trial142.stdout:833: copy_from oid 16 from oid 26 current snap is 99 2026-02-17T11:51:14.114 INFO:tasks.rados.rados.0.trial142.stdout:824: finishing rollback tid 0 to trial14245205-14 2026-02-17T11:51:14.114 INFO:tasks.rados.rados.0.trial142.stdout:824: finishing rollback tid 1 to trial14245205-14 2026-02-17T11:51:14.115 INFO:tasks.rados.rados.0.trial142.stdout:824: finishing rollback tid 2 to trial14245205-14 2026-02-17T11:51:14.115 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 647 (ObjNum 272 snap 85 seq_num 272) dirty exists 2026-02-17T11:51:14.115 INFO:tasks.rados.rados.0.trial142.stdout:827: finishing copy_from racing read to trial14245205-42 2026-02-17T11:51:14.115 INFO:tasks.rados.rados.0.trial142.stdout:826: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: finishing write tid 3 to trial14245205-5 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: finishing write tid 4 to trial14245205-5 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: finishing write tid 5 to trial14245205-5 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: oid 5 updating version 0 to 575 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: oid 5 version 575 is already newer than 572 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: oid 5 version 575 is already newer than 573 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: oid 5 version 575 is already newer than 574 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 575 (ObjNum 308 snap 99 seq_num 308) dirty exists 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:822: left oid 5 (ObjNum 308 snap 99 seq_num 308) 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:828: finishing copy_from racing read to trial14245205-3 2026-02-17T11:51:14.242 INFO:tasks.rados.rados.0.trial142.stdout:825: expect (ObjNum 299 snap 96 seq_num 299) 2026-02-17T11:51:14.369 INFO:tasks.rados.rados.0.trial142.stdout:830: finishing copy_from to trial14245205-47 2026-02-17T11:51:14.369 INFO:tasks.rados.rados.0.trial142.stdout:830: got expected ENOENT (src dne) 2026-02-17T11:51:14.369 INFO:tasks.rados.rados.0.trial142.stdout:830: finishing copy_from racing read to trial14245205-47 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:823: finishing copy_from racing read to trial14245205-8 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:827: finishing copy_from to trial14245205-42 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 437 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:823: finishing copy_from to trial14245205-8 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 571 (ObjNum 305 snap 99 seq_num 305) dirty exists 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:828: finishing copy_from to trial14245205-3 2026-02-17T11:51:14.370 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 214 (ObjNum 259 snap 81 seq_num 259) dirty exists 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:833: finishing copy_from racing read to trial14245205-16 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:833: finishing copy_from to trial14245205-16 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 227 (ObjNum 147 snap 40 seq_num 147) dirty exists 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:822: done (10 left) 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:823: done (9 left) 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:824: done (8 left) 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:825: done (7 left) 2026-02-17T11:51:14.371 INFO:tasks.rados.rados.0.trial142.stdout:826: done (6 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:827: done (5 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:828: done (4 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:829: done (3 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:830: done (2 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:831: done (1 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:833: done (0 left) 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:834: read oid 21 snap -1 2026-02-17T11:51:14.372 INFO:tasks.rados.rados.0.trial142.stdout:834: expect deleted 2026-02-17T11:51:14.373 INFO:tasks.rados.rados.0.trial142.stdout:835: read oid 40 snap -1 2026-02-17T11:51:14.373 INFO:tasks.rados.rados.0.trial142.stdout:835: expect deleted 2026-02-17T11:51:14.373 INFO:tasks.rados.rados.0.trial142.stdout:836: write oid 38 current snap is 99 2026-02-17T11:51:14.373 INFO:tasks.rados.rados.0.trial142.stdout:836: seq_num 309 ranges {793363=706061,2282230=796095} 2026-02-17T11:51:14.374 INFO:tasks.rados.rados.0.trial142.stdout:836: writing trial14245205-38 from 793363 to 1499424 tid 1 2026-02-17T11:51:14.380 INFO:tasks.rados.rados.0.trial142.stdout:836: writing trial14245205-38 from 2282230 to 3078325 tid 2 2026-02-17T11:51:14.380 INFO:tasks.rados.rados.0.trial142.stdout:837: read oid 17 snap -1 2026-02-17T11:51:14.380 INFO:tasks.rados.rados.0.trial142.stdout:837: expect (ObjNum 305 snap 99 seq_num 305) 2026-02-17T11:51:14.380 INFO:tasks.rados.rados.0.trial142.stdout:838: write (excl) oid 19 current snap is 99 2026-02-17T11:51:14.380 INFO:tasks.rados.rados.0.trial142.stdout:838: seq_num 310 ranges {410170=781310,1940712=656106,3163363=46807} 2026-02-17T11:51:14.384 INFO:tasks.rados.rados.0.trial142.stdout:838: writing trial14245205-19 from 410170 to 1191480 tid 1 2026-02-17T11:51:14.389 INFO:tasks.rados.rados.0.trial142.stdout:838: writing trial14245205-19 from 1940712 to 2596818 tid 2 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:838: writing trial14245205-19 from 3163363 to 3210170 tid 3 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:839: read oid 48 snap -1 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:839: expect (ObjNum 258 snap 80 seq_num 258) 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:840: snap_create 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:836: finishing write tid 1 to trial14245205-38 2026-02-17T11:51:14.392 INFO:tasks.rados.rados.0.trial142.stdout:836: finishing write tid 2 to trial14245205-38 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: finishing write tid 3 to trial14245205-38 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: finishing write tid 4 to trial14245205-38 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: oid 38 updating version 0 to 76 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: oid 38 version 76 is already newer than 75 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: oid 38 version 76 is already newer than 74 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 76 (ObjNum 309 snap 99 seq_num 309) dirty exists 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:836: left oid 38 (ObjNum 309 snap 99 seq_num 309) 2026-02-17T11:51:14.393 INFO:tasks.rados.rados.0.trial142.stdout:837: expect (ObjNum 305 snap 99 seq_num 305) 2026-02-17T11:51:14.494 INFO:tasks.rados.rados.0.trial142.stdout:838: finishing write tid 1 to trial14245205-19 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: finishing write tid 2 to trial14245205-19 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: finishing write tid 3 to trial14245205-19 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: finishing write tid 4 to trial14245205-19 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: finishing write tid 5 to trial14245205-19 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: oid 19 updating version 0 to 394 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: oid 19 updating version 394 to 395 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: oid 19 updating version 395 to 396 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: oid 19 version 396 is already newer than 393 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 396 (ObjNum 310 snap 99 seq_num 310) dirty exists 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:838: left oid 19 (ObjNum 310 snap 99 seq_num 310) 2026-02-17T11:51:14.495 INFO:tasks.rados.rados.0.trial142.stdout:839: expect (ObjNum 258 snap 80 seq_num 258) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:834: done (6 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:835: done (5 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:836: done (4 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:837: done (3 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:838: done (2 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:839: done (1 left) 2026-02-17T11:51:15.117 INFO:tasks.rados.rados.0.trial142.stdout:840: done (0 left) 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:841: read oid 29 snap -1 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:841: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:842: rollback oid 28 current snap is 100 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 99 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:843: copy_from oid 31 from oid 22 current snap is 100 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:844: read oid 47 snap 75 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:844: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:51:15.118 INFO:tasks.rados.rados.0.trial142.stdout:845: snap_remove snap 89 2026-02-17T11:51:16.120 INFO:tasks.rados.rados.0.trial142.stdout:845: done (4 left) 2026-02-17T11:51:16.120 INFO:tasks.rados.rados.0.trial142.stdout:846: copy_from oid 41 from oid 18 current snap is 100 2026-02-17T11:51:16.121 INFO:tasks.rados.rados.0.trial142.stdout:841: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:843: finishing copy_from to trial14245205-31 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:843: got expected ENOENT (src dne) 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:843: finishing copy_from racing read to trial14245205-31 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:842: finishing rollback tid 0 to trial14245205-28 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:842: finishing rollback tid 1 to trial14245205-28 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:842: finishing rollback tid 2 to trial14245205-28 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 270 (ObjNum 242 snap 78 seq_num 242) dirty exists 2026-02-17T11:51:16.176 INFO:tasks.rados.rados.0.trial142.stdout:844: expect (ObjNum 195 snap 56 seq_num 195) 2026-02-17T11:51:16.251 INFO:tasks.rados.rados.0.trial142.stdout:846: finishing copy_from racing read to trial14245205-41 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:846: finishing copy_from to trial14245205-41 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 606 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:841: done (4 left) 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:842: done (3 left) 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:843: done (2 left) 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:844: done (1 left) 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:846: done (0 left) 2026-02-17T11:51:16.252 INFO:tasks.rados.rados.0.trial142.stdout:847: snap_remove snap 83 2026-02-17T11:51:17.083 INFO:tasks.rados.rados.0.trial142.stdout:847: done (0 left) 2026-02-17T11:51:17.084 INFO:tasks.rados.rados.0.trial142.stdout:848: read oid 17 snap 66 2026-02-17T11:51:17.084 INFO:tasks.rados.rados.0.trial142.stdout:848: expect (ObjNum 190 snap 54 seq_num 190) 2026-02-17T11:51:17.084 INFO:tasks.rados.rados.0.trial142.stdout:849: snap_remove snap 95 2026-02-17T11:51:18.086 INFO:tasks.rados.rados.0.trial142.stdout:849: done (1 left) 2026-02-17T11:51:18.086 INFO:tasks.rados.rados.0.trial142.stdout:850: write (excl) oid 19 current snap is 100 2026-02-17T11:51:18.086 INFO:tasks.rados.rados.0.trial142.stdout:850: seq_num 311 ranges {426977=456559,1482841=799764,2958080=268897} 2026-02-17T11:51:18.089 INFO:tasks.rados.rados.0.trial142.stdout:850: writing trial14245205-19 from 426977 to 883536 tid 1 2026-02-17T11:51:18.095 INFO:tasks.rados.rados.0.trial142.stdout:850: writing trial14245205-19 from 1482841 to 2282605 tid 2 2026-02-17T11:51:18.099 INFO:tasks.rados.rados.0.trial142.stdout:850: writing trial14245205-19 from 2958080 to 3226977 tid 3 2026-02-17T11:51:18.099 INFO:tasks.rados.rados.0.trial142.stdout:851: read oid 26 snap 66 2026-02-17T11:51:18.099 INFO:tasks.rados.rados.0.trial142.stdout:851: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:51:18.099 INFO:tasks.rados.rados.0.trial142.stdout:852: write (excl) oid 25 current snap is 100 2026-02-17T11:51:18.099 INFO:tasks.rados.rados.0.trial142.stdout:852: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2026-02-17T11:51:18.103 INFO:tasks.rados.rados.0.trial142.stdout:852: writing trial14245205-25 from 443784 to 1091945 tid 1 2026-02-17T11:51:18.107 INFO:tasks.rados.rados.0.trial142.stdout:852: writing trial14245205-25 from 1657676 to 2317451 tid 2 2026-02-17T11:51:18.111 INFO:tasks.rados.rados.0.trial142.stdout:852: writing trial14245205-25 from 2818209 to 3243784 tid 3 2026-02-17T11:51:18.111 INFO:tasks.rados.rados.0.trial142.stdout:853: copy_from oid 31 from oid 2 current snap is 100 2026-02-17T11:51:18.111 INFO:tasks.rados.rados.0.trial142.stdout:848: expect (ObjNum 190 snap 54 seq_num 190) 2026-02-17T11:51:18.213 INFO:tasks.rados.rados.0.trial142.stdout:850: finishing write tid 1 to trial14245205-19 2026-02-17T11:51:18.213 INFO:tasks.rados.rados.0.trial142.stdout:850: finishing write tid 2 to trial14245205-19 2026-02-17T11:51:18.213 INFO:tasks.rados.rados.0.trial142.stdout:850: finishing write tid 3 to trial14245205-19 2026-02-17T11:51:18.213 INFO:tasks.rados.rados.0.trial142.stdout:848: done (4 left) 2026-02-17T11:51:18.213 INFO:tasks.rados.rados.0.trial142.stdout:854: snap_remove snap 87 2026-02-17T11:51:19.123 INFO:tasks.rados.rados.0.trial142.stdout:854: done (4 left) 2026-02-17T11:51:19.123 INFO:tasks.rados.rados.0.trial142.stdout:855: rollback oid 8 current snap is 100 2026-02-17T11:51:19.123 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 82 2026-02-17T11:51:19.123 INFO:tasks.rados.rados.0.trial142.stdout:850: finishing write tid 4 to trial14245205-19 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: finishing write tid 5 to trial14245205-19 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: oid 19 updating version 0 to 415 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: oid 19 updating version 415 to 417 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: oid 19 version 417 is already newer than 416 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: oid 19 version 417 is already newer than 410 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 417 (ObjNum 311 snap 100 seq_num 311) dirty exists 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:850: left oid 19 (ObjNum 311 snap 100 seq_num 311) 2026-02-17T11:51:19.124 INFO:tasks.rados.rados.0.trial142.stdout:851: expect (ObjNum 147 snap 40 seq_num 147) 2026-02-17T11:51:19.183 INFO:tasks.rados.rados.0.trial142.stdout:852: finishing write tid 1 to trial14245205-25 2026-02-17T11:51:19.183 INFO:tasks.rados.rados.0.trial142.stdout:852: finishing write tid 2 to trial14245205-25 2026-02-17T11:51:19.183 INFO:tasks.rados.rados.0.trial142.stdout:853: finishing copy_from to trial14245205-31 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:853: got expected ENOENT (src dne) 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:853: finishing copy_from racing read to trial14245205-31 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:850: done (4 left) 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:851: done (3 left) 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:853: done (2 left) 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:856: write oid 40 current snap is 100 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:852: finishing write tid 3 to trial14245205-25 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:852: finishing write tid 4 to trial14245205-25 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:852: finishing write tid 5 to trial14245205-25 2026-02-17T11:51:19.184 INFO:tasks.rados.rados.0.trial142.stdout:852: oid 25 updating version 0 to 251 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:852: oid 25 version 251 is already newer than 250 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:852: oid 25 updating version 251 to 252 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:852: oid 25 updating version 252 to 253 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 253 (ObjNum 312 snap 100 seq_num 312) dirty exists 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:852: left oid 25 (ObjNum 312 snap 100 seq_num 312) 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:855: finishing rollback tid 0 to trial14245205-8 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:855: finishing rollback tid 1 to trial14245205-8 2026-02-17T11:51:19.185 INFO:tasks.rados.rados.0.trial142.stdout:856: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2026-02-17T11:51:19.187 INFO:tasks.rados.rados.0.trial142.stdout:856: writing trial14245205-40 from 460591 to 1184001 tid 1 2026-02-17T11:51:19.190 INFO:tasks.rados.rados.0.trial142.stdout:856: writing trial14245205-40 from 1716158 to 2119591 tid 2 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:856: writing trial14245205-40 from 2729279 to 3169419 tid 3 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:852: done (2 left) 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:857: rollback oid 29 current snap is 100 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 81 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:855: finishing rollback tid 2 to trial14245205-8 2026-02-17T11:51:19.195 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 574 (ObjNum 257 snap 80 seq_num 257) dirty exists 2026-02-17T11:51:19.196 INFO:tasks.rados.rados.0.trial142.stdout:856: finishing write tid 1 to trial14245205-40 2026-02-17T11:51:19.196 INFO:tasks.rados.rados.0.trial142.stdout:856: finishing write tid 2 to trial14245205-40 2026-02-17T11:51:19.196 INFO:tasks.rados.rados.0.trial142.stdout:855: done (2 left) 2026-02-17T11:51:19.196 INFO:tasks.rados.rados.0.trial142.stdout:858: write oid 2 current snap is 100 2026-02-17T11:51:19.196 INFO:tasks.rados.rados.0.trial142.stdout:858: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-17T11:51:19.199 INFO:tasks.rados.rados.0.trial142.stdout:858: writing trial14245205-2 from 477398 to 1276057 tid 1 2026-02-17T11:51:19.203 INFO:tasks.rados.rados.0.trial142.stdout:858: writing trial14245205-2 from 1774640 to 2438084 tid 2 2026-02-17T11:51:19.207 INFO:tasks.rados.rados.0.trial142.stdout:858: writing trial14245205-2 from 2873055 to 3277398 tid 3 2026-02-17T11:51:19.207 INFO:tasks.rados.rados.0.trial142.stdout:859: read oid 25 snap 84 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:859: expect (ObjNum 207 snap 66 seq_num 207) 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:860: snap_create 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:857: finishing rollback tid 0 to trial14245205-29 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: finishing write tid 3 to trial14245205-40 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: finishing write tid 4 to trial14245205-40 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:857: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: finishing write tid 5 to trial14245205-40 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: oid 40 updating version 0 to 188 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: oid 40 version 188 is already newer than 187 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: oid 40 version 188 is already newer than 186 2026-02-17T11:51:19.208 INFO:tasks.rados.rados.0.trial142.stdout:856: oid 40 updating version 188 to 189 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 189 (ObjNum 313 snap 100 seq_num 313) dirty exists 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:856: left oid 40 (ObjNum 313 snap 100 seq_num 313) 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:857: finishing rollback tid 2 to trial14245205-29 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 444 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:858: finishing write tid 1 to trial14245205-2 2026-02-17T11:51:19.209 INFO:tasks.rados.rados.0.trial142.stdout:858: finishing write tid 2 to trial14245205-2 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: finishing write tid 3 to trial14245205-2 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: finishing write tid 4 to trial14245205-2 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: finishing write tid 5 to trial14245205-2 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: oid 2 updating version 0 to 609 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: oid 2 version 609 is already newer than 608 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: oid 2 updating version 609 to 610 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:858: oid 2 version 610 is already newer than 607 2026-02-17T11:51:19.210 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 610 (ObjNum 314 snap 100 seq_num 314) dirty exists 2026-02-17T11:51:19.211 INFO:tasks.rados.rados.0.trial142.stdout:858: left oid 2 (ObjNum 314 snap 100 seq_num 314) 2026-02-17T11:51:19.214 INFO:tasks.rados.rados.0.trial142.stdout:859: expect (ObjNum 207 snap 66 seq_num 207) 2026-02-17T11:51:20.132 INFO:tasks.rados.rados.0.trial142.stdout:856: done (4 left) 2026-02-17T11:51:20.132 INFO:tasks.rados.rados.0.trial142.stdout:857: done (3 left) 2026-02-17T11:51:20.132 INFO:tasks.rados.rados.0.trial142.stdout:858: done (2 left) 2026-02-17T11:51:20.133 INFO:tasks.rados.rados.0.trial142.stdout:859: done (1 left) 2026-02-17T11:51:20.133 INFO:tasks.rados.rados.0.trial142.stdout:860: done (0 left) 2026-02-17T11:51:20.133 INFO:tasks.rados.rados.0.trial142.stdout:861: snap_create 2026-02-17T11:51:21.134 INFO:tasks.rados.rados.0.trial142.stdout:861: done (0 left) 2026-02-17T11:51:21.134 INFO:tasks.rados.rados.0.trial142.stdout:862: rollback oid 46 current snap is 102 2026-02-17T11:51:21.135 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 84 2026-02-17T11:51:21.135 INFO:tasks.rados.rados.0.trial142.stdout:863: write oid 45 current snap is 102 2026-02-17T11:51:21.135 INFO:tasks.rados.rados.0.trial142.stdout:863: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2026-02-17T11:51:21.138 INFO:tasks.rados.rados.0.trial142.stdout:863: writing trial14245205-45 from 494205 to 968113 tid 1 2026-02-17T11:51:21.141 INFO:tasks.rados.rados.0.trial142.stdout:863: writing trial14245205-45 from 1433122 to 1840224 tid 2 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:863: writing trial14245205-45 from 2384125 to 2846809 tid 3 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:864: copy_from oid 34 from oid 11 current snap is 102 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:862: finishing rollback tid 1 to trial14245205-46 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 0 (ObjNum 33 snap 0 seq_num 3520836880) dirty dne 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:862: done (2 left) 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:865: copy_from oid 25 from oid 27 current snap is 102 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:863: finishing write tid 1 to trial14245205-45 2026-02-17T11:51:21.147 INFO:tasks.rados.rados.0.trial142.stdout:863: finishing write tid 2 to trial14245205-45 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:866: rollback oid 15 current snap is 102 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 101 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:867: read oid 17 snap 101 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:867: expect (ObjNum 305 snap 99 seq_num 305) 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:868: rollback oid 4 current snap is 102 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 94 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:869: write (excl) oid 26 current snap is 102 2026-02-17T11:51:21.148 INFO:tasks.rados.rados.0.trial142.stdout:869: seq_num 316 ranges {511012=549157,1775251=550760,3095195=215817} 2026-02-17T11:51:21.151 INFO:tasks.rados.rados.0.trial142.stdout:869: writing trial14245205-26 from 511012 to 1060169 tid 1 2026-02-17T11:51:21.156 INFO:tasks.rados.rados.0.trial142.stdout:869: writing trial14245205-26 from 1775251 to 2326011 tid 2 2026-02-17T11:51:21.161 INFO:tasks.rados.rados.0.trial142.stdout:869: writing trial14245205-26 from 3095195 to 3311012 tid 3 2026-02-17T11:51:21.161 INFO:tasks.rados.rados.0.trial142.stdout:870: read oid 29 snap 82 2026-02-17T11:51:21.161 INFO:tasks.rados.rados.0.trial142.stdout:870: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:51:21.161 INFO:tasks.rados.rados.0.trial142.stdout:871: snap_remove snap 84 2026-02-17T11:51:21.397 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:51:21.397 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:51:21.397 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:51:21.397 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:51:21.399 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:51:21.399 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:51:21.399 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.465+0000 7ff8523f7640 10 monclient: get_monmap_and_config 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.465+0000 7ff8523f7640 10 monclient: build_initial_monmap 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.465+0000 7ff8523f7640 10 monclient: monmap: 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:21.466770+0000 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:21.466770+0000 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:21.468 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:21.468 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:21.468 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 Processor -- start 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 -- start start 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient: init 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff84c135f10 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff84c0744e0 0x7ff84c13ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-c con 0x7ff84c0744e0 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff84c13b280 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c070560 con 0x7ff84c135f10 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c06fd00 con 0x7ff84c13b280 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff84c073520 con 0x7ff84c0744e0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff84bfff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff84c135f10 0x7ff84c1362f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39640/0 (socket says 10.20.193.51:39640) 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff84bfff640 1 -- 10.20.193.51:0/513214903 learned_addr learned my addr 10.20.193.51:0/513214903 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff8523f7640 10 monclient(hunting): authenticate will time out at 969.085880s 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.466+0000 7ff84b7fe640 1 --2- 10.20.193.51:0/513214903 >> v2:10.20.193.142:3300/0 conn(0x7ff84c0744e0 0x7ff84c13ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): get_auth_request con 0x7ff84c0744e0 auth_method 0 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:21.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient(hunting): handle_auth_done global_id 64270 payload 274 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 1 -- 10.20.193.51:0/513214903 >> v1:10.20.193.142:6789/0 conn(0x7ff84c13b280 legacy=0x7ff84c13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 1 -- 10.20.193.51:0/513214903 >> v1:10.20.193.51:6789/0 conn(0x7ff84c135f10 legacy=0x7ff84c1362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 1 monclient: found mon.noname-c 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:51:21.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.467+0000 7ff84b7fe640 1 -- 10.20.193.51:0/513214903 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c073240 con 0x7ff84c0744e0 2026-02-17T11:51:21.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84b7fe640 1 -- 10.20.193.51:0/513214903 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 msgr2=0x7ff84c13ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:21.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84b7fe640 1 --2- 10.20.193.51:0/513214903 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c13ad40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0098a0 tx=0x7ff83c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34a813623a81bb49 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 1 -- 10.20.193.51:0/513214903 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c03c070 con 0x7ff84c0744e0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: dump: 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: _finish_auth 0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: _check_auth_tickets 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 1 -- 10.20.193.51:0/513214903 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c02fce0 con 0x7ff84c0744e0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff8523f7640 5 monclient: authenticate success, global_id 64270 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff8523f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 1 -- 10.20.193.51:0/513214903 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037660 con 0x7ff84c0744e0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:21.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff84affd640 10 monclient: dump: 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff8523f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.471+0000 7ff8523f7640 4 set_mon_vals no callback set 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 10 monclient: shutdown 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- 10.20.193.51:0/513214903 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 msgr2=0x7ff84c13ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 --2- 10.20.193.51:0/513214903 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c13ad40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0098a0 tx=0x7ff83c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- 10.20.193.51:0/513214903 shutdown_connections 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 --2- 10.20.193.51:0/513214903 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c13ad40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- 10.20.193.51:0/513214903 >> 10.20.193.51:0/513214903 conn(0x7ff84c0a3940 msgr2=0x7ff84c0a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- 10.20.193.51:0/513214903 shutdown_connections 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- 10.20.193.51:0/513214903 wait complete. 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 10 monclient: build_initial_monmap 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 10 monclient: monmap: 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:21.475 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:21.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 Processor -- start 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 1 -- start start 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.472+0000 7ff8523f7640 10 monclient: init 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c0a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-b con 0x7ff84c0744e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-c con 0x7ff84c135f10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 0x7ff84c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): picked mon.noname-a con 0x7ff84c13b280 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0a4730 con 0x7ff84c13b280 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c06ff80 con 0x7ff84c0744e0 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c13ed90 con 0x7ff84c135f10 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:21.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff8523f7640 10 monclient(hunting): authenticate will time out at 969.092061s 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59084/0 (socket says 10.20.193.51:59084) 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 -- 10.20.193.51:0/1294880662 learned_addr learned my addr 10.20.193.51:0/1294880662 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 0x7ff84c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 10 monclient(hunting): get_auth_request con 0x7ff84c135f10 auth_method 0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): get_auth_request con 0x7ff84c13b280 auth_method 0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 msgr2=0x7ff84c071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 msgr2=0x7ff84c071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84b7fe640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c0a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): get_auth_request con 0x7ff84c0744e0 auth_method 0 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:21.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff84bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient(hunting): handle_auth_done global_id 74280 payload 824 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 msgr2=0x7ff84c071400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 msgr2=0x7ff84c0a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c0a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient: _finish_hunting 0 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 monclient: found mon.noname-a 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.473+0000 7ff85096d640 1 -- 10.20.193.51:0/1294880662 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c13af80 con 0x7ff84c13b280 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff85096d640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 msgr2=0x7ff84c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff85096d640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 0x7ff84c071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff84000cb10 tx=0x7ff84000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840016020 con 0x7ff84c13b280 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: dump: 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:21.480 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: _finish_auth 0 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840012420 con 0x7ff84c13b280 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84000ae60 con 0x7ff84c13b280 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff848ff9640 10 monclient: dump: 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff84a7fc640 4 set_mon_vals no callback set 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 5 monclient: authenticate success, global_id 74280 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 10 monclient: _renew_subs 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c13ab50 con 0x7ff84c13b280 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 10 monclient: _renew_subs 2026-02-17T11:51:21.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.475+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c138c00 con 0x7ff84c13b280 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff8523f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff8523f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff8523f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c1362f0 con 0x7ff84c13b280 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff8400128d0 con 0x7ff84c13b280 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff848ff9640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 0x7ff81c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(220..220 src has 47..220) ==== 4799+0+0 (secure 0 0 0) 0x7ff840053020 con 0x7ff84c13b280 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff84bfff640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 0x7ff81c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.476+0000 7ff84bfff640 10 monclient: get_auth_request con 0x7ff81c03dd10 auth_method 0 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.478+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff840020020 con 0x7ff84c13b280 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.478+0000 7ff848ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.478+0000 7ff848ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:21.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.479+0000 7ff84bfff640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 0x7ff81c0401d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff838007d90 tx=0x7ff838007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff8523f7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff8523f7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff8523f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff84c071e80 con 0x7ff84c13b280 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff848ff9640 1 -- 10.20.193.51:0/1294880662 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7ff84c13af80 con 0x7ff84c13b280 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff848ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.596+0000 7ff848ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:21.598 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 msgr2=0x7ff81c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 0x7ff81c0401d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff838007d90 tx=0x7ff838007ce0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 10 monclient: shutdown 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 msgr2=0x7ff84c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 0x7ff84c071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff84000cb10 tx=0x7ff84000a060 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 shutdown_connections 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff81c03dd10 0x7ff81c0401d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff84c13b280 0x7ff84c071940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff84c135f10 0x7ff84c071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 --2- 10.20.193.51:0/1294880662 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff84c0744e0 0x7ff84c0a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 >> 10.20.193.51:0/1294880662 conn(0x7ff84c0a3940 msgr2=0x7ff84c0a4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 shutdown_connections 2026-02-17T11:51:21.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:21.597+0000 7ff8523f7640 1 -- 10.20.193.51:0/1294880662 wait complete. 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:871: done (8 left) 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:872: copy_from oid 35 from oid 21 current snap is 102 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:866: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 445 (ObjNum 209 snap 0 seq_num 1213736640) dirty dne 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:868: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:868: finishing rollback tid 2 to trial14245205-4 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 681 (ObjNum 240 snap 75 seq_num 240) dirty exists 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:863: finishing write tid 3 to trial14245205-45 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:863: finishing write tid 4 to trial14245205-45 2026-02-17T11:51:22.085 INFO:tasks.rados.rados.0.trial142.stdout:863: finishing write tid 5 to trial14245205-45 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: oid 45 updating version 0 to 438 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: oid 45 updating version 438 to 439 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: oid 45 version 439 is already newer than 436 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: oid 45 version 439 is already newer than 437 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 439 (ObjNum 315 snap 102 seq_num 315) dirty exists 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: left oid 45 (ObjNum 315 snap 102 seq_num 315) 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:865: finishing copy_from racing read to trial14245205-25 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:863: done (8 left) 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:866: done (7 left) 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:868: done (6 left) 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:873: copy_from oid 38 from oid 49 current snap is 102 2026-02-17T11:51:22.086 INFO:tasks.rados.rados.0.trial142.stdout:867: expect (ObjNum 305 snap 99 seq_num 305) 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:865: finishing copy_from to trial14245205-25 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 436 (ObjNum 216 snap 69 seq_num 216) dirty exists 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:869: finishing write tid 1 to trial14245205-26 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:864: finishing copy_from racing read to trial14245205-34 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:865: done (6 left) 2026-02-17T11:51:22.186 INFO:tasks.rados.rados.0.trial142.stdout:867: done (5 left) 2026-02-17T11:51:22.187 INFO:tasks.rados.rados.0.trial142.stdout:874: write oid 7 current snap is 102 2026-02-17T11:51:22.187 INFO:tasks.rados.rados.0.trial142.stdout:874: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2026-02-17T11:51:22.191 INFO:tasks.rados.rados.0.trial142.stdout:874: writing trial14245205-7 from 527819 to 1152225 tid 1 2026-02-17T11:51:22.195 INFO:tasks.rados.rados.0.trial142.stdout:874: writing trial14245205-7 from 1833733 to 2244504 tid 2 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:874: writing trial14245205-7 from 2722618 to 3324199 tid 3 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:875: copy_from oid 33 from oid 22 current snap is 102 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:864: finishing copy_from to trial14245205-34 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: finishing write tid 2 to trial14245205-26 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: finishing write tid 3 to trial14245205-26 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: finishing write tid 4 to trial14245205-26 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: finishing write tid 5 to trial14245205-26 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: oid 26 updating version 0 to 440 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: oid 26 version 440 is already newer than 437 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: oid 26 version 440 is already newer than 439 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: oid 26 version 440 is already newer than 438 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 440 (ObjNum 316 snap 102 seq_num 316) dirty exists 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:869: left oid 26 (ObjNum 316 snap 102 seq_num 316) 2026-02-17T11:51:22.200 INFO:tasks.rados.rados.0.trial142.stdout:870: expect (ObjNum 261 snap 81 seq_num 261) 2026-02-17T11:51:22.262 INFO:tasks.rados.rados.0.trial142.stdout:872: finishing copy_from to trial14245205-35 2026-02-17T11:51:22.262 INFO:tasks.rados.rados.0.trial142.stdout:872: got expected ENOENT (src dne) 2026-02-17T11:51:22.262 INFO:tasks.rados.rados.0.trial142.stdout:872: finishing copy_from racing read to trial14245205-35 2026-02-17T11:51:22.262 INFO:tasks.rados.rados.0.trial142.stdout:873: finishing copy_from to trial14245205-38 2026-02-17T11:51:22.262 INFO:tasks.rados.rados.0.trial142.stdout:873: got expected ENOENT (src dne) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:873: finishing copy_from racing read to trial14245205-38 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:874: finishing write tid 1 to trial14245205-7 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:874: finishing write tid 2 to trial14245205-7 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:875: finishing copy_from to trial14245205-33 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:875: got expected ENOENT (src dne) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:875: finishing copy_from racing read to trial14245205-33 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:864: done (6 left) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:869: done (5 left) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:870: done (4 left) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:872: done (3 left) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:873: done (2 left) 2026-02-17T11:51:22.263 INFO:tasks.rados.rados.0.trial142.stdout:875: done (1 left) 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:876: snap_create 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: finishing write tid 3 to trial14245205-7 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: finishing write tid 4 to trial14245205-7 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: finishing write tid 5 to trial14245205-7 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: oid 7 updating version 0 to 691 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: oid 7 version 691 is already newer than 690 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: oid 7 updating version 691 to 692 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: oid 7 version 692 is already newer than 689 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 692 (ObjNum 317 snap 102 seq_num 317) dirty exists 2026-02-17T11:51:22.264 INFO:tasks.rados.rados.0.trial142.stdout:874: left oid 7 (ObjNum 317 snap 102 seq_num 317) 2026-02-17T11:51:23.147 INFO:tasks.rados.rados.0.trial142.stdout:874: done (1 left) 2026-02-17T11:51:23.147 INFO:tasks.rados.rados.0.trial142.stdout:876: done (0 left) 2026-02-17T11:51:23.147 INFO:tasks.rados.rados.0.trial142.stdout:877: copy_from oid 29 from oid 36 current snap is 103 2026-02-17T11:51:23.147 INFO:tasks.rados.rados.0.trial142.stdout:878: snap_remove snap 74 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:878: done (1 left) 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:879: read oid 14 snap 71 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:879: expect deleted 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:880: snap_create 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:877: finishing copy_from racing read to trial14245205-29 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:877: finishing copy_from to trial14245205-29 2026-02-17T11:51:24.148 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 262 (ObjNum 197 snap 58 seq_num 197) dirty exists 2026-02-17T11:51:24.607 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:51:24.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.674+0000 7f54ea3e6640 10 monclient: get_monmap_and_config 2026-02-17T11:51:24.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.674+0000 7f54ea3e6640 10 monclient: build_initial_monmap 2026-02-17T11:51:24.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.674+0000 7f54ea3e6640 10 monclient: monmap: 2026-02-17T11:51:24.679 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:24.675779+0000 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:24.675779+0000 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:24.680 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 Processor -- start 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 -- start start 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient: init 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T11:51:24.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54e40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-b con 0x7f54e40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f54e413b760 0x7f54e413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-a con 0x7f54e413b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e406e140 con 0x7f54e40a3bb0 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f54e409f910 con 0x7f54e413b760 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f54e409ccd0 con 0x7f54e40a0750 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54ea3e6640 10 monclient(hunting): authenticate will time out at 972.294503s 2026-02-17T11:51:24.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f54e413b760 0x7f54e413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f54e413b760 0x7f54e413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50352/0 (socket says 10.20.193.51:50352) 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 -- 10.20.193.51:0/1921124792 learned_addr learned my addr 10.20.193.51:0/1921124792 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): get_auth_request con 0x7f54e413b760 auth_method 0 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 10 monclient(hunting): get_auth_request con 0x7f54e40a0750 auth_method 0 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:24.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 1 -- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 msgr2=0x7f54e409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 1 -- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 msgr2=0x7f54e409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e37fe640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient(hunting): handle_auth_done global_id 74283 payload 274 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 -- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 msgr2=0x7f54e409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 -- 10.20.193.51:0/1921124792 >> v1:10.20.193.51:6789/0 conn(0x7f54e40a3bb0 legacy=0x7f54e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient: _finish_hunting 0 2026-02-17T11:51:24.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 monclient: found mon.noname-a 2026-02-17T11:51:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:24.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.675+0000 7f54e895c640 1 -- 10.20.193.51:0/1921124792 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e409eec0 con 0x7f54e413b760 2026-02-17T11:51:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e895c640 1 -- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e413b760 msgr2=0x7f54e413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e895c640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e413b760 0x7f54e413db50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f54e409f230 tx=0x7f54d802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5777db439e0cd12 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 1 -- 10.20.193.51:0/1921124792 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d802fe60 con 0x7f54e413b760 2026-02-17T11:51:24.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: dump: 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 5 monclient: authenticate success, global_id 74283 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 1 -- 10.20.193.51:0/1921124792 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d80373f0 con 0x7f54e413b760 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 1 -- 10.20.193.51:0/1921124792 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d80377c0 con 0x7f54e413b760 2026-02-17T11:51:24.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 4 set_mon_vals no callback set 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54e2ffd640 10 monclient: dump: 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:24.693 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 10 monclient: shutdown 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 -- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e413b760 msgr2=0x7f54e413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e413b760 0x7f54e413db50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f54e409f230 tx=0x7f54d802f230 comp rx=0 tx=0).stop 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 -- 10.20.193.51:0/1921124792 shutdown_connections 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e413b760 0x7f54e413db50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/1921124792 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a0750 0x7f54e409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 -- 10.20.193.51:0/1921124792 >> 10.20.193.51:0/1921124792 conn(0x7f54e40a30c0 msgr2=0x7f54e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 -- 10.20.193.51:0/1921124792 shutdown_connections 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.678+0000 7f54ea3e6640 1 -- 10.20.193.51:0/1921124792 wait complete. 2026-02-17T11:51:24.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient: build_initial_monmap 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient: monmap: 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 Processor -- start 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 -- start start 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient: init 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-a con 0x7f54e40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54e409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-c con 0x7f54e40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 0x7f54e4131170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): picked mon.noname-b con 0x7f54e413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f54e40a04b0 con 0x7f54e40a0750 2026-02-17T11:51:24.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f54e409c850 con 0x7f54e413b760 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f54e409e710 con 0x7f54e40a3bb0 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54ea3e6640 10 monclient(hunting): authenticate will time out at 972.298658s 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54e409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50358/0 (socket says 10.20.193.51:50358) 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 learned_addr learned my addr 10.20.193.51:0/2064300427 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): get_auth_request con 0x7f54e40a0750 auth_method 0 2026-02-17T11:51:24.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 10 monclient(hunting): get_auth_request con 0x7f54e40a3bb0 auth_method 0 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 msgr2=0x7f54e409bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 msgr2=0x7f54e409bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54e409bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:24.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54e409bb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient(hunting): handle_auth_done global_id 74286 payload 824 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 msgr2=0x7f54e409bb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54e409bb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 msgr2=0x7f54e4131170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 0x7f54e4131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 monclient: found mon.noname-a 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e4134b00 con 0x7f54e40a0750 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 msgr2=0x7f54e409b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:51:24.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 msgr2=0x7f54e409b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:24.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f54d000c5d0 tx=0x7f54d000caa0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:24.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.679+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient: get_auth_request con 0x7f54e40a0750 auth_method 0 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 0 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 msgr2=0x7f54e409b5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54e40a0750 0x7f54e409b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54b40055d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f54e40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 0x7f54b40084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f54b4006030 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 0x7f54b400b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f54e413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f54b400ba90 con 0x7f54b4006030 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f54b400bc10 con 0x7f54e413b760 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f54b400be10 con 0x7f54e40a3bb0 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e0ff9640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54b40055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 0x7f54b40084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): get_auth_request con 0x7f54e40a3bb0 auth_method 0 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): get_auth_request con 0x7f54b4006030 auth_method 0 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient(hunting): handle_auth_done global_id 74286 payload 293 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 msgr2=0x7f54b400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 0x7f54b400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 msgr2=0x7f54b40084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 0x7f54b40084c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 monclient: found mon.noname-c 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b400c0d0 con 0x7f54e40a3bb0 2026-02-17T11:51:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.881+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 0x7f54b40084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e3fff640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 msgr2=0x7f54b40055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e3fff640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54b40055d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54d000cae0 tx=0x7f54d0003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0012750 con 0x7f54e40a3bb0 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: dump: 2026-02-17T11:51:24.888 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 5 monclient: authenticate success, global_id 74286 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 10 monclient: _renew_subs 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e4134580 con 0x7f54e40a3bb0 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d0012a80 con 0x7f54e40a3bb0 2026-02-17T11:51:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0012c30 con 0x7f54e40a3bb0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e0ff9640 10 monclient: dump: 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54e27fc640 4 set_mon_vals no callback set 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 10 monclient: _renew_subs 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.883+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e4134820 con 0x7f54e40a3bb0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54ea3e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54ea3e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54ea3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e409dac0 con 0x7f54e40a3bb0 2026-02-17T11:51:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f54d0005020 con 0x7f54e40a3bb0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54e0ff9640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 0x7f54b40482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.884+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(199..199 src has 47..199) ==== 4811+0+0 (secure 0 0 0) 0x7f54d0053160 con 0x7f54e40a3bb0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.885+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 0x7f54b40482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.885+0000 7f54e37fe640 10 monclient: get_auth_request con 0x7f54e40a0750 auth_method 0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.887+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f54d001bdb0 con 0x7f54e40a3bb0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.887+0000 7f54e0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.887+0000 7f54e0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:24.887+0000 7f54e37fe640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 0x7f54b40482e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54e4132ac0 tx=0x7f54d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:25.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:25.001+0000 7f54ea3e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:51:25.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:25.001+0000 7f54ea3e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:25.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:25.001+0000 7f54ea3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:25.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:25.001+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f54e4135020 con 0x7f54e40a3bb0 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:877: done (2 left) 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:879: done (1 left) 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:880: done (0 left) 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:881: read oid 30 snap -1 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:881: expect (ObjNum 302 snap 99 seq_num 302) 2026-02-17T11:51:25.153 INFO:tasks.rados.rados.0.trial142.stdout:882: snap_create 2026-02-17T11:51:25.158 INFO:tasks.rados.rados.0.trial142.stdout:881: expect (ObjNum 302 snap 99 seq_num 302) 2026-02-17T11:51:26.164 INFO:tasks.rados.rados.0.trial142.stdout:881: done (1 left) 2026-02-17T11:51:26.164 INFO:tasks.rados.rados.0.trial142.stdout:882: done (0 left) 2026-02-17T11:51:26.164 INFO:tasks.rados.rados.0.trial142.stdout:883: write (excl) oid 49 current snap is 105 2026-02-17T11:51:26.164 INFO:tasks.rados.rados.0.trial142.stdout:883: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2026-02-17T11:51:26.168 INFO:tasks.rados.rados.0.trial142.stdout:883: writing trial14245205-49 from 544626 to 1244281 tid 1 2026-02-17T11:51:26.173 INFO:tasks.rados.rados.0.trial142.stdout:883: writing trial14245205-49 from 1892215 to 2446644 tid 2 2026-02-17T11:51:26.176 INFO:tasks.rados.rados.0.trial142.stdout:883: writing trial14245205-49 from 3150041 to 3344626 tid 3 2026-02-17T11:51:26.176 INFO:tasks.rados.rados.0.trial142.stdout:884: delete oid 27 current snap is 105 2026-02-17T11:51:26.176 INFO:tasks.rados.rados.0.trial142.stdout:883: finishing write tid 1 to trial14245205-49 2026-02-17T11:51:26.176 INFO:tasks.rados.rados.0.trial142.stdout:883: finishing write tid 2 to trial14245205-49 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: finishing write tid 3 to trial14245205-49 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: finishing write tid 4 to trial14245205-49 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: finishing write tid 5 to trial14245205-49 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: oid 49 updating version 0 to 706 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: oid 49 version 706 is already newer than 703 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: oid 49 version 706 is already newer than 704 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: oid 49 version 706 is already newer than 705 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 706 (ObjNum 318 snap 105 seq_num 318) dirty exists 2026-02-17T11:51:26.178 INFO:tasks.rados.rados.0.trial142.stdout:883: left oid 49 (ObjNum 318 snap 105 seq_num 318) 2026-02-17T11:51:26.183 INFO:tasks.rados.rados.0.trial142.stdout:883: done (1 left) 2026-02-17T11:51:26.183 INFO:tasks.rados.rados.0.trial142.stdout:884: done (0 left) 2026-02-17T11:51:26.183 INFO:tasks.rados.rados.0.trial142.stdout:885: write (excl) oid 50 current snap is 105 2026-02-17T11:51:26.183 INFO:tasks.rados.rados.0.trial142.stdout:885: seq_num 320 ranges {578240=566506,1609179=558098,2804887=551750} 2026-02-17T11:51:26.187 INFO:tasks.rados.rados.0.trial142.stdout:885: writing trial14245205-50 from 578240 to 1144746 tid 1 2026-02-17T11:51:26.190 INFO:tasks.rados.rados.0.trial142.stdout:885: writing trial14245205-50 from 1609179 to 2167277 tid 2 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:885: writing trial14245205-50 from 2804887 to 3356637 tid 3 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:886: read oid 5 snap -1 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:886: expect (ObjNum 308 snap 99 seq_num 308) 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:887: write oid 27 current snap is 105 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:885: finishing write tid 1 to trial14245205-50 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:885: finishing write tid 2 to trial14245205-50 2026-02-17T11:51:26.195 INFO:tasks.rados.rados.0.trial142.stdout:887: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-17T11:51:26.199 INFO:tasks.rados.rados.0.trial142.stdout:887: writing trial14245205-27 from 595047 to 1236802 tid 1 2026-02-17T11:51:26.203 INFO:tasks.rados.rados.0.trial142.stdout:887: writing trial14245205-27 from 1667661 to 2085770 tid 2 2026-02-17T11:51:26.207 INFO:tasks.rados.rados.0.trial142.stdout:887: writing trial14245205-27 from 2548663 to 3311685 tid 3 2026-02-17T11:51:26.207 INFO:tasks.rados.rados.0.trial142.stdout:888: copy_from oid 6 from oid 2 current snap is 105 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: finishing write tid 3 to trial14245205-50 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: finishing write tid 4 to trial14245205-50 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: finishing write tid 5 to trial14245205-50 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: oid 50 updating version 0 to 444 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: oid 50 version 444 is already newer than 441 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: oid 50 version 444 is already newer than 443 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: oid 50 version 444 is already newer than 442 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 444 (ObjNum 320 snap 105 seq_num 320) dirty exists 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:885: left oid 50 (ObjNum 320 snap 105 seq_num 320) 2026-02-17T11:51:26.208 INFO:tasks.rados.rados.0.trial142.stdout:886: expect (ObjNum 308 snap 99 seq_num 308) 2026-02-17T11:51:26.341 INFO:tasks.rados.rados.0.trial142.stdout:887: finishing write tid 1 to trial14245205-27 2026-02-17T11:51:26.341 INFO:tasks.rados.rados.0.trial142.stdout:887: finishing write tid 2 to trial14245205-27 2026-02-17T11:51:26.341 INFO:tasks.rados.rados.0.trial142.stdout:887: finishing write tid 3 to trial14245205-27 2026-02-17T11:51:26.341 INFO:tasks.rados.rados.0.trial142.stdout:887: finishing write tid 4 to trial14245205-27 2026-02-17T11:51:26.341 INFO:tasks.rados.rados.0.trial142.stdout:887: finishing write tid 5 to trial14245205-27 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: oid 27 updating version 0 to 578 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: oid 27 updating version 578 to 579 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: oid 27 version 579 is already newer than 576 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: oid 27 version 579 is already newer than 577 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 579 (ObjNum 321 snap 105 seq_num 321) dirty exists 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: left oid 27 (ObjNum 321 snap 105 seq_num 321) 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:888: finishing copy_from racing read to trial14245205-6 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:888: finishing copy_from to trial14245205-6 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 610 (ObjNum 314 snap 100 seq_num 314) dirty exists 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:885: done (3 left) 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:886: done (2 left) 2026-02-17T11:51:26.342 INFO:tasks.rados.rados.0.trial142.stdout:887: done (1 left) 2026-02-17T11:51:26.343 INFO:tasks.rados.rados.0.trial142.stdout:888: done (0 left) 2026-02-17T11:51:26.343 INFO:tasks.rados.rados.0.trial142.stdout:889: copy_from oid 41 from oid 39 current snap is 105 2026-02-17T11:51:26.343 INFO:tasks.rados.rados.0.trial142.stdout:890: write oid 38 current snap is 105 2026-02-17T11:51:26.343 INFO:tasks.rados.rados.0.trial142.stdout:890: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2026-02-17T11:51:26.345 INFO:tasks.rados.rados.0.trial142.stdout:890: writing trial14245205-38 from 611854 to 1328858 tid 1 2026-02-17T11:51:26.350 INFO:tasks.rados.rados.0.trial142.stdout:890: writing trial14245205-38 from 2126143 to 2687910 tid 2 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:890: writing trial14245205-38 from 3259733 to 3411854 tid 3 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:891: delete oid 15 current snap is 105 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:889: finishing copy_from racing read to trial14245205-41 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:889: finishing copy_from to trial14245205-41 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 337 (ObjNum 266 snap 83 seq_num 266) dirty exists 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:890: finishing write tid 1 to trial14245205-38 2026-02-17T11:51:26.353 INFO:tasks.rados.rados.0.trial142.stdout:890: finishing write tid 2 to trial14245205-38 2026-02-17T11:51:26.354 INFO:tasks.rados.rados.0.trial142.stdout:889: done (2 left) 2026-02-17T11:51:26.354 INFO:tasks.rados.rados.0.trial142.stdout:891: done (1 left) 2026-02-17T11:51:26.354 INFO:tasks.rados.rados.0.trial142.stdout:892: read oid 21 snap -1 2026-02-17T11:51:26.354 INFO:tasks.rados.rados.0.trial142.stdout:892: expect deleted 2026-02-17T11:51:26.354 INFO:tasks.rados.rados.0.trial142.stdout:893: read oid 9 snap -1 2026-02-17T11:51:26.355 INFO:tasks.rados.rados.0.trial142.stdout:893: expect deleted 2026-02-17T11:51:26.355 INFO:tasks.rados.rados.0.trial142.stdout:894: snap_remove snap 71 2026-02-17T11:51:27.085 INFO:tasks.rados.rados.0.trial142.stdout:894: done (3 left) 2026-02-17T11:51:27.085 INFO:tasks.rados.rados.0.trial142.stdout:895: snap_remove snap 104 2026-02-17T11:51:27.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.444+0000 7f54e0ff9640 1 -- 10.20.193.51:0/2064300427 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f54d0012e10 con 0x7f54e40a3bb0 2026-02-17T11:51:27.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.444+0000 7f54e0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:27.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.444+0000 7f54e0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:27.446 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:51:27.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 msgr2=0x7f54b40482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 0x7f54b40482e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54e4132ac0 tx=0x7f54d4008040 comp rx=0 tx=0).stop 2026-02-17T11:51:27.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 10 monclient: shutdown 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 msgr2=0x7f54b40055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54b40055d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54d000cae0 tx=0x7f54d0003960 comp rx=0 tx=0).stop 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 shutdown_connections 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f54e40a0750 0x7f54b40482e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54e413b760 0x7f54b400b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54b4006030 0x7f54b40084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 --2- 10.20.193.51:0/2064300427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54e40a3bb0 0x7f54b40055d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 >> 10.20.193.51:0/2064300427 conn(0x7f54e40a30c0 msgr2=0x7f54e4139d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 shutdown_connections 2026-02-17T11:51:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.447+0000 7f54ea3e6640 1 -- 10.20.193.51:0/2064300427 wait complete. 2026-02-17T11:51:27.457 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:51:27.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:51:27.457 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:51:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: get_monmap_and_config 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: build_initial_monmap 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: monmap: 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:27.525020+0000 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:27.525020+0000 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 Processor -- start 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 -- start start 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: init 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 0x7f16bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f16bc0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16bc13b760 0x7f16bc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc06e140 con 0x7f16bc0a0750 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc09f910 con 0x7f16bc13b760 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc09ccd0 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c3c0c640 10 monclient(hunting): authenticate will time out at 975.143789s 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16bc13b760 0x7f16bc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16bc13b760 0x7f16bc13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56286/0 (socket says 10.20.193.51:56286) 2026-02-17T11:51:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 1 -- 10.20.193.51:0/1645418279 learned_addr learned my addr 10.20.193.51:0/1645418279 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): get_auth_request con 0x7f16bc13b760 auth_method 0 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c1981640 1 --2- 10.20.193.51:0/1645418279 >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 0x7f16bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c2182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c1981640 10 monclient(hunting): get_auth_request con 0x7f16bc0a3bb0 auth_method 0 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c1981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c1981640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.524+0000 7f16c1981640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 10 monclient(hunting): handle_auth_done global_id 74289 payload 274 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 1 -- 10.20.193.51:0/1645418279 >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 msgr2=0x7f16bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 1 --2- 10.20.193.51:0/1645418279 >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 0x7f16bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 1 -- 10.20.193.51:0/1645418279 >> v1:10.20.193.142:6789/0 conn(0x7f16bc0a0750 legacy=0x7f16bc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 10 monclient: _finish_hunting 0 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 1 monclient: found mon.noname-a 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c2182640 1 -- 10.20.193.51:0/1645418279 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc09eec0 con 0x7f16bc13b760 2026-02-17T11:51:27.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.525+0000 7f16c1981640 1 --2- 10.20.193.51:0/1645418279 >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 0x7f16bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c2182640 1 -- 10.20.193.51:0/1645418279 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc13b760 msgr2=0x7f16bc13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c2182640 1 --2- 10.20.193.51:0/1645418279 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc13b760 0x7f16bc13db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06c1c0 tx=0x7f16b802f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20661d0e1e633494 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 1 -- 10.20.193.51:0/1645418279 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b802fe50 con 0x7f16bc13b760 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: dump: 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.543 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: _finish_auth 0 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: _check_auth_tickets 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 5 monclient: authenticate success, global_id 74289 2026-02-17T11:51:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 1 -- 10.20.193.51:0/1645418279 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80373f0 con 0x7f16bc13b760 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 1 -- 10.20.193.51:0/1645418279 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80377c0 con 0x7f16bc13b760 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 4 set_mon_vals no callback set 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c097f640 10 monclient: dump: 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 10 monclient: shutdown 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 -- 10.20.193.51:0/1645418279 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc13b760 msgr2=0x7f16bc13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/1645418279 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc13b760 0x7f16bc13db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06c1c0 tx=0x7f16b802f1e0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 -- 10.20.193.51:0/1645418279 shutdown_connections 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/1645418279 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc13b760 0x7f16bc13db50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/1645418279 >> v2:10.20.193.142:3300/0 conn(0x7f16bc0a3bb0 0x7f16bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 -- 10.20.193.51:0/1645418279 >> 10.20.193.51:0/1645418279 conn(0x7f16bc0a30c0 msgr2=0x7f16bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 -- 10.20.193.51:0/1645418279 shutdown_connections 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.527+0000 7f16c3c0c640 1 -- 10.20.193.51:0/1645418279 wait complete. 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient: build_initial_monmap 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient: monmap: 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:27.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 Processor -- start 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 -- start start 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient: init 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16bc0a0750 0x7f16bc09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-b con 0x7f16bc0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 0x7f16bc09b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0a04b0 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc09c850 con 0x7f16bc0a0750 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc09e710 con 0x7f16bc13b760 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.528+0000 7f16c3c0c640 10 monclient(hunting): authenticate will time out at 975.147990s 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56300/0 (socket says 10.20.193.51:56300) 2026-02-17T11:51:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 -- 10.20.193.51:0/3398556324 learned_addr learned my addr 10.20.193.51:0/3398556324 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): get_auth_request con 0x7f16bc0a3bb0 auth_method 0 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 0x7f16bc09b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 10 monclient(hunting): get_auth_request con 0x7f16bc13b760 auth_method 0 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 msgr2=0x7f16bc09b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 msgr2=0x7f16bc09b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 0x7f16bc09b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c2182640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 0x7f16bc09b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient(hunting): handle_auth_done global_id 74292 payload 824 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 msgr2=0x7f16bc09b040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16bc13b760 0x7f16bc09b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16bc0a0750 msgr2=0x7f16bc09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16bc0a0750 0x7f16bc09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient: _finish_hunting 0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 monclient: found mon.noname-a 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.529+0000 7f16c1180640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc09d7b0 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c1180640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 msgr2=0x7f16bc09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c1180640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c5d0 tx=0x7f16b000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0016020 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: dump: 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.553 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0012a60 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0012e50 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16abfff640 4 set_mon_vals no callback set 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16aa7fc640 10 monclient: dump: 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.554 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 5 monclient: authenticate success, global_id 74292 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 monclient: _renew_subs 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc137650 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 monclient: _renew_subs 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc132580 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 0x7f16bc12b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.531+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc1332c0 con 0x7f16bc09b580 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 0x7f16bc12b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient: get_auth_request con 0x7f16bc09b580 auth_method 0 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f16b001b400 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 10 monclient(hunting): handle_auth_done global_id 74295 payload 824 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c1981640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16bc09dac0 con 0x7f16bc09b580 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16aa7fc640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f168c03df00 0x7f168c0403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(226..226 src has 47..226) ==== 4855+0+0 (secure 0 0 0) 0x7f16b0052a70 con 0x7f16bc0a3bb0 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c2182640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f168c03df00 0x7f168c0403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.532+0000 7f16c2182640 10 monclient: get_auth_request con 0x7f168c03df00 auth_method 0 2026-02-17T11:51:27.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16c1981640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 msgr2=0x7f16bc12b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16c1981640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 0x7f16bc12b680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac017070 con 0x7f16bc09b580 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 10 monclient: dump: 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.558 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f16ac00cb50 con 0x7f16bc09b580 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 msgr2=0x7f16bc12b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 0x7f16bc12b680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac00ebe0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 msgr2=0x7f16bc12b680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.534+0000 7f16aa7fc640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc09b580 0x7f16bc12b680 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac00ebe0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.535+0000 7f16c2182640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f168c03df00 0x7f168c0403c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06f3c0 tx=0x7f16b8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c3c0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 0x7f16bc12bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c3c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc073f90 con 0x7f16bc12bbc0 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 0x7f16bc12bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient: get_auth_request con 0x7f16bc12bbc0 auth_method 0 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 10 monclient(hunting): handle_auth_done global_id 74298 payload 824 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.537+0000 7f16c1981640 1 -- 10.20.193.51:0/3398556324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16bc131f90 con 0x7f16bc12bbc0 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c1981640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 msgr2=0x7f16bc12bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c1981640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 0x7f16bc12bfd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00f040 con 0x7f16bc12bbc0 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 10 monclient: dump: 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f16ac013610 con 0x7f16bc12bbc0 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 msgr2=0x7f16bc12bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 0x7f16bc12bfd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac011000 comp rx=0 tx=0).stop 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 msgr2=0x7f16bc12bfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16aa7fc640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc12bbc0 0x7f16bc12bfd0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e710 tx=0x7f16ac011000 comp rx=0 tx=0).stop 2026-02-17T11:51:27.562 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 105471, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:27.563 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:27.564 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:27.565 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:27.566 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:27.567 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:27.568 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:27.569 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:27.570 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:27.571 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:27.572 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:27.573 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f168c03df00 msgr2=0x7f168c0403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f168c03df00 0x7f168c0403c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16bc06f3c0 tx=0x7f16b8033000 comp rx=0 tx=0).stop 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 10 monclient: shutdown 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 msgr2=0x7f16bc09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c5d0 tx=0x7f16b000caa0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c2182640 1 -- 10.20.193.51:0/3398556324 reap_dead start 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 shutdown_connections 2026-02-17T11:51:27.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 --2- 10.20.193.51:0/3398556324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16bc0a3bb0 0x7f16bc09ab00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 >> 10.20.193.51:0/3398556324 conn(0x7f16bc0a30c0 msgr2=0x7f16bc138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:27.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 shutdown_connections 2026-02-17T11:51:27.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.540+0000 7f16c3c0c640 1 -- 10.20.193.51:0/3398556324 wait complete. 2026-02-17T11:51:27.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:27.575 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:51:27.575 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.641+0000 7fdfd2da8640 10 monclient: get_monmap_and_config 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.641+0000 7fdfd2da8640 10 monclient: build_initial_monmap 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.641+0000 7fdfd2da8640 10 monclient: monmap: 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.645 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:27.642698+0000 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:27.642698+0000 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 Processor -- start 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 -- start start 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient: init 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T11:51:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdfcc0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdfcc0a0750 0x7fdfcc09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-c con 0x7fdfcc0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdfcc13b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfcc06e140 con 0x7fdfcc0a3bb0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfcc09f910 con 0x7fdfcc13b760 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdfcc09ccd0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd2da8640 10 monclient(hunting): authenticate will time out at 975.261475s 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd0b1d640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fdfcc0a3bb0 0x7fdfcc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39128/0 (socket says 10.20.193.51:39128) 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/2139575435 learned_addr learned my addr 10.20.193.51:0/2139575435 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/2139575435 >> v2:10.20.193.142:3300/0 conn(0x7fdfcc0a0750 0x7fdfcc09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request con 0x7fdfcc0a0750 auth_method 0 2026-02-17T11:51:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_done global_id 64279 payload 274 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 1 -- 10.20.193.51:0/2139575435 >> v1:10.20.193.142:6789/0 conn(0x7fdfcc13b760 legacy=0x7fdfcc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 1 -- 10.20.193.51:0/2139575435 >> v1:10.20.193.51:6789/0 conn(0x7fdfcc0a3bb0 legacy=0x7fdfcc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 1 monclient: found mon.noname-c 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:51:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.642+0000 7fdfc3fff640 1 -- 10.20.193.51:0/2139575435 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc09eec0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc3fff640 1 -- 10.20.193.51:0/2139575435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc0a0750 msgr2=0x7fdfcc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/2139575435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc09e1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098a0 tx=0x7fdfb402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e4a36313b6b1fa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 1 -- 10.20.193.51:0/2139575435 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb403c070 con 0x7fdfcc0a0750 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: dump: 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 1 -- 10.20.193.51:0/2139575435 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb402fce0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 1 -- 10.20.193.51:0/2139575435 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4037660 con 0x7fdfcc0a0750 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfc37fe640 10 monclient: dump: 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 5 monclient: authenticate success, global_id 64279 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 4 set_mon_vals no callback set 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 10 monclient: shutdown 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 -- 10.20.193.51:0/2139575435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc0a0750 msgr2=0x7fdfcc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/2139575435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc09e1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098a0 tx=0x7fdfb402ed80 comp rx=0 tx=0).stop 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 -- 10.20.193.51:0/2139575435 shutdown_connections 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/2139575435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc09e1d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 -- 10.20.193.51:0/2139575435 >> 10.20.193.51:0/2139575435 conn(0x7fdfcc0a30c0 msgr2=0x7fdfcc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 -- 10.20.193.51:0/2139575435 shutdown_connections 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.647+0000 7fdfd2da8640 1 -- 10.20.193.51:0/2139575435 wait complete. 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient: build_initial_monmap 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient: monmap: 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 Processor -- start 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 -- start start 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient: init 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-a con 0x7fdfcc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 0x7fdfcc1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-c con 0x7fdfcc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc13b760 0x7fdfcc130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): picked mon.noname-b con 0x7fdfcc13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc0a04b0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc09c850 con 0x7fdfcc13b760 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc09e710 con 0x7fdfcc0a3bb0 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd2da8640 10 monclient(hunting): authenticate will time out at 975.267596s 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56328/0 (socket says 10.20.193.51:56328) 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/1314463644 learned_addr learned my addr 10.20.193.51:0/1314463644 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): get_auth_request con 0x7fdfcc0a0750 auth_method 0 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 0x7fdfcc1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request con 0x7fdfcc0a3bb0 auth_method 0 2026-02-17T11:51:27.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc13b760 0x7fdfcc130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): get_auth_request con 0x7fdfcc13b760 auth_method 0 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 msgr2=0x7fdfcc1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 msgr2=0x7fdfcc1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 0x7fdfcc1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 0x7fdfcc1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd131e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:27.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient(hunting): handle_auth_done global_id 74301 payload 824 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 msgr2=0x7fdfcc1d0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc0a3bb0 0x7fdfcc1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc13b760 msgr2=0x7fdfcc130e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdfcc13b760 0x7fdfcc130e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient: _finish_hunting 0 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 monclient: found mon.noname-a 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.648+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc1347e0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd0b1d640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 msgr2=0x7fdfcc1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd0b1d640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00c750 tx=0x7fdfbc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc005de0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: dump: 2026-02-17T11:51:27.662 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: _finish_auth 0 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfbc007070 con 0x7fdfcc0a0750 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 5 monclient: authenticate success, global_id 74301 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:27.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc007440 con 0x7fdfcc0a0750 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc2ffd640 4 set_mon_vals no callback set 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 10 monclient: dump: 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:27.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 monclient: _renew_subs 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc0a2510 con 0x7fdfcc0a0750 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 monclient: _renew_subs 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc1331b0 con 0x7fdfcc0a0750 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc09dac0 con 0x7fdfcc131350 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdfbc007660 con 0x7fdfcc0a0750 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131350 auth_method 0 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:27.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.651+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.652+0000 7fdfc17fa640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 0x7fdf9c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.652+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(226..226 src has 47..226) ==== 4855+0+0 (secure 0 0 0) 0x7fdfbc052410 con 0x7fdfcc0a0750 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.652+0000 7fdfd131e640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 0x7fdf9c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.652+0000 7fdfd131e640 10 monclient: get_auth_request con 0x7fdf9c03dd10 auth_method 0 2026-02-17T11:51:27.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.654+0000 7fdfd131e640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 0x7fdf9c0401d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc132af0 tx=0x7fdfc8004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:27.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131350 auth_method 0 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:27.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:27.852+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:51:28.159 INFO:tasks.rados.rados.0.trial142.stdout:895: done (3 left) 2026-02-17T11:51:28.159 INFO:tasks.rados.rados.0.trial142.stdout:896: write oid 29 current snap is 105 2026-02-17T11:51:28.159 INFO:tasks.rados.rados.0.trial142.stdout:896: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2026-02-17T11:51:28.163 INFO:tasks.rados.rados.0.trial142.stdout:896: writing trial14245205-29 from 645468 to 1112970 tid 1 2026-02-17T11:51:28.168 INFO:tasks.rados.rados.0.trial142.stdout:896: writing trial14245205-29 from 1726754 to 2292190 tid 2 2026-02-17T11:51:28.173 INFO:tasks.rados.rados.0.trial142.stdout:896: writing trial14245205-29 from 2798226 to 3395064 tid 3 2026-02-17T11:51:28.173 INFO:tasks.rados.rados.0.trial142.stdout:897: write oid 26 current snap is 105 2026-02-17T11:51:28.173 INFO:tasks.rados.rados.0.trial142.stdout:890: finishing write tid 3 to trial14245205-38 2026-02-17T11:51:28.173 INFO:tasks.rados.rados.0.trial142.stdout:897: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2026-02-17T11:51:28.177 INFO:tasks.rados.rados.0.trial142.stdout:897: writing trial14245205-26 from 662275 to 1205026 tid 1 2026-02-17T11:51:28.181 INFO:tasks.rados.rados.0.trial142.stdout:897: writing trial14245205-26 from 1785236 to 2210683 tid 2 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:897: writing trial14245205-26 from 2942002 to 3462275 tid 3 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:898: rollback oid 16 current snap is 105 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 101 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: finishing write tid 4 to trial14245205-38 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: finishing write tid 5 to trial14245205-38 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: oid 38 updating version 0 to 82 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: oid 38 updating version 82 to 83 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: oid 38 version 83 is already newer than 81 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:890: oid 38 version 83 is already newer than 80 2026-02-17T11:51:28.187 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 83 (ObjNum 322 snap 105 seq_num 322) dirty exists 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:890: left oid 38 (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:896: finishing write tid 1 to trial14245205-29 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:896: finishing write tid 2 to trial14245205-29 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:890: done (5 left) 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:892: done (4 left) 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:893: done (3 left) 2026-02-17T11:51:28.188 INFO:tasks.rados.rados.0.trial142.stdout:899: snap_remove snap 78 2026-02-17T11:51:28.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131350 auth_method 0 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:28.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:28.253+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:51:29.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131350 auth_method 0 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:29.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:29.054+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:51:29.170 INFO:tasks.rados.rados.0.trial142.stdout:899: done (3 left) 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:900: copy_from oid 36 from oid 24 current snap is 105 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: finishing write tid 3 to trial14245205-29 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: finishing write tid 4 to trial14245205-29 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: finishing write tid 5 to trial14245205-29 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: oid 29 updating version 0 to 446 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: oid 29 updating version 446 to 448 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: oid 29 version 448 is already newer than 447 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:896: oid 29 version 448 is already newer than 445 2026-02-17T11:51:29.171 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 448 (ObjNum 324 snap 105 seq_num 324) dirty exists 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:896: left oid 29 (ObjNum 324 snap 105 seq_num 324) 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:897: finishing write tid 1 to trial14245205-26 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:897: finishing write tid 2 to trial14245205-26 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:898: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:898: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:898: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 578 (ObjNum 147 snap 40 seq_num 147) dirty exists 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:897: finishing write tid 3 to trial14245205-26 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:897: finishing write tid 4 to trial14245205-26 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:896: done (3 left) 2026-02-17T11:51:29.172 INFO:tasks.rados.rados.0.trial142.stdout:898: done (2 left) 2026-02-17T11:51:29.173 INFO:tasks.rados.rados.0.trial142.stdout:901: read oid 44 snap -1 2026-02-17T11:51:29.173 INFO:tasks.rados.rados.0.trial142.stdout:901: expect deleted 2026-02-17T11:51:29.173 INFO:tasks.rados.rados.0.trial142.stdout:902: snap_remove snap 103 2026-02-17T11:51:30.172 INFO:tasks.rados.rados.0.trial142.stdout:902: done (3 left) 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:903: write (excl) oid 21 current snap is 105 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: finishing write tid 5 to trial14245205-26 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: oid 26 updating version 0 to 446 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: oid 26 version 446 is already newer than 445 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: oid 26 updating version 446 to 447 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: oid 26 updating version 447 to 448 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 448 (ObjNum 325 snap 105 seq_num 325) dirty exists 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:897: left oid 26 (ObjNum 325 snap 105 seq_num 325) 2026-02-17T11:51:30.173 INFO:tasks.rados.rados.0.trial142.stdout:903: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2026-02-17T11:51:30.177 INFO:tasks.rados.rados.0.trial142.stdout:903: writing trial14245205-21 from 679082 to 1297082 tid 1 2026-02-17T11:51:30.182 INFO:tasks.rados.rados.0.trial142.stdout:903: writing trial14245205-21 from 1843718 to 2412823 tid 2 2026-02-17T11:51:30.187 INFO:tasks.rados.rados.0.trial142.stdout:903: writing trial14245205-21 from 2853072 to 3479082 tid 3 2026-02-17T11:51:30.187 INFO:tasks.rados.rados.0.trial142.stdout:897: done (3 left) 2026-02-17T11:51:30.187 INFO:tasks.rados.rados.0.trial142.stdout:904: copy_from oid 3 from oid 15 current snap is 105 2026-02-17T11:51:30.187 INFO:tasks.rados.rados.0.trial142.stdout:900: finishing copy_from racing read to trial14245205-36 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:900: finishing copy_from to trial14245205-36 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 340 (ObjNum 286 snap 93 seq_num 286) dirty exists 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:903: finishing write tid 1 to trial14245205-21 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:903: finishing write tid 2 to trial14245205-21 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:900: done (3 left) 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:901: done (2 left) 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:905: write (excl) oid 49 current snap is 105 2026-02-17T11:51:30.188 INFO:tasks.rados.rados.0.trial142.stdout:905: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2026-02-17T11:51:30.190 INFO:tasks.rados.rados.0.trial142.stdout:905: writing trial14245205-49 from 695889 to 1105491 tid 1 2026-02-17T11:51:30.195 INFO:tasks.rados.rados.0.trial142.stdout:905: writing trial14245205-49 from 1618553 to 2331316 tid 2 2026-02-17T11:51:30.200 INFO:tasks.rados.rados.0.trial142.stdout:905: writing trial14245205-49 from 2996848 to 3495889 tid 3 2026-02-17T11:51:30.200 INFO:tasks.rados.rados.0.trial142.stdout:906: snap_remove snap 82 2026-02-17T11:51:30.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.649+0000 7fdf9bfff640 10 monclient: tick 2026-02-17T11:51:30.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.649+0000 7fdf9bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:51:30.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.649+0000 7fdf9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:30.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.649+0000 7fdf9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:30.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131350 auth_method 0 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:30.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:30.656+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:906: done (3 left) 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:907: delete oid 14 current snap is 105 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:904: finishing copy_from to trial14245205-3 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:904: got expected ENOENT (src dne) 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:904: finishing copy_from racing read to trial14245205-3 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:903: finishing write tid 3 to trial14245205-21 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:903: finishing write tid 4 to trial14245205-21 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:903: finishing write tid 5 to trial14245205-21 2026-02-17T11:51:31.174 INFO:tasks.rados.rados.0.trial142.stdout:903: oid 21 updating version 0 to 440 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:903: oid 21 updating version 440 to 441 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:903: oid 21 updating version 441 to 442 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:903: oid 21 updating version 442 to 443 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 443 (ObjNum 326 snap 105 seq_num 326) dirty exists 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:903: left oid 21 (ObjNum 326 snap 105 seq_num 326) 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: finishing write tid 1 to trial14245205-49 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: finishing write tid 2 to trial14245205-49 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: finishing write tid 3 to trial14245205-49 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: finishing write tid 4 to trial14245205-49 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: finishing write tid 5 to trial14245205-49 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: oid 49 updating version 0 to 723 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: oid 49 updating version 723 to 726 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: oid 49 version 726 is already newer than 725 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: oid 49 version 726 is already newer than 724 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 726 (ObjNum 327 snap 105 seq_num 327) dirty exists 2026-02-17T11:51:31.175 INFO:tasks.rados.rados.0.trial142.stdout:905: left oid 49 (ObjNum 327 snap 105 seq_num 327) 2026-02-17T11:51:31.177 INFO:tasks.rados.rados.0.trial142.stdout:903: done (3 left) 2026-02-17T11:51:31.177 INFO:tasks.rados.rados.0.trial142.stdout:904: done (2 left) 2026-02-17T11:51:31.177 INFO:tasks.rados.rados.0.trial142.stdout:905: done (1 left) 2026-02-17T11:51:31.177 INFO:tasks.rados.rados.0.trial142.stdout:907: done (0 left) 2026-02-17T11:51:31.177 INFO:tasks.rados.rados.0.trial142.stdout:908: snap_remove snap 98 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 10 monclient: tick 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 0x7fdf94005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 msgr2=0x7fdfcc131730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131350 0x7fdfcc131730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdf9bfff640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc09dac0 con 0x7fdf94003640 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 0x7fdf94005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdf94003640 auth_method 0 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_done global_id 94100 payload 824 2026-02-17T11:51:31.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.649+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf940061b0 con 0x7fdf94003640 2026-02-17T11:51:31.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 msgr2=0x7fdf94005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 0x7fdf94005ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4039000 tx=0x7fdfb40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb403c040 con 0x7fdf94003640 2026-02-17T11:51:31.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 10 monclient: dump: 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fdfb4037c70 con 0x7fdf94003640 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 msgr2=0x7fdf94005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 0x7fdf94005ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4039000 tx=0x7fdfb40047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 msgr2=0x7fdf94005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:31.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.651+0000 7fdfc17fa640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf94003640 0x7fdf94005ad0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4039000 tx=0x7fdfb40047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfd2da8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 0x7fdfcc1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfd2da8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc133610 con 0x7fdfcc131c70 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 0x7fdfcc1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient: get_auth_request con 0x7fdfcc131c70 auth_method 0 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_done global_id 94103 payload 824 2026-02-17T11:51:31.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.655+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdfcc134e00 con 0x7fdfcc131c70 2026-02-17T11:51:31.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.657+0000 7fdfc3fff640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 msgr2=0x7fdfcc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.657+0000 7fdfc3fff640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 0x7fdfcc1daad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098a0 tx=0x7fdfb4043040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb403c030 con 0x7fdfcc131c70 2026-02-17T11:51:31.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 10 monclient: dump: 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.663 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fdfb4052890 con 0x7fdfcc131c70 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 msgr2=0x7fdfcc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 0x7fdfcc1daad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098a0 tx=0x7fdfb4043040 comp rx=0 tx=0).stop 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 msgr2=0x7fdfcc1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfc17fa640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdfcc131c70 0x7fdfcc1daad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd131e640 1 -- 10.20.193.51:0/1314463644 reap_dead start 2026-02-17T11:51:31.665 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:31.665 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:31.665 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:31.665 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10201, 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:31.666 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.667 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.668 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:31.669 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.670 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.671 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:31.672 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:31.673 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.674 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:31.675 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.676 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:31.677 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.678 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.679 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.679 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:31.679 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 msgr2=0x7fdf9c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 0x7fdf9c0401d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc132af0 tx=0x7fdfc8004200 comp rx=0 tx=0).stop 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 10 monclient: shutdown 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 msgr2=0x7fdfcc1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00c750 tx=0x7fdfbc00cc20 comp rx=0 tx=0).stop 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 shutdown_connections 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf9c03dd10 0x7fdf9c0401d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 --2- 10.20.193.51:0/1314463644 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdfcc0a0750 0x7fdfcc1cfad0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 >> 10.20.193.51:0/1314463644 conn(0x7fdfcc0a30c0 msgr2=0x7fdfcc139e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:31.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 shutdown_connections 2026-02-17T11:51:31.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.658+0000 7fdfd2da8640 1 -- 10.20.193.51:0/1314463644 wait complete. 2026-02-17T11:51:31.682 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:31.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:51:31.683 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:51:31.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: get_monmap_and_config 2026-02-17T11:51:31.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: build_initial_monmap 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: monmap: 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:31.752111+0000 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:31.752111+0000 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:31.753 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 Processor -- start 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 -- start start 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: init 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 0x7f229809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-b con 0x7f22980a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22980a0750 0x7f229809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-a con 0x7f22980a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f229809e540 0x7f229813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-c con 0x7f229809e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f22980a3f90 con 0x7f22980a0750 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f229806e140 con 0x7f229809e540 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f229809f910 con 0x7f22980a3bb0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f229e3cc640 10 monclient(hunting): authenticate will time out at 979.370891s 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22980a0750 0x7f229809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f2297fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 0x7f229809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22980a0750 0x7f229809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56344/0 (socket says 10.20.193.51:56344) 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 1 -- 10.20.193.51:0/3704332267 learned_addr learned my addr 10.20.193.51:0/3704332267 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 10 monclient(hunting): get_auth_request con 0x7f22980a0750 auth_method 0 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.751+0000 7f22977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x7f22980a3bb0 auth_method 0 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient(hunting): handle_auth_done global_id 74304 payload 274 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 -- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 msgr2=0x7f229809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 0x7f229809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 -- 10.20.193.51:0/3704332267 >> v2:10.20.193.142:3300/0 conn(0x7f229809e540 msgr2=0x7f229813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 --2- 10.20.193.51:0/3704332267 >> v2:10.20.193.142:3300/0 conn(0x7f229809e540 0x7f229813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 monclient: found mon.noname-a 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f22977fe640 1 -- 10.20.193.51:0/3704332267 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229809ccd0 con 0x7f22980a0750 2026-02-17T11:51:31.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.752+0000 7f2297fff640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 0x7f229809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f22977fe640 1 -- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a0750 msgr2=0x7f229809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f22977fe640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a0750 0x7f229809e000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f229809f230 tx=0x7f228802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3da1eafbac4069d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 1 -- 10.20.193.51:0/3704332267 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228803c070 con 0x7f22980a0750 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: dump: 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: _finish_auth 0 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:31.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 1 -- 10.20.193.51:0/3704332267 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228802fca0 con 0x7f22980a0750 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 5 monclient: authenticate success, global_id 74304 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 1 -- 10.20.193.51:0/3704332267 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288037660 con 0x7f22980a0750 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f2296ffd640 10 monclient: dump: 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 4 set_mon_vals no callback set 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 10 monclient: shutdown 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 1 -- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a0750 msgr2=0x7f229809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.754+0000 7f229e3cc640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a0750 0x7f229809e000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f229809f230 tx=0x7f228802ee60 comp rx=0 tx=0).stop 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 -- 10.20.193.51:0/3704332267 shutdown_connections 2026-02-17T11:51:31.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 --2- 10.20.193.51:0/3704332267 >> v2:10.20.193.142:3300/0 conn(0x7f229809e540 0x7f229813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a0750 0x7f229809e000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 --2- 10.20.193.51:0/3704332267 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22980a3bb0 0x7f229809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 -- 10.20.193.51:0/3704332267 >> 10.20.193.51:0/3704332267 conn(0x7f22980a30c0 msgr2=0x7f22980a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 -- 10.20.193.51:0/3704332267 shutdown_connections 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 -- 10.20.193.51:0/3704332267 wait complete. 2026-02-17T11:51:31.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 10 monclient: build_initial_monmap 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 10 monclient: monmap: 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 Processor -- start 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 1 -- start start 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.755+0000 7f229e3cc640 10 monclient: init 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 0x7f229808f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-c con 0x7f229809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a0750 0x7f229808fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-b con 0x7f22980a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 0x7f22980901c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): picked mon.noname-a con 0x7f22980a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f22980a04b0 con 0x7f22980a3bb0 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f229809c850 con 0x7f22980a0750 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f229813cca0 con 0x7f229809e540 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229e3cc640 10 monclient(hunting): authenticate will time out at 979.375144s 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 0x7f229808f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 0x7f22980901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 0x7f229808f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34906/0 (socket says 10.20.193.51:34906) 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 0x7f22980901c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56350/0 (socket says 10.20.193.51:56350) 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 1 -- 10.20.193.51:0/1324948802 learned_addr learned my addr 10.20.193.51:0/1324948802 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x7f229809e540 auth_method 0 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): get_auth_request con 0x7f22980a3bb0 auth_method 0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f22977fe640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a0750 0x7f229808fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f22977fe640 10 monclient(hunting): get_auth_request con 0x7f22980a0750 auth_method 0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f22977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f22977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f22977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient(hunting): handle_auth_done global_id 74307 payload 824 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 msgr2=0x7f229808f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 0x7f229808f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a0750 msgr2=0x7f229808fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22980a0750 0x7f229808fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient: _finish_hunting 0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 monclient: found mon.noname-a 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2298093480 con 0x7f22980a3bb0 2026-02-17T11:51:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.756+0000 7f2297fff640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f229809e540 0x7f229808f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 msgr2=0x7f22980901c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229c942640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 0x7f22980901c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f228c00be50 tx=0x7f228c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c00cc10 con 0x7f22980a3bb0 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: _finish_auth 0 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 5 monclient: authenticate success, global_id 74307 2026-02-17T11:51:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c010070 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0040f0 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f22967fc640 4 set_mon_vals no callback set 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 10 monclient: _renew_subs 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229806f6c0 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 10 monclient: _renew_subs 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.758+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22980a2600 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f229e3cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f229e3cc640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 0x7f22981cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f229809dac0 con 0x7f22981ccce0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f228c004290 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 0x7f22981cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient: get_auth_request con 0x7f22981ccce0 auth_method 0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2294ff9640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dd10 0x7f22680401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(230..230 src has 47..230) ==== 4843+0+0 (secure 0 0 0) 0x7f228c052680 con 0x7f22980a3bb0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 64288 payload 824 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f2297fff640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2298093260 con 0x7f22981ccce0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f22977fe640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dd10 0x7f22680401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.759+0000 7f22977fe640 10 monclient: get_auth_request con 0x7f226803dd10 auth_method 0 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2297fff640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 msgr2=0x7f22981cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2297fff640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 0x7f22981cd0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284014860 con 0x7f22981ccce0 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.763 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f2284014860 con 0x7f22981ccce0 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 msgr2=0x7f22981cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 0x7f22981cd0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400f610 comp rx=0 tx=0).stop 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 msgr2=0x7f22981cd0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f2294ff9640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981ccce0 0x7f22981cd0c0 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400f610 comp rx=0 tx=0).stop 2026-02-17T11:51:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.762+0000 7f22977fe640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dd10 0x7f22680401d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f229e3cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f229e3cc640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 0x7f22981d8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f229e3cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f22980008d0 con 0x7f22981cd600 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f2297fff640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 0x7f22981d8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f2297fff640 10 monclient: get_auth_request con 0x7f22981cd600 auth_method 0 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.765+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.766+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.766+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.766+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.766+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 64291 payload 824 2026-02-17T11:51:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.766+0000 7f2297fff640 1 -- 10.20.193.51:0/1324948802 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2298050ac0 con 0x7f22981cd600 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2297fff640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 msgr2=0x7f22981d8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2297fff640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 0x7f22981d8050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f22840047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284022ca0 con 0x7f22981cd600 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f228402b480 con 0x7f22981cd600 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 msgr2=0x7f22981d8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.768+0000 7f2294ff9640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 0x7f22981d8050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f22840047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f2294ff9640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 msgr2=0x7f22981d8050 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f2294ff9640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22981cd600 0x7f22981d8050 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f22840047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 163315, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:31.771 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:31.772 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.773 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.774 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:31.775 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dd10 msgr2=0x7f22680401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f226803dd10 0x7f22680401d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288039040 comp rx=0 tx=0).stop 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 10 monclient: shutdown 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 msgr2=0x7f22980901c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 --2- 10.20.193.51:0/1324948802 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22980a3bb0 0x7f22980901c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f228c00be50 tx=0x7f228c00bf50 comp rx=0 tx=0).stop 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 reap_dead start 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229c942640 1 -- 10.20.193.51:0/1324948802 reap_dead start 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 shutdown_connections 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 >> 10.20.193.51:0/1324948802 conn(0x7f22980a30c0 msgr2=0x7f2298072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 shutdown_connections 2026-02-17T11:51:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.769+0000 7f229e3cc640 1 -- 10.20.193.51:0/1324948802 wait complete. 2026-02-17T11:51:31.776 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:31.776 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:51:31.776 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:51:31.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: get_monmap_and_config 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: build_initial_monmap 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: monmap: 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:31.842090+0000 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:31.842090+0000 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:31.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 Processor -- start 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 -- start start 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: init 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe5240a3bb0 0x7fe52409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-c con 0x7fe5240a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe5240a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe52413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52406e140 con 0x7fe52413b760 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52409f910 con 0x7fe5240a0750 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe52409ccd0 con 0x7fe5240a3bb0 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe52970a640 10 monclient(hunting): authenticate will time out at 979.460819s 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe5237fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe52413b760 0x7fe52413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39130/0 (socket says 10.20.193.51:39130) 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.841+0000 7fe5237fe640 1 -- 10.20.193.51:0/2320816485 learned_addr learned my addr 10.20.193.51:0/2320816485 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:31.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 1 --2- 10.20.193.51:0/2320816485 >> v2:10.20.193.142:3300/0 conn(0x7fe5240a3bb0 0x7fe52409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): get_auth_request con 0x7fe5240a3bb0 auth_method 0 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient(hunting): handle_auth_done global_id 64294 payload 274 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 1 -- 10.20.193.51:0/2320816485 >> v1:10.20.193.142:6789/0 conn(0x7fe5240a0750 legacy=0x7fe52409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 1 -- 10.20.193.51:0/2320816485 >> v1:10.20.193.51:6789/0 conn(0x7fe52413b760 legacy=0x7fe52413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 1 monclient: found mon.noname-c 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:51:31.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.842+0000 7fe522ffd640 1 -- 10.20.193.51:0/2320816485 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52409eec0 con 0x7fe5240a3bb0 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe522ffd640 1 -- 10.20.193.51:0/2320816485 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5240a3bb0 msgr2=0x7fe52409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe522ffd640 1 --2- 10.20.193.51:0/2320816485 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5240a3bb0 0x7fe52409dac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098a0 tx=0x7fe51802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae582ad783854f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 1 -- 10.20.193.51:0/2320816485 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51803c070 con 0x7fe5240a3bb0 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: dump: 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.849 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: _finish_auth 0 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 5 monclient: authenticate success, global_id 64294 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 1 -- 10.20.193.51:0/2320816485 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51802fce0 con 0x7fe5240a3bb0 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 1 -- 10.20.193.51:0/2320816485 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518037660 con 0x7fe5240a3bb0 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe521ffb640 10 monclient: dump: 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.850 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 4 set_mon_vals no callback set 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 10 monclient: shutdown 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 -- 10.20.193.51:0/2320816485 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5240a3bb0 msgr2=0x7fe52409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 --2- 10.20.193.51:0/2320816485 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5240a3bb0 0x7fe52409dac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098a0 tx=0x7fe51802ed80 comp rx=0 tx=0).stop 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 -- 10.20.193.51:0/2320816485 shutdown_connections 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 --2- 10.20.193.51:0/2320816485 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5240a3bb0 0x7fe52409dac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 -- 10.20.193.51:0/2320816485 >> 10.20.193.51:0/2320816485 conn(0x7fe5240a30c0 msgr2=0x7fe5240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 -- 10.20.193.51:0/2320816485 shutdown_connections 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.845+0000 7fe52970a640 1 -- 10.20.193.51:0/2320816485 wait complete. 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient: build_initial_monmap 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient: monmap: 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:31.851 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 Processor -- start 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 -- start start 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient: init 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-a con 0x7fe5240a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5240a3bb0 0x7fe5241cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-c con 0x7fe5240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe52413b760 0x7fe524090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): picked mon.noname-b con 0x7fe52413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe5240a04b0 con 0x7fe5240a0750 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe52409c850 con 0x7fe52413b760 2026-02-17T11:51:31.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe52409e710 con 0x7fe5240a3bb0 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe52970a640 10 monclient(hunting): authenticate will time out at 979.465594s 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56362/0 (socket says 10.20.193.51:56362) 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 -- 10.20.193.51:0/747144517 learned_addr learned my addr 10.20.193.51:0/747144517 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): get_auth_request con 0x7fe5240a0750 auth_method 0 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5240a3bb0 0x7fe5241cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): get_auth_request con 0x7fe5240a3bb0 auth_method 0 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe5227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:31.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient(hunting): handle_auth_done global_id 74310 payload 824 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 -- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5240a3bb0 msgr2=0x7fe5241cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5240a3bb0 0x7fe5241cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 -- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe52413b760 msgr2=0x7fe524090dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe52413b760 0x7fe524090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 monclient: found mon.noname-a 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.846+0000 7fe522ffd640 1 -- 10.20.193.51:0/747144517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe524094600 con 0x7fe5240a0750 2026-02-17T11:51:31.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe522ffd640 1 -- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 msgr2=0x7fe5241cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:31.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe522ffd640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098a0 tx=0x7fe5180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518046070 con 0x7fe5240a0750 2026-02-17T11:51:31.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: dump: 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 5 monclient: authenticate success, global_id 74310 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe518041870 con 0x7fe5240a0750 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51803c040 con 0x7fe5240a0750 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:31.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 10 monclient: dump: 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5217fa640 4 set_mon_vals no callback set 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _renew_subs 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5240948e0 con 0x7fe5240a0750 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _renew_subs 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52409d7b0 con 0x7fe5240a0750 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5240a2490 con 0x7fe5240a0750 2026-02-17T11:51:31.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.849+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe518041c60 con 0x7fe5240a0750 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.850+0000 7fe5037fe640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 0x7fe4f00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.850+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(230..230 src has 47..230) ==== 4843+0+0 (secure 0 0 0) 0x7fe518077f30 con 0x7fe5240a0750 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.850+0000 7fe5227fc640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 0x7fe4f00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.850+0000 7fe5227fc640 10 monclient: get_auth_request con 0x7fe4f003dd10 auth_method 0 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.852+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe518040c70 con 0x7fe5240a0750 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.852+0000 7fe5037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.852+0000 7fe5037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:31.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.853+0000 7fe5227fc640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 0x7fe4f00401d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe52413a050 tx=0x7fe50c007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:31.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.965+0000 7fe52970a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:51:31.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.965+0000 7fe52970a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:51:31.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.965+0000 7fe52970a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:31.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.965+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe524094c20 con 0x7fe5240a0750 2026-02-17T11:51:31.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.966+0000 7fe5037fe640 1 -- 10.20.193.51:0/747144517 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe524094c20 con 0x7fe5240a0750 2026-02-17T11:51:31.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.966+0000 7fe5037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:51:31.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.966+0000 7fe5037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=3260220215,config=692619927,health=3602034646,kv=643764953,logm=2710899453}) 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=2342146163,config=692619927,health=1361790972,kv=4015639851,logm=2873447211}) 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=3260220215,config=692619927,health=3602034646,kv=643764953,logm=2710899453}) 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.966+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=3260220215,config=692619927,health=3819404006,kv=643764953,logm=991872123}) 2026-02-17T11:51:31.970 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.971 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101264706}) 2026-02-17T11:51:31.971 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3956828452}) 2026-02-17T11:51:31.971 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.971 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101264706}) 2026-02-17T11:51:31.971 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2205612241}) 2026-02-17T11:51:31.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 msgr2=0x7fe4f00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 0x7fe4f00401d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe52413a050 tx=0x7fe50c007f30 comp rx=0 tx=0).stop 2026-02-17T11:51:31.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 10 monclient: shutdown 2026-02-17T11:51:31.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 msgr2=0x7fe5241cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098a0 tx=0x7fe5180047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 shutdown_connections 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4f003dd10 0x7fe4f00401d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe52413b760 0x7fe524090dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5240a3bb0 0x7fe5241cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 --2- 10.20.193.51:0/747144517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5240a0750 0x7fe5241cdab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 >> 10.20.193.51:0/747144517 conn(0x7fe5240a30c0 msgr2=0x7fe52413ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 shutdown_connections 2026-02-17T11:51:31.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:31.967+0000 7fe52970a640 1 -- 10.20.193.51:0/747144517 wait complete. 2026-02-17T11:51:31.983 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2545354212}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1890157638}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2545354212}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3754859667}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163986746}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2712782704}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163986746}) 2026-02-17T11:51:31.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.967+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3751177378}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=81726881}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3619321733}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=81726881}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1619046240}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1146413004}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3126056111}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1146413004}) 2026-02-17T11:51:31.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.968+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4161836330}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59148266}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3201994713}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59148266}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1811226997}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=704573044}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1195073627}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=704573044}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3786255194}) 2026-02-17T11:51:31.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2276135837}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2839419552}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2276135837}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.969+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1649302986}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4058550805}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1795503885}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4058550805}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2147848136}) 2026-02-17T11:51:31.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172701378}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3729292953}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172701378}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3416619645}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.970+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2426671059}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1086974046}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2426671059}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2791413273}) 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917054482}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2792538333}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917054482}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2454896007}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1374756493}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=43580289}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1374756493}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.971+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2947444334}) 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.989 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294639301}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1800375996}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294639301}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=769351674}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068739374}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1070846059}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068739374}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.972+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4112035582}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2891084565}) 2026-02-17T11:51:31.990 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=616033687}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2891084565}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=968730476}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1484080143}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3413865570}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1484080143}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.973+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1387360867}) 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.991 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=68,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11} crc {logm=4102009543,mdsmap=3207544932,mgr=1062795410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1312251216,mon_config_key=1983055269}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=6} crc {logm=867832255,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1312251216,mon_config_key=3131122695}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=68,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11} crc {logm=4102009543,mdsmap=3207544932,mgr=1062795410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1312251216,mon_config_key=1983055269}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=72,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6} crc {logm=4050070343,mdsmap=3207544932,mgr=1712578885,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=336563940,mon_config_key=3131122695}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=1,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=37,osdmap=53} crc {mon_config_key=337786862,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=2966436192,osd_snap=2534886762,osdmap=287604100}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=2,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38,osdmap=50} crc {mon_config_key=195236525,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=2966436192,osd_snap=2138019136,osdmap=4075726159}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=1,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=37,osdmap=53} crc {mon_config_key=337786862,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=2966436192,osd_snap=2534886762,osdmap=287604100}) 2026-02-17T11:51:31.992 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=1,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=40,osdmap=50} crc {mon_config_key=2481559271,monmap=263989209,osd_metadata=101123558,osd_pg_creating=2966436192,osd_snap=3296618272,osdmap=381183381}) 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2822200114}) 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4095278789}) 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2822200114}) 2026-02-17T11:51:31.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.974+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=880970742}) 2026-02-17T11:51:31.994 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=557441002}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1414322711}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=557441002}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.975+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2667169386}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=1217821651}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=30} crc {osdmap=389028726}) 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:51:31.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=1217821651}) 2026-02-17T11:51:31.997 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:51:31.977+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=31} crc {osdmap=1147048373}) 2026-02-17T11:51:32.089 INFO:tasks.rados.rados.0.trial142.stdout:908: done (0 left) 2026-02-17T11:51:32.090 INFO:tasks.rados.rados.0.trial142.stdout:909: copy_from oid 20 from oid 4 current snap is 105 2026-02-17T11:51:32.090 INFO:tasks.rados.rados.0.trial142.stdout:910: write (excl) oid 17 current snap is 105 2026-02-17T11:51:32.090 INFO:tasks.rados.rados.0.trial142.stdout:910: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2026-02-17T11:51:32.094 INFO:tasks.rados.rados.0.trial142.stdout:910: writing trial14245205-17 from 729503 to 1289603 tid 1 2026-02-17T11:51:32.099 INFO:tasks.rados.rados.0.trial142.stdout:910: writing trial14245205-17 from 2019164 to 2735596 tid 2 2026-02-17T11:51:32.102 INFO:tasks.rados.rados.0.trial142.stdout:910: writing trial14245205-17 from 3335341 to 3529503 tid 3 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:911: copy_from oid 13 from oid 42 current snap is 105 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:909: finishing copy_from racing read to trial14245205-20 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:910: finishing write tid 1 to trial14245205-17 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:909: finishing copy_from to trial14245205-20 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 681 (ObjNum 240 snap 75 seq_num 240) dirty exists 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:910: finishing write tid 2 to trial14245205-17 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:909: done (2 left) 2026-02-17T11:51:32.103 INFO:tasks.rados.rados.0.trial142.stdout:912: snap_remove snap 66 2026-02-17T11:51:32.995 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:51:32.995 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:51:33.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.061+0000 7fce4c07c640 10 monclient: get_monmap_and_config 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.061+0000 7fce4c07c640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.061+0000 7fce4c07c640 10 monclient: monmap: 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:33.062887+0000 2026-02-17T11:51:33.064 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:33.062887+0000 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:33.065 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 Processor -- start 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 -- start start 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient: init 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fce44138600 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:33.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 0x7fce4413d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-b con 0x7fce440a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce4413d8a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce440a1df0 con 0x7fce44138600 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce440a65b0 con 0x7fce4413d8a0 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fce440a6830 con 0x7fce440a35a0 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce4c07c640 10 monclient(hunting): authenticate will time out at 980.681905s 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce49df1640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fce44138600 0x7fce441389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39142/0 (socket says 10.20.193.51:39142) 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce49df1640 1 -- 10.20.193.51:0/1118832119 learned_addr learned my addr 10.20.193.51:0/1118832119 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:33.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.062+0000 7fce495f0640 1 --2- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 0x7fce4413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): get_auth_request con 0x7fce440a35a0 auth_method 0 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient(hunting): handle_auth_done global_id 94115 payload 274 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 1 -- 10.20.193.51:0/1118832119 >> v1:10.20.193.142:6789/0 conn(0x7fce4413d8a0 legacy=0x7fce4413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 1 -- 10.20.193.51:0/1118832119 >> v1:10.20.193.51:6789/0 conn(0x7fce44138600 legacy=0x7fce441389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 1 monclient: found mon.noname-b 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.063+0000 7fce495f0640 1 -- 10.20.193.51:0/1118832119 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce440a22d0 con 0x7fce440a35a0 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce495f0640 1 -- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 msgr2=0x7fce4413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce495f0640 1 --2- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 0x7fce4413d360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce380098d0 tx=0x7fce3802edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d8ab42d046396f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 1 -- 10.20.193.51:0/1118832119 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3803c070 con 0x7fce440a35a0 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: dump: 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.077 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 1 -- 10.20.193.51:0/1118832119 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3802fd20 con 0x7fce440a35a0 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce4c07c640 5 monclient: authenticate success, global_id 94115 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce4c07c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 1 -- 10.20.193.51:0/1118832119 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38037660 con 0x7fce440a35a0 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce4c07c640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce4c07c640 4 set_mon_vals no callback set 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.065+0000 7fce48def640 10 monclient: dump: 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.079 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: shutdown 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 msgr2=0x7fce4413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 --2- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 0x7fce4413d360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce380098d0 tx=0x7fce3802edc0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- 10.20.193.51:0/1118832119 shutdown_connections 2026-02-17T11:51:33.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 --2- 10.20.193.51:0/1118832119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce440a35a0 0x7fce4413d360 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- 10.20.193.51:0/1118832119 >> 10.20.193.51:0/1118832119 conn(0x7fce440a7460 msgr2=0x7fce440a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- 10.20.193.51:0/1118832119 shutdown_connections 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- 10.20.193.51:0/1118832119 wait complete. 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: monmap: 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.081 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 Processor -- start 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 -- start start 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: init 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:51:33.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce440a35a0 0x7fce441cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-b con 0x7fce440a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-c con 0x7fce44138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.066+0000 7fce4c07c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce4413d8a0 0x7fce441379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): picked mon.noname-a con 0x7fce4413d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fce440a15f0 con 0x7fce4413d8a0 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fce440a2c00 con 0x7fce440a35a0 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fce440a1770 con 0x7fce44138600 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4c07c640 10 monclient(hunting): authenticate will time out at 980.686008s 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce4413d8a0 0x7fce441379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34938/0 (socket says 10.20.193.51:34938) 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 -- 10.20.193.51:0/219255707 learned_addr learned my addr 10.20.193.51:0/219255707 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): get_auth_request con 0x7fce4413d8a0 auth_method 0 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): get_auth_request con 0x7fce44138600 auth_method 0 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce4a5f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce49df1640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce440a35a0 0x7fce441cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce49df1640 10 monclient(hunting): get_auth_request con 0x7fce440a35a0 auth_method 0 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce49df1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce49df1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce49df1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient(hunting): handle_auth_done global_id 94118 payload 824 2026-02-17T11:51:33.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 -- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce440a35a0 msgr2=0x7fce441cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce440a35a0 0x7fce441cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 -- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce4413d8a0 msgr2=0x7fce441379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce4413d8a0 0x7fce441379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 monclient: found mon.noname-c 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.067+0000 7fce495f0640 1 -- 10.20.193.51:0/219255707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce440748b0 con 0x7fce44138600 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce495f0640 1 -- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 msgr2=0x7fce44137460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce495f0640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce380098d0 tx=0x7fce380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38046070 con 0x7fce44138600 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: dump: 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.087 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38041870 con 0x7fce44138600 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 5 monclient: authenticate success, global_id 94118 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _renew_subs 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4413d110 con 0x7fce44138600 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3803c040 con 0x7fce44138600 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce33fff640 4 set_mon_vals no callback set 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce327fc640 10 monclient: dump: 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _renew_subs 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce44073110 con 0x7fce44138600 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.069+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce441389e0 con 0x7fce44138600 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.070+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fce38041c60 con 0x7fce44138600 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.070+0000 7fce327fc640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 0x7fce14040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.070+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(231..231 src has 47..231) ==== 4871+0+0 (secure 0 0 0) 0x7fce38077e80 con 0x7fce44138600 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.070+0000 7fce49df1640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 0x7fce14040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.070+0000 7fce49df1640 10 monclient: get_auth_request con 0x7fce1403dd60 auth_method 0 2026-02-17T11:51:33.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.072+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fce38037e10 con 0x7fce44138600 2026-02-17T11:51:33.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.072+0000 7fce327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.072+0000 7fce327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:33.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.073+0000 7fce49df1640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 0x7fce14040220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce34007340 tx=0x7fce34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:912: done (2 left) 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:913: copy_from oid 20 from oid 38 current snap is 105 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:910: finishing write tid 3 to trial14245205-17 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:910: finishing write tid 4 to trial14245205-17 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:910: finishing write tid 5 to trial14245205-17 2026-02-17T11:51:33.093 INFO:tasks.rados.rados.0.trial142.stdout:910: oid 17 updating version 0 to 581 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:910: oid 17 version 581 is already newer than 580 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:910: oid 17 updating version 581 to 582 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:910: oid 17 version 582 is already newer than 579 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 582 (ObjNum 329 snap 105 seq_num 329) dirty exists 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:910: left oid 17 (ObjNum 329 snap 105 seq_num 329) 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:911: finishing copy_from racing read to trial14245205-13 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:911: finishing copy_from to trial14245205-13 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 437 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:910: done (2 left) 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:911: done (1 left) 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:914: rollback oid 18 current snap is 105 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 81 2026-02-17T11:51:33.094 INFO:tasks.rados.rados.0.trial142.stdout:915: delete oid 45 current snap is 105 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:915: done (2 left) 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:916: rollback oid 6 current snap is 105 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 93 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:917: write (excl) oid 36 current snap is 105 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:917: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2026-02-17T11:51:33.095 INFO:tasks.rados.rados.0.trial142.stdout:917: writing trial14245205-36 from 763117 to 1473715 tid 1 2026-02-17T11:51:33.100 INFO:tasks.rados.rados.0.trial142.stdout:917: writing trial14245205-36 from 2136128 to 2856229 tid 2 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:917: writing trial14245205-36 from 3390187 to 3563117 tid 3 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:918: delete oid 3 current snap is 105 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:914: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:914: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:914: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 744 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:916: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:916: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:51:33.104 INFO:tasks.rados.rados.0.trial142.stdout:916: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 613 (ObjNum 212 snap 68 seq_num 212) dirty exists 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:913: finishing copy_from racing read to trial14245205-20 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:913: finishing copy_from to trial14245205-20 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 83 (ObjNum 322 snap 105 seq_num 322) dirty exists 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:917: finishing write tid 1 to trial14245205-36 2026-02-17T11:51:33.105 INFO:tasks.rados.rados.0.trial142.stdout:917: finishing write tid 2 to trial14245205-36 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: finishing write tid 3 to trial14245205-36 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: finishing write tid 4 to trial14245205-36 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: finishing write tid 5 to trial14245205-36 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: oid 36 updating version 0 to 682 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: oid 36 updating version 682 to 685 2026-02-17T11:51:33.106 INFO:tasks.rados.rados.0.trial142.stdout:917: oid 36 version 685 is already newer than 684 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:917: oid 36 version 685 is already newer than 683 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 685 (ObjNum 331 snap 105 seq_num 331) dirty exists 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:917: left oid 36 (ObjNum 331 snap 105 seq_num 331) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:913: done (4 left) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:914: done (3 left) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:916: done (2 left) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:917: done (1 left) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:918: done (0 left) 2026-02-17T11:51:33.107 INFO:tasks.rados.rados.0.trial142.stdout:919: snap_create 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.188+0000 7fce4c07c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.188+0000 7fce4c07c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.188+0000 7fce4c07c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.188+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fce44069780 con 0x7fce44138600 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.189+0000 7fce327fc640 1 -- 10.20.193.51:0/219255707 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fce3802fbe0 con 0x7fce44138600 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.189+0000 7fce327fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:33.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.189+0000 7fce327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:33.192 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:51:33.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 msgr2=0x7fce14040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 0x7fce14040220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce34007340 tx=0x7fce34009040 comp rx=0 tx=0).stop 2026-02-17T11:51:33.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 10 monclient: shutdown 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 msgr2=0x7fce44137460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce380098d0 tx=0x7fce380047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 shutdown_connections 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fce1403dd60 0x7fce14040220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fce4413d8a0 0x7fce441379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fce44138600 0x7fce44137460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 --2- 10.20.193.51:0/219255707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fce440a35a0 0x7fce441cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 >> 10.20.193.51:0/219255707 conn(0x7fce440a7460 msgr2=0x7fce440aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 shutdown_connections 2026-02-17T11:51:33.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.190+0000 7fce4c07c640 1 -- 10.20.193.51:0/219255707 wait complete. 2026-02-17T11:51:33.201 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:51:33.201 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:51:33.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:51:33.201 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:51:33.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.268+0000 7f10fd664640 10 monclient: get_monmap_and_config 2026-02-17T11:51:33.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.268+0000 7f10fd664640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.268+0000 7f10fd664640 10 monclient: monmap: 2026-02-17T11:51:33.273 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:33.269856+0000 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:33.269856+0000 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 Processor -- start 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 -- start start 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient: init 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f10f809e370 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f809ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-b con 0x7f10f809aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f10f8139950 0x7f10f813bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-c con 0x7f10f8139950 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f80a0980 con 0x7f10f809e370 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f10f809d600 con 0x7f10f8139950 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f10f806d8e0 con 0x7f10f809aa50 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10fd664640 10 monclient(hunting): authenticate will time out at 980.888798s 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f809ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f6ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f10f809e370 0x7f10f809e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39150/0 (socket says 10.20.193.51:39150) 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f6ffd640 1 -- 10.20.193.51:0/4063204823 learned_addr learned my addr 10.20.193.51:0/4063204823 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): get_auth_request con 0x7f10f809aa50 auth_method 0 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.269+0000 7f10f77fe640 1 --2- 10.20.193.51:0/4063204823 >> v2:10.20.193.142:3300/0 conn(0x7f10f8139950 0x7f10f813bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f77fe640 10 monclient(hunting): get_auth_request con 0x7f10f8139950 auth_method 0 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 10 monclient(hunting): handle_auth_done global_id 94121 payload 274 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 1 -- 10.20.193.51:0/4063204823 >> v2:10.20.193.142:3300/0 conn(0x7f10f8139950 msgr2=0x7f10f813bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 1 --2- 10.20.193.51:0/4063204823 >> v2:10.20.193.142:3300/0 conn(0x7f10f8139950 0x7f10f813bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 1 -- 10.20.193.51:0/4063204823 >> v1:10.20.193.51:6789/0 conn(0x7f10f809e370 legacy=0x7f10f809e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 1 monclient: found mon.noname-b 2026-02-17T11:51:33.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.270+0000 7f10f67fc640 1 -- 10.20.193.51:0/4063204823 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f809ff30 con 0x7f10f809aa50 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f67fc640 1 -- 10.20.193.51:0/4063204823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 msgr2=0x7f10f809ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f67fc640 1 --2- 10.20.193.51:0/4063204823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f809ee60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10e00098a0 tx=0x7f10e002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7446440c9123d0a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 1 -- 10.20.193.51:0/4063204823 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e003c070 con 0x7f10f809aa50 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: dump: 2026-02-17T11:51:33.288 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 1 -- 10.20.193.51:0/4063204823 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e002fc00 con 0x7f10f809aa50 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10fd664640 5 monclient: authenticate success, global_id 94121 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10fd664640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 1 -- 10.20.193.51:0/4063204823 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0037440 con 0x7f10f809aa50 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10f5ffb640 10 monclient: dump: 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.290 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10fd664640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.272+0000 7f10fd664640 4 set_mon_vals no callback set 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 10 monclient: shutdown 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- 10.20.193.51:0/4063204823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 msgr2=0x7f10f809ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 --2- 10.20.193.51:0/4063204823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f809ee60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10e00098a0 tx=0x7f10e002ed80 comp rx=0 tx=0).stop 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- 10.20.193.51:0/4063204823 shutdown_connections 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 --2- 10.20.193.51:0/4063204823 >> v2:10.20.193.142:3300/0 conn(0x7f10f8139950 0x7f10f813bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 --2- 10.20.193.51:0/4063204823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f809ee60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- 10.20.193.51:0/4063204823 >> 10.20.193.51:0/4063204823 conn(0x7f10f80a30c0 msgr2=0x7f10f80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- 10.20.193.51:0/4063204823 shutdown_connections 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- 10.20.193.51:0/4063204823 wait complete. 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 10 monclient: monmap: 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:33.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 Processor -- start 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 1 -- start start 2026-02-17T11:51:33.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.273+0000 7f10fd664640 10 monclient: init 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-c con 0x7f10f809aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f809e370 0x7f10f8092020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-a con 0x7f10f809e370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f10f8139950 0x7f10f8092560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): picked mon.noname-b con 0x7f10f8139950 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f10f80a3e20 con 0x7f10f809e370 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10f806e140 con 0x7f10f8139950 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f10f80a3fa0 con 0x7f10f809aa50 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10fd664640 10 monclient(hunting): authenticate will time out at 980.893218s 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34944/0 (socket says 10.20.193.51:34944) 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 -- 10.20.193.51:0/2569045794 learned_addr learned my addr 10.20.193.51:0/2569045794 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): get_auth_request con 0x7f10f809aa50 auth_method 0 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f809e370 0x7f10f8092020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): get_auth_request con 0x7f10f809e370 auth_method 0 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient(hunting): handle_auth_done global_id 94124 payload 824 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f10f8139950 msgr2=0x7f10f8092560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f10f8139950 0x7f10f8092560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f809e370 msgr2=0x7f10f8092020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f809e370 0x7f10f8092020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 monclient: found mon.noname-c 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.274+0000 7f10f6ffd640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f8095630 con 0x7f10f809aa50 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10f6ffd640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 msgr2=0x7f10f8091ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10f6ffd640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c780 tx=0x7f10ec00cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec005de0 con 0x7f10f809aa50 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: dump: 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec007070 con 0x7f10f809aa50 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 5 monclient: authenticate success, global_id 94124 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 10 monclient: _renew_subs 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f809c740 con 0x7f10f809aa50 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec007440 con 0x7f10f809aa50 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10d77fe640 10 monclient: dump: 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.299 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10f57fa640 4 set_mon_vals no callback set 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 10 monclient: _renew_subs 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:51:33.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.276+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f80a2960 con 0x7f10f809aa50 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10fd664640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10fd664640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 0x7f10f808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f10f809dcc0 con 0x7f10f8092aa0 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 0x7f10f808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient: get_auth_request con 0x7f10f8092aa0 auth_method 0 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f10ec007620 con 0x7f10f809aa50 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 10 monclient(hunting): handle_auth_done global_id 74319 payload 824 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f67fc640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f8092e80 con 0x7f10f8092aa0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10d77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f10c403dd10 0x7f10c40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(232..232 src has 47..232) ==== 4843+0+0 (secure 0 0 0) 0x7f10ec052420 con 0x7f10f809aa50 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f10c403dd10 0x7f10c40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.277+0000 7f10f77fe640 10 monclient: get_auth_request con 0x7f10c403dd10 auth_method 0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10f67fc640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 msgr2=0x7f10f808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10f67fc640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 0x7f10f808d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10e0039000 tx=0x7f10e00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0048070 con 0x7f10f8092aa0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 10 monclient: dump: 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f10e004d450 con 0x7f10f8092aa0 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 msgr2=0x7f10f808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 0x7f10f808d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10e0039000 tx=0x7f10e00047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 msgr2=0x7f10f808d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.279+0000 7f10d77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f8092aa0 0x7f10f808d3f0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10e0039000 tx=0x7f10e00047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.280+0000 7f10f77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f10c403dd10 0x7f10c40401d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009fa0 tx=0x7f10e80096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10fd664640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10fd664640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 0x7f10f808dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10fd664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8094180 con 0x7f10f808d930 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 0x7f10f808dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient: get_auth_request con 0x7f10f808d930 auth_method 0 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 10 monclient(hunting): handle_auth_done global_id 74322 payload 824 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.283+0000 7f10f67fc640 1 -- 10.20.193.51:0/2569045794 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10f80008d0 con 0x7f10f808d930 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10f67fc640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 msgr2=0x7f10f808dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10f67fc640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 0x7f10f808dd10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10e002edc0 tx=0x7f10e0009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e003c040 con 0x7f10f808d930 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 10 monclient: dump: 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.305 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f10e0041a00 con 0x7f10f808d930 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 msgr2=0x7f10f808dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 0x7f10f808dd10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10e002edc0 tx=0x7f10e0009290 comp rx=0 tx=0).stop 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 msgr2=0x7f10f808dd10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10d77fe640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f10f808d930 0x7f10f808dd10 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10e002edc0 tx=0x7f10e0009290 comp rx=0 tx=0).stop 2026-02-17T11:51:33.307 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:33.307 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:33.307 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:33.307 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:51:33.307 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 111216, 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.308 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.309 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.310 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.311 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:33.312 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:33.313 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:33.316 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.317 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.318 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:33.318 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f10c403dd10 msgr2=0x7f10c40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f10c403dd10 0x7f10c40401d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009fa0 tx=0x7f10e80096a0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 10 monclient: shutdown 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 msgr2=0x7f10f8091ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10f77fe640 1 -- 10.20.193.51:0/2569045794 reap_dead start 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c780 tx=0x7f10ec00cc50 comp rx=0 tx=0).stop 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 shutdown_connections 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 --2- 10.20.193.51:0/2569045794 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f809aa50 0x7f10f8091ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 >> 10.20.193.51:0/2569045794 conn(0x7f10f80a30c0 msgr2=0x7f10f81c2990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 shutdown_connections 2026-02-17T11:51:33.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.285+0000 7f10fd664640 1 -- 10.20.193.51:0/2569045794 wait complete. 2026-02-17T11:51:33.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:33.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:51:33.320 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 10 monclient: get_monmap_and_config 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 10 monclient: monmap: 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:33.385425+0000 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:33.385425+0000 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:33.388 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 1 Processor -- start 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 1 -- start start 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.384+0000 7f1490bf5640 10 monclient: init 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f148c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f148c0a0750 0x7f148c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f148c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 0x7f148c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f148c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148c06e140 con 0x7f148c0a3bb0 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f148c09f910 con 0x7f148c0a0750 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f148c09ccd0 con 0x7f148c13b760 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1490bf5640 10 monclient(hunting): authenticate will time out at 981.004166s 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f148c0a0750 0x7f148c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f148c0a0750 0x7f148c09e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56396/0 (socket says 10.20.193.51:56396) 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 -- 10.20.193.51:0/987158048 learned_addr learned my addr 10.20.193.51:0/987158048 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f148a575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f148c0a3bb0 0x7f148c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39164/0 (socket says 10.20.193.51:39164) 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): get_auth_request con 0x7f148c0a0750 auth_method 0 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f148ad76640 1 --2- 10.20.193.51:0/987158048 >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 0x7f148c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient(hunting): handle_auth_done global_id 74325 payload 274 2026-02-17T11:51:33.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 -- 10.20.193.51:0/987158048 >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 msgr2=0x7f148c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 --2- 10.20.193.51:0/987158048 >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 0x7f148c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 -- 10.20.193.51:0/987158048 >> v1:10.20.193.51:6789/0 conn(0x7f148c0a3bb0 legacy=0x7f148c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 monclient: found mon.noname-a 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f1489d74640 1 -- 10.20.193.51:0/987158048 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c09eec0 con 0x7f148c0a0750 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f148ad76640 10 monclient: get_auth_request con 0x7f148c13b760 auth_method 0 2026-02-17T11:51:33.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.385+0000 7f148ad76640 1 --2- 10.20.193.51:0/987158048 >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 0x7f148c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489d74640 1 -- 10.20.193.51:0/987158048 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 msgr2=0x7f148c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489d74640 1 --2- 10.20.193.51:0/987158048 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c09e1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f148c09f5f0 tx=0x7f147402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a30389e1eefab6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 1 -- 10.20.193.51:0/987158048 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147403c070 con 0x7f148c0a0750 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: dump: 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.396 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 1 -- 10.20.193.51:0/987158048 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147402fd80 con 0x7f148c0a0750 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 1 -- 10.20.193.51:0/987158048 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474037660 con 0x7f148c0a0750 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1489573640 10 monclient: dump: 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.397 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1490bf5640 5 monclient: authenticate success, global_id 74325 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1490bf5640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.387+0000 7f1490bf5640 4 set_mon_vals no callback set 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 10 monclient: shutdown 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 -- 10.20.193.51:0/987158048 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 msgr2=0x7f148c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 --2- 10.20.193.51:0/987158048 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c09e1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f148c09f5f0 tx=0x7f147402ee60 comp rx=0 tx=0).stop 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 -- 10.20.193.51:0/987158048 shutdown_connections 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 --2- 10.20.193.51:0/987158048 >> v2:10.20.193.142:3300/0 conn(0x7f148c13b760 0x7f148c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 --2- 10.20.193.51:0/987158048 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c09e1d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 -- 10.20.193.51:0/987158048 >> 10.20.193.51:0/987158048 conn(0x7f148c0a30c0 msgr2=0x7f148c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 -- 10.20.193.51:0/987158048 shutdown_connections 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 -- 10.20.193.51:0/987158048 wait complete. 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 10 monclient: monmap: 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:33.398 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.388+0000 7f1490bf5640 1 Processor -- start 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 -- start start 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient: init 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c091140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f148c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f148c0a3bb0 0x7f148c091680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-b con 0x7f148c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c13b760 0x7f148c091bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f148c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f148c0a04b0 con 0x7f148c0a0750 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f148c09c850 con 0x7f148c0a3bb0 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f148c09e710 con 0x7f148c13b760 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f1490bf5640 10 monclient(hunting): authenticate will time out at 981.008267s 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c091140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c091140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56404/0 (socket says 10.20.193.51:56404) 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 -- 10.20.193.51:0/2850235661 learned_addr learned my addr 10.20.193.51:0/2850235661 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): get_auth_request con 0x7f148c0a0750 auth_method 0 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c13b760 0x7f148c091bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): get_auth_request con 0x7f148c13b760 auth_method 0 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient(hunting): handle_auth_done global_id 74328 payload 824 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c13b760 msgr2=0x7f148c091bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c13b760 0x7f148c091bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f148c0a3bb0 msgr2=0x7f148c091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f148c0a3bb0 0x7f148c091680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 monclient: found mon.noname-a 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.389+0000 7f148a575640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c094d80 con 0x7f148c0a0750 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f148a575640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 msgr2=0x7f148c091140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f148a575640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c091140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f148000c550 tx=0x7f148000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f148c0a0750 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: dump: 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1480007070 con 0x7f148c0a0750 2026-02-17T11:51:33.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480007460 con 0x7f148c0a0750 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1472ffd640 10 monclient: dump: 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 5 monclient: authenticate success, global_id 74328 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 10 monclient: _renew_subs 2026-02-17T11:51:33.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1488d72640 4 set_mon_vals no callback set 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c0a2c00 con 0x7f148c0a0750 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 10 monclient: _renew_subs 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.391+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c0947c0 con 0x7f148c0a0750 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1490bf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1490bf5640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 0x7f148c08d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f148c077c20 con 0x7f148c08d3f0 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 0x7f148c08d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient: get_auth_request con 0x7f148c08d3f0 auth_method 0 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 10 monclient(hunting): handle_auth_done global_id 94130 payload 824 2026-02-17T11:51:33.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1489d74640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f148c09dac0 con 0x7f148c08d3f0 2026-02-17T11:51:33.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f148001b3b0 con 0x7f148c0a0750 2026-02-17T11:51:33.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1472ffd640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f145803dd60 0x7f1458040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(232..232 src has 47..232) ==== 4843+0+0 (secure 0 0 0) 0x7f1480051e70 con 0x7f148c0a0750 2026-02-17T11:51:33.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f148ad76640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f145803dd60 0x7f1458040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.392+0000 7f148ad76640 10 monclient: get_auth_request con 0x7f145803dd60 auth_method 0 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1489d74640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 msgr2=0x7f148c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1489d74640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 0x7f148c08d7d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f148c06c1c0 tx=0x7f14740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474046020 con 0x7f148c08d3f0 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 10 monclient: dump: 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1474037d70 con 0x7f148c08d3f0 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 msgr2=0x7f148c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 0x7f148c08d7d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f148c06c1c0 tx=0x7f14740047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 msgr2=0x7f148c08d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.394+0000 7f1472ffd640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08d3f0 0x7f148c08d7d0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f148c06c1c0 tx=0x7f14740047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.395+0000 7f148ad76640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f145803dd60 0x7f1458040220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f148c093e30 tx=0x7f147c0076d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1490bf5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1490bf5640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 0x7f148c1d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1490bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f148c092eb0 con 0x7f148c08dd10 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1489d74640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 0x7f148c1d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1489d74640 10 monclient: get_auth_request con 0x7f148c08dd10 auth_method 0 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1489d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1489d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.397+0000 7f1489d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.398+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.398+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.398+0000 7f1489d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.398+0000 7f1489d74640 10 monclient(hunting): handle_auth_done global_id 94133 payload 824 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.398+0000 7f1489d74640 1 -- 10.20.193.51:0/2850235661 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f148c0008d0 con 0x7f148c08dd10 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1489d74640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 msgr2=0x7f148c1d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1489d74640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 0x7f148c1d7890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f147402eea0 tx=0x7f1474008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474046030 con 0x7f148c08dd10 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 10 monclient: dump: 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.409 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f147404a3e0 con 0x7f148c08dd10 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 msgr2=0x7f148c1d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 0x7f148c1d7890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f147402eea0 tx=0x7f1474008030 comp rx=0 tx=0).stop 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 msgr2=0x7f148c1d7890 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1472ffd640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f148c08dd10 0x7f148c1d7890 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f147402eea0 tx=0x7f1474008030 comp rx=0 tx=0).stop 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:33.410 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 11943, 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.411 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.412 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.413 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.414 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.415 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:33.416 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.417 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:33.419 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f145803dd60 msgr2=0x7f1458040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f145803dd60 0x7f1458040220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f148c093e30 tx=0x7f147c0076d0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 10 monclient: shutdown 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 msgr2=0x7f148c091140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 --2- 10.20.193.51:0/2850235661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f148c0a0750 0x7f148c091140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f148000c550 tx=0x7f148000ca20 comp rx=0 tx=0).stop 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f148ad76640 1 -- 10.20.193.51:0/2850235661 reap_dead start 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f148ad76640 1 -- 10.20.193.51:0/2850235661 reap_dead start 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 shutdown_connections 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 >> 10.20.193.51:0/2850235661 conn(0x7f148c0a30c0 msgr2=0x7f148c13abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 shutdown_connections 2026-02-17T11:51:33.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.400+0000 7f1490bf5640 1 -- 10.20.193.51:0/2850235661 wait complete. 2026-02-17T11:51:33.421 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:33.422 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:51:33.422 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 10 monclient: get_monmap_and_config 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 10 monclient: monmap: 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:33.489270+0000 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:33.489270+0000 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:33.490 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:33.491 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 1 Processor -- start 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 1 -- start start 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.488+0000 7fc0cad22640 10 monclient: init 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T11:51:33.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc0c406d180 0x7fc0c40a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-a con 0x7fc0c406d180 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc0c409c8a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc0c40a3260 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c409c480 con 0x7fc0c409c8a0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c409b420 con 0x7fc0c40a3260 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c40a3670 con 0x7fc0c406d180 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0cad22640 10 monclient(hunting): authenticate will time out at 981.108323s 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc0c406d180 0x7fc0c40a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0bbfff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc0c409c8a0 0x7fc0c40a2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39178/0 (socket says 10.20.193.51:39178) 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc0c406d180 0x7fc0c40a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56414/0 (socket says 10.20.193.51:56414) 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3306726363 learned_addr learned my addr 10.20.193.51:0/3306726363 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): get_auth_request con 0x7fc0c406d180 auth_method 0 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_done global_id 74331 payload 274 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3306726363 >> v1:10.20.193.142:6789/0 conn(0x7fc0c40a3260 legacy=0x7fc0c413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3306726363 >> v1:10.20.193.51:6789/0 conn(0x7fc0c409c8a0 legacy=0x7fc0c40a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 monclient: found mon.noname-a 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.489+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3306726363 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c409bbe0 con 0x7fc0c406d180 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.491+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3306726363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c406d180 msgr2=0x7fc0c40a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.491+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3306726363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c406d180 0x7fc0c40a2610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40098a0 tx=0x7fc0b402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27501fa7dd5c888a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 1 -- 10.20.193.51:0/3306726363 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b403c070 con 0x7fc0c406d180 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: dump: 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.497 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 5 monclient: authenticate success, global_id 74331 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 1 -- 10.20.193.51:0/3306726363 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b402fce0 con 0x7fc0c406d180 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 1 -- 10.20.193.51:0/3306726363 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4037660 con 0x7fc0c406d180 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 4 set_mon_vals no callback set 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0bb7fe640 10 monclient: dump: 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.498 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 10 monclient: shutdown 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 -- 10.20.193.51:0/3306726363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c406d180 msgr2=0x7fc0c40a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3306726363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c406d180 0x7fc0c40a2610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40098a0 tx=0x7fc0b402ed80 comp rx=0 tx=0).stop 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 -- 10.20.193.51:0/3306726363 shutdown_connections 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3306726363 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c406d180 0x7fc0c40a2610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 -- 10.20.193.51:0/3306726363 >> 10.20.193.51:0/3306726363 conn(0x7fc0c40a7b90 msgr2=0x7fc0c40a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 -- 10.20.193.51:0/3306726363 shutdown_connections 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.492+0000 7fc0cad22640 1 -- 10.20.193.51:0/3306726363 wait complete. 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient: build_initial_monmap 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient: monmap: 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:33.499 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 Processor -- start 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 -- start start 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient: init 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c406d180 0x7fc0c4140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-b con 0x7fc0c406d180 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 0x7fc0c4093a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-a con 0x7fc0c409c8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc0c40a3260 0x7fc0c4093f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): picked mon.noname-c con 0x7fc0c40a3260 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c409e640 con 0x7fc0c409c8a0 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c406d560 con 0x7fc0c406d180 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c409e7c0 con 0x7fc0c40a3260 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0cad22640 10 monclient(hunting): authenticate will time out at 981.112558s 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 0x7fc0c4093a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 0x7fc0c4093a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56416/0 (socket says 10.20.193.51:56416) 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3990371510 learned_addr learned my addr 10.20.193.51:0/3990371510 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): get_auth_request con 0x7fc0c409c8a0 auth_method 0 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc0c40a3260 0x7fc0c4093f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): get_auth_request con 0x7fc0c40a3260 auth_method 0 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c406d180 0x7fc0c4140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c9298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient(hunting): handle_auth_done global_id 74334 payload 824 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc0c40a3260 msgr2=0x7fc0c4093f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc0c40a3260 0x7fc0c4093f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c406d180 msgr2=0x7fc0c4140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c406d180 0x7fc0c4140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 monclient: found mon.noname-a 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c4097630 con 0x7fc0c409c8a0 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c8a97640 10 monclient: get_auth_request con 0x7fc0c406d180 auth_method 0 2026-02-17T11:51:33.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.493+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c406d180 0x7fc0c4140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0bbfff640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 msgr2=0x7fc0c4093a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0bbfff640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 0x7fc0c4093a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c750 tx=0x7fc0ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac005de0 con 0x7fc0c409c8a0 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:33.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: dump: 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: _finish_auth 0 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac007070 con 0x7fc0c409c8a0 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0cad22640 5 monclient: authenticate success, global_id 74334 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0cad22640 10 monclient: _renew_subs 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0cad22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c40a65b0 con 0x7fc0c409c8a0 2026-02-17T11:51:33.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac007440 con 0x7fc0c409c8a0 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0baffd640 4 set_mon_vals no callback set 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.495+0000 7fc0b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0b97fa640 10 monclient: dump: 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 10 monclient: _renew_subs 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c4095f00 con 0x7fc0c409c8a0 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 0x7fc0c40944d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c40a2610 con 0x7fc0c40982f0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc0ac007620 con 0x7fc0c409c8a0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 0x7fc0c40944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient: get_auth_request con 0x7fc0c40982f0 auth_method 0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0b97fa640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc09403dd10 0x7fc0940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.496+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(232..232 src has 47..232) ==== 4843+0+0 (secure 0 0 0) 0x7fc0ac0523d0 con 0x7fc0c409c8a0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.497+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_done global_id 64303 payload 824 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.497+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0c40008d0 con 0x7fc0c40982f0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.497+0000 7fc0c9298640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc09403dd10 0x7fc0940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.497+0000 7fc0c9298640 10 monclient: get_auth_request con 0x7fc09403dd10 auth_method 0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 msgr2=0x7fc0c40944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 0x7fc0c40944d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4039000 tx=0x7fc0b40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0c9298640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc09403dd10 0x7fc0940401d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4095db0 tx=0x7fc0c00042b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4047070 con 0x7fc0c40982f0 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 10 monclient: dump: 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc0b4043460 con 0x7fc0c40982f0 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 msgr2=0x7fc0c40944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 0x7fc0c40944d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4039000 tx=0x7fc0b40047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 msgr2=0x7fc0c40944d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.499+0000 7fc0b97fa640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c40982f0 0x7fc0c40944d0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4039000 tx=0x7fc0b40047c0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.502+0000 7fc0cad22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.502+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 0x7fc0c41da160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.502+0000 7fc0cad22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.502+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4094e20 con 0x7fc0c4094a10 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 0x7fc0c41da160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient: get_auth_request con 0x7fc0c4094a10 auth_method 0 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 10 monclient(hunting): handle_auth_done global_id 64306 payload 824 2026-02-17T11:51:33.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.503+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3990371510 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0c41407b0 con 0x7fc0c4094a10 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0c8a97640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 msgr2=0x7fc0c41da160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0c8a97640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 0x7fc0c41da160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0b402edc0 tx=0x7fc0b4009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b403c040 con 0x7fc0c4094a10 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 10 monclient: dump: 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.511 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7fc0b4003de0 con 0x7fc0c4094a10 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 msgr2=0x7fc0c41da160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 0x7fc0c41da160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0b402edc0 tx=0x7fc0b4009290 comp rx=0 tx=0).stop 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 msgr2=0x7fc0c41da160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.505+0000 7fc0b97fa640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc0c4094a10 0x7fc0c41da160 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0b402edc0 tx=0x7fc0b4009290 comp rx=0 tx=0).stop 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:33.512 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 50, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 165052, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.513 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.514 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:33.515 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:33.516 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.517 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.518 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.519 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.520 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:33.521 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:33.522 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:33.522 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:33.522 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:33.522 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc09403dd10 msgr2=0x7fc0940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc09403dd10 0x7fc0940401d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4095db0 tx=0x7fc0c00042b0 comp rx=0 tx=0).stop 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 10 monclient: shutdown 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 msgr2=0x7fc0c4093a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 --2- 10.20.193.51:0/3990371510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc0c409c8a0 0x7fc0c4093a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c750 tx=0x7fc0ac00cc20 comp rx=0 tx=0).stop 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0c9298640 1 -- 10.20.193.51:0/3990371510 reap_dead start 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0c9298640 1 -- 10.20.193.51:0/3990371510 reap_dead start 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 shutdown_connections 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 >> 10.20.193.51:0/3990371510 conn(0x7fc0c40a7b90 msgr2=0x7fc0c40a41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 shutdown_connections 2026-02-17T11:51:33.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:33.506+0000 7fc0cad22640 1 -- 10.20.193.51:0/3990371510 wait complete. 2026-02-17T11:51:33.524 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:51:33.524 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:51:33.524 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-17T11:51:33.524 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:51:33.524 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:51:33.524 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:51:33.524 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:51:33.533 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:51:33.533 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T11:51:33.533 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T11:51:33.533 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:51:48.533 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T11:51:48.534 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T11:51:48.534 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:51:48.535 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:51:48.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.601+0000 7f47bf1cc640 10 monclient: get_monmap_and_config 2026-02-17T11:51:48.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.601+0000 7f47bf1cc640 10 monclient: build_initial_monmap 2026-02-17T11:51:48.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.601+0000 7f47bf1cc640 10 monclient: monmap: 2026-02-17T11:51:48.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:48.603946+0000 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:48.603946+0000 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:48.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 Processor -- start 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 -- start start 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient: init 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f47b80a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-b con 0x7f47b809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47b80a0110 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b806e140 con 0x7f47b80a0110 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b809ce60 con 0x7f47b80a3bb0 2026-02-17T11:51:48.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f47b809aed0 con 0x7f47b809dac0 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bf1cc640 10 monclient(hunting): authenticate will time out at 996.222691s 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47affff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 msgr2=0x7f47b809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47affff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bd742640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f47b80a0110 0x7f47b813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:48520/0 (socket says 10.20.193.51:48520) 2026-02-17T11:51:48.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.602+0000 7f47bd742640 1 -- 10.20.193.51:0/1418085067 learned_addr learned my addr 10.20.193.51:0/1418085067 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:48.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.604+0000 7f47bd742640 1 -- 10.20.193.51:0/1418085067 >> v1:10.20.193.51:6789/0 conn(0x7f47b80a0110 legacy=0x7f47b813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:48.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.605+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v1:10.20.193.142:6789/0 conn(0x7f47b80a3bb0 legacy=0x7f47b809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:48.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.803+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 msgr2=0x7f47b809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:48.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:48.803+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:51:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:49.204+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 msgr2=0x7f47b809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:49.204+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:51:50.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:50.005+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 msgr2=0x7f47b809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:50.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:50.005+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:51:51.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): tick 2026-02-17T11:51:51.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:51:51.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:51:51.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 msgr2=0x7f47b809fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47b809dac0 0x7f47b809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 >> v1:10.20.193.142:6789/0 conn(0x7f47b80a3bb0 legacy=0x7f47b809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 >> v1:10.20.193.51:6789/0 conn(0x7f47b80a0110 legacy=0x7f47b813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient: _add_conns ranks=[3,4] 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f479c003910 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f479c006440 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:51.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f47b809aed0 con 0x7f479c003910 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f479c008f90 con 0x7f479c006440 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47ae7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003910 auth_method 0 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47bcf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.603+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 10 monclient(hunting): get_auth_request con 0x7f479c006440 auth_method 0 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:51.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:51.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.604+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003910 auth_method 0 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:51.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 10 monclient(hunting): get_auth_request con 0x7f479c006440 auth_method 0 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:51.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:51.805+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:51:52.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:52.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003910 auth_method 0 2026-02-17T11:51:52.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 10 monclient(hunting): get_auth_request con 0x7f479c006440 auth_method 0 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:52.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:52.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:51:52.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:52.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:52.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:52.206+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:51:53.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003910 auth_method 0 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 10 monclient(hunting): get_auth_request con 0x7f479c006440 auth_method 0 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:51:53.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:53.007+0000 7f47affff640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:51:54.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): tick 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 msgr2=0x7f479c008900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c006440 0x7f479c008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 msgr2=0x7f479c005d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.51:3300/0 conn(0x7f479c003910 0x7f479c005d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47bd742640 1 -- 10.20.193.51:0/1418085067 reap_dead start 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T11:51:54.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c003d60 0x7f479c0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f479c003d60 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f479c006e30 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 0x7f479c00d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f479c008930 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b809a5c0 con 0x7f479c006e30 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f47b809aed0 con 0x7f479c003d60 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 1 -- 10.20.193.51:0/1418085067 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f479c008f90 con 0x7f479c008930 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47ae7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47bd742640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 msgr2=0x7f479c00d470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.603+0000 7f47bd742640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 0x7f479c00d470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> v2:10.20.193.142:3300/0 conn(0x7f479c003d60 0x7f479c0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003d60 auth_method 0 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient(hunting): handle_auth_done global_id 64309 payload 274 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 msgr2=0x7f479c00d470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 0x7f479c00d470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> v1:10.20.193.51:6789/0 conn(0x7f479c006e30 legacy=0x7f479c007210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:54.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 monclient: found mon.noname-c 2026-02-17T11:51:54.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:51:54.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.604+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c00ec60 con 0x7f479c003d60 2026-02-17T11:51:54.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47bcf41640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c003d60 msgr2=0x7f479c0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47bcf41640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c003d60 0x7f479c0068f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47a8007bf0 tx=0x7f47a802fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5929b86e1fa85ff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 1 -- 10.20.193.51:0/1418085067 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8036700 con 0x7f479c003d60 2026-02-17T11:51:54.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: dump: 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.619 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 1 -- 10.20.193.51:0/1418085067 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a803c070 con 0x7f479c003d60 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 1 -- 10.20.193.51:0/1418085067 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8036b00 con 0x7f479c003d60 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47af7fe640 10 monclient: dump: 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.620 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47bf1cc640 5 monclient: authenticate success, global_id 64309 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47bf1cc640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.607+0000 7f47bf1cc640 4 set_mon_vals no callback set 2026-02-17T11:51:54.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 10 monclient: shutdown 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 -- 10.20.193.51:0/1418085067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c003d60 msgr2=0x7f479c0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c003d60 0x7f479c0068f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47a8007bf0 tx=0x7f47a802fa10 comp rx=0 tx=0).stop 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 -- 10.20.193.51:0/1418085067 shutdown_connections 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c008930 0x7f479c00d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/1418085067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c003d60 0x7f479c0068f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 -- 10.20.193.51:0/1418085067 >> 10.20.193.51:0/1418085067 conn(0x7f47b80a30c0 msgr2=0x7f47b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 -- 10.20.193.51:0/1418085067 shutdown_connections 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 1 -- 10.20.193.51:0/1418085067 wait complete. 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 10 monclient: build_initial_monmap 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.608+0000 7f47bf1cc640 10 monclient: monmap: 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:54.622 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 Processor -- start 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 -- start start 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient: init 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-a con 0x7f479c003d60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 0x7f47b8095260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-c con 0x7f479c006e30 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 0x7f47b80957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): picked mon.noname-b con 0x7f479c008930 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80a3f90 con 0x7f479c003d60 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47b809cad0 con 0x7f479c008930 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80a0540 con 0x7f479c006e30 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bf1cc640 10 monclient(hunting): authenticate will time out at 1002.228366s 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47affff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 msgr2=0x7f47b8095260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47affff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 0x7f47b8095260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48876/0 (socket says 10.20.193.51:48876) 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 -- 10.20.193.51:0/2994552270 learned_addr learned my addr 10.20.193.51:0/2994552270 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): get_auth_request con 0x7f479c003d60 auth_method 0 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bd742640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 0x7f47b80957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient(hunting): handle_auth_done global_id 74337 payload 824 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 -- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 msgr2=0x7f47b8095260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 0x7f47b8095260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 -- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 msgr2=0x7f47b80957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 0x7f47b80957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 monclient: found mon.noname-a 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bcf41640 1 -- 10.20.193.51:0/2994552270 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b8098f60 con 0x7f479c003d60 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bd742640 10 monclient: get_auth_request con 0x7f479c008930 auth_method 0 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.609+0000 7f47bd742640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 0x7f47b80957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bcf41640 1 -- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 msgr2=0x7f47b8099380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bcf41640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47a8039040 tx=0x7f47a8002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a804b630 con 0x7f479c003d60 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: dump: 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8044070 con 0x7f479c003d60 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 5 monclient: authenticate success, global_id 74337 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a804ba10 con 0x7f479c003d60 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47aeffd640 4 set_mon_vals no callback set 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47ad7fa640 10 monclient: dump: 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.628 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 10 monclient: _renew_subs 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b80986c0 con 0x7f479c003d60 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 10 monclient: _renew_subs 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.611+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b8095ce0 con 0x7f479c003d60 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f47a80403f0 con 0x7f479c003d60 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47bf1cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47bf1cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47bf1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b809e5c0 con 0x7f479c003d60 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47ad7fa640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 0x7f47880401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(232..232 src has 47..232) ==== 4843+0+0 (secure 0 0 0) 0x7f47a8077f40 con 0x7f479c003d60 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47affff640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 0x7f47880401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.612+0000 7f47affff640 10 monclient: get_auth_request con 0x7f478803dd10 auth_method 0 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.615+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f47a8076900 con 0x7f479c003d60 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.615+0000 7f47ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.615+0000 7f47ad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:54.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.615+0000 7f47affff640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 0x7f47880401d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47a0003a80 tx=0x7f47a0005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.653 INFO:tasks.rados.rados.0.trial142.stdout:919: done (0 left) 2026-02-17T11:51:54.653 INFO:tasks.rados.rados.0.trial142.stdout:920: read oid 2 snap -1 2026-02-17T11:51:54.653 INFO:tasks.rados.rados.0.trial142.stdout:920: expect (ObjNum 314 snap 100 seq_num 314) 2026-02-17T11:51:54.653 INFO:tasks.rados.rados.0.trial142.stdout:921: snap_create 2026-02-17T11:51:54.658 INFO:tasks.rados.rados.0.trial142.stdout:920: expect (ObjNum 314 snap 100 seq_num 314) 2026-02-17T11:51:54.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47bf1cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:51:54.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47bf1cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47bf1cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47b809bf90 con 0x7f479c003d60 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47ad7fa640 1 -- 10.20.193.51:0/2994552270 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f47a8041d40 con 0x7f479c003d60 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47ad7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.730+0000 7f47ad7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:54.733 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":52,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 msgr2=0x7f47880401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 0x7f47880401d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47a0003a80 tx=0x7f47a0005040 comp rx=0 tx=0).stop 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 10 monclient: shutdown 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 msgr2=0x7f47b8099380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47a8039040 tx=0x7f47a8002d30 comp rx=0 tx=0).stop 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 shutdown_connections 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f478803dd10 0x7f47880401d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f479c008930 0x7f47b80957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f479c006e30 0x7f47b8095260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 --2- 10.20.193.51:0/2994552270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f479c003d60 0x7f47b8099380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 >> 10.20.193.51:0/2994552270 conn(0x7f47b80a30c0 msgr2=0x7f47b8071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 shutdown_connections 2026-02-17T11:51:54.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.731+0000 7f47bf1cc640 1 -- 10.20.193.51:0/2994552270 wait complete. 2026-02-17T11:51:54.742 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:51:54.742 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:51:54.742 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:51:54.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 10 monclient: get_monmap_and_config 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 10 monclient: build_initial_monmap 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 10 monclient: monmap: 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:54.808293+0000 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:54.808293+0000 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:54.812 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 1 Processor -- start 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 1 -- start start 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 10 monclient: init 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.807+0000 7f44f933e640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 0x7f44f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-b con 0x7f44f40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44f40a0750 0x7f44f409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-a con 0x7f44f40a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f44f409e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f406e140 con 0x7f44f409e540 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f44f40a3f90 con 0x7f44f40a0750 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f44f409f910 con 0x7f44f40a3bb0 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f933e640 10 monclient(hunting): authenticate will time out at 1002.427075s 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f2ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 msgr2=0x7f44f409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 0x7f44f409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44f40a0750 0x7f44f409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44f40a0750 0x7f44f409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48888/0 (socket says 10.20.193.51:48888) 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 -- 10.20.193.51:0/1116282862 learned_addr learned my addr 10.20.193.51:0/1116282862 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f44f409e540 0x7f44f413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:48540/0 (socket says 10.20.193.51:48540) 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): get_auth_request con 0x7f44f40a0750 auth_method 0 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient(hunting): handle_auth_done global_id 74340 payload 274 2026-02-17T11:51:54.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 -- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 msgr2=0x7f44f409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 --2- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 0x7f44f409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 -- 10.20.193.51:0/1116282862 >> v1:10.20.193.51:6789/0 conn(0x7f44f409e540 legacy=0x7f44f413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 monclient: found mon.noname-a 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.808+0000 7f44f27fc640 1 -- 10.20.193.51:0/1116282862 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f409ccd0 con 0x7f44f40a0750 2026-02-17T11:51:54.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f27fc640 1 -- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a0750 msgr2=0x7f44f409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f27fc640 1 --2- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a0750 0x7f44f409e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44f4069d60 tx=0x7f44dc02ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9eac9c04336eb4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 1 -- 10.20.193.51:0/1116282862 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03c070 con 0x7f44f40a0750 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: dump: 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 1 -- 10.20.193.51:0/1116282862 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44dc02fda0 con 0x7f44f40a0750 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f933e640 5 monclient: authenticate success, global_id 74340 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 1 -- 10.20.193.51:0/1116282862 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc037660 con 0x7f44f40a0750 2026-02-17T11:51:54.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f1ffb640 10 monclient: dump: 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f933e640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.810+0000 7f44f933e640 4 set_mon_vals no callback set 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 10 monclient: shutdown 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a0750 msgr2=0x7f44f409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 --2- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a0750 0x7f44f409e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44f4069d60 tx=0x7f44dc02ee80 comp rx=0 tx=0).stop 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- 10.20.193.51:0/1116282862 shutdown_connections 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 --2- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a0750 0x7f44f409e000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 --2- 10.20.193.51:0/1116282862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f40a3bb0 0x7f44f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- 10.20.193.51:0/1116282862 >> 10.20.193.51:0/1116282862 conn(0x7f44f40a30c0 msgr2=0x7f44f40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- 10.20.193.51:0/1116282862 shutdown_connections 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- 10.20.193.51:0/1116282862 wait complete. 2026-02-17T11:51:54.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 10 monclient: build_initial_monmap 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 10 monclient: monmap: 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 Processor -- start 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 1 -- start start 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.811+0000 7f44f933e640 10 monclient: init 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f409e540 0x7f44f413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-c con 0x7f44f409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44f40a0750 0x7f44f4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-b con 0x7f44f40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 0x7f44f41371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): picked mon.noname-a con 0x7f44f40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44f40a04b0 con 0x7f44f40a3bb0 2026-02-17T11:51:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f44f409c850 con 0x7f44f40a0750 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f44f413de80 con 0x7f44f409e540 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f933e640 10 monclient(hunting): authenticate will time out at 1002.431268s 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f2ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f409e540 msgr2=0x7f44f413d090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f409e540 0x7f44f413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 0x7f44f41371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 0x7f44f41371c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48890/0 (socket says 10.20.193.51:48890) 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 learned_addr learned my addr 10.20.193.51:0/3869456119 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): get_auth_request con 0x7f44f40a3bb0 auth_method 0 2026-02-17T11:51:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient(hunting): handle_auth_done global_id 74343 payload 824 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f409e540 msgr2=0x7f44f413d090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44f409e540 0x7f44f413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44f40a0750 msgr2=0x7f44f4136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44f40a0750 0x7f44f4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 monclient: found mon.noname-a 2026-02-17T11:51:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.812+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f412e120 con 0x7f44f40a3bb0 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 msgr2=0x7f44f41371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 0x7f44f41371c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e400caf0 tx=0x7f44e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4017070 con 0x7f44f40a3bb0 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: dump: 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.832 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e4012400 con 0x7f44f40a3bb0 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e40127f0 con 0x7f44f40a3bb0 2026-02-17T11:51:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44d37fe640 10 monclient: dump: 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f17fa640 4 set_mon_vals no callback set 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 5 monclient: authenticate success, global_id 74343 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 10 monclient: _renew_subs 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f412e400 con 0x7f44f40a3bb0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 10 monclient: _renew_subs 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.814+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f40a2810 con 0x7f44f40a3bb0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f933e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f933e640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 0x7f44f41cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44f409dac0 con 0x7f44f41cd1c0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 0x7f44f41cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient: get_auth_request con 0x7f44f41cd1c0 auth_method 0 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f44e4007070 con 0x7f44f40a3bb0 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_done global_id 74346 payload 824 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44f2ffd640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44f413dc20 con 0x7f44f41cd1c0 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44d37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f44c003dcf0 0x7f44c00401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.815+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(233..233 src has 47..233) ==== 4815+0+0 (secure 0 0 0) 0x7f44e4052790 con 0x7f44f40a3bb0 2026-02-17T11:51:54.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.816+0000 7f44f27fc640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f44c003dcf0 0x7f44c00401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.816+0000 7f44f27fc640 10 monclient: get_auth_request con 0x7f44c003dcf0 auth_method 0 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44f2ffd640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 msgr2=0x7f44f41cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44f2ffd640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 0x7f44f41cd5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8005070 con 0x7f44f41cd1c0 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.817+0000 7f44d37fe640 10 monclient: dump: 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.837 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f44e8005070 con 0x7f44f41cd1c0 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 msgr2=0x7f44f41cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 0x7f44f41cd5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 msgr2=0x7f44f41cd5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44d37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cd1c0 0x7f44f41cd5a0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.818+0000 7f44f27fc640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f44c003dcf0 0x7f44c00401b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44dc036000 tx=0x7f44dc031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f933e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f933e640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 0x7f44f41d8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f933e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44f412bb60 con 0x7f44f41cdae0 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 0x7f44f41d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient: get_auth_request con 0x7f44f41cdae0 auth_method 0 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 10 monclient(hunting): handle_auth_done global_id 74349 payload 824 2026-02-17T11:51:54.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.821+0000 7f44f2ffd640 1 -- 10.20.193.51:0/3869456119 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44f40008d0 con 0x7f44f41cdae0 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f2ffd640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 msgr2=0x7f44f41d8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f2ffd640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 0x7f44f41d8510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e8005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e801a730 con 0x7f44f41cdae0 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 10 monclient: dump: 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.841 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f44e8014430 con 0x7f44f41cdae0 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 msgr2=0x7f44f41d8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 0x7f44f41d8510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e8005ad0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 msgr2=0x7f44f41d8510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44d37fe640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f41cdae0 0x7f44f41d8510 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bcc0 tx=0x7f44e8005ad0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 52, 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 132755, 2026-02-17T11:51:54.843 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.844 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.845 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:54.846 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.847 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:54.848 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.849 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.850 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:54.851 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:54.852 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.853 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:54.854 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:54.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f44c003dcf0 msgr2=0x7f44c00401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f44c003dcf0 0x7f44c00401b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44dc036000 tx=0x7f44dc031000 comp rx=0 tx=0).stop 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 10 monclient: shutdown 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 msgr2=0x7f44f41371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 --2- 10.20.193.51:0/3869456119 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44f40a3bb0 0x7f44f41371c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e400caf0 tx=0x7f44e400a060 comp rx=0 tx=0).stop 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 reap_dead start 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f37fe640 1 -- 10.20.193.51:0/3869456119 reap_dead start 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 shutdown_connections 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 >> 10.20.193.51:0/3869456119 conn(0x7f44f40a30c0 msgr2=0x7f44f4072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.823+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 shutdown_connections 2026-02-17T11:51:54.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.824+0000 7f44f933e640 1 -- 10.20.193.51:0/3869456119 wait complete. 2026-02-17T11:51:54.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:51:54.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:51:54.857 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:51:54.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.922+0000 7f8bb6f14640 10 monclient: get_monmap_and_config 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.922+0000 7f8bb6f14640 10 monclient: build_initial_monmap 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.922+0000 7f8bb6f14640 10 monclient: monmap: 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:51:54.923472+0000 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:51:54.923472+0000 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.922+0000 7f8bb6f14640 1 Processor -- start 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 1 -- start start 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient: init 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8bb00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8bb00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8bb013c770 0x7f8bb013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-c con 0x7f8bb013c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb009e8e0 con 0x7f8bb00a0750 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb006e140 con 0x7f8bb00a3bb0 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb009f910 con 0x7f8bb013c770 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb6f14640 10 monclient(hunting): authenticate will time out at 1002.542303s 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8ba7fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8bb00a0750 0x7f8bb009e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:48546/0 (socket says 10.20.193.51:48546) 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 learned_addr learned my addr 10.20.193.51:0/1886505258 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1886505258 >> v2:10.20.193.142:3300/0 conn(0x7f8bb013c770 0x7f8bb013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb548a640 10 monclient(hunting): get_auth_request con 0x7f8bb013c770 auth_method 0 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb548a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb548a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.923+0000 7f8bb548a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 >> v1:10.20.193.51:6789/0 conn(0x7f8bb00a0750 legacy=0x7f8bb009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885453820 0 0) 0x7f8bb009e8e0 con 0x7f8bb00a0750 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): _negotiate 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): my global_id is 74352 2026-02-17T11:51:54.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b9c003620 con 0x7f8bb00a0750 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1886505258 >> v1:10.20.193.142:6789/0 conn(0x7f8bb00a3bb0 legacy=0x7f8bb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3680667891 0 0) 0x7f8b9c003620 con 0x7f8bb00a0750 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 >> v2:10.20.193.142:3300/0 conn(0x7f8bb013c770 msgr2=0x7f8bb013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 --2- 10.20.193.51:0/1886505258 >> v2:10.20.193.142:3300/0 conn(0x7f8bb013c770 0x7f8bb013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 >> v1:10.20.193.142:6789/0 conn(0x7f8bb00a3bb0 legacy=0x7f8bb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb009ccd0 con 0x7f8bb00a0750 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f8b980031b0 con 0x7f8bb00a0750 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: dump: 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.941 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 >> v1:10.20.193.51:6789/0 conn(0x7f8bb00a0750 legacy=0x7f8bb009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8b9c003c20 0x7f8b9c004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): picked mon.b con 0x7f8b9c003c20 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8b9c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): picked mon.a con 0x7f8b9c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8b9c009ab0 0x7f8b9c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): picked mon.c con 0x7f8b9c009ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb009f910 con 0x7f8b9c004900 2026-02-17T11:51:54.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c00c4c0 con 0x7f8b9c003c20 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c00c6c0 con 0x7f8b9c009ab0 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba77fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8bb548a640 1 -- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8b9c009ab0 msgr2=0x7f8b9c00bea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8b9c009ab0 0x7f8b9c00bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8b9c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): get_auth_request con 0x7f8b9c004900 auth_method 0 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.925+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb4c89640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8b9c003c20 0x7f8b9c004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb4c89640 10 monclient(hunting): get_auth_request con 0x7f8b9c003c20 auth_method 0 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb4c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb4c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb4c89640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_done global_id 74352 payload 293 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8b9c009ab0 msgr2=0x7f8b9c00bea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8b9c009ab0 0x7f8b9c00bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8b9c003c20 msgr2=0x7f8b9c004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8b9c003c20 0x7f8b9c004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 monclient: found mon.a 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb548a640 1 -- 10.20.193.51:0/1886505258 reap_dead start 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c003620 con 0x7f8b9c004900 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8ba7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb6f14640 5 monclient: authenticate success, global_id 74352 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.926+0000 7f8bb6f14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 msgr2=0x7f8b9c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8b9c004d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b980033d0 tx=0x7f8b9802f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9b9f6767917d32 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800c180 con 0x7f8b9c004900 2026-02-17T11:51:54.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: dump: 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b98005cb0 con 0x7f8b9c004900 2026-02-17T11:51:54.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8bb6f14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 1 -- 10.20.193.51:0/1886505258 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98005e60 con 0x7f8b9c004900 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8bb6f14640 10 monclient: get_monmap_and_config success 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8bb6f14640 4 set_mon_vals no callback set 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8ba77fe640 10 monclient: dump: 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.947 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.928+0000 7f8bb6f14640 10 monclient: shutdown 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 msgr2=0x7f8b9c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8b9c004d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b980033d0 tx=0x7f8b9802f740 comp rx=0 tx=0).stop 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1886505258 shutdown_connections 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1886505258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8b9c004d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1886505258 >> 10.20.193.51:0/1886505258 conn(0x7f8bb00a30c0 msgr2=0x7f8bb00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1886505258 shutdown_connections 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1886505258 wait complete. 2026-02-17T11:51:54.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 10 monclient: build_initial_monmap 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 10 monclient: monmap: 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 Processor -- start 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 1 -- start start 2026-02-17T11:51:54.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.929+0000 7f8bb6f14640 10 monclient: init 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient: _reopen_session rank -1 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-a con 0x7f8b9c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bb0099940 0x7f8bb0092fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-c con 0x7f8bb0099940 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb0093510 0x7f8bb0093990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): picked mon.noname-b con 0x7f8bb0093510 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb009c850 con 0x7f8b9c004900 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb009ebe0 con 0x7f8bb0093510 2026-02-17T11:51:54.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00a04b0 con 0x7f8bb0099940 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): _renew_subs 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb6f14640 10 monclient(hunting): authenticate will time out at 1002.549171s 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8ba7fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bb0099940 msgr2=0x7f8bb0092fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8ba7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bb0099940 0x7f8bb0092fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48936/0 (socket says 10.20.193.51:48936) 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1294196211 learned_addr learned my addr 10.20.193.51:0/1294196211 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): get_auth_request con 0x7f8b9c004900 auth_method 0 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb0093510 0x7f8bb0093990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 10 monclient(hunting): get_auth_request con 0x7f8bb0093510 auth_method 0 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient(hunting): handle_auth_done global_id 74355 payload 824 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bb0099940 msgr2=0x7f8bb0092fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bb0099940 0x7f8bb0092fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb0093510 msgr2=0x7f8bb0093990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb0093510 0x7f8bb0093990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient: _finish_hunting 0 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 monclient: found mon.noname-a 2026-02-17T11:51:54.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb0096900 con 0x7f8b9c004900 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.930+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb0093510 0x7f8bb0093990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb4c89640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 msgr2=0x7f8bb0099400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb4c89640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e7e0 tx=0x7f8ba000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0005ad0 con 0x7f8b9c004900 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: dump: 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.953 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: _finish_auth 0 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: _check_auth_tickets 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0018070 con 0x7f8b9c004900 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00070d0 con 0x7f8b9c004900 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:51:54.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba6ffd640 4 set_mon_vals no callback set 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8ba57fa640 10 monclient: dump: 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 5 monclient: authenticate success, global_id 74355 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 10 monclient: _renew_subs 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb0096be0 con 0x7f8b9c004900 2026-02-17T11:51:54.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 10 monclient: _renew_subs 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.932+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb00a2c60 con 0x7f8b9c004900 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb6f14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 0x7f8bb008e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb006a290 con 0x7f8bb008e400 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 0x7f8bb008e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8ba0007270 con 0x7f8b9c004900 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient: get_auth_request con 0x7f8bb008e400 auth_method 0 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba57fa640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8003dd10 0x7f8b800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(233..233 src has 47..233) ==== 4815+0+0 (secure 0 0 0) 0x7f8ba0052400 con 0x7f8b9c004900 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_done global_id 64321 payload 824 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bb009db50 con 0x7f8bb008e400 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8003dd10 0x7f8b800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.933+0000 7f8bb548a640 10 monclient: get_auth_request con 0x7f8b8003dd10 auth_method 0 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.935+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 msgr2=0x7f8bb008e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.935+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 0x7f8bb008e7e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b98036000 tx=0x7f8bb0076660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800c180 con 0x7f8bb008e400 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 10 monclient: dump: 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.957 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8b98005050 con 0x7f8bb008e400 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 msgr2=0x7f8bb008e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 0x7f8bb008e7e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b98036000 tx=0x7f8bb0076660 comp rx=0 tx=0).stop 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 msgr2=0x7f8bb008e7e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8ba57fa640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008e400 0x7f8bb008e7e0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b98036000 tx=0x7f8bb0076660 comp rx=0 tx=0).stop 2026-02-17T11:51:54.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.936+0000 7f8bb548a640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8003dd10 0x7f8b800401d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bb006e310 tx=0x7f8bac00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8bb6f14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:51:54.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 0x7f8bb01d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:51:54.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8bb6f14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:51:54.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00954b0 con 0x7f8bb008ed20 2026-02-17T11:51:54.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 0x7f8bb01d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient: get_auth_request con 0x7f8bb008ed20 auth_method 0 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 10 monclient(hunting): handle_auth_done global_id 64324 payload 824 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.939+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1294196211 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8bb00a3850 con 0x7f8bb008ed20 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.941+0000 7f8ba7fff640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 msgr2=0x7f8bb01d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.941+0000 7f8ba7fff640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 0x7f8bb01d88a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b980028f0 tx=0x7f8b98007c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98005e60 con 0x7f8bb008ed20 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 10 monclient: dump: 2026-02-17T11:51:54.961 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f8b980488a0 con 0x7f8bb008ed20 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 msgr2=0x7f8bb01d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 0x7f8bb01d88a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b980028f0 tx=0x7f8b98007c60 comp rx=0 tx=0).stop 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 msgr2=0x7f8bb01d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:51:54.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8ba57fa640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bb008ed20 0x7f8bb01d88a0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b980028f0 tx=0x7f8b98007c60 comp rx=0 tx=0).stop 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 52, 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 186489, 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:54.963 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:54.965 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:51:54.966 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:51:54.967 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:51:54.968 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:51:54.969 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:51:54.970 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:51:54.971 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:51:54.972 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8003dd10 msgr2=0x7f8b800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8003dd10 0x7f8b800401d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bb006e310 tx=0x7f8bac00d040 comp rx=0 tx=0).stop 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 10 monclient: shutdown 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 msgr2=0x7f8bb0099400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e7e0 tx=0x7f8ba000ecb0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb548a640 1 -- 10.20.193.51:0/1294196211 reap_dead start 2026-02-17T11:51:54.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 shutdown_connections 2026-02-17T11:51:54.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 --2- 10.20.193.51:0/1294196211 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8b9c004900 0x7f8bb0099400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:51:54.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 >> 10.20.193.51:0/1294196211 conn(0x7f8bb00a30c0 msgr2=0x7f8bb0072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:51:54.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 shutdown_connections 2026-02-17T11:51:54.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:51:54.942+0000 7f8bb6f14640 1 -- 10.20.193.51:0/1294196211 wait complete. 2026-02-17T11:51:54.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:51:54.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:51:55.655 INFO:tasks.rados.rados.0.trial142.stdout:920: done (1 left) 2026-02-17T11:51:55.655 INFO:tasks.rados.rados.0.trial142.stdout:921: done (0 left) 2026-02-17T11:51:55.655 INFO:tasks.rados.rados.0.trial142.stdout:922: snap_create 2026-02-17T11:51:56.655 INFO:tasks.rados.rados.0.trial142.stdout:922: done (0 left) 2026-02-17T11:51:56.655 INFO:tasks.rados.rados.0.trial142.stdout:923: snap_remove snap 100 2026-02-17T11:51:57.655 INFO:tasks.rados.rados.0.trial142.stdout:923: done (0 left) 2026-02-17T11:51:57.655 INFO:tasks.rados.rados.0.trial142.stdout:924: read oid 9 snap -1 2026-02-17T11:51:57.655 INFO:tasks.rados.rados.0.trial142.stdout:924: expect deleted 2026-02-17T11:51:57.656 INFO:tasks.rados.rados.0.trial142.stdout:925: rollback oid 50 current snap is 108 2026-02-17T11:51:57.656 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 105 2026-02-17T11:51:57.656 INFO:tasks.rados.rados.0.trial142.stdout:926: delete oid 37 current snap is 108 2026-02-17T11:51:57.659 INFO:tasks.rados.rados.0.trial142.stdout:924: done (2 left) 2026-02-17T11:51:57.659 INFO:tasks.rados.rados.0.trial142.stdout:926: done (1 left) 2026-02-17T11:51:57.660 INFO:tasks.rados.rados.0.trial142.stdout:927: snap_remove snap 107 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:927: done (1 left) 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:928: copy_from oid 20 from oid 25 current snap is 108 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:925: finishing rollback tid 0 to trial14245205-50 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:925: finishing rollback tid 1 to trial14245205-50 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:925: finishing rollback tid 2 to trial14245205-50 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 451 (ObjNum 320 snap 105 seq_num 320) dirty exists 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:925: done (1 left) 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:929: read oid 24 snap -1 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:929: expect (ObjNum 286 snap 93 seq_num 286) 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:930: read oid 44 snap -1 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:930: expect deleted 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:931: read oid 28 snap -1 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:931: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:51:58.538 INFO:tasks.rados.rados.0.trial142.stdout:932: copy_from oid 39 from oid 11 current snap is 108 2026-02-17T11:51:58.539 INFO:tasks.rados.rados.0.trial142.stdout:933: snap_create 2026-02-17T11:51:58.544 INFO:tasks.rados.rados.0.trial142.stdout:929: expect (ObjNum 286 snap 93 seq_num 286) 2026-02-17T11:51:58.660 INFO:tasks.rados.rados.0.trial142.stdout:931: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:51:58.734 INFO:tasks.rados.rados.0.trial142.stdout:932: finishing copy_from racing read to trial14245205-39 2026-02-17T11:51:58.734 INFO:tasks.rados.rados.0.trial142.stdout:928: finishing copy_from racing read to trial14245205-20 2026-02-17T11:51:58.734 INFO:tasks.rados.rados.0.trial142.stdout:932: finishing copy_from to trial14245205-39 2026-02-17T11:51:58.735 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:51:58.735 INFO:tasks.rados.rados.0.trial142.stdout:928: finishing copy_from to trial14245205-20 2026-02-17T11:51:58.735 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 436 (ObjNum 216 snap 69 seq_num 216) dirty exists 2026-02-17T11:51:59.540 INFO:tasks.rados.rados.0.trial142.stdout:928: done (5 left) 2026-02-17T11:51:59.540 INFO:tasks.rados.rados.0.trial142.stdout:929: done (4 left) 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:930: done (3 left) 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:931: done (2 left) 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:932: done (1 left) 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:933: done (0 left) 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:934: rollback oid 17 current snap is 109 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 75 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:935: write oid 31 current snap is 109 2026-02-17T11:51:59.541 INFO:tasks.rados.rados.0.trial142.stdout:935: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-17T11:51:59.544 INFO:tasks.rados.rados.0.trial142.stdout:935: writing trial14245205-31 from 413538 to 949883 tid 1 2026-02-17T11:51:59.548 INFO:tasks.rados.rados.0.trial142.stdout:935: writing trial14245205-31 from 1395221 to 1979002 tid 2 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:935: writing trial14245205-31 from 2556103 to 3214720 tid 3 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:936: write oid 3 current snap is 109 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:934: finishing rollback tid 0 to trial14245205-17 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:934: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:934: finishing rollback tid 2 to trial14245205-17 2026-02-17T11:51:59.554 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 585 (ObjNum 190 snap 54 seq_num 190) dirty exists 2026-02-17T11:51:59.555 INFO:tasks.rados.rados.0.trial142.stdout:935: finishing write tid 1 to trial14245205-31 2026-02-17T11:51:59.555 INFO:tasks.rados.rados.0.trial142.stdout:936: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2026-02-17T11:51:59.558 INFO:tasks.rados.rados.0.trial142.stdout:936: writing trial14245205-3 from 430345 to 1158292 tid 1 2026-02-17T11:51:59.562 INFO:tasks.rados.rados.0.trial142.stdout:936: writing trial14245205-3 from 1570056 to 2297495 tid 2 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:936: writing trial14245205-3 from 2699879 to 3169768 tid 3 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:934: done (2 left) 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:937: delete oid 19 current snap is 109 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: finishing write tid 2 to trial14245205-31 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: finishing write tid 3 to trial14245205-31 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: finishing write tid 4 to trial14245205-31 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: finishing write tid 5 to trial14245205-31 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: oid 31 updating version 0 to 586 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: oid 31 version 586 is already newer than 585 2026-02-17T11:51:59.566 INFO:tasks.rados.rados.0.trial142.stdout:935: oid 31 version 586 is already newer than 584 2026-02-17T11:51:59.567 INFO:tasks.rados.rados.0.trial142.stdout:935: oid 31 version 586 is already newer than 583 2026-02-17T11:51:59.567 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 586 (ObjNum 334 snap 109 seq_num 334) dirty exists 2026-02-17T11:51:59.567 INFO:tasks.rados.rados.0.trial142.stdout:935: left oid 31 (ObjNum 334 snap 109 seq_num 334) 2026-02-17T11:51:59.567 INFO:tasks.rados.rados.0.trial142.stdout:936: finishing write tid 1 to trial14245205-3 2026-02-17T11:51:59.567 INFO:tasks.rados.rados.0.trial142.stdout:936: finishing write tid 2 to trial14245205-3 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: finishing write tid 3 to trial14245205-3 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: finishing write tid 4 to trial14245205-3 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: finishing write tid 5 to trial14245205-3 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: oid 3 updating version 0 to 334 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: oid 3 version 334 is already newer than 332 2026-02-17T11:51:59.568 INFO:tasks.rados.rados.0.trial142.stdout:936: oid 3 version 334 is already newer than 331 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:936: oid 3 version 334 is already newer than 333 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 334 (ObjNum 335 snap 109 seq_num 335) dirty exists 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:936: left oid 3 (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:935: done (2 left) 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:936: done (1 left) 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:937: done (0 left) 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:938: read oid 21 snap -1 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:938: expect (ObjNum 326 snap 105 seq_num 326) 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:939: rollback oid 49 current snap is 109 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 81 2026-02-17T11:51:59.569 INFO:tasks.rados.rados.0.trial142.stdout:940: delete oid 40 current snap is 109 2026-02-17T11:51:59.570 INFO:tasks.rados.rados.0.trial142.stdout:940: done (2 left) 2026-02-17T11:51:59.570 INFO:tasks.rados.rados.0.trial142.stdout:941: copy_from oid 13 from oid 39 current snap is 109 2026-02-17T11:51:59.570 INFO:tasks.rados.rados.0.trial142.stdout:942: rollback oid 37 current snap is 109 2026-02-17T11:51:59.570 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 75 2026-02-17T11:51:59.571 INFO:tasks.rados.rados.0.trial142.stdout:943: snap_remove snap 105 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:943: done (4 left) 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:944: read oid 36 snap -1 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:944: expect (ObjNum 331 snap 105 seq_num 331) 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:945: read oid 3 snap -1 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:945: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:946: copy_from oid 17 from oid 15 current snap is 109 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:942: finishing rollback tid 1 to trial14245205-37 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:942: finishing rollback tid 2 to trial14245205-37 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 336 (ObjNum 227 snap 74 seq_num 227) dirty exists 2026-02-17T11:52:00.541 INFO:tasks.rados.rados.0.trial142.stdout:938: expect (ObjNum 326 snap 105 seq_num 326) 2026-02-17T11:52:00.623 INFO:tasks.rados.rados.0.trial142.stdout:939: finishing rollback tid 0 to trial14245205-49 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:939: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 763 (ObjNum 113 snap 0 seq_num 1213082272) dirty dne 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:941: finishing copy_from racing read to trial14245205-13 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:941: finishing copy_from to trial14245205-13 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:946: finishing copy_from to trial14245205-17 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:946: got expected ENOENT (src dne) 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:946: finishing copy_from racing read to trial14245205-17 2026-02-17T11:52:00.624 INFO:tasks.rados.rados.0.trial142.stdout:945: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:52:00.707 INFO:tasks.rados.rados.0.trial142.stdout:944: expect (ObjNum 331 snap 105 seq_num 331) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:938: done (6 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:939: done (5 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:941: done (4 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:942: done (3 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:944: done (2 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:945: done (1 left) 2026-02-17T11:52:00.832 INFO:tasks.rados.rados.0.trial142.stdout:946: done (0 left) 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:947: copy_from oid 39 from oid 36 current snap is 109 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:948: rollback oid 40 current snap is 109 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 93 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:949: read oid 49 snap 101 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:949: expect deleted 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:950: write oid 12 current snap is 109 2026-02-17T11:52:00.833 INFO:tasks.rados.rados.0.trial142.stdout:950: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-17T11:52:00.835 INFO:tasks.rados.rados.0.trial142.stdout:950: writing trial14245205-12 from 480766 to 1034460 tid 1 2026-02-17T11:52:00.839 INFO:tasks.rados.rados.0.trial142.stdout:950: writing trial14245205-12 from 1629149 to 2220268 tid 2 2026-02-17T11:52:00.843 INFO:tasks.rados.rados.0.trial142.stdout:950: writing trial14245205-12 from 2782148 to 3202206 tid 3 2026-02-17T11:52:00.843 INFO:tasks.rados.rados.0.trial142.stdout:951: snap_create 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:948: finishing rollback tid 1 to trial14245205-40 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 614 (ObjNum 177 snap 0 seq_num 1214084832) dirty dne 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:950: finishing write tid 1 to trial14245205-12 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:947: finishing copy_from racing read to trial14245205-39 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:950: finishing write tid 2 to trial14245205-12 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:947: finishing copy_from to trial14245205-39 2026-02-17T11:52:00.844 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 685 (ObjNum 331 snap 105 seq_num 331) dirty exists 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: finishing write tid 3 to trial14245205-12 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: finishing write tid 4 to trial14245205-12 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: finishing write tid 5 to trial14245205-12 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: oid 12 updating version 0 to 769 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: oid 12 version 769 is already newer than 767 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: oid 12 version 769 is already newer than 768 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:950: oid 12 updating version 769 to 770 2026-02-17T11:52:00.845 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 770 (ObjNum 338 snap 109 seq_num 338) dirty exists 2026-02-17T11:52:00.846 INFO:tasks.rados.rados.0.trial142.stdout:950: left oid 12 (ObjNum 338 snap 109 seq_num 338) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:947: done (4 left) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:948: done (3 left) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:949: done (2 left) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:950: done (1 left) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:951: done (0 left) 2026-02-17T11:52:01.663 INFO:tasks.rados.rados.0.trial142.stdout:952: rollback oid 18 current snap is 110 2026-02-17T11:52:01.664 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 109 2026-02-17T11:52:01.664 INFO:tasks.rados.rados.0.trial142.stdout:953: read oid 19 snap -1 2026-02-17T11:52:01.664 INFO:tasks.rados.rados.0.trial142.stdout:953: expect deleted 2026-02-17T11:52:01.664 INFO:tasks.rados.rados.0.trial142.stdout:954: snap_remove snap 108 2026-02-17T11:52:02.665 INFO:tasks.rados.rados.0.trial142.stdout:954: done (2 left) 2026-02-17T11:52:02.665 INFO:tasks.rados.rados.0.trial142.stdout:955: rollback oid 25 current snap is 110 2026-02-17T11:52:02.665 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 25 to 75 2026-02-17T11:52:02.665 INFO:tasks.rados.rados.0.trial142.stdout:952: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:52:02.665 INFO:tasks.rados.rados.0.trial142.stdout:952: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:952: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 774 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:952: done (2 left) 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:953: done (1 left) 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:956: write oid 44 current snap is 110 2026-02-17T11:52:02.666 INFO:tasks.rados.rados.0.trial142.stdout:956: seq_num 339 ranges {497573=628943,1687631=734777,3093218=604355} 2026-02-17T11:52:02.670 INFO:tasks.rados.rados.0.trial142.stdout:956: writing trial14245205-44 from 497573 to 1126516 tid 1 2026-02-17T11:52:02.675 INFO:tasks.rados.rados.0.trial142.stdout:956: writing trial14245205-44 from 1687631 to 2422408 tid 2 2026-02-17T11:52:02.680 INFO:tasks.rados.rados.0.trial142.stdout:956: writing trial14245205-44 from 3093218 to 3697573 tid 3 2026-02-17T11:52:02.680 INFO:tasks.rados.rados.0.trial142.stdout:957: write (excl) oid 13 current snap is 110 2026-02-17T11:52:02.681 INFO:tasks.rados.rados.0.trial142.stdout:957: seq_num 340 ranges {514380=704192,1629760=478435,2604288=442602} 2026-02-17T11:52:02.685 INFO:tasks.rados.rados.0.trial142.stdout:957: writing trial14245205-13 from 514380 to 1218572 tid 1 2026-02-17T11:52:02.689 INFO:tasks.rados.rados.0.trial142.stdout:957: writing trial14245205-13 from 1629760 to 2108195 tid 2 2026-02-17T11:52:02.693 INFO:tasks.rados.rados.0.trial142.stdout:957: writing trial14245205-13 from 2604288 to 3046890 tid 3 2026-02-17T11:52:02.693 INFO:tasks.rados.rados.0.trial142.stdout:958: write (excl) oid 5 current snap is 110 2026-02-17T11:52:02.693 INFO:tasks.rados.rados.0.trial142.stdout:955: finishing rollback tid 0 to trial14245205-25 2026-02-17T11:52:02.693 INFO:tasks.rados.rados.0.trial142.stdout:955: finishing rollback tid 1 to trial14245205-25 2026-02-17T11:52:02.693 INFO:tasks.rados.rados.0.trial142.stdout:958: seq_num 341 ranges {531187=779441,2088242=738446,3431711=299476} 2026-02-17T11:52:02.698 INFO:tasks.rados.rados.0.trial142.stdout:958: writing trial14245205-5 from 531187 to 1310628 tid 1 2026-02-17T11:52:02.704 INFO:tasks.rados.rados.0.trial142.stdout:958: writing trial14245205-5 from 2088242 to 2826688 tid 2 2026-02-17T11:52:02.708 INFO:tasks.rados.rados.0.trial142.stdout:958: writing trial14245205-5 from 3431711 to 3731187 tid 3 2026-02-17T11:52:02.708 INFO:tasks.rados.rados.0.trial142.stdout:959: delete oid 22 current snap is 110 2026-02-17T11:52:02.708 INFO:tasks.rados.rados.0.trial142.stdout:955: finishing rollback tid 2 to trial14245205-25 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 454 (ObjNum 207 snap 66 seq_num 207) dirty exists 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: finishing write tid 1 to trial14245205-44 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: finishing write tid 2 to trial14245205-44 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: finishing write tid 3 to trial14245205-44 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: finishing write tid 4 to trial14245205-44 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: finishing write tid 5 to trial14245205-44 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: oid 44 updating version 0 to 258 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: oid 44 version 258 is already newer than 257 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: oid 44 updating version 258 to 259 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: oid 44 version 259 is already newer than 256 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 259 (ObjNum 339 snap 110 seq_num 339) dirty exists 2026-02-17T11:52:02.709 INFO:tasks.rados.rados.0.trial142.stdout:956: left oid 44 (ObjNum 339 snap 110 seq_num 339) 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: finishing write tid 1 to trial14245205-13 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: finishing write tid 2 to trial14245205-13 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: finishing write tid 3 to trial14245205-13 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: finishing write tid 4 to trial14245205-13 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: finishing write tid 5 to trial14245205-13 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: oid 13 updating version 0 to 598 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: oid 13 updating version 598 to 600 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: oid 13 version 600 is already newer than 599 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: oid 13 updating version 600 to 601 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 601 (ObjNum 340 snap 110 seq_num 340) dirty exists 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:957: left oid 13 (ObjNum 340 snap 110 seq_num 340) 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:958: finishing write tid 1 to trial14245205-5 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:958: finishing write tid 2 to trial14245205-5 2026-02-17T11:52:02.710 INFO:tasks.rados.rados.0.trial142.stdout:955: done (4 left) 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:956: done (3 left) 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:957: done (2 left) 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:959: done (1 left) 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:960: read oid 28 snap -1 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:960: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:02.711 INFO:tasks.rados.rados.0.trial142.stdout:961: delete oid 19 current snap is 110 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:958: finishing write tid 3 to trial14245205-5 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:961: done (2 left) 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:962: read oid 27 snap -1 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:962: expect (ObjNum 321 snap 105 seq_num 321) 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:963: write (excl) oid 10 current snap is 110 2026-02-17T11:52:02.712 INFO:tasks.rados.rados.0.trial142.stdout:963: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2026-02-17T11:52:02.714 INFO:tasks.rados.rados.0.trial142.stdout:963: writing trial14245205-10 from 581608 to 1303149 tid 1 2026-02-17T11:52:02.718 INFO:tasks.rados.rados.0.trial142.stdout:963: writing trial14245205-10 from 1863688 to 2349461 tid 2 2026-02-17T11:52:02.723 INFO:tasks.rados.rados.0.trial142.stdout:963: writing trial14245205-10 from 3113980 to 3718023 tid 3 2026-02-17T11:52:02.723 INFO:tasks.rados.rados.0.trial142.stdout:964: snap_create 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: finishing write tid 4 to trial14245205-5 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: finishing write tid 5 to trial14245205-5 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: oid 5 updating version 0 to 586 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: oid 5 updating version 586 to 589 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: oid 5 version 589 is already newer than 587 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: oid 5 version 589 is already newer than 588 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 589 (ObjNum 341 snap 110 seq_num 341) dirty exists 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:958: left oid 5 (ObjNum 341 snap 110 seq_num 341) 2026-02-17T11:52:02.724 INFO:tasks.rados.rados.0.trial142.stdout:960: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:02.794 INFO:tasks.rados.rados.0.trial142.stdout:962: expect (ObjNum 321 snap 105 seq_num 321) 2026-02-17T11:52:02.871 INFO:tasks.rados.rados.0.trial142.stdout:963: finishing write tid 1 to trial14245205-10 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: finishing write tid 2 to trial14245205-10 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: finishing write tid 3 to trial14245205-10 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: finishing write tid 4 to trial14245205-10 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: finishing write tid 5 to trial14245205-10 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: oid 10 updating version 0 to 464 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: oid 10 version 464 is already newer than 462 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: oid 10 version 464 is already newer than 463 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: oid 10 updating version 464 to 465 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 465 (ObjNum 344 snap 110 seq_num 344) dirty exists 2026-02-17T11:52:02.872 INFO:tasks.rados.rados.0.trial142.stdout:963: left oid 10 (ObjNum 344 snap 110 seq_num 344) 2026-02-17T11:52:03.667 INFO:tasks.rados.rados.0.trial142.stdout:958: done (4 left) 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:960: done (3 left) 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:962: done (2 left) 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:963: done (1 left) 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:964: done (0 left) 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:965: write (excl) oid 20 current snap is 111 2026-02-17T11:52:03.668 INFO:tasks.rados.rados.0.trial142.stdout:965: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2026-02-17T11:52:03.672 INFO:tasks.rados.rados.0.trial142.stdout:965: writing trial14245205-20 from 598415 to 1395205 tid 1 2026-02-17T11:52:03.677 INFO:tasks.rados.rados.0.trial142.stdout:965: writing trial14245205-20 from 1922170 to 2667954 tid 2 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:965: writing trial14245205-20 from 3141403 to 3556718 tid 3 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:966: rollback oid 37 current snap is 111 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 101 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:965: finishing write tid 1 to trial14245205-20 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:965: finishing write tid 2 to trial14245205-20 2026-02-17T11:52:03.681 INFO:tasks.rados.rados.0.trial142.stdout:967: snap_remove snap 99 2026-02-17T11:52:04.779 INFO:tasks.rados.rados.0.trial142.stdout:967: done (2 left) 2026-02-17T11:52:04.780 INFO:tasks.rados.rados.0.trial142.stdout:968: snap_remove snap 102 2026-02-17T11:52:05.780 INFO:tasks.rados.rados.0.trial142.stdout:968: done (2 left) 2026-02-17T11:52:05.780 INFO:tasks.rados.rados.0.trial142.stdout:969: write (excl) oid 35 current snap is 111 2026-02-17T11:52:05.781 INFO:tasks.rados.rados.0.trial142.stdout:969: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-17T11:52:05.784 INFO:tasks.rados.rados.0.trial142.stdout:969: writing trial14245205-35 from 615222 to 1087261 tid 1 2026-02-17T11:52:05.787 INFO:tasks.rados.rados.0.trial142.stdout:969: writing trial14245205-35 from 1580652 to 2070094 tid 2 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:969: writing trial14245205-35 from 2768826 to 3395413 tid 3 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:970: snap_create 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:965: finishing write tid 3 to trial14245205-20 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:965: finishing write tid 4 to trial14245205-20 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:965: finishing write tid 5 to trial14245205-20 2026-02-17T11:52:05.793 INFO:tasks.rados.rados.0.trial142.stdout:965: oid 20 updating version 0 to 689 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:965: oid 20 version 689 is already newer than 687 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:965: oid 20 version 689 is already newer than 688 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:965: oid 20 version 689 is already newer than 686 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 689 (ObjNum 345 snap 111 seq_num 345) dirty exists 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:965: left oid 20 (ObjNum 345 snap 111 seq_num 345) 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:966: finishing rollback tid 0 to trial14245205-37 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:966: finishing rollback tid 1 to trial14245205-37 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:966: finishing rollback tid 2 to trial14245205-37 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 342 (ObjNum 255 snap 80 seq_num 255) dirty exists 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:969: finishing write tid 1 to trial14245205-35 2026-02-17T11:52:05.794 INFO:tasks.rados.rados.0.trial142.stdout:969: finishing write tid 2 to trial14245205-35 2026-02-17T11:52:05.795 INFO:tasks.rados.rados.0.trial142.stdout:969: finishing write tid 3 to trial14245205-35 2026-02-17T11:52:05.795 INFO:tasks.rados.rados.0.trial142.stdout:969: finishing write tid 4 to trial14245205-35 2026-02-17T11:52:05.795 INFO:tasks.rados.rados.0.trial142.stdout:969: finishing write tid 5 to trial14245205-35 2026-02-17T11:52:05.795 INFO:tasks.rados.rados.0.trial142.stdout:969: oid 35 updating version 0 to 620 2026-02-17T11:52:05.795 INFO:tasks.rados.rados.0.trial142.stdout:969: oid 35 version 620 is already newer than 619 2026-02-17T11:52:05.796 INFO:tasks.rados.rados.0.trial142.stdout:969: oid 35 version 620 is already newer than 618 2026-02-17T11:52:05.796 INFO:tasks.rados.rados.0.trial142.stdout:969: oid 35 version 620 is already newer than 615 2026-02-17T11:52:05.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 620 (ObjNum 346 snap 111 seq_num 346) dirty exists 2026-02-17T11:52:05.796 INFO:tasks.rados.rados.0.trial142.stdout:969: left oid 35 (ObjNum 346 snap 111 seq_num 346) 2026-02-17T11:52:06.782 INFO:tasks.rados.rados.0.trial142.stdout:965: done (3 left) 2026-02-17T11:52:06.783 INFO:tasks.rados.rados.0.trial142.stdout:966: done (2 left) 2026-02-17T11:52:06.783 INFO:tasks.rados.rados.0.trial142.stdout:969: done (1 left) 2026-02-17T11:52:06.783 INFO:tasks.rados.rados.0.trial142.stdout:970: done (0 left) 2026-02-17T11:52:06.783 INFO:tasks.rados.rados.0.trial142.stdout:971: copy_from oid 26 from oid 48 current snap is 112 2026-02-17T11:52:06.783 INFO:tasks.rados.rados.0.trial142.stdout:972: delete oid 4 current snap is 112 2026-02-17T11:52:06.784 INFO:tasks.rados.rados.0.trial142.stdout:972: done (1 left) 2026-02-17T11:52:06.784 INFO:tasks.rados.rados.0.trial142.stdout:973: write (excl) oid 49 current snap is 112 2026-02-17T11:52:06.785 INFO:tasks.rados.rados.0.trial142.stdout:973: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2026-02-17T11:52:06.789 INFO:tasks.rados.rados.0.trial142.stdout:973: writing trial14245205-49 from 648836 to 1271373 tid 1 2026-02-17T11:52:06.794 INFO:tasks.rados.rados.0.trial142.stdout:973: writing trial14245205-49 from 1981263 to 2474374 tid 2 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:973: writing trial14245205-49 from 3107319 to 3848836 tid 3 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:973: finishing write tid 1 to trial14245205-49 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:971: finishing copy_from racing read to trial14245205-26 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:971: finishing copy_from to trial14245205-26 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 434 (ObjNum 258 snap 80 seq_num 258) dirty exists 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:974: read oid 38 snap -1 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:974: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:971: done (2 left) 2026-02-17T11:52:06.800 INFO:tasks.rados.rados.0.trial142.stdout:975: delete oid 39 current snap is 112 2026-02-17T11:52:06.801 INFO:tasks.rados.rados.0.trial142.stdout:974: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:52:06.911 INFO:tasks.rados.rados.0.trial142.stdout:973: finishing write tid 2 to trial14245205-49 2026-02-17T11:52:06.911 INFO:tasks.rados.rados.0.trial142.stdout:973: finishing write tid 3 to trial14245205-49 2026-02-17T11:52:06.911 INFO:tasks.rados.rados.0.trial142.stdout:974: done (2 left) 2026-02-17T11:52:06.911 INFO:tasks.rados.rados.0.trial142.stdout:975: done (1 left) 2026-02-17T11:52:06.911 INFO:tasks.rados.rados.0.trial142.stdout:976: snap_remove snap 111 2026-02-17T11:52:07.785 INFO:tasks.rados.rados.0.trial142.stdout:976: done (1 left) 2026-02-17T11:52:07.785 INFO:tasks.rados.rados.0.trial142.stdout:977: snap_remove snap 101 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:977: done (1 left) 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:978: snap_create 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: finishing write tid 4 to trial14245205-49 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: finishing write tid 5 to trial14245205-49 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: oid 49 updating version 0 to 797 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: oid 49 updating version 797 to 798 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: oid 49 updating version 798 to 799 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: oid 49 updating version 799 to 800 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 800 (ObjNum 348 snap 112 seq_num 348) dirty exists 2026-02-17T11:52:08.540 INFO:tasks.rados.rados.0.trial142.stdout:973: left oid 49 (ObjNum 348 snap 112 seq_num 348) 2026-02-17T11:52:09.540 INFO:tasks.rados.rados.0.trial142.stdout:973: done (1 left) 2026-02-17T11:52:09.541 INFO:tasks.rados.rados.0.trial142.stdout:978: done (0 left) 2026-02-17T11:52:09.541 INFO:tasks.rados.rados.0.trial142.stdout:979: rollback oid 6 current snap is 113 2026-02-17T11:52:09.541 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 81 2026-02-17T11:52:09.541 INFO:tasks.rados.rados.0.trial142.stdout:980: snap_remove snap 109 2026-02-17T11:52:10.542 INFO:tasks.rados.rados.0.trial142.stdout:980: done (1 left) 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:981: copy_from oid 21 from oid 3 current snap is 113 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:979: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:979: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:979: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 617 (ObjNum 212 snap 68 seq_num 212) dirty exists 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:979: done (1 left) 2026-02-17T11:52:10.543 INFO:tasks.rados.rados.0.trial142.stdout:982: delete oid 1 current snap is 113 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:982: done (1 left) 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:983: rollback oid 35 current snap is 113 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 106 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:984: read oid 47 snap -1 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:984: expect deleted 2026-02-17T11:52:10.545 INFO:tasks.rados.rados.0.trial142.stdout:985: snap_remove snap 110 2026-02-17T11:52:11.544 INFO:tasks.rados.rados.0.trial142.stdout:985: done (3 left) 2026-02-17T11:52:11.544 INFO:tasks.rados.rados.0.trial142.stdout:986: read oid 4 snap -1 2026-02-17T11:52:11.545 INFO:tasks.rados.rados.0.trial142.stdout:986: expect deleted 2026-02-17T11:52:11.545 INFO:tasks.rados.rados.0.trial142.stdout:987: read oid 43 snap -1 2026-02-17T11:52:11.545 INFO:tasks.rados.rados.0.trial142.stdout:987: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:52:11.545 INFO:tasks.rados.rados.0.trial142.stdout:988: write oid 50 current snap is 113 2026-02-17T11:52:11.545 INFO:tasks.rados.rados.0.trial142.stdout:988: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2026-02-17T11:52:11.549 INFO:tasks.rados.rados.0.trial142.stdout:988: writing trial14245205-50 from 699257 to 1263894 tid 1 2026-02-17T11:52:11.554 INFO:tasks.rados.rados.0.trial142.stdout:988: writing trial14245205-50 from 1873062 to 2513500 tid 2 2026-02-17T11:52:11.559 INFO:tasks.rados.rados.0.trial142.stdout:988: writing trial14245205-50 from 3305941 to 3899257 tid 3 2026-02-17T11:52:11.559 INFO:tasks.rados.rados.0.trial142.stdout:989: write oid 5 current snap is 113 2026-02-17T11:52:11.559 INFO:tasks.rados.rados.0.trial142.stdout:989: seq_num 352 ranges {716064=639886,1815191=500449,2817011=526925} 2026-02-17T11:52:11.565 INFO:tasks.rados.rados.0.trial142.stdout:989: writing trial14245205-5 from 716064 to 1355950 tid 1 2026-02-17T11:52:11.568 INFO:tasks.rados.rados.0.trial142.stdout:989: writing trial14245205-5 from 1815191 to 2315640 tid 2 2026-02-17T11:52:11.572 INFO:tasks.rados.rados.0.trial142.stdout:989: writing trial14245205-5 from 2817011 to 3343936 tid 3 2026-02-17T11:52:11.572 INFO:tasks.rados.rados.0.trial142.stdout:990: snap_create 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:983: finishing rollback tid 0 to trial14245205-35 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:981: finishing copy_from racing read to trial14245205-21 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:983: finishing rollback tid 1 to trial14245205-35 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:983: finishing rollback tid 2 to trial14245205-35 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 632 (ObjNum 214 snap 69 seq_num 214) dirty exists 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:981: finishing copy_from to trial14245205-21 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 334 (ObjNum 335 snap 109 seq_num 335) dirty exists 2026-02-17T11:52:11.573 INFO:tasks.rados.rados.0.trial142.stdout:987: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: finishing write tid 1 to trial14245205-50 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: finishing write tid 2 to trial14245205-50 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: finishing write tid 3 to trial14245205-50 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: finishing write tid 4 to trial14245205-50 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: finishing write tid 5 to trial14245205-50 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: oid 50 updating version 0 to 455 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: oid 50 updating version 455 to 457 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: oid 50 updating version 457 to 458 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: oid 50 version 458 is already newer than 456 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 458 (ObjNum 351 snap 113 seq_num 351) dirty exists 2026-02-17T11:52:11.632 INFO:tasks.rados.rados.0.trial142.stdout:988: left oid 50 (ObjNum 351 snap 113 seq_num 351) 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: finishing write tid 1 to trial14245205-5 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: finishing write tid 2 to trial14245205-5 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: finishing write tid 3 to trial14245205-5 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: finishing write tid 4 to trial14245205-5 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: finishing write tid 5 to trial14245205-5 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: oid 5 updating version 0 to 590 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: oid 5 updating version 590 to 593 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: oid 5 version 593 is already newer than 592 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: oid 5 version 593 is already newer than 591 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 593 (ObjNum 352 snap 113 seq_num 352) dirty exists 2026-02-17T11:52:11.633 INFO:tasks.rados.rados.0.trial142.stdout:989: left oid 5 (ObjNum 352 snap 113 seq_num 352) 2026-02-17T11:52:12.548 INFO:tasks.rados.rados.0.trial142.stdout:981: done (7 left) 2026-02-17T11:52:12.548 INFO:tasks.rados.rados.0.trial142.stdout:983: done (6 left) 2026-02-17T11:52:12.548 INFO:tasks.rados.rados.0.trial142.stdout:984: done (5 left) 2026-02-17T11:52:12.548 INFO:tasks.rados.rados.0.trial142.stdout:986: done (4 left) 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:987: done (3 left) 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:988: done (2 left) 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:989: done (1 left) 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:990: done (0 left) 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:991: write (excl) oid 19 current snap is 114 2026-02-17T11:52:12.549 INFO:tasks.rados.rados.0.trial142.stdout:991: seq_num 353 ranges {732871=715135,1873673=644107,3244434=688437} 2026-02-17T11:52:12.554 INFO:tasks.rados.rados.0.trial142.stdout:991: writing trial14245205-19 from 732871 to 1448006 tid 1 2026-02-17T11:52:12.558 INFO:tasks.rados.rados.0.trial142.stdout:991: writing trial14245205-19 from 1873673 to 2517780 tid 2 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:991: writing trial14245205-19 from 3244434 to 3932871 tid 3 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:992: read oid 28 snap 94 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:992: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:993: copy_from oid 15 from oid 14 current snap is 114 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:991: finishing write tid 1 to trial14245205-19 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:991: finishing write tid 2 to trial14245205-19 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:994: write oid 49 current snap is 114 2026-02-17T11:52:12.564 INFO:tasks.rados.rados.0.trial142.stdout:994: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-17T11:52:12.569 INFO:tasks.rados.rados.0.trial142.stdout:994: writing trial14245205-49 from 749678 to 1540062 tid 1 2026-02-17T11:52:12.574 INFO:tasks.rados.rados.0.trial142.stdout:994: writing trial14245205-49 from 2332155 to 2836273 tid 2 2026-02-17T11:52:12.578 INFO:tasks.rados.rados.0.trial142.stdout:994: writing trial14245205-49 from 3271857 to 3821326 tid 3 2026-02-17T11:52:12.578 INFO:tasks.rados.rados.0.trial142.stdout:995: read oid 36 snap -1 2026-02-17T11:52:12.578 INFO:tasks.rados.rados.0.trial142.stdout:995: expect (ObjNum 331 snap 105 seq_num 331) 2026-02-17T11:52:12.578 INFO:tasks.rados.rados.0.trial142.stdout:996: copy_from oid 1 from oid 11 current snap is 114 2026-02-17T11:52:12.578 INFO:tasks.rados.rados.0.trial142.stdout:991: finishing write tid 3 to trial14245205-19 2026-02-17T11:52:12.579 INFO:tasks.rados.rados.0.trial142.stdout:997: snap_remove snap 93 2026-02-17T11:52:13.541 INFO:tasks.rados.rados.0.trial142.stdout:997: done (6 left) 2026-02-17T11:52:13.541 INFO:tasks.rados.rados.0.trial142.stdout:998: snap_remove snap 106 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:998: done (6 left) 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:999: delete oid 26 current snap is 114 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: finishing write tid 4 to trial14245205-19 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: finishing write tid 5 to trial14245205-19 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: oid 19 updating version 0 to 483 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: oid 19 version 483 is already newer than 481 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: oid 19 version 483 is already newer than 482 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:991: oid 19 version 483 is already newer than 480 2026-02-17T11:52:14.541 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 483 (ObjNum 353 snap 114 seq_num 353) dirty exists 2026-02-17T11:52:14.542 INFO:tasks.rados.rados.0.trial142.stdout:991: left oid 19 (ObjNum 353 snap 114 seq_num 353) 2026-02-17T11:52:14.542 INFO:tasks.rados.rados.0.trial142.stdout:993: finishing copy_from to trial14245205-15 2026-02-17T11:52:14.542 INFO:tasks.rados.rados.0.trial142.stdout:993: got expected ENOENT (src dne) 2026-02-17T11:52:14.542 INFO:tasks.rados.rados.0.trial142.stdout:993: finishing copy_from racing read to trial14245205-15 2026-02-17T11:52:14.542 INFO:tasks.rados.rados.0.trial142.stdout:992: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:14.613 INFO:tasks.rados.rados.0.trial142.stdout:994: finishing write tid 1 to trial14245205-49 2026-02-17T11:52:14.613 INFO:tasks.rados.rados.0.trial142.stdout:994: finishing write tid 2 to trial14245205-49 2026-02-17T11:52:14.613 INFO:tasks.rados.rados.0.trial142.stdout:994: finishing write tid 3 to trial14245205-49 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: finishing write tid 4 to trial14245205-49 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: finishing write tid 5 to trial14245205-49 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: oid 49 updating version 0 to 820 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: oid 49 version 820 is already newer than 818 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: oid 49 updating version 820 to 821 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: oid 49 version 821 is already newer than 819 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 821 (ObjNum 354 snap 114 seq_num 354) dirty exists 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:994: left oid 49 (ObjNum 354 snap 114 seq_num 354) 2026-02-17T11:52:14.614 INFO:tasks.rados.rados.0.trial142.stdout:995: expect (ObjNum 331 snap 105 seq_num 331) 2026-02-17T11:52:14.737 INFO:tasks.rados.rados.0.trial142.stdout:996: finishing copy_from racing read to trial14245205-1 2026-02-17T11:52:14.737 INFO:tasks.rados.rados.0.trial142.stdout:996: finishing copy_from to trial14245205-1 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:991: done (6 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:992: done (5 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:993: done (4 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:994: done (3 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:995: done (2 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:996: done (1 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:999: done (0 left) 2026-02-17T11:52:14.738 INFO:tasks.rados.rados.0.trial142.stdout:1000: snap_remove snap 94 2026-02-17T11:52:14.975 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:52:14.975 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:52:14.975 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:52:14.976 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:52:14.979 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:52:14.979 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T11:52:14.980 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T11:52:14.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:52:29.981 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T11:52:29.981 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T11:52:29.981 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:52:29.982 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:30.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: get_monmap_and_config 2026-02-17T11:52:30.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: build_initial_monmap 2026-02-17T11:52:30.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: monmap: 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:30.051086+0000 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:30.051086+0000 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:30.055 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 Processor -- start 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 -- start start 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: init 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): picked mon.noname-a con 0x7f47540a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f47540a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:30.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 0x7f475413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): picked mon.noname-b con 0x7f475413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475406e140 con 0x7f47540a0750 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f475409f910 con 0x7f47540a3bb0 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f475409ccd0 con 0x7f475413b760 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f475b355640 10 monclient(hunting): authenticate will time out at 1037.669837s 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 0x7f475413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43208/0 (socket says 10.20.193.51:43208) 2026-02-17T11:52:30.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 1 -- 10.20.193.51:0/3966175060 learned_addr learned my addr 10.20.193.51:0/3966175060 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 10 monclient(hunting): get_auth_request con 0x7f47540a3bb0 auth_method 0 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): get_auth_request con 0x7f475413b760 auth_method 0 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47598cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.050+0000 7f47590ca640 1 -- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 msgr2=0x7f475409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:52:30.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47590ca640 1 -- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 msgr2=0x7f475409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47590ca640 1 --2- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47590ca640 1 --2- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 10 monclient(hunting): handle_auth_done global_id 104099 payload 274 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 1 -- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 msgr2=0x7f475409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 1 --2- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 1 -- 10.20.193.51:0/3966175060 >> v1:10.20.193.142:6789/0 conn(0x7f47540a0750 legacy=0x7f475409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 10 monclient: _finish_hunting 0 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 1 monclient: found mon.noname-b 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.051+0000 7f47598cb640 1 -- 10.20.193.51:0/3966175060 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475409eec0 con 0x7f475413b760 2026-02-17T11:52:30.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f47598cb640 1 -- 10.20.193.51:0/3966175060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 msgr2=0x7f475413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:30.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f47598cb640 1 --2- 10.20.193.51:0/3966175060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 0x7f475413db50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f475406c1c0 tx=0x7f475002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1555c1970d1758e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 1 -- 10.20.193.51:0/3966175060 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475003c070 con 0x7f475413b760 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: dump: 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:30.070 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: _finish_auth 0 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: _check_auth_tickets 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 1 -- 10.20.193.51:0/3966175060 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4750037440 con 0x7f475413b760 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f475b355640 5 monclient: authenticate success, global_id 104099 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f475b355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:30.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 1 -- 10.20.193.51:0/3966175060 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750037810 con 0x7f475413b760 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f475b355640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f475b355640 4 set_mon_vals no callback set 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.053+0000 7f4743fff640 10 monclient: dump: 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.072 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: shutdown 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- 10.20.193.51:0/3966175060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 msgr2=0x7f475413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 --2- 10.20.193.51:0/3966175060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 0x7f475413db50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f475406c1c0 tx=0x7f475002f130 comp rx=0 tx=0).stop 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- 10.20.193.51:0/3966175060 shutdown_connections 2026-02-17T11:52:30.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 --2- 10.20.193.51:0/3966175060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f475413b760 0x7f475413db50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 --2- 10.20.193.51:0/3966175060 >> v2:10.20.193.51:3300/0 conn(0x7f47540a3bb0 0x7f475409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- 10.20.193.51:0/3966175060 >> 10.20.193.51:0/3966175060 conn(0x7f47540a30c0 msgr2=0x7f47540a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- 10.20.193.51:0/3966175060 shutdown_connections 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- 10.20.193.51:0/3966175060 wait complete. 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: build_initial_monmap 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: monmap: 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:30.074 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 Processor -- start 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 1 -- start start 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: init 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.054+0000 7f475b355640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:30.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): picked mon.noname-c con 0x7f47540a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f47541d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): picked mon.noname-b con 0x7f47540a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4754096280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): picked mon.noname-a con 0x7f475413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f47540a04b0 con 0x7f475413b760 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f475409c850 con 0x7f47540a3bb0 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f475409e710 con 0x7f47540a0750 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:30.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f475b355640 10 monclient(hunting): authenticate will time out at 1037.674036s 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38892/0 (socket says 10.20.193.51:38892) 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 learned_addr learned my addr 10.20.193.51:0/1153525188 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): get_auth_request con 0x7f47540a0750 auth_method 0 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4754096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 10 monclient(hunting): get_auth_request con 0x7f475413b760 auth_method 0 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient(hunting): handle_auth_done global_id 104102 payload 824 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 msgr2=0x7f4754096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 msgr2=0x7f4754096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4754096280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 msgr2=0x7f47541d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f47541d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 msgr2=0x7f4754096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47598cb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4754096280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4754096280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient: _finish_hunting 0 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 monclient: found mon.noname-c 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.055+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475409c350 con 0x7f47540a0750 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 msgr2=0x7f47541cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f474400d800 tx=0x7f474400dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744018030 con 0x7f47540a0750 2026-02-17T11:52:30.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: dump: 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:30.080 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: _finish_auth 0 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474400bae0 con 0x7f47540a0750 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474400bcd0 con 0x7f47540a0750 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f47437fe640 4 set_mon_vals no callback set 2026-02-17T11:52:30.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f4741ffb640 10 monclient: dump: 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 5 monclient: authenticate success, global_id 104102 2026-02-17T11:52:30.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _renew_subs 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47540983c0 con 0x7f47540a0750 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _renew_subs 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47540a2370 con 0x7f47540a0750 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.057+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475409dac0 con 0x7f47540a0750 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4744013050 con 0x7f47540a0750 2026-02-17T11:52:30.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 msgr2=0x7f47541cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 msgr2=0x7f47541cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f474400d800 tx=0x7f474400dcd0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f474400d800 tx=0x7f474400dcd0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 0x7f4724040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 msgr2=0x7f47541cfad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f47540a0750 0x7f47541cfad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4724042940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): picked mon.a con 0x7f475413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:30.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f4724045240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): picked mon.b con 0x7f47540a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 0x7f4724048050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): picked mon.c con 0x7f4724045bc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4724048b00 con 0x7f475413b760 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4724048c80 con 0x7f47540a3bb0 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4724048e00 con 0x7f4724045bc0 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f4741ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4724042940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): get_auth_request con 0x7f475413b760 auth_method 0 2026-02-17T11:52:30.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 0x7f4724048050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): get_auth_request con 0x7f4724045bc0 auth_method 0 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47588c9640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:30.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47598cb640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f4724045240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient(hunting): handle_auth_done global_id 104102 payload 293 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 msgr2=0x7f4724045240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f4724045240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 msgr2=0x7f4724042940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4724042940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _finish_hunting 0 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 monclient: found mon.c 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f4724048fb0 con 0x7f4724045bc0 2026-02-17T11:52:30.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475409dac0 con 0x7f4724045bc0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _finish_auth 0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: _check_auth_tickets 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 0x7f4724040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.058+0000 7f47590ca640 10 monclient: get_auth_request con 0x7f472403dd60 auth_method 0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f47590ca640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 msgr2=0x7f4724048050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 0x7f4724048050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4754098c50 tx=0x7f4744008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744049070 con 0x7f4724045bc0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:30.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 10 monclient: dump: 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474401b360 con 0x7f4724045bc0 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4741ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:30.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.060+0000 7f4742ffd640 4 set_mon_vals no callback set 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.061+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f474401ca80 con 0x7f4724045bc0 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.061+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 4 ==== osd_map(254..254 src has 167..254) ==== 4783+0+0 (secure 0 0 0) 0x7f4744059770 con 0x7f4724045bc0 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.061+0000 7f47590ca640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 0x7f4724040220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4744012580 tx=0x7f4744041000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.063+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f474403de20 con 0x7f4724045bc0 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.063+0000 7f4741ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:30.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.063+0000 7f4741ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f475b355640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f475b355640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f475b355640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f475409a170 con 0x7f4724045bc0 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f4741ffb640 1 -- 10.20.193.51:0/1153525188 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f4744022020 con 0x7f4724045bc0 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f4741ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:30.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.176+0000 7f4741ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:30.180 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:30.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 msgr2=0x7f4724040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 0x7f4724040220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4744012580 tx=0x7f4744041000 comp rx=0 tx=0).stop 2026-02-17T11:52:30.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 10 monclient: shutdown 2026-02-17T11:52:30.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 msgr2=0x7f4724048050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 0x7f4724048050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4754098c50 tx=0x7f4744008040 comp rx=0 tx=0).stop 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 shutdown_connections 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4724045bc0 0x7f4724048050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f47540a3bb0 0x7f4724045240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f475413b760 0x7f4724042940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 --2- 10.20.193.51:0/1153525188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f472403dd60 0x7f4724040220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 >> 10.20.193.51:0/1153525188 conn(0x7f47540a30c0 msgr2=0x7f475413ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.177+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 shutdown_connections 2026-02-17T11:52:30.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:30.178+0000 7f475b355640 1 -- 10.20.193.51:0/1153525188 wait complete. 2026-02-17T11:52:33.188 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:33.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: get_monmap_and_config 2026-02-17T11:52:33.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: build_initial_monmap 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: monmap: 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:33.257994+0000 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:33.257994+0000 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:33.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 Processor -- start 2026-02-17T11:52:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 -- start start 2026-02-17T11:52:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: init 2026-02-17T11:52:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc7940a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-c con 0x7fc7940a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-a con 0x7fc79413b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79406e140 con 0x7fc7940a3bb0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc79409f910 con 0x7fc79413b760 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc79409ccd0 con 0x7fc7940a0750 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79a3e6640 10 monclient(hunting): authenticate will time out at 1040.876793s 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43238/0 (socket says 10.20.193.51:43238) 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 learned_addr learned my addr 10.20.193.51:0/1659238182 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 10 monclient(hunting): get_auth_request con 0x7fc79413b760 auth_method 0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.257+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 10 monclient(hunting): get_auth_request con 0x7fc7940a0750 auth_method 0 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.258+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:33.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.260+0000 7fc793fff640 1 -- 10.20.193.51:0/1659238182 >> v1:10.20.193.142:6789/0 conn(0x7fc7940a3bb0 legacy=0x7fc79409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 10 monclient(hunting): get_auth_request con 0x7fc79413b760 auth_method 0 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.458+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:52:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 10 monclient(hunting): get_auth_request con 0x7fc7940a0750 auth_method 0 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.459+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:52:33.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 10 monclient(hunting): get_auth_request con 0x7fc79413b760 auth_method 0 2026-02-17T11:52:33.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.859+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 10 monclient(hunting): get_auth_request con 0x7fc7940a0750 auth_method 0 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:33.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:33.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:33.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:33.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:33.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:33.860+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:52:34.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:34.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 10 monclient(hunting): get_auth_request con 0x7fc79413b760 auth_method 0 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:34.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.660+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 10 monclient(hunting): get_auth_request con 0x7fc7940a0750 auth_method 0 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:34.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.661+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8520040 0 0) 0x7fc79406e140 con 0x7fc7940a3bb0 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): my global_id is 64327 2026-02-17T11:52:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc778003620 con 0x7fc7940a3bb0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2423089751 0 0) 0x7fc778003620 con 0x7fc7940a3bb0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 msgr2=0x7fc79409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.142:3300/0 conn(0x7fc7940a0750 0x7fc79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 msgr2=0x7fc79413db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 --2- 10.20.193.51:0/1659238182 >> v2:10.20.193.51:3300/0 conn(0x7fc79413b760 0x7fc79413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79409eec0 con 0x7fc7940a3bb0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fc780003200 con 0x7fc7940a3bb0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: dump: 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 >> v1:10.20.193.142:6789/0 conn(0x7fc7940a3bb0 legacy=0x7fc79409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:52:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc778004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): picked mon.c con 0x7fc778003c20 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc778004900 0x7fc778004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): picked mon.a con 0x7fc778004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc7780054a0 0x7fc77800bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): picked mon.b con 0x7fc7780054a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc79409f910 con 0x7fc778004900 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc79409ccd0 con 0x7fc7780054a0 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc77800c460 con 0x7fc778003c20 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc792ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc778004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): get_auth_request con 0x7fc778003c20 auth_method 0 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:34.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc7780054a0 0x7fc77800bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc79895c640 10 monclient(hunting): get_auth_request con 0x7fc7780054a0 auth_method 0 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc79895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc79895c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.988+0000 7fc79895c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 10 monclient(hunting): handle_auth_done global_id 64327 payload 293 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 -- 10.20.193.51:0/1659238182 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc7780054a0 msgr2=0x7fc77800bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc7780054a0 0x7fc77800bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 -- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc778004900 msgr2=0x7fc778004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc778004900 0x7fc778004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 monclient: found mon.c 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:34.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 1 -- 10.20.193.51:0/1659238182 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc778003620 con 0x7fc778003c20 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 10 monclient: _finish_auth 0 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 10 monclient: _check_auth_tickets 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc793fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc79a3e6640 5 monclient: authenticate success, global_id 64327 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc79a3e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc79895c640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc7780054a0 0x7fc77800bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:52:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.989+0000 7fc79895c640 1 -- 10.20.193.51:0/1659238182 reap_dead start 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc793fff640 1 -- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 msgr2=0x7fc778004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc793fff640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc778004040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc780003420 tx=0x7fc78002f6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e293a63a0cc17550 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000c140 con 0x7fc778003c20 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: dump: 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:35.001 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc780005ae0 con 0x7fc778003c20 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 1 -- 10.20.193.51:0/1659238182 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780007070 con 0x7fc778003c20 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 4 set_mon_vals no callback set 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc792ffd640 10 monclient: dump: 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:35.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 10 monclient: shutdown 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 msgr2=0x7fc778004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc778004040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc780003420 tx=0x7fc78002f6e0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1659238182 shutdown_connections 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1659238182 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc778004040 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.991+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1659238182 >> 10.20.193.51:0/1659238182 conn(0x7fc7940a30c0 msgr2=0x7fc7940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1659238182 shutdown_connections 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1659238182 wait complete. 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 10 monclient: build_initial_monmap 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 10 monclient: monmap: 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:35.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 1 Processor -- start 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 1 -- start start 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.992+0000 7fc79a3e6640 10 monclient: init 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-c con 0x7fc778003c20 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc794131850 0x7fc794131cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-a con 0x7fc794131850 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 0x7fc7941d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): picked mon.noname-b con 0x7fc794132210 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940a04b0 con 0x7fc794131850 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc79409c850 con 0x7fc794132210 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc79409dac0 con 0x7fc778003c20 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:35.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79a3e6640 10 monclient(hunting): authenticate will time out at 1042.612153s 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc794131850 0x7fc794131cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38936/0 (socket says 10.20.193.51:38936) 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 -- 10.20.193.51:0/1510882270 learned_addr learned my addr 10.20.193.51:0/1510882270 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): get_auth_request con 0x7fc778003c20 auth_method 0 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): get_auth_request con 0x7fc794131850 auth_method 0 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc7937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient(hunting): handle_auth_done global_id 104105 payload 824 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79895c640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 0x7fc7941d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 -- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 msgr2=0x7fc7941d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 0x7fc7941d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 -- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc794131850 msgr2=0x7fc794131cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc794131850 0x7fc794131cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 monclient: found mon.noname-c 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc793fff640 1 -- 10.20.193.51:0/1510882270 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794134cf0 con 0x7fc778003c20 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79895c640 10 monclient: get_auth_request con 0x7fc794132210 auth_method 0 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.993+0000 7fc79895c640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 0x7fc7941d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc793fff640 1 -- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 msgr2=0x7fc794131310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc793fff640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc780002920 tx=0x7fc794076660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000c140 con 0x7fc778003c20 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: dump: 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.006 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc780037430 con 0x7fc778003c20 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 5 monclient: authenticate success, global_id 104105 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780003200 con 0x7fc778003c20 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 10 monclient: _renew_subs 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc7927fc640 4 set_mon_vals no callback set 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7940a2ab0 con 0x7fc778003c20 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc790ff9640 10 monclient: dump: 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:35.007 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 10 monclient: _renew_subs 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.995+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc794134a10 con 0x7fc778003c20 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc79a3e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc79a3e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc79a3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc7800379f0 con 0x7fc778003c20 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79409de50 con 0x7fc778003c20 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc790ff9640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 0x7fc7640401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(254..254 src has 167..254) ==== 4783+0+0 (secure 0 0 0) 0x7fc780077590 con 0x7fc778003c20 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 0x7fc7640401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.996+0000 7fc7937fe640 10 monclient: get_auth_request con 0x7fc76403dd10 auth_method 0 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.998+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc78004b3a0 con 0x7fc778003c20 2026-02-17T11:52:35.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.998+0000 7fc790ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:35.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.998+0000 7fc790ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:35.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:34.999+0000 7fc7937fe640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 0x7fc7640401d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc794133e40 tx=0x7fc784012380 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc79a3e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc79a3e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc79a3e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc7940008d0 con 0x7fc778003c20 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc790ff9640 1 -- 10.20.193.51:0/1510882270 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fc780037dc0 con 0x7fc778003c20 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc790ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.112+0000 7fc790ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:35.114 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:35.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 msgr2=0x7fc7640401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:35.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 0x7fc7640401d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc794133e40 tx=0x7fc784012380 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 10 monclient: shutdown 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 msgr2=0x7fc794131310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc780002920 tx=0x7fc794076660 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 shutdown_connections 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc76403dd10 0x7fc7640401d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc794132210 0x7fc7941d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc794131850 0x7fc794131cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 --2- 10.20.193.51:0/1510882270 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc778003c20 0x7fc794131310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 >> 10.20.193.51:0/1510882270 conn(0x7fc7940a30c0 msgr2=0x7fc794138b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:35.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 shutdown_connections 2026-02-17T11:52:35.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:35.113+0000 7fc79a3e6640 1 -- 10.20.193.51:0/1510882270 wait complete. 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1000: done (0 left) 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1001: read oid 15 snap -1 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1001: expect deleted 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1002: read oid 28 snap -1 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1002: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1003: write oid 16 current snap is 114 2026-02-17T11:52:35.393 INFO:tasks.rados.rados.0.trial142.stdout:1003: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2026-02-17T11:52:35.398 INFO:tasks.rados.rados.0.trial142.stdout:1003: writing trial14245205-16 from 783292 to 1324174 tid 1 2026-02-17T11:52:35.402 INFO:tasks.rados.rados.0.trial142.stdout:1003: writing trial14245205-16 from 1932766 to 2440553 tid 2 2026-02-17T11:52:35.408 INFO:tasks.rados.rados.0.trial142.stdout:1003: writing trial14245205-16 from 3210350 to 3782363 tid 3 2026-02-17T11:52:35.408 INFO:tasks.rados.rados.0.trial142.stdout:1004: delete oid 17 current snap is 114 2026-02-17T11:52:35.408 INFO:tasks.rados.rados.0.trial142.stdout:1002: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:52:35.478 INFO:tasks.rados.rados.0.trial142.stdout:1003: finishing write tid 1 to trial14245205-16 2026-02-17T11:52:35.478 INFO:tasks.rados.rados.0.trial142.stdout:1003: finishing write tid 2 to trial14245205-16 2026-02-17T11:52:35.478 INFO:tasks.rados.rados.0.trial142.stdout:1003: finishing write tid 3 to trial14245205-16 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: finishing write tid 4 to trial14245205-16 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: finishing write tid 5 to trial14245205-16 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: oid 16 updating version 0 to 594 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: oid 16 updating version 594 to 595 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: oid 16 updating version 595 to 597 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: oid 16 version 597 is already newer than 596 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 597 (ObjNum 356 snap 114 seq_num 356) dirty exists 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: left oid 16 (ObjNum 356 snap 114 seq_num 356) 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1001: done (3 left) 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1002: done (2 left) 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1003: done (1 left) 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1004: done (0 left) 2026-02-17T11:52:35.479 INFO:tasks.rados.rados.0.trial142.stdout:1005: delete oid 4 current snap is 114 2026-02-17T11:52:35.481 INFO:tasks.rados.rados.0.trial142.stdout:1005: done (0 left) 2026-02-17T11:52:35.481 INFO:tasks.rados.rados.0.trial142.stdout:1006: copy_from oid 9 from oid 34 current snap is 114 2026-02-17T11:52:35.481 INFO:tasks.rados.rados.0.trial142.stdout:1007: write (excl) oid 10 current snap is 114 2026-02-17T11:52:35.481 INFO:tasks.rados.rados.0.trial142.stdout:1007: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-17T11:52:35.484 INFO:tasks.rados.rados.0.trial142.stdout:1007: writing trial14245205-10 from 433713 to 916695 tid 1 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1007: writing trial14245205-10 from 1424565 to 2033713 tid 2 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1008: copy_from oid 2 from oid 42 current snap is 114 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1007: finishing write tid 1 to trial14245205-10 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1006: finishing copy_from racing read to trial14245205-9 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1009: read oid 13 snap -1 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1009: expect (ObjNum 340 snap 110 seq_num 340) 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1010: write oid 16 current snap is 114 2026-02-17T11:52:35.489 INFO:tasks.rados.rados.0.trial142.stdout:1010: seq_num 360 ranges {450520=558231,1483047=515125} 2026-02-17T11:52:35.492 INFO:tasks.rados.rados.0.trial142.stdout:1010: writing trial14245205-16 from 450520 to 1008751 tid 1 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1010: writing trial14245205-16 from 1483047 to 1998172 tid 2 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1011: write oid 22 current snap is 114 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1006: finishing copy_from to trial14245205-9 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1007: finishing write tid 2 to trial14245205-10 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1007: finishing write tid 3 to trial14245205-10 2026-02-17T11:52:35.496 INFO:tasks.rados.rados.0.trial142.stdout:1011: seq_num 361 ranges {467327=633480,1825176=242151} 2026-02-17T11:52:35.500 INFO:tasks.rados.rados.0.trial142.stdout:1011: writing trial14245205-22 from 467327 to 1100807 tid 1 2026-02-17T11:52:35.504 INFO:tasks.rados.rados.0.trial142.stdout:1011: writing trial14245205-22 from 1825176 to 2067327 tid 2 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1006: done (5 left) 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1012: rollback oid 47 current snap is 114 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 75 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1007: finishing write tid 4 to trial14245205-10 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1007: oid 10 updating version 0 to 499 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1007: oid 10 version 499 is already newer than 498 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1007: oid 10 version 499 is already newer than 497 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 499 (ObjNum 359 snap 114 seq_num 359) dirty exists 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1007: left oid 10 (ObjNum 359 snap 114 seq_num 359) 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1008: finishing copy_from racing read to trial14245205-2 2026-02-17T11:52:35.505 INFO:tasks.rados.rados.0.trial142.stdout:1009: expect (ObjNum 340 snap 110 seq_num 340) 2026-02-17T11:52:35.685 INFO:tasks.rados.rados.0.trial142.stdout:1010: finishing write tid 1 to trial14245205-16 2026-02-17T11:52:35.685 INFO:tasks.rados.rados.0.trial142.stdout:1008: finishing copy_from to trial14245205-2 2026-02-17T11:52:35.685 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 437 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-17T11:52:35.685 INFO:tasks.rados.rados.0.trial142.stdout:1010: finishing write tid 2 to trial14245205-16 2026-02-17T11:52:35.685 INFO:tasks.rados.rados.0.trial142.stdout:1010: finishing write tid 3 to trial14245205-16 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1010: finishing write tid 4 to trial14245205-16 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1010: oid 16 updating version 0 to 599 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1010: oid 16 updating version 599 to 600 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1010: oid 16 updating version 600 to 601 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 601 (ObjNum 360 snap 114 seq_num 360) dirty exists 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1010: left oid 16 (ObjNum 360 snap 114 seq_num 360) 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1011: finishing write tid 1 to trial14245205-22 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1011: finishing write tid 2 to trial14245205-22 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1012: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1012: finishing rollback tid 2 to trial14245205-47 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 501 (ObjNum 195 snap 56 seq_num 195) dirty exists 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1011: finishing write tid 3 to trial14245205-22 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1011: finishing write tid 4 to trial14245205-22 2026-02-17T11:52:35.686 INFO:tasks.rados.rados.0.trial142.stdout:1011: oid 22 updating version 0 to 273 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1011: oid 22 updating version 273 to 274 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1011: oid 22 version 274 is already newer than 272 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 274 (ObjNum 361 snap 114 seq_num 361) dirty exists 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1011: left oid 22 (ObjNum 361 snap 114 seq_num 361) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1007: done (5 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1008: done (4 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1009: done (3 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1010: done (2 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1011: done (1 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1012: done (0 left) 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1013: rollback oid 33 current snap is 114 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 75 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1014: read oid 30 snap -1 2026-02-17T11:52:35.687 INFO:tasks.rados.rados.0.trial142.stdout:1014: expect (ObjNum 302 snap 99 seq_num 302) 2026-02-17T11:52:35.688 INFO:tasks.rados.rados.0.trial142.stdout:1015: copy_from oid 6 from oid 19 current snap is 114 2026-02-17T11:52:35.688 INFO:tasks.rados.rados.0.trial142.stdout:1016: copy_from oid 8 from oid 39 current snap is 114 2026-02-17T11:52:35.688 INFO:tasks.rados.rados.0.trial142.stdout:1017: delete oid 34 current snap is 114 2026-02-17T11:52:35.688 INFO:tasks.rados.rados.0.trial142.stdout:1014: expect (ObjNum 302 snap 99 seq_num 302) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1016: finishing copy_from to trial14245205-8 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1016: got expected ENOENT (src dne) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1016: finishing copy_from racing read to trial14245205-8 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1013: finishing rollback tid 0 to trial14245205-33 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1013: finishing rollback tid 1 to trial14245205-33 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1014: done (4 left) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1016: done (3 left) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1017: done (2 left) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1018: read oid 11 snap 81 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1018: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:52:35.825 INFO:tasks.rados.rados.0.trial142.stdout:1019: snap_remove snap 112 2026-02-17T11:52:36.399 INFO:tasks.rados.rados.0.trial142.stdout:1019: done (3 left) 2026-02-17T11:52:36.399 INFO:tasks.rados.rados.0.trial142.stdout:1020: write oid 27 current snap is 114 2026-02-17T11:52:36.399 INFO:tasks.rados.rados.0.trial142.stdout:1020: seq_num 363 ranges {500941=783978,1942140=158801} 2026-02-17T11:52:36.403 INFO:tasks.rados.rados.0.trial142.stdout:1020: writing trial14245205-27 from 500941 to 1284919 tid 1 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1020: writing trial14245205-27 from 1942140 to 2100941 tid 2 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1021: rollback oid 30 current snap is 114 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 30 to 81 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1013: finishing rollback tid 2 to trial14245205-33 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 664 (ObjNum 234 snap 74 seq_num 234) dirty exists 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1015: finishing copy_from racing read to trial14245205-6 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1015: finishing copy_from to trial14245205-6 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 483 (ObjNum 353 snap 114 seq_num 353) dirty exists 2026-02-17T11:52:36.407 INFO:tasks.rados.rados.0.trial142.stdout:1018: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:52:36.554 INFO:tasks.rados.rados.0.trial142.stdout:1020: finishing write tid 1 to trial14245205-27 2026-02-17T11:52:36.554 INFO:tasks.rados.rados.0.trial142.stdout:1020: finishing write tid 2 to trial14245205-27 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1021: finishing rollback tid 0 to trial14245205-30 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1021: finishing rollback tid 1 to trial14245205-30 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1020: finishing write tid 3 to trial14245205-27 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1013: done (4 left) 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1015: done (3 left) 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1018: done (2 left) 2026-02-17T11:52:36.555 INFO:tasks.rados.rados.0.trial142.stdout:1022: snap_remove snap 75 2026-02-17T11:52:37.400 INFO:tasks.rados.rados.0.trial142.stdout:1022: done (2 left) 2026-02-17T11:52:37.400 INFO:tasks.rados.rados.0.trial142.stdout:1023: copy_from oid 21 from oid 1 current snap is 114 2026-02-17T11:52:37.400 INFO:tasks.rados.rados.0.trial142.stdout:1020: finishing write tid 4 to trial14245205-27 2026-02-17T11:52:37.400 INFO:tasks.rados.rados.0.trial142.stdout:1020: oid 27 updating version 0 to 667 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1020: oid 27 updating version 667 to 668 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1020: oid 27 version 668 is already newer than 666 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 668 (ObjNum 363 snap 114 seq_num 363) dirty exists 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1020: left oid 27 (ObjNum 363 snap 114 seq_num 363) 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1021: finishing rollback tid 2 to trial14245205-30 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 451 (ObjNum 213 snap 69 seq_num 213) dirty exists 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1020: done (2 left) 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1021: done (1 left) 2026-02-17T11:52:37.401 INFO:tasks.rados.rados.0.trial142.stdout:1024: delete oid 22 current snap is 114 2026-02-17T11:52:37.405 INFO:tasks.rados.rados.0.trial142.stdout:1024: done (1 left) 2026-02-17T11:52:37.405 INFO:tasks.rados.rados.0.trial142.stdout:1025: snap_remove snap 113 2026-02-17T11:52:38.123 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:38.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: get_monmap_and_config 2026-02-17T11:52:38.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: build_initial_monmap 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: monmap: 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:38.193012+0000 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:38.193012+0000 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:38.197 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 Processor -- start 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 -- start start 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: init 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7f240a3bb0 0x7f7f2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-a con 0x7f7f240a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f240a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:38.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f2413b760 0x7f7f2413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-b con 0x7f7f2413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2406e140 con 0x7f7f240a0750 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2409f910 con 0x7f7f240a3bb0 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2409ccd0 con 0x7f7f2413b760 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f2a864640 10 monclient(hunting): authenticate will time out at 1045.811822s 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7f240a3bb0 0x7f7f2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7f240a3bb0 0x7f7f2409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33554/0 (socket says 10.20.193.51:33554) 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 1 -- 10.20.193.51:0/2066206184 learned_addr learned my addr 10.20.193.51:0/2066206184 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:38.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): get_auth_request con 0x7f7f240a3bb0 auth_method 0 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f28dda640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f2413b760 0x7f7f2413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f28dda640 10 monclient(hunting): get_auth_request con 0x7f7f2413b760 auth_method 0 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f28dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f28dda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f28dda640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.192+0000 7f7f23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:38.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 10 monclient(hunting): handle_auth_done global_id 74361 payload 274 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 1 -- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f2413b760 msgr2=0x7f7f2413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f2413b760 0x7f7f2413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 1 -- 10.20.193.51:0/2066206184 >> v1:10.20.193.142:6789/0 conn(0x7f7f240a0750 legacy=0x7f7f2409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 1 monclient: found mon.noname-a 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.193+0000 7f7f23fff640 1 -- 10.20.193.51:0/2066206184 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2409eec0 con 0x7f7f240a3bb0 2026-02-17T11:52:38.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f23fff640 1 -- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f240a3bb0 msgr2=0x7f7f2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:38.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f23fff640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f240a3bb0 0x7f7f2409dac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406c1c0 tx=0x7f7f1002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbf3257c60b18c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 1 -- 10.20.193.51:0/2066206184 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1003c070 con 0x7f7f240a3bb0 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: dump: 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.208 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 1 -- 10.20.193.51:0/2066206184 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1002fca0 con 0x7f7f240a3bb0 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f2a864640 5 monclient: authenticate success, global_id 74361 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f2a864640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 1 -- 10.20.193.51:0/2066206184 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10037660 con 0x7f7f240a3bb0 2026-02-17T11:52:38.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f22ffd640 10 monclient: dump: 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f2a864640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.195+0000 7f7f2a864640 4 set_mon_vals no callback set 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 10 monclient: shutdown 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f240a3bb0 msgr2=0x7f7f2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f240a3bb0 0x7f7f2409dac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406c1c0 tx=0x7f7f1002ee60 comp rx=0 tx=0).stop 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- 10.20.193.51:0/2066206184 shutdown_connections 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f2413b760 0x7f7f2413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 --2- 10.20.193.51:0/2066206184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f240a3bb0 0x7f7f2409dac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- 10.20.193.51:0/2066206184 >> 10.20.193.51:0/2066206184 conn(0x7f7f240a30c0 msgr2=0x7f7f240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- 10.20.193.51:0/2066206184 shutdown_connections 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- 10.20.193.51:0/2066206184 wait complete. 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 10 monclient: build_initial_monmap 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 10 monclient: monmap: 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:38.212 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 Processor -- start 2026-02-17T11:52:38.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 1 -- start start 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.196+0000 7f7f2a864640 10 monclient: init 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f240a0750 0x7f7f24090bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-b con 0x7f7f240a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 0x7f7f240910f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-c con 0x7f7f240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): picked mon.noname-a con 0x7f7f2413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f240a04b0 con 0x7f7f2413b760 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:38.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2409c850 con 0x7f7f240a0750 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2409e710 con 0x7f7f240a3bb0 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f2a864640 10 monclient(hunting): authenticate will time out at 1045.816202s 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 0x7f7f240910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33568/0 (socket says 10.20.193.51:33568) 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 1 -- 10.20.193.51:0/1871487911 learned_addr learned my addr 10.20.193.51:0/1871487911 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): get_auth_request con 0x7f7f240a3bb0 auth_method 0 2026-02-17T11:52:38.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): get_auth_request con 0x7f7f2413b760 auth_method 0 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:38.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient(hunting): handle_auth_done global_id 104111 payload 824 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 -- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f240a0750 msgr2=0x7f7f24090bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f240a0750 0x7f7f24090bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 -- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 msgr2=0x7f7f24091630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient: _finish_hunting 0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 monclient: found mon.noname-c 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f237fe640 1 -- 10.20.193.51:0/1871487911 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f24099590 con 0x7f7f240a3bb0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.197+0000 7f7f28dda640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f237fe640 1 -- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 msgr2=0x7f7f240910f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f237fe640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 0x7f7f240910f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c450 tx=0x7f7f1400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14016020 con 0x7f7f240a3bb0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:38.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: dump: 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f14012a40 con 0x7f7f240a3bb0 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14011380 con 0x7f7f240a3bb0 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f20ff9640 10 monclient: dump: 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.221 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f227fc640 4 set_mon_vals no callback set 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 5 monclient: authenticate success, global_id 104111 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 10 monclient: _renew_subs 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f240945b0 con 0x7f7f240a3bb0 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 10 monclient: _renew_subs 2026-02-17T11:52:38.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.199+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f240a2400 con 0x7f7f240a3bb0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f2a864640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f2a864640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f2a864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2406f530 con 0x7f7f240a3bb0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7f140115e0 con 0x7f7f240a3bb0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f20ff9640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 0x7f7ef40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(254..254 src has 167..254) ==== 4783+0+0 (secure 0 0 0) 0x7f7f14052680 con 0x7f7f240a3bb0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f23fff640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 0x7f7ef40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.200+0000 7f7f23fff640 10 monclient: get_auth_request con 0x7f7ef403dd10 auth_method 0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.203+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f14020030 con 0x7f7f240a3bb0 2026-02-17T11:52:38.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.203+0000 7f7f20ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:38.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.203+0000 7f7f20ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:38.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.203+0000 7f7f23fff640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 0x7f7ef40401d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f10036000 tx=0x7f7f10031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f2a864640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f2a864640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f2a864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f2409dac0 con 0x7f7f240a3bb0 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f20ff9640 1 -- 10.20.193.51:0/1871487911 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f7f1401ac60 con 0x7f7f240a3bb0 2026-02-17T11:52:38.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f20ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:38.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.316+0000 7f7f20ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:38.319 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:38.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 msgr2=0x7f7ef40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:38.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 0x7f7ef40401d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f10036000 tx=0x7f7f10031000 comp rx=0 tx=0).stop 2026-02-17T11:52:38.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 10 monclient: shutdown 2026-02-17T11:52:38.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 msgr2=0x7f7f240910f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 0x7f7f240910f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c450 tx=0x7f7f1400c920 comp rx=0 tx=0).stop 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 shutdown_connections 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef403dd10 0x7f7ef40401d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f2413b760 0x7f7f24091630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f240a3bb0 0x7f7f240910f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 --2- 10.20.193.51:0/1871487911 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f240a0750 0x7f7f24090bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 >> 10.20.193.51:0/1871487911 conn(0x7f7f240a30c0 msgr2=0x7f7f2413acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 shutdown_connections 2026-02-17T11:52:38.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:38.317+0000 7f7f2a864640 1 -- 10.20.193.51:0/1871487911 wait complete. 2026-02-17T11:52:38.405 INFO:tasks.rados.rados.0.trial142.stdout:1025: done (1 left) 2026-02-17T11:52:38.406 INFO:tasks.rados.rados.0.trial142.stdout:1026: snap_create 2026-02-17T11:52:38.406 INFO:tasks.rados.rados.0.trial142.stdout:1023: finishing copy_from racing read to trial14245205-21 2026-02-17T11:52:38.406 INFO:tasks.rados.rados.0.trial142.stdout:1023: finishing copy_from to trial14245205-21 2026-02-17T11:52:38.406 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:52:39.406 INFO:tasks.rados.rados.0.trial142.stdout:1023: done (1 left) 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1026: done (0 left) 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1027: copy_from oid 17 from oid 45 current snap is 115 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1028: copy_from oid 14 from oid 16 current snap is 115 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1029: read oid 32 snap 114 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1029: expect deleted 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1030: rollback oid 37 current snap is 115 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 81 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1031: read oid 19 snap -1 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1031: expect (ObjNum 353 snap 114 seq_num 353) 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1032: rollback oid 33 current snap is 115 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 81 2026-02-17T11:52:39.407 INFO:tasks.rados.rados.0.trial142.stdout:1033: snap_create 2026-02-17T11:52:39.408 INFO:tasks.rados.rados.0.trial142.stdout:1030: finishing rollback tid 0 to trial14245205-37 2026-02-17T11:52:39.409 INFO:tasks.rados.rados.0.trial142.stdout:1030: finishing rollback tid 1 to trial14245205-37 2026-02-17T11:52:39.409 INFO:tasks.rados.rados.0.trial142.stdout:1030: finishing rollback tid 2 to trial14245205-37 2026-02-17T11:52:39.409 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 384 (ObjNum 255 snap 80 seq_num 255) dirty exists 2026-02-17T11:52:39.412 INFO:tasks.rados.rados.0.trial142.stdout:1032: finishing rollback tid 0 to trial14245205-33 2026-02-17T11:52:39.412 INFO:tasks.rados.rados.0.trial142.stdout:1032: finishing rollback tid 1 to trial14245205-33 2026-02-17T11:52:39.412 INFO:tasks.rados.rados.0.trial142.stdout:1032: finishing rollback tid 2 to trial14245205-33 2026-02-17T11:52:39.412 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 692 (ObjNum 234 snap 74 seq_num 234) dirty exists 2026-02-17T11:52:39.413 INFO:tasks.rados.rados.0.trial142.stdout:1031: expect (ObjNum 353 snap 114 seq_num 353) 2026-02-17T11:52:39.503 INFO:tasks.rados.rados.0.trial142.stdout:1027: finishing copy_from to trial14245205-17 2026-02-17T11:52:39.504 INFO:tasks.rados.rados.0.trial142.stdout:1027: got expected ENOENT (src dne) 2026-02-17T11:52:39.504 INFO:tasks.rados.rados.0.trial142.stdout:1027: finishing copy_from racing read to trial14245205-17 2026-02-17T11:52:39.504 INFO:tasks.rados.rados.0.trial142.stdout:1028: finishing copy_from racing read to trial14245205-14 2026-02-17T11:52:39.504 INFO:tasks.rados.rados.0.trial142.stdout:1028: finishing copy_from to trial14245205-14 2026-02-17T11:52:39.504 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 601 (ObjNum 360 snap 114 seq_num 360) dirty exists 2026-02-17T11:52:40.664 INFO:tasks.rados.rados.0.trial142.stdout:1027: done (6 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1028: done (5 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1029: done (4 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1030: done (3 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1031: done (2 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1032: done (1 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1033: done (0 left) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1034: read oid 38 snap -1 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1034: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:52:40.665 INFO:tasks.rados.rados.0.trial142.stdout:1035: snap_remove snap 115 2026-02-17T11:52:41.327 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: get_monmap_and_config 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: monmap: 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:41.395981+0000 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:41.395981+0000 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:41.399 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 Processor -- start 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 -- start start 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: init 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7b900a3bb0 0x7f7b9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-c con 0x7f7b900a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b900a0750 0x7f7b9009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-a con 0x7f7b900a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7b9009e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9006e140 con 0x7f7b9009e540 2026-02-17T11:52:41.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7b900a3f90 con 0x7f7b900a0750 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7b9009f910 con 0x7f7b900a3bb0 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b94d49640 10 monclient(hunting): authenticate will time out at 1049.014768s 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b900a0750 0x7f7b9009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b900a0750 0x7f7b9009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33574/0 (socket says 10.20.193.51:33574) 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 1 -- 10.20.193.51:0/1663920746 learned_addr learned my addr 10.20.193.51:0/1663920746 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): get_auth_request con 0x7f7b900a0750 auth_method 0 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.395+0000 7f7b8e575640 1 --2- 10.20.193.51:0/1663920746 >> v2:10.20.193.142:3300/0 conn(0x7f7b900a3bb0 0x7f7b9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8e575640 10 monclient(hunting): get_auth_request con 0x7f7b900a3bb0 auth_method 0 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 10 monclient(hunting): handle_auth_done global_id 74367 payload 274 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 1 -- 10.20.193.51:0/1663920746 >> v2:10.20.193.142:3300/0 conn(0x7f7b900a3bb0 msgr2=0x7f7b9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 1 --2- 10.20.193.51:0/1663920746 >> v2:10.20.193.142:3300/0 conn(0x7f7b900a3bb0 0x7f7b9009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 1 -- 10.20.193.51:0/1663920746 >> v1:10.20.193.142:6789/0 conn(0x7f7b9009e540 legacy=0x7f7b9013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 1 monclient: found mon.noname-a 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.396+0000 7f7b8dd74640 1 -- 10.20.193.51:0/1663920746 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9009ccd0 con 0x7f7b900a0750 2026-02-17T11:52:41.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8dd74640 1 -- 10.20.193.51:0/1663920746 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a0750 msgr2=0x7f7b9009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8dd74640 1 --2- 10.20.193.51:0/1663920746 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a0750 0x7f7b9009e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b9006f3c0 tx=0x7f7b7802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2297372963ecc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 1 -- 10.20.193.51:0/1663920746 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7803c070 con 0x7f7b900a0750 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: dump: 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 1 -- 10.20.193.51:0/1663920746 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7802fc70 con 0x7f7b900a0750 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 1 -- 10.20.193.51:0/1663920746 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78037660 con 0x7f7b900a0750 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b94d49640 5 monclient: authenticate success, global_id 74367 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b8d573640 10 monclient: dump: 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b94d49640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:41.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.398+0000 7f7b94d49640 4 set_mon_vals no callback set 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 10 monclient: shutdown 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- 10.20.193.51:0/1663920746 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a0750 msgr2=0x7f7b9009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 --2- 10.20.193.51:0/1663920746 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a0750 0x7f7b9009e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b9006f3c0 tx=0x7f7b7802edf0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- 10.20.193.51:0/1663920746 shutdown_connections 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 --2- 10.20.193.51:0/1663920746 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a0750 0x7f7b9009e000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 --2- 10.20.193.51:0/1663920746 >> v2:10.20.193.142:3300/0 conn(0x7f7b900a3bb0 0x7f7b9009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- 10.20.193.51:0/1663920746 >> 10.20.193.51:0/1663920746 conn(0x7f7b900a30c0 msgr2=0x7f7b900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- 10.20.193.51:0/1663920746 shutdown_connections 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- 10.20.193.51:0/1663920746 wait complete. 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 10 monclient: monmap: 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.409 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 Processor -- start 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 1 -- start start 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.399+0000 7f7b94d49640 10 monclient: init 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b9009e540 0x7f7b9009c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-c con 0x7f7b9009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 0x7f7b90092d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-b con 0x7f7b900a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): picked mon.noname-a con 0x7f7b900a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900a04b0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9009c850 con 0x7f7b900a0750 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9013de80 con 0x7f7b9009e540 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b94d49640 10 monclient(hunting): authenticate will time out at 1049.019220s 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b9009e540 0x7f7b9009c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33582/0 (socket says 10.20.193.51:33582) 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 -- 10.20.193.51:0/260949510 learned_addr learned my addr 10.20.193.51:0/260949510 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): get_auth_request con 0x7f7b900a3bb0 auth_method 0 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): get_auth_request con 0x7f7b9009e540 auth_method 0 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient(hunting): handle_auth_done global_id 74370 payload 824 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8dd74640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 0x7f7b90092d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 -- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b9009e540 msgr2=0x7f7b9009c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b9009e540 0x7f7b9009c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 -- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 msgr2=0x7f7b90092d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 0x7f7b90092d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 monclient: found mon.noname-a 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8ed76640 1 -- 10.20.193.51:0/260949510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b90094720 con 0x7f7b900a3bb0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8dd74640 10 monclient: get_auth_request con 0x7f7b900a0750 auth_method 0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.400+0000 7f7b8dd74640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 0x7f7b90092d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b8ed76640 1 -- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 msgr2=0x7f7b90093270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b8ed76640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000cb90 tx=0x7f7b8000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016020 con 0x7f7b900a3bb0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: dump: 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80012420 con 0x7f7b900a3bb0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80012810 con 0x7f7b900a3bb0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 5 monclient: authenticate success, global_id 74370 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 10 monclient: _renew_subs 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b8cd72640 4 set_mon_vals no callback set 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b900964a0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b76ffd640 10 monclient: dump: 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 10 monclient: _renew_subs 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.402+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9009b6f0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b94d49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b94d49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b94d49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b900a2cc0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7b800129b0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b76ffd640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 0x7f7b5c040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(260..260 src has 167..260) ==== 4767+0+0 (secure 0 0 0) 0x7f7b80053000 con 0x7f7b900a3bb0 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b8e575640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 0x7f7b5c040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.403+0000 7f7b8e575640 10 monclient: get_auth_request con 0x7f7b5c03dd90 auth_method 0 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.406+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7b900a2cc0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.406+0000 7f7b76ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.406+0000 7f7b76ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:41.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.406+0000 7f7b8e575640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 0x7f7b5c040250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009a50 tx=0x7f7b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b94d49640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b94d49640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b94d49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b9009dac0 con 0x7f7b900a3bb0 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b76ffd640 1 -- 10.20.193.51:0/260949510 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f7b80020020 con 0x7f7b900a3bb0 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b76ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:41.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.520+0000 7f7b76ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 msgr2=0x7f7b5c040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 0x7f7b5c040250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009a50 tx=0x7f7b84008040 comp rx=0 tx=0).stop 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 10 monclient: shutdown 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 msgr2=0x7f7b90093270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000cb90 tx=0x7f7b8000a430 comp rx=0 tx=0).stop 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 shutdown_connections 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b5c03dd90 0x7f7b5c040250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b900a3bb0 0x7f7b90093270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b900a0750 0x7f7b90092d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 --2- 10.20.193.51:0/260949510 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b9009e540 0x7f7b9009c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 >> 10.20.193.51:0/260949510 conn(0x7f7b900a30c0 msgr2=0x7f7b90072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 shutdown_connections 2026-02-17T11:52:41.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.521+0000 7f7b94d49640 1 -- 10.20.193.51:0/260949510 wait complete. 2026-02-17T11:52:41.530 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:52:41.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:52:41.531 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:52:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.594+0000 7f029b21a640 10 monclient: get_monmap_and_config 2026-02-17T11:52:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.594+0000 7f029b21a640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.594+0000 7f029b21a640 10 monclient: monmap: 2026-02-17T11:52:41.596 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:41.595678+0000 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:41.595678+0000 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:41.597 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 Processor -- start 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 -- start start 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient: init 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-a con 0x7f02940a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-b con 0x7f02940a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f029409e540 0x7f029413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-c con 0x7f029409e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f02940a3f90 con 0x7f02940a3bb0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f029406e140 con 0x7f029409e540 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f029409f910 con 0x7f02940a0750 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f029b21a640 10 monclient(hunting): authenticate will time out at 1049.214433s 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36494/0 (socket says 10.20.193.51:36494) 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33592/0 (socket says 10.20.193.51:33592) 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 1 -- 10.20.193.51:0/49144032 learned_addr learned my addr 10.20.193.51:0/49144032 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): get_auth_request con 0x7f02940a3bb0 auth_method 0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): get_auth_request con 0x7f02940a0750 auth_method 0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0299790640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.142:3300/0 conn(0x7f029409e540 0x7f029413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0299790640 10 monclient(hunting): get_auth_request con 0x7f029409e540 auth_method 0 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0299790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0299790640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0299790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient(hunting): handle_auth_done global_id 104117 payload 274 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 -- 10.20.193.51:0/49144032 >> v2:10.20.193.142:3300/0 conn(0x7f029409e540 msgr2=0x7f029413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.142:3300/0 conn(0x7f029409e540 0x7f029413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 -- 10.20.193.51:0/49144032 >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 msgr2=0x7f029409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 monclient: found mon.noname-b 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f028bfff640 1 -- 10.20.193.51:0/49144032 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029409ccd0 con 0x7f02940a0750 2026-02-17T11:52:41.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.595+0000 7f0298f8f640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:41.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028bfff640 1 -- 10.20.193.51:0/49144032 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 msgr2=0x7f029409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028bfff640 1 --2- 10.20.193.51:0/49144032 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f029409f230 tx=0x7f027c02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c745b45a458895 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 1 -- 10.20.193.51:0/49144032 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c03c070 con 0x7f02940a0750 2026-02-17T11:52:41.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: dump: 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 5 monclient: authenticate success, global_id 104117 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 1 -- 10.20.193.51:0/49144032 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c02fbd0 con 0x7f02940a0750 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 4 set_mon_vals no callback set 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 1 -- 10.20.193.51:0/49144032 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c037440 con 0x7f02940a0750 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f028b7fe640 10 monclient: dump: 2026-02-17T11:52:41.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 10 monclient: shutdown 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 -- 10.20.193.51:0/49144032 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 msgr2=0x7f029409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 --2- 10.20.193.51:0/49144032 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f029409f230 tx=0x7f027c02ed50 comp rx=0 tx=0).stop 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 -- 10.20.193.51:0/49144032 shutdown_connections 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.142:3300/0 conn(0x7f029409e540 0x7f029413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 --2- 10.20.193.51:0/49144032 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f02940a0750 0x7f029409e000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 --2- 10.20.193.51:0/49144032 >> v2:10.20.193.51:3300/0 conn(0x7f02940a3bb0 0x7f029409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 -- 10.20.193.51:0/49144032 >> 10.20.193.51:0/49144032 conn(0x7f02940a30c0 msgr2=0x7f02940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 -- 10.20.193.51:0/49144032 shutdown_connections 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.598+0000 7f029b21a640 1 -- 10.20.193.51:0/49144032 wait complete. 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient: monmap: 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:41.606 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 Processor -- start 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 -- start start 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient: init 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f029409e540 0x7f029413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-c con 0x7f029409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02940a0750 0x7f02941cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-b con 0x7f02940a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 0x7f02941cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): picked mon.noname-a con 0x7f02940a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f02940a04b0 con 0x7f02940a3bb0 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f029409c850 con 0x7f02940a0750 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f029413cca0 con 0x7f029409e540 2026-02-17T11:52:41.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f029b21a640 10 monclient(hunting): authenticate will time out at 1049.218627s 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f029409e540 0x7f029413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 0x7f02941cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f029409e540 0x7f029413bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36504/0 (socket says 10.20.193.51:36504) 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 1 -- 10.20.193.51:0/666694538 learned_addr learned my addr 10.20.193.51:0/666694538 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): get_auth_request con 0x7f029409e540 auth_method 0 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): get_auth_request con 0x7f02940a3bb0 auth_method 0 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient(hunting): handle_auth_done global_id 74376 payload 824 2026-02-17T11:52:41.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f029409e540 msgr2=0x7f029413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f029409e540 0x7f029413bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02940a0750 msgr2=0x7f02941cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02940a0750 0x7f02941cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 monclient: found mon.noname-a 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.599+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02940981f0 con 0x7f02940a3bb0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.601+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 msgr2=0x7f02941cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.601+0000 7f0299790640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 0x7f02941cd980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0290007d40 tx=0x7f029000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290003a90 con 0x7f02940a3bb0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: dump: 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.609 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0290003c50 con 0x7f02940a3bb0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 5 monclient: authenticate success, global_id 74376 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 monclient: _renew_subs 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0294090100 con 0x7f02940a3bb0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290004020 con 0x7f02940a3bb0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f028affd640 4 set_mon_vals no callback set 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 10 monclient: dump: 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 monclient: _renew_subs 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02940a2350 con 0x7f02940a3bb0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 0x7f029408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f029408fcf0 con 0x7f029408d3f0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 0x7f029408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient: get_auth_request con 0x7f029408d3f0 auth_method 0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0290004240 con 0x7f02940a3bb0 2026-02-17T11:52:41.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 10 monclient(hunting): handle_auth_done global_id 74379 payload 824 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f0298f8f640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f029409d7b0 con 0x7f029408d3f0 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f026403dd10 0x7f02640401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.602+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(260..260 src has 167..260) ==== 4767+0+0 (secure 0 0 0) 0x7f02900529b0 con 0x7f02940a3bb0 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.603+0000 7f028bfff640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f026403dd10 0x7f02640401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.603+0000 7f028bfff640 10 monclient: get_auth_request con 0x7f026403dd10 auth_method 0 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.604+0000 7f0298f8f640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 msgr2=0x7f029408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.604+0000 7f0298f8f640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 0x7f029408d7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f028400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0284019070 con 0x7f029408d3f0 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 10 monclient: dump: 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f0284004240 con 0x7f029408d3f0 2026-02-17T11:52:41.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 msgr2=0x7f029408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 0x7f029408d7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f028400f610 comp rx=0 tx=0).stop 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 msgr2=0x7f029408d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f02897fa640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408d3f0 0x7f029408d7d0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f028400f610 comp rx=0 tx=0).stop 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.605+0000 7f028bfff640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f026403dd10 0x7f02640401d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f029406c1c0 tx=0x7f027c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f029b21a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f029b21a640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 0x7f02941d82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f029b21a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f029409dac0 con 0x7f029408dd10 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 0x7f02941d82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient: get_auth_request con 0x7f029408dd10 auth_method 0 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 10 monclient(hunting): handle_auth_done global_id 74382 payload 824 2026-02-17T11:52:41.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.608+0000 7f0298f8f640 1 -- 10.20.193.51:0/666694538 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02940008d0 con 0x7f029408dd10 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f0298f8f640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 msgr2=0x7f02941d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f0298f8f640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 0x7f02941d82b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f02840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0284019040 con 0x7f029408dd10 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f02897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f02897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.610+0000 7f02897fa640 10 monclient: dump: 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f028401e660 con 0x7f029408dd10 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:41.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 msgr2=0x7f02941d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 0x7f02941d82b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f02840047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 msgr2=0x7f02941d82b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f02897fa640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f029408dd10 0x7f02941d82b0 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0284011be0 tx=0x7f02840047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 179542, 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:41.617 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.619 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.620 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.622 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.624 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:41.625 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f026403dd10 msgr2=0x7f02640401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f026403dd10 0x7f02640401d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f029406c1c0 tx=0x7f027c031000 comp rx=0 tx=0).stop 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 10 monclient: shutdown 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 msgr2=0x7f02941cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 --2- 10.20.193.51:0/666694538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02940a3bb0 0x7f02941cd980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0290007d40 tx=0x7f029000e4b0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 reap_dead start 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f0299790640 1 -- 10.20.193.51:0/666694538 reap_dead start 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 shutdown_connections 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 >> 10.20.193.51:0/666694538 conn(0x7f02940a30c0 msgr2=0x7f0294072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 shutdown_connections 2026-02-17T11:52:41.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.611+0000 7f029b21a640 1 -- 10.20.193.51:0/666694538 wait complete. 2026-02-17T11:52:41.627 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:41.627 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:52:41.627 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:52:41.666 INFO:tasks.rados.rados.0.trial142.stdout:1035: done (1 left) 2026-02-17T11:52:41.666 INFO:tasks.rados.rados.0.trial142.stdout:1036: write (excl) oid 49 current snap is 116 2026-02-17T11:52:41.666 INFO:tasks.rados.rados.0.trial142.stdout:1036: seq_num 365 ranges {534555=650829,1659104=475451} 2026-02-17T11:52:41.671 INFO:tasks.rados.rados.0.trial142.stdout:1036: writing trial14245205-49 from 534555 to 1185384 tid 1 2026-02-17T11:52:41.675 INFO:tasks.rados.rados.0.trial142.stdout:1036: writing trial14245205-49 from 1659104 to 2134555 tid 2 2026-02-17T11:52:41.675 INFO:tasks.rados.rados.0.trial142.stdout:1037: snap_create 2026-02-17T11:52:41.675 INFO:tasks.rados.rados.0.trial142.stdout:1034: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: get_monmap_and_config 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: monmap: 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:41.695021+0000 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:41.695021+0000 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:41.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 Processor -- start 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 -- start start 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: init 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f94040a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 0x7f940413d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f940413b380 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 0x7f94041400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f940413dcb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9404135430 con 0x7f94040a3bb0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f940409a5c0 con 0x7f940413b380 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f940409b520 con 0x7f940413dcb0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f940a2a0640 10 monclient(hunting): authenticate will time out at 1049.313792s 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9403fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f94040a3bb0 0x7f940409cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52444/0 (socket says 10.20.193.51:52444) 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9403fff640 1 -- 10.20.193.51:0/1196334751 learned_addr learned my addr 10.20.193.51:0/1196334751 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 1 --2- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 0x7f94041400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): get_auth_request con 0x7f940413dcb0 auth_method 0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.694+0000 7f9408816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f94037fe640 1 --2- 10.20.193.51:0/1196334751 >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 0x7f940413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 10 monclient(hunting): handle_auth_done global_id 104123 payload 274 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 1 -- 10.20.193.51:0/1196334751 >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 msgr2=0x7f940413d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 1 --2- 10.20.193.51:0/1196334751 >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 0x7f940413d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 1 -- 10.20.193.51:0/1196334751 >> v1:10.20.193.51:6789/0 conn(0x7f94040a3bb0 legacy=0x7f940409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 1 monclient: found mon.noname-b 2026-02-17T11:52:41.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f9408816640 1 -- 10.20.193.51:0/1196334751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940409af60 con 0x7f940413dcb0 2026-02-17T11:52:41.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f94037fe640 10 monclient: get_auth_request con 0x7f940413b380 auth_method 0 2026-02-17T11:52:41.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.695+0000 7f94037fe640 1 --2- 10.20.193.51:0/1196334751 >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 0x7f940413d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9408816640 1 -- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 msgr2=0x7f94041400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9408816640 1 --2- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 0x7f94041400a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f940409a740 tx=0x7f93f802f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4961728393c5b661 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 1 -- 10.20.193.51:0/1196334751 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f803c070 con 0x7f940413dcb0 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: dump: 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.699 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 1 -- 10.20.193.51:0/1196334751 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f8037640 con 0x7f940413dcb0 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 5 monclient: authenticate success, global_id 104123 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 1 -- 10.20.193.51:0/1196334751 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f8037a10 con 0x7f940413dcb0 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 4 set_mon_vals no callback set 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f9402ffd640 10 monclient: dump: 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 10 monclient: shutdown 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 1 -- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 msgr2=0x7f94041400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.697+0000 7f940a2a0640 1 --2- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 0x7f94041400a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f940409a740 tx=0x7f93f802f150 comp rx=0 tx=0).stop 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 -- 10.20.193.51:0/1196334751 shutdown_connections 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 --2- 10.20.193.51:0/1196334751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413dcb0 0x7f94041400a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 --2- 10.20.193.51:0/1196334751 >> v2:10.20.193.142:3300/0 conn(0x7f940413b380 0x7f940413d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 -- 10.20.193.51:0/1196334751 >> 10.20.193.51:0/1196334751 conn(0x7f94040a30c0 msgr2=0x7f94040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 -- 10.20.193.51:0/1196334751 shutdown_connections 2026-02-17T11:52:41.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 -- 10.20.193.51:0/1196334751 wait complete. 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient: monmap: 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:41.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 Processor -- start 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 -- start start 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient: init 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f94040a3bb0 0x7f9404137240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-a con 0x7f94040a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.698+0000 7f940a2a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 0x7f9404137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f940413b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f940413dcb0 0x7f9404137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f940413dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9404135040 con 0x7f94040a3bb0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9404074ac0 con 0x7f940413dcb0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f94041351c0 con 0x7f940413b380 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f940a2a0640 10 monclient(hunting): authenticate will time out at 1049.318019s 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f94040a3bb0 0x7f9404137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 0x7f9404137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f94040a3bb0 0x7f9404137240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33626/0 (socket says 10.20.193.51:33626) 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 1 -- 10.20.193.51:0/439038513 learned_addr learned my addr 10.20.193.51:0/439038513 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): get_auth_request con 0x7f94040a3bb0 auth_method 0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): get_auth_request con 0x7f940413b380 auth_method 0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9408816640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f940413dcb0 0x7f9404137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9408816640 10 monclient(hunting): get_auth_request con 0x7f940413dcb0 auth_method 0 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9408816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9408816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f9408816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient(hunting): handle_auth_done global_id 104126 payload 824 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f940413dcb0 msgr2=0x7f9404137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f940413dcb0 0x7f9404137cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f94040a3bb0 msgr2=0x7f9404137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f94040a3bb0 0x7f9404137240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 monclient: found mon.noname-c 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.699+0000 7f94037fe640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9404138de0 con 0x7f940413b380 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f94037fe640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 msgr2=0x7f9404137780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f94037fe640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 0x7f9404137780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93f400c7c0 tx=0x7f93f400cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4015070 con 0x7f940413b380 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: dump: 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4007c40 con 0x7f940413b380 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40113f0 con 0x7f940413b380 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f94027fc640 4 set_mon_vals no callback set 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 10 monclient: dump: 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 5 monclient: authenticate success, global_id 104126 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 10 monclient: _renew_subs 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9404139280 con 0x7f940413b380 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 10 monclient: _renew_subs 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f940413a830 con 0x7f940413b380 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f93f40115d0 con 0x7f940413b380 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.701+0000 7f940a2a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f940a2a0640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 0x7f940412b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f940413d810 con 0x7f9404138200 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 0x7f940412b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient: get_auth_request con 0x7f9404138200 auth_method 0 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9400ff9640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93d403dd60 0x7f93d4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(261..261 src has 167..261) ==== 4811+0+0 (secure 0 0 0) 0x7f93f4052ad0 con 0x7f940413b380 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 10 monclient(hunting): handle_auth_done global_id 104129 payload 824 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9403fff640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f940413aa70 con 0x7f9404138200 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9408816640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93d403dd60 0x7f93d4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.702+0000 7f9408816640 10 monclient: get_auth_request con 0x7f93d403dd60 auth_method 0 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9403fff640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 msgr2=0x7f940412b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9403fff640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 0x7f940412b710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7f0 tx=0x7f93f000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0017070 con 0x7f9404138200 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 10 monclient: dump: 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f93f000cb40 con 0x7f9404138200 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 msgr2=0x7f940412b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 0x7f940412b710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7f0 tx=0x7f93f000ecc0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 msgr2=0x7f940412b710 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9400ff9640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9404138200 0x7f940412b710 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7f0 tx=0x7f93f000ecc0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.704+0000 7f9408816640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93d403dd60 0x7f93d4040220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93f8036000 tx=0x7f93f8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f940a2a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:41.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f940a2a0640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 0x7f94040638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f940a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f94041385e0 con 0x7f940409eb40 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f9403fff640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 0x7f94040638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f9403fff640 10 monclient: get_auth_request con 0x7f940409eb40 auth_method 0 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f9403fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f9403fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.707+0000 7f9403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.708+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.708+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.708+0000 7f9403fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.708+0000 7f9403fff640 10 monclient(hunting): handle_auth_done global_id 104132 payload 824 2026-02-17T11:52:41.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.708+0000 7f9403fff640 1 -- 10.20.193.51:0/439038513 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9404074db0 con 0x7f940409eb40 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9403fff640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 msgr2=0x7f94040638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9403fff640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 0x7f94040638c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7f0 tx=0x7f93f00059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0017070 con 0x7f940409eb40 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 10 monclient: dump: 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f93f00067c0 con 0x7f940409eb40 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 msgr2=0x7f94040638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 0x7f94040638c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7f0 tx=0x7f93f00059d0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 msgr2=0x7f94040638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9400ff9640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940409eb40 0x7f94040638c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26675, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.713 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:41.714 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.715 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.716 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.717 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:41.718 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93d403dd60 msgr2=0x7f93d4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93d403dd60 0x7f93d4040220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93f8036000 tx=0x7f93f8033000 comp rx=0 tx=0).stop 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 10 monclient: shutdown 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 msgr2=0x7f9404137780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 --2- 10.20.193.51:0/439038513 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f940413b380 0x7f9404137780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93f400c7c0 tx=0x7f93f400cc90 comp rx=0 tx=0).stop 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9408816640 1 -- 10.20.193.51:0/439038513 reap_dead start 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f9408816640 1 -- 10.20.193.51:0/439038513 reap_dead start 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 shutdown_connections 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 >> 10.20.193.51:0/439038513 conn(0x7f94040a30c0 msgr2=0x7f9404133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 shutdown_connections 2026-02-17T11:52:41.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.710+0000 7f940a2a0640 1 -- 10.20.193.51:0/439038513 wait complete. 2026-02-17T11:52:41.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:41.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:52:41.719 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: finishing write tid 1 to trial14245205-49 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: finishing write tid 2 to trial14245205-49 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: finishing write tid 3 to trial14245205-49 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: finishing write tid 4 to trial14245205-49 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: oid 49 updating version 0 to 864 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: oid 49 version 864 is already newer than 863 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: oid 49 version 864 is already newer than 862 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 864 (ObjNum 365 snap 116 seq_num 365) dirty exists 2026-02-17T11:52:41.786 INFO:tasks.rados.rados.0.trial142.stdout:1036: left oid 49 (ObjNum 365 snap 116 seq_num 365) 2026-02-17T11:52:41.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: get_monmap_and_config 2026-02-17T11:52:41.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: monmap: 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:41.787015+0000 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:41.787015+0000 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:41.788 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 Processor -- start 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 -- start start 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: init 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a3bb0 0x7f442009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-b con 0x7f44200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44200a0750 0x7f442009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-a con 0x7f44200a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f442009e540 0x7f442013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-c con 0x7f442009e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:41.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f44200a3f90 con 0x7f44200a0750 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f442006e140 con 0x7f442009e540 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f442009f910 con 0x7f44200a3bb0 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4426fe6640 10 monclient(hunting): authenticate will time out at 1049.405815s 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44200a0750 0x7f442009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4424d5b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a3bb0 0x7f442009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f44200a0750 0x7f442009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33642/0 (socket says 10.20.193.51:33642) 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4424d5b640 10 monclient(hunting): get_auth_request con 0x7f44200a3bb0 auth_method 0 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 1 -- 10.20.193.51:0/4062095601 learned_addr learned my addr 10.20.193.51:0/4062095601 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4424d5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4424d5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4424d5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): get_auth_request con 0x7f44200a0750 auth_method 0 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f442555c640 1 --2- 10.20.193.51:0/4062095601 >> v2:10.20.193.142:3300/0 conn(0x7f442009e540 0x7f442013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.786+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f442555c640 10 monclient(hunting): get_auth_request con 0x7f442009e540 auth_method 0 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f442555c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f442555c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f442555c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 10 monclient(hunting): handle_auth_done global_id 74388 payload 274 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 -- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a3bb0 msgr2=0x7f442009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 --2- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a3bb0 0x7f442009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 -- 10.20.193.51:0/4062095601 >> v2:10.20.193.142:3300/0 conn(0x7f442009e540 msgr2=0x7f442013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 --2- 10.20.193.51:0/4062095601 >> v2:10.20.193.142:3300/0 conn(0x7f442009e540 0x7f442013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 monclient: found mon.noname-a 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.787+0000 7f4417fff640 1 -- 10.20.193.51:0/4062095601 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442009ccd0 con 0x7f44200a0750 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4417fff640 1 -- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44200a0750 msgr2=0x7f442009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4417fff640 1 --2- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44200a0750 0x7f442009e000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f442009f230 tx=0x7f440802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8bc390397da2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 1 -- 10.20.193.51:0/4062095601 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440803c070 con 0x7f44200a0750 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: dump: 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 1 -- 10.20.193.51:0/4062095601 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440802fca0 con 0x7f44200a0750 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 5 monclient: authenticate success, global_id 74388 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 1 -- 10.20.193.51:0/4062095601 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408037660 con 0x7f44200a0750 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f44177fe640 10 monclient: dump: 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.799 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 4 set_mon_vals no callback set 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 10 monclient: shutdown 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 1 -- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44200a0750 msgr2=0x7f442009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.789+0000 7f4426fe6640 1 --2- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44200a0750 0x7f442009e000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f442009f230 tx=0x7f440802ee60 comp rx=0 tx=0).stop 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 -- 10.20.193.51:0/4062095601 shutdown_connections 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 --2- 10.20.193.51:0/4062095601 >> v2:10.20.193.142:3300/0 conn(0x7f442009e540 0x7f442013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 --2- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44200a0750 0x7f442009e000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 --2- 10.20.193.51:0/4062095601 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a3bb0 0x7f442009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 -- 10.20.193.51:0/4062095601 >> 10.20.193.51:0/4062095601 conn(0x7f44200a30c0 msgr2=0x7f44200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 -- 10.20.193.51:0/4062095601 shutdown_connections 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 -- 10.20.193.51:0/4062095601 wait complete. 2026-02-17T11:52:41.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 10 monclient: monmap: 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 Processor -- start 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 1 -- start start 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 10 monclient: init 2026-02-17T11:52:41.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.790+0000 7f4426fe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f442009e540 0x7f4420130be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-a con 0x7f442009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-c con 0x7f44200a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44200a3bb0 0x7f4420131660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): picked mon.noname-b con 0x7f44200a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44200a04b0 con 0x7f442009e540 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f442009c850 con 0x7f44200a3bb0 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f442013cca0 con 0x7f44200a0750 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4426fe6640 10 monclient(hunting): authenticate will time out at 1049.410046s 2026-02-17T11:52:41.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f442009e540 0x7f4420130be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f442009e540 0x7f4420130be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33644/0 (socket says 10.20.193.51:33644) 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36580/0 (socket says 10.20.193.51:36580) 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 1 -- 10.20.193.51:0/1722620389 learned_addr learned my addr 10.20.193.51:0/1722620389 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): get_auth_request con 0x7f442009e540 auth_method 0 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): get_auth_request con 0x7f44200a0750 auth_method 0 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient(hunting): handle_auth_done global_id 104138 payload 824 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44200a3bb0 msgr2=0x7f4420131660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44200a3bb0 0x7f4420131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f442009e540 msgr2=0x7f4420130be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f442009e540 0x7f4420130be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 monclient: found mon.noname-c 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.791+0000 7f4417fff640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442009d7b0 con 0x7f44200a0750 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4417fff640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 msgr2=0x7f4420131120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4417fff640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4420051340 tx=0x7f4408004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408047070 con 0x7f44200a0750 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: dump: 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.809 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440802fe50 con 0x7f44200a0750 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440803c040 con 0x7f44200a0750 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f44157fa640 10 monclient: dump: 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4416ffd640 4 set_mon_vals no callback set 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 5 monclient: authenticate success, global_id 104138 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 monclient: _renew_subs 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442006f410 con 0x7f44200a0750 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 monclient: _renew_subs 2026-02-17T11:52:41.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201345a0 con 0x7f44200a0750 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 0x7f44201ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.793+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f442009dac0 con 0x7f4420133080 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f440803fa30 con 0x7f44200a0750 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 0x7f44201ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient: get_auth_request con 0x7f4420133080 auth_method 0 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f44157fa640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43f003dd10 0x7f43f00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(261..261 src has 167..261) ==== 4811+0+0 (secure 0 0 0) 0x7f4408076f20 con 0x7f44200a0750 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f442555c640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43f003dd10 0x7f43f00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f442555c640 10 monclient: get_auth_request con 0x7f43f003dd10 auth_method 0 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 10 monclient(hunting): handle_auth_done global_id 64342 payload 824 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.794+0000 7f4424d5b640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4420069830 con 0x7f4420133080 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.796+0000 7f4424d5b640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 msgr2=0x7f44201ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.796+0000 7f4424d5b640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 0x7f44201ceff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f441000f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410019070 con 0x7f4420133080 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 10 monclient: dump: 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.813 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f442555c640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43f003dd10 0x7f43f00401d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f441c009fa0 tx=0x7f441c0096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f4410004240 con 0x7f4420133080 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 msgr2=0x7f44201ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 0x7f44201ceff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f441000f610 comp rx=0 tx=0).stop 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 msgr2=0x7f44201ceff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.797+0000 7f44157fa640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4420133080 0x7f44201ceff0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f441000f610 comp rx=0 tx=0).stop 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4426fe6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4426fe6640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 0x7f44201da340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4426fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4420050ac0 con 0x7f44201cf530 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 0x7f44201da340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient: get_auth_request con 0x7f44201cf530 auth_method 0 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.800+0000 7f4424d5b640 10 monclient(hunting): handle_auth_done global_id 64345 payload 824 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.801+0000 7f4424d5b640 1 -- 10.20.193.51:0/1722620389 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44201cf940 con 0x7f44201cf530 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f4424d5b640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 msgr2=0x7f44201da340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f4424d5b640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 0x7f44201da340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f44100047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410019040 con 0x7f44201cf530 2026-02-17T11:52:41.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 10 monclient: dump: 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f441001e660 con 0x7f44201cf530 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 msgr2=0x7f44201da340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 0x7f44201da340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f44100047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 msgr2=0x7f44201da340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f44157fa640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44201cf530 0x7f44201da340 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4410011c00 tx=0x7f44100047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 233350, 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:41.817 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:41.818 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:41.819 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:41.820 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.821 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.822 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:41.823 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:52:41.825 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:41.826 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.803+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43f003dd10 msgr2=0x7f43f00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43f003dd10 0x7f43f00401d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f441c009fa0 tx=0x7f441c0096a0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 10 monclient: shutdown 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 msgr2=0x7f4420131120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4420051340 tx=0x7f4408004830 comp rx=0 tx=0).stop 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f442555c640 1 -- 10.20.193.51:0/1722620389 reap_dead start 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 shutdown_connections 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 --2- 10.20.193.51:0/1722620389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44200a0750 0x7f4420131120 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 >> 10.20.193.51:0/1722620389 conn(0x7f44200a30c0 msgr2=0x7f4420072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 shutdown_connections 2026-02-17T11:52:41.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.804+0000 7f4426fe6640 1 -- 10.20.193.51:0/1722620389 wait complete. 2026-02-17T11:52:41.828 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:41.828 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:52:41.828 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.893+0000 7f11524d3640 10 monclient: get_monmap_and_config 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.893+0000 7f11524d3640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.893+0000 7f11524d3640 10 monclient: monmap: 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:41.894579+0000 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:41.894579+0000 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:41.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 Processor -- start 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 -- start start 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient: init 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 0x7f114c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-b con 0x7f114c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f114c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f114c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114c06e140 con 0x7f114c13b760 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114c09f910 con 0x7f114c0a0750 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f114c09ccd0 con 0x7f114c0a3bb0 2026-02-17T11:52:41.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f11524d3640 10 monclient(hunting): authenticate will time out at 1049.513387s 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 0x7f114c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f1150a49640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f114c13b760 0x7f114c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52454/0 (socket says 10.20.193.51:52454) 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f1150a49640 1 -- 10.20.193.51:0/4256463068 learned_addr learned my addr 10.20.193.51:0/4256463068 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): get_auth_request con 0x7f114c0a3bb0 auth_method 0 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient(hunting): handle_auth_done global_id 104141 payload 274 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 1 -- 10.20.193.51:0/4256463068 >> v1:10.20.193.142:6789/0 conn(0x7f114c0a0750 legacy=0x7f114c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 1 -- 10.20.193.51:0/4256463068 >> v1:10.20.193.51:6789/0 conn(0x7f114c13b760 legacy=0x7f114c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 1 monclient: found mon.noname-b 2026-02-17T11:52:41.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.894+0000 7f114bfff640 1 -- 10.20.193.51:0/4256463068 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c09eec0 con 0x7f114c0a3bb0 2026-02-17T11:52:41.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114bfff640 1 -- 10.20.193.51:0/4256463068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 msgr2=0x7f114c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114bfff640 1 --2- 10.20.193.51:0/4256463068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 0x7f114c09dac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f114c069d60 tx=0x7f113802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20a1600002f0f67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 1 -- 10.20.193.51:0/4256463068 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113803c070 con 0x7f114c0a3bb0 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: dump: 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 1 -- 10.20.193.51:0/4256463068 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113802fce0 con 0x7f114c0a3bb0 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 5 monclient: authenticate success, global_id 104141 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 1 -- 10.20.193.51:0/4256463068 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138037660 con 0x7f114c0a3bb0 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 4 set_mon_vals no callback set 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f114affd640 10 monclient: dump: 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.906 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 10 monclient: shutdown 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 -- 10.20.193.51:0/4256463068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 msgr2=0x7f114c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 --2- 10.20.193.51:0/4256463068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 0x7f114c09dac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f114c069d60 tx=0x7f113802ed80 comp rx=0 tx=0).stop 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 -- 10.20.193.51:0/4256463068 shutdown_connections 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 --2- 10.20.193.51:0/4256463068 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a3bb0 0x7f114c09dac0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 -- 10.20.193.51:0/4256463068 >> 10.20.193.51:0/4256463068 conn(0x7f114c0a30c0 msgr2=0x7f114c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 -- 10.20.193.51:0/4256463068 shutdown_connections 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.897+0000 7f11524d3640 1 -- 10.20.193.51:0/4256463068 wait complete. 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient: build_initial_monmap 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient: monmap: 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:41.907 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 Processor -- start 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 -- start start 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient: init 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-c con 0x7f114c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f114c0a3bb0 0x7f114c095700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-b con 0x7f114c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:41.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f114c13b760 0x7f114c095c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): picked mon.noname-a con 0x7f114c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f114c0a04b0 con 0x7f114c13b760 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f114c09c850 con 0x7f114c0a3bb0 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f114c09e710 con 0x7f114c0a0750 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f11524d3640 10 monclient(hunting): authenticate will time out at 1049.517618s 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36596/0 (socket says 10.20.193.51:36596) 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 -- 10.20.193.51:0/1327493589 learned_addr learned my addr 10.20.193.51:0/1327493589 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): get_auth_request con 0x7f114c0a0750 auth_method 0 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f114c13b760 0x7f114c095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): get_auth_request con 0x7f114c13b760 auth_method 0 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f1150a49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient(hunting): handle_auth_done global_id 104144 payload 824 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114b7fe640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f114c0a3bb0 0x7f114c095700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 -- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f114c0a3bb0 msgr2=0x7f114c095700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f114c0a3bb0 0x7f114c095700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 -- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f114c13b760 msgr2=0x7f114c095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f114c13b760 0x7f114c095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:41.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 monclient: found mon.noname-c 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.898+0000 7f114bfff640 1 -- 10.20.193.51:0/1327493589 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c098da0 con 0x7f114c0a0750 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.900+0000 7f114bfff640 1 -- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 msgr2=0x7f114c0951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.900+0000 7f114bfff640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11380099d0 tx=0x7f11380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138047020 con 0x7f114c0a0750 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: dump: 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.911 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1138042670 con 0x7f114c0a0750 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 5 monclient: authenticate success, global_id 104144 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _renew_subs 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c09d7b0 con 0x7f114c0a0750 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113803c040 con 0x7f114c0a0750 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f114a7fc640 4 set_mon_vals no callback set 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 10 monclient: dump: 2026-02-17T11:52:41.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _renew_subs 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c098ac0 con 0x7f114c0a0750 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114c09dac0 con 0x7f114c0a0750 2026-02-17T11:52:41.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.901+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1138042a60 con 0x7f114c0a0750 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.902+0000 7f1148ff9640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 0x7f111c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.902+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(261..261 src has 167..261) ==== 4811+0+0 (secure 0 0 0) 0x7f1138077f00 con 0x7f114c0a0750 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.902+0000 7f114b7fe640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 0x7f111c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.902+0000 7f114b7fe640 10 monclient: get_auth_request con 0x7f111c03dd60 auth_method 0 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.904+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1138051030 con 0x7f114c0a0750 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.904+0000 7f1148ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.904+0000 7f1148ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:41.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:41.904+0000 7f114b7fe640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 0x7f111c040220 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f114c0972b0 tx=0x7f113c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:42.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.018+0000 7f11524d3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:52:42.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.018+0000 7f11524d3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:52:42.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.018+0000 7f11524d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:42.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.018+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f114c0a2d20 con 0x7f114c0a0750 2026-02-17T11:52:42.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.019+0000 7f1148ff9640 1 -- 10.20.193.51:0/1327493589 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f1138041e20 con 0x7f114c0a0750 2026-02-17T11:52:42.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.019+0000 7f1148ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:52:42.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.019+0000 7f1148ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=12,logm=60} crc {auth=736615333,config=692619927,health=3778872965,kv=643764953,logm=1783713765}) 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=10,kv=10,logm=62} crc {auth=1932421967,config=692619927,health=1228072951,kv=904623928,logm=1742820365}) 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=12,logm=60} crc {auth=736615333,config=692619927,health=3778872965,kv=643764953,logm=1783713765}) 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.019+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=11,logm=58} crc {auth=3275124442,config=692619927,health=2301855438,kv=1982221976,logm=3072845860}) 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338249650}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4175542696}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338249650}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2480005701}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866968766}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2814639259}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866968766}) 2026-02-17T11:52:42.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=738088423}) 2026-02-17T11:52:42.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 msgr2=0x7f111c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:42.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 0x7f111c040220 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f114c0972b0 tx=0x7f113c009040 comp rx=0 tx=0).stop 2026-02-17T11:52:42.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 10 monclient: shutdown 2026-02-17T11:52:42.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 msgr2=0x7f114c0951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11380099d0 tx=0x7f11380047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 shutdown_connections 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f111c03dd60 0x7f111c040220 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f114c13b760 0x7f114c095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f114c0a3bb0 0x7f114c095700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 --2- 10.20.193.51:0/1327493589 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f114c0a0750 0x7f114c0951c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 >> 10.20.193.51:0/1327493589 conn(0x7f114c0a30c0 msgr2=0x7f114c13ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 shutdown_connections 2026-02-17T11:52:42.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:42.020+0000 7f11524d3640 1 -- 10.20.193.51:0/1327493589 wait complete. 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=478477192}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3090339722}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=478477192}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.020+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3604103428}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=913242606}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4220602220}) 2026-02-17T11:52:42.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=913242606}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2907930738}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277323915}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1409900377}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277323915}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.021+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3339675487}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252897734}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1921815203}) 2026-02-17T11:52:42.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252897734}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4001117673}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339953559}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1738797716}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339953559}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.022+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2736267134}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159922664}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1875364810}) 2026-02-17T11:52:42.035 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159922664}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=863671649}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084465845}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2150955122}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084465845}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3581333727}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1696884740}) 2026-02-17T11:52:42.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=253651072}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1696884740}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.023+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=802545672}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=729506396}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1998106121}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=729506396}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1032391550}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4125622876}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3584236698}) 2026-02-17T11:52:42.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4125622876}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.024+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2415111427}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=127394143}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2348379253}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=127394143}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2357156393}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177979834}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4197147586}) 2026-02-17T11:52:42.038 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177979834}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.025+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4161567931}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158223058}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2764105995}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158223058}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2288579786}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333605687}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2346021987}) 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.039 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333605687}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1056429649}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156595247}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1344956564}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156595247}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.026+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=81586260}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=978325021}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1641283528}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=978325021}) 2026-02-17T11:52:42.040 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2766569642}) 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=159363133}) 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1777407824}) 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=159363133}) 2026-02-17T11:52:42.041 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.027+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2761470432}) 2026-02-17T11:52:42.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:52:42.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2597696427}) 2026-02-17T11:52:42.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=461217298}) 2026-02-17T11:52:42.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2597696427}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2051442308}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=536121191}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1308318239}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=536121191}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.028+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2929971360}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190025328}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2477766203}) 2026-02-17T11:52:42.046 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190025328}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2978237237}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=5} crc {logm=3434470695,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgrstat=3675466649,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=281702470,osd_snap=1019235178}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=50,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=8} crc {logm=1953497696,mdsmap=3207544932,mgr=2165206045,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1442428036,mon_config_key=2056056423,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=281702470,osd_snap=1546319896}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=5} crc {logm=3434470695,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgrstat=3675466649,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=281702470,osd_snap=1019235178}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.029+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=6} crc {logm=975351908,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1988865142,mon_config_key=2551492584,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=281702470,osd_snap=706753371}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=32,osdmap=68} crc {osd_snap=1367994551,osdmap=3562656882}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=35,osdmap=65} crc {osd_snap=3763912493,osdmap=582680723}) 2026-02-17T11:52:42.047 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=32,osdmap=68} crc {osd_snap=1367994551,osdmap=3562656882}) 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.030+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=35,osdmap=65} crc {osd_snap=3763912493,osdmap=2340165762}) 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=3051835445}) 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=80} crc {osdmap=2475001769}) 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=3051835445}) 2026-02-17T11:52:42.048 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:52:42.032+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=82} crc {osdmap=2118208342}) 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1034: done (2 left) 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1036: done (1 left) 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1037: done (0 left) 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1038: read oid 9 snap -1 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1038: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:52:42.676 INFO:tasks.rados.rados.0.trial142.stdout:1039: delete oid 32 current snap is 117 2026-02-17T11:52:42.677 INFO:tasks.rados.rados.0.trial142.stdout:1039: done (1 left) 2026-02-17T11:52:42.677 INFO:tasks.rados.rados.0.trial142.stdout:1040: read oid 22 snap -1 2026-02-17T11:52:42.678 INFO:tasks.rados.rados.0.trial142.stdout:1040: expect deleted 2026-02-17T11:52:42.678 INFO:tasks.rados.rados.0.trial142.stdout:1041: rollback oid 30 current snap is 117 2026-02-17T11:52:42.678 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 30 to 116 2026-02-17T11:52:42.678 INFO:tasks.rados.rados.0.trial142.stdout:1042: write (excl) oid 6 current snap is 117 2026-02-17T11:52:42.678 INFO:tasks.rados.rados.0.trial142.stdout:1042: seq_num 367 ranges {568169=401327,1376068=669790} 2026-02-17T11:52:42.681 INFO:tasks.rados.rados.0.trial142.stdout:1042: writing trial14245205-6 from 568169 to 969496 tid 1 2026-02-17T11:52:42.685 INFO:tasks.rados.rados.0.trial142.stdout:1042: writing trial14245205-6 from 1376068 to 2045858 tid 2 2026-02-17T11:52:42.685 INFO:tasks.rados.rados.0.trial142.stdout:1043: rollback oid 13 current snap is 117 2026-02-17T11:52:42.685 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 13 to 114 2026-02-17T11:52:42.686 INFO:tasks.rados.rados.0.trial142.stdout:1038: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1041: finishing rollback tid 0 to trial14245205-30 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1041: finishing rollback tid 1 to trial14245205-30 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1041: finishing rollback tid 2 to trial14245205-30 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 454 (ObjNum 213 snap 69 seq_num 213) dirty exists 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: finishing write tid 1 to trial14245205-6 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: finishing write tid 2 to trial14245205-6 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: finishing write tid 3 to trial14245205-6 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1043: finishing rollback tid 0 to trial14245205-13 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: finishing write tid 4 to trial14245205-6 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: oid 6 updating version 0 to 619 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: oid 6 updating version 619 to 620 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: oid 6 version 620 is already newer than 618 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 620 (ObjNum 367 snap 117 seq_num 367) dirty exists 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: left oid 6 (ObjNum 367 snap 117 seq_num 367) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1043: finishing rollback tid 1 to trial14245205-13 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1043: finishing rollback tid 2 to trial14245205-13 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 696 (ObjNum 340 snap 110 seq_num 340) dirty exists 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1038: done (4 left) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1040: done (3 left) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1041: done (2 left) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1042: done (1 left) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1043: done (0 left) 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1044: write (excl) oid 29 current snap is 117 2026-02-17T11:52:42.832 INFO:tasks.rados.rados.0.trial142.stdout:1044: seq_num 368 ranges {584976=476576,1834550=350426} 2026-02-17T11:52:42.836 INFO:tasks.rados.rados.0.trial142.stdout:1044: writing trial14245205-29 from 584976 to 1061552 tid 1 2026-02-17T11:52:42.840 INFO:tasks.rados.rados.0.trial142.stdout:1044: writing trial14245205-29 from 1834550 to 2184976 tid 2 2026-02-17T11:52:42.840 INFO:tasks.rados.rados.0.trial142.stdout:1045: read oid 35 snap 116 2026-02-17T11:52:42.840 INFO:tasks.rados.rados.0.trial142.stdout:1045: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:52:42.841 INFO:tasks.rados.rados.0.trial142.stdout:1046: rollback oid 5 current snap is 117 2026-02-17T11:52:42.841 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 5 to 81 2026-02-17T11:52:42.841 INFO:tasks.rados.rados.0.trial142.stdout:1044: finishing write tid 1 to trial14245205-29 2026-02-17T11:52:42.841 INFO:tasks.rados.rados.0.trial142.stdout:1047: write (excl) oid 32 current snap is 117 2026-02-17T11:52:42.841 INFO:tasks.rados.rados.0.trial142.stdout:1047: seq_num 369 ranges {601783=551825,1776679=425104} 2026-02-17T11:52:42.844 INFO:tasks.rados.rados.0.trial142.stdout:1047: writing trial14245205-32 from 601783 to 1153608 tid 1 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1047: writing trial14245205-32 from 1776679 to 2201783 tid 2 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1048: rollback oid 3 current snap is 117 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 116 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: finishing write tid 2 to trial14245205-29 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: finishing write tid 3 to trial14245205-29 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: finishing write tid 4 to trial14245205-29 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: oid 29 updating version 0 to 457 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: oid 29 version 457 is already newer than 455 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: oid 29 version 457 is already newer than 456 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 457 (ObjNum 368 snap 117 seq_num 368) dirty exists 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1044: left oid 29 (ObjNum 368 snap 117 seq_num 368) 2026-02-17T11:52:42.849 INFO:tasks.rados.rados.0.trial142.stdout:1045: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:52:42.988 INFO:tasks.rados.rados.0.trial142.stdout:1046: finishing rollback tid 0 to trial14245205-5 2026-02-17T11:52:42.988 INFO:tasks.rados.rados.0.trial142.stdout:1046: finishing rollback tid 1 to trial14245205-5 2026-02-17T11:52:42.988 INFO:tasks.rados.rados.0.trial142.stdout:1046: finishing rollback tid 2 to trial14245205-5 2026-02-17T11:52:42.988 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 604 (ObjNum 249 snap 79 seq_num 249) dirty exists 2026-02-17T11:52:42.988 INFO:tasks.rados.rados.0.trial142.stdout:1047: finishing write tid 1 to trial14245205-32 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: finishing write tid 2 to trial14245205-32 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: finishing write tid 3 to trial14245205-32 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: finishing write tid 4 to trial14245205-32 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: oid 32 updating version 0 to 692 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: oid 32 version 692 is already newer than 690 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: oid 32 version 692 is already newer than 691 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 692 (ObjNum 369 snap 117 seq_num 369) dirty exists 2026-02-17T11:52:42.989 INFO:tasks.rados.rados.0.trial142.stdout:1047: left oid 32 (ObjNum 369 snap 117 seq_num 369) 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1048: finishing rollback tid 0 to trial14245205-3 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1048: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1048: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 388 (ObjNum 335 snap 109 seq_num 335) dirty exists 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1044: done (4 left) 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1045: done (3 left) 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1046: done (2 left) 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1047: done (1 left) 2026-02-17T11:52:42.990 INFO:tasks.rados.rados.0.trial142.stdout:1048: done (0 left) 2026-02-17T11:52:42.991 INFO:tasks.rados.rados.0.trial142.stdout:1049: snap_create 2026-02-17T11:52:43.043 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:52:43.043 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:43.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.108+0000 7f0ff8cf3640 10 monclient: get_monmap_and_config 2026-02-17T11:52:43.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.108+0000 7f0ff8cf3640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.108+0000 7f0ff8cf3640 10 monclient: monmap: 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:43.109618+0000 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:43.109618+0000 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 Processor -- start 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 -- start start 2026-02-17T11:52:43.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient: init 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ff40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f0ff40a0750 0x7f0ff409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-c con 0x7f0ff40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 0x7f0ff413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-b con 0x7f0ff413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff406e140 con 0x7f0ff40a3bb0 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff409f910 con 0x7f0ff40a0750 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff409ccd0 con 0x7f0ff413b760 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff8cf3640 10 monclient(hunting): authenticate will time out at 1050.728415s 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f0ff40a3bb0 0x7f0ff409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52468/0 (socket says 10.20.193.51:52468) 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2575640 1 -- 10.20.193.51:0/68463325 learned_addr learned my addr 10.20.193.51:0/68463325 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 --2- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 0x7f0ff413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): get_auth_request con 0x7f0ff413b760 auth_method 0 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff1d74640 1 --2- 10.20.193.51:0/68463325 >> v2:10.20.193.142:3300/0 conn(0x7f0ff40a0750 0x7f0ff409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff1d74640 10 monclient(hunting): get_auth_request con 0x7f0ff40a0750 auth_method 0 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_done global_id 104147 payload 274 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 -- 10.20.193.51:0/68463325 >> v2:10.20.193.142:3300/0 conn(0x7f0ff40a0750 msgr2=0x7f0ff409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 --2- 10.20.193.51:0/68463325 >> v2:10.20.193.142:3300/0 conn(0x7f0ff40a0750 0x7f0ff409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 -- 10.20.193.51:0/68463325 >> v1:10.20.193.51:6789/0 conn(0x7f0ff40a3bb0 legacy=0x7f0ff409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 monclient: found mon.noname-b 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.109+0000 7f0ff2d76640 1 -- 10.20.193.51:0/68463325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff409eec0 con 0x7f0ff413b760 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff2d76640 1 -- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 msgr2=0x7f0ff413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff2d76640 1 --2- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 0x7f0ff413db50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ff406f3c0 tx=0x7f0fe402f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=991c4a41bc2fa5ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 1 -- 10.20.193.51:0/68463325 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe403c070 con 0x7f0ff413b760 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: dump: 2026-02-17T11:52:43.119 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 1 -- 10.20.193.51:0/68463325 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe4037440 con 0x7f0ff413b760 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 5 monclient: authenticate success, global_id 104147 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 1 -- 10.20.193.51:0/68463325 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4037810 con 0x7f0ff413b760 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff1573640 10 monclient: dump: 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 4 set_mon_vals no callback set 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 10 monclient: shutdown 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 msgr2=0x7f0ff413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 0x7f0ff413db50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ff406f3c0 tx=0x7f0fe402f130 comp rx=0 tx=0).stop 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/68463325 shutdown_connections 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/68463325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff413b760 0x7f0ff413db50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/68463325 >> v2:10.20.193.142:3300/0 conn(0x7f0ff40a0750 0x7f0ff409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/68463325 >> 10.20.193.51:0/68463325 conn(0x7f0ff40a30c0 msgr2=0x7f0ff40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/68463325 shutdown_connections 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.112+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/68463325 wait complete. 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient: monmap: 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 Processor -- start 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 -- start start 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient: init 2026-02-17T11:52:43.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-c con 0x7f0ff40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ff40a3bb0 0x7f0ff41ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-b con 0x7f0ff40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 0x7f0ff4090f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): picked mon.noname-a con 0x7f0ff413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40a04b0 con 0x7f0ff413b760 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff409c850 con 0x7f0ff40a3bb0 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff409e710 con 0x7f0ff40a0750 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff8cf3640 10 monclient(hunting): authenticate will time out at 1050.732761s 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 0x7f0ff4090f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36616/0 (socket says 10.20.193.51:36616) 2026-02-17T11:52:43.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): get_auth_request con 0x7f0ff413b760 auth_method 0 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 1 -- 10.20.193.51:0/1284898338 learned_addr learned my addr 10.20.193.51:0/1284898338 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): get_auth_request con 0x7f0ff40a0750 auth_method 0 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff1d74640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ff40a3bb0 0x7f0ff41ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff1d74640 10 monclient(hunting): get_auth_request con 0x7f0ff40a3bb0 auth_method 0 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.113+0000 7f0ff1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 10 monclient(hunting): handle_auth_done global_id 104150 payload 824 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 -- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ff40a3bb0 msgr2=0x7f0ff41ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ff40a3bb0 0x7f0ff41ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 -- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 msgr2=0x7f0ff4090f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 0x7f0ff4090f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 monclient: found mon.noname-c 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2575640 1 -- 10.20.193.51:0/1284898338 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4093260 con 0x7f0ff40a0750 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.114+0000 7f0ff2d76640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 0x7f0ff4090f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff2575640 1 -- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 msgr2=0x7f0ff41cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff2575640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c780 tx=0x7f0fe800cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8005de0 con 0x7f0ff40a0750 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: dump: 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.125 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe8007070 con 0x7f0ff40a0750 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8007440 con 0x7f0ff40a0750 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff0d72640 4 set_mon_vals no callback set 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0fdaffd640 10 monclient: dump: 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.126 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 5 monclient: authenticate success, global_id 104150 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _renew_subs 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40a2490 con 0x7f0ff40a0750 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _renew_subs 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff409d7b0 con 0x7f0ff40a0750 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.116+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff409dac0 con 0x7f0ff40a0750 2026-02-17T11:52:43.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.117+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0fe8007620 con 0x7f0ff40a0750 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.117+0000 7f0fdaffd640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 0x7f0fc00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.117+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f0fe80523e0 con 0x7f0ff40a0750 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.117+0000 7f0ff1d74640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 0x7f0fc00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.117+0000 7f0ff1d74640 10 monclient: get_auth_request con 0x7f0fc003dd10 auth_method 0 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.119+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0fe8011a00 con 0x7f0ff40a0750 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.119+0000 7f0fdaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.119+0000 7f0fdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:43.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.120+0000 7f0ff1d74640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 0x7f0fc00401d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ff413aa00 tx=0x7f0fdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0ff8cf3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:43.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0ff8cf3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0ff8cf3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0ff40008d0 con 0x7f0ff40a0750 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0fdaffd640 1 -- 10.20.193.51:0/1284898338 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f0fe80520c0 con 0x7f0ff40a0750 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0fdaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.233+0000 7f0fdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:43.236 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 msgr2=0x7f0fc00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 0x7f0fc00401d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ff413aa00 tx=0x7f0fdc008040 comp rx=0 tx=0).stop 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 10 monclient: shutdown 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 msgr2=0x7f0ff41cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c780 tx=0x7f0fe800cc50 comp rx=0 tx=0).stop 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 shutdown_connections 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0fc003dd10 0x7f0fc00401d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ff413b760 0x7f0ff4090f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ff40a3bb0 0x7f0ff41ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 --2- 10.20.193.51:0/1284898338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ff40a0750 0x7f0ff41cdb20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 >> 10.20.193.51:0/1284898338 conn(0x7f0ff40a30c0 msgr2=0x7f0ff413ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 shutdown_connections 2026-02-17T11:52:43.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.234+0000 7f0ff8cf3640 1 -- 10.20.193.51:0/1284898338 wait complete. 2026-02-17T11:52:43.244 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:52:43.244 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:52:43.245 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:52:43.245 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:52:43.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: get_monmap_and_config 2026-02-17T11:52:43.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: monmap: 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:43.312242+0000 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:43.312242+0000 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:43.316 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 1 Processor -- start 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 1 -- start start 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: init 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.311+0000 7f3962f1b640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f395c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f395c0a0750 0x7f395c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-c con 0x7f395c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:43.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-b con 0x7f395c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c06e140 con 0x7f395c0a3bb0 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f395c09f910 con 0x7f395c0a0750 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f395c09ccd0 con 0x7f395c13b760 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3962f1b640 10 monclient(hunting): authenticate will time out at 1050.931036s 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36624/0 (socket says 10.20.193.51:36624) 2026-02-17T11:52:43.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 -- 10.20.193.51:0/719286016 learned_addr learned my addr 10.20.193.51:0/719286016 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): get_auth_request con 0x7f395c13b760 auth_method 0 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3953fff640 1 --2- 10.20.193.51:0/719286016 >> v2:10.20.193.142:3300/0 conn(0x7f395c0a0750 0x7f395c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3953fff640 10 monclient(hunting): get_auth_request con 0x7f395c0a0750 auth_method 0 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3953fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3953fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3953fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient(hunting): handle_auth_done global_id 104153 payload 274 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 -- 10.20.193.51:0/719286016 >> v2:10.20.193.142:3300/0 conn(0x7f395c0a0750 msgr2=0x7f395c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 --2- 10.20.193.51:0/719286016 >> v2:10.20.193.142:3300/0 conn(0x7f395c0a0750 0x7f395c09e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 -- 10.20.193.51:0/719286016 >> v1:10.20.193.142:6789/0 conn(0x7f395c0a3bb0 legacy=0x7f395c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 monclient: found mon.noname-b 2026-02-17T11:52:43.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.312+0000 7f3961491640 1 -- 10.20.193.51:0/719286016 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c09eec0 con 0x7f395c13b760 2026-02-17T11:52:43.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f3961491640 1 -- 10.20.193.51:0/719286016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 msgr2=0x7f395c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f3961491640 1 --2- 10.20.193.51:0/719286016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f395c06f3c0 tx=0x7f395802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=817d619d97342065 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 1 -- 10.20.193.51:0/719286016 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395802fe60 con 0x7f395c13b760 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 10 monclient: dump: 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.333 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.314+0000 7f39537fe640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 5 monclient: authenticate success, global_id 104153 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 1 -- 10.20.193.51:0/719286016 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580373f0 con 0x7f395c13b760 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 4 set_mon_vals no callback set 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 1 -- 10.20.193.51:0/719286016 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39580377c0 con 0x7f395c13b760 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f39537fe640 10 monclient: dump: 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.335 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 10 monclient: shutdown 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 -- 10.20.193.51:0/719286016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 msgr2=0x7f395c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 --2- 10.20.193.51:0/719286016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f395c06f3c0 tx=0x7f395802f230 comp rx=0 tx=0).stop 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 -- 10.20.193.51:0/719286016 shutdown_connections 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 --2- 10.20.193.51:0/719286016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c13db50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 --2- 10.20.193.51:0/719286016 >> v2:10.20.193.142:3300/0 conn(0x7f395c0a0750 0x7f395c09e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 -- 10.20.193.51:0/719286016 >> 10.20.193.51:0/719286016 conn(0x7f395c0a30c0 msgr2=0x7f395c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 -- 10.20.193.51:0/719286016 shutdown_connections 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 -- 10.20.193.51:0/719286016 wait complete. 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 10 monclient: monmap: 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.337 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:43.338 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.315+0000 7f3962f1b640 1 Processor -- start 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 -- start start 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient: init 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:52:43.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f395c0a0750 0x7f395c094dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-b con 0x7f395c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c0a3bb0 0x7f395c095310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-a con 0x7f395c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): picked mon.noname-c con 0x7f395c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0a04b0 con 0x7f395c0a3bb0 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f395c09c850 con 0x7f395c0a0750 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f395c09e710 con 0x7f395c13b760 2026-02-17T11:52:43.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3962f1b640 10 monclient(hunting): authenticate will time out at 1050.935291s 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c0a3bb0 0x7f395c095310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36640/0 (socket says 10.20.193.51:36640) 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 learned_addr learned my addr 10.20.193.51:0/245793470 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): get_auth_request con 0x7f395c13b760 auth_method 0 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): get_auth_request con 0x7f395c0a3bb0 auth_method 0 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3953fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient(hunting): handle_auth_done global_id 104156 payload 824 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f395c0a0750 msgr2=0x7f395c094dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f395c0a0750 0x7f395c094dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c0a3bb0 msgr2=0x7f395c095310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c0a3bb0 0x7f395c095310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 monclient: found mon.noname-c 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.316+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c09c470 con 0x7f395c13b760 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 msgr2=0x7f395c095850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3961491640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3958009f50 tx=0x7f3958004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958046020 con 0x7f395c13b760 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: dump: 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.344 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958041870 con 0x7f395c13b760 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 5 monclient: authenticate success, global_id 104156 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 10 monclient: _renew_subs 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c0986e0 con 0x7f395c13b760 2026-02-17T11:52:43.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958041c60 con 0x7f395c13b760 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f39517fa640 10 monclient: dump: 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.346 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3952ffd640 4 set_mon_vals no callback set 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 10 monclient: _renew_subs 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.318+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c09d7b0 con 0x7f395c13b760 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3962f1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3962f1b640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 0x7f395c091900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f395c09dac0 con 0x7f395c095d90 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 0x7f395c091900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient: get_auth_request con 0x7f395c095d90 auth_method 0 2026-02-17T11:52:43.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3958042400 con 0x7f395c13b760 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 10 monclient(hunting): handle_auth_done global_id 74403 payload 824 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3960c90640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f395c096170 con 0x7f395c095d90 2026-02-17T11:52:43.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f39517fa640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f392c03dd10 0x7f392c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f3958078570 con 0x7f395c13b760 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3953fff640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f392c03dd10 0x7f392c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.319+0000 7f3953fff640 10 monclient: get_auth_request con 0x7f392c03dd10 auth_method 0 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f3960c90640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 msgr2=0x7f395c091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f3960c90640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 0x7f395c091900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c011a80 con 0x7f395c095d90 2026-02-17T11:52:43.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f39517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f39517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.321+0000 7f39517fa640 10 monclient: dump: 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.350 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f394c017070 con 0x7f395c095d90 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 msgr2=0x7f395c091900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 0x7f395c091900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c00c860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 msgr2=0x7f395c091900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f39517fa640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c095d90 0x7f395c091900 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c00c860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.322+0000 7f3953fff640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f392c03dd10 0x7f392c0401d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f395c097e70 tx=0x7f3944008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.324+0000 7f3962f1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.324+0000 7f3962f1b640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 0x7f395c092250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.324+0000 7f3962f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.324+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f395c096940 con 0x7f395c091e40 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.324+0000 7f3960c90640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 0x7f395c092250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient: get_auth_request con 0x7f395c091e40 auth_method 0 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 10 monclient(hunting): handle_auth_done global_id 74406 payload 824 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.325+0000 7f3960c90640 1 -- 10.20.193.51:0/245793470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f395c0008d0 con 0x7f395c091e40 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3960c90640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 msgr2=0x7f395c092250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3960c90640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 0x7f395c092250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c01caf0 con 0x7f395c091e40 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 10 monclient: dump: 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f394c01caf0 con 0x7f395c091e40 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 msgr2=0x7f395c092250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 0x7f395c092250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c003860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 msgr2=0x7f395c092250 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f39517fa640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f395c091e40 0x7f395c092250 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c390 tx=0x7f394c003860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:52:43.357 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 181259, 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.358 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.359 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:43.360 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:43.361 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.362 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.364 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.365 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.366 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:43.367 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f392c03dd10 msgr2=0x7f392c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f392c03dd10 0x7f392c0401d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f395c097e70 tx=0x7f3944008040 comp rx=0 tx=0).stop 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 10 monclient: shutdown 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 msgr2=0x7f395c095850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3961491640 1 -- 10.20.193.51:0/245793470 reap_dead start 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3958009f50 tx=0x7f3958004b40 comp rx=0 tx=0).stop 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 shutdown_connections 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 --2- 10.20.193.51:0/245793470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f395c13b760 0x7f395c095850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 >> 10.20.193.51:0/245793470 conn(0x7f395c0a30c0 msgr2=0x7f395c13ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 shutdown_connections 2026-02-17T11:52:43.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.327+0000 7f3962f1b640 1 -- 10.20.193.51:0/245793470 wait complete. 2026-02-17T11:52:43.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:43.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:52:43.369 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:52:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.434+0000 7f6c57bc1640 10 monclient: get_monmap_and_config 2026-02-17T11:52:43.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.434+0000 7f6c57bc1640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.434+0000 7f6c57bc1640 10 monclient: monmap: 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:43.435693+0000 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:43.435693+0000 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 Processor -- start 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 -- start start 2026-02-17T11:52:43.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient: init 2026-02-17T11:52:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:52:43.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6c500a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6c500a0750 0x7f6c5009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-c con 0x7f6c500a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6c5013b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5006e140 con 0x7f6c5013b760 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5009f910 con 0x7f6c500a3bb0 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5009ccd0 con 0x7f6c500a0750 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c57bc1640 10 monclient(hunting): authenticate will time out at 1051.054454s 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c56137640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6c5013b760 0x7f6c5013db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52480/0 (socket says 10.20.193.51:52480) 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 learned_addr learned my addr 10.20.193.51:0/3944525603 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:43.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c55135640 1 --2- 10.20.193.51:0/3944525603 >> v2:10.20.193.142:3300/0 conn(0x7f6c500a0750 0x7f6c5009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c55135640 10 monclient(hunting): get_auth_request con 0x7f6c500a0750 auth_method 0 2026-02-17T11:52:43.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c55135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c55135640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.435+0000 7f6c55135640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 >> v1:10.20.193.51:6789/0 conn(0x7f6c5013b760 legacy=0x7f6c5013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332163921 0 0) 0x7f6c5006e140 con 0x7f6c5013b760 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient(hunting): _negotiate 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient(hunting): my global_id is 74409 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003620 con 0x7f6c5013b760 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c55936640 1 -- 10.20.193.51:0/3944525603 >> v1:10.20.193.142:6789/0 conn(0x7f6c500a3bb0 legacy=0x7f6c5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 575251174 0 0) 0x7f6c38003620 con 0x7f6c5013b760 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 >> v2:10.20.193.142:3300/0 conn(0x7f6c500a0750 msgr2=0x7f6c5009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 --2- 10.20.193.51:0/3944525603 >> v2:10.20.193.142:3300/0 conn(0x7f6c500a0750 0x7f6c5009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 >> v1:10.20.193.142:6789/0 conn(0x7f6c500a3bb0 legacy=0x7f6c5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5009eec0 con 0x7f6c5013b760 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f6c4c003530 con 0x7f6c5013b760 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c57bc1640 5 monclient: authenticate success, global_id 74409 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c57bc1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: dump: 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.450 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 >> v1:10.20.193.51:6789/0 conn(0x7f6c5013b760 legacy=0x7f6c5013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.437+0000 7f6c54934640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c38003c20 0x7f6c38004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): picked mon.b con 0x7f6c38003c20 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c38004900 0x7f6c38004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): picked mon.c con 0x7f6c38004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 0x7f6c3800bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): picked mon.a con 0x7f6c380054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5009ccd0 con 0x7f6c380054c0 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3800c400 con 0x7f6c38003c20 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3800c600 con 0x7f6c38004900 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c54934640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:52:43.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c57bc1640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c38004900 0x7f6c38004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 0x7f6c3800bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): get_auth_request con 0x7f6c380054c0 auth_method 0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): get_auth_request con 0x7f6c38004900 auth_method 0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55936640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c38003c20 0x7f6c38004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55936640 10 monclient(hunting): get_auth_request con 0x7f6c38003c20 auth_method 0 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55936640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55936640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55936640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient(hunting): handle_auth_done global_id 74409 payload 293 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c38004900 msgr2=0x7f6c38004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c38004900 0x7f6c38004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c38003c20 msgr2=0x7f6c38004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c38003c20 0x7f6c38004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 monclient: found mon.a 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38003620 con 0x7f6c380054c0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c55135640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c38004900 0x7f6c38004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.438+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 reap_dead start 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c56137640 1 -- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 msgr2=0x7f6c3800bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c56137640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 0x7f6c3800bb20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003750 tx=0x7f6c4c02ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efada36ea2d6916d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44009790 con 0x7f6c380054c0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: dump: 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.453 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c57bc1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c034070 con 0x7f6c380054c0 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 1 -- 10.20.193.51:0/3944525603 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00a7e0 con 0x7f6c380054c0 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c57bc1640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c57bc1640 4 set_mon_vals no callback set 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.440+0000 7f6c54934640 10 monclient: dump: 2026-02-17T11:52:43.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.455 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 10 monclient: shutdown 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 msgr2=0x7f6c3800bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 0x7f6c3800bb20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003750 tx=0x7f6c4c02ff30 comp rx=0 tx=0).stop 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3944525603 shutdown_connections 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3944525603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c380054c0 0x7f6c3800bb20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3944525603 >> 10.20.193.51:0/3944525603 conn(0x7f6c500a30c0 msgr2=0x7f6c500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3944525603 shutdown_connections 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3944525603 wait complete. 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 10 monclient: monmap: 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:43.456 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.441+0000 7f6c57bc1640 1 Processor -- start 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 -- start start 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient: init 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c380054c0 0x7f6c5012e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-c con 0x7f6c380054c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 0x7f6c5012eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-a con 0x7f6c5012e6e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c5012f060 0x7f6c501d3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): picked mon.noname-b con 0x7f6c5012f060 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500a04b0 con 0x7f6c5012e6e0 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5009c850 con 0x7f6c5012f060 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5009dac0 con 0x7f6c380054c0 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c57bc1640 10 monclient(hunting): authenticate will time out at 1051.061295s 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c380054c0 0x7f6c5012e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 0x7f6c5012eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c380054c0 0x7f6c5012e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36658/0 (socket says 10.20.193.51:36658) 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): get_auth_request con 0x7f6c5012e6e0 auth_method 0 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 1 -- 10.20.193.51:0/3050226490 learned_addr learned my addr 10.20.193.51:0/3050226490 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): get_auth_request con 0x7f6c380054c0 auth_method 0 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c56137640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c5012f060 0x7f6c501d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c56137640 10 monclient(hunting): get_auth_request con 0x7f6c5012f060 auth_method 0 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c56137640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c56137640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c56137640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient(hunting): handle_auth_done global_id 74412 payload 824 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c380054c0 msgr2=0x7f6c5012e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c380054c0 0x7f6c5012e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c5012f060 msgr2=0x7f6c501d3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c5012f060 0x7f6c501d3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 monclient: found mon.noname-a 2026-02-17T11:52:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.442+0000 7f6c55135640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c50131a10 con 0x7f6c5012e6e0 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c55135640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 msgr2=0x7f6c5012eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c55135640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 0x7f6c5012eb20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c440118e0 tx=0x7f6c44011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44019070 con 0x7f6c5012e6e0 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: dump: 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.461 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44004450 con 0x7f6c5012e6e0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 5 monclient: authenticate success, global_id 74412 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400faa0 con 0x7f6c5012e6e0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 10 monclient: _renew_subs 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3ffff640 4 set_mon_vals no callback set 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c50131cf0 con 0x7f6c5012e6e0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c3e7fc640 10 monclient: dump: 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 10 monclient: _renew_subs 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.444+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c50073f40 con 0x7f6c5012e6e0 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c57bc1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 0x7f6c500a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5009d7b0 con 0x7f6c500a0ec0 2026-02-17T11:52:43.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 0x7f6c500a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6c4400fc40 con 0x7f6c5012e6e0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient: get_auth_request con 0x7f6c500a0ec0 auth_method 0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 10 monclient(hunting): handle_auth_done global_id 104162 payload 824 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c55936640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c5009de50 con 0x7f6c500a0ec0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c3e7fc640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c2003dd10 0x7f6c200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f6c44052e60 con 0x7f6c5012e6e0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c56137640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c2003dd10 0x7f6c200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.445+0000 7f6c56137640 10 monclient: get_auth_request con 0x7f6c2003dd10 auth_method 0 2026-02-17T11:52:43.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c55936640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 msgr2=0x7f6c500a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c55936640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 0x7f6c500a12a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40005ce0 con 0x7f6c500a0ec0 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 10 monclient: dump: 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6c4001a070 con 0x7f6c500a0ec0 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:43.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 msgr2=0x7f6c500a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 0x7f6c500a12a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40011c20 comp rx=0 tx=0).stop 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 msgr2=0x7f6c500a12a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.447+0000 7f6c3e7fc640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a0ec0 0x7f6c500a12a0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40011c20 comp rx=0 tx=0).stop 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.448+0000 7f6c56137640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c2003dd10 0x7f6c200401d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c5009f620 tx=0x7f6c4c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.450+0000 7f6c57bc1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.450+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 0x7f6c501d7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.450+0000 7f6c57bc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.450+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5012fa80 con 0x7f6c500a17e0 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 0x7f6c501d7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient: get_auth_request con 0x7f6c500a17e0 auth_method 0 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 10 monclient(hunting): handle_auth_done global_id 104165 payload 824 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.451+0000 7f6c55936640 1 -- 10.20.193.51:0/3050226490 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c500008d0 con 0x7f6c500a17e0 2026-02-17T11:52:43.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c55936640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 msgr2=0x7f6c501d7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c55936640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 0x7f6c501d7dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40002cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400074f0 con 0x7f6c500a17e0 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 10 monclient: dump: 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f6c400074f0 con 0x7f6c500a17e0 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:43.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 msgr2=0x7f6c501d7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 0x7f6c501d7dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40002cc0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 msgr2=0x7f6c501d7dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c3e7fc640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c500a17e0 0x7f6c501d7dd0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40002cc0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28418, 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:43.470 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.471 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:43.472 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.473 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.474 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.475 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.476 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.477 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:43.478 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:43.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c2003dd10 msgr2=0x7f6c200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c2003dd10 0x7f6c200401d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c5009f620 tx=0x7f6c4c009030 comp rx=0 tx=0).stop 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 10 monclient: shutdown 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 msgr2=0x7f6c5012eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 --2- 10.20.193.51:0/3050226490 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c5012e6e0 0x7f6c5012eb20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c440118e0 tx=0x7f6c44011db0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c56137640 1 -- 10.20.193.51:0/3050226490 reap_dead start 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c56137640 1 -- 10.20.193.51:0/3050226490 reap_dead start 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 shutdown_connections 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 >> 10.20.193.51:0/3050226490 conn(0x7f6c500a30c0 msgr2=0x7f6c50138a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 shutdown_connections 2026-02-17T11:52:43.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.453+0000 7f6c57bc1640 1 -- 10.20.193.51:0/3050226490 wait complete. 2026-02-17T11:52:43.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:43.479 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:52:43.479 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:52:43.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: get_monmap_and_config 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: monmap: 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:43.546022+0000 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:43.546022+0000 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:43.549 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 Processor -- start 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 -- start start 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: init 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8c2c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8c2c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 0x7f8c2c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-b con 0x7f8c2c13c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c09e8e0 con 0x7f8c2c0a3bb0 2026-02-17T11:52:43.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c06e140 con 0x7f8c2c0a0750 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c09f910 con 0x7f8c2c13c770 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c30d6a640 10 monclient(hunting): authenticate will time out at 1051.164793s 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2a575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8c2c0a3bb0 0x7f8c2c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52496/0 (socket says 10.20.193.51:52496) 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2a575640 1 -- 10.20.193.51:0/111113541 learned_addr learned my addr 10.20.193.51:0/111113541 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 1 --2- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 0x7f8c2c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): get_auth_request con 0x7f8c2c13c770 auth_method 0 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.545+0000 7f8c2ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 10 monclient(hunting): handle_auth_done global_id 104168 payload 274 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 1 -- 10.20.193.51:0/111113541 >> v1:10.20.193.142:6789/0 conn(0x7f8c2c0a0750 legacy=0x7f8c2c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 1 -- 10.20.193.51:0/111113541 >> v1:10.20.193.51:6789/0 conn(0x7f8c2c0a3bb0 legacy=0x7f8c2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 1 monclient: found mon.noname-b 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.546+0000 7f8c2ad76640 1 -- 10.20.193.51:0/111113541 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c09ccd0 con 0x7f8c2c13c770 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c2ad76640 1 -- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 msgr2=0x7f8c2c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c2ad76640 1 --2- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 0x7f8c2c13eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009dc0 tx=0x7f8c1c02f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da730c9a04de5a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 1 -- 10.20.193.51:0/111113541 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c03c070 con 0x7f8c2c13c770 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:43.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: dump: 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 1 -- 10.20.193.51:0/111113541 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c037640 con 0x7f8c2c13c770 2026-02-17T11:52:43.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c30d6a640 5 monclient: authenticate success, global_id 104168 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 1 -- 10.20.193.51:0/111113541 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c037a10 con 0x7f8c2c13c770 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c29573640 10 monclient: dump: 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c30d6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.548+0000 7f8c30d6a640 4 set_mon_vals no callback set 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: shutdown 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 msgr2=0x7f8c2c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 0x7f8c2c13eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009dc0 tx=0x7f8c1c02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- 10.20.193.51:0/111113541 shutdown_connections 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/111113541 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c13c770 0x7f8c2c13eb60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- 10.20.193.51:0/111113541 >> 10.20.193.51:0/111113541 conn(0x7f8c2c0a30c0 msgr2=0x7f8c2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- 10.20.193.51:0/111113541 shutdown_connections 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- 10.20.193.51:0/111113541 wait complete. 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: monmap: 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:43.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 Processor -- start 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 1 -- start start 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: init 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.549+0000 7f8c30d6a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-a con 0x7f8c2c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c0a3bb0 0x7f8c2c0946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-c con 0x7f8c2c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c13c770 0x7f8c2c094be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): picked mon.noname-b con 0x7f8c2c13c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c09c850 con 0x7f8c2c0a0750 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c09eef0 con 0x7f8c2c13c770 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c0a04b0 con 0x7f8c2c0a3bb0 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c30d6a640 10 monclient(hunting): authenticate will time out at 1051.169054s 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c0a3bb0 0x7f8c2c0946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33712/0 (socket says 10.20.193.51:33712) 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 -- 10.20.193.51:0/2463353026 learned_addr learned my addr 10.20.193.51:0/2463353026 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): get_auth_request con 0x7f8c2c0a0750 auth_method 0 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): get_auth_request con 0x7f8c2c0a3bb0 auth_method 0 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient(hunting): handle_auth_done global_id 74415 payload 824 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2ad76640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c13c770 0x7f8c2c094be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c0a3bb0 msgr2=0x7f8c2c0946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c0a3bb0 0x7f8c2c0946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c13c770 msgr2=0x7f8c2c094be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c13c770 0x7f8c2c094be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 monclient: found mon.noname-a 2026-02-17T11:52:43.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c2a575640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c096e30 con 0x7f8c2c0a0750 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.550+0000 7f8c29d74640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c2c0a3bb0 0x7f8c2c0946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c2a575640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 msgr2=0x7f8c2c09bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c2a575640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c750 tx=0x7f8c2000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20005de0 con 0x7f8c2c0a0750 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: dump: 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.565 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c20007070 con 0x7f8c2c0a0750 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 5 monclient: authenticate success, global_id 74415 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 10 monclient: _renew_subs 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c28d72640 4 set_mon_vals no callback set 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20007440 con 0x7f8c2c0a0750 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c0985c0 con 0x7f8c2c0a0750 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c12ffd640 10 monclient: dump: 2026-02-17T11:52:43.566 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 10 monclient: _renew_subs 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c098000 con 0x7f8c2c0a0750 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.552+0000 7f8c30d6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 0x7f8c2c072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c09dac0 con 0x7f8c2c095120 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8c20007660 con 0x7f8c2c0a0750 2026-02-17T11:52:43.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 0x7f8c2c072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient: get_auth_request con 0x7f8c2c095120 auth_method 0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c12ffd640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8bf803dd60 0x7f8bf8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f8c20052380 con 0x7f8c2c0a0750 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c2ad76640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8bf803dd60 0x7f8bf8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 10 monclient(hunting): handle_auth_done global_id 64366 payload 824 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c29d74640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c2c095500 con 0x7f8c2c095120 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.553+0000 7f8c2ad76640 10 monclient: get_auth_request con 0x7f8bf803dd60 auth_method 0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c29d74640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 msgr2=0x7f8c2c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c29d74640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 0x7f8c2c072950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400fb10 tx=0x7f8c1400d150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14018020 con 0x7f8c2c095120 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c12ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c12ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.555+0000 7f8c12ffd640 10 monclient: dump: 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c2ad76640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8bf803dd60 0x7f8bf8040220 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c06c1c0 tx=0x7f8c1c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8c14014470 con 0x7f8c2c095120 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 msgr2=0x7f8c2c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 0x7f8c2c072950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400fb10 tx=0x7f8c1400d150 comp rx=0 tx=0).stop 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 msgr2=0x7f8c2c072950 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.556+0000 7f8c12ffd640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c095120 0x7f8c2c072950 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400fb10 tx=0x7f8c1400d150 comp rx=0 tx=0).stop 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c30d6a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 0x7f8c2c063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c30d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c096bb0 con 0x7f8c2c0638c0 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 0x7f8c2c063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient: get_auth_request con 0x7f8c2c0638c0 auth_method 0 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.559+0000 7f8c29d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.560+0000 7f8c29d74640 10 monclient(hunting): handle_auth_done global_id 64369 payload 824 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.560+0000 7f8c29d74640 1 -- 10.20.193.51:0/2463353026 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c2c098340 con 0x7f8c2c0638c0 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c29d74640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 msgr2=0x7f8c2c063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c29d74640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 0x7f8c2c063cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c14019000 tx=0x7f8c14003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14018030 con 0x7f8c2c0638c0 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 10 monclient: dump: 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f8c14014a30 con 0x7f8c2c0638c0 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 msgr2=0x7f8c2c063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 0x7f8c2c063cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c14019000 tx=0x7f8c14003860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 msgr2=0x7f8c2c063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c12ffd640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c2c0638c0 0x7f8c2c063cd0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c14019000 tx=0x7f8c14003860 comp rx=0 tx=0).stop 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 58, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 235109, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:43.573 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.574 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:43.575 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.576 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:43.577 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.578 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.579 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.580 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:43.581 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:43.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8bf803dd60 msgr2=0x7f8bf8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.562+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8bf803dd60 0x7f8bf8040220 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c06c1c0 tx=0x7f8c1c033000 comp rx=0 tx=0).stop 2026-02-17T11:52:43.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 10 monclient: shutdown 2026-02-17T11:52:43.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 msgr2=0x7f8c2c09bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c2ad76640 1 -- 10.20.193.51:0/2463353026 reap_dead start 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c750 tx=0x7f8c2000cc20 comp rx=0 tx=0).stop 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 shutdown_connections 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 --2- 10.20.193.51:0/2463353026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c2c0a0750 0x7f8c2c09bdd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 >> 10.20.193.51:0/2463353026 conn(0x7f8c2c0a30c0 msgr2=0x7f8c2c13dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 shutdown_connections 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.563+0000 7f8c30d6a640 1 -- 10.20.193.51:0/2463353026 wait complete. 2026-02-17T11:52:43.583 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:52:43.583 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T11:52:43.583 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:52:43.583 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T11:52:43.583 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:52:43.583 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T11:52:43.583 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:52:43.594 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T11:52:43.594 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:52:43.594 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.660+0000 7fd194fc1640 10 monclient: get_monmap_and_config 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.660+0000 7fd194fc1640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.660+0000 7fd194fc1640 10 monclient: monmap: 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:43.661387+0000 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:43.661387+0000 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:43.662 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.660+0000 7fd194fc1640 1 Processor -- start 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 1 -- start start 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient: init 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd190138470 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd1900a0570 0x7fd19013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-c con 0x7fd1900a0570 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd1900a0d50 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd190138f60 con 0x7fd190138470 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900a3050 con 0x7fd1900a0d50 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd1900a1520 con 0x7fd1900a0570 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd194fc1640 10 monclient(hunting): authenticate will time out at 1051.280437s 2026-02-17T11:52:43.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd18dd74640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fd1900a0570 msgr2=0x7fd19013d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:43.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd18dd74640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd1900a0570 0x7fd19013d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:43.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd18ed76640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fd1900a0d50 legacy=0x7fd19013f8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:43.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd18e575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd190138470 0x7fd190138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52510/0 (socket says 10.20.193.51:52510) 2026-02-17T11:52:43.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.661+0000 7fd18e575640 1 -- 10.20.193.51:0/1346198647 learned_addr learned my addr 10.20.193.51:0/1346198647 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:43.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18e575640 1 -- 10.20.193.51:0/1346198647 >> v1:10.20.193.51:6789/0 conn(0x7fd190138470 legacy=0x7fd190138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786435361 0 0) 0x7fd190138f60 con 0x7fd190138470 2026-02-17T11:52:43.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient(hunting): _negotiate 2026-02-17T11:52:43.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient(hunting): my global_id is 74418 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd17c003620 con 0x7fd190138470 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 357611448 0 0) 0x7fd17c003620 con 0x7fd190138470 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 >> v2:10.20.193.142:3300/0 conn(0x7fd1900a0570 msgr2=0x7fd19013d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 --2- 10.20.193.51:0/1346198647 >> v2:10.20.193.142:3300/0 conn(0x7fd1900a0570 0x7fd19013d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 >> v1:10.20.193.142:6789/0 conn(0x7fd1900a0d50 legacy=0x7fd19013f8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900a09f0 con 0x7fd190138470 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fd1840031b0 con 0x7fd190138470 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: dump: 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.667 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 >> v1:10.20.193.51:6789/0 conn(0x7fd190138470 legacy=0x7fd190138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c003ab0 0x7fd17c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 10 monclient(hunting): picked mon.c con 0x7fd17c003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.663+0000 7fd18d573640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 0x7fd17c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): picked mon.a con 0x7fd17c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd17c0054c0 0x7fd17c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): picked mon.b con 0x7fd17c0054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900a1520 con 0x7fd17c004900 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00c360 con 0x7fd17c0054c0 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c00c560 con 0x7fd17c003ab0 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18d573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 0x7fd17c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c003ab0 0x7fd17c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18ed76640 1 -- 10.20.193.51:0/1346198647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd17c0054c0 msgr2=0x7fd17c00bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): get_auth_request con 0x7fd17c004900 auth_method 0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): get_auth_request con 0x7fd17c003ab0 auth_method 0 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18ed76640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd17c0054c0 0x7fd17c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient(hunting): handle_auth_done global_id 74418 payload 293 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 -- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c003ab0 msgr2=0x7fd17c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c003ab0 0x7fd17c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 -- 10.20.193.51:0/1346198647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd17c0054c0 msgr2=0x7fd17c00bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:43.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd17c0054c0 0x7fd17c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 monclient: found mon.a 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 1 -- 10.20.193.51:0/1346198647 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c003620 con 0x7fd17c004900 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd18ed76640 1 -- 10.20.193.51:0/1346198647 reap_dead start 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd194fc1640 5 monclient: authenticate success, global_id 74418 2026-02-17T11:52:43.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.664+0000 7fd194fc1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18dd74640 1 -- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 msgr2=0x7fd17c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18dd74640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 0x7fd17c004d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd178009e30 tx=0x7fd17802f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b212ffcbb265d72c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178009a30 con 0x7fd17c004900 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: dump: 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.673 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178003cb0 con 0x7fd17c004900 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 1 -- 10.20.193.51:0/1346198647 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178003e60 con 0x7fd17c004900 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd194fc1640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd194fc1640 4 set_mon_vals no callback set 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.666+0000 7fd18d573640 10 monclient: dump: 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 10 monclient: shutdown 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:43.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 msgr2=0x7fd17c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 0x7fd17c004d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd178009e30 tx=0x7fd17802f660 comp rx=0 tx=0).stop 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- 10.20.193.51:0/1346198647 shutdown_connections 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 --2- 10.20.193.51:0/1346198647 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd17c004900 0x7fd17c004d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- 10.20.193.51:0/1346198647 >> 10.20.193.51:0/1346198647 conn(0x7fd1900aa960 msgr2=0x7fd1900aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- 10.20.193.51:0/1346198647 shutdown_connections 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- 10.20.193.51:0/1346198647 wait complete. 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 10 monclient: build_initial_monmap 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 10 monclient: monmap: 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 Processor -- start 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 1 -- start start 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.667+0000 7fd194fc1640 10 monclient: init 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-c con 0x7fd17c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 0x7fd190137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-b con 0x7fd1901cf0a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd190124e90 0x7fd190125310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): picked mon.noname-a con 0x7fd190124e90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900ab870 con 0x7fd190124e90 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900ab6f0 con 0x7fd1901cf0a0 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd190138850 con 0x7fd17c004900 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd194fc1640 10 monclient(hunting): authenticate will time out at 1051.287188s 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36728/0 (socket says 10.20.193.51:36728) 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 -- 10.20.193.51:0/3970481621 learned_addr learned my addr 10.20.193.51:0/3970481621 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): get_auth_request con 0x7fd17c004900 auth_method 0 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18dd74640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 msgr2=0x7fd190137960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd190124e90 0x7fd190125310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18dd74640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 0x7fd190137960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:43.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): get_auth_request con 0x7fd190124e90 auth_method 0 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient(hunting): handle_auth_done global_id 104174 payload 824 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 msgr2=0x7fd190137960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 0x7fd190137960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd190124e90 msgr2=0x7fd190125310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd190124e90 0x7fd190125310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient: _finish_hunting 0 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 monclient: found mon.noname-c 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.668+0000 7fd18e575640 1 -- 10.20.193.51:0/3970481621 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd190126fd0 con 0x7fd17c004900 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd18e575640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 msgr2=0x7fd190137420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd18e575640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1840073d0 tx=0x7fd1840078a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18400fbd0 con 0x7fd17c004900 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd18e575640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1840073d0 tx=0x7fd1840078a0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fd184018070 config(0 keys) 2026-02-17T11:52:43.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: dump: 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 5 monclient: authenticate success, global_id 104174 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd184018070 con 0x7fd17c004900 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd176ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 10 monclient: _renew_subs 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd190074990 con 0x7fd17c004900 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd18cd72640 4 set_mon_vals no callback set 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 10 monclient: _renew_subs 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.670+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd190128860 con 0x7fd17c004900 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1840133f0 con 0x7fd17c004900 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 10 monclient: dump: 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd184013590 con 0x7fd17c004900 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd194fc1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd194fc1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd194fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd190126b30 con 0x7fd17c004900 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd176ffd640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 0x7fd15c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd18dd74640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 0x7fd15c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:43.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.671+0000 7fd18dd74640 10 monclient: get_auth_request con 0x7fd15c03dcc0 auth_method 0 2026-02-17T11:52:43.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.673+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7fd1840527d0 con 0x7fd17c004900 2026-02-17T11:52:43.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:43.674+0000 7fd18dd74640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 0x7fd15c040180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd178003a30 tx=0x7fd178005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:44.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.498+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd1900a09f0 con 0x7fd17c004900 2026-02-17T11:52:44.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.498+0000 7fd176ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:44.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.498+0000 7fd176ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:44.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd194fc1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:44.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd194fc1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd194fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd190138c60 con 0x7fd17c004900 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd176ffd640 1 -- 10.20.193.51:0/3970481621 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fd18401a310 con 0x7fd17c004900 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd176ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.613+0000 7fd176ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:44.616 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 msgr2=0x7fd15c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 0x7fd15c040180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd178003a30 tx=0x7fd178005000 comp rx=0 tx=0).stop 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 10 monclient: shutdown 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 msgr2=0x7fd190137420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1840073d0 tx=0x7fd1840078a0 comp rx=0 tx=0).stop 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 shutdown_connections 2026-02-17T11:52:44.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd15c03dcc0 0x7fd15c040180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd190124e90 0x7fd190125310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1901cf0a0 0x7fd190137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 --2- 10.20.193.51:0/3970481621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd17c004900 0x7fd190137420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 >> 10.20.193.51:0/3970481621 conn(0x7fd1900aa960 msgr2=0x7fd19006fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 shutdown_connections 2026-02-17T11:52:44.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:44.614+0000 7fd194fc1640 1 -- 10.20.193.51:0/3970481621 wait complete. 2026-02-17T11:52:47.625 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: get_monmap_and_config 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: build_initial_monmap 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: monmap: 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:47.695996+0000 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:47.695996+0000 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 Processor -- start 2026-02-17T11:52:47.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 -- start start 2026-02-17T11:52:47.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: init 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient: _add_conns ranks=[3,4,0,1,2] 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-a con 0x7fe5ac0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 0x7fe5ac09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-c con 0x7fe5ac0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe5ac09e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ac06e140 con 0x7fe5ac09e540 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ac0a3f90 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ac09f910 con 0x7fe5ac0a0750 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5b247e640 10 monclient(hunting): authenticate will time out at 1055.314792s 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:47.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52004/0 (socket says 10.20.193.51:52004) 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 1 -- 10.20.193.51:0/27526605 learned_addr learned my addr 10.20.193.51:0/27526605 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): get_auth_request con 0x7fe5ac0a3bb0 auth_method 0 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/27526605 >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 msgr2=0x7fe5ac09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5ab7fe640 1 --2- 10.20.193.51:0/27526605 >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 0x7fe5ac09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.695+0000 7fe5abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 10 monclient(hunting): handle_auth_done global_id 74424 payload 274 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 1 -- 10.20.193.51:0/27526605 >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 msgr2=0x7fe5ac09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 1 --2- 10.20.193.51:0/27526605 >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 0x7fe5ac09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 1 -- 10.20.193.51:0/27526605 >> v1:10.20.193.51:6789/0 conn(0x7fe5ac09e540 legacy=0x7fe5ac13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 1 monclient: found mon.noname-a 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:47.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.696+0000 7fe5abfff640 1 -- 10.20.193.51:0/27526605 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac09ccd0 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.698+0000 7fe5abfff640 1 -- 10.20.193.51:0/27526605 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 msgr2=0x7fe5ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:47.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.698+0000 7fe5abfff640 1 --2- 10.20.193.51:0/27526605 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06c1c0 tx=0x7fe59802ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa707420cff2ba8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:47.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 1 -- 10.20.193.51:0/27526605 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59803c070 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:47.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: dump: 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 1 -- 10.20.193.51:0/27526605 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59802fd70 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 5 monclient: authenticate success, global_id 74424 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 1 -- 10.20.193.51:0/27526605 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598037660 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:47.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 4 set_mon_vals no callback set 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5aaffd640 10 monclient: dump: 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 10 monclient: shutdown 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 -- 10.20.193.51:0/27526605 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 msgr2=0x7fe5ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 --2- 10.20.193.51:0/27526605 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06c1c0 tx=0x7fe59802ee10 comp rx=0 tx=0).stop 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 -- 10.20.193.51:0/27526605 shutdown_connections 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 --2- 10.20.193.51:0/27526605 >> v2:10.20.193.142:3300/0 conn(0x7fe5ac0a0750 0x7fe5ac09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 --2- 10.20.193.51:0/27526605 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac09dac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 -- 10.20.193.51:0/27526605 >> 10.20.193.51:0/27526605 conn(0x7fe5ac0a30c0 msgr2=0x7fe5ac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:47.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 -- 10.20.193.51:0/27526605 shutdown_connections 2026-02-17T11:52:47.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.700+0000 7fe5b247e640 1 -- 10.20.193.51:0/27526605 wait complete. 2026-02-17T11:52:47.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 10 monclient: build_initial_monmap 2026-02-17T11:52:47.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 10 monclient: monmap: 2026-02-17T11:52:47.707 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 1 Processor -- start 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 1 -- start start 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 10 monclient: init 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.701+0000 7fe5b247e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 0x7fe5ac08e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-b con 0x7fe5ac09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-c con 0x7fe5ac0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): picked mon.noname-a con 0x7fe5ac0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac0a04b0 con 0x7fe5ac0a3bb0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac09c850 con 0x7fe5ac09e540 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe5ac13de80 con 0x7fe5ac0a0750 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b247e640 10 monclient(hunting): authenticate will time out at 1055.321039s 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5abfff640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 msgr2=0x7fe5ac08e3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5abfff640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 0x7fe5ac08e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49346/0 (socket says 10.20.193.51:49346) 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52018/0 (socket says 10.20.193.51:52018) 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/3568013819 learned_addr learned my addr 10.20.193.51:0/3568013819 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): get_auth_request con 0x7fe5ac0a0750 auth_method 0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): get_auth_request con 0x7fe5ac0a3bb0 auth_method 0 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:47.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient(hunting): handle_auth_done global_id 104177 payload 824 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 msgr2=0x7fe5ac08e3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 0x7fe5ac08e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 msgr2=0x7fe5ac08ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 monclient: found mon.noname-c 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/3568013819 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac0917f0 con 0x7fe5ac0a0750 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.702+0000 7fe5b09f4640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5ab7fe640 1 -- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 msgr2=0x7fe5ac08e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5ab7fe640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b780 tx=0x7fe59c00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0052d0 con 0x7fe5ac0a0750 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:47.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: dump: 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c010070 con 0x7fe5ac0a0750 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 5 monclient: authenticate success, global_id 104177 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 10 monclient: _renew_subs 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac08f490 con 0x7fe5ac0a0750 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0056d0 con 0x7fe5ac0a0750 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5aa7fc640 4 set_mon_vals no callback set 2026-02-17T11:52:47.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5a8ff9640 10 monclient: dump: 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 10 monclient: _renew_subs 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.704+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac090430 con 0x7fe5ac0a0750 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5b247e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5b247e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5b247e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac08e130 con 0x7fe5ac0a0750 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe59c01d030 con 0x7fe5ac0a0750 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5a8ff9640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 0x7fe57c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7fe59c051b50 con 0x7fe5ac0a0750 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5abfff640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 0x7fe57c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:47.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.705+0000 7fe5abfff640 10 monclient: get_auth_request con 0x7fe57c03dcc0 auth_method 0 2026-02-17T11:52:47.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.707+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe5ac08e130 con 0x7fe5ac0a0750 2026-02-17T11:52:47.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.707+0000 7fe5a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:47.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.707+0000 7fe5a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:47.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.708+0000 7fe5abfff640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 0x7fe57c040180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe598036000 tx=0x7fe598033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:47.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5b247e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:47.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5b247e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:47.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5b247e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:47.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe5ac0a24f0 con 0x7fe5ac0a0750 2026-02-17T11:52:47.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5a8ff9640 1 -- 10.20.193.51:0/3568013819 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe5ac0a24f0 con 0x7fe5ac0a0750 2026-02-17T11:52:47.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:47.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.821+0000 7fe5a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:47.824 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 msgr2=0x7fe57c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 0x7fe57c040180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe598036000 tx=0x7fe598033000 comp rx=0 tx=0).stop 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 10 monclient: shutdown 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 msgr2=0x7fe5ac08e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b780 tx=0x7fe59c00bc50 comp rx=0 tx=0).stop 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 shutdown_connections 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe57c03dcc0 0x7fe57c040180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5ac0a3bb0 0x7fe5ac08ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe5ac0a0750 0x7fe5ac08e8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 --2- 10.20.193.51:0/3568013819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5ac09e540 0x7fe5ac08e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:47.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 >> 10.20.193.51:0/3568013819 conn(0x7fe5ac0a30c0 msgr2=0x7fe5ac09b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:47.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 shutdown_connections 2026-02-17T11:52:47.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:47.822+0000 7fe5b247e640 1 -- 10.20.193.51:0/3568013819 wait complete. 2026-02-17T11:52:50.833 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.900+0000 7fc933a5b640 10 monclient: get_monmap_and_config 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.900+0000 7fc933a5b640 10 monclient: build_initial_monmap 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.900+0000 7fc933a5b640 10 monclient: monmap: 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:50.901538+0000 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:50.901538+0000 2026-02-17T11:52:50.902 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:50.903 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.900+0000 7fc933a5b640 1 Processor -- start 2026-02-17T11:52:50.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.900+0000 7fc933a5b640 1 -- start start 2026-02-17T11:52:50.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient: init 2026-02-17T11:52:50.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fc92c09a5c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 0x7fc92c09aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fc92c09d340 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc92c13c800 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c06e140 con 0x7fc92c13c800 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c09cf20 con 0x7fc92c09d340 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c09b420 con 0x7fc92c09a5c0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc933a5b640 10 monclient(hunting): authenticate will time out at 1058.520392s 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc930fcf640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 msgr2=0x7fc92c09aee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc931fd1640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fc92c13c800 legacy=0x7fc92c13cc30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc930fcf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 0x7fc92c09aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49350/0 (socket says 10.20.193.51:49350) 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 -- 10.20.193.51:0/802885649 learned_addr learned my addr 10.20.193.51:0/802885649 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): get_auth_request con 0x7fc92c09a5c0 auth_method 0 2026-02-17T11:52:50.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient(hunting): handle_auth_done global_id 104180 payload 274 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 -- 10.20.193.51:0/802885649 >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 msgr2=0x7fc92c09aee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 --2- 10.20.193.51:0/802885649 >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 0x7fc92c09aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 -- 10.20.193.51:0/802885649 >> v1:10.20.193.142:6789/0 conn(0x7fc92c13c800 legacy=0x7fc92c13cc30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient: _finish_hunting 0 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 monclient: found mon.noname-b 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:50.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.901+0000 7fc9317d0640 1 -- 10.20.193.51:0/802885649 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c06daa0 con 0x7fc92c09a5c0 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc9317d0640 1 -- 10.20.193.51:0/802885649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 msgr2=0x7fc92c09a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc9317d0640 1 --2- 10.20.193.51:0/802885649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009970 tx=0x7fc91c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f380150aede3caf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 1 -- 10.20.193.51:0/802885649 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c03c070 con 0x7fc92c09a5c0 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: dump: 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: _finish_auth 0 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 1 -- 10.20.193.51:0/802885649 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c02fdd0 con 0x7fc92c09a5c0 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 5 monclient: authenticate success, global_id 104180 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 1 -- 10.20.193.51:0/802885649 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c037660 con 0x7fc92c09a5c0 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 4 set_mon_vals no callback set 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc91bfff640 10 monclient: dump: 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:50.910 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 10 monclient: shutdown 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 -- 10.20.193.51:0/802885649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 msgr2=0x7fc92c09a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 --2- 10.20.193.51:0/802885649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009970 tx=0x7fc91c02eeb0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 -- 10.20.193.51:0/802885649 shutdown_connections 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 --2- 10.20.193.51:0/802885649 >> v2:10.20.193.142:3300/0 conn(0x7fc92c09d340 0x7fc92c09aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 --2- 10.20.193.51:0/802885649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c09a5c0 0x7fc92c09a9a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 -- 10.20.193.51:0/802885649 >> 10.20.193.51:0/802885649 conn(0x7fc92c0a30c0 msgr2=0x7fc92c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 -- 10.20.193.51:0/802885649 shutdown_connections 2026-02-17T11:52:50.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.904+0000 7fc933a5b640 1 -- 10.20.193.51:0/802885649 wait complete. 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient: build_initial_monmap 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient: monmap: 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 Processor -- start 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 -- start start 2026-02-17T11:52:50.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient: init 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 0x7fc92c1d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fc92c09a5c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-a con 0x7fc92c13c800 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 0x7fc92c0724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fc92c072020 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0a3e20 con 0x7fc92c13c800 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c09c6a0 con 0x7fc92c09a5c0 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c0a3fa0 con 0x7fc92c072020 2026-02-17T11:52:50.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc933a5b640 10 monclient(hunting): authenticate will time out at 1058.524750s 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc9317d0640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 msgr2=0x7fc92c1d3a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc9317d0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 0x7fc92c1d3a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 0x7fc92c0724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52022/0 (socket says 10.20.193.51:52022) 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 1 -- 10.20.193.51:0/1975553632 learned_addr learned my addr 10.20.193.51:0/1975553632 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): get_auth_request con 0x7fc92c13c800 auth_method 0 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): get_auth_request con 0x7fc92c072020 auth_method 0 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:50.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc931fd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 10 monclient(hunting): handle_auth_done global_id 74430 payload 824 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 1 -- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 msgr2=0x7fc92c0724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.905+0000 7fc930fcf640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 0x7fc92c0724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 1 -- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 msgr2=0x7fc92c1d3a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 0x7fc92c1d3a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 10 monclient: _finish_hunting 0 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 1 monclient: found mon.noname-a 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc930fcf640 1 -- 10.20.193.51:0/1975553632 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c073cc0 con 0x7fc92c13c800 2026-02-17T11:52:50.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.906+0000 7fc931fd1640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 0x7fc92c0724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc930fcf640 1 -- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 msgr2=0x7fc92c1d3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc930fcf640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc92000b780 tx=0x7fc92000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9200052d0 con 0x7fc92c13c800 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: dump: 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:50.917 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: _finish_auth 0 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc920010070 con 0x7fc92c13c800 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 5 monclient: authenticate success, global_id 74430 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _renew_subs 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c12cfd0 con 0x7fc92c13c800 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9200056d0 con 0x7fc92c13c800 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc91b7fe640 4 set_mon_vals no callback set 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc919ffb640 10 monclient: dump: 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:50.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _renew_subs 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c12ccf0 con 0x7fc92c13c800 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.908+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c13cc30 con 0x7fc92c13c800 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.909+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc920015470 con 0x7fc92c13c800 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.909+0000 7fc919ffb640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 0x7fc8fc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.909+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7fc920051ef0 con 0x7fc92c13c800 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.909+0000 7fc9317d0640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 0x7fc8fc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.909+0000 7fc9317d0640 10 monclient: get_auth_request con 0x7fc8fc03dcc0 auth_method 0 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.911+0000 7fc9317d0640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 0x7fc8fc040180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc91c036000 tx=0x7fc91c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:50.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.911+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc92001a060 con 0x7fc92c13c800 2026-02-17T11:52:50.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.911+0000 7fc919ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:50.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:50.911+0000 7fc919ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:51.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.026+0000 7fc933a5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.026+0000 7fc933a5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.026+0000 7fc933a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.026+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc92c0a28c0 con 0x7fc92c13c800 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.027+0000 7fc919ffb640 1 -- 10.20.193.51:0/1975553632 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fc9200058b0 con 0x7fc92c13c800 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.027+0000 7fc919ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.027+0000 7fc919ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:51.029 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 msgr2=0x7fc8fc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 0x7fc8fc040180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc91c036000 tx=0x7fc91c033000 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 10 monclient: shutdown 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 msgr2=0x7fc92c1d3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc92000b780 tx=0x7fc92000bc50 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 shutdown_connections 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc8fc03dcc0 0x7fc8fc040180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc92c072020 0x7fc92c0724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc92c13c800 0x7fc92c1d3f80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 --2- 10.20.193.51:0/1975553632 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc92c09a5c0 0x7fc92c1d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 >> 10.20.193.51:0/1975553632 conn(0x7fc92c0a30c0 msgr2=0x7fc92c09fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 shutdown_connections 2026-02-17T11:52:51.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:51.028+0000 7fc933a5b640 1 -- 10.20.193.51:0/1975553632 wait complete. 2026-02-17T11:52:54.037 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:52:54.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: get_monmap_and_config 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: build_initial_monmap 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: monmap: 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:54.106006+0000 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:54.106006+0000 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:54.109 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 Processor -- start 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 -- start start 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: init 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:54.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-b con 0x7f7cf80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-a con 0x7f7cf80a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7cf809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf806e140 con 0x7f7cf809e540 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf80a3f90 con 0x7f7cf80a0750 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf809f910 con 0x7f7cf80a3bb0 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfe5ff640 10 monclient(hunting): authenticate will time out at 1061.724713s 2026-02-17T11:52:54.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cfcb75640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f7cf809e540 legacy=0x7f7cf813c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49362/0 (socket says 10.20.193.51:49362) 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 learned_addr learned my addr 10.20.193.51:0/964882166 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request con 0x7f7cf80a0750 auth_method 0 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:54.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.105+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.142:6789/0 conn(0x7f7cf809e540 legacy=0x7f7cf813c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request con 0x7f7cf80a0750 auth_method 0 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:52:54.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.306+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.142:6789/0 conn(0x7f7cf809e540 legacy=0x7f7cf813c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request con 0x7f7cf80a0750 auth_method 0 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:54.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:54.707+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.142:6789/0 conn(0x7f7cf809e540 legacy=0x7f7cf813c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request con 0x7f7cf80a0750 auth_method 0 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:55.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:52:55.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:55.508+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:52:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): tick 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 msgr2=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.51:3300/0 conn(0x7f7cf80a0750 0x7f7cf809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.142:6789/0 conn(0x7f7cf809e540 legacy=0x7f7cf813c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient: _add_conns ranks=[4,0] 2026-02-17T11:52:57.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 0x7f7cd4005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd4003770 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7cd40062e0 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 -- 10.20.193.51:0/964882166 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf809ccd0 con 0x7f7cd40062e0 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 1 -- 10.20.193.51:0/964882166 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf80a3f90 con 0x7f7cd4003770 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf5ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 msgr2=0x7f7cd4005bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.106+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 0x7f7cd4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:57.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.108+0000 7f7cf77fe640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.51:6789/0 conn(0x7f7cd40062e0 legacy=0x7f7cd40087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.307+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 msgr2=0x7f7cd4005bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.307+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 0x7f7cd4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112547235 0 0) 0x7f7cf809ccd0 con 0x7f7cd40062e0 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): my global_id is 74433 2026-02-17T11:52:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cdc003620 con 0x7f7cd40062e0 2026-02-17T11:52:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1361821127 0 0) 0x7f7cdc003620 con 0x7f7cd40062e0 2026-02-17T11:52:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 msgr2=0x7f7cd4005bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 --2- 10.20.193.51:0/964882166 >> v2:10.20.193.142:3300/0 conn(0x7f7cd4003770 0x7f7cd4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:52:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf806e140 con 0x7f7cd40062e0 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f7ce800f040 con 0x7f7cd40062e0 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: dump: 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 >> v1:10.20.193.51:6789/0 conn(0x7f7cd40062e0 legacy=0x7f7cd40087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 reap_dead start 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 0x7f7cdc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): picked mon.b con 0x7f7cdc003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 0x7f7cdc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): picked mon.a con 0x7f7cdc004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 0x7f7cdc00bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): picked mon.c con 0x7f7cdc005470 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80a3f90 con 0x7f7cdc004900 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc00c3c0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc00c5c0 con 0x7f7cdc005470 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 0x7f7cdc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 0x7f7cdc00bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request con 0x7f7cdc004900 auth_method 0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): get_auth_request con 0x7f7cdc005470 auth_method 0 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf7fff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 msgr2=0x7f7cdc003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 0x7f7cdc003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_done global_id 74433 payload 293 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 msgr2=0x7f7cdc003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.682+0000 7f7cfcb75640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 0x7f7cdc003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 msgr2=0x7f7cdc004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 0x7f7cdc004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 10 monclient: _finish_hunting 0 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 1 monclient: found mon.c 2026-02-17T11:52:57.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc003620 con 0x7f7cdc005470 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 10 monclient: _finish_auth 0 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 10 monclient: _check_auth_tickets 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfcb75640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfe5ff640 5 monclient: authenticate success, global_id 74433 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 0x7f7cdc004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.683+0000 7f7cfe5ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfcb75640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 msgr2=0x7f7cdc00bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfcb75640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 0x7f7cdc00bae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8077150 tx=0x7f7cec02fa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600f37598dba7726 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec007b30 con 0x7f7cdc005470 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: dump: 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec03a070 con 0x7f7cdc005470 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 1 -- 10.20.193.51:0/964882166 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0349d0 con 0x7f7cdc005470 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 4 set_mon_vals no callback set 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cf6ffd640 10 monclient: dump: 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.696 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 10 monclient: shutdown 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 msgr2=0x7f7cdc00bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 0x7f7cdc00bae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8077150 tx=0x7f7cec02fa30 comp rx=0 tx=0).stop 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/964882166 shutdown_connections 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc005470 0x7f7cdc00bae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc004900 0x7f7cdc004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/964882166 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc003ab0 0x7f7cdc003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/964882166 >> 10.20.193.51:0/964882166 conn(0x7f7cf80a30c0 msgr2=0x7f7cf80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:57.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.685+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/964882166 shutdown_connections 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/964882166 wait complete. 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient: build_initial_monmap 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient: monmap: 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 Processor -- start 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 -- start start 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient: init 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-c con 0x7f7cdc003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 0x7f7cf8095b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-b con 0x7f7cdc004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc005470 0x7f7cf80960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): picked mon.noname-a con 0x7f7cdc005470 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf809c850 con 0x7f7cdc005470 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf809ef20 con 0x7f7cdc004900 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80a04b0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.686+0000 7f7cfe5ff640 10 monclient(hunting): authenticate will time out at 1065.305996s 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54588/0 (socket says 10.20.193.51:54588) 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 -- 10.20.193.51:0/1179717456 learned_addr learned my addr 10.20.193.51:0/1179717456 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request con 0x7f7cdc003ab0 auth_method 0 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf77fe640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 msgr2=0x7f7cf8095b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc005470 0x7f7cf80960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 0x7f7cf8095b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): get_auth_request con 0x7f7cdc005470 auth_method 0 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cfcb75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient(hunting): handle_auth_done global_id 104186 payload 824 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 msgr2=0x7f7cf8095b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 0x7f7cf8095b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc005470 msgr2=0x7f7cf80960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc005470 0x7f7cf80960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 monclient: found mon.noname-c 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.687+0000 7f7cf7fff640 1 -- 10.20.193.51:0/1179717456 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8099220 con 0x7f7cdc003ab0 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf7fff640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 msgr2=0x7f7cf8095650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf7fff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40135e0 tx=0x7f7ce4013ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce401c070 con 0x7f7cdc003ab0 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: dump: 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce40158d0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 5 monclient: authenticate success, global_id 104186 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4015ca0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 10 monclient: dump: 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf67fc640 4 set_mon_vals no callback set 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 10 monclient: _renew_subs 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf8099500 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 10 monclient: _renew_subs 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf809d7b0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.689+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7ce4016460 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cfe5ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cfe5ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cfe5ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf809dc30 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cf4ff9640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 0x7f7cc80401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f7ce4052ea0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 0x7f7cc80401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.690+0000 7f7cf77fe640 10 monclient: get_auth_request con 0x7f7cc803dcf0 auth_method 0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.692+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7ce4020cd0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.692+0000 7f7cf4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.692+0000 7f7cf4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.693+0000 7f7cf77fe640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 0x7f7cc80401b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7cf806d590 tx=0x7f7ce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cfe5ff640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cfe5ff640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cfe5ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7cf80008d0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cf4ff9640 1 -- 10.20.193.51:0/1179717456 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f7ce40518a0 con 0x7f7cdc003ab0 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cf4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.813+0000 7f7cf4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:57.816 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":62,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 msgr2=0x7f7cc80401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 0x7f7cc80401b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7cf806d590 tx=0x7f7ce8008040 comp rx=0 tx=0).stop 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 10 monclient: shutdown 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 msgr2=0x7f7cf8095650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40135e0 tx=0x7f7ce4013ab0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 shutdown_connections 2026-02-17T11:52:57.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dcf0 0x7f7cc80401b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cdc005470 0x7f7cf80960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cdc004900 0x7f7cf8095b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 --2- 10.20.193.51:0/1179717456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cdc003ab0 0x7f7cf8095650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 >> 10.20.193.51:0/1179717456 conn(0x7f7cf80a30c0 msgr2=0x7f7cf8072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 shutdown_connections 2026-02-17T11:52:57.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.814+0000 7f7cfe5ff640 1 -- 10.20.193.51:0/1179717456 wait complete. 2026-02-17T11:52:57.825 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:52:57.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:52:57.825 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:52:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: get_monmap_and_config 2026-02-17T11:52:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: build_initial_monmap 2026-02-17T11:52:57.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: monmap: 2026-02-17T11:52:57.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:57.892136+0000 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:57.892136+0000 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 Processor -- start 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 -- start start 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: init 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 0x7fb9a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-c con 0x7fb9a80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9a80a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-b con 0x7fb9a813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a806e140 con 0x7fb9a80a0750 2026-02-17T11:52:57.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a809f910 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a809ccd0 con 0x7fb9a813b760 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aecfb640 10 monclient(hunting): authenticate will time out at 1065.510919s 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aca70640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 msgr2=0x7fb9a809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.891+0000 7fb9aca70640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 0x7fb9a809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54602/0 (socket says 10.20.193.51:54602) 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 -- 10.20.193.51:0/2058819251 learned_addr learned my addr 10.20.193.51:0/2058819251 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): get_auth_request con 0x7fb9a813b760 auth_method 0 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb99ffff640 1 -- 10.20.193.51:0/2058819251 >> v1:10.20.193.142:6789/0 conn(0x7fb9a80a0750 legacy=0x7fb9a809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient(hunting): handle_auth_done global_id 104189 payload 274 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 -- 10.20.193.51:0/2058819251 >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 msgr2=0x7fb9a809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 --2- 10.20.193.51:0/2058819251 >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 0x7fb9a809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 -- 10.20.193.51:0/2058819251 >> v1:10.20.193.142:6789/0 conn(0x7fb9a80a0750 legacy=0x7fb9a809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient: _finish_hunting 0 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 monclient: found mon.noname-b 2026-02-17T11:52:57.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:57.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.892+0000 7fb9ad271640 1 -- 10.20.193.51:0/2058819251 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a809eec0 con 0x7fb9a813b760 2026-02-17T11:52:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb9ad271640 1 -- 10.20.193.51:0/2058819251 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 msgr2=0x7fb9a813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb9ad271640 1 --2- 10.20.193.51:0/2058819251 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806c1c0 tx=0x7fb9a402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8676071743f63c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 1 -- 10.20.193.51:0/2058819251 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40373f0 con 0x7fb9a813b760 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: dump: 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.909 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb9aecfb640 5 monclient: authenticate success, global_id 104189 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 1 -- 10.20.193.51:0/2058819251 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a4037590 con 0x7fb9a813b760 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb9aecfb640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb9aecfb640 4 set_mon_vals no callback set 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 1 -- 10.20.193.51:0/2058819251 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4037960 con 0x7fb9a813b760 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.894+0000 7fb99f7fe640 10 monclient: dump: 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.911 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 10 monclient: shutdown 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2058819251 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 msgr2=0x7fb9a813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2058819251 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806c1c0 tx=0x7fb9a402f230 comp rx=0 tx=0).stop 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2058819251 shutdown_connections 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2058819251 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a813b760 0x7fb9a813db50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2058819251 >> v2:10.20.193.142:3300/0 conn(0x7fb9a80a3bb0 0x7fb9a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2058819251 >> 10.20.193.51:0/2058819251 conn(0x7fb9a80a30c0 msgr2=0x7fb9a80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2058819251 shutdown_connections 2026-02-17T11:52:57.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2058819251 wait complete. 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 10 monclient: build_initial_monmap 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 10 monclient: monmap: 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:57.913 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 Processor -- start 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 1 -- start start 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.895+0000 7fb9aecfb640 10 monclient: init 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9a80a0750 0x7fb9a80951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-b con 0x7fb9a80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:57.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 0x7fb9a8095700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-c con 0x7fb9a80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a813b760 0x7fb9a8095c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): picked mon.noname-a con 0x7fb9a813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a80a04b0 con 0x7fb9a813b760 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a809c850 con 0x7fb9a80a0750 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a809e710 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aecfb640 10 monclient(hunting): authenticate will time out at 1065.515080s 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aca70640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9a80a0750 msgr2=0x7fb9a80951c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:57.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9aca70640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9a80a0750 0x7fb9a80951c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:57.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 0x7fb9a8095700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a813b760 0x7fb9a8095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 0x7fb9a8095700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54610/0 (socket says 10.20.193.51:54610) 2026-02-17T11:52:57.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 -- 10.20.193.51:0/2012490170 learned_addr learned my addr 10.20.193.51:0/2012490170 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:57.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): get_auth_request con 0x7fb9a80a3bb0 auth_method 0 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): get_auth_request con 0x7fb9a813b760 auth_method 0 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb9ad271640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient(hunting): handle_auth_done global_id 104192 payload 824 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9a80a0750 msgr2=0x7fb9a80951c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9a80a0750 0x7fb9a80951c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a813b760 msgr2=0x7fb9a8095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a813b760 0x7fb9a8095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:52:57.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 monclient: found mon.noname-c 2026-02-17T11:52:57.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:57.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.896+0000 7fb99ffff640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a8096f80 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99ffff640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 msgr2=0x7fb9a8095700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99ffff640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 0x7fb9a8095700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb99000b780 tx=0x7fb99000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990005270 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: dump: 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.923 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.924 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.924 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.924 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.924 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.924 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990010070 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:57.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990005650 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99effd640 4 set_mon_vals no callback set 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb99d7fa640 10 monclient: dump: 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.926 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 5 monclient: authenticate success, global_id 104192 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 10 monclient: _renew_subs 2026-02-17T11:52:57.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a80a2c00 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 10 monclient: _renew_subs 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.898+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a8098ac0 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aecfb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:57.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 0x7fb9a808d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a809dac0 con 0x7fb9a808d3f0 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb99000c520 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 0x7fb9a808d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient: get_auth_request con 0x7fb9a808d3f0 auth_method 0 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb99d7fa640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb97803dd10 0x7fb9780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 10 monclient(hunting): handle_auth_done global_id 74442 payload 824 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9aca70640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9a8069830 con 0x7fb9a808d3f0 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7fb990051ee0 con 0x7fb9a80a3bb0 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9ad271640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb97803dd10 0x7fb9780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.899+0000 7fb9ad271640 10 monclient: get_auth_request con 0x7fb97803dd10 auth_method 0 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb9aca70640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 msgr2=0x7fb9a808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb9aca70640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 0x7fb9a808d7d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb99800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998005070 con 0x7fb9a808d3f0 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 10 monclient: dump: 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.933 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb998005070 con 0x7fb9a808d3f0 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 msgr2=0x7fb9a808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 0x7fb9a808d7d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb99800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 msgr2=0x7fb9a808d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.901+0000 7fb99d7fa640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808d3f0 0x7fb9a808d7d0 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb99800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.902+0000 7fb9ad271640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb97803dd10 0x7fb9780401d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806f3c0 tx=0x7fb9a4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aecfb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 0x7fb9a81d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aecfb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8098620 con 0x7fb9a808dd10 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 0x7fb9a81d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient: get_auth_request con 0x7fb9a808dd10 auth_method 0 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:57.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:57.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:57.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:57.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:57.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 10 monclient(hunting): handle_auth_done global_id 74445 payload 824 2026-02-17T11:52:57.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.905+0000 7fb9aca70640 1 -- 10.20.193.51:0/2012490170 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9a8098900 con 0x7fb9a808dd10 2026-02-17T11:52:57.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aca70640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 msgr2=0x7fb9a81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:57.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aca70640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 0x7fb9a81d98b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb998005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:57.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998005220 con 0x7fb9a808dd10 2026-02-17T11:52:57.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:57.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 10 monclient: dump: 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:57.940 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7fb998005220 con 0x7fb9a808dd10 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 msgr2=0x7fb9a81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 0x7fb9a81d98b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb998005b20 comp rx=0 tx=0).stop 2026-02-17T11:52:57.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 msgr2=0x7fb9a81d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb99d7fa640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9a808dd10 0x7fb9a81d98b0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bcc0 tx=0x7fb998005b20 comp rx=0 tx=0).stop 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:52:57.942 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 62, 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 195839, 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:57.943 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:57.944 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:57.945 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.946 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:57.947 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:57.948 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:57.949 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:57.950 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:57.951 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.952 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.953 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:57.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:57.956 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:57.957 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:57.958 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:57.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb97803dd10 msgr2=0x7fb9780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb97803dd10 0x7fb9780401d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806f3c0 tx=0x7fb9a4033000 comp rx=0 tx=0).stop 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 10 monclient: shutdown 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 msgr2=0x7fb9a8095700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9aecfb640 1 --2- 10.20.193.51:0/2012490170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9a80a3bb0 0x7fb9a8095700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb99000b780 tx=0x7fb99000bc50 comp rx=0 tx=0).stop 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9ad271640 1 -- 10.20.193.51:0/2012490170 reap_dead start 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.907+0000 7fb9ad271640 1 -- 10.20.193.51:0/2012490170 reap_dead start 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.908+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 shutdown_connections 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.908+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 >> 10.20.193.51:0/2012490170 conn(0x7fb9a80a30c0 msgr2=0x7fb9a813aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.908+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 shutdown_connections 2026-02-17T11:52:57.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:57.908+0000 7fb9aecfb640 1 -- 10.20.193.51:0/2012490170 wait complete. 2026-02-17T11:52:57.961 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:52:57.961 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:52:57.961 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:52:58.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.026+0000 7f88e3efa640 10 monclient: get_monmap_and_config 2026-02-17T11:52:58.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.026+0000 7f88e3efa640 10 monclient: build_initial_monmap 2026-02-17T11:52:58.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.026+0000 7f88e3efa640 10 monclient: monmap: 2026-02-17T11:52:58.028 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:58.028 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:52:58.027912+0000 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:52:58.027912+0000 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:52:58.029 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 Processor -- start 2026-02-17T11:52:58.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 -- start start 2026-02-17T11:52:58.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient: init 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-b con 0x7f88dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 0x7f88dc09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-c con 0x7f88dc09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88dc09ff40 addr v1:10.20.193.51:6789/0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88dc06e140 con 0x7f88dc09ff40 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f88dc09aed0 con 0x7f88dc09dac0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc09caa0 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e3efa640 10 monclient(hunting): authenticate will time out at 1065.646666s 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e146e640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 msgr2=0x7f88dc09fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e146e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 0x7f88dc09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e2470640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f88dc09ff40 0x7f88dc13b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55984/0 (socket says 10.20.193.51:55984) 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e2470640 1 -- 10.20.193.51:0/917127119 learned_addr learned my addr 10.20.193.51:0/917127119 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request con 0x7f88dc0a3bb0 auth_method 0 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:58.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_done global_id 104195 payload 274 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 -- 10.20.193.51:0/917127119 >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 msgr2=0x7f88dc09fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/917127119 >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 0x7f88dc09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 -- 10.20.193.51:0/917127119 >> v1:10.20.193.51:6789/0 conn(0x7f88dc09ff40 legacy=0x7f88dc13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient: _finish_hunting 0 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 monclient: found mon.noname-b 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:52:58.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.027+0000 7f88e1c6f640 1 -- 10.20.193.51:0/917127119 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc09ce60 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e1c6f640 1 -- 10.20.193.51:0/917127119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/917127119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc09f4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88dc069d60 tx=0x7f88cc02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b21cc4c23502e9f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 1 -- 10.20.193.51:0/917127119 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03c070 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: dump: 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: _finish_auth 0 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: _check_auth_tickets 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 5 monclient: authenticate success, global_id 104195 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 1 -- 10.20.193.51:0/917127119 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc02fd70 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 10 monclient: get_monmap_and_config success 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 1 -- 10.20.193.51:0/917127119 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc037660 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 4 set_mon_vals no callback set 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e0c6d640 10 monclient: dump: 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 10 monclient: shutdown 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 -- 10.20.193.51:0/917127119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 --2- 10.20.193.51:0/917127119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc09f4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88dc069d60 tx=0x7f88cc02ee10 comp rx=0 tx=0).stop 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 -- 10.20.193.51:0/917127119 shutdown_connections 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 --2- 10.20.193.51:0/917127119 >> v2:10.20.193.142:3300/0 conn(0x7f88dc09dac0 0x7f88dc09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 --2- 10.20.193.51:0/917127119 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc09f4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 -- 10.20.193.51:0/917127119 >> 10.20.193.51:0/917127119 conn(0x7f88dc0a30c0 msgr2=0x7f88dc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 -- 10.20.193.51:0/917127119 shutdown_connections 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.030+0000 7f88e3efa640 1 -- 10.20.193.51:0/917127119 wait complete. 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient: build_initial_monmap 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient: monmap: 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 Processor -- start 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 -- start start 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient: init 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient: _reopen_session rank -1 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc09dac0 0x7f88dc1cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-a con 0x7f88dc09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc09ff40 0x7f88dc1cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-b con 0x7f88dc09ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc1cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): picked mon.noname-c con 0x7f88dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc09a880 con 0x7f88dc09dac0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc0a0350 con 0x7f88dc09ff40 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc0a04d0 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): _renew_subs 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e3efa640 10 monclient(hunting): authenticate will time out at 1065.650843s 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc09dac0 0x7f88dc1cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e146e640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc09ff40 msgr2=0x7f88dc1cf9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc09dac0 0x7f88dc1cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:47930/0 (socket says 10.20.193.51:47930) 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 1 -- 10.20.193.51:0/1529364091 learned_addr learned my addr 10.20.193.51:0/1529364091 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request con 0x7f88dc09dac0 auth_method 0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc1cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e146e640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc09ff40 0x7f88dc1cf9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:52:58.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): get_auth_request con 0x7f88dc0a3bb0 auth_method 0 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.031+0000 7f88e2470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 10 monclient(hunting): handle_auth_done global_id 104198 payload 824 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc09ff40 msgr2=0x7f88dc1cf9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc09ff40 0x7f88dc1cf9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc09dac0 msgr2=0x7f88dc1cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc09dac0 0x7f88dc1cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 10 monclient: _finish_hunting 0 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 monclient: found mon.noname-c 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:52:58.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.032+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc097c70 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc1cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e2470640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc1cff20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88d800cb20 tx=0x7f88d8005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d800ad50 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:52:58.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: dump: 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: _finish_auth 0 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d8012400 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d80127f0 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:58.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88ca7fc640 10 monclient: dump: 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88cbfff640 4 set_mon_vals no callback set 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 5 monclient: authenticate success, global_id 104198 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 monclient: _renew_subs 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc097f50 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 monclient: _renew_subs 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc09d7b0 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 0x7f88dc0907f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc0a3fc0 con 0x7f88dc090410 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 0x7f88dc0907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient: get_auth_request con 0x7f88dc090410 auth_method 0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.034+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f88d80129d0 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_done global_id 104201 payload 824 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88e1c6f640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88dc09e490 con 0x7f88dc090410 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88ca7fc640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dcc0 0x7f88ac040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(262..262 src has 167..262) ==== 4783+0+0 (secure 0 0 0) 0x7f88d8052a90 con 0x7f88dc0a3bb0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88e146e640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dcc0 0x7f88ac040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.035+0000 7f88e146e640 10 monclient: get_auth_request con 0x7f88ac03dcc0 auth_method 0 2026-02-17T11:52:58.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88e1c6f640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 msgr2=0x7f88dc0907f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 0x7f88dc0907f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88cc03a040 tx=0x7f88cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03c040 con 0x7f88dc090410 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 10 monclient: dump: 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f88cc037d50 con 0x7f88dc090410 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 msgr2=0x7f88dc0907f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 0x7f88dc0907f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88cc03a040 tx=0x7f88cc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 msgr2=0x7f88dc0907f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.037+0000 7f88ca7fc640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090410 0x7f88dc0907f0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88cc03a040 tx=0x7f88cc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.038+0000 7f88e146e640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dcc0 0x7f88ac040180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88dc095860 tx=0x7f88d0009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e3efa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e3efa640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 0x7f88dc1da780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e3efa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc096540 con 0x7f88dc090d30 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 0x7f88dc1da780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient: get_auth_request con 0x7f88dc090d30 auth_method 0 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 10 monclient(hunting): handle_auth_done global_id 104204 payload 824 2026-02-17T11:52:58.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.040+0000 7f88e1c6f640 1 -- 10.20.193.51:0/1529364091 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88dc0008d0 con 0x7f88dc090d30 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.042+0000 7f88e1c6f640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 msgr2=0x7f88dc1da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.042+0000 7f88e1c6f640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 0x7f88dc1da780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88cc048000 tx=0x7f88cc008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03c040 con 0x7f88dc090d30 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 10 monclient: dump: 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:52:58.049 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4696 (secure 0 0 0) 0x7f88cc051940 con 0x7f88dc090d30 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 msgr2=0x7f88dc1da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 0x7f88dc1da780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88cc048000 tx=0x7f88cc008030 comp rx=0 tx=0).stop 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 msgr2=0x7f88dc1da780 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88ca7fc640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc090d30 0x7f88dc1da780 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88cc048000 tx=0x7f88cc008030 comp rx=0 tx=0).stop 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:52:58.050 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 62, 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 43008, 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:58.051 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:52:58.052 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:52:58.053 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:52:58.054 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.056 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:52:58.057 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.058 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.059 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:52:58.060 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:52:58.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dcc0 msgr2=0x7f88ac040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dcc0 0x7f88ac040180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88dc095860 tx=0x7f88d0009270 comp rx=0 tx=0).stop 2026-02-17T11:52:58.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 10 monclient: shutdown 2026-02-17T11:52:58.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:52:58.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc1cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 --2- 10.20.193.51:0/1529364091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc1cff20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88d800cb20 tx=0x7f88d8005bc0 comp rx=0 tx=0).stop 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 reap_dead start 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e2470640 1 -- 10.20.193.51:0/1529364091 reap_dead start 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 shutdown_connections 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 >> 10.20.193.51:0/1529364091 conn(0x7f88dc0a30c0 msgr2=0x7f88dc09e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 shutdown_connections 2026-02-17T11:52:58.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:52:58.043+0000 7f88e3efa640 1 -- 10.20.193.51:0/1529364091 wait complete. 2026-02-17T11:52:58.062 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:52:58.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:52:58.685 INFO:tasks.rados.rados.0.trial142.stdout:1049: done (0 left) 2026-02-17T11:52:58.685 INFO:tasks.rados.rados.0.trial142.stdout:1050: rollback oid 17 current snap is 118 2026-02-17T11:52:58.685 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 116 2026-02-17T11:52:58.685 INFO:tasks.rados.rados.0.trial142.stdout:1051: write oid 2 current snap is 118 2026-02-17T11:52:58.685 INFO:tasks.rados.rados.0.trial142.stdout:1051: seq_num 370 ranges {618590=627074,1835161=383429} 2026-02-17T11:52:58.690 INFO:tasks.rados.rados.0.trial142.stdout:1051: writing trial14245205-2 from 618590 to 1245664 tid 1 2026-02-17T11:52:58.693 INFO:tasks.rados.rados.0.trial142.stdout:1051: writing trial14245205-2 from 1835161 to 2218590 tid 2 2026-02-17T11:52:58.694 INFO:tasks.rados.rados.0.trial142.stdout:1052: write (excl) oid 41 current snap is 118 2026-02-17T11:52:58.694 INFO:tasks.rados.rados.0.trial142.stdout:1052: seq_num 371 ranges {635397=702323,1893643=341754} 2026-02-17T11:52:58.698 INFO:tasks.rados.rados.0.trial142.stdout:1052: writing trial14245205-41 from 635397 to 1337720 tid 1 2026-02-17T11:52:58.702 INFO:tasks.rados.rados.0.trial142.stdout:1052: writing trial14245205-41 from 1893643 to 2235397 tid 2 2026-02-17T11:52:58.702 INFO:tasks.rados.rados.0.trial142.stdout:1053: copy_from oid 24 from oid 50 current snap is 118 2026-02-17T11:52:58.702 INFO:tasks.rados.rados.0.trial142.stdout:1050: finishing rollback tid 1 to trial14245205-17 2026-02-17T11:52:58.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 598 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:52:58.702 INFO:tasks.rados.rados.0.trial142.stdout:1051: finishing write tid 1 to trial14245205-2 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: finishing write tid 2 to trial14245205-2 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: finishing write tid 3 to trial14245205-2 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1050: done (3 left) 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1054: read oid 37 snap -1 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1054: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1055: delete oid 18 current snap is 118 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: finishing write tid 4 to trial14245205-2 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: oid 2 updating version 0 to 613 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: oid 2 version 613 is already newer than 611 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: oid 2 version 613 is already newer than 612 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 613 (ObjNum 370 snap 118 seq_num 370) dirty exists 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1051: left oid 2 (ObjNum 370 snap 118 seq_num 370) 2026-02-17T11:52:58.703 INFO:tasks.rados.rados.0.trial142.stdout:1052: finishing write tid 1 to trial14245205-41 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: finishing write tid 2 to trial14245205-41 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: finishing write tid 3 to trial14245205-41 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: finishing write tid 4 to trial14245205-41 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: oid 41 updating version 0 to 615 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: oid 41 version 615 is already newer than 614 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: oid 41 updating version 615 to 616 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 616 (ObjNum 371 snap 118 seq_num 371) dirty exists 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: left oid 41 (ObjNum 371 snap 118 seq_num 371) 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1051: done (4 left) 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1052: done (3 left) 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1055: done (2 left) 2026-02-17T11:52:58.704 INFO:tasks.rados.rados.0.trial142.stdout:1056: snap_remove snap 81 2026-02-17T11:52:59.686 INFO:tasks.rados.rados.0.trial142.stdout:1056: done (2 left) 2026-02-17T11:52:59.686 INFO:tasks.rados.rados.0.trial142.stdout:1057: rollback oid 4 current snap is 118 2026-02-17T11:52:59.686 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 114 2026-02-17T11:52:59.686 INFO:tasks.rados.rados.0.trial142.stdout:1054: expect (ObjNum 255 snap 80 seq_num 255) 2026-02-17T11:52:59.789 INFO:tasks.rados.rados.0.trial142.stdout:1053: finishing copy_from racing read to trial14245205-24 2026-02-17T11:52:59.789 INFO:tasks.rados.rados.0.trial142.stdout:1053: finishing copy_from to trial14245205-24 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 458 (ObjNum 351 snap 113 seq_num 351) dirty exists 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:1057: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 796 (ObjNum 129 snap 0 seq_num 1534363028) dirty dne 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:1053: done (2 left) 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:1054: done (1 left) 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:1057: done (0 left) 2026-02-17T11:52:59.790 INFO:tasks.rados.rados.0.trial142.stdout:1058: snap_remove snap 114 2026-02-17T11:52:59.986 INFO:tasks.rados.rados.0.trial142.stdout:1058: done (0 left) 2026-02-17T11:52:59.986 INFO:tasks.rados.rados.0.trial142.stdout:1059: snap_create 2026-02-17T11:53:00.986 INFO:tasks.rados.rados.0.trial142.stdout:1059: done (0 left) 2026-02-17T11:53:00.987 INFO:tasks.rados.rados.0.trial142.stdout:1060: read oid 31 snap -1 2026-02-17T11:53:00.987 INFO:tasks.rados.rados.0.trial142.stdout:1060: expect (ObjNum 334 snap 109 seq_num 334) 2026-02-17T11:53:00.987 INFO:tasks.rados.rados.0.trial142.stdout:1061: delete oid 13 current snap is 119 2026-02-17T11:53:00.996 INFO:tasks.rados.rados.0.trial142.stdout:1060: expect (ObjNum 334 snap 109 seq_num 334) 2026-02-17T11:53:01.106 INFO:tasks.rados.rados.0.trial142.stdout:1060: done (1 left) 2026-02-17T11:53:01.107 INFO:tasks.rados.rados.0.trial142.stdout:1061: done (0 left) 2026-02-17T11:53:01.107 INFO:tasks.rados.rados.0.trial142.stdout:1062: write oid 40 current snap is 119 2026-02-17T11:53:01.107 INFO:tasks.rados.rados.0.trial142.stdout:1062: seq_num 374 ranges {685818=644423,2069089=216729} 2026-02-17T11:53:01.111 INFO:tasks.rados.rados.0.trial142.stdout:1062: writing trial14245205-40 from 685818 to 1330241 tid 1 2026-02-17T11:53:01.115 INFO:tasks.rados.rados.0.trial142.stdout:1062: writing trial14245205-40 from 2069089 to 2285818 tid 2 2026-02-17T11:53:01.115 INFO:tasks.rados.rados.0.trial142.stdout:1063: read oid 35 snap 118 2026-02-17T11:53:01.115 INFO:tasks.rados.rados.0.trial142.stdout:1063: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:53:01.115 INFO:tasks.rados.rados.0.trial142.stdout:1064: snap_remove snap 117 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1064: done (2 left) 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1065: write oid 46 current snap is 119 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: finishing write tid 1 to trial14245205-40 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: finishing write tid 2 to trial14245205-40 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: finishing write tid 3 to trial14245205-40 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: finishing write tid 4 to trial14245205-40 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: oid 40 updating version 0 to 621 2026-02-17T11:53:01.988 INFO:tasks.rados.rados.0.trial142.stdout:1062: oid 40 updating version 621 to 623 2026-02-17T11:53:01.989 INFO:tasks.rados.rados.0.trial142.stdout:1062: oid 40 version 623 is already newer than 622 2026-02-17T11:53:01.989 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 623 (ObjNum 374 snap 119 seq_num 374) dirty exists 2026-02-17T11:53:01.989 INFO:tasks.rados.rados.0.trial142.stdout:1062: left oid 40 (ObjNum 374 snap 119 seq_num 374) 2026-02-17T11:53:01.989 INFO:tasks.rados.rados.0.trial142.stdout:1063: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:53:02.125 INFO:tasks.rados.rados.0.trial142.stdout:1065: seq_num 375 ranges {702625=719672,2127571=175054} 2026-02-17T11:53:02.131 INFO:tasks.rados.rados.0.trial142.stdout:1065: writing trial14245205-46 from 702625 to 1422297 tid 1 2026-02-17T11:53:02.135 INFO:tasks.rados.rados.0.trial142.stdout:1065: writing trial14245205-46 from 2127571 to 2302625 tid 2 2026-02-17T11:53:02.136 INFO:tasks.rados.rados.0.trial142.stdout:1062: done (2 left) 2026-02-17T11:53:02.136 INFO:tasks.rados.rados.0.trial142.stdout:1063: done (1 left) 2026-02-17T11:53:02.136 INFO:tasks.rados.rados.0.trial142.stdout:1066: delete oid 17 current snap is 119 2026-02-17T11:53:02.136 INFO:tasks.rados.rados.0.trial142.stdout:1065: finishing write tid 1 to trial14245205-46 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: finishing write tid 2 to trial14245205-46 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: finishing write tid 3 to trial14245205-46 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: finishing write tid 4 to trial14245205-46 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: oid 46 updating version 0 to 880 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: oid 46 version 880 is already newer than 879 2026-02-17T11:53:02.137 INFO:tasks.rados.rados.0.trial142.stdout:1065: oid 46 version 880 is already newer than 876 2026-02-17T11:53:02.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 880 (ObjNum 375 snap 119 seq_num 375) dirty exists 2026-02-17T11:53:02.138 INFO:tasks.rados.rados.0.trial142.stdout:1065: left oid 46 (ObjNum 375 snap 119 seq_num 375) 2026-02-17T11:53:02.138 INFO:tasks.rados.rados.0.trial142.stdout:1065: done (1 left) 2026-02-17T11:53:02.138 INFO:tasks.rados.rados.0.trial142.stdout:1066: done (0 left) 2026-02-17T11:53:02.138 INFO:tasks.rados.rados.0.trial142.stdout:1067: write oid 42 current snap is 119 2026-02-17T11:53:02.139 INFO:tasks.rados.rados.0.trial142.stdout:1067: seq_num 377 ranges {736239=470170,1728182=571782} 2026-02-17T11:53:02.142 INFO:tasks.rados.rados.0.trial142.stdout:1067: writing trial14245205-42 from 736239 to 1206409 tid 1 2026-02-17T11:53:02.147 INFO:tasks.rados.rados.0.trial142.stdout:1067: writing trial14245205-42 from 1728182 to 2299964 tid 2 2026-02-17T11:53:02.147 INFO:tasks.rados.rados.0.trial142.stdout:1068: write (excl) oid 40 current snap is 119 2026-02-17T11:53:02.147 INFO:tasks.rados.rados.0.trial142.stdout:1068: seq_num 378 ranges {753046=545419,1786664=431793} 2026-02-17T11:53:02.152 INFO:tasks.rados.rados.0.trial142.stdout:1068: writing trial14245205-40 from 753046 to 1298465 tid 1 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1068: writing trial14245205-40 from 1786664 to 2218457 tid 2 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1069: write oid 20 current snap is 119 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: finishing write tid 1 to trial14245205-42 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: finishing write tid 2 to trial14245205-42 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: finishing write tid 3 to trial14245205-42 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: finishing write tid 4 to trial14245205-42 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: oid 42 updating version 0 to 694 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: oid 42 updating version 694 to 695 2026-02-17T11:53:02.156 INFO:tasks.rados.rados.0.trial142.stdout:1067: oid 42 version 695 is already newer than 693 2026-02-17T11:53:02.157 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 695 (ObjNum 377 snap 119 seq_num 377) dirty exists 2026-02-17T11:53:02.157 INFO:tasks.rados.rados.0.trial142.stdout:1067: left oid 42 (ObjNum 377 snap 119 seq_num 377) 2026-02-17T11:53:02.157 INFO:tasks.rados.rados.0.trial142.stdout:1068: finishing write tid 1 to trial14245205-40 2026-02-17T11:53:02.157 INFO:tasks.rados.rados.0.trial142.stdout:1069: seq_num 379 ranges {769853=620668,1845146=524707} 2026-02-17T11:53:02.160 INFO:tasks.rados.rados.0.trial142.stdout:1069: writing trial14245205-20 from 769853 to 1390521 tid 1 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1069: writing trial14245205-20 from 1845146 to 2369853 tid 2 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1067: done (2 left) 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1070: rollback oid 7 current snap is 119 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 118 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1068: finishing write tid 2 to trial14245205-40 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1068: finishing write tid 3 to trial14245205-40 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1068: finishing write tid 4 to trial14245205-40 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1068: oid 40 updating version 0 to 626 2026-02-17T11:53:02.165 INFO:tasks.rados.rados.0.trial142.stdout:1068: oid 40 version 626 is already newer than 624 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1068: oid 40 version 626 is already newer than 625 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 626 (ObjNum 378 snap 119 seq_num 378) dirty exists 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1068: left oid 40 (ObjNum 378 snap 119 seq_num 378) 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1069: finishing write tid 1 to trial14245205-20 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1068: done (2 left) 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1071: write oid 13 current snap is 119 2026-02-17T11:53:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1071: seq_num 380 ranges {786660=695917,1903628=435462} 2026-02-17T11:53:02.170 INFO:tasks.rados.rados.0.trial142.stdout:1071: writing trial14245205-13 from 786660 to 1482577 tid 1 2026-02-17T11:53:02.174 INFO:tasks.rados.rados.0.trial142.stdout:1071: writing trial14245205-13 from 1903628 to 2339090 tid 2 2026-02-17T11:53:02.174 INFO:tasks.rados.rados.0.trial142.stdout:1072: write (excl) oid 43 current snap is 119 2026-02-17T11:53:02.174 INFO:tasks.rados.rados.0.trial142.stdout:1069: finishing write tid 2 to trial14245205-20 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: finishing write tid 3 to trial14245205-20 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: finishing write tid 4 to trial14245205-20 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: oid 20 updating version 0 to 698 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: oid 20 version 698 is already newer than 696 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: oid 20 version 698 is already newer than 697 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 698 (ObjNum 379 snap 119 seq_num 379) dirty exists 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1069: left oid 20 (ObjNum 379 snap 119 seq_num 379) 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1070: finishing rollback tid 0 to trial14245205-7 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1070: finishing rollback tid 1 to trial14245205-7 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:1070: finishing rollback tid 2 to trial14245205-7 2026-02-17T11:53:02.175 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 884 (ObjNum 317 snap 102 seq_num 317) dirty exists 2026-02-17T11:53:02.176 INFO:tasks.rados.rados.0.trial142.stdout:1071: finishing write tid 1 to trial14245205-13 2026-02-17T11:53:02.176 INFO:tasks.rados.rados.0.trial142.stdout:1072: seq_num 381 ranges {403467=487519,1562110=579120} 2026-02-17T11:53:02.177 INFO:tasks.rados.rados.0.trial142.stdout:1072: writing trial14245205-43 from 403467 to 890986 tid 1 2026-02-17T11:53:02.181 INFO:tasks.rados.rados.0.trial142.stdout:1072: writing trial14245205-43 from 1562110 to 2141230 tid 2 2026-02-17T11:53:02.182 INFO:tasks.rados.rados.0.trial142.stdout:1069: done (3 left) 2026-02-17T11:53:02.182 INFO:tasks.rados.rados.0.trial142.stdout:1070: done (2 left) 2026-02-17T11:53:02.182 INFO:tasks.rados.rados.0.trial142.stdout:1073: snap_remove snap 118 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1073: done (2 left) 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1074: read oid 20 snap 116 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1074: expect (ObjNum 345 snap 111 seq_num 345) 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1075: rollback oid 18 current snap is 119 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 116 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1071: finishing write tid 2 to trial14245205-13 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1071: finishing write tid 3 to trial14245205-13 2026-02-17T11:53:02.990 INFO:tasks.rados.rados.0.trial142.stdout:1071: finishing write tid 4 to trial14245205-13 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1071: oid 13 updating version 0 to 719 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1071: oid 13 version 719 is already newer than 718 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1071: oid 13 version 719 is already newer than 717 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 719 (ObjNum 380 snap 119 seq_num 380) dirty exists 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1071: left oid 13 (ObjNum 380 snap 119 seq_num 380) 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: finishing write tid 1 to trial14245205-43 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: finishing write tid 2 to trial14245205-43 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: finishing write tid 3 to trial14245205-43 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: finishing write tid 4 to trial14245205-43 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: oid 43 updating version 0 to 888 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: oid 43 version 888 is already newer than 886 2026-02-17T11:53:02.991 INFO:tasks.rados.rados.0.trial142.stdout:1072: oid 43 version 888 is already newer than 887 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 888 (ObjNum 381 snap 119 seq_num 381) dirty exists 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:1072: left oid 43 (ObjNum 381 snap 119 seq_num 381) 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:1071: done (3 left) 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:1072: done (2 left) 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:1076: write oid 6 current snap is 119 2026-02-17T11:53:02.992 INFO:tasks.rados.rados.0.trial142.stdout:1076: seq_num 382 ranges {420274=562768,1620592=439131} 2026-02-17T11:53:02.993 INFO:tasks.rados.rados.0.trial142.stdout:1076: writing trial14245205-6 from 420274 to 983042 tid 1 2026-02-17T11:53:02.997 INFO:tasks.rados.rados.0.trial142.stdout:1076: writing trial14245205-6 from 1620592 to 2059723 tid 2 2026-02-17T11:53:02.997 INFO:tasks.rados.rados.0.trial142.stdout:1077: write oid 43 current snap is 119 2026-02-17T11:53:02.997 INFO:tasks.rados.rados.0.trial142.stdout:1075: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:53:02.997 INFO:tasks.rados.rados.0.trial142.stdout:1074: expect (ObjNum 345 snap 111 seq_num 345) 2026-02-17T11:53:03.116 INFO:tasks.rados.rados.0.trial142.stdout:1076: finishing write tid 1 to trial14245205-6 2026-02-17T11:53:03.116 INFO:tasks.rados.rados.0.trial142.stdout:1077: seq_num 383 ranges {437081=638017,1679074=582789} 2026-02-17T11:53:03.119 INFO:tasks.rados.rados.0.trial142.stdout:1077: writing trial14245205-43 from 437081 to 1075098 tid 1 2026-02-17T11:53:03.124 INFO:tasks.rados.rados.0.trial142.stdout:1077: writing trial14245205-43 from 1679074 to 2261863 tid 2 2026-02-17T11:53:03.124 INFO:tasks.rados.rados.0.trial142.stdout:1074: done (3 left) 2026-02-17T11:53:03.125 INFO:tasks.rados.rados.0.trial142.stdout:1078: write oid 16 current snap is 119 2026-02-17T11:53:03.125 INFO:tasks.rados.rados.0.trial142.stdout:1078: seq_num 384 ranges {453888=713266,1737556=442800} 2026-02-17T11:53:03.128 INFO:tasks.rados.rados.0.trial142.stdout:1078: writing trial14245205-16 from 453888 to 1167154 tid 1 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:1078: writing trial14245205-16 from 1737556 to 2180356 tid 2 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:1079: rollback oid 27 current snap is 119 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 116 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:1075: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 890 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T11:53:03.133 INFO:tasks.rados.rados.0.trial142.stdout:1076: finishing write tid 2 to trial14245205-6 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: finishing write tid 3 to trial14245205-6 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: finishing write tid 4 to trial14245205-6 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: oid 6 updating version 0 to 629 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: oid 6 version 629 is already newer than 628 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: oid 6 version 629 is already newer than 627 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 629 (ObjNum 382 snap 119 seq_num 382) dirty exists 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: left oid 6 (ObjNum 382 snap 119 seq_num 382) 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1077: finishing write tid 1 to trial14245205-43 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1077: finishing write tid 2 to trial14245205-43 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1075: done (4 left) 2026-02-17T11:53:03.134 INFO:tasks.rados.rados.0.trial142.stdout:1076: done (3 left) 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1080: delete oid 12 current snap is 119 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: finishing write tid 3 to trial14245205-43 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: finishing write tid 4 to trial14245205-43 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: oid 43 updating version 0 to 897 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: oid 43 version 897 is already newer than 896 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: oid 43 version 897 is already newer than 895 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 897 (ObjNum 383 snap 119 seq_num 383) dirty exists 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1077: left oid 43 (ObjNum 383 snap 119 seq_num 383) 2026-02-17T11:53:03.135 INFO:tasks.rados.rados.0.trial142.stdout:1078: finishing write tid 1 to trial14245205-16 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1078: finishing write tid 2 to trial14245205-16 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1077: done (3 left) 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1080: done (2 left) 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1081: read oid 28 snap 116 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1081: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1082: snap_create 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1078: finishing write tid 3 to trial14245205-16 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1078: finishing write tid 4 to trial14245205-16 2026-02-17T11:53:03.137 INFO:tasks.rados.rados.0.trial142.stdout:1078: oid 16 updating version 0 to 606 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1078: oid 16 updating version 606 to 607 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1078: oid 16 version 607 is already newer than 605 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 607 (ObjNum 384 snap 119 seq_num 384) dirty exists 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1078: left oid 16 (ObjNum 384 snap 119 seq_num 384) 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1079: finishing rollback tid 0 to trial14245205-27 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1079: finishing rollback tid 1 to trial14245205-27 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1079: finishing rollback tid 2 to trial14245205-27 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 725 (ObjNum 363 snap 114 seq_num 363) dirty exists 2026-02-17T11:53:03.138 INFO:tasks.rados.rados.0.trial142.stdout:1081: expect (ObjNum 242 snap 78 seq_num 242) 2026-02-17T11:53:03.991 INFO:tasks.rados.rados.0.trial142.stdout:1078: done (3 left) 2026-02-17T11:53:03.991 INFO:tasks.rados.rados.0.trial142.stdout:1079: done (2 left) 2026-02-17T11:53:03.992 INFO:tasks.rados.rados.0.trial142.stdout:1081: done (1 left) 2026-02-17T11:53:03.992 INFO:tasks.rados.rados.0.trial142.stdout:1082: done (0 left) 2026-02-17T11:53:03.992 INFO:tasks.rados.rados.0.trial142.stdout:1083: snap_remove snap 119 2026-02-17T11:53:04.992 INFO:tasks.rados.rados.0.trial142.stdout:1083: done (0 left) 2026-02-17T11:53:04.992 INFO:tasks.rados.rados.0.trial142.stdout:1084: write oid 49 current snap is 120 2026-02-17T11:53:04.992 INFO:tasks.rados.rados.0.trial142.stdout:1084: seq_num 386 ranges {487502=463764,1738167=446469} 2026-02-17T11:53:04.995 INFO:tasks.rados.rados.0.trial142.stdout:1084: writing trial14245205-49 from 487502 to 951266 tid 1 2026-02-17T11:53:05.000 INFO:tasks.rados.rados.0.trial142.stdout:1084: writing trial14245205-49 from 1738167 to 2184636 tid 2 2026-02-17T11:53:05.000 INFO:tasks.rados.rados.0.trial142.stdout:1085: copy_from oid 14 from oid 21 current snap is 120 2026-02-17T11:53:05.001 INFO:tasks.rados.rados.0.trial142.stdout:1084: finishing write tid 1 to trial14245205-49 2026-02-17T11:53:05.001 INFO:tasks.rados.rados.0.trial142.stdout:1086: snap_remove snap 116 2026-02-17T11:53:05.995 INFO:tasks.rados.rados.0.trial142.stdout:1086: done (2 left) 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1087: rollback oid 37 current snap is 120 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1087: done (2 left) 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1088: snap_create 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: finishing write tid 2 to trial14245205-49 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: finishing write tid 3 to trial14245205-49 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: finishing write tid 4 to trial14245205-49 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: oid 49 updating version 0 to 903 2026-02-17T11:53:05.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: oid 49 version 903 is already newer than 902 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:1084: oid 49 version 903 is already newer than 901 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 903 (ObjNum 386 snap 120 seq_num 386) dirty exists 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:1084: left oid 49 (ObjNum 386 snap 120 seq_num 386) 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:1085: finishing copy_from racing read to trial14245205-14 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:1085: finishing copy_from to trial14245205-14 2026-02-17T11:53:05.997 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:06.996 INFO:tasks.rados.rados.0.trial142.stdout:1084: done (2 left) 2026-02-17T11:53:06.997 INFO:tasks.rados.rados.0.trial142.stdout:1085: done (1 left) 2026-02-17T11:53:06.997 INFO:tasks.rados.rados.0.trial142.stdout:1088: done (0 left) 2026-02-17T11:53:06.997 INFO:tasks.rados.rados.0.trial142.stdout:1089: read oid 15 snap 120 2026-02-17T11:53:06.997 INFO:tasks.rados.rados.0.trial142.stdout:1089: expect deleted 2026-02-17T11:53:06.997 INFO:tasks.rados.rados.0.trial142.stdout:1090: delete oid 46 current snap is 121 2026-02-17T11:53:07.000 INFO:tasks.rados.rados.0.trial142.stdout:1089: done (1 left) 2026-02-17T11:53:07.000 INFO:tasks.rados.rados.0.trial142.stdout:1090: done (0 left) 2026-02-17T11:53:07.000 INFO:tasks.rados.rados.0.trial142.stdout:1091: copy_from oid 13 from oid 34 current snap is 121 2026-02-17T11:53:07.000 INFO:tasks.rados.rados.0.trial142.stdout:1092: write oid 32 current snap is 121 2026-02-17T11:53:07.000 INFO:tasks.rados.rados.0.trial142.stdout:1092: seq_num 388 ranges {521116=730615,1971484=549632} 2026-02-17T11:53:07.005 INFO:tasks.rados.rados.0.trial142.stdout:1092: writing trial14245205-32 from 521116 to 1251731 tid 1 2026-02-17T11:53:07.009 INFO:tasks.rados.rados.0.trial142.stdout:1092: writing trial14245205-32 from 1971484 to 2521116 tid 2 2026-02-17T11:53:07.010 INFO:tasks.rados.rados.0.trial142.stdout:1093: snap_remove snap 120 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1093: done (2 left) 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1094: delete oid 44 current snap is 121 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1091: finishing copy_from to trial14245205-13 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1091: got expected ENOENT (src dne) 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1091: finishing copy_from racing read to trial14245205-13 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: finishing write tid 1 to trial14245205-32 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: finishing write tid 2 to trial14245205-32 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: finishing write tid 3 to trial14245205-32 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: finishing write tid 4 to trial14245205-32 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: oid 32 updating version 0 to 699 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: oid 32 updating version 699 to 700 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: oid 32 updating version 700 to 701 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 701 (ObjNum 388 snap 121 seq_num 388) dirty exists 2026-02-17T11:53:07.999 INFO:tasks.rados.rados.0.trial142.stdout:1092: left oid 32 (ObjNum 388 snap 121 seq_num 388) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1091: done (2 left) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1092: done (1 left) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1094: done (0 left) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1095: read oid 50 snap -1 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1095: expect (ObjNum 351 snap 113 seq_num 351) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1096: read oid 32 snap -1 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1096: expect (ObjNum 388 snap 121 seq_num 388) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1097: rollback oid 2 current snap is 121 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1097: done (2 left) 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1098: write (excl) oid 13 current snap is 121 2026-02-17T11:53:08.001 INFO:tasks.rados.rados.0.trial142.stdout:1098: seq_num 390 ranges {554730=481113,1572095=737454} 2026-02-17T11:53:08.005 INFO:tasks.rados.rados.0.trial142.stdout:1098: writing trial14245205-13 from 554730 to 1035843 tid 1 2026-02-17T11:53:08.010 INFO:tasks.rados.rados.0.trial142.stdout:1098: writing trial14245205-13 from 1572095 to 2309549 tid 2 2026-02-17T11:53:08.010 INFO:tasks.rados.rados.0.trial142.stdout:1099: delete oid 2 current snap is 121 2026-02-17T11:53:08.010 INFO:tasks.rados.rados.0.trial142.stdout:1096: expect (ObjNum 388 snap 121 seq_num 388) 2026-02-17T11:53:08.087 INFO:tasks.rados.rados.0.trial142.stdout:1095: expect (ObjNum 351 snap 113 seq_num 351) 2026-02-17T11:53:08.205 INFO:tasks.rados.rados.0.trial142.stdout:1098: finishing write tid 1 to trial14245205-13 2026-02-17T11:53:08.205 INFO:tasks.rados.rados.0.trial142.stdout:1098: finishing write tid 2 to trial14245205-13 2026-02-17T11:53:08.205 INFO:tasks.rados.rados.0.trial142.stdout:1095: done (3 left) 2026-02-17T11:53:08.206 INFO:tasks.rados.rados.0.trial142.stdout:1096: done (2 left) 2026-02-17T11:53:08.206 INFO:tasks.rados.rados.0.trial142.stdout:1099: done (1 left) 2026-02-17T11:53:08.206 INFO:tasks.rados.rados.0.trial142.stdout:1100: write oid 46 current snap is 121 2026-02-17T11:53:08.206 INFO:tasks.rados.rados.0.trial142.stdout:1100: seq_num 392 ranges {588344=631611,1689059=741123} 2026-02-17T11:53:08.209 INFO:tasks.rados.rados.0.trial142.stdout:1100: writing trial14245205-46 from 588344 to 1219955 tid 1 2026-02-17T11:53:08.214 INFO:tasks.rados.rados.0.trial142.stdout:1100: writing trial14245205-46 from 1689059 to 2430182 tid 2 2026-02-17T11:53:08.214 INFO:tasks.rados.rados.0.trial142.stdout:1101: copy_from oid 37 from oid 36 current snap is 121 2026-02-17T11:53:08.214 INFO:tasks.rados.rados.0.trial142.stdout:1098: finishing write tid 3 to trial14245205-13 2026-02-17T11:53:08.214 INFO:tasks.rados.rados.0.trial142.stdout:1098: finishing write tid 4 to trial14245205-13 2026-02-17T11:53:08.214 INFO:tasks.rados.rados.0.trial142.stdout:1098: oid 13 updating version 0 to 731 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1098: oid 13 version 731 is already newer than 730 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1098: oid 13 updating version 731 to 732 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 732 (ObjNum 390 snap 121 seq_num 390) dirty exists 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1098: left oid 13 (ObjNum 390 snap 121 seq_num 390) 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1100: finishing write tid 1 to trial14245205-46 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1098: done (2 left) 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1102: read oid 3 snap -1 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1102: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1103: read oid 14 snap -1 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1103: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:08.215 INFO:tasks.rados.rados.0.trial142.stdout:1104: write (excl) oid 11 current snap is 121 2026-02-17T11:53:08.216 INFO:tasks.rados.rados.0.trial142.stdout:1104: seq_num 393 ranges {605151=706860,2031188=573963} 2026-02-17T11:53:08.218 INFO:tasks.rados.rados.0.trial142.stdout:1104: writing trial14245205-11 from 605151 to 1312011 tid 1 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1104: writing trial14245205-11 from 2031188 to 2605151 tid 2 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1105: copy_from oid 42 from oid 48 current snap is 121 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1100: finishing write tid 2 to trial14245205-46 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1100: finishing write tid 3 to trial14245205-46 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1100: finishing write tid 4 to trial14245205-46 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1100: oid 46 updating version 0 to 922 2026-02-17T11:53:08.224 INFO:tasks.rados.rados.0.trial142.stdout:1100: oid 46 updating version 922 to 923 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:1100: oid 46 updating version 923 to 924 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 924 (ObjNum 392 snap 121 seq_num 392) dirty exists 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:1100: left oid 46 (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:1101: finishing copy_from racing read to trial14245205-37 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:1104: finishing write tid 1 to trial14245205-11 2026-02-17T11:53:08.225 INFO:tasks.rados.rados.0.trial142.stdout:1103: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:08.370 INFO:tasks.rados.rados.0.trial142.stdout:1102: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1101: finishing copy_from to trial14245205-37 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 685 (ObjNum 331 snap 105 seq_num 331) dirty exists 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1104: finishing write tid 2 to trial14245205-11 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1104: finishing write tid 3 to trial14245205-11 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1104: finishing write tid 4 to trial14245205-11 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1104: oid 11 updating version 0 to 198 2026-02-17T11:53:08.453 INFO:tasks.rados.rados.0.trial142.stdout:1104: oid 11 version 198 is already newer than 196 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1104: oid 11 version 198 is already newer than 197 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 198 (ObjNum 393 snap 121 seq_num 393) dirty exists 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1104: left oid 11 (ObjNum 393 snap 121 seq_num 393) 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1105: finishing copy_from racing read to trial14245205-42 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1105: finishing copy_from to trial14245205-42 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 434 (ObjNum 258 snap 80 seq_num 258) dirty exists 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1100: done (5 left) 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1101: done (4 left) 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1102: done (3 left) 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1103: done (2 left) 2026-02-17T11:53:08.454 INFO:tasks.rados.rados.0.trial142.stdout:1104: done (1 left) 2026-02-17T11:53:08.455 INFO:tasks.rados.rados.0.trial142.stdout:1105: done (0 left) 2026-02-17T11:53:08.455 INFO:tasks.rados.rados.0.trial142.stdout:1106: copy_from oid 36 from oid 34 current snap is 121 2026-02-17T11:53:08.455 INFO:tasks.rados.rados.0.trial142.stdout:1107: write (excl) oid 4 current snap is 121 2026-02-17T11:53:08.455 INFO:tasks.rados.rados.0.trial142.stdout:1107: seq_num 394 ranges {621958=782109,2089670=532288} 2026-02-17T11:53:08.457 INFO:tasks.rados.rados.0.trial142.stdout:1107: writing trial14245205-4 from 621958 to 1404067 tid 1 2026-02-17T11:53:08.462 INFO:tasks.rados.rados.0.trial142.stdout:1107: writing trial14245205-4 from 2089670 to 2621958 tid 2 2026-02-17T11:53:08.463 INFO:tasks.rados.rados.0.trial142.stdout:1108: delete oid 45 current snap is 121 2026-02-17T11:53:08.463 INFO:tasks.rados.rados.0.trial142.stdout:1106: finishing copy_from to trial14245205-36 2026-02-17T11:53:08.463 INFO:tasks.rados.rados.0.trial142.stdout:1106: got expected ENOENT (src dne) 2026-02-17T11:53:08.463 INFO:tasks.rados.rados.0.trial142.stdout:1106: finishing copy_from racing read to trial14245205-36 2026-02-17T11:53:08.463 INFO:tasks.rados.rados.0.trial142.stdout:1107: finishing write tid 1 to trial14245205-4 2026-02-17T11:53:08.464 INFO:tasks.rados.rados.0.trial142.stdout:1106: done (2 left) 2026-02-17T11:53:08.464 INFO:tasks.rados.rados.0.trial142.stdout:1108: done (1 left) 2026-02-17T11:53:08.464 INFO:tasks.rados.rados.0.trial142.stdout:1109: rollback oid 45 current snap is 121 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1109: done (1 left) 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1110: delete oid 43 current snap is 121 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: finishing write tid 2 to trial14245205-4 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: finishing write tid 3 to trial14245205-4 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: finishing write tid 4 to trial14245205-4 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: oid 4 updating version 0 to 927 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: oid 4 version 927 is already newer than 926 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: oid 4 version 927 is already newer than 925 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 927 (ObjNum 394 snap 121 seq_num 394) dirty exists 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: left oid 4 (ObjNum 394 snap 121 seq_num 394) 2026-02-17T11:53:08.465 INFO:tasks.rados.rados.0.trial142.stdout:1107: done (1 left) 2026-02-17T11:53:08.466 INFO:tasks.rados.rados.0.trial142.stdout:1110: done (0 left) 2026-02-17T11:53:08.466 INFO:tasks.rados.rados.0.trial142.stdout:1111: delete oid 28 current snap is 121 2026-02-17T11:53:08.466 INFO:tasks.rados.rados.0.trial142.stdout:1111: done (0 left) 2026-02-17T11:53:08.466 INFO:tasks.rados.rados.0.trial142.stdout:1112: write oid 2 current snap is 121 2026-02-17T11:53:08.466 INFO:tasks.rados.rados.0.trial142.stdout:1112: seq_num 398 ranges {689186=799458,1923598=752130} 2026-02-17T11:53:08.471 INFO:tasks.rados.rados.0.trial142.stdout:1112: writing trial14245205-2 from 689186 to 1488644 tid 1 2026-02-17T11:53:08.476 INFO:tasks.rados.rados.0.trial142.stdout:1112: writing trial14245205-2 from 1923598 to 2675728 tid 2 2026-02-17T11:53:08.476 INFO:tasks.rados.rados.0.trial142.stdout:1113: write (excl) oid 19 current snap is 121 2026-02-17T11:53:08.476 INFO:tasks.rados.rados.0.trial142.stdout:1112: finishing write tid 1 to trial14245205-2 2026-02-17T11:53:08.476 INFO:tasks.rados.rados.0.trial142.stdout:1113: seq_num 399 ranges {705993=474707,1582080=612141} 2026-02-17T11:53:08.480 INFO:tasks.rados.rados.0.trial142.stdout:1113: writing trial14245205-19 from 705993 to 1180700 tid 1 2026-02-17T11:53:08.484 INFO:tasks.rados.rados.0.trial142.stdout:1113: writing trial14245205-19 from 1582080 to 2194221 tid 2 2026-02-17T11:53:08.484 INFO:tasks.rados.rados.0.trial142.stdout:1114: write oid 24 current snap is 121 2026-02-17T11:53:08.484 INFO:tasks.rados.rados.0.trial142.stdout:1114: seq_num 400 ranges {722800=549956,2040562=682238} 2026-02-17T11:53:08.488 INFO:tasks.rados.rados.0.trial142.stdout:1114: writing trial14245205-24 from 722800 to 1272756 tid 1 2026-02-17T11:53:08.494 INFO:tasks.rados.rados.0.trial142.stdout:1114: writing trial14245205-24 from 2040562 to 2722800 tid 2 2026-02-17T11:53:08.494 INFO:tasks.rados.rados.0.trial142.stdout:1115: copy_from oid 47 from oid 5 current snap is 121 2026-02-17T11:53:08.494 INFO:tasks.rados.rados.0.trial142.stdout:1112: finishing write tid 2 to trial14245205-2 2026-02-17T11:53:08.494 INFO:tasks.rados.rados.0.trial142.stdout:1116: read oid 41 snap -1 2026-02-17T11:53:08.495 INFO:tasks.rados.rados.0.trial142.stdout:1116: expect (ObjNum 371 snap 118 seq_num 371) 2026-02-17T11:53:08.495 INFO:tasks.rados.rados.0.trial142.stdout:1117: write oid 6 current snap is 121 2026-02-17T11:53:08.495 INFO:tasks.rados.rados.0.trial142.stdout:1117: seq_num 401 ranges {739607=625205,1982691=499457} 2026-02-17T11:53:08.499 INFO:tasks.rados.rados.0.trial142.stdout:1117: writing trial14245205-6 from 739607 to 1364812 tid 1 2026-02-17T11:53:08.504 INFO:tasks.rados.rados.0.trial142.stdout:1117: writing trial14245205-6 from 1982691 to 2482148 tid 2 2026-02-17T11:53:08.504 INFO:tasks.rados.rados.0.trial142.stdout:1118: read oid 16 snap -1 2026-02-17T11:53:08.504 INFO:tasks.rados.rados.0.trial142.stdout:1118: expect (ObjNum 384 snap 119 seq_num 384) 2026-02-17T11:53:08.504 INFO:tasks.rados.rados.0.trial142.stdout:1119: copy_from oid 50 from oid 37 current snap is 121 2026-02-17T11:53:08.504 INFO:tasks.rados.rados.0.trial142.stdout:1112: finishing write tid 3 to trial14245205-2 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: finishing write tid 4 to trial14245205-2 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: oid 2 updating version 0 to 620 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: oid 2 version 620 is already newer than 619 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: oid 2 version 620 is already newer than 618 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 620 (ObjNum 398 snap 121 seq_num 398) dirty exists 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: left oid 2 (ObjNum 398 snap 121 seq_num 398) 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1113: finishing write tid 1 to trial14245205-19 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1112: done (7 left) 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1120: write oid 23 current snap is 121 2026-02-17T11:53:08.505 INFO:tasks.rados.rados.0.trial142.stdout:1120: seq_num 402 ranges {756414=700454,2041173=715241} 2026-02-17T11:53:08.508 INFO:tasks.rados.rados.0.trial142.stdout:1120: writing trial14245205-23 from 756414 to 1456868 tid 1 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1120: writing trial14245205-23 from 2041173 to 2756414 tid 2 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1121: delete oid 36 current snap is 121 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: finishing write tid 2 to trial14245205-19 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: finishing write tid 3 to trial14245205-19 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: finishing write tid 4 to trial14245205-19 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: oid 19 updating version 0 to 515 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: oid 19 version 515 is already newer than 514 2026-02-17T11:53:08.514 INFO:tasks.rados.rados.0.trial142.stdout:1113: oid 19 updating version 515 to 516 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 516 (ObjNum 399 snap 121 seq_num 399) dirty exists 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1113: left oid 19 (ObjNum 399 snap 121 seq_num 399) 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: finishing write tid 1 to trial14245205-24 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: finishing write tid 2 to trial14245205-24 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: finishing write tid 3 to trial14245205-24 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: finishing write tid 4 to trial14245205-24 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: oid 24 updating version 0 to 688 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: oid 24 version 688 is already newer than 687 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: oid 24 updating version 688 to 689 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 689 (ObjNum 400 snap 121 seq_num 400) dirty exists 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1114: left oid 24 (ObjNum 400 snap 121 seq_num 400) 2026-02-17T11:53:08.515 INFO:tasks.rados.rados.0.trial142.stdout:1116: expect (ObjNum 371 snap 118 seq_num 371) 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1115: finishing copy_from racing read to trial14245205-47 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1115: finishing copy_from to trial14245205-47 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 604 (ObjNum 249 snap 79 seq_num 249) dirty exists 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: finishing write tid 1 to trial14245205-6 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: finishing write tid 2 to trial14245205-6 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: finishing write tid 3 to trial14245205-6 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: finishing write tid 4 to trial14245205-6 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: oid 6 updating version 0 to 632 2026-02-17T11:53:08.585 INFO:tasks.rados.rados.0.trial142.stdout:1117: oid 6 version 632 is already newer than 631 2026-02-17T11:53:08.586 INFO:tasks.rados.rados.0.trial142.stdout:1117: oid 6 version 632 is already newer than 630 2026-02-17T11:53:08.586 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 632 (ObjNum 401 snap 121 seq_num 401) dirty exists 2026-02-17T11:53:08.586 INFO:tasks.rados.rados.0.trial142.stdout:1117: left oid 6 (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:08.586 INFO:tasks.rados.rados.0.trial142.stdout:1118: expect (ObjNum 384 snap 119 seq_num 384) 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1120: finishing write tid 1 to trial14245205-23 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1119: finishing copy_from racing read to trial14245205-50 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1120: finishing write tid 2 to trial14245205-23 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1119: finishing copy_from to trial14245205-50 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 685 (ObjNum 331 snap 105 seq_num 331) dirty exists 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1120: finishing write tid 3 to trial14245205-23 2026-02-17T11:53:08.692 INFO:tasks.rados.rados.0.trial142.stdout:1120: finishing write tid 4 to trial14245205-23 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1120: oid 23 updating version 0 to 605 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1120: oid 23 updating version 605 to 606 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1120: oid 23 updating version 606 to 607 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 607 (ObjNum 402 snap 121 seq_num 402) dirty exists 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1120: left oid 23 (ObjNum 402 snap 121 seq_num 402) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1113: done (8 left) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1114: done (7 left) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1115: done (6 left) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1116: done (5 left) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1117: done (4 left) 2026-02-17T11:53:08.693 INFO:tasks.rados.rados.0.trial142.stdout:1118: done (3 left) 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1119: done (2 left) 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1120: done (1 left) 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1121: done (0 left) 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1122: read oid 1 snap -1 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1122: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1123: snap_create 2026-02-17T11:53:08.694 INFO:tasks.rados.rados.0.trial142.stdout:1122: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:09.002 INFO:tasks.rados.rados.0.trial142.stdout:1122: done (1 left) 2026-02-17T11:53:09.003 INFO:tasks.rados.rados.0.trial142.stdout:1123: done (0 left) 2026-02-17T11:53:09.003 INFO:tasks.rados.rados.0.trial142.stdout:1124: snap_create 2026-02-17T11:53:09.987 INFO:tasks.rados.rados.0.trial142.stdout:1124: done (0 left) 2026-02-17T11:53:09.987 INFO:tasks.rados.rados.0.trial142.stdout:1125: write (excl) oid 42 current snap is 123 2026-02-17T11:53:09.987 INFO:tasks.rados.rados.0.trial142.stdout:1125: seq_num 404 ranges {790028=567305,1874490=763137} 2026-02-17T11:53:09.991 INFO:tasks.rados.rados.0.trial142.stdout:1125: writing trial14245205-42 from 790028 to 1357333 tid 1 2026-02-17T11:53:09.997 INFO:tasks.rados.rados.0.trial142.stdout:1125: writing trial14245205-42 from 1874490 to 2637627 tid 2 2026-02-17T11:53:09.997 INFO:tasks.rados.rados.0.trial142.stdout:1126: copy_from oid 24 from oid 39 current snap is 123 2026-02-17T11:53:09.997 INFO:tasks.rados.rados.0.trial142.stdout:1125: finishing write tid 1 to trial14245205-42 2026-02-17T11:53:09.997 INFO:tasks.rados.rados.0.trial142.stdout:1127: write (excl) oid 2 current snap is 123 2026-02-17T11:53:09.997 INFO:tasks.rados.rados.0.trial142.stdout:1127: seq_num 405 ranges {406835=642554,1532972=506795,2772312=34523} 2026-02-17T11:53:10.000 INFO:tasks.rados.rados.0.trial142.stdout:1127: writing trial14245205-2 from 406835 to 1049389 tid 1 2026-02-17T11:53:10.004 INFO:tasks.rados.rados.0.trial142.stdout:1127: writing trial14245205-2 from 1532972 to 2039767 tid 2 2026-02-17T11:53:10.007 INFO:tasks.rados.rados.0.trial142.stdout:1127: writing trial14245205-2 from 2772312 to 2806835 tid 3 2026-02-17T11:53:10.007 INFO:tasks.rados.rados.0.trial142.stdout:1128: read oid 34 snap -1 2026-02-17T11:53:10.008 INFO:tasks.rados.rados.0.trial142.stdout:1128: expect deleted 2026-02-17T11:53:10.008 INFO:tasks.rados.rados.0.trial142.stdout:1129: write oid 18 current snap is 123 2026-02-17T11:53:10.008 INFO:tasks.rados.rados.0.trial142.stdout:1129: seq_num 406 ranges {423642=717803,1875101=766806} 2026-02-17T11:53:10.011 INFO:tasks.rados.rados.0.trial142.stdout:1129: writing trial14245205-18 from 423642 to 1141445 tid 1 2026-02-17T11:53:10.017 INFO:tasks.rados.rados.0.trial142.stdout:1129: writing trial14245205-18 from 1875101 to 2641907 tid 2 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1130: copy_from oid 13 from oid 4 current snap is 123 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1126: finishing copy_from to trial14245205-24 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1126: got expected ENOENT (src dne) 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1126: finishing copy_from racing read to trial14245205-24 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: finishing write tid 2 to trial14245205-42 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: finishing write tid 3 to trial14245205-42 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: finishing write tid 4 to trial14245205-42 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: oid 42 updating version 0 to 704 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: oid 42 version 704 is already newer than 703 2026-02-17T11:53:10.018 INFO:tasks.rados.rados.0.trial142.stdout:1125: oid 42 updating version 704 to 705 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 705 (ObjNum 404 snap 123 seq_num 404) dirty exists 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1125: left oid 42 (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1127: finishing write tid 1 to trial14245205-2 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1127: finishing write tid 2 to trial14245205-2 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1125: done (5 left) 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1126: done (4 left) 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1128: done (3 left) 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1131: write oid 43 current snap is 123 2026-02-17T11:53:10.019 INFO:tasks.rados.rados.0.trial142.stdout:1131: seq_num 407 ranges {440449=793052,1933583=510464} 2026-02-17T11:53:10.022 INFO:tasks.rados.rados.0.trial142.stdout:1131: writing trial14245205-43 from 440449 to 1233501 tid 1 2026-02-17T11:53:10.026 INFO:tasks.rados.rados.0.trial142.stdout:1131: writing trial14245205-43 from 1933583 to 2444047 tid 2 2026-02-17T11:53:10.026 INFO:tasks.rados.rados.0.trial142.stdout:1132: write oid 34 current snap is 123 2026-02-17T11:53:10.026 INFO:tasks.rados.rados.0.trial142.stdout:1127: finishing write tid 3 to trial14245205-2 2026-02-17T11:53:10.027 INFO:tasks.rados.rados.0.trial142.stdout:1132: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2026-02-17T11:53:10.030 INFO:tasks.rados.rados.0.trial142.stdout:1132: writing trial14245205-34 from 457256 to 925557 tid 1 2026-02-17T11:53:10.035 INFO:tasks.rados.rados.0.trial142.stdout:1132: writing trial14245205-34 from 1592065 to 2362540 tid 2 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1132: writing trial14245205-34 from 2854581 to 2857256 tid 3 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1133: copy_from oid 26 from oid 16 current snap is 123 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: finishing write tid 4 to trial14245205-2 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: finishing write tid 5 to trial14245205-2 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: oid 2 updating version 0 to 624 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: oid 2 version 624 is already newer than 622 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: oid 2 version 624 is already newer than 623 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: oid 2 version 624 is already newer than 621 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 624 (ObjNum 405 snap 123 seq_num 405) dirty exists 2026-02-17T11:53:10.038 INFO:tasks.rados.rados.0.trial142.stdout:1127: left oid 2 (ObjNum 405 snap 123 seq_num 405) 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: finishing write tid 1 to trial14245205-18 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: finishing write tid 2 to trial14245205-18 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: finishing write tid 3 to trial14245205-18 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: finishing write tid 4 to trial14245205-18 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: oid 18 updating version 0 to 932 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: oid 18 version 932 is already newer than 930 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: oid 18 version 932 is already newer than 931 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 932 (ObjNum 406 snap 123 seq_num 406) dirty exists 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1129: left oid 18 (ObjNum 406 snap 123 seq_num 406) 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1131: finishing write tid 1 to trial14245205-43 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1130: finishing copy_from racing read to trial14245205-13 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:1130: finishing copy_from to trial14245205-13 2026-02-17T11:53:10.039 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 927 (ObjNum 394 snap 121 seq_num 394) dirty exists 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: finishing write tid 2 to trial14245205-43 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: finishing write tid 3 to trial14245205-43 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: finishing write tid 4 to trial14245205-43 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: oid 43 updating version 0 to 935 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: oid 43 version 935 is already newer than 933 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: oid 43 version 935 is already newer than 934 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 935 (ObjNum 407 snap 123 seq_num 407) dirty exists 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1131: left oid 43 (ObjNum 407 snap 123 seq_num 407) 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1132: finishing write tid 1 to trial14245205-34 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1127: done (5 left) 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1129: done (4 left) 2026-02-17T11:53:10.040 INFO:tasks.rados.rados.0.trial142.stdout:1130: done (3 left) 2026-02-17T11:53:10.041 INFO:tasks.rados.rados.0.trial142.stdout:1131: done (2 left) 2026-02-17T11:53:10.041 INFO:tasks.rados.rados.0.trial142.stdout:1134: snap_remove snap 122 2026-02-17T11:53:11.014 INFO:tasks.rados.rados.0.trial142.stdout:1134: done (2 left) 2026-02-17T11:53:11.014 INFO:tasks.rados.rados.0.trial142.stdout:1135: read oid 35 snap 121 2026-02-17T11:53:11.014 INFO:tasks.rados.rados.0.trial142.stdout:1135: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:53:11.014 INFO:tasks.rados.rados.0.trial142.stdout:1136: delete oid 50 current snap is 123 2026-02-17T11:53:11.014 INFO:tasks.rados.rados.0.trial142.stdout:1132: finishing write tid 2 to trial14245205-34 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: finishing write tid 3 to trial14245205-34 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: finishing write tid 4 to trial14245205-34 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: finishing write tid 5 to trial14245205-34 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: oid 34 updating version 0 to 447 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: oid 34 updating version 447 to 449 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: oid 34 version 449 is already newer than 448 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: oid 34 version 449 is already newer than 446 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 449 (ObjNum 408 snap 123 seq_num 408) dirty exists 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1132: left oid 34 (ObjNum 408 snap 123 seq_num 408) 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1133: finishing copy_from racing read to trial14245205-26 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:1133: finishing copy_from to trial14245205-26 2026-02-17T11:53:11.015 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 607 (ObjNum 384 snap 119 seq_num 384) dirty exists 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1132: done (3 left) 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1133: done (2 left) 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1136: done (1 left) 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1137: read oid 2 snap -1 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1137: expect (ObjNum 405 snap 123 seq_num 405) 2026-02-17T11:53:11.018 INFO:tasks.rados.rados.0.trial142.stdout:1138: snap_create 2026-02-17T11:53:11.022 INFO:tasks.rados.rados.0.trial142.stdout:1135: expect (ObjNum 214 snap 69 seq_num 214) 2026-02-17T11:53:11.160 INFO:tasks.rados.rados.0.trial142.stdout:1137: expect (ObjNum 405 snap 123 seq_num 405) 2026-02-17T11:53:12.017 INFO:tasks.rados.rados.0.trial142.stdout:1135: done (2 left) 2026-02-17T11:53:12.018 INFO:tasks.rados.rados.0.trial142.stdout:1137: done (1 left) 2026-02-17T11:53:12.018 INFO:tasks.rados.rados.0.trial142.stdout:1138: done (0 left) 2026-02-17T11:53:12.018 INFO:tasks.rados.rados.0.trial142.stdout:1139: delete oid 41 current snap is 124 2026-02-17T11:53:12.020 INFO:tasks.rados.rados.0.trial142.stdout:1139: done (0 left) 2026-02-17T11:53:12.020 INFO:tasks.rados.rados.0.trial142.stdout:1140: copy_from oid 16 from oid 35 current snap is 124 2026-02-17T11:53:12.020 INFO:tasks.rados.rados.0.trial142.stdout:1141: snap_remove snap 123 2026-02-17T11:53:13.039 INFO:tasks.rados.rados.0.trial142.stdout:1141: done (1 left) 2026-02-17T11:53:13.039 INFO:tasks.rados.rados.0.trial142.stdout:1142: read oid 29 snap -1 2026-02-17T11:53:13.039 INFO:tasks.rados.rados.0.trial142.stdout:1142: expect (ObjNum 368 snap 117 seq_num 368) 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1143: read oid 38 snap -1 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1143: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1144: rollback oid 14 current snap is 124 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 121 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1140: finishing copy_from racing read to trial14245205-16 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1140: finishing copy_from to trial14245205-16 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 632 (ObjNum 214 snap 69 seq_num 214) dirty exists 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1140: done (3 left) 2026-02-17T11:53:13.040 INFO:tasks.rados.rados.0.trial142.stdout:1145: read oid 27 snap -1 2026-02-17T11:53:13.041 INFO:tasks.rados.rados.0.trial142.stdout:1145: expect (ObjNum 363 snap 114 seq_num 363) 2026-02-17T11:53:13.041 INFO:tasks.rados.rados.0.trial142.stdout:1146: delete oid 32 current snap is 124 2026-02-17T11:53:13.041 INFO:tasks.rados.rados.0.trial142.stdout:1144: finishing rollback tid 0 to trial14245205-14 2026-02-17T11:53:13.042 INFO:tasks.rados.rados.0.trial142.stdout:1144: finishing rollback tid 1 to trial14245205-14 2026-02-17T11:53:13.042 INFO:tasks.rados.rados.0.trial142.stdout:1144: finishing rollback tid 2 to trial14245205-14 2026-02-17T11:53:13.042 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 941 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:13.043 INFO:tasks.rados.rados.0.trial142.stdout:1144: done (4 left) 2026-02-17T11:53:13.043 INFO:tasks.rados.rados.0.trial142.stdout:1146: done (3 left) 2026-02-17T11:53:13.043 INFO:tasks.rados.rados.0.trial142.stdout:1147: rollback oid 21 current snap is 124 2026-02-17T11:53:13.043 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 121 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1148: read oid 33 snap -1 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1148: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1149: copy_from oid 24 from oid 35 current snap is 124 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1150: read oid 41 snap 121 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1150: expect (ObjNum 371 snap 118 seq_num 371) 2026-02-17T11:53:13.044 INFO:tasks.rados.rados.0.trial142.stdout:1151: write (excl) oid 25 current snap is 124 2026-02-17T11:53:13.045 INFO:tasks.rados.rados.0.trial142.stdout:1151: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2026-02-17T11:53:13.047 INFO:tasks.rados.rados.0.trial142.stdout:1151: writing trial14245205-25 from 524484 to 1010134 tid 1 2026-02-17T11:53:13.051 INFO:tasks.rados.rados.0.trial142.stdout:1151: writing trial14245205-25 from 1425993 to 2087453 tid 2 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:1151: writing trial14245205-25 from 2847920 to 2924484 tid 3 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:1152: read oid 45 snap -1 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:1152: expect deleted 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:1153: rollback oid 16 current snap is 124 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 121 2026-02-17T11:53:13.055 INFO:tasks.rados.rados.0.trial142.stdout:1142: expect (ObjNum 368 snap 117 seq_num 368) 2026-02-17T11:53:13.155 INFO:tasks.rados.rados.0.trial142.stdout:1145: expect (ObjNum 363 snap 114 seq_num 363) 2026-02-17T11:53:13.223 INFO:tasks.rados.rados.0.trial142.stdout:1143: expect (ObjNum 322 snap 105 seq_num 322) 2026-02-17T11:53:13.334 INFO:tasks.rados.rados.0.trial142.stdout:1147: finishing rollback tid 0 to trial14245205-21 2026-02-17T11:53:13.334 INFO:tasks.rados.rados.0.trial142.stdout:1147: finishing rollback tid 1 to trial14245205-21 2026-02-17T11:53:13.334 INFO:tasks.rados.rados.0.trial142.stdout:1147: finishing rollback tid 2 to trial14245205-21 2026-02-17T11:53:13.335 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 452 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:13.335 INFO:tasks.rados.rados.0.trial142.stdout:1150: expect (ObjNum 371 snap 118 seq_num 371) 2026-02-17T11:53:13.404 INFO:tasks.rados.rados.0.trial142.stdout:1148: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1151: finishing write tid 1 to trial14245205-25 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1151: finishing write tid 2 to trial14245205-25 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1142: done (9 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1143: done (8 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1145: done (7 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1147: done (6 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1148: done (5 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1150: done (4 left) 2026-02-17T11:53:13.534 INFO:tasks.rados.rados.0.trial142.stdout:1154: snap_create 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1149: finishing copy_from racing read to trial14245205-24 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1149: finishing copy_from to trial14245205-24 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 632 (ObjNum 214 snap 69 seq_num 214) dirty exists 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: finishing write tid 3 to trial14245205-25 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: finishing write tid 4 to trial14245205-25 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: finishing write tid 5 to trial14245205-25 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: oid 25 updating version 0 to 690 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: oid 25 version 690 is already newer than 689 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: oid 25 version 690 is already newer than 688 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: oid 25 version 690 is already newer than 687 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 690 (ObjNum 412 snap 124 seq_num 412) dirty exists 2026-02-17T11:53:13.535 INFO:tasks.rados.rados.0.trial142.stdout:1151: left oid 25 (ObjNum 412 snap 124 seq_num 412) 2026-02-17T11:53:13.536 INFO:tasks.rados.rados.0.trial142.stdout:1153: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:53:13.536 INFO:tasks.rados.rados.0.trial142.stdout:1153: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:53:13.536 INFO:tasks.rados.rados.0.trial142.stdout:1153: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:53:13.536 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 635 (ObjNum 384 snap 119 seq_num 384) dirty exists 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1149: done (4 left) 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1151: done (3 left) 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1152: done (2 left) 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1153: done (1 left) 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1154: done (0 left) 2026-02-17T11:53:14.041 INFO:tasks.rados.rados.0.trial142.stdout:1155: delete oid 19 current snap is 125 2026-02-17T11:53:14.043 INFO:tasks.rados.rados.0.trial142.stdout:1155: done (0 left) 2026-02-17T11:53:14.043 INFO:tasks.rados.rados.0.trial142.stdout:1156: write (excl) oid 36 current snap is 125 2026-02-17T11:53:14.043 INFO:tasks.rados.rados.0.trial142.stdout:1156: seq_num 414 ranges {558098=636148,1826604=665129} 2026-02-17T11:53:14.049 INFO:tasks.rados.rados.0.trial142.stdout:1156: writing trial14245205-36 from 558098 to 1194246 tid 1 2026-02-17T11:53:14.055 INFO:tasks.rados.rados.0.trial142.stdout:1156: writing trial14245205-36 from 1826604 to 2491733 tid 2 2026-02-17T11:53:14.055 INFO:tasks.rados.rados.0.trial142.stdout:1157: write oid 7 current snap is 125 2026-02-17T11:53:14.055 INFO:tasks.rados.rados.0.trial142.stdout:1157: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2026-02-17T11:53:14.060 INFO:tasks.rados.rados.0.trial142.stdout:1157: writing trial14245205-7 from 574905 to 1286302 tid 1 2026-02-17T11:53:14.064 INFO:tasks.rados.rados.0.trial142.stdout:1157: writing trial14245205-7 from 1885086 to 2410226 tid 2 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1157: writing trial14245205-7 from 2930189 to 2974905 tid 3 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1158: snap_create 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: finishing write tid 1 to trial14245205-36 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: finishing write tid 2 to trial14245205-36 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: finishing write tid 3 to trial14245205-36 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: finishing write tid 4 to trial14245205-36 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: oid 36 updating version 0 to 709 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: oid 36 version 709 is already newer than 708 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: oid 36 version 709 is already newer than 707 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 709 (ObjNum 414 snap 125 seq_num 414) dirty exists 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1156: left oid 36 (ObjNum 414 snap 125 seq_num 414) 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1157: finishing write tid 1 to trial14245205-7 2026-02-17T11:53:14.067 INFO:tasks.rados.rados.0.trial142.stdout:1157: finishing write tid 2 to trial14245205-7 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: finishing write tid 3 to trial14245205-7 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: finishing write tid 4 to trial14245205-7 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: finishing write tid 5 to trial14245205-7 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: oid 7 updating version 0 to 944 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: oid 7 updating version 944 to 945 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: oid 7 updating version 945 to 946 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: oid 7 version 946 is already newer than 943 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 946 (ObjNum 415 snap 125 seq_num 415) dirty exists 2026-02-17T11:53:14.068 INFO:tasks.rados.rados.0.trial142.stdout:1157: left oid 7 (ObjNum 415 snap 125 seq_num 415) 2026-02-17T11:53:14.996 INFO:tasks.rados.rados.0.trial142.stdout:1156: done (2 left) 2026-02-17T11:53:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1157: done (1 left) 2026-02-17T11:53:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1158: done (0 left) 2026-02-17T11:53:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1159: write (excl) oid 19 current snap is 126 2026-02-17T11:53:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1159: seq_num 416 ranges {591712=786646,1943568=668798} 2026-02-17T11:53:15.001 INFO:tasks.rados.rados.0.trial142.stdout:1159: writing trial14245205-19 from 591712 to 1378358 tid 1 2026-02-17T11:53:15.006 INFO:tasks.rados.rados.0.trial142.stdout:1159: writing trial14245205-19 from 1943568 to 2612366 tid 2 2026-02-17T11:53:15.007 INFO:tasks.rados.rados.0.trial142.stdout:1160: read oid 44 snap -1 2026-02-17T11:53:15.007 INFO:tasks.rados.rados.0.trial142.stdout:1160: expect deleted 2026-02-17T11:53:15.007 INFO:tasks.rados.rados.0.trial142.stdout:1161: delete oid 14 current snap is 126 2026-02-17T11:53:15.007 INFO:tasks.rados.rados.0.trial142.stdout:1159: finishing write tid 1 to trial14245205-19 2026-02-17T11:53:15.009 INFO:tasks.rados.rados.0.trial142.stdout:1159: finishing write tid 2 to trial14245205-19 2026-02-17T11:53:15.009 INFO:tasks.rados.rados.0.trial142.stdout:1159: finishing write tid 3 to trial14245205-19 2026-02-17T11:53:15.009 INFO:tasks.rados.rados.0.trial142.stdout:1159: finishing write tid 4 to trial14245205-19 2026-02-17T11:53:15.009 INFO:tasks.rados.rados.0.trial142.stdout:1159: oid 19 updating version 0 to 611 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1159: oid 19 version 611 is already newer than 610 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1159: oid 19 version 611 is already newer than 609 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 611 (ObjNum 416 snap 126 seq_num 416) dirty exists 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1159: left oid 19 (ObjNum 416 snap 126 seq_num 416) 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1159: done (2 left) 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1160: done (1 left) 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1161: done (0 left) 2026-02-17T11:53:15.010 INFO:tasks.rados.rados.0.trial142.stdout:1162: delete oid 13 current snap is 126 2026-02-17T11:53:15.011 INFO:tasks.rados.rados.0.trial142.stdout:1162: done (0 left) 2026-02-17T11:53:15.011 INFO:tasks.rados.rados.0.trial142.stdout:1163: delete oid 41 current snap is 126 2026-02-17T11:53:15.013 INFO:tasks.rados.rados.0.trial142.stdout:1163: done (0 left) 2026-02-17T11:53:15.013 INFO:tasks.rados.rados.0.trial142.stdout:1164: write oid 12 current snap is 126 2026-02-17T11:53:15.013 INFO:tasks.rados.rados.0.trial142.stdout:1164: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2026-02-17T11:53:15.017 INFO:tasks.rados.rados.0.trial142.stdout:1164: writing trial14245205-12 from 658940 to 1062935 tid 1 2026-02-17T11:53:15.023 INFO:tasks.rados.rados.0.trial142.stdout:1164: writing trial14245205-12 from 1777496 to 2453632 tid 2 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1164: writing trial14245205-12 from 2950951 to 3058940 tid 3 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1165: read oid 44 snap -1 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1165: expect deleted 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1166: write oid 20 current snap is 126 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1164: finishing write tid 1 to trial14245205-12 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1164: finishing write tid 2 to trial14245205-12 2026-02-17T11:53:15.026 INFO:tasks.rados.rados.0.trial142.stdout:1166: seq_num 421 ranges {675747=479244,1835978=536147} 2026-02-17T11:53:15.030 INFO:tasks.rados.rados.0.trial142.stdout:1166: writing trial14245205-20 from 675747 to 1154991 tid 1 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1166: writing trial14245205-20 from 1835978 to 2372125 tid 2 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1167: read oid 46 snap 121 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1167: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1168: delete oid 30 current snap is 126 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1164: finishing write tid 3 to trial14245205-12 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1164: finishing write tid 4 to trial14245205-12 2026-02-17T11:53:15.035 INFO:tasks.rados.rados.0.trial142.stdout:1164: finishing write tid 5 to trial14245205-12 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:1164: oid 12 updating version 0 to 950 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:1164: oid 12 updating version 950 to 951 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:1164: oid 12 updating version 951 to 952 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:1164: oid 12 version 952 is already newer than 949 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 952 (ObjNum 420 snap 126 seq_num 420) dirty exists 2026-02-17T11:53:15.036 INFO:tasks.rados.rados.0.trial142.stdout:1164: left oid 12 (ObjNum 420 snap 126 seq_num 420) 2026-02-17T11:53:15.037 INFO:tasks.rados.rados.0.trial142.stdout:1166: finishing write tid 1 to trial14245205-20 2026-02-17T11:53:15.038 INFO:tasks.rados.rados.0.trial142.stdout:1164: done (4 left) 2026-02-17T11:53:15.038 INFO:tasks.rados.rados.0.trial142.stdout:1165: done (3 left) 2026-02-17T11:53:15.038 INFO:tasks.rados.rados.0.trial142.stdout:1168: done (2 left) 2026-02-17T11:53:15.038 INFO:tasks.rados.rados.0.trial142.stdout:1169: write (excl) oid 21 current snap is 126 2026-02-17T11:53:15.038 INFO:tasks.rados.rados.0.trial142.stdout:1169: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2026-02-17T11:53:15.041 INFO:tasks.rados.rados.0.trial142.stdout:1169: writing trial14245205-21 from 709361 to 1339103 tid 1 2026-02-17T11:53:15.045 INFO:tasks.rados.rados.0.trial142.stdout:1169: writing trial14245205-21 from 1836589 to 2376405 tid 2 2026-02-17T11:53:15.048 INFO:tasks.rados.rados.0.trial142.stdout:1169: writing trial14245205-21 from 3033220 to 3109361 tid 3 2026-02-17T11:53:15.048 INFO:tasks.rados.rados.0.trial142.stdout:1166: finishing write tid 2 to trial14245205-20 2026-02-17T11:53:15.048 INFO:tasks.rados.rados.0.trial142.stdout:1166: finishing write tid 3 to trial14245205-20 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1170: read oid 6 snap 124 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1170: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1171: snap_create 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1166: finishing write tid 4 to trial14245205-20 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1166: oid 20 updating version 0 to 711 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1166: oid 20 updating version 711 to 712 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1166: oid 20 version 712 is already newer than 710 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 712 (ObjNum 421 snap 126 seq_num 421) dirty exists 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1166: left oid 20 (ObjNum 421 snap 126 seq_num 421) 2026-02-17T11:53:15.049 INFO:tasks.rados.rados.0.trial142.stdout:1167: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:15.106 INFO:tasks.rados.rados.0.trial142.stdout:1169: finishing write tid 1 to trial14245205-21 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: finishing write tid 2 to trial14245205-21 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: finishing write tid 3 to trial14245205-21 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: finishing write tid 4 to trial14245205-21 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: finishing write tid 5 to trial14245205-21 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: oid 21 updating version 0 to 456 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: oid 21 version 456 is already newer than 455 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: oid 21 version 456 is already newer than 453 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:1169: oid 21 version 456 is already newer than 454 2026-02-17T11:53:15.107 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 456 (ObjNum 423 snap 126 seq_num 423) dirty exists 2026-02-17T11:53:15.108 INFO:tasks.rados.rados.0.trial142.stdout:1169: left oid 21 (ObjNum 423 snap 126 seq_num 423) 2026-02-17T11:53:15.108 INFO:tasks.rados.rados.0.trial142.stdout:1170: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1166: done (4 left) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1167: done (3 left) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1169: done (2 left) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1170: done (1 left) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1171: done (0 left) 2026-02-17T11:53:15.997 INFO:tasks.rados.rados.0.trial142.stdout:1172: snap_remove snap 124 2026-02-17T11:53:16.997 INFO:tasks.rados.rados.0.trial142.stdout:1172: done (0 left) 2026-02-17T11:53:16.997 INFO:tasks.rados.rados.0.trial142.stdout:1173: snap_remove snap 125 2026-02-17T11:53:17.998 INFO:tasks.rados.rados.0.trial142.stdout:1173: done (0 left) 2026-02-17T11:53:17.998 INFO:tasks.rados.rados.0.trial142.stdout:1174: write (excl) oid 37 current snap is 127 2026-02-17T11:53:17.998 INFO:tasks.rados.rados.0.trial142.stdout:1174: seq_num 424 ranges {726168=704991,1895071=683474} 2026-02-17T11:53:18.004 INFO:tasks.rados.rados.0.trial142.stdout:1174: writing trial14245205-37 from 726168 to 1431159 tid 1 2026-02-17T11:53:18.008 INFO:tasks.rados.rados.0.trial142.stdout:1174: writing trial14245205-37 from 1895071 to 2578545 tid 2 2026-02-17T11:53:18.008 INFO:tasks.rados.rados.0.trial142.stdout:1175: read oid 46 snap -1 2026-02-17T11:53:18.008 INFO:tasks.rados.rados.0.trial142.stdout:1175: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:18.008 INFO:tasks.rados.rados.0.trial142.stdout:1176: write (excl) oid 48 current snap is 127 2026-02-17T11:53:18.008 INFO:tasks.rados.rados.0.trial142.stdout:1176: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2026-02-17T11:53:18.014 INFO:tasks.rados.rados.0.trial142.stdout:1176: writing trial14245205-48 from 742975 to 1523215 tid 1 2026-02-17T11:53:18.017 INFO:tasks.rados.rados.0.trial142.stdout:1176: writing trial14245205-48 from 1953553 to 2380685 tid 2 2026-02-17T11:53:18.020 INFO:tasks.rados.rados.0.trial142.stdout:1176: writing trial14245205-48 from 2971713 to 3142975 tid 3 2026-02-17T11:53:18.020 INFO:tasks.rados.rados.0.trial142.stdout:1177: write (excl) oid 33 current snap is 127 2026-02-17T11:53:18.020 INFO:tasks.rados.rados.0.trial142.stdout:1177: seq_num 426 ranges {759782=571842,2012035=687143} 2026-02-17T11:53:18.025 INFO:tasks.rados.rados.0.trial142.stdout:1177: writing trial14245205-33 from 759782 to 1331624 tid 1 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1177: writing trial14245205-33 from 2012035 to 2699178 tid 2 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1178: delete oid 1 current snap is 127 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: finishing write tid 1 to trial14245205-37 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: finishing write tid 2 to trial14245205-37 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: finishing write tid 3 to trial14245205-37 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: finishing write tid 4 to trial14245205-37 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: oid 37 updating version 0 to 689 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: oid 37 version 689 is already newer than 688 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:1174: oid 37 version 689 is already newer than 687 2026-02-17T11:53:18.030 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 689 (ObjNum 424 snap 127 seq_num 424) dirty exists 2026-02-17T11:53:18.031 INFO:tasks.rados.rados.0.trial142.stdout:1174: left oid 37 (ObjNum 424 snap 127 seq_num 424) 2026-02-17T11:53:18.031 INFO:tasks.rados.rados.0.trial142.stdout:1175: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:18.063 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:53:18.063 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T11:53:18.063 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:53:18.063 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T11:53:18.065 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:53:18.065 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:53:18.065 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1176: finishing write tid 1 to trial14245205-48 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1176: finishing write tid 2 to trial14245205-48 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1176: finishing write tid 3 to trial14245205-48 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1174: done (4 left) 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1175: done (3 left) 2026-02-17T11:53:18.089 INFO:tasks.rados.rados.0.trial142.stdout:1178: done (2 left) 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1179: write oid 24 current snap is 127 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: finishing write tid 4 to trial14245205-48 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: finishing write tid 5 to trial14245205-48 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: oid 48 updating version 0 to 461 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: oid 48 updating version 461 to 462 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: oid 48 version 462 is already newer than 460 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: oid 48 version 462 is already newer than 459 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 462 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1176: left oid 48 (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1177: finishing write tid 1 to trial14245205-33 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1177: finishing write tid 2 to trial14245205-33 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1177: finishing write tid 3 to trial14245205-33 2026-02-17T11:53:18.090 INFO:tasks.rados.rados.0.trial142.stdout:1179: seq_num 428 ranges {793396=722340,2128999=690812} 2026-02-17T11:53:18.094 INFO:tasks.rados.rados.0.trial142.stdout:1179: writing trial14245205-24 from 793396 to 1515736 tid 1 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1179: writing trial14245205-24 from 2128999 to 2819811 tid 2 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1176: done (2 left) 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1180: snap_create 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1177: finishing write tid 4 to trial14245205-33 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1177: oid 33 updating version 0 to 930 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1177: oid 33 updating version 930 to 931 2026-02-17T11:53:18.099 INFO:tasks.rados.rados.0.trial142.stdout:1177: oid 33 version 931 is already newer than 929 2026-02-17T11:53:18.100 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 931 (ObjNum 426 snap 127 seq_num 426) dirty exists 2026-02-17T11:53:18.100 INFO:tasks.rados.rados.0.trial142.stdout:1177: left oid 33 (ObjNum 426 snap 127 seq_num 426) 2026-02-17T11:53:18.100 INFO:tasks.rados.rados.0.trial142.stdout:1179: finishing write tid 1 to trial14245205-24 2026-02-17T11:53:18.101 INFO:tasks.rados.rados.0.trial142.stdout:1179: finishing write tid 2 to trial14245205-24 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: finishing write tid 3 to trial14245205-24 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: finishing write tid 4 to trial14245205-24 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: oid 24 updating version 0 to 692 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: oid 24 version 692 is already newer than 691 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: oid 24 version 692 is already newer than 690 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 692 (ObjNum 428 snap 127 seq_num 428) dirty exists 2026-02-17T11:53:18.102 INFO:tasks.rados.rados.0.trial142.stdout:1179: left oid 24 (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:53:18.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: get_monmap_and_config 2026-02-17T11:53:18.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: build_initial_monmap 2026-02-17T11:53:18.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: monmap: 2026-02-17T11:53:18.132 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:18.132011+0000 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:18.132011+0000 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:18.133 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 Processor -- start 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 -- start start 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: init 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa8bc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8bc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa8bc13c770 0x7fa8bc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-a con 0x7fa8bc13c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc09e8e0 con 0x7fa8bc0a0750 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc06e140 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc09f910 con 0x7fa8bc13c770 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c3429640 10 monclient(hunting): authenticate will time out at 1085.750756s 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c099d640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa8bc0a0750 0x7fa8bc09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49976/0 (socket says 10.20.193.51:49976) 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.131+0000 7fa8c099d640 1 -- 10.20.193.51:0/1281065033 learned_addr learned my addr 10.20.193.51:0/1281065033 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 1 --2- 10.20.193.51:0/1281065033 >> v2:10.20.193.51:3300/0 conn(0x7fa8bc13c770 0x7fa8bc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): get_auth_request con 0x7fa8bc13c770 auth_method 0 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient(hunting): handle_auth_done global_id 74451 payload 274 2026-02-17T11:53:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 1 -- 10.20.193.51:0/1281065033 >> v1:10.20.193.142:6789/0 conn(0x7fa8bc0a3bb0 legacy=0x7fa8bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 1 -- 10.20.193.51:0/1281065033 >> v1:10.20.193.51:6789/0 conn(0x7fa8bc0a0750 legacy=0x7fa8bc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient: _finish_hunting 0 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 1 monclient: found mon.noname-a 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.132+0000 7fa8c199f640 1 -- 10.20.193.51:0/1281065033 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc09ccd0 con 0x7fa8bc13c770 2026-02-17T11:53:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c199f640 1 -- 10.20.193.51:0/1281065033 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc13c770 msgr2=0x7fa8bc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c199f640 1 --2- 10.20.193.51:0/1281065033 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc13c770 0x7fa8bc13eb60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009d90 tx=0x7fa8b802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c84893a10bdccf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 1 -- 10.20.193.51:0/1281065033 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b803c070 con 0x7fa8bc13c770 2026-02-17T11:53:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: dump: 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: _finish_auth 0 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: _check_auth_tickets 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 5 monclient: authenticate success, global_id 74451 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 1 -- 10.20.193.51:0/1281065033 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b8037640 con 0x7fa8bc13c770 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 1 -- 10.20.193.51:0/1281065033 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8037a10 con 0x7fa8bc13c770 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 4 set_mon_vals no callback set 2026-02-17T11:53:18.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8abfff640 10 monclient: dump: 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 10 monclient: shutdown 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- 10.20.193.51:0/1281065033 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc13c770 msgr2=0x7fa8bc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1281065033 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc13c770 0x7fa8bc13eb60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009d90 tx=0x7fa8b802f190 comp rx=0 tx=0).stop 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- 10.20.193.51:0/1281065033 shutdown_connections 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1281065033 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc13c770 0x7fa8bc13eb60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- 10.20.193.51:0/1281065033 >> 10.20.193.51:0/1281065033 conn(0x7fa8bc0a30c0 msgr2=0x7fa8bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- 10.20.193.51:0/1281065033 shutdown_connections 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- 10.20.193.51:0/1281065033 wait complete. 2026-02-17T11:53:18.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 10 monclient: build_initial_monmap 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 10 monclient: monmap: 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 Processor -- start 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 1 -- start start 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.135+0000 7fa8c3429640 10 monclient: init 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 0x7fa8bc099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-c con 0x7fa8bc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-a con 0x7fa8bc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8bc13c770 0x7fa8bc09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:18.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): picked mon.noname-b con 0x7fa8bc13c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc09c850 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc09ebe0 con 0x7fa8bc13c770 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc0a04b0 con 0x7fa8bc0a0750 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c3429640 10 monclient(hunting): authenticate will time out at 1085.755240s 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 0x7fa8bc099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 0x7fa8bc099ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55222/0 (socket says 10.20.193.51:55222) 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39328/0 (socket says 10.20.193.51:39328) 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 1 -- 10.20.193.51:0/1553744403 learned_addr learned my addr 10.20.193.51:0/1553744403 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): get_auth_request con 0x7fa8bc0a0750 auth_method 0 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): get_auth_request con 0x7fa8bc0a3bb0 auth_method 0 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:18.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c199f640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8bc13c770 0x7fa8bc09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c119e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c199f640 10 monclient(hunting): get_auth_request con 0x7fa8bc13c770 auth_method 0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c199f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c199f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c199f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient(hunting): handle_auth_done global_id 74454 payload 824 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 -- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 msgr2=0x7fa8bc099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 0x7fa8bc099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 -- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8bc13c770 msgr2=0x7fa8bc09ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8bc13c770 0x7fa8bc09ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient: _finish_hunting 0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 monclient: found mon.noname-a 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.136+0000 7fa8c099d640 1 -- 10.20.193.51:0/1553744403 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc095f20 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c099d640 1 -- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 msgr2=0x7fa8bc09a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c099d640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b470 tx=0x7fa8b000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:18.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0015020 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: dump: 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0011a40 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011e30 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 5 monclient: authenticate success, global_id 74454 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 10 monclient: _renew_subs 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8ab7fe640 4 set_mon_vals no callback set 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc13e690 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8a9ffb640 10 monclient: dump: 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 10 monclient: _renew_subs 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.138+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc0964e0 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8c3429640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:18.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8c3429640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8c3429640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc06e4a0 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa8b001a400 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8a9ffb640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 0x7fa88c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(283..283 src has 167..283) ==== 4763+0+0 (secure 0 0 0) 0x7fa8b00528d0 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.139+0000 7fa8c119e640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 0x7fa88c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.140+0000 7fa8c119e640 10 monclient: get_auth_request con 0x7fa88c03dd10 auth_method 0 2026-02-17T11:53:18.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.142+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa8bc06e4a0 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.142+0000 7fa8a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:18.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.142+0000 7fa8a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:18.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.142+0000 7fa8c119e640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 0x7fa88c0401d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0052b0 tx=0x7fa8ac003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:18.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8c3429640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8c3429640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8c3429640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa8bc09dac0 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8a9ffb640 1 -- 10.20.193.51:0/1553744403 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fa8b001f020 con 0x7fa8bc0a3bb0 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.261+0000 7fa8a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:18.263 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":62,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 msgr2=0x7fa88c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 0x7fa88c0401d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0052b0 tx=0x7fa8ac003960 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 10 monclient: shutdown 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 msgr2=0x7fa8bc09a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b470 tx=0x7fa8b000b940 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 shutdown_connections 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa88c03dd10 0x7fa88c0401d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8bc13c770 0x7fa8bc09ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8bc0a3bb0 0x7fa8bc09a5f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 --2- 10.20.193.51:0/1553744403 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8bc0a0750 0x7fa8bc099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 >> 10.20.193.51:0/1553744403 conn(0x7fa8bc0a30c0 msgr2=0x7fa8bc13ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 shutdown_connections 2026-02-17T11:53:18.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:18.262+0000 7fa8c3429640 1 -- 10.20.193.51:0/1553744403 wait complete. 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1177: done (2 left) 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1179: done (1 left) 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1180: done (0 left) 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1181: rollback oid 31 current snap is 128 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 31 to 127 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1182: copy_from oid 27 from oid 40 current snap is 128 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1183: copy_from oid 33 from oid 49 current snap is 128 2026-02-17T11:53:19.003 INFO:tasks.rados.rados.0.trial142.stdout:1184: snap_create 2026-02-17T11:53:19.006 INFO:tasks.rados.rados.0.trial142.stdout:1181: finishing rollback tid 0 to trial14245205-31 2026-02-17T11:53:19.007 INFO:tasks.rados.rados.0.trial142.stdout:1181: finishing rollback tid 1 to trial14245205-31 2026-02-17T11:53:19.007 INFO:tasks.rados.rados.0.trial142.stdout:1181: finishing rollback tid 2 to trial14245205-31 2026-02-17T11:53:19.007 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 934 (ObjNum 334 snap 109 seq_num 334) dirty exists 2026-02-17T11:53:19.011 INFO:tasks.rados.rados.0.trial142.stdout:1182: finishing copy_from racing read to trial14245205-27 2026-02-17T11:53:19.013 INFO:tasks.rados.rados.0.trial142.stdout:1183: finishing copy_from racing read to trial14245205-33 2026-02-17T11:53:19.014 INFO:tasks.rados.rados.0.trial142.stdout:1182: finishing copy_from to trial14245205-27 2026-02-17T11:53:19.014 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 626 (ObjNum 378 snap 119 seq_num 378) dirty exists 2026-02-17T11:53:19.015 INFO:tasks.rados.rados.0.trial142.stdout:1183: finishing copy_from to trial14245205-33 2026-02-17T11:53:19.015 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 903 (ObjNum 386 snap 120 seq_num 386) dirty exists 2026-02-17T11:53:19.989 INFO:tasks.rados.rados.0.trial142.stdout:1181: done (3 left) 2026-02-17T11:53:19.989 INFO:tasks.rados.rados.0.trial142.stdout:1182: done (2 left) 2026-02-17T11:53:19.989 INFO:tasks.rados.rados.0.trial142.stdout:1183: done (1 left) 2026-02-17T11:53:19.990 INFO:tasks.rados.rados.0.trial142.stdout:1184: done (0 left) 2026-02-17T11:53:19.990 INFO:tasks.rados.rados.0.trial142.stdout:1185: read oid 21 snap 128 2026-02-17T11:53:19.990 INFO:tasks.rados.rados.0.trial142.stdout:1185: expect (ObjNum 423 snap 126 seq_num 423) 2026-02-17T11:53:19.990 INFO:tasks.rados.rados.0.trial142.stdout:1186: delete oid 40 current snap is 129 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1186: done (1 left) 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1187: read oid 11 snap 128 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1187: expect (ObjNum 393 snap 121 seq_num 393) 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1188: rollback oid 16 current snap is 129 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 126 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1189: read oid 13 snap 126 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1189: expect deleted 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1190: write oid 2 current snap is 129 2026-02-17T11:53:19.993 INFO:tasks.rados.rados.0.trial142.stdout:1190: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2026-02-17T11:53:19.996 INFO:tasks.rados.rados.0.trial142.stdout:1190: writing trial14245205-2 from 427010 to 899848 tid 1 2026-02-17T11:53:20.000 INFO:tasks.rados.rados.0.trial142.stdout:1190: writing trial14245205-2 from 1329610 to 2024091 tid 2 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1190: writing trial14245205-2 from 2708828 to 3227010 tid 3 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1191: snap_create 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1188: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1188: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1188: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 638 (ObjNum 384 snap 119 seq_num 384) dirty exists 2026-02-17T11:53:20.005 INFO:tasks.rados.rados.0.trial142.stdout:1185: expect (ObjNum 423 snap 126 seq_num 423) 2026-02-17T11:53:20.150 INFO:tasks.rados.rados.0.trial142.stdout:1187: expect (ObjNum 393 snap 121 seq_num 393) 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: finishing write tid 1 to trial14245205-2 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: finishing write tid 2 to trial14245205-2 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: finishing write tid 3 to trial14245205-2 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: finishing write tid 4 to trial14245205-2 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: finishing write tid 5 to trial14245205-2 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: oid 2 updating version 0 to 627 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: oid 2 version 627 is already newer than 626 2026-02-17T11:53:20.246 INFO:tasks.rados.rados.0.trial142.stdout:1190: oid 2 updating version 627 to 628 2026-02-17T11:53:20.247 INFO:tasks.rados.rados.0.trial142.stdout:1190: oid 2 updating version 628 to 629 2026-02-17T11:53:20.247 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 629 (ObjNum 430 snap 129 seq_num 430) dirty exists 2026-02-17T11:53:20.247 INFO:tasks.rados.rados.0.trial142.stdout:1190: left oid 2 (ObjNum 430 snap 129 seq_num 430) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1185: done (5 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1187: done (4 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1188: done (3 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1189: done (2 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1190: done (1 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1191: done (0 left) 2026-02-17T11:53:21.006 INFO:tasks.rados.rados.0.trial142.stdout:1192: snap_remove snap 127 2026-02-17T11:53:21.272 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 10 monclient: get_monmap_and_config 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 10 monclient: build_initial_monmap 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 10 monclient: monmap: 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:21.339484+0000 2026-02-17T11:53:21.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:21.339484+0000 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 1 Processor -- start 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 1 -- start start 2026-02-17T11:53:21.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.338+0000 7f6b9b3a9640 10 monclient: init 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6b940a3bb0 0x7f6b9409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-a con 0x7f6b940a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6b9409d270 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6b94138780 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b94135430 con 0x7f6b94138780 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9409af60 con 0x7f6b9409d270 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9409a5c0 con 0x7f6b940a3bb0 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:21.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9b3a9640 10 monclient(hunting): authenticate will time out at 1088.958257s 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6b940a3bb0 0x7f6b9409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6b940a3bb0 0x7f6b9409cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39344/0 (socket says 10.20.193.51:39344) 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9991f640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6b94138780 0x7f6b941403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49988/0 (socket says 10.20.193.51:49988) 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 -- 10.20.193.51:0/201254612 learned_addr learned my addr 10.20.193.51:0/201254612 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): get_auth_request con 0x7f6b940a3bb0 auth_method 0 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:21.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient(hunting): handle_auth_done global_id 74457 payload 274 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 -- 10.20.193.51:0/201254612 >> v1:10.20.193.142:6789/0 conn(0x7f6b9409d270 legacy=0x7f6b94138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 -- 10.20.193.51:0/201254612 >> v1:10.20.193.51:6789/0 conn(0x7f6b94138780 legacy=0x7f6b941403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient: _finish_hunting 0 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 monclient: found mon.noname-a 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.339+0000 7f6b9911e640 1 -- 10.20.193.51:0/201254612 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9409b240 con 0x7f6b940a3bb0 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9911e640 1 -- 10.20.193.51:0/201254612 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b940a3bb0 msgr2=0x7f6b9409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9911e640 1 --2- 10.20.193.51:0/201254612 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b940a3bb0 0x7f6b9409cd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b940694e0 tx=0x7f6b8402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9b6a754c684c0e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 1 -- 10.20.193.51:0/201254612 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8403c070 con 0x7f6b940a3bb0 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: dump: 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.354 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: _finish_auth 0 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: _check_auth_tickets 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 1 -- 10.20.193.51:0/201254612 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8402fd80 con 0x7f6b940a3bb0 2026-02-17T11:53:21.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 5 monclient: authenticate success, global_id 74457 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 1 -- 10.20.193.51:0/201254612 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84037660 con 0x7f6b940a3bb0 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b83fff640 10 monclient: dump: 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:21.356 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 4 set_mon_vals no callback set 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 10 monclient: shutdown 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/201254612 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b940a3bb0 msgr2=0x7f6b9409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/201254612 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b940a3bb0 0x7f6b9409cd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b940694e0 tx=0x7f6b8402ee60 comp rx=0 tx=0).stop 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/201254612 shutdown_connections 2026-02-17T11:53:21.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/201254612 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b940a3bb0 0x7f6b9409cd30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/201254612 >> 10.20.193.51:0/201254612 conn(0x7f6b940a30c0 msgr2=0x7f6b940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/201254612 shutdown_connections 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/201254612 wait complete. 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 10 monclient: build_initial_monmap 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.342+0000 7f6b9b3a9640 10 monclient: monmap: 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.358 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 Processor -- start 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 -- start start 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient: init 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b9409d270 0x7f6b94130f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-c con 0x7f6b9409d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 0x7f6b9412cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:21.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-b con 0x7f6b940a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): picked mon.noname-a con 0x7f6b94138780 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6b940a3f90 con 0x7f6b94138780 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9409b520 con 0x7f6b940a3bb0 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6b94135040 con 0x7f6b9409d270 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9b3a9640 10 monclient(hunting): authenticate will time out at 1088.962653s 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:21.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39348/0 (socket says 10.20.193.51:39348) 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 -- 10.20.193.51:0/2502827328 learned_addr learned my addr 10.20.193.51:0/2502827328 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b9409d270 0x7f6b94130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): get_auth_request con 0x7f6b94138780 auth_method 0 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): get_auth_request con 0x7f6b9409d270 auth_method 0 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:21.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9911e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient(hunting): handle_auth_done global_id 74460 payload 824 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 -- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b9409d270 msgr2=0x7f6b94130f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b9409d270 0x7f6b94130f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 -- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 msgr2=0x7f6b9412cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9891d640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 0x7f6b9412cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 0x7f6b9412cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient: _finish_hunting 0 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 monclient: found mon.noname-a 2026-02-17T11:53:21.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9991f640 1 -- 10.20.193.51:0/2502827328 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940a2780 con 0x7f6b94138780 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9891d640 10 monclient: get_auth_request con 0x7f6b940a3bb0 auth_method 0 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.343+0000 7f6b9891d640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 0x7f6b9412cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9991f640 1 -- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 msgr2=0x7f6b9412d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9991f640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000caf0 tx=0x7f6b9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90017070 con 0x7f6b94138780 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: dump: 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:21.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: _finish_auth 0 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:21.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b90012400 con 0x7f6b94138780 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900127f0 con 0x7f6b94138780 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 10 monclient: dump: 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:21.365 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b837fe640 4 set_mon_vals no callback set 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 5 monclient: authenticate success, global_id 74460 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _renew_subs 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9412ec90 con 0x7f6b94138780 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _renew_subs 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b94130ae0 con 0x7f6b94138780 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:21.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b94138cd0 con 0x7f6b94138780 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6b90007070 con 0x7f6b94138780 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.346+0000 7f6b81ffb640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 0x7f6b64040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.347+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(286..286 src has 167..286) ==== 4735+0+0 (secure 0 0 0) 0x7f6b90052710 con 0x7f6b94138780 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.347+0000 7f6b9911e640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 0x7f6b64040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.347+0000 7f6b9911e640 10 monclient: get_auth_request con 0x7f6b6403dd60 auth_method 0 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.349+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6b940a2780 con 0x7f6b94138780 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.349+0000 7f6b81ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.349+0000 7f6b81ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:21.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.349+0000 7f6b9911e640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 0x7f6b64040220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b84036000 tx=0x7f6b84033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b9b3a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b9b3a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b9b3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6b94074d80 con 0x7f6b94138780 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b81ffb640 1 -- 10.20.193.51:0/2502827328 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f6b90007570 con 0x7f6b94138780 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b81ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:21.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.461+0000 7f6b81ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:21.465 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":62,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 msgr2=0x7f6b64040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 0x7f6b64040220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b84036000 tx=0x7f6b84033000 comp rx=0 tx=0).stop 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 10 monclient: shutdown 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 msgr2=0x7f6b9412d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:21.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000caf0 tx=0x7f6b9000a060 comp rx=0 tx=0).stop 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 shutdown_connections 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b6403dd60 0x7f6b64040220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b94138780 0x7f6b9412d0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b940a3bb0 0x7f6b9412cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 --2- 10.20.193.51:0/2502827328 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b9409d270 0x7f6b94130f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 >> 10.20.193.51:0/2502827328 conn(0x7f6b940a30c0 msgr2=0x7f6b9409c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 shutdown_connections 2026-02-17T11:53:21.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:21.462+0000 7f6b9b3a9640 1 -- 10.20.193.51:0/2502827328 wait complete. 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1192: done (0 left) 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1193: read oid 6 snap -1 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1193: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1194: copy_from oid 7 from oid 42 current snap is 130 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1195: write (excl) oid 19 current snap is 130 2026-02-17T11:53:22.007 INFO:tasks.rados.rados.0.trial142.stdout:1195: seq_num 431 ranges {443817=548087,1788092=438139,3019898=223919} 2026-02-17T11:53:22.011 INFO:tasks.rados.rados.0.trial142.stdout:1195: writing trial14245205-19 from 443817 to 991904 tid 1 2026-02-17T11:53:22.015 INFO:tasks.rados.rados.0.trial142.stdout:1195: writing trial14245205-19 from 1788092 to 2226231 tid 2 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1195: writing trial14245205-19 from 3019898 to 3243817 tid 3 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1196: read oid 47 snap -1 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1196: expect (ObjNum 249 snap 79 seq_num 249) 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1197: read oid 36 snap -1 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1197: expect (ObjNum 414 snap 125 seq_num 414) 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1198: write oid 14 current snap is 130 2026-02-17T11:53:22.019 INFO:tasks.rados.rados.0.trial142.stdout:1198: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2026-02-17T11:53:22.023 INFO:tasks.rados.rados.0.trial142.stdout:1198: writing trial14245205-14 from 460624 to 1083960 tid 1 2026-02-17T11:53:22.029 INFO:tasks.rados.rados.0.trial142.stdout:1198: writing trial14245205-14 from 1846574 to 2544724 tid 2 2026-02-17T11:53:22.031 INFO:tasks.rados.rados.0.trial142.stdout:1198: writing trial14245205-14 from 3163674 to 3260624 tid 3 2026-02-17T11:53:22.031 INFO:tasks.rados.rados.0.trial142.stdout:1199: read oid 16 snap -1 2026-02-17T11:53:22.031 INFO:tasks.rados.rados.0.trial142.stdout:1199: expect (ObjNum 384 snap 119 seq_num 384) 2026-02-17T11:53:22.031 INFO:tasks.rados.rados.0.trial142.stdout:1200: snap_remove snap 126 2026-02-17T11:53:23.011 INFO:tasks.rados.rados.0.trial142.stdout:1200: done (7 left) 2026-02-17T11:53:23.011 INFO:tasks.rados.rados.0.trial142.stdout:1201: copy_from oid 25 from oid 27 current snap is 130 2026-02-17T11:53:23.012 INFO:tasks.rados.rados.0.trial142.stdout:1193: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:1195: finishing write tid 1 to trial14245205-19 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:1194: finishing copy_from racing read to trial14245205-7 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:1195: finishing write tid 2 to trial14245205-19 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:1194: finishing copy_from to trial14245205-7 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 705 (ObjNum 404 snap 123 seq_num 404) dirty exists 2026-02-17T11:53:23.128 INFO:tasks.rados.rados.0.trial142.stdout:1197: expect (ObjNum 414 snap 125 seq_num 414) 2026-02-17T11:53:23.198 INFO:tasks.rados.rados.0.trial142.stdout:1195: finishing write tid 3 to trial14245205-19 2026-02-17T11:53:23.198 INFO:tasks.rados.rados.0.trial142.stdout:1195: finishing write tid 4 to trial14245205-19 2026-02-17T11:53:23.198 INFO:tasks.rados.rados.0.trial142.stdout:1195: finishing write tid 5 to trial14245205-19 2026-02-17T11:53:23.198 INFO:tasks.rados.rados.0.trial142.stdout:1195: oid 19 updating version 0 to 612 2026-02-17T11:53:23.198 INFO:tasks.rados.rados.0.trial142.stdout:1195: oid 19 updating version 612 to 614 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:1195: oid 19 updating version 614 to 615 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:1195: oid 19 version 615 is already newer than 613 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 615 (ObjNum 431 snap 130 seq_num 431) dirty exists 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:1195: left oid 19 (ObjNum 431 snap 130 seq_num 431) 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:1198: finishing write tid 1 to trial14245205-14 2026-02-17T11:53:23.199 INFO:tasks.rados.rados.0.trial142.stdout:1196: expect (ObjNum 249 snap 79 seq_num 249) 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1198: finishing write tid 2 to trial14245205-14 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1193: done (7 left) 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1194: done (6 left) 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1195: done (5 left) 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1196: done (4 left) 2026-02-17T11:53:23.285 INFO:tasks.rados.rados.0.trial142.stdout:1197: done (3 left) 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1202: rollback oid 26 current snap is 130 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 128 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: finishing write tid 3 to trial14245205-14 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: finishing write tid 4 to trial14245205-14 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: finishing write tid 5 to trial14245205-14 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: oid 14 updating version 0 to 963 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: oid 14 version 963 is already newer than 962 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: oid 14 version 963 is already newer than 961 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: oid 14 updating version 963 to 964 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 964 (ObjNum 432 snap 130 seq_num 432) dirty exists 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1198: left oid 14 (ObjNum 432 snap 130 seq_num 432) 2026-02-17T11:53:23.286 INFO:tasks.rados.rados.0.trial142.stdout:1199: expect (ObjNum 384 snap 119 seq_num 384) 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1201: finishing copy_from racing read to trial14245205-25 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1201: finishing copy_from to trial14245205-25 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 626 (ObjNum 378 snap 119 seq_num 378) dirty exists 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1202: finishing rollback tid 0 to trial14245205-26 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1202: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1198: done (3 left) 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1199: done (2 left) 2026-02-17T11:53:23.394 INFO:tasks.rados.rados.0.trial142.stdout:1201: done (1 left) 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:1203: copy_from oid 27 from oid 9 current snap is 130 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:1202: finishing rollback tid 2 to trial14245205-26 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 693 (ObjNum 384 snap 119 seq_num 384) dirty exists 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:1202: done (1 left) 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:1204: write (excl) oid 41 current snap is 130 2026-02-17T11:53:23.395 INFO:tasks.rados.rados.0.trial142.stdout:1204: seq_num 433 ranges {477431=698585,1905056=441808,3074744=202687} 2026-02-17T11:53:23.398 INFO:tasks.rados.rados.0.trial142.stdout:1204: writing trial14245205-41 from 477431 to 1176016 tid 1 2026-02-17T11:53:23.402 INFO:tasks.rados.rados.0.trial142.stdout:1204: writing trial14245205-41 from 1905056 to 2346864 tid 2 2026-02-17T11:53:23.406 INFO:tasks.rados.rados.0.trial142.stdout:1204: writing trial14245205-41 from 3074744 to 3277431 tid 3 2026-02-17T11:53:23.406 INFO:tasks.rados.rados.0.trial142.stdout:1205: write (excl) oid 38 current snap is 130 2026-02-17T11:53:23.406 INFO:tasks.rados.rados.0.trial142.stdout:1205: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2026-02-17T11:53:23.409 INFO:tasks.rados.rados.0.trial142.stdout:1205: writing trial14245205-38 from 494238 to 984425 tid 1 2026-02-17T11:53:23.414 INFO:tasks.rados.rados.0.trial142.stdout:1205: writing trial14245205-38 from 1563538 to 2265357 tid 2 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1205: writing trial14245205-38 from 2818520 to 3294238 tid 3 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1206: copy_from oid 50 from oid 7 current snap is 130 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1203: finishing copy_from racing read to trial14245205-27 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1204: finishing write tid 1 to trial14245205-41 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1204: finishing write tid 2 to trial14245205-41 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1203: finishing copy_from to trial14245205-27 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:23.419 INFO:tasks.rados.rados.0.trial142.stdout:1204: finishing write tid 3 to trial14245205-41 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: finishing write tid 4 to trial14245205-41 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: finishing write tid 5 to trial14245205-41 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: oid 41 updating version 0 to 633 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: oid 41 version 633 is already newer than 631 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: oid 41 version 633 is already newer than 632 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: oid 41 version 633 is already newer than 630 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 633 (ObjNum 433 snap 130 seq_num 433) dirty exists 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: left oid 41 (ObjNum 433 snap 130 seq_num 433) 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1205: finishing write tid 1 to trial14245205-38 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1205: finishing write tid 2 to trial14245205-38 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1203: done (3 left) 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1204: done (2 left) 2026-02-17T11:53:23.420 INFO:tasks.rados.rados.0.trial142.stdout:1207: read oid 12 snap -1 2026-02-17T11:53:23.421 INFO:tasks.rados.rados.0.trial142.stdout:1207: expect (ObjNum 420 snap 126 seq_num 420) 2026-02-17T11:53:23.421 INFO:tasks.rados.rados.0.trial142.stdout:1208: rollback oid 18 current snap is 130 2026-02-17T11:53:23.421 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 128 2026-02-17T11:53:23.421 INFO:tasks.rados.rados.0.trial142.stdout:1209: delete oid 40 current snap is 130 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1209: done (4 left) 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1210: snap_create 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: finishing write tid 3 to trial14245205-38 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: finishing write tid 4 to trial14245205-38 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: finishing write tid 5 to trial14245205-38 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: oid 38 updating version 0 to 107 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: oid 38 version 107 is already newer than 106 2026-02-17T11:53:23.422 INFO:tasks.rados.rados.0.trial142.stdout:1205: oid 38 updating version 107 to 108 2026-02-17T11:53:23.423 INFO:tasks.rados.rados.0.trial142.stdout:1205: oid 38 version 108 is already newer than 105 2026-02-17T11:53:23.423 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 108 (ObjNum 434 snap 130 seq_num 434) dirty exists 2026-02-17T11:53:23.423 INFO:tasks.rados.rados.0.trial142.stdout:1205: left oid 38 (ObjNum 434 snap 130 seq_num 434) 2026-02-17T11:53:23.423 INFO:tasks.rados.rados.0.trial142.stdout:1207: expect (ObjNum 420 snap 126 seq_num 420) 2026-02-17T11:53:23.496 INFO:tasks.rados.rados.0.trial142.stdout:1208: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:1208: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:1208: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 970 (ObjNum 406 snap 123 seq_num 406) dirty exists 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:1206: finishing copy_from racing read to trial14245205-50 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:1206: finishing copy_from to trial14245205-50 2026-02-17T11:53:23.497 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 705 (ObjNum 404 snap 123 seq_num 404) dirty exists 2026-02-17T11:53:24.014 INFO:tasks.rados.rados.0.trial142.stdout:1205: done (4 left) 2026-02-17T11:53:24.014 INFO:tasks.rados.rados.0.trial142.stdout:1206: done (3 left) 2026-02-17T11:53:24.014 INFO:tasks.rados.rados.0.trial142.stdout:1207: done (2 left) 2026-02-17T11:53:24.014 INFO:tasks.rados.rados.0.trial142.stdout:1208: done (1 left) 2026-02-17T11:53:24.015 INFO:tasks.rados.rados.0.trial142.stdout:1210: done (0 left) 2026-02-17T11:53:24.015 INFO:tasks.rados.rados.0.trial142.stdout:1211: delete oid 3 current snap is 131 2026-02-17T11:53:24.017 INFO:tasks.rados.rados.0.trial142.stdout:1211: done (0 left) 2026-02-17T11:53:24.017 INFO:tasks.rados.rados.0.trial142.stdout:1212: write oid 2 current snap is 131 2026-02-17T11:53:24.017 INFO:tasks.rados.rados.0.trial142.stdout:1212: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2026-02-17T11:53:24.022 INFO:tasks.rados.rados.0.trial142.stdout:1212: writing trial14245205-2 from 544659 to 1260593 tid 1 2026-02-17T11:53:24.025 INFO:tasks.rados.rados.0.trial142.stdout:1212: writing trial14245205-2 from 1738984 to 2188130 tid 2 2026-02-17T11:53:24.030 INFO:tasks.rados.rados.0.trial142.stdout:1212: writing trial14245205-2 from 2784436 to 3344659 tid 3 2026-02-17T11:53:24.030 INFO:tasks.rados.rados.0.trial142.stdout:1213: read oid 17 snap 121 2026-02-17T11:53:24.030 INFO:tasks.rados.rados.0.trial142.stdout:1213: expect deleted 2026-02-17T11:53:24.030 INFO:tasks.rados.rados.0.trial142.stdout:1214: write (excl) oid 10 current snap is 131 2026-02-17T11:53:24.030 INFO:tasks.rados.rados.0.trial142.stdout:1214: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2026-02-17T11:53:24.034 INFO:tasks.rados.rados.0.trial142.stdout:1214: writing trial14245205-10 from 561466 to 1352649 tid 1 2026-02-17T11:53:24.039 INFO:tasks.rados.rados.0.trial142.stdout:1214: writing trial14245205-10 from 2081113 to 2673917 tid 2 2026-02-17T11:53:24.042 INFO:tasks.rados.rados.0.trial142.stdout:1214: writing trial14245205-10 from 3095506 to 3361466 tid 3 2026-02-17T11:53:24.042 INFO:tasks.rados.rados.0.trial142.stdout:1215: snap_remove snap 130 2026-02-17T11:53:24.472 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.540+0000 7f23244da640 10 monclient: get_monmap_and_config 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.540+0000 7f23244da640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.540+0000 7f23244da640 10 monclient: monmap: 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:24.541744+0000 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:24.541744+0000 2026-02-17T11:53:24.542 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:24.543 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 Processor -- start 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 -- start start 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient: init 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f231c0a3bb0 0x7f231c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): picked mon.noname-a con 0x7f231c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f231c0a0750 0x7f231c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): picked mon.noname-c con 0x7f231c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): picked mon.noname-b con 0x7f231c09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f231c0a3f90 con 0x7f231c0a3bb0 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f231c06e140 con 0x7f231c0a0750 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f231c09f910 con 0x7f231c09e540 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f23244da640 10 monclient(hunting): authenticate will time out at 1092.160510s 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f231c0a3bb0 0x7f231c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55232/0 (socket says 10.20.193.51:55232) 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 -- 10.20.193.51:0/3756092826 learned_addr learned my addr 10.20.193.51:0/3756092826 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): get_auth_request con 0x7f231c0a3bb0 auth_method 0 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): get_auth_request con 0x7f231c09e540 auth_method 0 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f232224f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient(hunting): handle_auth_done global_id 104213 payload 274 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 -- 10.20.193.51:0/3756092826 >> v2:10.20.193.142:3300/0 conn(0x7f231c0a0750 msgr2=0x7f231c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 --2- 10.20.193.51:0/3756092826 >> v2:10.20.193.142:3300/0 conn(0x7f231c0a0750 0x7f231c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 -- 10.20.193.51:0/3756092826 >> v2:10.20.193.51:3300/0 conn(0x7f231c0a3bb0 msgr2=0x7f231c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 --2- 10.20.193.51:0/3756092826 >> v2:10.20.193.51:3300/0 conn(0x7f231c0a3bb0 0x7f231c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 monclient: found mon.noname-b 2026-02-17T11:53:24.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.541+0000 7f2322a50640 1 -- 10.20.193.51:0/3756092826 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c09ccd0 con 0x7f231c09e540 2026-02-17T11:53:24.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f2322a50640 1 -- 10.20.193.51:0/3756092826 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 msgr2=0x7f231c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f2322a50640 1 --2- 10.20.193.51:0/3756092826 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f231c06f3c0 tx=0x7f231802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b18443767ec3e708 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 1 -- 10.20.193.51:0/3756092826 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231802fe60 con 0x7f231c09e540 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: dump: 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 5 monclient: authenticate success, global_id 104213 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 1 -- 10.20.193.51:0/3756092826 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23180373f0 con 0x7f231c09e540 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 1 -- 10.20.193.51:0/3756092826 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180377c0 con 0x7f231c09e540 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 4 set_mon_vals no callback set 2026-02-17T11:53:24.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f232124d640 10 monclient: dump: 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 10 monclient: shutdown 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 -- 10.20.193.51:0/3756092826 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 msgr2=0x7f231c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 --2- 10.20.193.51:0/3756092826 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f231c06f3c0 tx=0x7f231802f230 comp rx=0 tx=0).stop 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 -- 10.20.193.51:0/3756092826 shutdown_connections 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 --2- 10.20.193.51:0/3756092826 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c09e540 0x7f231c13c760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 --2- 10.20.193.51:0/3756092826 >> v2:10.20.193.142:3300/0 conn(0x7f231c0a0750 0x7f231c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 --2- 10.20.193.51:0/3756092826 >> v2:10.20.193.51:3300/0 conn(0x7f231c0a3bb0 0x7f231c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 -- 10.20.193.51:0/3756092826 >> 10.20.193.51:0/3756092826 conn(0x7f231c0a30c0 msgr2=0x7f231c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 -- 10.20.193.51:0/3756092826 shutdown_connections 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 1 -- 10.20.193.51:0/3756092826 wait complete. 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.544+0000 7f23244da640 10 monclient: monmap: 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.548 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 Processor -- start 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 -- start start 2026-02-17T11:53:24.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient: init 2026-02-17T11:53:24.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:53:24.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f231c09e540 0x7f231c1cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): picked mon.noname-b con 0x7f231c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f231c0a0750 0x7f231c1cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): picked mon.noname-a con 0x7f231c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): picked mon.noname-c con 0x7f231c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f231c09a5c0 con 0x7f231c0a0750 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0a04b0 con 0x7f231c09e540 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f231c09a740 con 0x7f231c0a3bb0 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f23244da640 10 monclient(hunting): authenticate will time out at 1092.164673s 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55244/0 (socket says 10.20.193.51:55244) 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 -- 10.20.193.51:0/3543569320 learned_addr learned my addr 10.20.193.51:0/3543569320 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): get_auth_request con 0x7f231c0a3bb0 auth_method 0 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f231c0a0750 0x7f231c1cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): get_auth_request con 0x7f231c0a0750 auth_method 0 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2321a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient(hunting): handle_auth_done global_id 104216 payload 824 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 -- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f231c09e540 msgr2=0x7f231c1cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f231c09e540 0x7f231c1cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 -- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f231c0a0750 msgr2=0x7f231c1cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f231c0a0750 0x7f231c1cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 monclient: found mon.noname-c 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.545+0000 7f2322a50640 1 -- 10.20.193.51:0/3543569320 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c094b30 con 0x7f231c0a3bb0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2322a50640 1 -- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 msgr2=0x7f231c090c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2322a50640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2318009f50 tx=0x7f2318004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318046020 con 0x7f231c0a3bb0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: dump: 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2318041660 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 5 monclient: authenticate success, global_id 104216 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _renew_subs 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c09c570 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318041a30 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2320a4c640 4 set_mon_vals no callback set 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 10 monclient: dump: 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _renew_subs 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c094290 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2318053060 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c077c20 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 0x7f22ec040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.548+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(289..289 src has 167..289) ==== 4735+0+0 (secure 0 0 0) 0x7f23180782c0 con 0x7f231c0a3bb0 2026-02-17T11:53:24.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.549+0000 7f232224f640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 0x7f22ec040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.549+0000 7f232224f640 10 monclient: get_auth_request con 0x7f22ec03dd60 auth_method 0 2026-02-17T11:53:24.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.551+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f231c077c20 con 0x7f231c0a3bb0 2026-02-17T11:53:24.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.551+0000 7f2302ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.551+0000 7f2302ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:24.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.552+0000 7f232224f640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 0x7f22ec040220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f230c006b90 tx=0x7f230c006b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f23244da640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:24.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f23244da640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f23244da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f231c0a0fc0 con 0x7f231c0a3bb0 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f2302ffd640 1 -- 10.20.193.51:0/3543569320 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f231c0a0fc0 con 0x7f231c0a3bb0 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f2302ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.665+0000 7f2302ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:24.668 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 msgr2=0x7f22ec040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 0x7f22ec040220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f230c006b90 tx=0x7f230c006b20 comp rx=0 tx=0).stop 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 10 monclient: shutdown 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 msgr2=0x7f231c090c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2318009f50 tx=0x7f2318004b40 comp rx=0 tx=0).stop 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 shutdown_connections 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f22ec03dd60 0x7f22ec040220 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f231c0a3bb0 0x7f231c090c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f231c0a0750 0x7f231c1cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 --2- 10.20.193.51:0/3543569320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f231c09e540 0x7f231c1cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 >> 10.20.193.51:0/3543569320 conn(0x7f231c0a30c0 msgr2=0x7f231c071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 shutdown_connections 2026-02-17T11:53:24.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.666+0000 7f23244da640 1 -- 10.20.193.51:0/3543569320 wait complete. 2026-02-17T11:53:24.675 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:53:24.675 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:53:24.676 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:53:24.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.742+0000 7f77bfee8640 10 monclient: get_monmap_and_config 2026-02-17T11:53:24.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.742+0000 7f77bfee8640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.742+0000 7f77bfee8640 10 monclient: monmap: 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:24.743541+0000 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:24.743541+0000 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:24.748 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.742+0000 7f77bfee8640 1 Processor -- start 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 -- start start 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient: init 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 0x7f77b809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-c con 0x7f77b80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f77b809dac0 0x7f77b809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-a con 0x7f77b809dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:24.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f77b809ff40 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b806e140 con 0x7f77b809ff40 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f77b809aed0 con 0x7f77b809dac0 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f77b809caa0 con 0x7f77b80a3bb0 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bfee8640 10 monclient(hunting): authenticate will time out at 1092.362325s 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f77b809dac0 0x7f77b809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f77b809dac0 0x7f77b809fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39386/0 (socket says 10.20.193.51:39386) 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 -- 10.20.193.51:0/4170444375 learned_addr learned my addr 10.20.193.51:0/4170444375 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): get_auth_request con 0x7f77b809dac0 auth_method 0 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77be45e640 1 --1- 10.20.193.51:0/4170444375 >> v1:10.20.193.51:6789/0 conn(0x7f77b809ff40 0x7f77b813b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49990/0 (socket says 10.20.193.51:49990) 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bdc5d640 1 --2- 10.20.193.51:0/4170444375 >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 0x7f77b809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient(hunting): handle_auth_done global_id 74469 payload 274 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 -- 10.20.193.51:0/4170444375 >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 msgr2=0x7f77b809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 --2- 10.20.193.51:0/4170444375 >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 0x7f77b809f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 -- 10.20.193.51:0/4170444375 >> v1:10.20.193.51:6789/0 conn(0x7f77b809ff40 legacy=0x7f77b813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 monclient: found mon.noname-a 2026-02-17T11:53:24.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bd45c640 1 -- 10.20.193.51:0/4170444375 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b809ce60 con 0x7f77b809dac0 2026-02-17T11:53:24.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bdc5d640 10 monclient: get_auth_request con 0x7f77b80a3bb0 auth_method 0 2026-02-17T11:53:24.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.743+0000 7f77bdc5d640 1 --2- 10.20.193.51:0/4170444375 >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 0x7f77b809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.745+0000 7f77bd45c640 1 -- 10.20.193.51:0/4170444375 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 msgr2=0x7f77b809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.745+0000 7f77bd45c640 1 --2- 10.20.193.51:0/4170444375 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809fa00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77b809cc20 tx=0x7f77ac02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed7be8b90e1896b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 1 -- 10.20.193.51:0/4170444375 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac03c070 con 0x7f77b809dac0 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: dump: 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.762 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 5 monclient: authenticate success, global_id 74469 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 1 -- 10.20.193.51:0/4170444375 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac02fd70 con 0x7f77b809dac0 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 1 -- 10.20.193.51:0/4170444375 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac037660 con 0x7f77b809dac0 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 4 set_mon_vals no callback set 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bcc5b640 10 monclient: dump: 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.764 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 10 monclient: shutdown 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 -- 10.20.193.51:0/4170444375 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 msgr2=0x7f77b809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 --2- 10.20.193.51:0/4170444375 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809fa00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77b809cc20 tx=0x7f77ac02ee10 comp rx=0 tx=0).stop 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 -- 10.20.193.51:0/4170444375 shutdown_connections 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 --2- 10.20.193.51:0/4170444375 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809fa00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 --2- 10.20.193.51:0/4170444375 >> v2:10.20.193.142:3300/0 conn(0x7f77b80a3bb0 0x7f77b809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 -- 10.20.193.51:0/4170444375 >> 10.20.193.51:0/4170444375 conn(0x7f77b80a30c0 msgr2=0x7f77b80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 -- 10.20.193.51:0/4170444375 shutdown_connections 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 1 -- 10.20.193.51:0/4170444375 wait complete. 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.746+0000 7f77bfee8640 10 monclient: monmap: 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:24.766 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 Processor -- start 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 -- start start 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient: init 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-a con 0x7f77b809dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77b809ff40 0x7f77b81b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-c con 0x7f77b809ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77b80a3bb0 0x7f77b81b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): picked mon.noname-b con 0x7f77b80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77b80a0370 con 0x7f77b809dac0 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f77b809a880 con 0x7f77b80a3bb0 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f77b80a04f0 con 0x7f77b809ff40 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bfee8640 10 monclient(hunting): authenticate will time out at 1092.366511s 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39396/0 (socket says 10.20.193.51:39396) 2026-02-17T11:53:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 -- 10.20.193.51:0/1338948320 learned_addr learned my addr 10.20.193.51:0/1338948320 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): get_auth_request con 0x7f77b809dac0 auth_method 0 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77b809ff40 0x7f77b81b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): get_auth_request con 0x7f77b809ff40 auth_method 0 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient(hunting): handle_auth_done global_id 74472 payload 824 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77b809ff40 msgr2=0x7f77b81b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77b809ff40 0x7f77b81b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77b80a3bb0 msgr2=0x7f77b81b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77be45e640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77b80a3bb0 0x7f77b81b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77b80a3bb0 0x7f77b81b8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 monclient: found mon.noname-a 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.747+0000 7f77bdc5d640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b80a1ed0 con 0x7f77b809dac0 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bdc5d640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 msgr2=0x7f77b809e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bdc5d640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c7a0 tx=0x7f77a800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8015070 con 0x7f77b809dac0 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: dump: 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.771 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bfee8640 5 monclient: authenticate success, global_id 74472 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a800ac70 con 0x7f77b809dac0 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8011630 con 0x7f77b809dac0 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a67fc640 10 monclient: dump: 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77a7fff640 4 set_mon_vals no callback set 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bfee8640 10 monclient: _renew_subs 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bfee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.749+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b81baa70 con 0x7f77b809dac0 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 10 monclient: _renew_subs 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b81ba790 con 0x7f77b809dac0 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 0x7f77b81cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77b809d7b0 con 0x7f77b81b8740 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 0x7f77b81cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient: get_auth_request con 0x7f77b81b8740 auth_method 0 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 10 monclient(hunting): handle_auth_done global_id 74475 payload 824 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77bd45c640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77b81b8b20 con 0x7f77b81b8740 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f77a80117d0 con 0x7f77b809dac0 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.750+0000 7f77a67fc640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f778803dd40 0x7f7788040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.751+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(289..289 src has 167..289) ==== 4735+0+0 (secure 0 0 0) 0x7f77a8052a40 con 0x7f77b809dac0 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.751+0000 7f77be45e640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f778803dd40 0x7f7788040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.751+0000 7f77be45e640 10 monclient: get_auth_request con 0x7f778803dd40 auth_method 0 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77bd45c640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 msgr2=0x7f77b81cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77bd45c640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 0x7f77b81cd440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77b806dd50 tx=0x7f77ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac037e60 con 0x7f77b81b8740 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.752+0000 7f77a67fc640 10 monclient: dump: 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.776 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f77ac03d040 con 0x7f77b81b8740 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 msgr2=0x7f77b81cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 0x7f77b81cd440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77b806dd50 tx=0x7f77ac0047c0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 msgr2=0x7f77b81cd440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77a67fc640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81b8740 0x7f77b81cd440 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77b806dd50 tx=0x7f77ac0047c0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.753+0000 7f77be45e640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f778803dd40 0x7f7788040200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005b90 tx=0x7f77b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bfee8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:24.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bfee8640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 0x7f77b81d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77b809f4c0 con 0x7f77b81cd980 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 0x7f77b81d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient: get_auth_request con 0x7f77b81cd980 auth_method 0 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 10 monclient(hunting): handle_auth_done global_id 74478 payload 824 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.756+0000 7f77bd45c640 1 -- 10.20.193.51:0/1338948320 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77b81b9e40 con 0x7f77b81cd980 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77bd45c640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 msgr2=0x7f77b81d86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77bd45c640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 0x7f77b81d86b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77ac02ee50 tx=0x7f77ac009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac037e60 con 0x7f77b81cd980 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 10 monclient: dump: 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f77ac004020 con 0x7f77b81cd980 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 msgr2=0x7f77b81d86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 0x7f77b81d86b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77ac02ee50 tx=0x7f77ac009340 comp rx=0 tx=0).stop 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 msgr2=0x7f77b81d86b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.758+0000 7f77a67fc640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b81cd980 0x7f77b81d86b0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77ac02ee50 tx=0x7f77ac009340 comp rx=0 tx=0).stop 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:24.780 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 222689, 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:24.781 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.782 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:24.783 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.784 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:24.785 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.786 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.787 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:24.788 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:24.789 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.790 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.791 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.791 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:24.791 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f778803dd40 msgr2=0x7f7788040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f778803dd40 0x7f7788040200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005b90 tx=0x7f77b4009040 comp rx=0 tx=0).stop 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 10 monclient: shutdown 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 msgr2=0x7f77b809e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77be45e640 1 -- 10.20.193.51:0/1338948320 reap_dead start 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c7a0 tx=0x7f77a800cc70 comp rx=0 tx=0).stop 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 shutdown_connections 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 --2- 10.20.193.51:0/1338948320 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77b809dac0 0x7f77b809e3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 >> 10.20.193.51:0/1338948320 conn(0x7f77b80a30c0 msgr2=0x7f77b806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 shutdown_connections 2026-02-17T11:53:24.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.759+0000 7f77bfee8640 1 -- 10.20.193.51:0/1338948320 wait complete. 2026-02-17T11:53:24.793 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:24.793 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:53:24.793 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:53:24.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.857+0000 7f37e8d96640 10 monclient: get_monmap_and_config 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.857+0000 7f37e8d96640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.857+0000 7f37e8d96640 10 monclient: monmap: 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:24.858861+0000 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:24.858861+0000 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:24.860 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:24.861 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:24.861 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:24.861 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:24.861 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 Processor -- start 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 -- start start 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient: init 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:53:24.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37e406eb80 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 0x7f37e41385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-b con 0x7f37e40a4c10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f37e413d210 0x7f37e413f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-c con 0x7f37e413d210 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e406f9c0 con 0x7f37e406eb80 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f37e406ef60 con 0x7f37e413d210 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f37e406fca0 con 0x7f37e40a4c10 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e8d96640 10 monclient(hunting): authenticate will time out at 1092.477708s 2026-02-17T11:53:24.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 0x7f37e41385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e2575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f37e406eb80 0x7f37e4137e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:50006/0 (socket says 10.20.193.51:50006) 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e2575640 1 -- 10.20.193.51:0/3817653204 learned_addr learned my addr 10.20.193.51:0/3817653204 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): get_auth_request con 0x7f37e40a4c10 auth_method 0 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient(hunting): handle_auth_done global_id 104222 payload 274 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 -- 10.20.193.51:0/3817653204 >> v2:10.20.193.142:3300/0 conn(0x7f37e413d210 msgr2=0x7f37e413f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 --2- 10.20.193.51:0/3817653204 >> v2:10.20.193.142:3300/0 conn(0x7f37e413d210 0x7f37e413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 -- 10.20.193.51:0/3817653204 >> v1:10.20.193.51:6789/0 conn(0x7f37e406eb80 legacy=0x7f37e4137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 monclient: found mon.noname-b 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.858+0000 7f37e1d74640 1 -- 10.20.193.51:0/3817653204 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e406ff80 con 0x7f37e40a4c10 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1d74640 1 -- 10.20.193.51:0/3817653204 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 msgr2=0x7f37e41385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1d74640 1 --2- 10.20.193.51:0/3817653204 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 0x7f37e41385a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37e4070ed0 tx=0x7f37cc02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb485ef6ab8977e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 1 -- 10.20.193.51:0/3817653204 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc03c070 con 0x7f37e40a4c10 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: dump: 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.872 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 1 -- 10.20.193.51:0/3817653204 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc02fcb0 con 0x7f37e40a4c10 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 5 monclient: authenticate success, global_id 104222 2026-02-17T11:53:24.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 1 -- 10.20.193.51:0/3817653204 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc02fe60 con 0x7f37e40a4c10 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 4 set_mon_vals no callback set 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e1573640 10 monclient: dump: 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.874 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 10 monclient: shutdown 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 -- 10.20.193.51:0/3817653204 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 msgr2=0x7f37e41385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 --2- 10.20.193.51:0/3817653204 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 0x7f37e41385a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37e4070ed0 tx=0x7f37cc02ed50 comp rx=0 tx=0).stop 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 -- 10.20.193.51:0/3817653204 shutdown_connections 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 --2- 10.20.193.51:0/3817653204 >> v2:10.20.193.142:3300/0 conn(0x7f37e413d210 0x7f37e413f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 --2- 10.20.193.51:0/3817653204 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e40a4c10 0x7f37e41385a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 -- 10.20.193.51:0/3817653204 >> 10.20.193.51:0/3817653204 conn(0x7f37e40a8c80 msgr2=0x7f37e40a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 -- 10.20.193.51:0/3817653204 shutdown_connections 2026-02-17T11:53:24.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.861+0000 7f37e8d96640 1 -- 10.20.193.51:0/3817653204 wait complete. 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient: monmap: 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:24.876 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 Processor -- start 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 -- start start 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient: init 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-a con 0x7f37e406eb80 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f37e40a4c10 0x7f37e41cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-b con 0x7f37e40a4c10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e413d210 0x7f37e41cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): picked mon.noname-c con 0x7f37e413d210 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f37e413fb40 con 0x7f37e406eb80 2026-02-17T11:53:24.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4138cf0 con 0x7f37e40a4c10 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f37e413fcc0 con 0x7f37e413d210 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e8d96640 10 monclient(hunting): authenticate will time out at 1092.481717s 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39428/0 (socket says 10.20.193.51:39428) 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 -- 10.20.193.51:0/2512678384 learned_addr learned my addr 10.20.193.51:0/2512678384 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e413d210 0x7f37e41cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): get_auth_request con 0x7f37e406eb80 auth_method 0 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): get_auth_request con 0x7f37e413d210 auth_method 0 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient(hunting): handle_auth_done global_id 74481 payload 824 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e413d210 msgr2=0x7f37e41cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e413d210 0x7f37e41cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f37e40a4c10 msgr2=0x7f37e41cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f37e40a4c10 0x7f37e41cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 monclient: found mon.noname-a 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.862+0000 7f37e2575640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e4133930 con 0x7f37e406eb80 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e2575640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 msgr2=0x7f37e40744c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e2575640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c750 tx=0x7f37d800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8005de0 con 0x7f37e406eb80 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: dump: 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 5 monclient: authenticate success, global_id 74481 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8007070 con 0x7f37e406eb80 2026-02-17T11:53:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 monclient: _renew_subs 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e4134c00 con 0x7f37e406eb80 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8007440 con 0x7f37e406eb80 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e0d72640 4 set_mon_vals no callback set 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 10 monclient: dump: 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.882 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 monclient: _renew_subs 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e4134590 con 0x7f37e406eb80 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 0x7f37e41cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f37e41ccda0 con 0x7f37e409fa50 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 0x7f37e41cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient: get_auth_request con 0x7f37e409fa50 auth_method 0 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f37d8007660 con 0x7f37e406eb80 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 10 monclient(hunting): handle_auth_done global_id 104228 payload 824 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.865+0000 7f37e1d74640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37e413f8a0 con 0x7f37e409fa50 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.866+0000 7f37caffd640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f37b003dd10 0x7f37b00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.866+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(289..289 src has 167..289) ==== 4735+0+0 (secure 0 0 0) 0x7f37d8052390 con 0x7f37e406eb80 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.866+0000 7f37e2d76640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f37b003dd10 0x7f37b00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.866+0000 7f37e2d76640 10 monclient: get_auth_request con 0x7f37b003dd10 auth_method 0 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37e1d74640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 msgr2=0x7f37e41cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37e1d74640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 0x7f37e41cf340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37cc039000 tx=0x7f37cc0095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc046070 con 0x7f37e409fa50 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 10 monclient: dump: 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.886 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f37cc041c20 con 0x7f37e409fa50 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 msgr2=0x7f37e41cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 0x7f37e41cf340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37cc039000 tx=0x7f37cc0095f0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 msgr2=0x7f37e41cf340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37caffd640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e409fa50 0x7f37e41cf340 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37cc039000 tx=0x7f37cc0095f0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.868+0000 7f37e2d76640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f37b003dd10 0x7f37b00401d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37e4074d70 tx=0x7f37d400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e8d96640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e8d96640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 0x7f37e41da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e8d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f37e4137e90 con 0x7f37e41cf880 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 0x7f37e41da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient: get_auth_request con 0x7f37e41cf880 auth_method 0 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 10 monclient(hunting): handle_auth_done global_id 104231 payload 824 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.872+0000 7f37e1d74640 1 -- 10.20.193.51:0/2512678384 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f37e4069830 con 0x7f37e41cf880 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e1d74640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 msgr2=0x7f37e41da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e1d74640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 0x7f37e41da6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02ed90 tx=0x7f37cc033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc057020 con 0x7f37e41cf880 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 10 monclient: dump: 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7f37cc037440 con 0x7f37e41cf880 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 msgr2=0x7f37e41da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 0x7f37e41da6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02ed90 tx=0x7f37cc033000 comp rx=0 tx=0).stop 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 msgr2=0x7f37e41da6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:24.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37caffd640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f37e41cf880 0x7f37e41da6b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 69838, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:24.890 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.891 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:24.892 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:24.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:24.894 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.895 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:24.897 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:24.898 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:24.898 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:24.898 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f37b003dd10 msgr2=0x7f37b00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f37b003dd10 0x7f37b00401d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37e4074d70 tx=0x7f37d400d040 comp rx=0 tx=0).stop 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 10 monclient: shutdown 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 msgr2=0x7f37e40744c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c750 tx=0x7f37d800cc20 comp rx=0 tx=0).stop 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e2d76640 1 -- 10.20.193.51:0/2512678384 reap_dead start 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 shutdown_connections 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 --2- 10.20.193.51:0/2512678384 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f37e406eb80 0x7f37e40744c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.874+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 >> 10.20.193.51:0/2512678384 conn(0x7f37e40a8c80 msgr2=0x7f37e40a6660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.875+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 shutdown_connections 2026-02-17T11:53:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.875+0000 7f37e8d96640 1 -- 10.20.193.51:0/2512678384 wait complete. 2026-02-17T11:53:24.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:24.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:53:24.899 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.966+0000 7fa0118fb640 10 monclient: get_monmap_and_config 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.966+0000 7fa0118fb640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.966+0000 7fa0118fb640 10 monclient: monmap: 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:24.967675+0000 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:24.967675+0000 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.968 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:24.969 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 Processor -- start 2026-02-17T11:53:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 -- start start 2026-02-17T11:53:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient: init 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa00c0a3bb0 0x7fa00c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-a con 0x7fa00c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa00c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c13b760 0x7fa00c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-b con 0x7fa00c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00c06e140 con 0x7fa00c0a0750 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa00c09f910 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c09ccd0 con 0x7fa00c13b760 2026-02-17T11:53:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa0118fb640 10 monclient(hunting): authenticate will time out at 1092.586666s 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa00c0a3bb0 0x7fa00c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa00c0a3bb0 0x7fa00c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39442/0 (socket says 10.20.193.51:39442) 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 -- 10.20.193.51:0/2539052803 learned_addr learned my addr 10.20.193.51:0/2539052803 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): get_auth_request con 0x7fa00c0a3bb0 auth_method 0 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00a7fc640 1 --1- 10.20.193.51:0/2539052803 >> v1:10.20.193.51:6789/0 conn(0x7fa00c0a0750 0x7fa00c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:50010/0 (socket says 10.20.193.51:50010) 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c13b760 0x7fa00c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): get_auth_request con 0x7fa00c13b760 auth_method 0 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient(hunting): handle_auth_done global_id 74484 payload 274 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 -- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c13b760 msgr2=0x7fa00c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c13b760 0x7fa00c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 -- 10.20.193.51:0/2539052803 >> v1:10.20.193.51:6789/0 conn(0x7fa00c0a0750 legacy=0x7fa00c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 monclient: found mon.noname-a 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.967+0000 7fa00affd640 1 -- 10.20.193.51:0/2539052803 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c09eec0 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa00affd640 1 -- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 msgr2=0x7fa00c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa00affd640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c09dac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa00c06c1c0 tx=0x7fa00002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546827c8b278b848 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 1 -- 10.20.193.51:0/2539052803 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00003c070 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: dump: 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 1 -- 10.20.193.51:0/2539052803 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00002fca0 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 5 monclient: authenticate success, global_id 74484 2026-02-17T11:53:24.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 1 -- 10.20.193.51:0/2539052803 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000037660 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 4 set_mon_vals no callback set 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa009ffb640 10 monclient: dump: 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.982 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 10 monclient: shutdown 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 -- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 msgr2=0x7fa00c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c09dac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa00c06c1c0 tx=0x7fa00002ee60 comp rx=0 tx=0).stop 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 -- 10.20.193.51:0/2539052803 shutdown_connections 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c13b760 0x7fa00c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2539052803 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c09dac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 -- 10.20.193.51:0/2539052803 >> 10.20.193.51:0/2539052803 conn(0x7fa00c0a30c0 msgr2=0x7fa00c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:24.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 -- 10.20.193.51:0/2539052803 shutdown_connections 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.970+0000 7fa0118fb640 1 -- 10.20.193.51:0/2539052803 wait complete. 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient: build_initial_monmap 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient: monmap: 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 Processor -- start 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 -- start start 2026-02-17T11:53:24.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient: init 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-c con 0x7fa00c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c0910f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-a con 0x7fa00c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c13b760 0x7fa00c091630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): picked mon.noname-b con 0x7fa00c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0a04b0 con 0x7fa00c0a3bb0 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c09c850 con 0x7fa00c13b760 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c09e710 con 0x7fa00c0a0750 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:24.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa0118fb640 10 monclient(hunting): authenticate will time out at 1092.590836s 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55322/0 (socket says 10.20.193.51:55322) 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 1 -- 10.20.193.51:0/2177980634 learned_addr learned my addr 10.20.193.51:0/2177980634 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): get_auth_request con 0x7fa00c0a0750 auth_method 0 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c0910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request con 0x7fa00c0a3bb0 auth_method 0 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 10 monclient(hunting): handle_auth_done global_id 104237 payload 824 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c13b760 msgr2=0x7fa00c091630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.971+0000 7fa00affd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c13b760 0x7fa00c091630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 msgr2=0x7fa00c0910f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c0a3bb0 0x7fa00c0910f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 10 monclient: _finish_hunting 0 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 1 monclient: found mon.noname-c 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.972+0000 7fa00affd640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c099590 con 0x7fa00c0a0750 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa00affd640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 msgr2=0x7fa00c090bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa00affd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa000002410 tx=0x7fa0000047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000046070 con 0x7fa00c0a0750 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: dump: 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: _finish_auth 0 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00002fe50 con 0x7fa00c0a0750 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00003c040 con 0x7fa00c0a0750 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0097fa640 4 set_mon_vals no callback set 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7f9fe3fff640 10 monclient: dump: 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:24.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 5 monclient: authenticate success, global_id 104237 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 monclient: _renew_subs 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c0945b0 con 0x7fa00c0a0750 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 monclient: _renew_subs 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c0a2400 con 0x7fa00c0a0750 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.974+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c093320 con 0x7fa00c091b70 2026-02-17T11:53:24.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa0000416e0 con 0x7fa00c0a0750 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c091b70 auth_method 0 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7f9fe3fff640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 0x7f9fdc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(289..289 src has 167..289) ==== 4735+0+0 (secure 0 0 0) 0x7fa000077b60 con 0x7fa00c0a0750 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00b7fe640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 0x7f9fdc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00b7fe640 10 monclient: get_auth_request con 0x7f9fdc03dd10 auth_method 0 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.975+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:24.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:24.977+0000 7fa00b7fe640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 0x7f9fdc0401d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa00c099df0 tx=0x7f9ffc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:24.992 INFO:tasks.rados.rados.0.trial142.stdout:1212: finishing write tid 1 to trial14245205-2 2026-02-17T11:53:24.992 INFO:tasks.rados.rados.0.trial142.stdout:1215: done (3 left) 2026-02-17T11:53:24.992 INFO:tasks.rados.rados.0.trial142.stdout:1216: write oid 13 current snap is 131 2026-02-17T11:53:24.992 INFO:tasks.rados.rados.0.trial142.stdout:1212: finishing write tid 2 to trial14245205-2 2026-02-17T11:53:24.992 INFO:tasks.rados.rados.0.trial142.stdout:1212: finishing write tid 3 to trial14245205-2 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: finishing write tid 4 to trial14245205-2 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: finishing write tid 5 to trial14245205-2 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: oid 2 updating version 0 to 634 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: oid 2 updating version 634 to 637 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: oid 2 version 637 is already newer than 636 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: oid 2 version 637 is already newer than 635 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 637 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1212: left oid 2 (ObjNum 437 snap 131 seq_num 437) 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: finishing write tid 1 to trial14245205-10 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: finishing write tid 2 to trial14245205-10 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: finishing write tid 3 to trial14245205-10 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: finishing write tid 4 to trial14245205-10 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: finishing write tid 5 to trial14245205-10 2026-02-17T11:53:24.993 INFO:tasks.rados.rados.0.trial142.stdout:1214: oid 10 updating version 0 to 618 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1214: oid 10 updating version 618 to 619 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1214: oid 10 version 619 is already newer than 616 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1214: oid 10 version 619 is already newer than 617 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 619 (ObjNum 438 snap 131 seq_num 438) dirty exists 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1214: left oid 10 (ObjNum 438 snap 131 seq_num 438) 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1216: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2026-02-17T11:53:24.994 INFO:tasks.rados.rados.0.trial142.stdout:1216: writing trial14245205-13 from 578273 to 1044705 tid 1 2026-02-17T11:53:24.998 INFO:tasks.rados.rados.0.trial142.stdout:1216: writing trial14245205-13 from 1739595 to 2192410 tid 2 2026-02-17T11:53:25.003 INFO:tasks.rados.rados.0.trial142.stdout:1216: writing trial14245205-13 from 2722929 to 3378273 tid 3 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1212: done (3 left) 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1213: done (2 left) 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1214: done (1 left) 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1217: copy_from oid 19 from oid 10 current snap is 131 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1216: finishing write tid 1 to trial14245205-13 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1218: write oid 50 current snap is 131 2026-02-17T11:53:25.004 INFO:tasks.rados.rados.0.trial142.stdout:1218: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2026-02-17T11:53:25.007 INFO:tasks.rados.rados.0.trial142.stdout:1218: writing trial14245205-50 from 595080 to 1136761 tid 1 2026-02-17T11:53:25.012 INFO:tasks.rados.rados.0.trial142.stdout:1218: writing trial14245205-50 from 1798077 to 2394550 tid 2 2026-02-17T11:53:25.016 INFO:tasks.rados.rados.0.trial142.stdout:1218: writing trial14245205-50 from 3150352 to 3395080 tid 3 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1219: read oid 46 snap -1 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1219: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1220: snap_create 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: finishing write tid 2 to trial14245205-13 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: finishing write tid 3 to trial14245205-13 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: finishing write tid 4 to trial14245205-13 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: finishing write tid 5 to trial14245205-13 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: oid 13 updating version 0 to 936 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: oid 13 version 936 is already newer than 935 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: oid 13 updating version 936 to 938 2026-02-17T11:53:25.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: oid 13 version 938 is already newer than 937 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 938 (ObjNum 439 snap 131 seq_num 439) dirty exists 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:1216: left oid 13 (ObjNum 439 snap 131 seq_num 439) 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:1218: finishing write tid 1 to trial14245205-50 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:1217: finishing copy_from racing read to trial14245205-19 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:1217: finishing copy_from to trial14245205-19 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 619 (ObjNum 438 snap 131 seq_num 438) dirty exists 2026-02-17T11:53:25.018 INFO:tasks.rados.rados.0.trial142.stdout:1218: finishing write tid 2 to trial14245205-50 2026-02-17T11:53:25.019 INFO:tasks.rados.rados.0.trial142.stdout:1218: finishing write tid 3 to trial14245205-50 2026-02-17T11:53:25.019 INFO:tasks.rados.rados.0.trial142.stdout:1218: finishing write tid 4 to trial14245205-50 2026-02-17T11:53:25.019 INFO:tasks.rados.rados.0.trial142.stdout:1219: expect (ObjNum 392 snap 121 seq_num 392) 2026-02-17T11:53:25.076 INFO:tasks.rados.rados.0.trial142.stdout:1218: finishing write tid 5 to trial14245205-50 2026-02-17T11:53:25.076 INFO:tasks.rados.rados.0.trial142.stdout:1218: oid 50 updating version 0 to 708 2026-02-17T11:53:25.076 INFO:tasks.rados.rados.0.trial142.stdout:1218: oid 50 version 708 is already newer than 707 2026-02-17T11:53:25.076 INFO:tasks.rados.rados.0.trial142.stdout:1218: oid 50 updating version 708 to 709 2026-02-17T11:53:25.076 INFO:tasks.rados.rados.0.trial142.stdout:1218: oid 50 version 709 is already newer than 706 2026-02-17T11:53:25.077 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 709 (ObjNum 440 snap 131 seq_num 440) dirty exists 2026-02-17T11:53:25.077 INFO:tasks.rados.rados.0.trial142.stdout:1218: left oid 50 (ObjNum 440 snap 131 seq_num 440) 2026-02-17T11:53:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c091b70 auth_method 0 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.176+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:25.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c091b70 auth_method 0 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:25.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:25.577+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1216: done (4 left) 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1217: done (3 left) 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1218: done (2 left) 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1219: done (1 left) 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1220: done (0 left) 2026-02-17T11:53:26.017 INFO:tasks.rados.rados.0.trial142.stdout:1221: snap_create 2026-02-17T11:53:26.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:26.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c091b70 auth_method 0 2026-02-17T11:53:26.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:26.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:26.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:26.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:26.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:26.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:26.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:26.379+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:27.017 INFO:tasks.rados.rados.0.trial142.stdout:1221: done (0 left) 2026-02-17T11:53:27.018 INFO:tasks.rados.rados.0.trial142.stdout:1222: rollback oid 12 current snap is 133 2026-02-17T11:53:27.018 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 12 to 128 2026-02-17T11:53:27.018 INFO:tasks.rados.rados.0.trial142.stdout:1223: read oid 50 snap 131 2026-02-17T11:53:27.018 INFO:tasks.rados.rados.0.trial142.stdout:1223: expect (ObjNum 440 snap 131 seq_num 440) 2026-02-17T11:53:27.018 INFO:tasks.rados.rados.0.trial142.stdout:1224: delete oid 17 current snap is 133 2026-02-17T11:53:27.020 INFO:tasks.rados.rados.0.trial142.stdout:1224: done (2 left) 2026-02-17T11:53:27.020 INFO:tasks.rados.rados.0.trial142.stdout:1225: read oid 9 snap 128 2026-02-17T11:53:27.020 INFO:tasks.rados.rados.0.trial142.stdout:1225: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:27.021 INFO:tasks.rados.rados.0.trial142.stdout:1226: delete oid 11 current snap is 133 2026-02-17T11:53:27.022 INFO:tasks.rados.rados.0.trial142.stdout:1222: finishing rollback tid 0 to trial14245205-12 2026-02-17T11:53:27.022 INFO:tasks.rados.rados.0.trial142.stdout:1222: finishing rollback tid 1 to trial14245205-12 2026-02-17T11:53:27.023 INFO:tasks.rados.rados.0.trial142.stdout:1226: done (3 left) 2026-02-17T11:53:27.023 INFO:tasks.rados.rados.0.trial142.stdout:1227: snap_create 2026-02-17T11:53:27.025 INFO:tasks.rados.rados.0.trial142.stdout:1223: expect (ObjNum 440 snap 131 seq_num 440) 2026-02-17T11:53:27.182 INFO:tasks.rados.rados.0.trial142.stdout:1225: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:53:27.328 INFO:tasks.rados.rados.0.trial142.stdout:1222: finishing rollback tid 2 to trial14245205-12 2026-02-17T11:53:27.328 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 974 (ObjNum 420 snap 126 seq_num 420) dirty exists 2026-02-17T11:53:27.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.972+0000 7f9fe2ffd640 10 monclient: tick 2026-02-17T11:53:27.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.972+0000 7f9fe2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:27.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.972+0000 7f9fe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:27.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.972+0000 7f9fe2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c091b70 auth_method 0 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:27.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:27.981+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:53:28.021 INFO:tasks.rados.rados.0.trial142.stdout:1222: done (3 left) 2026-02-17T11:53:28.022 INFO:tasks.rados.rados.0.trial142.stdout:1223: done (2 left) 2026-02-17T11:53:28.022 INFO:tasks.rados.rados.0.trial142.stdout:1225: done (1 left) 2026-02-17T11:53:28.022 INFO:tasks.rados.rados.0.trial142.stdout:1227: done (0 left) 2026-02-17T11:53:28.022 INFO:tasks.rados.rados.0.trial142.stdout:1228: write oid 23 current snap is 134 2026-02-17T11:53:28.022 INFO:tasks.rados.rados.0.trial142.stdout:1228: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2026-02-17T11:53:28.026 INFO:tasks.rados.rados.0.trial142.stdout:1228: writing trial14245205-23 from 645501 to 1129282 tid 1 2026-02-17T11:53:28.029 INFO:tasks.rados.rados.0.trial142.stdout:1228: writing trial14245205-23 from 1573523 to 2033676 tid 2 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:1228: writing trial14245205-23 from 2548974 to 3312358 tid 3 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:1229: rollback oid 36 current snap is 134 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 132 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:1228: finishing write tid 1 to trial14245205-23 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:1228: finishing write tid 2 to trial14245205-23 2026-02-17T11:53:28.035 INFO:tasks.rados.rados.0.trial142.stdout:1230: read oid 38 snap 132 2026-02-17T11:53:28.036 INFO:tasks.rados.rados.0.trial142.stdout:1230: expect (ObjNum 434 snap 130 seq_num 434) 2026-02-17T11:53:28.036 INFO:tasks.rados.rados.0.trial142.stdout:1231: rollback oid 28 current snap is 134 2026-02-17T11:53:28.036 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 121 2026-02-17T11:53:28.036 INFO:tasks.rados.rados.0.trial142.stdout:1232: write (excl) oid 5 current snap is 134 2026-02-17T11:53:28.036 INFO:tasks.rados.rados.0.trial142.stdout:1232: seq_num 444 ranges {662308=559030,1632005=603811,2860044=602264} 2026-02-17T11:53:28.040 INFO:tasks.rados.rados.0.trial142.stdout:1232: writing trial14245205-5 from 662308 to 1221338 tid 1 2026-02-17T11:53:28.043 INFO:tasks.rados.rados.0.trial142.stdout:1232: writing trial14245205-5 from 1632005 to 2235816 tid 2 2026-02-17T11:53:28.048 INFO:tasks.rados.rados.0.trial142.stdout:1232: writing trial14245205-5 from 2860044 to 3462308 tid 3 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1233: read oid 44 snap -1 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1233: expect deleted 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1234: write (excl) oid 13 current snap is 134 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1229: finishing rollback tid 0 to trial14245205-36 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1229: finishing rollback tid 1 to trial14245205-36 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1231: finishing rollback tid 1 to trial14245205-28 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 0 (ObjNum 81 snap 0 seq_num 1) dirty dne 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1228: finishing write tid 3 to trial14245205-23 2026-02-17T11:53:28.049 INFO:tasks.rados.rados.0.trial142.stdout:1234: seq_num 445 ranges {679115=634279,2090487=463822,3003820=475295} 2026-02-17T11:53:28.053 INFO:tasks.rados.rados.0.trial142.stdout:1234: writing trial14245205-13 from 679115 to 1313394 tid 1 2026-02-17T11:53:28.058 INFO:tasks.rados.rados.0.trial142.stdout:1234: writing trial14245205-13 from 2090487 to 2554309 tid 2 2026-02-17T11:53:28.062 INFO:tasks.rados.rados.0.trial142.stdout:1234: writing trial14245205-13 from 3003820 to 3479115 tid 3 2026-02-17T11:53:28.062 INFO:tasks.rados.rados.0.trial142.stdout:1231: done (6 left) 2026-02-17T11:53:28.062 INFO:tasks.rados.rados.0.trial142.stdout:1235: write oid 33 current snap is 134 2026-02-17T11:53:28.062 INFO:tasks.rados.rados.0.trial142.stdout:1235: seq_num 446 ranges {695922=709528,2032616=607480,3198537=297385} 2026-02-17T11:53:28.067 INFO:tasks.rados.rados.0.trial142.stdout:1235: writing trial14245205-33 from 695922 to 1405450 tid 1 2026-02-17T11:53:28.072 INFO:tasks.rados.rados.0.trial142.stdout:1235: writing trial14245205-33 from 2032616 to 2640096 tid 2 2026-02-17T11:53:28.075 INFO:tasks.rados.rados.0.trial142.stdout:1235: writing trial14245205-33 from 3198537 to 3495922 tid 3 2026-02-17T11:53:28.075 INFO:tasks.rados.rados.0.trial142.stdout:1236: write oid 4 current snap is 134 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1229: finishing rollback tid 2 to trial14245205-36 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 715 (ObjNum 414 snap 125 seq_num 414) dirty exists 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: finishing write tid 4 to trial14245205-23 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: finishing write tid 5 to trial14245205-23 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: oid 23 updating version 0 to 622 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: oid 23 version 622 is already newer than 621 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: oid 23 version 622 is already newer than 620 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: oid 23 updating version 622 to 623 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 623 (ObjNum 443 snap 134 seq_num 443) dirty exists 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1228: left oid 23 (ObjNum 443 snap 134 seq_num 443) 2026-02-17T11:53:28.076 INFO:tasks.rados.rados.0.trial142.stdout:1230: expect (ObjNum 434 snap 130 seq_num 434) 2026-02-17T11:53:28.201 INFO:tasks.rados.rados.0.trial142.stdout:1232: finishing write tid 1 to trial14245205-5 2026-02-17T11:53:28.201 INFO:tasks.rados.rados.0.trial142.stdout:1232: finishing write tid 2 to trial14245205-5 2026-02-17T11:53:28.201 INFO:tasks.rados.rados.0.trial142.stdout:1236: seq_num 447 ranges {712729=784777,2091098=467491,3342313=170416} 2026-02-17T11:53:28.206 INFO:tasks.rados.rados.0.trial142.stdout:1236: writing trial14245205-4 from 712729 to 1497506 tid 1 2026-02-17T11:53:28.210 INFO:tasks.rados.rados.0.trial142.stdout:1236: writing trial14245205-4 from 2091098 to 2558589 tid 2 2026-02-17T11:53:28.214 INFO:tasks.rados.rados.0.trial142.stdout:1236: writing trial14245205-4 from 3342313 to 3512729 tid 3 2026-02-17T11:53:28.214 INFO:tasks.rados.rados.0.trial142.stdout:1228: done (7 left) 2026-02-17T11:53:28.214 INFO:tasks.rados.rados.0.trial142.stdout:1229: done (6 left) 2026-02-17T11:53:28.214 INFO:tasks.rados.rados.0.trial142.stdout:1230: done (5 left) 2026-02-17T11:53:28.214 INFO:tasks.rados.rados.0.trial142.stdout:1233: done (4 left) 2026-02-17T11:53:28.215 INFO:tasks.rados.rados.0.trial142.stdout:1237: write oid 14 current snap is 134 2026-02-17T11:53:28.215 INFO:tasks.rados.rados.0.trial142.stdout:1237: seq_num 448 ranges {729536=460026,1749580=611149,2853383=452450} 2026-02-17T11:53:28.218 INFO:tasks.rados.rados.0.trial142.stdout:1237: writing trial14245205-14 from 729536 to 1189562 tid 1 2026-02-17T11:53:28.223 INFO:tasks.rados.rados.0.trial142.stdout:1237: writing trial14245205-14 from 1749580 to 2360729 tid 2 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1237: writing trial14245205-14 from 2853383 to 3305833 tid 3 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1238: rollback oid 15 current snap is 134 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: finishing write tid 3 to trial14245205-5 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: finishing write tid 4 to trial14245205-5 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: finishing write tid 5 to trial14245205-5 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: oid 5 updating version 0 to 642 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: oid 5 version 642 is already newer than 639 2026-02-17T11:53:28.228 INFO:tasks.rados.rados.0.trial142.stdout:1232: oid 5 version 642 is already newer than 641 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1232: oid 5 version 642 is already newer than 640 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 642 (ObjNum 444 snap 134 seq_num 444) dirty exists 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1232: left oid 5 (ObjNum 444 snap 134 seq_num 444) 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: finishing write tid 1 to trial14245205-13 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: finishing write tid 2 to trial14245205-13 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: finishing write tid 3 to trial14245205-13 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: finishing write tid 4 to trial14245205-13 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: finishing write tid 5 to trial14245205-13 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: oid 13 updating version 0 to 940 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: oid 13 version 940 is already newer than 939 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: oid 13 updating version 940 to 942 2026-02-17T11:53:28.229 INFO:tasks.rados.rados.0.trial142.stdout:1234: oid 13 version 942 is already newer than 941 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 942 (ObjNum 445 snap 134 seq_num 445) dirty exists 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1234: left oid 13 (ObjNum 445 snap 134 seq_num 445) 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: finishing write tid 1 to trial14245205-33 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: finishing write tid 2 to trial14245205-33 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: finishing write tid 3 to trial14245205-33 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 129 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: finishing write tid 4 to trial14245205-33 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: finishing write tid 5 to trial14245205-33 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: oid 33 updating version 0 to 945 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: oid 33 version 945 is already newer than 944 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: oid 33 updating version 945 to 946 2026-02-17T11:53:28.230 INFO:tasks.rados.rados.0.trial142.stdout:1235: oid 33 version 946 is already newer than 943 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 946 (ObjNum 446 snap 134 seq_num 446) dirty exists 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1235: left oid 33 (ObjNum 446 snap 134 seq_num 446) 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: finishing write tid 1 to trial14245205-4 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: finishing write tid 2 to trial14245205-4 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: finishing write tid 3 to trial14245205-4 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: finishing write tid 4 to trial14245205-4 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: finishing write tid 5 to trial14245205-4 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: oid 4 updating version 0 to 977 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: oid 4 updating version 977 to 978 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: oid 4 version 978 is already newer than 976 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: oid 4 updating version 978 to 979 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 979 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:53:28.231 INFO:tasks.rados.rados.0.trial142.stdout:1236: left oid 4 (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1237: finishing write tid 1 to trial14245205-14 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1237: finishing write tid 2 to trial14245205-14 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1232: done (5 left) 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1234: done (4 left) 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1235: done (3 left) 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1236: done (2 left) 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1239: read oid 22 snap 133 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1239: expect deleted 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1240: delete oid 18 current snap is 134 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:1238: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:53:28.232 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 0 (ObjNum 33 snap 0 seq_num 1213778528) dirty dne 2026-02-17T11:53:28.233 INFO:tasks.rados.rados.0.trial142.stdout:1237: finishing write tid 3 to trial14245205-14 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: finishing write tid 4 to trial14245205-14 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: finishing write tid 5 to trial14245205-14 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: oid 14 updating version 0 to 983 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: oid 14 version 983 is already newer than 982 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: oid 14 updating version 983 to 984 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: oid 14 version 984 is already newer than 981 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 984 (ObjNum 448 snap 134 seq_num 448) dirty exists 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: left oid 14 (ObjNum 448 snap 134 seq_num 448) 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1237: done (3 left) 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1238: done (2 left) 2026-02-17T11:53:28.234 INFO:tasks.rados.rados.0.trial142.stdout:1239: done (1 left) 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1240: done (0 left) 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1241: delete oid 7 current snap is 134 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1241: done (0 left) 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1242: read oid 3 snap 129 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1242: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1243: snap_create 2026-02-17T11:53:28.235 INFO:tasks.rados.rados.0.trial142.stdout:1242: expect (ObjNum 335 snap 109 seq_num 335) 2026-02-17T11:53:28.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 10 monclient: tick 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 0x7f9fd8005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 msgr2=0x7fa00c08d3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:28.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c091b70 0x7fa00c08d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.971+0000 7f9fe2ffd640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd8006180 con 0x7f9fd8003640 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 0x7f9fd8005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7f9fd8003640 auth_method 0 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:28.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:28.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:28.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_done global_id 114100 payload 824 2026-02-17T11:53:28.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.972+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fd8006330 con 0x7f9fd8003640 2026-02-17T11:53:28.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.974+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 msgr2=0x7f9fd8005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:28.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.974+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 0x7f9fd8005ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0921a0 tx=0x7f9ff4018f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:28.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4019450 con 0x7f9fd8003640 2026-02-17T11:53:28.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:28.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 10 monclient: dump: 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:28.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9ff4019450 con 0x7f9fd8003640 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 msgr2=0x7f9fd8005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 0x7f9fd8005ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0921a0 tx=0x7f9ff4018f80 comp rx=0 tx=0).stop 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 msgr2=0x7f9fd8005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:28.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.975+0000 7f9fe3fff640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9fd8003640 0x7f9fd8005ad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:28.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.978+0000 7fa0118fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:28.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.978+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 0x7fa00c08d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.978+0000 7fa0118fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.978+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c09dac0 con 0x7fa00c0940d0 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 0x7fa00c08d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient: get_auth_request con 0x7fa00c0940d0 auth_method 0 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 10 monclient(hunting): handle_auth_done global_id 114103 payload 824 2026-02-17T11:53:28.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.979+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa00c092a00 con 0x7fa00c0940d0 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7fa00a7fc640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 msgr2=0x7fa00c08d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7fa00a7fc640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 0x7fa00c08d930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4022000 tx=0x7f9ff4028530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4002d20 con 0x7fa00c0940d0 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 10 monclient: dump: 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:28.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f9ff4002d20 con 0x7fa00c0940d0 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:28.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 msgr2=0x7fa00c08d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.981+0000 7f9fe3fff640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 0x7fa00c08d930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4022000 tx=0x7f9ff4028530 comp rx=0 tx=0).stop 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7f9fe3fff640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 msgr2=0x7fa00c08d930 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa00b7fe640 1 -- 10.20.193.51:0/2177980634 reap_dead start 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7f9fe3fff640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0940d0 0x7fa00c08d930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:28.986 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10856, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:53:28.987 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:28.988 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:28.989 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:28.990 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:28.991 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:28.992 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.993 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:28.994 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.995 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:28.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:28.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:28.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:29.000 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 msgr2=0x7f9fdc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 0x7f9fdc0401d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa00c099df0 tx=0x7f9ffc00b040 comp rx=0 tx=0).stop 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 10 monclient: shutdown 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 msgr2=0x7fa00c090bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa000002410 tx=0x7fa0000047c0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 shutdown_connections 2026-02-17T11:53:29.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dd10 0x7f9fdc0401d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 --2- 10.20.193.51:0/2177980634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a0750 0x7fa00c090bb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 >> 10.20.193.51:0/2177980634 conn(0x7fa00c0a30c0 msgr2=0x7fa00c13acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:29.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 shutdown_connections 2026-02-17T11:53:29.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:28.982+0000 7fa0118fb640 1 -- 10.20.193.51:0/2177980634 wait complete. 2026-02-17T11:53:29.003 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:29.004 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:53:29.004 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:53:29.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: get_monmap_and_config 2026-02-17T11:53:29.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: build_initial_monmap 2026-02-17T11:53:29.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: monmap: 2026-02-17T11:53:29.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:29.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:29.070197+0000 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:29.070197+0000 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 Processor -- start 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 -- start start 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: init 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-a con 0x7f07ac0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f07ac0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f07ac09e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ac06e140 con 0x7f07ac09e540 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:29.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f07ac0a3f90 con 0x7f07ac0a3bb0 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f07ac09f910 con 0x7f07ac0a0750 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.069+0000 7f07b0fc1640 10 monclient(hunting): authenticate will time out at 1096.688952s 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45198/0 (socket says 10.20.193.51:45198) 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 1 -- 10.20.193.51:0/31162717 learned_addr learned my addr 10.20.193.51:0/31162717 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): get_auth_request con 0x7f07ac0a0750 auth_method 0 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:29.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): get_auth_request con 0x7f07ac0a3bb0 auth_method 0 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient(hunting): handle_auth_done global_id 104240 payload 274 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 -- 10.20.193.51:0/31162717 >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 msgr2=0x7f07ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:29.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 --2- 10.20.193.51:0/31162717 >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 -- 10.20.193.51:0/31162717 >> v1:10.20.193.142:6789/0 conn(0x7f07ac09e540 legacy=0x7f07ac13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 monclient: found mon.noname-b 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07a9d74640 1 -- 10.20.193.51:0/31162717 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac09ccd0 con 0x7f07ac0a0750 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.070+0000 7f07aa575640 1 --2- 10.20.193.51:0/31162717 >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9d74640 1 -- 10.20.193.51:0/31162717 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 msgr2=0x7f07ac09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9d74640 1 --2- 10.20.193.51:0/31162717 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac09e000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07ac06c1c0 tx=0x7f079402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee15f3ec8e2e4e37 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 1 -- 10.20.193.51:0/31162717 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079403c070 con 0x7f07ac0a0750 2026-02-17T11:53:29.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: dump: 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: _finish_auth 0 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: _check_auth_tickets 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 1 -- 10.20.193.51:0/31162717 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079402fbd0 con 0x7f07ac0a0750 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07b0fc1640 5 monclient: authenticate success, global_id 104240 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 1 -- 10.20.193.51:0/31162717 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794037440 con 0x7f07ac0a0750 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07a9573640 10 monclient: dump: 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:29.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07b0fc1640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.072+0000 7f07b0fc1640 4 set_mon_vals no callback set 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: shutdown 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:29.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- 10.20.193.51:0/31162717 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 msgr2=0x7f07ac09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/31162717 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac09e000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07ac06c1c0 tx=0x7f079402ed50 comp rx=0 tx=0).stop 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- 10.20.193.51:0/31162717 shutdown_connections 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/31162717 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac09e000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/31162717 >> v2:10.20.193.51:3300/0 conn(0x7f07ac0a3bb0 0x7f07ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- 10.20.193.51:0/31162717 >> 10.20.193.51:0/31162717 conn(0x7f07ac0a30c0 msgr2=0x7f07ac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- 10.20.193.51:0/31162717 shutdown_connections 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- 10.20.193.51:0/31162717 wait complete. 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: build_initial_monmap 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: monmap: 2026-02-17T11:53:29.090 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 Processor -- start 2026-02-17T11:53:29.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- start start 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: init 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-a con 0x7f07ac09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-c con 0x7f07ac0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f07ac0a3bb0 0x7f07ac130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f07ac0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac0a04b0 con 0x7f07ac09e540 2026-02-17T11:53:29.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac09c850 con 0x7f07ac0a3bb0 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f07ac13de80 con 0x7f07ac0a0750 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.073+0000 7f07b0fc1640 10 monclient(hunting): authenticate will time out at 1096.692977s 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45206/0 (socket says 10.20.193.51:45206) 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38622/0 (socket says 10.20.193.51:38622) 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 1 -- 10.20.193.51:0/684349080 learned_addr learned my addr 10.20.193.51:0/684349080 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): get_auth_request con 0x7f07ac09e540 auth_method 0 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:29.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): get_auth_request con 0x7f07ac0a0750 auth_method 0 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:29.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient(hunting): handle_auth_done global_id 104243 payload 824 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 -- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f07ac0a3bb0 msgr2=0x7f07ac130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f07ac0a3bb0 0x7f07ac130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 -- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 msgr2=0x7f07ac1381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 monclient: found mon.noname-c 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07a9d74640 1 -- 10.20.193.51:0/684349080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac1337a0 con 0x7f07ac0a0750 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.074+0000 7f07aa575640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07a9d74640 1 -- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 msgr2=0x7f07ac12fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:29.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07a9d74640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0794036000 tx=0x7f07940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794046020 con 0x7f07ac0a0750 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: dump: 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:29.096 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794040800 con 0x7f07ac0a0750 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079403c040 con 0x7f07ac0a0750 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f0792ffd640 10 monclient: dump: 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:29.097 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07a8d72640 4 set_mon_vals no callback set 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 5 monclient: authenticate success, global_id 104243 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _renew_subs 2026-02-17T11:53:29.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ac131f10 con 0x7f07ac0a0750 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _renew_subs 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ac09d7b0 con 0x7f07ac0a0750 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.076+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ac09dac0 con 0x7f07ac0a0750 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.077+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f079403f030 con 0x7f07ac0a0750 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.077+0000 7f0792ffd640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 0x7f07780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.077+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(293..293 src has 167..293) ==== 4751+0+0 (secure 0 0 0) 0x7f0794076fe0 con 0x7f07ac0a0750 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.077+0000 7f07aa575640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 0x7f07780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:29.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.077+0000 7f07aa575640 10 monclient: get_auth_request con 0x7f077803dd10 auth_method 0 2026-02-17T11:53:29.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.079+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f079402fa90 con 0x7f07ac0a0750 2026-02-17T11:53:29.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.079+0000 7f0792ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:29.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.079+0000 7f0792ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:29.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.080+0000 7f07aa575640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 0x7f07780401d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f07a00113d0 tx=0x7f07a0009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:29.103 INFO:tasks.rados.rados.0.trial142.stdout:1242: done (1 left) 2026-02-17T11:53:29.103 INFO:tasks.rados.rados.0.trial142.stdout:1243: done (0 left) 2026-02-17T11:53:29.103 INFO:tasks.rados.rados.0.trial142.stdout:1244: snap_create 2026-02-17T11:53:29.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.196+0000 7f07b0fc1640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:53:29.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.196+0000 7f07b0fc1640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:53:29.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.196+0000 7f07b0fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:29.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.196+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f07ac0008d0 con 0x7f07ac0a0750 2026-02-17T11:53:29.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.197+0000 7f0792ffd640 1 -- 10.20.193.51:0/684349080 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f0794040c70 con 0x7f07ac0a0750 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.197+0000 7f0792ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.197+0000 7f0792ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 msgr2=0x7f07780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 0x7f07780401d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f07a00113d0 tx=0x7f07a0009340 comp rx=0 tx=0).stop 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 10 monclient: shutdown 2026-02-17T11:53:29.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 msgr2=0x7f07ac12fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0794036000 tx=0x7f07940047c0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 shutdown_connections 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f077803dd10 0x7f07780401d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f07ac0a3bb0 0x7f07ac130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f07ac0a0750 0x7f07ac12fff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 --2- 10.20.193.51:0/684349080 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f07ac09e540 0x7f07ac1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:29.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 >> 10.20.193.51:0/684349080 conn(0x7f07ac0a30c0 msgr2=0x7f07ac0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:29.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 shutdown_connections 2026-02-17T11:53:29.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:29.198+0000 7f07b0fc1640 1 -- 10.20.193.51:0/684349080 wait complete. 2026-02-17T11:53:29.209 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:53:29.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=603575727,config=692619927,health=1068221574,kv=2474110515,logm=1063882153}) 2026-02-17T11:53:29.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=11,logm=57} crc {auth=2319060906,config=692619927,health=1378089662,kv=218791062,logm=4237093139}) 2026-02-17T11:53:29.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=603575727,config=692619927,health=1068221574,kv=2474110515,logm=1063882153}) 2026-02-17T11:53:29.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=603575727,config=692619927,health=1378089662,kv=643764953,logm=3126093714}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1522937873}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3870573779}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1522937873}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.296+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=666631463}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=645441627}) 2026-02-17T11:53:29.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3526124640}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=645441627}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1438469597}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=100900613}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=644885546}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=100900613}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1719399257}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1509190573}) 2026-02-17T11:53:29.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2860195642}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1509190573}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1834928465}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244678520}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.297+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1351677415}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244678520}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2859203167}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3942781462}) 2026-02-17T11:53:29.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1539078762}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3942781462}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3962582954}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=32275402}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3865804018}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=32275402}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1440454918}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209285226}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=683775031}) 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209285226}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.298+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3100988589}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1963388175}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=792321881}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1963388175}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1340276235}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741056287}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=704717192}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741056287}) 2026-02-17T11:53:29.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.299+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=180623350}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4239387471}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3231376972}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4239387471}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.305+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2038267232}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510767460}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3836635430}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510767460}) 2026-02-17T11:53:29.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2419183760}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2986403295}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3333975296}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2986403295}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.306+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1476133233}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=646508618}) 2026-02-17T11:53:29.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3310538357}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=646508618}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=80425550}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3250662707}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2142980005}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3250662707}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3725210263}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=510322344}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3149352538}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=510322344}) 2026-02-17T11:53:29.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2249844518}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3878328530}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=968096123}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3878328530}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.307+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3265299280}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940661232}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=558278708}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940661232}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642425035}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248942333}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4101018755}) 2026-02-17T11:53:29.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248942333}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2492083118}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297593887}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1898371665}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297593887}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.308+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=490458932}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1204857778}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2915925727}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1204857778}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=878841819}) 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2394369}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2518038010}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2394369}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2133597872}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=316874203}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3305316903}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=316874203}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2124833786}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1390494954}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3906002}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1390494954}) 2026-02-17T11:53:29.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.309+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2800634523}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3441864781}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3124872767}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3441864781}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=651284337}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=70,mdsmap=3,mgr=7,mgrstat=13,mon_config_key=7} crc {logm=870226979,mdsmap=3207544932,mgr=2242172100,mgrstat=4054332056,mon_config_key=3202994854}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=71,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=4} crc {logm=776963190,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=4054332056,mon_config_key=1000785255}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=70,mdsmap=3,mgr=7,mgrstat=13,mon_config_key=7} crc {logm=870226979,mdsmap=3207544932,mgr=2242172100,mgrstat=4054332056,mon_config_key=3202994854}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.310+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=65,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10} crc {logm=1410430056,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1519375744,mon_config_key=726310875}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=44,osdmap=40} crc {mon_config_key=775002920,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=177767302,osd_snap=4102494538,osdmap=938861606}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=6,monmap=3,osd_metadata=6,osd_snap=44,osdmap=41} crc {mon_config_key=775002920,monmap=263989209,osd_metadata=3956758304,osd_snap=3717846813,osdmap=2496025108}) 2026-02-17T11:53:29.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=44,osdmap=40} crc {mon_config_key=775002920,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=177767302,osd_snap=4102494538,osdmap=938861606}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=44,osdmap=40} crc {mon_config_key=775002920,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=177767302,osd_snap=3825836100,osdmap=1239157315}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1744445534}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3228721506}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1744445534}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.311+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1958684410}) 2026-02-17T11:53:29.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.322 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=99675437}) 2026-02-17T11:53:29.322 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=4244455923}) 2026-02-17T11:53:29.322 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:53:29.322 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=58} crc {osdmap=99675437}) 2026-02-17T11:53:29.322 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:53:29.314+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=60} crc {osdmap=1044656246}) 2026-02-17T11:53:29.992 INFO:tasks.rados.rados.0.trial142.stdout:1244: done (0 left) 2026-02-17T11:53:29.992 INFO:tasks.rados.rados.0.trial142.stdout:1245: write (excl) oid 37 current snap is 136 2026-02-17T11:53:29.992 INFO:tasks.rados.rados.0.trial142.stdout:1245: seq_num 451 ranges {779957=402126,1925026=758476,3335652=244305} 2026-02-17T11:53:29.996 INFO:tasks.rados.rados.0.trial142.stdout:1245: writing trial14245205-37 from 779957 to 1182083 tid 1 2026-02-17T11:53:30.002 INFO:tasks.rados.rados.0.trial142.stdout:1245: writing trial14245205-37 from 1925026 to 2683502 tid 2 2026-02-17T11:53:30.005 INFO:tasks.rados.rados.0.trial142.stdout:1245: writing trial14245205-37 from 3335652 to 3579957 tid 3 2026-02-17T11:53:30.006 INFO:tasks.rados.rados.0.trial142.stdout:1246: copy_from oid 50 from oid 5 current snap is 136 2026-02-17T11:53:30.006 INFO:tasks.rados.rados.0.trial142.stdout:1245: finishing write tid 1 to trial14245205-37 2026-02-17T11:53:30.006 INFO:tasks.rados.rados.0.trial142.stdout:1245: finishing write tid 2 to trial14245205-37 2026-02-17T11:53:30.006 INFO:tasks.rados.rados.0.trial142.stdout:1247: snap_create 2026-02-17T11:53:30.007 INFO:tasks.rados.rados.0.trial142.stdout:1245: finishing write tid 3 to trial14245205-37 2026-02-17T11:53:30.007 INFO:tasks.rados.rados.0.trial142.stdout:1245: finishing write tid 4 to trial14245205-37 2026-02-17T11:53:30.007 INFO:tasks.rados.rados.0.trial142.stdout:1245: finishing write tid 5 to trial14245205-37 2026-02-17T11:53:30.007 INFO:tasks.rados.rados.0.trial142.stdout:1245: oid 37 updating version 0 to 694 2026-02-17T11:53:30.008 INFO:tasks.rados.rados.0.trial142.stdout:1245: oid 37 version 694 is already newer than 691 2026-02-17T11:53:30.008 INFO:tasks.rados.rados.0.trial142.stdout:1245: oid 37 version 694 is already newer than 692 2026-02-17T11:53:30.008 INFO:tasks.rados.rados.0.trial142.stdout:1245: oid 37 version 694 is already newer than 693 2026-02-17T11:53:30.008 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 694 (ObjNum 451 snap 136 seq_num 451) dirty exists 2026-02-17T11:53:30.008 INFO:tasks.rados.rados.0.trial142.stdout:1245: left oid 37 (ObjNum 451 snap 136 seq_num 451) 2026-02-17T11:53:30.014 INFO:tasks.rados.rados.0.trial142.stdout:1246: finishing copy_from racing read to trial14245205-50 2026-02-17T11:53:30.015 INFO:tasks.rados.rados.0.trial142.stdout:1246: finishing copy_from to trial14245205-50 2026-02-17T11:53:30.015 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 642 (ObjNum 444 snap 134 seq_num 444) dirty exists 2026-02-17T11:53:30.210 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:53:30.210 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:30.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: get_monmap_and_config 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: monmap: 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:30.277153+0000 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:30.277153+0000 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:30.281 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 Processor -- start 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 -- start start 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: init 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 0x7fe98809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-b con 0x7fe9880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe98809dac0 0x7fe98809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-a con 0x7fe98809dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe98809ff40 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98806e140 con 0x7fe98809ff40 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe98809aed0 con 0x7fe98809dac0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe98809caa0 con 0x7fe9880a3bb0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe98e5c1640 10 monclient(hunting): authenticate will time out at 1097.895918s 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe987fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 0x7fe98809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.275+0000 7fe9877fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe98809dac0 0x7fe98809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 0x7fe98809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38654/0 (socket says 10.20.193.51:38654) 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 1 -- 10.20.193.51:0/3419056131 learned_addr learned my addr 10.20.193.51:0/3419056131 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): get_auth_request con 0x7fe9880a3bb0 auth_method 0 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): get_auth_request con 0x7fe98809dac0 auth_method 0 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient(hunting): handle_auth_done global_id 74496 payload 274 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 1 -- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 msgr2=0x7fe98809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 1 --2- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 0x7fe98809f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 1 -- 10.20.193.51:0/3419056131 >> v1:10.20.193.142:6789/0 conn(0x7fe98809ff40 legacy=0x7fe98813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 1 monclient: found mon.noname-a 2026-02-17T11:53:30.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.276+0000 7fe9877fe640 1 -- 10.20.193.51:0/3419056131 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98809ce60 con 0x7fe98809dac0 2026-02-17T11:53:30.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe9877fe640 1 -- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809dac0 msgr2=0x7fe98809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe9877fe640 1 --2- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809dac0 0x7fe98809fa00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe988069d60 tx=0x7fe97802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80f098146387bdd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 1 -- 10.20.193.51:0/3419056131 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97803c070 con 0x7fe98809dac0 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: dump: 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 1 -- 10.20.193.51:0/3419056131 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97802fc60 con 0x7fe98809dac0 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe98e5c1640 5 monclient: authenticate success, global_id 74496 2026-02-17T11:53:30.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe98e5c1640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 1 -- 10.20.193.51:0/3419056131 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978037660 con 0x7fe98809dac0 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe98e5c1640 4 set_mon_vals no callback set 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.278+0000 7fe986ffd640 10 monclient: dump: 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.295 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 10 monclient: shutdown 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809dac0 msgr2=0x7fe98809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809dac0 0x7fe98809fa00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe988069d60 tx=0x7fe97802ede0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- 10.20.193.51:0/3419056131 shutdown_connections 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809dac0 0x7fe98809fa00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/3419056131 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe9880a3bb0 0x7fe98809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- 10.20.193.51:0/3419056131 >> 10.20.193.51:0/3419056131 conn(0x7fe9880a30c0 msgr2=0x7fe9880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- 10.20.193.51:0/3419056131 shutdown_connections 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- 10.20.193.51:0/3419056131 wait complete. 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 10 monclient: monmap: 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.297 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 Processor -- start 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 1 -- start start 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.279+0000 7fe98e5c1640 10 monclient: init 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe98809dac0 0x7fe9881bd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-c con 0x7fe98809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-a con 0x7fe98809ff40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 0x7fe9881b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): picked mon.noname-b con 0x7fe9880a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe98809a880 con 0x7fe98809ff40 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe9880a0350 con 0x7fe9880a3bb0 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe9880a04d0 con 0x7fe98809dac0 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98e5c1640 10 monclient(hunting): authenticate will time out at 1097.900172s 2026-02-17T11:53:30.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45218/0 (socket says 10.20.193.51:45218) 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 -- 10.20.193.51:0/830771670 learned_addr learned my addr 10.20.193.51:0/830771670 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): get_auth_request con 0x7fe98809ff40 auth_method 0 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe98809dac0 0x7fe9881bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): get_auth_request con 0x7fe98809dac0 auth_method 0 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe987fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient(hunting): handle_auth_done global_id 74499 payload 824 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 -- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe98809dac0 msgr2=0x7fe9881bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe98809dac0 0x7fe9881bd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 -- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 msgr2=0x7fe9881b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98cb37640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 0x7fe9881b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 0x7fe9881b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 monclient: found mon.noname-a 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe9877fe640 1 -- 10.20.193.51:0/830771670 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98809d7e0 con 0x7fe98809ff40 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98cb37640 10 monclient: get_auth_request con 0x7fe9880a3bb0 auth_method 0 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.280+0000 7fe98cb37640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 0x7fe9881b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe9877fe640 1 -- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 msgr2=0x7fe9881b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe9877fe640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe978002410 tx=0x7fe9780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97803c040 con 0x7fe98809ff40 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: dump: 2026-02-17T11:53:30.302 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978047070 con 0x7fe98809ff40 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978040a60 con 0x7fe98809ff40 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe9867fc640 4 set_mon_vals no callback set 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe984ff9640 10 monclient: dump: 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 5 monclient: authenticate success, global_id 74499 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 10 monclient: _renew_subs 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9881bc6f0 con 0x7fe98809ff40 2026-02-17T11:53:30.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 10 monclient: _renew_subs 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.282+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98808d3f0 con 0x7fe98809ff40 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe98e5c1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe98e5c1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe98e5c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98809e490 con 0x7fe98809ff40 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe97803f030 con 0x7fe98809ff40 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe984ff9640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 0x7fe9580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7fe978077880 con 0x7fe98809ff40 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe987fff640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 0x7fe9580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.283+0000 7fe987fff640 10 monclient: get_auth_request con 0x7fe95803dd10 auth_method 0 2026-02-17T11:53:30.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.285+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe98809d7e0 con 0x7fe98809ff40 2026-02-17T11:53:30.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.285+0000 7fe984ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.285+0000 7fe984ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:30.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.286+0000 7fe987fff640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 0x7fe9580401d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe974006dc0 tx=0x7fe974009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe98e5c1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:30.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe98e5c1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe98e5c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9880a2dc0 con 0x7fe98809ff40 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe984ff9640 1 -- 10.20.193.51:0/830771670 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe978035d70 con 0x7fe98809ff40 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe984ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.399+0000 7fe984ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:30.403 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:30.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 msgr2=0x7fe9580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 0x7fe9580401d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe974006dc0 tx=0x7fe974009340 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 10 monclient: shutdown 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 msgr2=0x7fe9881b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe978002410 tx=0x7fe9780047c0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 shutdown_connections 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe95803dd10 0x7fe9580401d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe9880a3bb0 0x7fe9881b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe98809ff40 0x7fe9881b8f10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 --2- 10.20.193.51:0/830771670 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe98809dac0 0x7fe9881bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 >> 10.20.193.51:0/830771670 conn(0x7fe9880a30c0 msgr2=0x7fe98809e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 shutdown_connections 2026-02-17T11:53:30.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.400+0000 7fe98e5c1640 1 -- 10.20.193.51:0/830771670 wait complete. 2026-02-17T11:53:30.411 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:53:30.411 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:53:30.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:53:30.411 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:53:30.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.473+0000 7f1282eca640 10 monclient: get_monmap_and_config 2026-02-17T11:53:30.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.473+0000 7f1282eca640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.473+0000 7f1282eca640 10 monclient: monmap: 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:30.475665+0000 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:30.475665+0000 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:30.479 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 Processor -- start 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 -- start start 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient: init 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 0x7f127c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-c con 0x7f127c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:30.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f127c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f127c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-b con 0x7f127c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c06e140 con 0x7f127c0a0750 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f127c09f910 con 0x7f127c0a3bb0 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f127c09ccd0 con 0x7f127c13b760 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1282eca640 10 monclient(hunting): authenticate will time out at 1098.094428s 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1273fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f127c0a0750 0x7f127c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44146/0 (socket says 10.20.193.51:44146) 2026-02-17T11:53:30.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1273fff640 1 -- 10.20.193.51:0/981523707 learned_addr learned my addr 10.20.193.51:0/981523707 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f127c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 10 monclient(hunting): get_auth_request con 0x7f127c13b760 auth_method 0 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1280c3f640 1 --2- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 0x7f127c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 msgr2=0x7f127c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 msgr2=0x7f127c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f127c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1280c3f640 1 -- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 msgr2=0x7f127c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1280c3f640 1 -- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 msgr2=0x7f127c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1280c3f640 1 --2- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 0x7f127c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:30.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1280c3f640 1 --2- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 0x7f127c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:30.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.474+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f127c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f1273fff640 1 -- 10.20.193.51:0/981523707 >> v1:10.20.193.51:6789/0 conn(0x7f127c0a0750 legacy=0x7f127c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809608201 0 0) 0x7f127c06e140 con 0x7f127c0a0750 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): _negotiate 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): my global_id is 74502 2026-02-17T11:53:30.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1268003620 con 0x7f127c0a0750 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1620041452 0 0) 0x7f1268003620 con 0x7f127c0a0750 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 msgr2=0x7f127c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f127c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 msgr2=0x7f127c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 --2- 10.20.193.51:0/981523707 >> v2:10.20.193.142:3300/0 conn(0x7f127c0a3bb0 0x7f127c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c09eec0 con 0x7f127c0a0750 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f12640031a0 con 0x7f127c0a0750 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f1282eca640 5 monclient: authenticate success, global_id 74502 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f1282eca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: dump: 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.498 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 >> v1:10.20.193.51:6789/0 conn(0x7f127c0a0750 legacy=0x7f127c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f1268003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): picked mon.c con 0x7f127c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1268004250 0x7f1268004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 10 monclient(hunting): picked mon.b con 0x7f1268004250 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.476+0000 7f12737fe640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 0x7f126800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): picked mon.a con 0x7f1268005040 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f127c09f910 con 0x7f1268005040 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f127c09ccd0 con 0x7f1268004250 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f126800c000 con 0x7f127c13b760 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f12737fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1282eca640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f1268003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): get_auth_request con 0x7f127c13b760 auth_method 0 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 0x7f126800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): get_auth_request con 0x7f1268005040 auth_method 0 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1273fff640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1268004250 0x7f1268004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1273fff640 10 monclient(hunting): get_auth_request con 0x7f1268004250 auth_method 0 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1273fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1273fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1273fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient(hunting): handle_auth_done global_id 74502 payload 293 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 msgr2=0x7f1268003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f1268003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1268004250 msgr2=0x7f1268004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1268004250 0x7f1268004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 monclient: found mon.a 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1268003620 con 0x7f1268005040 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1281440640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.477+0000 7f1280c3f640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c13b760 0x7f1268003bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 msgr2=0x7f126800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f1281440640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 0x7f126800bac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1278009610 tx=0x7f127802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6354dbb3263d1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127803b070 con 0x7f1268005040 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: dump: 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.504 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f1282eca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278034710 con 0x7f1268005040 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 1 -- 10.20.193.51:0/981523707 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278009bd0 con 0x7f1268005040 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f12737fe640 10 monclient: dump: 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.505 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f1282eca640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.479+0000 7f1282eca640 4 set_mon_vals no callback set 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 10 monclient: shutdown 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 -- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 msgr2=0x7f126800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 --2- 10.20.193.51:0/981523707 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1268005040 0x7f126800bac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1278009610 tx=0x7f127802f710 comp rx=0 tx=0).stop 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1281440640 1 -- 10.20.193.51:0/981523707 reap_dead start 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 -- 10.20.193.51:0/981523707 shutdown_connections 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 -- 10.20.193.51:0/981523707 >> 10.20.193.51:0/981523707 conn(0x7f127c0a30c0 msgr2=0x7f127c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 -- 10.20.193.51:0/981523707 shutdown_connections 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 1 -- 10.20.193.51:0/981523707 wait complete. 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.480+0000 7f1282eca640 10 monclient: monmap: 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.507 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 Processor -- start 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 -- start start 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient: init 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c1cfad0 0x7f127c1cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-c con 0x7f127c1cfad0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f127c1d03f0 0x7f127c096230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-b con 0x7f127c1d03f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 0x7f127c096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): picked mon.noname-a con 0x7f127c096770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0a04b0 con 0x7f127c096770 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f127c09c850 con 0x7f127c1d03f0 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f127c09e710 con 0x7f127c1cfad0 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1282eca640 10 monclient(hunting): authenticate will time out at 1098.101334s 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 0x7f127c096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c1cfad0 0x7f127c1cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 0x7f127c096bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45240/0 (socket says 10.20.193.51:45240) 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 learned_addr learned my addr 10.20.193.51:0/1294894901 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): get_auth_request con 0x7f127c096770 auth_method 0 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): get_auth_request con 0x7f127c1cfad0 auth_method 0 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1273fff640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f127c1d03f0 0x7f127c096230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1273fff640 10 monclient(hunting): get_auth_request con 0x7f127c1d03f0 auth_method 0 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1273fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1273fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1273fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient(hunting): handle_auth_done global_id 74505 payload 824 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c1cfad0 msgr2=0x7f127c1cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c1cfad0 0x7f127c1cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f127c1d03f0 msgr2=0x7f127c096230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f127c1d03f0 0x7f127c096230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 monclient: found mon.noname-a 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c099e00 con 0x7f127c096770 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.481+0000 7f1280c3f640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f127c1cfad0 0x7f127c1cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 msgr2=0x7f127c096bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1281440640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 0x7f127c096bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f127802fc20 tx=0x7f1278004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278045030 con 0x7f127c096770 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: dump: 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278034510 con 0x7f127c096770 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127803b040 con 0x7f127c096770 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f12717fa640 10 monclient: dump: 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.513 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1272ffd640 4 set_mon_vals no callback set 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 5 monclient: authenticate success, global_id 74505 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 10 monclient: _renew_subs 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c098290 con 0x7f127c096770 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 10 monclient: _renew_subs 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.483+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c0a2140 con 0x7f127c096770 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1282eca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1282eca640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 0x7f127c092a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f127c099480 con 0x7f127c097130 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 0x7f127c092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient: get_auth_request con 0x7f127c097130 auth_method 0 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1278036830 con 0x7f127c096770 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 10 monclient(hunting): handle_auth_done global_id 74508 payload 824 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1280c3f640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f127c09d7b0 con 0x7f127c097130 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f12717fa640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 0x7f124c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7f12780778c0 con 0x7f127c096770 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1273fff640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 0x7f124c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.484+0000 7f1273fff640 10 monclient: get_auth_request con 0x7f124c03dd10 auth_method 0 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.485+0000 7f1273fff640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 msgr2=0x7f124c0401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.485+0000 7f1273fff640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 msgr2=0x7f124c0401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.485+0000 7f1273fff640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 0x7f124c0401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.485+0000 7f1273fff640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 0x7f124c0401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f1280c3f640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 msgr2=0x7f127c092a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f1280c3f640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 0x7f127c092a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c010750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c00a690 con 0x7f127c097130 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f12717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f12717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.486+0000 7f12717fa640 10 monclient: dump: 2026-02-17T11:53:30.515 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f126c014a30 con 0x7f127c097130 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 msgr2=0x7f127c092a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 0x7f127c092a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c010750 comp rx=0 tx=0).stop 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 msgr2=0x7f127c092a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.487+0000 7f12717fa640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c097130 0x7f127c092a80 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c010750 comp rx=0 tx=0).stop 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1282eca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:30.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1282eca640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 0x7f127c063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1282eca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f127c097e50 con 0x7f127c0638c0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 0x7f127c063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient: get_auth_request con 0x7f127c0638c0 auth_method 0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 10 monclient(hunting): handle_auth_done global_id 74511 payload 824 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.490+0000 7f1280c3f640 1 -- 10.20.193.51:0/1294894901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f127c0a2910 con 0x7f127c0638c0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1280c3f640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 msgr2=0x7f127c063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1280c3f640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 0x7f127c063cd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c003230 con 0x7f127c0638c0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 10 monclient: dump: 2026-02-17T11:53:30.517 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f126c003230 con 0x7f127c0638c0 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 msgr2=0x7f127c063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 0x7f127c063cd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c004830 comp rx=0 tx=0).stop 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 msgr2=0x7f127c063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f12717fa640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c0638c0 0x7f127c063cd0 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c004830 comp rx=0 tx=0).stop 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 228424, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.519 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.520 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:30.521 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.522 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:30.523 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.524 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:30.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 msgr2=0x7f124c0401d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f124c03dd10 0x7f124c0401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 10 monclient: shutdown 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 msgr2=0x7f127c096bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 --2- 10.20.193.51:0/1294894901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f127c096770 0x7f127c096bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f127802fc20 tx=0x7f1278004bb0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 reap_dead start 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1281440640 1 -- 10.20.193.51:0/1294894901 reap_dead start 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 shutdown_connections 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 >> 10.20.193.51:0/1294894901 conn(0x7f127c0a30c0 msgr2=0x7f127c13ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 shutdown_connections 2026-02-17T11:53:30.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.492+0000 7f1282eca640 1 -- 10.20.193.51:0/1294894901 wait complete. 2026-02-17T11:53:30.528 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:30.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:53:30.528 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:53:30.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.591+0000 7fee0bf14640 10 monclient: get_monmap_and_config 2026-02-17T11:53:30.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.591+0000 7fee0bf14640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.591+0000 7fee0bf14640 10 monclient: monmap: 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:30.593828+0000 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:30.593828+0000 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 Processor -- start 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 -- start start 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient: init 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fee040a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fee040a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fee0413c770 0x7fee0413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-c con 0x7fee0413c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0409e8e0 con 0x7fee040a0750 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0406e140 con 0x7fee040a3bb0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fee0409f910 con 0x7fee0413c770 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0bf14640 10 monclient(hunting): authenticate will time out at 1098.212625s 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee09488640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fee040a0750 0x7fee0409e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44148/0 (socket says 10.20.193.51:44148) 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee09488640 1 -- 10.20.193.51:0/2509473451 learned_addr learned my addr 10.20.193.51:0/2509473451 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2509473451 >> v2:10.20.193.142:3300/0 conn(0x7fee0413c770 0x7fee0413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0a48a640 10 monclient(hunting): get_auth_request con 0x7fee0413c770 auth_method 0 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0a48a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0a48a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.592+0000 7fee0a48a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee09488640 1 -- 10.20.193.51:0/2509473451 >> v1:10.20.193.51:6789/0 conn(0x7fee040a0750 legacy=0x7fee0409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee09c89640 1 -- 10.20.193.51:0/2509473451 >> v1:10.20.193.142:6789/0 conn(0x7fee040a3bb0 legacy=0x7fee0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451187122 0 0) 0x7fee0409e8e0 con 0x7fee040a0750 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 10 monclient(hunting): _negotiate 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 10 monclient(hunting): my global_id is 74514 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec003620 con 0x7fee040a0750 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.594+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999216127 0 0) 0x7fee0406e140 con 0x7fee040a3bb0 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): _negotiate 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): my global_id is 114112 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee0409e8e0 con 0x7fee040a3bb0 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 406489378 0 0) 0x7fedec003620 con 0x7fee040a0750 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 >> v2:10.20.193.142:3300/0 conn(0x7fee0413c770 msgr2=0x7fee0413eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 --2- 10.20.193.51:0/2509473451 >> v2:10.20.193.142:3300/0 conn(0x7fee0413c770 0x7fee0413eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 >> v1:10.20.193.142:6789/0 conn(0x7fee040a3bb0 legacy=0x7fee0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0409ccd0 con 0x7fee040a0750 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fedf80031b0 con 0x7fee040a0750 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0bf14640 5 monclient: authenticate success, global_id 74514 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: dump: 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 >> v1:10.20.193.51:6789/0 conn(0x7fee040a0750 legacy=0x7fee0409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 0x7fedec004180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): picked mon.a con 0x7fedec003d80 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedec004900 0x7fedec004d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): picked mon.b con 0x7fedec004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec005470 0x7fedec00bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): picked mon.c con 0x7fedec005470 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fee0409f910 con 0x7fedec003d80 2026-02-17T11:53:30.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fedec00c3c0 con 0x7fedec004900 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fedec00c5c0 con 0x7fedec005470 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee08c87640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0bf14640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2509473451 >> v2:10.20.193.142:3300/0 conn(0x7fee0413c770 0x7fee0413eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 0x7fedec004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): get_auth_request con 0x7fedec003d80 auth_method 0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec005470 0x7fedec00bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09488640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedec004900 0x7fedec004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): get_auth_request con 0x7fedec005470 auth_method 0 2026-02-17T11:53:30.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09488640 10 monclient(hunting): get_auth_request con 0x7fedec004900 auth_method 0 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09488640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09488640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09488640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient(hunting): handle_auth_done global_id 74514 payload 293 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 -- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec005470 msgr2=0x7fedec00bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec005470 0x7fedec00bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 -- 10.20.193.51:0/2509473451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedec004900 msgr2=0x7fedec004d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fedec004900 0x7fedec004d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 monclient: found mon.a 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 1 -- 10.20.193.51:0/2509473451 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec003620 con 0x7fedec003d80 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee0a48a640 1 -- 10.20.193.51:0/2509473451 reap_dead start 2026-02-17T11:53:30.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.595+0000 7fee09c89640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.597+0000 7fee09c89640 1 -- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 msgr2=0x7fedec004180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.597+0000 7fee09c89640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 0x7fedec004180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fedf4002d30 tx=0x7fedf402f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109843c636b23be8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007a60 con 0x7fedec003d80 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: dump: 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4033030 con 0x7fedec003d80 2026-02-17T11:53:30.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 1 -- 10.20.193.51:0/2509473451 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf402fd90 con 0x7fedec003d80 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee08c87640 10 monclient: dump: 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:30.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 4 set_mon_vals no callback set 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 10 monclient: shutdown 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 -- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 msgr2=0x7fedec004180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 0x7fedec004180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fedf4002d30 tx=0x7fedf402f170 comp rx=0 tx=0).stop 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 -- 10.20.193.51:0/2509473451 shutdown_connections 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2509473451 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fedec003d80 0x7fedec004180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 -- 10.20.193.51:0/2509473451 >> 10.20.193.51:0/2509473451 conn(0x7fee040a30c0 msgr2=0x7fee040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 -- 10.20.193.51:0/2509473451 shutdown_connections 2026-02-17T11:53:30.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 1 -- 10.20.193.51:0/2509473451 wait complete. 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.598+0000 7fee0bf14640 10 monclient: monmap: 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 Processor -- start 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 -- start start 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient: init 2026-02-17T11:53:30.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 0x7fee041cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-c con 0x7fedec003d80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fee041d0010 0x7fee04094490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-b con 0x7fee041d0010 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 0x7fee040949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): picked mon.noname-a con 0x7fee041d03f0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fee0409c850 con 0x7fee041d03f0 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fee0409ebe0 con 0x7fee041d0010 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fee040a04b0 con 0x7fedec003d80 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0bf14640 10 monclient(hunting): authenticate will time out at 1098.219595s 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 0x7fee040949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 0x7fee041cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 0x7fee040949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45274/0 (socket says 10.20.193.51:45274) 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 0x7fee041cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38698/0 (socket says 10.20.193.51:38698) 2026-02-17T11:53:30.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 1 -- 10.20.193.51:0/2514871694 learned_addr learned my addr 10.20.193.51:0/2514871694 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): get_auth_request con 0x7fee041d03f0 auth_method 0 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): get_auth_request con 0x7fedec003d80 auth_method 0 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient(hunting): handle_auth_done global_id 104258 payload 824 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fee041d0010 0x7fee04094490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fee041d0010 msgr2=0x7fee04094490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fee041d0010 0x7fee04094490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 msgr2=0x7fee040949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 0x7fee040949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 monclient: found mon.noname-c 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09c89640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee04097cc0 con 0x7fedec003d80 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fee041d03f0 0x7fee040949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09488640 10 monclient: get_auth_request con 0x7fee041d0010 auth_method 0 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.599+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fee041d0010 0x7fee04094490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.601+0000 7fee09c89640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 msgr2=0x7fee041cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.601+0000 7fee09c89640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 0x7fee041cfad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedec00c390 tx=0x7fedf4002ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007a40 con 0x7fedec003d80 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: dump: 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.616 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4005ce0 con 0x7fedec003d80 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 5 monclient: authenticate success, global_id 104258 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 monclient: _renew_subs 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee040a2c90 con 0x7fedec003d80 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007270 con 0x7fedec003d80 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 10 monclient: dump: 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.617 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf3fff640 4 set_mon_vals no callback set 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 monclient: _renew_subs 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee040979e0 con 0x7fedec003d80 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 0x7fee040952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fee0409d7b0 con 0x7fee04094f10 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 0x7fee040952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient: get_auth_request con 0x7fee04094f10 auth_method 0 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fedf4007450 con 0x7fedec003d80 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 10 monclient(hunting): handle_auth_done global_id 104261 payload 824 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fee09488640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee040a2420 con 0x7fee04094f10 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.602+0000 7fedf27fc640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fedd403dd10 0x7fedd40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.603+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7fedf40763f0 con 0x7fedec003d80 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.603+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fedd403dd10 0x7fedd40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.603+0000 7fee0a48a640 10 monclient: get_auth_request con 0x7fedd403dd10 auth_method 0 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fee09488640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 msgr2=0x7fee040952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 0x7fee040952f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee0406b0c0 tx=0x7fedf80074f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8010040 con 0x7fee04094f10 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 10 monclient: dump: 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.619 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fedf8019070 con 0x7fee04094f10 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 msgr2=0x7fee040952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 0x7fee040952f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee0406b0c0 tx=0x7fedf80074f0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 msgr2=0x7fee040952f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fedf27fc640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee04094f10 0x7fee040952f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee0406b0c0 tx=0x7fedf80074f0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.605+0000 7fee0a48a640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fedd403dd10 0x7fedd40401d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee041d0840 tx=0x7fee0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee0bf14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 0x7fee041daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee0bf14640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fee04095f20 con 0x7fee0408d3f0 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 0x7fee041daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient: get_auth_request con 0x7fee0408d3f0 auth_method 0 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 10 monclient(hunting): handle_auth_done global_id 104264 payload 824 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.608+0000 7fee09488640 1 -- 10.20.193.51:0/2514871694 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fee0409db50 con 0x7fee0408d3f0 2026-02-17T11:53:30.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.610+0000 7fee09488640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 msgr2=0x7fee041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.610+0000 7fee09488640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 0x7fee041daad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee0409cc70 tx=0x7fedf8002b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf80146e0 con 0x7fee0408d3f0 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 10 monclient: dump: 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fedf80146e0 con 0x7fee0408d3f0 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 msgr2=0x7fee041daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 0x7fee041daad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee0409cc70 tx=0x7fedf8002b30 comp rx=0 tx=0).stop 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 msgr2=0x7fee041daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fedf27fc640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fee0408d3f0 0x7fee041daad0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee0409cc70 tx=0x7fedf8002b30 comp rx=0 tx=0).stop 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 75576, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.623 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.624 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:30.625 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:30.626 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:30.627 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.628 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.629 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:30.630 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fedd403dd10 msgr2=0x7fedd40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fedd403dd10 0x7fedd40401d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee041d0840 tx=0x7fee0000b040 comp rx=0 tx=0).stop 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 10 monclient: shutdown 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 msgr2=0x7fee041cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 --2- 10.20.193.51:0/2514871694 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fedec003d80 0x7fee041cfad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedec00c390 tx=0x7fedf4002ec0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0a48a640 1 -- 10.20.193.51:0/2514871694 reap_dead start 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0a48a640 1 -- 10.20.193.51:0/2514871694 reap_dead start 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 shutdown_connections 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 >> 10.20.193.51:0/2514871694 conn(0x7fee040a30c0 msgr2=0x7fee0413bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 shutdown_connections 2026-02-17T11:53:30.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.611+0000 7fee0bf14640 1 -- 10.20.193.51:0/2514871694 wait complete. 2026-02-17T11:53:30.632 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:30.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:53:30.632 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:53:30.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 10 monclient: get_monmap_and_config 2026-02-17T11:53:30.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 10 monclient: monmap: 2026-02-17T11:53:30.699 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.699 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:30.698502+0000 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:30.698502+0000 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 1 Processor -- start 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 1 -- start start 2026-02-17T11:53:30.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.696+0000 7f911ecbf640 10 monclient: init 2026-02-17T11:53:30.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2026-02-17T11:53:30.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f91180a3bb0 0x7f911809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-c con 0x7f91180a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:30.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91180a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-b con 0x7f911813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911806e140 con 0x7f91180a0750 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f911809f910 con 0x7f91180a3bb0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f911809ccd0 con 0x7f911813b760 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ecbf640 10 monclient(hunting): authenticate will time out at 1098.317257s 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38730/0 (socket says 10.20.193.51:38730) 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 -- 10.20.193.51:0/2470410305 learned_addr learned my addr 10.20.193.51:0/2470410305 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): get_auth_request con 0x7f911813b760 auth_method 0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ca34640 1 --2- 10.20.193.51:0/2470410305 >> v2:10.20.193.142:3300/0 conn(0x7f91180a3bb0 0x7f911809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ca34640 10 monclient(hunting): get_auth_request con 0x7f91180a3bb0 auth_method 0 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ca34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ca34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911ca34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient(hunting): handle_auth_done global_id 104267 payload 274 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 -- 10.20.193.51:0/2470410305 >> v2:10.20.193.142:3300/0 conn(0x7f91180a3bb0 msgr2=0x7f911809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 --2- 10.20.193.51:0/2470410305 >> v2:10.20.193.142:3300/0 conn(0x7f91180a3bb0 0x7f911809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 -- 10.20.193.51:0/2470410305 >> v1:10.20.193.142:6789/0 conn(0x7f91180a0750 legacy=0x7f911809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 monclient: found mon.noname-b 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.697+0000 7f911d235640 1 -- 10.20.193.51:0/2470410305 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911809eec0 con 0x7f911813b760 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.699+0000 7f911d235640 1 -- 10.20.193.51:0/2470410305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 msgr2=0x7f911813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911d235640 1 --2- 10.20.193.51:0/2470410305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f911806c1c0 tx=0x7f911402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698bc40a87b9bf0b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 1 -- 10.20.193.51:0/2470410305 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911402fe60 con 0x7f911813b760 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:53:30.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: dump: 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 1 -- 10.20.193.51:0/2470410305 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91140373f0 con 0x7f911813b760 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 5 monclient: authenticate success, global_id 104267 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 4 set_mon_vals no callback set 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 1 -- 10.20.193.51:0/2470410305 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140377c0 con 0x7f911813b760 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f910f7fe640 10 monclient: dump: 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 10 monclient: shutdown 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 -- 10.20.193.51:0/2470410305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 msgr2=0x7f911813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 --2- 10.20.193.51:0/2470410305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f911806c1c0 tx=0x7f911402f230 comp rx=0 tx=0).stop 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 -- 10.20.193.51:0/2470410305 shutdown_connections 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 --2- 10.20.193.51:0/2470410305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f911813b760 0x7f911813db50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 --2- 10.20.193.51:0/2470410305 >> v2:10.20.193.142:3300/0 conn(0x7f91180a3bb0 0x7f911809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 -- 10.20.193.51:0/2470410305 >> 10.20.193.51:0/2470410305 conn(0x7f91180a30c0 msgr2=0x7f91180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 -- 10.20.193.51:0/2470410305 shutdown_connections 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 1 -- 10.20.193.51:0/2470410305 wait complete. 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.700+0000 7f911ecbf640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient: monmap: 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 Processor -- start 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 -- start start 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient: init 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91180a0750 0x7f9118139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-b con 0x7f91180a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 0x7f911813a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-c con 0x7f91180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f911813b760 0x7f9118096420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): picked mon.noname-a con 0x7f911813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f91180a04b0 con 0x7f911813b760 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f911809c850 con 0x7f91180a0750 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f911809e710 con 0x7f91180a3bb0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ecbf640 10 monclient(hunting): authenticate will time out at 1098.321567s 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 0x7f911813a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 0x7f911813a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38734/0 (socket says 10.20.193.51:38734) 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 -- 10.20.193.51:0/4144264146 learned_addr learned my addr 10.20.193.51:0/4144264146 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): get_auth_request con 0x7f91180a3bb0 auth_method 0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f911813b760 0x7f9118096420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): get_auth_request con 0x7f911813b760 auth_method 0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91180a0750 0x7f9118139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): get_auth_request con 0x7f91180a0750 auth_method 0 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911d235640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient(hunting): handle_auth_done global_id 104270 payload 824 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91180a0750 msgr2=0x7f9118139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91180a0750 0x7f9118139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f911813b760 msgr2=0x7f9118096420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f911813b760 0x7f9118096420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 monclient: found mon.noname-c 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.701+0000 7f910ffff640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911809a330 con 0x7f91180a3bb0 2026-02-17T11:53:30.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.703+0000 7f910ffff640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 msgr2=0x7f911813a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.703+0000 7f910ffff640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 0x7f911813a010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f910000c5d0 tx=0x7f910000caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100016020 con 0x7f91180a3bb0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: dump: 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9100012a60 con 0x7f91180a3bb0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100012e50 con 0x7f91180a3bb0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:53:30.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910effd640 4 set_mon_vals no callback set 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 10 monclient: dump: 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 5 monclient: authenticate success, global_id 104270 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 monclient: _renew_subs 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9118074140 con 0x7f91180a3bb0 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 monclient: _renew_subs 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91180a2490 con 0x7f91180a3bb0 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 0x7f9118097120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9118070640 con 0x7f9118099c60 2026-02-17T11:53:30.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ca34640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 0x7f9118097120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ca34640 10 monclient: get_auth_request con 0x7f9118099c60 auth_method 0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ca34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ca34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f911ca34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.704+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f910001b400 con 0x7f91180a3bb0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f910d7fa640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f90e803df00 0x7f90e80403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7f9100052690 con 0x7f91180a3bb0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911ca34640 10 monclient(hunting): handle_auth_done global_id 114121 payload 824 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911ca34640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f911809dac0 con 0x7f9118099c60 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911d235640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f90e803df00 0x7f90e80403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.705+0000 7f911d235640 10 monclient: get_auth_request con 0x7f90e803df00 auth_method 0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f911ca34640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 msgr2=0x7f9118097120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f911ca34640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 0x7f9118097120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108011d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910800f040 con 0x7f9118099c60 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 10 monclient: dump: 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.715 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f910800fe50 con 0x7f9118099c60 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 msgr2=0x7f9118097120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 0x7f9118097120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108011d00 comp rx=0 tx=0).stop 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 msgr2=0x7f9118097120 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.707+0000 7f910d7fa640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9118099c60 0x7f9118097120 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108011d00 comp rx=0 tx=0).stop 2026-02-17T11:53:30.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.708+0000 7f911d235640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f90e803df00 0x7f90e80403c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f911806f3c0 tx=0x7f9114033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ecbf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ecbf640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 0x7f91181dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ecbf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f911806d9a0 con 0x7f911808d3f0 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 0x7f91181dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient: get_auth_request con 0x7f911808d3f0 auth_method 0 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 10 monclient(hunting): handle_auth_done global_id 114124 payload 824 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.711+0000 7f911ca34640 1 -- 10.20.193.51:0/4144264146 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9118098690 con 0x7f911808d3f0 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.713+0000 7f911ca34640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 msgr2=0x7f91181dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.713+0000 7f911ca34640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 0x7f91181dace0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108015660 con 0x7f911808d3f0 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 10 monclient: dump: 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.718 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f9108003e30 con 0x7f911808d3f0 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 msgr2=0x7f91181dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 0x7f91181dace0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108004830 comp rx=0 tx=0).stop 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 msgr2=0x7f91181dace0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f910d7fa640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f911808d3f0 0x7f91181dace0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9108011830 tx=0x7f9108004830 comp rx=0 tx=0).stop 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 64, 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12589, 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:30.719 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.720 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:30.721 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:30.722 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.723 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.724 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:30.725 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f90e803df00 msgr2=0x7f90e80403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f90e803df00 0x7f90e80403c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f911806f3c0 tx=0x7f9114033000 comp rx=0 tx=0).stop 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 10 monclient: shutdown 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 msgr2=0x7f911813a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 --2- 10.20.193.51:0/4144264146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91180a3bb0 0x7f911813a010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f910000c5d0 tx=0x7f910000caa0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911d235640 1 -- 10.20.193.51:0/4144264146 reap_dead start 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911d235640 1 -- 10.20.193.51:0/4144264146 reap_dead start 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 shutdown_connections 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 >> 10.20.193.51:0/4144264146 conn(0x7f91180a30c0 msgr2=0x7f911813ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 shutdown_connections 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.714+0000 7f911ecbf640 1 -- 10.20.193.51:0/4144264146 wait complete. 2026-02-17T11:53:30.728 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:53:30.728 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:53:30.728 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:53:30.728 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:53:30.728 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:53:30.728 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:53:30.728 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:53:30.737 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:53:30.737 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:53:30.738 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.843+0000 7ff7180d3640 10 monclient: get_monmap_and_config 2026-02-17T11:53:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.843+0000 7ff7180d3640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.843+0000 7ff7180d3640 10 monclient: monmap: 2026-02-17T11:53:30.846 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:30.845701+0000 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:30.845701+0000 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:30.847 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 Processor -- start 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 -- start start 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient: init 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff7100a3bb0 0x7ff71009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-a con 0x7ff7100a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 0x7ff71009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-c con 0x7ff71009dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff71009ff40 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71006e140 con 0x7ff71009ff40 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff71009aed0 con 0x7ff7100a3bb0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff71009caa0 con 0x7ff71009dac0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff7180d3640 10 monclient(hunting): authenticate will time out at 1098.464482s 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff7100a3bb0 0x7ff71009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff7100a3bb0 0x7ff71009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45284/0 (socket says 10.20.193.51:45284) 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 -- 10.20.193.51:0/3643797734 learned_addr learned my addr 10.20.193.51:0/3643797734 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): get_auth_request con 0x7ff7100a3bb0 auth_method 0 2026-02-17T11:53:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient(hunting): handle_auth_done global_id 74523 payload 274 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 -- 10.20.193.51:0/3643797734 >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 msgr2=0x7ff71009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715647640 1 --2- 10.20.193.51:0/3643797734 >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 0x7ff71009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 --2- 10.20.193.51:0/3643797734 >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 0x7ff71009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 -- 10.20.193.51:0/3643797734 >> v1:10.20.193.142:6789/0 conn(0x7ff71009ff40 legacy=0x7ff71013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 monclient: found mon.noname-a 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715e48640 1 -- 10.20.193.51:0/3643797734 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71009ce60 con 0x7ff7100a3bb0 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715647640 10 monclient: get_auth_request con 0x7ff71009dac0 auth_method 0 2026-02-17T11:53:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.844+0000 7ff715647640 1 --2- 10.20.193.51:0/3643797734 >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 0x7ff71009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff715e48640 1 -- 10.20.193.51:0/3643797734 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff7100a3bb0 msgr2=0x7ff71009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff715e48640 1 --2- 10.20.193.51:0/3643797734 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff7100a3bb0 0x7ff71009f4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff71009cc20 tx=0x7ff70002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cfff375fba8816 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 1 -- 10.20.193.51:0/3643797734 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70003c070 con 0x7ff7100a3bb0 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: dump: 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 1 -- 10.20.193.51:0/3643797734 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70002fd70 con 0x7ff7100a3bb0 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 5 monclient: authenticate success, global_id 74523 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 1 -- 10.20.193.51:0/3643797734 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700037660 con 0x7ff7100a3bb0 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff714e46640 10 monclient: dump: 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 4 set_mon_vals no callback set 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 10 monclient: shutdown 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 -- 10.20.193.51:0/3643797734 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff7100a3bb0 msgr2=0x7ff71009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3643797734 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff7100a3bb0 0x7ff71009f4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff71009cc20 tx=0x7ff70002ee10 comp rx=0 tx=0).stop 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 -- 10.20.193.51:0/3643797734 shutdown_connections 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3643797734 >> v2:10.20.193.142:3300/0 conn(0x7ff71009dac0 0x7ff71009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3643797734 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff7100a3bb0 0x7ff71009f4c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 -- 10.20.193.51:0/3643797734 >> 10.20.193.51:0/3643797734 conn(0x7ff7100a30c0 msgr2=0x7ff7100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 -- 10.20.193.51:0/3643797734 shutdown_connections 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.847+0000 7ff7180d3640 1 -- 10.20.193.51:0/3643797734 wait complete. 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient: build_initial_monmap 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient: monmap: 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:30.855 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 Processor -- start 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 -- start start 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient: init 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff71009dac0 0x7ff710136d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-b con 0x7ff71009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-a con 0x7ff71009ff40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 0x7ff71013b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): picked mon.noname-c con 0x7ff7100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff7100a0370 con 0x7ff71009ff40 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff71009a880 con 0x7ff71009dac0 2026-02-17T11:53:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff7100a04f0 con 0x7ff7100a3bb0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff7180d3640 10 monclient(hunting): authenticate will time out at 1098.468808s 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff716649640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 msgr2=0x7ff71013b090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff716649640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 0x7ff71013b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45298/0 (socket says 10.20.193.51:45298) 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 1 -- 10.20.193.51:0/3175102137 learned_addr learned my addr 10.20.193.51:0/3175102137 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): get_auth_request con 0x7ff71009ff40 auth_method 0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715e48640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff71009dac0 0x7ff710136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715e48640 10 monclient(hunting): get_auth_request con 0x7ff71009dac0 auth_method 0 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715e48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715e48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715e48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 10 monclient(hunting): handle_auth_done global_id 74526 payload 824 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 1 -- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 msgr2=0x7ff71013b090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.848+0000 7ff715647640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 0x7ff71013b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 1 -- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff71009dac0 msgr2=0x7ff710136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff71009dac0 0x7ff710136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 10 monclient: _finish_hunting 0 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 1 monclient: found mon.noname-a 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.849+0000 7ff715647640 1 -- 10.20.193.51:0/3175102137 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71013cb70 con 0x7ff71009ff40 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff715647640 1 -- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 msgr2=0x7ff71013ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff715647640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c7a0 tx=0x7ff70400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704015070 con 0x7ff71009ff40 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: dump: 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.859 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: _finish_auth 0 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70400acd0 con 0x7ff71009ff40 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704011630 con 0x7ff71009ff40 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fffff640 4 set_mon_vals no callback set 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 10 monclient: dump: 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 5 monclient: authenticate success, global_id 74526 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _renew_subs 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71012bf80 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _renew_subs 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7100a11c0 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff7040117d0 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.851+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71009d7b0 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.852+0000 7ff6fe7fc640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 0x7ff6e00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.852+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7ff704052a60 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.852+0000 7ff715e48640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 0x7ff6e00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.852+0000 7ff715e48640 10 monclient: get_auth_request con 0x7ff6e003dd10 auth_method 0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.854+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff704054e20 con 0x7ff71009ff40 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.854+0000 7ff6fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.854+0000 7ff6fe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.855+0000 7ff715e48640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 0x7ff6e00401d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff700036000 tx=0x7ff700039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:30.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff7180d3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:30.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff7180d3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:30.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff7180d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:30.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff7101cb490 con 0x7ff71009ff40 2026-02-17T11:53:30.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff6fe7fc640 1 -- 10.20.193.51:0/3175102137 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7ff704019cb0 con 0x7ff71009ff40 2026-02-17T11:53:30.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff6fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:30.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.968+0000 7ff6fe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:30.972 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:30.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 msgr2=0x7ff6e00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 0x7ff6e00401d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff700036000 tx=0x7ff700039040 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 10 monclient: shutdown 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 msgr2=0x7ff71013ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c7a0 tx=0x7ff70400cc70 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 shutdown_connections 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e003dd10 0x7ff6e00401d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff7100a3bb0 0x7ff71013b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71009ff40 0x7ff71013ab50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 --2- 10.20.193.51:0/3175102137 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff71009dac0 0x7ff710136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 >> 10.20.193.51:0/3175102137 conn(0x7ff7100a30c0 msgr2=0x7ff710071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:30.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 shutdown_connections 2026-02-17T11:53:30.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:30.969+0000 7ff7180d3640 1 -- 10.20.193.51:0/3175102137 wait complete. 2026-02-17T11:53:33.980 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: get_monmap_and_config 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: build_initial_monmap 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: monmap: 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:34.050009+0000 2026-02-17T11:53:34.063 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:34.050009+0000 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 Processor -- start 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 -- start start 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: init 2026-02-17T11:53:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient: _add_conns ranks=[4,2,3,0,1] 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f48d40a3bb0 0x7f48d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-c con 0x7f48d40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-b con 0x7f48d40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48d409e540 0x7f48d413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-a con 0x7f48d409e540 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f48d40a3f90 con 0x7f48d409e540 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f48d406e140 con 0x7f48d40a3bb0 2026-02-17T11:53:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f48d409f910 con 0x7f48d40a0750 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d9b33640 10 monclient(hunting): authenticate will time out at 1101.668811s 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d2ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 msgr2=0x7f48d409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48d409e540 0x7f48d413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48d409e540 0x7f48d413c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45304/0 (socket says 10.20.193.51:45304) 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 1 -- 10.20.193.51:0/562174946 learned_addr learned my addr 10.20.193.51:0/562174946 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): get_auth_request con 0x7f48d409e540 auth_method 0 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.049+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d37fe640 1 --2- 10.20.193.51:0/562174946 >> v2:10.20.193.142:3300/0 conn(0x7f48d40a3bb0 0x7f48d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d37fe640 10 monclient(hunting): get_auth_request con 0x7f48d40a3bb0 auth_method 0 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 10 monclient(hunting): handle_auth_done global_id 74529 payload 274 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 -- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 msgr2=0x7f48d409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 --2- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 -- 10.20.193.51:0/562174946 >> v2:10.20.193.142:3300/0 conn(0x7f48d40a3bb0 msgr2=0x7f48d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 --2- 10.20.193.51:0/562174946 >> v2:10.20.193.142:3300/0 conn(0x7f48d40a3bb0 0x7f48d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 monclient: found mon.noname-a 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.050+0000 7f48d3fff640 1 -- 10.20.193.51:0/562174946 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d409ccd0 con 0x7f48d409e540 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d3fff640 1 -- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d409e540 msgr2=0x7f48d413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d3fff640 1 --2- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d409e540 0x7f48d413c760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48d406c1c0 tx=0x7f48c802f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4700ab75de173c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 1 -- 10.20.193.51:0/562174946 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80373f0 con 0x7f48d409e540 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: dump: 2026-02-17T11:53:34.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: _finish_auth 0 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:53:34.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 1 -- 10.20.193.51:0/562174946 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8037590 con 0x7f48d409e540 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d9b33640 5 monclient: authenticate success, global_id 74529 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d9b33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 1 -- 10.20.193.51:0/562174946 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8037960 con 0x7f48d409e540 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d9b33640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d9b33640 4 set_mon_vals no callback set 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.052+0000 7f48d27fc640 10 monclient: dump: 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:34.070 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: shutdown 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d409e540 msgr2=0x7f48d413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d409e540 0x7f48d413c760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48d406c1c0 tx=0x7f48c802f200 comp rx=0 tx=0).stop 2026-02-17T11:53:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- 10.20.193.51:0/562174946 shutdown_connections 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d409e540 0x7f48d413c760 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- 10.20.193.51:0/562174946 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- 10.20.193.51:0/562174946 >> v2:10.20.193.142:3300/0 conn(0x7f48d40a3bb0 0x7f48d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- 10.20.193.51:0/562174946 >> 10.20.193.51:0/562174946 conn(0x7f48d40a30c0 msgr2=0x7f48d40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- 10.20.193.51:0/562174946 shutdown_connections 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- 10.20.193.51:0/562174946 wait complete. 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: build_initial_monmap 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: monmap: 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:34.072 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 Processor -- start 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- start start 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: init 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:53:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48d409e540 0x7f48d41cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-b con 0x7f48d409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d4138f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-c con 0x7f48d40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): picked mon.noname-a con 0x7f48d40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f48d40a04b0 con 0x7f48d40a3bb0 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48d409c850 con 0x7f48d409e540 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f48d413cca0 con 0x7f48d40a0750 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.053+0000 7f48d9b33640 10 monclient(hunting): authenticate will time out at 1101.672997s 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d2ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 msgr2=0x7f48d4138f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d4138f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45306/0 (socket says 10.20.193.51:45306) 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 -- 10.20.193.51:0/1484114713 learned_addr learned my addr 10.20.193.51:0/1484114713 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): get_auth_request con 0x7f48d40a3bb0 auth_method 0 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient(hunting): handle_auth_done global_id 74532 payload 824 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 -- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 msgr2=0x7f48d4138f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d4138f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 -- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48d409e540 msgr2=0x7f48d41cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48d409e540 0x7f48d41cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 monclient: found mon.noname-a 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.054+0000 7f48d3fff640 1 -- 10.20.193.51:0/1484114713 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d409d7b0 con 0x7f48d40a3bb0 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d3fff640 1 -- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 msgr2=0x7f48d41cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d3fff640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009f50 tx=0x7f48c8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8046020 con 0x7f48d40a3bb0 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: dump: 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:34.077 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: _finish_auth 0 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: _check_auth_tickets 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8041870 con 0x7f48d40a3bb0 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 5 monclient: authenticate success, global_id 74532 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 10 monclient: _renew_subs 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d4134990 con 0x7f48d40a3bb0 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8041c80 con 0x7f48d40a3bb0 2026-02-17T11:53:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d1ffb640 4 set_mon_vals no callback set 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48affff640 10 monclient: dump: 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:34.079 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 10 monclient: _renew_subs 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.056+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d41356d0 con 0x7f48d40a3bb0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d9b33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d9b33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d9b33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f48c8042400 con 0x7f48d40a3bb0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d409dac0 con 0x7f48d40a3bb0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48affff640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 0x7f48a40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7f48c8078540 con 0x7f48d40a3bb0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d37fe640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 0x7f48a40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.057+0000 7f48d37fe640 10 monclient: get_auth_request con 0x7f48a403dd10 auth_method 0 2026-02-17T11:53:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.059+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f48c8050030 con 0x7f48d40a3bb0 2026-02-17T11:53:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.059+0000 7f48affff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.059+0000 7f48affff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.060+0000 7f48d37fe640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 0x7f48a40401d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006fd0 tx=0x7f48c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:34.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48d9b33640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:34.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48d9b33640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:34.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48d9b33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:34.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f48d40a2990 con 0x7f48d40a3bb0 2026-02-17T11:53:34.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48affff640 1 -- 10.20.193.51:0/1484114713 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f48c8041e20 con 0x7f48d40a3bb0 2026-02-17T11:53:34.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48affff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:34.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.173+0000 7f48affff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:34.176 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:34.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 msgr2=0x7f48a40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:34.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 0x7f48a40401d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006fd0 tx=0x7f48c0008040 comp rx=0 tx=0).stop 2026-02-17T11:53:34.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 10 monclient: shutdown 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 msgr2=0x7f48d41cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009f50 tx=0x7f48c8004b40 comp rx=0 tx=0).stop 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 shutdown_connections 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f48a403dd10 0x7f48a40401d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48d40a3bb0 0x7f48d41cf060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f48d40a0750 0x7f48d4138f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 --2- 10.20.193.51:0/1484114713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48d409e540 0x7f48d41cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 >> 10.20.193.51:0/1484114713 conn(0x7f48d40a30c0 msgr2=0x7f48d4072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 shutdown_connections 2026-02-17T11:53:34.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:34.174+0000 7f48d9b33640 1 -- 10.20.193.51:0/1484114713 wait complete. 2026-02-17T11:53:37.185 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:37.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: get_monmap_and_config 2026-02-17T11:53:37.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: build_initial_monmap 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: monmap: 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:37.254003+0000 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:37.254003+0000 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:37.255 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 Processor -- start 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 -- start start 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: init 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f65300a3bb0 0x7f653009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-c con 0x7f65300a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 0x7f653009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-b con 0x7f65300a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f653009e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653006e140 con 0x7f653009e540 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f65300a3f90 con 0x7f65300a3bb0 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:37.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f653009f910 con 0x7f65300a0750 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6536bde640 10 monclient(hunting): authenticate will time out at 1104.872806s 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6527fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 msgr2=0x7f653009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6527fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 0x7f653009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6535154640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f653009e540 0x7f653013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60176/0 (socket says 10.20.193.51:60176) 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6535154640 1 -- 10.20.193.51:0/324275512 learned_addr learned my addr 10.20.193.51:0/324275512 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6534953640 1 --2- 10.20.193.51:0/324275512 >> v2:10.20.193.142:3300/0 conn(0x7f65300a3bb0 0x7f653009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.253+0000 7f6534953640 10 monclient(hunting): get_auth_request con 0x7f65300a3bb0 auth_method 0 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient(hunting): handle_auth_done global_id 114133 payload 274 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 1 -- 10.20.193.51:0/324275512 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 msgr2=0x7f653009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 1 --2- 10.20.193.51:0/324275512 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 0x7f653009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 1 -- 10.20.193.51:0/324275512 >> v1:10.20.193.51:6789/0 conn(0x7f653009e540 legacy=0x7f653013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient: _finish_hunting 0 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 1 monclient: found mon.noname-c 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:53:37.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.254+0000 7f6534953640 1 -- 10.20.193.51:0/324275512 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653009ccd0 con 0x7f65300a3bb0 2026-02-17T11:53:37.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.256+0000 7f6534953640 1 -- 10.20.193.51:0/324275512 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a3bb0 msgr2=0x7f653009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:37.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.256+0000 7f6534953640 1 --2- 10.20.193.51:0/324275512 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a3bb0 0x7f653009dac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f653006c1c0 tx=0x7f652002ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450da948739455e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 1 -- 10.20.193.51:0/324275512 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652003c070 con 0x7f65300a3bb0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: dump: 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: _finish_auth 0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: _check_auth_tickets 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 1 -- 10.20.193.51:0/324275512 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652002fcd0 con 0x7f65300a3bb0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 5 monclient: authenticate success, global_id 114133 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 1 -- 10.20.193.51:0/324275512 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520037660 con 0x7f65300a3bb0 2026-02-17T11:53:37.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f65277fe640 10 monclient: dump: 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 4 set_mon_vals no callback set 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 10 monclient: shutdown 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- 10.20.193.51:0/324275512 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a3bb0 msgr2=0x7f653009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 --2- 10.20.193.51:0/324275512 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a3bb0 0x7f653009dac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f653006c1c0 tx=0x7f652002ed70 comp rx=0 tx=0).stop 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- 10.20.193.51:0/324275512 shutdown_connections 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 --2- 10.20.193.51:0/324275512 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65300a0750 0x7f653009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 --2- 10.20.193.51:0/324275512 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a3bb0 0x7f653009dac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- 10.20.193.51:0/324275512 >> 10.20.193.51:0/324275512 conn(0x7f65300a30c0 msgr2=0x7f65300a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- 10.20.193.51:0/324275512 shutdown_connections 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- 10.20.193.51:0/324275512 wait complete. 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 10 monclient: build_initial_monmap 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 10 monclient: monmap: 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:37.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:37.261 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.261 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:37.261 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:37.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:37.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 Processor -- start 2026-02-17T11:53:37.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 1 -- start start 2026-02-17T11:53:37.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.257+0000 7f6536bde640 10 monclient: init 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 0x7f6530138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-c con 0x7f653009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 0x7f65301393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-b con 0x7f65300a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): picked mon.noname-a con 0x7f65300a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f65300a04b0 con 0x7f65300a3bb0 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f653009c850 con 0x7f65300a0750 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f653013de80 con 0x7f653009e540 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6536bde640 10 monclient(hunting): authenticate will time out at 1104.877239s 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6534953640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 msgr2=0x7f6530138ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6534953640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 0x7f6530138ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:46702/0 (socket says 10.20.193.51:46702) 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 -- 10.20.193.51:0/4180490867 learned_addr learned my addr 10.20.193.51:0/4180490867 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): get_auth_request con 0x7f65300a3bb0 auth_method 0 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6527fff640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 0x7f65301393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:37.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient(hunting): handle_auth_done global_id 74535 payload 824 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 -- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 msgr2=0x7f6530138ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 0x7f6530138ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 -- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 msgr2=0x7f65301393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 0x7f65301393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient: _finish_hunting 0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 monclient: found mon.noname-a 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6535154640 1 -- 10.20.193.51:0/4180490867 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65300a2960 con 0x7f65300a3bb0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6527fff640 10 monclient: get_auth_request con 0x7f65300a0750 auth_method 0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.258+0000 7f6527fff640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 0x7f65301393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6535154640 1 -- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 msgr2=0x7f6530130be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6535154640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ca70 tx=0x7f652c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00ae50 con 0x7f65300a3bb0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: dump: 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: _finish_auth 0 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: _check_auth_tickets 2026-02-17T11:53:37.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652c012400 con 0x7f65300a3bb0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c0127d0 con 0x7f65300a3bb0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6526ffd640 4 set_mon_vals no callback set 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f65257fa640 10 monclient: dump: 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 5 monclient: authenticate success, global_id 74535 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 10 monclient: _renew_subs 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6530132600 con 0x7f65300a3bb0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 10 monclient: _renew_subs 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.260+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6530134380 con 0x7f65300a3bb0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6536bde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6536bde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6536bde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f652c012970 con 0x7f65300a3bb0 2026-02-17T11:53:37.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653009dac0 con 0x7f65300a3bb0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f65257fa640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 0x7f6500040320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(295..295 src has 167..295) ==== 4763+0+0 (secure 0 0 0) 0x7f652c052c60 con 0x7f65300a3bb0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6534953640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 0x7f6500040320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.261+0000 7f6534953640 10 monclient: get_auth_request con 0x7f650003de60 auth_method 0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.263+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f65300a2960 con 0x7f65300a3bb0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.263+0000 7f65257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.263+0000 7f65257fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:37.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.264+0000 7f6534953640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 0x7f6500040320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f653009f230 tx=0x7f6520033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f6536bde640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f6536bde640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f6536bde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6530132a40 con 0x7f65300a3bb0 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f65257fa640 1 -- 10.20.193.51:0/4180490867 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f652c051670 con 0x7f65300a3bb0 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f65257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:37.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.376+0000 7f65257fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:37.380 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 msgr2=0x7f6500040320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 0x7f6500040320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f653009f230 tx=0x7f6520033000 comp rx=0 tx=0).stop 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 10 monclient: shutdown 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 msgr2=0x7f6530130be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ca70 tx=0x7f652c00cf40 comp rx=0 tx=0).stop 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 shutdown_connections 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f650003de60 0x7f6500040320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65300a3bb0 0x7f6530130be0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65300a0750 0x7f65301393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 --2- 10.20.193.51:0/4180490867 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f653009e540 0x7f6530138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:37.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 >> 10.20.193.51:0/4180490867 conn(0x7f65300a30c0 msgr2=0x7f6530072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:37.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 shutdown_connections 2026-02-17T11:53:37.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:37.377+0000 7f6536bde640 1 -- 10.20.193.51:0/4180490867 wait complete. 2026-02-17T11:53:40.388 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:53:40.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: get_monmap_and_config 2026-02-17T11:53:40.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: build_initial_monmap 2026-02-17T11:53:40.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: monmap: 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:40.456256+0000 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:40.456256+0000 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:40.460 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 1 Processor -- start 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 1 -- start start 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: init 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-c con 0x7f6a600a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.455+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6a600a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:53:40.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-b con 0x7f6a6013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6006e140 con 0x7f6a600a0750 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6009f910 con 0x7f6a600a3bb0 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6009ccd0 con 0x7f6a6013b760 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a65c24640 10 monclient(hunting): authenticate will time out at 1108.075032s 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5ffff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 msgr2=0x7f6a6013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:40.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5effd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6a600a0750 0x7f6a6009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60184/0 (socket says 10.20.193.51:60184) 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5effd640 1 -- 10.20.193.51:0/3196078186 learned_addr learned my addr 10.20.193.51:0/3196078186 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a600a3bb0 auth_method 0 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:40.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:40.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.458+0000 7f6a5effd640 1 -- 10.20.193.51:0/3196078186 >> v1:10.20.193.51:6789/0 conn(0x7f6a600a0750 legacy=0x7f6a6009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:40.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5ffff640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 msgr2=0x7f6a6013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5ffff640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a600a3bb0 auth_method 0 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:40.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:40.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5ffff640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 msgr2=0x7f6a6013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5ffff640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a600a3bb0 auth_method 0 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:41.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:41.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5ffff640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 msgr2=0x7f6a6013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5ffff640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a600a3bb0 auth_method 0 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:41.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:41.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:41.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): tick 2026-02-17T11:53:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:43.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 msgr2=0x7f6a6013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a6013b760 0x7f6a6013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 msgr2=0x7f6a6009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.142:3300/0 conn(0x7f6a600a3bb0 0x7f6a6009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 -- 10.20.193.51:0/3196078186 >> v1:10.20.193.51:6789/0 conn(0x7f6a600a0750 legacy=0x7f6a6009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient: _add_conns ranks=[3,1] 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f6a3c003840 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6a3c006390 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 -- 10.20.193.51:0/3196078186 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6009eec0 con 0x7f6a3c006390 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:43.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 1 -- 10.20.193.51:0/3196078186 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6009f910 con 0x7f6a3c003840 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5d7fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a3c003840 auth_method 0 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:43.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.456+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:43.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.458+0000 7f6a5effd640 1 -- 10.20.193.51:0/3196078186 >> v1:10.20.193.142:6789/0 conn(0x7f6a3c006390 legacy=0x7f6a3c008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:43.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a3c003840 auth_method 0 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:43.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:43.657+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:44.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:44.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a3c003840 auth_method 0 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:44.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.058+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:44.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:44.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a3c003840 auth_method 0 2026-02-17T11:53:44.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:44.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:44.859+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:45.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318900018 0 0) 0x7f6a6009eec0 con 0x7f6a3c006390 2026-02-17T11:53:45.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): my global_id is 114136 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a44003620 con 0x7f6a3c006390 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2512868448 0 0) 0x7f6a44003620 con 0x7f6a3c006390 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 msgr2=0x7f6a3c005ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 --2- 10.20.193.51:0/3196078186 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c003840 0x7f6a3c005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:53:45.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c00b1c0 con 0x7f6a3c006390 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f6a50003180 con 0x7f6a3c006390 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: dump: 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.125 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:53:45.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 >> v1:10.20.193.142:6789/0 conn(0x7f6a3c006390 legacy=0x7f6a3c008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5ffff640 1 -- 10.20.193.51:0/3196078186 reap_dead start 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 0x7f6a44003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): picked mon.b con 0x7f6a44003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 0x7f6a44004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): picked mon.c con 0x7f6a44004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44005390 0x7f6a4400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): picked mon.a con 0x7f6a44005390 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:45.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6009f910 con 0x7f6a44005390 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4400c2e0 con 0x7f6a44003ab0 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4400c4e0 con 0x7f6a44004900 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5effd640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 msgr2=0x7f6a44004d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5effd640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 0x7f6a44004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 0x7f6a44003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6a44003ab0 auth_method 0 2026-02-17T11:53:45.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.119+0000 7f6a5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 10 monclient(hunting): handle_auth_done global_id 114136 payload 293 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 msgr2=0x7f6a44004d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 0x7f6a44004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44005390 msgr2=0x7f6a4400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44005390 0x7f6a4400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 monclient: found mon.b 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a44003620 con 0x7f6a44003ab0 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a65c24640 5 monclient: authenticate success, global_id 114136 2026-02-17T11:53:45.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.120+0000 7f6a65c24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:45.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5f7fe640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 msgr2=0x7f6a44003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 0x7f6a44003eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c003810 tx=0x7f6a4c030990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8a5b37eaaf7bf9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00f040 con 0x7f6a44003ab0 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a5e7fc640 10 monclient: dump: 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.137 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.122+0000 7f6a65c24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c03a670 con 0x7f6a44003ab0 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 1 -- 10.20.193.51:0/3196078186 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c03aa60 con 0x7f6a44003ab0 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a5e7fc640 10 monclient: dump: 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 4 set_mon_vals no callback set 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 10 monclient: shutdown 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 -- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 msgr2=0x7f6a44003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 0x7f6a44003eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c003810 tx=0x7f6a4c030990 comp rx=0 tx=0).stop 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 -- 10.20.193.51:0/3196078186 shutdown_connections 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44005390 0x7f6a4400bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44004900 0x7f6a44004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 --2- 10.20.193.51:0/3196078186 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44003ab0 0x7f6a44003eb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 -- 10.20.193.51:0/3196078186 >> 10.20.193.51:0/3196078186 conn(0x7f6a600a30c0 msgr2=0x7f6a600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 -- 10.20.193.51:0/3196078186 shutdown_connections 2026-02-17T11:53:45.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 1 -- 10.20.193.51:0/3196078186 wait complete. 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 10 monclient: build_initial_monmap 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.123+0000 7f6a65c24640 10 monclient: monmap: 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 Processor -- start 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 -- start start 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient: init 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 0x7f6a6009b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-c con 0x7f6a44003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-a con 0x7f6a44004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44005390 0x7f6a6013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): picked mon.noname-b con 0x7f6a44005390 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600a04b0 con 0x7f6a44004900 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6009c850 con 0x7f6a44005390 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6009dac0 con 0x7f6a44003ab0 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a65c24640 10 monclient(hunting): authenticate will time out at 1112.743469s 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5f7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 msgr2=0x7f6a6009b640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 0x7f6a6009b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59554/0 (socket says 10.20.193.51:59554) 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 -- 10.20.193.51:0/1539764202 learned_addr learned my addr 10.20.193.51:0/1539764202 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): get_auth_request con 0x7f6a44004900 auth_method 0 2026-02-17T11:53:45.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5ffff640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44005390 0x7f6a6013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5ffff640 10 monclient(hunting): get_auth_request con 0x7f6a44005390 auth_method 0 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient(hunting): handle_auth_done global_id 74538 payload 824 2026-02-17T11:53:45.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 -- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 msgr2=0x7f6a6009b640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 0x7f6a6009b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 -- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44005390 msgr2=0x7f6a6013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44005390 0x7f6a6013acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 monclient: found mon.noname-a 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.124+0000 7f6a5effd640 1 -- 10.20.193.51:0/1539764202 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6009abd0 con 0x7f6a44004900 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a5effd640 1 -- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 msgr2=0x7f6a6013a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a5effd640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c700 tx=0x7f6a5000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ce30 con 0x7f6a44004900 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a3bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.126+0000 7f6a3bfff640 10 monclient: dump: 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a50007110 con 0x7f6a44004900 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 5 monclient: authenticate success, global_id 74538 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _renew_subs 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6009aeb0 con 0x7f6a44004900 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a500074c0 con 0x7f6a44004900 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 10 monclient: dump: 2026-02-17T11:53:45.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a5dffb640 4 set_mon_vals no callback set 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _renew_subs 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a60074460 con 0x7f6a44004900 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6009eec0 con 0x7f6a44004900 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6a5000a5e0 con 0x7f6a44004900 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 0x7f6a30040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.127+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(296..296 src has 167..296) ==== 4735+0+0 (secure 0 0 0) 0x7f6a500526b0 con 0x7f6a44004900 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.128+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 0x7f6a30040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.128+0000 7f6a5f7fe640 10 monclient: get_auth_request con 0x7f6a3003dcc0 auth_method 0 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.130+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6a5001c9f0 con 0x7f6a44004900 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.130+0000 7f6a3bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.130+0000 7f6a3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:45.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.130+0000 7f6a5f7fe640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 0x7f6a30040180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006fb0 tx=0x7f6a4c035000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.243+0000 7f6a65c24640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.243+0000 7f6a65c24640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.243+0000 7f6a65c24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.243+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6a6009d790 con 0x7f6a44004900 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1539764202 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f6a5000a900 con 0x7f6a44004900 2026-02-17T11:53:45.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a3bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:53:45.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:45.247 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:53:45.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 msgr2=0x7f6a30040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 0x7f6a30040180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006fb0 tx=0x7f6a4c035000 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 10 monclient: shutdown 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 msgr2=0x7f6a6013a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c700 tx=0x7f6a5000cbd0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.244+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 shutdown_connections 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a3003dcc0 0x7f6a30040180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a44005390 0x7f6a6013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a44004900 0x7f6a6013a770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 --2- 10.20.193.51:0/1539764202 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a44003ab0 0x7f6a6009b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 >> 10.20.193.51:0/1539764202 conn(0x7f6a600a30c0 msgr2=0x7f6a60072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 shutdown_connections 2026-02-17T11:53:45.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.245+0000 7f6a65c24640 1 -- 10.20.193.51:0/1539764202 wait complete. 2026-02-17T11:53:45.255 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:53:45.255 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:53:45.256 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.322+0000 7f630cc64640 10 monclient: get_monmap_and_config 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.322+0000 7f630cc64640 10 monclient: build_initial_monmap 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.322+0000 7f630cc64640 10 monclient: monmap: 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:45.323853+0000 2026-02-17T11:53:45.327 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:45.323853+0000 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 Processor -- start 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 -- start start 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient: init 2026-02-17T11:53:45.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 0x7f630809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-b con 0x7f63080a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f63080a0750 0x7f630809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-a con 0x7f63080a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f630809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630806e140 con 0x7f630809e540 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f63080a3f90 con 0x7f63080a0750 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f630809f910 con 0x7f63080a3bb0 2026-02-17T11:53:45.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f630cc64640 10 monclient(hunting): authenticate will time out at 1112.942635s 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6306575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 msgr2=0x7f630809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6306575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 0x7f630809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f63080a0750 0x7f630809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f63080a0750 0x7f630809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59566/0 (socket says 10.20.193.51:59566) 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 -- 10.20.193.51:0/1746397341 learned_addr learned my addr 10.20.193.51:0/1746397341 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): get_auth_request con 0x7f63080a0750 auth_method 0 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient(hunting): handle_auth_done global_id 74541 payload 274 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 -- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 msgr2=0x7f630809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 --2- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 0x7f630809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 -- 10.20.193.51:0/1746397341 >> v1:10.20.193.142:6789/0 conn(0x7f630809e540 legacy=0x7f630813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 monclient: found mon.noname-a 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.323+0000 7f6305d74640 1 -- 10.20.193.51:0/1746397341 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630809ccd0 con 0x7f63080a0750 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305d74640 1 -- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a0750 msgr2=0x7f630809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305d74640 1 --2- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a0750 0x7f630809e000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6308069d60 tx=0x7f62f002ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a201dfddcd9559 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 1 -- 10.20.193.51:0/1746397341 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f003c070 con 0x7f63080a0750 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:45.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: dump: 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 5 monclient: authenticate success, global_id 74541 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 1 -- 10.20.193.51:0/1746397341 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f002fda0 con 0x7f63080a0750 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 1 -- 10.20.193.51:0/1746397341 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0037660 con 0x7f63080a0750 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 4 set_mon_vals no callback set 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f6305573640 10 monclient: dump: 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 10 monclient: shutdown 2026-02-17T11:53:45.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 -- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a0750 msgr2=0x7f630809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 --2- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a0750 0x7f630809e000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6308069d60 tx=0x7f62f002ee80 comp rx=0 tx=0).stop 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 -- 10.20.193.51:0/1746397341 shutdown_connections 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 --2- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a0750 0x7f630809e000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 --2- 10.20.193.51:0/1746397341 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63080a3bb0 0x7f630809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 -- 10.20.193.51:0/1746397341 >> 10.20.193.51:0/1746397341 conn(0x7f63080a30c0 msgr2=0x7f63080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 -- 10.20.193.51:0/1746397341 shutdown_connections 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.326+0000 7f630cc64640 1 -- 10.20.193.51:0/1746397341 wait complete. 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient: build_initial_monmap 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient: monmap: 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:45.347 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 Processor -- start 2026-02-17T11:53:45.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 -- start start 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient: init 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f630809e540 0x7f63081cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-c con 0x7f630809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63080a0750 0x7f63080999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-b con 0x7f63080a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): picked mon.noname-a con 0x7f63080a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:45.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f63080a04b0 con 0x7f63080a3bb0 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f630809c850 con 0x7f63080a0750 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f630813de80 con 0x7f630809e540 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f630cc64640 10 monclient(hunting): authenticate will time out at 1112.946679s 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f630809e540 msgr2=0x7f63081cf3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f630809e540 0x7f63081cf3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59570/0 (socket says 10.20.193.51:59570) 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 learned_addr learned my addr 10.20.193.51:0/4280412477 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): get_auth_request con 0x7f63080a3bb0 auth_method 0 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6305d74640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63080a0750 0x7f63080999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6305d74640 10 monclient(hunting): get_auth_request con 0x7f63080a0750 auth_method 0 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6305d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6305d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6305d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient(hunting): handle_auth_done global_id 74544 payload 824 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f630809e540 msgr2=0x7f63081cf3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f630809e540 0x7f63081cf3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63080a0750 msgr2=0x7f63080999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63080a0750 0x7f63080999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 monclient: found mon.noname-a 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.327+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63080915b0 con 0x7f63080a3bb0 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 msgr2=0x7f6308099f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306d76640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62f800cb90 tx=0x7f62f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8016020 con 0x7f63080a3bb0 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: dump: 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.353 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f8012420 con 0x7f63080a3bb0 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 5 monclient: authenticate success, global_id 74544 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 monclient: _renew_subs 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63080a2610 con 0x7f63080a3bb0 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8012810 con 0x7f63080a3bb0 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6304d72640 4 set_mon_vals no callback set 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 10 monclient: dump: 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 monclient: _renew_subs 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6308093190 con 0x7f63080a3bb0 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 0x7f630808fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f63081cf920 con 0x7f630808f740 2026-02-17T11:53:45.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 0x7f630808fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient: get_auth_request con 0x7f630808f740 auth_method 0 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f62f80129b0 con 0x7f63080a3bb0 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 10 monclient(hunting): handle_auth_done global_id 74547 payload 824 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.330+0000 7f6306575640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f630809dac0 con 0x7f630808f740 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f62eeffd640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 0x7f62d4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(296..296 src has 167..296) ==== 4735+0+0 (secure 0 0 0) 0x7f62f8053010 con 0x7f63080a3bb0 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 0x7f62d4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 10 monclient: get_auth_request con 0x7f62d403dcc0 auth_method 0 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 msgr2=0x7f62d4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 msgr2=0x7f62d4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 0x7f62d4040180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f62f0036000 tx=0x7f62f0033000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.331+0000 7f6305d74640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 0x7f62d4040180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f6306575640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 msgr2=0x7f630808fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f6306575640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 0x7f630808fb20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc005070 con 0x7f630808f740 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 10 monclient: dump: 2026-02-17T11:53:45.358 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f62fc005070 con 0x7f630808f740 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 msgr2=0x7f630808fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 0x7f630808fb20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc00bcf0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 msgr2=0x7f630808fb20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.333+0000 7f62eeffd640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f630808f740 0x7f630808fb20 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc00bcf0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f630cc64640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f630cc64640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 0x7f63081da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f630cc64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f63080008d0 con 0x7f6308090060 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 0x7f63081da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient: get_auth_request con 0x7f6308090060 auth_method 0 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 10 monclient(hunting): handle_auth_done global_id 74550 payload 824 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.336+0000 7f6306575640 1 -- 10.20.193.51:0/4280412477 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6308050ac0 con 0x7f6308090060 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f6306575640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 msgr2=0x7f63081da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f6306575640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 0x7f63081da4c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc01a730 con 0x7f6308090060 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 10 monclient: dump: 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.361 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f62fc014430 con 0x7f6308090060 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 msgr2=0x7f63081da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 0x7f63081da4c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc005ad0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 msgr2=0x7f63081da4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:45.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f62eeffd640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6308090060 0x7f63081da4c0 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00bcc0 tx=0x7f62fc005ad0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 68, 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 243271, 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.363 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.364 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.365 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:45.366 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:45.367 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.368 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:45.369 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:45.370 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:45.371 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.372 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.373 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:45.373 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 msgr2=0x7f62d4040180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f62d403dcc0 0x7f62d4040180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 10 monclient: shutdown 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 msgr2=0x7f6308099f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62f800cb90 tx=0x7f62f800a430 comp rx=0 tx=0).stop 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f6306d76640 1 -- 10.20.193.51:0/4280412477 reap_dead start 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 shutdown_connections 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 --2- 10.20.193.51:0/4280412477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63080a3bb0 0x7f6308099f10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 >> 10.20.193.51:0/4280412477 conn(0x7f63080a30c0 msgr2=0x7f630809b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 shutdown_connections 2026-02-17T11:53:45.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.339+0000 7f630cc64640 1 -- 10.20.193.51:0/4280412477 wait complete. 2026-02-17T11:53:45.375 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:53:45.375 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:53:45.375 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:53:45.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.443+0000 7f0ec8e32640 10 monclient: get_monmap_and_config 2026-02-17T11:53:45.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.443+0000 7f0ec8e32640 10 monclient: build_initial_monmap 2026-02-17T11:53:45.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.443+0000 7f0ec8e32640 10 monclient: monmap: 2026-02-17T11:53:45.445 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:53:45.444611+0000 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:53:45.444611+0000 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:53:45.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 Processor -- start 2026-02-17T11:53:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 -- start start 2026-02-17T11:53:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient: init 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0ec40a3bb0 0x7f0ec409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-a con 0x7f0ec40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ec40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f0ec413b760 0x7f0ec413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-c con 0x7f0ec413b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec406e140 con 0x7f0ec40a0750 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec409f910 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec409ccd0 con 0x7f0ec413b760 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec8e32640 10 monclient(hunting): authenticate will time out at 1113.063431s 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0ec40a3bb0 0x7f0ec409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0ec40a3bb0 0x7f0ec409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59588/0 (socket says 10.20.193.51:59588) 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 -- 10.20.193.51:0/25380136 learned_addr learned my addr 10.20.193.51:0/25380136 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): get_auth_request con 0x7f0ec40a3bb0 auth_method 0 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2d76640 1 --2- 10.20.193.51:0/25380136 >> v2:10.20.193.142:3300/0 conn(0x7f0ec413b760 0x7f0ec413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2d76640 10 monclient(hunting): get_auth_request con 0x7f0ec413b760 auth_method 0 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient(hunting): handle_auth_done global_id 74553 payload 274 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 -- 10.20.193.51:0/25380136 >> v2:10.20.193.142:3300/0 conn(0x7f0ec413b760 msgr2=0x7f0ec413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 --2- 10.20.193.51:0/25380136 >> v2:10.20.193.142:3300/0 conn(0x7f0ec413b760 0x7f0ec413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 -- 10.20.193.51:0/25380136 >> v1:10.20.193.142:6789/0 conn(0x7f0ec40a0750 legacy=0x7f0ec409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 monclient: found mon.noname-a 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.444+0000 7f0ec2575640 1 -- 10.20.193.51:0/25380136 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec409eec0 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec2575640 1 -- 10.20.193.51:0/25380136 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a3bb0 msgr2=0x7f0ec409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec2575640 1 --2- 10.20.193.51:0/25380136 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a3bb0 0x7f0ec409dac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0ec409f5f0 tx=0x7f0eb802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bde6a31debb86a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 1 -- 10.20.193.51:0/25380136 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803c070 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: dump: 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.459 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 1 -- 10.20.193.51:0/25380136 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb802fca0 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 5 monclient: authenticate success, global_id 74553 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 10 monclient: get_monmap_and_config success 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 1 -- 10.20.193.51:0/25380136 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8037660 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 4 set_mon_vals no callback set 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec1573640 10 monclient: dump: 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.461 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 10 monclient: shutdown 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 -- 10.20.193.51:0/25380136 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a3bb0 msgr2=0x7f0ec409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/25380136 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a3bb0 0x7f0ec409dac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0ec409f5f0 tx=0x7f0eb802ee60 comp rx=0 tx=0).stop 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 -- 10.20.193.51:0/25380136 shutdown_connections 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/25380136 >> v2:10.20.193.142:3300/0 conn(0x7f0ec413b760 0x7f0ec413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/25380136 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a3bb0 0x7f0ec409dac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 -- 10.20.193.51:0/25380136 >> 10.20.193.51:0/25380136 conn(0x7f0ec40a30c0 msgr2=0x7f0ec40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 -- 10.20.193.51:0/25380136 shutdown_connections 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.447+0000 7f0ec8e32640 1 -- 10.20.193.51:0/25380136 wait complete. 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient: build_initial_monmap 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient: monmap: 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:53:45.463 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 Processor -- start 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 -- start start 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient: init 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-a con 0x7f0ec40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40a3bb0 0x7f0ec41d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-b con 0x7f0ec40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ec413b760 0x7f0ec40950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): picked mon.noname-c con 0x7f0ec413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40a04b0 con 0x7f0ec40a0750 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec409c850 con 0x7f0ec40a3bb0 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec409e710 con 0x7f0ec413b760 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec8e32640 10 monclient(hunting): authenticate will time out at 1113.067771s 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2d76640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ec413b760 msgr2=0x7f0ec40950b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:53:45.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ec413b760 0x7f0ec40950b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59592/0 (socket says 10.20.193.51:59592) 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 -- 10.20.193.51:0/608984582 learned_addr learned my addr 10.20.193.51:0/608984582 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): get_auth_request con 0x7f0ec40a0750 auth_method 0 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient(hunting): handle_auth_done global_id 74556 payload 824 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ec413b760 msgr2=0x7f0ec40950b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:53:45.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0ec413b760 0x7f0ec40950b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40a3bb0 msgr2=0x7f0ec41d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40a3bb0 0x7f0ec41d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient: _finish_hunting 0 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 monclient: found mon.noname-a 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.448+0000 7f0ec2575640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec4097730 con 0x7f0ec40a0750 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec2575640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 msgr2=0x7f0ec41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec2575640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8002410 tx=0x7f0eb8004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803c040 con 0x7f0ec40a0750 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: dump: 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: _finish_auth 0 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb8047070 con 0x7f0ec40a0750 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 5 monclient: authenticate success, global_id 74556 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 monclient: _renew_subs 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec4098f30 con 0x7f0ec40a0750 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8042890 con 0x7f0ec40a0750 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:53:45.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 10 monclient: dump: 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec0d72640 4 set_mon_vals no callback set 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 monclient: _renew_subs 2026-02-17T11:53:45.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec40a2390 con 0x7f0ec40a0750 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 0x7f0ec40955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40a2c60 con 0x7f0ec40988d0 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0eb8042a70 con 0x7f0ec40a0750 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec1d74640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 0x7f0ec40955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec1d74640 10 monclient: get_auth_request con 0x7f0ec40988d0 auth_method 0 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.451+0000 7f0ec1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0eaaffd640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0e9003dcf0 0x7f0e900401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(296..296 src has 167..296) ==== 4735+0+0 (secure 0 0 0) 0x7f0eb80773d0 con 0x7f0ec40a0750 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec2d76640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0e9003dcf0 0x7f0e900401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_done global_id 114148 payload 824 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec1d74640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ec406f8a0 con 0x7f0ec40988d0 2026-02-17T11:53:45.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.452+0000 7f0ec2d76640 10 monclient: get_auth_request con 0x7f0e9003dcf0 auth_method 0 2026-02-17T11:53:45.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0ec1d74640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 msgr2=0x7f0ec40955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0ec1d74640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 0x7f0ec40955f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac011a80 con 0x7f0ec40988d0 2026-02-17T11:53:45.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0eaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0eaaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.454+0000 7f0eaaffd640 10 monclient: dump: 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f0eac017070 con 0x7f0ec40988d0 2026-02-17T11:53:45.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 msgr2=0x7f0ec40955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 0x7f0ec40955f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac00c800 comp rx=0 tx=0).stop 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 msgr2=0x7f0ec40955f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0eaaffd640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec40988d0 0x7f0ec40955f0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac00c800 comp rx=0 tx=0).stop 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.455+0000 7f0ec2d76640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0e9003dcf0 0x7f0e900401b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40975a0 tx=0x7f0eb4009920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec8e32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 0x7f0ec41daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec8e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec409dac0 con 0x7f0ec4095b30 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 0x7f0ec41daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient: get_auth_request con 0x7f0ec4095b30 auth_method 0 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:53:45.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 10 monclient(hunting): handle_auth_done global_id 114151 payload 824 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.458+0000 7f0ec1d74640 1 -- 10.20.193.51:0/608984582 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ec4098cb0 con 0x7f0ec4095b30 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0ec1d74640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 msgr2=0x7f0ec41daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0ec1d74640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 0x7f0ec41daad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac01caf0 con 0x7f0ec4095b30 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0eaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0eaaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.460+0000 7f0eaaffd640 10 monclient: dump: 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.478 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4696 (secure 0 0 0) 0x7f0eac0068d0 con 0x7f0ec4095b30 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 msgr2=0x7f0ec41daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 0x7f0ec41daad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac003860 comp rx=0 tx=0).stop 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 msgr2=0x7f0ec41daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:53:45.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0eaaffd640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0ec4095b30 0x7f0ec41daad0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4097920 tx=0x7f0eac003860 comp rx=0 tx=0).stop 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 68, 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 27335, 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.480 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.481 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:53:45.482 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:53:45.483 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.484 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.485 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.486 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.487 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:53:45.488 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:53:45.489 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:53:45.490 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:53:45.490 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:53:45.490 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:53:45.490 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:53:45.490 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0e9003dcf0 msgr2=0x7f0e900401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0e9003dcf0 0x7f0e900401b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40975a0 tx=0x7f0eb4009920 comp rx=0 tx=0).stop 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 10 monclient: shutdown 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 msgr2=0x7f0ec41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8002410 tx=0x7f0eb8004830 comp rx=0 tx=0).stop 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec2d76640 1 -- 10.20.193.51:0/608984582 reap_dead start 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 shutdown_connections 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 --2- 10.20.193.51:0/608984582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0ec40a0750 0x7f0ec41cfad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 >> 10.20.193.51:0/608984582 conn(0x7f0ec40a30c0 msgr2=0x7f0ec413ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 shutdown_connections 2026-02-17T11:53:45.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:53:45.461+0000 7f0ec8e32640 1 -- 10.20.193.51:0/608984582 wait complete. 2026-02-17T11:53:45.492 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:53:45.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:53:46.123 INFO:tasks.rados.rados.0.trial142.stdout:1245: done (2 left) 2026-02-17T11:53:46.123 INFO:tasks.rados.rados.0.trial142.stdout:1246: done (1 left) 2026-02-17T11:53:46.123 INFO:tasks.rados.rados.0.trial142.stdout:1247: done (0 left) 2026-02-17T11:53:46.123 INFO:tasks.rados.rados.0.trial142.stdout:1248: snap_create 2026-02-17T11:53:47.124 INFO:tasks.rados.rados.0.trial142.stdout:1248: done (0 left) 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1249: read oid 6 snap -1 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1249: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1250: copy_from oid 26 from oid 39 current snap is 138 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1251: read oid 1 snap -1 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1251: expect deleted 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1252: rollback oid 3 current snap is 138 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 129 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1253: rollback oid 47 current snap is 138 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 137 2026-02-17T11:53:47.125 INFO:tasks.rados.rados.0.trial142.stdout:1254: delete oid 36 current snap is 138 2026-02-17T11:53:47.127 INFO:tasks.rados.rados.0.trial142.stdout:1252: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:53:47.127 INFO:tasks.rados.rados.0.trial142.stdout:1252: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:53:47.127 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 696 (ObjNum 335 snap 109 seq_num 335) dirty exists 2026-02-17T11:53:47.128 INFO:tasks.rados.rados.0.trial142.stdout:1251: done (5 left) 2026-02-17T11:53:47.128 INFO:tasks.rados.rados.0.trial142.stdout:1252: done (4 left) 2026-02-17T11:53:47.128 INFO:tasks.rados.rados.0.trial142.stdout:1254: done (3 left) 2026-02-17T11:53:47.128 INFO:tasks.rados.rados.0.trial142.stdout:1255: delete oid 33 current snap is 138 2026-02-17T11:53:47.129 INFO:tasks.rados.rados.0.trial142.stdout:1253: finishing rollback tid 0 to trial14245205-47 2026-02-17T11:53:47.129 INFO:tasks.rados.rados.0.trial142.stdout:1253: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:53:47.129 INFO:tasks.rados.rados.0.trial142.stdout:1253: finishing rollback tid 2 to trial14245205-47 2026-02-17T11:53:47.129 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 626 (ObjNum 249 snap 79 seq_num 249) dirty exists 2026-02-17T11:53:47.130 INFO:tasks.rados.rados.0.trial142.stdout:1253: done (3 left) 2026-02-17T11:53:47.130 INFO:tasks.rados.rados.0.trial142.stdout:1255: done (2 left) 2026-02-17T11:53:47.131 INFO:tasks.rados.rados.0.trial142.stdout:1256: snap_remove snap 131 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1256: done (2 left) 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1257: read oid 33 snap -1 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1257: expect deleted 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1258: read oid 17 snap -1 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1258: expect deleted 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1259: read oid 42 snap 129 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1259: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1260: rollback oid 7 current snap is 138 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 121 2026-02-17T11:53:48.127 INFO:tasks.rados.rados.0.trial142.stdout:1249: expect (ObjNum 401 snap 121 seq_num 401) 2026-02-17T11:53:48.245 INFO:tasks.rados.rados.0.trial142.stdout:1250: finishing copy_from to trial14245205-26 2026-02-17T11:53:48.245 INFO:tasks.rados.rados.0.trial142.stdout:1250: got expected ENOENT (src dne) 2026-02-17T11:53:48.246 INFO:tasks.rados.rados.0.trial142.stdout:1250: finishing copy_from racing read to trial14245205-26 2026-02-17T11:53:48.246 INFO:tasks.rados.rados.0.trial142.stdout:1260: finishing rollback tid 1 to trial14245205-7 2026-02-17T11:53:48.246 INFO:tasks.rados.rados.0.trial142.stdout:1260: finishing rollback tid 2 to trial14245205-7 2026-02-17T11:53:48.246 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 994 (ObjNum 317 snap 102 seq_num 317) dirty exists 2026-02-17T11:53:48.246 INFO:tasks.rados.rados.0.trial142.stdout:1259: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1249: done (5 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1250: done (4 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1257: done (3 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1258: done (2 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1259: done (1 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1260: done (0 left) 2026-02-17T11:53:48.359 INFO:tasks.rados.rados.0.trial142.stdout:1261: rollback oid 44 current snap is 138 2026-02-17T11:53:48.360 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 134 2026-02-17T11:53:48.360 INFO:tasks.rados.rados.0.trial142.stdout:1262: snap_create 2026-02-17T11:53:48.360 INFO:tasks.rados.rados.0.trial142.stdout:1261: finishing rollback tid 1 to trial14245205-44 2026-02-17T11:53:48.360 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:53:49.130 INFO:tasks.rados.rados.0.trial142.stdout:1261: done (1 left) 2026-02-17T11:53:49.131 INFO:tasks.rados.rados.0.trial142.stdout:1262: done (0 left) 2026-02-17T11:53:49.131 INFO:tasks.rados.rados.0.trial142.stdout:1263: read oid 44 snap -1 2026-02-17T11:53:49.131 INFO:tasks.rados.rados.0.trial142.stdout:1263: expect deleted 2026-02-17T11:53:49.131 INFO:tasks.rados.rados.0.trial142.stdout:1264: write (excl) oid 50 current snap is 139 2026-02-17T11:53:49.131 INFO:tasks.rados.rados.0.trial142.stdout:1264: seq_num 454 ranges {430378=627873,1700472=622156,3017921=612457} 2026-02-17T11:53:49.134 INFO:tasks.rados.rados.0.trial142.stdout:1264: writing trial14245205-50 from 430378 to 1058251 tid 1 2026-02-17T11:53:49.139 INFO:tasks.rados.rados.0.trial142.stdout:1264: writing trial14245205-50 from 1700472 to 2322628 tid 2 2026-02-17T11:53:49.145 INFO:tasks.rados.rados.0.trial142.stdout:1264: writing trial14245205-50 from 3017921 to 3630378 tid 3 2026-02-17T11:53:49.145 INFO:tasks.rados.rados.0.trial142.stdout:1265: snap_remove snap 136 2026-02-17T11:53:49.991 INFO:tasks.rados.rados.0.trial142.stdout:1265: done (2 left) 2026-02-17T11:53:49.991 INFO:tasks.rados.rados.0.trial142.stdout:1266: read oid 24 snap 129 2026-02-17T11:53:49.992 INFO:tasks.rados.rados.0.trial142.stdout:1266: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:53:49.992 INFO:tasks.rados.rados.0.trial142.stdout:1267: snap_remove snap 128 2026-02-17T11:53:50.992 INFO:tasks.rados.rados.0.trial142.stdout:1267: done (3 left) 2026-02-17T11:53:50.992 INFO:tasks.rados.rados.0.trial142.stdout:1268: snap_remove snap 135 2026-02-17T11:53:51.993 INFO:tasks.rados.rados.0.trial142.stdout:1268: done (3 left) 2026-02-17T11:53:51.993 INFO:tasks.rados.rados.0.trial142.stdout:1269: write (excl) oid 16 current snap is 139 2026-02-17T11:53:51.993 INFO:tasks.rados.rados.0.trial142.stdout:1269: seq_num 455 ranges {447185=703122,1642601=765814,2928991=447707} 2026-02-17T11:53:51.998 INFO:tasks.rados.rados.0.trial142.stdout:1269: writing trial14245205-16 from 447185 to 1150307 tid 1 2026-02-17T11:53:52.002 INFO:tasks.rados.rados.0.trial142.stdout:1269: writing trial14245205-16 from 1642601 to 2408415 tid 2 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1269: writing trial14245205-16 from 2928991 to 3376698 tid 3 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1270: copy_from oid 39 from oid 2 current snap is 139 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: finishing write tid 1 to trial14245205-50 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: finishing write tid 2 to trial14245205-50 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: finishing write tid 3 to trial14245205-50 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: finishing write tid 4 to trial14245205-50 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: finishing write tid 5 to trial14245205-50 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: oid 50 updating version 0 to 712 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: oid 50 version 712 is already newer than 711 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: oid 50 updating version 712 to 713 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: oid 50 version 713 is already newer than 710 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 713 (ObjNum 454 snap 139 seq_num 454) dirty exists 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1264: left oid 50 (ObjNum 454 snap 139 seq_num 454) 2026-02-17T11:53:52.006 INFO:tasks.rados.rados.0.trial142.stdout:1266: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:53:52.165 INFO:tasks.rados.rados.0.trial142.stdout:1269: finishing write tid 1 to trial14245205-16 2026-02-17T11:53:52.165 INFO:tasks.rados.rados.0.trial142.stdout:1270: finishing copy_from racing read to trial14245205-39 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: finishing write tid 2 to trial14245205-16 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: finishing write tid 3 to trial14245205-16 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: finishing write tid 4 to trial14245205-16 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1270: finishing copy_from to trial14245205-39 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 637 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: finishing write tid 5 to trial14245205-16 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: oid 16 updating version 0 to 643 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: oid 16 updating version 643 to 646 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: oid 16 version 646 is already newer than 644 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: oid 16 version 646 is already newer than 645 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 646 (ObjNum 455 snap 139 seq_num 455) dirty exists 2026-02-17T11:53:52.166 INFO:tasks.rados.rados.0.trial142.stdout:1269: left oid 16 (ObjNum 455 snap 139 seq_num 455) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1263: done (4 left) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1264: done (3 left) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1266: done (2 left) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1269: done (1 left) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1270: done (0 left) 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1271: write oid 14 current snap is 139 2026-02-17T11:53:52.167 INFO:tasks.rados.rados.0.trial142.stdout:1271: seq_num 456 ranges {463992=778371,1701083=625825,2956414=658979} 2026-02-17T11:53:52.169 INFO:tasks.rados.rados.0.trial142.stdout:1271: writing trial14245205-14 from 463992 to 1242363 tid 1 2026-02-17T11:53:52.173 INFO:tasks.rados.rados.0.trial142.stdout:1271: writing trial14245205-14 from 1701083 to 2326908 tid 2 2026-02-17T11:53:52.178 INFO:tasks.rados.rados.0.trial142.stdout:1271: writing trial14245205-14 from 2956414 to 3615393 tid 3 2026-02-17T11:53:52.178 INFO:tasks.rados.rados.0.trial142.stdout:1272: snap_remove snap 137 2026-02-17T11:53:53.134 INFO:tasks.rados.rados.0.trial142.stdout:1272: done (1 left) 2026-02-17T11:53:53.134 INFO:tasks.rados.rados.0.trial142.stdout:1273: write (excl) oid 22 current snap is 139 2026-02-17T11:53:53.135 INFO:tasks.rados.rados.0.trial142.stdout:1273: seq_num 457 ranges {480799=569973,1475918=769483,2700190=586604} 2026-02-17T11:53:53.138 INFO:tasks.rados.rados.0.trial142.stdout:1273: writing trial14245205-22 from 480799 to 1050772 tid 1 2026-02-17T11:53:53.142 INFO:tasks.rados.rados.0.trial142.stdout:1273: writing trial14245205-22 from 1475918 to 2245401 tid 2 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1273: writing trial14245205-22 from 2700190 to 3286794 tid 3 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1274: write (excl) oid 20 current snap is 139 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1271: finishing write tid 1 to trial14245205-14 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1271: finishing write tid 2 to trial14245205-14 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1271: finishing write tid 3 to trial14245205-14 2026-02-17T11:53:53.147 INFO:tasks.rados.rados.0.trial142.stdout:1274: seq_num 458 ranges {497606=645222,1934400=629494,3243966=453640} 2026-02-17T11:53:53.151 INFO:tasks.rados.rados.0.trial142.stdout:1274: writing trial14245205-20 from 497606 to 1142828 tid 1 2026-02-17T11:53:53.156 INFO:tasks.rados.rados.0.trial142.stdout:1274: writing trial14245205-20 from 1934400 to 2563894 tid 2 2026-02-17T11:53:53.160 INFO:tasks.rados.rados.0.trial142.stdout:1274: writing trial14245205-20 from 3243966 to 3697606 tid 3 2026-02-17T11:53:53.160 INFO:tasks.rados.rados.0.trial142.stdout:1275: write (excl) oid 10 current snap is 139 2026-02-17T11:53:53.160 INFO:tasks.rados.rados.0.trial142.stdout:1275: seq_num 459 ranges {514413=720471,1876529=773152,3438683=275730} 2026-02-17T11:53:53.165 INFO:tasks.rados.rados.0.trial142.stdout:1275: writing trial14245205-10 from 514413 to 1234884 tid 1 2026-02-17T11:53:53.170 INFO:tasks.rados.rados.0.trial142.stdout:1275: writing trial14245205-10 from 1876529 to 2649681 tid 2 2026-02-17T11:53:53.174 INFO:tasks.rados.rados.0.trial142.stdout:1275: writing trial14245205-10 from 3438683 to 3714413 tid 3 2026-02-17T11:53:53.174 INFO:tasks.rados.rados.0.trial142.stdout:1276: write (excl) oid 16 current snap is 139 2026-02-17T11:53:53.174 INFO:tasks.rados.rados.0.trial142.stdout:1276: seq_num 460 ranges {531220=795720,1935011=516810,3066106=420420} 2026-02-17T11:53:53.179 INFO:tasks.rados.rados.0.trial142.stdout:1276: writing trial14245205-16 from 531220 to 1326940 tid 1 2026-02-17T11:53:53.183 INFO:tasks.rados.rados.0.trial142.stdout:1276: writing trial14245205-16 from 1935011 to 2451821 tid 2 2026-02-17T11:53:53.187 INFO:tasks.rados.rados.0.trial142.stdout:1276: writing trial14245205-16 from 3066106 to 3486526 tid 3 2026-02-17T11:53:53.187 INFO:tasks.rados.rados.0.trial142.stdout:1277: rollback oid 40 current snap is 139 2026-02-17T11:53:53.187 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 134 2026-02-17T11:53:53.187 INFO:tasks.rados.rados.0.trial142.stdout:1271: finishing write tid 4 to trial14245205-14 2026-02-17T11:53:53.187 INFO:tasks.rados.rados.0.trial142.stdout:1278: snap_remove snap 129 2026-02-17T11:53:54.138 INFO:tasks.rados.rados.0.trial142.stdout:1278: done (6 left) 2026-02-17T11:53:54.138 INFO:tasks.rados.rados.0.trial142.stdout:1279: write (excl) oid 50 current snap is 139 2026-02-17T11:53:54.138 INFO:tasks.rados.rados.0.trial142.stdout:1279: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2026-02-17T11:53:54.141 INFO:tasks.rados.rados.0.trial142.stdout:1279: writing trial14245205-50 from 548027 to 1018996 tid 1 2026-02-17T11:53:54.147 INFO:tasks.rados.rados.0.trial142.stdout:1279: writing trial14245205-50 from 1593493 to 2370314 tid 2 2026-02-17T11:53:54.152 INFO:tasks.rados.rados.0.trial142.stdout:1279: writing trial14245205-50 from 3093529 to 3725221 tid 3 2026-02-17T11:53:54.152 INFO:tasks.rados.rados.0.trial142.stdout:1280: read oid 42 snap -1 2026-02-17T11:53:54.152 INFO:tasks.rados.rados.0.trial142.stdout:1280: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:54.152 INFO:tasks.rados.rados.0.trial142.stdout:1281: snap_remove snap 121 2026-02-17T11:53:54.992 INFO:tasks.rados.rados.0.trial142.stdout:1281: done (8 left) 2026-02-17T11:53:54.993 INFO:tasks.rados.rados.0.trial142.stdout:1282: write (excl) oid 26 current snap is 139 2026-02-17T11:53:54.993 INFO:tasks.rados.rados.0.trial142.stdout:1282: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2026-02-17T11:53:54.996 INFO:tasks.rados.rados.0.trial142.stdout:1282: writing trial14245205-26 from 564834 to 1111052 tid 1 2026-02-17T11:53:55.000 INFO:tasks.rados.rados.0.trial142.stdout:1282: writing trial14245205-26 from 1651975 to 2172454 tid 2 2026-02-17T11:53:55.008 INFO:tasks.rados.rados.0.trial142.stdout:1282: writing trial14245205-26 from 2720952 to 3280269 tid 3 2026-02-17T11:53:55.008 INFO:tasks.rados.rados.0.trial142.stdout:1283: snap_create 2026-02-17T11:53:55.008 INFO:tasks.rados.rados.0.trial142.stdout:1271: finishing write tid 5 to trial14245205-14 2026-02-17T11:53:55.008 INFO:tasks.rados.rados.0.trial142.stdout:1271: oid 14 updating version 0 to 1013 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:1271: oid 14 version 1013 is already newer than 1010 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:1271: oid 14 version 1013 is already newer than 1012 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:1271: oid 14 version 1013 is already newer than 1011 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1013 (ObjNum 456 snap 139 seq_num 456) dirty exists 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:1271: left oid 14 (ObjNum 456 snap 139 seq_num 456) 2026-02-17T11:53:55.009 INFO:tasks.rados.rados.0.trial142.stdout:1273: finishing write tid 1 to trial14245205-22 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: finishing write tid 2 to trial14245205-22 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: finishing write tid 3 to trial14245205-22 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: finishing write tid 4 to trial14245205-22 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: finishing write tid 5 to trial14245205-22 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: oid 22 updating version 0 to 290 2026-02-17T11:53:55.010 INFO:tasks.rados.rados.0.trial142.stdout:1273: oid 22 updating version 290 to 293 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1273: oid 22 version 293 is already newer than 291 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1273: oid 22 version 293 is already newer than 292 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 293 (ObjNum 457 snap 139 seq_num 457) dirty exists 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1273: left oid 22 (ObjNum 457 snap 139 seq_num 457) 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1274: finishing write tid 1 to trial14245205-20 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1274: finishing write tid 2 to trial14245205-20 2026-02-17T11:53:55.011 INFO:tasks.rados.rados.0.trial142.stdout:1274: finishing write tid 3 to trial14245205-20 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: finishing write tid 4 to trial14245205-20 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: finishing write tid 5 to trial14245205-20 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: oid 20 updating version 0 to 718 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: oid 20 updating version 718 to 719 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: oid 20 updating version 719 to 720 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:1274: oid 20 version 720 is already newer than 717 2026-02-17T11:53:55.012 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 720 (ObjNum 458 snap 139 seq_num 458) dirty exists 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1274: left oid 20 (ObjNum 458 snap 139 seq_num 458) 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1275: finishing write tid 1 to trial14245205-10 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1275: finishing write tid 2 to trial14245205-10 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1275: finishing write tid 3 to trial14245205-10 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1275: finishing write tid 4 to trial14245205-10 2026-02-17T11:53:55.013 INFO:tasks.rados.rados.0.trial142.stdout:1275: finishing write tid 5 to trial14245205-10 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:1275: oid 10 updating version 0 to 628 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:1275: oid 10 updating version 628 to 629 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:1275: oid 10 version 629 is already newer than 627 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:1275: oid 10 updating version 629 to 630 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 630 (ObjNum 459 snap 139 seq_num 459) dirty exists 2026-02-17T11:53:55.014 INFO:tasks.rados.rados.0.trial142.stdout:1275: left oid 10 (ObjNum 459 snap 139 seq_num 459) 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1276: finishing write tid 1 to trial14245205-16 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1276: finishing write tid 2 to trial14245205-16 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1277: finishing rollback tid 1 to trial14245205-40 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 633 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1276: finishing write tid 3 to trial14245205-16 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1276: finishing write tid 4 to trial14245205-16 2026-02-17T11:53:55.015 INFO:tasks.rados.rados.0.trial142.stdout:1276: finishing write tid 5 to trial14245205-16 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:1276: oid 16 updating version 0 to 649 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:1276: oid 16 version 649 is already newer than 648 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:1276: oid 16 updating version 649 to 650 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:1276: oid 16 version 650 is already newer than 647 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 650 (ObjNum 460 snap 139 seq_num 460) dirty exists 2026-02-17T11:53:55.016 INFO:tasks.rados.rados.0.trial142.stdout:1276: left oid 16 (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:53:55.017 INFO:tasks.rados.rados.0.trial142.stdout:1279: finishing write tid 1 to trial14245205-50 2026-02-17T11:53:55.017 INFO:tasks.rados.rados.0.trial142.stdout:1279: finishing write tid 2 to trial14245205-50 2026-02-17T11:53:55.017 INFO:tasks.rados.rados.0.trial142.stdout:1280: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:55.118 INFO:tasks.rados.rados.0.trial142.stdout:1279: finishing write tid 3 to trial14245205-50 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: finishing write tid 4 to trial14245205-50 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: finishing write tid 5 to trial14245205-50 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: oid 50 updating version 0 to 716 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: oid 50 version 716 is already newer than 715 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: oid 50 updating version 716 to 717 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: oid 50 version 717 is already newer than 714 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 717 (ObjNum 461 snap 139 seq_num 461) dirty exists 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1279: left oid 50 (ObjNum 461 snap 139 seq_num 461) 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1282: finishing write tid 1 to trial14245205-26 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1282: finishing write tid 2 to trial14245205-26 2026-02-17T11:53:55.119 INFO:tasks.rados.rados.0.trial142.stdout:1282: finishing write tid 3 to trial14245205-26 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: finishing write tid 4 to trial14245205-26 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: finishing write tid 5 to trial14245205-26 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: oid 26 updating version 0 to 718 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: oid 26 updating version 718 to 720 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: oid 26 updating version 720 to 721 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: oid 26 version 721 is already newer than 719 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 721 (ObjNum 462 snap 139 seq_num 462) dirty exists 2026-02-17T11:53:55.120 INFO:tasks.rados.rados.0.trial142.stdout:1282: left oid 26 (ObjNum 462 snap 139 seq_num 462) 2026-02-17T11:53:55.995 INFO:tasks.rados.rados.0.trial142.stdout:1271: done (9 left) 2026-02-17T11:53:55.995 INFO:tasks.rados.rados.0.trial142.stdout:1273: done (8 left) 2026-02-17T11:53:55.995 INFO:tasks.rados.rados.0.trial142.stdout:1274: done (7 left) 2026-02-17T11:53:55.995 INFO:tasks.rados.rados.0.trial142.stdout:1275: done (6 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1276: done (5 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1277: done (4 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1279: done (3 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1280: done (2 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1282: done (1 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1283: done (0 left) 2026-02-17T11:53:55.996 INFO:tasks.rados.rados.0.trial142.stdout:1284: snap_create 2026-02-17T11:53:56.995 INFO:tasks.rados.rados.0.trial142.stdout:1284: done (0 left) 2026-02-17T11:53:56.995 INFO:tasks.rados.rados.0.trial142.stdout:1285: write (excl) oid 40 current snap is 141 2026-02-17T11:53:56.995 INFO:tasks.rados.rados.0.trial142.stdout:1285: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2026-02-17T11:53:57.000 INFO:tasks.rados.rados.0.trial142.stdout:1285: writing trial14245205-40 from 581641 to 1203108 tid 1 2026-02-17T11:53:57.005 INFO:tasks.rados.rados.0.trial142.stdout:1285: writing trial14245205-40 from 1994104 to 2774594 tid 2 2026-02-17T11:53:57.009 INFO:tasks.rados.rados.0.trial142.stdout:1285: writing trial14245205-40 from 3432022 to 3781641 tid 3 2026-02-17T11:53:57.009 INFO:tasks.rados.rados.0.trial142.stdout:1286: delete oid 34 current snap is 141 2026-02-17T11:53:57.009 INFO:tasks.rados.rados.0.trial142.stdout:1285: finishing write tid 1 to trial14245205-40 2026-02-17T11:53:57.009 INFO:tasks.rados.rados.0.trial142.stdout:1285: finishing write tid 2 to trial14245205-40 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: finishing write tid 3 to trial14245205-40 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: finishing write tid 4 to trial14245205-40 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1286: done (1 left) 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1287: rollback oid 11 current snap is 141 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 140 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: finishing write tid 5 to trial14245205-40 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: oid 40 updating version 0 to 636 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: oid 40 updating version 636 to 637 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: oid 40 version 637 is already newer than 635 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: oid 40 version 637 is already newer than 634 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 637 (ObjNum 463 snap 141 seq_num 463) dirty exists 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: left oid 40 (ObjNum 463 snap 141 seq_num 463) 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1285: done (1 left) 2026-02-17T11:53:57.011 INFO:tasks.rados.rados.0.trial142.stdout:1288: copy_from oid 47 from oid 24 current snap is 141 2026-02-17T11:53:57.012 INFO:tasks.rados.rados.0.trial142.stdout:1289: write (excl) oid 15 current snap is 141 2026-02-17T11:53:57.012 INFO:tasks.rados.rados.0.trial142.stdout:1289: seq_num 465 ranges {615255=488318,1827421=784159,3203221=612034} 2026-02-17T11:53:57.015 INFO:tasks.rados.rados.0.trial142.stdout:1289: writing trial14245205-15 from 615255 to 1103573 tid 1 2026-02-17T11:53:57.021 INFO:tasks.rados.rados.0.trial142.stdout:1289: writing trial14245205-15 from 1827421 to 2611580 tid 2 2026-02-17T11:53:57.025 INFO:tasks.rados.rados.0.trial142.stdout:1289: writing trial14245205-15 from 3203221 to 3815255 tid 3 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1290: rollback oid 37 current snap is 141 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 134 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1287: finishing rollback tid 1 to trial14245205-11 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 199 (ObjNum 177 snap 0 seq_num 1213978704) dirty dne 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1287: done (3 left) 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1291: copy_from oid 43 from oid 9 current snap is 141 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1288: finishing copy_from racing read to trial14245205-47 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1288: finishing copy_from to trial14245205-47 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 692 (ObjNum 428 snap 127 seq_num 428) dirty exists 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1288: done (3 left) 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1292: write oid 50 current snap is 141 2026-02-17T11:53:57.026 INFO:tasks.rados.rados.0.trial142.stdout:1292: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2026-02-17T11:53:57.030 INFO:tasks.rados.rados.0.trial142.stdout:1292: writing trial14245205-50 from 632062 to 1195629 tid 1 2026-02-17T11:53:57.035 INFO:tasks.rados.rados.0.trial142.stdout:1292: writing trial14245205-50 from 1885903 to 2413720 tid 2 2026-02-17T11:53:57.040 INFO:tasks.rados.rados.0.trial142.stdout:1292: writing trial14245205-50 from 2830644 to 3551402 tid 3 2026-02-17T11:53:57.040 INFO:tasks.rados.rados.0.trial142.stdout:1293: write oid 24 current snap is 141 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: finishing write tid 1 to trial14245205-15 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: finishing write tid 2 to trial14245205-15 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: finishing write tid 3 to trial14245205-15 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: finishing write tid 4 to trial14245205-15 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: finishing write tid 5 to trial14245205-15 2026-02-17T11:53:57.041 INFO:tasks.rados.rados.0.trial142.stdout:1289: oid 15 updating version 0 to 950 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1289: oid 15 version 950 is already newer than 949 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1289: oid 15 updating version 950 to 951 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1289: oid 15 version 951 is already newer than 948 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 951 (ObjNum 465 snap 141 seq_num 465) dirty exists 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1289: left oid 15 (ObjNum 465 snap 141 seq_num 465) 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1290: finishing rollback tid 0 to trial14245205-37 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1290: finishing rollback tid 1 to trial14245205-37 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1290: finishing rollback tid 2 to trial14245205-37 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 699 (ObjNum 424 snap 127 seq_num 424) dirty exists 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1292: finishing write tid 1 to trial14245205-50 2026-02-17T11:53:57.042 INFO:tasks.rados.rados.0.trial142.stdout:1293: seq_num 467 ranges {648869=638816,1828032=787828,3141714=532030} 2026-02-17T11:53:57.044 INFO:tasks.rados.rados.0.trial142.stdout:1293: writing trial14245205-24 from 648869 to 1287685 tid 1 2026-02-17T11:53:57.049 INFO:tasks.rados.rados.0.trial142.stdout:1293: writing trial14245205-24 from 1828032 to 2615860 tid 2 2026-02-17T11:53:57.053 INFO:tasks.rados.rados.0.trial142.stdout:1293: writing trial14245205-24 from 3141714 to 3673744 tid 3 2026-02-17T11:53:57.053 INFO:tasks.rados.rados.0.trial142.stdout:1289: done (4 left) 2026-02-17T11:53:57.054 INFO:tasks.rados.rados.0.trial142.stdout:1290: done (3 left) 2026-02-17T11:53:57.054 INFO:tasks.rados.rados.0.trial142.stdout:1294: write oid 38 current snap is 141 2026-02-17T11:53:57.054 INFO:tasks.rados.rados.0.trial142.stdout:1294: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2026-02-17T11:53:57.058 INFO:tasks.rados.rados.0.trial142.stdout:1294: writing trial14245205-38 from 665676 to 1379741 tid 1 2026-02-17T11:53:57.062 INFO:tasks.rados.rados.0.trial142.stdout:1294: writing trial14245205-38 from 1886514 to 2418000 tid 2 2026-02-17T11:53:57.068 INFO:tasks.rados.rados.0.trial142.stdout:1294: writing trial14245205-38 from 3169137 to 3865676 tid 3 2026-02-17T11:53:57.068 INFO:tasks.rados.rados.0.trial142.stdout:1295: write oid 2 current snap is 141 2026-02-17T11:53:57.068 INFO:tasks.rados.rados.0.trial142.stdout:1295: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2026-02-17T11:53:57.073 INFO:tasks.rados.rados.0.trial142.stdout:1295: writing trial14245205-2 from 682483 to 1471797 tid 1 2026-02-17T11:53:57.078 INFO:tasks.rados.rados.0.trial142.stdout:1295: writing trial14245205-2 from 1944996 to 2736493 tid 2 2026-02-17T11:53:57.083 INFO:tasks.rados.rados.0.trial142.stdout:1295: writing trial14245205-2 from 3196560 to 3751134 tid 3 2026-02-17T11:53:57.083 INFO:tasks.rados.rados.0.trial142.stdout:1296: delete oid 13 current snap is 141 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1291: finishing copy_from racing read to trial14245205-43 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1291: finishing copy_from to trial14245205-43 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1292: finishing write tid 2 to trial14245205-50 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1292: finishing write tid 3 to trial14245205-50 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1292: finishing write tid 4 to trial14245205-50 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1292: finishing write tid 5 to trial14245205-50 2026-02-17T11:53:57.084 INFO:tasks.rados.rados.0.trial142.stdout:1292: oid 50 updating version 0 to 723 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1292: oid 50 version 723 is already newer than 722 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1292: oid 50 updating version 723 to 725 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1292: oid 50 version 725 is already newer than 724 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 725 (ObjNum 466 snap 141 seq_num 466) dirty exists 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1292: left oid 50 (ObjNum 466 snap 141 seq_num 466) 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1293: finishing write tid 1 to trial14245205-24 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1293: finishing write tid 2 to trial14245205-24 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1293: finishing write tid 3 to trial14245205-24 2026-02-17T11:53:57.085 INFO:tasks.rados.rados.0.trial142.stdout:1293: finishing write tid 4 to trial14245205-24 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: finishing write tid 5 to trial14245205-24 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: oid 24 updating version 0 to 694 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: oid 24 version 694 is already newer than 693 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: oid 24 updating version 694 to 696 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: oid 24 version 696 is already newer than 695 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 696 (ObjNum 467 snap 141 seq_num 467) dirty exists 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1293: left oid 24 (ObjNum 467 snap 141 seq_num 467) 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1294: finishing write tid 1 to trial14245205-38 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1294: finishing write tid 2 to trial14245205-38 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1294: finishing write tid 3 to trial14245205-38 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1294: finishing write tid 4 to trial14245205-38 2026-02-17T11:53:57.086 INFO:tasks.rados.rados.0.trial142.stdout:1294: finishing write tid 5 to trial14245205-38 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1294: oid 38 updating version 0 to 119 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1294: oid 38 version 119 is already newer than 118 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1294: oid 38 version 119 is already newer than 116 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1294: oid 38 version 119 is already newer than 117 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 119 (ObjNum 468 snap 141 seq_num 468) dirty exists 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1294: left oid 38 (ObjNum 468 snap 141 seq_num 468) 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1295: finishing write tid 1 to trial14245205-2 2026-02-17T11:53:57.087 INFO:tasks.rados.rados.0.trial142.stdout:1295: finishing write tid 2 to trial14245205-2 2026-02-17T11:53:57.089 INFO:tasks.rados.rados.0.trial142.stdout:1291: done (5 left) 2026-02-17T11:53:57.089 INFO:tasks.rados.rados.0.trial142.stdout:1292: done (4 left) 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1293: done (3 left) 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1294: done (2 left) 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1296: done (1 left) 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1297: read oid 18 snap -1 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1297: expect deleted 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1298: read oid 13 snap -1 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1298: expect deleted 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1299: read oid 5 snap 133 2026-02-17T11:53:57.090 INFO:tasks.rados.rados.0.trial142.stdout:1299: expect (ObjNum 249 snap 79 seq_num 249) 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1300: copy_from oid 36 from oid 9 current snap is 141 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1301: rollback oid 29 current snap is 141 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 138 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1295: finishing write tid 3 to trial14245205-2 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1302: read oid 19 snap -1 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1302: expect (ObjNum 438 snap 131 seq_num 438) 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1303: read oid 37 snap -1 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1303: expect (ObjNum 424 snap 127 seq_num 424) 2026-02-17T11:53:57.091 INFO:tasks.rados.rados.0.trial142.stdout:1304: write oid 45 current snap is 141 2026-02-17T11:53:57.092 INFO:tasks.rados.rados.0.trial142.stdout:1304: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2026-02-17T11:53:57.092 INFO:tasks.rados.rados.0.trial142.stdout:1304: writing trial14245205-45 from 716097 to 1255909 tid 1 2026-02-17T11:53:57.095 INFO:tasks.rados.rados.0.trial142.stdout:1304: writing trial14245205-45 from 1945607 to 2740773 tid 2 2026-02-17T11:53:57.099 INFO:tasks.rados.rados.0.trial142.stdout:1304: writing trial14245205-45 from 3535053 to 3916097 tid 3 2026-02-17T11:53:57.099 INFO:tasks.rados.rados.0.trial142.stdout:1305: write (excl) oid 23 current snap is 141 2026-02-17T11:53:57.100 INFO:tasks.rados.rados.0.trial142.stdout:1305: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2026-02-17T11:53:57.105 INFO:tasks.rados.rados.0.trial142.stdout:1305: writing trial14245205-23 from 732904 to 1464318 tid 1 2026-02-17T11:53:57.109 INFO:tasks.rados.rados.0.trial142.stdout:1305: writing trial14245205-23 from 2120442 to 2659266 tid 2 2026-02-17T11:53:57.114 INFO:tasks.rados.rados.0.trial142.stdout:1305: writing trial14245205-23 from 3278829 to 3783572 tid 3 2026-02-17T11:53:57.114 INFO:tasks.rados.rados.0.trial142.stdout:1306: copy_from oid 25 from oid 32 current snap is 141 2026-02-17T11:53:57.114 INFO:tasks.rados.rados.0.trial142.stdout:1295: finishing write tid 4 to trial14245205-2 2026-02-17T11:53:57.114 INFO:tasks.rados.rados.0.trial142.stdout:1295: finishing write tid 5 to trial14245205-2 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1295: oid 2 updating version 0 to 638 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1295: oid 2 updating version 638 to 641 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1295: oid 2 version 641 is already newer than 639 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1295: oid 2 version 641 is already newer than 640 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 641 (ObjNum 469 snap 141 seq_num 469) dirty exists 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1295: left oid 2 (ObjNum 469 snap 141 seq_num 469) 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1301: finishing rollback tid 0 to trial14245205-29 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1301: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:53:57.115 INFO:tasks.rados.rados.0.trial142.stdout:1301: finishing rollback tid 2 to trial14245205-29 2026-02-17T11:53:57.116 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 465 (ObjNum 368 snap 117 seq_num 368) dirty exists 2026-02-17T11:53:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1303: expect (ObjNum 424 snap 127 seq_num 424) 2026-02-17T11:53:57.259 INFO:tasks.rados.rados.0.trial142.stdout:1300: finishing copy_from racing read to trial14245205-36 2026-02-17T11:53:57.259 INFO:tasks.rados.rados.0.trial142.stdout:1300: finishing copy_from to trial14245205-36 2026-02-17T11:53:57.259 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:57.259 INFO:tasks.rados.rados.0.trial142.stdout:1304: finishing write tid 1 to trial14245205-45 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1295: done (10 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1297: done (9 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1298: done (8 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1300: done (7 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1301: done (6 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1303: done (5 left) 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1307: write oid 1 current snap is 141 2026-02-17T11:53:57.260 INFO:tasks.rados.rados.0.trial142.stdout:1307: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2026-02-17T11:53:57.264 INFO:tasks.rados.rados.0.trial142.stdout:1307: writing trial14245205-1 from 749711 to 1156374 tid 1 2026-02-17T11:53:57.268 INFO:tasks.rados.rados.0.trial142.stdout:1307: writing trial14245205-1 from 1778924 to 2461406 tid 2 2026-02-17T11:53:57.274 INFO:tasks.rados.rados.0.trial142.stdout:1307: writing trial14245205-1 from 3189899 to 3905914 tid 3 2026-02-17T11:53:57.274 INFO:tasks.rados.rados.0.trial142.stdout:1308: copy_from oid 21 from oid 27 current snap is 141 2026-02-17T11:53:57.274 INFO:tasks.rados.rados.0.trial142.stdout:1299: expect (ObjNum 249 snap 79 seq_num 249) 2026-02-17T11:53:57.360 INFO:tasks.rados.rados.0.trial142.stdout:1302: expect (ObjNum 438 snap 131 seq_num 438) 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: finishing write tid 2 to trial14245205-45 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1299: done (6 left) 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1302: done (5 left) 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1309: read oid 30 snap -1 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1309: expect deleted 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1310: copy_from oid 49 from oid 18 current snap is 141 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1305: finishing write tid 1 to trial14245205-23 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: finishing write tid 3 to trial14245205-45 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: finishing write tid 4 to trial14245205-45 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: finishing write tid 5 to trial14245205-45 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: oid 45 updating version 0 to 459 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: oid 45 updating version 459 to 460 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: oid 45 updating version 460 to 461 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: oid 45 version 461 is already newer than 458 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 461 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: left oid 45 (ObjNum 471 snap 141 seq_num 471) 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1304: done (6 left) 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1311: copy_from oid 7 from oid 45 current snap is 141 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1305: finishing write tid 2 to trial14245205-23 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1306: finishing copy_from to trial14245205-25 2026-02-17T11:53:57.460 INFO:tasks.rados.rados.0.trial142.stdout:1306: got expected ENOENT (src dne) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1306: finishing copy_from racing read to trial14245205-25 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: finishing write tid 3 to trial14245205-23 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: finishing write tid 4 to trial14245205-23 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: finishing write tid 5 to trial14245205-23 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: oid 23 updating version 0 to 694 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: oid 23 updating version 694 to 695 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: oid 23 version 695 is already newer than 693 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: oid 23 updating version 695 to 696 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 696 (ObjNum 472 snap 141 seq_num 472) dirty exists 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: left oid 23 (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: finishing write tid 1 to trial14245205-1 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: finishing write tid 2 to trial14245205-1 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: finishing write tid 3 to trial14245205-1 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: finishing write tid 4 to trial14245205-1 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: finishing write tid 5 to trial14245205-1 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: oid 1 updating version 0 to 299 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: oid 1 version 299 is already newer than 297 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: oid 1 version 299 is already newer than 298 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: oid 1 version 299 is already newer than 296 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 299 (ObjNum 473 snap 141 seq_num 473) dirty exists 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: left oid 1 (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1308: finishing copy_from racing read to trial14245205-21 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1305: done (6 left) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1306: done (5 left) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1307: done (4 left) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1312: snap_create 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1308: finishing copy_from to trial14245205-21 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1310: finishing copy_from to trial14245205-49 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1310: got expected ENOENT (src dne) 2026-02-17T11:53:57.461 INFO:tasks.rados.rados.0.trial142.stdout:1310: finishing copy_from racing read to trial14245205-49 2026-02-17T11:53:57.466 INFO:tasks.rados.rados.0.trial142.stdout:1311: finishing copy_from racing read to trial14245205-7 2026-02-17T11:53:57.468 INFO:tasks.rados.rados.0.trial142.stdout:1311: finishing copy_from to trial14245205-7 2026-02-17T11:53:57.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 461 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-17T11:53:58.001 INFO:tasks.rados.rados.0.trial142.stdout:1308: done (4 left) 2026-02-17T11:53:58.001 INFO:tasks.rados.rados.0.trial142.stdout:1309: done (3 left) 2026-02-17T11:53:58.001 INFO:tasks.rados.rados.0.trial142.stdout:1310: done (2 left) 2026-02-17T11:53:58.001 INFO:tasks.rados.rados.0.trial142.stdout:1311: done (1 left) 2026-02-17T11:53:58.001 INFO:tasks.rados.rados.0.trial142.stdout:1312: done (0 left) 2026-02-17T11:53:58.002 INFO:tasks.rados.rados.0.trial142.stdout:1313: rollback oid 6 current snap is 142 2026-02-17T11:53:58.002 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 141 2026-02-17T11:53:58.002 INFO:tasks.rados.rados.0.trial142.stdout:1314: read oid 42 snap -1 2026-02-17T11:53:58.002 INFO:tasks.rados.rados.0.trial142.stdout:1314: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:58.002 INFO:tasks.rados.rados.0.trial142.stdout:1315: delete oid 49 current snap is 142 2026-02-17T11:53:58.004 INFO:tasks.rados.rados.0.trial142.stdout:1315: done (2 left) 2026-02-17T11:53:58.004 INFO:tasks.rados.rados.0.trial142.stdout:1316: read oid 1 snap -1 2026-02-17T11:53:58.005 INFO:tasks.rados.rados.0.trial142.stdout:1316: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:53:58.005 INFO:tasks.rados.rados.0.trial142.stdout:1317: delete oid 3 current snap is 142 2026-02-17T11:53:58.005 INFO:tasks.rados.rados.0.trial142.stdout:1314: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:53:58.118 INFO:tasks.rados.rados.0.trial142.stdout:1313: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:53:58.118 INFO:tasks.rados.rados.0.trial142.stdout:1313: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:53:58.118 INFO:tasks.rados.rados.0.trial142.stdout:1313: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:53:58.118 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 640 (ObjNum 401 snap 121 seq_num 401) dirty exists 2026-02-17T11:53:58.118 INFO:tasks.rados.rados.0.trial142.stdout:1316: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:53:58.210 INFO:tasks.rados.rados.0.trial142.stdout:1313: done (3 left) 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1314: done (2 left) 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1316: done (1 left) 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1317: done (0 left) 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1318: read oid 5 snap -1 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1318: expect (ObjNum 444 snap 134 seq_num 444) 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1319: copy_from oid 28 from oid 9 current snap is 142 2026-02-17T11:53:58.211 INFO:tasks.rados.rados.0.trial142.stdout:1320: snap_remove snap 138 2026-02-17T11:53:59.105 INFO:tasks.rados.rados.0.trial142.stdout:1320: done (2 left) 2026-02-17T11:53:59.106 INFO:tasks.rados.rados.0.trial142.stdout:1321: write (excl) oid 14 current snap is 142 2026-02-17T11:53:59.106 INFO:tasks.rados.rados.0.trial142.stdout:1321: seq_num 476 ranges {400132=632410,1438017=546162} 2026-02-17T11:53:59.109 INFO:tasks.rados.rados.0.trial142.stdout:1321: writing trial14245205-14 from 400132 to 1032542 tid 1 2026-02-17T11:53:59.112 INFO:tasks.rados.rados.0.trial142.stdout:1321: writing trial14245205-14 from 1438017 to 1984179 tid 2 2026-02-17T11:53:59.113 INFO:tasks.rados.rados.0.trial142.stdout:1322: rollback oid 42 current snap is 142 2026-02-17T11:53:59.113 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 134 2026-02-17T11:53:59.113 INFO:tasks.rados.rados.0.trial142.stdout:1318: expect (ObjNum 444 snap 134 seq_num 444) 2026-02-17T11:53:59.253 INFO:tasks.rados.rados.0.trial142.stdout:1319: finishing copy_from racing read to trial14245205-28 2026-02-17T11:53:59.253 INFO:tasks.rados.rados.0.trial142.stdout:1319: finishing copy_from to trial14245205-28 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: finishing write tid 1 to trial14245205-14 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1318: done (3 left) 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1319: done (2 left) 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1323: copy_from oid 15 from oid 43 current snap is 142 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: finishing write tid 2 to trial14245205-14 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: finishing write tid 3 to trial14245205-14 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: finishing write tid 4 to trial14245205-14 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: oid 14 updating version 0 to 1047 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: oid 14 updating version 1047 to 1049 2026-02-17T11:53:59.254 INFO:tasks.rados.rados.0.trial142.stdout:1321: oid 14 version 1049 is already newer than 1048 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1049 (ObjNum 476 snap 142 seq_num 476) dirty exists 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1321: left oid 14 (ObjNum 476 snap 142 seq_num 476) 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1322: finishing rollback tid 0 to trial14245205-42 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1322: finishing rollback tid 1 to trial14245205-42 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1322: finishing rollback tid 2 to trial14245205-42 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 723 (ObjNum 404 snap 123 seq_num 404) dirty exists 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1321: done (2 left) 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1322: done (1 left) 2026-02-17T11:53:59.255 INFO:tasks.rados.rados.0.trial142.stdout:1324: delete oid 27 current snap is 142 2026-02-17T11:53:59.256 INFO:tasks.rados.rados.0.trial142.stdout:1324: done (1 left) 2026-02-17T11:53:59.256 INFO:tasks.rados.rados.0.trial142.stdout:1325: copy_from oid 24 from oid 38 current snap is 142 2026-02-17T11:53:59.256 INFO:tasks.rados.rados.0.trial142.stdout:1326: write (excl) oid 49 current snap is 142 2026-02-17T11:53:59.256 INFO:tasks.rados.rados.0.trial142.stdout:1326: seq_num 478 ranges {433746=782908,1954981=78765} 2026-02-17T11:53:59.260 INFO:tasks.rados.rados.0.trial142.stdout:1326: writing trial14245205-49 from 433746 to 1216654 tid 1 2026-02-17T11:53:59.263 INFO:tasks.rados.rados.0.trial142.stdout:1326: writing trial14245205-49 from 1954981 to 2033746 tid 2 2026-02-17T11:53:59.263 INFO:tasks.rados.rados.0.trial142.stdout:1327: snap_remove snap 134 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1327: done (3 left) 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1328: read oid 45 snap -1 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1328: expect (ObjNum 471 snap 141 seq_num 471) 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1329: read oid 23 snap -1 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1329: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1330: copy_from oid 12 from oid 6 current snap is 142 2026-02-17T11:53:59.996 INFO:tasks.rados.rados.0.trial142.stdout:1326: finishing write tid 1 to trial14245205-49 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1323: finishing copy_from racing read to trial14245205-15 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1326: finishing write tid 2 to trial14245205-49 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1326: finishing write tid 3 to trial14245205-49 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1331: read oid 40 snap -1 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1331: expect (ObjNum 463 snap 141 seq_num 463) 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1332: read oid 16 snap 141 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1332: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1333: snap_create 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1326: finishing write tid 4 to trial14245205-49 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1326: oid 49 updating version 0 to 1051 2026-02-17T11:53:59.997 INFO:tasks.rados.rados.0.trial142.stdout:1326: oid 49 version 1051 is already newer than 1050 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:1326: oid 49 updating version 1051 to 1052 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1052 (ObjNum 478 snap 142 seq_num 478) dirty exists 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:1326: left oid 49 (ObjNum 478 snap 142 seq_num 478) 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:1323: finishing copy_from to trial14245205-15 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:1325: finishing copy_from racing read to trial14245205-24 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:1325: finishing copy_from to trial14245205-24 2026-02-17T11:53:59.998 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 119 (ObjNum 468 snap 141 seq_num 468) dirty exists 2026-02-17T11:54:00.000 INFO:tasks.rados.rados.0.trial142.stdout:1328: expect (ObjNum 471 snap 141 seq_num 471) 2026-02-17T11:54:00.093 INFO:tasks.rados.rados.0.trial142.stdout:1330: finishing copy_from racing read to trial14245205-12 2026-02-17T11:54:00.094 INFO:tasks.rados.rados.0.trial142.stdout:1330: finishing copy_from to trial14245205-12 2026-02-17T11:54:00.094 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 640 (ObjNum 401 snap 121 seq_num 401) dirty exists 2026-02-17T11:54:00.094 INFO:tasks.rados.rados.0.trial142.stdout:1331: expect (ObjNum 463 snap 141 seq_num 463) 2026-02-17T11:54:00.182 INFO:tasks.rados.rados.0.trial142.stdout:1329: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:54:00.327 INFO:tasks.rados.rados.0.trial142.stdout:1332: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:54:00.994 INFO:tasks.rados.rados.0.trial142.stdout:1323: done (8 left) 2026-02-17T11:54:00.994 INFO:tasks.rados.rados.0.trial142.stdout:1325: done (7 left) 2026-02-17T11:54:00.994 INFO:tasks.rados.rados.0.trial142.stdout:1326: done (6 left) 2026-02-17T11:54:00.994 INFO:tasks.rados.rados.0.trial142.stdout:1328: done (5 left) 2026-02-17T11:54:00.994 INFO:tasks.rados.rados.0.trial142.stdout:1329: done (4 left) 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1330: done (3 left) 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1331: done (2 left) 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1332: done (1 left) 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1333: done (0 left) 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1334: rollback oid 42 current snap is 143 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 133 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1335: copy_from oid 24 from oid 45 current snap is 143 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1336: rollback oid 2 current snap is 143 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 133 2026-02-17T11:54:00.995 INFO:tasks.rados.rados.0.trial142.stdout:1337: snap_create 2026-02-17T11:54:00.997 INFO:tasks.rados.rados.0.trial142.stdout:1336: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:54:00.998 INFO:tasks.rados.rados.0.trial142.stdout:1336: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:54:00.998 INFO:tasks.rados.rados.0.trial142.stdout:1336: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:54:00.998 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 644 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:54:00.998 INFO:tasks.rados.rados.0.trial142.stdout:1334: finishing rollback tid 0 to trial14245205-42 2026-02-17T11:54:00.999 INFO:tasks.rados.rados.0.trial142.stdout:1334: finishing rollback tid 1 to trial14245205-42 2026-02-17T11:54:01.003 INFO:tasks.rados.rados.0.trial142.stdout:1334: finishing rollback tid 2 to trial14245205-42 2026-02-17T11:54:01.004 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 726 (ObjNum 404 snap 123 seq_num 404) dirty exists 2026-02-17T11:54:01.008 INFO:tasks.rados.rados.0.trial142.stdout:1335: finishing copy_from racing read to trial14245205-24 2026-02-17T11:54:01.009 INFO:tasks.rados.rados.0.trial142.stdout:1335: finishing copy_from to trial14245205-24 2026-02-17T11:54:01.009 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 461 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-17T11:54:01.995 INFO:tasks.rados.rados.0.trial142.stdout:1334: done (3 left) 2026-02-17T11:54:01.995 INFO:tasks.rados.rados.0.trial142.stdout:1335: done (2 left) 2026-02-17T11:54:01.995 INFO:tasks.rados.rados.0.trial142.stdout:1336: done (1 left) 2026-02-17T11:54:01.995 INFO:tasks.rados.rados.0.trial142.stdout:1337: done (0 left) 2026-02-17T11:54:01.995 INFO:tasks.rados.rados.0.trial142.stdout:1338: delete oid 41 current snap is 144 2026-02-17T11:54:01.997 INFO:tasks.rados.rados.0.trial142.stdout:1338: done (0 left) 2026-02-17T11:54:01.997 INFO:tasks.rados.rados.0.trial142.stdout:1339: read oid 44 snap 142 2026-02-17T11:54:01.998 INFO:tasks.rados.rados.0.trial142.stdout:1339: expect deleted 2026-02-17T11:54:01.998 INFO:tasks.rados.rados.0.trial142.stdout:1340: write oid 11 current snap is 144 2026-02-17T11:54:01.998 INFO:tasks.rados.rados.0.trial142.stdout:1340: seq_num 480 ranges {467360=649759,1671945=395415} 2026-02-17T11:54:02.001 INFO:tasks.rados.rados.0.trial142.stdout:1340: writing trial14245205-11 from 467360 to 1117119 tid 1 2026-02-17T11:54:02.005 INFO:tasks.rados.rados.0.trial142.stdout:1340: writing trial14245205-11 from 1671945 to 2067360 tid 2 2026-02-17T11:54:02.005 INFO:tasks.rados.rados.0.trial142.stdout:1341: read oid 20 snap -1 2026-02-17T11:54:02.006 INFO:tasks.rados.rados.0.trial142.stdout:1341: expect (ObjNum 458 snap 139 seq_num 458) 2026-02-17T11:54:02.006 INFO:tasks.rados.rados.0.trial142.stdout:1342: delete oid 32 current snap is 144 2026-02-17T11:54:02.006 INFO:tasks.rados.rados.0.trial142.stdout:1340: finishing write tid 1 to trial14245205-11 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: finishing write tid 2 to trial14245205-11 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: finishing write tid 3 to trial14245205-11 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: finishing write tid 4 to trial14245205-11 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: oid 11 updating version 0 to 200 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: oid 11 updating version 200 to 202 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: oid 11 version 202 is already newer than 201 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 202 (ObjNum 480 snap 144 seq_num 480) dirty exists 2026-02-17T11:54:02.007 INFO:tasks.rados.rados.0.trial142.stdout:1340: left oid 11 (ObjNum 480 snap 144 seq_num 480) 2026-02-17T11:54:02.010 INFO:tasks.rados.rados.0.trial142.stdout:1341: expect (ObjNum 458 snap 139 seq_num 458) 2026-02-17T11:54:02.190 INFO:tasks.rados.rados.0.trial142.stdout:1339: done (3 left) 2026-02-17T11:54:02.190 INFO:tasks.rados.rados.0.trial142.stdout:1340: done (2 left) 2026-02-17T11:54:02.190 INFO:tasks.rados.rados.0.trial142.stdout:1341: done (1 left) 2026-02-17T11:54:02.190 INFO:tasks.rados.rados.0.trial142.stdout:1342: done (0 left) 2026-02-17T11:54:02.190 INFO:tasks.rados.rados.0.trial142.stdout:1343: read oid 27 snap -1 2026-02-17T11:54:02.191 INFO:tasks.rados.rados.0.trial142.stdout:1343: expect deleted 2026-02-17T11:54:02.191 INFO:tasks.rados.rados.0.trial142.stdout:1344: copy_from oid 31 from oid 43 current snap is 144 2026-02-17T11:54:02.191 INFO:tasks.rados.rados.0.trial142.stdout:1345: snap_remove snap 133 2026-02-17T11:54:03.110 INFO:tasks.rados.rados.0.trial142.stdout:1345: done (2 left) 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:1346: read oid 18 snap -1 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:1346: expect deleted 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:1347: snap_create 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:1344: finishing copy_from racing read to trial14245205-31 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:1344: finishing copy_from to trial14245205-31 2026-02-17T11:54:03.111 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:04.111 INFO:tasks.rados.rados.0.trial142.stdout:1343: done (3 left) 2026-02-17T11:54:04.112 INFO:tasks.rados.rados.0.trial142.stdout:1344: done (2 left) 2026-02-17T11:54:04.112 INFO:tasks.rados.rados.0.trial142.stdout:1346: done (1 left) 2026-02-17T11:54:04.112 INFO:tasks.rados.rados.0.trial142.stdout:1347: done (0 left) 2026-02-17T11:54:04.112 INFO:tasks.rados.rados.0.trial142.stdout:1348: snap_create 2026-02-17T11:54:04.994 INFO:tasks.rados.rados.0.trial142.stdout:1348: done (0 left) 2026-02-17T11:54:04.994 INFO:tasks.rados.rados.0.trial142.stdout:1349: write (excl) oid 12 current snap is 146 2026-02-17T11:54:04.994 INFO:tasks.rados.rados.0.trial142.stdout:1349: seq_num 482 ranges {500974=400257,1388909=557169} 2026-02-17T11:54:04.998 INFO:tasks.rados.rados.0.trial142.stdout:1349: writing trial14245205-12 from 500974 to 901231 tid 1 2026-02-17T11:54:05.002 INFO:tasks.rados.rados.0.trial142.stdout:1349: writing trial14245205-12 from 1388909 to 1946078 tid 2 2026-02-17T11:54:05.002 INFO:tasks.rados.rados.0.trial142.stdout:1350: delete oid 18 current snap is 146 2026-02-17T11:54:05.004 INFO:tasks.rados.rados.0.trial142.stdout:1349: finishing write tid 1 to trial14245205-12 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: finishing write tid 2 to trial14245205-12 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: finishing write tid 3 to trial14245205-12 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: finishing write tid 4 to trial14245205-12 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: oid 12 updating version 0 to 1077 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: oid 12 version 1077 is already newer than 1076 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: oid 12 updating version 1077 to 1078 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1078 (ObjNum 482 snap 146 seq_num 482) dirty exists 2026-02-17T11:54:05.005 INFO:tasks.rados.rados.0.trial142.stdout:1349: left oid 12 (ObjNum 482 snap 146 seq_num 482) 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1349: done (1 left) 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1350: done (0 left) 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1351: read oid 38 snap -1 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1351: expect (ObjNum 468 snap 141 seq_num 468) 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1352: copy_from oid 12 from oid 4 current snap is 146 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1353: write oid 34 current snap is 146 2026-02-17T11:54:05.006 INFO:tasks.rados.rados.0.trial142.stdout:1353: seq_num 484 ranges {534588=550755,1789520=345068} 2026-02-17T11:54:05.009 INFO:tasks.rados.rados.0.trial142.stdout:1353: writing trial14245205-34 from 534588 to 1085343 tid 1 2026-02-17T11:54:05.013 INFO:tasks.rados.rados.0.trial142.stdout:1353: writing trial14245205-34 from 1789520 to 2134588 tid 2 2026-02-17T11:54:05.013 INFO:tasks.rados.rados.0.trial142.stdout:1354: write (excl) oid 8 current snap is 146 2026-02-17T11:54:05.013 INFO:tasks.rados.rados.0.trial142.stdout:1354: seq_num 485 ranges {551395=626004,1848002=303393} 2026-02-17T11:54:05.017 INFO:tasks.rados.rados.0.trial142.stdout:1354: writing trial14245205-8 from 551395 to 1177399 tid 1 2026-02-17T11:54:05.021 INFO:tasks.rados.rados.0.trial142.stdout:1354: writing trial14245205-8 from 1848002 to 2151395 tid 2 2026-02-17T11:54:05.021 INFO:tasks.rados.rados.0.trial142.stdout:1355: rollback oid 6 current snap is 146 2026-02-17T11:54:05.021 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 139 2026-02-17T11:54:05.021 INFO:tasks.rados.rados.0.trial142.stdout:1351: expect (ObjNum 468 snap 141 seq_num 468) 2026-02-17T11:54:05.192 INFO:tasks.rados.rados.0.trial142.stdout:1352: finishing copy_from racing read to trial14245205-12 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1353: finishing write tid 1 to trial14245205-34 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1352: finishing copy_from to trial14245205-12 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 979 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1353: finishing write tid 2 to trial14245205-34 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1353: finishing write tid 3 to trial14245205-34 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1351: done (4 left) 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1352: done (3 left) 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1356: read oid 36 snap -1 2026-02-17T11:54:05.193 INFO:tasks.rados.rados.0.trial142.stdout:1356: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1357: delete oid 22 current snap is 146 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1353: finishing write tid 4 to trial14245205-34 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1353: oid 34 updating version 0 to 463 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1353: oid 34 updating version 463 to 464 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1353: oid 34 version 464 is already newer than 462 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 464 (ObjNum 484 snap 146 seq_num 484) dirty exists 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1353: left oid 34 (ObjNum 484 snap 146 seq_num 484) 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1354: finishing write tid 1 to trial14245205-8 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1354: finishing write tid 2 to trial14245205-8 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1355: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1354: finishing write tid 3 to trial14245205-8 2026-02-17T11:54:05.194 INFO:tasks.rados.rados.0.trial142.stdout:1355: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1354: finishing write tid 4 to trial14245205-8 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1354: oid 8 updating version 0 to 955 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1354: oid 8 updating version 955 to 956 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1354: oid 8 version 956 is already newer than 954 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 956 (ObjNum 485 snap 146 seq_num 485) dirty exists 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1354: left oid 8 (ObjNum 485 snap 146 seq_num 485) 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:1355: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:54:05.195 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 643 (ObjNum 401 snap 121 seq_num 401) dirty exists 2026-02-17T11:54:05.196 INFO:tasks.rados.rados.0.trial142.stdout:1353: done (4 left) 2026-02-17T11:54:05.196 INFO:tasks.rados.rados.0.trial142.stdout:1354: done (3 left) 2026-02-17T11:54:05.196 INFO:tasks.rados.rados.0.trial142.stdout:1355: done (2 left) 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1357: done (1 left) 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1358: read oid 5 snap -1 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1358: expect (ObjNum 444 snap 134 seq_num 444) 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1359: rollback oid 18 current snap is 146 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 144 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1360: read oid 16 snap -1 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1360: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1361: write oid 25 current snap is 146 2026-02-17T11:54:05.197 INFO:tasks.rados.rados.0.trial142.stdout:1361: seq_num 487 ranges {585009=492855,1564966=620043} 2026-02-17T11:54:05.198 INFO:tasks.rados.rados.0.trial142.stdout:1361: writing trial14245205-25 from 585009 to 1077864 tid 1 2026-02-17T11:54:05.202 INFO:tasks.rados.rados.0.trial142.stdout:1361: writing trial14245205-25 from 1564966 to 2185009 tid 2 2026-02-17T11:54:05.202 INFO:tasks.rados.rados.0.trial142.stdout:1362: write oid 44 current snap is 146 2026-02-17T11:54:05.202 INFO:tasks.rados.rados.0.trial142.stdout:1362: seq_num 488 ranges {601816=568104,1623448=451823} 2026-02-17T11:54:05.206 INFO:tasks.rados.rados.0.trial142.stdout:1362: writing trial14245205-44 from 601816 to 1169920 tid 1 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:1362: writing trial14245205-44 from 1623448 to 2075271 tid 2 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:1363: read oid 26 snap -1 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:1363: expect (ObjNum 462 snap 139 seq_num 462) 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:1364: copy_from oid 6 from oid 15 current snap is 146 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:1359: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:54:05.210 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 986 (ObjNum 129 snap 0 seq_num 1213876992) dirty dne 2026-02-17T11:54:05.211 INFO:tasks.rados.rados.0.trial142.stdout:1359: done (7 left) 2026-02-17T11:54:05.211 INFO:tasks.rados.rados.0.trial142.stdout:1365: snap_create 2026-02-17T11:54:05.211 INFO:tasks.rados.rados.0.trial142.stdout:1356: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:05.357 INFO:tasks.rados.rados.0.trial142.stdout:1358: expect (ObjNum 444 snap 134 seq_num 444) 2026-02-17T11:54:05.493 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:54:05.493 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:54:05.493 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:54:05.494 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:54:05.497 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:54:05.497 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:54:05.497 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:54:05.502 INFO:tasks.rados.rados.0.trial142.stdout:1360: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:54:05.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.564+0000 7f8ec00fa640 10 monclient: get_monmap_and_config 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.564+0000 7f8ec00fa640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.564+0000 7f8ec00fa640 10 monclient: monmap: 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:05.565818+0000 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:05.565818+0000 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 Processor -- start 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 -- start start 2026-02-17T11:54:05.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient: init 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8eb80a3bb0 0x7f8eb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8eb80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8eb80a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8eb813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb806e140 con 0x7f8eb80a0750 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb809f910 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb809ccd0 con 0x7f8eb813b760 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ec00fa640 10 monclient(hunting): authenticate will time out at 1133.184567s 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8eb80a3bb0 0x7f8eb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8eb80a3bb0 0x7f8eb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34374/0 (socket says 10.20.193.51:34374) 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 -- 10.20.193.51:0/484789621 learned_addr learned my addr 10.20.193.51:0/484789621 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): get_auth_request con 0x7f8eb80a3bb0 auth_method 0 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 10 monclient(hunting): get_auth_request con 0x7f8eb813b760 auth_method 0 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 1 -- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 1 -- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:05.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebe670640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient(hunting): handle_auth_done global_id 74559 payload 274 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 -- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 -- 10.20.193.51:0/484789621 >> v1:10.20.193.142:6789/0 conn(0x7f8eb80a0750 legacy=0x7f8eb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 monclient: found mon.noname-a 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.565+0000 7f8ebde6f640 1 -- 10.20.193.51:0/484789621 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb809eec0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebde6f640 1 -- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 msgr2=0x7f8eb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:05.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebde6f640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb809dac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806c1c0 tx=0x7f8ea802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74640bec5707377f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 1 -- 10.20.193.51:0/484789621 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea803c070 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: dump: 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 1 -- 10.20.193.51:0/484789621 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea802fca0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 5 monclient: authenticate success, global_id 74559 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 1 -- 10.20.193.51:0/484789621 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037660 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 4 set_mon_vals no callback set 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ebce6d640 10 monclient: dump: 2026-02-17T11:54:05.575 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 10 monclient: shutdown 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 -- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 msgr2=0x7f8eb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb809dac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806c1c0 tx=0x7f8ea802ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 -- 10.20.193.51:0/484789621 shutdown_connections 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/484789621 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb809dac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 -- 10.20.193.51:0/484789621 >> 10.20.193.51:0/484789621 conn(0x7f8eb80a30c0 msgr2=0x7f8eb80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 -- 10.20.193.51:0/484789621 shutdown_connections 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.568+0000 7f8ec00fa640 1 -- 10.20.193.51:0/484789621 wait complete. 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient: monmap: 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:05.576 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 Processor -- start 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 -- start start 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient: init 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8eb80a0750 0x7f8eb8090830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8eb80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8eb80a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): picked mon.noname-c con 0x7f8eb813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80a04b0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb809c850 con 0x7f8eb80a0750 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb809e710 con 0x7f8eb813b760 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ec00fa640 10 monclient(hunting): authenticate will time out at 1133.188954s 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.569+0000 7f8ebd66e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34390/0 (socket says 10.20.193.51:34390) 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 -- 10.20.193.51:0/2612327595 learned_addr learned my addr 10.20.193.51:0/2612327595 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): get_auth_request con 0x7f8eb80a3bb0 auth_method 0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 10 monclient(hunting): get_auth_request con 0x7f8eb813b760 auth_method 0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb80912b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb80912b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebe670640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebde6f640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8eb80a0750 0x7f8eb8090830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebde6f640 10 monclient(hunting): get_auth_request con 0x7f8eb80a0750 auth_method 0 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebde6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebde6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebde6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient(hunting): handle_auth_done global_id 74562 payload 824 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 msgr2=0x7f8eb80912b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8eb80a0750 msgr2=0x7f8eb8090830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8eb80a0750 0x7f8eb8090830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 monclient: found mon.noname-a 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.570+0000 7f8ebd66e640 1 -- 10.20.193.51:0/2612327595 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb8092330 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ebd66e640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 msgr2=0x7f8eb8090d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ebd66e640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c5d0 tx=0x7f8eac00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac016020 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: dump: 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:05.579 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac012a60 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 5 monclient: authenticate success, global_id 74562 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac012e50 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea7fff640 4 set_mon_vals no callback set 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ea67fc640 10 monclient: dump: 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 10 monclient: _renew_subs 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb809d7b0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 10 monclient: _renew_subs 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.572+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb80945a0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ec00fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ec00fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ec00fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb809dac0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8eac01b400 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ea67fc640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 0x7f8e880403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(316..316 src has 167..316) ==== 4795+0+0 (secure 0 0 0) 0x7f8eac052730 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ebde6f640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 0x7f8e880403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.573+0000 7f8ebde6f640 10 monclient: get_auth_request con 0x7f8e8803df00 auth_method 0 2026-02-17T11:54:05.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.575+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8eac020030 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.575+0000 7f8ea67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.575+0000 7f8ea67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:05.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.576+0000 7f8ebde6f640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 0x7f8e880403c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8036000 tx=0x7f8ea8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ec00fa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ec00fa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ec00fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8eb80008d0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ea67fc640 1 -- 10.20.193.51:0/2612327595 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f8eac01b9b0 con 0x7f8eb80a3bb0 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ea67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:05.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.689+0000 7f8ea67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:05.693 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 msgr2=0x7f8e880403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 0x7f8e880403c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8036000 tx=0x7f8ea8033000 comp rx=0 tx=0).stop 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 10 monclient: shutdown 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 msgr2=0x7f8eb8090d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c5d0 tx=0x7f8eac00caa0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 shutdown_connections 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e8803df00 0x7f8e880403c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8eb813b760 0x7f8eb80912b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8eb80a3bb0 0x7f8eb8090d70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 --2- 10.20.193.51:0/2612327595 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8eb80a0750 0x7f8eb8090830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 >> 10.20.193.51:0/2612327595 conn(0x7f8eb80a30c0 msgr2=0x7f8eb80a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 shutdown_connections 2026-02-17T11:54:05.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:05.690+0000 7f8ec00fa640 1 -- 10.20.193.51:0/2612327595 wait complete. 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: finishing write tid 1 to trial14245205-25 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: finishing write tid 2 to trial14245205-25 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: finishing write tid 3 to trial14245205-25 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: finishing write tid 4 to trial14245205-25 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: oid 25 updating version 0 to 728 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: oid 25 version 728 is already newer than 727 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: oid 25 version 728 is already newer than 726 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 728 (ObjNum 487 snap 146 seq_num 487) dirty exists 2026-02-17T11:54:05.709 INFO:tasks.rados.rados.0.trial142.stdout:1361: left oid 25 (ObjNum 487 snap 146 seq_num 487) 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: finishing write tid 1 to trial14245205-44 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: finishing write tid 2 to trial14245205-44 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: finishing write tid 3 to trial14245205-44 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: finishing write tid 4 to trial14245205-44 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: oid 44 updating version 0 to 303 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: oid 44 version 303 is already newer than 302 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: oid 44 updating version 303 to 304 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 304 (ObjNum 488 snap 146 seq_num 488) dirty exists 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1362: left oid 44 (ObjNum 488 snap 146 seq_num 488) 2026-02-17T11:54:05.710 INFO:tasks.rados.rados.0.trial142.stdout:1363: expect (ObjNum 462 snap 139 seq_num 462) 2026-02-17T11:54:05.884 INFO:tasks.rados.rados.0.trial142.stdout:1364: finishing copy_from racing read to trial14245205-6 2026-02-17T11:54:05.885 INFO:tasks.rados.rados.0.trial142.stdout:1364: finishing copy_from to trial14245205-6 2026-02-17T11:54:05.885 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:06.117 INFO:tasks.rados.rados.0.trial142.stdout:1356: done (7 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1358: done (6 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1360: done (5 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1361: done (4 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1362: done (3 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1363: done (2 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1364: done (1 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1365: done (0 left) 2026-02-17T11:54:06.118 INFO:tasks.rados.rados.0.trial142.stdout:1366: snap_remove snap 145 2026-02-17T11:54:07.119 INFO:tasks.rados.rados.0.trial142.stdout:1366: done (0 left) 2026-02-17T11:54:07.119 INFO:tasks.rados.rados.0.trial142.stdout:1367: write oid 11 current snap is 147 2026-02-17T11:54:07.119 INFO:tasks.rados.rados.0.trial142.stdout:1367: seq_num 489 ranges {618623=643353,1681930=536693} 2026-02-17T11:54:07.124 INFO:tasks.rados.rados.0.trial142.stdout:1367: writing trial14245205-11 from 618623 to 1261976 tid 1 2026-02-17T11:54:07.128 INFO:tasks.rados.rados.0.trial142.stdout:1367: writing trial14245205-11 from 1681930 to 2218623 tid 2 2026-02-17T11:54:07.128 INFO:tasks.rados.rados.0.trial142.stdout:1368: read oid 47 snap -1 2026-02-17T11:54:07.128 INFO:tasks.rados.rados.0.trial142.stdout:1368: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:54:07.128 INFO:tasks.rados.rados.0.trial142.stdout:1369: write (excl) oid 48 current snap is 147 2026-02-17T11:54:07.128 INFO:tasks.rados.rados.0.trial142.stdout:1369: seq_num 490 ranges {635430=718602,2140412=95018} 2026-02-17T11:54:07.133 INFO:tasks.rados.rados.0.trial142.stdout:1369: writing trial14245205-48 from 635430 to 1354032 tid 1 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1369: writing trial14245205-48 from 2140412 to 2235430 tid 2 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1370: snap_create 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: finishing write tid 1 to trial14245205-11 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: finishing write tid 2 to trial14245205-11 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: finishing write tid 3 to trial14245205-11 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: finishing write tid 4 to trial14245205-11 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: oid 11 updating version 0 to 204 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: oid 11 updating version 204 to 205 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: oid 11 version 205 is already newer than 203 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 205 (ObjNum 489 snap 147 seq_num 489) dirty exists 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1367: left oid 11 (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:54:07.138 INFO:tasks.rados.rados.0.trial142.stdout:1368: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:54:07.295 INFO:tasks.rados.rados.0.trial142.stdout:1369: finishing write tid 1 to trial14245205-48 2026-02-17T11:54:07.295 INFO:tasks.rados.rados.0.trial142.stdout:1369: finishing write tid 2 to trial14245205-48 2026-02-17T11:54:07.295 INFO:tasks.rados.rados.0.trial142.stdout:1369: finishing write tid 3 to trial14245205-48 2026-02-17T11:54:07.295 INFO:tasks.rados.rados.0.trial142.stdout:1369: finishing write tid 4 to trial14245205-48 2026-02-17T11:54:07.295 INFO:tasks.rados.rados.0.trial142.stdout:1369: oid 48 updating version 0 to 466 2026-02-17T11:54:07.296 INFO:tasks.rados.rados.0.trial142.stdout:1369: oid 48 updating version 466 to 468 2026-02-17T11:54:07.296 INFO:tasks.rados.rados.0.trial142.stdout:1369: oid 48 version 468 is already newer than 467 2026-02-17T11:54:07.296 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 468 (ObjNum 490 snap 147 seq_num 490) dirty exists 2026-02-17T11:54:07.296 INFO:tasks.rados.rados.0.trial142.stdout:1369: left oid 48 (ObjNum 490 snap 147 seq_num 490) 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1367: done (3 left) 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1368: done (2 left) 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1369: done (1 left) 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1370: done (0 left) 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1371: read oid 36 snap -1 2026-02-17T11:54:08.123 INFO:tasks.rados.rados.0.trial142.stdout:1371: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:08.124 INFO:tasks.rados.rados.0.trial142.stdout:1372: write oid 7 current snap is 148 2026-02-17T11:54:08.124 INFO:tasks.rados.rados.0.trial142.stdout:1372: seq_num 491 ranges {652237=793851,2198894=53343} 2026-02-17T11:54:08.128 INFO:tasks.rados.rados.0.trial142.stdout:1372: writing trial14245205-7 from 652237 to 1446088 tid 1 2026-02-17T11:54:08.132 INFO:tasks.rados.rados.0.trial142.stdout:1372: writing trial14245205-7 from 2198894 to 2252237 tid 2 2026-02-17T11:54:08.132 INFO:tasks.rados.rados.0.trial142.stdout:1373: snap_create 2026-02-17T11:54:08.132 INFO:tasks.rados.rados.0.trial142.stdout:1371: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: finishing write tid 1 to trial14245205-7 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: finishing write tid 2 to trial14245205-7 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: finishing write tid 3 to trial14245205-7 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: finishing write tid 4 to trial14245205-7 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: oid 7 updating version 0 to 1085 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: oid 7 updating version 1085 to 1087 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: oid 7 version 1087 is already newer than 1086 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 1087 (ObjNum 491 snap 148 seq_num 491) dirty exists 2026-02-17T11:54:08.279 INFO:tasks.rados.rados.0.trial142.stdout:1372: left oid 7 (ObjNum 491 snap 148 seq_num 491) 2026-02-17T11:54:08.701 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:54:08.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: get_monmap_and_config 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: build_initial_monmap 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: monmap: 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:08.770110+0000 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:08.770110+0000 2026-02-17T11:54:08.774 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 Processor -- start 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 -- start start 2026-02-17T11:54:08.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: init 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53c00a3bb0 0x7f53c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-a con 0x7f53c00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-b con 0x7f53c00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f53c009e540 0x7f53c013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-c con 0x7f53c009e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:08.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00a3f90 con 0x7f53c00a3bb0 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f53c006e140 con 0x7f53c009e540 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f53c009f910 con 0x7f53c00a0750 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53c6829640 10 monclient(hunting): authenticate will time out at 1136.388838s 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53c00a3bb0 0x7f53c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53c00a3bb0 0x7f53c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34446/0 (socket says 10.20.193.51:34446) 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 1 -- 10.20.193.51:0/864220376 learned_addr learned my addr 10.20.193.51:0/864220376 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 10 monclient(hunting): get_auth_request con 0x7f53c00a3bb0 auth_method 0 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bf7fe640 10 monclient(hunting): get_auth_request con 0x7f53c00a0750 auth_method 0 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.769+0000 7f53bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:08.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bf7fe640 1 -- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bf7fe640 1 -- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bf7fe640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bf7fe640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient(hunting): handle_auth_done global_id 74565 payload 274 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 -- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 -- 10.20.193.51:0/864220376 >> v2:10.20.193.142:3300/0 conn(0x7f53c009e540 msgr2=0x7f53c013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 --2- 10.20.193.51:0/864220376 >> v2:10.20.193.142:3300/0 conn(0x7f53c009e540 0x7f53c013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:08.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 monclient: found mon.noname-a 2026-02-17T11:54:08.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:08.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.770+0000 7f53bffff640 1 -- 10.20.193.51:0/864220376 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c009ccd0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53bffff640 1 -- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 msgr2=0x7f53c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:08.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53bffff640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c009dac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f53c009f230 tx=0x7f53ac02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa59e8a2400ae0c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:08.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 1 -- 10.20.193.51:0/864220376 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac03c070 con 0x7f53c00a3bb0 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: dump: 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: _finish_auth 0 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 1 -- 10.20.193.51:0/864220376 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac02fca0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53c6829640 5 monclient: authenticate success, global_id 74565 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53c6829640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:08.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 1 -- 10.20.193.51:0/864220376 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac037660 con 0x7f53c00a3bb0 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53c6829640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53c6829640 4 set_mon_vals no callback set 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.772+0000 7f53beffd640 10 monclient: dump: 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.791 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 10 monclient: shutdown 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 msgr2=0x7f53c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:08.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c009dac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f53c009f230 tx=0x7f53ac02ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- 10.20.193.51:0/864220376 shutdown_connections 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 --2- 10.20.193.51:0/864220376 >> v2:10.20.193.142:3300/0 conn(0x7f53c009e540 0x7f53c013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 --2- 10.20.193.51:0/864220376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c009dac0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- 10.20.193.51:0/864220376 >> 10.20.193.51:0/864220376 conn(0x7f53c00a30c0 msgr2=0x7f53c00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- 10.20.193.51:0/864220376 shutdown_connections 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- 10.20.193.51:0/864220376 wait complete. 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 10 monclient: build_initial_monmap 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 10 monclient: monmap: 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:08.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 Processor -- start 2026-02-17T11:54:08.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 1 -- start start 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.773+0000 7f53c6829640 10 monclient: init 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c009e540 0x7f53c01cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-b con 0x7f53c009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-c con 0x7f53c00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): picked mon.noname-a con 0x7f53c00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00a04b0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f53c009c850 con 0x7f53c009e540 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f53c013cca0 con 0x7f53c00a0750 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c6829640 10 monclient(hunting): authenticate will time out at 1136.393116s 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54778/0 (socket says 10.20.193.51:54778) 2026-02-17T11:54:08.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34456/0 (socket says 10.20.193.51:34456) 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 -- 10.20.193.51:0/1019198988 learned_addr learned my addr 10.20.193.51:0/1019198988 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 10 monclient(hunting): get_auth_request con 0x7f53c00a0750 auth_method 0 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): get_auth_request con 0x7f53c00a3bb0 auth_method 0 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:08.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c01d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c01d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bf7fe640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bffff640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c009e540 0x7f53c01cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bffff640 10 monclient(hunting): get_auth_request con 0x7f53c009e540 auth_method 0 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:08.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient(hunting): handle_auth_done global_id 74568 payload 824 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 msgr2=0x7f53c01d02e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c009e540 msgr2=0x7f53c01cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c009e540 0x7f53c01cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient: _finish_hunting 0 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 monclient: found mon.noname-a 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.774+0000 7f53c4d9f640 1 -- 10.20.193.51:0/1019198988 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c01337f0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c4d9f640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 msgr2=0x7f53c01310b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c4d9f640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53b400be20 tx=0x7f53b400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b400cbe0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: dump: 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: _finish_auth 0 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: _check_auth_tickets 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4010070 con 0x7f53c00a3bb0 2026-02-17T11:54:08.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 5 monclient: authenticate success, global_id 74568 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 10 monclient: _renew_subs 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c0133130 con 0x7f53c00a3bb0 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b40040f0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53bcff9640 10 monclient: dump: 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:08.802 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53be7fc640 4 set_mon_vals no callback set 2026-02-17T11:54:08.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 10 monclient: _renew_subs 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.776+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c006f8f0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53c6829640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53c6829640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53c6829640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c00a29c0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f53b4004290 con 0x7f53c00a3bb0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53bcff9640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 0x7f5390040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(319..319 src has 167..319) ==== 4767+0+0 (secure 0 0 0) 0x7f53b4052780 con 0x7f53c00a3bb0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53bffff640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 0x7f5390040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:08.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.777+0000 7f53bffff640 10 monclient: get_auth_request con 0x7f539003dd60 auth_method 0 2026-02-17T11:54:08.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.779+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f53c00a29c0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.779+0000 7f53bcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:08.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.779+0000 7f53bcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:08.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.780+0000 7f53bffff640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 0x7f5390040220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53ac036000 tx=0x7f53ac039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53c6829640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53c6829640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53c6829640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f53c009dac0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53bcff9640 1 -- 10.20.193.51:0/1019198988 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f53b401ddf0 con 0x7f53c00a3bb0 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53bcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:08.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.893+0000 7f53bcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:08.897 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 msgr2=0x7f5390040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 0x7f5390040220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53ac036000 tx=0x7f53ac039040 comp rx=0 tx=0).stop 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 10 monclient: shutdown 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 msgr2=0x7f53c01310b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:08.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53b400be20 tx=0x7f53b400bf20 comp rx=0 tx=0).stop 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 shutdown_connections 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539003dd60 0x7f5390040220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c00a3bb0 0x7f53c01310b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c00a0750 0x7f53c01d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 --2- 10.20.193.51:0/1019198988 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c009e540 0x7f53c01cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 >> 10.20.193.51:0/1019198988 conn(0x7f53c00a30c0 msgr2=0x7f53c0072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 shutdown_connections 2026-02-17T11:54:08.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:08.894+0000 7f53c6829640 1 -- 10.20.193.51:0/1019198988 wait complete. 2026-02-17T11:54:09.125 INFO:tasks.rados.rados.0.trial142.stdout:1371: done (2 left) 2026-02-17T11:54:09.125 INFO:tasks.rados.rados.0.trial142.stdout:1372: done (1 left) 2026-02-17T11:54:09.125 INFO:tasks.rados.rados.0.trial142.stdout:1373: done (0 left) 2026-02-17T11:54:09.126 INFO:tasks.rados.rados.0.trial142.stdout:1374: delete oid 40 current snap is 149 2026-02-17T11:54:09.128 INFO:tasks.rados.rados.0.trial142.stdout:1374: done (0 left) 2026-02-17T11:54:09.128 INFO:tasks.rados.rados.0.trial142.stdout:1375: read oid 13 snap 140 2026-02-17T11:54:09.129 INFO:tasks.rados.rados.0.trial142.stdout:1375: expect (ObjNum 445 snap 134 seq_num 445) 2026-02-17T11:54:09.129 INFO:tasks.rados.rados.0.trial142.stdout:1376: copy_from oid 46 from oid 17 current snap is 149 2026-02-17T11:54:09.129 INFO:tasks.rados.rados.0.trial142.stdout:1377: snap_create 2026-02-17T11:54:09.130 INFO:tasks.rados.rados.0.trial142.stdout:1376: finishing copy_from to trial14245205-46 2026-02-17T11:54:09.130 INFO:tasks.rados.rados.0.trial142.stdout:1376: got expected ENOENT (src dne) 2026-02-17T11:54:09.130 INFO:tasks.rados.rados.0.trial142.stdout:1376: finishing copy_from racing read to trial14245205-46 2026-02-17T11:54:09.134 INFO:tasks.rados.rados.0.trial142.stdout:1375: expect (ObjNum 445 snap 134 seq_num 445) 2026-02-17T11:54:09.995 INFO:tasks.rados.rados.0.trial142.stdout:1375: done (2 left) 2026-02-17T11:54:09.995 INFO:tasks.rados.rados.0.trial142.stdout:1376: done (1 left) 2026-02-17T11:54:09.995 INFO:tasks.rados.rados.0.trial142.stdout:1377: done (0 left) 2026-02-17T11:54:09.995 INFO:tasks.rados.rados.0.trial142.stdout:1378: copy_from oid 5 from oid 6 current snap is 150 2026-02-17T11:54:09.996 INFO:tasks.rados.rados.0.trial142.stdout:1379: write oid 40 current snap is 150 2026-02-17T11:54:09.996 INFO:tasks.rados.rados.0.trial142.stdout:1379: seq_num 493 ranges {685851=544349,1799505=486346} 2026-02-17T11:54:10.000 INFO:tasks.rados.rados.0.trial142.stdout:1379: writing trial14245205-40 from 685851 to 1230200 tid 1 2026-02-17T11:54:10.004 INFO:tasks.rados.rados.0.trial142.stdout:1379: writing trial14245205-40 from 1799505 to 2285851 tid 2 2026-02-17T11:54:10.004 INFO:tasks.rados.rados.0.trial142.stdout:1380: snap_remove snap 142 2026-02-17T11:54:10.996 INFO:tasks.rados.rados.0.trial142.stdout:1380: done (2 left) 2026-02-17T11:54:10.996 INFO:tasks.rados.rados.0.trial142.stdout:1381: write oid 25 current snap is 150 2026-02-17T11:54:10.996 INFO:tasks.rados.rados.0.trial142.stdout:1379: finishing write tid 1 to trial14245205-40 2026-02-17T11:54:10.996 INFO:tasks.rados.rados.0.trial142.stdout:1381: seq_num 494 ranges {702658=619598,1857987=444671} 2026-02-17T11:54:11.001 INFO:tasks.rados.rados.0.trial142.stdout:1381: writing trial14245205-25 from 702658 to 1322256 tid 1 2026-02-17T11:54:11.007 INFO:tasks.rados.rados.0.trial142.stdout:1381: writing trial14245205-25 from 1857987 to 2302658 tid 2 2026-02-17T11:54:11.007 INFO:tasks.rados.rados.0.trial142.stdout:1382: read oid 7 snap -1 2026-02-17T11:54:11.007 INFO:tasks.rados.rados.0.trial142.stdout:1382: expect (ObjNum 491 snap 148 seq_num 491) 2026-02-17T11:54:11.007 INFO:tasks.rados.rados.0.trial142.stdout:1383: rollback oid 44 current snap is 150 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 144 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:1378: finishing copy_from racing read to trial14245205-5 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:1379: finishing write tid 2 to trial14245205-40 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:1379: finishing write tid 3 to trial14245205-40 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:1379: finishing write tid 4 to trial14245205-40 2026-02-17T11:54:11.008 INFO:tasks.rados.rados.0.trial142.stdout:1379: oid 40 updating version 0 to 646 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:1379: oid 40 updating version 646 to 647 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:1379: oid 40 version 647 is already newer than 645 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 647 (ObjNum 493 snap 150 seq_num 493) dirty exists 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:1379: left oid 40 (ObjNum 493 snap 150 seq_num 493) 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:1378: finishing copy_from to trial14245205-5 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:11.009 INFO:tasks.rados.rados.0.trial142.stdout:1381: finishing write tid 1 to trial14245205-25 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:1378: done (4 left) 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:1379: done (3 left) 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:1384: snap_create 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:1383: finishing rollback tid 0 to trial14245205-44 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:1383: finishing rollback tid 1 to trial14245205-44 2026-02-17T11:54:11.010 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 311 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: finishing write tid 2 to trial14245205-25 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: finishing write tid 3 to trial14245205-25 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: finishing write tid 4 to trial14245205-25 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: oid 25 updating version 0 to 729 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: oid 25 updating version 729 to 731 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: oid 25 version 731 is already newer than 730 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 731 (ObjNum 494 snap 150 seq_num 494) dirty exists 2026-02-17T11:54:11.011 INFO:tasks.rados.rados.0.trial142.stdout:1381: left oid 25 (ObjNum 494 snap 150 seq_num 494) 2026-02-17T11:54:11.012 INFO:tasks.rados.rados.0.trial142.stdout:1382: expect (ObjNum 491 snap 148 seq_num 491) 2026-02-17T11:54:11.905 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:54:11.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.972+0000 7f729b83b640 10 monclient: get_monmap_and_config 2026-02-17T11:54:11.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.972+0000 7f729b83b640 10 monclient: build_initial_monmap 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.972+0000 7f729b83b640 10 monclient: monmap: 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:11.973708+0000 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:11.973708+0000 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:11.975 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:11.976 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:11.976 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:11.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:11.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 Processor -- start 2026-02-17T11:54:11.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 -- start start 2026-02-17T11:54:11.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient: init 2026-02-17T11:54:11.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-b con 0x7f72940a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f72940a0750 0x7f729409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-c con 0x7f72940a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f729409e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729406e140 con 0x7f729409e540 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f72940a3f90 con 0x7f72940a0750 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:11.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f729409f910 con 0x7f72940a3bb0 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f729b83b640 10 monclient(hunting): authenticate will time out at 1139.592512s 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54796/0 (socket says 10.20.193.51:54796) 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 -- 10.20.193.51:0/2904596272 learned_addr learned my addr 10.20.193.51:0/2904596272 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 10 monclient(hunting): get_auth_request con 0x7f72940a3bb0 auth_method 0 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 -- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 -- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:11.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f72995b0640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 1 --2- 10.20.193.51:0/2904596272 >> v2:10.20.193.142:3300/0 conn(0x7f72940a0750 0x7f729409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): get_auth_request con 0x7f72940a0750 auth_method 0 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.973+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 10 monclient(hunting): handle_auth_done global_id 114160 payload 274 2026-02-17T11:54:11.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 1 -- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 1 -- 10.20.193.51:0/2904596272 >> v1:10.20.193.142:6789/0 conn(0x7f729409e540 legacy=0x7f729413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 10 monclient: _finish_hunting 0 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 1 monclient: found mon.noname-c 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.974+0000 7f7298daf640 1 -- 10.20.193.51:0/2904596272 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729409ccd0 con 0x7f72940a0750 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.976+0000 7f7298daf640 1 -- 10.20.193.51:0/2904596272 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f72940a0750 msgr2=0x7f729409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.976+0000 7f7298daf640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f72940a0750 0x7f729409e000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7294069d60 tx=0x7f728802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a332fb12c339bf70 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.976+0000 7f7283fff640 1 -- 10.20.193.51:0/2904596272 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728803c070 con 0x7f72940a0750 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.976+0000 7f7283fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:11.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: dump: 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:11.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 1 -- 10.20.193.51:0/2904596272 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728802fbd0 con 0x7f72940a0750 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 1 -- 10.20.193.51:0/2904596272 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288037440 con 0x7f72940a0750 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 5 monclient: authenticate success, global_id 114160 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 4 set_mon_vals no callback set 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:11.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f7283fff640 10 monclient: dump: 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:11.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 10 monclient: shutdown 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 -- 10.20.193.51:0/2904596272 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f72940a0750 msgr2=0x7f729409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f72940a0750 0x7f729409e000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7294069d60 tx=0x7f728802ed50 comp rx=0 tx=0).stop 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 -- 10.20.193.51:0/2904596272 shutdown_connections 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f72940a0750 0x7f729409e000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 --2- 10.20.193.51:0/2904596272 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 -- 10.20.193.51:0/2904596272 >> 10.20.193.51:0/2904596272 conn(0x7f72940a30c0 msgr2=0x7f72940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 -- 10.20.193.51:0/2904596272 shutdown_connections 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 -- 10.20.193.51:0/2904596272 wait complete. 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 10 monclient: build_initial_monmap 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 10 monclient: monmap: 2026-02-17T11:54:11.993 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.977+0000 7f729b83b640 1 Processor -- start 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 -- start start 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient: init 2026-02-17T11:54:11.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f729409e540 0x7f7294099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-b con 0x7f729409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 0x7f729408e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-a con 0x7f72940a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): picked mon.noname-c con 0x7f72940a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f72940a04b0 con 0x7f72940a0750 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f729409c850 con 0x7f729409e540 2026-02-17T11:54:11.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f729413de80 con 0x7f72940a3bb0 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f729b83b640 10 monclient(hunting): authenticate will time out at 1139.597495s 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 0x7f729408e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54800/0 (socket says 10.20.193.51:54800) 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 -- 10.20.193.51:0/510926735 learned_addr learned my addr 10.20.193.51:0/510926735 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): get_auth_request con 0x7f72940a0750 auth_method 0 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:11.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 10 monclient(hunting): get_auth_request con 0x7f72940a3bb0 auth_method 0 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729408ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729408ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:11.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f72995b0640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f729409e540 0x7f7294099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7299db1640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f72995b0640 10 monclient(hunting): get_auth_request con 0x7f729409e540 auth_method 0 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f72995b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f72995b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f72995b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient(hunting): handle_auth_done global_id 74571 payload 824 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 msgr2=0x7f729408ef20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f729409e540 msgr2=0x7f7294099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f729409e540 0x7f7294099dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient: _finish_hunting 0 2026-02-17T11:54:11.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 monclient: found mon.noname-a 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.978+0000 7f7298daf640 1 -- 10.20.193.51:0/510926735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7294099440 con 0x7f72940a0750 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7298daf640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 msgr2=0x7f729408e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7298daf640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 0x7f729408e9e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7288036000 tx=0x7f72880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288046070 con 0x7f72940a0750 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 10 monclient: dump: 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:11.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7288037e50 con 0x7f72940a0750 2026-02-17T11:54:12.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f729b83b640 5 monclient: authenticate success, global_id 74571 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f729b83b640 10 monclient: _renew_subs 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f729b83b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.980+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7294091ed0 con 0x7f72940a0750 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728803c040 con 0x7f72940a0750 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 10 monclient: dump: 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f72837fe640 4 set_mon_vals no callback set 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 10 monclient: _renew_subs 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729409a300 con 0x7f72940a0750 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72940a24c0 con 0x7f72940a0750 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7288041af0 con 0x7f72940a0750 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 0x7f72640401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(322..322 src has 167..322) ==== 4779+0+0 (secure 0 0 0) 0x7f7288077e20 con 0x7f72940a0750 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f72995b0640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 0x7f72640401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.981+0000 7f72995b0640 10 monclient: get_auth_request con 0x7f726403dd10 auth_method 0 2026-02-17T11:54:12.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.984+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f72940a24c0 con 0x7f72940a0750 2026-02-17T11:54:12.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.984+0000 7f7281ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.984+0000 7f7281ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:12.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:11.984+0000 7f72995b0640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 0x7f72640401d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7284006fd0 tx=0x7f7284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f729b83b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f729b83b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f729b83b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f729409dac0 con 0x7f72940a0750 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f7281ffb640 1 -- 10.20.193.51:0/510926735 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f7288040c70 con 0x7f72940a0750 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f7281ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:12.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.097+0000 7f7281ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:12.100 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 msgr2=0x7f72640401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 0x7f72640401d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7284006fd0 tx=0x7f7284008040 comp rx=0 tx=0).stop 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 10 monclient: shutdown 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 msgr2=0x7f729408e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 0x7f729408e9e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7288036000 tx=0x7f72880047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 shutdown_connections 2026-02-17T11:54:12.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f726403dd10 0x7f72640401d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f72940a3bb0 0x7f729408ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f72940a0750 0x7f729408e9e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 --2- 10.20.193.51:0/510926735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f729409e540 0x7f7294099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 >> 10.20.193.51:0/510926735 conn(0x7f72940a30c0 msgr2=0x7f7294072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 shutdown_connections 2026-02-17T11:54:12.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.098+0000 7f729b83b640 1 -- 10.20.193.51:0/510926735 wait complete. 2026-02-17T11:54:12.107 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:54:12.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:54:12.108 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:54:12.131 INFO:tasks.rados.rados.0.trial142.stdout:1381: done (3 left) 2026-02-17T11:54:12.131 INFO:tasks.rados.rados.0.trial142.stdout:1382: done (2 left) 2026-02-17T11:54:12.131 INFO:tasks.rados.rados.0.trial142.stdout:1383: done (1 left) 2026-02-17T11:54:12.131 INFO:tasks.rados.rados.0.trial142.stdout:1384: done (0 left) 2026-02-17T11:54:12.132 INFO:tasks.rados.rados.0.trial142.stdout:1385: delete oid 29 current snap is 151 2026-02-17T11:54:12.134 INFO:tasks.rados.rados.0.trial142.stdout:1385: done (0 left) 2026-02-17T11:54:12.134 INFO:tasks.rados.rados.0.trial142.stdout:1386: rollback oid 49 current snap is 151 2026-02-17T11:54:12.134 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 132 2026-02-17T11:54:12.134 INFO:tasks.rados.rados.0.trial142.stdout:1387: snap_create 2026-02-17T11:54:12.136 INFO:tasks.rados.rados.0.trial142.stdout:1386: finishing rollback tid 0 to trial14245205-49 2026-02-17T11:54:12.136 INFO:tasks.rados.rados.0.trial142.stdout:1386: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:54:12.136 INFO:tasks.rados.rados.0.trial142.stdout:1386: finishing rollback tid 2 to trial14245205-49 2026-02-17T11:54:12.136 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1095 (ObjNum 386 snap 120 seq_num 386) dirty exists 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: get_monmap_and_config 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: build_initial_monmap 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: monmap: 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:12.175280+0000 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:12.175280+0000 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:12.176 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:12.177 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 1 Processor -- start 2026-02-17T11:54:12.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 1 -- start start 2026-02-17T11:54:12.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: init 2026-02-17T11:54:12.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-b con 0x7fd31c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd31c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.174+0000 7fd321e32640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd31c13b760 0x7fd31c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-c con 0x7fd31c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c06e140 con 0x7fd31c0a0750 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd31c09f910 con 0x7fd31c13b760 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c09ccd0 con 0x7fd31c0a3bb0 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd321e32640 10 monclient(hunting): authenticate will time out at 1139.794027s 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54814/0 (socket says 10.20.193.51:54814) 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 -- 10.20.193.51:0/857605271 learned_addr learned my addr 10.20.193.51:0/857605271 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 10 monclient(hunting): get_auth_request con 0x7fd31c0a3bb0 auth_method 0 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 -- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 -- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:12.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 --2- 10.20.193.51:0/857605271 >> v2:10.20.193.142:3300/0 conn(0x7fd31c13b760 0x7fd31c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31b7fe640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): get_auth_request con 0x7fd31c13b760 auth_method 0 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient(hunting): handle_auth_done global_id 114166 payload 274 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 -- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 -- 10.20.193.51:0/857605271 >> v1:10.20.193.142:6789/0 conn(0x7fd31c0a0750 legacy=0x7fd31c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 monclient: found mon.noname-c 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.175+0000 7fd31bfff640 1 -- 10.20.193.51:0/857605271 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c09eec0 con 0x7fd31c13b760 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31bfff640 1 -- 10.20.193.51:0/857605271 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 msgr2=0x7fd31c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31bfff640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd31c09f230 tx=0x7fd31002f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbffbe5ad658f90c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 1 -- 10.20.193.51:0/857605271 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31003c070 con 0x7fd31c13b760 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:12.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: dump: 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 1 -- 10.20.193.51:0/857605271 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd310037440 con 0x7fd31c13b760 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 5 monclient: authenticate success, global_id 114166 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 1 -- 10.20.193.51:0/857605271 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd310037810 con 0x7fd31c13b760 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 4 set_mon_vals no callback set 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd31a7fc640 10 monclient: dump: 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 10 monclient: shutdown 2026-02-17T11:54:12.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 -- 10.20.193.51:0/857605271 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 msgr2=0x7fd31c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd31c09f230 tx=0x7fd31002f150 comp rx=0 tx=0).stop 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 -- 10.20.193.51:0/857605271 shutdown_connections 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13db50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 --2- 10.20.193.51:0/857605271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 -- 10.20.193.51:0/857605271 >> 10.20.193.51:0/857605271 conn(0x7fd31c0a30c0 msgr2=0x7fd31c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 -- 10.20.193.51:0/857605271 shutdown_connections 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.178+0000 7fd321e32640 1 -- 10.20.193.51:0/857605271 wait complete. 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient: build_initial_monmap 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient: monmap: 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:12.195 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 Processor -- start 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 -- start start 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient: init 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:12.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 0x7fd31c09a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-a con 0x7fd31c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-c con 0x7fd31c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): picked mon.noname-b con 0x7fd31c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0a04b0 con 0x7fd31c0a0750 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c09c850 con 0x7fd31c13b760 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c09e710 con 0x7fd31c0a3bb0 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd321e32640 10 monclient(hunting): authenticate will time out at 1139.798583s 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 0x7fd31c09a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54824/0 (socket says 10.20.193.51:54824) 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 learned_addr learned my addr 10.20.193.51:0/3289170302 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 10 monclient(hunting): get_auth_request con 0x7fd31c0a3bb0 auth_method 0 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): get_auth_request con 0x7fd31c0a0750 auth_method 0 2026-02-17T11:54:12.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c13a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c13a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31bfff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31bfff640 10 monclient(hunting): get_auth_request con 0x7fd31c13b760 auth_method 0 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient(hunting): handle_auth_done global_id 74574 payload 824 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 msgr2=0x7fd31c13a770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd31c0a3bb0 0x7fd31c13a770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 msgr2=0x7fd31c13acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd31c13b760 0x7fd31c13acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.179+0000 7fd31b7fe640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0a2a60 con 0x7fd31c0a0750 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31b7fe640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 msgr2=0x7fd31c09a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31b7fe640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 0x7fd31c09a000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd30800d7d0 tx=0x7fd30800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30800bae0 con 0x7fd31c0a0750 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: dump: 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30800bcc0 con 0x7fd31c0a0750 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 5 monclient: authenticate success, global_id 74574 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 monclient: _renew_subs 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c096230 con 0x7fd31c0a0750 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308004020 con 0x7fd31c0a0750 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 10 monclient: dump: 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.203 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd319ffb640 4 set_mon_vals no callback set 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 monclient: _renew_subs 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c094de0 con 0x7fd31c0a0750 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 0x7fd31c093140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c13b5d0 con 0x7fd31c13b1f0 2026-02-17T11:54:12.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 0x7fd31c093140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient: get_auth_request con 0x7fd31c13b1f0 auth_method 0 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd308013070 con 0x7fd31c0a0750 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 10 monclient(hunting): handle_auth_done global_id 74577 payload 824 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.182+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd31c095f50 con 0x7fd31c13b1f0 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.183+0000 7fd2f7fff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2ec03dd10 0x7fd2ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.183+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(323..323 src has 167..323) ==== 4751+0+0 (secure 0 0 0) 0x7fd308052530 con 0x7fd31c0a0750 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.183+0000 7fd31bfff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2ec03dd10 0x7fd2ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.183+0000 7fd31bfff640 10 monclient: get_auth_request con 0x7fd2ec03dd10 auth_method 0 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 msgr2=0x7fd31c093140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 0x7fd31c093140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd31c094100 tx=0x7fd30c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c006ae0 con 0x7fd31c13b1f0 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 10 monclient: dump: 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd30c006ae0 con 0x7fd31c13b1f0 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 msgr2=0x7fd31c093140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 0x7fd31c093140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd31c094100 tx=0x7fd30c00eba0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 msgr2=0x7fd31c093140 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:12.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.185+0000 7fd2f7fff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c13b1f0 0x7fd31c093140 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd31c094100 tx=0x7fd30c00eba0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.186+0000 7fd31bfff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2ec03dd10 0x7fd2ec0401d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd31c069d60 tx=0x7fd310033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd321e32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd321e32640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 0x7fd31c1d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd321e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c09dac0 con 0x7fd31c08d3f0 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 0x7fd31c1d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient: get_auth_request con 0x7fd31c08d3f0 auth_method 0 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 10 monclient(hunting): handle_auth_done global_id 74580 payload 824 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.188+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd31c0008d0 con 0x7fd31c08d3f0 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd31affd640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 msgr2=0x7fd31c1d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd31affd640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 0x7fd31c1d88a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd30c018000 tx=0x7fd30c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c003230 con 0x7fd31c08d3f0 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 10 monclient: dump: 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.211 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fd30c003230 con 0x7fd31c08d3f0 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 msgr2=0x7fd31c1d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 0x7fd31c1d88a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd30c018000 tx=0x7fd30c003860 comp rx=0 tx=0).stop 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 msgr2=0x7fd31c1d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:12.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.190+0000 7fd2f7fff640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c08d3f0 0x7fd31c1d88a0 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd30c018000 tx=0x7fd30c003860 comp rx=0 tx=0).stop 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 270121, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:54:12.213 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:12.214 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:12.215 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:12.216 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:12.217 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:12.218 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:12.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:12.220 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.221 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:12.222 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:54:12.223 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:12.223 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:12.223 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:12.223 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:12.223 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2ec03dd10 msgr2=0x7fd2ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd2ec03dd10 0x7fd2ec0401d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd31c069d60 tx=0x7fd310033000 comp rx=0 tx=0).stop 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 10 monclient: shutdown 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 msgr2=0x7fd31c09a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 0x7fd31c09a000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd30800d7d0 tx=0x7fd30800dca0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd31bfff640 1 -- 10.20.193.51:0/3289170302 reap_dead start 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 shutdown_connections 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 --2- 10.20.193.51:0/3289170302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd31c0a0750 0x7fd31c09a000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 >> 10.20.193.51:0/3289170302 conn(0x7fd31c0a30c0 msgr2=0x7fd31c0a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:12.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 shutdown_connections 2026-02-17T11:54:12.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.191+0000 7fd321e32640 1 -- 10.20.193.51:0/3289170302 wait complete. 2026-02-17T11:54:12.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:12.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:54:12.225 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:54:12.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.289+0000 7fb05c522640 10 monclient: get_monmap_and_config 2026-02-17T11:54:12.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.289+0000 7fb05c522640 10 monclient: build_initial_monmap 2026-02-17T11:54:12.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.289+0000 7fb05c522640 10 monclient: monmap: 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:12.290872+0000 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:12.290872+0000 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:12.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 Processor -- start 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 -- start start 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient: init 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0540a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-b con 0x7fb05409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0540a0110 0x7fb05413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-a con 0x7fb0540a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05406e140 con 0x7fb0540a3bb0 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb05409aed0 con 0x7fb0540a0110 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb05409caa0 con 0x7fb05409dac0 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05c522640 10 monclient(hunting): authenticate will time out at 1139.909639s 2026-02-17T11:54:12.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0540a0110 0x7fb05413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54836/0 (socket says 10.20.193.51:54836) 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0540a0110 0x7fb05413c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34488/0 (socket says 10.20.193.51:34488) 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 -- 10.20.193.51:0/1613461305 learned_addr learned my addr 10.20.193.51:0/1613461305 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 10 monclient(hunting): get_auth_request con 0x7fb05409dac0 auth_method 0 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): get_auth_request con 0x7fb0540a0110 auth_method 0 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 -- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb05409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 -- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb05409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb059a96640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient(hunting): handle_auth_done global_id 74583 payload 274 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 -- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb05409fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 -- 10.20.193.51:0/1613461305 >> v1:10.20.193.142:6789/0 conn(0x7fb0540a3bb0 legacy=0x7fb05409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient: _finish_hunting 0 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 monclient: found mon.noname-a 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.290+0000 7fb05aa98640 1 -- 10.20.193.51:0/1613461305 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05409ce60 con 0x7fb0540a0110 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb05aa98640 1 -- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a0110 msgr2=0x7fb05413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb05aa98640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a0110 0x7fb05413c760 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e10 tx=0x7fb05002f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e513870b387475 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 1 -- 10.20.193.51:0/1613461305 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05003c070 con 0x7fb0540a0110 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: dump: 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.305 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: _finish_auth 0 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: _check_auth_tickets 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 1 -- 10.20.193.51:0/1613461305 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb050037440 con 0x7fb0540a0110 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb05c522640 5 monclient: authenticate success, global_id 74583 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 1 -- 10.20.193.51:0/1613461305 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050037810 con 0x7fb0540a0110 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb059295640 10 monclient: dump: 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb05c522640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.293+0000 7fb05c522640 4 set_mon_vals no callback set 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 10 monclient: shutdown 2026-02-17T11:54:12.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a0110 msgr2=0x7fb05413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a0110 0x7fb05413c760 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e10 tx=0x7fb05002f0f0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- 10.20.193.51:0/1613461305 shutdown_connections 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a0110 0x7fb05413c760 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 --2- 10.20.193.51:0/1613461305 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb05409fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- 10.20.193.51:0/1613461305 >> 10.20.193.51:0/1613461305 conn(0x7fb0540a30c0 msgr2=0x7fb0540a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- 10.20.193.51:0/1613461305 shutdown_connections 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- 10.20.193.51:0/1613461305 wait complete. 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 10 monclient: build_initial_monmap 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 10 monclient: monmap: 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:12.308 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 Processor -- start 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 1 -- start start 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.294+0000 7fb05c522640 10 monclient: init 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-c con 0x7fb05409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:12.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0540a0110 0x7fb054099880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-b con 0x7fb0540a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): picked mon.noname-a con 0x7fb0540a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb0540a0540 con 0x7fb0540a3bb0 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb05409a880 con 0x7fb0540a0110 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb05409e370 con 0x7fb05409dac0 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05c522640 10 monclient(hunting): authenticate will time out at 1139.914104s 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34498/0 (socket says 10.20.193.51:34498) 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:54842/0 (socket says 10.20.193.51:54842) 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 learned_addr learned my addr 10.20.193.51:0/2017947330 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): get_auth_request con 0x7fb0540a3bb0 auth_method 0 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 10 monclient(hunting): get_auth_request con 0x7fb05409dac0 auth_method 0 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:12.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb054090b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb054090b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient(hunting): handle_auth_done global_id 74586 payload 824 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 msgr2=0x7fb054090b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb05409dac0 0x7fb054090b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0540a0110 msgr2=0x7fb054099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0540a0110 0x7fb054099880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient: _finish_hunting 0 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 monclient: found mon.noname-a 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.295+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05409a300 con 0x7fb0540a3bb0 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 msgr2=0x7fb054099dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05aa98640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e10 tx=0x7fb050004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05003c050 con 0x7fb0540a3bb0 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: dump: 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.313 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb050048070 con 0x7fb0540a3bb0 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050041c80 con 0x7fb0540a3bb0 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb058a94640 4 set_mon_vals no callback set 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb03affd640 10 monclient: dump: 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:12.314 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 5 monclient: authenticate success, global_id 74586 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 10 monclient: _renew_subs 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05409d7b0 con 0x7fb0540a3bb0 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 10 monclient: _renew_subs 2026-02-17T11:54:12.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.297+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb054093d50 con 0x7fb0540a3bb0 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05c522640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb054091b30 con 0x7fb0541caa30 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541caa30 auth_method 0 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:12.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb05004d460 con 0x7fb0540a3bb0 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb03affd640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 0x7fb0240401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(323..323 src has 167..323) ==== 4751+0+0 (secure 0 0 0) 0x7fb0500785b0 con 0x7fb0540a3bb0 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb059a96640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 0x7fb0240401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.298+0000 7fb059a96640 10 monclient: get_auth_request con 0x7fb02403dd10 auth_method 0 2026-02-17T11:54:12.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.301+0000 7fb059a96640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 0x7fb0240401d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb05406fb70 tx=0x7fb048008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541caa30 auth_method 0 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:12.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:12.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:12.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.499+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:54:12.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:12.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541caa30 auth_method 0 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:12.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:12.900+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:54:13.132 INFO:tasks.rados.rados.0.trial142.stdout:1386: done (1 left) 2026-02-17T11:54:13.133 INFO:tasks.rados.rados.0.trial142.stdout:1387: done (0 left) 2026-02-17T11:54:13.133 INFO:tasks.rados.rados.0.trial142.stdout:1388: snap_remove snap 140 2026-02-17T11:54:13.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541caa30 auth_method 0 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:13.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:13.701+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:54:14.133 INFO:tasks.rados.rados.0.trial142.stdout:1388: done (0 left) 2026-02-17T11:54:14.133 INFO:tasks.rados.rados.0.trial142.stdout:1389: delete oid 38 current snap is 152 2026-02-17T11:54:14.138 INFO:tasks.rados.rados.0.trial142.stdout:1389: done (0 left) 2026-02-17T11:54:14.138 INFO:tasks.rados.rados.0.trial142.stdout:1390: delete oid 8 current snap is 152 2026-02-17T11:54:14.140 INFO:tasks.rados.rados.0.trial142.stdout:1390: done (0 left) 2026-02-17T11:54:14.141 INFO:tasks.rados.rados.0.trial142.stdout:1391: rollback oid 13 current snap is 152 2026-02-17T11:54:14.141 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 13 to 148 2026-02-17T11:54:14.141 INFO:tasks.rados.rados.0.trial142.stdout:1392: write oid 14 current snap is 152 2026-02-17T11:54:14.141 INFO:tasks.rados.rados.0.trial142.stdout:1392: seq_num 498 ranges {769886=636947,2091915=277971} 2026-02-17T11:54:14.146 INFO:tasks.rados.rados.0.trial142.stdout:1392: writing trial14245205-14 from 769886 to 1406833 tid 1 2026-02-17T11:54:14.150 INFO:tasks.rados.rados.0.trial142.stdout:1392: writing trial14245205-14 from 2091915 to 2369886 tid 2 2026-02-17T11:54:14.150 INFO:tasks.rados.rados.0.trial142.stdout:1393: read oid 12 snap -1 2026-02-17T11:54:14.150 INFO:tasks.rados.rados.0.trial142.stdout:1393: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:54:14.150 INFO:tasks.rados.rados.0.trial142.stdout:1394: write oid 30 current snap is 152 2026-02-17T11:54:14.150 INFO:tasks.rados.rados.0.trial142.stdout:1394: seq_num 499 ranges {786693=712196,2150397=236296} 2026-02-17T11:54:14.156 INFO:tasks.rados.rados.0.trial142.stdout:1394: writing trial14245205-30 from 786693 to 1498889 tid 1 2026-02-17T11:54:14.159 INFO:tasks.rados.rados.0.trial142.stdout:1394: writing trial14245205-30 from 2150397 to 2386693 tid 2 2026-02-17T11:54:14.159 INFO:tasks.rados.rados.0.trial142.stdout:1395: write oid 20 current snap is 152 2026-02-17T11:54:14.159 INFO:tasks.rados.rados.0.trial142.stdout:1395: seq_num 500 ranges {403500=787445,1692526=473837} 2026-02-17T11:54:14.163 INFO:tasks.rados.rados.0.trial142.stdout:1395: writing trial14245205-20 from 403500 to 1190945 tid 1 2026-02-17T11:54:14.167 INFO:tasks.rados.rados.0.trial142.stdout:1395: writing trial14245205-20 from 1692526 to 2166363 tid 2 2026-02-17T11:54:14.167 INFO:tasks.rados.rados.0.trial142.stdout:1396: write (excl) oid 26 current snap is 152 2026-02-17T11:54:14.167 INFO:tasks.rados.rados.0.trial142.stdout:1396: seq_num 501 ranges {420307=462694,1351008=617495} 2026-02-17T11:54:14.170 INFO:tasks.rados.rados.0.trial142.stdout:1396: writing trial14245205-26 from 420307 to 883001 tid 1 2026-02-17T11:54:14.175 INFO:tasks.rados.rados.0.trial142.stdout:1396: writing trial14245205-26 from 1351008 to 1968503 tid 2 2026-02-17T11:54:14.175 INFO:tasks.rados.rados.0.trial142.stdout:1397: snap_create 2026-02-17T11:54:14.175 INFO:tasks.rados.rados.0.trial142.stdout:1391: finishing rollback tid 1 to trial14245205-13 2026-02-17T11:54:14.175 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 952 (ObjNum 177 snap 0 seq_num 324778628) dirty dne 2026-02-17T11:54:14.175 INFO:tasks.rados.rados.0.trial142.stdout:1392: finishing write tid 1 to trial14245205-14 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: finishing write tid 2 to trial14245205-14 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: finishing write tid 3 to trial14245205-14 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: finishing write tid 4 to trial14245205-14 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: oid 14 updating version 0 to 1109 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: oid 14 version 1109 is already newer than 1107 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: oid 14 version 1109 is already newer than 1108 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1109 (ObjNum 498 snap 152 seq_num 498) dirty exists 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1392: left oid 14 (ObjNum 498 snap 152 seq_num 498) 2026-02-17T11:54:14.176 INFO:tasks.rados.rados.0.trial142.stdout:1393: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: finishing write tid 1 to trial14245205-30 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: finishing write tid 2 to trial14245205-30 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: finishing write tid 3 to trial14245205-30 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: finishing write tid 4 to trial14245205-30 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: oid 30 updating version 0 to 471 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: oid 30 updating version 471 to 472 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: oid 30 version 472 is already newer than 470 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 472 (ObjNum 499 snap 152 seq_num 499) dirty exists 2026-02-17T11:54:14.288 INFO:tasks.rados.rados.0.trial142.stdout:1394: left oid 30 (ObjNum 499 snap 152 seq_num 499) 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: finishing write tid 1 to trial14245205-20 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: finishing write tid 2 to trial14245205-20 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: finishing write tid 3 to trial14245205-20 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: finishing write tid 4 to trial14245205-20 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: oid 20 updating version 0 to 729 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: oid 20 version 729 is already newer than 728 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: oid 20 version 729 is already newer than 727 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 729 (ObjNum 500 snap 152 seq_num 500) dirty exists 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1395: left oid 20 (ObjNum 500 snap 152 seq_num 500) 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1396: finishing write tid 1 to trial14245205-26 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1396: finishing write tid 2 to trial14245205-26 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1396: finishing write tid 3 to trial14245205-26 2026-02-17T11:54:14.289 INFO:tasks.rados.rados.0.trial142.stdout:1396: finishing write tid 4 to trial14245205-26 2026-02-17T11:54:14.290 INFO:tasks.rados.rados.0.trial142.stdout:1396: oid 26 updating version 0 to 733 2026-02-17T11:54:14.290 INFO:tasks.rados.rados.0.trial142.stdout:1396: oid 26 updating version 733 to 734 2026-02-17T11:54:14.290 INFO:tasks.rados.rados.0.trial142.stdout:1396: oid 26 version 734 is already newer than 732 2026-02-17T11:54:14.290 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 734 (ObjNum 501 snap 152 seq_num 501) dirty exists 2026-02-17T11:54:14.290 INFO:tasks.rados.rados.0.trial142.stdout:1396: left oid 26 (ObjNum 501 snap 152 seq_num 501) 2026-02-17T11:54:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1391: done (6 left) 2026-02-17T11:54:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1392: done (5 left) 2026-02-17T11:54:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1393: done (4 left) 2026-02-17T11:54:14.997 INFO:tasks.rados.rados.0.trial142.stdout:1394: done (3 left) 2026-02-17T11:54:14.998 INFO:tasks.rados.rados.0.trial142.stdout:1395: done (2 left) 2026-02-17T11:54:14.998 INFO:tasks.rados.rados.0.trial142.stdout:1396: done (1 left) 2026-02-17T11:54:14.998 INFO:tasks.rados.rados.0.trial142.stdout:1397: done (0 left) 2026-02-17T11:54:14.998 INFO:tasks.rados.rados.0.trial142.stdout:1398: snap_remove snap 149 2026-02-17T11:54:15.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.295+0000 7fb039ffb640 10 monclient: tick 2026-02-17T11:54:15.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.295+0000 7fb039ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:15.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.295+0000 7fb039ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:15.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.295+0000 7fb039ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541caa30 auth_method 0 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:54:15.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:15.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:15.303+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T11:54:15.999 INFO:tasks.rados.rados.0.trial142.stdout:1398: done (0 left) 2026-02-17T11:54:16.000 INFO:tasks.rados.rados.0.trial142.stdout:1399: write (excl) oid 10 current snap is 153 2026-02-17T11:54:16.000 INFO:tasks.rados.rados.0.trial142.stdout:1399: seq_num 502 ranges {437114=654296,1525843=477506} 2026-02-17T11:54:16.003 INFO:tasks.rados.rados.0.trial142.stdout:1399: writing trial14245205-10 from 437114 to 1091410 tid 1 2026-02-17T11:54:16.007 INFO:tasks.rados.rados.0.trial142.stdout:1399: writing trial14245205-10 from 1525843 to 2003349 tid 2 2026-02-17T11:54:16.007 INFO:tasks.rados.rados.0.trial142.stdout:1400: write oid 49 current snap is 153 2026-02-17T11:54:16.007 INFO:tasks.rados.rados.0.trial142.stdout:1400: seq_num 503 ranges {453921=729545,1584325=621164} 2026-02-17T11:54:16.011 INFO:tasks.rados.rados.0.trial142.stdout:1400: writing trial14245205-49 from 453921 to 1183466 tid 1 2026-02-17T11:54:16.015 INFO:tasks.rados.rados.0.trial142.stdout:1400: writing trial14245205-49 from 1584325 to 2205489 tid 2 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1401: delete oid 40 current snap is 153 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: finishing write tid 1 to trial14245205-10 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: finishing write tid 2 to trial14245205-10 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: finishing write tid 3 to trial14245205-10 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: finishing write tid 4 to trial14245205-10 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: oid 10 updating version 0 to 699 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: oid 10 version 699 is already newer than 698 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: oid 10 version 699 is already newer than 697 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 699 (ObjNum 502 snap 153 seq_num 502) dirty exists 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1399: left oid 10 (ObjNum 502 snap 153 seq_num 502) 2026-02-17T11:54:16.016 INFO:tasks.rados.rados.0.trial142.stdout:1400: finishing write tid 1 to trial14245205-49 2026-02-17T11:54:16.017 INFO:tasks.rados.rados.0.trial142.stdout:1399: done (2 left) 2026-02-17T11:54:16.017 INFO:tasks.rados.rados.0.trial142.stdout:1401: done (1 left) 2026-02-17T11:54:16.017 INFO:tasks.rados.rados.0.trial142.stdout:1402: read oid 25 snap 139 2026-02-17T11:54:16.017 INFO:tasks.rados.rados.0.trial142.stdout:1402: expect (ObjNum 378 snap 119 seq_num 378) 2026-02-17T11:54:16.018 INFO:tasks.rados.rados.0.trial142.stdout:1403: snap_remove snap 148 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 10 monclient: tick 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:16.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 0x7fb01c005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 msgr2=0x7fb0541cae10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541caa30 0x7fb0541cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb039ffb640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb054091b30 con 0x7fb01c003640 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 0x7fb01c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb01c003640 auth_method 0 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 10 monclient(hunting): handle_auth_done global_id 124100 payload 824 2026-02-17T11:54:16.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.296+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb01c0061b0 con 0x7fb01c003640 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 msgr2=0x7fb01c005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 0x7fb01c005ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb044017e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044003d80 con 0x7fb01c003640 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:16.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 10 monclient: dump: 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb04401c070 con 0x7fb01c003640 2026-02-17T11:54:16.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:16.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 msgr2=0x7fb01c005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 0x7fb01c005ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb044017e40 comp rx=0 tx=0).stop 2026-02-17T11:54:16.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 msgr2=0x7fb01c005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:16.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.298+0000 7fb03affd640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb01c003640 0x7fb01c005ad0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb044017e40 comp rx=0 tx=0).stop 2026-02-17T11:54:16.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05c522640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 0x7fb0541d5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05c522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb0540910b0 con 0x7fb0541cb350 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 0x7fb0541d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient: get_auth_request con 0x7fb0541cb350 auth_method 0 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 10 monclient(hunting): handle_auth_done global_id 124103 payload 824 2026-02-17T11:54:16.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.302+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0540008d0 con 0x7fb0541cb350 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb05a297640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 msgr2=0x7fb0541d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb05a297640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 0x7fb0541d5d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb0440037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044013aa0 con 0x7fb0541cb350 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 10 monclient: dump: 2026-02-17T11:54:16.307 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7fb044013aa0 con 0x7fb0541cb350 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:16.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 msgr2=0x7fb0541d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 0x7fb0541d5d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb0440037f0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 msgr2=0x7fb0541d5d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb03affd640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0541cb350 0x7fb0541d5d80 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb044017970 tx=0x7fb0440037f0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.304+0000 7fb05aa98640 1 -- 10.20.193.51:0/2017947330 reap_dead start 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:16.309 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10748, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:16.310 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.311 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.312 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:16.313 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.314 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.315 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.316 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.317 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.318 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:16.319 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.320 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:16.321 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.322 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.323 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:16.323 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:16.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 msgr2=0x7fb0240401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 0x7fb0240401d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb05406fb70 tx=0x7fb048008040 comp rx=0 tx=0).stop 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 10 monclient: shutdown 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 msgr2=0x7fb054099dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e10 tx=0x7fb050004b40 comp rx=0 tx=0).stop 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 shutdown_connections 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb02403dd10 0x7fb0240401d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 --2- 10.20.193.51:0/2017947330 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0540a3bb0 0x7fb054099dc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 >> 10.20.193.51:0/2017947330 conn(0x7fb0540a30c0 msgr2=0x7fb05409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 shutdown_connections 2026-02-17T11:54:16.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.305+0000 7fb05c522640 1 -- 10.20.193.51:0/2017947330 wait complete. 2026-02-17T11:54:16.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:16.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:54:16.326 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 10 monclient: get_monmap_and_config 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 10 monclient: build_initial_monmap 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 10 monclient: monmap: 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.396 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:16.395288+0000 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:16.395288+0000 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:16.397 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 1 Processor -- start 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 1 -- start start 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.394+0000 7f7aceea0640 10 monclient: init 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7ac80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7ac809dac0 0x7f7ac809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-c con 0x7f7ac809dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7ac80a0110 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac806e140 con 0x7f7ac80a3bb0 2026-02-17T11:54:16.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac809ce60 con 0x7f7ac80a0110 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac809aed0 con 0x7f7ac809dac0 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7aceea0640 10 monclient(hunting): authenticate will time out at 1144.014105s 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7accc15640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7ac80a3bb0 0x7f7ac809f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46820/0 (socket says 10.20.193.51:46820) 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7accc15640 1 -- 10.20.193.51:0/2738234209 learned_addr learned my addr 10.20.193.51:0/2738234209 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 1 --2- 10.20.193.51:0/2738234209 >> v2:10.20.193.142:3300/0 conn(0x7f7ac809dac0 0x7f7ac809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): get_auth_request con 0x7f7ac809dac0 auth_method 0 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient(hunting): handle_auth_done global_id 114172 payload 274 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 1 -- 10.20.193.51:0/2738234209 >> v1:10.20.193.142:6789/0 conn(0x7f7ac80a0110 legacy=0x7f7ac813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 1 -- 10.20.193.51:0/2738234209 >> v1:10.20.193.51:6789/0 conn(0x7f7ac80a3bb0 legacy=0x7f7ac809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 1 monclient: found mon.noname-c 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:54:16.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.395+0000 7f7abffff640 1 -- 10.20.193.51:0/2738234209 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac809a5c0 con 0x7f7ac809dac0 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abffff640 1 -- 10.20.193.51:0/2738234209 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac809dac0 msgr2=0x7f7ac809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abffff640 1 --2- 10.20.193.51:0/2738234209 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac809dac0 0x7f7ac809fbd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586194a7fb4851d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 1 -- 10.20.193.51:0/2738234209 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003c070 con 0x7f7ac809dac0 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: dump: 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.410 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 5 monclient: authenticate success, global_id 114172 2026-02-17T11:54:16.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 1 -- 10.20.193.51:0/2738234209 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab002fce0 con 0x7f7ac809dac0 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 1 -- 10.20.193.51:0/2738234209 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0037660 con 0x7f7ac809dac0 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7abf7fe640 10 monclient: dump: 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.412 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 4 set_mon_vals no callback set 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 10 monclient: shutdown 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 1 -- 10.20.193.51:0/2738234209 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac809dac0 msgr2=0x7f7ac809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.398+0000 7f7aceea0640 1 --2- 10.20.193.51:0/2738234209 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac809dac0 0x7f7ac809fbd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab002ed80 comp rx=0 tx=0).stop 2026-02-17T11:54:16.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- 10.20.193.51:0/2738234209 shutdown_connections 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 --2- 10.20.193.51:0/2738234209 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac809dac0 0x7f7ac809fbd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- 10.20.193.51:0/2738234209 >> 10.20.193.51:0/2738234209 conn(0x7f7ac80a30c0 msgr2=0x7f7ac80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- 10.20.193.51:0/2738234209 shutdown_connections 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- 10.20.193.51:0/2738234209 wait complete. 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient: build_initial_monmap 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient: monmap: 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.414 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 Processor -- start 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- start start 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient: init 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ac809dac0 0x7f7ac808e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-c con 0x7f7ac809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 0x7f7ac808ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-a con 0x7f7ac80a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac80a3bb0 0x7f7ac808f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): picked mon.noname-b con 0x7f7ac80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80a3f90 con 0x7f7ac80a0110 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac809caa0 con 0x7f7ac80a3bb0 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac80a0540 con 0x7f7ac809dac0 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7aceea0640 10 monclient(hunting): authenticate will time out at 1144.018918s 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 0x7f7ac808ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7accc15640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ac809dac0 0x7f7ac808e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 0x7f7ac808ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33446/0 (socket says 10.20.193.51:33446) 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 1 -- 10.20.193.51:0/3108847012 learned_addr learned my addr 10.20.193.51:0/3108847012 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 10 monclient(hunting): get_auth_request con 0x7f7ac80a0110 auth_method 0 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.399+0000 7f7abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): get_auth_request con 0x7f7ac809dac0 auth_method 0 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7acd416640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac80a3bb0 0x7f7ac808f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient(hunting): handle_auth_done global_id 74589 payload 824 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ac809dac0 msgr2=0x7f7ac808e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ac809dac0 0x7f7ac808e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac80a3bb0 msgr2=0x7f7ac808f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac80a3bb0 0x7f7ac808f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 monclient: found mon.noname-a 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.400+0000 7f7abffff640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac80920e0 con 0x7f7ac80a0110 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abffff640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 msgr2=0x7f7ac808ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abffff640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 0x7f7ac808ec00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0046070 con 0x7f7ac80a0110 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: dump: 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.419 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: _finish_auth 0 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab0041870 con 0x7f7ac80a0110 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:16.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003c040 con 0x7f7ac80a0110 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abeffd640 4 set_mon_vals no callback set 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7abd7fa640 10 monclient: dump: 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 5 monclient: authenticate success, global_id 74589 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 10 monclient: _renew_subs 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac80a2a30 con 0x7f7ac80a0110 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 10 monclient: _renew_subs 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac809d7b0 con 0x7f7ac80a0110 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.402+0000 7f7aceea0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7aceea0640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 0x7f7ac81ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8090c30 con 0x7f7ac8091c80 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7ab0041c60 con 0x7f7ac80a0110 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 0x7f7ac81ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient: get_auth_request con 0x7f7ac8091c80 auth_method 0 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7abd7fa640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a9803dd10 0x7f7a980401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(327..327 src has 167..327) ==== 4795+0+0 (secure 0 0 0) 0x7f7ab0077e80 con 0x7f7ac80a0110 2026-02-17T11:54:16.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 10 monclient(hunting): handle_auth_done global_id 114175 payload 824 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7accc15640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ac809fe20 con 0x7f7ac8091c80 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7acd416640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a9803dd10 0x7f7a980401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.403+0000 7f7acd416640 10 monclient: get_auth_request con 0x7f7a9803dd10 auth_method 0 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7accc15640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 msgr2=0x7f7ac81ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7accc15640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 0x7f7ac81ccfd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab800ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800cbf0 con 0x7f7ac8091c80 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 10 monclient: dump: 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.424 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7acd416640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a9803dd10 0x7f7a980401d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808fde0 tx=0x7f7ac4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7ab8019070 con 0x7f7ac8091c80 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.405+0000 7f7abd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:16.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.406+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 msgr2=0x7f7ac81ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.406+0000 7f7abd7fa640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 0x7f7ac81ccfd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab800ef70 comp rx=0 tx=0).stop 2026-02-17T11:54:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.406+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 msgr2=0x7f7ac81ccfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.406+0000 7f7abd7fa640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac8091c80 0x7f7ac81ccfd0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab800ef70 comp rx=0 tx=0).stop 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.408+0000 7f7aceea0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.408+0000 7f7aceea0640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 0x7f7ac81d8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.408+0000 7f7aceea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.408+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac809f4c0 con 0x7f7ac81cd510 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 0x7f7ac81d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient: get_auth_request con 0x7f7ac81cd510 auth_method 0 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 10 monclient(hunting): handle_auth_done global_id 114178 payload 824 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.409+0000 7f7accc15640 1 -- 10.20.193.51:0/3108847012 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ac80008d0 con 0x7f7ac81cd510 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7accc15640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 msgr2=0x7f7ac81d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7accc15640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 0x7f7ac81d8380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab801e250 con 0x7f7ac81cd510 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7abd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7abd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.411+0000 7f7abd7fa640 10 monclient: dump: 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.429 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7f7ab801e250 con 0x7f7ac81cd510 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 msgr2=0x7f7ac81d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 0x7f7ac81d8380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab8004a40 comp rx=0 tx=0).stop 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 msgr2=0x7f7ac81d8380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7abd7fa640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ac81cd510 0x7f7ac81d8380 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab8004a40 comp rx=0 tx=0).stop 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 58287, 2026-02-17T11:54:16.431 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.432 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.433 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:16.434 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:16.435 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:16.437 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.438 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.439 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.440 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:16.441 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a9803dd10 msgr2=0x7f7a980401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a9803dd10 0x7f7a980401d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808fde0 tx=0x7f7ac4009040 comp rx=0 tx=0).stop 2026-02-17T11:54:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 10 monclient: shutdown 2026-02-17T11:54:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 msgr2=0x7f7ac808ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 --2- 10.20.193.51:0/3108847012 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ac80a0110 0x7f7ac808ec00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab00047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7acd416640 1 -- 10.20.193.51:0/3108847012 reap_dead start 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7acd416640 1 -- 10.20.193.51:0/3108847012 reap_dead start 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 shutdown_connections 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 >> 10.20.193.51:0/3108847012 conn(0x7f7ac80a30c0 msgr2=0x7f7ac806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 shutdown_connections 2026-02-17T11:54:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.412+0000 7f7aceea0640 1 -- 10.20.193.51:0/3108847012 wait complete. 2026-02-17T11:54:16.443 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:16.443 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:54:16.443 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 10 monclient: get_monmap_and_config 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 10 monclient: build_initial_monmap 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 10 monclient: monmap: 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:16.509171+0000 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:16.509171+0000 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.510 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:16.511 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:16.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:16.511 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:16.511 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:16.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 1 Processor -- start 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 1 -- start start 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.508+0000 7ff71b0a0640 10 monclient: init 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff71406c8d0 0x7ff7140a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-c con 0x7ff71406c8d0 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-b con 0x7ff714074d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff71406d1f0 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140a0210 con 0x7ff71406d1f0 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140a07d0 con 0x7ff71406c8d0 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140a04f0 con 0x7ff714074d60 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff71b0a0640 10 monclient(hunting): authenticate will time out at 1144.128230s 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59438/0 (socket says 10.20.193.51:59438) 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 -- 10.20.193.51:0/3928741890 learned_addr learned my addr 10.20.193.51:0/3928741890 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): get_auth_request con 0x7ff714074d60 auth_method 0 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff718e15640 1 --2- 10.20.193.51:0/3928741890 >> v2:10.20.193.142:3300/0 conn(0x7ff71406c8d0 0x7ff7140a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff718e15640 10 monclient(hunting): get_auth_request con 0x7ff71406c8d0 auth_method 0 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff718e15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff718e15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff718e15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient(hunting): handle_auth_done global_id 124109 payload 274 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 -- 10.20.193.51:0/3928741890 >> v2:10.20.193.142:3300/0 conn(0x7ff71406c8d0 msgr2=0x7ff7140a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 --2- 10.20.193.51:0/3928741890 >> v2:10.20.193.142:3300/0 conn(0x7ff71406c8d0 0x7ff7140a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 -- 10.20.193.51:0/3928741890 >> v1:10.20.193.142:6789/0 conn(0x7ff71406d1f0 legacy=0x7ff71409d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 monclient: found mon.noname-b 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.509+0000 7ff70bfff640 1 -- 10.20.193.51:0/3928741890 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71409ecd0 con 0x7ff714074d60 2026-02-17T11:54:16.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.511+0000 7ff70bfff640 1 -- 10.20.193.51:0/3928741890 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 msgr2=0x7ff71406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.511+0000 7ff70bfff640 1 --2- 10.20.193.51:0/3928741890 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009970 tx=0x7ff6fc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72619365fea38b0e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.511+0000 7ff70b7fe640 1 -- 10.20.193.51:0/3928741890 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc03c070 con 0x7ff714074d60 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: dump: 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:16.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 1 -- 10.20.193.51:0/3928741890 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc02fcd0 con 0x7ff714074d60 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 1 -- 10.20.193.51:0/3928741890 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc037660 con 0x7ff714074d60 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff70b7fe640 10 monclient: dump: 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.522 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 5 monclient: authenticate success, global_id 124109 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 4 set_mon_vals no callback set 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 10 monclient: shutdown 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 -- 10.20.193.51:0/3928741890 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 msgr2=0x7ff71406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/3928741890 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009970 tx=0x7ff6fc02ee90 comp rx=0 tx=0).stop 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 -- 10.20.193.51:0/3928741890 shutdown_connections 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/3928741890 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff714074d60 0x7ff71406ccb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/3928741890 >> v2:10.20.193.142:3300/0 conn(0x7ff71406c8d0 0x7ff7140a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 -- 10.20.193.51:0/3928741890 >> 10.20.193.51:0/3928741890 conn(0x7ff7140aaa60 msgr2=0x7ff7140aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 -- 10.20.193.51:0/3928741890 shutdown_connections 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 1 -- 10.20.193.51:0/3928741890 wait complete. 2026-02-17T11:54:16.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 10 monclient: build_initial_monmap 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.512+0000 7ff71b0a0640 10 monclient: monmap: 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 Processor -- start 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 -- start start 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient: init 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:16.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71406c8d0 0x7ff71412fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-a con 0x7ff71406c8d0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-c con 0x7ff71406d1f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff714074d60 0x7ff7141305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): picked mon.noname-b con 0x7ff714074d60 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140ab970 con 0x7ff71406c8d0 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140ab7f0 con 0x7ff714074d60 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff71409e0d0 con 0x7ff71406d1f0 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff71b0a0640 10 monclient(hunting): authenticate will time out at 1144.132486s 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59446/0 (socket says 10.20.193.51:59446) 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 -- 10.20.193.51:0/2894287892 learned_addr learned my addr 10.20.193.51:0/2894287892 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): get_auth_request con 0x7ff71406d1f0 auth_method 0 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71406c8d0 0x7ff71412fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): get_auth_request con 0x7ff71406c8d0 auth_method 0 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff718e15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff719616640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff714074d60 0x7ff7141305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff719616640 10 monclient(hunting): get_auth_request con 0x7ff714074d60 auth_method 0 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff719616640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff719616640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff719616640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient(hunting): handle_auth_done global_id 124112 payload 824 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 -- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff714074d60 msgr2=0x7ff7141305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff714074d60 0x7ff7141305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 -- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71406c8d0 msgr2=0x7ff71412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71406c8d0 0x7ff71412fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 monclient: found mon.noname-c 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:16.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.513+0000 7ff70bfff640 1 -- 10.20.193.51:0/2894287892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff714132420 con 0x7ff71406d1f0 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff70bfff640 1 -- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 msgr2=0x7ff714130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff70bfff640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009aa0 tx=0x7ff6fc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc044020 con 0x7ff71406d1f0 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 10 monclient: dump: 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.528 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 10 monclient: _finish_auth 0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 10 monclient: _check_auth_tickets 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc040820 con 0x7ff71406d1f0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff71b0a0640 5 monclient: authenticate success, global_id 124112 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.515+0000 7ff71b0a0640 10 monclient: _renew_subs 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff714074a90 con 0x7ff71406d1f0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc03c040 con 0x7ff71406d1f0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff70affd640 4 set_mon_vals no callback set 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 10 monclient: dump: 2026-02-17T11:54:16.529 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 monclient: _renew_subs 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7140745f0 con 0x7ff71406d1f0 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff6fc03f050 con 0x7ff71406d1f0 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71409e500 con 0x7ff71406d1f0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 0x7ff6e40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.516+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(327..327 src has 167..327) ==== 4795+0+0 (secure 0 0 0) 0x7ff6fc077470 con 0x7ff71406d1f0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.517+0000 7ff718e15640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 0x7ff6e40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.517+0000 7ff718e15640 10 monclient: get_auth_request con 0x7ff6e403dd10 auth_method 0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.519+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff6fc04e030 con 0x7ff71406d1f0 2026-02-17T11:54:16.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.519+0000 7ff7097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:16.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.519+0000 7ff7097fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:16.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.519+0000 7ff718e15640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 0x7ff6e40401d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff704009a50 tx=0x7ff704008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:16.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.639+0000 7ff71b0a0640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:54:16.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.639+0000 7ff71b0a0640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:54:16.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.639+0000 7ff71b0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:16.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.639+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff714069830 con 0x7ff71406d1f0 2026-02-17T11:54:16.642 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.640+0000 7ff7097fa640 1 -- 10.20.193.51:0/2894287892 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff6fc0363a0 con 0x7ff71406d1f0 2026-02-17T11:54:16.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.640+0000 7ff7097fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:54:16.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.640+0000 7ff7097fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:16.643 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=1013498065,config=692619927,health=418911152,kv=643764953,logm=4133290910}) 2026-02-17T11:54:16.643 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=11,kv=10,logm=57} crc {auth=1013498065,config=692619927,health=1145329893,kv=3063189015,logm=3102097072}) 2026-02-17T11:54:16.643 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.643 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=1013498065,config=692619927,health=418911152,kv=643764953,logm=4133290910}) 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=2158188895,config=692619927,health=418911152,kv=643764953,logm=4145704968}) 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147295968}) 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1817002351}) 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.640+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147295968}) 2026-02-17T11:54:16.644 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4208698781}) 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 msgr2=0x7ff6e40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 0x7ff6e40401d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff704009a50 tx=0x7ff704008040 comp rx=0 tx=0).stop 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 10 monclient: shutdown 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 msgr2=0x7ff714130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:16.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009aa0 tx=0x7ff6fc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 shutdown_connections 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff6e403dd10 0x7ff6e40401d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff714074d60 0x7ff7141305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff71406d1f0 0x7ff714130060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 --2- 10.20.193.51:0/2894287892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff71406c8d0 0x7ff71412fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 >> 10.20.193.51:0/2894287892 conn(0x7ff7140aaa60 msgr2=0x7ff714138770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 shutdown_connections 2026-02-17T11:54:16.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:16.641+0000 7ff71b0a0640 1 -- 10.20.193.51:0/2894287892 wait complete. 2026-02-17T11:54:16.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159510914}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=164557087}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159510914}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1441968823}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991711954}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2618211117}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991711954}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.641+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3545212950}) 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1116540173}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4102318735}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1116540173}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2149316562}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2362174633}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3570116897}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2362174633}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.642+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1189734101}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=908765902}) 2026-02-17T11:54:16.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1011277046}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=908765902}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3624252131}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919767955}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3404847210}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919767955}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1300690930}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641470394}) 2026-02-17T11:54:16.656 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2463849195}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641470394}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.643+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3434179013}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1441568179}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=466660332}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1441568179}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=869947638}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268730116}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2043141695}) 2026-02-17T11:54:16.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268730116}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3615264423}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=122959205}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3425640774}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=122959205}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.644+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1128246406}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659711369}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2625943766}) 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.658 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659711369}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1929238461}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=565060169}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3297035822}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=565060169}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.645+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=755955261}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3875734480}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=261948290}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3875734480}) 2026-02-17T11:54:16.659 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2245653753}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2519140994}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1977744671}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2519140994}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1172671817}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4157129239}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3001854645}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4157129239}) 2026-02-17T11:54:16.660 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.646+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=103894569}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245064441}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=241126115}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245064441}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3012829309}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3935867994}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3700875395}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3935867994}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.647+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2354458008}) 2026-02-17T11:54:16.661 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=474980923}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1472981179}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=474980923}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=103552802}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4146182519}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3975955057}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4146182519}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2667764322}) 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335326559}) 2026-02-17T11:54:16.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1605112157}) 2026-02-17T11:54:16.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335326559}) 2026-02-17T11:54:16.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.648+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=794726127}) 2026-02-17T11:54:16.664 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=63700294}) 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2961415627}) 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=63700294}) 2026-02-17T11:54:16.668 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517875724}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3087685775}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=339640278}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3087685775}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3104663430}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3524724583}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1188192254}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3524724583}) 2026-02-17T11:54:16.669 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.649+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3266003829}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653508718}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2322781168}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653508718}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193133198}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402985436}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3215747269}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402985436}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2165571860}) 2026-02-17T11:54:16.670 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3593677569}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1701746182}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3593677569}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.650+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2344520443}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=100426978}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1847663473}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=100426978}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3604110378}) 2026-02-17T11:54:16.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=25} crc {logm=4024074125,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3627576456,mon_config_key=1325082650,monmap=263989209,osd_metadata=101123558,osd_pg_creating=611293126,osd_snap=4063458149}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=13,monmap=3,osd_metadata=3,osd_pg_creating=1,osd_snap=27} crc {logm=2902863307,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3627576456,mon_config_key=3390328712,monmap=263989209,osd_metadata=195677084,osd_pg_creating=611293126,osd_snap=4008486122}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=25} crc {logm=4024074125,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3627576456,mon_config_key=1325082650,monmap=263989209,osd_metadata=101123558,osd_pg_creating=611293126,osd_snap=4063458149}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.651+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=26} crc {logm=173932233,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3627576456,mon_config_key=3390328712,monmap=263989209,osd_metadata=4184050976,osd_pg_creating=611293126,osd_snap=1122586252}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=3969561761,osdmap=2471868078}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=28,osdmap=72} crc {osd_snap=1525166948,osdmap=1072006880}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=3969561761,osdmap=2471868078}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.658+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=26,osdmap=74} crc {osd_snap=3025938317,osdmap=4009204162}) 2026-02-17T11:54:16.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=391217172}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=468009653}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=391217172}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.659+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=145815157}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=2904225997}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=72} crc {osdmap=649925161}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=2904225997}) 2026-02-17T11:54:16.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:54:16.661+0000 7f8e5eb2f640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=70} crc {osdmap=1919639255}) 2026-02-17T11:54:17.012 INFO:tasks.rados.rados.0.trial142.stdout:1403: done (2 left) 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1404: delete oid 31 current snap is 153 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: finishing write tid 2 to trial14245205-49 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: finishing write tid 3 to trial14245205-49 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: finishing write tid 4 to trial14245205-49 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: oid 49 updating version 0 to 1111 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: oid 49 updating version 1111 to 1117 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:1400: oid 49 version 1117 is already newer than 1116 2026-02-17T11:54:17.013 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1117 (ObjNum 503 snap 153 seq_num 503) dirty exists 2026-02-17T11:54:17.014 INFO:tasks.rados.rados.0.trial142.stdout:1400: left oid 49 (ObjNum 503 snap 153 seq_num 503) 2026-02-17T11:54:17.014 INFO:tasks.rados.rados.0.trial142.stdout:1402: expect (ObjNum 378 snap 119 seq_num 378) 2026-02-17T11:54:17.092 INFO:tasks.rados.rados.0.trial142.stdout:1400: done (2 left) 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1402: done (1 left) 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1404: done (0 left) 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1405: copy_from oid 44 from oid 38 current snap is 153 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1406: read oid 23 snap -1 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1406: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1407: copy_from oid 46 from oid 5 current snap is 153 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1408: write oid 15 current snap is 153 2026-02-17T11:54:17.093 INFO:tasks.rados.rados.0.trial142.stdout:1408: seq_num 506 ranges {504342=555292,1643418=484844} 2026-02-17T11:54:17.096 INFO:tasks.rados.rados.0.trial142.stdout:1408: writing trial14245205-15 from 504342 to 1059634 tid 1 2026-02-17T11:54:17.100 INFO:tasks.rados.rados.0.trial142.stdout:1408: writing trial14245205-15 from 1643418 to 2128262 tid 2 2026-02-17T11:54:17.100 INFO:tasks.rados.rados.0.trial142.stdout:1409: write oid 43 current snap is 153 2026-02-17T11:54:17.100 INFO:tasks.rados.rados.0.trial142.stdout:1409: seq_num 507 ranges {521149=630541,1701900=628502} 2026-02-17T11:54:17.104 INFO:tasks.rados.rados.0.trial142.stdout:1409: writing trial14245205-43 from 521149 to 1151690 tid 1 2026-02-17T11:54:17.109 INFO:tasks.rados.rados.0.trial142.stdout:1409: writing trial14245205-43 from 1701900 to 2330402 tid 2 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1410: read oid 1 snap -1 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1410: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1411: delete oid 18 current snap is 153 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1405: finishing copy_from to trial14245205-44 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1405: got expected ENOENT (src dne) 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1405: finishing copy_from racing read to trial14245205-44 2026-02-17T11:54:17.110 INFO:tasks.rados.rados.0.trial142.stdout:1406: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1408: finishing write tid 1 to trial14245205-15 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1408: finishing write tid 2 to trial14245205-15 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1405: done (6 left) 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1406: done (5 left) 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1411: done (4 left) 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1412: snap_create 2026-02-17T11:54:17.253 INFO:tasks.rados.rados.0.trial142.stdout:1408: finishing write tid 3 to trial14245205-15 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1408: finishing write tid 4 to trial14245205-15 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1408: oid 15 updating version 0 to 961 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1408: oid 15 version 961 is already newer than 959 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1408: oid 15 version 961 is already newer than 960 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 961 (ObjNum 506 snap 153 seq_num 506) dirty exists 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1408: left oid 15 (ObjNum 506 snap 153 seq_num 506) 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1407: finishing copy_from racing read to trial14245205-46 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1407: finishing copy_from to trial14245205-46 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: finishing write tid 1 to trial14245205-43 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: finishing write tid 2 to trial14245205-43 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: finishing write tid 3 to trial14245205-43 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: finishing write tid 4 to trial14245205-43 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: oid 43 updating version 0 to 1125 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: oid 43 updating version 1125 to 1127 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: oid 43 version 1127 is already newer than 1126 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1127 (ObjNum 507 snap 153 seq_num 507) dirty exists 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1409: left oid 43 (ObjNum 507 snap 153 seq_num 507) 2026-02-17T11:54:17.254 INFO:tasks.rados.rados.0.trial142.stdout:1410: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:54:17.665 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:54:17.666 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:54:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.733+0000 7fdc5c6c6640 10 monclient: get_monmap_and_config 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.733+0000 7fdc5c6c6640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.733+0000 7fdc5c6c6640 10 monclient: monmap: 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:17.734547+0000 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:17.734547+0000 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:17.738 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.733+0000 7fdc5c6c6640 1 Processor -- start 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 -- start start 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient: init 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdc540a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdc540a0750 0x7fdc5409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-a con 0x7fdc540a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 0x7fdc5413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-b con 0x7fdc5413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5406e140 con 0x7fdc540a3bb0 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5409f910 con 0x7fdc540a0750 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5409ccd0 con 0x7fdc5413b760 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5c6c6640 10 monclient(hunting): authenticate will time out at 1145.353296s 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdc540a0750 0x7fdc5409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 0x7fdc5413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdc540a0750 0x7fdc5409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33462/0 (socket says 10.20.193.51:33462) 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 -- 10.20.193.51:0/661017040 learned_addr learned my addr 10.20.193.51:0/661017040 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): get_auth_request con 0x7fdc540a0750 auth_method 0 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): get_auth_request con 0x7fdc5413b760 auth_method 0 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient(hunting): handle_auth_done global_id 74595 payload 274 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 -- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 msgr2=0x7fdc5413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 0x7fdc5413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 -- 10.20.193.51:0/661017040 >> v1:10.20.193.142:6789/0 conn(0x7fdc540a3bb0 legacy=0x7fdc5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 monclient: found mon.noname-a 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc59c3a640 1 -- 10.20.193.51:0/661017040 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5409eec0 con 0x7fdc540a0750 2026-02-17T11:54:17.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.734+0000 7fdc5ac3c640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 0x7fdc5413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.736+0000 7fdc59c3a640 1 -- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc540a0750 msgr2=0x7fdc5409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.736+0000 7fdc59c3a640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc540a0750 0x7fdc5409e1d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc5406f3c0 tx=0x7fdc4802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e7dc103cd912e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 1 -- 10.20.193.51:0/661017040 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803c070 con 0x7fdc540a0750 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: dump: 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.750 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 1 -- 10.20.193.51:0/661017040 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4802fca0 con 0x7fdc540a0750 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 5 monclient: authenticate success, global_id 74595 2026-02-17T11:54:17.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 1 -- 10.20.193.51:0/661017040 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48037660 con 0x7fdc540a0750 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 4 set_mon_vals no callback set 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc59439640 10 monclient: dump: 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.752 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 10 monclient: shutdown 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc540a0750 msgr2=0x7fdc5409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc540a0750 0x7fdc5409e1d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc5406f3c0 tx=0x7fdc4802ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/661017040 shutdown_connections 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc5413b760 0x7fdc5413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/661017040 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc540a0750 0x7fdc5409e1d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/661017040 >> 10.20.193.51:0/661017040 conn(0x7fdc540a30c0 msgr2=0x7fdc540a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/661017040 shutdown_connections 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/661017040 wait complete. 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.737+0000 7fdc5c6c6640 10 monclient: monmap: 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:17.754 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 Processor -- start 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 -- start start 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient: init 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 0x7fdc54090a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-c con 0x7fdc540a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 0x7fdc54090f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-b con 0x7fdc540a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 0x7fdc540914a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): picked mon.noname-a con 0x7fdc5413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540a04b0 con 0x7fdc5413b760 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5409c850 con 0x7fdc540a3bb0 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5409e710 con 0x7fdc540a0750 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5c6c6640 10 monclient(hunting): authenticate will time out at 1145.357439s 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 0x7fdc54090a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 0x7fdc540914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 0x7fdc54090a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59464/0 (socket says 10.20.193.51:59464) 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): get_auth_request con 0x7fdc5413b760 auth_method 0 2026-02-17T11:54:17.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 1 -- 10.20.193.51:0/1552228125 learned_addr learned my addr 10.20.193.51:0/1552228125 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): get_auth_request con 0x7fdc540a0750 auth_method 0 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5a43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc59c3a640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 0x7fdc54090f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient(hunting): handle_auth_done global_id 74598 payload 824 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 -- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 msgr2=0x7fdc54090a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 0x7fdc54090a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 -- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 msgr2=0x7fdc54090f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 0x7fdc54090f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 monclient: found mon.noname-a 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc5ac3c640 1 -- 10.20.193.51:0/1552228125 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54094630 con 0x7fdc5413b760 2026-02-17T11:54:17.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc59c3a640 10 monclient: get_auth_request con 0x7fdc540a3bb0 auth_method 0 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.738+0000 7fdc59c3a640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 0x7fdc54090f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5ac3c640 1 -- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 msgr2=0x7fdc540914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5ac3c640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 0x7fdc540914a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000ef90 tx=0x7fdc5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50018030 con 0x7fdc5413b760 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: dump: 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.759 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc50003a90 con 0x7fdc5413b760 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003e60 con 0x7fdc5413b760 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc3affd640 10 monclient: dump: 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc58c38640 4 set_mon_vals no callback set 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5c6c6640 5 monclient: authenticate success, global_id 74598 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5c6c6640 10 monclient: _renew_subs 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5c6c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.740+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5406f510 con 0x7fdc5413b760 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 10 monclient: _renew_subs 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc54094350 con 0x7fdc5413b760 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5409dac0 con 0x7fdc5413b760 2026-02-17T11:54:17.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdc50004000 con 0x7fdc5413b760 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc3affd640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 0x7fdc24040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.741+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(328..328 src has 167..328) ==== 4795+0+0 (secure 0 0 0) 0x7fdc500530f0 con 0x7fdc5413b760 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.742+0000 7fdc5a43b640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 0x7fdc24040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.742+0000 7fdc5a43b640 10 monclient: get_auth_request con 0x7fdc2403dd60 auth_method 0 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.744+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdc50022070 con 0x7fdc5413b760 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.744+0000 7fdc3affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.744+0000 7fdc3affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:17.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.744+0000 7fdc5a43b640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 0x7fdc24040220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc440052b0 tx=0x7fdc44003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc5c6c6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:54:17.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc5c6c6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:17.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc5c6c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:17.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc540008d0 con 0x7fdc5413b760 2026-02-17T11:54:17.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc3affd640 1 -- 10.20.193.51:0/1552228125 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fdc50010040 con 0x7fdc5413b760 2026-02-17T11:54:17.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc3affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:17.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.857+0000 7fdc3affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:17.860 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:54:17.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 msgr2=0x7fdc24040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 0x7fdc24040220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc440052b0 tx=0x7fdc44003960 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 10 monclient: shutdown 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 msgr2=0x7fdc540914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 0x7fdc540914a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000ef90 tx=0x7fdc5000c490 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 shutdown_connections 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdc2403dd60 0x7fdc24040220 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdc5413b760 0x7fdc540914a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdc540a3bb0 0x7fdc54090f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 --2- 10.20.193.51:0/1552228125 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdc540a0750 0x7fdc54090a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 >> 10.20.193.51:0/1552228125 conn(0x7fdc540a30c0 msgr2=0x7fdc540a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 shutdown_connections 2026-02-17T11:54:17.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.858+0000 7fdc5c6c6640 1 -- 10.20.193.51:0/1552228125 wait complete. 2026-02-17T11:54:17.867 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:54:17.868 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:54:17.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:54:17.868 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.932+0000 7eff31bd3640 10 monclient: get_monmap_and_config 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.932+0000 7eff31bd3640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.932+0000 7eff31bd3640 10 monclient: monmap: 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:17.933923+0000 2026-02-17T11:54:17.935 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:17.933923+0000 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 Processor -- start 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 -- start start 2026-02-17T11:54:17.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient: init 2026-02-17T11:54:17.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7eff2c06eb80 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7eff2c0a4c10 addr v1:10.20.193.51:6789/0 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 0x7eff2c140610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c13e220 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c138cb0 con 0x7eff2c0a4c10 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c06f9c0 con 0x7eff2c06eb80 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7eff2c06ef60 con 0x7eff2c13e220 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff31bd3640 10 monclient(hunting): authenticate will time out at 1145.552732s 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2affd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7eff2c0a4c10 0x7eff2c1385a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46834/0 (socket says 10.20.193.51:46834) 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2affd640 1 -- 10.20.193.51:0/3430723582 learned_addr learned my addr 10.20.193.51:0/3430723582 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 1 --2- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 0x7eff2c140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): get_auth_request con 0x7eff2c13e220 auth_method 0 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.933+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 10 monclient(hunting): handle_auth_done global_id 124121 payload 274 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 1 -- 10.20.193.51:0/3430723582 >> v1:10.20.193.142:6789/0 conn(0x7eff2c06eb80 legacy=0x7eff2c137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 1 -- 10.20.193.51:0/3430723582 >> v1:10.20.193.51:6789/0 conn(0x7eff2c0a4c10 legacy=0x7eff2c1385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 1 monclient: found mon.noname-b 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.934+0000 7eff2bfff640 1 -- 10.20.193.51:0/3430723582 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c06fca0 con 0x7eff2c13e220 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2bfff640 1 -- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 msgr2=0x7eff2c140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2bfff640 1 --2- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 0x7eff2c140610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff20009dc0 tx=0x7eff2002f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a1f089a0e72f31 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 1 -- 10.20.193.51:0/3430723582 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2003c070 con 0x7eff2c13e220 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: dump: 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 1 -- 10.20.193.51:0/3430723582 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20037640 con 0x7eff2c13e220 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff31bd3640 5 monclient: authenticate success, global_id 124121 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff31bd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 1 -- 10.20.193.51:0/3430723582 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20037a10 con 0x7eff2c13e220 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff2a7fc640 10 monclient: dump: 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.951 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff31bd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.936+0000 7eff31bd3640 4 set_mon_vals no callback set 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: shutdown 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 msgr2=0x7eff2c140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 --2- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 0x7eff2c140610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff20009dc0 tx=0x7eff2002f1c0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- 10.20.193.51:0/3430723582 shutdown_connections 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 --2- 10.20.193.51:0/3430723582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c13e220 0x7eff2c140610 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- 10.20.193.51:0/3430723582 >> 10.20.193.51:0/3430723582 conn(0x7eff2c0a8c80 msgr2=0x7eff2c0a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- 10.20.193.51:0/3430723582 shutdown_connections 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- 10.20.193.51:0/3430723582 wait complete. 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: monmap: 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:17.953 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 Processor -- start 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- start start 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: init 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:17.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7eff2c06eb80 0x7eff2c09e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c06eb80 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 0x7eff2c134ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-c con 0x7eff2c0a4c10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 0x7eff2c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): picked mon.noname-a con 0x7eff2c13e220 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c140d60 con 0x7eff2c13e220 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c070000 con 0x7eff2c06eb80 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7eff2c140ee0 con 0x7eff2c0a4c10 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff31bd3640 10 monclient(hunting): authenticate will time out at 1145.556897s 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 0x7eff2c134ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 0x7eff2c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 0x7eff2c134ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59494/0 (socket says 10.20.193.51:59494) 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 1 -- 10.20.193.51:0/2159459231 learned_addr learned my addr 10.20.193.51:0/2159459231 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 0x7eff2c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33486/0 (socket says 10.20.193.51:33486) 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 10 monclient(hunting): get_auth_request con 0x7eff2c0a4c10 auth_method 0 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 10 monclient(hunting): get_auth_request con 0x7eff2c13e220 auth_method 0 2026-02-17T11:54:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.937+0000 7eff2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2b7fe640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7eff2c06eb80 0x7eff2c09e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2b7fe640 10 monclient(hunting): get_auth_request con 0x7eff2c06eb80 auth_method 0 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient(hunting): handle_auth_done global_id 124124 payload 824 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7eff2c06eb80 msgr2=0x7eff2c09e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7eff2c06eb80 0x7eff2c09e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 msgr2=0x7eff2c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 0x7eff2c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 monclient: found mon.noname-c 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2affd640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c074d60 con 0x7eff2c0a4c10 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.938+0000 7eff2bfff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c13e220 0x7eff2c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:54:17.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff2affd640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 msgr2=0x7eff2c134ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff2affd640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 0x7eff2c134ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c780 tx=0x7eff1c00cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c005de0 con 0x7eff2c0a4c10 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: dump: 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.959 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1c007070 con 0x7eff2c0a4c10 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 5 monclient: authenticate success, global_id 124124 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 monclient: _renew_subs 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c140840 con 0x7eff2c0a4c10 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c007440 con 0x7eff2c0a4c10 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff29ffb640 4 set_mon_vals no callback set 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff07fff640 10 monclient: dump: 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.961 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 monclient: _renew_subs 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2c073360 con 0x7eff2c0a4c10 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 0x7eff2c0723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.940+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c074800 con 0x7eff2c1353e0 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 0x7eff2c0723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient: get_auth_request con 0x7eff2c1353e0 auth_method 0 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7eff1c007620 con 0x7eff2c0a4c10 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_done global_id 74604 payload 824 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2b7fe640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff2c1cf7d0 con 0x7eff2c1353e0 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff07fff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efefc03dd10 0x7efefc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(328..328 src has 167..328) ==== 4795+0+0 (secure 0 0 0) 0x7eff1c0523f0 con 0x7eff2c0a4c10 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2bfff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efefc03dd10 0x7efefc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.941+0000 7eff2bfff640 10 monclient: get_auth_request con 0x7efefc03dd10 auth_method 0 2026-02-17T11:54:17.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff2b7fe640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 msgr2=0x7eff2c0723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff2b7fe640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 0x7eff2c0723e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff1800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18006ae0 con 0x7eff2c1353e0 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 10 monclient: dump: 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.964 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7eff18006ae0 con 0x7eff2c1353e0 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 msgr2=0x7eff2c0723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 0x7eff2c0723e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff1800ec00 comp rx=0 tx=0).stop 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 msgr2=0x7eff2c0723e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.943+0000 7eff07fff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c1353e0 0x7eff2c0723e0 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff1800ec00 comp rx=0 tx=0).stop 2026-02-17T11:54:17.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.944+0000 7eff2bfff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efefc03dd10 0x7efefc0401d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0a5070 tx=0x7eff20033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff31bd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff31bd3640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 0x7eff2c1da640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff31bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c072d30 con 0x7eff2c072920 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 0x7eff2c1da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient: get_auth_request con 0x7eff2c072920 auth_method 0 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.946+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.947+0000 7eff2b7fe640 10 monclient(hunting): handle_auth_done global_id 74607 payload 824 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.947+0000 7eff2b7fe640 1 -- 10.20.193.51:0/2159459231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff2c06e4a0 con 0x7eff2c072920 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff2b7fe640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 msgr2=0x7eff2c1da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff2b7fe640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 0x7eff2c1da640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff18003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1800c930 con 0x7eff2c072920 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 10 monclient: dump: 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:17.969 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7eff1800c930 con 0x7eff2c072920 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 msgr2=0x7eff2c1da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 0x7eff2c1da640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff18003860 comp rx=0 tx=0).stop 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 msgr2=0x7eff2c1da640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff07fff640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7eff2c072920 0x7eff2c1da640 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e730 tx=0x7eff18003860 comp rx=0 tx=0).stop 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 275880, 2026-02-17T11:54:17.971 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:17.972 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:17.973 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:17.974 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:17.975 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.978 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:17.979 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:17.980 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:17.981 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:17.982 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efefc03dd10 msgr2=0x7efefc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efefc03dd10 0x7efefc0401d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0a5070 tx=0x7eff20033000 comp rx=0 tx=0).stop 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 10 monclient: shutdown 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 msgr2=0x7eff2c134ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 --2- 10.20.193.51:0/2159459231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7eff2c0a4c10 0x7eff2c134ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c780 tx=0x7eff1c00cc50 comp rx=0 tx=0).stop 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff2bfff640 1 -- 10.20.193.51:0/2159459231 reap_dead start 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff2bfff640 1 -- 10.20.193.51:0/2159459231 reap_dead start 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 shutdown_connections 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 >> 10.20.193.51:0/2159459231 conn(0x7eff2c0a8c80 msgr2=0x7eff2c0a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 shutdown_connections 2026-02-17T11:54:17.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:17.949+0000 7eff31bd3640 1 -- 10.20.193.51:0/2159459231 wait complete. 2026-02-17T11:54:17.983 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:17.984 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:54:17.984 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1407: done (4 left) 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1408: done (3 left) 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1409: done (2 left) 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1410: done (1 left) 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1412: done (0 left) 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1413: write (excl) oid 38 current snap is 154 2026-02-17T11:54:18.023 INFO:tasks.rados.rados.0.trial142.stdout:1413: seq_num 509 ranges {554763=781039,2102511=452252} 2026-02-17T11:54:18.027 INFO:tasks.rados.rados.0.trial142.stdout:1413: writing trial14245205-38 from 554763 to 1335802 tid 1 2026-02-17T11:54:18.032 INFO:tasks.rados.rados.0.trial142.stdout:1413: writing trial14245205-38 from 2102511 to 2554763 tid 2 2026-02-17T11:54:18.033 INFO:tasks.rados.rados.0.trial142.stdout:1414: read oid 22 snap -1 2026-02-17T11:54:18.033 INFO:tasks.rados.rados.0.trial142.stdout:1414: expect deleted 2026-02-17T11:54:18.033 INFO:tasks.rados.rados.0.trial142.stdout:1415: snap_create 2026-02-17T11:54:18.033 INFO:tasks.rados.rados.0.trial142.stdout:1413: finishing write tid 1 to trial14245205-38 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: finishing write tid 2 to trial14245205-38 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: finishing write tid 3 to trial14245205-38 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: finishing write tid 4 to trial14245205-38 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: oid 38 updating version 0 to 136 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: oid 38 version 136 is already newer than 135 2026-02-17T11:54:18.034 INFO:tasks.rados.rados.0.trial142.stdout:1413: oid 38 version 136 is already newer than 134 2026-02-17T11:54:18.035 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 136 (ObjNum 509 snap 154 seq_num 509) dirty exists 2026-02-17T11:54:18.035 INFO:tasks.rados.rados.0.trial142.stdout:1413: left oid 38 (ObjNum 509 snap 154 seq_num 509) 2026-02-17T11:54:18.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.049+0000 7f4362503640 10 monclient: get_monmap_and_config 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.049+0000 7f4362503640 10 monclient: build_initial_monmap 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 10 monclient: monmap: 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:18.050976+0000 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:18.050976+0000 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:18.052 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:18.053 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:18.053 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:18.053 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:18.053 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 1 Processor -- start 2026-02-17T11:54:18.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 1 -- start start 2026-02-17T11:54:18.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 10 monclient: init 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 10 monclient: _add_conns ranks=[4,3,2,0,1] 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.050+0000 7f4362503640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f435c138600 0x7f435c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): picked mon.noname-c con 0x7f435c138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f435c0a35a0 0x7f435c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): picked mon.noname-a con 0x7f435c0a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): picked mon.noname-b con 0x7f435c0a58a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0a6830 con 0x7f435c0a35a0 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0a2c00 con 0x7f435c138600 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0a1df0 con 0x7f435c0a58a0 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4362503640 10 monclient(hunting): authenticate will time out at 1145.670061s 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f435c0a35a0 0x7f435c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f435c0a35a0 0x7f435c0a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33520/0 (socket says 10.20.193.51:33520) 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 -- 10.20.193.51:0/267567028 learned_addr learned my addr 10.20.193.51:0/267567028 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59500/0 (socket says 10.20.193.51:59500) 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): get_auth_request con 0x7f435c0a35a0 auth_method 0 2026-02-17T11:54:18.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): get_auth_request con 0x7f435c0a58a0 auth_method 0 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435bfff640 1 --2- 10.20.193.51:0/267567028 >> v2:10.20.193.142:3300/0 conn(0x7f435c138600 0x7f435c1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435bfff640 10 monclient(hunting): get_auth_request con 0x7f435c138600 auth_method 0 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient(hunting): handle_auth_done global_id 74610 payload 274 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 -- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 msgr2=0x7f435c0a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 -- 10.20.193.51:0/267567028 >> v2:10.20.193.142:3300/0 conn(0x7f435c138600 msgr2=0x7f435c1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 --2- 10.20.193.51:0/267567028 >> v2:10.20.193.142:3300/0 conn(0x7f435c138600 0x7f435c1389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:18.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f435b7fe640 1 -- 10.20.193.51:0/267567028 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c138f20 con 0x7f435c0a35a0 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.051+0000 7f4360a79640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435b7fe640 1 -- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 msgr2=0x7f435c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435b7fe640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c0a5360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ab950 tx=0x7f434c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0780e4292037ca3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 1 -- 10.20.193.51:0/267567028 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c03c070 con 0x7f435c0a35a0 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: dump: 2026-02-17T11:54:18.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:18.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 1 -- 10.20.193.51:0/267567028 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c02fca0 con 0x7f435c0a35a0 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f4362503640 5 monclient: authenticate success, global_id 74610 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f4362503640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 1 -- 10.20.193.51:0/267567028 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c037660 con 0x7f435c0a35a0 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f435affd640 10 monclient: dump: 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.070 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f4362503640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.053+0000 7f4362503640 4 set_mon_vals no callback set 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 10 monclient: shutdown 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 -- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 msgr2=0x7f435c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c0a5360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ab950 tx=0x7f434c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 -- 10.20.193.51:0/267567028 shutdown_connections 2026-02-17T11:54:18.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c0a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 --2- 10.20.193.51:0/267567028 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c0a5360 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 --2- 10.20.193.51:0/267567028 >> v2:10.20.193.142:3300/0 conn(0x7f435c138600 0x7f435c1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 -- 10.20.193.51:0/267567028 >> 10.20.193.51:0/267567028 conn(0x7f435c0a7460 msgr2=0x7f435c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 -- 10.20.193.51:0/267567028 shutdown_connections 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 1 -- 10.20.193.51:0/267567028 wait complete. 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 10 monclient: build_initial_monmap 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.054+0000 7f4362503640 10 monclient: monmap: 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:18.072 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 Processor -- start 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 -- start start 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient: init 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): picked mon.noname-a con 0x7f435c0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): picked mon.noname-c con 0x7f435c0a58a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f435c138600 0x7f435c123f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): picked mon.noname-b con 0x7f435c138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:18.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0a25b0 con 0x7f435c0a35a0 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0a22d0 con 0x7f435c138600 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0a15f0 con 0x7f435c0a58a0 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f4362503640 10 monclient(hunting): authenticate will time out at 1145.674491s 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33528/0 (socket says 10.20.193.51:33528) 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 -- 10.20.193.51:0/3484680627 learned_addr learned my addr 10.20.193.51:0/3484680627 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): get_auth_request con 0x7f435c0a35a0 auth_method 0 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): get_auth_request con 0x7f435c0a58a0 auth_method 0 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient(hunting): handle_auth_done global_id 74613 payload 824 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 msgr2=0x7f435c136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c0a58a0 0x7f435c136910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f435c138600 msgr2=0x7f435c123f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f435c138600 0x7f435c123f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 monclient: found mon.noname-a 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.055+0000 7f435bfff640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0a8ef0 con 0x7f435c0a35a0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f435bfff640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 msgr2=0x7f435c1363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f435bfff640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f434800e7c0 tx=0x7f434800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348017070 con 0x7f435c0a35a0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: dump: 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.076 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: _finish_auth 0 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4362503640 5 monclient: authenticate success, global_id 74613 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434800ca60 con 0x7f435c0a35a0 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4362503640 10 monclient: _renew_subs 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4362503640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c125f80 con 0x7f435c0a35a0 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:18.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434800f040 con 0x7f435c0a35a0 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f435a7fc640 4 set_mon_vals no callback set 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4358ff9640 10 monclient: dump: 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.057+0000 7f4362503640 10 monclient: _renew_subs 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c137e40 con 0x7f435c0a35a0 2026-02-17T11:54:18.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 0x7f435c127770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0a5360 con 0x7f435c1cf360 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 0x7f435c127770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient: get_auth_request con 0x7f435c1cf360 auth_method 0 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4348012050 con 0x7f435c0a35a0 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 10 monclient(hunting): handle_auth_done global_id 124133 payload 824 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f435b7fe640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f435c0008d0 con 0x7f435c1cf360 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.058+0000 7f4358ff9640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f432c03dd10 0x7f432c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.059+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(329..329 src has 167..329) ==== 4767+0+0 (secure 0 0 0) 0x7f43480523a0 con 0x7f435c0a35a0 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.059+0000 7f4360a79640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f432c03dd10 0x7f432c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.059+0000 7f4360a79640 10 monclient: get_auth_request con 0x7f432c03dd10 auth_method 0 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.060+0000 7f435b7fe640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 msgr2=0x7f435c127770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.060+0000 7f435b7fe640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 0x7f435c127770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f435c06a700 tx=0x7f434c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c047020 con 0x7f435c1cf360 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 10 monclient: dump: 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.080 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f434c02fe50 con 0x7f435c1cf360 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 msgr2=0x7f435c127770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 0x7f435c127770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f435c06a700 tx=0x7f434c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 msgr2=0x7f435c127770 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4358ff9640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c1cf360 0x7f435c127770 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f435c06a700 tx=0x7f434c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.061+0000 7f4360a79640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f432c03dd10 0x7f432c0401d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4350009bd0 tx=0x7f435000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f4362503640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f4362503640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 0x7f435c1da440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f4362503640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f435c124870 con 0x7f435c124490 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 0x7f435c1da440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient: get_auth_request con 0x7f435c124490 auth_method 0 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 10 monclient(hunting): handle_auth_done global_id 124136 payload 824 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.064+0000 7f435b7fe640 1 -- 10.20.193.51:0/3484680627 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f435c124a40 con 0x7f435c124490 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f435b7fe640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 msgr2=0x7f435c1da440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f435b7fe640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 0x7f435c1da440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f434c02eea0 tx=0x7f434c039040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c047030 con 0x7f435c124490 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 10 monclient: dump: 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f434c042470 con 0x7f435c124490 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 msgr2=0x7f435c1da440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 0x7f435c1da440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f434c02eea0 tx=0x7f434c039040 comp rx=0 tx=0).stop 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 msgr2=0x7f435c1da440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:18.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.066+0000 7f4358ff9640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f435c124490 0x7f435c1da440 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f434c02eea0 tx=0x7f434c039040 comp rx=0 tx=0).stop 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12510, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:18.085 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.086 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:18.087 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:18.088 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:18.090 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:18.091 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:18.092 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:18.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f432c03dd10 msgr2=0x7f432c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f432c03dd10 0x7f432c0401d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4350009bd0 tx=0x7f435000b040 comp rx=0 tx=0).stop 2026-02-17T11:54:18.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 10 monclient: shutdown 2026-02-17T11:54:18.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:18.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 msgr2=0x7f435c1363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f434800e7c0 tx=0x7f434800ec90 comp rx=0 tx=0).stop 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4360a79640 1 -- 10.20.193.51:0/3484680627 reap_dead start 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 shutdown_connections 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 --2- 10.20.193.51:0/3484680627 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f435c0a35a0 0x7f435c1363d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 >> 10.20.193.51:0/3484680627 conn(0x7f435c0a7460 msgr2=0x7f435c0a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 shutdown_connections 2026-02-17T11:54:18.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.067+0000 7f4362503640 1 -- 10.20.193.51:0/3484680627 wait complete. 2026-02-17T11:54:18.094 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:18.094 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:54:18.094 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 10 monclient: get_monmap_and_config 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 10 monclient: build_initial_monmap 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 10 monclient: monmap: 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:18.160459+0000 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:18.160459+0000 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:18.161 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:18.162 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:18.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 1 Processor -- start 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 1 -- start start 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.159+0000 7fab6ebb6640 10 monclient: init 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fab6809a5c0 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fab6809d340 0x7fab68141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-c con 0x7fab6809d340 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fab6809b0b0 0x7fab68144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-a con 0x7fab6809b0b0 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6806e140 con 0x7fab6809a5c0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fab6809cf20 con 0x7fab6809b0b0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fab6806daa0 con 0x7fab6809d340 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6ebb6640 10 monclient(hunting): authenticate will time out at 1145.779328s 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fab6809b0b0 0x7fab68144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fab6809b0b0 0x7fab68144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33530/0 (socket says 10.20.193.51:33530) 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 -- 10.20.193.51:0/2944195462 learned_addr learned my addr 10.20.193.51:0/2944195462 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): get_auth_request con 0x7fab6809b0b0 auth_method 0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient(hunting): handle_auth_done global_id 74616 payload 274 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 -- 10.20.193.51:0/2944195462 >> v2:10.20.193.142:3300/0 conn(0x7fab6809d340 msgr2=0x7fab68141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 --2- 10.20.193.51:0/2944195462 >> v2:10.20.193.142:3300/0 conn(0x7fab6809d340 0x7fab68141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 -- 10.20.193.51:0/2944195462 >> v1:10.20.193.142:6789/0 conn(0x7fab6809a5c0 legacy=0x7fab6809a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient: _finish_hunting 0 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 monclient: found mon.noname-a 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:18.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.160+0000 7fab6d12c640 1 -- 10.20.193.51:0/2944195462 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6809c610 con 0x7fab6809b0b0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6d12c640 1 -- 10.20.193.51:0/2944195462 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 msgr2=0x7fab68144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6d12c640 1 --2- 10.20.193.51:0/2944195462 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68144000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab6809c980 tx=0x7fab6402f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6883d0dbad709a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 1 -- 10.20.193.51:0/2944195462 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6402fe30 con 0x7fab6809b0b0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: dump: 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 1 -- 10.20.193.51:0/2944195462 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab640373f0 con 0x7fab6809b0b0 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:18.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 1 -- 10.20.193.51:0/2944195462 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640377c0 con 0x7fab6809b0b0 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 5 monclient: authenticate success, global_id 74616 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 4 set_mon_vals no callback set 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab5f7fe640 10 monclient: dump: 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 10 monclient: shutdown 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 -- 10.20.193.51:0/2944195462 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 msgr2=0x7fab68144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/2944195462 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68144000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab6809c980 tx=0x7fab6402f200 comp rx=0 tx=0).stop 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 -- 10.20.193.51:0/2944195462 shutdown_connections 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/2944195462 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68144000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/2944195462 >> v2:10.20.193.142:3300/0 conn(0x7fab6809d340 0x7fab68141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 -- 10.20.193.51:0/2944195462 >> 10.20.193.51:0/2944195462 conn(0x7fab680a30c0 msgr2=0x7fab680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:18.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 -- 10.20.193.51:0/2944195462 shutdown_connections 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.163+0000 7fab6ebb6640 1 -- 10.20.193.51:0/2944195462 wait complete. 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient: build_initial_monmap 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient: monmap: 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 Processor -- start 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 -- start start 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient: init 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809a5c0 0x7fab68142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-b con 0x7fab6809a5c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-a con 0x7fab6809b0b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab681d3890 0x7fab680725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): picked mon.noname-c con 0x7fab681d3890 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fab680a3fa0 con 0x7fab6809b0b0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab680a3e20 con 0x7fab6809a5c0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fab68144540 con 0x7fab681d3890 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6ebb6640 10 monclient(hunting): authenticate will time out at 1145.783633s 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33532/0 (socket says 10.20.193.51:33532) 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 -- 10.20.193.51:0/1784012664 learned_addr learned my addr 10.20.193.51:0/1784012664 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab681d3890 0x7fab680725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): get_auth_request con 0x7fab6809b0b0 auth_method 0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): get_auth_request con 0x7fab681d3890 auth_method 0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6c92b640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809a5c0 0x7fab68142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6c92b640 10 monclient(hunting): get_auth_request con 0x7fab6809a5c0 auth_method 0 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6c92b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6c92b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6c92b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab6d12c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient(hunting): handle_auth_done global_id 74619 payload 824 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab681d3890 msgr2=0x7fab680725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab681d3890 0x7fab680725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809a5c0 msgr2=0x7fab68142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809a5c0 0x7fab68142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 monclient: found mon.noname-a 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.164+0000 7fab5ffff640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6813f700 con 0x7fab6809b0b0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.166+0000 7fab5ffff640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 msgr2=0x7fab68143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.166+0000 7fab5ffff640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab5000b780 tx=0x7fab5000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab500026e0 con 0x7fab6809b0b0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: dump: 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab50010070 con 0x7fab6809b0b0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 5 monclient: authenticate success, global_id 74619 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 monclient: _renew_subs 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6813f9e0 con 0x7fab6809b0b0 2026-02-17T11:54:18.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50002ac0 con 0x7fab6809b0b0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 10 monclient: dump: 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5effd640 4 set_mon_vals no callback set 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 monclient: _renew_subs 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab68143fd0 con 0x7fab6809b0b0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 0x7fab68097e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab6809ef40 con 0x7fab6809d340 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 0x7fab68097e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient: get_auth_request con 0x7fab6809d340 auth_method 0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fab5001d030 con 0x7fab6809b0b0 2026-02-17T11:54:18.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd60 0x7fab38040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.167+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(329..329 src has 167..329) ==== 4767+0+0 (secure 0 0 0) 0x7fab50051a90 con 0x7fab6809b0b0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.168+0000 7fab6c92b640 10 monclient(hunting): handle_auth_done global_id 114196 payload 824 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.168+0000 7fab6c92b640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab6809d7b0 con 0x7fab6809d340 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.168+0000 7fab6d12c640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd60 0x7fab38040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.168+0000 7fab6d12c640 10 monclient: get_auth_request con 0x7fab3803dd60 auth_method 0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab6c92b640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 msgr2=0x7fab68097e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab6c92b640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 0x7fab68097e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab5800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58006ae0 con 0x7fab6809d340 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 10 monclient: dump: 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fab58006ae0 con 0x7fab6809d340 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:18.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 msgr2=0x7fab68097e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 0x7fab68097e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab5800ec00 comp rx=0 tx=0).stop 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 msgr2=0x7fab68097e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab5d7fa640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6809d340 0x7fab68097e10 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab5800ec00 comp rx=0 tx=0).stop 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.170+0000 7fab6d12c640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd60 0x7fab38040220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab6806c1c0 tx=0x7fab64033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.173+0000 7fab6ebb6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.173+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 0x7fab681de970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.173+0000 7fab6ebb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.173+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab6809a9a0 con 0x7fab68098350 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 0x7fab681de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient: get_auth_request con 0x7fab68098350 auth_method 0 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:18.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 10 monclient(hunting): handle_auth_done global_id 114199 payload 824 2026-02-17T11:54:18.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.174+0000 7fab6c92b640 1 -- 10.20.193.51:0/1784012664 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fab6813dfd0 con 0x7fab68098350 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab6c92b640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 msgr2=0x7fab681de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab6c92b640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 0x7fab681de970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab58003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5800c930 con 0x7fab68098350 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 10 monclient: dump: 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:18.178 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fab58006e30 con 0x7fab68098350 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 msgr2=0x7fab681de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 0x7fab681de970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab58003860 comp rx=0 tx=0).stop 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 msgr2=0x7fab681de970 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.176+0000 7fab5d7fa640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab68098350 0x7fab681de970 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e730 tx=0x7fab58003860 comp rx=0 tx=0).stop 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 70, 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 60052, 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:18.179 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.180 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:18.181 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.182 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:18.183 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:18.184 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:18.185 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd60 msgr2=0x7fab38040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd60 0x7fab38040220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab6806c1c0 tx=0x7fab64033000 comp rx=0 tx=0).stop 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 10 monclient: shutdown 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 msgr2=0x7fab68143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab5000b780 tx=0x7fab5000bc50 comp rx=0 tx=0).stop 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6d12c640 1 -- 10.20.193.51:0/1784012664 reap_dead start 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 shutdown_connections 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 --2- 10.20.193.51:0/1784012664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab6809b0b0 0x7fab68143470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 >> 10.20.193.51:0/1784012664 conn(0x7fab680a30c0 msgr2=0x7fab6809fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 shutdown_connections 2026-02-17T11:54:18.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:18.177+0000 7fab6ebb6640 1 -- 10.20.193.51:0/1784012664 wait complete. 2026-02-17T11:54:18.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:54:18.186 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T11:54:18.186 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-17T11:54:18.186 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T11:54:18.186 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:54:18.187 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:54:18.187 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:18.197 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:54:18.197 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T11:54:18.198 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T11:54:18.198 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:54:33.199 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T11:54:33.199 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T11:54:33.199 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:54:33.200 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:54:33.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 10 monclient: get_monmap_and_config 2026-02-17T11:54:33.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 10 monclient: build_initial_monmap 2026-02-17T11:54:33.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 10 monclient: monmap: 2026-02-17T11:54:33.272 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:33.272 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:33.269450+0000 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:33.269450+0000 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:33.273 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 1 Processor -- start 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 1 -- start start 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.268+0000 7fc20e779640 10 monclient: init 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-a con 0x7fc2080a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc2080a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-b con 0x7fc20813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20806e140 con 0x7fc2080a0750 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc20809f910 con 0x7fc2080a3bb0 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc20809ccd0 con 0x7fc20813b760 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20e779640 10 monclient(hunting): authenticate will time out at 1160.888241s 2026-02-17T11:54:33.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc207fff640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 msgr2=0x7fc20809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc207fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36956/0 (socket says 10.20.193.51:36956) 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 learned_addr learned my addr 10.20.193.51:0/1973387276 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc20813b760 auth_method 0 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:33.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.269+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:33.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.271+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.142:6789/0 conn(0x7fc2080a0750 legacy=0x7fc20809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:33.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 msgr2=0x7fc20809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc207fff640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc20813b760 auth_method 0 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:33.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.470+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:54:33.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 msgr2=0x7fc20809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc207fff640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc20813b760 auth_method 0 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:33.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:33.871+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:54:34.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 msgr2=0x7fc20809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc207fff640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc20813b760 auth_method 0 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:34.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:34.672+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:54:36.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): tick 2026-02-17T11:54:36.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 msgr2=0x7fc20813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc20813b760 0x7fc20813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 msgr2=0x7fc20809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc2080a3bb0 0x7fc20809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:36.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.142:6789/0 conn(0x7fc2080a0750 legacy=0x7fc20809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient: _add_conns ranks=[0,4] 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1e4003840 addr v1:10.20.193.51:6789/0 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fc1e4007570 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20809eec0 con 0x7fc1e4003840 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc20809f910 con 0x7fc1e4007570 2026-02-17T11:54:36.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc205ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.51:6789/0 conn(0x7fc1e4003840 legacy=0x7fc1e4005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 10 monclient(hunting): get_auth_request con 0x7fc1e4007570 auth_method 0 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:36.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:54:36.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:36.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:36.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:36.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.51:6789/0 conn(0x7fc1e4003840 legacy=0x7fc1e4005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:54:36.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:36.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 10 monclient(hunting): get_auth_request con 0x7fc1e4007570 auth_method 0 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:36.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.470+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:54:36.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.51:6789/0 conn(0x7fc1e4003840 legacy=0x7fc1e4005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:54:36.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 10 monclient(hunting): get_auth_request con 0x7fc1e4007570 auth_method 0 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:36.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:36.871+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:54:37.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.51:6789/0 conn(0x7fc1e4003840 legacy=0x7fc1e4005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:54:37.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 10 monclient(hunting): get_auth_request con 0x7fc1e4007570 auth_method 0 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:37.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:37.672+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:54:38.600 INFO:tasks.rados.rados.0.trial142.stdout:1413: done (2 left) 2026-02-17T11:54:38.600 INFO:tasks.rados.rados.0.trial142.stdout:1414: done (1 left) 2026-02-17T11:54:38.600 INFO:tasks.rados.rados.0.trial142.stdout:1415: done (0 left) 2026-02-17T11:54:38.600 INFO:tasks.rados.rados.0.trial142.stdout:1416: snap_remove snap 151 2026-02-17T11:54:39.263 INFO:tasks.rados.rados.0.trial142.stdout:1416: done (0 left) 2026-02-17T11:54:39.264 INFO:tasks.rados.rados.0.trial142.stdout:1417: snap_remove snap 132 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): tick 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4007570 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 >> v1:10.20.193.51:6789/0 conn(0x7fc1e4003840 legacy=0x7fc1e4005ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 1 -- 10.20.193.51:0/1973387276 reap_dead start 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 0x7fc1e4009a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fc1e4006470 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc1e4006d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fc1e40068f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4005c30 0x7fc1e400a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fc1e4005c30 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc20809f910 con 0x7fc1e4006470 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc20809ccd0 con 0x7fc1e4005c30 2026-02-17T11:54:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 1 -- 10.20.193.51:0/1973387276 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e400a600 con 0x7fc1e40068f0 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc205ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc207fff640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc207fff640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc1e4006d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): get_auth_request con 0x7fc1e40068f0 auth_method 0 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4005c30 0x7fc1e400a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc1e4005c30 auth_method 0 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc20ccef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient(hunting): handle_auth_done global_id 124142 payload 274 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4005c30 msgr2=0x7fc1e400a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4005c30 0x7fc1e400a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 msgr2=0x7fc1e4009a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 0x7fc1e4009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 monclient: found mon.noname-b 2026-02-17T11:54:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.269+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e400b1c0 con 0x7fc1e40068f0 2026-02-17T11:54:39.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc2077fe640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 msgr2=0x7fc1e4006d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc2077fe640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc1e4006d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4007450 tx=0x7fc1f802f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330a31c5786b2b3e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 1 -- 10.20.193.51:0/1973387276 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803c020 con 0x7fc1e40068f0 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: dump: 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.284 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 1 -- 10.20.193.51:0/1973387276 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8038410 con 0x7fc1e40068f0 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 1 -- 10.20.193.51:0/1973387276 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8038800 con 0x7fc1e40068f0 2026-02-17T11:54:39.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc206ffd640 10 monclient: dump: 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.286 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 5 monclient: authenticate success, global_id 124142 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 4 set_mon_vals no callback set 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 10 monclient: shutdown 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 -- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 msgr2=0x7fc1e4006d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc1e4006d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4007450 tx=0x7fc1f802f9d0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 -- 10.20.193.51:0/1973387276 shutdown_connections 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.142:3300/0 conn(0x7fc1e4005c30 0x7fc1e400a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 --2- 10.20.193.51:0/1973387276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc1e4006d70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 --2- 10.20.193.51:0/1973387276 >> v2:10.20.193.51:3300/0 conn(0x7fc1e4006470 0x7fc1e4009a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 -- 10.20.193.51:0/1973387276 >> 10.20.193.51:0/1973387276 conn(0x7fc2080a30c0 msgr2=0x7fc2080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 -- 10.20.193.51:0/1973387276 shutdown_connections 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.272+0000 7fc20e779640 1 -- 10.20.193.51:0/1973387276 wait complete. 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient: build_initial_monmap 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient: monmap: 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:39.288 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 Processor -- start 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 -- start start 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient: init 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:39.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 0x7fc208096100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-a con 0x7fc1e4005c30 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1e4006470 0x7fc208096640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-b con 0x7fc1e4006470 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): picked mon.noname-c con 0x7fc1e40068f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080a04b0 con 0x7fc1e4005c30 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc20809c850 con 0x7fc1e4006470 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc20809dac0 con 0x7fc1e40068f0 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20e779640 10 monclient(hunting): authenticate will time out at 1166.892834s 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc207fff640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 msgr2=0x7fc208096100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc207fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 0x7fc208096100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42640/0 (socket says 10.20.193.51:42640) 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 1 -- 10.20.193.51:0/2820314831 learned_addr learned my addr 10.20.193.51:0/2820314831 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): get_auth_request con 0x7fc1e40068f0 auth_method 0 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.273+0000 7fc20ccef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 10 monclient(hunting): handle_auth_done global_id 124145 payload 824 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 -- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1e4006470 msgr2=0x7fc208096640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1e4006470 0x7fc208096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 -- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 msgr2=0x7fc208096100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 0x7fc208096100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 monclient: found mon.noname-c 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.274+0000 7fc20ccef640 1 -- 10.20.193.51:0/2820314831 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080a29d0 con 0x7fc1e40068f0 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20ccef640 1 -- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 msgr2=0x7fc208096b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20ccef640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc20806dab0 tx=0x7fc1fc014dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc01b030 con 0x7fc1e40068f0 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: dump: 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.293 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc012c50 con 0x7fc1e40068f0 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 5 monclient: authenticate success, global_id 124145 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 10 monclient: _renew_subs 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20809d7b0 con 0x7fc1e40068f0 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc012e40 con 0x7fc1e40068f0 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 10 monclient: dump: 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.295 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc2067fc640 4 set_mon_vals no callback set 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 10 monclient: _renew_subs 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc208099900 con 0x7fc1e40068f0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.276+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc1fc017440 con 0x7fc1e40068f0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc20e779640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc20e779640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc20e779640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc204ff9640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 0x7fc1d8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20809def0 con 0x7fc1e40068f0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(331..331 src has 167..331) ==== 4811+0+0 (secure 0 0 0) 0x7fc1fc053230 con 0x7fc1e40068f0 2026-02-17T11:54:39.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc207fff640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 0x7fc1d8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.277+0000 7fc207fff640 10 monclient: get_auth_request con 0x7fc1d803dcc0 auth_method 0 2026-02-17T11:54:39.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.279+0000 7fc207fff640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 0x7fc1d8040180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4003a80 tx=0x7fc1f4007170 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.279+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc1fc051c10 con 0x7fc1e40068f0 2026-02-17T11:54:39.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.279+0000 7fc204ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.279+0000 7fc204ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:39.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc20e779640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:54:39.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc20e779640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:39.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc20e779640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc2080008d0 con 0x7fc1e40068f0 2026-02-17T11:54:39.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc204ff9640 1 -- 10.20.193.51:0/2820314831 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fc1fc00adb0 con 0x7fc1e40068f0 2026-02-17T11:54:39.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc204ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:54:39.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.394+0000 7fc204ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:39.398 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:54:39.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 msgr2=0x7fc1d8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 0x7fc1d8040180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4003a80 tx=0x7fc1f4007170 comp rx=0 tx=0).stop 2026-02-17T11:54:39.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 10 monclient: shutdown 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 msgr2=0x7fc208096b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc20806dab0 tx=0x7fc1fc014dd0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 shutdown_connections 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc1d803dcc0 0x7fc1d8040180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1e40068f0 0x7fc208096b80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1e4006470 0x7fc208096640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 --2- 10.20.193.51:0/2820314831 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1e4005c30 0x7fc208096100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 >> 10.20.193.51:0/2820314831 conn(0x7fc2080a30c0 msgr2=0x7fc20813ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 shutdown_connections 2026-02-17T11:54:39.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.395+0000 7fc20e779640 1 -- 10.20.193.51:0/2820314831 wait complete. 2026-02-17T11:54:39.406 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:54:39.406 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:54:39.407 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:54:39.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.476+0000 7fd420bd3640 10 monclient: get_monmap_and_config 2026-02-17T11:54:39.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.476+0000 7fd420bd3640 10 monclient: build_initial_monmap 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.476+0000 7fd420bd3640 10 monclient: monmap: 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:39.477681+0000 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:39.477681+0000 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:39.479 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 Processor -- start 2026-02-17T11:54:39.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 -- start start 2026-02-17T11:54:39.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient: init 2026-02-17T11:54:39.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:39.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd41c0a3bb0 0x7fd41c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-c con 0x7fd41c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 0x7fd41c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-a con 0x7fd41c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd41c09e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c06e140 con 0x7fd41c09e540 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0a3f90 con 0x7fd41c0a0750 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c09f910 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd420bd3640 10 monclient(hunting): authenticate will time out at 1167.096498s 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41ad76640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fd41c09e540 legacy=0x7fd41c13c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd419d74640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 msgr2=0x7fd41c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd419d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 0x7fd41c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd41c0a3bb0 0x7fd41c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd41c0a3bb0 0x7fd41c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:35918/0 (socket says 10.20.193.51:35918) 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 1 -- 10.20.193.51:0/2820049559 learned_addr learned my addr 10.20.193.51:0/2820049559 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 10 monclient(hunting): get_auth_request con 0x7fd41c0a3bb0 auth_method 0 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.477+0000 7fd41a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient(hunting): handle_auth_done global_id 114205 payload 274 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 1 -- 10.20.193.51:0/2820049559 >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 msgr2=0x7fd41c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 1 --2- 10.20.193.51:0/2820049559 >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 0x7fd41c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 1 -- 10.20.193.51:0/2820049559 >> v1:10.20.193.51:6789/0 conn(0x7fd41c09e540 legacy=0x7fd41c13c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 1 monclient: found mon.noname-c 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:54:39.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.478+0000 7fd41a575640 1 -- 10.20.193.51:0/2820049559 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c09ccd0 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd41a575640 1 -- 10.20.193.51:0/2820049559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c0a3bb0 msgr2=0x7fd41c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd41a575640 1 --2- 10.20.193.51:0/2820049559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c0a3bb0 0x7fd41c09dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06f3c0 tx=0x7fd41002ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e165920c211c14ce server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 1 -- 10.20.193.51:0/2820049559 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41003c070 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: dump: 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.491 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 5 monclient: authenticate success, global_id 114205 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 1 -- 10.20.193.51:0/2820049559 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41002fd90 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 1 -- 10.20.193.51:0/2820049559 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037660 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd419573640 10 monclient: dump: 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.492 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 4 set_mon_vals no callback set 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 10 monclient: shutdown 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 -- 10.20.193.51:0/2820049559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c0a3bb0 msgr2=0x7fd41c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2820049559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c0a3bb0 0x7fd41c09dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06f3c0 tx=0x7fd41002ee30 comp rx=0 tx=0).stop 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 -- 10.20.193.51:0/2820049559 shutdown_connections 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2820049559 >> v2:10.20.193.51:3300/0 conn(0x7fd41c0a0750 0x7fd41c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2820049559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c0a3bb0 0x7fd41c09dac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 -- 10.20.193.51:0/2820049559 >> 10.20.193.51:0/2820049559 conn(0x7fd41c0a30c0 msgr2=0x7fd41c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 -- 10.20.193.51:0/2820049559 shutdown_connections 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.481+0000 7fd420bd3640 1 -- 10.20.193.51:0/2820049559 wait complete. 2026-02-17T11:54:39.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient: build_initial_monmap 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient: monmap: 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 Processor -- start 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 -- start start 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient: init 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:39.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c09e540 0x7fd41c1cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-b con 0x7fd41c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd41c0a0750 0x7fd41c09be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-a con 0x7fd41c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): picked mon.noname-c con 0x7fd41c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0a04b0 con 0x7fd41c0a0750 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c09c850 con 0x7fd41c09e540 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c13de80 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd420bd3640 10 monclient(hunting): authenticate will time out at 1167.101788s 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd419d74640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd41c0a0750 msgr2=0x7fd41c09be80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd419d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd41c0a0750 0x7fd41c09be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42648/0 (socket says 10.20.193.51:42648) 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 learned_addr learned my addr 10.20.193.51:0/2936341154 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): get_auth_request con 0x7fd41c0a3bb0 auth_method 0 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.482+0000 7fd41ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 10 monclient(hunting): handle_auth_done global_id 124148 payload 824 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c09e540 msgr2=0x7fd41c1cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd41c09e540 0x7fd41c1cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd41c0a0750 msgr2=0x7fd41c09be80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd41c0a0750 0x7fd41c09be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 monclient: found mon.noname-c 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.483+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c094620 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 msgr2=0x7fd41c092b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41ad76640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00be50 tx=0x7fd40c00bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c016630 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: dump: 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c010030 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 5 monclient: authenticate success, global_id 124148 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 monclient: _renew_subs 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c096630 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c016a10 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd402ffd640 10 monclient: dump: 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd418d72640 4 set_mon_vals no callback set 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 monclient: _renew_subs 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c094d00 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 0x7fd41c0930c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c073e40 con 0x7fd41c096070 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41a575640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 0x7fd41c0930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41a575640 10 monclient: get_auth_request con 0x7fd41c096070 auth_method 0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.485+0000 7fd41a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd40c0153e0 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd41a575640 10 monclient(hunting): handle_auth_done global_id 124151 payload 824 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd41a575640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd41c09dac0 con 0x7fd41c096070 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd402ffd640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd3e803dcc0 0x7fd3e8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(331..331 src has 167..331) ==== 4811+0+0 (secure 0 0 0) 0x7fd40c052f00 con 0x7fd41c0a3bb0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd419d74640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd3e803dcc0 0x7fd3e8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.486+0000 7fd419d74640 10 monclient: get_auth_request con 0x7fd3e803dcc0 auth_method 0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd41a575640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 msgr2=0x7fd41c0930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd41a575640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 0x7fd41c0930c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd41c09f5f0 tx=0x7fd410037670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410046020 con 0x7fd41c096070 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 10 monclient: dump: 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd410037d70 con 0x7fd41c096070 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 msgr2=0x7fd41c0930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 0x7fd41c0930c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd41c09f5f0 tx=0x7fd410037670 comp rx=0 tx=0).stop 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 msgr2=0x7fd41c0930c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.488+0000 7fd402ffd640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c096070 0x7fd41c0930c0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd41c09f5f0 tx=0x7fd410037670 comp rx=0 tx=0).stop 2026-02-17T11:54:39.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.489+0000 7fd419d74640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd3e803dcc0 0x7fd3e8040180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06f5f0 tx=0x7fd404009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd420bd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:39.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 0x7fd41c1da520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd420bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0008d0 con 0x7fd41c09c3c0 2026-02-17T11:54:39.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 0x7fd41c1da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient: get_auth_request con 0x7fd41c09c3c0 auth_method 0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 10 monclient(hunting): handle_auth_done global_id 124154 payload 824 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.491+0000 7fd41a575640 1 -- 10.20.193.51:0/2936341154 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd41c050ac0 con 0x7fd41c09c3c0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.493+0000 7fd41a575640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 msgr2=0x7fd41c1da520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.493+0000 7fd41a575640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 0x7fd41c1da520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd410002410 tx=0x7fd410008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410046040 con 0x7fd41c09c3c0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 10 monclient: dump: 2026-02-17T11:54:39.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4696 (secure 0 0 0) 0x7fd41004dd90 con 0x7fd41c09c3c0 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 msgr2=0x7fd41c1da520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 0x7fd41c1da520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd410002410 tx=0x7fd410008030 comp rx=0 tx=0).stop 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 msgr2=0x7fd41c1da520 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:39.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd402ffd640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c09c3c0 0x7fd41c1da520 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd410002410 tx=0x7fd410008030 comp rx=0 tx=0).stop 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 72, 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 33939, 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:39.505 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.506 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:39.507 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:39.508 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.509 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.510 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:39.511 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.512 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.513 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:39.514 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd3e803dcc0 msgr2=0x7fd3e8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd3e803dcc0 0x7fd3e8040180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06f5f0 tx=0x7fd404009270 comp rx=0 tx=0).stop 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 10 monclient: shutdown 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 msgr2=0x7fd41c092b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00be50 tx=0x7fd40c00bf50 comp rx=0 tx=0).stop 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd41ad76640 1 -- 10.20.193.51:0/2936341154 reap_dead start 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 shutdown_connections 2026-02-17T11:54:39.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 --2- 10.20.193.51:0/2936341154 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd41c0a3bb0 0x7fd41c092b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 >> 10.20.193.51:0/2936341154 conn(0x7fd41c0a30c0 msgr2=0x7fd41c072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 shutdown_connections 2026-02-17T11:54:39.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.494+0000 7fd420bd3640 1 -- 10.20.193.51:0/2936341154 wait complete. 2026-02-17T11:54:39.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:54:39.516 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:54:39.516 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: get_monmap_and_config 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: build_initial_monmap 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: monmap: 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:54:39.583202+0000 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:54:39.583202+0000 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:54:39.586 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 Processor -- start 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 -- start start 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: init 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fccc80a3bb0 0x7fccc809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-c con 0x7fccc80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 0x7fccc809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-a con 0x7fccc80a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fccc809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc806e140 con 0x7fccc809e540 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fccc80a3f90 con 0x7fccc80a0750 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fccc809f910 con 0x7fccc80a3bb0 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fcccce7c640 10 monclient(hunting): authenticate will time out at 1167.201944s 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fccc5d74640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 msgr2=0x7fccc809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.582+0000 7fccc5d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 0x7fccc809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fccc80a3bb0 0x7fccc809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6d76640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fccc809e540 0x7fccc813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:34142/0 (socket says 10.20.193.51:34142) 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6d76640 1 -- 10.20.193.51:0/3593876223 learned_addr learned my addr 10.20.193.51:0/3593876223 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 --2- 10.20.193.51:0/3593876223 >> v2:10.20.193.142:3300/0 conn(0x7fccc80a3bb0 0x7fccc809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:35938/0 (socket says 10.20.193.51:35938) 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): get_auth_request con 0x7fccc80a3bb0 auth_method 0 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient(hunting): handle_auth_done global_id 114208 payload 274 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 -- 10.20.193.51:0/3593876223 >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 msgr2=0x7fccc809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 --2- 10.20.193.51:0/3593876223 >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 0x7fccc809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 -- 10.20.193.51:0/3593876223 >> v1:10.20.193.142:6789/0 conn(0x7fccc809e540 legacy=0x7fccc813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:39.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 monclient: found mon.noname-c 2026-02-17T11:54:39.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:54:39.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.583+0000 7fccc6575640 1 -- 10.20.193.51:0/3593876223 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc809ccd0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc6575640 1 -- 10.20.193.51:0/3593876223 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a3bb0 msgr2=0x7fccc809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc6575640 1 --2- 10.20.193.51:0/3593876223 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a3bb0 0x7fccc809dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fccc806f3c0 tx=0x7fccbc02ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd5dde6a461c945 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 1 -- 10.20.193.51:0/3593876223 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc03c070 con 0x7fccc80a3bb0 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: dump: 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.593 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 1 -- 10.20.193.51:0/3593876223 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc02fcb0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 5 monclient: authenticate success, global_id 114208 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 1 -- 10.20.193.51:0/3593876223 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc02fe60 con 0x7fccc80a3bb0 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 4 set_mon_vals no callback set 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fccc5573640 10 monclient: dump: 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 10 monclient: shutdown 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 -- 10.20.193.51:0/3593876223 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a3bb0 msgr2=0x7fccc809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 --2- 10.20.193.51:0/3593876223 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a3bb0 0x7fccc809dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fccc806f3c0 tx=0x7fccbc02ed50 comp rx=0 tx=0).stop 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 -- 10.20.193.51:0/3593876223 shutdown_connections 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 --2- 10.20.193.51:0/3593876223 >> v2:10.20.193.51:3300/0 conn(0x7fccc80a0750 0x7fccc809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 --2- 10.20.193.51:0/3593876223 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a3bb0 0x7fccc809dac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 -- 10.20.193.51:0/3593876223 >> 10.20.193.51:0/3593876223 conn(0x7fccc80a30c0 msgr2=0x7fccc80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 -- 10.20.193.51:0/3593876223 shutdown_connections 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 1 -- 10.20.193.51:0/3593876223 wait complete. 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.586+0000 7fcccce7c640 10 monclient: build_initial_monmap 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient: monmap: 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 Processor -- start 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 -- start start 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient: init 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fccc809e540 0x7fccc8138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-a con 0x7fccc809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a0750 0x7fccc812fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-b con 0x7fccc80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): picked mon.noname-c con 0x7fccc80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fccc80a04b0 con 0x7fccc809e540 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccc809c850 con 0x7fccc80a0750 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fccc813de80 con 0x7fccc80a3bb0 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fcccce7c640 10 monclient(hunting): authenticate will time out at 1167.206448s 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6575640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fccc809e540 msgr2=0x7fccc8138210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fccc809e540 0x7fccc8138210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42672/0 (socket says 10.20.193.51:42672) 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 learned_addr learned my addr 10.20.193.51:0/2929471587 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): get_auth_request con 0x7fccc80a3bb0 auth_method 0 2026-02-17T11:54:39.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc5d74640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a0750 0x7fccc812fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient(hunting): handle_auth_done global_id 124157 payload 824 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a0750 msgr2=0x7fccc812fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a0750 0x7fccc812fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fccc809e540 msgr2=0x7fccc8138210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fccc809e540 0x7fccc8138210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 monclient: found mon.noname-c 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc8131770 con 0x7fccc80a3bb0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc5d74640 10 monclient: get_auth_request con 0x7fccc80a0750 auth_method 0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.587+0000 7fccc5d74640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc80a0750 0x7fccc812fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 msgr2=0x7fccc81300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccc6d76640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccb800ca40 tx=0x7fccb800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb800add0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: dump: 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: _finish_auth 0 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb8012400 con 0x7fccc80a3bb0 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fcccce7c640 5 monclient: authenticate success, global_id 124157 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fcccce7c640 10 monclient: _renew_subs 2026-02-17T11:54:39.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fcccce7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc8133a60 con 0x7fccc80a3bb0 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb80127f0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccaeffd640 10 monclient: dump: 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.589+0000 7fccc4d72640 4 set_mon_vals no callback set 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 10 monclient: _renew_subs 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:54:39.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc806f7d0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 0x7fccc8139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccc81309f0 con 0x7fccc8130610 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fccb80129d0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccc6575640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 0x7fccc8139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccc6575640 10 monclient: get_auth_request con 0x7fccc8130610 auth_method 0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccc6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccc6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccc6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccaeffd640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc9403dcc0 0x7fcc94040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.590+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(331..331 src has 167..331) ==== 4811+0+0 (secure 0 0 0) 0x7fccb8052ce0 con 0x7fccc80a3bb0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc5d74640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc9403dcc0 0x7fcc94040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc5d74640 10 monclient: get_auth_request con 0x7fcc9403dcc0 auth_method 0 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc6575640 10 monclient(hunting): handle_auth_done global_id 114211 payload 824 2026-02-17T11:54:39.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.591+0000 7fccc6575640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccc809dac0 con 0x7fccc8130610 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccc6575640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 msgr2=0x7fccc8139980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccc6575640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 0x7fccc8139980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccbc039000 tx=0x7fccbc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc047070 con 0x7fccc8130610 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:39.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 10 monclient: dump: 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccc5d74640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc9403dcc0 0x7fcc94040180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fccb0006fd0 tx=0x7fccb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fccbc037d00 con 0x7fccc8130610 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 msgr2=0x7fccc8139980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 0x7fccc8139980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccbc039000 tx=0x7fccbc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 msgr2=0x7fccc8139980 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.593+0000 7fccaeffd640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8130610 0x7fccc8139980 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccbc039000 tx=0x7fccbc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fcccce7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fcccce7c640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 0x7fccc813a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fcccce7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccc81332a0 con 0x7fccc8139ec0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 0x7fccc813a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient: get_auth_request con 0x7fccc8139ec0 auth_method 0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 10 monclient(hunting): handle_auth_done global_id 114214 payload 824 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.597+0000 7fccc6575640 1 -- 10.20.193.51:0/2929471587 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fccc80008d0 con 0x7fccc8139ec0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccc6575640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 msgr2=0x7fccc813a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccc6575640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 0x7fccc813a2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccbc002410 tx=0x7fccbc008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc058020 con 0x7fccc8139ec0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 10 monclient: dump: 2026-02-17T11:54:39.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7fccbc042440 con 0x7fccc8139ec0 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 msgr2=0x7fccc813a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 0x7fccc813a2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccbc002410 tx=0x7fccbc008030 comp rx=0 tx=0).stop 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 msgr2=0x7fccc813a2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccaeffd640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fccc8139ec0 0x7fccc813a2a0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccbc002410 tx=0x7fccbc008030 comp rx=0 tx=0).stop 2026-02-17T11:54:39.606 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 72, 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 81474, 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.607 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.608 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:54:39.609 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:54:39.610 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.611 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.612 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.613 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.614 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:54:39.615 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:54:39.616 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc9403dcc0 msgr2=0x7fcc94040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcc9403dcc0 0x7fcc94040180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fccb0006fd0 tx=0x7fccb0008040 comp rx=0 tx=0).stop 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 10 monclient: shutdown 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 msgr2=0x7fccc81300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccb800ca40 tx=0x7fccb800cf10 comp rx=0 tx=0).stop 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fccc6d76640 1 -- 10.20.193.51:0/2929471587 reap_dead start 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 shutdown_connections 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 --2- 10.20.193.51:0/2929471587 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fccc80a3bb0 0x7fccc81300d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 >> 10.20.193.51:0/2929471587 conn(0x7fccc80a30c0 msgr2=0x7fccc8072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 shutdown_connections 2026-02-17T11:54:39.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:54:39.600+0000 7fcccce7c640 1 -- 10.20.193.51:0/2929471587 wait complete. 2026-02-17T11:54:39.618 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:54:39.618 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:54:40.268 INFO:tasks.rados.rados.0.trial142.stdout:1417: done (0 left) 2026-02-17T11:54:40.269 INFO:tasks.rados.rados.0.trial142.stdout:1418: copy_from oid 38 from oid 14 current snap is 155 2026-02-17T11:54:40.269 INFO:tasks.rados.rados.0.trial142.stdout:1419: snap_create 2026-02-17T11:54:40.277 INFO:tasks.rados.rados.0.trial142.stdout:1418: finishing copy_from racing read to trial14245205-38 2026-02-17T11:54:40.281 INFO:tasks.rados.rados.0.trial142.stdout:1418: finishing copy_from to trial14245205-38 2026-02-17T11:54:40.281 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1109 (ObjNum 498 snap 152 seq_num 498) dirty exists 2026-02-17T11:54:41.269 INFO:tasks.rados.rados.0.trial142.stdout:1418: done (1 left) 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1419: done (0 left) 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1420: read oid 6 snap -1 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1420: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1421: read oid 33 snap -1 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1421: expect deleted 2026-02-17T11:54:41.270 INFO:tasks.rados.rados.0.trial142.stdout:1422: delete oid 31 current snap is 156 2026-02-17T11:54:41.274 INFO:tasks.rados.rados.0.trial142.stdout:1421: done (2 left) 2026-02-17T11:54:41.274 INFO:tasks.rados.rados.0.trial142.stdout:1422: done (1 left) 2026-02-17T11:54:41.274 INFO:tasks.rados.rados.0.trial142.stdout:1423: copy_from oid 34 from oid 15 current snap is 156 2026-02-17T11:54:41.274 INFO:tasks.rados.rados.0.trial142.stdout:1424: copy_from oid 18 from oid 50 current snap is 156 2026-02-17T11:54:41.274 INFO:tasks.rados.rados.0.trial142.stdout:1425: snap_remove snap 139 2026-02-17T11:54:43.136 INFO:tasks.rados.rados.0.trial142.stdout:1425: done (3 left) 2026-02-17T11:54:43.136 INFO:tasks.rados.rados.0.trial142.stdout:1426: snap_remove snap 154 2026-02-17T11:54:43.204 INFO:tasks.rados.rados.0.trial142.stdout:1426: done (3 left) 2026-02-17T11:54:43.204 INFO:tasks.rados.rados.0.trial142.stdout:1427: snap_remove snap 143 2026-02-17T11:54:44.207 INFO:tasks.rados.rados.0.trial142.stdout:1427: done (3 left) 2026-02-17T11:54:44.207 INFO:tasks.rados.rados.0.trial142.stdout:1428: write oid 37 current snap is 156 2026-02-17T11:54:44.207 INFO:tasks.rados.rados.0.trial142.stdout:1420: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:44.355 INFO:tasks.rados.rados.0.trial142.stdout:1423: finishing copy_from racing read to trial14245205-34 2026-02-17T11:54:44.355 INFO:tasks.rados.rados.0.trial142.stdout:1423: finishing copy_from to trial14245205-34 2026-02-17T11:54:44.356 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 961 (ObjNum 506 snap 153 seq_num 506) dirty exists 2026-02-17T11:54:44.356 INFO:tasks.rados.rados.0.trial142.stdout:1424: finishing copy_from racing read to trial14245205-18 2026-02-17T11:54:44.356 INFO:tasks.rados.rados.0.trial142.stdout:1424: finishing copy_from to trial14245205-18 2026-02-17T11:54:44.356 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 725 (ObjNum 466 snap 141 seq_num 466) dirty exists 2026-02-17T11:54:44.356 INFO:tasks.rados.rados.0.trial142.stdout:1428: seq_num 511 ranges {588377=647890,1935828=635840} 2026-02-17T11:54:44.360 INFO:tasks.rados.rados.0.trial142.stdout:1428: writing trial14245205-37 from 588377 to 1236267 tid 1 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1428: writing trial14245205-37 from 1935828 to 2571668 tid 2 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1420: done (3 left) 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1423: done (2 left) 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1424: done (1 left) 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1429: snap_create 2026-02-17T11:54:44.366 INFO:tasks.rados.rados.0.trial142.stdout:1428: finishing write tid 1 to trial14245205-37 2026-02-17T11:54:44.367 INFO:tasks.rados.rados.0.trial142.stdout:1428: finishing write tid 2 to trial14245205-37 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: finishing write tid 3 to trial14245205-37 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: finishing write tid 4 to trial14245205-37 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: oid 37 updating version 0 to 703 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: oid 37 version 703 is already newer than 701 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: oid 37 version 703 is already newer than 702 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 703 (ObjNum 511 snap 156 seq_num 511) dirty exists 2026-02-17T11:54:44.368 INFO:tasks.rados.rados.0.trial142.stdout:1428: left oid 37 (ObjNum 511 snap 156 seq_num 511) 2026-02-17T11:54:45.275 INFO:tasks.rados.rados.0.trial142.stdout:1428: done (1 left) 2026-02-17T11:54:45.276 INFO:tasks.rados.rados.0.trial142.stdout:1429: done (0 left) 2026-02-17T11:54:45.276 INFO:tasks.rados.rados.0.trial142.stdout:1430: snap_create 2026-02-17T11:54:46.326 INFO:tasks.rados.rados.0.trial142.stdout:1430: done (0 left) 2026-02-17T11:54:46.326 INFO:tasks.rados.rados.0.trial142.stdout:1431: rollback oid 46 current snap is 158 2026-02-17T11:54:46.326 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 153 2026-02-17T11:54:46.326 INFO:tasks.rados.rados.0.trial142.stdout:1432: write (excl) oid 49 current snap is 158 2026-02-17T11:54:46.326 INFO:tasks.rados.rados.0.trial142.stdout:1432: seq_num 512 ranges {605184=723139,1877957=727227} 2026-02-17T11:54:46.331 INFO:tasks.rados.rados.0.trial142.stdout:1432: writing trial14245205-49 from 605184 to 1328323 tid 1 2026-02-17T11:54:46.336 INFO:tasks.rados.rados.0.trial142.stdout:1432: writing trial14245205-49 from 1877957 to 2605184 tid 2 2026-02-17T11:54:46.336 INFO:tasks.rados.rados.0.trial142.stdout:1433: delete oid 9 current snap is 158 2026-02-17T11:54:46.337 INFO:tasks.rados.rados.0.trial142.stdout:1431: finishing rollback tid 0 to trial14245205-46 2026-02-17T11:54:46.337 INFO:tasks.rados.rados.0.trial142.stdout:1431: finishing rollback tid 1 to trial14245205-46 2026-02-17T11:54:46.337 INFO:tasks.rados.rados.0.trial142.stdout:1431: finishing rollback tid 2 to trial14245205-46 2026-02-17T11:54:46.337 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1181 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:46.337 INFO:tasks.rados.rados.0.trial142.stdout:1432: finishing write tid 1 to trial14245205-49 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: finishing write tid 2 to trial14245205-49 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: finishing write tid 3 to trial14245205-49 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: finishing write tid 4 to trial14245205-49 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: oid 49 updating version 0 to 1184 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: oid 49 version 1184 is already newer than 1183 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: oid 49 updating version 1184 to 1185 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1185 (ObjNum 512 snap 158 seq_num 512) dirty exists 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: left oid 49 (ObjNum 512 snap 158 seq_num 512) 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1431: done (2 left) 2026-02-17T11:54:46.344 INFO:tasks.rados.rados.0.trial142.stdout:1432: done (1 left) 2026-02-17T11:54:46.345 INFO:tasks.rados.rados.0.trial142.stdout:1433: done (0 left) 2026-02-17T11:54:46.345 INFO:tasks.rados.rados.0.trial142.stdout:1434: delete oid 47 current snap is 158 2026-02-17T11:54:46.346 INFO:tasks.rados.rados.0.trial142.stdout:1434: done (0 left) 2026-02-17T11:54:46.346 INFO:tasks.rados.rados.0.trial142.stdout:1435: copy_from oid 50 from oid 16 current snap is 158 2026-02-17T11:54:46.346 INFO:tasks.rados.rados.0.trial142.stdout:1436: write oid 35 current snap is 158 2026-02-17T11:54:46.346 INFO:tasks.rados.rados.0.trial142.stdout:1436: seq_num 515 ranges {655605=548886,1653403=643178} 2026-02-17T11:54:46.351 INFO:tasks.rados.rados.0.trial142.stdout:1436: writing trial14245205-35 from 655605 to 1204491 tid 1 2026-02-17T11:54:46.355 INFO:tasks.rados.rados.0.trial142.stdout:1436: writing trial14245205-35 from 1653403 to 2296581 tid 2 2026-02-17T11:54:46.355 INFO:tasks.rados.rados.0.trial142.stdout:1437: snap_create 2026-02-17T11:54:46.355 INFO:tasks.rados.rados.0.trial142.stdout:1435: finishing copy_from racing read to trial14245205-50 2026-02-17T11:54:46.355 INFO:tasks.rados.rados.0.trial142.stdout:1435: finishing copy_from to trial14245205-50 2026-02-17T11:54:46.355 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 650 (ObjNum 460 snap 139 seq_num 460) dirty exists 2026-02-17T11:54:46.356 INFO:tasks.rados.rados.0.trial142.stdout:1436: finishing write tid 1 to trial14245205-35 2026-02-17T11:54:46.357 INFO:tasks.rados.rados.0.trial142.stdout:1436: finishing write tid 2 to trial14245205-35 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: finishing write tid 3 to trial14245205-35 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: finishing write tid 4 to trial14245205-35 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: oid 35 updating version 0 to 963 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: oid 35 updating version 963 to 964 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: oid 35 version 964 is already newer than 962 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 964 (ObjNum 515 snap 158 seq_num 515) dirty exists 2026-02-17T11:54:46.358 INFO:tasks.rados.rados.0.trial142.stdout:1436: left oid 35 (ObjNum 515 snap 158 seq_num 515) 2026-02-17T11:54:47.330 INFO:tasks.rados.rados.0.trial142.stdout:1435: done (2 left) 2026-02-17T11:54:47.331 INFO:tasks.rados.rados.0.trial142.stdout:1436: done (1 left) 2026-02-17T11:54:47.331 INFO:tasks.rados.rados.0.trial142.stdout:1437: done (0 left) 2026-02-17T11:54:47.331 INFO:tasks.rados.rados.0.trial142.stdout:1438: snap_create 2026-02-17T11:54:48.204 INFO:tasks.rados.rados.0.trial142.stdout:1438: done (0 left) 2026-02-17T11:54:48.205 INFO:tasks.rados.rados.0.trial142.stdout:1439: read oid 42 snap -1 2026-02-17T11:54:48.205 INFO:tasks.rados.rados.0.trial142.stdout:1439: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:54:48.205 INFO:tasks.rados.rados.0.trial142.stdout:1440: copy_from oid 41 from oid 34 current snap is 160 2026-02-17T11:54:48.205 INFO:tasks.rados.rados.0.trial142.stdout:1441: write oid 6 current snap is 160 2026-02-17T11:54:48.205 INFO:tasks.rados.rados.0.trial142.stdout:1441: seq_num 516 ranges {672412=624135,1995532=676880} 2026-02-17T11:54:48.209 INFO:tasks.rados.rados.0.trial142.stdout:1441: writing trial14245205-6 from 672412 to 1296547 tid 1 2026-02-17T11:54:48.214 INFO:tasks.rados.rados.0.trial142.stdout:1441: writing trial14245205-6 from 1995532 to 2672412 tid 2 2026-02-17T11:54:48.214 INFO:tasks.rados.rados.0.trial142.stdout:1442: write oid 13 current snap is 160 2026-02-17T11:54:48.214 INFO:tasks.rados.rados.0.trial142.stdout:1442: seq_num 517 ranges {689219=415737,1770367=646847} 2026-02-17T11:54:48.218 INFO:tasks.rados.rados.0.trial142.stdout:1442: writing trial14245205-13 from 689219 to 1104956 tid 1 2026-02-17T11:54:48.223 INFO:tasks.rados.rados.0.trial142.stdout:1442: writing trial14245205-13 from 1770367 to 2417214 tid 2 2026-02-17T11:54:48.223 INFO:tasks.rados.rados.0.trial142.stdout:1443: delete oid 25 current snap is 160 2026-02-17T11:54:48.223 INFO:tasks.rados.rados.0.trial142.stdout:1439: expect (ObjNum 404 snap 123 seq_num 404) 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1441: finishing write tid 1 to trial14245205-6 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1440: finishing copy_from racing read to trial14245205-41 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1439: done (4 left) 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1443: done (3 left) 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1444: delete oid 47 current snap is 160 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1440: finishing copy_from to trial14245205-41 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 961 (ObjNum 506 snap 153 seq_num 506) dirty exists 2026-02-17T11:54:48.338 INFO:tasks.rados.rados.0.trial142.stdout:1441: finishing write tid 2 to trial14245205-6 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: finishing write tid 3 to trial14245205-6 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: finishing write tid 4 to trial14245205-6 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: oid 6 updating version 0 to 651 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: oid 6 version 651 is already newer than 650 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: oid 6 version 651 is already newer than 649 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 651 (ObjNum 516 snap 160 seq_num 516) dirty exists 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1441: left oid 6 (ObjNum 516 snap 160 seq_num 516) 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1442: finishing write tid 1 to trial14245205-13 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1442: finishing write tid 2 to trial14245205-13 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1442: finishing write tid 3 to trial14245205-13 2026-02-17T11:54:48.339 INFO:tasks.rados.rados.0.trial142.stdout:1442: finishing write tid 4 to trial14245205-13 2026-02-17T11:54:48.340 INFO:tasks.rados.rados.0.trial142.stdout:1442: oid 13 updating version 0 to 965 2026-02-17T11:54:48.340 INFO:tasks.rados.rados.0.trial142.stdout:1442: oid 13 updating version 965 to 967 2026-02-17T11:54:48.340 INFO:tasks.rados.rados.0.trial142.stdout:1442: oid 13 version 967 is already newer than 966 2026-02-17T11:54:48.340 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 967 (ObjNum 517 snap 160 seq_num 517) dirty exists 2026-02-17T11:54:48.340 INFO:tasks.rados.rados.0.trial142.stdout:1442: left oid 13 (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1440: done (3 left) 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1441: done (2 left) 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1442: done (1 left) 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1444: done (0 left) 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1445: read oid 31 snap -1 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1445: expect deleted 2026-02-17T11:54:48.341 INFO:tasks.rados.rados.0.trial142.stdout:1446: snap_create 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1445: done (1 left) 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1446: done (0 left) 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1447: rollback oid 39 current snap is 161 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 146 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1448: read oid 23 snap -1 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1448: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:54:49.334 INFO:tasks.rados.rados.0.trial142.stdout:1449: snap_remove snap 152 2026-02-17T11:54:50.337 INFO:tasks.rados.rados.0.trial142.stdout:1449: done (2 left) 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:1450: delete oid 21 current snap is 161 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:1447: finishing rollback tid 0 to trial14245205-39 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:1447: finishing rollback tid 1 to trial14245205-39 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:1447: finishing rollback tid 2 to trial14245205-39 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 699 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:54:50.338 INFO:tasks.rados.rados.0.trial142.stdout:1448: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:54:50.483 INFO:tasks.rados.rados.0.trial142.stdout:1447: done (2 left) 2026-02-17T11:54:50.484 INFO:tasks.rados.rados.0.trial142.stdout:1448: done (1 left) 2026-02-17T11:54:50.484 INFO:tasks.rados.rados.0.trial142.stdout:1450: done (0 left) 2026-02-17T11:54:50.484 INFO:tasks.rados.rados.0.trial142.stdout:1451: snap_remove snap 160 2026-02-17T11:54:51.349 INFO:tasks.rados.rados.0.trial142.stdout:1451: done (0 left) 2026-02-17T11:54:51.350 INFO:tasks.rados.rados.0.trial142.stdout:1452: snap_create 2026-02-17T11:54:52.351 INFO:tasks.rados.rados.0.trial142.stdout:1452: done (0 left) 2026-02-17T11:54:52.351 INFO:tasks.rados.rados.0.trial142.stdout:1453: write oid 46 current snap is 162 2026-02-17T11:54:52.351 INFO:tasks.rados.rados.0.trial142.stdout:1453: seq_num 521 ranges {756447=716733,1887942=537832} 2026-02-17T11:54:52.357 INFO:tasks.rados.rados.0.trial142.stdout:1453: writing trial14245205-46 from 756447 to 1473180 tid 1 2026-02-17T11:54:52.361 INFO:tasks.rados.rados.0.trial142.stdout:1453: writing trial14245205-46 from 1887942 to 2425774 tid 2 2026-02-17T11:54:52.361 INFO:tasks.rados.rados.0.trial142.stdout:1454: write oid 33 current snap is 162 2026-02-17T11:54:52.361 INFO:tasks.rados.rados.0.trial142.stdout:1453: finishing write tid 1 to trial14245205-46 2026-02-17T11:54:52.361 INFO:tasks.rados.rados.0.trial142.stdout:1454: seq_num 522 ranges {773254=791982,2346424=426830} 2026-02-17T11:54:52.367 INFO:tasks.rados.rados.0.trial142.stdout:1454: writing trial14245205-33 from 773254 to 1565236 tid 1 2026-02-17T11:54:52.372 INFO:tasks.rados.rados.0.trial142.stdout:1454: writing trial14245205-33 from 2346424 to 2773254 tid 2 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1455: delete oid 15 current snap is 162 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: finishing write tid 2 to trial14245205-46 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: finishing write tid 3 to trial14245205-46 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: finishing write tid 4 to trial14245205-46 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: oid 46 updating version 0 to 1197 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: oid 46 updating version 1197 to 1199 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: oid 46 version 1199 is already newer than 1198 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1199 (ObjNum 521 snap 162 seq_num 521) dirty exists 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1453: left oid 46 (ObjNum 521 snap 162 seq_num 521) 2026-02-17T11:54:52.373 INFO:tasks.rados.rados.0.trial142.stdout:1454: finishing write tid 1 to trial14245205-33 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: finishing write tid 2 to trial14245205-33 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: finishing write tid 3 to trial14245205-33 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: finishing write tid 4 to trial14245205-33 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: oid 33 updating version 0 to 969 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: oid 33 version 969 is already newer than 968 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:1454: oid 33 updating version 969 to 970 2026-02-17T11:54:52.375 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 970 (ObjNum 522 snap 162 seq_num 522) dirty exists 2026-02-17T11:54:52.376 INFO:tasks.rados.rados.0.trial142.stdout:1454: left oid 33 (ObjNum 522 snap 162 seq_num 522) 2026-02-17T11:54:52.376 INFO:tasks.rados.rados.0.trial142.stdout:1453: done (2 left) 2026-02-17T11:54:52.376 INFO:tasks.rados.rados.0.trial142.stdout:1454: done (1 left) 2026-02-17T11:54:52.376 INFO:tasks.rados.rados.0.trial142.stdout:1455: done (0 left) 2026-02-17T11:54:52.376 INFO:tasks.rados.rados.0.trial142.stdout:1456: snap_create 2026-02-17T11:54:53.205 INFO:tasks.rados.rados.0.trial142.stdout:1456: done (0 left) 2026-02-17T11:54:53.205 INFO:tasks.rados.rados.0.trial142.stdout:1457: write (excl) oid 17 current snap is 163 2026-02-17T11:54:53.205 INFO:tasks.rados.rados.0.trial142.stdout:1457: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2026-02-17T11:54:53.208 INFO:tasks.rados.rados.0.trial142.stdout:1457: writing trial14245205-17 from 406868 to 949348 tid 1 2026-02-17T11:54:53.212 INFO:tasks.rados.rados.0.trial142.stdout:1457: writing trial14245205-17 from 1547035 to 1948547 tid 2 2026-02-17T11:54:53.216 INFO:tasks.rados.rados.0.trial142.stdout:1457: writing trial14245205-17 from 2690354 to 2806868 tid 3 2026-02-17T11:54:53.216 INFO:tasks.rados.rados.0.trial142.stdout:1458: rollback oid 43 current snap is 163 2026-02-17T11:54:53.216 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 141 2026-02-17T11:54:53.216 INFO:tasks.rados.rados.0.trial142.stdout:1457: finishing write tid 1 to trial14245205-17 2026-02-17T11:54:53.216 INFO:tasks.rados.rados.0.trial142.stdout:1457: finishing write tid 2 to trial14245205-17 2026-02-17T11:54:53.217 INFO:tasks.rados.rados.0.trial142.stdout:1459: snap_create 2026-02-17T11:54:53.217 INFO:tasks.rados.rados.0.trial142.stdout:1457: finishing write tid 3 to trial14245205-17 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: finishing write tid 4 to trial14245205-17 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: finishing write tid 5 to trial14245205-17 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: oid 17 updating version 0 to 652 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: oid 17 updating version 652 to 654 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: oid 17 version 654 is already newer than 651 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: oid 17 version 654 is already newer than 653 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 654 (ObjNum 524 snap 163 seq_num 524) dirty exists 2026-02-17T11:54:53.218 INFO:tasks.rados.rados.0.trial142.stdout:1457: left oid 17 (ObjNum 524 snap 163 seq_num 524) 2026-02-17T11:54:53.219 INFO:tasks.rados.rados.0.trial142.stdout:1458: finishing rollback tid 0 to trial14245205-43 2026-02-17T11:54:53.219 INFO:tasks.rados.rados.0.trial142.stdout:1458: finishing rollback tid 1 to trial14245205-43 2026-02-17T11:54:53.219 INFO:tasks.rados.rados.0.trial142.stdout:1458: finishing rollback tid 2 to trial14245205-43 2026-02-17T11:54:53.219 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1203 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:54.208 INFO:tasks.rados.rados.0.trial142.stdout:1457: done (2 left) 2026-02-17T11:54:54.208 INFO:tasks.rados.rados.0.trial142.stdout:1458: done (1 left) 2026-02-17T11:54:54.208 INFO:tasks.rados.rados.0.trial142.stdout:1459: done (0 left) 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1460: read oid 35 snap -1 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1460: expect (ObjNum 515 snap 158 seq_num 515) 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1461: read oid 36 snap 141 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1461: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1462: copy_from oid 12 from oid 4 current snap is 164 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1463: rollback oid 40 current snap is 164 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 162 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1464: copy_from oid 48 from oid 2 current snap is 164 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1465: copy_from oid 45 from oid 28 current snap is 164 2026-02-17T11:54:54.209 INFO:tasks.rados.rados.0.trial142.stdout:1466: snap_create 2026-02-17T11:54:54.210 INFO:tasks.rados.rados.0.trial142.stdout:1463: finishing rollback tid 1 to trial14245205-40 2026-02-17T11:54:54.210 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 648 (ObjNum 33 snap 0 seq_num 1213877952) dirty dne 2026-02-17T11:54:54.213 INFO:tasks.rados.rados.0.trial142.stdout:1461: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:54:54.362 INFO:tasks.rados.rados.0.trial142.stdout:1460: expect (ObjNum 515 snap 158 seq_num 515) 2026-02-17T11:54:54.483 INFO:tasks.rados.rados.0.trial142.stdout:1462: finishing copy_from racing read to trial14245205-12 2026-02-17T11:54:54.483 INFO:tasks.rados.rados.0.trial142.stdout:1462: finishing copy_from to trial14245205-12 2026-02-17T11:54:54.483 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 979 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:54:54.483 INFO:tasks.rados.rados.0.trial142.stdout:1464: finishing copy_from racing read to trial14245205-48 2026-02-17T11:54:54.484 INFO:tasks.rados.rados.0.trial142.stdout:1465: finishing copy_from racing read to trial14245205-45 2026-02-17T11:54:54.484 INFO:tasks.rados.rados.0.trial142.stdout:1465: finishing copy_from to trial14245205-45 2026-02-17T11:54:54.484 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 195 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:54:54.484 INFO:tasks.rados.rados.0.trial142.stdout:1464: finishing copy_from to trial14245205-48 2026-02-17T11:54:54.484 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 644 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:54:55.209 INFO:tasks.rados.rados.0.trial142.stdout:1460: done (6 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1461: done (5 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1462: done (4 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1463: done (3 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1464: done (2 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1465: done (1 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1466: done (0 left) 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1467: read oid 3 snap 158 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1467: expect deleted 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1468: copy_from oid 33 from oid 12 current snap is 165 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1469: write (excl) oid 26 current snap is 165 2026-02-17T11:54:55.210 INFO:tasks.rados.rados.0.trial142.stdout:1469: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2026-02-17T11:54:55.213 INFO:tasks.rados.rados.0.trial142.stdout:1469: writing trial14245205-26 from 423675 to 1157757 tid 1 2026-02-17T11:54:55.217 INFO:tasks.rados.rados.0.trial142.stdout:1469: writing trial14245205-26 from 1721870 to 2267040 tid 2 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1469: writing trial14245205-26 from 2717777 to 2823675 tid 3 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1470: rollback oid 19 current snap is 165 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 153 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1469: finishing write tid 1 to trial14245205-26 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1467: done (3 left) 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1471: rollback oid 41 current snap is 165 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 41 to 162 2026-02-17T11:54:55.220 INFO:tasks.rados.rados.0.trial142.stdout:1469: finishing write tid 2 to trial14245205-26 2026-02-17T11:54:55.221 INFO:tasks.rados.rados.0.trial142.stdout:1472: write (excl) oid 7 current snap is 165 2026-02-17T11:54:55.221 INFO:tasks.rados.rados.0.trial142.stdout:1472: seq_num 526 ranges {440482=409331,1380352=405181,2461553=378929} 2026-02-17T11:54:55.222 INFO:tasks.rados.rados.0.trial142.stdout:1472: writing trial14245205-7 from 440482 to 849813 tid 1 2026-02-17T11:54:55.226 INFO:tasks.rados.rados.0.trial142.stdout:1472: writing trial14245205-7 from 1380352 to 1785533 tid 2 2026-02-17T11:54:55.230 INFO:tasks.rados.rados.0.trial142.stdout:1472: writing trial14245205-7 from 2461553 to 2840482 tid 3 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1473: delete oid 46 current snap is 165 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1468: finishing copy_from racing read to trial14245205-33 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1470: finishing rollback tid 0 to trial14245205-19 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1469: finishing write tid 3 to trial14245205-26 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1470: finishing rollback tid 1 to trial14245205-19 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1471: finishing rollback tid 0 to trial14245205-41 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1471: finishing rollback tid 1 to trial14245205-41 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1469: finishing write tid 4 to trial14245205-26 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:1468: finishing copy_from to trial14245205-33 2026-02-17T11:54:55.231 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 979 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: finishing write tid 5 to trial14245205-26 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: oid 26 updating version 0 to 736 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: oid 26 updating version 736 to 737 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: oid 26 updating version 737 to 738 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: oid 26 updating version 738 to 739 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 739 (ObjNum 525 snap 165 seq_num 525) dirty exists 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1469: left oid 26 (ObjNum 525 snap 165 seq_num 525) 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1470: finishing rollback tid 2 to trial14245205-19 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 703 (ObjNum 438 snap 131 seq_num 438) dirty exists 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1471: finishing rollback tid 2 to trial14245205-41 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 964 (ObjNum 506 snap 153 seq_num 506) dirty exists 2026-02-17T11:54:55.232 INFO:tasks.rados.rados.0.trial142.stdout:1472: finishing write tid 1 to trial14245205-7 2026-02-17T11:54:55.233 INFO:tasks.rados.rados.0.trial142.stdout:1472: finishing write tid 2 to trial14245205-7 2026-02-17T11:54:55.234 INFO:tasks.rados.rados.0.trial142.stdout:1472: finishing write tid 3 to trial14245205-7 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: finishing write tid 4 to trial14245205-7 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: finishing write tid 5 to trial14245205-7 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: oid 7 updating version 0 to 1208 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: oid 7 updating version 1208 to 1210 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: oid 7 version 1210 is already newer than 1207 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: oid 7 version 1210 is already newer than 1209 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 1210 (ObjNum 526 snap 165 seq_num 526) dirty exists 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1472: left oid 7 (ObjNum 526 snap 165 seq_num 526) 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1468: done (5 left) 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1469: done (4 left) 2026-02-17T11:54:55.235 INFO:tasks.rados.rados.0.trial142.stdout:1470: done (3 left) 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1471: done (2 left) 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1472: done (1 left) 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1473: done (0 left) 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1474: delete oid 33 current snap is 165 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1474: done (0 left) 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1475: copy_from oid 20 from oid 39 current snap is 165 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1476: read oid 46 snap -1 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1476: expect deleted 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1477: copy_from oid 49 from oid 15 current snap is 165 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1478: delete oid 36 current snap is 165 2026-02-17T11:54:55.236 INFO:tasks.rados.rados.0.trial142.stdout:1477: finishing copy_from to trial14245205-49 2026-02-17T11:54:55.237 INFO:tasks.rados.rados.0.trial142.stdout:1477: got expected ENOENT (src dne) 2026-02-17T11:54:55.237 INFO:tasks.rados.rados.0.trial142.stdout:1477: finishing copy_from racing read to trial14245205-49 2026-02-17T11:54:55.237 INFO:tasks.rados.rados.0.trial142.stdout:1476: done (3 left) 2026-02-17T11:54:55.237 INFO:tasks.rados.rados.0.trial142.stdout:1477: done (2 left) 2026-02-17T11:54:55.237 INFO:tasks.rados.rados.0.trial142.stdout:1478: done (1 left) 2026-02-17T11:54:55.238 INFO:tasks.rados.rados.0.trial142.stdout:1479: write (excl) oid 25 current snap is 165 2026-02-17T11:54:55.238 INFO:tasks.rados.rados.0.trial142.stdout:1479: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2026-02-17T11:54:55.240 INFO:tasks.rados.rados.0.trial142.stdout:1479: writing trial14245205-25 from 507710 to 1218037 tid 1 2026-02-17T11:54:55.244 INFO:tasks.rados.rados.0.trial142.stdout:1479: writing trial14245205-25 from 1897927 to 2310446 tid 2 2026-02-17T11:54:55.247 INFO:tasks.rados.rados.0.trial142.stdout:1479: writing trial14245205-25 from 2854892 to 2907710 tid 3 2026-02-17T11:54:55.247 INFO:tasks.rados.rados.0.trial142.stdout:1480: write oid 28 current snap is 165 2026-02-17T11:54:55.247 INFO:tasks.rados.rados.0.trial142.stdout:1480: seq_num 531 ranges {524517=785576,1956409=556177} 2026-02-17T11:54:55.251 INFO:tasks.rados.rados.0.trial142.stdout:1480: writing trial14245205-28 from 524517 to 1310093 tid 1 2026-02-17T11:54:55.257 INFO:tasks.rados.rados.0.trial142.stdout:1480: writing trial14245205-28 from 1956409 to 2512586 tid 2 2026-02-17T11:54:55.257 INFO:tasks.rados.rados.0.trial142.stdout:1481: read oid 11 snap -1 2026-02-17T11:54:55.257 INFO:tasks.rados.rados.0.trial142.stdout:1481: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:54:55.257 INFO:tasks.rados.rados.0.trial142.stdout:1482: read oid 29 snap 155 2026-02-17T11:54:55.257 INFO:tasks.rados.rados.0.trial142.stdout:1482: expect deleted 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1483: read oid 3 snap 158 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1483: expect deleted 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1484: read oid 13 snap -1 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1484: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1485: delete oid 35 current snap is 165 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1475: finishing copy_from racing read to trial14245205-20 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1479: finishing write tid 1 to trial14245205-25 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:1475: finishing copy_from to trial14245205-20 2026-02-17T11:54:55.258 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 699 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: finishing write tid 2 to trial14245205-25 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: finishing write tid 3 to trial14245205-25 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: finishing write tid 4 to trial14245205-25 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: finishing write tid 5 to trial14245205-25 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: oid 25 updating version 0 to 741 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: oid 25 version 741 is already newer than 740 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: oid 25 updating version 741 to 742 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: oid 25 updating version 742 to 743 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 743 (ObjNum 530 snap 165 seq_num 530) dirty exists 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1479: left oid 25 (ObjNum 530 snap 165 seq_num 530) 2026-02-17T11:54:55.259 INFO:tasks.rados.rados.0.trial142.stdout:1480: finishing write tid 1 to trial14245205-28 2026-02-17T11:54:55.260 INFO:tasks.rados.rados.0.trial142.stdout:1480: finishing write tid 2 to trial14245205-28 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: finishing write tid 3 to trial14245205-28 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: finishing write tid 4 to trial14245205-28 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: oid 28 updating version 0 to 704 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: oid 28 updating version 704 to 706 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: oid 28 version 706 is already newer than 705 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 706 (ObjNum 531 snap 165 seq_num 531) dirty exists 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1480: left oid 28 (ObjNum 531 snap 165 seq_num 531) 2026-02-17T11:54:55.261 INFO:tasks.rados.rados.0.trial142.stdout:1484: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:54:55.325 INFO:tasks.rados.rados.0.trial142.stdout:1481: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1475: done (7 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1479: done (6 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1480: done (5 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1481: done (4 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1482: done (3 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1483: done (2 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1484: done (1 left) 2026-02-17T11:54:55.392 INFO:tasks.rados.rados.0.trial142.stdout:1485: done (0 left) 2026-02-17T11:54:55.393 INFO:tasks.rados.rados.0.trial142.stdout:1486: read oid 41 snap -1 2026-02-17T11:54:55.393 INFO:tasks.rados.rados.0.trial142.stdout:1486: expect (ObjNum 506 snap 153 seq_num 506) 2026-02-17T11:54:55.393 INFO:tasks.rados.rados.0.trial142.stdout:1487: write (excl) oid 14 current snap is 165 2026-02-17T11:54:55.393 INFO:tasks.rados.rados.0.trial142.stdout:1487: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2026-02-17T11:54:55.396 INFO:tasks.rados.rados.0.trial142.stdout:1487: writing trial14245205-14 from 558131 to 1210558 tid 1 2026-02-17T11:54:55.400 INFO:tasks.rados.rados.0.trial142.stdout:1487: writing trial14245205-14 from 1673373 to 2233219 tid 2 2026-02-17T11:54:55.403 INFO:tasks.rados.rados.0.trial142.stdout:1487: writing trial14245205-14 from 2820808 to 2958131 tid 3 2026-02-17T11:54:55.403 INFO:tasks.rados.rados.0.trial142.stdout:1488: snap_remove snap 158 2026-02-17T11:54:56.214 INFO:tasks.rados.rados.0.trial142.stdout:1488: done (2 left) 2026-02-17T11:54:56.215 INFO:tasks.rados.rados.0.trial142.stdout:1489: snap_remove snap 162 2026-02-17T11:54:57.216 INFO:tasks.rados.rados.0.trial142.stdout:1489: done (2 left) 2026-02-17T11:54:57.216 INFO:tasks.rados.rados.0.trial142.stdout:1490: snap_remove snap 153 2026-02-17T11:54:58.205 INFO:tasks.rados.rados.0.trial142.stdout:1490: done (2 left) 2026-02-17T11:54:58.205 INFO:tasks.rados.rados.0.trial142.stdout:1491: snap_remove snap 164 2026-02-17T11:54:59.206 INFO:tasks.rados.rados.0.trial142.stdout:1491: done (2 left) 2026-02-17T11:54:59.206 INFO:tasks.rados.rados.0.trial142.stdout:1492: write oid 24 current snap is 165 2026-02-17T11:54:59.206 INFO:tasks.rados.rados.0.trial142.stdout:1492: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2026-02-17T11:54:59.211 INFO:tasks.rados.rados.0.trial142.stdout:1492: writing trial14245205-24 from 574938 to 1302614 tid 1 2026-02-17T11:54:59.215 INFO:tasks.rados.rados.0.trial142.stdout:1492: writing trial14245205-24 from 1731855 to 2435359 tid 2 2026-02-17T11:54:59.218 INFO:tasks.rados.rados.0.trial142.stdout:1492: writing trial14245205-24 from 2848231 to 2974938 tid 3 2026-02-17T11:54:59.218 INFO:tasks.rados.rados.0.trial142.stdout:1493: delete oid 42 current snap is 165 2026-02-17T11:54:59.218 INFO:tasks.rados.rados.0.trial142.stdout:1486: expect (ObjNum 506 snap 153 seq_num 506) 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1487: finishing write tid 1 to trial14245205-14 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1487: finishing write tid 2 to trial14245205-14 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1486: done (3 left) 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1493: done (2 left) 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1494: write oid 2 current snap is 165 2026-02-17T11:54:59.340 INFO:tasks.rados.rados.0.trial142.stdout:1494: seq_num 536 ranges {608552=478174,1848819=707173} 2026-02-17T11:54:59.344 INFO:tasks.rados.rados.0.trial142.stdout:1494: writing trial14245205-2 from 608552 to 1086726 tid 1 2026-02-17T11:54:59.349 INFO:tasks.rados.rados.0.trial142.stdout:1494: writing trial14245205-2 from 1848819 to 2555992 tid 2 2026-02-17T11:54:59.350 INFO:tasks.rados.rados.0.trial142.stdout:1495: write (excl) oid 49 current snap is 165 2026-02-17T11:54:59.350 INFO:tasks.rados.rados.0.trial142.stdout:1495: seq_num 537 ranges {625359=553423,1790948=567184,2930500=94859} 2026-02-17T11:54:59.354 INFO:tasks.rados.rados.0.trial142.stdout:1495: writing trial14245205-49 from 625359 to 1178782 tid 1 2026-02-17T11:54:59.358 INFO:tasks.rados.rados.0.trial142.stdout:1495: writing trial14245205-49 from 1790948 to 2358132 tid 2 2026-02-17T11:54:59.360 INFO:tasks.rados.rados.0.trial142.stdout:1495: writing trial14245205-49 from 2930500 to 3025359 tid 3 2026-02-17T11:54:59.360 INFO:tasks.rados.rados.0.trial142.stdout:1496: write oid 32 current snap is 165 2026-02-17T11:54:59.360 INFO:tasks.rados.rados.0.trial142.stdout:1496: seq_num 538 ranges {642166=628672,1849430=710842} 2026-02-17T11:54:59.365 INFO:tasks.rados.rados.0.trial142.stdout:1496: writing trial14245205-32 from 642166 to 1270838 tid 1 2026-02-17T11:54:59.370 INFO:tasks.rados.rados.0.trial142.stdout:1496: writing trial14245205-32 from 1849430 to 2560272 tid 2 2026-02-17T11:54:59.370 INFO:tasks.rados.rados.0.trial142.stdout:1497: copy_from oid 5 from oid 1 current snap is 165 2026-02-17T11:54:59.370 INFO:tasks.rados.rados.0.trial142.stdout:1487: finishing write tid 3 to trial14245205-14 2026-02-17T11:54:59.370 INFO:tasks.rados.rados.0.trial142.stdout:1487: finishing write tid 4 to trial14245205-14 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: finishing write tid 5 to trial14245205-14 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: oid 14 updating version 0 to 1216 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: oid 14 version 1216 is already newer than 1215 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: oid 14 updating version 1216 to 1217 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: oid 14 version 1217 is already newer than 1214 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1217 (ObjNum 533 snap 165 seq_num 533) dirty exists 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1487: left oid 14 (ObjNum 533 snap 165 seq_num 533) 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1492: finishing write tid 1 to trial14245205-24 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1492: finishing write tid 2 to trial14245205-24 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1492: finishing write tid 3 to trial14245205-24 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1492: finishing write tid 4 to trial14245205-24 2026-02-17T11:54:59.371 INFO:tasks.rados.rados.0.trial142.stdout:1492: finishing write tid 5 to trial14245205-24 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1492: oid 24 updating version 0 to 702 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1492: oid 24 updating version 702 to 703 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1492: oid 24 version 703 is already newer than 701 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1492: oid 24 version 703 is already newer than 700 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 703 (ObjNum 534 snap 165 seq_num 534) dirty exists 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1492: left oid 24 (ObjNum 534 snap 165 seq_num 534) 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: finishing write tid 1 to trial14245205-2 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: finishing write tid 2 to trial14245205-2 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: finishing write tid 3 to trial14245205-2 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: finishing write tid 4 to trial14245205-2 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: oid 2 updating version 0 to 967 2026-02-17T11:54:59.372 INFO:tasks.rados.rados.0.trial142.stdout:1494: oid 2 version 967 is already newer than 965 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1494: oid 2 version 967 is already newer than 966 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 967 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1494: left oid 2 (ObjNum 536 snap 165 seq_num 536) 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: finishing write tid 1 to trial14245205-49 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: finishing write tid 2 to trial14245205-49 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: finishing write tid 3 to trial14245205-49 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: finishing write tid 4 to trial14245205-49 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: finishing write tid 5 to trial14245205-49 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: oid 49 updating version 0 to 1261 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: oid 49 version 1261 is already newer than 1259 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: oid 49 version 1261 is already newer than 1260 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:1495: oid 49 updating version 1261 to 1262 2026-02-17T11:54:59.373 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1262 (ObjNum 537 snap 165 seq_num 537) dirty exists 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1495: left oid 49 (ObjNum 537 snap 165 seq_num 537) 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1496: finishing write tid 1 to trial14245205-32 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1487: done (5 left) 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1492: done (4 left) 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1494: done (3 left) 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1495: done (2 left) 2026-02-17T11:54:59.374 INFO:tasks.rados.rados.0.trial142.stdout:1498: snap_create 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: finishing write tid 2 to trial14245205-32 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: finishing write tid 3 to trial14245205-32 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: finishing write tid 4 to trial14245205-32 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: oid 32 updating version 0 to 732 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: oid 32 updating version 732 to 734 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: oid 32 version 734 is already newer than 733 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 734 (ObjNum 538 snap 165 seq_num 538) dirty exists 2026-02-17T11:54:59.375 INFO:tasks.rados.rados.0.trial142.stdout:1496: left oid 32 (ObjNum 538 snap 165 seq_num 538) 2026-02-17T11:54:59.378 INFO:tasks.rados.rados.0.trial142.stdout:1497: finishing copy_from racing read to trial14245205-5 2026-02-17T11:54:59.378 INFO:tasks.rados.rados.0.trial142.stdout:1497: finishing copy_from to trial14245205-5 2026-02-17T11:54:59.379 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 299 (ObjNum 473 snap 141 seq_num 473) dirty exists 2026-02-17T11:54:59.618 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:54:59.618 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T11:54:59.618 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:54:59.618 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:54:59.620 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:54:59.620 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T11:54:59.621 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T11:54:59.621 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T11:55:14.621 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T11:55:14.622 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T11:55:14.622 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:55:14.622 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:14.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.689+0000 7f19063ce640 10 monclient: get_monmap_and_config 2026-02-17T11:55:14.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.689+0000 7f19063ce640 10 monclient: build_initial_monmap 2026-02-17T11:55:14.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.689+0000 7f19063ce640 10 monclient: monmap: 2026-02-17T11:55:14.694 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:14.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:14.690509+0000 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:14.690509+0000 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:14.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.689+0000 7f19063ce640 1 Processor -- start 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 -- start start 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient: init 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-c con 0x7f19000a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-b con 0x7f190009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f190009ff40 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:14.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190006e140 con 0x7f190009ff40 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f190009aed0 con 0x7f19000a3bb0 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f190009caa0 con 0x7f190009dac0 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f19063ce640 10 monclient(hunting): authenticate will time out at 1202.309305s 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f1904944640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f190009ff40 0x7f190013b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:45558/0 (socket says 10.20.193.51:45558) 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f1904944640 1 -- 10.20.193.51:0/677731249 learned_addr learned my addr 10.20.193.51:0/677731249 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f190009dac0 auth_method 0 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:14.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 10 monclient(hunting): get_auth_request con 0x7f19000a3bb0 auth_method 0 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:14.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:14.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:14.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.690+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:14.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.692+0000 7f1904944640 1 -- 10.20.193.51:0/677731249 >> v1:10.20.193.51:6789/0 conn(0x7f190009ff40 legacy=0x7f190013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f190009dac0 auth_method 0 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:14.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 10 monclient(hunting): get_auth_request con 0x7f19000a3bb0 auth_method 0 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:14.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:14.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:14.891+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f190009dac0 auth_method 0 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 10 monclient(hunting): get_auth_request con 0x7f19000a3bb0 auth_method 0 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:15.292+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f190009dac0 auth_method 0 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:16.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 10 monclient(hunting): get_auth_request con 0x7f19000a3bb0 auth_method 0 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:16.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:16.093+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): tick 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 msgr2=0x7f190009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:17.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f190009dac0 0x7f190009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 msgr2=0x7f190009f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.142:3300/0 conn(0x7f19000a3bb0 0x7f190009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 -- 10.20.193.51:0/677731249 >> v1:10.20.193.51:6789/0 conn(0x7f190009ff40 legacy=0x7f190013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient: _add_conns ranks=[1,3] 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f18dc003820 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): picked mon.noname-a con 0x7f18dc007550 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 -- 10.20.193.51:0/677731249 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190009ce60 con 0x7f18dc003820 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 1 -- 10.20.193.51:0/677731249 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f190009aed0 con 0x7f18dc007550 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18fdffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:17.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18dc007550 auth_method 0 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:17.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.690+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:17.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.692+0000 7f18fffff640 1 -- 10.20.193.51:0/677731249 >> v1:10.20.193.142:6789/0 conn(0x7f18dc003820 legacy=0x7f18dc005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18dc007550 auth_method 0 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:17.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:17.891+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:18.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:18.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18dc007550 auth_method 0 2026-02-17T11:55:18.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:18.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:18.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:18.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:18.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:18.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:18.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:18.292+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:19.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18dc007550 auth_method 0 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:19.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.093+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646711535 0 0) 0x7f190009ce60 con 0x7f18dc003820 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): _negotiate 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): my global_id is 114217 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e4003620 con 0x7f18dc003820 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2758784530 0 0) 0x7f18e4003620 con 0x7f18dc003820 2026-02-17T11:55:19.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 msgr2=0x7f18dc009a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 --2- 10.20.193.51:0/677731249 >> v2:10.20.193.51:3300/0 conn(0x7f18dc007550 0x7f18dc009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18dc00b190 con 0x7f18dc003820 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f18ec00f040 con 0x7f18dc003820 2026-02-17T11:55:19.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f19063ce640 5 monclient: authenticate success, global_id 114217 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f19063ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: dump: 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:19.644 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 >> v1:10.20.193.142:6789/0 conn(0x7f18dc003820 legacy=0x7f18dc005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f1904944640 1 -- 10.20.193.51:0/677731249 reap_dead start 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f18e4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): picked mon.b con 0x7f18e4003ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f18e4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): picked mon.a con 0x7f18e4004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:19.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f18e400bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): picked mon.c con 0x7f18e4005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f190009aed0 con 0x7f18e4004900 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f18e400c420 con 0x7f18e4003ba0 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f18e400c620 con 0x7f18e4005510 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18feffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f19063ce640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.629+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f18e4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18e4004900 auth_method 0 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f18e400bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f18e4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): get_auth_request con 0x7f18e4005510 auth_method 0 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): get_auth_request con 0x7f18e4003ba0 auth_method 0 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18fffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:19.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient(hunting): handle_auth_done global_id 114217 payload 293 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 msgr2=0x7f18e400bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f18e400bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 msgr2=0x7f18e4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f18e4003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 monclient: found mon.a 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e4003620 con 0x7f18e4004900 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f18ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:19.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.630+0000 7f1904944640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f18e400bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18ff7fe640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 msgr2=0x7f18e4004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f18e4004d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18f0019890 tx=0x7f18f0032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae770b35596317a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0040070 con 0x7f18e4004900 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: dump: 2026-02-17T11:55:19.650 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.651 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0033870 con 0x7f18e4004900 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f19063ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:19.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 1 -- 10.20.193.51:0/677731249 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f000f040 con 0x7f18e4004900 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f18feffd640 10 monclient: dump: 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:19.653 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f19063ce640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.632+0000 7f19063ce640 4 set_mon_vals no callback set 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 10 monclient: shutdown 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 -- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 msgr2=0x7f18e4004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f18e4004d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18f0019890 tx=0x7f18f0032e30 comp rx=0 tx=0).stop 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 -- 10.20.193.51:0/677731249 shutdown_connections 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f18e400bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f18e4004d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 --2- 10.20.193.51:0/677731249 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f18e4003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 -- 10.20.193.51:0/677731249 >> 10.20.193.51:0/677731249 conn(0x7f19000a30c0 msgr2=0x7f19000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 -- 10.20.193.51:0/677731249 shutdown_connections 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.633+0000 7f19063ce640 1 -- 10.20.193.51:0/677731249 wait complete. 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient: build_initial_monmap 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient: monmap: 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:19.655 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 Processor -- start 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 -- start start 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient: init 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f1900099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-b con 0x7f18e4003ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-a con 0x7f18e4004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f1900094de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): picked mon.noname-c con 0x7f18e4005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f190009a880 con 0x7f18e4004900 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f19000a3f90 con 0x7f18e4003ba0 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f19000a0370 con 0x7f18e4005510 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f19063ce640 10 monclient(hunting): authenticate will time out at 1207.253564s 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56084/0 (socket says 10.20.193.51:56084) 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 -- 10.20.193.51:0/539183001 learned_addr learned my addr 10.20.193.51:0/539183001 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request con 0x7f18e4004900 auth_method 0 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f1900094de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): get_auth_request con 0x7f18e4005510 auth_method 0 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 msgr2=0x7f19000948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:55:19.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 msgr2=0x7f19000948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18ff7fe640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient(hunting): handle_auth_done global_id 124160 payload 824 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 msgr2=0x7f1900099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18fffff640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f1900099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f1900099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 msgr2=0x7f19000948a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient: _finish_hunting 0 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 monclient: found mon.noname-c 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f1904944640 1 -- 10.20.193.51:0/539183001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900098830 con 0x7f18e4005510 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18fffff640 10 monclient: get_auth_request con 0x7f18e4003ba0 auth_method 0 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.634+0000 7f18fffff640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f1900099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.636+0000 7f1904944640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 msgr2=0x7f1900094de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.636+0000 7f1904944640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f1900094de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19000a3020 tx=0x7f18f400f5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.636+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f400fea0 con 0x7f18e4005510 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.636+0000 7f18fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:19.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: dump: 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:19.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f4018070 con 0x7f18e4005510 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4012780 con 0x7f18e4005510 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fe7fc640 4 set_mon_vals no callback set 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 5 monclient: authenticate success, global_id 124160 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _renew_subs 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19000a2b60 con 0x7f18e4005510 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 10 monclient: dump: 2026-02-17T11:55:19.662 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:19.663 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _renew_subs 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:19.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1900097220 con 0x7f18e4005510 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f18f40129a0 con 0x7f18e4005510 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190009e370 con 0x7f18e4005510 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 0x7f18d00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:19.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.637+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(352..352 src has 167..352) ==== 4783+0+0 (secure 0 0 0) 0x7f18f4052990 con 0x7f18e4005510 2026-02-17T11:55:19.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.638+0000 7f18fffff640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 0x7f18d00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:19.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.638+0000 7f18fffff640 10 monclient: get_auth_request con 0x7f18d003dd10 auth_method 0 2026-02-17T11:55:19.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.640+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f18f4051390 con 0x7f18e4005510 2026-02-17T11:55:19.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.640+0000 7f18fcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.640+0000 7f18fcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.640+0000 7f18fffff640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 0x7f18d00401d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00c720 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f19063ce640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f19063ce640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f19063ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1900096540 con 0x7f18e4005510 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f18fcff9640 1 -- 10.20.193.51:0/539183001 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f18f401d980 con 0x7f18e4005510 2026-02-17T11:55:19.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f18fcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:19.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.753+0000 7f18fcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:19.757 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":76,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:19.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 msgr2=0x7f18d00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:19.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 0x7f18d00401d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00c720 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2026-02-17T11:55:19.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 10 monclient: shutdown 2026-02-17T11:55:19.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 msgr2=0x7f1900094de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f1900094de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19000a3020 tx=0x7f18f400f5a0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 shutdown_connections 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18d003dd10 0x7f18d00401d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f18e4005510 0x7f1900094de0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f18e4004900 0x7f19000948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 --2- 10.20.193.51:0/539183001 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f18e4003ba0 0x7f1900099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 >> 10.20.193.51:0/539183001 conn(0x7f19000a30c0 msgr2=0x7f190009e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 shutdown_connections 2026-02-17T11:55:19.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:19.754+0000 7f19063ce640 1 -- 10.20.193.51:0/539183001 wait complete. 2026-02-17T11:55:20.631 INFO:tasks.rados.rados.0.trial142.stdout:1496: done (2 left) 2026-02-17T11:55:20.631 INFO:tasks.rados.rados.0.trial142.stdout:1497: done (1 left) 2026-02-17T11:55:20.632 INFO:tasks.rados.rados.0.trial142.stdout:1498: done (0 left) 2026-02-17T11:55:20.632 INFO:tasks.rados.rados.0.trial142.stdout:1499: write oid 19 current snap is 166 2026-02-17T11:55:20.632 INFO:tasks.rados.rados.0.trial142.stdout:1499: seq_num 539 ranges {658973=703921,1907912=570853,2985346=73627} 2026-02-17T11:55:20.636 INFO:tasks.rados.rados.0.trial142.stdout:1499: writing trial14245205-19 from 658973 to 1362894 tid 1 2026-02-17T11:55:20.640 INFO:tasks.rados.rados.0.trial142.stdout:1499: writing trial14245205-19 from 1907912 to 2478765 tid 2 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1499: writing trial14245205-19 from 2985346 to 3058973 tid 3 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1500: read oid 11 snap -1 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1500: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1501: copy_from oid 41 from oid 7 current snap is 166 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1499: finishing write tid 1 to trial14245205-19 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1499: finishing write tid 2 to trial14245205-19 2026-02-17T11:55:20.643 INFO:tasks.rados.rados.0.trial142.stdout:1502: read oid 33 snap -1 2026-02-17T11:55:20.644 INFO:tasks.rados.rados.0.trial142.stdout:1502: expect deleted 2026-02-17T11:55:20.644 INFO:tasks.rados.rados.0.trial142.stdout:1503: read oid 38 snap -1 2026-02-17T11:55:20.644 INFO:tasks.rados.rados.0.trial142.stdout:1503: expect (ObjNum 498 snap 152 seq_num 498) 2026-02-17T11:55:20.644 INFO:tasks.rados.rados.0.trial142.stdout:1504: delete oid 20 current snap is 166 2026-02-17T11:55:20.644 INFO:tasks.rados.rados.0.trial142.stdout:1499: finishing write tid 3 to trial14245205-19 2026-02-17T11:55:20.645 INFO:tasks.rados.rados.0.trial142.stdout:1499: finishing write tid 4 to trial14245205-19 2026-02-17T11:55:20.645 INFO:tasks.rados.rados.0.trial142.stdout:1500: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:55:20.713 INFO:tasks.rados.rados.0.trial142.stdout:1499: finishing write tid 5 to trial14245205-19 2026-02-17T11:55:20.713 INFO:tasks.rados.rados.0.trial142.stdout:1499: oid 19 updating version 0 to 707 2026-02-17T11:55:20.713 INFO:tasks.rados.rados.0.trial142.stdout:1499: oid 19 version 707 is already newer than 705 2026-02-17T11:55:20.714 INFO:tasks.rados.rados.0.trial142.stdout:1499: oid 19 version 707 is already newer than 706 2026-02-17T11:55:20.714 INFO:tasks.rados.rados.0.trial142.stdout:1499: oid 19 version 707 is already newer than 704 2026-02-17T11:55:20.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 707 (ObjNum 539 snap 166 seq_num 539) dirty exists 2026-02-17T11:55:20.714 INFO:tasks.rados.rados.0.trial142.stdout:1499: left oid 19 (ObjNum 539 snap 166 seq_num 539) 2026-02-17T11:55:20.714 INFO:tasks.rados.rados.0.trial142.stdout:1503: expect (ObjNum 498 snap 152 seq_num 498) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1501: finishing copy_from racing read to trial14245205-41 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1501: finishing copy_from to trial14245205-41 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1210 (ObjNum 526 snap 165 seq_num 526) dirty exists 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1499: done (5 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1500: done (4 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1501: done (3 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1502: done (2 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1503: done (1 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1504: done (0 left) 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1505: write oid 5 current snap is 166 2026-02-17T11:55:20.804 INFO:tasks.rados.rados.0.trial142.stdout:1505: seq_num 541 ranges {692587=570772,2024876=574522,3040192=52395} 2026-02-17T11:55:20.808 INFO:tasks.rados.rados.0.trial142.stdout:1505: writing trial14245205-5 from 692587 to 1263359 tid 1 2026-02-17T11:55:20.813 INFO:tasks.rados.rados.0.trial142.stdout:1505: writing trial14245205-5 from 2024876 to 2599398 tid 2 2026-02-17T11:55:20.815 INFO:tasks.rados.rados.0.trial142.stdout:1505: writing trial14245205-5 from 3040192 to 3092587 tid 3 2026-02-17T11:55:20.815 INFO:tasks.rados.rados.0.trial142.stdout:1506: write oid 20 current snap is 166 2026-02-17T11:55:20.815 INFO:tasks.rados.rados.0.trial142.stdout:1505: finishing write tid 1 to trial14245205-5 2026-02-17T11:55:20.815 INFO:tasks.rados.rados.0.trial142.stdout:1506: seq_num 542 ranges {709394=646021,2083358=718180} 2026-02-17T11:55:20.820 INFO:tasks.rados.rados.0.trial142.stdout:1506: writing trial14245205-20 from 709394 to 1355415 tid 1 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1506: writing trial14245205-20 from 2083358 to 2801538 tid 2 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1507: delete oid 26 current snap is 166 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: finishing write tid 2 to trial14245205-5 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: finishing write tid 3 to trial14245205-5 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: finishing write tid 4 to trial14245205-5 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: finishing write tid 5 to trial14245205-5 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: oid 5 updating version 0 to 658 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: oid 5 version 658 is already newer than 655 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: oid 5 version 658 is already newer than 656 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: oid 5 version 658 is already newer than 657 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 658 (ObjNum 541 snap 166 seq_num 541) dirty exists 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1505: left oid 5 (ObjNum 541 snap 166 seq_num 541) 2026-02-17T11:55:20.826 INFO:tasks.rados.rados.0.trial142.stdout:1506: finishing write tid 1 to trial14245205-20 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1505: done (2 left) 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1507: done (1 left) 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1508: read oid 48 snap -1 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1508: expect (ObjNum 437 snap 131 seq_num 437) 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1509: read oid 35 snap -1 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1509: expect deleted 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1510: copy_from oid 37 from oid 3 current snap is 166 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1511: read oid 42 snap -1 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1511: expect deleted 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1512: read oid 27 snap -1 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1512: expect deleted 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1513: copy_from oid 11 from oid 8 current snap is 166 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1514: read oid 36 snap -1 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1514: expect deleted 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1515: write (excl) oid 29 current snap is 166 2026-02-17T11:55:20.828 INFO:tasks.rados.rados.0.trial142.stdout:1515: seq_num 544 ranges {743008=796519,2200322=721849} 2026-02-17T11:55:20.834 INFO:tasks.rados.rados.0.trial142.stdout:1515: writing trial14245205-29 from 743008 to 1539527 tid 1 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1515: writing trial14245205-29 from 2200322 to 2922171 tid 2 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1516: copy_from oid 31 from oid 50 current snap is 166 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: finishing write tid 2 to trial14245205-20 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: finishing write tid 3 to trial14245205-20 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: finishing write tid 4 to trial14245205-20 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: oid 20 updating version 0 to 738 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: oid 20 version 738 is already newer than 736 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: oid 20 version 738 is already newer than 737 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 738 (ObjNum 542 snap 166 seq_num 542) dirty exists 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1506: left oid 20 (ObjNum 542 snap 166 seq_num 542) 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1513: finishing copy_from to trial14245205-11 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1513: got expected ENOENT (src dne) 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1513: finishing copy_from racing read to trial14245205-11 2026-02-17T11:55:20.839 INFO:tasks.rados.rados.0.trial142.stdout:1508: expect (ObjNum 437 snap 131 seq_num 437) 2026-02-17T11:55:20.968 INFO:tasks.rados.rados.0.trial142.stdout:1510: finishing copy_from to trial14245205-37 2026-02-17T11:55:20.968 INFO:tasks.rados.rados.0.trial142.stdout:1510: got expected ENOENT (src dne) 2026-02-17T11:55:20.968 INFO:tasks.rados.rados.0.trial142.stdout:1510: finishing copy_from racing read to trial14245205-37 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1506: done (9 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1508: done (8 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1509: done (7 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1510: done (6 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1511: done (5 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1512: done (4 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1513: done (3 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1514: done (2 left) 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1517: copy_from oid 7 from oid 39 current snap is 166 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: finishing write tid 1 to trial14245205-29 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: finishing write tid 2 to trial14245205-29 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: finishing write tid 3 to trial14245205-29 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: finishing write tid 4 to trial14245205-29 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: oid 29 updating version 0 to 645 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: oid 29 updating version 645 to 646 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: oid 29 updating version 646 to 647 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 647 (ObjNum 544 snap 166 seq_num 544) dirty exists 2026-02-17T11:55:20.969 INFO:tasks.rados.rados.0.trial142.stdout:1515: left oid 29 (ObjNum 544 snap 166 seq_num 544) 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1516: finishing copy_from racing read to trial14245205-31 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1516: finishing copy_from to trial14245205-31 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 650 (ObjNum 460 snap 139 seq_num 460) dirty exists 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1515: done (2 left) 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1516: done (1 left) 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1518: read oid 4 snap 147 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1518: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1519: write (excl) oid 8 current snap is 166 2026-02-17T11:55:20.970 INFO:tasks.rados.rados.0.trial142.stdout:1519: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2026-02-17T11:55:20.973 INFO:tasks.rados.rados.0.trial142.stdout:1519: writing trial14245205-8 from 759815 to 1231583 tid 1 2026-02-17T11:55:20.976 INFO:tasks.rados.rados.0.trial142.stdout:1519: writing trial14245205-8 from 1742451 to 2207958 tid 2 2026-02-17T11:55:20.980 INFO:tasks.rados.rados.0.trial142.stdout:1519: writing trial14245205-8 from 2917178 to 3159815 tid 3 2026-02-17T11:55:20.980 INFO:tasks.rados.rados.0.trial142.stdout:1520: snap_remove snap 146 2026-02-17T11:55:21.636 INFO:tasks.rados.rados.0.trial142.stdout:1520: done (3 left) 2026-02-17T11:55:21.636 INFO:tasks.rados.rados.0.trial142.stdout:1521: read oid 43 snap 144 2026-02-17T11:55:21.636 INFO:tasks.rados.rados.0.trial142.stdout:1521: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:55:21.636 INFO:tasks.rados.rados.0.trial142.stdout:1522: write oid 49 current snap is 166 2026-02-17T11:55:21.636 INFO:tasks.rados.rados.0.trial142.stdout:1522: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2026-02-17T11:55:21.640 INFO:tasks.rados.rados.0.trial142.stdout:1522: writing trial14245205-49 from 776622 to 1323639 tid 1 2026-02-17T11:55:21.645 INFO:tasks.rados.rados.0.trial142.stdout:1522: writing trial14245205-49 from 1800933 to 2526451 tid 2 2026-02-17T11:55:21.648 INFO:tasks.rados.rados.0.trial142.stdout:1522: writing trial14245205-49 from 2944601 to 3176622 tid 3 2026-02-17T11:55:21.648 INFO:tasks.rados.rados.0.trial142.stdout:1523: snap_create 2026-02-17T11:55:21.648 INFO:tasks.rados.rados.0.trial142.stdout:1518: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1517: finishing copy_from racing read to trial14245205-7 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1519: finishing write tid 1 to trial14245205-8 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1517: finishing copy_from to trial14245205-7 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 699 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1519: finishing write tid 2 to trial14245205-8 2026-02-17T11:55:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1519: finishing write tid 3 to trial14245205-8 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: finishing write tid 4 to trial14245205-8 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: finishing write tid 5 to trial14245205-8 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: oid 8 updating version 0 to 982 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: oid 8 updating version 982 to 985 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: oid 8 version 985 is already newer than 984 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: oid 8 version 985 is already newer than 983 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 985 (ObjNum 545 snap 166 seq_num 545) dirty exists 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1519: left oid 8 (ObjNum 545 snap 166 seq_num 545) 2026-02-17T11:55:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1521: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:55:21.906 INFO:tasks.rados.rados.0.trial142.stdout:1522: finishing write tid 1 to trial14245205-49 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: finishing write tid 2 to trial14245205-49 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: finishing write tid 3 to trial14245205-49 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: finishing write tid 4 to trial14245205-49 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: finishing write tid 5 to trial14245205-49 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: oid 49 updating version 0 to 1281 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: oid 49 updating version 1281 to 1283 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: oid 49 version 1283 is already newer than 1280 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:1522: oid 49 version 1283 is already newer than 1282 2026-02-17T11:55:21.907 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1283 (ObjNum 546 snap 166 seq_num 546) dirty exists 2026-02-17T11:55:21.908 INFO:tasks.rados.rados.0.trial142.stdout:1522: left oid 49 (ObjNum 546 snap 166 seq_num 546) 2026-02-17T11:55:22.395 INFO:tasks.rados.rados.0.trial142.stdout:1517: done (5 left) 2026-02-17T11:55:22.395 INFO:tasks.rados.rados.0.trial142.stdout:1518: done (4 left) 2026-02-17T11:55:22.395 INFO:tasks.rados.rados.0.trial142.stdout:1519: done (3 left) 2026-02-17T11:55:22.395 INFO:tasks.rados.rados.0.trial142.stdout:1521: done (2 left) 2026-02-17T11:55:22.396 INFO:tasks.rados.rados.0.trial142.stdout:1522: done (1 left) 2026-02-17T11:55:22.396 INFO:tasks.rados.rados.0.trial142.stdout:1523: done (0 left) 2026-02-17T11:55:22.396 INFO:tasks.rados.rados.0.trial142.stdout:1524: delete oid 7 current snap is 167 2026-02-17T11:55:22.398 INFO:tasks.rados.rados.0.trial142.stdout:1524: done (0 left) 2026-02-17T11:55:22.398 INFO:tasks.rados.rados.0.trial142.stdout:1525: rollback oid 29 current snap is 167 2026-02-17T11:55:22.398 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 156 2026-02-17T11:55:22.398 INFO:tasks.rados.rados.0.trial142.stdout:1526: snap_create 2026-02-17T11:55:22.399 INFO:tasks.rados.rados.0.trial142.stdout:1525: finishing rollback tid 0 to trial14245205-29 2026-02-17T11:55:22.400 INFO:tasks.rados.rados.0.trial142.stdout:1525: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:55:22.400 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 649 (ObjNum 129 snap 0 seq_num 321933531) dirty dne 2026-02-17T11:55:22.766 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:22.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: get_monmap_and_config 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: build_initial_monmap 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: monmap: 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:22.833300+0000 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:22.833300+0000 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:22.837 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 1 Processor -- start 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 1 -- start start 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: init 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.832+0000 7fa4e0bd3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa4dc0a3bb0 0x7fa4dc09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-c con 0x7fa4dc0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:22.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-b con 0x7fa4dc09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa4dc09ff40 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc06e140 con 0x7fa4dc09ff40 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa4dc09aed0 con 0x7fa4dc0a3bb0 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc09caa0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4e0bd3640 10 monclient(hunting): authenticate will time out at 1210.452043s 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43396/0 (socket says 10.20.193.51:43396) 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 -- 10.20.193.51:0/3988698718 learned_addr learned my addr 10.20.193.51:0/3988698718 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): get_auth_request con 0x7fa4dc09dac0 auth_method 0 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4da575640 1 --2- 10.20.193.51:0/3988698718 >> v2:10.20.193.142:3300/0 conn(0x7fa4dc0a3bb0 0x7fa4dc09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4da575640 10 monclient(hunting): get_auth_request con 0x7fa4dc0a3bb0 auth_method 0 2026-02-17T11:55:22.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient(hunting): handle_auth_done global_id 124163 payload 274 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 -- 10.20.193.51:0/3988698718 >> v2:10.20.193.142:3300/0 conn(0x7fa4dc0a3bb0 msgr2=0x7fa4dc09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 --2- 10.20.193.51:0/3988698718 >> v2:10.20.193.142:3300/0 conn(0x7fa4dc0a3bb0 0x7fa4dc09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 -- 10.20.193.51:0/3988698718 >> v1:10.20.193.142:6789/0 conn(0x7fa4dc09ff40 legacy=0x7fa4dc13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 monclient: found mon.noname-b 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:22.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.833+0000 7fa4d9d74640 1 -- 10.20.193.51:0/3988698718 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc09ce60 con 0x7fa4dc09dac0 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9d74640 1 -- 10.20.193.51:0/3988698718 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 msgr2=0x7fa4dc09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9d74640 1 --2- 10.20.193.51:0/3988698718 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009970 tx=0x7fa4c402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=174bc16effe210a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 1 -- 10.20.193.51:0/3988698718 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c403c070 con 0x7fa4dc09dac0 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: dump: 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: _finish_auth 0 2026-02-17T11:55:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4e0bd3640 5 monclient: authenticate success, global_id 124163 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 1 -- 10.20.193.51:0/3988698718 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c402fcd0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 1 -- 10.20.193.51:0/3988698718 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4037660 con 0x7fa4dc09dac0 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4e0bd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4e0bd3640 4 set_mon_vals no callback set 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.835+0000 7fa4d9573640 10 monclient: dump: 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.850 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 10 monclient: shutdown 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3988698718 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 msgr2=0x7fa4dc09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3988698718 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009970 tx=0x7fa4c402ee90 comp rx=0 tx=0).stop 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3988698718 shutdown_connections 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3988698718 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc09fa00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3988698718 >> v2:10.20.193.142:3300/0 conn(0x7fa4dc0a3bb0 0x7fa4dc09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3988698718 >> 10.20.193.51:0/3988698718 conn(0x7fa4dc0a30c0 msgr2=0x7fa4dc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:22.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3988698718 shutdown_connections 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3988698718 wait complete. 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 10 monclient: build_initial_monmap 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 10 monclient: monmap: 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:22.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 Processor -- start 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 1 -- start start 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.836+0000 7fa4e0bd3640 10 monclient: init 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-c con 0x7fa4dc09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4dc09ff40 0x7fa4dc1bd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-b con 0x7fa4dc09ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4dc0a3bb0 0x7fa4dc1bde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): picked mon.noname-a con 0x7fa4dc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0a0370 con 0x7fa4dc0a3bb0 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc09a880 con 0x7fa4dc09ff40 2026-02-17T11:55:22.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0a04f0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4e0bd3640 10 monclient(hunting): authenticate will time out at 1210.456243s 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43402/0 (socket says 10.20.193.51:43402) 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 -- 10.20.193.51:0/3621709739 learned_addr learned my addr 10.20.193.51:0/3621709739 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): get_auth_request con 0x7fa4dc09dac0 auth_method 0 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4dc0a3bb0 0x7fa4dc1bde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): get_auth_request con 0x7fa4dc0a3bb0 auth_method 0 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:22.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4d9d74640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4dc09ff40 0x7fa4dc1bd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4dad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4d9d74640 10 monclient(hunting): get_auth_request con 0x7fa4dc09ff40 auth_method 0 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4d9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient(hunting): handle_auth_done global_id 124166 payload 824 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 -- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4dc09ff40 msgr2=0x7fa4dc1bd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4dc09ff40 0x7fa4dc1bd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 -- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4dc0a3bb0 msgr2=0x7fa4dc1bde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4dc0a3bb0 0x7fa4dc1bde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 monclient: found mon.noname-c 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.837+0000 7fa4da575640 1 -- 10.20.193.51:0/3621709739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc1b7dd0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4da575640 1 -- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 msgr2=0x7fa4dc1ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4da575640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000e7c0 tx=0x7fa4d000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0017070 con 0x7fa4dc09dac0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: dump: 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:22.856 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d000cae0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 5 monclient: authenticate success, global_id 124166 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000f040 con 0x7fa4dc09dac0 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4d8d72640 4 set_mon_vals no callback set 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4c2ffd640 10 monclient: dump: 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:22.857 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 10 monclient: _renew_subs 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc1b80b0 con 0x7fa4dc09dac0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 10 monclient: _renew_subs 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.839+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1b7270 con 0x7fa4dc09dac0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4e0bd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4e0bd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4e0bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc074360 con 0x7fa4dc09dac0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa4d0012050 con 0x7fa4dc09dac0 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4c2ffd640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 0x7fa4a80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:22.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(355..355 src has 167..355) ==== 4799+0+0 (secure 0 0 0) 0x7fa4d0052490 con 0x7fa4dc09dac0 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4d9d74640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 0x7fa4a80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.840+0000 7fa4d9d74640 10 monclient: get_auth_request con 0x7fa4a803dd10 auth_method 0 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.843+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa4dc074360 con 0x7fa4dc09dac0 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.843+0000 7fa4c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.843+0000 7fa4c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:22.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.843+0000 7fa4d9d74640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 0x7fa4a80401d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4036000 tx=0x7fa4c4039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:22.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4e0bd3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:22.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4e0bd3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:22.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4e0bd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:22.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa4dc09f150 con 0x7fa4dc09dac0 2026-02-17T11:55:22.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4c2ffd640 1 -- 10.20.193.51:0/3621709739 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fa4d0023d80 con 0x7fa4dc09dac0 2026-02-17T11:55:22.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:22.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.956+0000 7fa4c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:22.959 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 msgr2=0x7fa4a80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 0x7fa4a80401d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4036000 tx=0x7fa4c4039040 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 10 monclient: shutdown 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 msgr2=0x7fa4dc1ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000e7c0 tx=0x7fa4d000ec90 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 shutdown_connections 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa4a803dd10 0x7fa4a80401d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4dc0a3bb0 0x7fa4dc1bde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4dc09ff40 0x7fa4dc1bd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 --2- 10.20.193.51:0/3621709739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4dc09dac0 0x7fa4dc1ccf40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 >> 10.20.193.51:0/3621709739 conn(0x7fa4dc0a30c0 msgr2=0x7fa4dc06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:22.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 shutdown_connections 2026-02-17T11:55:22.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:22.957+0000 7fa4e0bd3640 1 -- 10.20.193.51:0/3621709739 wait complete. 2026-02-17T11:55:22.966 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:55:22.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:55:22.966 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.031+0000 7f7c29f79640 10 monclient: get_monmap_and_config 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.031+0000 7f7c29f79640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.031+0000 7f7c29f79640 10 monclient: monmap: 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:23.032943+0000 2026-02-17T11:55:23.036 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:23.032943+0000 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 Processor -- start 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 -- start start 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient: init 2026-02-17T11:55:23.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7c240a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7c240a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7c2413c770 0x7f7c2413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-c con 0x7f7c2413c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2409e8e0 con 0x7f7c240a0750 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2406e140 con 0x7f7c240a3bb0 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2409f910 con 0x7f7c2413c770 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c29f79640 10 monclient(hunting): authenticate will time out at 1210.651733s 2026-02-17T11:55:23.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c22ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7c240a0750 0x7f7c2409e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46740/0 (socket says 10.20.193.51:46740) 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c22ffd640 1 -- 10.20.193.51:0/865481876 learned_addr learned my addr 10.20.193.51:0/865481876 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c23fff640 1 --2- 10.20.193.51:0/865481876 >> v2:10.20.193.142:3300/0 conn(0x7f7c2413c770 0x7f7c2413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c23fff640 10 monclient(hunting): get_auth_request con 0x7f7c2413c770 auth_method 0 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.032+0000 7f7c23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient(hunting): handle_auth_done global_id 114226 payload 274 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 1 -- 10.20.193.51:0/865481876 >> v1:10.20.193.142:6789/0 conn(0x7f7c240a3bb0 legacy=0x7f7c2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 1 -- 10.20.193.51:0/865481876 >> v1:10.20.193.51:6789/0 conn(0x7f7c240a0750 legacy=0x7f7c2409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:23.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:55:23.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.033+0000 7f7c23fff640 1 -- 10.20.193.51:0/865481876 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2409ccd0 con 0x7f7c2413c770 2026-02-17T11:55:23.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.035+0000 7f7c23fff640 1 -- 10.20.193.51:0/865481876 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 msgr2=0x7f7c2413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.035+0000 7f7c23fff640 1 --2- 10.20.193.51:0/865481876 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c2413eb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1802f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6614c98628d51 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 1 -- 10.20.193.51:0/865481876 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1803c070 con 0x7f7c2413c770 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: dump: 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.051 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 5 monclient: authenticate success, global_id 114226 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 1 -- 10.20.193.51:0/865481876 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c18037640 con 0x7f7c2413c770 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 1 -- 10.20.193.51:0/865481876 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18037a10 con 0x7f7c2413c770 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 4 set_mon_vals no callback set 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c227fc640 10 monclient: dump: 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.053 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 10 monclient: shutdown 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 -- 10.20.193.51:0/865481876 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 msgr2=0x7f7c2413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 --2- 10.20.193.51:0/865481876 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c2413eb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1802f190 comp rx=0 tx=0).stop 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 -- 10.20.193.51:0/865481876 shutdown_connections 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 --2- 10.20.193.51:0/865481876 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c2413eb60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 -- 10.20.193.51:0/865481876 >> 10.20.193.51:0/865481876 conn(0x7f7c240a30c0 msgr2=0x7f7c240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 -- 10.20.193.51:0/865481876 shutdown_connections 2026-02-17T11:55:23.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.036+0000 7f7c29f79640 1 -- 10.20.193.51:0/865481876 wait complete. 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient: monmap: 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:23.055 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 Processor -- start 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 -- start start 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient: init 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 0x7f7c24099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-a con 0x7f7c240a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 0x7f7c24090340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-c con 0x7f7c240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c24090880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): picked mon.noname-b con 0x7f7c2413c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2409c850 con 0x7f7c240a0750 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2409ebe0 con 0x7f7c2413c770 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7c240a04b0 con 0x7f7c240a3bb0 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c29f79640 10 monclient(hunting): authenticate will time out at 1210.656635s 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 0x7f7c24099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 0x7f7c24099b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56108/0 (socket says 10.20.193.51:56108) 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 1 -- 10.20.193.51:0/529101310 learned_addr learned my addr 10.20.193.51:0/529101310 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): get_auth_request con 0x7f7c240a0750 auth_method 0 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 0x7f7c24090340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): get_auth_request con 0x7f7c240a3bb0 auth_method 0 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c23fff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c24090880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c23fff640 10 monclient(hunting): get_auth_request con 0x7f7c2413c770 auth_method 0 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient(hunting): handle_auth_done global_id 124169 payload 824 2026-02-17T11:55:23.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 msgr2=0x7f7c24090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7c2413c770 0x7f7c24090880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 msgr2=0x7f7c24099b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 0x7f7c24099b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 monclient: found mon.noname-c 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c22ffd640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c24094210 con 0x7f7c240a3bb0 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.037+0000 7f7c237fe640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240a0750 0x7f7c24099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c22ffd640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 msgr2=0x7f7c24090340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c22ffd640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 0x7f7c24090340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400b470 tx=0x7f7c1400b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14015020 con 0x7f7c240a3bb0 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: dump: 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.061 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14011aa0 con 0x7f7c240a3bb0 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140103e0 con 0x7f7c240a3bb0 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 10 monclient: dump: 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c21ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 5 monclient: authenticate success, global_id 124169 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 monclient: _renew_subs 2026-02-17T11:55:23.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2409d7b0 con 0x7f7c240a3bb0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 monclient: _renew_subs 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c24093c50 con 0x7f7c240a3bb0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 0x7f7c240728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2406e4a0 con 0x7f7c24090dc0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 0x7f7c240728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient: get_auth_request con 0x7f7c24090dc0 auth_method 0 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 10 monclient(hunting): handle_auth_done global_id 134103 payload 824 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7c237fe640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c2409dac0 con 0x7f7c24090dc0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.040+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7c14010600 con 0x7f7c240a3bb0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.041+0000 7f7bfffff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bf403dd40 0x7f7bf4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.041+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(355..355 src has 167..355) ==== 4799+0+0 (secure 0 0 0) 0x7f7c140524d0 con 0x7f7c240a3bb0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.041+0000 7f7c23fff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bf403dd40 0x7f7bf4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.041+0000 7f7c23fff640 10 monclient: get_auth_request con 0x7f7bf403dd40 auth_method 0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7c237fe640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 msgr2=0x7f7c240728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7c237fe640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 0x7f7c240728e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000fc30 tx=0x7f7c1000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10018020 con 0x7f7c24090dc0 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7bfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7bfffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.042+0000 7f7bfffff640 10 monclient: dump: 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7c1000fe70 con 0x7f7c24090dc0 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 msgr2=0x7f7c240728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 0x7f7c240728e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000fc30 tx=0x7f7c1000d520 comp rx=0 tx=0).stop 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 msgr2=0x7f7c240728e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.043+0000 7f7bfffff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c24090dc0 0x7f7c240728e0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000fc30 tx=0x7f7c1000d520 comp rx=0 tx=0).stop 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.044+0000 7f7c23fff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bf403dd40 0x7f7bf4040200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406f3c0 tx=0x7f7c18033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c29f79640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c29f79640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 0x7f7c24063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c29f79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24092800 con 0x7f7c240638c0 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 0x7f7c24063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient: get_auth_request con 0x7f7c240638c0 auth_method 0 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 10 monclient(hunting): handle_auth_done global_id 134106 payload 824 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.046+0000 7f7c237fe640 1 -- 10.20.193.51:0/529101310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7c2409a0a0 con 0x7f7c240638c0 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c237fe640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 msgr2=0x7f7c24063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c237fe640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 0x7f7c24063ca0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c10019000 tx=0x7f7c10003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10018070 con 0x7f7c240638c0 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 10 monclient: dump: 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4542 (secure 0 0 0) 0x7f7c10014ca0 con 0x7f7c240638c0 2026-02-17T11:55:23.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 msgr2=0x7f7c24063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 0x7f7c24063ca0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c10019000 tx=0x7f7c10003860 comp rx=0 tx=0).stop 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 msgr2=0x7f7c24063ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7bfffff640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7c240638c0 0x7f7c24063ca0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:23.070 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 23370, 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.071 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.072 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:23.073 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.074 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:23.075 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.076 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.077 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.078 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.079 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:23.080 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bf403dd40 msgr2=0x7f7bf4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bf403dd40 0x7f7bf4040200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406f3c0 tx=0x7f7c18033000 comp rx=0 tx=0).stop 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 10 monclient: shutdown 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 msgr2=0x7f7c24090340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c29f79640 1 --2- 10.20.193.51:0/529101310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7c240a3bb0 0x7f7c24090340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400b470 tx=0x7f7c1400b940 comp rx=0 tx=0).stop 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.048+0000 7f7c23fff640 1 -- 10.20.193.51:0/529101310 reap_dead start 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.049+0000 7f7c23fff640 1 -- 10.20.193.51:0/529101310 reap_dead start 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.049+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 shutdown_connections 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.049+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 >> 10.20.193.51:0/529101310 conn(0x7f7c240a30c0 msgr2=0x7f7c2413ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.049+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 shutdown_connections 2026-02-17T11:55:23.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.049+0000 7f7c29f79640 1 -- 10.20.193.51:0/529101310 wait complete. 2026-02-17T11:55:23.082 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:23.083 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:55:23.083 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:55:23.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.148+0000 7f3a4daf2640 10 monclient: get_monmap_and_config 2026-02-17T11:55:23.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.148+0000 7f3a4daf2640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.148+0000 7f3a4daf2640 10 monclient: monmap: 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:23.149835+0000 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:23.149835+0000 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 Processor -- start 2026-02-17T11:55:23.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 -- start start 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient: init 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3a480a3bb0 0x7f3a4809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-c con 0x7f3a480a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-b con 0x7f3a480a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a4809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a4806e140 con 0x7f3a4809e540 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3a480a3f90 con 0x7f3a480a3bb0 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4809f910 con 0x7f3a480a0750 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a4daf2640 10 monclient(hunting): authenticate will time out at 1210.768619s 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43408/0 (socket says 10.20.193.51:43408) 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 -- 10.20.193.51:0/1965586430 learned_addr learned my addr 10.20.193.51:0/1965586430 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): get_auth_request con 0x7f3a480a0750 auth_method 0 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a477fe640 1 --2- 10.20.193.51:0/1965586430 >> v2:10.20.193.142:3300/0 conn(0x7f3a480a3bb0 0x7f3a4809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a477fe640 10 monclient(hunting): get_auth_request con 0x7f3a480a3bb0 auth_method 0 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_done global_id 124172 payload 274 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 -- 10.20.193.51:0/1965586430 >> v2:10.20.193.142:3300/0 conn(0x7f3a480a3bb0 msgr2=0x7f3a4809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 --2- 10.20.193.51:0/1965586430 >> v2:10.20.193.142:3300/0 conn(0x7f3a480a3bb0 0x7f3a4809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 -- 10.20.193.51:0/1965586430 >> v1:10.20.193.142:6789/0 conn(0x7f3a4809e540 legacy=0x7f3a4813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 monclient: found mon.noname-b 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.149+0000 7f3a46ffd640 1 -- 10.20.193.51:0/1965586430 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4809ccd0 con 0x7f3a480a0750 2026-02-17T11:55:23.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a46ffd640 1 -- 10.20.193.51:0/1965586430 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 msgr2=0x7f3a4809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a46ffd640 1 --2- 10.20.193.51:0/1965586430 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806c1c0 tx=0x7f3a3802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ef25d2c17be2cc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 1 -- 10.20.193.51:0/1965586430 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3803c070 con 0x7f3a480a0750 2026-02-17T11:55:23.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: dump: 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 1 -- 10.20.193.51:0/1965586430 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3802fca0 con 0x7f3a480a0750 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 5 monclient: authenticate success, global_id 124172 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 1 -- 10.20.193.51:0/1965586430 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38037660 con 0x7f3a480a0750 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 4 set_mon_vals no callback set 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a467fc640 10 monclient: dump: 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.164 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 10 monclient: shutdown 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 -- 10.20.193.51:0/1965586430 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 msgr2=0x7f3a4809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/1965586430 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806c1c0 tx=0x7f3a3802ee60 comp rx=0 tx=0).stop 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 -- 10.20.193.51:0/1965586430 shutdown_connections 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/1965586430 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a0750 0x7f3a4809e000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/1965586430 >> v2:10.20.193.142:3300/0 conn(0x7f3a480a3bb0 0x7f3a4809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 -- 10.20.193.51:0/1965586430 >> 10.20.193.51:0/1965586430 conn(0x7f3a480a30c0 msgr2=0x7f3a480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 -- 10.20.193.51:0/1965586430 shutdown_connections 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.152+0000 7f3a4daf2640 1 -- 10.20.193.51:0/1965586430 wait complete. 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient: monmap: 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 Processor -- start 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 -- start start 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient: init 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a4809e540 0x7f3a481381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-b con 0x7f3a4809e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a480a0750 0x7f3a4812fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-a con 0x7f3a480a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): picked mon.noname-c con 0x7f3a480a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480a04b0 con 0x7f3a480a0750 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4809c850 con 0x7f3a4809e540 2026-02-17T11:55:23.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4813de80 con 0x7f3a480a3bb0 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a4daf2640 10 monclient(hunting): authenticate will time out at 1210.772610s 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a480a0750 0x7f3a4812fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43420/0 (socket says 10.20.193.51:43420) 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 learned_addr learned my addr 10.20.193.51:0/3120503928 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): get_auth_request con 0x7f3a480a3bb0 auth_method 0 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): get_auth_request con 0x7f3a480a0750 auth_method 0 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a46ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient(hunting): handle_auth_done global_id 124175 payload 824 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a4809e540 msgr2=0x7f3a481381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a4809e540 0x7f3a481381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a480a0750 msgr2=0x7f3a4812fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a480a0750 0x7f3a4812fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.153+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a481337a0 con 0x7f3a480a3bb0 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.155+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 msgr2=0x7f3a48130530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.155+0000 7f3a47fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00cb60 tx=0x7f3a3c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c016020 con 0x7f3a480a3bb0 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: dump: 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.170 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c012420 con 0x7f3a480a3bb0 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 5 monclient: authenticate success, global_id 124175 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 monclient: _renew_subs 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a48131f10 con 0x7f3a480a3bb0 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c012810 con 0x7f3a480a3bb0 2026-02-17T11:55:23.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a45ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 10 monclient: dump: 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 monclient: _renew_subs 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4809d7b0 con 0x7f3a480a3bb0 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 0x7f3a48139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4806f410 con 0x7f3a48130a70 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 0x7f3a48139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a3c012a30 con 0x7f3a480a3bb0 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient: get_auth_request con 0x7f3a48130a70 auth_method 0 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 10 monclient(hunting): handle_auth_done global_id 124178 payload 824 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a477fe640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a48130e50 con 0x7f3a48130a70 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a1803dd10 0x7f3a180401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.156+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(355..355 src has 167..355) ==== 4799+0+0 (secure 0 0 0) 0x7f3a3c053010 con 0x7f3a480a3bb0 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.157+0000 7f3a46ffd640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a1803dd10 0x7f3a180401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.157+0000 7f3a46ffd640 10 monclient: get_auth_request con 0x7f3a1803dd10 auth_method 0 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.158+0000 7f3a477fe640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 msgr2=0x7f3a48139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a477fe640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 0x7f3a48139960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e740 tx=0x7f3a3400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34017070 con 0x7f3a48130a70 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 10 monclient: dump: 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.174 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3a3400cb50 con 0x7f3a48130a70 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 msgr2=0x7f3a48139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 0x7f3a48139960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e740 tx=0x7f3a3400ec10 comp rx=0 tx=0).stop 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 msgr2=0x7f3a48139960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.159+0000 7f3a23fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48130a70 0x7f3a48139960 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e740 tx=0x7f3a3400ec10 comp rx=0 tx=0).stop 2026-02-17T11:55:23.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.160+0000 7f3a46ffd640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a1803dd10 0x7f3a180401d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a38036000 tx=0x7f3a38033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a4daf2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 0x7f3a4813a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a4daf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4809dac0 con 0x7f3a48139ea0 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 0x7f3a4813a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient: get_auth_request con 0x7f3a48139ea0 auth_method 0 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 10 monclient(hunting): handle_auth_done global_id 124181 payload 824 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.162+0000 7f3a477fe640 1 -- 10.20.193.51:0/3120503928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a480008d0 con 0x7f3a48139ea0 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a477fe640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 msgr2=0x7f3a4813a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a477fe640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 0x7f3a4813a2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a34018000 tx=0x7f3a340047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400f040 con 0x7f3a48139ea0 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 10 monclient: dump: 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7f3a34003c10 con 0x7f3a48139ea0 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:23.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 msgr2=0x7f3a4813a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 0x7f3a4813a2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a34018000 tx=0x7f3a340047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 msgr2=0x7f3a4813a2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a23fff640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a48139ea0 0x7f3a4813a2b0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a34018000 tx=0x7f3a340047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:55:23.180 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 77609, 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.181 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.182 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.183 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.184 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:23.185 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:23.186 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.187 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:23.188 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.189 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:23.190 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:23.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a1803dd10 msgr2=0x7f3a180401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a1803dd10 0x7f3a180401d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a38036000 tx=0x7f3a38033000 comp rx=0 tx=0).stop 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a4daf2640 10 monclient: shutdown 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a4daf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.164+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 msgr2=0x7f3a48130530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00cb60 tx=0x7f3a3c00a430 comp rx=0 tx=0).stop 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a47fff640 1 -- 10.20.193.51:0/3120503928 reap_dead start 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 shutdown_connections 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 --2- 10.20.193.51:0/3120503928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a480a3bb0 0x7f3a48130530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 >> 10.20.193.51:0/3120503928 conn(0x7f3a480a30c0 msgr2=0x7f3a480a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 shutdown_connections 2026-02-17T11:55:23.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.165+0000 7f3a4daf2640 1 -- 10.20.193.51:0/3120503928 wait complete. 2026-02-17T11:55:23.192 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:23.192 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:55:23.193 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:55:23.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: get_monmap_and_config 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: monmap: 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:23.259186+0000 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:23.259186+0000 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:23.262 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 Processor -- start 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 -- start start 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: init 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f141c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f141c09dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f141c0a02e0 0x7f141c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-c con 0x7f141c0a02e0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c06e140 con 0x7f141c09dac0 2026-02-17T11:55:23.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c09ce60 con 0x7f141c0a3bb0 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f141c09aed0 con 0x7f141c0a02e0 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.258+0000 7f1422b51640 10 monclient(hunting): authenticate will time out at 1210.877956s 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f1413fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f141c09dac0 0x7f141c09fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46742/0 (socket says 10.20.193.51:46742) 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f1413fff640 1 -- 10.20.193.51:0/1961427493 learned_addr learned my addr 10.20.193.51:0/1961427493 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 1 --2- 10.20.193.51:0/1961427493 >> v2:10.20.193.142:3300/0 conn(0x7f141c0a02e0 0x7f141c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): get_auth_request con 0x7f141c0a02e0 auth_method 0 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient(hunting): handle_auth_done global_id 114235 payload 274 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 1 -- 10.20.193.51:0/1961427493 >> v1:10.20.193.142:6789/0 conn(0x7f141c0a3bb0 legacy=0x7f141c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 1 -- 10.20.193.51:0/1961427493 >> v1:10.20.193.51:6789/0 conn(0x7f141c09dac0 legacy=0x7f141c09fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 1 monclient: found mon.noname-c 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:55:23.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.259+0000 7f14210c7640 1 -- 10.20.193.51:0/1961427493 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c09a5c0 con 0x7f141c0a02e0 2026-02-17T11:55:23.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14210c7640 1 -- 10.20.193.51:0/1961427493 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c0a02e0 msgr2=0x7f141c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14210c7640 1 --2- 10.20.193.51:0/1961427493 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c0a02e0 0x7f141c13d770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1418009d90 tx=0x7f141802f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7479edf810067168 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 1 -- 10.20.193.51:0/1961427493 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141803c070 con 0x7f141c0a02e0 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: dump: 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.271 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 5 monclient: authenticate success, global_id 114235 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 1 -- 10.20.193.51:0/1961427493 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1418037640 con 0x7f141c0a02e0 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 1 -- 10.20.193.51:0/1961427493 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418037a10 con 0x7f141c0a02e0 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f14137fe640 10 monclient: dump: 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.272 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 4 set_mon_vals no callback set 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 10 monclient: shutdown 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 1 -- 10.20.193.51:0/1961427493 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c0a02e0 msgr2=0x7f141c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.262+0000 7f1422b51640 1 --2- 10.20.193.51:0/1961427493 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c0a02e0 0x7f141c13d770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1418009d90 tx=0x7f141802f190 comp rx=0 tx=0).stop 2026-02-17T11:55:23.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 -- 10.20.193.51:0/1961427493 shutdown_connections 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 --2- 10.20.193.51:0/1961427493 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c0a02e0 0x7f141c13d770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 -- 10.20.193.51:0/1961427493 >> 10.20.193.51:0/1961427493 conn(0x7f141c0a30c0 msgr2=0x7f141c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 -- 10.20.193.51:0/1961427493 shutdown_connections 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 -- 10.20.193.51:0/1961427493 wait complete. 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 10 monclient: monmap: 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:23.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 Processor -- start 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 1 -- start start 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.263+0000 7f1422b51640 10 monclient: init 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c09dac0 0x7f141c0927c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-b con 0x7f141c09dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 0x7f141c092d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-a con 0x7f141c0a02e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f141c0a3bb0 0x7f141c093240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): picked mon.noname-c con 0x7f141c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f141c0a3f90 con 0x7f141c0a02e0 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f141c09caa0 con 0x7f141c09dac0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f141c13dcb0 con 0x7f141c0a3bb0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1422b51640 10 monclient(hunting): authenticate will time out at 1210.883081s 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 0x7f141c092d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 0x7f141c092d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56148/0 (socket says 10.20.193.51:56148) 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 -- 10.20.193.51:0/2693820807 learned_addr learned my addr 10.20.193.51:0/2693820807 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): get_auth_request con 0x7f141c0a02e0 auth_method 0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f141c0a3bb0 0x7f141c093240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): get_auth_request con 0x7f141c0a3bb0 auth_method 0 2026-02-17T11:55:23.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14210c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14208c6640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c09dac0 0x7f141c0927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14208c6640 10 monclient(hunting): get_auth_request con 0x7f141c09dac0 auth_method 0 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14208c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14208c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f14208c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient(hunting): handle_auth_done global_id 134112 payload 824 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f141c0a3bb0 msgr2=0x7f141c093240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f141c0a3bb0 0x7f141c093240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c09dac0 msgr2=0x7f141c0927c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c09dac0 0x7f141c0927c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 monclient: found mon.noname-a 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.264+0000 7f1413fff640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c09d7b0 con 0x7f141c0a02e0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1413fff640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 msgr2=0x7f141c092d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1413fff640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 0x7f141c092d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f140400c750 tx=0x7f140400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404005de0 con 0x7f141c0a02e0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: dump: 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.278 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404007070 con 0x7f141c0a02e0 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404007440 con 0x7f141c0a02e0 2026-02-17T11:55:23.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f14117fa640 10 monclient: dump: 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1412ffd640 4 set_mon_vals no callback set 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 5 monclient: authenticate success, global_id 134112 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 10 monclient: _renew_subs 2026-02-17T11:55:23.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c094360 con 0x7f141c0a02e0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 10 monclient: _renew_subs 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.266+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c09a2d0 con 0x7f141c0a02e0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f1422b51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f1422b51640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 0x7f141c1cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f141c0a1930 con 0x7f141c094ec0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1404007660 con 0x7f141c0a02e0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14117fa640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13ec03dd10 0x7f13ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(355..355 src has 167..355) ==== 4799+0+0 (secure 0 0 0) 0x7f14040523f0 con 0x7f141c0a02e0 2026-02-17T11:55:23.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 0x7f141c1cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient: get_auth_request con 0x7f141c094ec0 auth_method 0 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14210c7640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13ec03dd10 0x7f13ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14210c7640 10 monclient: get_auth_request con 0x7f13ec03dd10 auth_method 0 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 10 monclient(hunting): handle_auth_done global_id 114241 payload 824 2026-02-17T11:55:23.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.267+0000 7f14208c6640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f141c06a290 con 0x7f141c094ec0 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14210c7640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13ec03dd10 0x7f13ec0401d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f141c06dc20 tx=0x7f1418033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14208c6640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 msgr2=0x7f141c1cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14208c6640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 0x7f141c1cd900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c006ae0 con 0x7f141c094ec0 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 10 monclient: dump: 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.285 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f140c006ae0 con 0x7f141c094ec0 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 msgr2=0x7f141c1cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 0x7f141c1cd900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c00ec00 comp rx=0 tx=0).stop 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 msgr2=0x7f141c1cd900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.270+0000 7f14117fa640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c094ec0 0x7f141c1cd900 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c00ec00 comp rx=0 tx=0).stop 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f1422b51640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:23.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f1422b51640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 0x7f141c1d8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f1422b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f141c09f4c0 con 0x7f141c1cde40 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 0x7f141c1d8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient: get_auth_request con 0x7f141c1cde40 auth_method 0 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 10 monclient(hunting): handle_auth_done global_id 114244 payload 824 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.273+0000 7f14208c6640 1 -- 10.20.193.51:0/2693820807 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f141c0008d0 con 0x7f141c1cde40 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14208c6640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 msgr2=0x7f141c1d8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14208c6640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 0x7f141c1d8490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c00c930 con 0x7f141c1cde40 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 10 monclient: dump: 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f140c00c930 con 0x7f141c1cde40 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:23.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 msgr2=0x7f141c1d8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 0x7f141c1d8490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c003860 comp rx=0 tx=0).stop 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 msgr2=0x7f141c1d8490 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14117fa640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f141c1cde40 0x7f141c1d8490 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e730 tx=0x7f140c003860 comp rx=0 tx=0).stop 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:55:23.289 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 125151, 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.290 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.291 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:23.292 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:23.293 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.294 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.295 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:23.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:23.298 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:23.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:23.300 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13ec03dd10 msgr2=0x7f13ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13ec03dd10 0x7f13ec0401d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f141c06dc20 tx=0x7f1418033000 comp rx=0 tx=0).stop 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 10 monclient: shutdown 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 msgr2=0x7f141c092d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 --2- 10.20.193.51:0/2693820807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f141c0a02e0 0x7f141c092d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f140400c750 tx=0x7f140400cc20 comp rx=0 tx=0).stop 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14210c7640 1 -- 10.20.193.51:0/2693820807 reap_dead start 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f14210c7640 1 -- 10.20.193.51:0/2693820807 reap_dead start 2026-02-17T11:55:23.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 shutdown_connections 2026-02-17T11:55:23.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 >> 10.20.193.51:0/2693820807 conn(0x7f141c0a30c0 msgr2=0x7f141c0a2440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 shutdown_connections 2026-02-17T11:55:23.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.276+0000 7f1422b51640 1 -- 10.20.193.51:0/2693820807 wait complete. 2026-02-17T11:55:23.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:23.302 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:55:23.302 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:55:23.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: get_monmap_and_config 2026-02-17T11:55:23.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: monmap: 2026-02-17T11:55:23.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:23.368101+0000 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:23.368101+0000 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 Processor -- start 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 -- start start 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: init 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T11:55:23.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb300a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb3009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-b con 0x7fbb300a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbb3013b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3006e140 con 0x7fbb300a3bb0 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3009f910 con 0x7fbb3013b760 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3009ccd0 con 0x7fbb300a0750 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb36f22640 10 monclient(hunting): authenticate will time out at 1210.986853s 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb34c97640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fbb300a3bb0 0x7fbb3009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46746/0 (socket says 10.20.193.51:46746) 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb3009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb34c97640 1 -- 10.20.193.51:0/3256449736 learned_addr learned my addr 10.20.193.51:0/3256449736 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): get_auth_request con 0x7fbb300a0750 auth_method 0 2026-02-17T11:55:23.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.367+0000 7fbb27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 10 monclient(hunting): handle_auth_done global_id 124187 payload 274 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 1 -- 10.20.193.51:0/3256449736 >> v1:10.20.193.142:6789/0 conn(0x7fbb3013b760 legacy=0x7fbb3013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 1 -- 10.20.193.51:0/3256449736 >> v1:10.20.193.51:6789/0 conn(0x7fbb300a3bb0 legacy=0x7fbb3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 1 monclient: found mon.noname-b 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.368+0000 7fbb27fff640 1 -- 10.20.193.51:0/3256449736 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3009eec0 con 0x7fbb300a0750 2026-02-17T11:55:23.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb27fff640 1 -- 10.20.193.51:0/3256449736 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 msgr2=0x7fbb3009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb27fff640 1 --2- 10.20.193.51:0/3256449736 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb3009e1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb3009f230 tx=0x7fbb1802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c89aaa1121d0aa5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 1 -- 10.20.193.51:0/3256449736 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1803c070 con 0x7fbb300a0750 2026-02-17T11:55:23.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: dump: 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 1 -- 10.20.193.51:0/3256449736 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1802fce0 con 0x7fbb300a0750 2026-02-17T11:55:23.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 5 monclient: authenticate success, global_id 124187 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 1 -- 10.20.193.51:0/3256449736 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18037660 con 0x7fbb300a0750 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 4 set_mon_vals no callback set 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb277fe640 10 monclient: dump: 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 10 monclient: shutdown 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 1 -- 10.20.193.51:0/3256449736 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 msgr2=0x7fbb3009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.370+0000 7fbb36f22640 1 --2- 10.20.193.51:0/3256449736 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb3009e1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb3009f230 tx=0x7fbb1802ed80 comp rx=0 tx=0).stop 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- 10.20.193.51:0/3256449736 shutdown_connections 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 --2- 10.20.193.51:0/3256449736 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb3009e1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- 10.20.193.51:0/3256449736 >> 10.20.193.51:0/3256449736 conn(0x7fbb300a30c0 msgr2=0x7fbb300a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- 10.20.193.51:0/3256449736 shutdown_connections 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- 10.20.193.51:0/3256449736 wait complete. 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient: build_initial_monmap 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient: monmap: 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:23.380 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 Processor -- start 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- start start 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient: init 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-c con 0x7fbb300a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb300a3bb0 0x7fbb301d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-b con 0x7fbb300a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb3013b760 0x7fbb301310d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): picked mon.noname-a con 0x7fbb3013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300a04b0 con 0x7fbb3013b760 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3009c850 con 0x7fbb300a3bb0 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3009e710 con 0x7fbb300a0750 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb36f22640 10 monclient(hunting): authenticate will time out at 1210.990880s 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43462/0 (socket says 10.20.193.51:43462) 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 1 -- 10.20.193.51:0/4064168090 learned_addr learned my addr 10.20.193.51:0/4064168090 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): get_auth_request con 0x7fbb300a0750 auth_method 0 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb35498640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb3013b760 0x7fbb301310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb34c97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb35498640 10 monclient(hunting): get_auth_request con 0x7fbb3013b760 auth_method 0 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb35498640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb35498640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.371+0000 7fbb35498640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb35498640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb35498640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb35498640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 10 monclient(hunting): handle_auth_done global_id 124190 payload 824 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 -- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb300a3bb0 msgr2=0x7fbb301d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb300a3bb0 0x7fbb301d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 -- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb3013b760 msgr2=0x7fbb301310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb3013b760 0x7fbb301310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 10 monclient: _finish_hunting 0 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 monclient: found mon.noname-c 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.372+0000 7fbb34c97640 1 -- 10.20.193.51:0/4064168090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb30134aa0 con 0x7fbb300a0750 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb34c97640 1 -- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 msgr2=0x7fbb301cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb34c97640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c780 tx=0x7fbb2000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20005de0 con 0x7fbb300a0750 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: dump: 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.384 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb20007070 con 0x7fbb300a0750 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 5 monclient: authenticate success, global_id 124190 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 10 monclient: _renew_subs 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb30134d80 con 0x7fbb300a0750 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20007440 con 0x7fbb300a0750 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:23.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb257fa640 10 monclient: dump: 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb26ffd640 4 set_mon_vals no callback set 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 10 monclient: _renew_subs 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.374+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb300a2970 con 0x7fbb300a0750 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbb20007620 con 0x7fbb300a0750 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb36f22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb36f22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb36f22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3009d7b0 con 0x7fbb300a0750 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb257fa640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 0x7fbb000401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(355..355 src has 167..355) ==== 4799+0+0 (secure 0 0 0) 0x7fbb200523f0 con 0x7fbb300a0750 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb27fff640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 0x7fbb000401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.375+0000 7fbb27fff640 10 monclient: get_auth_request con 0x7fbb0003dd10 auth_method 0 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.377+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb20050de0 con 0x7fbb300a0750 2026-02-17T11:55:23.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.377+0000 7fbb257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:23.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.377+0000 7fbb257fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:23.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.378+0000 7fbb27fff640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 0x7fbb000401d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb3006c1c0 tx=0x7fbb18031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:23.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.493+0000 7fbb36f22640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:55:23.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.493+0000 7fbb36f22640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:55:23.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.493+0000 7fbb36f22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:55:23.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.493+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fbb3009dac0 con 0x7fbb300a0750 2026-02-17T11:55:23.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.494+0000 7fbb257fa640 1 -- 10.20.193.51:0/4064168090 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fbb20011a00 con 0x7fbb300a0750 2026-02-17T11:55:23.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.494+0000 7fbb257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:55:23.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.494+0000 7fbb257fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=496465431,config=692619927,health=1902400218,kv=643764953,logm=2089347917}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=12,kv=11,logm=55} crc {auth=2785765630,config=692619927,health=3286790080,kv=1982221976,logm=991926573}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=496465431,config=692619927,health=1902400218,kv=643764953,logm=2089347917}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=9,kv=12,logm=56} crc {auth=2675301964,config=692619927,health=3882262412,kv=643764953,logm=1076120863}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=554460576}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1457518942}) 2026-02-17T11:55:23.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=554460576}) 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.494+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3968319720}) 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=974185343}) 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2409365007}) 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=974185343}) 2026-02-17T11:55:23.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1765797352}) 2026-02-17T11:55:23.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 msgr2=0x7fbb000401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 0x7fbb000401d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb3006c1c0 tx=0x7fbb18031000 comp rx=0 tx=0).stop 2026-02-17T11:55:23.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 10 monclient: shutdown 2026-02-17T11:55:23.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 msgr2=0x7fbb301cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c780 tx=0x7fbb2000cc50 comp rx=0 tx=0).stop 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 shutdown_connections 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbb0003dd10 0x7fbb000401d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbb3013b760 0x7fbb301310d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbb300a3bb0 0x7fbb301d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 --2- 10.20.193.51:0/4064168090 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbb300a0750 0x7fbb301cfad0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 >> 10.20.193.51:0/4064168090 conn(0x7fbb300a30c0 msgr2=0x7fbb3013a050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 shutdown_connections 2026-02-17T11:55:23.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:23.495+0000 7fbb36f22640 1 -- 10.20.193.51:0/4064168090 wait complete. 2026-02-17T11:55:23.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1069440465}) 2026-02-17T11:55:23.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1472694726}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1069440465}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.495+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2243546798}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1637536854}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2177235001}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1637536854}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=847497351}) 2026-02-17T11:55:23.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933555261}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1647074913}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933555261}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2095123010}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2703066790}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1582114550}) 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.513 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2703066790}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.496+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3792612228}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1865147468}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2391519136}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1865147468}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1480639671}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466254579}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1644503879}) 2026-02-17T11:55:23.514 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466254579}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3533889565}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2654221276}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=814837581}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2654221276}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.497+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4072915708}) 2026-02-17T11:55:23.515 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483267259}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=665826630}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483267259}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3494697219}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75469811}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2711273180}) 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.516 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75469811}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3397606869}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3141647799}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1927140907}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.498+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3141647799}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4016274400}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2579697251}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1726065356}) 2026-02-17T11:55:23.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2579697251}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4010069144}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780880065}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3864239910}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780880065}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.499+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=268441079}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1438729836}) 2026-02-17T11:55:23.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3582291874}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1438729836}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3740725658}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3208780937}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1552263972}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3208780937}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=983811773}) 2026-02-17T11:55:23.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3911852521}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4141156261}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3911852521}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.500+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=719713385}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=25660993}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2930274818}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=25660993}) 2026-02-17T11:55:23.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2658524506}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673769100}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1300194668}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673769100}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3694805363}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=758090324}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=315690380}) 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=758090324}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.501+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=393187046}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510346783}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3553456578}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510346783}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4021292283}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1978774598}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1427753576}) 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1978774598}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1830819487}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103362115}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1721006755}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103362115}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.502+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=677397183}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289469416}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=767674237}) 2026-02-17T11:55:23.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289469416}) 2026-02-17T11:55:23.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3838199133}) 2026-02-17T11:55:23.525 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:55:23.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159633051}) 2026-02-17T11:55:23.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4201900367}) 2026-02-17T11:55:23.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159633051}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4142042722}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1575167799}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1069407843}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1575167799}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.503+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1932322164}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1432766451}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1998102233}) 2026-02-17T11:55:23.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1432766451}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2813131737}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2225705208}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2794124090}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2225705208}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3293604269}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538667583}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1820328766}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538667583}) 2026-02-17T11:55:23.532 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.504+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3651666634}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750547605}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3558132073}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750547605}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1336709830}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304719090}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3771847401}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304719090}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3275432465}) 2026-02-17T11:55:23.533 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3508066400}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3073891632}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3508066400}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.505+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=900948342}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=11} crc {logm=1597885888,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1340579809,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=2596912786,osd_snap=2282903434}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=46,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=8} crc {logm=2140126844,mdsmap=3207544932,mgr=1312948032,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3663667509,mon_config_key=350269981,monmap=3140514009,osd_metadata=3956758304,osd_pg_creating=2596912786,osd_snap=4209519642}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=11} crc {logm=1597885888,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1340579809,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=2596912786,osd_snap=2282903434}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=44,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=13} crc {logm=1533594842,mdsmap=3140514009,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3663667509,mon_config_key=136537339,monmap=263989209,osd_metadata=3812721542,osd_pg_creating=2596912786,osd_snap=96034756}) 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=48,osdmap=52} crc {osd_snap=320616058,osdmap=2453208663}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=45,osdmap=55} crc {osd_snap=1540282596,osdmap=4230623580}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=48,osdmap=52} crc {osd_snap=320616058,osdmap=2453208663}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.506+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=47,osdmap=53} crc {osd_snap=2474197803,osdmap=3057715553}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2948358946}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2473970666}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2948358946}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=651569547}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1120678263}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4165143356}) 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1120678263}) 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.507+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3133735342}) 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=35} crc {osdmap=4225604257}) 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=35} crc {osdmap=3628369877}) 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=35} crc {osdmap=4225604257}) 2026-02-17T11:55:23.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:55:23.510+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=36} crc {osdmap=1016212391}) 2026-02-17T11:55:24.188 INFO:tasks.rados.rados.0.trial142.stdout:1525: done (1 left) 2026-02-17T11:55:24.188 INFO:tasks.rados.rados.0.trial142.stdout:1526: done (0 left) 2026-02-17T11:55:24.188 INFO:tasks.rados.rados.0.trial142.stdout:1527: read oid 5 snap -1 2026-02-17T11:55:24.188 INFO:tasks.rados.rados.0.trial142.stdout:1527: expect (ObjNum 541 snap 166 seq_num 541) 2026-02-17T11:55:24.189 INFO:tasks.rados.rados.0.trial142.stdout:1528: rollback oid 49 current snap is 168 2026-02-17T11:55:24.189 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 144 2026-02-17T11:55:24.189 INFO:tasks.rados.rados.0.trial142.stdout:1529: copy_from oid 45 from oid 39 current snap is 168 2026-02-17T11:55:24.189 INFO:tasks.rados.rados.0.trial142.stdout:1530: write oid 30 current snap is 168 2026-02-17T11:55:24.189 INFO:tasks.rados.rados.0.trial142.stdout:1530: seq_num 548 ranges {410236=413868,1234250=729187,2715800=423063} 2026-02-17T11:55:24.190 INFO:tasks.rados.rados.0.trial142.stdout:1530: writing trial14245205-30 from 410236 to 824104 tid 1 2026-02-17T11:55:24.195 INFO:tasks.rados.rados.0.trial142.stdout:1530: writing trial14245205-30 from 1234250 to 1963437 tid 2 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1530: writing trial14245205-30 from 2715800 to 3138863 tid 3 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1531: delete oid 15 current snap is 168 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1528: finishing rollback tid 0 to trial14245205-49 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1528: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1528: finishing rollback tid 2 to trial14245205-49 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1289 (ObjNum 478 snap 142 seq_num 478) dirty exists 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1530: finishing write tid 1 to trial14245205-30 2026-02-17T11:55:24.200 INFO:tasks.rados.rados.0.trial142.stdout:1527: expect (ObjNum 541 snap 166 seq_num 541) 2026-02-17T11:55:24.295 INFO:tasks.rados.rados.0.trial142.stdout:1530: finishing write tid 2 to trial14245205-30 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1529: finishing copy_from racing read to trial14245205-45 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1529: finishing copy_from to trial14245205-45 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 699 (ObjNum 437 snap 131 seq_num 437) dirty exists 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: finishing write tid 3 to trial14245205-30 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: finishing write tid 4 to trial14245205-30 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: finishing write tid 5 to trial14245205-30 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: oid 30 updating version 0 to 650 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: oid 30 updating version 650 to 651 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: oid 30 updating version 651 to 652 2026-02-17T11:55:24.296 INFO:tasks.rados.rados.0.trial142.stdout:1530: oid 30 updating version 652 to 653 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 653 (ObjNum 548 snap 168 seq_num 548) dirty exists 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1530: left oid 30 (ObjNum 548 snap 168 seq_num 548) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1527: done (4 left) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1528: done (3 left) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1529: done (2 left) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1530: done (1 left) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1531: done (0 left) 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1532: rollback oid 5 current snap is 168 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 5 to 156 2026-02-17T11:55:24.297 INFO:tasks.rados.rados.0.trial142.stdout:1533: write (excl) oid 12 current snap is 168 2026-02-17T11:55:24.298 INFO:tasks.rados.rados.0.trial142.stdout:1533: seq_num 550 ranges {443850=564366,1634861=732856,2770646=473204} 2026-02-17T11:55:24.298 INFO:tasks.rados.rados.0.trial142.stdout:1533: writing trial14245205-12 from 443850 to 1008216 tid 1 2026-02-17T11:55:24.303 INFO:tasks.rados.rados.0.trial142.stdout:1533: writing trial14245205-12 from 1634861 to 2367717 tid 2 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1533: writing trial14245205-12 from 2770646 to 3243850 tid 3 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1534: delete oid 11 current snap is 168 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1532: finishing rollback tid 0 to trial14245205-5 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1532: finishing rollback tid 1 to trial14245205-5 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1532: finishing rollback tid 2 to trial14245205-5 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 661 (ObjNum 228 snap 74 seq_num 228) dirty exists 2026-02-17T11:55:24.307 INFO:tasks.rados.rados.0.trial142.stdout:1533: finishing write tid 1 to trial14245205-12 2026-02-17T11:55:24.308 INFO:tasks.rados.rados.0.trial142.stdout:1533: finishing write tid 2 to trial14245205-12 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1533: finishing write tid 3 to trial14245205-12 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1533: finishing write tid 4 to trial14245205-12 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1532: done (2 left) 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1534: done (1 left) 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1535: read oid 33 snap 159 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1535: expect deleted 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1536: write (excl) oid 46 current snap is 168 2026-02-17T11:55:24.309 INFO:tasks.rados.rados.0.trial142.stdout:1536: seq_num 552 ranges {477464=714864,1751825=736525,3225492=51972} 2026-02-17T11:55:24.313 INFO:tasks.rados.rados.0.trial142.stdout:1536: writing trial14245205-46 from 477464 to 1192328 tid 1 2026-02-17T11:55:24.317 INFO:tasks.rados.rados.0.trial142.stdout:1536: writing trial14245205-46 from 1751825 to 2488350 tid 2 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1536: writing trial14245205-46 from 3225492 to 3277464 tid 3 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1537: delete oid 36 current snap is 168 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1533: finishing write tid 5 to trial14245205-12 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1533: oid 12 updating version 0 to 1291 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1533: oid 12 updating version 1291 to 1294 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1533: oid 12 version 1294 is already newer than 1292 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:1533: oid 12 version 1294 is already newer than 1293 2026-02-17T11:55:24.321 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1294 (ObjNum 550 snap 168 seq_num 550) dirty exists 2026-02-17T11:55:24.322 INFO:tasks.rados.rados.0.trial142.stdout:1533: left oid 12 (ObjNum 550 snap 168 seq_num 550) 2026-02-17T11:55:24.322 INFO:tasks.rados.rados.0.trial142.stdout:1536: finishing write tid 1 to trial14245205-46 2026-02-17T11:55:24.322 INFO:tasks.rados.rados.0.trial142.stdout:1536: finishing write tid 2 to trial14245205-46 2026-02-17T11:55:24.322 INFO:tasks.rados.rados.0.trial142.stdout:1536: finishing write tid 3 to trial14245205-46 2026-02-17T11:55:24.323 INFO:tasks.rados.rados.0.trial142.stdout:1533: done (3 left) 2026-02-17T11:55:24.323 INFO:tasks.rados.rados.0.trial142.stdout:1535: done (2 left) 2026-02-17T11:55:24.323 INFO:tasks.rados.rados.0.trial142.stdout:1537: done (1 left) 2026-02-17T11:55:24.323 INFO:tasks.rados.rados.0.trial142.stdout:1538: write (excl) oid 15 current snap is 168 2026-02-17T11:55:24.323 INFO:tasks.rados.rados.0.trial142.stdout:1538: seq_num 554 ranges {511078=465362,1752436=740194,3163985=147093} 2026-02-17T11:55:24.325 INFO:tasks.rados.rados.0.trial142.stdout:1538: writing trial14245205-15 from 511078 to 976440 tid 1 2026-02-17T11:55:24.331 INFO:tasks.rados.rados.0.trial142.stdout:1538: writing trial14245205-15 from 1752436 to 2492630 tid 2 2026-02-17T11:55:24.335 INFO:tasks.rados.rados.0.trial142.stdout:1538: writing trial14245205-15 from 3163985 to 3311078 tid 3 2026-02-17T11:55:24.335 INFO:tasks.rados.rados.0.trial142.stdout:1539: read oid 25 snap -1 2026-02-17T11:55:24.335 INFO:tasks.rados.rados.0.trial142.stdout:1539: expect (ObjNum 530 snap 165 seq_num 530) 2026-02-17T11:55:24.335 INFO:tasks.rados.rados.0.trial142.stdout:1540: snap_remove snap 163 2026-02-17T11:55:24.526 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:55:24.526 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.593+0000 7f1bb3f2c640 10 monclient: get_monmap_and_config 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.593+0000 7f1bb3f2c640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.593+0000 7f1bb3f2c640 10 monclient: monmap: 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:24.594728+0000 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:24.594728+0000 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:24.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 Processor -- start 2026-02-17T11:55:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 -- start start 2026-02-17T11:55:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient: init 2026-02-17T11:55:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f1bac0a3bb0 0x7f1bac09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-c con 0x7f1bac0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1bac09dac0 0x7f1bac09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f1bac09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1bac09ff40 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac06e140 con 0x7f1bac09ff40 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f1bac09aed0 con 0x7f1bac09dac0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1bac09caa0 con 0x7f1bac0a3bb0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb3f2c640 10 monclient(hunting): authenticate will time out at 1212.213530s 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1bac09dac0 0x7f1bac09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1bac09dac0 0x7f1bac09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56160/0 (socket says 10.20.193.51:56160) 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 -- 10.20.193.51:0/3411077134 learned_addr learned my addr 10.20.193.51:0/3411077134 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): get_auth_request con 0x7f1bac09dac0 auth_method 0 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient(hunting): handle_auth_done global_id 134118 payload 274 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 -- 10.20.193.51:0/3411077134 >> v2:10.20.193.142:3300/0 conn(0x7f1bac0a3bb0 msgr2=0x7f1bac09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 --2- 10.20.193.51:0/3411077134 >> v2:10.20.193.142:3300/0 conn(0x7f1bac0a3bb0 0x7f1bac09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 -- 10.20.193.51:0/3411077134 >> v1:10.20.193.142:6789/0 conn(0x7f1bac09ff40 legacy=0x7f1bac13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.594+0000 7f1bb14a0640 1 -- 10.20.193.51:0/3411077134 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac09ce60 con 0x7f1bac09dac0 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb14a0640 1 -- 10.20.193.51:0/3411077134 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 msgr2=0x7f1bac09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb14a0640 1 --2- 10.20.193.51:0/3411077134 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac09fa00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bac09cc20 tx=0x7f1ba002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc08648aa5fa13a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 1 -- 10.20.193.51:0/3411077134 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba003c070 con 0x7f1bac09dac0 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: dump: 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 5 monclient: authenticate success, global_id 134118 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 1 -- 10.20.193.51:0/3411077134 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba002fd70 con 0x7f1bac09dac0 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 1 -- 10.20.193.51:0/3411077134 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0037660 con 0x7f1bac09dac0 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 4 set_mon_vals no callback set 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb0c9f640 10 monclient: dump: 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 10 monclient: shutdown 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/3411077134 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 msgr2=0x7f1bac09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/3411077134 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac09fa00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bac09cc20 tx=0x7f1ba002ee10 comp rx=0 tx=0).stop 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/3411077134 shutdown_connections 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/3411077134 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac09fa00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/3411077134 >> v2:10.20.193.142:3300/0 conn(0x7f1bac0a3bb0 0x7f1bac09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/3411077134 >> 10.20.193.51:0/3411077134 conn(0x7f1bac0a30c0 msgr2=0x7f1bac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/3411077134 shutdown_connections 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.597+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/3411077134 wait complete. 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient: monmap: 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 Processor -- start 2026-02-17T11:55:24.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 -- start start 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient: init 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f1bac09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1bac09ff40 0x7f1bac1d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-b con 0x7f1bac09ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1bac0a3bb0 0x7f1bac06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): picked mon.noname-c con 0x7f1bac0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac0a0370 con 0x7f1bac09dac0 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac09a880 con 0x7f1bac09ff40 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1bac0a04f0 con 0x7f1bac0a3bb0 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb3f2c640 10 monclient(hunting): authenticate will time out at 1212.217814s 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56166/0 (socket says 10.20.193.51:56166) 2026-02-17T11:55:24.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 1 -- 10.20.193.51:0/1243271217 learned_addr learned my addr 10.20.193.51:0/1243271217 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): get_auth_request con 0x7f1bac09dac0 auth_method 0 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1bac0a3bb0 0x7f1bac06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): get_auth_request con 0x7f1bac0a3bb0 auth_method 0 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb1ca1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb14a0640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1bac09ff40 0x7f1bac1d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.598+0000 7f1bb24a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb14a0640 10 monclient(hunting): get_auth_request con 0x7f1bac09ff40 auth_method 0 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb14a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb14a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb14a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 10 monclient(hunting): handle_auth_done global_id 134121 payload 824 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 -- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1bac0a3bb0 msgr2=0x7f1bac06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1bac0a3bb0 0x7f1bac06ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 -- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1bac09ff40 msgr2=0x7f1bac1d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1bac09ff40 0x7f1bac1d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.599+0000 7f1bb1ca1640 1 -- 10.20.193.51:0/1243271217 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac1bb140 con 0x7f1bac09dac0 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb1ca1640 1 -- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 msgr2=0x7f1bac1cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb1ca1640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00b780 tx=0x7f1b9c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0026e0 con 0x7f1bac09dac0 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: dump: 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c010070 con 0x7f1bac09dac0 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c002ac0 con 0x7f1bac09dac0 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9bfff640 4 set_mon_vals no callback set 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 10 monclient: dump: 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 5 monclient: authenticate success, global_id 134121 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _renew_subs 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac09d7b0 con 0x7f1bac09dac0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _renew_subs 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1bae60 con 0x7f1bac09dac0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bac06e550 con 0x7f1bac09dac0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.601+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1b9c01d030 con 0x7f1bac09dac0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.602+0000 7f1b9a7fc640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 0x7f1b7c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.602+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(356..356 src has 167..356) ==== 4799+0+0 (secure 0 0 0) 0x7f1b9c051ab0 con 0x7f1bac09dac0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.602+0000 7f1bb14a0640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 0x7f1b7c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.602+0000 7f1bb14a0640 10 monclient: get_auth_request con 0x7f1b7c03dd60 auth_method 0 2026-02-17T11:55:24.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.604+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1bac06e550 con 0x7f1bac09dac0 2026-02-17T11:55:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.604+0000 7f1b9a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.604+0000 7f1b9a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:24.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.605+0000 7f1bb14a0640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 0x7f1b7c040220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0036000 tx=0x7f1ba0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.686 INFO:tasks.rados.rados.0.trial142.stdout:1540: done (3 left) 2026-02-17T11:55:24.686 INFO:tasks.rados.rados.0.trial142.stdout:1541: write (excl) oid 41 current snap is 168 2026-02-17T11:55:24.686 INFO:tasks.rados.rados.0.trial142.stdout:1541: seq_num 555 ranges {527885=656964,1927271=483852,3191408=136477} 2026-02-17T11:55:24.691 INFO:tasks.rados.rados.0.trial142.stdout:1541: writing trial14245205-41 from 527885 to 1184849 tid 1 2026-02-17T11:55:24.695 INFO:tasks.rados.rados.0.trial142.stdout:1541: writing trial14245205-41 from 1927271 to 2411123 tid 2 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1541: writing trial14245205-41 from 3191408 to 3327885 tid 3 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1542: delete oid 22 current snap is 168 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: finishing write tid 4 to trial14245205-46 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: finishing write tid 5 to trial14245205-46 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: oid 46 updating version 0 to 1298 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: oid 46 version 1298 is already newer than 1297 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: oid 46 version 1298 is already newer than 1296 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:1536: oid 46 version 1298 is already newer than 1295 2026-02-17T11:55:24.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1298 (ObjNum 552 snap 168 seq_num 552) dirty exists 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1536: left oid 46 (ObjNum 552 snap 168 seq_num 552) 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: finishing write tid 1 to trial14245205-15 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: finishing write tid 2 to trial14245205-15 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: finishing write tid 3 to trial14245205-15 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: finishing write tid 4 to trial14245205-15 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: finishing write tid 5 to trial14245205-15 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: oid 15 updating version 0 to 989 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: oid 15 version 989 is already newer than 986 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: oid 15 version 989 is already newer than 988 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: oid 15 version 989 is already newer than 987 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 989 (ObjNum 554 snap 168 seq_num 554) dirty exists 2026-02-17T11:55:24.701 INFO:tasks.rados.rados.0.trial142.stdout:1538: left oid 15 (ObjNum 554 snap 168 seq_num 554) 2026-02-17T11:55:24.702 INFO:tasks.rados.rados.0.trial142.stdout:1539: expect (ObjNum 530 snap 165 seq_num 530) 2026-02-17T11:55:24.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1bb3f2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:24.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1bb3f2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:24.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1bb3f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1bac09f4c0 con 0x7f1bac09dac0 2026-02-17T11:55:24.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1b9a7fc640 1 -- 10.20.193.51:0/1243271217 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f1b9c0504a0 con 0x7f1bac09dac0 2026-02-17T11:55:24.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1b9a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:24.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.721+0000 7f1b9a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:24.724 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:24.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 msgr2=0x7f1b7c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 0x7f1b7c040220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0036000 tx=0x7f1ba0033000 comp rx=0 tx=0).stop 2026-02-17T11:55:24.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 10 monclient: shutdown 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 msgr2=0x7f1bac1cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00b780 tx=0x7f1b9c00bc50 comp rx=0 tx=0).stop 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 shutdown_connections 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b7c03dd60 0x7f1b7c040220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1bac0a3bb0 0x7f1bac06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1bac09ff40 0x7f1bac1d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 --2- 10.20.193.51:0/1243271217 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1bac09dac0 0x7f1bac1cfd60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 >> 10.20.193.51:0/1243271217 conn(0x7f1bac0a30c0 msgr2=0x7f1bac06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 shutdown_connections 2026-02-17T11:55:24.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.722+0000 7f1bb3f2c640 1 -- 10.20.193.51:0/1243271217 wait complete. 2026-02-17T11:55:24.733 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:55:24.733 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:55:24.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:55:24.733 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:55:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1541: finishing write tid 1 to trial14245205-41 2026-02-17T11:55:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1541: finishing write tid 2 to trial14245205-41 2026-02-17T11:55:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1541: finishing write tid 3 to trial14245205-41 2026-02-17T11:55:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1541: finishing write tid 4 to trial14245205-41 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1536: done (4 left) 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1538: done (3 left) 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1539: done (2 left) 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1542: done (1 left) 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1543: read oid 11 snap 155 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1543: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1544: delete oid 26 current snap is 168 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: finishing write tid 5 to trial14245205-41 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: oid 41 updating version 0 to 1214 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: oid 41 version 1214 is already newer than 1212 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: oid 41 version 1214 is already newer than 1213 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: oid 41 version 1214 is already newer than 1211 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1214 (ObjNum 555 snap 168 seq_num 555) dirty exists 2026-02-17T11:55:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1541: left oid 41 (ObjNum 555 snap 168 seq_num 555) 2026-02-17T11:55:24.771 INFO:tasks.rados.rados.0.trial142.stdout:1541: done (2 left) 2026-02-17T11:55:24.771 INFO:tasks.rados.rados.0.trial142.stdout:1544: done (1 left) 2026-02-17T11:55:24.771 INFO:tasks.rados.rados.0.trial142.stdout:1545: snap_remove snap 150 2026-02-17T11:55:24.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: get_monmap_and_config 2026-02-17T11:55:24.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: monmap: 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:24.800986+0000 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:24.800986+0000 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:24.805 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 Processor -- start 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 -- start start 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: init 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7fbc0a3bb0 0x7f7fbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-a con 0x7f7fbc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7fbc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7fbc13b760 0x7f7fbc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-c con 0x7f7fbc13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fbc06e140 con 0x7f7fbc0a0750 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc09f910 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc09ccd0 con 0x7f7fbc13b760 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc2a7e640 10 monclient(hunting): authenticate will time out at 1212.419729s 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7fbc0a3bb0 0x7f7fbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbb7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7fbc0a0750 0x7f7fbc09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46752/0 (socket says 10.20.193.51:46752) 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbb7fe640 1 -- 10.20.193.51:0/3328248336 learned_addr learned my addr 10.20.193.51:0/3328248336 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request con 0x7f7fbc0a3bb0 auth_method 0 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc0ff4640 1 --2- 10.20.193.51:0/3328248336 >> v2:10.20.193.142:3300/0 conn(0x7f7fbc13b760 0x7f7fbc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc0ff4640 10 monclient(hunting): get_auth_request con 0x7f7fbc13b760 auth_method 0 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc0ff4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc0ff4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fc0ff4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_done global_id 134124 payload 274 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 -- 10.20.193.51:0/3328248336 >> v2:10.20.193.142:3300/0 conn(0x7f7fbc13b760 msgr2=0x7f7fbc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/3328248336 >> v2:10.20.193.142:3300/0 conn(0x7f7fbc13b760 0x7f7fbc13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 -- 10.20.193.51:0/3328248336 >> v1:10.20.193.51:6789/0 conn(0x7f7fbc0a0750 legacy=0x7f7fbc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.800+0000 7f7fbbfff640 1 -- 10.20.193.51:0/3328248336 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc09eec0 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbbfff640 1 -- 10.20.193.51:0/3328248336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0a3bb0 msgr2=0x7f7fbc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/3328248336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc09dac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc09f5f0 tx=0x7f7fa802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963aba74fa662a76 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 1 -- 10.20.193.51:0/3328248336 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa803c070 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: dump: 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.821 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 5 monclient: authenticate success, global_id 134124 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 1 -- 10.20.193.51:0/3328248336 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa802fbd0 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 4 set_mon_vals no callback set 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 1 -- 10.20.193.51:0/3328248336 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8037440 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fbaffd640 10 monclient: dump: 2026-02-17T11:55:24.823 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 10 monclient: shutdown 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/3328248336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0a3bb0 msgr2=0x7f7fbc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.803+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/3328248336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc09dac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc09f5f0 tx=0x7f7fa802ed50 comp rx=0 tx=0).stop 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/3328248336 shutdown_connections 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/3328248336 >> v2:10.20.193.142:3300/0 conn(0x7f7fbc13b760 0x7f7fbc13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/3328248336 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc09dac0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/3328248336 >> 10.20.193.51:0/3328248336 conn(0x7f7fbc0a30c0 msgr2=0x7f7fbc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/3328248336 shutdown_connections 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/3328248336 wait complete. 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 10 monclient: monmap: 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:24.825 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 Processor -- start 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 1 -- start start 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.804+0000 7f7fc2a7e640 10 monclient: init 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fbc0a0750 0x7f7fbc1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-c con 0x7f7fbc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-b con 0x7f7fbc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 0x7f7fbc096500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): picked mon.noname-a con 0x7f7fbc13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0a04b0 con 0x7f7fbc13b760 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc09c850 con 0x7f7fbc0a3bb0 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc09e710 con 0x7f7fbc0a0750 2026-02-17T11:55:24.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc2a7e640 10 monclient(hunting): authenticate will time out at 1212.424067s 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 0x7f7fbc096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fbc0a0750 0x7f7fbc1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 0x7f7fbc096500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56184/0 (socket says 10.20.193.51:56184) 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 learned_addr learned my addr 10.20.193.51:0/1142310009 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): get_auth_request con 0x7f7fbc13b760 auth_method 0 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request con 0x7f7fbc0a0750 auth_method 0 2026-02-17T11:55:24.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 10 monclient(hunting): get_auth_request con 0x7f7fbc0a3bb0 auth_method 0 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient(hunting): handle_auth_done global_id 134127 payload 824 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fbc0a0750 msgr2=0x7f7fbc1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fbc0a0750 0x7f7fbc1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fbc0a3bb0 msgr2=0x7f7fbc1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc06f4a0 con 0x7f7fbc13b760 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fbc0a0750 0x7f7fbc1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:55:24.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.805+0000 7f7fbb7fe640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fbc0a3bb0 0x7f7fbc1d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 msgr2=0x7f7fbc096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc0ff4640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 0x7f7fbc096500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0007d80 tx=0x7f7fb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0014620 con 0x7f7fbc13b760 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: dump: 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.831 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0019070 con 0x7f7fbc13b760 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 5 monclient: authenticate success, global_id 134127 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0014a00 con 0x7f7fbc13b760 2026-02-17T11:55:24.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 10 monclient: _renew_subs 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc09d7b0 con 0x7f7fbc13b760 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fba7fc640 4 set_mon_vals no callback set 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fb8ff9640 10 monclient: dump: 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.833 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 10 monclient: _renew_subs 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc099a10 con 0x7f7fbc13b760 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.807+0000 7f7fc2a7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 0x7f7fbc08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc09a3c0 con 0x7f7fbc097200 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 0x7f7fbc08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient: get_auth_request con 0x7f7fbc097200 auth_method 0 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7fb001e460 con 0x7f7fbc13b760 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_done global_id 134130 payload 824 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbbfff640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fbc06fe20 con 0x7f7fbc097200 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fb8ff9640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f8c03dd10 0x7f7f8c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7f7fb0053010 con 0x7f7fbc13b760 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbb7fe640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f8c03dd10 0x7f7f8c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.808+0000 7f7fbb7fe640 10 monclient: get_auth_request con 0x7f7f8c03dd10 auth_method 0 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fbbfff640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 msgr2=0x7f7fbc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 0x7f7fbc08d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8039000 tx=0x7f7fa80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa803c040 con 0x7f7fbc097200 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 10 monclient: dump: 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7fa8041850 con 0x7f7fbc097200 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 msgr2=0x7f7fbc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 0x7f7fbc08d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8039000 tx=0x7f7fa80047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 msgr2=0x7f7fbc08d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.810+0000 7f7fb8ff9640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc097200 0x7f7fbc08d3f0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8039000 tx=0x7f7fa80047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.811+0000 7f7fbb7fe640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f8c03dd10 0x7f7f8c0401d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007d90 tx=0x7f7fac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fc2a7e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 0x7f7fbc1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fc2a7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc09dac0 con 0x7f7fbc0975e0 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 0x7f7fbc1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient: get_auth_request con 0x7f7fbc0975e0 auth_method 0 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 10 monclient(hunting): handle_auth_done global_id 134133 payload 824 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.813+0000 7f7fbbfff640 1 -- 10.20.193.51:0/1142310009 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fbc0a22a0 con 0x7f7fbc0975e0 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.815+0000 7f7fbbfff640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 msgr2=0x7f7fbc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.815+0000 7f7fbbfff640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 0x7f7fbc1daad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802ed90 tx=0x7f7fa8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa803c040 con 0x7f7fbc0975e0 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 10 monclient: dump: 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.838 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4542 (secure 0 0 0) 0x7f7fa804e3f0 con 0x7f7fbc0975e0 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 msgr2=0x7f7fbc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 0x7f7fbc1daad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802ed90 tx=0x7f7fa8009290 comp rx=0 tx=0).stop 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 msgr2=0x7f7fbc1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fb8ff9640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc0975e0 0x7f7fbc1daad0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802ed90 tx=0x7f7fa8009290 comp rx=0 tx=0).stop 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:24.839 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 25138, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.840 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.841 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:24.842 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:24.843 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:24.844 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.845 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.846 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.847 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:24.848 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f8c03dd10 msgr2=0x7f7f8c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f8c03dd10 0x7f7f8c0401d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007d90 tx=0x7f7fac009040 comp rx=0 tx=0).stop 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 10 monclient: shutdown 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 msgr2=0x7f7fbc096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 --2- 10.20.193.51:0/1142310009 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fbc13b760 0x7f7fbc096500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0007d80 tx=0x7f7fb000e4b0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 reap_dead start 2026-02-17T11:55:24.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc0ff4640 1 -- 10.20.193.51:0/1142310009 reap_dead start 2026-02-17T11:55:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 shutdown_connections 2026-02-17T11:55:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 >> 10.20.193.51:0/1142310009 conn(0x7f7fbc0a30c0 msgr2=0x7f7fbc13ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 shutdown_connections 2026-02-17T11:55:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.816+0000 7f7fc2a7e640 1 -- 10.20.193.51:0/1142310009 wait complete. 2026-02-17T11:55:24.850 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:24.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:55:24.850 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.916+0000 7fe0a7491640 10 monclient: get_monmap_and_config 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.916+0000 7fe0a7491640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.916+0000 7fe0a7491640 10 monclient: monmap: 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:24.917696+0000 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:24.917696+0000 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:24.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 Processor -- start 2026-02-17T11:55:24.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 -- start start 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient: init 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe0a00a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe0a00a0750 0x7fe0a009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-c con 0x7fe0a00a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe0a013b760 0x7fe0a013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-a con 0x7fe0a013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a006e140 con 0x7fe0a00a3bb0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a009f910 con 0x7fe0a013b760 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a009ccd0 con 0x7fe0a00a0750 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a7491640 10 monclient(hunting): authenticate will time out at 1212.536455s 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5206640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe0a00a3bb0 0x7fe0a009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46760/0 (socket says 10.20.193.51:46760) 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5206640 1 -- 10.20.193.51:0/1078591188 learned_addr learned my addr 10.20.193.51:0/1078591188 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1078591188 >> v2:10.20.193.51:3300/0 conn(0x7fe0a013b760 0x7fe0a013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): get_auth_request con 0x7fe0a013b760 auth_method 0 2026-02-17T11:55:24.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a4a05640 1 --2- 10.20.193.51:0/1078591188 >> v2:10.20.193.142:3300/0 conn(0x7fe0a00a0750 0x7fe0a009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a4a05640 10 monclient(hunting): get_auth_request con 0x7fe0a00a0750 auth_method 0 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a4a05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a4a05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a4a05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_done global_id 134136 payload 274 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1078591188 >> v2:10.20.193.142:3300/0 conn(0x7fe0a00a0750 msgr2=0x7fe0a009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1078591188 >> v2:10.20.193.142:3300/0 conn(0x7fe0a00a0750 0x7fe0a009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1078591188 >> v1:10.20.193.51:6789/0 conn(0x7fe0a00a3bb0 legacy=0x7fe0a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.917+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1078591188 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a009eec0 con 0x7fe0a013b760 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1078591188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 msgr2=0x7fe0a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1078591188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013db50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006f3c0 tx=0x7fe09c02f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954898b5cd23ab48 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 1 -- 10.20.193.51:0/1078591188 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c03c070 con 0x7fe0a013b760 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: dump: 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.925 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 1 -- 10.20.193.51:0/1078591188 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c037440 con 0x7fe0a013b760 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 5 monclient: authenticate success, global_id 134136 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 1 -- 10.20.193.51:0/1078591188 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c037810 con 0x7fe0a013b760 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 4 set_mon_vals no callback set 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe08ffff640 10 monclient: dump: 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.926 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 10 monclient: shutdown 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 -- 10.20.193.51:0/1078591188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 msgr2=0x7fe0a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1078591188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013db50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006f3c0 tx=0x7fe09c02f130 comp rx=0 tx=0).stop 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 -- 10.20.193.51:0/1078591188 shutdown_connections 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1078591188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013db50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1078591188 >> v2:10.20.193.142:3300/0 conn(0x7fe0a00a0750 0x7fe0a009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 -- 10.20.193.51:0/1078591188 >> 10.20.193.51:0/1078591188 conn(0x7fe0a00a30c0 msgr2=0x7fe0a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 -- 10.20.193.51:0/1078591188 shutdown_connections 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.920+0000 7fe0a7491640 1 -- 10.20.193.51:0/1078591188 wait complete. 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient: build_initial_monmap 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient: monmap: 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:24.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 Processor -- start 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 -- start start 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient: init 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0a00a0750 0x7fe0a009b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-b con 0x7fe0a00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a3bb0 0x7fe0a013abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-c con 0x7fe0a00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): picked mon.noname-a con 0x7fe0a013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00a04b0 con 0x7fe0a013b760 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a009c850 con 0x7fe0a00a0750 2026-02-17T11:55:24.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a009e710 con 0x7fe0a00a3bb0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a7491640 10 monclient(hunting): authenticate will time out at 1212.540590s 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56224/0 (socket says 10.20.193.51:56224) 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 learned_addr learned my addr 10.20.193.51:0/1222799609 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): get_auth_request con 0x7fe0a013b760 auth_method 0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a3bb0 0x7fe0a013abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): get_auth_request con 0x7fe0a00a3bb0 auth_method 0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0a00a0750 0x7fe0a009b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a4a05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient(hunting): handle_auth_done global_id 134139 payload 824 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a3bb0 msgr2=0x7fe0a013abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a3bb0 0x7fe0a013abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0a00a0750 msgr2=0x7fe0a009b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0a00a0750 0x7fe0a009b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient: _finish_hunting 0 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 monclient: found mon.noname-a 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a009ae20 con 0x7fe0a013b760 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5206640 10 monclient: get_auth_request con 0x7fe0a00a0750 auth_method 0 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.921+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0a00a0750 0x7fe0a009b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.923+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 msgr2=0x7fe0a013b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.923+0000 7fe0a5a07640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013b0f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe09c03a040 tx=0x7fe09c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c03c050 con 0x7fe0a013b760 2026-02-17T11:55:24.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:24.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: dump: 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c048070 con 0x7fe0a013b760 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c041c60 con 0x7fe0a013b760 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:24.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 10 monclient: dump: 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08f7fe640 4 set_mon_vals no callback set 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 5 monclient: authenticate success, global_id 134139 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 monclient: _renew_subs 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a009b100 con 0x7fe0a013b760 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 monclient: _renew_subs 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a00a2450 con 0x7fe0a013b760 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe09c04d460 con 0x7fe0a013b760 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 0x7fe0a00972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a009d7b0 con 0x7fe0a00a2b20 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 0x7fe0a00972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient: get_auth_request con 0x7fe0a00a2b20 auth_method 0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe07003dd10 0x7fe0700401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7fe09c0786c0 con 0x7fe0a013b760 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 10 monclient(hunting): handle_auth_done global_id 124202 payload 824 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.924+0000 7fe0a5206640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0a009dac0 con 0x7fe0a00a2b20 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.925+0000 7fe0a4a05640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe07003dd10 0x7fe0700401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.925+0000 7fe0a4a05640 10 monclient: get_auth_request con 0x7fe07003dd10 auth_method 0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe0a5206640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 msgr2=0x7fe0a00972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 0x7fe0a00972c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe09000dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090005de0 con 0x7fe0a00a2b20 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 10 monclient: dump: 2026-02-17T11:55:24.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fe090017070 con 0x7fe0a00a2b20 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 msgr2=0x7fe0a00972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 0x7fe0a00972c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe09000dbf0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 msgr2=0x7fe0a00972c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe08dffb640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a00a2b20 0x7fe0a00972c0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe09000dbf0 comp rx=0 tx=0).stop 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.927+0000 7fe0a4a05640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe07003dd10 0x7fe0700401d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe094009a50 tx=0x7fe094008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a7491640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 0x7fe0a01da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a7491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a006fe50 con 0x7fe0a0097800 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 0x7fe0a01da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:24.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient: get_auth_request con 0x7fe0a0097800 auth_method 0 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 10 monclient(hunting): handle_auth_done global_id 124205 payload 824 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.930+0000 7fe0a5206640 1 -- 10.20.193.51:0/1222799609 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe0a00008d0 con 0x7fe0a0097800 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe0a5206640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 msgr2=0x7fe0a01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:24.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe0a5206640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 0x7fe0a01da8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe090004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09000bb40 con 0x7fe0a0097800 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 10 monclient: dump: 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fe09000bb40 con 0x7fe0a0097800 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 msgr2=0x7fe0a01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 0x7fe0a01da8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe090004a40 comp rx=0 tx=0).stop 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 msgr2=0x7fe0a01da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:24.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.932+0000 7fe08dffb640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0a0097800 0x7fe0a01da8c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d720 tx=0x7fe090004a40 comp rx=0 tx=0).stop 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 79377, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.939 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.940 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:24.941 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.942 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:24.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:24.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:24.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:24.946 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe07003dd10 msgr2=0x7fe0700401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe07003dd10 0x7fe0700401d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe094009a50 tx=0x7fe094008040 comp rx=0 tx=0).stop 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 10 monclient: shutdown 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 msgr2=0x7fe0a013b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 --2- 10.20.193.51:0/1222799609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0a013b760 0x7fe0a013b0f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe09c03a040 tx=0x7fe09c004b40 comp rx=0 tx=0).stop 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 reap_dead start 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a5a07640 1 -- 10.20.193.51:0/1222799609 reap_dead start 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 shutdown_connections 2026-02-17T11:55:24.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 >> 10.20.193.51:0/1222799609 conn(0x7fe0a00a30c0 msgr2=0x7fe0a0072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:24.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 shutdown_connections 2026-02-17T11:55:24.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:24.933+0000 7fe0a7491640 1 -- 10.20.193.51:0/1222799609 wait complete. 2026-02-17T11:55:24.948 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:24.948 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:55:24.948 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.012+0000 7f499a2a0640 10 monclient: get_monmap_and_config 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.012+0000 7f499a2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.012+0000 7f499a2a0640 10 monclient: monmap: 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:25.013716+0000 2026-02-17T11:55:25.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:25.013716+0000 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:25.015 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 Processor -- start 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 -- start start 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient: init 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-17T11:55:25.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f49940a3bb0 0x7f499409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f49940a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f49940a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f499413b760 0x7f499413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-a con 0x7f499413b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499406e140 con 0x7f49940a0750 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f499409f910 con 0x7f499413b760 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f499409ccd0 con 0x7f49940a3bb0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f499a2a0640 10 monclient(hunting): authenticate will time out at 1212.632505s 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f499413b760 0x7f499413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f499413b760 0x7f499413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56240/0 (socket says 10.20.193.51:56240) 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 -- 10.20.193.51:0/3511656288 learned_addr learned my addr 10.20.193.51:0/3511656288 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): get_auth_request con 0x7f499413b760 auth_method 0 2026-02-17T11:55:25.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient(hunting): handle_auth_done global_id 134142 payload 274 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 -- 10.20.193.51:0/3511656288 >> v2:10.20.193.142:3300/0 conn(0x7f49940a3bb0 msgr2=0x7f499409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 --2- 10.20.193.51:0/3511656288 >> v2:10.20.193.142:3300/0 conn(0x7f49940a3bb0 0x7f499409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 -- 10.20.193.51:0/3511656288 >> v1:10.20.193.142:6789/0 conn(0x7f49940a0750 legacy=0x7f499409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient: _finish_hunting 0 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 monclient: found mon.noname-a 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.013+0000 7f4998816640 1 -- 10.20.193.51:0/3511656288 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499409eec0 con 0x7f499413b760 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4998816640 1 -- 10.20.193.51:0/3511656288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 msgr2=0x7f499413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4998816640 1 --2- 10.20.193.51:0/3511656288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f499413db50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f499406c1c0 tx=0x7f498802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aa51a24d037e56 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 1 -- 10.20.193.51:0/3511656288 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498802fe60 con 0x7f499413b760 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: dump: 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.026 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 5 monclient: authenticate success, global_id 134142 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 1 -- 10.20.193.51:0/3511656288 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49880373f0 con 0x7f499413b760 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 1 -- 10.20.193.51:0/3511656288 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49880377c0 con 0x7f499413b760 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 4 set_mon_vals no callback set 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f4992ffd640 10 monclient: dump: 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 10 monclient: shutdown 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 -- 10.20.193.51:0/3511656288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 msgr2=0x7f499413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 --2- 10.20.193.51:0/3511656288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f499413db50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f499406c1c0 tx=0x7f498802f230 comp rx=0 tx=0).stop 2026-02-17T11:55:25.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 -- 10.20.193.51:0/3511656288 shutdown_connections 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 --2- 10.20.193.51:0/3511656288 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f499413db50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 --2- 10.20.193.51:0/3511656288 >> v2:10.20.193.142:3300/0 conn(0x7f49940a3bb0 0x7f499409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 -- 10.20.193.51:0/3511656288 >> 10.20.193.51:0/3511656288 conn(0x7f49940a30c0 msgr2=0x7f49940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 -- 10.20.193.51:0/3511656288 shutdown_connections 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.016+0000 7f499a2a0640 1 -- 10.20.193.51:0/3511656288 wait complete. 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient: monmap: 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:25.029 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 Processor -- start 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 -- start start 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient: init 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49940a0750 0x7f49941cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f49940a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49940a3bb0 0x7f49941cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f49940a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f4994091cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): picked mon.noname-a con 0x7f499413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f49940a04b0 con 0x7f499413b760 2026-02-17T11:55:25.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f499409c850 con 0x7f49940a3bb0 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f499409e710 con 0x7f49940a0750 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.017+0000 7f499a2a0640 10 monclient(hunting): authenticate will time out at 1212.636977s 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49940a0750 0x7f49941cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f4994091cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f4994091cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56248/0 (socket says 10.20.193.51:56248) 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): get_auth_request con 0x7f49940a0750 auth_method 0 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 learned_addr learned my addr 10.20.193.51:0/808315373 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): get_auth_request con 0x7f499413b760 auth_method 0 2026-02-17T11:55:25.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient(hunting): handle_auth_done global_id 134145 payload 824 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49940a0750 msgr2=0x7f49941cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49940a0750 0x7f49941cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49940a3bb0 msgr2=0x7f49941cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f49937fe640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49940a3bb0 0x7f49941cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49940a3bb0 0x7f49941cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient: _finish_hunting 0 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 monclient: found mon.noname-a 2026-02-17T11:55:25.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4994093e10 con 0x7f499413b760 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f49937fe640 10 monclient: get_auth_request con 0x7f49940a3bb0 auth_method 0 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.018+0000 7f49937fe640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49940a3bb0 0x7f49941cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 msgr2=0x7f4994091cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4998816640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f4994091cd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4988039040 tx=0x7f4988004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988046020 con 0x7f499413b760 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: dump: 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4988041870 con 0x7f499413b760 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 5 monclient: authenticate success, global_id 134145 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 monclient: _renew_subs 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4994095c60 con 0x7f499413b760 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988041c60 con 0x7f499413b760 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f49927fc640 4 set_mon_vals no callback set 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f4990ff9640 10 monclient: dump: 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.034 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 monclient: _renew_subs 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49940a2b70 con 0x7f499413b760 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 0x7f49940638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.020+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f499409d7b0 con 0x7f4994095600 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f498804b410 con 0x7f499413b760 2026-02-17T11:55:25.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 0x7f49940638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient: get_auth_request con 0x7f4994095600 auth_method 0 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4990ff9640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f496403dd40 0x7f4964040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7f4988078310 con 0x7f499413b760 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f49937fe640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f496403dd40 0x7f4964040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f49937fe640 10 monclient: get_auth_request con 0x7f496403dd40 auth_method 0 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 10 monclient(hunting): handle_auth_done global_id 114259 payload 824 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.021+0000 7f4993fff640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f499409dac0 con 0x7f4994095600 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.023+0000 7f49937fe640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f496403dd40 0x7f4964040200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f49940947a0 tx=0x7f4984009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.023+0000 7f4993fff640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 msgr2=0x7f49940638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.023+0000 7f4993fff640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 0x7f49940638c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f4980009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980016070 con 0x7f4994095600 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 10 monclient: dump: 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f498000ea30 con 0x7f4994095600 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:25.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:25.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 msgr2=0x7f49940638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 0x7f49940638c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f4980009bd0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 msgr2=0x7f49940638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:25.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.024+0000 7f4990ff9640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994095600 0x7f49940638c0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f4980009bd0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f499a2a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:25.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f499a2a0640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 0x7f49941d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f499a2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49940959e0 con 0x7f4994063e00 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 0x7f49941d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient: get_auth_request con 0x7f4994063e00 auth_method 0 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 10 monclient(hunting): handle_auth_done global_id 114262 payload 824 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.027+0000 7f4993fff640 1 -- 10.20.193.51:0/808315373 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49940008d0 con 0x7f4994063e00 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4993fff640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 msgr2=0x7f49941d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4993fff640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 0x7f49941d8ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f49800048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980016040 con 0x7f4994063e00 2026-02-17T11:55:25.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 10 monclient: dump: 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f498001d270 con 0x7f4994063e00 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 msgr2=0x7f49941d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 0x7f49941d8ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f49800048d0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 msgr2=0x7f49941d8ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4990ff9640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4994063e00 0x7f49941d8ab0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4980009700 tx=0x7f49800048d0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 80, 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 126906, 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:55:25.042 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:25.043 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:25.045 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.046 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:25.047 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:25.050 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:25.051 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:25.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f496403dd40 msgr2=0x7f4964040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f496403dd40 0x7f4964040200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f49940947a0 tx=0x7f4984009040 comp rx=0 tx=0).stop 2026-02-17T11:55:25.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 10 monclient: shutdown 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 msgr2=0x7f4994091cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 --2- 10.20.193.51:0/808315373 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f499413b760 0x7f4994091cd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4988039040 tx=0x7f4988004b40 comp rx=0 tx=0).stop 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 reap_dead start 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f4998816640 1 -- 10.20.193.51:0/808315373 reap_dead start 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 shutdown_connections 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 >> 10.20.193.51:0/808315373 conn(0x7f49940a30c0 msgr2=0x7f499413ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 shutdown_connections 2026-02-17T11:55:25.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.030+0000 7f499a2a0640 1 -- 10.20.193.51:0/808315373 wait complete. 2026-02-17T11:55:25.053 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:55:25.053 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:55:25.053 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:55:25.053 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:55:25.053 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:55:25.054 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:55:25.054 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:25.063 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:55:25.063 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:55:25.063 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 10 monclient: get_monmap_and_config 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 10 monclient: build_initial_monmap 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 10 monclient: monmap: 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:25.171454+0000 2026-02-17T11:55:25.172 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:25.171454+0000 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:25.173 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 1 Processor -- start 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 1 -- start start 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.170+0000 7fe7bff87640 10 monclient: init 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe7b8138190 0x7fe7b8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b8138190 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8138570 0x7fe7b80a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b8138570 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe7b80a2d90 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:25.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b80a03e0 con 0x7fe7b80a2d90 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b806fdc0 con 0x7fe7b8138190 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b80700a0 con 0x7fe7b8138570 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bff87640 10 monclient(hunting): authenticate will time out at 1212.790270s 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bd4fb640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8138570 msgr2=0x7fe7b80a2850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bd4fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8138570 0x7fe7b80a2850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7be4fd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe7b80a2d90 0x7fe7b813efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36920/0 (socket says 10.20.193.51:36920) 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7be4fd640 1 -- 10.20.193.51:0/1775351580 learned_addr learned my addr 10.20.193.51:0/1775351580 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:25.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/1775351580 >> v2:10.20.193.142:3300/0 conn(0x7fe7b8138190 0x7fe7b8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): get_auth_request con 0x7fe7b8138190 auth_method 0 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_done global_id 114265 payload 274 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8138570 msgr2=0x7fe7b80a2850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8138570 0x7fe7b80a2850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 >> v1:10.20.193.51:6789/0 conn(0x7fe7b80a2d90 legacy=0x7fe7b813efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 monclient: found mon.noname-c 2026-02-17T11:55:25.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.171+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b8137c70 con 0x7fe7b8138190 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 0x7fe7b8070bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80098a0 tx=0x7fe7a802ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eade6679b2d9c40 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 0x7fe7b8070bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80098a0 tx=0x7fe7a802ee30 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 0x7fe7b8070bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80098a0 tx=0x7fe7a802ee30 comp rx=0 tx=0).stop 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient: ms_handle_reset current mon [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b8070bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 0x7fe7b8070bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient: _add_conns ranks=[1,3] 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7a0003600 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 1 --2- 10.20.193.51:0/1775351580 >> v2:10.20.193.51:3300/0 conn(0x7fe7a0007590 0x7fe7a0009a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient(hunting): picked mon.noname-a con 0x7fe7a0007590 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a000a320 con 0x7fe7a0003600 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a000b520 con 0x7fe7a0007590 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bccfa640 10 monclient(hunting): ms_handle_reset stray mon [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/1775351580 >> v2:10.20.193.51:3300/0 conn(0x7fe7a0007590 0x7fe7a0009a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): get_auth_request con 0x7fe7a0007590 auth_method 0 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient(hunting): handle_auth_done global_id 114265 payload 293 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 1 -- 10.20.193.51:0/1775351580 >> v1:10.20.193.142:6789/0 conn(0x7fe7a0003600 legacy=0x7fe7a0005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient: _finish_hunting 0 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 1 monclient: found mon.noname-a 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.174+0000 7fe7bd4fb640 1 -- 10.20.193.51:0/1775351580 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a000b790 con 0x7fe7a0007590 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bd4fb640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7a0007590 msgr2=0x7fe7a0009a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7a0007590 0x7fe7a0009a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac003a80 tx=0x7fe7a8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9024eaba0ecb672a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac009a30 con 0x7fe7a0007590 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:25.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: dump: 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: _finish_auth 0 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:25.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac003cb0 con 0x7fe7a0007590 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bff87640 5 monclient: authenticate success, global_id 114265 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bff87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 1 -- 10.20.193.51:0/1775351580 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac003e60 con 0x7fe7a0007590 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bff87640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bff87640 4 set_mon_vals no callback set 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.176+0000 7fe7bccfa640 10 monclient: dump: 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.191 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 10 monclient: shutdown 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 -- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7a0007590 msgr2=0x7fe7a0009a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7a0007590 0x7fe7a0009a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac003a80 tx=0x7fe7a8009290 comp rx=0 tx=0).stop 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7be4fd640 1 -- 10.20.193.51:0/1775351580 reap_dead start 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 -- 10.20.193.51:0/1775351580 shutdown_connections 2026-02-17T11:55:25.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7a0007590 0x7fe7a0009a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 --2- 10.20.193.51:0/1775351580 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7b8138190 0x7fe7b8070bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 -- 10.20.193.51:0/1775351580 >> 10.20.193.51:0/1775351580 conn(0x7fe7b80a3940 msgr2=0x7fe7b80a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 -- 10.20.193.51:0/1775351580 shutdown_connections 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 1 -- 10.20.193.51:0/1775351580 wait complete. 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 10 monclient: build_initial_monmap 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.177+0000 7fe7bff87640 10 monclient: monmap: 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:25.193 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 Processor -- start 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 -- start start 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient: init 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b8138190 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 0x7fe7b8131800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-b con 0x7fe7a0007590 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 0x7fe7b8133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b8131d40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:25.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b8138ad0 con 0x7fe7b8138190 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b8138950 con 0x7fe7a0007590 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b80a3220 con 0x7fe7b8131d40 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bff87640 10 monclient(hunting): authenticate will time out at 1212.797429s 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7be4fd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 msgr2=0x7fe7b8133790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7be4fd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 0x7fe7b8133790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43340/0 (socket says 10.20.193.51:43340) 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/2322996146 learned_addr learned my addr 10.20.193.51:0/2322996146 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): get_auth_request con 0x7fe7b8138190 auth_method 0 2026-02-17T11:55:25.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient(hunting): handle_auth_done global_id 134148 payload 824 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 msgr2=0x7fe7b8133790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 0x7fe7b8133790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 msgr2=0x7fe7b8131800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 0x7fe7b8131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 0x7fe7b8131800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 monclient: found mon.noname-a 2026-02-17T11:55:25.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/2322996146 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b811eee0 con 0x7fe7b8138190 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bd4fb640 10 monclient: get_auth_request con 0x7fe7a0007590 auth_method 0 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.178+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 0x7fe7b8131800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bdcfc640 1 -- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b81cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099a0 tx=0x7fe7a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8046020 con 0x7fe7b8138190 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: dump: 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a8037440 con 0x7fe7b8138190 2026-02-17T11:55:25.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a803c070 con 0x7fe7b8138190 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a7fff640 4 set_mon_vals no callback set 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7a67fc640 10 monclient: dump: 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:25.199 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 5 monclient: authenticate success, global_id 134148 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 10 monclient: _renew_subs 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b811da30 con 0x7fe7b8138190 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 10 monclient: _renew_subs 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.180+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b81cf5e0 con 0x7fe7b8138190 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bff87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bff87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bff87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b81c21d0 con 0x7fe7b8138190 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bdcfc640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099a0 tx=0x7fe7a80047c0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fe7a80377f0 mgrmap(e 5) 2026-02-17T11:55:25.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe7a80377f0 con 0x7fe7b8138190 2026-02-17T11:55:25.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7a67fc640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 0x7fe7880401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:25.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 0x7fe7880401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:25.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.181+0000 7fe7bd4fb640 10 monclient: get_auth_request con 0x7fe78803dcf0 auth_method 0 2026-02-17T11:55:25.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.184+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7fe7a8078640 con 0x7fe7b8138190 2026-02-17T11:55:25.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:25.184+0000 7fe7bd4fb640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 0x7fe7880401b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac002410 tx=0x7fe7ac005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:26.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.009+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe7b81c21d0 con 0x7fe7b8138190 2026-02-17T11:55:26.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.009+0000 7fe7a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:26.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.009+0000 7fe7a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7bff87640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7bff87640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7bff87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe7b8070bf0 con 0x7fe7b8138190 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7a67fc640 1 -- 10.20.193.51:0/2322996146 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe7a8050020 con 0x7fe7b8138190 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7a67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.123+0000 7fe7a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:26.127 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 msgr2=0x7fe7880401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 0x7fe7880401b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac002410 tx=0x7fe7ac005000 comp rx=0 tx=0).stop 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 10 monclient: shutdown 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 msgr2=0x7fe7b81cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099a0 tx=0x7fe7a80047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 shutdown_connections 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe78803dcf0 0x7fe7880401b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe7b8131d40 0x7fe7b8133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe7a0007590 0x7fe7b8131800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 --2- 10.20.193.51:0/2322996146 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe7b8138190 0x7fe7b81cf0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 >> 10.20.193.51:0/2322996146 conn(0x7fe7b80a3940 msgr2=0x7fe7b81c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 shutdown_connections 2026-02-17T11:55:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:26.124+0000 7fe7bff87640 1 -- 10.20.193.51:0/2322996146 wait complete. 2026-02-17T11:55:29.136 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:29.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.204+0000 7f40c3ce8640 10 monclient: get_monmap_and_config 2026-02-17T11:55:29.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.204+0000 7f40c3ce8640 10 monclient: build_initial_monmap 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.204+0000 7f40c3ce8640 10 monclient: monmap: 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:29.205810+0000 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:29.205810+0000 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:29.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 Processor -- start 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 -- start start 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient: init 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 0x7f40bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-b con 0x7f40bc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f40bc0a0750 0x7f40bc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-c con 0x7f40bc0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40bc09e540 0x7f40bc13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-a con 0x7f40bc09e540 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f40bc0a3f90 con 0x7f40bc09e540 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f40bc06e140 con 0x7f40bc0a0750 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc09f910 con 0x7f40bc0a3bb0 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:29.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c3ce8640 10 monclient(hunting): authenticate will time out at 1216.824569s 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c1a5d640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 msgr2=0x7f40bc09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c1a5d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 0x7f40bc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40bc09e540 0x7f40bc13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40bc09e540 0x7f40bc13c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43354/0 (socket says 10.20.193.51:43354) 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 -- 10.20.193.51:0/1533211489 learned_addr learned my addr 10.20.193.51:0/1533211489 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): get_auth_request con 0x7f40bc09e540 auth_method 0 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:29.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c125c640 1 --2- 10.20.193.51:0/1533211489 >> v2:10.20.193.142:3300/0 conn(0x7f40bc0a0750 0x7f40bc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient(hunting): handle_auth_done global_id 134151 payload 274 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 -- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 msgr2=0x7f40bc09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 --2- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 0x7f40bc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 -- 10.20.193.51:0/1533211489 >> v2:10.20.193.142:3300/0 conn(0x7f40bc0a0750 msgr2=0x7f40bc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 --2- 10.20.193.51:0/1533211489 >> v2:10.20.193.142:3300/0 conn(0x7f40bc0a0750 0x7f40bc09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient: _finish_hunting 0 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 monclient: found mon.noname-a 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.205+0000 7f40c225e640 1 -- 10.20.193.51:0/1533211489 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc09ccd0 con 0x7f40bc09e540 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c225e640 1 -- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 msgr2=0x7f40bc13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c225e640 1 --2- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40bc069d60 tx=0x7f40b802f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9161f55a26e05aaf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 1 -- 10.20.193.51:0/1533211489 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80373f0 con 0x7f40bc09e540 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: dump: 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:29.222 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: _finish_auth 0 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: _check_auth_tickets 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:29.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 5 monclient: authenticate success, global_id 134151 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 1 -- 10.20.193.51:0/1533211489 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8037590 con 0x7f40bc09e540 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 1 -- 10.20.193.51:0/1533211489 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8037960 con 0x7f40bc09e540 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c0a5b640 10 monclient: dump: 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.224 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 4 set_mon_vals no callback set 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 10 monclient: shutdown 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 msgr2=0x7f40bc13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40bc069d60 tx=0x7f40b802f200 comp rx=0 tx=0).stop 2026-02-17T11:55:29.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1533211489 shutdown_connections 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1533211489 >> v2:10.20.193.142:3300/0 conn(0x7f40bc0a0750 0x7f40bc09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1533211489 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a3bb0 0x7f40bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1533211489 >> 10.20.193.51:0/1533211489 conn(0x7f40bc0a30c0 msgr2=0x7f40bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1533211489 shutdown_connections 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.208+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1533211489 wait complete. 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient: build_initial_monmap 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient: monmap: 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:29.226 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 Processor -- start 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 -- start start 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient: init 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:29.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-a con 0x7f40bc09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 0x7f40bc08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-c con 0x7f40bc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 0x7f40bc08d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): picked mon.noname-b con 0x7f40bc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc09c850 con 0x7f40bc09e540 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc0a04b0 con 0x7f40bc0a3bb0 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc13cca0 con 0x7f40bc0a0750 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c3ce8640 10 monclient(hunting): authenticate will time out at 1216.828792s 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c125c640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 msgr2=0x7f40bc08d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c125c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 0x7f40bc08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43368/0 (socket says 10.20.193.51:43368) 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 1 -- 10.20.193.51:0/1776641364 learned_addr learned my addr 10.20.193.51:0/1776641364 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): get_auth_request con 0x7f40bc09e540 auth_method 0 2026-02-17T11:55:29.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c1a5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c225e640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 0x7f40bc08d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c225e640 10 monclient(hunting): get_auth_request con 0x7f40bc0a3bb0 auth_method 0 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c225e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c225e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.209+0000 7f40c225e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:29.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 10 monclient(hunting): handle_auth_done global_id 134154 payload 824 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 -- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 msgr2=0x7f40bc08d3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 0x7f40bc08d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 -- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 msgr2=0x7f40bc08d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 0x7f40bc08d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 10 monclient: _finish_hunting 0 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 monclient: found mon.noname-a 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c1a5d640 1 -- 10.20.193.51:0/1776641364 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc08fd20 con 0x7f40bc09e540 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.210+0000 7f40c225e640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 0x7f40bc08d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:55:29.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c1a5d640 1 -- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 msgr2=0x7f40bc13c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c1a5d640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00b780 tx=0x7f40ac00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac005270 con 0x7f40bc09e540 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: dump: 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.232 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ac010070 con 0x7f40bc09e540 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac005650 con 0x7f40bc09e540 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:29.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40aa7fc640 10 monclient: dump: 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40abfff640 4 set_mon_vals no callback set 2026-02-17T11:55:29.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 5 monclient: authenticate success, global_id 134154 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 10 monclient: _renew_subs 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc06f410 con 0x7f40bc09e540 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 10 monclient: _renew_subs 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.212+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc08ffc0 con 0x7f40bc09e540 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c3ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c3ce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c3ce8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc09dac0 con 0x7f40bc09e540 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f40ac01d070 con 0x7f40bc09e540 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40aa7fc640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 0x7f408c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:29.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7f40ac052000 con 0x7f40bc09e540 2026-02-17T11:55:29.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c125c640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 0x7f408c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:29.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.213+0000 7f40c125c640 10 monclient: get_auth_request con 0x7f408c03dd10 auth_method 0 2026-02-17T11:55:29.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.215+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f40ac01a060 con 0x7f40bc09e540 2026-02-17T11:55:29.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.215+0000 7f40aa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:29.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.215+0000 7f40aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:29.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.216+0000 7f40c125c640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 0x7f408c0401d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40bc06a3e0 tx=0x7f40b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40c3ce8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40c3ce8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40c3ce8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f40bc06f8e0 con 0x7f40bc09e540 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40aa7fc640 1 -- 10.20.193.51:0/1776641364 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f40ac014e20 con 0x7f40bc09e540 2026-02-17T11:55:29.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40aa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:29.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.330+0000 7f40aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:29.334 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 msgr2=0x7f408c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 0x7f408c0401d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40bc06a3e0 tx=0x7f40b0008040 comp rx=0 tx=0).stop 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 10 monclient: shutdown 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 msgr2=0x7f40bc13c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00b780 tx=0x7f40ac00bc50 comp rx=0 tx=0).stop 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 shutdown_connections 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f408c03dd10 0x7f408c0401d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40bc0a3bb0 0x7f40bc08d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40bc0a0750 0x7f40bc08d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 --2- 10.20.193.51:0/1776641364 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40bc09e540 0x7f40bc13c3d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 >> 10.20.193.51:0/1776641364 conn(0x7f40bc0a30c0 msgr2=0x7f40bc072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:29.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 shutdown_connections 2026-02-17T11:55:29.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:29.332+0000 7f40c3ce8640 1 -- 10.20.193.51:0/1776641364 wait complete. 2026-02-17T11:55:32.343 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:32.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.412+0000 7fcaf5496640 10 monclient: get_monmap_and_config 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.412+0000 7fcaf5496640 10 monclient: build_initial_monmap 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.412+0000 7fcaf5496640 10 monclient: monmap: 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:32.413742+0000 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:32.413742+0000 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:32.415 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:32.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:32.416 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:32.416 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:32.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 Processor -- start 2026-02-17T11:55:32.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 -- start start 2026-02-17T11:55:32.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient: init 2026-02-17T11:55:32.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:32.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcaf00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcaf00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fcaf013c770 0x7fcaf013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf013c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf009e8e0 con 0x7fcaf00a0750 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf006e140 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf009f910 con 0x7fcaf013c770 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaf5496640 10 monclient(hunting): authenticate will time out at 1220.032582s 2026-02-17T11:55:32.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaee7fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fcaf00a0750 0x7fcaf009e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36924/0 (socket says 10.20.193.51:36924) 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaee7fc640 1 -- 10.20.193.51:0/629009086 learned_addr learned my addr 10.20.193.51:0/629009086 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 1 --2- 10.20.193.51:0/629009086 >> v2:10.20.193.142:3300/0 conn(0x7fcaf013c770 0x7fcaf013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): get_auth_request con 0x7fcaf013c770 auth_method 0 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.413+0000 7fcaef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 10 monclient(hunting): handle_auth_done global_id 114271 payload 274 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 1 -- 10.20.193.51:0/629009086 >> v1:10.20.193.142:6789/0 conn(0x7fcaf00a3bb0 legacy=0x7fcaf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 1 -- 10.20.193.51:0/629009086 >> v1:10.20.193.51:6789/0 conn(0x7fcaf00a0750 legacy=0x7fcaf009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:32.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 1 monclient: found mon.noname-c 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.414+0000 7fcaef7fe640 1 -- 10.20.193.51:0/629009086 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf009ccd0 con 0x7fcaf013c770 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaef7fe640 1 -- 10.20.193.51:0/629009086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf013c770 msgr2=0x7fcaf013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaef7fe640 1 --2- 10.20.193.51:0/629009086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf013c770 0x7fcaf013eb60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a218b8e801c6de86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 1 -- 10.20.193.51:0/629009086 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae003c070 con 0x7fcaf013c770 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: dump: 2026-02-17T11:55:32.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:32.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaf5496640 5 monclient: authenticate success, global_id 114271 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaf5496640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 1 -- 10.20.193.51:0/629009086 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0037640 con 0x7fcaf013c770 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 1 -- 10.20.193.51:0/629009086 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0037a10 con 0x7fcaf013c770 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaf5496640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaf5496640 4 set_mon_vals no callback set 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.416+0000 7fcaedffb640 10 monclient: dump: 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:32.429 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 10 monclient: shutdown 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- 10.20.193.51:0/629009086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf013c770 msgr2=0x7fcaf013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 --2- 10.20.193.51:0/629009086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf013c770 0x7fcaf013eb60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002f190 comp rx=0 tx=0).stop 2026-02-17T11:55:32.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- 10.20.193.51:0/629009086 shutdown_connections 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 --2- 10.20.193.51:0/629009086 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf013c770 0x7fcaf013eb60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- 10.20.193.51:0/629009086 >> 10.20.193.51:0/629009086 conn(0x7fcaf00a30c0 msgr2=0x7fcaf00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- 10.20.193.51:0/629009086 shutdown_connections 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- 10.20.193.51:0/629009086 wait complete. 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 10 monclient: build_initial_monmap 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 10 monclient: monmap: 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:32.431 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 Processor -- start 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 1 -- start start 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.417+0000 7fcaf5496640 10 monclient: init 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf00a0750 0x7fcaf00998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:32.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-a con 0x7fcaf00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 0x7fcaf0090420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf013c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf009c850 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf009ebe0 con 0x7fcaf00a0750 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf00a04b0 con 0x7fcaf013c770 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaf5496640 10 monclient(hunting): authenticate will time out at 1220.037113s 2026-02-17T11:55:32.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaef7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 msgr2=0x7fcaf0090420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaef7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 0x7fcaf0090420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:43370/0 (socket says 10.20.193.51:43370) 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 -- 10.20.193.51:0/1148002128 learned_addr learned my addr 10.20.193.51:0/1148002128 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): get_auth_request con 0x7fcaf00a3bb0 auth_method 0 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:32.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaeeffd640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf00a0750 0x7fcaf00998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaeeffd640 10 monclient(hunting): get_auth_request con 0x7fcaf00a0750 auth_method 0 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient(hunting): handle_auth_done global_id 134157 payload 824 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 -- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 msgr2=0x7fcaf0090420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 0x7fcaf0090420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 -- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf00a0750 msgr2=0x7fcaf00998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf00a0750 0x7fcaf00998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 monclient: found mon.noname-a 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:32.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.418+0000 7fcaee7fc640 1 -- 10.20.193.51:0/1148002128 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf0094050 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaee7fc640 1 -- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 msgr2=0x7fcaf0099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaee7fc640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcad800b530 tx=0x7fcad800ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad800fa60 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: dump: 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad800fc00 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8017400 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaed7fa640 4 set_mon_vals no callback set 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcacf7fe640 10 monclient: dump: 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:32.438 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 5 monclient: authenticate success, global_id 134157 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 10 monclient: _renew_subs 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf0094330 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 10 monclient: _renew_subs 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.420+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf0093d70 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaf5496640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaf5496640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaf5496640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcad800d3e0 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf009dac0 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcacf7fe640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 0x7fcabc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:32.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7fcad80527f0 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaeeffd640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 0x7fcabc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:32.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.421+0000 7fcaeeffd640 10 monclient: get_auth_request con 0x7fcabc03dcc0 auth_method 0 2026-02-17T11:55:32.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.423+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcad8013030 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.423+0000 7fcacf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:32.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.423+0000 7fcacf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:32.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.424+0000 7fcaeeffd640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 0x7fcabc040180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcae4005020 tx=0x7fcae4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:32.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcaf5496640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:32.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcaf5496640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:32.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcaf5496640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:32.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcaf009d7b0 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcacf7fe640 1 -- 10.20.193.51:0/1148002128 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fcad80511a0 con 0x7fcaf00a3bb0 2026-02-17T11:55:32.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcacf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:32.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.537+0000 7fcacf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:32.540 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 msgr2=0x7fcabc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 0x7fcabc040180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcae4005020 tx=0x7fcae4009040 comp rx=0 tx=0).stop 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 10 monclient: shutdown 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 msgr2=0x7fcaf0099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcad800b530 tx=0x7fcad800ba00 comp rx=0 tx=0).stop 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 shutdown_connections 2026-02-17T11:55:32.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcabc03dcc0 0x7fcabc040180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcaf013c770 0x7fcaf0090420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcaf00a3bb0 0x7fcaf0099de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 --2- 10.20.193.51:0/1148002128 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcaf00a0750 0x7fcaf00998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 >> 10.20.193.51:0/1148002128 conn(0x7fcaf00a30c0 msgr2=0x7fcaf00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 shutdown_connections 2026-02-17T11:55:32.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:32.538+0000 7fcaf5496640 1 -- 10.20.193.51:0/1148002128 wait complete. 2026-02-17T11:55:35.548 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.616+0000 7f02ac56a640 10 monclient: get_monmap_and_config 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.616+0000 7f02ac56a640 10 monclient: build_initial_monmap 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.616+0000 7f02ac56a640 10 monclient: monmap: 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:35.617571+0000 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:35.617571+0000 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:35.618 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:35.619 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:35.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 Processor -- start 2026-02-17T11:55:35.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 -- start start 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient: init 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-c con 0x7f02a40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f02a40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f02a413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a406e140 con 0x7f02a413b760 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a409f910 con 0x7f02a40a0750 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:35.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f02a409ccd0 con 0x7f02a40a3bb0 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02ac56a640 10 monclient(hunting): authenticate will time out at 1223.236408s 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aaae0640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f02a413b760 0x7f02a413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:50592/0 (socket says 10.20.193.51:50592) 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aaae0640 1 -- 10.20.193.51:0/3735310483 learned_addr learned my addr 10.20.193.51:0/3735310483 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 10 monclient(hunting): get_auth_request con 0x7f02a40a3bb0 auth_method 0 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:35.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:35.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:35.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.617+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:35.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.619+0000 7f02aaae0640 1 -- 10.20.193.51:0/3735310483 >> v1:10.20.193.51:6789/0 conn(0x7f02a413b760 legacy=0x7f02a413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:35.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.619+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v1:10.20.193.142:6789/0 conn(0x7f02a40a0750 legacy=0x7f02a409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 10 monclient(hunting): get_auth_request con 0x7f02a40a3bb0 auth_method 0 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:35.818+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 10 monclient(hunting): get_auth_request con 0x7f02a40a3bb0 auth_method 0 2026-02-17T11:55:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:36.219+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:37.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:37.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 10 monclient(hunting): get_auth_request con 0x7f02a40a3bb0 auth_method 0 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:37.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:37.020+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): tick 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 monclient(hunting): continuing hunt 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 msgr2=0x7f02a409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.142:3300/0 conn(0x7f02a40a3bb0 0x7f02a409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 -- 10.20.193.51:0/3735310483 >> v1:10.20.193.142:6789/0 conn(0x7f02a40a0750 legacy=0x7f02a409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 -- 10.20.193.51:0/3735310483 >> v1:10.20.193.51:6789/0 conn(0x7f02a413b760 legacy=0x7f02a413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient: _add_conns ranks=[2,3] 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f0284003910 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f0284006450 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 -- 10.20.193.51:0/3735310483 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f02a409ccd0 con 0x7f0284006450 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 1 -- 10.20.193.51:0/3735310483 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0284008fd0 con 0x7f0284003910 2026-02-17T11:55:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f028bfff640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 msgr2=0x7f0284005d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 10 monclient(hunting): get_auth_request con 0x7f0284006450 auth_method 0 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.617+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:38.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 msgr2=0x7f0284005d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:38.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:38.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:38.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 10 monclient(hunting): get_auth_request con 0x7f0284006450 auth_method 0 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:38.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:38.818+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:55:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 msgr2=0x7f0284005d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 10 monclient(hunting): get_auth_request con 0x7f0284006450 auth_method 0 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 msgr2=0x7f0284008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:39.219+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02aa2df640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 msgr2=0x7f0284005d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02aa2df640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> v2:10.20.193.51:3300/0 conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): get_auth_request con 0x7f0284006450 auth_method 0 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient(hunting): handle_auth_done global_id 134160 payload 274 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 msgr2=0x7f0284005d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284003910 0x7f0284005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 1 monclient: found mon.noname-a 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.020+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a409eec0 con 0x7f0284006450 2026-02-17T11:55:40.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a9ade640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 msgr2=0x7f0284008910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 0x7f0284008910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0298007bf0 tx=0x7f029802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e082c13dced676d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 1 -- 10.20.193.51:0/3735310483 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029803b070 con 0x7f0284006450 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a9ade640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 0x7f0284008910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0298007bf0 tx=0x7f029802f710 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f0298005b90 config(0 keys) 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: dump: 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 5 monclient: authenticate success, global_id 134160 2026-02-17T11:55:40.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 1 -- 10.20.193.51:0/3735310483 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0298005b90 con 0x7f0284006450 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 4 set_mon_vals no callback set 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 10 monclient: shutdown 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 -- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 msgr2=0x7f0284008910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 0x7f0284008910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0298007bf0 tx=0x7f029802f710 comp rx=0 tx=0).stop 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02aaae0640 1 -- 10.20.193.51:0/3735310483 reap_dead start 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 1 -- 10.20.193.51:0/3735310483 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7f02980070d0 con 0x7f0284006450 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02a92dd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T11:55:40.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 -- 10.20.193.51:0/3735310483 shutdown_connections 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 --2- 10.20.193.51:0/3735310483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0284006450 0x7f0284008910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 -- 10.20.193.51:0/3735310483 >> 10.20.193.51:0/3735310483 conn(0x7f02a40a30c0 msgr2=0x7f02a40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 -- 10.20.193.51:0/3735310483 shutdown_connections 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.023+0000 7f02ac56a640 1 -- 10.20.193.51:0/3735310483 wait complete. 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.024+0000 7f02ac56a640 10 monclient: build_initial_monmap 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.024+0000 7f02ac56a640 10 monclient: monmap: 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:40.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.024+0000 7f02ac56a640 1 Processor -- start 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.024+0000 7f02ac56a640 1 -- start start 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.024+0000 7f02ac56a640 10 monclient: init 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 0x7f02a41cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-c con 0x7f0284006450 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02a41d0010 0x7f02a409a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-b con 0x7f02a41d0010 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): picked mon.noname-a con 0x7f02a41d0450 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40a04b0 con 0x7f02a41d0450 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f02a409c850 con 0x7f02a41d0010 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f02a409e710 con 0x7f0284006450 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02ac56a640 10 monclient(hunting): authenticate will time out at 1227.644067s 2026-02-17T11:55:40.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aa2df640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 msgr2=0x7f02a41cfad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aa2df640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 0x7f02a41cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36942/0 (socket says 10.20.193.51:36942) 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 -- 10.20.193.51:0/1538592425 learned_addr learned my addr 10.20.193.51:0/1538592425 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): get_auth_request con 0x7f02a41d0450 auth_method 0 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02a9ade640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02a41d0010 0x7f02a409a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02a9ade640 10 monclient(hunting): get_auth_request con 0x7f02a41d0010 auth_method 0 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02a9ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02a9ade640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02a9ade640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient(hunting): handle_auth_done global_id 134163 payload 824 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 -- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 msgr2=0x7f02a41cfad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 0x7f02a41cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 -- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02a41d0010 msgr2=0x7f02a409a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02a41d0010 0x7f02a409a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 monclient: found mon.noname-a 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.025+0000 7f02aaae0640 1 -- 10.20.193.51:0/1538592425 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a4133af0 con 0x7f02a41d0450 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02aaae0640 1 -- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 msgr2=0x7f02a409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02aaae0640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02a406dab0 tx=0x7f02a000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0017070 con 0x7f02a41d0450 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:40.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: dump: 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a000ac60 con 0x7f02a41d0450 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 5 monclient: authenticate success, global_id 134163 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 10 monclient: _renew_subs 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a409d7b0 con 0x7f02a41d0450 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0012400 con 0x7f02a41d0450 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f028affd640 10 monclient: dump: 2026-02-17T11:55:40.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02a8adc640 4 set_mon_vals no callback set 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 10 monclient: _renew_subs 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.027+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a4133530 con 0x7f02a41d0450 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02ac56a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02ac56a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02ac56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f02a001b3b0 con 0x7f02a41d0450 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a409dac0 con 0x7f02a41d0450 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f028affd640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 0x7f0274040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7f02a0052190 con 0x7f02a41d0450 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02aa2df640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 0x7f0274040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.028+0000 7f02aa2df640 10 monclient: get_auth_request con 0x7f027403dcc0 auth_method 0 2026-02-17T11:55:40.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.031+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f02a0050b40 con 0x7f02a41d0450 2026-02-17T11:55:40.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.031+0000 7f028affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.031+0000 7f028affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:40.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.031+0000 7f02aa2df640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 0x7f0274040180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0294006fb0 tx=0x7f0294008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.146+0000 7f02ac56a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:55:40.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.146+0000 7f02ac56a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.146+0000 7f02ac56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.146+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f02a4133d30 con 0x7f02a41d0450 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.147+0000 7f028affd640 1 -- 10.20.193.51:0/1538592425 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f02a0011360 con 0x7f02a41d0450 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.147+0000 7f028affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.147+0000 7f028affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:40.149 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":84,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 msgr2=0x7f0274040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 0x7f0274040180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0294006fb0 tx=0x7f0294008040 comp rx=0 tx=0).stop 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 10 monclient: shutdown 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 msgr2=0x7f02a409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02a406dab0 tx=0x7f02a000cd70 comp rx=0 tx=0).stop 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 shutdown_connections 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f027403dcc0 0x7f0274040180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f02a41d0450 0x7f02a409ab30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f02a41d0010 0x7f02a409a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 --2- 10.20.193.51:0/1538592425 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0284006450 0x7f02a41cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 >> 10.20.193.51:0/1538592425 conn(0x7f02a40a30c0 msgr2=0x7f02a413ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 shutdown_connections 2026-02-17T11:55:40.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.149+0000 7f02ac56a640 1 -- 10.20.193.51:0/1538592425 wait complete. 2026-02-17T11:55:40.159 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:55:40.159 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:55:40.160 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 10 monclient: get_monmap_and_config 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 10 monclient: build_initial_monmap 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 10 monclient: monmap: 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:40.226374+0000 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:40.226374+0000 2026-02-17T11:55:40.229 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 1 Processor -- start 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 1 -- start start 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.225+0000 7fbeddc7c640 10 monclient: init 2026-02-17T11:55:40.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbed80a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 0x7fbed809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-b con 0x7fbed80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbed813b760 0x7fbed813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-c con 0x7fbed813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed806e140 con 0x7fbed80a3bb0 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbed809f910 con 0x7fbed813b760 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbed809ccd0 con 0x7fbed80a0750 2026-02-17T11:55:40.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbeddc7c640 10 monclient(hunting): authenticate will time out at 1227.845134s 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed6ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 msgr2=0x7fbed809e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 0x7fbed809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbed813b760 0x7fbed813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed77fe640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fbed80a3bb0 0x7fbed809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:50206/0 (socket says 10.20.193.51:50206) 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed77fe640 1 -- 10.20.193.51:0/2998328455 learned_addr learned my addr 10.20.193.51:0/2998328455 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): get_auth_request con 0x7fbed813b760 auth_method 0 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.226+0000 7fbed7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed77fe640 1 -- 10.20.193.51:0/2998328455 >> v1:10.20.193.142:6789/0 conn(0x7fbed80a3bb0 legacy=0x7fbed809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 10 monclient(hunting): handle_auth_done global_id 114280 payload 274 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 1 -- 10.20.193.51:0/2998328455 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 msgr2=0x7fbed809e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 1 --2- 10.20.193.51:0/2998328455 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 0x7fbed809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 1 -- 10.20.193.51:0/2998328455 >> v1:10.20.193.142:6789/0 conn(0x7fbed80a3bb0 legacy=0x7fbed809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.228+0000 7fbed7fff640 1 -- 10.20.193.51:0/2998328455 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed809eec0 con 0x7fbed813b760 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed7fff640 1 -- 10.20.193.51:0/2998328455 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 msgr2=0x7fbed813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed7fff640 1 --2- 10.20.193.51:0/2998328455 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed813db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e10 tx=0x7fbecc02f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb7746c8d9e8f57 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 1 -- 10.20.193.51:0/2998328455 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc03c070 con 0x7fbed813b760 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: dump: 2026-02-17T11:55:40.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 5 monclient: authenticate success, global_id 114280 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 1 -- 10.20.193.51:0/2998328455 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc037640 con 0x7fbed813b760 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 1 -- 10.20.193.51:0/2998328455 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc037a10 con 0x7fbed813b760 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbed67fc640 10 monclient: dump: 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 4 set_mon_vals no callback set 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 10 monclient: shutdown 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 1 -- 10.20.193.51:0/2998328455 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 msgr2=0x7fbed813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.231+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/2998328455 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed813db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e10 tx=0x7fbecc02f200 comp rx=0 tx=0).stop 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- 10.20.193.51:0/2998328455 shutdown_connections 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/2998328455 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed813db50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/2998328455 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a0750 0x7fbed809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- 10.20.193.51:0/2998328455 >> 10.20.193.51:0/2998328455 conn(0x7fbed80a30c0 msgr2=0x7fbed80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- 10.20.193.51:0/2998328455 shutdown_connections 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- 10.20.193.51:0/2998328455 wait complete. 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient: build_initial_monmap 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient: monmap: 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:40.247 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 Processor -- start 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- start start 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient: init 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:40.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 0x7fbed8094e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-a con 0x7fbed80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a3bb0 0x7fbed80953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-c con 0x7fbed80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed80958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): picked mon.noname-b con 0x7fbed813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80a04b0 con 0x7fbed80a0750 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbed809c850 con 0x7fbed813b760 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbed809e710 con 0x7fbed80a3bb0 2026-02-17T11:55:40.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbeddc7c640 10 monclient(hunting): authenticate will time out at 1227.851978s 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbed6ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a3bb0 msgr2=0x7fbed80953a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.232+0000 7fbed6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a3bb0 0x7fbed80953a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 0x7fbed8094e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 0x7fbed8094e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36948/0 (socket says 10.20.193.51:36948) 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 -- 10.20.193.51:0/4241608008 learned_addr learned my addr 10.20.193.51:0/4241608008 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): get_auth_request con 0x7fbed80a0750 auth_method 0 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed7fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed80958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed7fff640 10 monclient(hunting): get_auth_request con 0x7fbed813b760 auth_method 0 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient(hunting): handle_auth_done global_id 134166 payload 824 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a3bb0 msgr2=0x7fbed80953a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbed80a3bb0 0x7fbed80953a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 msgr2=0x7fbed80958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbed813b760 0x7fbed80958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 monclient: found mon.noname-a 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.233+0000 7fbed77fe640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed8096f10 con 0x7fbed80a0750 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbed77fe640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 msgr2=0x7fbed8094e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbed77fe640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 0x7fbed8094e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c730 tx=0x7fbec400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4017070 con 0x7fbed80a0750 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: dump: 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4005e00 con 0x7fbed80a0750 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40072b0 con 0x7fbed80a0750 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 5 monclient: authenticate success, global_id 134166 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbed5ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 10 monclient: _renew_subs 2026-02-17T11:55:40.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed8098a80 con 0x7fbed80a0750 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeb3fff640 10 monclient: dump: 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 10 monclient: _renew_subs 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.235+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed809b940 con 0x7fbed80a0750 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeddc7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 0x7fbed8095e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80988a0 con 0x7fbed80984c0 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 0x7fbed8095e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient: get_auth_request con 0x7fbed80984c0 auth_method 0 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_done global_id 134169 payload 824 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed6ffd640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbed809dac0 con 0x7fbed80984c0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbec40074d0 con 0x7fbed80a0750 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeb3fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbea803dcc0 0x7fbea8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7fbec4051d00 con 0x7fbed80a0750 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed7fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbea803dcc0 0x7fbea8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.236+0000 7fbed7fff640 10 monclient: get_auth_request con 0x7fbea803dcc0 auth_method 0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbed6ffd640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 msgr2=0x7fbed8095e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbed6ffd640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 0x7fbed8095e20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8005070 con 0x7fbed80984c0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 10 monclient: dump: 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.256 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fbec8005070 con 0x7fbed80984c0 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 msgr2=0x7fbed8095e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 0x7fbed8095e20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8009f10 comp rx=0 tx=0).stop 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 msgr2=0x7fbed8095e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:40.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.238+0000 7fbeb3fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80984c0 0x7fbed8095e20 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8009f10 comp rx=0 tx=0).stop 2026-02-17T11:55:40.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.239+0000 7fbed7fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbea803dcc0 0x7fbea8040180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbed806c1c0 tx=0x7fbecc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbeddc7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:40.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 0x7fbed81d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbeddc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80008d0 con 0x7fbed808d3f0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 0x7fbed81d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient: get_auth_request con 0x7fbed808d3f0 auth_method 0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 10 monclient(hunting): handle_auth_done global_id 134172 payload 824 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.241+0000 7fbed6ffd640 1 -- 10.20.193.51:0/4241608008 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbed8050ac0 con 0x7fbed808d3f0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.243+0000 7fbed6ffd640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 msgr2=0x7fbed81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.243+0000 7fbed6ffd640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 0x7fbed81d98b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec801ae30 con 0x7fbed808d3f0 2026-02-17T11:55:40.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 10 monclient: dump: 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7fbec8005430 con 0x7fbed808d3f0 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:40.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 msgr2=0x7fbed81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 0x7fbed81d98b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8005b10 comp rx=0 tx=0).stop 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 msgr2=0x7fbed81d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeb3fff640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed808d3f0 0x7fbed81d98b0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbec800bca0 tx=0x7fbec8005b10 comp rx=0 tx=0).stop 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 84, 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 40566, 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:40.262 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.263 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:40.264 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.265 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.266 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:40.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.268 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:40.271 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbea803dcc0 msgr2=0x7fbea8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbea803dcc0 0x7fbea8040180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbed806c1c0 tx=0x7fbecc033000 comp rx=0 tx=0).stop 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 10 monclient: shutdown 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 msgr2=0x7fbed8094e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 --2- 10.20.193.51:0/4241608008 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbed80a0750 0x7fbed8094e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c730 tx=0x7fbec400cc00 comp rx=0 tx=0).stop 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbed7fff640 1 -- 10.20.193.51:0/4241608008 reap_dead start 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbed7fff640 1 -- 10.20.193.51:0/4241608008 reap_dead start 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 shutdown_connections 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 >> 10.20.193.51:0/4241608008 conn(0x7fbed80a30c0 msgr2=0x7fbed813aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 shutdown_connections 2026-02-17T11:55:40.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.244+0000 7fbeddc7c640 1 -- 10.20.193.51:0/4241608008 wait complete. 2026-02-17T11:55:40.273 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:55:40.273 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:55:40.273 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: get_monmap_and_config 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: build_initial_monmap 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: monmap: 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:55:40.341178+0000 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:55:40.341178+0000 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:40.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 Processor -- start 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 -- start start 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: init 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 0x7fca3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-b con 0x7fca3c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fca3c0a0750 0x7fca3c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-a con 0x7fca3c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:55:40.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fca3c09e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c06e140 con 0x7fca3c09e540 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fca3c0a3f90 con 0x7fca3c0a0750 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c09f910 con 0x7fca3c0a3bb0 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca420b0640 10 monclient(hunting): authenticate will time out at 1227.959960s 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca3b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 msgr2=0x7fca3c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.340+0000 7fca3b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 0x7fca3c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fca3c0a0750 0x7fca3c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fca3c0a0750 0x7fca3c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36990/0 (socket says 10.20.193.51:36990) 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 -- 10.20.193.51:0/192381441 learned_addr learned my addr 10.20.193.51:0/192381441 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): get_auth_request con 0x7fca3c0a0750 auth_method 0 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient(hunting): handle_auth_done global_id 134175 payload 274 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 -- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 msgr2=0x7fca3c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 --2- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 0x7fca3c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 -- 10.20.193.51:0/192381441 >> v1:10.20.193.142:6789/0 conn(0x7fca3c09e540 legacy=0x7fca3c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 monclient: found mon.noname-a 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.341+0000 7fca3affd640 1 -- 10.20.193.51:0/192381441 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c09ccd0 con 0x7fca3c0a0750 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3affd640 1 -- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 msgr2=0x7fca3c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3affd640 1 --2- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c09e000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca3c069d60 tx=0x7fca2c02ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d4ebaee22871c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 1 -- 10.20.193.51:0/192381441 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03c070 con 0x7fca3c0a0750 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: dump: 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.353 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 1 -- 10.20.193.51:0/192381441 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c02fda0 con 0x7fca3c0a0750 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 5 monclient: authenticate success, global_id 134175 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 1 -- 10.20.193.51:0/192381441 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c037660 con 0x7fca3c0a0750 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 4 set_mon_vals no callback set 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca3a7fc640 10 monclient: dump: 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.354 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 10 monclient: shutdown 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 1 -- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 msgr2=0x7fca3c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.343+0000 7fca420b0640 1 --2- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c09e000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca3c069d60 tx=0x7fca2c02ee80 comp rx=0 tx=0).stop 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- 10.20.193.51:0/192381441 shutdown_connections 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 --2- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c09e000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 --2- 10.20.193.51:0/192381441 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c0a3bb0 0x7fca3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- 10.20.193.51:0/192381441 >> 10.20.193.51:0/192381441 conn(0x7fca3c0a30c0 msgr2=0x7fca3c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- 10.20.193.51:0/192381441 shutdown_connections 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- 10.20.193.51:0/192381441 wait complete. 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient: build_initial_monmap 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient: monmap: 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 Processor -- start 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- start start 2026-02-17T11:55:40.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient: init 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c09e540 0x7fca3c13d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-c con 0x7fca3c09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c12fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-a con 0x7fca3c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c0a3bb0 0x7fca3c1300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): picked mon.noname-b con 0x7fca3c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0a04b0 con 0x7fca3c0a0750 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c09c850 con 0x7fca3c0a3bb0 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c13de80 con 0x7fca3c09e540 2026-02-17T11:55:40.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca420b0640 10 monclient(hunting): authenticate will time out at 1227.963885s 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c09e540 msgr2=0x7fca3c13d040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c09e540 0x7fca3c13d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c12fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c12fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37006/0 (socket says 10.20.193.51:37006) 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 1 -- 10.20.193.51:0/1907568044 learned_addr learned my addr 10.20.193.51:0/1907568044 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): get_auth_request con 0x7fca3c0a0750 auth_method 0 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.344+0000 7fca3affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 10 monclient(hunting): handle_auth_done global_id 134178 payload 824 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c09e540 msgr2=0x7fca3c13d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:55:40.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca3c09e540 0x7fca3c13d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c0a3bb0 msgr2=0x7fca3c1300d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c0a3bb0 0x7fca3c1300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 monclient: found mon.noname-a 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.345+0000 7fca3affd640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c0a23c0 con 0x7fca3c0a0750 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca3affd640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 msgr2=0x7fca3c12fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca3affd640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c12fb90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca2c002410 tx=0x7fca2c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c046020 con 0x7fca3c0a0750 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: dump: 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.359 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 5 monclient: authenticate success, global_id 134178 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c042640 con 0x7fca3c0a0750 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03c040 con 0x7fca3c0a0750 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 monclient: _renew_subs 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca39ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c130da0 con 0x7fca3c0a0750 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca17fff640 10 monclient: dump: 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 monclient: _renew_subs 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:55:40.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c13dc20 con 0x7fca3c0a0750 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 0x7fca3c130610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.347+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c1314d0 con 0x7fca3c132590 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fca2c03f030 con 0x7fca3c0a0750 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 0x7fca3c130610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient: get_auth_request con 0x7fca3c132590 auth_method 0 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca17fff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca0c03dcf0 0x7fca0c0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(357..357 src has 167..357) ==== 4855+0+0 (secure 0 0 0) 0x7fca2c077760 con 0x7fca3c0a0750 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3bfff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca0c03dcf0 0x7fca0c0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3bfff640 10 monclient: get_auth_request con 0x7fca0c03dcf0 auth_method 0 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_done global_id 114289 payload 824 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.348+0000 7fca3b7fe640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca3c09dac0 con 0x7fca3c132590 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.350+0000 7fca3b7fe640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 msgr2=0x7fca3c130610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.350+0000 7fca3b7fe640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 0x7fca3c130610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca2800bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28005070 con 0x7fca3c132590 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 10 monclient: dump: 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca3bfff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca0c03dcf0 0x7fca0c0401b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca30004980 tx=0x7fca30003fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fca28005070 con 0x7fca3c132590 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 msgr2=0x7fca3c130610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 0x7fca3c130610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca2800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 msgr2=0x7fca3c130610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:40.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.351+0000 7fca17fff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c132590 0x7fca3c130610 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca2800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca420b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca420b0640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 0x7fca3c1d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca420b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0008d0 con 0x7fca3c1386e0 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 0x7fca3c1d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient: get_auth_request con 0x7fca3c1386e0 auth_method 0 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:40.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.354+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.355+0000 7fca3b7fe640 10 monclient(hunting): handle_auth_done global_id 114292 payload 824 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.355+0000 7fca3b7fe640 1 -- 10.20.193.51:0/1907568044 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca3c050aa0 con 0x7fca3c1386e0 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca3b7fe640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 msgr2=0x7fca3c1d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca3b7fe640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 0x7fca3c1d9de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca28005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2801a730 con 0x7fca3c1386e0 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 10 monclient: dump: 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:55:40.367 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7fca28014430 con 0x7fca3c1386e0 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 msgr2=0x7fca3c1d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 0x7fca3c1d9de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca28005ad0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 msgr2=0x7fca3c1d9de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca17fff640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca3c1386e0 0x7fca3c1d9de0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bcc0 tx=0x7fca28005ad0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:55:40.368 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 84, 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 142232, 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.369 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.370 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:55:40.371 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:55:40.372 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:55:40.373 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:55:40.374 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.375 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.376 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.377 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:55:40.378 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:55:40.379 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca0c03dcf0 msgr2=0x7fca0c0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca0c03dcf0 0x7fca0c0401b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca30004980 tx=0x7fca30003fc0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 10 monclient: shutdown 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 msgr2=0x7fca3c12fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 --2- 10.20.193.51:0/1907568044 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca3c0a0750 0x7fca3c12fb90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca2c002410 tx=0x7fca2c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca3bfff640 1 -- 10.20.193.51:0/1907568044 reap_dead start 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca3bfff640 1 -- 10.20.193.51:0/1907568044 reap_dead start 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 shutdown_connections 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 >> 10.20.193.51:0/1907568044 conn(0x7fca3c0a30c0 msgr2=0x7fca3c072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 shutdown_connections 2026-02-17T11:55:40.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:55:40.357+0000 7fca420b0640 1 -- 10.20.193.51:0/1907568044 wait complete. 2026-02-17T11:55:40.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:55:40.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:55:40.694 INFO:tasks.rados.rados.0.trial142.stdout:1545: done (1 left) 2026-02-17T11:55:40.694 INFO:tasks.rados.rados.0.trial142.stdout:1546: copy_from oid 22 from oid 40 current snap is 168 2026-02-17T11:55:40.694 INFO:tasks.rados.rados.0.trial142.stdout:1543: expect (ObjNum 489 snap 147 seq_num 489) 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1546: finishing copy_from to trial14245205-22 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1546: got expected ENOENT (src dne) 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1546: finishing copy_from racing read to trial14245205-22 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1543: done (1 left) 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1546: done (0 left) 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1547: read oid 36 snap -1 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1547: expect deleted 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1548: rollback oid 48 current snap is 168 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 144 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1549: read oid 33 snap -1 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1549: expect deleted 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1550: read oid 7 snap -1 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1550: expect deleted 2026-02-17T11:55:40.761 INFO:tasks.rados.rados.0.trial142.stdout:1551: snap_remove snap 167 2026-02-17T11:55:41.998 INFO:tasks.rados.rados.0.trial142.stdout:1551: done (4 left) 2026-02-17T11:55:41.998 INFO:tasks.rados.rados.0.trial142.stdout:1552: snap_remove snap 155 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1552: done (4 left) 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1553: copy_from oid 42 from oid 15 current snap is 168 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1548: finishing rollback tid 0 to trial14245205-48 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1548: finishing rollback tid 1 to trial14245205-48 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1548: finishing rollback tid 2 to trial14245205-48 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T11:55:42.945 INFO:tasks.rados.rados.0.trial142.stdout:1547: done (4 left) 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1548: done (3 left) 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1549: done (2 left) 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1550: done (1 left) 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1554: copy_from oid 16 from oid 13 current snap is 168 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1555: read oid 44 snap 147 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1555: expect (ObjNum 488 snap 146 seq_num 488) 2026-02-17T11:55:42.946 INFO:tasks.rados.rados.0.trial142.stdout:1556: snap_remove snap 157 2026-02-17T11:55:43.947 INFO:tasks.rados.rados.0.trial142.stdout:1556: done (3 left) 2026-02-17T11:55:43.947 INFO:tasks.rados.rados.0.trial142.stdout:1557: write oid 3 current snap is 168 2026-02-17T11:55:43.947 INFO:tasks.rados.rados.0.trial142.stdout:1557: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2026-02-17T11:55:43.951 INFO:tasks.rados.rados.0.trial142.stdout:1557: writing trial14245205-3 from 578306 to 1061017 tid 1 2026-02-17T11:55:43.955 INFO:tasks.rados.rados.0.trial142.stdout:1557: writing trial14245205-3 from 1586364 to 2217543 tid 2 2026-02-17T11:55:43.959 INFO:tasks.rados.rados.0.trial142.stdout:1557: writing trial14245205-3 from 2757324 to 3242166 tid 3 2026-02-17T11:55:43.960 INFO:tasks.rados.rados.0.trial142.stdout:1558: snap_create 2026-02-17T11:55:43.960 INFO:tasks.rados.rados.0.trial142.stdout:1555: expect (ObjNum 488 snap 146 seq_num 488) 2026-02-17T11:55:44.011 INFO:tasks.rados.rados.0.trial142.stdout:1554: finishing copy_from racing read to trial14245205-16 2026-02-17T11:55:44.011 INFO:tasks.rados.rados.0.trial142.stdout:1554: finishing copy_from to trial14245205-16 2026-02-17T11:55:44.011 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 967 (ObjNum 517 snap 160 seq_num 517) dirty exists 2026-02-17T11:55:44.011 INFO:tasks.rados.rados.0.trial142.stdout:1553: finishing copy_from racing read to trial14245205-42 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1553: finishing copy_from to trial14245205-42 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 989 (ObjNum 554 snap 168 seq_num 554) dirty exists 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: finishing write tid 1 to trial14245205-3 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: finishing write tid 2 to trial14245205-3 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: finishing write tid 3 to trial14245205-3 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: finishing write tid 4 to trial14245205-3 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: finishing write tid 5 to trial14245205-3 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: oid 3 updating version 0 to 710 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: oid 3 version 710 is already newer than 708 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: oid 3 version 710 is already newer than 707 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:1557: oid 3 version 710 is already newer than 709 2026-02-17T11:55:44.012 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 710 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:55:44.013 INFO:tasks.rados.rados.0.trial142.stdout:1557: left oid 3 (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:55:44.688 INFO:tasks.rados.rados.0.trial142.stdout:1553: done (4 left) 2026-02-17T11:55:44.688 INFO:tasks.rados.rados.0.trial142.stdout:1554: done (3 left) 2026-02-17T11:55:44.689 INFO:tasks.rados.rados.0.trial142.stdout:1555: done (2 left) 2026-02-17T11:55:44.689 INFO:tasks.rados.rados.0.trial142.stdout:1557: done (1 left) 2026-02-17T11:55:44.689 INFO:tasks.rados.rados.0.trial142.stdout:1558: done (0 left) 2026-02-17T11:55:44.689 INFO:tasks.rados.rados.0.trial142.stdout:1559: write oid 50 current snap is 169 2026-02-17T11:55:44.689 INFO:tasks.rados.rados.0.trial142.stdout:1559: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2026-02-17T11:55:44.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: writing trial14245205-50 from 595113 to 1153073 tid 1 2026-02-17T11:55:44.697 INFO:tasks.rados.rados.0.trial142.stdout:1559: writing trial14245205-50 from 1644846 to 2136036 tid 2 2026-02-17T11:55:44.702 INFO:tasks.rados.rados.0.trial142.stdout:1559: writing trial14245205-50 from 2784747 to 3395113 tid 3 2026-02-17T11:55:44.703 INFO:tasks.rados.rados.0.trial142.stdout:1560: read oid 29 snap 161 2026-02-17T11:55:44.703 INFO:tasks.rados.rados.0.trial142.stdout:1560: expect deleted 2026-02-17T11:55:44.703 INFO:tasks.rados.rados.0.trial142.stdout:1561: delete oid 6 current snap is 169 2026-02-17T11:55:44.703 INFO:tasks.rados.rados.0.trial142.stdout:1559: finishing write tid 1 to trial14245205-50 2026-02-17T11:55:44.703 INFO:tasks.rados.rados.0.trial142.stdout:1559: finishing write tid 2 to trial14245205-50 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1560: done (2 left) 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1561: done (1 left) 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1562: read oid 36 snap -1 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1562: expect deleted 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1563: write oid 47 current snap is 169 2026-02-17T11:55:44.705 INFO:tasks.rados.rados.0.trial142.stdout:1563: seq_num 561 ranges {628727=708458,2045457=494859,3123240=305487} 2026-02-17T11:55:44.710 INFO:tasks.rados.rados.0.trial142.stdout:1563: writing trial14245205-47 from 628727 to 1337185 tid 1 2026-02-17T11:55:44.714 INFO:tasks.rados.rados.0.trial142.stdout:1563: writing trial14245205-47 from 2045457 to 2540316 tid 2 2026-02-17T11:55:44.718 INFO:tasks.rados.rados.0.trial142.stdout:1563: writing trial14245205-47 from 3123240 to 3428727 tid 3 2026-02-17T11:55:44.718 INFO:tasks.rados.rados.0.trial142.stdout:1564: snap_remove snap 141 2026-02-17T11:55:44.718 INFO:tasks.rados.rados.0.trial142.stdout:1559: finishing write tid 3 to trial14245205-50 2026-02-17T11:55:45.690 INFO:tasks.rados.rados.0.trial142.stdout:1564: done (3 left) 2026-02-17T11:55:45.691 INFO:tasks.rados.rados.0.trial142.stdout:1565: read oid 5 snap 159 2026-02-17T11:55:45.691 INFO:tasks.rados.rados.0.trial142.stdout:1565: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:55:45.691 INFO:tasks.rados.rados.0.trial142.stdout:1566: snap_remove snap 165 2026-02-17T11:55:46.693 INFO:tasks.rados.rados.0.trial142.stdout:1566: done (4 left) 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1567: snap_create 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: finishing write tid 4 to trial14245205-50 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: finishing write tid 5 to trial14245205-50 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: oid 50 updating version 0 to 748 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: oid 50 version 748 is already newer than 746 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: oid 50 version 748 is already newer than 745 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: oid 50 version 748 is already newer than 747 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 748 (ObjNum 559 snap 169 seq_num 559) dirty exists 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1559: left oid 50 (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: finishing write tid 1 to trial14245205-47 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: finishing write tid 2 to trial14245205-47 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: finishing write tid 3 to trial14245205-47 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: finishing write tid 4 to trial14245205-47 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: finishing write tid 5 to trial14245205-47 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: oid 47 updating version 0 to 711 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: oid 47 version 711 is already newer than 710 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: oid 47 version 711 is already newer than 708 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: oid 47 version 711 is already newer than 709 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 711 (ObjNum 561 snap 169 seq_num 561) dirty exists 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1563: left oid 47 (ObjNum 561 snap 169 seq_num 561) 2026-02-17T11:55:46.694 INFO:tasks.rados.rados.0.trial142.stdout:1565: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1559: done (4 left) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1562: done (3 left) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1563: done (2 left) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1565: done (1 left) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1567: done (0 left) 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1568: write oid 8 current snap is 170 2026-02-17T11:55:47.696 INFO:tasks.rados.rados.0.trial142.stdout:1568: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2026-02-17T11:55:47.701 INFO:tasks.rados.rados.0.trial142.stdout:1568: writing trial14245205-8 from 645534 to 1429241 tid 1 2026-02-17T11:55:47.706 INFO:tasks.rados.rados.0.trial142.stdout:1568: writing trial14245205-8 from 2103939 to 2742456 tid 2 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:1568: writing trial14245205-8 from 3150663 to 3445534 tid 3 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:1569: rollback oid 22 current snap is 170 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 161 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:1568: finishing write tid 1 to trial14245205-8 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:1568: finishing write tid 2 to trial14245205-8 2026-02-17T11:55:47.709 INFO:tasks.rados.rados.0.trial142.stdout:1570: snap_create 2026-02-17T11:55:47.710 INFO:tasks.rados.rados.0.trial142.stdout:1569: finishing rollback tid 1 to trial14245205-22 2026-02-17T11:55:47.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 301 (ObjNum 129 snap 0 seq_num 1214081824) dirty dne 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: finishing write tid 3 to trial14245205-8 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: finishing write tid 4 to trial14245205-8 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: finishing write tid 5 to trial14245205-8 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: oid 8 updating version 0 to 990 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: oid 8 updating version 990 to 992 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: oid 8 updating version 992 to 993 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: oid 8 version 993 is already newer than 991 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 993 (ObjNum 562 snap 170 seq_num 562) dirty exists 2026-02-17T11:55:47.711 INFO:tasks.rados.rados.0.trial142.stdout:1568: left oid 8 (ObjNum 562 snap 170 seq_num 562) 2026-02-17T11:55:48.698 INFO:tasks.rados.rados.0.trial142.stdout:1568: done (2 left) 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1569: done (1 left) 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1570: done (0 left) 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1571: read oid 35 snap 166 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1571: expect deleted 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1572: rollback oid 12 current snap is 171 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 12 to 161 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1573: rollback oid 32 current snap is 171 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 161 2026-02-17T11:55:48.699 INFO:tasks.rados.rados.0.trial142.stdout:1574: delete oid 33 current snap is 171 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1571: done (3 left) 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1574: done (2 left) 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1575: rollback oid 47 current snap is 171 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 156 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1576: copy_from oid 23 from oid 21 current snap is 171 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1577: rollback oid 49 current snap is 171 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 169 2026-02-17T11:55:48.701 INFO:tasks.rados.rados.0.trial142.stdout:1578: snap_create 2026-02-17T11:55:48.702 INFO:tasks.rados.rados.0.trial142.stdout:1573: finishing rollback tid 0 to trial14245205-32 2026-02-17T11:55:48.702 INFO:tasks.rados.rados.0.trial142.stdout:1573: finishing rollback tid 1 to trial14245205-32 2026-02-17T11:55:48.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 991 (ObjNum 129 snap 0 seq_num 1213586640) dirty dne 2026-02-17T11:55:48.702 INFO:tasks.rados.rados.0.trial142.stdout:1572: finishing rollback tid 0 to trial14245205-12 2026-02-17T11:55:48.703 INFO:tasks.rados.rados.0.trial142.stdout:1575: finishing rollback tid 0 to trial14245205-47 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1575: finishing rollback tid 1 to trial14245205-47 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1572: finishing rollback tid 1 to trial14245205-12 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1576: finishing copy_from to trial14245205-23 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1576: got expected ENOENT (src dne) 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1572: finishing rollback tid 2 to trial14245205-12 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1378 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1577: finishing rollback tid 0 to trial14245205-49 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1576: finishing copy_from racing read to trial14245205-23 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1577: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:1575: finishing rollback tid 2 to trial14245205-47 2026-02-17T11:55:48.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 714 (ObjNum 428 snap 127 seq_num 428) dirty exists 2026-02-17T11:55:48.705 INFO:tasks.rados.rados.0.trial142.stdout:1577: finishing rollback tid 2 to trial14245205-49 2026-02-17T11:55:48.705 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1382 (ObjNum 478 snap 142 seq_num 478) dirty exists 2026-02-17T11:55:49.688 INFO:tasks.rados.rados.0.trial142.stdout:1572: done (5 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1573: done (4 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1575: done (3 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1576: done (2 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1577: done (1 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1578: done (0 left) 2026-02-17T11:55:49.689 INFO:tasks.rados.rados.0.trial142.stdout:1579: snap_remove snap 166 2026-02-17T11:55:51.120 INFO:tasks.rados.rados.0.trial142.stdout:1579: done (0 left) 2026-02-17T11:55:51.120 INFO:tasks.rados.rados.0.trial142.stdout:1580: copy_from oid 35 from oid 26 current snap is 172 2026-02-17T11:55:51.120 INFO:tasks.rados.rados.0.trial142.stdout:1581: delete oid 36 current snap is 172 2026-02-17T11:55:51.121 INFO:tasks.rados.rados.0.trial142.stdout:1580: finishing copy_from to trial14245205-35 2026-02-17T11:55:51.121 INFO:tasks.rados.rados.0.trial142.stdout:1580: got expected ENOENT (src dne) 2026-02-17T11:55:51.121 INFO:tasks.rados.rados.0.trial142.stdout:1580: finishing copy_from racing read to trial14245205-35 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1580: done (1 left) 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1581: done (0 left) 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1582: copy_from oid 38 from oid 40 current snap is 172 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1583: copy_from oid 12 from oid 2 current snap is 172 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1584: rollback oid 27 current snap is 172 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 144 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1585: rollback oid 7 current snap is 172 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 170 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1586: read oid 34 snap 144 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1586: expect deleted 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1587: write oid 42 current snap is 172 2026-02-17T11:55:51.122 INFO:tasks.rados.rados.0.trial142.stdout:1587: seq_num 565 ranges {695955=725807,1879385=502197,2949285=480099} 2026-02-17T11:55:51.127 INFO:tasks.rados.rados.0.trial142.stdout:1587: writing trial14245205-42 from 695955 to 1421762 tid 1 2026-02-17T11:55:51.131 INFO:tasks.rados.rados.0.trial142.stdout:1587: writing trial14245205-42 from 1879385 to 2381582 tid 2 2026-02-17T11:55:51.136 INFO:tasks.rados.rados.0.trial142.stdout:1587: writing trial14245205-42 from 2949285 to 3429384 tid 3 2026-02-17T11:55:51.136 INFO:tasks.rados.rados.0.trial142.stdout:1588: read oid 13 snap -1 2026-02-17T11:55:51.136 INFO:tasks.rados.rados.0.trial142.stdout:1588: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1589: rollback oid 16 current snap is 172 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 159 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1584: finishing rollback tid 1 to trial14245205-27 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 0 (ObjNum 129 snap 0 seq_num 1213756432) dirty dne 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1585: finishing rollback tid 1 to trial14245205-7 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 1285 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1582: finishing copy_from to trial14245205-38 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1582: got expected ENOENT (src dne) 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1582: finishing copy_from racing read to trial14245205-38 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1583: finishing copy_from racing read to trial14245205-12 2026-02-17T11:55:51.137 INFO:tasks.rados.rados.0.trial142.stdout:1587: finishing write tid 1 to trial14245205-42 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1583: finishing copy_from to trial14245205-12 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 967 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1587: finishing write tid 2 to trial14245205-42 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1582: done (7 left) 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1583: done (6 left) 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1584: done (5 left) 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1585: done (4 left) 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1586: done (3 left) 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1590: write oid 27 current snap is 172 2026-02-17T11:55:51.138 INFO:tasks.rados.rados.0.trial142.stdout:1590: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2026-02-17T11:55:51.139 INFO:tasks.rados.rados.0.trial142.stdout:1590: writing trial14245205-27 from 712762 to 1113818 tid 1 2026-02-17T11:55:51.143 INFO:tasks.rados.rados.0.trial142.stdout:1590: writing trial14245205-27 from 1537867 to 2183722 tid 2 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1590: writing trial14245205-27 from 2860355 to 3512762 tid 3 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1591: read oid 2 snap -1 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1591: expect (ObjNum 536 snap 165 seq_num 536) 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1592: delete oid 38 current snap is 172 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1587: finishing write tid 3 to trial14245205-42 2026-02-17T11:55:51.149 INFO:tasks.rados.rados.0.trial142.stdout:1587: finishing write tid 4 to trial14245205-42 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: finishing write tid 5 to trial14245205-42 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: oid 42 updating version 0 to 993 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: oid 42 updating version 993 to 995 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: oid 42 version 995 is already newer than 994 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: oid 42 version 995 is already newer than 992 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 995 (ObjNum 565 snap 172 seq_num 565) dirty exists 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1587: left oid 42 (ObjNum 565 snap 172 seq_num 565) 2026-02-17T11:55:51.150 INFO:tasks.rados.rados.0.trial142.stdout:1588: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:55:51.214 INFO:tasks.rados.rados.0.trial142.stdout:1589: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:55:51.214 INFO:tasks.rados.rados.0.trial142.stdout:1587: done (5 left) 2026-02-17T11:55:51.214 INFO:tasks.rados.rados.0.trial142.stdout:1588: done (4 left) 2026-02-17T11:55:51.214 INFO:tasks.rados.rados.0.trial142.stdout:1592: done (3 left) 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1593: read oid 24 snap 147 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1593: expect (ObjNum 471 snap 141 seq_num 471) 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1594: snap_create 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1589: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1589: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 970 (ObjNum 460 snap 139 seq_num 460) dirty exists 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1590: finishing write tid 1 to trial14245205-27 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1590: finishing write tid 2 to trial14245205-27 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1590: finishing write tid 3 to trial14245205-27 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1590: finishing write tid 4 to trial14245205-27 2026-02-17T11:55:51.215 INFO:tasks.rados.rados.0.trial142.stdout:1590: finishing write tid 5 to trial14245205-27 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1590: oid 27 updating version 0 to 997 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1590: oid 27 version 997 is already newer than 996 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1590: oid 27 updating version 997 to 999 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1590: oid 27 version 999 is already newer than 998 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 999 (ObjNum 566 snap 172 seq_num 566) dirty exists 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1590: left oid 27 (ObjNum 566 snap 172 seq_num 566) 2026-02-17T11:55:51.216 INFO:tasks.rados.rados.0.trial142.stdout:1591: expect (ObjNum 536 snap 165 seq_num 536) 2026-02-17T11:55:51.368 INFO:tasks.rados.rados.0.trial142.stdout:1593: expect (ObjNum 471 snap 141 seq_num 471) 2026-02-17T11:55:51.700 INFO:tasks.rados.rados.0.trial142.stdout:1589: done (4 left) 2026-02-17T11:55:51.700 INFO:tasks.rados.rados.0.trial142.stdout:1590: done (3 left) 2026-02-17T11:55:51.701 INFO:tasks.rados.rados.0.trial142.stdout:1591: done (2 left) 2026-02-17T11:55:51.701 INFO:tasks.rados.rados.0.trial142.stdout:1593: done (1 left) 2026-02-17T11:55:51.701 INFO:tasks.rados.rados.0.trial142.stdout:1594: done (0 left) 2026-02-17T11:55:51.701 INFO:tasks.rados.rados.0.trial142.stdout:1595: write (excl) oid 44 current snap is 173 2026-02-17T11:55:51.701 INFO:tasks.rados.rados.0.trial142.stdout:1595: seq_num 568 ranges {746376=551554,2054831=649524,3315201=231175} 2026-02-17T11:55:51.705 INFO:tasks.rados.rados.0.trial142.stdout:1595: writing trial14245205-44 from 746376 to 1297930 tid 1 2026-02-17T11:55:51.710 INFO:tasks.rados.rados.0.trial142.stdout:1595: writing trial14245205-44 from 2054831 to 2704355 tid 2 2026-02-17T11:55:51.713 INFO:tasks.rados.rados.0.trial142.stdout:1595: writing trial14245205-44 from 3315201 to 3546376 tid 3 2026-02-17T11:55:51.714 INFO:tasks.rados.rados.0.trial142.stdout:1596: snap_remove snap 168 2026-02-17T11:55:52.701 INFO:tasks.rados.rados.0.trial142.stdout:1596: done (1 left) 2026-02-17T11:55:52.701 INFO:tasks.rados.rados.0.trial142.stdout:1597: read oid 30 snap 161 2026-02-17T11:55:52.701 INFO:tasks.rados.rados.0.trial142.stdout:1597: expect (ObjNum 499 snap 152 seq_num 499) 2026-02-17T11:55:52.702 INFO:tasks.rados.rados.0.trial142.stdout:1598: snap_remove snap 144 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1598: done (2 left) 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1599: delete oid 21 current snap is 173 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: finishing write tid 1 to trial14245205-44 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: finishing write tid 2 to trial14245205-44 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: finishing write tid 3 to trial14245205-44 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: finishing write tid 4 to trial14245205-44 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: finishing write tid 5 to trial14245205-44 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: oid 44 updating version 0 to 329 2026-02-17T11:55:53.706 INFO:tasks.rados.rados.0.trial142.stdout:1595: oid 44 updating version 329 to 331 2026-02-17T11:55:53.707 INFO:tasks.rados.rados.0.trial142.stdout:1595: oid 44 version 331 is already newer than 328 2026-02-17T11:55:53.707 INFO:tasks.rados.rados.0.trial142.stdout:1595: oid 44 version 331 is already newer than 330 2026-02-17T11:55:53.707 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 331 (ObjNum 568 snap 173 seq_num 568) dirty exists 2026-02-17T11:55:53.707 INFO:tasks.rados.rados.0.trial142.stdout:1595: left oid 44 (ObjNum 568 snap 173 seq_num 568) 2026-02-17T11:55:53.707 INFO:tasks.rados.rados.0.trial142.stdout:1597: expect (ObjNum 499 snap 152 seq_num 499) 2026-02-17T11:55:53.762 INFO:tasks.rados.rados.0.trial142.stdout:1595: done (2 left) 2026-02-17T11:55:53.762 INFO:tasks.rados.rados.0.trial142.stdout:1597: done (1 left) 2026-02-17T11:55:53.762 INFO:tasks.rados.rados.0.trial142.stdout:1599: done (0 left) 2026-02-17T11:55:53.763 INFO:tasks.rados.rados.0.trial142.stdout:1600: snap_remove snap 171 2026-02-17T11:55:54.690 INFO:tasks.rados.rados.0.trial142.stdout:1600: done (0 left) 2026-02-17T11:55:54.690 INFO:tasks.rados.rados.0.trial142.stdout:1601: snap_remove snap 156 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1601: done (0 left) 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1602: read oid 47 snap -1 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1602: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1603: read oid 45 snap -1 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1603: expect (ObjNum 437 snap 131 seq_num 437) 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1604: read oid 12 snap 161 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1604: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:55:55.690 INFO:tasks.rados.rados.0.trial142.stdout:1605: snap_remove snap 172 2026-02-17T11:55:56.690 INFO:tasks.rados.rados.0.trial142.stdout:1605: done (3 left) 2026-02-17T11:55:56.690 INFO:tasks.rados.rados.0.trial142.stdout:1606: write oid 11 current snap is 173 2026-02-17T11:55:56.690 INFO:tasks.rados.rados.0.trial142.stdout:1606: seq_num 570 ranges {779990=702052,2055442=653193,3253694=326296} 2026-02-17T11:55:56.696 INFO:tasks.rados.rados.0.trial142.stdout:1606: writing trial14245205-11 from 779990 to 1482042 tid 1 2026-02-17T11:55:56.701 INFO:tasks.rados.rados.0.trial142.stdout:1606: writing trial14245205-11 from 2055442 to 2708635 tid 2 2026-02-17T11:55:56.704 INFO:tasks.rados.rados.0.trial142.stdout:1606: writing trial14245205-11 from 3253694 to 3579990 tid 3 2026-02-17T11:55:56.704 INFO:tasks.rados.rados.0.trial142.stdout:1607: write oid 44 current snap is 173 2026-02-17T11:55:56.704 INFO:tasks.rados.rados.0.trial142.stdout:1607: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2026-02-17T11:55:56.709 INFO:tasks.rados.rados.0.trial142.stdout:1607: writing trial14245205-44 from 796797 to 1290451 tid 1 2026-02-17T11:55:56.714 INFO:tasks.rados.rados.0.trial142.stdout:1607: writing trial14245205-44 from 1830277 to 2627128 tid 2 2026-02-17T11:55:56.718 INFO:tasks.rados.rados.0.trial142.stdout:1607: writing trial14245205-44 from 3397470 to 3596797 tid 3 2026-02-17T11:55:56.718 INFO:tasks.rados.rados.0.trial142.stdout:1608: delete oid 19 current snap is 173 2026-02-17T11:55:56.718 INFO:tasks.rados.rados.0.trial142.stdout:1604: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:55:56.829 INFO:tasks.rados.rados.0.trial142.stdout:1603: expect (ObjNum 437 snap 131 seq_num 437) 2026-02-17T11:55:56.958 INFO:tasks.rados.rados.0.trial142.stdout:1602: expect (ObjNum 428 snap 127 seq_num 428) 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: finishing write tid 1 to trial14245205-11 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: finishing write tid 2 to trial14245205-11 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: finishing write tid 3 to trial14245205-11 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: finishing write tid 4 to trial14245205-11 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: finishing write tid 5 to trial14245205-11 2026-02-17T11:55:57.116 INFO:tasks.rados.rados.0.trial142.stdout:1606: oid 11 updating version 0 to 209 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1606: oid 11 updating version 209 to 210 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1606: oid 11 version 210 is already newer than 208 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1606: oid 11 version 210 is already newer than 207 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 210 (ObjNum 570 snap 173 seq_num 570) dirty exists 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1606: left oid 11 (ObjNum 570 snap 173 seq_num 570) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1607: finishing write tid 1 to trial14245205-44 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1607: finishing write tid 2 to trial14245205-44 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1602: done (5 left) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1603: done (4 left) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1604: done (3 left) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1606: done (2 left) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1608: done (1 left) 2026-02-17T11:55:57.117 INFO:tasks.rados.rados.0.trial142.stdout:1609: write (excl) oid 49 current snap is 173 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: finishing write tid 3 to trial14245205-44 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: finishing write tid 4 to trial14245205-44 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: finishing write tid 5 to trial14245205-44 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: oid 44 updating version 0 to 337 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: oid 44 version 337 is already newer than 336 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: oid 44 version 337 is already newer than 335 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: oid 44 version 337 is already newer than 334 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 337 (ObjNum 571 snap 173 seq_num 571) dirty exists 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1607: left oid 44 (ObjNum 571 snap 173 seq_num 571) 2026-02-17T11:55:57.118 INFO:tasks.rados.rados.0.trial142.stdout:1609: seq_num 573 ranges {430411=644152,1830888=400520,2935963=402981} 2026-02-17T11:55:57.120 INFO:tasks.rados.rados.0.trial142.stdout:1609: writing trial14245205-49 from 430411 to 1074563 tid 1 2026-02-17T11:55:57.124 INFO:tasks.rados.rados.0.trial142.stdout:1609: writing trial14245205-49 from 1830888 to 2231408 tid 2 2026-02-17T11:55:57.129 INFO:tasks.rados.rados.0.trial142.stdout:1609: writing trial14245205-49 from 2935963 to 3338944 tid 3 2026-02-17T11:55:57.129 INFO:tasks.rados.rados.0.trial142.stdout:1607: done (1 left) 2026-02-17T11:55:57.129 INFO:tasks.rados.rados.0.trial142.stdout:1610: delete oid 25 current snap is 173 2026-02-17T11:55:57.129 INFO:tasks.rados.rados.0.trial142.stdout:1609: finishing write tid 1 to trial14245205-49 2026-02-17T11:55:57.129 INFO:tasks.rados.rados.0.trial142.stdout:1609: finishing write tid 2 to trial14245205-49 2026-02-17T11:55:57.131 INFO:tasks.rados.rados.0.trial142.stdout:1609: finishing write tid 3 to trial14245205-49 2026-02-17T11:55:57.131 INFO:tasks.rados.rados.0.trial142.stdout:1609: finishing write tid 4 to trial14245205-49 2026-02-17T11:55:57.131 INFO:tasks.rados.rados.0.trial142.stdout:1609: finishing write tid 5 to trial14245205-49 2026-02-17T11:55:57.131 INFO:tasks.rados.rados.0.trial142.stdout:1609: oid 49 updating version 0 to 1429 2026-02-17T11:55:57.131 INFO:tasks.rados.rados.0.trial142.stdout:1609: oid 49 version 1429 is already newer than 1427 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1609: oid 49 version 1429 is already newer than 1426 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1609: oid 49 version 1429 is already newer than 1428 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1429 (ObjNum 573 snap 173 seq_num 573) dirty exists 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1609: left oid 49 (ObjNum 573 snap 173 seq_num 573) 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1609: done (1 left) 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1610: done (0 left) 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1611: rollback oid 41 current snap is 173 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 41 to 159 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1612: write (excl) oid 21 current snap is 173 2026-02-17T11:55:57.132 INFO:tasks.rados.rados.0.trial142.stdout:1612: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2026-02-17T11:55:57.136 INFO:tasks.rados.rados.0.trial142.stdout:1612: writing trial14245205-21 from 464025 to 1258675 tid 1 2026-02-17T11:55:57.140 INFO:tasks.rados.rados.0.trial142.stdout:1612: writing trial14245205-21 from 1947852 to 2352041 tid 2 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1612: writing trial14245205-21 from 2990809 to 3416334 tid 3 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1613: snap_create 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1611: finishing rollback tid 0 to trial14245205-41 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1611: finishing rollback tid 1 to trial14245205-41 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1216 (ObjNum 129 snap 0 seq_num 1213810648) dirty dne 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1612: finishing write tid 1 to trial14245205-21 2026-02-17T11:55:57.144 INFO:tasks.rados.rados.0.trial142.stdout:1612: finishing write tid 2 to trial14245205-21 2026-02-17T11:55:57.145 INFO:tasks.rados.rados.0.trial142.stdout:1612: finishing write tid 3 to trial14245205-21 2026-02-17T11:55:57.145 INFO:tasks.rados.rados.0.trial142.stdout:1612: finishing write tid 4 to trial14245205-21 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: finishing write tid 5 to trial14245205-21 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: oid 21 updating version 0 to 966 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: oid 21 version 966 is already newer than 963 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: oid 21 version 966 is already newer than 964 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: oid 21 version 966 is already newer than 965 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 966 (ObjNum 575 snap 173 seq_num 575) dirty exists 2026-02-17T11:55:57.146 INFO:tasks.rados.rados.0.trial142.stdout:1612: left oid 21 (ObjNum 575 snap 173 seq_num 575) 2026-02-17T11:55:57.709 INFO:tasks.rados.rados.0.trial142.stdout:1611: done (2 left) 2026-02-17T11:55:57.709 INFO:tasks.rados.rados.0.trial142.stdout:1612: done (1 left) 2026-02-17T11:55:57.709 INFO:tasks.rados.rados.0.trial142.stdout:1613: done (0 left) 2026-02-17T11:55:57.709 INFO:tasks.rados.rados.0.trial142.stdout:1614: snap_remove snap 170 2026-02-17T11:55:58.711 INFO:tasks.rados.rados.0.trial142.stdout:1614: done (0 left) 2026-02-17T11:55:58.711 INFO:tasks.rados.rados.0.trial142.stdout:1615: snap_create 2026-02-17T11:55:59.689 INFO:tasks.rados.rados.0.trial142.stdout:1615: done (0 left) 2026-02-17T11:55:59.690 INFO:tasks.rados.rados.0.trial142.stdout:1616: read oid 27 snap -1 2026-02-17T11:55:59.690 INFO:tasks.rados.rados.0.trial142.stdout:1616: expect (ObjNum 566 snap 172 seq_num 566) 2026-02-17T11:55:59.690 INFO:tasks.rados.rados.0.trial142.stdout:1617: snap_create 2026-02-17T11:55:59.697 INFO:tasks.rados.rados.0.trial142.stdout:1616: expect (ObjNum 566 snap 172 seq_num 566) 2026-02-17T11:56:00.381 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:56:00.381 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:56:00.382 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:56:00.382 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:56:00.385 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:56:00.385 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:56:00.385 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.450+0000 7f54b3134640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.450+0000 7f54b3134640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.450+0000 7f54b3134640 10 monclient: monmap: 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:00.451819+0000 2026-02-17T11:56:00.452 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:00.451819+0000 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:00.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 Processor -- start 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 -- start start 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient: init 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54ac0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-b con 0x7f54ac09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f54ac0a0110 0x7f54ac13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-a con 0x7f54ac0a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac06e140 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac09aed0 con 0x7f54ac0a0110 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac09caa0 con 0x7f54ac09dac0 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b3134640 10 monclient(hunting): authenticate will time out at 1248.070687s 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b0ea9640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f54ac0a3bb0 0x7f54ac09f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39242/0 (socket says 10.20.193.51:39242) 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b0ea9640 1 -- 10.20.193.51:0/667082874 learned_addr learned my addr 10.20.193.51:0/667082874 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 --2- 10.20.193.51:0/667082874 >> v2:10.20.193.51:3300/0 conn(0x7f54ac0a0110 0x7f54ac13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): get_auth_request con 0x7f54ac0a0110 auth_method 0 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient(hunting): handle_auth_done global_id 134181 payload 274 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 -- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 msgr2=0x7f54ac09fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 --2- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 -- 10.20.193.51:0/667082874 >> v1:10.20.193.51:6789/0 conn(0x7f54ac0a3bb0 legacy=0x7f54ac09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.451+0000 7f54b16aa640 1 -- 10.20.193.51:0/667082874 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac09ce60 con 0x7f54ac0a0110 2026-02-17T11:56:00.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b16aa640 1 -- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a0110 msgr2=0x7f54ac13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b16aa640 1 --2- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a0110 0x7f54ac13c760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009d90 tx=0x7f54a802f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634dbf497d5d95da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 1 -- 10.20.193.51:0/667082874 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a803c070 con 0x7f54ac0a0110 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: dump: 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.456 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 1 -- 10.20.193.51:0/667082874 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a802fe50 con 0x7f54ac0a0110 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 5 monclient: authenticate success, global_id 134181 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 1 -- 10.20.193.51:0/667082874 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8037860 con 0x7f54ac0a0110 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 4 set_mon_vals no callback set 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54a37fe640 10 monclient: dump: 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:00.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 10 monclient: shutdown 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 -- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a0110 msgr2=0x7f54ac13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 --2- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a0110 0x7f54ac13c760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009d90 tx=0x7f54a802f130 comp rx=0 tx=0).stop 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 -- 10.20.193.51:0/667082874 shutdown_connections 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 --2- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a0110 0x7f54ac13c760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 --2- 10.20.193.51:0/667082874 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac09fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 -- 10.20.193.51:0/667082874 >> 10.20.193.51:0/667082874 conn(0x7f54ac0a30c0 msgr2=0x7f54ac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 -- 10.20.193.51:0/667082874 shutdown_connections 2026-02-17T11:56:00.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.454+0000 7f54b3134640 1 -- 10.20.193.51:0/667082874 wait complete. 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient: monmap: 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:00.459 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 1 Processor -- start 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 1 -- start start 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient: init 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-c con 0x7f54ac09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.455+0000 7f54b3134640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54ac0a0110 0x7f54ac136b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-b con 0x7f54ac0a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 0x7f54ac12b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): picked mon.noname-a con 0x7f54ac0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0a0540 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac09a880 con 0x7f54ac0a0110 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac13cca0 con 0x7f54ac09dac0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b3134640 10 monclient(hunting): authenticate will time out at 1248.075034s 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60532/0 (socket says 10.20.193.51:60532) 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 -- 10.20.193.51:0/2398072591 learned_addr learned my addr 10.20.193.51:0/2398072591 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 10 monclient(hunting): get_auth_request con 0x7f54ac09dac0 auth_method 0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 0x7f54ac12b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): get_auth_request con 0x7f54ac0a3bb0 auth_method 0 2026-02-17T11:56:00.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 msgr2=0x7f54ac1ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 msgr2=0x7f54ac1ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b0ea9640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient(hunting): handle_auth_done global_id 134184 payload 824 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 msgr2=0x7f54ac1ccd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54ac0a0110 msgr2=0x7f54ac136b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54ac0a0110 0x7f54ac136b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.456+0000 7f54b16aa640 1 -- 10.20.193.51:0/2398072591 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0a2960 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b16aa640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 msgr2=0x7f54ac12b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b16aa640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 0x7f54ac12b8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54a8036000 tx=0x7f54a8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8047070 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: dump: 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:00.462 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a8042640 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 5 monclient: authenticate success, global_id 134184 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 10 monclient: _renew_subs 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1cd2b0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a803c040 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a17fa640 10 monclient: dump: 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:00.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54a2ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 10 monclient: _renew_subs 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.458+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac12efc0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b3134640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b3134640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b3134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac09f4c0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f54a8042ab0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54a17fa640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 0x7f547c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(377..377 src has 167..377) ==== 4827+0+0 (secure 0 0 0) 0x7f54a8078080 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b0ea9640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 0x7f547c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.459+0000 7f54b0ea9640 10 monclient: get_auth_request con 0x7f547c03dd60 auth_method 0 2026-02-17T11:56:00.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.461+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f54ac0a2960 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.461+0000 7f54a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.461+0000 7f54a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.462+0000 7f54b0ea9640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 0x7f547c040220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f549c007f00 tx=0x7f549c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54b3134640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:00.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54b3134640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54b3134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f54ac0008d0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54a17fa640 1 -- 10.20.193.51:0/2398072591 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f54a804bcb0 con 0x7f54ac0a3bb0 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.575+0000 7f54a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.578 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":84,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 msgr2=0x7f547c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 0x7f547c040220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f549c007f00 tx=0x7f549c009040 comp rx=0 tx=0).stop 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 10 monclient: shutdown 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 msgr2=0x7f54ac12b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 0x7f54ac12b8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54a8036000 tx=0x7f54a8004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 shutdown_connections 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f547c03dd60 0x7f547c040220 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f54ac0a3bb0 0x7f54ac12b8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f54ac0a0110 0x7f54ac136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 --2- 10.20.193.51:0/2398072591 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f54ac09dac0 0x7f54ac1ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 >> 10.20.193.51:0/2398072591 conn(0x7f54ac0a30c0 msgr2=0x7f54ac06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 shutdown_connections 2026-02-17T11:56:00.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:00.576+0000 7f54b3134640 1 -- 10.20.193.51:0/2398072591 wait complete. 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1616: done (1 left) 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1617: done (0 left) 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1618: read oid 38 snap -1 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1618: expect deleted 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1619: read oid 26 snap -1 2026-02-17T11:56:00.693 INFO:tasks.rados.rados.0.trial142.stdout:1619: expect deleted 2026-02-17T11:56:00.694 INFO:tasks.rados.rados.0.trial142.stdout:1620: snap_create 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:1618: done (2 left) 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:1619: done (1 left) 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:1620: done (0 left) 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:1621: rollback oid 42 current snap is 177 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 175 2026-02-17T11:56:01.693 INFO:tasks.rados.rados.0.trial142.stdout:1622: snap_create 2026-02-17T11:56:01.698 INFO:tasks.rados.rados.0.trial142.stdout:1621: finishing rollback tid 0 to trial14245205-42 2026-02-17T11:56:01.699 INFO:tasks.rados.rados.0.trial142.stdout:1621: finishing rollback tid 1 to trial14245205-42 2026-02-17T11:56:01.699 INFO:tasks.rados.rados.0.trial142.stdout:1621: finishing rollback tid 2 to trial14245205-42 2026-02-17T11:56:01.699 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 998 (ObjNum 565 snap 172 seq_num 565) dirty exists 2026-02-17T11:56:03.587 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:03.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.656+0000 7fbec0796640 10 monclient: get_monmap_and_config 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.656+0000 7fbec0796640 10 monclient: build_initial_monmap 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.656+0000 7fbec0796640 10 monclient: monmap: 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:03.657593+0000 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:03.657593+0000 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:03.661 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 Processor -- start 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 -- start start 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient: init 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:03.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-a con 0x7fbeb80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-c con 0x7fbeb80a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbeb809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb806e140 con 0x7fbeb809e540 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb80a3f90 con 0x7fbeb80a3bb0 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb809f910 con 0x7fbeb80a0750 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbec0796640 10 monclient(hunting): authenticate will time out at 1251.276408s 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:03.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53674/0 (socket says 10.20.193.51:53674) 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebed0c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fbeb809e540 0x7fbeb813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39250/0 (socket says 10.20.193.51:39250) 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 learned_addr learned my addr 10.20.193.51:0/3307286167 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbeb80a3bb0 auth_method 0 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:03.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbeb80a0750 auth_method 0 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:03.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:03.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.659+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 >> v1:10.20.193.51:6789/0 conn(0x7fbeb809e540 legacy=0x7fbeb813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:03.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:03.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbeb80a3bb0 auth_method 0 2026-02-17T11:56:03.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbeb80a0750 auth_method 0 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:03.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:03.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbeb80a3bb0 auth_method 0 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:04.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbeb80a0750 auth_method 0 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:04.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:04.259+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:05.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbeb80a3bb0 auth_method 0 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbeb80a0750 auth_method 0 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:05.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:05.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:05.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.060+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:05.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:05.061+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:06.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): tick 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 monclient(hunting): continuing hunt 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 msgr2=0x7fbeb809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.142:3300/0 conn(0x7fbeb80a0750 0x7fbeb809e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 -- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 msgr2=0x7fbeb809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 --2- 10.20.193.51:0/3307286167 >> v2:10.20.193.51:3300/0 conn(0x7fbeb80a3bb0 0x7fbeb809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 -- 10.20.193.51:0/3307286167 >> v1:10.20.193.51:6789/0 conn(0x7fbeb809e540 legacy=0x7fbeb813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:06.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient: _add_conns ranks=[1,2] 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe980037f0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): picked mon.noname-b con 0x7fbe980074e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 -- 10.20.193.51:0/3307286167 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb809ccd0 con 0x7fbe980037f0 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 1 -- 10.20.193.51:0/3307286167 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb80a3f90 con 0x7fbe980074e0 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbe9ffff640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:06.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbe980074e0 auth_method 0 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 msgr2=0x7fbe98009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:06.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 msgr2=0x7fbe98009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:06.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:06.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.657+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:06.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.659+0000 7fbebe50b640 1 -- 10.20.193.51:0/3307286167 >> v1:10.20.193.142:6789/0 conn(0x7fbe980037f0 legacy=0x7fbe98005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbe980074e0 auth_method 0 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 msgr2=0x7fbe98009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 msgr2=0x7fbe98009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:06.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.858+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271014194 0 0) 0x7fbeb809ccd0 con 0x7fbe980037f0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): _negotiate 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): my global_id is 114295 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea0003620 con 0x7fbe980037f0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1795145959 0 0) 0x7fbea0003620 con 0x7fbe980037f0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 msgr2=0x7fbe98009980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbe980074e0 0x7fbe98009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _finish_hunting 0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9800b220 con 0x7fbe980037f0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _finish_auth 0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _check_auth_tickets 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fbea80096c0 con 0x7fbe980037f0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: dump: 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.882 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 >> v1:10.20.193.142:6789/0 conn(0x7fbe980037f0 legacy=0x7fbe98005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 reap_dead start 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0003b50 0x7fbea0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): picked mon.b con 0x7fbea0003b50 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea0004900 0x7fbea0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): picked mon.a con 0x7fbea0004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 0x7fbea000bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): picked mon.c con 0x7fbea00054c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb80a3f90 con 0x7fbea0004900 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbea000c3c0 con 0x7fbea0003b50 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbea000c5c0 con 0x7fbea00054c0 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebd509640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 0x7fbea000bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): get_auth_request con 0x7fbea00054c0 auth_method 0 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebe50b640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0003b50 0x7fbea0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbea0003b50 auth_method 0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebe50b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient(hunting): handle_auth_done global_id 114295 payload 293 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0003b50 msgr2=0x7fbea0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0003b50 0x7fbea0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea0004900 msgr2=0x7fbea0004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea0004900 0x7fbea0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 monclient: found mon.c 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea0003620 con 0x7fbea00054c0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient: _finish_auth 0 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 10 monclient: _check_auth_tickets 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbebed0c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbec0796640 5 monclient: authenticate success, global_id 114295 2026-02-17T11:56:06.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.879+0000 7fbec0796640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebed0c640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 msgr2=0x7fbea000bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebed0c640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 0x7fbea000bae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80a3020 tx=0x7fbeb402f3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641a2fbe5601b5d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4003830 con 0x7fbea00054c0 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: dump: 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.886 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb4033070 con 0x7fbea00054c0 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 1 -- 10.20.193.51:0/3307286167 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4038470 con 0x7fbea00054c0 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbebd509640 10 monclient: dump: 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 4 set_mon_vals no callback set 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 10 monclient: shutdown 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 -- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 msgr2=0x7fbea000bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 0x7fbea000bae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80a3020 tx=0x7fbeb402f3e0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 -- 10.20.193.51:0/3307286167 shutdown_connections 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea00054c0 0x7fbea000bae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea0004900 0x7fbea0004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 --2- 10.20.193.51:0/3307286167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0003b50 0x7fbea0003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 -- 10.20.193.51:0/3307286167 >> 10.20.193.51:0/3307286167 conn(0x7fbeb80a30c0 msgr2=0x7fbeb80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 -- 10.20.193.51:0/3307286167 shutdown_connections 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.882+0000 7fbec0796640 1 -- 10.20.193.51:0/3307286167 wait complete. 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient: build_initial_monmap 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient: monmap: 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 Processor -- start 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 -- start start 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient: init 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-c con 0x7fbea0003b50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0004900 0x7fbeb81cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-b con 0x7fbea0004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 0x7fbeb8091b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): picked mon.noname-a con 0x7fbea00054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb80a04b0 con 0x7fbea00054c0 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb809c850 con 0x7fbea0004900 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb809dac0 con 0x7fbea0003b50 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.883+0000 7fbec0796640 10 monclient(hunting): authenticate will time out at 1254.502990s 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56690/0 (socket says 10.20.193.51:56690) 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 -- 10.20.193.51:0/1893810566 learned_addr learned my addr 10.20.193.51:0/1893810566 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 10 monclient(hunting): get_auth_request con 0x7fbea0003b50 auth_method 0 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 0x7fbeb8091b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): get_auth_request con 0x7fbea00054c0 auth_method 0 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 msgr2=0x7fbeb81cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 msgr2=0x7fbeb81cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebe50b640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:06.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebdd0a640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0004900 0x7fbeb81cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request con 0x7fbea0004900 auth_method 0 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebdd0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebdd0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebdd0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient(hunting): handle_auth_done global_id 134187 payload 824 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 msgr2=0x7fbeb81cfa90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0004900 msgr2=0x7fbeb81cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0004900 0x7fbeb81cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 monclient: found mon.noname-a 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:06.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.884+0000 7fbebed0c640 1 -- 10.20.193.51:0/1893810566 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb8095780 con 0x7fbea00054c0 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbebed0c640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 msgr2=0x7fbeb8091b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbebed0c640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 0x7fbeb8091b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c790 tx=0x7fbeb4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb403a950 con 0x7fbea00054c0 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: dump: 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.891 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: _finish_auth 0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb403aaf0 con 0x7fbea00054c0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 5 monclient: authenticate success, global_id 134187 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 10 monclient: _renew_subs 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb80942d0 con 0x7fbea00054c0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4038470 con 0x7fbea00054c0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbebcd08640 4 set_mon_vals no callback set 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbe9effd640 10 monclient: dump: 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 10 monclient: _renew_subs 2026-02-17T11:56:06.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.886+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb8073920 con 0x7fbea00054c0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbec0796640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbec0796640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbec0796640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb808d6d0 con 0x7fbea00054c0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbeb404c030 con 0x7fbea00054c0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbe9effd640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 0x7fbe88040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(379..379 src has 167..379) ==== 4767+0+0 (secure 0 0 0) 0x7fbeb4076e70 con 0x7fbea00054c0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbebe50b640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 0x7fbe88040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.887+0000 7fbebe50b640 10 monclient: get_auth_request con 0x7fbe8803dd60 auth_method 0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.889+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbeb808d6d0 con 0x7fbea00054c0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.889+0000 7fbe9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.889+0000 7fbe9effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:06.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:06.890+0000 7fbebe50b640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 0x7fbe88040220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009350 tx=0x7fbea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbec0796640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbec0796640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbec0796640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbeb809d7b0 con 0x7fbea00054c0 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbe9effd640 1 -- 10.20.193.51:0/1893810566 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fbeb4035d90 con 0x7fbea00054c0 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbe9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.009+0000 7fbe9effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:07.013 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":88,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 msgr2=0x7fbe88040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 0x7fbe88040220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009350 tx=0x7fbea8008040 comp rx=0 tx=0).stop 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 10 monclient: shutdown 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 msgr2=0x7fbeb8091b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 0x7fbeb8091b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c790 tx=0x7fbeb4002ff0 comp rx=0 tx=0).stop 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 shutdown_connections 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbe8803dd60 0x7fbe88040220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbea00054c0 0x7fbeb8091b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:07.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbea0004900 0x7fbeb81cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:07.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 --2- 10.20.193.51:0/1893810566 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbea0003b50 0x7fbeb81cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:07.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 >> 10.20.193.51:0/1893810566 conn(0x7fbeb80a30c0 msgr2=0x7fbeb809bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:07.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 shutdown_connections 2026-02-17T11:56:07.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:07.010+0000 7fbec0796640 1 -- 10.20.193.51:0/1893810566 wait complete. 2026-02-17T11:56:07.171 INFO:tasks.rados.rados.0.trial142.stdout:1621: done (1 left) 2026-02-17T11:56:07.171 INFO:tasks.rados.rados.0.trial142.stdout:1622: done (0 left) 2026-02-17T11:56:07.171 INFO:tasks.rados.rados.0.trial142.stdout:1623: read oid 48 snap -1 2026-02-17T11:56:07.171 INFO:tasks.rados.rados.0.trial142.stdout:1623: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:56:07.172 INFO:tasks.rados.rados.0.trial142.stdout:1624: snap_remove snap 176 2026-02-17T11:56:08.170 INFO:tasks.rados.rados.0.trial142.stdout:1624: done (1 left) 2026-02-17T11:56:08.170 INFO:tasks.rados.rados.0.trial142.stdout:1625: snap_create 2026-02-17T11:56:08.171 INFO:tasks.rados.rados.0.trial142.stdout:1623: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:56:09.174 INFO:tasks.rados.rados.0.trial142.stdout:1623: done (1 left) 2026-02-17T11:56:09.174 INFO:tasks.rados.rados.0.trial142.stdout:1625: done (0 left) 2026-02-17T11:56:09.174 INFO:tasks.rados.rados.0.trial142.stdout:1626: read oid 19 snap -1 2026-02-17T11:56:09.174 INFO:tasks.rados.rados.0.trial142.stdout:1626: expect deleted 2026-02-17T11:56:09.174 INFO:tasks.rados.rados.0.trial142.stdout:1627: rollback oid 2 current snap is 179 2026-02-17T11:56:09.175 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 178 2026-02-17T11:56:09.175 INFO:tasks.rados.rados.0.trial142.stdout:1628: snap_create 2026-02-17T11:56:09.177 INFO:tasks.rados.rados.0.trial142.stdout:1627: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:56:09.177 INFO:tasks.rados.rados.0.trial142.stdout:1627: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:56:09.178 INFO:tasks.rados.rados.0.trial142.stdout:1627: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:56:09.178 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1219 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1626: done (2 left) 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1627: done (1 left) 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1628: done (0 left) 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1629: copy_from oid 47 from oid 12 current snap is 180 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1630: write oid 39 current snap is 180 2026-02-17T11:56:09.691 INFO:tasks.rados.rados.0.trial142.stdout:1630: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2026-02-17T11:56:09.694 INFO:tasks.rados.rados.0.trial142.stdout:1630: writing trial14245205-39 from 480832 to 950731 tid 1 2026-02-17T11:56:09.699 INFO:tasks.rados.rados.0.trial142.stdout:1630: writing trial14245205-39 from 1606334 to 2270534 tid 2 2026-02-17T11:56:09.705 INFO:tasks.rados.rados.0.trial142.stdout:1630: writing trial14245205-39 from 3018232 to 3680832 tid 3 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1631: read oid 31 snap -1 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1631: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1632: write (excl) oid 45 current snap is 180 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1630: finishing write tid 1 to trial14245205-39 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1630: finishing write tid 2 to trial14245205-39 2026-02-17T11:56:09.706 INFO:tasks.rados.rados.0.trial142.stdout:1632: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2026-02-17T11:56:09.709 INFO:tasks.rados.rados.0.trial142.stdout:1632: writing trial14245205-45 from 497639 to 1042787 tid 1 2026-02-17T11:56:09.712 INFO:tasks.rados.rados.0.trial142.stdout:1632: writing trial14245205-45 from 1548463 to 1956321 tid 2 2026-02-17T11:56:09.717 INFO:tasks.rados.rados.0.trial142.stdout:1632: writing trial14245205-45 from 2529302 to 3093724 tid 3 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1632: writing trial14245205-45 from 3528143 to 3697639 tid 4 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1633: snap_create 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1629: finishing copy_from racing read to trial14245205-47 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1629: finishing copy_from to trial14245205-47 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 967 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1630: finishing write tid 3 to trial14245205-39 2026-02-17T11:56:09.720 INFO:tasks.rados.rados.0.trial142.stdout:1630: finishing write tid 4 to trial14245205-39 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: finishing write tid 5 to trial14245205-39 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: oid 39 updating version 0 to 705 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: oid 39 updating version 705 to 707 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: oid 39 version 707 is already newer than 706 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: oid 39 version 707 is already newer than 704 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 707 (ObjNum 576 snap 180 seq_num 576) dirty exists 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1630: left oid 39 (ObjNum 576 snap 180 seq_num 576) 2026-02-17T11:56:09.721 INFO:tasks.rados.rados.0.trial142.stdout:1631: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 1 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 2 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 3 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 4 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 5 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: finishing write tid 6 to trial14245205-45 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: oid 45 updating version 0 to 971 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: oid 45 version 971 is already newer than 970 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: oid 45 version 971 is already newer than 967 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: oid 45 version 971 is already newer than 969 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: oid 45 version 971 is already newer than 968 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 971 (ObjNum 577 snap 180 seq_num 577) dirty exists 2026-02-17T11:56:09.923 INFO:tasks.rados.rados.0.trial142.stdout:1632: left oid 45 (ObjNum 577 snap 180 seq_num 577) 2026-02-17T11:56:10.021 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:10.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: get_monmap_and_config 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: monmap: 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:10.089220+0000 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:10.089220+0000 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 Processor -- start 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 -- start start 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: init 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-17T11:56:10.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa6d80a3bb0 0x7fa6d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-a con 0x7fa6d80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa6d80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-b con 0x7fa6d813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d806e140 con 0x7fa6d80a0750 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d809f910 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d809ccd0 con 0x7fa6d813b760 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.088+0000 7fa6dcb87640 10 monclient(hunting): authenticate will time out at 1257.707974s 2026-02-17T11:56:10.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa6d80a3bb0 0x7fa6d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d5d74640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa6d80a0750 0x7fa6d809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55244/0 (socket says 10.20.193.51:55244) 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d5d74640 1 -- 10.20.193.51:0/1548195808 learned_addr learned my addr 10.20.193.51:0/1548195808 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): get_auth_request con 0x7fa6d80a3bb0 auth_method 0 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 10 monclient(hunting): get_auth_request con 0x7fa6d813b760 auth_method 0 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 1 -- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 1 -- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6d76640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient(hunting): handle_auth_done global_id 134190 payload 274 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 -- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 -- 10.20.193.51:0/1548195808 >> v1:10.20.193.51:6789/0 conn(0x7fa6d80a0750 legacy=0x7fa6d809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.089+0000 7fa6d6575640 1 -- 10.20.193.51:0/1548195808 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d809eec0 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d6575640 1 -- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a3bb0 msgr2=0x7fa6d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d6575640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d809dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806c1c0 tx=0x7fa6cc02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d450b45aaba1dbee server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 1 -- 10.20.193.51:0/1548195808 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc03c070 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: dump: 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.105 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6dcb87640 5 monclient: authenticate success, global_id 134190 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 1 -- 10.20.193.51:0/1548195808 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc02fbd0 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6dcb87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6dcb87640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 1 -- 10.20.193.51:0/1548195808 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc037440 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6dcb87640 4 set_mon_vals no callback set 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.091+0000 7fa6d5573640 10 monclient: dump: 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.107 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 10 monclient: shutdown 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a3bb0 msgr2=0x7fa6d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d809dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806c1c0 tx=0x7fa6cc02ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1548195808 shutdown_connections 2026-02-17T11:56:10.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1548195808 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d809dac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1548195808 >> 10.20.193.51:0/1548195808 conn(0x7fa6d80a30c0 msgr2=0x7fa6d80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1548195808 shutdown_connections 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1548195808 wait complete. 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 10 monclient: monmap: 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.109 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 Processor -- start 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 1 -- start start 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.092+0000 7fa6dcb87640 10 monclient: init 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-a con 0x7fa6d80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:10.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d8094d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-b con 0x7fa6d80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): picked mon.noname-c con 0x7fa6d813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d80a04b0 con 0x7fa6d80a0750 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d809c850 con 0x7fa6d80a3bb0 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d809e710 con 0x7fa6d813b760 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6dcb87640 10 monclient(hunting): authenticate will time out at 1257.712059s 2026-02-17T11:56:10.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36764/0 (socket says 10.20.193.51:36764) 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 -- 10.20.193.51:0/1747255314 learned_addr learned my addr 10.20.193.51:0/1747255314 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): get_auth_request con 0x7fa6d80a0750 auth_method 0 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 10 monclient(hunting): get_auth_request con 0x7fa6d813b760 auth_method 0 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d8095250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d8095250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6d76640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient(hunting): handle_auth_done global_id 134193 payload 824 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 msgr2=0x7fa6d8095250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6d80a3bb0 msgr2=0x7fa6d8094d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d8094d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.093+0000 7fa6d6575640 1 -- 10.20.193.51:0/1747255314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d8098500 con 0x7fa6d80a0750 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6d6575640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 msgr2=0x7fa6d809c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6d6575640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0099a0 tx=0x7fa6cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc046070 con 0x7fa6d80a0750 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: dump: 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc041890 con 0x7fa6d80a0750 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 5 monclient: authenticate success, global_id 134193 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc03c040 con 0x7fa6d80a0750 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6beffd640 10 monclient: dump: 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.116 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6d4d72640 4 set_mon_vals no callback set 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 10 monclient: _renew_subs 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d806f5a0 con 0x7fa6d80a0750 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 10 monclient: _renew_subs 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.095+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d8098220 con 0x7fa6d80a0750 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6dcb87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6dcb87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6dcb87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d80988c0 con 0x7fa6d80a0750 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa6cc041cc0 con 0x7fa6d80a0750 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6beffd640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 0x7fa6a40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(383..383 src has 167..383) ==== 4795+0+0 (secure 0 0 0) 0x7fa6cc077ed0 con 0x7fa6d80a0750 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6d5d74640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 0x7fa6a40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.096+0000 7fa6d5d74640 10 monclient: get_auth_request con 0x7fa6a403dd10 auth_method 0 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.098+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa6cc040c70 con 0x7fa6d80a0750 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.098+0000 7fa6beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.098+0000 7fa6beffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:10.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.099+0000 7fa6d5d74640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 0x7fa6a40401d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0007fd0 tx=0x7fa6c0007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.212+0000 7fa6dcb87640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.212+0000 7fa6dcb87640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.212+0000 7fa6dcb87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.212+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa6d809dac0 con 0x7fa6d80a0750 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6beffd640 1 -- 10.20.193.51:0/1747255314 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fa6cc03fdf0 con 0x7fa6d80a0750 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:10.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6beffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:10.216 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 msgr2=0x7fa6a40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 0x7fa6a40401d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0007fd0 tx=0x7fa6c0007ba0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 10 monclient: shutdown 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 msgr2=0x7fa6d809c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0099a0 tx=0x7fa6cc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 shutdown_connections 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa6a403dd10 0x7fa6a40401d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa6d813b760 0x7fa6d8095250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa6d80a3bb0 0x7fa6d8094d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 --2- 10.20.193.51:0/1747255314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa6d80a0750 0x7fa6d809c260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 >> 10.20.193.51:0/1747255314 conn(0x7fa6d80a30c0 msgr2=0x7fa6d80a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.213+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 shutdown_connections 2026-02-17T11:56:10.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.214+0000 7fa6dcb87640 1 -- 10.20.193.51:0/1747255314 wait complete. 2026-02-17T11:56:10.223 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:56:10.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:56:10.224 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:56:10.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.289+0000 7f53cd779640 10 monclient: get_monmap_and_config 2026-02-17T11:56:10.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.289+0000 7f53cd779640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.289+0000 7f53cd779640 10 monclient: monmap: 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:10.290847+0000 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:10.290847+0000 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:10.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 Processor -- start 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 -- start start 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient: init 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-b con 0x7f53c80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53c80a0750 0x7f53c809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-a con 0x7f53c80a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:10.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f53c809e540 0x7f53c813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-c con 0x7f53c809e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f53c80a3f90 con 0x7f53c80a0750 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f53c806e140 con 0x7f53c809e540 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f53c809f910 con 0x7f53c80a3bb0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53cd779640 10 monclient(hunting): authenticate will time out at 1257.909591s 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56726/0 (socket says 10.20.193.51:56726) 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 -- 10.20.193.51:0/2749421444 learned_addr learned my addr 10.20.193.51:0/2749421444 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f53c80a0750 0x7f53c809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 10 monclient(hunting): get_auth_request con 0x7f53c80a3bb0 auth_method 0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): get_auth_request con 0x7f53c80a0750 auth_method 0 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 -- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 -- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c6ffd640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c77fe640 1 --2- 10.20.193.51:0/2749421444 >> v2:10.20.193.142:3300/0 conn(0x7f53c809e540 0x7f53c813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c77fe640 10 monclient(hunting): get_auth_request con 0x7f53c809e540 auth_method 0 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient(hunting): handle_auth_done global_id 134196 payload 274 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 -- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 -- 10.20.193.51:0/2749421444 >> v2:10.20.193.142:3300/0 conn(0x7f53c809e540 msgr2=0x7f53c813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 --2- 10.20.193.51:0/2749421444 >> v2:10.20.193.142:3300/0 conn(0x7f53c809e540 0x7f53c813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.290+0000 7f53c67fc640 1 -- 10.20.193.51:0/2749421444 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c809ccd0 con 0x7f53c80a0750 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c67fc640 1 -- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c80a0750 msgr2=0x7f53c809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c67fc640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c80a0750 0x7f53c809e000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53c809f230 tx=0x7f53b002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b578233ceecad24 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 1 -- 10.20.193.51:0/2749421444 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b003c070 con 0x7f53c80a0750 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: dump: 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.301 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 5 monclient: authenticate success, global_id 134196 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 1 -- 10.20.193.51:0/2749421444 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b002fbd0 con 0x7f53c80a0750 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 1 -- 10.20.193.51:0/2749421444 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0037440 con 0x7f53c80a0750 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 4 set_mon_vals no callback set 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53c5ffb640 10 monclient: dump: 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.302 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 10 monclient: shutdown 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 -- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c80a0750 msgr2=0x7f53c809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c80a0750 0x7f53c809e000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53c809f230 tx=0x7f53b002ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 -- 10.20.193.51:0/2749421444 shutdown_connections 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 --2- 10.20.193.51:0/2749421444 >> v2:10.20.193.142:3300/0 conn(0x7f53c809e540 0x7f53c813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c80a0750 0x7f53c809e000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 --2- 10.20.193.51:0/2749421444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 -- 10.20.193.51:0/2749421444 >> 10.20.193.51:0/2749421444 conn(0x7f53c80a30c0 msgr2=0x7f53c80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 -- 10.20.193.51:0/2749421444 shutdown_connections 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.293+0000 7f53cd779640 1 -- 10.20.193.51:0/2749421444 wait complete. 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient: monmap: 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:10.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 Processor -- start 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 -- start start 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient: init 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 0x7f53c81cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-a con 0x7f53c809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c80a0750 0x7f53c81d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-b con 0x7f53c80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c808fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): picked mon.noname-c con 0x7f53c80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f53c80a04b0 con 0x7f53c809e540 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f53c809c850 con 0x7f53c80a0750 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f53c813cca0 con 0x7f53c80a3bb0 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53cd779640 10 monclient(hunting): authenticate will time out at 1257.913874s 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 0x7f53c81cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 0x7f53c81cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36784/0 (socket says 10.20.193.51:36784) 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 1 -- 10.20.193.51:0/1619881821 learned_addr learned my addr 10.20.193.51:0/1619881821 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c808fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): get_auth_request con 0x7f53c809e540 auth_method 0 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 10 monclient(hunting): get_auth_request con 0x7f53c80a3bb0 auth_method 0 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c808fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c808fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c808fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.294+0000 7f53c77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c808fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 10 monclient(hunting): handle_auth_done global_id 134199 payload 824 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 msgr2=0x7f53c808fb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f53c80a3bb0 0x7f53c808fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c80a0750 msgr2=0x7f53c81d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f53c80a0750 0x7f53c81d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.295+0000 7f53c6ffd640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c8093a80 con 0x7f53c809e540 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c6ffd640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 msgr2=0x7f53c81cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c6ffd640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 0x7f53c81cfda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d830 tx=0x7f53bc00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc018030 con 0x7f53c809e540 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: dump: 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc00ba80 con 0x7f53c809e540 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 5 monclient: authenticate success, global_id 134199 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 monclient: _renew_subs 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c8091c30 con 0x7f53c809e540 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00bc70 con 0x7f53c809e540 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 10 monclient: dump: 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.307 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c57fa640 4 set_mon_vals no callback set 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 monclient: _renew_subs 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c80937a0 con 0x7f53c809e540 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 0x7f53c8138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8092510 con 0x7f53c8090830 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 0x7f53c8138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient: get_auth_request con 0x7f53c8090830 auth_method 0 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f53bc013050 con 0x7f53c809e540 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.297+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53c67fc640 10 monclient(hunting): handle_auth_done global_id 134202 payload 824 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53c67fc640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53c80a2510 con 0x7f53c8090830 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53a77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539403dd10 0x7f53940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(383..383 src has 167..383) ==== 4795+0+0 (secure 0 0 0) 0x7f53bc0523c0 con 0x7f53c809e540 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53c77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539403dd10 0x7f53940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.298+0000 7f53c77fe640 10 monclient: get_auth_request con 0x7f539403dd10 auth_method 0 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53c67fc640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 msgr2=0x7f53c8138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53c67fc640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 0x7f53c8138960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53b0039000 tx=0x7f53b0037670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0046020 con 0x7f53c8090830 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 10 monclient: dump: 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f53b0037b40 con 0x7f53c8090830 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 msgr2=0x7f53c8138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 0x7f53c8138960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53b0039000 tx=0x7f53b0037670 comp rx=0 tx=0).stop 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 msgr2=0x7f53c8138960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.300+0000 7f53a77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090830 0x7f53c8138960 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53b0039000 tx=0x7f53b0037670 comp rx=0 tx=0).stop 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.301+0000 7f53c77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539403dd10 0x7f53940401d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007330 tx=0x7f53b800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53cd779640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53cd779640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 0x7f53c81dada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53cd779640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f53c80a1ed0 con 0x7f53c8090c10 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 0x7f53c81dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient: get_auth_request con 0x7f53c8090c10 auth_method 0 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 10 monclient(hunting): handle_auth_done global_id 134205 payload 824 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.303+0000 7f53c67fc640 1 -- 10.20.193.51:0/1619881821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53c806e4a0 con 0x7f53c8090c10 2026-02-17T11:56:10.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.305+0000 7f53c67fc640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 msgr2=0x7f53c81dada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.305+0000 7f53c67fc640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 0x7f53c81dada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53b002ed90 tx=0x7f53b0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0046030 con 0x7f53c8090c10 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 10 monclient: dump: 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f53b004ae50 con 0x7f53c8090c10 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 msgr2=0x7f53c81dada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 0x7f53c81dada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53b002ed90 tx=0x7f53b0008030 comp rx=0 tx=0).stop 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 msgr2=0x7f53c81dada0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53a77fe640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c8090c10 0x7f53c81dada0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53b002ed90 tx=0x7f53b0008030 comp rx=0 tx=0).stop 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 70628, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:10.314 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.315 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:10.316 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.317 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:10.318 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.319 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.320 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:10.321 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.322 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:10.323 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:10.324 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539403dd10 msgr2=0x7f53940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f539403dd10 0x7f53940401d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007330 tx=0x7f53b800b040 comp rx=0 tx=0).stop 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 10 monclient: shutdown 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 msgr2=0x7f53c81cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 --2- 10.20.193.51:0/1619881821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f53c809e540 0x7f53c81cfda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d830 tx=0x7f53bc00dd00 comp rx=0 tx=0).stop 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53c77fe640 1 -- 10.20.193.51:0/1619881821 reap_dead start 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53c77fe640 1 -- 10.20.193.51:0/1619881821 reap_dead start 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 shutdown_connections 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 >> 10.20.193.51:0/1619881821 conn(0x7f53c80a30c0 msgr2=0x7f53c809bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 shutdown_connections 2026-02-17T11:56:10.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.306+0000 7f53cd779640 1 -- 10.20.193.51:0/1619881821 wait complete. 2026-02-17T11:56:10.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:10.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:56:10.326 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 10 monclient: get_monmap_and_config 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 10 monclient: monmap: 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:10.393431+0000 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:10.393431+0000 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:10.394 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 1 Processor -- start 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 1 -- start start 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.392+0000 7f9f32f87640 10 monclient: init 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-a con 0x7f9f2c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9f2c09e540 0x7f9f2c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-c con 0x7f9f2c09e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c0a3f90 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c06e140 con 0x7f9f2c09e540 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c09f910 con 0x7f9f2c0a0750 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f32f87640 10 monclient(hunting): authenticate will time out at 1258.012249s 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36818/0 (socket says 10.20.193.51:36818) 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 -- 10.20.193.51:0/1543482929 learned_addr learned my addr 10.20.193.51:0/1543482929 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): get_auth_request con 0x7f9f2c0a3bb0 auth_method 0 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 10 monclient(hunting): get_auth_request con 0x7f9f2c0a0750 auth_method 0 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 1 -- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 msgr2=0x7f9f2c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 1 -- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 msgr2=0x7f9f2c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f23fff640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f314fd640 1 --2- 10.20.193.51:0/1543482929 >> v2:10.20.193.142:3300/0 conn(0x7f9f2c09e540 0x7f9f2c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f314fd640 10 monclient(hunting): get_auth_request con 0x7f9f2c09e540 auth_method 0 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f314fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f314fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f314fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_done global_id 134208 payload 274 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 -- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 msgr2=0x7f9f2c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 -- 10.20.193.51:0/1543482929 >> v2:10.20.193.142:3300/0 conn(0x7f9f2c09e540 msgr2=0x7f9f2c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/1543482929 >> v2:10.20.193.142:3300/0 conn(0x7f9f2c09e540 0x7f9f2c13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.393+0000 7f9f30cfc640 1 -- 10.20.193.51:0/1543482929 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c09ccd0 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f30cfc640 1 -- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a3bb0 msgr2=0x7f9f2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c09f230 tx=0x7f9f1c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedf904773770bbc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 1 -- 10.20.193.51:0/1543482929 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c03c070 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: dump: 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 5 monclient: authenticate success, global_id 134208 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 1 -- 10.20.193.51:0/1543482929 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c02fca0 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 1 -- 10.20.193.51:0/1543482929 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c037660 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 4 set_mon_vals no callback set 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f237fe640 10 monclient: dump: 2026-02-17T11:56:10.400 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 10 monclient: shutdown 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 -- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a3bb0 msgr2=0x7f9f2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c09f230 tx=0x7f9f1c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 -- 10.20.193.51:0/1543482929 shutdown_connections 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 --2- 10.20.193.51:0/1543482929 >> v2:10.20.193.142:3300/0 conn(0x7f9f2c09e540 0x7f9f2c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a0750 0x7f9f2c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 --2- 10.20.193.51:0/1543482929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a3bb0 0x7f9f2c09dac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 -- 10.20.193.51:0/1543482929 >> 10.20.193.51:0/1543482929 conn(0x7f9f2c0a30c0 msgr2=0x7f9f2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 -- 10.20.193.51:0/1543482929 shutdown_connections 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 1 -- 10.20.193.51:0/1543482929 wait complete. 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.396+0000 7f9f32f87640 10 monclient: monmap: 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:10.401 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 Processor -- start 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 -- start start 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient: init 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2c09e540 0x7f9f2c1cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 0x7f9f2c1cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-a con 0x7f9f2c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): picked mon.noname-c con 0x7f9f2c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0a04b0 con 0x7f9f2c0a0750 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c09c850 con 0x7f9f2c09e540 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c13cca0 con 0x7f9f2c0a3bb0 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f32f87640 10 monclient(hunting): authenticate will time out at 1258.016359s 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 0x7f9f2c1cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56750/0 (socket says 10.20.193.51:56750) 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 -- 10.20.193.51:0/2820774273 learned_addr learned my addr 10.20.193.51:0/2820774273 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 10 monclient(hunting): get_auth_request con 0x7f9f2c0a3bb0 auth_method 0 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 0x7f9f2c1cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36820/0 (socket says 10.20.193.51:36820) 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): get_auth_request con 0x7f9f2c0a0750 auth_method 0 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 msgr2=0x7f9f2c08f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 msgr2=0x7f9f2c08f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f314fd640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient(hunting): handle_auth_done global_id 134211 payload 824 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2c09e540 0x7f9f2c1cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 msgr2=0x7f9f2c08f3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c0a3bb0 0x7f9f2c08f3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2c09e540 msgr2=0x7f9f2c1cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2c09e540 0x7f9f2c1cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f23fff640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c098f70 con 0x7f9f2c0a0750 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f30cfc640 10 monclient: get_auth_request con 0x7f9f2c09e540 auth_method 0 2026-02-17T11:56:10.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.397+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f2c09e540 0x7f9f2c1cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:10.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f23fff640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 msgr2=0x7f9f2c1cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f23fff640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 0x7f9f2c1cf8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e7e0 tx=0x7f9f1400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14017070 con 0x7f9f2c0a0750 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: dump: 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1400cb00 con 0x7f9f2c0a0750 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 5 monclient: authenticate success, global_id 134211 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 10 monclient: _renew_subs 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c092fa0 con 0x7f9f2c0a0750 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400f040 con 0x7f9f2c0a0750 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f22ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:10.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f217fa640 10 monclient: dump: 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 10 monclient: _renew_subs 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.399+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c099160 con 0x7f9f2c0a0750 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f32f87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f32f87640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c06e590 con 0x7f9f2c1cfe10 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 10 monclient: get_auth_request con 0x7f9f2c1cfe10 auth_method 0 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 msgr2=0x7f9f2c08f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 msgr2=0x7f9f2c08f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9f14012050 con 0x7f9f2c0a0750 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f217fa640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9efc03dd60 0x7f9efc040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(383..383 src has 167..383) ==== 4795+0+0 (secure 0 0 0) 0x7f9f14052360 con 0x7f9f2c0a0750 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f314fd640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9efc03dd60 0x7f9efc040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.400+0000 7f9f314fd640 10 monclient: get_auth_request con 0x7f9efc03dd60 auth_method 0 2026-02-17T11:56:10.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.403+0000 7f9f314fd640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9efc03dd60 0x7f9efc040220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c092910 tx=0x7f9f2800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient: get_auth_request con 0x7f9f2c1cfe10 auth_method 0 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_done global_id 144101 payload 824 2026-02-17T11:56:10.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.601+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f2c09dac0 con 0x7f9f2c1cfe10 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 msgr2=0x7f9f2c08f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c06c1c0 tx=0x7f9f1c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c03c040 con 0x7f9f2c1cfe10 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 10 monclient: dump: 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9f1c02fe50 con 0x7f9f2c1cfe10 2026-02-17T11:56:10.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.603+0000 7f9f217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.604+0000 7f9f217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:10.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.604+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 msgr2=0x7f9f2c08f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.604+0000 7f9f217fa640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c06c1c0 tx=0x7f9f1c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.604+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 msgr2=0x7f9f2c08f920 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.604+0000 7f9f217fa640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c1cfe10 0x7f9f2c08f920 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c06c1c0 tx=0x7f9f1c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f32f87640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f32f87640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 0x7f9f2c1da470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f32f87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c090270 con 0x7f9f2c08fe60 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 0x7f9f2c1da470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient: get_auth_request con 0x7f9f2c08fe60 auth_method 0 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 10 monclient(hunting): handle_auth_done global_id 144104 payload 824 2026-02-17T11:56:10.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.607+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f2c0008d0 con 0x7f9f2c08fe60 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f30cfc640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 msgr2=0x7f9f2c1da470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f30cfc640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 0x7f9f2c1da470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02eea0 tx=0x7f9f1c008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c03c040 con 0x7f9f2c08fe60 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 10 monclient: dump: 2026-02-17T11:56:10.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f9f1c0423f0 con 0x7f9f2c08fe60 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.609+0000 7f9f217fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 msgr2=0x7f9f2c1da470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f217fa640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 0x7f9f2c1da470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02eea0 tx=0x7f9f1c008030 comp rx=0 tx=0).stop 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f217fa640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 msgr2=0x7f9f2c1da470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f217fa640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f2c08fe60 0x7f9f2c1da470 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02eea0 tx=0x7f9f1c008030 comp rx=0 tx=0).stop 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10163, 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:10.614 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.615 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.616 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:10.617 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.618 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.619 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.621 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:10.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.624 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.625 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:10.626 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9efc03dd60 msgr2=0x7f9efc040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9efc03dd60 0x7f9efc040220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c092910 tx=0x7f9f2800b040 comp rx=0 tx=0).stop 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 10 monclient: shutdown 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 msgr2=0x7f9f2c1cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 --2- 10.20.193.51:0/2820774273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f2c0a0750 0x7f9f2c1cf8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e7e0 tx=0x7f9f1400ecb0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f314fd640 1 -- 10.20.193.51:0/2820774273 reap_dead start 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f314fd640 1 -- 10.20.193.51:0/2820774273 reap_dead start 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 shutdown_connections 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 >> 10.20.193.51:0/2820774273 conn(0x7f9f2c0a30c0 msgr2=0x7f9f2c09b560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 shutdown_connections 2026-02-17T11:56:10.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.610+0000 7f9f32f87640 1 -- 10.20.193.51:0/2820774273 wait complete. 2026-02-17T11:56:10.629 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:10.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:56:10.629 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:56:10.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 10 monclient: get_monmap_and_config 2026-02-17T11:56:10.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 10 monclient: monmap: 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:10.696226+0000 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:10.696226+0000 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:10.700 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 1 Processor -- start 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 1 -- start start 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 10 monclient: init 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.695+0000 7f95196f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f95140a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f95140a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f951413c770 0x7f951413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-a con 0x7f951413c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:10.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951409e8e0 con 0x7f95140a3bb0 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f9512ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f95140a3bb0 0x7f951409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55254/0 (socket says 10.20.193.51:55254) 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f9512ffd640 1 -- 10.20.193.51:0/1116896552 learned_addr learned my addr 10.20.193.51:0/1116896552 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951406e140 con 0x7f95140a0750 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f951409f910 con 0x7f951413c770 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 1 --2- 10.20.193.51:0/1116896552 >> v2:10.20.193.51:3300/0 conn(0x7f951413c770 0x7f951413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95196f3640 10 monclient(hunting): authenticate will time out at 1258.315160s 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): get_auth_request con 0x7f951413c770 auth_method 0 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient(hunting): handle_auth_done global_id 134214 payload 274 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 1 -- 10.20.193.51:0/1116896552 >> v1:10.20.193.142:6789/0 conn(0x7f95140a0750 legacy=0x7f951409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 1 -- 10.20.193.51:0/1116896552 >> v1:10.20.193.51:6789/0 conn(0x7f95140a3bb0 legacy=0x7f951409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:10.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.696+0000 7f95137fe640 1 -- 10.20.193.51:0/1116896552 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951409ccd0 con 0x7f951413c770 2026-02-17T11:56:10.705 INFO:tasks.rados.rados.0.trial142.stdout:1629: done (4 left) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1630: done (3 left) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1631: done (2 left) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1632: done (1 left) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1633: done (0 left) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1634: read oid 18 snap -1 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1634: expect (ObjNum 466 snap 141 seq_num 466) 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1635: write (excl) oid 24 current snap is 181 2026-02-17T11:56:10.706 INFO:tasks.rados.rados.0.trial142.stdout:1635: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2026-02-17T11:56:10.711 INFO:tasks.rados.rados.0.trial142.stdout:1635: writing trial14245205-24 from 514446 to 1251196 tid 1 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.698+0000 7f95137fe640 1 -- 10.20.193.51:0/1116896552 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f951413c770 msgr2=0x7f951413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.698+0000 7f95137fe640 1 --2- 10.20.193.51:0/1116896552 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f951413c770 0x7f951413eb60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9504009d90 tx=0x7f950402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d92dd1bd399f024 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.698+0000 7f9511ffb640 1 -- 10.20.193.51:0/1116896552 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950403c070 con 0x7f951413c770 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.698+0000 7f9511ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: dump: 2026-02-17T11:56:10.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 1 -- 10.20.193.51:0/1116896552 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9504037640 con 0x7f951413c770 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 5 monclient: authenticate success, global_id 134214 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 1 -- 10.20.193.51:0/1116896552 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504037a10 con 0x7f951413c770 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 4 set_mon_vals no callback set 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f9511ffb640 10 monclient: dump: 2026-02-17T11:56:10.718 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 10 monclient: shutdown 2026-02-17T11:56:10.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f951413c770 msgr2=0x7f951413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 --2- 10.20.193.51:0/1116896552 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f951413c770 0x7f951413eb60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9504009d90 tx=0x7f950402f190 comp rx=0 tx=0).stop 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 shutdown_connections 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 --2- 10.20.193.51:0/1116896552 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f951413c770 0x7f951413eb60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 >> 10.20.193.51:0/1116896552 conn(0x7f95140a30c0 msgr2=0x7f95140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 shutdown_connections 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 1 -- 10.20.193.51:0/1116896552 wait complete. 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.699+0000 7f95196f3640 10 monclient: monmap: 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:10.720 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 Processor -- start 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 -- start start 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient: init 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 0x7f951409b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-c con 0x7f95140a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 0x7f951409bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-a con 0x7f95140a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f951413c770 0x7f95140924f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): picked mon.noname-b con 0x7f951413c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f951409c850 con 0x7f95140a3bb0 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f951409ebe0 con 0x7f951413c770 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f95140a04b0 con 0x7f95140a0750 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95196f3640 10 monclient(hunting): authenticate will time out at 1258.319411s 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 0x7f951409b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 0x7f951409bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 0x7f951409bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36828/0 (socket says 10.20.193.51:36828) 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 0x7f951409b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56772/0 (socket says 10.20.193.51:56772) 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 1 -- 10.20.193.51:0/498288761 learned_addr learned my addr 10.20.193.51:0/498288761 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): get_auth_request con 0x7f95140a3bb0 auth_method 0 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): get_auth_request con 0x7f95140a0750 auth_method 0 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95137fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f951413c770 0x7f95140924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95137fe640 10 monclient(hunting): get_auth_request con 0x7f951413c770 auth_method 0 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient(hunting): handle_auth_done global_id 144107 payload 824 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f951413c770 msgr2=0x7f95140924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f951413c770 0x7f95140924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 msgr2=0x7f951409bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 0x7f951409bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 monclient: found mon.noname-c 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f9512ffd640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951413e610 con 0x7f95140a0750 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.700+0000 7f95127fc640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95140a3bb0 0x7f951409bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.702+0000 7f9512ffd640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 msgr2=0x7f951409b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.702+0000 7f9512ffd640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 0x7f951409b9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f950800c4a0 tx=0x7f950800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508007070 con 0x7f95140a0750 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:10.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: dump: 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508007210 con 0x7f95140a0750 2026-02-17T11:56:10.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 5 monclient: authenticate success, global_id 144107 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 monclient: _renew_subs 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95140a2aa0 con 0x7f95140a0750 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508007600 con 0x7f95140a0750 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95117fa640 4 set_mon_vals no callback set 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 10 monclient: dump: 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.727 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 monclient: _renew_subs 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9514096160 con 0x7f95140a0750 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 0x7f9514092a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9514094150 con 0x7f95141cf4e0 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f950801b400 con 0x7f95140a0750 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 0x7f9514092a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient: get_auth_request con 0x7f95141cf4e0 auth_method 0 2026-02-17T11:56:10.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f94e003dd60 0x7f94e0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(384..384 src has 167..384) ==== 4735+0+0 (secure 0 0 0) 0x7f9508052300 con 0x7f95140a0750 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.703+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.704+0000 7f95137fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f94e003dd60 0x7f94e0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.704+0000 7f95137fe640 10 monclient: get_auth_request con 0x7f94e003dd60 auth_method 0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.704+0000 7f95127fc640 10 monclient(hunting): handle_auth_done global_id 114310 payload 824 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.704+0000 7f95127fc640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f951409dac0 con 0x7f95141cf4e0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f95127fc640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 msgr2=0x7f9514092a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f95127fc640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 0x7f9514092a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00fc00 tx=0x7f94fc00d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f95137fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f94e003dd60 0x7f94e0040220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9504036000 tx=0x7f9504033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc018020 con 0x7f95141cf4e0 2026-02-17T11:56:10.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 10 monclient: dump: 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f94fc00fe40 con 0x7f95141cf4e0 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 msgr2=0x7f9514092a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 0x7f9514092a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00fc00 tx=0x7f94fc00d520 comp rx=0 tx=0).stop 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 msgr2=0x7f9514092a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.706+0000 7f94f37fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f95141cf4e0 0x7f9514092a30 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00fc00 tx=0x7f94fc00d520 comp rx=0 tx=0).stop 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95196f3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95196f3640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 0x7f95141da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95196f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9514093380 con 0x7f9514092f70 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 0x7f95141da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient: get_auth_request con 0x7f9514092f70 auth_method 0 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.710+0000 7f95127fc640 10 monclient(hunting): handle_auth_done global_id 114313 payload 824 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.711+0000 7f95127fc640 1 -- 10.20.193.51:0/498288761 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95140945b0 con 0x7f9514092f70 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95127fc640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 msgr2=0x7f95141da5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95127fc640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 0x7f95141da5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f94fc019000 tx=0x7f94fc003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc018070 con 0x7f9514092f70 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 10 monclient: dump: 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f94fc014aa0 con 0x7f9514092f70 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 msgr2=0x7f95141da5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 0x7f95141da5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f94fc019000 tx=0x7f94fc003860 comp rx=0 tx=0).stop 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 msgr2=0x7f95141da5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f94f37fe640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9514092f70 0x7f95141da5e0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f94fc019000 tx=0x7f94fc003860 comp rx=0 tx=0).stop 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:10.733 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 172589, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.734 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.735 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:10.736 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.737 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.738 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.739 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:10.740 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:10.741 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:10.742 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1635: writing trial14245205-24 from 1723298 to 2391167 tid 2 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1635: writing trial14245205-24 from 3073078 to 3714446 tid 3 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: write (excl) oid 29 current snap is 181 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: seq_num 579 ranges {531253=411999,1381780=411527,2300501=586966,3376974=354279} 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: writing trial14245205-29 from 531253 to 943252 tid 1 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: writing trial14245205-29 from 1381780 to 1793307 tid 2 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: writing trial14245205-29 from 2300501 to 2887467 tid 3 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1636: writing trial14245205-29 from 3376974 to 3731253 tid 4 2026-02-17T11:56:10.744 INFO:tasks.rados.rados.0.trial142.stdout:1637: snap_remove snap 161 2026-02-17T11:56:10.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f94e003dd60 msgr2=0x7f94e0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f94e003dd60 0x7f94e0040220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9504036000 tx=0x7f9504033000 comp rx=0 tx=0).stop 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 10 monclient: shutdown 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 msgr2=0x7f951409b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95196f3640 1 --2- 10.20.193.51:0/498288761 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95140a0750 0x7f951409b9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f950800c4a0 tx=0x7f950800c970 comp rx=0 tx=0).stop 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95137fe640 1 -- 10.20.193.51:0/498288761 reap_dead start 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.713+0000 7f95137fe640 1 -- 10.20.193.51:0/498288761 reap_dead start 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.714+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 shutdown_connections 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.714+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 >> 10.20.193.51:0/498288761 conn(0x7f95140a30c0 msgr2=0x7f95140a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.714+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 shutdown_connections 2026-02-17T11:56:10.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.714+0000 7f95196f3640 1 -- 10.20.193.51:0/498288761 wait complete. 2026-02-17T11:56:10.745 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:10.745 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:56:10.745 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.810+0000 7fd3b4b49640 10 monclient: get_monmap_and_config 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.810+0000 7fd3b4b49640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.810+0000 7fd3b4b49640 10 monclient: monmap: 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:10.811670+0000 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:10.811670+0000 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:10.812 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:10.813 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 Processor -- start 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 -- start start 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient: init 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 0x7fd3b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-b con 0x7fd3b00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd3b00a0750 0x7fd3b009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-c con 0x7fd3b00a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3b009e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b006e140 con 0x7fd3b009e540 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b00a3f90 con 0x7fd3b00a0750 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b009f910 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3b4b49640 10 monclient(hunting): authenticate will time out at 1258.430434s 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 0x7fd3b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3aed76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd3b009e540 0x7fd3b013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55260/0 (socket says 10.20.193.51:55260) 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3aed76640 1 -- 10.20.193.51:0/1086711128 learned_addr learned my addr 10.20.193.51:0/1086711128 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): get_auth_request con 0x7fd3b00a3bb0 auth_method 0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 1 --2- 10.20.193.51:0/1086711128 >> v2:10.20.193.142:3300/0 conn(0x7fd3b00a0750 0x7fd3b009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): get_auth_request con 0x7fd3b00a0750 auth_method 0 2026-02-17T11:56:10.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient(hunting): handle_auth_done global_id 144110 payload 274 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 -- 10.20.193.51:0/1086711128 >> v2:10.20.193.142:3300/0 conn(0x7fd3b00a0750 msgr2=0x7fd3b009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 --2- 10.20.193.51:0/1086711128 >> v2:10.20.193.142:3300/0 conn(0x7fd3b00a0750 0x7fd3b009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 -- 10.20.193.51:0/1086711128 >> v1:10.20.193.51:6789/0 conn(0x7fd3b009e540 legacy=0x7fd3b013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 monclient: found mon.noname-b 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.811+0000 7fd3ae575640 1 -- 10.20.193.51:0/1086711128 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b009ccd0 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ae575640 1 -- 10.20.193.51:0/1086711128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 msgr2=0x7fd3b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ae575640 1 --2- 10.20.193.51:0/1086711128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 0x7fd3b009dac0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0069d60 tx=0x7fd3a402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549590befc4ef192 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 1 -- 10.20.193.51:0/1086711128 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a403c070 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: dump: 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 1 -- 10.20.193.51:0/1086711128 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a402fbd0 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 1 -- 10.20.193.51:0/1086711128 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4037440 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 5 monclient: authenticate success, global_id 144110 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 4 set_mon_vals no callback set 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3ad573640 10 monclient: dump: 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 10 monclient: shutdown 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 -- 10.20.193.51:0/1086711128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 msgr2=0x7fd3b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/1086711128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 0x7fd3b009dac0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0069d60 tx=0x7fd3a402ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 -- 10.20.193.51:0/1086711128 shutdown_connections 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/1086711128 >> v2:10.20.193.142:3300/0 conn(0x7fd3b00a0750 0x7fd3b009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/1086711128 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b00a3bb0 0x7fd3b009dac0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 -- 10.20.193.51:0/1086711128 >> 10.20.193.51:0/1086711128 conn(0x7fd3b00a30c0 msgr2=0x7fd3b00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 -- 10.20.193.51:0/1086711128 shutdown_connections 2026-02-17T11:56:10.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.814+0000 7fd3b4b49640 1 -- 10.20.193.51:0/1086711128 wait complete. 2026-02-17T11:56:10.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient: build_initial_monmap 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient: monmap: 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 Processor -- start 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 -- start start 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient: init 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-c con 0x7fd3b009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3b00a0750 0x7fd3b01305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-b con 0x7fd3b00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd3b00a3bb0 0x7fd3b0130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): picked mon.noname-a con 0x7fd3b00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b00a04b0 con 0x7fd3b00a3bb0 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b009c850 con 0x7fd3b00a0750 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b013de80 con 0x7fd3b009e540 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3b4b49640 10 monclient(hunting): authenticate will time out at 1258.434613s 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56790/0 (socket says 10.20.193.51:56790) 2026-02-17T11:56:10.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 -- 10.20.193.51:0/3112379780 learned_addr learned my addr 10.20.193.51:0/3112379780 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): get_auth_request con 0x7fd3b009e540 auth_method 0 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd3b00a3bb0 0x7fd3b0130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): get_auth_request con 0x7fd3b00a3bb0 auth_method 0 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3aed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient(hunting): handle_auth_done global_id 144113 payload 824 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 -- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3b00a0750 msgr2=0x7fd3b01305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3b00a0750 0x7fd3b01305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 -- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd3b00a3bb0 msgr2=0x7fd3b0130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd3b00a3bb0 0x7fd3b0130b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 monclient: found mon.noname-c 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.815+0000 7fd3ae575640 1 -- 10.20.193.51:0/3112379780 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b0131e60 con 0x7fd3b009e540 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.817+0000 7fd3ae575640 1 -- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 msgr2=0x7fd3b01300b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.817+0000 7fd3ae575640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40099a0 tx=0x7fd3a40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a403c040 con 0x7fd3b009e540 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: dump: 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 5 monclient: authenticate success, global_id 144113 2026-02-17T11:56:10.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4047070 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _renew_subs 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b009d7b0 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4040a60 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3acd72640 4 set_mon_vals no callback set 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 10 monclient: dump: 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _renew_subs 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b006f8d0 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b0139640 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd3a403f030 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 0x7fd37c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.818+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(384..384 src has 167..384) ==== 4735+0+0 (secure 0 0 0) 0x7fd3a4077910 con 0x7fd3b009e540 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.819+0000 7fd3add74640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 0x7fd37c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:10.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.819+0000 7fd3add74640 10 monclient: get_auth_request con 0x7fd37c03dd10 auth_method 0 2026-02-17T11:56:10.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.821+0000 7fd3add74640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 0x7fd37c0401d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0074fa0 tx=0x7fd3980096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:10.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.821+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd3b0139640 con 0x7fd3b009e540 2026-02-17T11:56:10.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.821+0000 7fd396ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:10.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.821+0000 7fd396ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:10.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.937+0000 7fd3b4b49640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:56:10.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.937+0000 7fd3b4b49640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:56:10.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.937+0000 7fd3b4b49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:10.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.937+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd3b009dac0 con 0x7fd3b009e540 2026-02-17T11:56:10.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=11,kv=12,logm=55} crc {auth=1123842888,config=692619927,health=2267228605,kv=2594088328,logm=1793918001}) 2026-02-17T11:56:10.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=22,config=1,health=12,kv=12,logm=53} crc {auth=940414212,config=3678701417,health=1784518911,kv=643764953,logm=3985193924}) 2026-02-17T11:56:10.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=11,kv=12,logm=55} crc {auth=1123842888,config=692619927,health=2267228605,kv=2594088328,logm=1793918001}) 2026-02-17T11:56:10.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=12,logm=53} crc {auth=1009957666,config=2435484489,health=1784518911,kv=643764953,logm=4070232805}) 2026-02-17T11:56:10.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.938+0000 7fd396ffd640 1 -- 10.20.193.51:0/3112379780 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fd3b009d7b0 con 0x7fd3b009e540 2026-02-17T11:56:10.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.938+0000 7fd396ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:56:10.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.938+0000 7fd396ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:10.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4145012988}) 2026-02-17T11:56:10.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3923045436}) 2026-02-17T11:56:10.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4145012988}) 2026-02-17T11:56:10.943 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.938+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2997217160}) 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 msgr2=0x7fd37c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 0x7fd37c0401d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0074fa0 tx=0x7fd3980096a0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 10 monclient: shutdown 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 msgr2=0x7fd3b01300b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40099a0 tx=0x7fd3a40047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 shutdown_connections 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd37c03dd10 0x7fd37c0401d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd3b00a3bb0 0x7fd3b0130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3b00a0750 0x7fd3b01305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 --2- 10.20.193.51:0/3112379780 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3b009e540 0x7fd3b01300b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 >> 10.20.193.51:0/3112379780 conn(0x7fd3b00a30c0 msgr2=0x7fd3b0073000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 shutdown_connections 2026-02-17T11:56:10.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:10.939+0000 7fd3b4b49640 1 -- 10.20.193.51:0/3112379780 wait complete. 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=352945456}) 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3850180287}) 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=352945456}) 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1389939944}) 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138838826}) 2026-02-17T11:56:10.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2364566783}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138838826}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.939+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3950725779}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251402394}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811100254}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251402394}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2309382852}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=248833164}) 2026-02-17T11:56:10.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=93788924}) 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=248833164}) 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4196053332}) 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2011337612}) 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3246574838}) 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.954 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2011337612}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.940+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1670294512}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=580369766}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1396171297}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=580369766}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=575711710}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2784385407}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=302913180}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2784385407}) 2026-02-17T11:56:10.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3212078476}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2407982393}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=7337054}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2407982393}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.941+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2573992545}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838718732}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4280684476}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838718732}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1980473230}) 2026-02-17T11:56:10.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000410449}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3622537297}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000410449}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=51165697}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3715657523}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=365989015}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3715657523}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.942+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3194250544}) 2026-02-17T11:56:10.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4215940108}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3625550197}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4215940108}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3055410856}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=236129176}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1602916702}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=236129176}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3930334668}) 2026-02-17T11:56:10.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2696315131}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2061008649}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2696315131}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.943+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2286965949}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844436467}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3823646066}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844436467}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=284772922}) 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2889588054}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3723727210}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2889588054}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1322111508}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1732369651}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=462101172}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1732369651}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3351743038}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3483431554}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.944+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3005138631}) 2026-02-17T11:56:10.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3483431554}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=365035358}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1739553979}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3242183277}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1739553979}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1098192505}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3677600533}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=99595502}) 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:10.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3677600533}) 2026-02-17T11:56:10.962 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:10.945+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=496240188}) 2026-02-17T11:56:10.963 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:56:11.135 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.135 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224301713}) 2026-02-17T11:56:11.135 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1135353128}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224301713}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1954192103}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1456600467}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3879675030}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1456600467}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.128+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=848638785}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2756567727}) 2026-02-17T11:56:11.136 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2421554219}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2756567727}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=756316604}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111088273}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2415763631}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111088273}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1254237067}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624401949}) 2026-02-17T11:56:11.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2199872336}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624401949}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.129+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=477003844}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4045390179}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1432300180}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4045390179}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2405383225}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3139023347}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3272488795}) 2026-02-17T11:56:11.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3139023347}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.130+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4252734183}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679160294}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1166260356}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679160294}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1038371006}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209562980}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1333336678}) 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209562980}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2746927218}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=845498869}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3002485546}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=845498869}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.131+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3992684288}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3766980259}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3456154313}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3766980259}) 2026-02-17T11:56:11.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2575238831}) 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1920466914}) 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1707572967}) 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1920466914}) 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.132+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3870136733}) 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.141 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015168604}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4046148525}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015168604}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650776597}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965510178}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3291908057}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965510178}) 2026-02-17T11:56:11.142 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.133+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3170806770}) 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=73,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=7} crc {logm=3789348742,mdsmap=3140514009,mgr=2645453887,mgr_command_descs=1238205435,mgrstat=950052907,mon_config_key=3202994854}) 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=77,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=1} crc {logm=408030519,mdsmap=3207544932,mgr=4058783121,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=855023966,mon_config_key=3777742722}) 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=73,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=7} crc {logm=3789348742,mdsmap=3140514009,mgr=2645453887,mgr_command_descs=1238205435,mgrstat=950052907,mon_config_key=3202994854}) 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=75,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=2} crc {logm=3932438156,mdsmap=3207544932,mgr=2242172100,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=569401469,mon_config_key=877951575}) 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=5,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=64,osdmap=22} crc {mon_config_key=3814836199,monmap=263989209,osd_metadata=101123558,osd_pg_creating=762033013,osd_snap=2030543472,osdmap=3200062601}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=6,monmap=3,osd_metadata=6,osd_snap=66,osdmap=19} crc {mon_config_key=775002920,monmap=263989209,osd_metadata=3956758304,osd_snap=671707549,osdmap=2970844395}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=5,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=64,osdmap=22} crc {mon_config_key=3814836199,monmap=263989209,osd_metadata=101123558,osd_pg_creating=762033013,osd_snap=2030543472,osdmap=3200062601}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.134+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=5,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=65,osdmap=21} crc {mon_config_key=3814836199,monmap=263989209,osd_metadata=2557680352,osd_pg_creating=762033013,osd_snap=1179805087,osdmap=4103218583}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1549992882}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1040380867}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1549992882}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2761086009}) 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=992286707}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2019904515}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=992286707}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.135+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=495440156}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3066001829}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3476247627}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3066001829}) 2026-02-17T11:56:11.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:11.136+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1717187919}) 2026-02-17T11:56:11.704 INFO:tasks.rados.rados.0.trial142.stdout:1637: done (3 left) 2026-02-17T11:56:11.705 INFO:tasks.rados.rados.0.trial142.stdout:1638: write (excl) oid 20 current snap is 181 2026-02-17T11:56:11.705 INFO:tasks.rados.rados.0.trial142.stdout:1638: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2026-02-17T11:56:11.709 INFO:tasks.rados.rados.0.trial142.stdout:1638: writing trial14245205-20 from 548060 to 1035308 tid 1 2026-02-17T11:56:11.713 INFO:tasks.rados.rados.0.trial142.stdout:1638: writing trial14245205-20 from 1440262 to 2111800 tid 2 2026-02-17T11:56:11.720 INFO:tasks.rados.rados.0.trial142.stdout:1638: writing trial14245205-20 from 2844277 to 3642515 tid 3 2026-02-17T11:56:11.720 INFO:tasks.rados.rados.0.trial142.stdout:1639: snap_remove snap 147 2026-02-17T11:56:11.963 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:56:11.964 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.029+0000 7fe0d5d51640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.029+0000 7fe0d5d51640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.029+0000 7fe0d5d51640 10 monclient: monmap: 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:12.030781+0000 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:12.030781+0000 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 Processor -- start 2026-02-17T11:56:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 -- start start 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient: init 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe0d00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe0d00a0750 0x7fe0d009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-a con 0x7fe0d00a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 0x7fe0d013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-b con 0x7fe0d013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d006e140 con 0x7fe0d00a3bb0 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d009f910 con 0x7fe0d00a0750 2026-02-17T11:56:12.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d009ccd0 con 0x7fe0d013b760 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0d5d51640 10 monclient(hunting): authenticate will time out at 1259.649499s 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe0d00a0750 0x7fe0d009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 0x7fe0d013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe0d00a0750 0x7fe0d009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36848/0 (socket says 10.20.193.51:36848) 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 -- 10.20.193.51:0/870762624 learned_addr learned my addr 10.20.193.51:0/870762624 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request con 0x7fe0d00a0750 auth_method 0 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): get_auth_request con 0x7fe0d013b760 auth_method 0 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_done global_id 134223 payload 274 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 -- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 msgr2=0x7fe0d013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 0x7fe0d013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 -- 10.20.193.51:0/870762624 >> v1:10.20.193.142:6789/0 conn(0x7fe0d00a3bb0 legacy=0x7fe0d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0ceffd640 1 -- 10.20.193.51:0/870762624 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d009eec0 con 0x7fe0d00a0750 2026-02-17T11:56:12.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.030+0000 7fe0cffff640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 0x7fe0d013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ceffd640 1 -- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d00a0750 msgr2=0x7fe0d009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ceffd640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d00a0750 0x7fe0d009e1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0d006f3c0 tx=0x7fe0c002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc966c58bcf1562 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 1 -- 10.20.193.51:0/870762624 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c003c070 con 0x7fe0d00a0750 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: dump: 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 1 -- 10.20.193.51:0/870762624 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c002fca0 con 0x7fe0d00a0750 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 1 -- 10.20.193.51:0/870762624 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0037660 con 0x7fe0d00a0750 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 5 monclient: authenticate success, global_id 134223 2026-02-17T11:56:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0ce7fc640 10 monclient: dump: 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.049 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 4 set_mon_vals no callback set 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 10 monclient: shutdown 2026-02-17T11:56:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 -- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d00a0750 msgr2=0x7fe0d009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d00a0750 0x7fe0d009e1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0d006f3c0 tx=0x7fe0c002ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 -- 10.20.193.51:0/870762624 shutdown_connections 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d013b760 0x7fe0d013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/870762624 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d00a0750 0x7fe0d009e1d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 -- 10.20.193.51:0/870762624 >> 10.20.193.51:0/870762624 conn(0x7fe0d00a30c0 msgr2=0x7fe0d00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 -- 10.20.193.51:0/870762624 shutdown_connections 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.033+0000 7fe0d5d51640 1 -- 10.20.193.51:0/870762624 wait complete. 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient: monmap: 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:12.052 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 Processor -- start 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 -- start start 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient: init 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d00a0750 0x7fe0d0130fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-c con 0x7fe0d00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0d00a3bb0 0x7fe0d01314f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-b con 0x7fe0d00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): picked mon.noname-a con 0x7fe0d013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d00a04b0 con 0x7fe0d013b760 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d009c850 con 0x7fe0d00a3bb0 2026-02-17T11:56:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d009e710 con 0x7fe0d00a0750 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0d5d51640 10 monclient(hunting): authenticate will time out at 1259.653708s 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d00a0750 0x7fe0d0130fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36862/0 (socket says 10.20.193.51:36862) 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 -- 10.20.193.51:0/3857088098 learned_addr learned my addr 10.20.193.51:0/3857088098 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): get_auth_request con 0x7fe0d013b760 auth_method 0 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request con 0x7fe0d00a0750 auth_method 0 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0ceffd640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0d00a3bb0 0x7fe0d01314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request con 0x7fe0d00a3bb0 auth_method 0 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient(hunting): handle_auth_done global_id 134226 payload 824 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 -- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d00a0750 msgr2=0x7fe0d0130fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d00a0750 0x7fe0d0130fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 -- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0d00a3bb0 msgr2=0x7fe0d01314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0d00a3bb0 0x7fe0d01314f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.034+0000 7fe0cffff640 1 -- 10.20.193.51:0/3857088098 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d01330e0 con 0x7fe0d013b760 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0cffff640 1 -- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 msgr2=0x7fe0d0131a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0cffff640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009e00 tx=0x7fe0c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4018020 con 0x7fe0d013b760 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: dump: 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.059 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c4014680 con 0x7fe0d013b760 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4014a50 con 0x7fe0d013b760 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0cdffb640 4 set_mon_vals no callback set 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 10 monclient: dump: 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 5 monclient: authenticate success, global_id 134226 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _renew_subs 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d0134c80 con 0x7fe0d013b760 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _renew_subs 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d009d7b0 con 0x7fe0d013b760 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe0c4014c70 con 0x7fe0d013b760 2026-02-17T11:56:12.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d009dac0 con 0x7fe0d013b760 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.037+0000 7fe0abfff640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 0x7fe0a0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.038+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7fe0c4053510 con 0x7fe0d013b760 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.038+0000 7fe0cf7fe640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 0x7fe0a0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.038+0000 7fe0cf7fe640 10 monclient: get_auth_request con 0x7fe0a003dd60 auth_method 0 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.040+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe0c4022030 con 0x7fe0d013b760 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.040+0000 7fe0abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.040+0000 7fe0abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:12.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.040+0000 7fe0cf7fe640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 0x7fe0a0040220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc005160 tx=0x7fe0bc007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0d5d51640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0d5d51640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0d5d51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0d00008d0 con 0x7fe0d013b760 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0abfff640 1 -- 10.20.193.51:0/3857088098 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fe0c4010040 con 0x7fe0d013b760 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.160+0000 7fe0abfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:12.162 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 msgr2=0x7fe0a0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 0x7fe0a0040220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc005160 tx=0x7fe0bc007f30 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 10 monclient: shutdown 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 msgr2=0x7fe0d0131a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009e00 tx=0x7fe0c400c490 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 shutdown_connections 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe0a003dd60 0x7fe0a0040220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe0d013b760 0x7fe0d0131a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe0d00a3bb0 0x7fe0d01314f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 --2- 10.20.193.51:0/3857088098 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe0d00a0750 0x7fe0d0130fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 >> 10.20.193.51:0/3857088098 conn(0x7fe0d00a30c0 msgr2=0x7fe0d013a170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 shutdown_connections 2026-02-17T11:56:12.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.161+0000 7fe0d5d51640 1 -- 10.20.193.51:0/3857088098 wait complete. 2026-02-17T11:56:12.169 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:56:12.170 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:56:12.170 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:56:12.170 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.239+0000 7f05a7a96640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.239+0000 7f05a7a96640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.239+0000 7f05a7a96640 10 monclient: monmap: 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:12.240799+0000 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:12.240799+0000 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:12.242 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:12.242 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:12.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 Processor -- start 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 -- start start 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient: init 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f05a00a3bb0 0x7f05a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-c con 0x7f05a00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f05a00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-b con 0x7f05a013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a006e140 con 0x7f05a00a0750 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f05a009f910 con 0x7f05a00a3bb0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f05a009ccd0 con 0x7f05a013b760 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a7a96640 10 monclient(hunting): authenticate will time out at 1259.859540s 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56808/0 (socket says 10.20.193.51:56808) 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 -- 10.20.193.51:0/3820520811 learned_addr learned my addr 10.20.193.51:0/3820520811 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): get_auth_request con 0x7f05a013b760 auth_method 0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 1 --2- 10.20.193.51:0/3820520811 >> v2:10.20.193.142:3300/0 conn(0x7f05a00a3bb0 0x7f05a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): get_auth_request con 0x7f05a00a3bb0 auth_method 0 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient(hunting): handle_auth_done global_id 144122 payload 274 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 -- 10.20.193.51:0/3820520811 >> v2:10.20.193.142:3300/0 conn(0x7f05a00a3bb0 msgr2=0x7f05a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 --2- 10.20.193.51:0/3820520811 >> v2:10.20.193.142:3300/0 conn(0x7f05a00a3bb0 0x7f05a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 -- 10.20.193.51:0/3820520811 >> v1:10.20.193.142:6789/0 conn(0x7f05a00a0750 legacy=0x7f05a009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 monclient: found mon.noname-b 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.240+0000 7f05a600c640 1 -- 10.20.193.51:0/3820520811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a009eec0 con 0x7f05a013b760 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a600c640 1 -- 10.20.193.51:0/3820520811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 msgr2=0x7f05a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a600c640 1 --2- 10.20.193.51:0/3820520811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05a006c1c0 tx=0x7f059c02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1871a4e1b839aa0e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 1 -- 10.20.193.51:0/3820520811 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c02fe60 con 0x7f05a013b760 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: dump: 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 1 -- 10.20.193.51:0/3820520811 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c0373f0 con 0x7f05a013b760 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 5 monclient: authenticate success, global_id 144122 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 1 -- 10.20.193.51:0/3820520811 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c0377c0 con 0x7f05a013b760 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:12.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a4809640 10 monclient: dump: 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 4 set_mon_vals no callback set 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 10 monclient: shutdown 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 -- 10.20.193.51:0/3820520811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 msgr2=0x7f05a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 --2- 10.20.193.51:0/3820520811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05a006c1c0 tx=0x7f059c02f230 comp rx=0 tx=0).stop 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 -- 10.20.193.51:0/3820520811 shutdown_connections 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 --2- 10.20.193.51:0/3820520811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a013db50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 --2- 10.20.193.51:0/3820520811 >> v2:10.20.193.142:3300/0 conn(0x7f05a00a3bb0 0x7f05a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 -- 10.20.193.51:0/3820520811 >> 10.20.193.51:0/3820520811 conn(0x7f05a00a30c0 msgr2=0x7f05a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 -- 10.20.193.51:0/3820520811 shutdown_connections 2026-02-17T11:56:12.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.243+0000 7f05a7a96640 1 -- 10.20.193.51:0/3820520811 wait complete. 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient: monmap: 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 Processor -- start 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 -- start start 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient: init 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05a00a0750 0x7f05a00961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-b con 0x7f05a00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a00a3bb0 0x7f05a0096730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-a con 0x7f05a00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a0096c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): picked mon.noname-c con 0x7f05a013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f05a00a04b0 con 0x7f05a00a3bb0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05a009c850 con 0x7f05a00a0750 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f05a009e710 con 0x7f05a013b760 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a7a96640 10 monclient(hunting): authenticate will time out at 1259.863543s 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a0096c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a0096c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56824/0 (socket says 10.20.193.51:56824) 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 learned_addr learned my addr 10.20.193.51:0/2703251322 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): get_auth_request con 0x7f05a013b760 auth_method 0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a00a3bb0 0x7f05a0096730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): get_auth_request con 0x7f05a00a3bb0 auth_method 0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a580b640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05a00a0750 0x7f05a00961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a500a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a580b640 10 monclient(hunting): get_auth_request con 0x7f05a00a0750 auth_method 0 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a580b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a580b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient(hunting): handle_auth_done global_id 144125 payload 824 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05a00a0750 msgr2=0x7f05a00961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05a00a0750 0x7f05a00961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a00a3bb0 msgr2=0x7f05a0096730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a00a3bb0 0x7f05a0096730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 monclient: found mon.noname-c 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.244+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a0099890 con 0x7f05a013b760 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 msgr2=0x7f05a0096c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f05a600c640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a0096c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f059c02f740 tx=0x7f059c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c046020 con 0x7f05a013b760 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 10 monclient: dump: 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.246+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c037e40 con 0x7f05a013b760 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c041ab0 con 0x7f05a013b760 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058ffff640 4 set_mon_vals no callback set 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 10 monclient: dump: 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 5 monclient: authenticate success, global_id 144125 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 monclient: _renew_subs 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a0099e50 con 0x7f05a013b760 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 monclient: _renew_subs 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a00a2450 con 0x7f05a013b760 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 0x7f05a00638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f05a009dac0 con 0x7f05a0092a80 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f059c041cd0 con 0x7f05a013b760 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 0x7f05a00638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient: get_auth_request con 0x7f05a0092a80 auth_method 0 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057003dd60 0x7f0570040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7f059c078340 con 0x7f05a013b760 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 10 monclient(hunting): handle_auth_done global_id 134232 payload 824 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a580b640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05a0097fa0 con 0x7f05a0092a80 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a500a640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057003dd60 0x7f0570040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.247+0000 7f05a500a640 10 monclient: get_auth_request con 0x7f057003dd60 auth_method 0 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.249+0000 7f05a580b640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 msgr2=0x7f05a00638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.249+0000 7f05a580b640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 0x7f05a00638c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f0590011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.249+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000fe50 con 0x7f05a0092a80 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 10 monclient: dump: 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f059000fe50 con 0x7f05a0092a80 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 msgr2=0x7f05a00638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 0x7f05a00638c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f0590011d00 comp rx=0 tx=0).stop 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 msgr2=0x7f05a00638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f058e7fc640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092a80 0x7f05a00638c0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f0590011d00 comp rx=0 tx=0).stop 2026-02-17T11:56:12.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.250+0000 7f05a500a640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057003dd60 0x7f0570040220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05a00977a0 tx=0x7f0594007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a7a96640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a7a96640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 0x7f05a01d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a7a96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f05a00008d0 con 0x7f05a0092e60 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 0x7f05a01d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient: get_auth_request con 0x7f05a0092e60 auth_method 0 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 10 monclient(hunting): handle_auth_done global_id 134235 payload 824 2026-02-17T11:56:12.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.253+0000 7f05a580b640 1 -- 10.20.193.51:0/2703251322 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f05a0050ac0 con 0x7f05a0092e60 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f05a580b640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 msgr2=0x7f05a01d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f05a580b640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 0x7f05a01d98b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f05900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590003920 con 0x7f05a0092e60 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 10 monclient: dump: 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f0590003920 con 0x7f05a0092e60 2026-02-17T11:56:12.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 msgr2=0x7f05a01d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 0x7f05a01d98b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f05900047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 msgr2=0x7f05a01d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.255+0000 7f058e7fc640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05a0092e60 0x7f05a01d98b0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0590011830 tx=0x7f05900047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 72577, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.258 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.259 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.261 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:12.262 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057003dd60 msgr2=0x7f0570040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057003dd60 0x7f0570040220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05a00977a0 tx=0x7f0594007f30 comp rx=0 tx=0).stop 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 10 monclient: shutdown 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 msgr2=0x7f05a0096c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 --2- 10.20.193.51:0/2703251322 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05a013b760 0x7f05a0096c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f059c02f740 tx=0x7f059c004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 reap_dead start 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a600c640 1 -- 10.20.193.51:0/2703251322 reap_dead start 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 shutdown_connections 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 >> 10.20.193.51:0/2703251322 conn(0x7f05a00a30c0 msgr2=0x7f05a013ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 shutdown_connections 2026-02-17T11:56:12.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.256+0000 7f05a7a96640 1 -- 10.20.193.51:0/2703251322 wait complete. 2026-02-17T11:56:12.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:12.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:56:12.263 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: monmap: 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:12.331264+0000 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:12.331264+0000 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.332 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:12.333 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:12.333 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:12.333 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 Processor -- start 2026-02-17T11:56:12.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 -- start start 2026-02-17T11:56:12.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: init 2026-02-17T11:56:12.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faa800a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faa800a0750 0x7faa8009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-a con 0x7faa800a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7faa8013b760 0x7faa8013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-c con 0x7faa8013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8006e140 con 0x7faa800a3bb0 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7faa8009f910 con 0x7faa800a0750 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7faa8009ccd0 con 0x7faa8013b760 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.330+0000 7faa86d3e640 10 monclient(hunting): authenticate will time out at 1259.949993s 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faa800a0750 0x7faa8009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faa800a0750 0x7faa8009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36880/0 (socket says 10.20.193.51:36880) 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 -- 10.20.193.51:0/199294929 learned_addr learned my addr 10.20.193.51:0/199294929 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): get_auth_request con 0x7faa800a0750 auth_method 0 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa852b4640 1 --2- 10.20.193.51:0/199294929 >> v2:10.20.193.142:3300/0 conn(0x7faa8013b760 0x7faa8013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa852b4640 10 monclient(hunting): get_auth_request con 0x7faa8013b760 auth_method 0 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa852b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa852b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa852b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient(hunting): handle_auth_done global_id 134238 payload 274 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 -- 10.20.193.51:0/199294929 >> v2:10.20.193.142:3300/0 conn(0x7faa8013b760 msgr2=0x7faa8013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 --2- 10.20.193.51:0/199294929 >> v2:10.20.193.142:3300/0 conn(0x7faa8013b760 0x7faa8013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 -- 10.20.193.51:0/199294929 >> v1:10.20.193.142:6789/0 conn(0x7faa800a3bb0 legacy=0x7faa8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.331+0000 7faa77fff640 1 -- 10.20.193.51:0/199294929 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8009eec0 con 0x7faa800a0750 2026-02-17T11:56:12.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa77fff640 1 -- 10.20.193.51:0/199294929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 msgr2=0x7faa8009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa77fff640 1 --2- 10.20.193.51:0/199294929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa8009e1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa8009f5f0 tx=0x7faa6802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15baffa378dee7b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 1 -- 10.20.193.51:0/199294929 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6803c070 con 0x7faa800a0750 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: dump: 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 1 -- 10.20.193.51:0/199294929 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6802fca0 con 0x7faa800a0750 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 1 -- 10.20.193.51:0/199294929 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68037660 con 0x7faa800a0750 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa777fe640 10 monclient: dump: 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa86d3e640 5 monclient: authenticate success, global_id 134238 2026-02-17T11:56:12.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa86d3e640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.333+0000 7faa86d3e640 4 set_mon_vals no callback set 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 10 monclient: shutdown 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 -- 10.20.193.51:0/199294929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 msgr2=0x7faa8009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 --2- 10.20.193.51:0/199294929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa8009e1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa8009f5f0 tx=0x7faa6802ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 -- 10.20.193.51:0/199294929 shutdown_connections 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 --2- 10.20.193.51:0/199294929 >> v2:10.20.193.142:3300/0 conn(0x7faa8013b760 0x7faa8013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 --2- 10.20.193.51:0/199294929 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa8009e1d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 -- 10.20.193.51:0/199294929 >> 10.20.193.51:0/199294929 conn(0x7faa800a30c0 msgr2=0x7faa800a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 -- 10.20.193.51:0/199294929 shutdown_connections 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 1 -- 10.20.193.51:0/199294929 wait complete. 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.334+0000 7faa86d3e640 10 monclient: monmap: 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:12.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 Processor -- start 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 -- start start 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient: init 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-a con 0x7faa800a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa800a3bb0 0x7faa80139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-b con 0x7faa800a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa8013b760 0x7faa800953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): picked mon.noname-c con 0x7faa8013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faa800a04b0 con 0x7faa800a0750 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faa8009c850 con 0x7faa800a3bb0 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faa8009e710 con 0x7faa8013b760 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa86d3e640 10 monclient(hunting): authenticate will time out at 1259.954402s 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36884/0 (socket says 10.20.193.51:36884) 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 -- 10.20.193.51:0/3184349002 learned_addr learned my addr 10.20.193.51:0/3184349002 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): get_auth_request con 0x7faa800a0750 auth_method 0 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa8013b760 0x7faa800953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): get_auth_request con 0x7faa8013b760 auth_method 0 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa77fff640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa800a3bb0 0x7faa80139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa77fff640 10 monclient(hunting): get_auth_request con 0x7faa800a3bb0 auth_method 0 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa852b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient(hunting): handle_auth_done global_id 134241 payload 824 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa8013b760 msgr2=0x7faa800953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa8013b760 0x7faa800953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa800a3bb0 msgr2=0x7faa80139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa800a3bb0 0x7faa80139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.335+0000 7faa84ab3640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa800a2290 con 0x7faa800a0750 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa84ab3640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 msgr2=0x7faa80138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa84ab3640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c600 tx=0x7faa7000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70012a40 con 0x7faa800a0750 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: dump: 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.348 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 5 monclient: authenticate success, global_id 134241 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa70017070 con 0x7faa800a0750 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 10 monclient: _renew_subs 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa80099310 con 0x7faa800a0750 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70012e20 con 0x7faa800a0750 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa76ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa757fa640 10 monclient: dump: 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.349 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 10 monclient: _renew_subs 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.337+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa80098d50 con 0x7faa800a0750 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa86d3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa86d3e640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 0x7faa80095cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faa80098740 con 0x7faa80095910 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 0x7faa80095cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient: get_auth_request con 0x7faa80095910 auth_method 0 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 10 monclient(hunting): handle_auth_done global_id 144131 payload 824 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa77fff640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa80077c20 con 0x7faa80095910 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faa7001c460 con 0x7faa800a0750 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa757fa640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa5003dd10 0x7faa500401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.338+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7faa70052420 con 0x7faa800a0750 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.339+0000 7faa852b4640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa5003dd10 0x7faa500401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.339+0000 7faa852b4640 10 monclient: get_auth_request con 0x7faa5003dd10 auth_method 0 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa77fff640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 msgr2=0x7faa80095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa77fff640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 0x7faa80095cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa8006c1c0 tx=0x7faa68004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6803c040 con 0x7faa80095910 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.340+0000 7faa757fa640 10 monclient: dump: 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.354 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7faa6802fe50 con 0x7faa80095910 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 msgr2=0x7faa80095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 0x7faa80095cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa8006c1c0 tx=0x7faa68004830 comp rx=0 tx=0).stop 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 msgr2=0x7faa80095cf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa757fa640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80095910 0x7faa80095cf0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa8006c1c0 tx=0x7faa68004830 comp rx=0 tx=0).stop 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.341+0000 7faa852b4640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa5003dd10 0x7faa500401d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa8006dab0 tx=0x7faa7c009770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa86d3e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa86d3e640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 0x7faa801dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa86d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faa8009dac0 con 0x7faa80096230 2026-02-17T11:56:12.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 0x7faa801dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient: get_auth_request con 0x7faa80096230 auth_method 0 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 10 monclient(hunting): handle_auth_done global_id 144134 payload 824 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.344+0000 7faa77fff640 1 -- 10.20.193.51:0/3184349002 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa80097470 con 0x7faa80096230 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa77fff640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 msgr2=0x7faa801dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa77fff640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 0x7faa801dace0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa80077e80 tx=0x7faa680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6803c040 con 0x7faa80096230 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 10 monclient: dump: 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.356 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7faa68003e60 con 0x7faa80096230 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 msgr2=0x7faa801dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 0x7faa801dace0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa80077e80 tx=0x7faa680047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 msgr2=0x7faa801dace0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.346+0000 7faa757fa640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa80096230 0x7faa801dace0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa80077e80 tx=0x7faa680047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 11900, 2026-02-17T11:56:12.357 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:12.358 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:12.359 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.360 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.361 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.362 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:12.363 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:12.364 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa5003dd10 msgr2=0x7faa500401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa5003dd10 0x7faa500401d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa8006dab0 tx=0x7faa7c009770 comp rx=0 tx=0).stop 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 10 monclient: shutdown 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 msgr2=0x7faa80138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c600 tx=0x7faa7000cad0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa852b4640 1 -- 10.20.193.51:0/3184349002 reap_dead start 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 shutdown_connections 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 --2- 10.20.193.51:0/3184349002 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa800a0750 0x7faa80138ac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 >> 10.20.193.51:0/3184349002 conn(0x7faa800a30c0 msgr2=0x7faa8013abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 shutdown_connections 2026-02-17T11:56:12.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.347+0000 7faa86d3e640 1 -- 10.20.193.51:0/3184349002 wait complete. 2026-02-17T11:56:12.366 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:12.366 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:56:12.366 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: monmap: 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:12.431140+0000 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:12.431140+0000 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.434 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 Processor -- start 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 -- start start 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: init 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80380a3bb0 0x7f803809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-a con 0x7f80380a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a0750 0x7f803809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-b con 0x7f80380a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f803809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:12.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803806e140 con 0x7f803809e540 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f80380a3f90 con 0x7f80380a3bb0 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f803809f910 con 0x7f80380a0750 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803f1bc640 10 monclient(hunting): authenticate will time out at 1260.049896s 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f803cf31640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80380a3bb0 0x7f803809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.430+0000 7f802ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a0750 0x7f803809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80380a3bb0 0x7f803809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36894/0 (socket says 10.20.193.51:36894) 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 -- 10.20.193.51:0/1482654754 learned_addr learned my addr 10.20.193.51:0/1482654754 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): get_auth_request con 0x7f80380a0750 auth_method 0 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803d732640 1 --1- 10.20.193.51:0/1482654754 >> v1:10.20.193.51:6789/0 conn(0x7f803809e540 0x7f803813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55264/0 (socket says 10.20.193.51:55264) 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): get_auth_request con 0x7f80380a3bb0 auth_method 0 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient(hunting): handle_auth_done global_id 134244 payload 274 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 -- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a0750 msgr2=0x7f803809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 --2- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a0750 0x7f803809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 -- 10.20.193.51:0/1482654754 >> v1:10.20.193.51:6789/0 conn(0x7f803809e540 legacy=0x7f803813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.431+0000 7f803cf31640 1 -- 10.20.193.51:0/1482654754 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803809ccd0 con 0x7f80380a3bb0 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803cf31640 1 -- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a3bb0 msgr2=0x7f803809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803cf31640 1 --2- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a3bb0 0x7f803809dac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f803806c1c0 tx=0x7f802802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c542e104be7db3a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 1 -- 10.20.193.51:0/1482654754 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802803c070 con 0x7f80380a3bb0 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 1 -- 10.20.193.51:0/1482654754 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802802fca0 con 0x7f80380a3bb0 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803f1bc640 5 monclient: authenticate success, global_id 134244 2026-02-17T11:56:12.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803f1bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 1 -- 10.20.193.51:0/1482654754 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028037660 con 0x7f80380a3bb0 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803f1bc640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f803f1bc640 4 set_mon_vals no callback set 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.433+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.447 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: shutdown 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a3bb0 msgr2=0x7f803809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a3bb0 0x7f803809dac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f803806c1c0 tx=0x7f802802ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- 10.20.193.51:0/1482654754 shutdown_connections 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a0750 0x7f803809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- 10.20.193.51:0/1482654754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a3bb0 0x7f803809dac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- 10.20.193.51:0/1482654754 >> 10.20.193.51:0/1482654754 conn(0x7f80380a30c0 msgr2=0x7f80380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- 10.20.193.51:0/1482654754 shutdown_connections 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- 10.20.193.51:0/1482654754 wait complete. 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: monmap: 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.448 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 Processor -- start 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- start start 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: init 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f803809e540 0x7f80381cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-b con 0x7f803809e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:12.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a0750 0x7f80381d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-a con 0x7f80380a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 0x7f80381300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): picked mon.noname-c con 0x7f80380a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f80380a04b0 con 0x7f80380a0750 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f803809c850 con 0x7f803809e540 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f803813de80 con 0x7f80380a3bb0 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.434+0000 7f803f1bc640 10 monclient(hunting): authenticate will time out at 1260.053973s 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a0750 0x7f80381d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 0x7f80381300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 0x7f80381300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56876/0 (socket says 10.20.193.51:56876) 2026-02-17T11:56:12.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 learned_addr learned my addr 10.20.193.51:0/3364110013 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): get_auth_request con 0x7f80380a3bb0 auth_method 0 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): get_auth_request con 0x7f80380a0750 auth_method 0 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803cf31640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f803809e540 0x7f80381cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803cf31640 10 monclient(hunting): get_auth_request con 0x7f803809e540 auth_method 0 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803cf31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient(hunting): handle_auth_done global_id 144140 payload 824 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f803809e540 msgr2=0x7f80381cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f803809e540 0x7f80381cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a0750 msgr2=0x7f80381d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a0750 0x7f80381d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 monclient: found mon.noname-c 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8038133ac0 con 0x7f80380a3bb0 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.435+0000 7f802ffff640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80380a0750 0x7f80381d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 msgr2=0x7f80381300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803d732640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 0x7f80381300d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f803400caf0 tx=0x7f803400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034017070 con 0x7f80380a3bb0 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: dump: 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.453 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8034012400 con 0x7f80380a3bb0 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80340127f0 con 0x7f80380a3bb0 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802effd640 4 set_mon_vals no callback set 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f802d7fa640 10 monclient: dump: 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.454 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 5 monclient: authenticate success, global_id 144140 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 10 monclient: _renew_subs 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8038133da0 con 0x7f80380a3bb0 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 10 monclient: _renew_subs 2026-02-17T11:56:12.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.437+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f803806f840 con 0x7f80380a3bb0 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803f1bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803f1bc640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 0x7f80381309f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80380a1ed0 con 0x7f8038130610 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f803401c440 con 0x7f80380a3bb0 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 0x7f80381309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f802d7fa640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f800803dd10 0x7f80080401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient: get_auth_request con 0x7f8038130610 auth_method 0 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7f8034052780 con 0x7f80380a3bb0 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f802ffff640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f800803dd10 0x7f80080401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 10 monclient(hunting): handle_auth_done global_id 114337 payload 824 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f803cf31640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f803806fb90 con 0x7f8038130610 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.438+0000 7f802ffff640 10 monclient: get_auth_request con 0x7f800803dd10 auth_method 0 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.440+0000 7f803cf31640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 msgr2=0x7f80381309f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.440+0000 7f803cf31640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 0x7f80381309f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f803809f230 tx=0x7f8028004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802803c040 con 0x7f8038130610 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 10 monclient: dump: 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f802802fe50 con 0x7f8038130610 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 msgr2=0x7f80381309f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 0x7f80381309f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f803809f230 tx=0x7f8028004830 comp rx=0 tx=0).stop 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 msgr2=0x7f80381309f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802d7fa640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130610 0x7f80381309f0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f803809f230 tx=0x7f8028004830 comp rx=0 tx=0).stop 2026-02-17T11:56:12.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.441+0000 7f802ffff640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f800803dd10 0x7f80080401d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8038133710 tx=0x7f8020009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803f1bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:12.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803f1bc640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 0x7f80381daf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803f1bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8038077c20 con 0x7f8038130f30 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 0x7f80381daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient: get_auth_request con 0x7f8038130f30 auth_method 0 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.444+0000 7f803cf31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.445+0000 7f803cf31640 10 monclient(hunting): handle_auth_done global_id 114340 payload 824 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.445+0000 7f803cf31640 1 -- 10.20.193.51:0/3364110013 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8038073e70 con 0x7f8038130f30 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803cf31640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 msgr2=0x7f80381daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803cf31640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 0x7f80381daf70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8038077e30 tx=0x7f80280047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802803c040 con 0x7f8038130f30 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:12.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 10 monclient: dump: 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f8028003da0 con 0x7f8038130f30 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 msgr2=0x7f80381daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 0x7f80381daf70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8038077e30 tx=0x7f80280047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 msgr2=0x7f80381daf70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:12.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f802d7fa640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8038130f30 0x7f80381daf70 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8038077e30 tx=0x7f80280047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 90, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 174323, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.463 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.464 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.465 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:12.466 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:12.467 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:12.468 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:12.469 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:12.470 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.471 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:12.472 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f800803dd10 msgr2=0x7f80080401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f800803dd10 0x7f80080401d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8038133710 tx=0x7f8020009290 comp rx=0 tx=0).stop 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 10 monclient: shutdown 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 msgr2=0x7f80381300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 --2- 10.20.193.51:0/3364110013 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80380a3bb0 0x7f80381300d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f803400caf0 tx=0x7f803400a060 comp rx=0 tx=0).stop 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 reap_dead start 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803d732640 1 -- 10.20.193.51:0/3364110013 reap_dead start 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 shutdown_connections 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 >> 10.20.193.51:0/3364110013 conn(0x7f80380a30c0 msgr2=0x7f8038072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 shutdown_connections 2026-02-17T11:56:12.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.447+0000 7f803f1bc640 1 -- 10.20.193.51:0/3364110013 wait complete. 2026-02-17T11:56:12.474 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:12.474 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:56:12.474 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:56:12.474 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:56:12.474 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:56:12.474 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:56:12.474 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:56:12.483 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:56:12.483 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:56:12.483 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:12.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.588+0000 7f197dc7c640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.588+0000 7f197dc7c640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.588+0000 7f197dc7c640 10 monclient: monmap: 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:12.589647+0000 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:12.589647+0000 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:12.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 Processor -- start 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 -- start start 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient: init 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f19780a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 0x7f197809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-b con 0x7f19780a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f197813b760 0x7f197813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-a con 0x7f197813b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197806e140 con 0x7f19780a3bb0 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f197809f910 con 0x7f197813b760 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f197809ccd0 con 0x7f19780a0750 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f197dc7c640 10 monclient(hunting): authenticate will time out at 1260.208419s 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1976ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 msgr2=0x7f197809e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1976ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 0x7f197809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f19777fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f19780a3bb0 0x7f197809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55268/0 (socket says 10.20.193.51:55268) 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f19777fe640 1 -- 10.20.193.51:0/18882382 learned_addr learned my addr 10.20.193.51:0/18882382 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 --2- 10.20.193.51:0/18882382 >> v2:10.20.193.51:3300/0 conn(0x7f197813b760 0x7f197813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): get_auth_request con 0x7f197813b760 auth_method 0 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient(hunting): handle_auth_done global_id 134250 payload 274 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 -- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 msgr2=0x7f197809e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 --2- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 0x7f197809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 -- 10.20.193.51:0/18882382 >> v1:10.20.193.51:6789/0 conn(0x7f19780a3bb0 legacy=0x7f197809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.589+0000 7f1977fff640 1 -- 10.20.193.51:0/18882382 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197809eec0 con 0x7f197813b760 2026-02-17T11:56:12.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f1977fff640 1 -- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 msgr2=0x7f197813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f1977fff640 1 --2- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f197813db50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f197809f230 tx=0x7f196c02f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63e789425c55ee8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 1 -- 10.20.193.51:0/18882382 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c03c070 con 0x7f197813b760 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: dump: 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 1 -- 10.20.193.51:0/18882382 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c037640 con 0x7f197813b760 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 5 monclient: authenticate success, global_id 134250 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 1 -- 10.20.193.51:0/18882382 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c037a10 con 0x7f197813b760 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 4 set_mon_vals no callback set 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f19767fc640 10 monclient: dump: 2026-02-17T11:56:12.603 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 10 monclient: shutdown 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 -- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 msgr2=0x7f197813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 --2- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f197813db50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f197809f230 tx=0x7f196c02f150 comp rx=0 tx=0).stop 2026-02-17T11:56:12.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 -- 10.20.193.51:0/18882382 shutdown_connections 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 --2- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f197813db50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 --2- 10.20.193.51:0/18882382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a0750 0x7f197809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 -- 10.20.193.51:0/18882382 >> 10.20.193.51:0/18882382 conn(0x7f19780a30c0 msgr2=0x7f19780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 -- 10.20.193.51:0/18882382 shutdown_connections 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.592+0000 7f197dc7c640 1 -- 10.20.193.51:0/18882382 wait complete. 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient: monmap: 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:12.605 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 Processor -- start 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 -- start start 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient: init 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f19780a0750 0x7f19781cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-b con 0x7f19780a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 0x7f19781d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-c con 0x7f19780a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): picked mon.noname-a con 0x7f197813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f19780a04b0 con 0x7f197813b760 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f197809c850 con 0x7f19780a0750 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f197809e710 con 0x7f19780a3bb0 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f197dc7c640 10 monclient(hunting): authenticate will time out at 1260.212601s 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1976ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 msgr2=0x7f19781d0010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1976ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 0x7f19781d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36922/0 (socket says 10.20.193.51:36922) 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 -- 10.20.193.51:0/1672603026 learned_addr learned my addr 10.20.193.51:0/1672603026 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): get_auth_request con 0x7f197813b760 auth_method 0 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient(hunting): handle_auth_done global_id 134253 payload 824 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 -- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 msgr2=0x7f19781d0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 0x7f19781d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 -- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f19780a0750 msgr2=0x7f19781cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f19780a0750 0x7f19781cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.593+0000 7f1977fff640 1 -- 10.20.193.51:0/1672603026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1978134a70 con 0x7f197813b760 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.595+0000 7f1977fff640 1 -- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 msgr2=0x7f1978131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.595+0000 7f1977fff640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f196c02f660 tx=0x7f196c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c047020 con 0x7f197813b760 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1977fff640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f196c02f660 tx=0x7f196c004b40 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f196c03c040 mon_map magic: 0 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: dump: 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.609 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c042880 con 0x7f197813b760 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 5 monclient: authenticate success, global_id 134253 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _renew_subs 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197809d7b0 con 0x7f197813b760 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1975ffb640 4 set_mon_vals no callback set 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _renew_subs 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1978134d50 con 0x7f197813b760 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c03c040 con 0x7f197813b760 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 10 monclient: dump: 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:12.611 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f196c042cb0 con 0x7f197813b760 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197809dac0 con 0x7f197813b760 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.596+0000 7f1953fff640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 0x7f1948040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.597+0000 7f19777fe640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 0x7f1948040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.597+0000 7f19777fe640 10 monclient: get_auth_request con 0x7f194803dcc0 auth_method 0 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.599+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7f196c0784e0 con 0x7f197813b760 2026-02-17T11:56:12.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:12.600+0000 7f19777fe640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 0x7f1948040180 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f1964007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:13.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.219+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f196c051070 con 0x7f197813b760 2026-02-17T11:56:13.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.219+0000 7f1953fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:13.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.219+0000 7f1953fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:13.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f197dc7c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:13.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f197dc7c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:13.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f197dc7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:13.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1978132d10 con 0x7f197813b760 2026-02-17T11:56:13.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f1953fff640 1 -- 10.20.193.51:0/1672603026 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f196c076ee0 con 0x7f197813b760 2026-02-17T11:56:13.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f1953fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:13.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.332+0000 7f1953fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:13.335 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:13.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 msgr2=0x7f1948040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 0x7f1948040180 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f1964007ba0 comp rx=0 tx=0).stop 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 10 monclient: shutdown 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 msgr2=0x7f1978131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f196c02f660 tx=0x7f196c004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 shutdown_connections 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f194803dcc0 0x7f1948040180 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f197813b760 0x7f1978131260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f19780a3bb0 0x7f19781d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:13.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 --2- 10.20.193.51:0/1672603026 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f19780a0750 0x7f19781cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:13.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 >> 10.20.193.51:0/1672603026 conn(0x7f19780a30c0 msgr2=0x7f1978139dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:13.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 shutdown_connections 2026-02-17T11:56:13.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:13.333+0000 7f197dc7c640 1 -- 10.20.193.51:0/1672603026 wait complete. 2026-02-17T11:56:16.343 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:16.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: get_monmap_and_config 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: build_initial_monmap 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: monmap: 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:16.411154+0000 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:16.411154+0000 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:16.415 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 Processor -- start 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 -- start start 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: init 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T11:56:16.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3f940a3bb0 0x7f3f9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-a con 0x7f3f940a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3f940a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3f9413b760 0x7f3f9413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-c con 0x7f3f9413b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9406e140 con 0x7f3f940a0750 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9409f910 con 0x7f3f940a3bb0 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9409ccd0 con 0x7f3f9413b760 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f9be64640 10 monclient(hunting): authenticate will time out at 1264.029905s 2026-02-17T11:56:16.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f99bd9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3f940a3bb0 0x7f3f9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f993d8640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3f940a0750 0x7f3f9409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:59406/0 (socket says 10.20.193.51:59406) 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f993d8640 1 -- 10.20.193.51:0/3520785954 learned_addr learned my addr 10.20.193.51:0/3520785954 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f99bd9640 10 monclient(hunting): get_auth_request con 0x7f3f940a3bb0 auth_method 0 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.410+0000 7f3f99bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f9a3da640 1 --2- 10.20.193.51:0/3520785954 >> v2:10.20.193.142:3300/0 conn(0x7f3f9413b760 0x7f3f9413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f9a3da640 10 monclient(hunting): get_auth_request con 0x7f3f9413b760 auth_method 0 2026-02-17T11:56:16.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f9a3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f9a3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f9a3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient(hunting): handle_auth_done global_id 134256 payload 274 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 1 -- 10.20.193.51:0/3520785954 >> v2:10.20.193.142:3300/0 conn(0x7f3f9413b760 msgr2=0x7f3f9413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 1 --2- 10.20.193.51:0/3520785954 >> v2:10.20.193.142:3300/0 conn(0x7f3f9413b760 0x7f3f9413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 1 -- 10.20.193.51:0/3520785954 >> v1:10.20.193.51:6789/0 conn(0x7f3f940a0750 legacy=0x7f3f9409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient: _finish_hunting 0 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 1 monclient: found mon.noname-a 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.411+0000 7f3f99bd9640 1 -- 10.20.193.51:0/3520785954 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9409eec0 con 0x7f3f940a3bb0 2026-02-17T11:56:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f99bd9640 1 -- 10.20.193.51:0/3520785954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f940a3bb0 msgr2=0x7f3f9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f99bd9640 1 --2- 10.20.193.51:0/3520785954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f940a3bb0 0x7f3f9409dac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f9409f5f0 tx=0x7f3f8402ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdd7b53e425144c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 1 -- 10.20.193.51:0/3520785954 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8403c070 con 0x7f3f940a3bb0 2026-02-17T11:56:16.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: dump: 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:16.427 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: _finish_auth 0 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: _check_auth_tickets 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 1 -- 10.20.193.51:0/3520785954 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8402fbd0 con 0x7f3f940a3bb0 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f9be64640 5 monclient: authenticate success, global_id 134256 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f9be64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 1 -- 10.20.193.51:0/3520785954 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84037440 con 0x7f3f940a3bb0 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:16.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f98bd7640 10 monclient: dump: 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f9be64640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:16.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.413+0000 7f3f9be64640 4 set_mon_vals no callback set 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 10 monclient: shutdown 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- 10.20.193.51:0/3520785954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f940a3bb0 msgr2=0x7f3f9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 --2- 10.20.193.51:0/3520785954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f940a3bb0 0x7f3f9409dac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f9409f5f0 tx=0x7f3f8402ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- 10.20.193.51:0/3520785954 shutdown_connections 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 --2- 10.20.193.51:0/3520785954 >> v2:10.20.193.142:3300/0 conn(0x7f3f9413b760 0x7f3f9413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 --2- 10.20.193.51:0/3520785954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f940a3bb0 0x7f3f9409dac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- 10.20.193.51:0/3520785954 >> 10.20.193.51:0/3520785954 conn(0x7f3f940a30c0 msgr2=0x7f3f940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- 10.20.193.51:0/3520785954 shutdown_connections 2026-02-17T11:56:16.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- 10.20.193.51:0/3520785954 wait complete. 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 10 monclient: build_initial_monmap 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 10 monclient: monmap: 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:16.431 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 Processor -- start 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 1 -- start start 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.414+0000 7f3f9be64640 10 monclient: init 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f940a0750 0x7f3f94092290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-b con 0x7f3f940a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 0x7f3f940927d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-c con 0x7f3f940a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): picked mon.noname-a con 0x7f3f9413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3f940a04b0 con 0x7f3f9413b760 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9409c850 con 0x7f3f940a0750 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9409e710 con 0x7f3f940a3bb0 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9be64640 10 monclient(hunting): authenticate will time out at 1264.034218s 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f993d8640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 msgr2=0x7f3f940927d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:16.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f993d8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 0x7f3f940927d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:47824/0 (socket says 10.20.193.51:47824) 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 -- 10.20.193.51:0/133642804 learned_addr learned my addr 10.20.193.51:0/133642804 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): get_auth_request con 0x7f3f9413b760 auth_method 0 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:16.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f99bd9640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f940a0750 0x7f3f94092290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient(hunting): handle_auth_done global_id 134259 payload 824 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 -- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 msgr2=0x7f3f940927d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 0x7f3f940927d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 -- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f940a0750 msgr2=0x7f3f94092290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f940a0750 0x7f3f94092290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient: _finish_hunting 0 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 monclient: found mon.noname-a 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.415+0000 7f3f9a3da640 1 -- 10.20.193.51:0/133642804 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9406f4a0 con 0x7f3f9413b760 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9a3da640 1 -- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 msgr2=0x7f3f94092d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:16.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9a3da640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f90007d80 tx=0x7f3f9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90013790 con 0x7f3f9413b760 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: dump: 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:16.436 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f90019070 con 0x7f3f9413b760 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 5 monclient: authenticate success, global_id 134259 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90013b70 con 0x7f3f9413b760 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:16.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f827fc640 10 monclient: dump: 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f83fff640 4 set_mon_vals no callback set 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 10 monclient: _renew_subs 2026-02-17T11:56:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9409d7b0 con 0x7f3f9413b760 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 10 monclient: _renew_subs 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.417+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f940957e0 con 0x7f3f9413b760 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f9be64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f9be64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f9be64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9406fe20 con 0x7f3f9413b760 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3f9001e460 con 0x7f3f9413b760 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f827fc640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 0x7f3f64040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:16.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.418+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7f3f90052f10 con 0x7f3f9413b760 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.419+0000 7f3f99bd9640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 0x7f3f64040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.419+0000 7f3f99bd9640 10 monclient: get_auth_request con 0x7f3f6403dcc0 auth_method 0 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.421+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3f9406fe20 con 0x7f3f9413b760 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.421+0000 7f3f827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.421+0000 7f3f827fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.421+0000 7f3f99bd9640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 0x7f3f64040180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3f9406f3c0 tx=0x7f3f84033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f9be64640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f9be64640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f9be64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3f940959e0 con 0x7f3f9413b760 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f827fc640 1 -- 10.20.193.51:0/133642804 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f3f940959e0 con 0x7f3f9413b760 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f827fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.534+0000 7f3f827fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:16.536 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 msgr2=0x7f3f64040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 0x7f3f64040180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3f9406f3c0 tx=0x7f3f84033000 comp rx=0 tx=0).stop 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 10 monclient: shutdown 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 msgr2=0x7f3f94092d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f90007d80 tx=0x7f3f9000e4b0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 shutdown_connections 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3f6403dcc0 0x7f3f64040180 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3f9413b760 0x7f3f94092d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3f940a3bb0 0x7f3f940927d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 --2- 10.20.193.51:0/133642804 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3f940a0750 0x7f3f94092290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 >> 10.20.193.51:0/133642804 conn(0x7f3f940a30c0 msgr2=0x7f3f9413ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 shutdown_connections 2026-02-17T11:56:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:16.535+0000 7f3f9be64640 1 -- 10.20.193.51:0/133642804 wait complete. 2026-02-17T11:56:19.544 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 10 monclient: get_monmap_and_config 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 10 monclient: build_initial_monmap 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 10 monclient: monmap: 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:19.614430+0000 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:19.614430+0000 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:19.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:19.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 1 Processor -- start 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 1 -- start start 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.613+0000 7fb1f0f2c640 10 monclient: init 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T11:56:19.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb1ec06c8d0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-b con 0x7fb1ec074d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb1ec06d3c0 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec0a0210 con 0x7fb1ec06d3c0 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec0a04f0 con 0x7fb1ec06c8d0 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a07d0 con 0x7fb1ec074d60 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1f0f2c640 10 monclient(hunting): authenticate will time out at 1267.233254s 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1e9d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 msgr2=0x7fb1ec0a13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:19.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1e9d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:19.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1ead76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb1ec06d3c0 0x7fb1ec13f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:59414/0 (socket says 10.20.193.51:59414) 2026-02-17T11:56:19.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.614+0000 7fb1ead76640 1 -- 10.20.193.51:0/2213568405 learned_addr learned my addr 10.20.193.51:0/2213568405 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:19.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.616+0000 7fb1ead76640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.51:6789/0 conn(0x7fb1ec06d3c0 legacy=0x7fb1ec13f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:19.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.616+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec06c8d0 legacy=0x7fb1ec06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.815+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 msgr2=0x7fb1ec0a13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:19.815+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:20.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:20.216+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 msgr2=0x7fb1ec0a13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:20.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:20.216+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:21.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:21.017+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 msgr2=0x7fb1ec0a13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:21.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:21.017+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): tick 2026-02-17T11:56:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:56:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:56:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:56:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 msgr2=0x7fb1ec0a13b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec074d60 0x7fb1ec0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec06c8d0 legacy=0x7fb1ec06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.51:6789/0 conn(0x7fb1ec06d3c0 legacy=0x7fb1ec13f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient: _add_conns ranks=[4,3] 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fb1c8003910 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): picked mon.noname-a con 0x7fb1c8006440 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec0a07d0 con 0x7fb1c8006440 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c8008fc0 con 0x7fb1c8003910 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1d3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request con 0x7fb1c8006440 auth_method 0 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003910 auth_method 0 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:22.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request con 0x7fb1c8006440 auth_method 0 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003910 auth_method 0 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:22.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request con 0x7fb1c8006440 auth_method 0 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003910 auth_method 0 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:23.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:23.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:24.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:24.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request con 0x7fb1c8006440 auth_method 0 2026-02-17T11:56:24.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:24.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:24.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003910 auth_method 0 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:24.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:24.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:24.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:24.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:24.017+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): tick 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 msgr2=0x7fb1c8005d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003910 0x7fb1c8005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 msgr2=0x7fb1c8008900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.51:3300/0 conn(0x7fb1c8006440 0x7fb1c8008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ead76640 1 -- 10.20.193.51:0/2213568405 reap_dead start 2026-02-17T11:56:25.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fb1c8003d40 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1c8007210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): picked mon.noname-b con 0x7fb1c8006db0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb1c8007750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec09ecd0 con 0x7fb1c8007750 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec0a07d0 con 0x7fb1c8003d40 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 1 -- 10.20.193.51:0/2213568405 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c8008fc0 con 0x7fb1c8006db0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1d3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1c8007210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1c8007210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003d40 auth_method 0 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:25.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.614+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:25.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.616+0000 7fb1ead76640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.51:6789/0 conn(0x7fb1c8007750 legacy=0x7fb1c8007c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1c8007210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1c8007210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003d40 auth_method 0 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:25.815+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:26.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1c8007210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1c8007210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1c8003d40 auth_method 0 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:26.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:26.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.216+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177815613 0 0) 0x7fb1ec09ecd0 con 0x7fb1c8007750 2026-02-17T11:56:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): _negotiate 2026-02-17T11:56:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): my global_id is 134262 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8003620 con 0x7fb1c8007750 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878186005 0 0) 0x7fb1d8003620 con 0x7fb1c8007750 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1c8007210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1c8007210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 msgr2=0x7fb1c8006870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 --2- 10.20.193.51:0/2213568405 >> v2:10.20.193.142:3300/0 conn(0x7fb1c8003d40 0x7fb1c8006870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _finish_hunting 0 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80085e0 con 0x7fb1c8007750 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _finish_auth 0 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fb1dc003400 con 0x7fb1c8007750 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1f0f2c640 5 monclient: authenticate success, global_id 134262 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1f0f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: dump: 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 >> v1:10.20.193.51:6789/0 conn(0x7fb1c8007750 legacy=0x7fb1c8007c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1d8003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): picked mon.b con 0x7fb1d8003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1d8004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): picked mon.c con 0x7fb1c8006db0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d8004e90 0x7fb1d80052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): picked mon.a con 0x7fb1d8004e90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a07d0 con 0x7fb1d8004e90 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8008fc0 con 0x7fb1d8003ab0 2026-02-17T11:56:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d800bda0 con 0x7fb1c8006db0 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9d74640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1d8004900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1d8004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1e9573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.709+0000 7fb1f0f2c640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1d8003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): get_auth_request con 0x7fb1d8003ab0 auth_method 0 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient(hunting): handle_auth_done global_id 134262 payload 293 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 msgr2=0x7fb1d8004900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1c8006db0 0x7fb1d8004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d8004e90 msgr2=0x7fb1d80052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d8004e90 0x7fb1d80052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 monclient: found mon.b 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T11:56:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d8003620 con 0x7fb1d8003ab0 2026-02-17T11:56:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient: _finish_auth 0 2026-02-17T11:56:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 10 monclient: _check_auth_tickets 2026-02-17T11:56:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.710+0000 7fb1ea575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1ea575640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 msgr2=0x7fb1d8003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1ea575640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1d8003ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007bf0 tx=0x7fb1e0030680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44981e77ab914200 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003c070 con 0x7fb1d8003ab0 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: dump: 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.728 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e00058c0 con 0x7fb1d8003ab0 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:26.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 1 -- 10.20.193.51:0/2213568405 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0002fa0 con 0x7fb1d8003ab0 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1e9573640 10 monclient: dump: 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.730 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 4 set_mon_vals no callback set 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 10 monclient: shutdown 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 msgr2=0x7fb1d8003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/2213568405 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1d8003ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007bf0 tx=0x7fb1e0030680 comp rx=0 tx=0).stop 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1ead76640 1 -- 10.20.193.51:0/2213568405 reap_dead start 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/2213568405 shutdown_connections 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/2213568405 >> 10.20.193.51:0/2213568405 conn(0x7fb1ec0aaa60 msgr2=0x7fb1ec0aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.713+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/2213568405 shutdown_connections 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/2213568405 wait complete. 2026-02-17T11:56:26.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient: build_initial_monmap 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient: monmap: 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 Processor -- start 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 -- start start 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient: init 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1ec1cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-b con 0x7fb1d8003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-a con 0x7fb1ec1cfc70 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 0x7fb1ec1304c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): picked mon.noname-c con 0x7fb1ec130060 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a1530 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a13b0 con 0x7fb1d8003ab0 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a16b0 con 0x7fb1ec130060 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1f0f2c640 10 monclient(hunting): authenticate will time out at 1274.333895s 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1ead76640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 msgr2=0x7fb1ec1304c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1ead76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 0x7fb1ec1304c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41868/0 (socket says 10.20.193.51:41868) 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 1 -- 10.20.193.51:0/3278543887 learned_addr learned my addr 10.20.193.51:0/3278543887 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:26.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request con 0x7fb1ec1cfc70 auth_method 0 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.714+0000 7fb1e9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient(hunting): handle_auth_done global_id 134265 payload 824 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 -- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 msgr2=0x7fb1ec1304c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 0x7fb1ec1304c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 -- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 msgr2=0x7fb1ec1cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1ec1cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 monclient: found mon.noname-a 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.715+0000 7fb1e9d74640 1 -- 10.20.193.51:0/3278543887 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec09ea60 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1e9d74640 1 -- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 msgr2=0x7fb1ec12fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1e9d74640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400bb20 tx=0x7fb1d40050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d401b020 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: dump: 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.736 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40173f0 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40177c0 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1d2ffd640 10 monclient: dump: 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.738 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1e8d72640 4 set_mon_vals no callback set 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 5 monclient: authenticate success, global_id 134265 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 10 monclient: _renew_subs 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec138a30 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 10 monclient: _renew_subs 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.717+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec1331f0 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb1d4017a20 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1f0f2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:26.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1f0f2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1f0f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec06a290 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1d2ffd640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 0x7fb1b8040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7fb1d40533f0 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1ea575640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 0x7fb1b8040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.718+0000 7fb1ea575640 10 monclient: get_auth_request con 0x7fb1b803dd40 auth_method 0 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.720+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb1ec06a290 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.720+0000 7fb1d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.720+0000 7fb1d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:26.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.721+0000 7fb1ea575640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 0x7fb1b8040200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007fd0 tx=0x7fb1e0011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.835+0000 7fb1f0f2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.835+0000 7fb1f0f2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.835+0000 7fb1f0f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.835+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb1ec06ccb0 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1d2ffd640 1 -- 10.20.193.51:0/3278543887 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fb1d4025030 con 0x7fb1ec1cfc70 2026-02-17T11:56:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:26.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1d2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:26.839 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 msgr2=0x7fb1b8040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 0x7fb1b8040200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007fd0 tx=0x7fb1e0011040 comp rx=0 tx=0).stop 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 10 monclient: shutdown 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 msgr2=0x7fb1ec12fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400bb20 tx=0x7fb1d40050b0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 shutdown_connections 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1b803dd40 0x7fb1b8040200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec130060 0x7fb1ec1304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec1cfc70 0x7fb1ec12fb20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 --2- 10.20.193.51:0/3278543887 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d8003ab0 0x7fb1ec1cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 >> 10.20.193.51:0/3278543887 conn(0x7fb1ec0aaa60 msgr2=0x7fb1ec135fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 shutdown_connections 2026-02-17T11:56:26.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.836+0000 7fb1f0f2c640 1 -- 10.20.193.51:0/3278543887 wait complete. 2026-02-17T11:56:26.847 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:56:26.847 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:56:26.847 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:56:26.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: get_monmap_and_config 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: build_initial_monmap 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: monmap: 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:26.914133+0000 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:26.914133+0000 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:26.918 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 Processor -- start 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 -- start start 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: init 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:26.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc9dc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 0x7fc9dc09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-b con 0x7fc9dc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc9dc13b760 0x7fc9dc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-a con 0x7fc9dc13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9dc06e140 con 0x7fc9dc0a3bb0 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc9dc09f910 con 0x7fc9dc13b760 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc09ccd0 con 0x7fc9dc0a0750 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:26.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e330a640 10 monclient(hunting): authenticate will time out at 1274.532913s 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e087e640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 msgr2=0x7fc9dc09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.913+0000 7fc9e087e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 0x7fc9dc09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc9dc13b760 0x7fc9dc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc9dc13b760 0x7fc9dc13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41878/0 (socket says 10.20.193.51:41878) 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 -- 10.20.193.51:0/733987148 learned_addr learned my addr 10.20.193.51:0/733987148 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): get_auth_request con 0x7fc9dc13b760 auth_method 0 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient(hunting): handle_auth_done global_id 134268 payload 274 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 -- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 msgr2=0x7fc9dc09e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 --2- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 0x7fc9dc09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 -- 10.20.193.51:0/733987148 >> v1:10.20.193.142:6789/0 conn(0x7fc9dc0a3bb0 legacy=0x7fc9dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient: _finish_hunting 0 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 monclient: found mon.noname-a 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.914+0000 7fc9e1880640 1 -- 10.20.193.51:0/733987148 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc09eec0 con 0x7fc9dc13b760 2026-02-17T11:56:26.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e1880640 1 -- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc13b760 msgr2=0x7fc9dc13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e1880640 1 --2- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc13b760 0x7fc9dc13db50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc09f230 tx=0x7fc9d802f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9610fc7a12567b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 1 -- 10.20.193.51:0/733987148 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80373f0 con 0x7fc9dc13b760 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: dump: 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 1 -- 10.20.193.51:0/733987148 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d8037590 con 0x7fc9dc13b760 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e330a640 5 monclient: authenticate success, global_id 134268 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e330a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e330a640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9e330a640 4 set_mon_vals no callback set 2026-02-17T11:56:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 1 -- 10.20.193.51:0/733987148 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8037960 con 0x7fc9dc13b760 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.916+0000 7fc9cbfff640 10 monclient: dump: 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 10 monclient: shutdown 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc13b760 msgr2=0x7fc9dc13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 --2- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc13b760 0x7fc9dc13db50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc09f230 tx=0x7fc9d802f200 comp rx=0 tx=0).stop 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- 10.20.193.51:0/733987148 shutdown_connections 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 --2- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc13b760 0x7fc9dc13db50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 --2- 10.20.193.51:0/733987148 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a0750 0x7fc9dc09e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- 10.20.193.51:0/733987148 >> 10.20.193.51:0/733987148 conn(0x7fc9dc0a30c0 msgr2=0x7fc9dc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:26.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- 10.20.193.51:0/733987148 shutdown_connections 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- 10.20.193.51:0/733987148 wait complete. 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 10 monclient: build_initial_monmap 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 10 monclient: monmap: 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 Processor -- start 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 1 -- start start 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.917+0000 7fc9e330a640 10 monclient: init 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 0x7fc9dc13a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-a con 0x7fc9dc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a3bb0 0x7fc9dc13af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-c con 0x7fc9dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9dc13b760 0x7fc9dc092990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): picked mon.noname-b con 0x7fc9dc13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0a04b0 con 0x7fc9dc0a0750 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc09c850 con 0x7fc9dc13b760 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc09e710 con 0x7fc9dc0a3bb0 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e330a640 10 monclient(hunting): authenticate will time out at 1274.537143s 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e087e640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a3bb0 msgr2=0x7fc9dc13af20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e087e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a3bb0 0x7fc9dc13af20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 0x7fc9dc13a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 0x7fc9dc13a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41880/0 (socket says 10.20.193.51:41880) 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 -- 10.20.193.51:0/2019370990 learned_addr learned my addr 10.20.193.51:0/2019370990 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): get_auth_request con 0x7fc9dc0a0750 auth_method 0 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e1880640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9dc13b760 0x7fc9dc092990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e1880640 10 monclient(hunting): get_auth_request con 0x7fc9dc13b760 auth_method 0 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e1880640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e1880640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e1880640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient(hunting): handle_auth_done global_id 134271 payload 824 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a3bb0 msgr2=0x7fc9dc13af20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc9dc0a3bb0 0x7fc9dc13af20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9dc13b760 msgr2=0x7fc9dc092990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc9dc13b760 0x7fc9dc092990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient: _finish_hunting 0 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 monclient: found mon.noname-a 2026-02-17T11:56:26.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.918+0000 7fc9e107f640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc0968d0 con 0x7fc9dc0a0750 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e107f640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 msgr2=0x7fc9dc13a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e107f640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 0x7fc9dc13a9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00c5d0 tx=0x7fc9cc00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc016020 con 0x7fc9dc0a0750 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: dump: 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.943 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc012a60 con 0x7fc9dc0a0750 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 5 monclient: authenticate success, global_id 134271 2026-02-17T11:56:26.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 10 monclient: _renew_subs 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc0a2a50 con 0x7fc9dc0a0750 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc012e50 con 0x7fc9dc0a0750 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9c9ffb640 10 monclient: dump: 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.945 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9cb7fe640 4 set_mon_vals no callback set 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 10 monclient: _renew_subs 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.920+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc094ec0 con 0x7fc9dc0a0750 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e330a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e330a640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 0x7fc9dc08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc095360 con 0x7fc9dc093690 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 0x7fc9dc08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient: get_auth_request con 0x7fc9dc093690 auth_method 0 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc9cc01b400 con 0x7fc9dc0a0750 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 10 monclient(hunting): handle_auth_done global_id 134274 payload 824 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e087e640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9dc09dac0 con 0x7fc9dc093690 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9c9ffb640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9ac03deb0 0x7fc9ac040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7fc9cc052690 con 0x7fc9dc0a0750 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e1880640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9ac03deb0 0x7fc9ac040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.921+0000 7fc9e1880640 10 monclient: get_auth_request con 0x7fc9ac03deb0 auth_method 0 2026-02-17T11:56:26.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9e087e640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 msgr2=0x7fc9dc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9e087e640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 0x7fc9dc08d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc096ae0 tx=0x7fc9d000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00050f0 con 0x7fc9dc093690 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 10 monclient: dump: 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.948 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc9d00050f0 con 0x7fc9dc093690 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.923+0000 7fc9c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.924+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 msgr2=0x7fc9dc08d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.924+0000 7fc9c9ffb640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 0x7fc9dc08d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc096ae0 tx=0x7fc9d000bcc0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.924+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 msgr2=0x7fc9dc08d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.924+0000 7fc9c9ffb640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093690 0x7fc9dc08d3f0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc096ae0 tx=0x7fc9d000bcc0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.924+0000 7fc9e1880640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9ac03deb0 0x7fc9ac040370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06c1c0 tx=0x7fc9d8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e330a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e330a640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 0x7fc9dc1d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e330a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0a2200 con 0x7fc9dc093a70 2026-02-17T11:56:26.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 0x7fc9dc1d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient: get_auth_request con 0x7fc9dc093a70 auth_method 0 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 10 monclient(hunting): handle_auth_done global_id 134277 payload 824 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.927+0000 7fc9e087e640 1 -- 10.20.193.51:0/2019370990 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9dc09d7b0 con 0x7fc9dc093a70 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e087e640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 msgr2=0x7fc9dc1d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e087e640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 0x7fc9dc1d88a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc077d80 tx=0x7fc9d0005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d001a730 con 0x7fc9dc093a70 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 10 monclient: dump: 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4698 (secure 0 0 0) 0x7fc9d0014430 con 0x7fc9dc093a70 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 msgr2=0x7fc9dc1d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 0x7fc9dc1d88a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc077d80 tx=0x7fc9d0005aa0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 msgr2=0x7fc9dc1d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9c9ffb640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc093a70 0x7fc9dc1d88a0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc077d80 tx=0x7fc9d0005aa0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 94, 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 87251, 2026-02-17T11:56:26.952 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:26.953 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:26.954 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:26.955 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:26.956 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.957 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:26.958 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:26.959 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:26.960 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:26.961 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:26.962 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9ac03deb0 msgr2=0x7fc9ac040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc9ac03deb0 0x7fc9ac040370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06c1c0 tx=0x7fc9d8033000 comp rx=0 tx=0).stop 2026-02-17T11:56:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 10 monclient: shutdown 2026-02-17T11:56:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 msgr2=0x7fc9dc13a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 --2- 10.20.193.51:0/2019370990 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc9dc0a0750 0x7fc9dc13a9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00c5d0 tx=0x7fc9cc00caa0 comp rx=0 tx=0).stop 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e1880640 1 -- 10.20.193.51:0/2019370990 reap_dead start 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e1880640 1 -- 10.20.193.51:0/2019370990 reap_dead start 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 shutdown_connections 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 >> 10.20.193.51:0/2019370990 conn(0x7fc9dc0a30c0 msgr2=0x7fc9dc0a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.929+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 shutdown_connections 2026-02-17T11:56:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:26.930+0000 7fc9e330a640 1 -- 10.20.193.51:0/2019370990 wait complete. 2026-02-17T11:56:26.964 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:56:26.964 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:56:26.964 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.030+0000 7f6c1b043640 10 monclient: get_monmap_and_config 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.030+0000 7f6c1b043640 10 monclient: build_initial_monmap 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.030+0000 7f6c1b043640 10 monclient: monmap: 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:27.031469+0000 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:27.031469+0000 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 Processor -- start 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 -- start start 2026-02-17T11:56:27.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient: init 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6c140a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6c1409dac0 0x7f6c1409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-c con 0x7f6c1409dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6c140a0110 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1406e140 con 0x7f6c140a0110 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1409ce60 con 0x7f6c140a3bb0 2026-02-17T11:56:27.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1409aed0 con 0x7f6c1409dac0 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c1b043640 10 monclient(hunting): authenticate will time out at 1274.650511s 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c195b9640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6c140a0110 0x7f6c1413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39138/0 (socket says 10.20.193.51:39138) 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c195b9640 1 -- 10.20.193.51:0/2176059793 learned_addr learned my addr 10.20.193.51:0/2176059793 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 1 --2- 10.20.193.51:0/2176059793 >> v2:10.20.193.142:3300/0 conn(0x7f6c1409dac0 0x7f6c1409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): get_auth_request con 0x7f6c1409dac0 auth_method 0 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_done global_id 114349 payload 274 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 1 -- 10.20.193.51:0/2176059793 >> v1:10.20.193.142:6789/0 conn(0x7f6c140a3bb0 legacy=0x7f6c1409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 1 -- 10.20.193.51:0/2176059793 >> v1:10.20.193.51:6789/0 conn(0x7f6c140a0110 legacy=0x7f6c1413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 1 monclient: found mon.noname-c 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:56:27.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.031+0000 7f6c0bfff640 1 -- 10.20.193.51:0/2176059793 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1409a5c0 con 0x7f6c1409dac0 2026-02-17T11:56:27.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0bfff640 1 -- 10.20.193.51:0/2176059793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 msgr2=0x7f6c1409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:27.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0bfff640 1 --2- 10.20.193.51:0/2176059793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c1409fbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0098a0 tx=0x7f6bfc02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5887fe732eae4c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:27.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 1 -- 10.20.193.51:0/2176059793 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc03c070 con 0x7f6c1409dac0 2026-02-17T11:56:27.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: dump: 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 1 -- 10.20.193.51:0/2176059793 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc02fce0 con 0x7f6c1409dac0 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c1b043640 5 monclient: authenticate success, global_id 114349 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 1 -- 10.20.193.51:0/2176059793 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc037660 con 0x7f6c1409dac0 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c0b7fe640 10 monclient: dump: 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c1b043640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.034+0000 7f6c1b043640 4 set_mon_vals no callback set 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 10 monclient: shutdown 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- 10.20.193.51:0/2176059793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 msgr2=0x7f6c1409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 --2- 10.20.193.51:0/2176059793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c1409fbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0098a0 tx=0x7f6bfc02ed80 comp rx=0 tx=0).stop 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- 10.20.193.51:0/2176059793 shutdown_connections 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 --2- 10.20.193.51:0/2176059793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c1409fbd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- 10.20.193.51:0/2176059793 >> 10.20.193.51:0/2176059793 conn(0x7f6c140a30c0 msgr2=0x7f6c140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- 10.20.193.51:0/2176059793 shutdown_connections 2026-02-17T11:56:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- 10.20.193.51:0/2176059793 wait complete. 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 10 monclient: build_initial_monmap 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 10 monclient: monmap: 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:27.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 Processor -- start 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 1 -- start start 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.035+0000 7f6c1b043640 10 monclient: init 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c141cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-b con 0x7f6c1409dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-a con 0x7f6c140a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c140a3bb0 0x7f6c14099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): picked mon.noname-c con 0x7f6c140a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140a3f90 con 0x7f6c140a0110 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1409caa0 con 0x7f6c1409dac0 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140a0540 con 0x7f6c140a3bb0 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c1b043640 10 monclient(hunting): authenticate will time out at 1274.655176s 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c195b9640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c140a3bb0 msgr2=0x7f6c14099ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c195b9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c140a3bb0 0x7f6c14099ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41916/0 (socket says 10.20.193.51:41916) 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 -- 10.20.193.51:0/3208795131 learned_addr learned my addr 10.20.193.51:0/3208795131 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): get_auth_request con 0x7f6c140a0110 auth_method 0 2026-02-17T11:56:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient(hunting): handle_auth_done global_id 134280 payload 824 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c140a3bb0 msgr2=0x7f6c14099ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c140a3bb0 0x7f6c14099ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c141cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 msgr2=0x7f6c141cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c141cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 monclient: found mon.noname-a 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c0bfff640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1409d7b0 con 0x7f6c140a0110 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c18db8640 10 monclient: get_auth_request con 0x7f6c1409dac0 auth_method 0 2026-02-17T11:56:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.036+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1409dac0 0x7f6c141cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c0bfff640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 msgr2=0x7f6c14099980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c0bfff640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc02f290 tx=0x7f6bfc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc047020 con 0x7f6c140a0110 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: dump: 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.042 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc042670 con 0x7f6c140a0110 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc03c040 con 0x7f6c140a0110 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c0affd640 4 set_mon_vals no callback set 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c097fa640 10 monclient: dump: 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 5 monclient: authenticate success, global_id 134280 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 10 monclient: _renew_subs 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c14093c20 con 0x7f6c140a0110 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 10 monclient: _renew_subs 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.038+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c14070ec0 con 0x7f6c140a0110 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c1b043640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c1b043640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 0x7f6c140951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1409f4c0 con 0x7f6c14094b80 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 0x7f6c140951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient: get_auth_request con 0x7f6c14094b80 auth_method 0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6bfc042a60 con 0x7f6c140a0110 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 10 monclient(hunting): handle_auth_done global_id 114352 payload 824 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c18db8640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c14069830 con 0x7f6c14094b80 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c097fa640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(385..385 src has 167..385) ==== 4779+0+0 (secure 0 0 0) 0x7f6bfc077de0 con 0x7f6c140a0110 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c195b9640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.039+0000 7f6c195b9640 10 monclient: get_auth_request con 0x7f6be403dcc0 auth_method 0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.041+0000 7f6c18db8640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 msgr2=0x7f6c140951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.041+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 0x7f6c140951a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d720 tx=0x7f6c0400dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400bb30 con 0x7f6c14094b80 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 10 monclient: dump: 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6c0400bb30 con 0x7f6c14094b80 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 msgr2=0x7f6c140951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 0x7f6c140951a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d720 tx=0x7f6c0400dbf0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 msgr2=0x7f6c140951a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c097fa640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c14094b80 0x7f6c140951a0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d720 tx=0x7f6c0400dbf0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.042+0000 7f6c195b9640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c140a2c00 tx=0x7f6c10005220 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c1b043640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c1b043640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 0x7f6c141da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c1b043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c14050ac0 con 0x7f6c1406f410 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 0x7f6c141da2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient: get_auth_request con 0x7f6c1406f410 auth_method 0 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 10 monclient(hunting): handle_auth_done global_id 114355 payload 824 2026-02-17T11:56:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.045+0000 7f6c18db8640 1 -- 10.20.193.51:0/3208795131 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c1406f7f0 con 0x7f6c1406f410 2026-02-17T11:56:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c18db8640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 msgr2=0x7f6c141da2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c18db8640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 0x7f6c141da2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d720 tx=0x7f6c04003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04005070 con 0x7f6c1406f410 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 10 monclient: dump: 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f6c04005070 con 0x7f6c1406f410 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 msgr2=0x7f6c141da2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 0x7f6c141da2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d720 tx=0x7f6c04003860 comp rx=0 tx=0).stop 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 msgr2=0x7f6c141da2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c097fa640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1406f410 0x7f6c141da2a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:27.050 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 94, 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 188923, 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:27.051 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:27.052 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:27.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:27.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 msgr2=0x7f6be4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c140a2c00 tx=0x7f6c10005220 comp rx=0 tx=0).stop 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 10 monclient: shutdown 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 msgr2=0x7f6c14099980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc02f290 tx=0x7f6bfc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c195b9640 1 -- 10.20.193.51:0/3208795131 reap_dead start 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 shutdown_connections 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 --2- 10.20.193.51:0/3208795131 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c140a0110 0x7f6c14099980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 >> 10.20.193.51:0/3208795131 conn(0x7f6c140a30c0 msgr2=0x7f6c1406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 shutdown_connections 2026-02-17T11:56:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:27.048+0000 7f6c1b043640 1 -- 10.20.193.51:0/3208795131 wait complete. 2026-02-17T11:56:27.057 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:56:27.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:56:27.714 INFO:tasks.rados.rados.0.trial142.stdout:1639: done (4 left) 2026-02-17T11:56:27.714 INFO:tasks.rados.rados.0.trial142.stdout:1640: write (excl) oid 26 current snap is 181 2026-02-17T11:56:27.714 INFO:tasks.rados.rados.0.trial142.stdout:1640: seq_num 581 ranges {564867=562497,1898744=415196,2755347=725863} 2026-02-17T11:56:27.718 INFO:tasks.rados.rados.0.trial142.stdout:1640: writing trial14245205-26 from 564867 to 1127364 tid 1 2026-02-17T11:56:27.722 INFO:tasks.rados.rados.0.trial142.stdout:1640: writing trial14245205-26 from 1898744 to 2313940 tid 2 2026-02-17T11:56:27.727 INFO:tasks.rados.rados.0.trial142.stdout:1640: writing trial14245205-26 from 2755347 to 3481210 tid 3 2026-02-17T11:56:27.727 INFO:tasks.rados.rados.0.trial142.stdout:1641: read oid 42 snap -1 2026-02-17T11:56:27.728 INFO:tasks.rados.rados.0.trial142.stdout:1641: expect (ObjNum 565 snap 172 seq_num 565) 2026-02-17T11:56:27.728 INFO:tasks.rados.rados.0.trial142.stdout:1642: delete oid 44 current snap is 181 2026-02-17T11:56:27.728 INFO:tasks.rados.rados.0.trial142.stdout:1634: expect (ObjNum 466 snap 141 seq_num 466) 2026-02-17T11:56:27.959 INFO:tasks.rados.rados.0.trial142.stdout:1635: finishing write tid 1 to trial14245205-24 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: finishing write tid 2 to trial14245205-24 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: finishing write tid 3 to trial14245205-24 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: finishing write tid 4 to trial14245205-24 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: finishing write tid 5 to trial14245205-24 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: oid 24 updating version 0 to 711 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: oid 24 version 711 is already newer than 709 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: oid 24 version 711 is already newer than 708 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:1635: oid 24 version 711 is already newer than 710 2026-02-17T11:56:27.960 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 711 (ObjNum 578 snap 181 seq_num 578) dirty exists 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1635: left oid 24 (ObjNum 578 snap 181 seq_num 578) 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 1 to trial14245205-29 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 2 to trial14245205-29 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1634: done (6 left) 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1635: done (5 left) 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1642: done (4 left) 2026-02-17T11:56:27.961 INFO:tasks.rados.rados.0.trial142.stdout:1643: snap_remove snap 180 2026-02-17T11:56:28.714 INFO:tasks.rados.rados.0.trial142.stdout:1643: done (4 left) 2026-02-17T11:56:28.714 INFO:tasks.rados.rados.0.trial142.stdout:1644: write (excl) oid 19 current snap is 181 2026-02-17T11:56:28.714 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 3 to trial14245205-29 2026-02-17T11:56:28.715 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 4 to trial14245205-29 2026-02-17T11:56:28.715 INFO:tasks.rados.rados.0.trial142.stdout:1644: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2026-02-17T11:56:28.720 INFO:tasks.rados.rados.0.trial142.stdout:1644: writing trial14245205-19 from 598481 to 1311476 tid 1 2026-02-17T11:56:28.723 INFO:tasks.rados.rados.0.trial142.stdout:1644: writing trial14245205-19 from 1899355 to 2318220 tid 2 2026-02-17T11:56:28.729 INFO:tasks.rados.rados.0.trial142.stdout:1644: writing trial14245205-19 from 3093840 to 3798481 tid 3 2026-02-17T11:56:28.729 INFO:tasks.rados.rados.0.trial142.stdout:1645: snap_remove snap 179 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1645: done (5 left) 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1646: copy_from oid 41 from oid 3 current snap is 181 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 5 to trial14245205-29 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1636: finishing write tid 6 to trial14245205-29 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1636: oid 29 updating version 0 to 661 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1636: oid 29 version 661 is already newer than 659 2026-02-17T11:56:29.693 INFO:tasks.rados.rados.0.trial142.stdout:1636: oid 29 version 661 is already newer than 657 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1636: oid 29 version 661 is already newer than 660 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1636: oid 29 version 661 is already newer than 658 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 661 (ObjNum 579 snap 181 seq_num 579) dirty exists 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1636: left oid 29 (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: finishing write tid 1 to trial14245205-20 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: finishing write tid 2 to trial14245205-20 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: finishing write tid 3 to trial14245205-20 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: finishing write tid 4 to trial14245205-20 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: finishing write tid 5 to trial14245205-20 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: oid 20 updating version 0 to 1001 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: oid 20 version 1001 is already newer than 999 2026-02-17T11:56:29.694 INFO:tasks.rados.rados.0.trial142.stdout:1638: oid 20 updating version 1001 to 1002 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1638: oid 20 version 1002 is already newer than 1000 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1002 (ObjNum 580 snap 181 seq_num 580) dirty exists 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1638: left oid 20 (ObjNum 580 snap 181 seq_num 580) 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: finishing write tid 1 to trial14245205-26 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: finishing write tid 2 to trial14245205-26 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: finishing write tid 3 to trial14245205-26 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: finishing write tid 4 to trial14245205-26 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: finishing write tid 5 to trial14245205-26 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: oid 26 updating version 0 to 750 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: oid 26 updating version 750 to 753 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: oid 26 version 753 is already newer than 751 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:1640: oid 26 version 753 is already newer than 752 2026-02-17T11:56:29.695 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 753 (ObjNum 581 snap 181 seq_num 581) dirty exists 2026-02-17T11:56:29.696 INFO:tasks.rados.rados.0.trial142.stdout:1640: left oid 26 (ObjNum 581 snap 181 seq_num 581) 2026-02-17T11:56:29.696 INFO:tasks.rados.rados.0.trial142.stdout:1641: expect (ObjNum 565 snap 172 seq_num 565) 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1644: finishing write tid 1 to trial14245205-19 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1644: finishing write tid 2 to trial14245205-19 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1644: finishing write tid 3 to trial14245205-19 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1636: done (5 left) 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1638: done (4 left) 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1640: done (3 left) 2026-02-17T11:56:29.807 INFO:tasks.rados.rados.0.trial142.stdout:1641: done (2 left) 2026-02-17T11:56:29.808 INFO:tasks.rados.rados.0.trial142.stdout:1647: read oid 49 snap -1 2026-02-17T11:56:29.808 INFO:tasks.rados.rados.0.trial142.stdout:1647: expect (ObjNum 573 snap 173 seq_num 573) 2026-02-17T11:56:29.808 INFO:tasks.rados.rados.0.trial142.stdout:1648: write (excl) oid 34 current snap is 181 2026-02-17T11:56:29.808 INFO:tasks.rados.rados.0.trial142.stdout:1644: finishing write tid 4 to trial14245205-19 2026-02-17T11:56:29.808 INFO:tasks.rados.rados.0.trial142.stdout:1648: seq_num 584 ranges {615288=788244,1957837=562523,3121263=559679} 2026-02-17T11:56:29.811 INFO:tasks.rados.rados.0.trial142.stdout:1648: writing trial14245205-34 from 615288 to 1403532 tid 1 2026-02-17T11:56:29.816 INFO:tasks.rados.rados.0.trial142.stdout:1648: writing trial14245205-34 from 1957837 to 2520360 tid 2 2026-02-17T11:56:29.820 INFO:tasks.rados.rados.0.trial142.stdout:1648: writing trial14245205-34 from 3121263 to 3680942 tid 3 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1649: delete oid 21 current snap is 181 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: finishing write tid 5 to trial14245205-19 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: oid 19 updating version 0 to 970 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: oid 19 version 970 is already newer than 968 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: oid 19 updating version 970 to 971 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: oid 19 version 971 is already newer than 969 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 971 (ObjNum 583 snap 181 seq_num 583) dirty exists 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1644: left oid 19 (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:56:29.821 INFO:tasks.rados.rados.0.trial142.stdout:1646: finishing copy_from racing read to trial14245205-41 2026-02-17T11:56:29.822 INFO:tasks.rados.rados.0.trial142.stdout:1646: finishing copy_from to trial14245205-41 2026-02-17T11:56:29.822 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 710 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:56:29.822 INFO:tasks.rados.rados.0.trial142.stdout:1647: expect (ObjNum 573 snap 173 seq_num 573) 2026-02-17T11:56:29.943 INFO:tasks.rados.rados.0.trial142.stdout:1648: finishing write tid 1 to trial14245205-34 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: finishing write tid 2 to trial14245205-34 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: finishing write tid 3 to trial14245205-34 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: finishing write tid 4 to trial14245205-34 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: finishing write tid 5 to trial14245205-34 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: oid 34 updating version 0 to 975 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: oid 34 version 975 is already newer than 972 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: oid 34 version 975 is already newer than 974 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: oid 34 version 975 is already newer than 973 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 975 (ObjNum 584 snap 181 seq_num 584) dirty exists 2026-02-17T11:56:29.944 INFO:tasks.rados.rados.0.trial142.stdout:1648: left oid 34 (ObjNum 584 snap 181 seq_num 584) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1644: done (4 left) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1646: done (3 left) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1647: done (2 left) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1648: done (1 left) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1649: done (0 left) 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1650: write (excl) oid 32 current snap is 181 2026-02-17T11:56:29.945 INFO:tasks.rados.rados.0.trial142.stdout:1650: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2026-02-17T11:56:29.948 INFO:tasks.rados.rados.0.trial142.stdout:1650: writing trial14245205-32 from 648902 to 1303997 tid 1 2026-02-17T11:56:29.953 INFO:tasks.rados.rados.0.trial142.stdout:1650: writing trial14245205-32 from 2074801 to 2640993 tid 2 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1650: writing trial14245205-32 from 3176109 to 3848902 tid 3 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1651: copy_from oid 28 from oid 27 current snap is 181 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1650: finishing write tid 1 to trial14245205-32 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1650: finishing write tid 2 to trial14245205-32 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1652: copy_from oid 42 from oid 50 current snap is 181 2026-02-17T11:56:29.958 INFO:tasks.rados.rados.0.trial142.stdout:1653: delete oid 3 current snap is 181 2026-02-17T11:56:29.959 INFO:tasks.rados.rados.0.trial142.stdout:1650: finishing write tid 3 to trial14245205-32 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: finishing write tid 4 to trial14245205-32 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: finishing write tid 5 to trial14245205-32 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: oid 32 updating version 0 to 1004 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: oid 32 updating version 1004 to 1005 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: oid 32 updating version 1005 to 1006 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: oid 32 version 1006 is already newer than 1003 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1006 (ObjNum 586 snap 181 seq_num 586) dirty exists 2026-02-17T11:56:29.960 INFO:tasks.rados.rados.0.trial142.stdout:1650: left oid 32 (ObjNum 586 snap 181 seq_num 586) 2026-02-17T11:56:29.965 INFO:tasks.rados.rados.0.trial142.stdout:1651: finishing copy_from racing read to trial14245205-28 2026-02-17T11:56:29.965 INFO:tasks.rados.rados.0.trial142.stdout:1650: done (3 left) 2026-02-17T11:56:29.965 INFO:tasks.rados.rados.0.trial142.stdout:1653: done (2 left) 2026-02-17T11:56:29.965 INFO:tasks.rados.rados.0.trial142.stdout:1654: write oid 17 current snap is 181 2026-02-17T11:56:29.966 INFO:tasks.rados.rados.0.trial142.stdout:1654: seq_num 588 ranges {682516=405593,1791765=569861,2830955=721120} 2026-02-17T11:56:29.970 INFO:tasks.rados.rados.0.trial142.stdout:1654: writing trial14245205-17 from 682516 to 1088109 tid 1 2026-02-17T11:56:29.974 INFO:tasks.rados.rados.0.trial142.stdout:1654: writing trial14245205-17 from 1791765 to 2361626 tid 2 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1654: writing trial14245205-17 from 2830955 to 3552075 tid 3 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1655: rollback oid 3 current snap is 181 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 173 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1652: finishing copy_from racing read to trial14245205-42 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1652: finishing copy_from to trial14245205-42 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 748 (ObjNum 559 snap 169 seq_num 559) dirty exists 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1651: finishing copy_from to trial14245205-28 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 999 (ObjNum 566 snap 172 seq_num 566) dirty exists 2026-02-17T11:56:29.980 INFO:tasks.rados.rados.0.trial142.stdout:1651: done (3 left) 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1652: done (2 left) 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1656: rollback oid 38 current snap is 181 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 178 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1654: finishing write tid 1 to trial14245205-17 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1654: finishing write tid 2 to trial14245205-17 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1657: read oid 10 snap -1 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1657: expect (ObjNum 502 snap 153 seq_num 502) 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1658: copy_from oid 23 from oid 40 current snap is 181 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1659: snap_create 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:1656: finishing rollback tid 1 to trial14245205-38 2026-02-17T11:56:29.981 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1110 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:56:29.982 INFO:tasks.rados.rados.0.trial142.stdout:1655: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:56:29.982 INFO:tasks.rados.rados.0.trial142.stdout:1655: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:56:29.982 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1001 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: finishing write tid 3 to trial14245205-17 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: finishing write tid 4 to trial14245205-17 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: finishing write tid 5 to trial14245205-17 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: oid 17 updating version 0 to 971 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: oid 17 updating version 971 to 973 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: oid 17 updating version 973 to 974 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: oid 17 version 974 is already newer than 972 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 974 (ObjNum 588 snap 181 seq_num 588) dirty exists 2026-02-17T11:56:29.983 INFO:tasks.rados.rados.0.trial142.stdout:1654: left oid 17 (ObjNum 588 snap 181 seq_num 588) 2026-02-17T11:56:29.985 INFO:tasks.rados.rados.0.trial142.stdout:1657: expect (ObjNum 502 snap 153 seq_num 502) 2026-02-17T11:56:30.091 INFO:tasks.rados.rados.0.trial142.stdout:1658: finishing copy_from to trial14245205-23 2026-02-17T11:56:30.092 INFO:tasks.rados.rados.0.trial142.stdout:1658: got expected ENOENT (src dne) 2026-02-17T11:56:30.092 INFO:tasks.rados.rados.0.trial142.stdout:1658: finishing copy_from racing read to trial14245205-23 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1654: done (5 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1655: done (4 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1656: done (3 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1657: done (2 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1658: done (1 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1659: done (0 left) 2026-02-17T11:56:30.928 INFO:tasks.rados.rados.0.trial142.stdout:1660: write oid 3 current snap is 182 2026-02-17T11:56:30.929 INFO:tasks.rados.rados.0.trial142.stdout:1660: seq_num 589 ranges {699323=480842,1850247=429872,2858378=532392} 2026-02-17T11:56:30.932 INFO:tasks.rados.rados.0.trial142.stdout:1660: writing trial14245205-3 from 699323 to 1180165 tid 1 2026-02-17T11:56:30.936 INFO:tasks.rados.rados.0.trial142.stdout:1660: writing trial14245205-3 from 1850247 to 2280119 tid 2 2026-02-17T11:56:30.940 INFO:tasks.rados.rados.0.trial142.stdout:1660: writing trial14245205-3 from 2858378 to 3390770 tid 3 2026-02-17T11:56:30.940 INFO:tasks.rados.rados.0.trial142.stdout:1661: write oid 33 current snap is 182 2026-02-17T11:56:30.940 INFO:tasks.rados.rados.0.trial142.stdout:1660: finishing write tid 1 to trial14245205-3 2026-02-17T11:56:30.941 INFO:tasks.rados.rados.0.trial142.stdout:1660: finishing write tid 2 to trial14245205-3 2026-02-17T11:56:30.941 INFO:tasks.rados.rados.0.trial142.stdout:1661: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2026-02-17T11:56:30.945 INFO:tasks.rados.rados.0.trial142.stdout:1661: writing trial14245205-33 from 716130 to 1272221 tid 1 2026-02-17T11:56:30.949 INFO:tasks.rados.rados.0.trial142.stdout:1661: writing trial14245205-33 from 1792376 to 2365906 tid 2 2026-02-17T11:56:30.952 INFO:tasks.rados.rados.0.trial142.stdout:1661: writing trial14245205-33 from 2769448 to 3229465 tid 3 2026-02-17T11:56:30.955 INFO:tasks.rados.rados.0.trial142.stdout:1661: writing trial14245205-33 from 3821956 to 3916130 tid 4 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1662: read oid 43 snap -1 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1662: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1663: snap_create 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1660: finishing write tid 3 to trial14245205-3 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1660: finishing write tid 4 to trial14245205-3 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1660: finishing write tid 5 to trial14245205-3 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1660: oid 3 updating version 0 to 1005 2026-02-17T11:56:30.956 INFO:tasks.rados.rados.0.trial142.stdout:1660: oid 3 version 1005 is already newer than 1004 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1660: oid 3 version 1005 is already newer than 1003 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1660: oid 3 version 1005 is already newer than 1002 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1005 (ObjNum 589 snap 182 seq_num 589) dirty exists 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1660: left oid 3 (ObjNum 589 snap 182 seq_num 589) 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 1 to trial14245205-33 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 2 to trial14245205-33 2026-02-17T11:56:30.957 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 3 to trial14245205-33 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 4 to trial14245205-33 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 5 to trial14245205-33 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: finishing write tid 6 to trial14245205-33 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: oid 33 updating version 0 to 1028 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: oid 33 updating version 1028 to 1030 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: oid 33 version 1030 is already newer than 1029 2026-02-17T11:56:30.958 INFO:tasks.rados.rados.0.trial142.stdout:1661: oid 33 version 1030 is already newer than 1027 2026-02-17T11:56:30.959 INFO:tasks.rados.rados.0.trial142.stdout:1661: oid 33 version 1030 is already newer than 1026 2026-02-17T11:56:30.959 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1030 (ObjNum 590 snap 182 seq_num 590) dirty exists 2026-02-17T11:56:30.959 INFO:tasks.rados.rados.0.trial142.stdout:1661: left oid 33 (ObjNum 590 snap 182 seq_num 590) 2026-02-17T11:56:30.959 INFO:tasks.rados.rados.0.trial142.stdout:1662: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:56:31.929 INFO:tasks.rados.rados.0.trial142.stdout:1660: done (3 left) 2026-02-17T11:56:31.930 INFO:tasks.rados.rados.0.trial142.stdout:1661: done (2 left) 2026-02-17T11:56:31.930 INFO:tasks.rados.rados.0.trial142.stdout:1662: done (1 left) 2026-02-17T11:56:31.930 INFO:tasks.rados.rados.0.trial142.stdout:1663: done (0 left) 2026-02-17T11:56:31.930 INFO:tasks.rados.rados.0.trial142.stdout:1664: delete oid 22 current snap is 183 2026-02-17T11:56:31.932 INFO:tasks.rados.rados.0.trial142.stdout:1664: done (0 left) 2026-02-17T11:56:31.932 INFO:tasks.rados.rados.0.trial142.stdout:1665: read oid 29 snap -1 2026-02-17T11:56:31.932 INFO:tasks.rados.rados.0.trial142.stdout:1665: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:56:31.933 INFO:tasks.rados.rados.0.trial142.stdout:1666: read oid 41 snap 169 2026-02-17T11:56:31.933 INFO:tasks.rados.rados.0.trial142.stdout:1666: expect (ObjNum 555 snap 168 seq_num 555) 2026-02-17T11:56:31.933 INFO:tasks.rados.rados.0.trial142.stdout:1667: write oid 4 current snap is 183 2026-02-17T11:56:31.933 INFO:tasks.rados.rados.0.trial142.stdout:1667: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2026-02-17T11:56:31.938 INFO:tasks.rados.rados.0.trial142.stdout:1667: writing trial14245205-4 from 749744 to 1456333 tid 1 2026-02-17T11:56:31.941 INFO:tasks.rados.rados.0.trial142.stdout:1667: writing trial14245205-4 from 1909340 to 2486539 tid 2 2026-02-17T11:56:31.946 INFO:tasks.rados.rados.0.trial142.stdout:1667: writing trial14245205-4 from 3224294 to 3706855 tid 3 2026-02-17T11:56:31.947 INFO:tasks.rados.rados.0.trial142.stdout:1668: read oid 46 snap -1 2026-02-17T11:56:31.947 INFO:tasks.rados.rados.0.trial142.stdout:1668: expect (ObjNum 552 snap 168 seq_num 552) 2026-02-17T11:56:31.947 INFO:tasks.rados.rados.0.trial142.stdout:1669: write oid 43 current snap is 183 2026-02-17T11:56:31.947 INFO:tasks.rados.rados.0.trial142.stdout:1669: seq_num 593 ranges {766551=498191,1684175=720857,2851717=693833} 2026-02-17T11:56:31.951 INFO:tasks.rados.rados.0.trial142.stdout:1669: writing trial14245205-43 from 766551 to 1264742 tid 1 2026-02-17T11:56:31.955 INFO:tasks.rados.rados.0.trial142.stdout:1669: writing trial14245205-43 from 1684175 to 2405032 tid 2 2026-02-17T11:56:31.959 INFO:tasks.rados.rados.0.trial142.stdout:1669: writing trial14245205-43 from 2851717 to 3545550 tid 3 2026-02-17T11:56:31.959 INFO:tasks.rados.rados.0.trial142.stdout:1670: snap_remove snap 173 2026-02-17T11:56:32.934 INFO:tasks.rados.rados.0.trial142.stdout:1670: done (5 left) 2026-02-17T11:56:32.934 INFO:tasks.rados.rados.0.trial142.stdout:1671: rollback oid 12 current snap is 183 2026-02-17T11:56:32.934 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 12 to 178 2026-02-17T11:56:32.935 INFO:tasks.rados.rados.0.trial142.stdout:1665: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:56:33.020 INFO:tasks.rados.rados.0.trial142.stdout:1666: expect (ObjNum 555 snap 168 seq_num 555) 2026-02-17T11:56:33.148 INFO:tasks.rados.rados.0.trial142.stdout:1667: finishing write tid 1 to trial14245205-4 2026-02-17T11:56:33.148 INFO:tasks.rados.rados.0.trial142.stdout:1667: finishing write tid 2 to trial14245205-4 2026-02-17T11:56:33.148 INFO:tasks.rados.rados.0.trial142.stdout:1665: done (5 left) 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1666: done (4 left) 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1672: read oid 50 snap 181 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1672: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1673: read oid 6 snap -1 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1673: expect deleted 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1674: write (excl) oid 40 current snap is 183 2026-02-17T11:56:33.149 INFO:tasks.rados.rados.0.trial142.stdout:1674: seq_num 594 ranges {783358=573440,2026304=580868,3279140=621458} 2026-02-17T11:56:33.153 INFO:tasks.rados.rados.0.trial142.stdout:1674: writing trial14245205-40 from 783358 to 1356798 tid 1 2026-02-17T11:56:33.158 INFO:tasks.rados.rados.0.trial142.stdout:1674: writing trial14245205-40 from 2026304 to 2607172 tid 2 2026-02-17T11:56:33.163 INFO:tasks.rados.rados.0.trial142.stdout:1674: writing trial14245205-40 from 3279140 to 3900598 tid 3 2026-02-17T11:56:33.163 INFO:tasks.rados.rados.0.trial142.stdout:1675: snap_create 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: finishing write tid 3 to trial14245205-4 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: finishing write tid 4 to trial14245205-4 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: finishing write tid 5 to trial14245205-4 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: oid 4 updating version 0 to 1461 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: oid 4 updating version 1461 to 1464 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: oid 4 version 1464 is already newer than 1462 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: oid 4 version 1464 is already newer than 1463 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 1464 (ObjNum 592 snap 183 seq_num 592) dirty exists 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1667: left oid 4 (ObjNum 592 snap 183 seq_num 592) 2026-02-17T11:56:33.164 INFO:tasks.rados.rados.0.trial142.stdout:1668: expect (ObjNum 552 snap 168 seq_num 552) 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: finishing write tid 1 to trial14245205-43 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: finishing write tid 2 to trial14245205-43 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: finishing write tid 3 to trial14245205-43 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: finishing write tid 4 to trial14245205-43 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: finishing write tid 5 to trial14245205-43 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: oid 43 updating version 0 to 1468 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: oid 43 updating version 1468 to 1469 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: oid 43 version 1469 is already newer than 1466 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: oid 43 version 1469 is already newer than 1467 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1469 (ObjNum 593 snap 183 seq_num 593) dirty exists 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1669: left oid 43 (ObjNum 593 snap 183 seq_num 593) 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1671: finishing rollback tid 0 to trial14245205-12 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1671: finishing rollback tid 1 to trial14245205-12 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1671: finishing rollback tid 2 to trial14245205-12 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1477 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:56:33.241 INFO:tasks.rados.rados.0.trial142.stdout:1672: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: finishing write tid 1 to trial14245205-40 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: finishing write tid 2 to trial14245205-40 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: finishing write tid 3 to trial14245205-40 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: finishing write tid 4 to trial14245205-40 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: finishing write tid 5 to trial14245205-40 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: oid 40 updating version 0 to 653 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: oid 40 updating version 653 to 654 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: oid 40 updating version 654 to 656 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: oid 40 version 656 is already newer than 655 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 656 (ObjNum 594 snap 183 seq_num 594) dirty exists 2026-02-17T11:56:33.426 INFO:tasks.rados.rados.0.trial142.stdout:1674: left oid 40 (ObjNum 594 snap 183 seq_num 594) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1667: done (7 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1668: done (6 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1669: done (5 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1671: done (4 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1672: done (3 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1673: done (2 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1674: done (1 left) 2026-02-17T11:56:33.938 INFO:tasks.rados.rados.0.trial142.stdout:1675: done (0 left) 2026-02-17T11:56:33.939 INFO:tasks.rados.rados.0.trial142.stdout:1676: snap_remove snap 174 2026-02-17T11:56:34.693 INFO:tasks.rados.rados.0.trial142.stdout:1676: done (0 left) 2026-02-17T11:56:34.693 INFO:tasks.rados.rados.0.trial142.stdout:1677: read oid 19 snap -1 2026-02-17T11:56:34.693 INFO:tasks.rados.rados.0.trial142.stdout:1677: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:56:34.693 INFO:tasks.rados.rados.0.trial142.stdout:1678: write oid 35 current snap is 184 2026-02-17T11:56:34.693 INFO:tasks.rados.rados.0.trial142.stdout:1678: seq_num 595 ranges {400165=648689,1684786=315379} 2026-02-17T11:56:34.698 INFO:tasks.rados.rados.0.trial142.stdout:1678: writing trial14245205-35 from 400165 to 1048854 tid 1 2026-02-17T11:56:34.701 INFO:tasks.rados.rados.0.trial142.stdout:1678: writing trial14245205-35 from 1684786 to 2000165 tid 2 2026-02-17T11:56:34.701 INFO:tasks.rados.rados.0.trial142.stdout:1679: delete oid 22 current snap is 184 2026-02-17T11:56:34.702 INFO:tasks.rados.rados.0.trial142.stdout:1679: done (2 left) 2026-02-17T11:56:34.702 INFO:tasks.rados.rados.0.trial142.stdout:1680: rollback oid 3 current snap is 184 2026-02-17T11:56:34.702 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 169 2026-02-17T11:56:34.702 INFO:tasks.rados.rados.0.trial142.stdout:1681: snap_create 2026-02-17T11:56:34.704 INFO:tasks.rados.rados.0.trial142.stdout:1677: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: finishing write tid 1 to trial14245205-35 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: finishing write tid 2 to trial14245205-35 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: finishing write tid 3 to trial14245205-35 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1680: finishing rollback tid 0 to trial14245205-3 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: finishing write tid 4 to trial14245205-35 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: oid 35 updating version 0 to 1032 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: oid 35 updating version 1032 to 1033 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: oid 35 version 1033 is already newer than 1031 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1033 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1678: left oid 35 (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1680: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:1680: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:56:34.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1008 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1677: done (3 left) 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1678: done (2 left) 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1680: done (1 left) 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1681: done (0 left) 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1682: rollback oid 4 current snap is 185 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 159 2026-02-17T11:56:35.694 INFO:tasks.rados.rados.0.trial142.stdout:1683: snap_remove snap 184 2026-02-17T11:56:36.696 INFO:tasks.rados.rados.0.trial142.stdout:1683: done (1 left) 2026-02-17T11:56:36.696 INFO:tasks.rados.rados.0.trial142.stdout:1684: snap_remove snap 169 2026-02-17T11:56:37.698 INFO:tasks.rados.rados.0.trial142.stdout:1684: done (1 left) 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1685: rollback oid 2 current snap is 185 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 183 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1682: finishing rollback tid 0 to trial14245205-4 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1682: finishing rollback tid 1 to trial14245205-4 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1682: finishing rollback tid 2 to trial14245205-4 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 1487 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1682: done (1 left) 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1686: read oid 20 snap -1 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1686: expect (ObjNum 580 snap 181 seq_num 580) 2026-02-17T11:56:37.699 INFO:tasks.rados.rados.0.trial142.stdout:1687: snap_create 2026-02-17T11:56:37.705 INFO:tasks.rados.rados.0.trial142.stdout:1685: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:56:37.705 INFO:tasks.rados.rados.0.trial142.stdout:1685: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:56:37.705 INFO:tasks.rados.rados.0.trial142.stdout:1685: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:56:37.705 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1222 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:56:37.705 INFO:tasks.rados.rados.0.trial142.stdout:1686: expect (ObjNum 580 snap 181 seq_num 580) 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1685: done (2 left) 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1686: done (1 left) 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1687: done (0 left) 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1688: read oid 6 snap -1 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1688: expect deleted 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1689: write (excl) oid 25 current snap is 186 2026-02-17T11:56:38.702 INFO:tasks.rados.rados.0.trial142.stdout:1689: seq_num 597 ranges {433779=799187,1801750=232029} 2026-02-17T11:56:38.706 INFO:tasks.rados.rados.0.trial142.stdout:1689: writing trial14245205-25 from 433779 to 1232966 tid 1 2026-02-17T11:56:38.709 INFO:tasks.rados.rados.0.trial142.stdout:1689: writing trial14245205-25 from 1801750 to 2033779 tid 2 2026-02-17T11:56:38.709 INFO:tasks.rados.rados.0.trial142.stdout:1690: write (excl) oid 17 current snap is 186 2026-02-17T11:56:38.709 INFO:tasks.rados.rados.0.trial142.stdout:1690: seq_num 598 ranges {450586=474436,1343879=588206} 2026-02-17T11:56:38.713 INFO:tasks.rados.rados.0.trial142.stdout:1690: writing trial14245205-17 from 450586 to 925022 tid 1 2026-02-17T11:56:38.717 INFO:tasks.rados.rados.0.trial142.stdout:1690: writing trial14245205-17 from 1343879 to 1932085 tid 2 2026-02-17T11:56:38.717 INFO:tasks.rados.rados.0.trial142.stdout:1691: read oid 1 snap -1 2026-02-17T11:56:38.717 INFO:tasks.rados.rados.0.trial142.stdout:1691: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:56:38.717 INFO:tasks.rados.rados.0.trial142.stdout:1692: snap_remove snap 175 2026-02-17T11:56:39.694 INFO:tasks.rados.rados.0.trial142.stdout:1692: done (4 left) 2026-02-17T11:56:39.694 INFO:tasks.rados.rados.0.trial142.stdout:1693: read oid 8 snap 178 2026-02-17T11:56:39.694 INFO:tasks.rados.rados.0.trial142.stdout:1693: expect (ObjNum 562 snap 170 seq_num 562) 2026-02-17T11:56:39.695 INFO:tasks.rados.rados.0.trial142.stdout:1694: read oid 13 snap 178 2026-02-17T11:56:39.695 INFO:tasks.rados.rados.0.trial142.stdout:1694: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:56:39.695 INFO:tasks.rados.rados.0.trial142.stdout:1695: snap_remove snap 159 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:1695: done (6 left) 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:1696: rollback oid 2 current snap is 186 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 181 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:1689: finishing write tid 1 to trial14245205-25 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:1689: finishing write tid 2 to trial14245205-25 2026-02-17T11:56:40.699 INFO:tasks.rados.rados.0.trial142.stdout:1689: finishing write tid 3 to trial14245205-25 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1689: finishing write tid 4 to trial14245205-25 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1689: oid 25 updating version 0 to 754 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1689: oid 25 updating version 754 to 755 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1689: oid 25 updating version 755 to 756 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 756 (ObjNum 597 snap 186 seq_num 597) dirty exists 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1689: left oid 25 (ObjNum 597 snap 186 seq_num 597) 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1690: finishing write tid 1 to trial14245205-17 2026-02-17T11:56:40.700 INFO:tasks.rados.rados.0.trial142.stdout:1691: expect (ObjNum 473 snap 141 seq_num 473) 2026-02-17T11:56:40.792 INFO:tasks.rados.rados.0.trial142.stdout:1690: finishing write tid 2 to trial14245205-17 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: finishing write tid 3 to trial14245205-17 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1688: done (6 left) 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1689: done (5 left) 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1691: done (4 left) 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1697: copy_from oid 6 from oid 39 current snap is 186 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: finishing write tid 4 to trial14245205-17 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: oid 17 updating version 0 to 977 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: oid 17 version 977 is already newer than 975 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: oid 17 version 977 is already newer than 976 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 977 (ObjNum 598 snap 186 seq_num 598) dirty exists 2026-02-17T11:56:40.793 INFO:tasks.rados.rados.0.trial142.stdout:1690: left oid 17 (ObjNum 598 snap 186 seq_num 598) 2026-02-17T11:56:40.794 INFO:tasks.rados.rados.0.trial142.stdout:1693: expect (ObjNum 562 snap 170 seq_num 562) 2026-02-17T11:56:40.899 INFO:tasks.rados.rados.0.trial142.stdout:1694: expect (ObjNum 517 snap 160 seq_num 517) 2026-02-17T11:56:40.965 INFO:tasks.rados.rados.0.trial142.stdout:1696: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:56:40.965 INFO:tasks.rados.rados.0.trial142.stdout:1696: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:56:40.965 INFO:tasks.rados.rados.0.trial142.stdout:1696: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:56:40.965 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1225 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1697: finishing copy_from racing read to trial14245205-6 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1690: done (4 left) 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1693: done (3 left) 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1694: done (2 left) 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1696: done (1 left) 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1698: copy_from oid 34 from oid 1 current snap is 186 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1697: finishing copy_from to trial14245205-6 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 707 (ObjNum 576 snap 180 seq_num 576) dirty exists 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1697: done (1 left) 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1699: read oid 40 snap -1 2026-02-17T11:56:40.966 INFO:tasks.rados.rados.0.trial142.stdout:1699: expect (ObjNum 594 snap 183 seq_num 594) 2026-02-17T11:56:40.967 INFO:tasks.rados.rados.0.trial142.stdout:1700: delete oid 6 current snap is 186 2026-02-17T11:56:40.971 INFO:tasks.rados.rados.0.trial142.stdout:1698: finishing copy_from racing read to trial14245205-34 2026-02-17T11:56:40.973 INFO:tasks.rados.rados.0.trial142.stdout:1698: finishing copy_from to trial14245205-34 2026-02-17T11:56:40.973 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 299 (ObjNum 473 snap 141 seq_num 473) dirty exists 2026-02-17T11:56:40.974 INFO:tasks.rados.rados.0.trial142.stdout:1699: expect (ObjNum 594 snap 183 seq_num 594) 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1698: done (2 left) 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1699: done (1 left) 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1700: done (0 left) 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1701: copy_from oid 24 from oid 35 current snap is 186 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1702: read oid 45 snap -1 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1702: expect (ObjNum 577 snap 180 seq_num 577) 2026-02-17T11:56:41.069 INFO:tasks.rados.rados.0.trial142.stdout:1703: copy_from oid 1 from oid 38 current snap is 186 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1704: read oid 14 snap -1 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1704: expect (ObjNum 533 snap 165 seq_num 533) 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1705: snap_create 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1703: finishing copy_from to trial14245205-1 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1703: got expected ENOENT (src dne) 2026-02-17T11:56:41.070 INFO:tasks.rados.rados.0.trial142.stdout:1703: finishing copy_from racing read to trial14245205-1 2026-02-17T11:56:41.073 INFO:tasks.rados.rados.0.trial142.stdout:1701: finishing copy_from racing read to trial14245205-24 2026-02-17T11:56:41.073 INFO:tasks.rados.rados.0.trial142.stdout:1702: expect (ObjNum 577 snap 180 seq_num 577) 2026-02-17T11:56:41.233 INFO:tasks.rados.rados.0.trial142.stdout:1704: expect (ObjNum 533 snap 165 seq_num 533) 2026-02-17T11:56:41.341 INFO:tasks.rados.rados.0.trial142.stdout:1701: finishing copy_from to trial14245205-24 2026-02-17T11:56:41.341 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1033 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:56:41.704 INFO:tasks.rados.rados.0.trial142.stdout:1701: done (4 left) 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1702: done (3 left) 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1703: done (2 left) 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1704: done (1 left) 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1705: done (0 left) 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1706: write (excl) oid 18 current snap is 187 2026-02-17T11:56:41.705 INFO:tasks.rados.rados.0.trial142.stdout:1706: seq_num 600 ranges {484200=624934,1860843=223357} 2026-02-17T11:56:41.708 INFO:tasks.rados.rados.0.trial142.stdout:1706: writing trial14245205-18 from 484200 to 1109134 tid 1 2026-02-17T11:56:41.713 INFO:tasks.rados.rados.0.trial142.stdout:1706: writing trial14245205-18 from 1860843 to 2084200 tid 2 2026-02-17T11:56:41.713 INFO:tasks.rados.rados.0.trial142.stdout:1707: snap_remove snap 177 2026-02-17T11:56:42.707 INFO:tasks.rados.rados.0.trial142.stdout:1707: done (1 left) 2026-02-17T11:56:42.707 INFO:tasks.rados.rados.0.trial142.stdout:1708: snap_remove snap 185 2026-02-17T11:56:43.708 INFO:tasks.rados.rados.0.trial142.stdout:1708: done (1 left) 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1709: read oid 20 snap 181 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1709: expect (ObjNum 580 snap 181 seq_num 580) 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1710: write (excl) oid 40 current snap is 187 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: finishing write tid 1 to trial14245205-18 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: finishing write tid 2 to trial14245205-18 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: finishing write tid 3 to trial14245205-18 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: finishing write tid 4 to trial14245205-18 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: oid 18 updating version 0 to 1520 2026-02-17T11:56:43.709 INFO:tasks.rados.rados.0.trial142.stdout:1706: oid 18 version 1520 is already newer than 1519 2026-02-17T11:56:43.710 INFO:tasks.rados.rados.0.trial142.stdout:1706: oid 18 updating version 1520 to 1521 2026-02-17T11:56:43.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1521 (ObjNum 600 snap 187 seq_num 600) dirty exists 2026-02-17T11:56:43.710 INFO:tasks.rados.rados.0.trial142.stdout:1706: left oid 18 (ObjNum 600 snap 187 seq_num 600) 2026-02-17T11:56:43.710 INFO:tasks.rados.rados.0.trial142.stdout:1710: seq_num 601 ranges {501007=416536,1635678=465329} 2026-02-17T11:56:43.712 INFO:tasks.rados.rados.0.trial142.stdout:1710: writing trial14245205-40 from 501007 to 917543 tid 1 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1710: writing trial14245205-40 from 1635678 to 2101007 tid 2 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1706: done (2 left) 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1711: read oid 37 snap 183 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1711: expect (ObjNum 511 snap 156 seq_num 511) 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1712: read oid 19 snap -1 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1712: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1713: read oid 50 snap 186 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1713: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:43.717 INFO:tasks.rados.rados.0.trial142.stdout:1714: read oid 11 snap -1 2026-02-17T11:56:43.718 INFO:tasks.rados.rados.0.trial142.stdout:1714: expect (ObjNum 570 snap 173 seq_num 570) 2026-02-17T11:56:43.718 INFO:tasks.rados.rados.0.trial142.stdout:1715: delete oid 38 current snap is 187 2026-02-17T11:56:43.718 INFO:tasks.rados.rados.0.trial142.stdout:1709: expect (ObjNum 580 snap 181 seq_num 580) 2026-02-17T11:56:43.831 INFO:tasks.rados.rados.0.trial142.stdout:1710: finishing write tid 1 to trial14245205-40 2026-02-17T11:56:43.831 INFO:tasks.rados.rados.0.trial142.stdout:1709: done (6 left) 2026-02-17T11:56:43.831 INFO:tasks.rados.rados.0.trial142.stdout:1715: done (5 left) 2026-02-17T11:56:43.832 INFO:tasks.rados.rados.0.trial142.stdout:1716: write (excl) oid 6 current snap is 187 2026-02-17T11:56:43.832 INFO:tasks.rados.rados.0.trial142.stdout:1711: expect (ObjNum 511 snap 156 seq_num 511) 2026-02-17T11:56:43.978 INFO:tasks.rados.rados.0.trial142.stdout:1713: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:44.164 INFO:tasks.rados.rados.0.trial142.stdout:1710: finishing write tid 2 to trial14245205-40 2026-02-17T11:56:44.164 INFO:tasks.rados.rados.0.trial142.stdout:1710: finishing write tid 3 to trial14245205-40 2026-02-17T11:56:44.164 INFO:tasks.rados.rados.0.trial142.stdout:1716: seq_num 603 ranges {534621=567034,1636289=498332} 2026-02-17T11:56:44.168 INFO:tasks.rados.rados.0.trial142.stdout:1716: writing trial14245205-6 from 534621 to 1101655 tid 1 2026-02-17T11:56:44.172 INFO:tasks.rados.rados.0.trial142.stdout:1716: writing trial14245205-6 from 1636289 to 2134621 tid 2 2026-02-17T11:56:44.172 INFO:tasks.rados.rados.0.trial142.stdout:1711: done (5 left) 2026-02-17T11:56:44.172 INFO:tasks.rados.rados.0.trial142.stdout:1713: done (4 left) 2026-02-17T11:56:44.172 INFO:tasks.rados.rados.0.trial142.stdout:1717: snap_remove snap 183 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1717: done (4 left) 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1718: read oid 31 snap -1 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1718: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1719: copy_from oid 34 from oid 25 current snap is 187 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: finishing write tid 4 to trial14245205-40 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: oid 40 updating version 0 to 710 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: oid 40 updating version 710 to 711 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: oid 40 version 711 is already newer than 709 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 711 (ObjNum 601 snap 187 seq_num 601) dirty exists 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: left oid 40 (ObjNum 601 snap 187 seq_num 601) 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1710: done (5 left) 2026-02-17T11:56:44.695 INFO:tasks.rados.rados.0.trial142.stdout:1720: rollback oid 37 current snap is 187 2026-02-17T11:56:44.696 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 178 2026-02-17T11:56:44.696 INFO:tasks.rados.rados.0.trial142.stdout:1712: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:56:44.783 INFO:tasks.rados.rados.0.trial142.stdout:1714: expect (ObjNum 570 snap 173 seq_num 570) 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: finishing write tid 1 to trial14245205-6 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: finishing write tid 2 to trial14245205-6 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: finishing write tid 3 to trial14245205-6 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: finishing write tid 4 to trial14245205-6 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: oid 6 updating version 0 to 713 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: oid 6 updating version 713 to 714 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: oid 6 version 714 is already newer than 712 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 714 (ObjNum 603 snap 187 seq_num 603) dirty exists 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: left oid 6 (ObjNum 603 snap 187 seq_num 603) 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1720: finishing rollback tid 0 to trial14245205-37 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1712: done (5 left) 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1714: done (4 left) 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1716: done (3 left) 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1721: delete oid 8 current snap is 187 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1720: finishing rollback tid 1 to trial14245205-37 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1720: finishing rollback tid 2 to trial14245205-37 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 1011 (ObjNum 511 snap 156 seq_num 511) dirty exists 2026-02-17T11:56:44.866 INFO:tasks.rados.rados.0.trial142.stdout:1718: expect (ObjNum 460 snap 139 seq_num 460) 2026-02-17T11:56:45.068 INFO:tasks.rados.rados.0.trial142.stdout:1719: finishing copy_from racing read to trial14245205-34 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1719: finishing copy_from to trial14245205-34 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 756 (ObjNum 597 snap 186 seq_num 597) dirty exists 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1718: done (3 left) 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1719: done (2 left) 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1720: done (1 left) 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1721: done (0 left) 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1722: read oid 42 snap 181 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1722: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:45.069 INFO:tasks.rados.rados.0.trial142.stdout:1723: snap_remove snap 182 2026-02-17T11:56:45.774 INFO:tasks.rados.rados.0.trial142.stdout:1723: done (1 left) 2026-02-17T11:56:45.775 INFO:tasks.rados.rados.0.trial142.stdout:1724: read oid 29 snap -1 2026-02-17T11:56:45.775 INFO:tasks.rados.rados.0.trial142.stdout:1724: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:56:45.775 INFO:tasks.rados.rados.0.trial142.stdout:1725: write (excl) oid 21 current snap is 187 2026-02-17T11:56:45.775 INFO:tasks.rados.rados.0.trial142.stdout:1725: seq_num 605 ranges {568235=717532,1753253=414982} 2026-02-17T11:56:45.779 INFO:tasks.rados.rados.0.trial142.stdout:1725: writing trial14245205-21 from 568235 to 1285767 tid 1 2026-02-17T11:56:45.783 INFO:tasks.rados.rados.0.trial142.stdout:1725: writing trial14245205-21 from 1753253 to 2168235 tid 2 2026-02-17T11:56:45.783 INFO:tasks.rados.rados.0.trial142.stdout:1726: delete oid 31 current snap is 187 2026-02-17T11:56:45.783 INFO:tasks.rados.rados.0.trial142.stdout:1722: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:56:45.970 INFO:tasks.rados.rados.0.trial142.stdout:1724: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:56:46.057 INFO:tasks.rados.rados.0.trial142.stdout:1725: finishing write tid 1 to trial14245205-21 2026-02-17T11:56:46.057 INFO:tasks.rados.rados.0.trial142.stdout:1725: finishing write tid 2 to trial14245205-21 2026-02-17T11:56:46.057 INFO:tasks.rados.rados.0.trial142.stdout:1722: done (3 left) 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1724: done (2 left) 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1726: done (1 left) 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1727: delete oid 31 current snap is 187 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1725: finishing write tid 3 to trial14245205-21 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1725: finishing write tid 4 to trial14245205-21 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1725: oid 21 updating version 0 to 978 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1725: oid 21 updating version 978 to 979 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:1725: oid 21 version 979 is already newer than 977 2026-02-17T11:56:46.058 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 979 (ObjNum 605 snap 187 seq_num 605) dirty exists 2026-02-17T11:56:46.059 INFO:tasks.rados.rados.0.trial142.stdout:1725: left oid 21 (ObjNum 605 snap 187 seq_num 605) 2026-02-17T11:56:46.059 INFO:tasks.rados.rados.0.trial142.stdout:1725: done (1 left) 2026-02-17T11:56:46.059 INFO:tasks.rados.rados.0.trial142.stdout:1727: done (0 left) 2026-02-17T11:56:46.059 INFO:tasks.rados.rados.0.trial142.stdout:1728: snap_create 2026-02-17T11:56:46.964 INFO:tasks.rados.rados.0.trial142.stdout:1728: done (0 left) 2026-02-17T11:56:46.964 INFO:tasks.rados.rados.0.trial142.stdout:1729: write oid 25 current snap is 188 2026-02-17T11:56:46.964 INFO:tasks.rados.rados.0.trial142.stdout:1729: seq_num 608 ranges {618656=543279,1812346=406310} 2026-02-17T11:56:46.968 INFO:tasks.rados.rados.0.trial142.stdout:1729: writing trial14245205-25 from 618656 to 1161935 tid 1 2026-02-17T11:56:46.972 INFO:tasks.rados.rados.0.trial142.stdout:1729: writing trial14245205-25 from 1812346 to 2218656 tid 2 2026-02-17T11:56:46.972 INFO:tasks.rados.rados.0.trial142.stdout:1730: snap_remove snap 181 2026-02-17T11:56:46.972 INFO:tasks.rados.rados.0.trial142.stdout:1729: finishing write tid 1 to trial14245205-25 2026-02-17T11:56:47.058 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:56:47.058 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:56:47.058 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:56:47.058 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:56:47.061 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:56:47.061 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:56:47.062 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:47.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 10 monclient: get_monmap_and_config 2026-02-17T11:56:47.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 10 monclient: build_initial_monmap 2026-02-17T11:56:47.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 10 monclient: monmap: 2026-02-17T11:56:47.130 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:47.127407+0000 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:47.127407+0000 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:47.131 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 1 Processor -- start 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 1 -- start start 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.126+0000 7f1fb66e1640 10 monclient: init 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1fb00a3bb0 0x7f1fb009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-a con 0x7f1fb00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-b con 0x7f1fb009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1fb009ff40 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb006e140 con 0x7f1fb009ff40 2026-02-17T11:56:47.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb009aed0 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb009caa0 con 0x7f1fb009dac0 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1fb66e1640 10 monclient(hunting): authenticate will time out at 1294.746253s 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59400/0 (socket says 10.20.193.51:59400) 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 -- 10.20.193.51:0/1573437860 learned_addr learned my addr 10.20.193.51:0/1573437860 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 10 monclient(hunting): get_auth_request con 0x7f1fb009dac0 auth_method 0 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:47.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:47.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:47.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 -- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:47.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 -- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:47.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:47.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.127+0000 7f1faf7fe640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.129+0000 7f1faffff640 1 --2- 10.20.193.51:0/1573437860 >> v2:10.20.193.51:3300/0 conn(0x7f1fb00a3bb0 0x7f1fb009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.129+0000 7f1faffff640 10 monclient(hunting): get_auth_request con 0x7f1fb00a3bb0 auth_method 0 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.129+0000 7f1faffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.129+0000 7f1faffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.129+0000 7f1faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:47.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1fb4c57640 1 -- 10.20.193.51:0/1573437860 >> v1:10.20.193.51:6789/0 conn(0x7f1fb009ff40 legacy=0x7f1fb013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient(hunting): handle_auth_done global_id 134283 payload 274 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 1 -- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 1 -- 10.20.193.51:0/1573437860 >> v1:10.20.193.51:6789/0 conn(0x7f1fb009ff40 legacy=0x7f1fb013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 1 monclient: found mon.noname-a 2026-02-17T11:56:47.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.131+0000 7f1faffff640 1 -- 10.20.193.51:0/1573437860 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb009ce60 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.133+0000 7f1faffff640 1 -- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb00a3bb0 msgr2=0x7f1fb009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.133+0000 7f1faffff640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb009f4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009920 tx=0x7f1f9c02edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703e22bb3dbd766e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 1 -- 10.20.193.51:0/1573437860 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c03c070 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: dump: 2026-02-17T11:56:47.144 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:47.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 1 -- 10.20.193.51:0/1573437860 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c02fcd0 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 5 monclient: authenticate success, global_id 134283 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 1 -- 10.20.193.51:0/1573437860 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c037660 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1faeffd640 10 monclient: dump: 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.146 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 4 set_mon_vals no callback set 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 10 monclient: shutdown 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 -- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb00a3bb0 msgr2=0x7f1fb009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:47.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb009f4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009920 tx=0x7f1f9c02edb0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 -- 10.20.193.51:0/1573437860 shutdown_connections 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/1573437860 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb009f4c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 -- 10.20.193.51:0/1573437860 >> 10.20.193.51:0/1573437860 conn(0x7f1fb00a30c0 msgr2=0x7f1fb00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 -- 10.20.193.51:0/1573437860 shutdown_connections 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 -- 10.20.193.51:0/1573437860 wait complete. 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 10 monclient: build_initial_monmap 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 10 monclient: monmap: 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:47.148 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.134+0000 7f1fb66e1640 1 Processor -- start 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 -- start start 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient: init 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:47.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-c con 0x7f1fb009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 0x7f1fb0094390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-a con 0x7f1fb009ff40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb00948d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): picked mon.noname-b con 0x7f1fb00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb009a880 con 0x7f1fb009ff40 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00a3fd0 con 0x7f1fb00a3bb0 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb00a0370 con 0x7f1fb009dac0 2026-02-17T11:56:47.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb66e1640 10 monclient(hunting): authenticate will time out at 1294.754328s 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 0x7f1fb0094390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59412/0 (socket says 10.20.193.51:59412) 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 -- 10.20.193.51:0/4015636219 learned_addr learned my addr 10.20.193.51:0/4015636219 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): get_auth_request con 0x7f1fb009ff40 auth_method 0 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 10 monclient(hunting): get_auth_request con 0x7f1fb009dac0 auth_method 0 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:47.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb0093e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb0093e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faffff640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb4c57640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb00948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb4c57640 10 monclient(hunting): get_auth_request con 0x7f1fb00a3bb0 auth_method 0 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb4c57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:47.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb4c57640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1fb4c57640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient(hunting): handle_auth_done global_id 134289 payload 824 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 msgr2=0x7f1fb0093e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1fb00a3bb0 msgr2=0x7f1fb00948d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb00948d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.135+0000 7f1faf7fe640 1 -- 10.20.193.51:0/4015636219 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb0096650 con 0x7f1fb009ff40 2026-02-17T11:56:47.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1faf7fe640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 msgr2=0x7f1fb0094390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1faf7fe640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 0x7f1fb0094390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000d720 tx=0x7f1fa000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0018030 con 0x7f1fb009ff40 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: dump: 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.154 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: _finish_auth 0 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: _check_auth_tickets 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa000de50 con 0x7f1fb009ff40 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 5 monclient: authenticate success, global_id 134289 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 10 monclient: _renew_subs 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb00963d0 con 0x7f1fb009ff40 2026-02-17T11:56:47.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000bae0 con 0x7f1fb009ff40 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fae7fc640 4 set_mon_vals no callback set 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1facff9640 10 monclient: dump: 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:47.156 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 10 monclient: _renew_subs 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.137+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb0097de0 con 0x7f1fb009ff40 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1fb66e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1fb66e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1fb66e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb009e370 con 0x7f1fb009ff40 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1fa0013050 con 0x7f1fb009ff40 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1facff9640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 0x7f1f80040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:47.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.138+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(405..405 src has 167..405) ==== 4799+0+0 (secure 0 0 0) 0x7f1fa0052540 con 0x7f1fb009ff40 2026-02-17T11:56:47.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.139+0000 7f1faffff640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 0x7f1f80040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:47.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.139+0000 7f1faffff640 10 monclient: get_auth_request con 0x7f1f8003dd60 auth_method 0 2026-02-17T11:56:47.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.141+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1fa0022070 con 0x7f1fb009ff40 2026-02-17T11:56:47.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.141+0000 7f1facff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:47.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.141+0000 7f1facff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:47.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.141+0000 7f1faffff640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 0x7f1f80040220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009920 tx=0x7f1f9c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1fb66e1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1fb66e1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1fb66e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1fb00008d0 con 0x7f1fb009ff40 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1facff9640 1 -- 10.20.193.51:0/4015636219 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f1fa001c3b0 con 0x7f1fb009ff40 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1facff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:47.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.257+0000 7f1facff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:47.261 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 msgr2=0x7f1f80040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 0x7f1f80040220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009920 tx=0x7f1f9c033000 comp rx=0 tx=0).stop 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 10 monclient: shutdown 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 msgr2=0x7f1fb0094390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:47.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 0x7f1fb0094390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000d720 tx=0x7f1fa000dbf0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 shutdown_connections 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1f8003dd60 0x7f1f80040220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1fb00a3bb0 0x7f1fb00948d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1fb009ff40 0x7f1fb0094390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 --2- 10.20.193.51:0/4015636219 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1fb009dac0 0x7f1fb0093e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 >> 10.20.193.51:0/4015636219 conn(0x7f1fb00a30c0 msgr2=0x7f1fb0099e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 shutdown_connections 2026-02-17T11:56:47.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:47.258+0000 7f1fb66e1640 1 -- 10.20.193.51:0/4015636219 wait complete. 2026-02-17T11:56:47.966 INFO:tasks.rados.rados.0.trial142.stdout:1730: done (1 left) 2026-02-17T11:56:47.966 INFO:tasks.rados.rados.0.trial142.stdout:1731: write oid 18 current snap is 188 2026-02-17T11:56:47.966 INFO:tasks.rados.rados.0.trial142.stdout:1731: seq_num 609 ranges {635463=734881,1987181=248282} 2026-02-17T11:56:47.971 INFO:tasks.rados.rados.0.trial142.stdout:1731: writing trial14245205-18 from 635463 to 1370344 tid 1 2026-02-17T11:56:47.974 INFO:tasks.rados.rados.0.trial142.stdout:1731: writing trial14245205-18 from 1987181 to 2235463 tid 2 2026-02-17T11:56:47.974 INFO:tasks.rados.rados.0.trial142.stdout:1732: write (excl) oid 33 current snap is 188 2026-02-17T11:56:47.974 INFO:tasks.rados.rados.0.trial142.stdout:1732: seq_num 610 ranges {652270=410130,1529310=493867} 2026-02-17T11:56:47.978 INFO:tasks.rados.rados.0.trial142.stdout:1732: writing trial14245205-33 from 652270 to 1062400 tid 1 2026-02-17T11:56:47.982 INFO:tasks.rados.rados.0.trial142.stdout:1732: writing trial14245205-33 from 1529310 to 2023177 tid 2 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1733: delete oid 20 current snap is 188 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: finishing write tid 2 to trial14245205-25 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: finishing write tid 3 to trial14245205-25 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: finishing write tid 4 to trial14245205-25 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: oid 25 updating version 0 to 758 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: oid 25 updating version 758 to 759 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: oid 25 version 759 is already newer than 757 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 759 (ObjNum 608 snap 188 seq_num 608) dirty exists 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1729: left oid 25 (ObjNum 608 snap 188 seq_num 608) 2026-02-17T11:56:47.983 INFO:tasks.rados.rados.0.trial142.stdout:1731: finishing write tid 1 to trial14245205-18 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: finishing write tid 2 to trial14245205-18 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: finishing write tid 3 to trial14245205-18 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: finishing write tid 4 to trial14245205-18 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: oid 18 updating version 0 to 1553 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: oid 18 updating version 1553 to 1555 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: oid 18 version 1555 is already newer than 1554 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1555 (ObjNum 609 snap 188 seq_num 609) dirty exists 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1731: left oid 18 (ObjNum 609 snap 188 seq_num 609) 2026-02-17T11:56:47.984 INFO:tasks.rados.rados.0.trial142.stdout:1732: finishing write tid 1 to trial14245205-33 2026-02-17T11:56:47.985 INFO:tasks.rados.rados.0.trial142.stdout:1732: finishing write tid 2 to trial14245205-33 2026-02-17T11:56:47.985 INFO:tasks.rados.rados.0.trial142.stdout:1729: done (3 left) 2026-02-17T11:56:47.985 INFO:tasks.rados.rados.0.trial142.stdout:1731: done (2 left) 2026-02-17T11:56:47.985 INFO:tasks.rados.rados.0.trial142.stdout:1733: done (1 left) 2026-02-17T11:56:47.985 INFO:tasks.rados.rados.0.trial142.stdout:1734: write (excl) oid 41 current snap is 188 2026-02-17T11:56:47.986 INFO:tasks.rados.rados.0.trial142.stdout:1734: seq_num 612 ranges {685884=560628,2046274=239610} 2026-02-17T11:56:47.989 INFO:tasks.rados.rados.0.trial142.stdout:1734: writing trial14245205-41 from 685884 to 1246512 tid 1 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1734: writing trial14245205-41 from 2046274 to 2285884 tid 2 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1735: copy_from oid 17 from oid 48 current snap is 188 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: finishing write tid 3 to trial14245205-33 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: finishing write tid 4 to trial14245205-33 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: oid 33 updating version 0 to 1052 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: oid 33 updating version 1052 to 1054 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: oid 33 version 1054 is already newer than 1053 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1054 (ObjNum 610 snap 188 seq_num 610) dirty exists 2026-02-17T11:56:47.994 INFO:tasks.rados.rados.0.trial142.stdout:1732: left oid 33 (ObjNum 610 snap 188 seq_num 610) 2026-02-17T11:56:47.995 INFO:tasks.rados.rados.0.trial142.stdout:1734: finishing write tid 1 to trial14245205-41 2026-02-17T11:56:47.995 INFO:tasks.rados.rados.0.trial142.stdout:1732: done (2 left) 2026-02-17T11:56:47.995 INFO:tasks.rados.rados.0.trial142.stdout:1736: write (excl) oid 46 current snap is 188 2026-02-17T11:56:47.995 INFO:tasks.rados.rados.0.trial142.stdout:1736: seq_num 613 ranges {702691=635877,2104756=197935} 2026-02-17T11:56:47.998 INFO:tasks.rados.rados.0.trial142.stdout:1736: writing trial14245205-46 from 702691 to 1338568 tid 1 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1736: writing trial14245205-46 from 2104756 to 2302691 tid 2 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1737: read oid 32 snap -1 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1737: expect (ObjNum 586 snap 181 seq_num 586) 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1738: snap_create 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1734: finishing write tid 2 to trial14245205-41 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1734: finishing write tid 3 to trial14245205-41 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1734: finishing write tid 4 to trial14245205-41 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1734: oid 41 updating version 0 to 1226 2026-02-17T11:56:48.003 INFO:tasks.rados.rados.0.trial142.stdout:1734: oid 41 updating version 1226 to 1227 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:1734: oid 41 updating version 1227 to 1228 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1228 (ObjNum 612 snap 188 seq_num 612) dirty exists 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:1734: left oid 41 (ObjNum 612 snap 188 seq_num 612) 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:1735: finishing copy_from racing read to trial14245205-17 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:1735: finishing copy_from to trial14245205-17 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T11:56:48.004 INFO:tasks.rados.rados.0.trial142.stdout:1736: finishing write tid 1 to trial14245205-46 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: finishing write tid 2 to trial14245205-46 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: finishing write tid 3 to trial14245205-46 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: finishing write tid 4 to trial14245205-46 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: oid 46 updating version 0 to 1559 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: oid 46 version 1559 is already newer than 1557 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: oid 46 version 1559 is already newer than 1558 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1559 (ObjNum 613 snap 188 seq_num 613) dirty exists 2026-02-17T11:56:48.005 INFO:tasks.rados.rados.0.trial142.stdout:1736: left oid 46 (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:56:48.006 INFO:tasks.rados.rados.0.trial142.stdout:1737: expect (ObjNum 586 snap 181 seq_num 586) 2026-02-17T11:56:50.269 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:50.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: get_monmap_and_config 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: build_initial_monmap 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: monmap: 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:50.339180+0000 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:50.339180+0000 2026-02-17T11:56:50.343 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 Processor -- start 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 -- start start 2026-02-17T11:56:50.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: init 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-c con 0x7f89000a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f89000a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-a con 0x7f890013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890006e140 con 0x7f89000a0750 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:50.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f890009f910 con 0x7f890013b760 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f890009ccd0 con 0x7f89000a3bb0 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.338+0000 7f89085a9640 10 monclient(hunting): authenticate will time out at 1297.957935s 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8905b1d640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f89000a0750 0x7f890009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:47750/0 (socket says 10.20.193.51:47750) 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 learned_addr learned my addr 10.20.193.51:0/3936848964 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f890013b760 auth_method 0 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f89000a3bb0 auth_method 0 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:50.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:50.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.339+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:50.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.341+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 >> v1:10.20.193.51:6789/0 conn(0x7f89000a0750 legacy=0x7f890009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f890013b760 auth_method 0 2026-02-17T11:56:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f89000a3bb0 auth_method 0 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.540+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:50.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f89000a3bb0 auth_method 0 2026-02-17T11:56:50.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f890013b760 auth_method 0 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:50.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:50.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:50.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:50.941+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f89000a3bb0 auth_method 0 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:51.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f890013b760 auth_method 0 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:51.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:51.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:51.741+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:56:53.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 10 monclient(hunting): tick 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 msgr2=0x7f890009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.142:3300/0 conn(0x7f89000a3bb0 0x7f890009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 -- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 msgr2=0x7f890013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:53.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 --2- 10.20.193.51:0/3936848964 >> v2:10.20.193.51:3300/0 conn(0x7f890013b760 0x7f890013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 1 -- 10.20.193.51:0/3936848964 >> v1:10.20.193.51:6789/0 conn(0x7f89000a0750 legacy=0x7f890009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 10 monclient: _add_conns ranks=[1,2] 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.337+0000 7f88e7fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f88e00037f0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 10 monclient(hunting): picked mon.noname-b con 0x7f88e00074c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 1 -- 10.20.193.51:0/3936848964 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890009eec0 con 0x7f88e00037f0 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 1 -- 10.20.193.51:0/3936848964 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f890009f910 con 0x7f88e00074c0 2026-02-17T11:56:53.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f88e7fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 10 monclient(hunting): get_auth_request con 0x7f88e00074c0 auth_method 0 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 msgr2=0x7f88e0009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 msgr2=0x7f88e0009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:53.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.338+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:53.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.340+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> v1:10.20.193.142:6789/0 conn(0x7f88e00037f0 legacy=0x7f88e0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 10 monclient(hunting): get_auth_request con 0x7f88e00074c0 auth_method 0 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 msgr2=0x7f88e0009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 msgr2=0x7f88e0009980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.539+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555069043 0 0) 0x7f890009eec0 con 0x7f88e00037f0 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): _negotiate 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): my global_id is 114361 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e8003620 con 0x7f88e00037f0 2026-02-17T11:56:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890631e640 1 --1- 10.20.193.51:0/3936848964 >> v1:10.20.193.142:6789/0 conn(0x7f88e00037f0 0x7f88e0005c70 :-1 s=OPENED pgs=162 cs=1 l=1).queue_received will delay after 1.77133e+09 on 0x7f88e8003620 auth_reply(proto 2 0 (0) Success) 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1804885685 0 0) 0x7f88e8003620 con 0x7f88e00037f0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 msgr2=0x7f88e0009980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e00074c0 0x7f88e0009980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e000b1c0 con 0x7f88e00037f0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _finish_auth 0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _check_auth_tickets 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f89085a9640 5 monclient: authenticate success, global_id 114361 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f89085a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f88f000f040 con 0x7f88e00037f0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: dump: 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 >> v1:10.20.193.142:6789/0 conn(0x7f88e00037f0 legacy=0x7f88e0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f8906b1f640 1 -- 10.20.193.51:0/3936848964 reap_dead start 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f88e8003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): picked mon.c con 0x7f88e8003b00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8004900 0x7f88e8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): picked mon.b con 0x7f88e8004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8005410 0x7f88e800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): picked mon.a con 0x7f88e8005410 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f890009f910 con 0x7f88e8005410 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88e800c350 con 0x7f88e8004900 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88e800c550 con 0x7f88e8003b00 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.1 v1:10.20.193.142:6789/0 5 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f88f000ccf0 con 0x7f88e00037f0 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f89085a9640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890531c640 10 monclient(hunting): discarding stray monitor message mon_map magic: 0 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.551+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f88e8003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f88e8003b00 auth_method 0 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8005410 0x7f88e800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f88e8005410 auth_method 0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8905b1d640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8004900 0x7f88e8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8906b1f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8905b1d640 10 monclient(hunting): get_auth_request con 0x7f88e8004900 auth_method 0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8905b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8905b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f8905b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient(hunting): handle_auth_done global_id 114361 payload 293 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8004900 msgr2=0x7f88e8004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8004900 0x7f88e8004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8005410 msgr2=0x7f88e800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8005410 0x7f88e800bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient: _finish_hunting 0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 monclient: found mon.c 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e8003620 con 0x7f88e8003b00 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient: _finish_auth 0 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 10 monclient: _check_auth_tickets 2026-02-17T11:56:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.552+0000 7f890631e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890631e640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 msgr2=0x7f88e8003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890631e640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f88e8003ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88f000cf10 tx=0x7f88f0030d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4754a932f10f5182 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037070 con 0x7f88e8003b00 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: dump: 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f89085a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0031700 con 0x7f88e8003b00 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 1 -- 10.20.193.51:0/3936848964 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0010990 con 0x7f88e8003b00 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f890531c640 10 monclient: dump: 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f89085a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.554+0000 7f89085a9640 4 set_mon_vals no callback set 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 10 monclient: shutdown 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 -- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 msgr2=0x7f88e8003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f88e8003ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88f000cf10 tx=0x7f88f0030d40 comp rx=0 tx=0).stop 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 -- 10.20.193.51:0/3936848964 shutdown_connections 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8005410 0x7f88e800bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8004900 0x7f88e8004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 --2- 10.20.193.51:0/3936848964 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f88e8003ee0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 -- 10.20.193.51:0/3936848964 >> 10.20.193.51:0/3936848964 conn(0x7f89000a30c0 msgr2=0x7f89000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 -- 10.20.193.51:0/3936848964 shutdown_connections 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.555+0000 7f89085a9640 1 -- 10.20.193.51:0/3936848964 wait complete. 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.556+0000 7f89085a9640 10 monclient: build_initial_monmap 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.556+0000 7f89085a9640 10 monclient: monmap: 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:53.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.556+0000 7f89085a9640 1 Processor -- start 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.556+0000 7f89085a9640 1 -- start start 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.556+0000 7f89085a9640 10 monclient: init 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-c con 0x7f88e8003b00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 0x7f8900095aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-a con 0x7f88e8004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8005410 0x7f8900095fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): picked mon.noname-b con 0x7f88e8005410 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f89000a04b0 con 0x7f88e8004900 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f890009c850 con 0x7f88e8005410 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f890009dac0 con 0x7f88e8003b00 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f89085a9640 10 monclient(hunting): authenticate will time out at 1301.177183s 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 0x7f8900095aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59482/0 (socket says 10.20.193.51:59482) 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 -- 10.20.193.51:0/1737612559 learned_addr learned my addr 10.20.193.51:0/1737612559 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 10 monclient(hunting): get_auth_request con 0x7f88e8003b00 auth_method 0 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): get_auth_request con 0x7f88e8004900 auth_method 0 2026-02-17T11:56:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 msgr2=0x7f890013b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 msgr2=0x7f890013b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f890631e640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8906b1f640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8005410 0x7f8900095fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8906b1f640 10 monclient(hunting): get_auth_request con 0x7f88e8005410 auth_method 0 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8906b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8906b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8906b1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient(hunting): handle_auth_done global_id 134292 payload 824 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 msgr2=0x7f890013b0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8005410 msgr2=0x7f8900095fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8005410 0x7f8900095fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient: _finish_hunting 0 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 monclient: found mon.noname-a 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.557+0000 7f8905b1d640 1 -- 10.20.193.51:0/1737612559 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8900097c00 con 0x7f88e8004900 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f8905b1d640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 msgr2=0x7f8900095aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f8905b1d640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 0x7f8900095aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88f4007d00 tx=0x7f88f4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4013810 con 0x7f88e8004900 2026-02-17T11:56:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: dump: 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f401a070 con 0x7f88e8004900 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 5 monclient: authenticate success, global_id 134292 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 10 monclient: _renew_subs 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8900099470 con 0x7f88e8004900 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4013bd0 con 0x7f88e8004900 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f8904b1b640 4 set_mon_vals no callback set 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f88e6ffd640 10 monclient: dump: 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 10 monclient: _renew_subs 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.559+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8900073f70 con 0x7f88e8004900 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f88f4015470 con 0x7f88e8004900 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f89085a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f89085a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f88e6ffd640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 0x7f88d00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f89085a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890009d7b0 con 0x7f88e8004900 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(406..406 src has 167..406) ==== 4827+0+0 (secure 0 0 0) 0x7f88f40528c0 con 0x7f88e8004900 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f890631e640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 0x7f88d00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.560+0000 7f890631e640 10 monclient: get_auth_request con 0x7f88d003dd10 auth_method 0 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.563+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8900097c00 con 0x7f88e8004900 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.563+0000 7f88e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.563+0000 7f88e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.563+0000 7f890631e640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 0x7f88d00401d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88f0030d80 tx=0x7f88f0037000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1734: done (4 left) 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1735: done (3 left) 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1736: done (2 left) 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1737: done (1 left) 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1738: done (0 left) 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1739: write oid 11 current snap is 189 2026-02-17T11:56:53.610 INFO:tasks.rados.rados.0.trial142.stdout:1739: seq_num 614 ranges {719498=711126,2046885=272613} 2026-02-17T11:56:53.616 INFO:tasks.rados.rados.0.trial142.stdout:1739: writing trial14245205-11 from 719498 to 1430624 tid 1 2026-02-17T11:56:53.619 INFO:tasks.rados.rados.0.trial142.stdout:1739: writing trial14245205-11 from 2046885 to 2319498 tid 2 2026-02-17T11:56:53.619 INFO:tasks.rados.rados.0.trial142.stdout:1740: write (excl) oid 9 current snap is 189 2026-02-17T11:56:53.619 INFO:tasks.rados.rados.0.trial142.stdout:1740: seq_num 615 ranges {736305=786375,2105367=230938} 2026-02-17T11:56:53.625 INFO:tasks.rados.rados.0.trial142.stdout:1740: writing trial14245205-9 from 736305 to 1522680 tid 1 2026-02-17T11:56:53.628 INFO:tasks.rados.rados.0.trial142.stdout:1740: writing trial14245205-9 from 2105367 to 2336305 tid 2 2026-02-17T11:56:53.628 INFO:tasks.rados.rados.0.trial142.stdout:1741: write oid 47 current snap is 189 2026-02-17T11:56:53.628 INFO:tasks.rados.rados.0.trial142.stdout:1741: seq_num 616 ranges {753112=577977,1880202=472910} 2026-02-17T11:56:53.633 INFO:tasks.rados.rados.0.trial142.stdout:1741: writing trial14245205-47 from 753112 to 1331089 tid 1 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1741: writing trial14245205-47 from 1880202 to 2353112 tid 2 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1742: read oid 7 snap -1 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1742: expect deleted 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1743: copy_from oid 30 from oid 26 current snap is 189 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: finishing write tid 1 to trial14245205-11 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: finishing write tid 2 to trial14245205-11 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: finishing write tid 3 to trial14245205-11 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: finishing write tid 4 to trial14245205-11 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: oid 11 updating version 0 to 213 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: oid 11 version 213 is already newer than 212 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: oid 11 version 213 is already newer than 211 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 213 (ObjNum 614 snap 189 seq_num 614) dirty exists 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: left oid 11 (ObjNum 614 snap 189 seq_num 614) 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1740: finishing write tid 1 to trial14245205-9 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1739: done (4 left) 2026-02-17T11:56:53.637 INFO:tasks.rados.rados.0.trial142.stdout:1744: snap_create 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: finishing write tid 2 to trial14245205-9 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: finishing write tid 3 to trial14245205-9 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: finishing write tid 4 to trial14245205-9 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: oid 9 updating version 0 to 1560 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: oid 9 updating version 1560 to 1562 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: oid 9 version 1562 is already newer than 1561 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 1562 (ObjNum 615 snap 189 seq_num 615) dirty exists 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1740: left oid 9 (ObjNum 615 snap 189 seq_num 615) 2026-02-17T11:56:53.638 INFO:tasks.rados.rados.0.trial142.stdout:1741: finishing write tid 1 to trial14245205-47 2026-02-17T11:56:53.639 INFO:tasks.rados.rados.0.trial142.stdout:1741: finishing write tid 2 to trial14245205-47 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: finishing write tid 3 to trial14245205-47 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: finishing write tid 4 to trial14245205-47 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: oid 47 updating version 0 to 973 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: oid 47 updating version 973 to 974 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: oid 47 version 974 is already newer than 972 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 974 (ObjNum 616 snap 189 seq_num 616) dirty exists 2026-02-17T11:56:53.640 INFO:tasks.rados.rados.0.trial142.stdout:1741: left oid 47 (ObjNum 616 snap 189 seq_num 616) 2026-02-17T11:56:53.646 INFO:tasks.rados.rados.0.trial142.stdout:1743: finishing copy_from racing read to trial14245205-30 2026-02-17T11:56:53.647 INFO:tasks.rados.rados.0.trial142.stdout:1743: finishing copy_from to trial14245205-30 2026-02-17T11:56:53.647 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 753 (ObjNum 581 snap 181 seq_num 581) dirty exists 2026-02-17T11:56:53.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f890009eec0 con 0x7f88e8004900 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f88e6ffd640 1 -- 10.20.193.51:0/1737612559 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7f88f401ece0 con 0x7f88e8004900 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f88e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f88e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:53.679 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":98,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 msgr2=0x7f88d00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 0x7f88d00401d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f88f0030d80 tx=0x7f88f0037000 comp rx=0 tx=0).stop 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 10 monclient: shutdown 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 msgr2=0x7f8900095aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:53.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 0x7f8900095aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88f4007d00 tx=0x7f88f4007430 comp rx=0 tx=0).stop 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 shutdown_connections 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88d003dd10 0x7f88d00401d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88e8005410 0x7f8900095fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88e8004900 0x7f8900095aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 --2- 10.20.193.51:0/1737612559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88e8003b00 0x7f890013b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 >> 10.20.193.51:0/1737612559 conn(0x7f89000a30c0 msgr2=0x7f89000703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 shutdown_connections 2026-02-17T11:56:53.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:53.677+0000 7f89085a9640 1 -- 10.20.193.51:0/1737612559 wait complete. 2026-02-17T11:56:54.612 INFO:tasks.rados.rados.0.trial142.stdout:1740: done (4 left) 2026-02-17T11:56:54.612 INFO:tasks.rados.rados.0.trial142.stdout:1741: done (3 left) 2026-02-17T11:56:54.612 INFO:tasks.rados.rados.0.trial142.stdout:1742: done (2 left) 2026-02-17T11:56:54.612 INFO:tasks.rados.rados.0.trial142.stdout:1743: done (1 left) 2026-02-17T11:56:54.613 INFO:tasks.rados.rados.0.trial142.stdout:1744: done (0 left) 2026-02-17T11:56:54.613 INFO:tasks.rados.rados.0.trial142.stdout:1745: write (excl) oid 35 current snap is 190 2026-02-17T11:56:54.613 INFO:tasks.rados.rados.0.trial142.stdout:1745: seq_num 617 ranges {769919=653226,1938684=431235} 2026-02-17T11:56:54.617 INFO:tasks.rados.rados.0.trial142.stdout:1745: writing trial14245205-35 from 769919 to 1423145 tid 1 2026-02-17T11:56:54.621 INFO:tasks.rados.rados.0.trial142.stdout:1745: writing trial14245205-35 from 1938684 to 2369919 tid 2 2026-02-17T11:56:54.621 INFO:tasks.rados.rados.0.trial142.stdout:1746: delete oid 45 current snap is 190 2026-02-17T11:56:54.623 INFO:tasks.rados.rados.0.trial142.stdout:1745: finishing write tid 1 to trial14245205-35 2026-02-17T11:56:54.624 INFO:tasks.rados.rados.0.trial142.stdout:1746: done (1 left) 2026-02-17T11:56:54.624 INFO:tasks.rados.rados.0.trial142.stdout:1747: write oid 14 current snap is 190 2026-02-17T11:56:54.624 INFO:tasks.rados.rados.0.trial142.stdout:1747: seq_num 619 ranges {403533=403724,1539295=652201} 2026-02-17T11:56:54.626 INFO:tasks.rados.rados.0.trial142.stdout:1747: writing trial14245205-14 from 403533 to 807257 tid 1 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1747: writing trial14245205-14 from 1539295 to 2191496 tid 2 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1748: rollback oid 7 current snap is 190 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 186 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1745: finishing write tid 2 to trial14245205-35 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1749: snap_create 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1745: finishing write tid 3 to trial14245205-35 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1745: finishing write tid 4 to trial14245205-35 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1745: oid 35 updating version 0 to 1058 2026-02-17T11:56:54.633 INFO:tasks.rados.rados.0.trial142.stdout:1745: oid 35 version 1058 is already newer than 1057 2026-02-17T11:56:54.634 INFO:tasks.rados.rados.0.trial142.stdout:1745: oid 35 version 1058 is already newer than 1056 2026-02-17T11:56:54.634 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1058 (ObjNum 617 snap 190 seq_num 617) dirty exists 2026-02-17T11:56:54.634 INFO:tasks.rados.rados.0.trial142.stdout:1745: left oid 35 (ObjNum 617 snap 190 seq_num 617) 2026-02-17T11:56:54.634 INFO:tasks.rados.rados.0.trial142.stdout:1748: finishing rollback tid 1 to trial14245205-7 2026-02-17T11:56:54.634 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 0 (ObjNum 33 snap 0 seq_num 1201977176) dirty dne 2026-02-17T11:56:54.635 INFO:tasks.rados.rados.0.trial142.stdout:1747: finishing write tid 1 to trial14245205-14 2026-02-17T11:56:54.637 INFO:tasks.rados.rados.0.trial142.stdout:1747: finishing write tid 2 to trial14245205-14 2026-02-17T11:56:54.637 INFO:tasks.rados.rados.0.trial142.stdout:1747: finishing write tid 3 to trial14245205-14 2026-02-17T11:56:54.642 INFO:tasks.rados.rados.0.trial142.stdout:1747: finishing write tid 4 to trial14245205-14 2026-02-17T11:56:54.642 INFO:tasks.rados.rados.0.trial142.stdout:1747: oid 14 updating version 0 to 1566 2026-02-17T11:56:54.642 INFO:tasks.rados.rados.0.trial142.stdout:1747: oid 14 version 1566 is already newer than 1564 2026-02-17T11:56:54.642 INFO:tasks.rados.rados.0.trial142.stdout:1747: oid 14 version 1566 is already newer than 1565 2026-02-17T11:56:54.642 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1566 (ObjNum 619 snap 190 seq_num 619) dirty exists 2026-02-17T11:56:54.643 INFO:tasks.rados.rados.0.trial142.stdout:1747: left oid 14 (ObjNum 619 snap 190 seq_num 619) 2026-02-17T11:56:55.786 INFO:tasks.rados.rados.0.trial142.stdout:1745: done (3 left) 2026-02-17T11:56:55.787 INFO:tasks.rados.rados.0.trial142.stdout:1747: done (2 left) 2026-02-17T11:56:55.787 INFO:tasks.rados.rados.0.trial142.stdout:1748: done (1 left) 2026-02-17T11:56:55.787 INFO:tasks.rados.rados.0.trial142.stdout:1749: done (0 left) 2026-02-17T11:56:55.787 INFO:tasks.rados.rados.0.trial142.stdout:1750: write (excl) oid 13 current snap is 191 2026-02-17T11:56:55.787 INFO:tasks.rados.rados.0.trial142.stdout:1750: seq_num 620 ranges {420340=478973,1597777=512212} 2026-02-17T11:56:55.789 INFO:tasks.rados.rados.0.trial142.stdout:1750: writing trial14245205-13 from 420340 to 899313 tid 1 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1750: writing trial14245205-13 from 1597777 to 2109989 tid 2 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1751: rollback oid 23 current snap is 191 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 190 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1750: finishing write tid 1 to trial14245205-13 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1752: read oid 5 snap -1 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1752: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1753: read oid 35 snap -1 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1753: expect (ObjNum 617 snap 190 seq_num 617) 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1754: write oid 38 current snap is 191 2026-02-17T11:56:55.795 INFO:tasks.rados.rados.0.trial142.stdout:1754: seq_num 621 ranges {437147=554222,1656259=655870} 2026-02-17T11:56:55.798 INFO:tasks.rados.rados.0.trial142.stdout:1754: writing trial14245205-38 from 437147 to 991369 tid 1 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1754: writing trial14245205-38 from 1656259 to 2312129 tid 2 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1755: delete oid 21 current snap is 191 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1751: finishing rollback tid 0 to trial14245205-23 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1754: finishing write tid 1 to trial14245205-38 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1751: finishing rollback tid 1 to trial14245205-23 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1751: finishing rollback tid 2 to trial14245205-23 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 977 (ObjNum 472 snap 141 seq_num 472) dirty exists 2026-02-17T11:56:55.804 INFO:tasks.rados.rados.0.trial142.stdout:1752: expect (ObjNum 228 snap 74 seq_num 228) 2026-02-17T11:56:55.951 INFO:tasks.rados.rados.0.trial142.stdout:1750: finishing write tid 2 to trial14245205-13 2026-02-17T11:56:55.951 INFO:tasks.rados.rados.0.trial142.stdout:1751: done (5 left) 2026-02-17T11:56:55.951 INFO:tasks.rados.rados.0.trial142.stdout:1752: done (4 left) 2026-02-17T11:56:55.951 INFO:tasks.rados.rados.0.trial142.stdout:1755: done (3 left) 2026-02-17T11:56:55.951 INFO:tasks.rados.rados.0.trial142.stdout:1756: read oid 47 snap 190 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1756: expect (ObjNum 616 snap 189 seq_num 616) 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1757: read oid 23 snap -1 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1757: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: finishing write tid 3 to trial14245205-13 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: finishing write tid 4 to trial14245205-13 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: oid 13 updating version 0 to 1062 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: oid 13 version 1062 is already newer than 1061 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: oid 13 version 1062 is already newer than 1060 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 1062 (ObjNum 620 snap 191 seq_num 620) dirty exists 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1750: left oid 13 (ObjNum 620 snap 191 seq_num 620) 2026-02-17T11:56:55.952 INFO:tasks.rados.rados.0.trial142.stdout:1753: expect (ObjNum 617 snap 190 seq_num 617) 2026-02-17T11:56:56.020 INFO:tasks.rados.rados.0.trial142.stdout:1754: finishing write tid 2 to trial14245205-38 2026-02-17T11:56:56.020 INFO:tasks.rados.rados.0.trial142.stdout:1754: finishing write tid 3 to trial14245205-38 2026-02-17T11:56:56.020 INFO:tasks.rados.rados.0.trial142.stdout:1754: finishing write tid 4 to trial14245205-38 2026-02-17T11:56:56.020 INFO:tasks.rados.rados.0.trial142.stdout:1754: oid 38 updating version 0 to 1112 2026-02-17T11:56:56.021 INFO:tasks.rados.rados.0.trial142.stdout:1754: oid 38 updating version 1112 to 1113 2026-02-17T11:56:56.021 INFO:tasks.rados.rados.0.trial142.stdout:1754: oid 38 version 1113 is already newer than 1111 2026-02-17T11:56:56.021 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1113 (ObjNum 621 snap 191 seq_num 621) dirty exists 2026-02-17T11:56:56.021 INFO:tasks.rados.rados.0.trial142.stdout:1754: left oid 38 (ObjNum 621 snap 191 seq_num 621) 2026-02-17T11:56:56.021 INFO:tasks.rados.rados.0.trial142.stdout:1756: expect (ObjNum 616 snap 189 seq_num 616) 2026-02-17T11:56:56.131 INFO:tasks.rados.rados.0.trial142.stdout:1757: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:56:56.276 INFO:tasks.rados.rados.0.trial142.stdout:1758: read oid 45 snap -1 2026-02-17T11:56:56.276 INFO:tasks.rados.rados.0.trial142.stdout:1758: expect deleted 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1750: done (5 left) 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1753: done (4 left) 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1754: done (3 left) 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1756: done (2 left) 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1757: done (1 left) 2026-02-17T11:56:56.277 INFO:tasks.rados.rados.0.trial142.stdout:1759: snap_create 2026-02-17T11:56:56.690 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:56.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 10 monclient: get_monmap_and_config 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 10 monclient: build_initial_monmap 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 10 monclient: monmap: 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:56.757013+0000 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:56.757013+0000 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:56.758 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:56.759 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:56.759 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:56.759 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:56.759 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 1 Processor -- start 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 1 -- start start 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.756+0000 7f4a1ac0c640 10 monclient: init 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4a14138600 0x7f4a141389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4a14138600 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a140a35a0 0x7f4a140a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4a140a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4a140a58a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:56.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a140a1df0 con 0x7f4a140a58a0 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4a140a6830 con 0x7f4a140a35a0 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4a140a2c00 con 0x7f4a14138600 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a1ac0c640 10 monclient(hunting): authenticate will time out at 1304.376089s 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a140a35a0 0x7f4a140a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a140a35a0 0x7f4a140a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52680/0 (socket says 10.20.193.51:52680) 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 -- 10.20.193.51:0/1749331165 learned_addr learned my addr 10.20.193.51:0/1749331165 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): get_auth_request con 0x7f4a140a35a0 auth_method 0 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a18981640 1 --2- 10.20.193.51:0/1749331165 >> v2:10.20.193.142:3300/0 conn(0x7f4a14138600 0x7f4a141389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a18981640 10 monclient(hunting): get_auth_request con 0x7f4a14138600 auth_method 0 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a18981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a18981640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a18981640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient(hunting): handle_auth_done global_id 134295 payload 274 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 -- 10.20.193.51:0/1749331165 >> v2:10.20.193.142:3300/0 conn(0x7f4a14138600 msgr2=0x7f4a141389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/1749331165 >> v2:10.20.193.142:3300/0 conn(0x7f4a14138600 0x7f4a141389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 -- 10.20.193.51:0/1749331165 >> v1:10.20.193.142:6789/0 conn(0x7f4a140a58a0 legacy=0x7f4a1413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 monclient: found mon.noname-a 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.757+0000 7f4a0bfff640 1 -- 10.20.193.51:0/1749331165 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a14138f20 con 0x7f4a140a35a0 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0bfff640 1 -- 10.20.193.51:0/1749331165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 msgr2=0x7f4a140a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/1749331165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a140a5360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a140ab950 tx=0x7f49fc02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834720fbd8728d66 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 1 -- 10.20.193.51:0/1749331165 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc03c070 con 0x7f4a140a35a0 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: dump: 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.768 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a1ac0c640 5 monclient: authenticate success, global_id 134295 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a1ac0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 1 -- 10.20.193.51:0/1749331165 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc02fca0 con 0x7f4a140a35a0 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.759+0000 7f4a0b7fe640 1 -- 10.20.193.51:0/1749331165 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc037660 con 0x7f4a140a35a0 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a0b7fe640 10 monclient: dump: 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.769 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 4 set_mon_vals no callback set 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 10 monclient: shutdown 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/1749331165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 msgr2=0x7f4a140a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/1749331165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a140a5360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a140ab950 tx=0x7f49fc02ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/1749331165 shutdown_connections 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/1749331165 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a140a5360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/1749331165 >> v2:10.20.193.142:3300/0 conn(0x7f4a14138600 0x7f4a141389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/1749331165 >> 10.20.193.51:0/1749331165 conn(0x7f4a140a7460 msgr2=0x7f4a140a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/1749331165 shutdown_connections 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/1749331165 wait complete. 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 10 monclient: build_initial_monmap 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.760+0000 7f4a1ac0c640 10 monclient: monmap: 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:56.771 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 Processor -- start 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 -- start start 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient: init 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4a140a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4a140a58a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a14138600 0x7f4a14136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): picked mon.noname-b con 0x7f4a14138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4a140a25b0 con 0x7f4a140a35a0 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4a140a22d0 con 0x7f4a14138600 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4a140a15f0 con 0x7f4a140a58a0 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a1ac0c640 10 monclient(hunting): authenticate will time out at 1304.380434s 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52692/0 (socket says 10.20.193.51:52692) 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 -- 10.20.193.51:0/2242890314 learned_addr learned my addr 10.20.193.51:0/2242890314 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): get_auth_request con 0x7f4a140a35a0 auth_method 0 2026-02-17T11:56:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 10 monclient(hunting): get_auth_request con 0x7f4a140a58a0 auth_method 0 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a19182640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a14138600 0x7f4a14136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 msgr2=0x7f4a14136590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 msgr2=0x7f4a14136590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient(hunting): handle_auth_done global_id 134298 payload 824 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 msgr2=0x7f4a14136590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a14138600 msgr2=0x7f4a14136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a14138600 0x7f4a14136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient: _finish_hunting 0 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 monclient: found mon.noname-a 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.761+0000 7f4a18981640 1 -- 10.20.193.51:0/2242890314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a14126140 con 0x7f4a140a35a0 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a18981640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 msgr2=0x7f4a141cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a18981640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400e7c0 tx=0x7f4a0400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04017070 con 0x7f4a140a35a0 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: dump: 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0400cae0 con 0x7f4a140a35a0 2026-02-17T11:56:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 5 monclient: authenticate success, global_id 134298 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400f040 con 0x7f4a140a35a0 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a0affd640 4 set_mon_vals no callback set 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a097fa640 10 monclient: dump: 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.779 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 10 monclient: _renew_subs 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a141279d0 con 0x7f4a140a35a0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 10 monclient: _renew_subs 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.763+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a14137fb0 con 0x7f4a140a35a0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a1ac0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a1ac0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a1ac0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a140a5360 con 0x7f4a140a35a0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4a04012050 con 0x7f4a140a35a0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a097fa640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 0x7f49e4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(410..410 src has 167..410) ==== 4735+0+0 (secure 0 0 0) 0x7f4a040523d0 con 0x7f4a140a35a0 2026-02-17T11:56:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.764+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 0x7f49e4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.765+0000 7f4a0bfff640 10 monclient: get_auth_request con 0x7f49e403dd60 auth_method 0 2026-02-17T11:56:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.767+0000 7f4a0bfff640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 0x7f49e4040220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.767+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4a04023d80 con 0x7f4a140a35a0 2026-02-17T11:56:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.767+0000 7f4a097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.767+0000 7f4a097fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:56.788 INFO:tasks.rados.rados.0.trial142.stdout:1758: done (1 left) 2026-02-17T11:56:56.789 INFO:tasks.rados.rados.0.trial142.stdout:1759: done (0 left) 2026-02-17T11:56:56.789 INFO:tasks.rados.rados.0.trial142.stdout:1760: copy_from oid 1 from oid 24 current snap is 192 2026-02-17T11:56:56.789 INFO:tasks.rados.rados.0.trial142.stdout:1761: snap_create 2026-02-17T11:56:56.796 INFO:tasks.rados.rados.0.trial142.stdout:1760: finishing copy_from racing read to trial14245205-1 2026-02-17T11:56:56.797 INFO:tasks.rados.rados.0.trial142.stdout:1760: finishing copy_from to trial14245205-1 2026-02-17T11:56:56.797 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1033 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a1ac0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a1ac0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a1ac0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a141cf760 con 0x7f4a140a35a0 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a097fa640 1 -- 10.20.193.51:0/2242890314 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f4a040520d0 con 0x7f4a140a35a0 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a097fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:56.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.887+0000 7f4a097fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:56.891 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 msgr2=0x7f49e4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 0x7f49e4040220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc039040 comp rx=0 tx=0).stop 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 10 monclient: shutdown 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 msgr2=0x7f4a141cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400e7c0 tx=0x7f4a0400ec90 comp rx=0 tx=0).stop 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 shutdown_connections 2026-02-17T11:56:56.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49e403dd60 0x7f49e4040220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a14138600 0x7f4a14136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a140a58a0 0x7f4a14136590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 --2- 10.20.193.51:0/2242890314 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a140a35a0 0x7f4a141cf220 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 >> 10.20.193.51:0/2242890314 conn(0x7f4a140a7460 msgr2=0x7f4a140a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 shutdown_connections 2026-02-17T11:56:56.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.888+0000 7f4a1ac0c640 1 -- 10.20.193.51:0/2242890314 wait complete. 2026-02-17T11:56:56.899 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:56:56.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:56:56.899 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:56:56.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 10 monclient: get_monmap_and_config 2026-02-17T11:56:56.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 10 monclient: build_initial_monmap 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 10 monclient: monmap: 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:56.967360+0000 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:56.967360+0000 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:56.969 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:56.970 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 1 Processor -- start 2026-02-17T11:56:56.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 1 -- start start 2026-02-17T11:56:56.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.966+0000 7f7107787640 10 monclient: init 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient: _add_conns ranks=[4,0,1,2,3] 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f71000a3bb0 0x7f710009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): picked mon.noname-c con 0x7f71000a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71000a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f710013b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710006e140 con 0x7f71000a0750 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710009f910 con 0x7f710013b760 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f710009ccd0 con 0x7f71000a3bb0 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7107787640 10 monclient(hunting): authenticate will time out at 1304.586158s 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7104cfb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f71000a0750 0x7f710009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:45990/0 (socket says 10.20.193.51:45990) 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f7104cfb640 1 -- 10.20.193.51:0/3749709568 learned_addr learned my addr 10.20.193.51:0/3749709568 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 1 --2- 10.20.193.51:0/3749709568 >> v2:10.20.193.142:3300/0 conn(0x7f71000a3bb0 0x7f710009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): get_auth_request con 0x7f71000a3bb0 auth_method 0 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient(hunting): handle_auth_done global_id 114370 payload 274 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 1 -- 10.20.193.51:0/3749709568 >> v1:10.20.193.142:6789/0 conn(0x7f710013b760 legacy=0x7f710013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 1 -- 10.20.193.51:0/3749709568 >> v1:10.20.193.51:6789/0 conn(0x7f71000a0750 legacy=0x7f710009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 1 monclient: found mon.noname-c 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:56:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.967+0000 7f71054fc640 1 -- 10.20.193.51:0/3749709568 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710009eec0 con 0x7f71000a3bb0 2026-02-17T11:56:56.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.970+0000 7f71054fc640 1 -- 10.20.193.51:0/3749709568 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71000a3bb0 msgr2=0x7f710009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:56.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.970+0000 7f71054fc640 1 --2- 10.20.193.51:0/3749709568 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71000a3bb0 0x7f710009dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ca6333754409395 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 1 -- 10.20.193.51:0/3749709568 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f003c070 con 0x7f71000a3bb0 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: dump: 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.982 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: _finish_auth 0 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 5 monclient: authenticate success, global_id 114370 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 1 -- 10.20.193.51:0/3749709568 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f002fce0 con 0x7f71000a3bb0 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 1 -- 10.20.193.51:0/3749709568 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0037660 con 0x7f71000a3bb0 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 4 set_mon_vals no callback set 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f70effff640 10 monclient: dump: 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 10 monclient: shutdown 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 1 -- 10.20.193.51:0/3749709568 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71000a3bb0 msgr2=0x7f710009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.971+0000 7f7107787640 1 --2- 10.20.193.51:0/3749709568 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71000a3bb0 0x7f710009dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f002ed80 comp rx=0 tx=0).stop 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- 10.20.193.51:0/3749709568 shutdown_connections 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 --2- 10.20.193.51:0/3749709568 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71000a3bb0 0x7f710009dac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- 10.20.193.51:0/3749709568 >> 10.20.193.51:0/3749709568 conn(0x7f71000a30c0 msgr2=0x7f71000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- 10.20.193.51:0/3749709568 shutdown_connections 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- 10.20.193.51:0/3749709568 wait complete. 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient: build_initial_monmap 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient: monmap: 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:56.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 Processor -- start 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- start start 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient: init 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 0x7f71001381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): picked mon.noname-a con 0x7f71000a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 0x7f710012dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): picked mon.noname-c con 0x7f71000a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f710013b760 0x7f710012e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): picked mon.noname-b con 0x7f710013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71000a04b0 con 0x7f71000a0750 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f710009c850 con 0x7f710013b760 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f710009e710 con 0x7f71000a3bb0 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7107787640 10 monclient(hunting): authenticate will time out at 1304.591882s 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 0x7f71001381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 0x7f71001381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52700/0 (socket says 10.20.193.51:52700) 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 1 -- 10.20.193.51:0/3824451220 learned_addr learned my addr 10.20.193.51:0/3824451220 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): get_auth_request con 0x7f71000a0750 auth_method 0 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 0x7f710012dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7104cfb640 10 monclient(hunting): get_auth_request con 0x7f71000a3bb0 auth_method 0 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7104cfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7104cfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f7104cfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.972+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 msgr2=0x7f710012dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 msgr2=0x7f710012dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 0x7f710012dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 0x7f710012dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7105cfd640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f710013b760 0x7f710012e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7105cfd640 10 monclient(hunting): get_auth_request con 0x7f710013b760 auth_method 0 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7105cfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7105cfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f7105cfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 10 monclient(hunting): handle_auth_done global_id 134301 payload 824 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 msgr2=0x7f710012dbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71000a3bb0 0x7f710012dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f710013b760 msgr2=0x7f710012e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f710013b760 0x7f710012e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 monclient: found mon.noname-a 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.973+0000 7f71054fc640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71001314c0 con 0x7f71000a0750 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f71054fc640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 msgr2=0x7f71001381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f71054fc640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 0x7f71001381c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0046070 con 0x7f71000a0750 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: dump: 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:56.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f0041870 con 0x7f71000a0750 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 5 monclient: authenticate success, global_id 134301 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f003c040 con 0x7f71000a0750 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 10 monclient: dump: 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.993 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70ef7fe640 4 set_mon_vals no callback set 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 10 monclient: _renew_subs 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71001317a0 con 0x7f71000a0750 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 10 monclient: _renew_subs 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:56.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7100131a80 con 0x7f71000a0750 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f70f0041c60 con 0x7f71000a0750 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.975+0000 7f7107787640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7107787640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 0x7f71001398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71000a2e30 con 0x7f710012e640 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f70edffb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70d003dd10 0x7f70d00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 0x7f71001398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient: get_auth_request con 0x7f710012e640 auth_method 0 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:56.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(411..411 src has 167..411) ==== 4735+0+0 (secure 0 0 0) 0x7f70f0077e90 con 0x7f71000a0750 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 10 monclient(hunting): handle_auth_done global_id 134304 payload 824 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f710012ea20 con 0x7f710012e640 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7105cfd640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70d003dd10 0x7f70d00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.976+0000 7f7105cfd640 10 monclient: get_auth_request con 0x7f70d003dd10 auth_method 0 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 msgr2=0x7f71001398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 0x7f71001398f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71001394c0 tx=0x7f70f400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4004d20 con 0x7f710012e640 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:56.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 10 monclient: dump: 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:56.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f70f4018070 con 0x7f710012e640 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 msgr2=0x7f71001398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 0x7f71001398f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71001394c0 tx=0x7f70f400eba0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 msgr2=0x7f71001398f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f70edffb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f710012e640 0x7f71001398f0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71001394c0 tx=0x7f70f400eba0 comp rx=0 tx=0).stop 2026-02-17T11:56:56.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.978+0000 7f7105cfd640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70d003dd10 0x7f70d00401d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7100130700 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7107787640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7107787640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 0x7f710013a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7107787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f710009dac0 con 0x7f7100139e30 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 0x7f710013a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7104cfb640 10 monclient: get_auth_request con 0x7f7100139e30 auth_method 0 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7104cfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7104cfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.981+0000 7f7104cfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.982+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.982+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.982+0000 7f7104cfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.982+0000 7f7104cfb640 10 monclient(hunting): handle_auth_done global_id 134307 payload 824 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.982+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f710012fe00 con 0x7f7100139e30 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7104cfb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 msgr2=0x7f710013a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7104cfb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 0x7f710013a210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70f4017000 tx=0x7f70f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4003030 con 0x7f7100139e30 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 10 monclient: dump: 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f70f4003030 con 0x7f7100139e30 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 msgr2=0x7f710013a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 0x7f710013a210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70f4017000 tx=0x7f70f4004a40 comp rx=0 tx=0).stop 2026-02-17T11:56:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 msgr2=0x7f710013a210 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f70edffb640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7100139e30 0x7f710013a210 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70f4017000 tx=0x7f70f4004a40 comp rx=0 tx=0).stop 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 117306, 2026-02-17T11:56:57.004 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.005 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.006 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.007 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.008 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.009 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.010 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.011 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.012 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:57.013 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:57.014 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70d003dd10 msgr2=0x7f70d00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f70d003dd10 0x7f70d00401d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7100130700 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 10 monclient: shutdown 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 msgr2=0x7f71001381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 --2- 10.20.193.51:0/3824451220 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71000a0750 0x7f71001381c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f00047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7105cfd640 1 -- 10.20.193.51:0/3824451220 reap_dead start 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7105cfd640 1 -- 10.20.193.51:0/3824451220 reap_dead start 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 shutdown_connections 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 >> 10.20.193.51:0/3824451220 conn(0x7f71000a30c0 msgr2=0x7f710013ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 shutdown_connections 2026-02-17T11:56:57.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:56.984+0000 7f7107787640 1 -- 10.20.193.51:0/3824451220 wait complete. 2026-02-17T11:56:57.017 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:57.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:56:57.017 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 10 monclient: get_monmap_and_config 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 10 monclient: monmap: 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:57.084396+0000 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:57.084396+0000 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:57.085 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:57.086 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:57.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 1 Processor -- start 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 1 -- start start 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.083+0000 7f65e610a640 10 monclient: init 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-b con 0x7f65e00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f65e00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f65e013b760 0x7f65e013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-c con 0x7f65e013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e006e140 con 0x7f65e00a0750 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f65e009f910 con 0x7f65e013b760 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f65e009ccd0 con 0x7f65e00a3bb0 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65e610a640 10 monclient(hunting): authenticate will time out at 1304.703161s 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42984/0 (socket says 10.20.193.51:42984) 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 -- 10.20.193.51:0/2913233828 learned_addr learned my addr 10.20.193.51:0/2913233828 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 10 monclient(hunting): get_auth_request con 0x7f65e00a3bb0 auth_method 0 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 --2- 10.20.193.51:0/2913233828 >> v2:10.20.193.142:3300/0 conn(0x7f65e013b760 0x7f65e013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 -- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 msgr2=0x7f65e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 -- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 msgr2=0x7f65e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): get_auth_request con 0x7f65e013b760 auth_method 0 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65df7fe640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient(hunting): handle_auth_done global_id 114376 payload 274 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 -- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 msgr2=0x7f65e009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 -- 10.20.193.51:0/2913233828 >> v1:10.20.193.142:6789/0 conn(0x7f65e00a0750 legacy=0x7f65e009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 monclient: found mon.noname-c 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:56:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.084+0000 7f65dffff640 1 -- 10.20.193.51:0/2913233828 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e009eec0 con 0x7f65e013b760 2026-02-17T11:56:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65dffff640 1 -- 10.20.193.51:0/2913233828 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e013b760 msgr2=0x7f65e013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65dffff640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e013b760 0x7f65e013db50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f65e009f230 tx=0x7f65d402f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968cbb9508adde0a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 1 -- 10.20.193.51:0/2913233828 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d403c070 con 0x7f65e013b760 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: dump: 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 1 -- 10.20.193.51:0/2913233828 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4037440 con 0x7f65e013b760 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 5 monclient: authenticate success, global_id 114376 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 1 -- 10.20.193.51:0/2913233828 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4037810 con 0x7f65e013b760 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 4 set_mon_vals no callback set 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65de7fc640 10 monclient: dump: 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 10 monclient: shutdown 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 -- 10.20.193.51:0/2913233828 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e013b760 msgr2=0x7f65e013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e013b760 0x7f65e013db50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f65e009f230 tx=0x7f65d402f150 comp rx=0 tx=0).stop 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 -- 10.20.193.51:0/2913233828 shutdown_connections 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e013b760 0x7f65e013db50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 --2- 10.20.193.51:0/2913233828 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a3bb0 0x7f65e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 -- 10.20.193.51:0/2913233828 >> 10.20.193.51:0/2913233828 conn(0x7f65e00a30c0 msgr2=0x7f65e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 -- 10.20.193.51:0/2913233828 shutdown_connections 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.087+0000 7f65e610a640 1 -- 10.20.193.51:0/2913233828 wait complete. 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient: monmap: 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:57.100 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 Processor -- start 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 -- start start 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient: init 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-c con 0x7f65e00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e00a3bb0 0x7f65e013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-b con 0x7f65e00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 0x7f65e013b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): picked mon.noname-a con 0x7f65e013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f65e00a04b0 con 0x7f65e013b760 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65e009c850 con 0x7f65e00a3bb0 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f65e009e710 con 0x7f65e00a0750 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65e610a640 10 monclient(hunting): authenticate will time out at 1304.707585s 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42992/0 (socket says 10.20.193.51:42992) 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 learned_addr learned my addr 10.20.193.51:0/361091101 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 10 monclient(hunting): get_auth_request con 0x7f65e00a0750 auth_method 0 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 0x7f65e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): get_auth_request con 0x7f65e013b760 auth_method 0 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 msgr2=0x7f65e013a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 msgr2=0x7f65e013a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65deffd640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e00a3bb0 0x7f65e013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient(hunting): handle_auth_done global_id 134310 payload 824 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 msgr2=0x7f65e013a770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:57.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e00a0750 0x7f65e013a770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e00a3bb0 msgr2=0x7f65e013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e00a3bb0 0x7f65e013acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 monclient: found mon.noname-a 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65dffff640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e009a740 con 0x7f65e013b760 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65deffd640 10 monclient: get_auth_request con 0x7f65e00a3bb0 auth_method 0 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.088+0000 7f65deffd640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f65e00a3bb0 0x7f65e013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.090+0000 7f65dffff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 msgr2=0x7f65e013b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.090+0000 7f65dffff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 0x7f65e013b1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65e0051340 tx=0x7f65d4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4047020 con 0x7f65e013b760 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:57.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: dump: 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 5 monclient: authenticate success, global_id 134310 2026-02-17T11:56:57.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 monclient: _renew_subs 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d403d040 con 0x7f65e013b760 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e009ad00 con 0x7f65e013b760 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d403c070 con 0x7f65e013b760 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 10 monclient: dump: 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.106 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65dd7fa640 4 set_mon_vals no callback set 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 monclient: _renew_subs 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e009a460 con 0x7f65e013b760 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f65e00995e0 con 0x7f65e0097650 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f65d4043ce0 con 0x7f65e013b760 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 10 monclient: get_auth_request con 0x7f65e0097650 auth_method 0 2026-02-17T11:56:57.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 msgr2=0x7f65e008d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 msgr2=0x7f65e008d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65b003dd10 0x7f65b00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.091+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(411..411 src has 167..411) ==== 4735+0+0 (secure 0 0 0) 0x7f65d4078360 con 0x7f65e013b760 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.092+0000 7f65deffd640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65b003dd10 0x7f65b00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.092+0000 7f65deffd640 10 monclient: get_auth_request con 0x7f65b003dd10 auth_method 0 2026-02-17T11:56:57.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.094+0000 7f65deffd640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65b003dd10 0x7f65b00401d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f65e009a950 tx=0x7f65d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient: get_auth_request con 0x7f65e0097650 auth_method 0 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 10 monclient(hunting): handle_auth_done global_id 154100 payload 824 2026-02-17T11:56:57.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.292+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65e009dac0 con 0x7f65e0097650 2026-02-17T11:56:57.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 msgr2=0x7f65e008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc01a070 con 0x7f65e0097650 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 10 monclient: dump: 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.297 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f65cc00fe50 con 0x7f65e0097650 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 msgr2=0x7f65e008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc011cd0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 msgr2=0x7f65e008d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:57.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.294+0000 7f65bbfff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097650 0x7f65e008d3f0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc011cd0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65e610a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65e610a640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 0x7f65e01da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65e610a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f65e00a2a60 con 0x7f65e0097a30 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 0x7f65e01da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient: get_auth_request con 0x7f65e0097a30 auth_method 0 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 10 monclient(hunting): handle_auth_done global_id 154103 payload 824 2026-02-17T11:56:57.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.297+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65e008eab0 con 0x7f65e0097a30 2026-02-17T11:56:57.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65df7fe640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 msgr2=0x7f65e01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65df7fe640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 0x7f65e01da8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc015a60 con 0x7f65e0097a30 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 10 monclient: dump: 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f65cc015a60 con 0x7f65e0097a30 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 msgr2=0x7f65e01da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 0x7f65e01da8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 msgr2=0x7f65e01da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:57.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65bbfff640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f65e0097a30 0x7f65e01da8c0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65cc011800 tx=0x7f65cc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:57.305 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10180, 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.306 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:57.307 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.308 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:57.309 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.310 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.311 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.312 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.313 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:57.314 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.315 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.316 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:57.317 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.318 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.319 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.319 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:57.319 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:57.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65b003dd10 msgr2=0x7f65b00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65b003dd10 0x7f65b00401d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f65e009a950 tx=0x7f65d0009040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 10 monclient: shutdown 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 msgr2=0x7f65e013b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 0x7f65e013b1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65e0051340 tx=0x7f65d4004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65dffff640 1 -- 10.20.193.51:0/361091101 reap_dead start 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 shutdown_connections 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 --2- 10.20.193.51:0/361091101 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f65e013b760 0x7f65e013b1f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 >> 10.20.193.51:0/361091101 conn(0x7f65e00a30c0 msgr2=0x7f65e00a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 shutdown_connections 2026-02-17T11:56:57.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.300+0000 7f65e610a640 1 -- 10.20.193.51:0/361091101 wait complete. 2026-02-17T11:56:57.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:57.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:56:57.322 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:56:57.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 10 monclient: get_monmap_and_config 2026-02-17T11:56:57.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 10 monclient: monmap: 2026-02-17T11:56:57.393 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:57.390448+0000 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:57.390448+0000 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:57.394 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 1 Processor -- start 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 1 -- start start 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.389+0000 7f9b4f7f8640 10 monclient: init 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-b con 0x7f9b480a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9b4809d270 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9b48138780 0x7f9b481403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-c con 0x7f9b48138780 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48135430 con 0x7f9b4809d270 2026-02-17T11:56:57.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4809a5c0 con 0x7f9b48138780 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4809b520 con 0x7f9b480a3bb0 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4f7f8640 10 monclient(hunting): authenticate will time out at 1305.009191s 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43032/0 (socket says 10.20.193.51:43032) 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 -- 10.20.193.51:0/3779016585 learned_addr learned my addr 10.20.193.51:0/3779016585 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request con 0x7f9b480a3bb0 auth_method 0 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4dd6e640 1 --2- 10.20.193.51:0/3779016585 >> v2:10.20.193.142:3300/0 conn(0x7f9b48138780 0x7f9b481403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_done global_id 154106 payload 274 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 -- 10.20.193.51:0/3779016585 >> v2:10.20.193.142:3300/0 conn(0x7f9b48138780 msgr2=0x7f9b481403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/3779016585 >> v2:10.20.193.142:3300/0 conn(0x7f9b48138780 0x7f9b481403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 -- 10.20.193.51:0/3779016585 >> v1:10.20.193.142:6789/0 conn(0x7f9b4809d270 legacy=0x7f9b48138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 monclient: found mon.noname-b 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:57.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.390+0000 7f9b4d56d640 1 -- 10.20.193.51:0/3779016585 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4809af60 con 0x7f9b480a3bb0 2026-02-17T11:56:57.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.392+0000 7f9b4d56d640 1 -- 10.20.193.51:0/3779016585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 msgr2=0x7f9b4809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.392+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/3779016585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009970 tx=0x7f9b3802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ed4a850dbd0665 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 1 -- 10.20.193.51:0/3779016585 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3803c070 con 0x7f9b480a3bb0 2026-02-17T11:56:57.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: dump: 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.408 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 1 -- 10.20.193.51:0/3779016585 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3802fdb0 con 0x7f9b480a3bb0 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 5 monclient: authenticate success, global_id 154106 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 1 -- 10.20.193.51:0/3779016585 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38037660 con 0x7f9b480a3bb0 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 4 set_mon_vals no callback set 2026-02-17T11:56:57.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b37fff640 10 monclient: dump: 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.410 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 10 monclient: shutdown 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/3779016585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 msgr2=0x7f9b4809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/3779016585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009970 tx=0x7f9b3802ee90 comp rx=0 tx=0).stop 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/3779016585 shutdown_connections 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/3779016585 >> v2:10.20.193.142:3300/0 conn(0x7f9b48138780 0x7f9b481403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/3779016585 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b480a3bb0 0x7f9b4809cd30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/3779016585 >> 10.20.193.51:0/3779016585 conn(0x7f9b480a30c0 msgr2=0x7f9b480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/3779016585 shutdown_connections 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/3779016585 wait complete. 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.393+0000 7f9b4f7f8640 10 monclient: monmap: 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:57.412 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 Processor -- start 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 -- start start 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient: init 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b4809d270 0x7f9b48132180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-a con 0x7f9b4809d270 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b480a3bb0 0x7f9b4812cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-b con 0x7f9b480a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 0x7f9b4812d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): picked mon.noname-c con 0x7f9b48138780 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48074ac0 con 0x7f9b4809d270 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b480a3f90 con 0x7f9b480a3bb0 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9b48135040 con 0x7f9b48138780 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4f7f8640 10 monclient(hunting): authenticate will time out at 1305.013437s 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 0x7f9b4812d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 0x7f9b4812d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43036/0 (socket says 10.20.193.51:43036) 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 learned_addr learned my addr 10.20.193.51:0/4282406712 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): get_auth_request con 0x7f9b48138780 auth_method 0 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b4809d270 0x7f9b48132180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request con 0x7f9b4809d270 auth_method 0 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4cd6c640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b480a3bb0 0x7f9b4812cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4cd6c640 10 monclient(hunting): get_auth_request con 0x7f9b480a3bb0 auth_method 0 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4cd6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4cd6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4cd6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient(hunting): handle_auth_done global_id 154109 payload 824 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b480a3bb0 msgr2=0x7f9b4812cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b480a3bb0 0x7f9b4812cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b4809d270 msgr2=0x7f9b48132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b4809d270 0x7f9b48132180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 monclient: found mon.noname-c 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480a27a0 con 0x7f9b48138780 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.394+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b4809d270 0x7f9b48132180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 msgr2=0x7f9b4812d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4dd6e640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 0x7f9b4812d050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400cd20 tx=0x7f9b4400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44003c90 con 0x7f9b48138780 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: dump: 2026-02-17T11:56:57.417 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b44003e30 con 0x7f9b48138780 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4f7f8640 5 monclient: authenticate success, global_id 154109 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400e800 con 0x7f9b48138780 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b35ffb640 10 monclient: dump: 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.419 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b377fe640 4 set_mon_vals no callback set 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4f7f8640 10 monclient: _renew_subs 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4f7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b481303d0 con 0x7f9b48138780 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.396+0000 7f9b4f7f8640 10 monclient: _renew_subs 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:57.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4812ef80 con 0x7f9b48138780 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 0x7f9b4812d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b481382b0 con 0x7f9b481307d0 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9b4400e9a0 con 0x7f9b48138780 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 0x7f9b4812d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient: get_auth_request con 0x7f9b481307d0 auth_method 0 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b35ffb640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b1803dd60 0x7f9b18040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(411..411 src has 167..411) ==== 4735+0+0 (secure 0 0 0) 0x7f9b440531c0 con 0x7f9b48138780 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4cd6c640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b1803dd60 0x7f9b18040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4cd6c640 10 monclient: get_auth_request con 0x7f9b1803dd60 auth_method 0 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_done global_id 114382 payload 824 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.397+0000 7f9b4d56d640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b48138c10 con 0x7f9b481307d0 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b4d56d640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 msgr2=0x7f9b4812d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 0x7f9b4812d590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806c0d0 tx=0x7f9b380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b4cd6c640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b1803dd60 0x7f9b18040220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c006fd0 tx=0x7f9b3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38046020 con 0x7f9b481307d0 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 10 monclient: dump: 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9b38042670 con 0x7f9b481307d0 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 msgr2=0x7f9b4812d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 0x7f9b4812d590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806c0d0 tx=0x7f9b380047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 msgr2=0x7f9b4812d590 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.400+0000 7f9b35ffb640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b481307d0 0x7f9b4812d590 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806c0d0 tx=0x7f9b380047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4f7f8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 0x7f9b480638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4f7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48074db0 con 0x7f9b4809eb40 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 0x7f9b480638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4d56d640 10 monclient: get_auth_request con 0x7f9b4809eb40 auth_method 0 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4d56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4d56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.403+0000 7f9b4d56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.404+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.404+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.404+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.404+0000 7f9b4d56d640 10 monclient(hunting): handle_auth_done global_id 114385 payload 824 2026-02-17T11:56:57.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.404+0000 7f9b4d56d640 1 -- 10.20.193.51:0/4282406712 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b480008d0 con 0x7f9b4809eb40 2026-02-17T11:56:57.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4d56d640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 msgr2=0x7f9b480638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4d56d640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 0x7f9b480638c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802eed0 tx=0x7f9b38039040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38046030 con 0x7f9b4809eb40 2026-02-17T11:56:57.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 10 monclient: dump: 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f9b38057420 con 0x7f9b4809eb40 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:57.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 msgr2=0x7f9b480638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 0x7f9b480638c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802eed0 tx=0x7f9b38039040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 msgr2=0x7f9b480638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b35ffb640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b4809eb40 0x7f9b480638c0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802eed0 tx=0x7f9b38039040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:57.428 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 219281, 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.429 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.430 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:57.431 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:57.432 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:57.434 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.435 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.437 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:57.438 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:57.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b1803dd60 msgr2=0x7f9b18040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b1803dd60 0x7f9b18040220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c006fd0 tx=0x7f9b3c008040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 10 monclient: shutdown 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 msgr2=0x7f9b4812d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 --2- 10.20.193.51:0/4282406712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b48138780 0x7f9b4812d050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400cd20 tx=0x7f9b4400a660 comp rx=0 tx=0).stop 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 reap_dead start 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4dd6e640 1 -- 10.20.193.51:0/4282406712 reap_dead start 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 shutdown_connections 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 >> 10.20.193.51:0/4282406712 conn(0x7f9b480a30c0 msgr2=0x7f9b4809c650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 shutdown_connections 2026-02-17T11:56:57.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.406+0000 7f9b4f7f8640 1 -- 10.20.193.51:0/4282406712 wait complete. 2026-02-17T11:56:57.440 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:57.440 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:56:57.441 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 10 monclient: get_monmap_and_config 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 10 monclient: monmap: 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:57.508255+0000 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:57.508255+0000 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:57.509 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 1 Processor -- start 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 1 -- start start 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 10 monclient: init 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.507+0000 7f3895cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38900a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f38900a0750 0x7f389009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-a con 0x7f38900a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 0x7f389013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-c con 0x7f389013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389006e140 con 0x7f38900a3bb0 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f389009f910 con 0x7f38900a0750 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f389009ccd0 con 0x7f389013b760 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f3895cb0640 10 monclient(hunting): authenticate will time out at 1305.127139s 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388f7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f38900a3bb0 0x7f389009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46000/0 (socket says 10.20.193.51:46000) 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388f7fe640 1 -- 10.20.193.51:0/2502204378 learned_addr learned my addr 10.20.193.51:0/2502204378 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 --2- 10.20.193.51:0/2502204378 >> v2:10.20.193.51:3300/0 conn(0x7f38900a0750 0x7f389009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): get_auth_request con 0x7f38900a0750 auth_method 0 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388ffff640 1 --2- 10.20.193.51:0/2502204378 >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 0x7f389013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient(hunting): handle_auth_done global_id 134316 payload 274 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 -- 10.20.193.51:0/2502204378 >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 msgr2=0x7f389013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 --2- 10.20.193.51:0/2502204378 >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 0x7f389013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 -- 10.20.193.51:0/2502204378 >> v1:10.20.193.51:6789/0 conn(0x7f38900a3bb0 legacy=0x7f389009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 monclient: found mon.noname-a 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388effd640 1 -- 10.20.193.51:0/2502204378 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389009eec0 con 0x7f38900a0750 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388ffff640 10 monclient: get_auth_request con 0x7f389013b760 auth_method 0 2026-02-17T11:56:57.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.508+0000 7f388ffff640 1 --2- 10.20.193.51:0/2502204378 >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 0x7f389013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:57.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388effd640 1 -- 10.20.193.51:0/2502204378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38900a0750 msgr2=0x7f389009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388effd640 1 --2- 10.20.193.51:0/2502204378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38900a0750 0x7f389009e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f389009f5f0 tx=0x7f388002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb292da00c796d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 1 -- 10.20.193.51:0/2502204378 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388003c070 con 0x7f38900a0750 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: dump: 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 1 -- 10.20.193.51:0/2502204378 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388002fcb0 con 0x7f38900a0750 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f3895cb0640 5 monclient: authenticate success, global_id 134316 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f3895cb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f3895cb0640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 1 -- 10.20.193.51:0/2502204378 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388002fe60 con 0x7f38900a0750 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f3895cb0640 4 set_mon_vals no callback set 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.510+0000 7f388e7fc640 10 monclient: dump: 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.519 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 10 monclient: shutdown 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- 10.20.193.51:0/2502204378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38900a0750 msgr2=0x7f389009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 --2- 10.20.193.51:0/2502204378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38900a0750 0x7f389009e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f389009f5f0 tx=0x7f388002ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- 10.20.193.51:0/2502204378 shutdown_connections 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 --2- 10.20.193.51:0/2502204378 >> v2:10.20.193.142:3300/0 conn(0x7f389013b760 0x7f389013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 --2- 10.20.193.51:0/2502204378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38900a0750 0x7f389009e1d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- 10.20.193.51:0/2502204378 >> 10.20.193.51:0/2502204378 conn(0x7f38900a30c0 msgr2=0x7f38900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- 10.20.193.51:0/2502204378 shutdown_connections 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- 10.20.193.51:0/2502204378 wait complete. 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 10 monclient: build_initial_monmap 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 10 monclient: monmap: 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:57.520 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 Processor -- start 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 1 -- start start 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.511+0000 7f3895cb0640 10 monclient: init 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38900a0750 0x7f38901cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-b con 0x7f38900a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 0x7f38901d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-c con 0x7f38900a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): picked mon.noname-a con 0x7f389013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f38900a04b0 con 0x7f389013b760 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f389009c850 con 0x7f38900a0750 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f389009e710 con 0x7f38900a3bb0 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f3895cb0640 10 monclient(hunting): authenticate will time out at 1305.131237s 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52754/0 (socket says 10.20.193.51:52754) 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 -- 10.20.193.51:0/1986109213 learned_addr learned my addr 10.20.193.51:0/1986109213 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): get_auth_request con 0x7f389013b760 auth_method 0 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 0x7f38901d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): get_auth_request con 0x7f38900a3bb0 auth_method 0 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388f7fe640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38900a0750 0x7f38901cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388f7fe640 10 monclient(hunting): get_auth_request con 0x7f38900a0750 auth_method 0 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:57.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient(hunting): handle_auth_done global_id 134319 payload 824 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 -- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 msgr2=0x7f38901d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 0x7f38901d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 -- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38900a0750 msgr2=0x7f38901cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38900a0750 0x7f38901cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 monclient: found mon.noname-a 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388ffff640 1 -- 10.20.193.51:0/1986109213 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3890098ee0 con 0x7f389013b760 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.512+0000 7f388effd640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 0x7f38901d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f388ffff640 1 -- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 msgr2=0x7f3890095310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f388ffff640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f388400cdd0 tx=0x7f388400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388401a070 con 0x7f389013b760 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: dump: 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.524 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388400da50 con 0x7f389013b760 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388400de40 con 0x7f389013b760 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f388dffb640 4 set_mon_vals no callback set 2026-02-17T11:56:57.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f386bfff640 10 monclient: dump: 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 5 monclient: authenticate success, global_id 134319 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 10 monclient: _renew_subs 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38900991c0 con 0x7f389013b760 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 10 monclient: _renew_subs 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.514+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38900a2c00 con 0x7f389013b760 2026-02-17T11:56:57.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f3895cb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f3895cb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f3895cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3890077c20 con 0x7f389013b760 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f388401e3b0 con 0x7f389013b760 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f386bfff640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 0x7f3860040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(411..411 src has 167..411) ==== 4735+0+0 (secure 0 0 0) 0x7f3884053130 con 0x7f389013b760 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f388f7fe640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 0x7f3860040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:57.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.515+0000 7f388f7fe640 10 monclient: get_auth_request con 0x7f386003dd60 auth_method 0 2026-02-17T11:56:57.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.517+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3890077c20 con 0x7f389013b760 2026-02-17T11:56:57.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.517+0000 7f386bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:57.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.517+0000 7f386bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:57.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.518+0000 7f388f7fe640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 0x7f3860040220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f387c007340 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:57.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.632+0000 7f3895cb0640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:56:57.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.632+0000 7f3895cb0640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:56:57.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.632+0000 7f3895cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:57.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.632+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f389009dac0 con 0x7f389013b760 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.632+0000 7f386bfff640 1 -- 10.20.193.51:0/1986109213 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3884014cc0 con 0x7f389013b760 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.633+0000 7f386bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.633+0000 7f386bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 msgr2=0x7f3860040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 0x7f3860040220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f387c007340 tx=0x7f387c009040 comp rx=0 tx=0).stop 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 10 monclient: shutdown 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 msgr2=0x7f3890095310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:57.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f388400cdd0 tx=0x7f388400a710 comp rx=0 tx=0).stop 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 shutdown_connections 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f386003dd60 0x7f3860040220 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f389013b760 0x7f3890095310 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38900a3bb0 0x7f38901d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 --2- 10.20.193.51:0/1986109213 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38900a0750 0x7f38901cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 >> 10.20.193.51:0/1986109213 conn(0x7f38900a30c0 msgr2=0x7f389013ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 shutdown_connections 2026-02-17T11:56:57.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:57.634+0000 7f3895cb0640 1 -- 10.20.193.51:0/1986109213 wait complete. 2026-02-17T11:56:57.643 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:56:57.788 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.788 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=10,logm=54} crc {auth=2458656973,config=692619927,health=2974672015,kv=4176802182,logm=1420689035}) 2026-02-17T11:56:57.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=478860129,config=692619927,health=63035797,kv=643764953,logm=4270697672}) 2026-02-17T11:56:57.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=10,logm=54} crc {auth=2458656973,config=692619927,health=2974672015,kv=4176802182,logm=1420689035}) 2026-02-17T11:56:57.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.786+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=4001816223,config=692619927,health=271994670,kv=643764953,logm=4207448795}) 2026-02-17T11:56:57.791 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.791 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931319875}) 2026-02-17T11:56:57.792 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1654254676}) 2026-02-17T11:56:57.792 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.792 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931319875}) 2026-02-17T11:56:57.792 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.789+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2645873298}) 2026-02-17T11:56:57.793 INFO:tasks.rados.rados.0.trial142.stdout:1760: done (1 left) 2026-02-17T11:56:57.793 INFO:tasks.rados.rados.0.trial142.stdout:1761: done (0 left) 2026-02-17T11:56:57.793 INFO:tasks.rados.rados.0.trial142.stdout:1762: snap_create 2026-02-17T11:56:57.795 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.795 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=767821139}) 2026-02-17T11:56:57.796 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088639848}) 2026-02-17T11:56:57.796 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:57.796 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=767821139}) 2026-02-17T11:56:57.796 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:57.793+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3325685046}) 2026-02-17T11:56:58.033 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044725529}) 2026-02-17T11:56:58.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2775291221}) 2026-02-17T11:56:58.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044725529}) 2026-02-17T11:56:58.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.031+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2882396180}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3255522354}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2733361960}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3255522354}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1619825713}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963470245}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=599836591}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963470245}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.396+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=618701669}) 2026-02-17T11:56:58.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3208476766}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2965065160}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3208476766}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089180433}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950954277}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3788689494}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950954277}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.397+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2608431074}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468722465}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2227533925}) 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468722465}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=694952909}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2857460169}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=504881116}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2857460169}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.398+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3260096047}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1322890327}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51523242}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1322890327}) 2026-02-17T11:56:58.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=992283834}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3764456602}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4045111265}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3764456602}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3610091918}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534324082}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1826976956}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534324082}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.399+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=371043951}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2965252784}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=370362006}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2965252784}) 2026-02-17T11:56:58.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3730246752}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1352269438}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2321133214}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1352269438}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.400+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3773754761}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2358750179}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2563684293}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2358750179}) 2026-02-17T11:56:58.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3176698230}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1136231852}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=432133999}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1136231852}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=231853110}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2767379095}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3092649953}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2767379095}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.401+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1269617134}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1767424832}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4004526306}) 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1767424832}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=607691071}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861958571}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3481135199}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861958571}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2087780965}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849368572}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1174426681}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849368572}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.402+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1820369295}) 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805670047}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1729259099}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805670047}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2733880279}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3758664235}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1972558857}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3758664235}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.403+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=940731858}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160479974}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3520572549}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160479974}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2830921418}) 2026-02-17T11:56:58.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3108089070}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1585692974}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3108089070}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3395530631}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721383351}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2923437186}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721383351}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.404+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4001807185}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3865133703}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3064931473}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3865133703}) 2026-02-17T11:56:58.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=604651724}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065154659}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3535816758}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065154659}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1490942624}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252178443}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2875215006}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252178443}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.405+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=286796158}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064049558}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3914970254}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064049558}) 2026-02-17T11:56:58.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3906486219}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=375096841}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=432782701}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=375096841}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4097626686}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861861280}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2227961083}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861861280}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.406+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3562953848}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4201224852}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=568018698}) 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4201224852}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=728943104}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2516750836}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=603798881}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2516750836}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.407+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3307881333}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237802037}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=72139628}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237802037}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=219027098}) 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898249827}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1702516408}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898249827}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1794523937}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1058360867}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1044720569}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1058360867}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.408+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2455525898}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2266606549}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4265094237}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2266606549}) 2026-02-17T11:56:58.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=390272217}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3701852360}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4097929115}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3701852360}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2264502353}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325801183}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3698419991}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325801183}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.409+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2242227287}) 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5} crc {logm=2525602029,mdsmap=3207544932,mgr=3707591435,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=54355346,mon_config_key=3866048850,monmap=263989209,osd_metadata=101123558}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=61,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=7,mon_config_key=13,monmap=3,osd_metadata=5} crc {logm=3715188994,mdsmap=3140514009,mgr=2354395410,mgr_metadata=3312392843,mgrstat=1960388474,mon_config_key=3390328712,monmap=263989209,osd_metadata=101123558}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=5} crc {logm=2525602029,mdsmap=3207544932,mgr=3707591435,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=54355346,mon_config_key=3866048850,monmap=263989209,osd_metadata=101123558}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2} crc {logm=2407181591,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=235787378,mon_config_key=3390328712,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=159064505,osd_snap=1144924069}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=66,osdmap=33} crc {osd_pg_creating=159064505,osd_snap=3617752326,osdmap=919462139}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=63,osdmap=35} crc {osd_metadata=3051295309,osd_pg_creating=159064505,osd_snap=3641998728,osdmap=56922333}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=66,osdmap=33} crc {osd_pg_creating=159064505,osd_snap=3617752326,osdmap=919462139}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.410+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=65,osdmap=33} crc {osd_metadata=3051295309,osd_pg_creating=159064505,osd_snap=4010836819,osdmap=3344950814}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3188482976}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2685401409}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3188482976}) 2026-02-17T11:56:58.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=193549726}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3904104715}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1119200120}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3904104715}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.411+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2472732214}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=333706995}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4193807877}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=333706995}) 2026-02-17T11:56:58.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.412+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2691324368}) 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=30} crc {osdmap=1323698004}) 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=30} crc {osdmap=2772067833}) 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=30} crc {osdmap=1323698004}) 2026-02-17T11:56:58.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:56:58.414+0000 7f599a458640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=31} crc {osdmap=4110491142}) 2026-02-17T11:56:58.643 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:56:58.644 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.710+0000 7f8e3cf85640 10 monclient: get_monmap_and_config 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.710+0000 7f8e3cf85640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.710+0000 7f8e3cf85640 10 monclient: monmap: 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:58.711651+0000 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:58.711651+0000 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:58.712 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:58.713 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:58.713 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 Processor -- start 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 -- start start 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient: init 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8e38138600 0x7f8e381389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-a con 0x7f8e38138600 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8e380a35a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8e380a5a70 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e380a1df0 con 0x7f8e380a5a70 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e38138f20 con 0x7f8e380a35a0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8e380a6830 con 0x7f8e38138600 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e3cf85640 10 monclient(hunting): authenticate will time out at 1306.330486s 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8e38138600 0x7f8e381389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8e380a5a70 0x7f8e38140380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46008/0 (socket says 10.20.193.51:46008) 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36d76640 1 -- 10.20.193.51:0/1895179455 learned_addr learned my addr 10.20.193.51:0/1895179455 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): get_auth_request con 0x7f8e38138600 auth_method 0 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient(hunting): handle_auth_done global_id 134322 payload 274 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 1 -- 10.20.193.51:0/1895179455 >> v1:10.20.193.142:6789/0 conn(0x7f8e380a35a0 legacy=0x7f8e380a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 1 -- 10.20.193.51:0/1895179455 >> v1:10.20.193.51:6789/0 conn(0x7f8e380a5a70 legacy=0x7f8e38140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 1 monclient: found mon.noname-a 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.711+0000 7f8e36575640 1 -- 10.20.193.51:0/1895179455 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e380a65b0 con 0x7f8e38138600 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e36575640 1 -- 10.20.193.51:0/1895179455 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e38138600 msgr2=0x7f8e381389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e36575640 1 --2- 10.20.193.51:0/1895179455 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e38138600 0x7f8e381389e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0098a0 tx=0x7f8e2c02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320a330daf136107 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 1 -- 10.20.193.51:0/1895179455 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c03c070 con 0x7f8e38138600 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: dump: 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: _finish_auth 0 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 1 -- 10.20.193.51:0/1895179455 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c02fce0 con 0x7f8e38138600 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 5 monclient: authenticate success, global_id 134322 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 1 -- 10.20.193.51:0/1895179455 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c037660 con 0x7f8e38138600 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 4 set_mon_vals no callback set 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e35573640 10 monclient: dump: 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 10 monclient: shutdown 2026-02-17T11:56:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 -- 10.20.193.51:0/1895179455 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e38138600 msgr2=0x7f8e381389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/1895179455 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e38138600 0x7f8e381389e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0098a0 tx=0x7f8e2c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 -- 10.20.193.51:0/1895179455 shutdown_connections 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/1895179455 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e38138600 0x7f8e381389e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 -- 10.20.193.51:0/1895179455 >> 10.20.193.51:0/1895179455 conn(0x7f8e380a7460 msgr2=0x7f8e380a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 -- 10.20.193.51:0/1895179455 shutdown_connections 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.714+0000 7f8e3cf85640 1 -- 10.20.193.51:0/1895179455 wait complete. 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient: monmap: 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 Processor -- start 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 -- start start 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient: init 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8e380a35a0 0x7f8e38135e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-c con 0x7f8e380a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-a con 0x7f8e380a5a70 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8e38138600 0x7f8e38121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): picked mon.noname-b con 0x7f8e38138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380a25b0 con 0x7f8e380a5a70 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380a2c00 con 0x7f8e38138600 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8e380a15f0 con 0x7f8e380a35a0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e3cf85640 10 monclient(hunting): authenticate will time out at 1306.334690s 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52768/0 (socket says 10.20.193.51:52768) 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 -- 10.20.193.51:0/957491046 learned_addr learned my addr 10.20.193.51:0/957491046 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): get_auth_request con 0x7f8e380a5a70 auth_method 0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8e380a35a0 0x7f8e38135e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): get_auth_request con 0x7f8e380a35a0 auth_method 0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e36d76640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8e38138600 0x7f8e38121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient(hunting): handle_auth_done global_id 134325 payload 824 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 -- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8e380a35a0 msgr2=0x7f8e38135e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8e380a35a0 0x7f8e38135e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 -- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8e38138600 msgr2=0x7f8e38121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8e38138600 0x7f8e38121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 monclient: found mon.noname-a 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.715+0000 7f8e35d74640 1 -- 10.20.193.51:0/957491046 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e38125950 con 0x7f8e380a5a70 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e35d74640 1 -- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 msgr2=0x7f8e38136350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e35d74640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c5d0 tx=0x7f8e2000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20016020 con 0x7f8e380a5a70 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: dump: 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: _finish_auth 0 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e20012a60 con 0x7f8e380a5a70 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20012e50 con 0x7f8e380a5a70 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 10 monclient: dump: 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e34d72640 4 set_mon_vals no callback set 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 5 monclient: authenticate success, global_id 134325 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _renew_subs 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e38137df0 con 0x7f8e380a5a70 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _renew_subs 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381250b0 con 0x7f8e380a5a70 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8e2001b400 con 0x7f8e380a5a70 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e380a0c50 con 0x7f8e380a5a70 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.718+0000 7f8e1effd640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 0x7f8e040403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.719+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(412..412 src has 167..412) ==== 4735+0+0 (secure 0 0 0) 0x7f8e200525c0 con 0x7f8e380a5a70 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.719+0000 7f8e36575640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 0x7f8e040403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.719+0000 7f8e36575640 10 monclient: get_auth_request con 0x7f8e0403df00 auth_method 0 2026-02-17T11:56:58.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.721+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8e380a0c50 con 0x7f8e380a5a70 2026-02-17T11:56:58.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.721+0000 7f8e1effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.721+0000 7f8e1effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:58.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.721+0000 7f8e36575640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 0x7f8e040403c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e380aba00 tx=0x7f8e2c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.803 INFO:tasks.rados.rados.0.trial142.stdout:1762: done (0 left) 2026-02-17T11:56:58.803 INFO:tasks.rados.rados.0.trial142.stdout:1763: snap_create 2026-02-17T11:56:58.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e3cf85640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:58.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e3cf85640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e3cf85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8e38069780 con 0x7f8e380a5a70 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e1effd640 1 -- 10.20.193.51:0/957491046 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f8e20020030 con 0x7f8e380a5a70 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e1effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.838+0000 7f8e1effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:58.841 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:58.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 msgr2=0x7f8e040403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 0x7f8e040403c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e380aba00 tx=0x7f8e2c033000 comp rx=0 tx=0).stop 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 10 monclient: shutdown 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 msgr2=0x7f8e38136350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c5d0 tx=0x7f8e2000caa0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 shutdown_connections 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8e0403df00 0x7f8e040403c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8e38138600 0x7f8e38121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8e380a5a70 0x7f8e38136350 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 --2- 10.20.193.51:0/957491046 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8e380a35a0 0x7f8e38135e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 >> 10.20.193.51:0/957491046 conn(0x7f8e380a7460 msgr2=0x7f8e380a9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.839+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 shutdown_connections 2026-02-17T11:56:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.840+0000 7f8e3cf85640 1 -- 10.20.193.51:0/957491046 wait complete. 2026-02-17T11:56:58.850 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:56:58.850 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:56:58.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:56:58.851 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:56:58.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.916+0000 7f1129687640 10 monclient: get_monmap_and_config 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.916+0000 7f1129687640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.916+0000 7f1129687640 10 monclient: monmap: 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:58.917907+0000 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:58.917907+0000 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.921 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 Processor -- start 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 -- start start 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient: init 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T11:56:58.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 0x7f112409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): picked mon.noname-b con 0x7f11240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f11240a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f112413b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112406e140 con 0x7f11240a0750 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112409f910 con 0x7f112413b760 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f112409ccd0 con 0x7f11240a3bb0 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1129687640 10 monclient(hunting): authenticate will time out at 1306.536712s 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 0x7f112409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f11227fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f11240a0750 0x7f112409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46018/0 (socket says 10.20.193.51:46018) 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f11227fc640 1 -- 10.20.193.51:0/2710011682 learned_addr learned my addr 10.20.193.51:0/2710011682 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): get_auth_request con 0x7f11240a3bb0 auth_method 0 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient(hunting): handle_auth_done global_id 154118 payload 274 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 1 -- 10.20.193.51:0/2710011682 >> v1:10.20.193.142:6789/0 conn(0x7f112413b760 legacy=0x7f112413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 1 -- 10.20.193.51:0/2710011682 >> v1:10.20.193.51:6789/0 conn(0x7f11240a0750 legacy=0x7f112409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 1 monclient: found mon.noname-b 2026-02-17T11:56:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:58.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.917+0000 7f1122ffd640 1 -- 10.20.193.51:0/2710011682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112409eec0 con 0x7f11240a3bb0 2026-02-17T11:56:58.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1122ffd640 1 -- 10.20.193.51:0/2710011682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 msgr2=0x7f112409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1122ffd640 1 --2- 10.20.193.51:0/2710011682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 0x7f112409dac0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f112409f230 tx=0x7f111802eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb99613137153a6e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 1 -- 10.20.193.51:0/2710011682 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111803c070 con 0x7f11240a3bb0 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: dump: 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.930 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 1 -- 10.20.193.51:0/2710011682 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111802fd00 con 0x7f11240a3bb0 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 5 monclient: authenticate success, global_id 154118 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:58.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 1 -- 10.20.193.51:0/2710011682 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118037660 con 0x7f11240a3bb0 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 4 set_mon_vals no callback set 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1121ffb640 10 monclient: dump: 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.932 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 10 monclient: shutdown 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 1 -- 10.20.193.51:0/2710011682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 msgr2=0x7f112409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.920+0000 7f1129687640 1 --2- 10.20.193.51:0/2710011682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 0x7f112409dac0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f112409f230 tx=0x7f111802eda0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- 10.20.193.51:0/2710011682 shutdown_connections 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 --2- 10.20.193.51:0/2710011682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a3bb0 0x7f112409dac0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- 10.20.193.51:0/2710011682 >> 10.20.193.51:0/2710011682 conn(0x7f11240a30c0 msgr2=0x7f11240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- 10.20.193.51:0/2710011682 shutdown_connections 2026-02-17T11:56:58.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- 10.20.193.51:0/2710011682 wait complete. 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient: monmap: 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:58.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 Processor -- start 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- start start 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient: init 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): picked mon.noname-c con 0x7f11240a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f112409ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): picked mon.noname-a con 0x7f11240a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f112409b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): picked mon.noname-b con 0x7f112413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11240a04b0 con 0x7f11240a3bb0 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f112409c850 con 0x7f112413b760 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f112409e710 con 0x7f11240a0750 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1129687640 10 monclient(hunting): authenticate will time out at 1306.540874s 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f112409ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43066/0 (socket says 10.20.193.51:43066) 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 learned_addr learned my addr 10.20.193.51:0/3379840139 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): get_auth_request con 0x7f11240a0750 auth_method 0 2026-02-17T11:56:58.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): get_auth_request con 0x7f11240a3bb0 auth_method 0 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.921+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 10 monclient(hunting): handle_auth_done global_id 154121 payload 824 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 msgr2=0x7f112409b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f11237fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f112409b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f112409b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 msgr2=0x7f112409ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f112409ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 monclient: found mon.noname-c 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1124095700 con 0x7f11240a0750 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 msgr2=0x7f112409a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:56:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 msgr2=0x7f112409a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:56:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f1118009820 tx=0x7f11180047c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:56:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:58.922+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:59.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 10 monclient: get_auth_request con 0x7f11240a0750 auth_method 0 2026-02-17T11:56:59.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 0 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:56:59.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 msgr2=0x7f112409a830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11240a0750 0x7f112409a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f10f00055d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): picked mon.noname-b con 0x7f112413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 0x7f10f00084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): picked mon.noname-c con 0x7f10f0006030 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f10f000b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): picked mon.noname-a con 0x7f11240a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f10f000ba90 con 0x7f11240a3bb0 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10f000bc10 con 0x7f112413b760 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f10f000be10 con 0x7f10f0006030 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11037fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 0x7f10f00084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): get_auth_request con 0x7f10f0006030 auth_method 0 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f10f000b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): get_auth_request con 0x7f11240a3bb0 auth_method 0 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11237fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f10f00055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient(hunting): handle_auth_done global_id 154121 payload 293 2026-02-17T11:56:59.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 msgr2=0x7f10f00055d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f10f00055d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 msgr2=0x7f10f000b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11240a3bb0 0x7f10f000b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 monclient: found mon.noname-c 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f11227fc640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f000c0d0 con 0x7f10f0006030 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 10 monclient: get_auth_request con 0x7f112413b760 auth_method 0 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.123+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f112413b760 0x7f10f00055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:59.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11227fc640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 msgr2=0x7f10f00084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11227fc640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 0x7f10f00084c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1124095910 tx=0x7f1118033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c007390 con 0x7f10f0006030 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: dump: 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.136 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c018070 con 0x7f10f0006030 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c0071f0 con 0x7f10f0006030 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11217fa640 4 set_mon_vals no callback set 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f11037fe640 10 monclient: dump: 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 5 monclient: authenticate success, global_id 154121 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 10 monclient: _renew_subs 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112409c4f0 con 0x7f10f0006030 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 10 monclient: _renew_subs 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.125+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11240959e0 con 0x7f10f0006030 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1129687640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1129687640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 0x7f1124139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f112406f6e0 con 0x7f1124139960 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 0x7f1124139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient: get_auth_request con 0x7f1124139960 auth_method 0 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f110c01d460 con 0x7f10f0006030 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 10 monclient(hunting): handle_auth_done global_id 134331 payload 824 2026-02-17T11:56:59.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f112409b9b0 con 0x7f1124139960 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11240a0750 0x7f10f00485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f110c051760 con 0x7f10f0006030 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f11237fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11240a0750 0x7f10f00485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.126+0000 7f11237fe640 10 monclient: get_auth_request con 0x7f11240a0750 auth_method 0 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 msgr2=0x7f1124139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 0x7f1124139d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1118009820 tx=0x7f1118041ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111803c040 con 0x7f1124139960 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 10 monclient: dump: 2026-02-17T11:56:59.141 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1118037e10 con 0x7f1124139960 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 msgr2=0x7f1124139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 0x7f1124139d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1118009820 tx=0x7f1118041ce0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 msgr2=0x7f1124139d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.128+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1124139960 0x7f1124139d40 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1118009820 tx=0x7f1118041ce0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.129+0000 7f11237fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11240a0750 0x7f10f00485a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1114010350 tx=0x7f1114009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1129687640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1129687640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 0x7f11241d3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1129687640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f112409dac0 con 0x7f112413a280 2026-02-17T11:56:59.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 0x7f11241d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1122ffd640 10 monclient: get_auth_request con 0x7f112413a280 auth_method 0 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1122ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1122ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.131+0000 7f1122ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.132+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.132+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.132+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.132+0000 7f1122ffd640 10 monclient(hunting): handle_auth_done global_id 134334 payload 824 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.132+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11240008d0 con 0x7f112413a280 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1122ffd640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 msgr2=0x7f11241d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1122ffd640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 0x7f11241d3880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f112406f860 tx=0x7f11180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118042cd0 con 0x7f112413a280 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 10 monclient: dump: 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f1118042cd0 con 0x7f112413a280 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 msgr2=0x7f11241d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 0x7f11241d3880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f112406f860 tx=0x7f11180047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 msgr2=0x7f11241d3880 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11037fe640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f112413a280 0x7f11241d3880 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f112406f860 tx=0x7f11180047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.148 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 119456, 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:59.149 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.150 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.151 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:59.152 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:59.153 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.154 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.156 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:59.157 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.158 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.159 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.161 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:59.162 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11240a0750 msgr2=0x7f10f00485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11240a0750 0x7f10f00485a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1114010350 tx=0x7f1114009040 comp rx=0 tx=0).stop 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 10 monclient: shutdown 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 msgr2=0x7f10f00084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 0x7f10f00084c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1124095910 tx=0x7f1118033000 comp rx=0 tx=0).stop 2026-02-17T11:56:59.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f11237fe640 1 -- 10.20.193.51:0/3379840139 reap_dead start 2026-02-17T11:56:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 shutdown_connections 2026-02-17T11:56:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 --2- 10.20.193.51:0/3379840139 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f10f0006030 0x7f10f00084c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 >> 10.20.193.51:0/3379840139 conn(0x7f11240a30c0 msgr2=0x7f1124072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 shutdown_connections 2026-02-17T11:56:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.134+0000 7f1129687640 1 -- 10.20.193.51:0/3379840139 wait complete. 2026-02-17T11:56:59.165 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:59.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:56:59.166 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 10 monclient: get_monmap_and_config 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 10 monclient: monmap: 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:59.231322+0000 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:59.231322+0000 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.235 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 1 Processor -- start 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 1 -- start start 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 10 monclient: init 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.230+0000 7f212bdd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-b con 0x7f21240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f212409dac0 addr v1:10.20.193.142:6789/0 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f21240a0110 0x7f212413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-a con 0x7f21240a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212406e140 con 0x7f212409dac0 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f212409aed0 con 0x7f21240a0110 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f212409caa0 con 0x7f21240a3bb0 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212bdd3640 10 monclient(hunting): authenticate will time out at 1306.850063s 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f21240a0110 0x7f212413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43088/0 (socket says 10.20.193.51:43088) 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 1 -- 10.20.193.51:0/3560736749 learned_addr learned my addr 10.20.193.51:0/3560736749 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): get_auth_request con 0x7f21240a3bb0 auth_method 0 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): get_auth_request con 0x7f21240a0110 auth_method 0 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient(hunting): handle_auth_done global_id 134337 payload 274 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 -- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 msgr2=0x7f212409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 -- 10.20.193.51:0/3560736749 >> v1:10.20.193.142:6789/0 conn(0x7f212409dac0 legacy=0x7f212409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 monclient: found mon.noname-a 2026-02-17T11:56:59.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f212a349640 1 -- 10.20.193.51:0/3560736749 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212409ce60 con 0x7f21240a0110 2026-02-17T11:56:59.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.231+0000 7f2129b48640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.233+0000 7f212a349640 1 -- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 msgr2=0x7f212413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.233+0000 7f212a349640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212413c760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f212406dc20 tx=0x7f212002f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd78854b711fa51 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 1 -- 10.20.193.51:0/3560736749 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212003c070 con 0x7f21240a0110 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: dump: 2026-02-17T11:56:59.249 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 1 -- 10.20.193.51:0/3560736749 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120037640 con 0x7f21240a0110 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 5 monclient: authenticate success, global_id 134337 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 1 -- 10.20.193.51:0/3560736749 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120037a10 con 0x7f21240a0110 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 4 set_mon_vals no callback set 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f2128b46640 10 monclient: dump: 2026-02-17T11:56:59.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 10 monclient: shutdown 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 -- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 msgr2=0x7f212413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212413c760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f212406dc20 tx=0x7f212002f1c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 -- 10.20.193.51:0/3560736749 shutdown_connections 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212413c760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 --2- 10.20.193.51:0/3560736749 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 -- 10.20.193.51:0/3560736749 >> 10.20.193.51:0/3560736749 conn(0x7f21240a30c0 msgr2=0x7f21240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 -- 10.20.193.51:0/3560736749 shutdown_connections 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 1 -- 10.20.193.51:0/3560736749 wait complete. 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.234+0000 7f212bdd3640 10 monclient: monmap: 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:59.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 Processor -- start 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 -- start start 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient: init 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f212409dac0 0x7f212412b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-b con 0x7f212409dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-a con 0x7f21240a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212412c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): picked mon.noname-c con 0x7f21240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f212409a880 con 0x7f21240a0110 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f21240a0520 con 0x7f212409dac0 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f212413cca0 con 0x7f21240a3bb0 2026-02-17T11:56:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212bdd3640 10 monclient(hunting): authenticate will time out at 1306.854343s 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52818/0 (socket says 10.20.193.51:52818) 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 -- 10.20.193.51:0/402326650 learned_addr learned my addr 10.20.193.51:0/402326650 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): get_auth_request con 0x7f21240a0110 auth_method 0 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212412c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): get_auth_request con 0x7f21240a3bb0 auth_method 0 2026-02-17T11:56:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient(hunting): handle_auth_done global_id 134340 payload 824 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 msgr2=0x7f212412c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212412c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f212409dac0 msgr2=0x7f212412b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f212409dac0 0x7f212412b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 monclient: found mon.noname-a 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f2129347640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212412d6a0 con 0x7f21240a0110 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.235+0000 7f212a349640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f212412c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f2129347640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 msgr2=0x7f212412bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f2129347640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f211800c600 tx=0x7f211800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118012a40 con 0x7f21240a0110 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: dump: 2026-02-17T11:56:59.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2118017070 con 0x7f21240a0110 2026-02-17T11:56:59.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118012e20 con 0x7f21240a0110 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f21127fc640 10 monclient: dump: 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.260 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f2113fff640 4 set_mon_vals no callback set 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 5 monclient: authenticate success, global_id 134340 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 10 monclient: _renew_subs 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212412f4d0 con 0x7f21240a0110 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 10 monclient: _renew_subs 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.237+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212409d7b0 con 0x7f21240a0110 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f212bdd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f212bdd3640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 0x7f21241cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f21240a3fc0 con 0x7f212412f0e0 2026-02-17T11:56:59.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 0x7f21241cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient: get_auth_request con 0x7f212412f0e0 auth_method 0 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 10 monclient(hunting): handle_auth_done global_id 154130 payload 824 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f2129b48640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f212409f4c0 con 0x7f212412f0e0 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f211801c460 con 0x7f21240a0110 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f21127fc640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd10 0x7f20f40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.238+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f2118052400 con 0x7f21240a0110 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.239+0000 7f212a349640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd10 0x7f20f40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.239+0000 7f212a349640 10 monclient: get_auth_request con 0x7f20f403dd10 auth_method 0 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f2129b48640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 msgr2=0x7f21241cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f2129b48640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 0x7f21241cce50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f211400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114017070 con 0x7f212412f0e0 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f21127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.240+0000 7f21127fc640 10 monclient: dump: 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.263 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f211400cb40 con 0x7f212412f0e0 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 msgr2=0x7f21241cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 0x7f21241cce50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f211400ece0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 msgr2=0x7f21241cce50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f21127fc640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f212412f0e0 0x7f21241cce50 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f211400ece0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.241+0000 7f212a349640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd10 0x7f20f40401d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2124069d60 tx=0x7f2120033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.243+0000 7f212bdd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.243+0000 7f212bdd3640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 0x7f21241d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.243+0000 7f212bdd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.243+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f212412ee70 con 0x7f21241cd390 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.243+0000 7f2129b48640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 0x7f21241d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient: get_auth_request con 0x7f21241cd390 auth_method 0 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 10 monclient(hunting): handle_auth_done global_id 154133 payload 824 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.244+0000 7f2129b48640 1 -- 10.20.193.51:0/402326650 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f21240a29c0 con 0x7f21241cd390 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f2129b48640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 msgr2=0x7f21241d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f2129b48640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 0x7f21241d81a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f21140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114017050 con 0x7f21241cd390 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 10 monclient: dump: 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f2114006890 con 0x7f21241cd390 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 msgr2=0x7f21241d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 0x7f21241d81a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f21140047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 msgr2=0x7f21241d81a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f21127fc640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21241cd390 0x7f21241d81a0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2114009730 tx=0x7f21140047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:59.267 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12126, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.268 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.269 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.270 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.271 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.272 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.273 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:59.274 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.275 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.276 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:59.277 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:59.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd10 msgr2=0x7f20f40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd10 0x7f20f40401d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2124069d60 tx=0x7f2120033000 comp rx=0 tx=0).stop 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 10 monclient: shutdown 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 msgr2=0x7f212412bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f211800c600 tx=0x7f211800cad0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212a349640 1 -- 10.20.193.51:0/402326650 reap_dead start 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 shutdown_connections 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 --2- 10.20.193.51:0/402326650 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0110 0x7f212412bbc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 >> 10.20.193.51:0/402326650 conn(0x7f21240a30c0 msgr2=0x7f212406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 shutdown_connections 2026-02-17T11:56:59.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.246+0000 7f212bdd3640 1 -- 10.20.193.51:0/402326650 wait complete. 2026-02-17T11:56:59.278 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:59.278 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:56:59.279 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:56:59.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: get_monmap_and_config 2026-02-17T11:56:59.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: monmap: 2026-02-17T11:56:59.348 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.348 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:59.345167+0000 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:59.345167+0000 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 Processor -- start 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 -- start start 2026-02-17T11:56:59.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: init 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f81100a3bb0 0x7f811009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-c con 0x7f81100a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f81100a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 0x7f811013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-b con 0x7f811013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f811006e140 con 0x7f81100a0750 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f811009f910 con 0x7f81100a3bb0 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f811009ccd0 con 0x7f811013b760 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f8115d6a640 10 monclient(hunting): authenticate will time out at 1306.963908s 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f810effd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f81100a0750 0x7f811009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46028/0 (socket says 10.20.193.51:46028) 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f810effd640 1 -- 10.20.193.51:0/1071793975 learned_addr learned my addr 10.20.193.51:0/1071793975 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.344+0000 7f810ffff640 1 --2- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 0x7f811013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810f7fe640 1 --2- 10.20.193.51:0/1071793975 >> v2:10.20.193.142:3300/0 conn(0x7f81100a3bb0 0x7f811009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): get_auth_request con 0x7f811013b760 auth_method 0 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810f7fe640 10 monclient(hunting): get_auth_request con 0x7f81100a3bb0 auth_method 0 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient(hunting): handle_auth_done global_id 154136 payload 274 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 1 -- 10.20.193.51:0/1071793975 >> v2:10.20.193.142:3300/0 conn(0x7f81100a3bb0 msgr2=0x7f811009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 1 --2- 10.20.193.51:0/1071793975 >> v2:10.20.193.142:3300/0 conn(0x7f81100a3bb0 0x7f811009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 1 -- 10.20.193.51:0/1071793975 >> v1:10.20.193.51:6789/0 conn(0x7f81100a0750 legacy=0x7f811009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 1 monclient: found mon.noname-b 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.345+0000 7f810ffff640 1 -- 10.20.193.51:0/1071793975 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811009eec0 con 0x7f811013b760 2026-02-17T11:56:59.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810ffff640 1 -- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 msgr2=0x7f811013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810ffff640 1 --2- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 0x7f811013db50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f811006c1c0 tx=0x7f810402f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3ac240ee67304a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 1 -- 10.20.193.51:0/1071793975 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810403c070 con 0x7f811013b760 2026-02-17T11:56:59.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: dump: 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 1 -- 10.20.193.51:0/1071793975 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8104037440 con 0x7f811013b760 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f8115d6a640 5 monclient: authenticate success, global_id 154136 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 1 -- 10.20.193.51:0/1071793975 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104037810 con 0x7f811013b760 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f8115d6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f8115d6a640 4 set_mon_vals no callback set 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.347+0000 7f810e7fc640 10 monclient: dump: 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 10 monclient: shutdown 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 msgr2=0x7f811013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 --2- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 0x7f811013db50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f811006c1c0 tx=0x7f810402f130 comp rx=0 tx=0).stop 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- 10.20.193.51:0/1071793975 shutdown_connections 2026-02-17T11:56:59.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 --2- 10.20.193.51:0/1071793975 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f811013b760 0x7f811013db50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 --2- 10.20.193.51:0/1071793975 >> v2:10.20.193.142:3300/0 conn(0x7f81100a3bb0 0x7f811009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- 10.20.193.51:0/1071793975 >> 10.20.193.51:0/1071793975 conn(0x7f81100a30c0 msgr2=0x7f81100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- 10.20.193.51:0/1071793975 shutdown_connections 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- 10.20.193.51:0/1071793975 wait complete. 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 10 monclient: monmap: 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 Processor -- start 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 1 -- start start 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.348+0000 7f8115d6a640 10 monclient: init 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100a0750 0x7f8110099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-b con 0x7f81100a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 0x7f8110091ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-c con 0x7f81100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 0x7f81100921e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): picked mon.noname-a con 0x7f811013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f81100a04b0 con 0x7f811013b760 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f811009c850 con 0x7f81100a0750 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f811009e710 con 0x7f81100a3bb0 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f8115d6a640 10 monclient(hunting): authenticate will time out at 1306.968261s 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 0x7f8110091ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 0x7f81100921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 0x7f8110091ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43140/0 (socket says 10.20.193.51:43140) 2026-02-17T11:56:59.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 1 -- 10.20.193.51:0/3210298741 learned_addr learned my addr 10.20.193.51:0/3210298741 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): get_auth_request con 0x7f81100a3bb0 auth_method 0 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): get_auth_request con 0x7f811013b760 auth_method 0 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient(hunting): handle_auth_done global_id 134343 payload 824 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100a0750 0x7f8110099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 msgr2=0x7f8110091ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 0x7f8110091ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100a0750 msgr2=0x7f8110099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100a0750 0x7f8110099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 monclient: found mon.noname-a 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100954d0 con 0x7f811013b760 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810f7fe640 10 monclient: get_auth_request con 0x7f81100a0750 auth_method 0 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810effd640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81100a3bb0 0x7f8110091ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:59.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.349+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100a0750 0x7f8110099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 msgr2=0x7f81100921e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f810ffff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 0x7f81100921e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f811009ce50 tx=0x7f8104004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810403c050 con 0x7f811013b760 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: dump: 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.368 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 5 monclient: authenticate success, global_id 134343 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810403d040 con 0x7f811013b760 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 10 monclient: _renew_subs 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8110094300 con 0x7f811013b760 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104041a20 con 0x7f811013b760 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f810dffb640 4 set_mon_vals no callback set 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f80ebfff640 10 monclient: dump: 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 10 monclient: _renew_subs 2026-02-17T11:56:59.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.351+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81100957b0 con 0x7f811013b760 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f8115d6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f8115d6a640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 0x7f811008e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8110092b00 con 0x7f8110092720 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 0x7f811008e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient: get_auth_request con 0x7f8110092720 auth_method 0 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8104041c00 con 0x7f811013b760 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f80ebfff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80e003dd10 0x7f80e00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 10 monclient(hunting): handle_auth_done global_id 114394 payload 824 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810f7fe640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81100a2500 con 0x7f8110092720 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f8104077eb0 con 0x7f811013b760 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.352+0000 7f810effd640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80e003dd10 0x7f80e00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.353+0000 7f810effd640 10 monclient: get_auth_request con 0x7f80e003dd10 auth_method 0 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f810f7fe640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 msgr2=0x7f811008e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 0x7f811008e570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc00fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc018020 con 0x7f8110092720 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 10 monclient: dump: 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.372 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f80fc003710 con 0x7f8110092720 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 msgr2=0x7f811008e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 0x7f811008e570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc00fa30 comp rx=0 tx=0).stop 2026-02-17T11:56:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 msgr2=0x7f811008e570 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f80ebfff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8110092720 0x7f811008e570 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc00fa30 comp rx=0 tx=0).stop 2026-02-17T11:56:59.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.355+0000 7f810effd640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80e003dd10 0x7f80e00401d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8100007e50 tx=0x7f8100007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f8115d6a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:56:59.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f8115d6a640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 0x7f8110063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f8115d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f811009dac0 con 0x7f81100638c0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 0x7f8110063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient: get_auth_request con 0x7f81100638c0 auth_method 0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 10 monclient(hunting): handle_auth_done global_id 114397 payload 824 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.358+0000 7f810f7fe640 1 -- 10.20.193.51:0/3210298741 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f81100937a0 con 0x7f81100638c0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f810f7fe640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 msgr2=0x7f8110063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f810f7fe640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 0x7f8110063cd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc018070 con 0x7f81100638c0 2026-02-17T11:56:59.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 10 monclient: dump: 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f80fc014480 con 0x7f81100638c0 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:56:59.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 msgr2=0x7f8110063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 0x7f8110063cd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 msgr2=0x7f8110063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f80ebfff640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f81100638c0 0x7f8110063cd0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00f560 tx=0x7f80fc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:56:59.378 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 100, 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 221236, 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.379 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.380 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:56:59.381 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:56:59.382 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.383 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.384 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:56:59.385 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.386 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.387 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:56:59.388 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:56:59.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80e003dd10 msgr2=0x7f80e00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f80e003dd10 0x7f80e00401d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8100007e50 tx=0x7f8100007da0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 10 monclient: shutdown 2026-02-17T11:56:59.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 msgr2=0x7f81100921e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 --2- 10.20.193.51:0/3210298741 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f811013b760 0x7f81100921e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f811009ce50 tx=0x7f8104004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 reap_dead start 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f810ffff640 1 -- 10.20.193.51:0/3210298741 reap_dead start 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 shutdown_connections 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 >> 10.20.193.51:0/3210298741 conn(0x7f81100a30c0 msgr2=0x7f811013ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 shutdown_connections 2026-02-17T11:56:59.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.361+0000 7f8115d6a640 1 -- 10.20.193.51:0/3210298741 wait complete. 2026-02-17T11:56:59.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:56:59.390 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T11:56:59.390 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:56:59.390 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T11:56:59.390 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:56:59.391 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:56:59.391 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:56:59.401 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:56:59.401 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:56:59.402 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.507+0000 7f61091f7640 10 monclient: get_monmap_and_config 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.507+0000 7f61091f7640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.507+0000 7f61091f7640 10 monclient: monmap: 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:56:59.508567+0000 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:56:59.508567+0000 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.507+0000 7f61091f7640 1 Processor -- start 2026-02-17T11:56:59.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 -- start start 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient: init 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f61040a3bb0 0x7f610409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-c con 0x7f61040a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-b con 0x7f61040a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 0x7f610413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-a con 0x7f610409e540 addr v2:10.20.193.51:3300/0 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f61040a3f90 con 0x7f610409e540 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f610406e140 con 0x7f61040a3bb0 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f610409f910 con 0x7f61040a0750 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f61091f7640 10 monclient(hunting): authenticate will time out at 1307.127315s 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6103577640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 msgr2=0x7f610413c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6103577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 0x7f610413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43176/0 (socket says 10.20.193.51:43176) 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 -- 10.20.193.51:0/2395761803 learned_addr learned my addr 10.20.193.51:0/2395761803 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:59.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): get_auth_request con 0x7f61040a0750 auth_method 0 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102d76640 1 --2- 10.20.193.51:0/2395761803 >> v2:10.20.193.142:3300/0 conn(0x7f61040a3bb0 0x7f610409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102d76640 10 monclient(hunting): get_auth_request con 0x7f61040a3bb0 auth_method 0 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient(hunting): handle_auth_done global_id 154142 payload 274 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 -- 10.20.193.51:0/2395761803 >> v2:10.20.193.142:3300/0 conn(0x7f61040a3bb0 msgr2=0x7f610409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 --2- 10.20.193.51:0/2395761803 >> v2:10.20.193.142:3300/0 conn(0x7f61040a3bb0 0x7f610409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 -- 10.20.193.51:0/2395761803 >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 msgr2=0x7f610413c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 --2- 10.20.193.51:0/2395761803 >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 0x7f610413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 monclient: found mon.noname-b 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.508+0000 7f6102575640 1 -- 10.20.193.51:0/2395761803 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610409ccd0 con 0x7f61040a0750 2026-02-17T11:56:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6102575640 1 -- 10.20.193.51:0/2395761803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 msgr2=0x7f610409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6102575640 1 --2- 10.20.193.51:0/2395761803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f610406c1c0 tx=0x7f60ec02ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02af64ae8775b2b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 1 -- 10.20.193.51:0/2395761803 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec03c070 con 0x7f61040a0750 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: dump: 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.525 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 1 -- 10.20.193.51:0/2395761803 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ec02fcc0 con 0x7f61040a0750 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 5 monclient: authenticate success, global_id 154142 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 1 -- 10.20.193.51:0/2395761803 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec037660 con 0x7f61040a0750 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 4 set_mon_vals no callback set 2026-02-17T11:56:59.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f6101d74640 10 monclient: dump: 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.527 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 10 monclient: shutdown 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 -- 10.20.193.51:0/2395761803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 msgr2=0x7f610409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 --2- 10.20.193.51:0/2395761803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f610406c1c0 tx=0x7f60ec02ee80 comp rx=0 tx=0).stop 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 -- 10.20.193.51:0/2395761803 shutdown_connections 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 --2- 10.20.193.51:0/2395761803 >> v2:10.20.193.51:3300/0 conn(0x7f610409e540 0x7f610413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 --2- 10.20.193.51:0/2395761803 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a0750 0x7f610409e000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 --2- 10.20.193.51:0/2395761803 >> v2:10.20.193.142:3300/0 conn(0x7f61040a3bb0 0x7f610409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 -- 10.20.193.51:0/2395761803 >> 10.20.193.51:0/2395761803 conn(0x7f61040a30c0 msgr2=0x7f61040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 -- 10.20.193.51:0/2395761803 shutdown_connections 2026-02-17T11:56:59.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.511+0000 7f61091f7640 1 -- 10.20.193.51:0/2395761803 wait complete. 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient: build_initial_monmap 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient: monmap: 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 Processor -- start 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 -- start start 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient: init 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 0x7f610413bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-a con 0x7f610409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f61040a0750 0x7f610408d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-b con 0x7f61040a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): picked mon.noname-c con 0x7f61040a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f61040a04b0 con 0x7f610409e540 2026-02-17T11:56:59.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f610409c850 con 0x7f61040a0750 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f610413cca0 con 0x7f61040a3bb0 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f61091f7640 10 monclient(hunting): authenticate will time out at 1307.131700s 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6102d76640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 msgr2=0x7f610413bef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6102d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 0x7f610413bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43192/0 (socket says 10.20.193.51:43192) 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 -- 10.20.193.51:0/1175013038 learned_addr learned my addr 10.20.193.51:0/1175013038 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): get_auth_request con 0x7f61040a3bb0 auth_method 0 2026-02-17T11:56:59.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient(hunting): handle_auth_done global_id 154145 payload 824 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 -- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f61040a0750 msgr2=0x7f610408d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6102575640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f61040a0750 0x7f610408d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f61040a0750 0x7f610408d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 -- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 msgr2=0x7f610413bef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 0x7f610413bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient: _finish_hunting 0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 monclient: found mon.noname-c 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.512+0000 7f6103577640 1 -- 10.20.193.51:0/1175013038 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610409d7b0 con 0x7f61040a3bb0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f6103577640 1 -- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 msgr2=0x7f610408de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f6103577640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f60f400be60 tx=0x7f60f400bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4006e60 con 0x7f61040a3bb0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: dump: 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.533 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f4010030 con 0x7f61040a3bb0 2026-02-17T11:56:59.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 5 monclient: authenticate success, global_id 154145 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _renew_subs 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61040901e0 con 0x7f61040a3bb0 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f40168b0 con 0x7f61040a3bb0 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f6101573640 4 set_mon_vals no callback set 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 10 monclient: dump: 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.535 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _renew_subs 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f610408e350 con 0x7f61040a3bb0 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610409dac0 con 0x7f61040a3bb0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.515+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f60f4008070 con 0x7f61040a3bb0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.516+0000 7f60e37fe640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 0x7f60d00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.516+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f60f4052570 con 0x7f61040a3bb0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.516+0000 7f6102d76640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 0x7f60d00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.516+0000 7f6102d76640 10 monclient: get_auth_request con 0x7f60d003dd10 auth_method 0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.518+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f60f4012d50 con 0x7f61040a3bb0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.518+0000 7f60e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.518+0000 7f60e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:59.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.518+0000 7f6102d76640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 0x7f60d00401d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009180 tx=0x7f60f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:59.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f61091f7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f61091f7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f61091f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f610408e5e0 con 0x7f61040a3bb0 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f60e37fe640 1 -- 10.20.193.51:0/1175013038 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f60f4012670 con 0x7f61040a3bb0 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f60e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:56:59.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.633+0000 7f60e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:59.637 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 msgr2=0x7f60d00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 0x7f60d00401d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009180 tx=0x7f60f8008040 comp rx=0 tx=0).stop 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 10 monclient: shutdown 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 msgr2=0x7f610408de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f60f400be60 tx=0x7f60f400bf60 comp rx=0 tx=0).stop 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 shutdown_connections 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f60d003dd10 0x7f60d00401d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61040a3bb0 0x7f610408de10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f61040a0750 0x7f610408d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 --2- 10.20.193.51:0/1175013038 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f610409e540 0x7f610413bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 >> 10.20.193.51:0/1175013038 conn(0x7f61040a30c0 msgr2=0x7f6104072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 shutdown_connections 2026-02-17T11:56:59.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:56:59.634+0000 7f61091f7640 1 -- 10.20.193.51:0/1175013038 wait complete. 2026-02-17T11:57:02.644 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: get_monmap_and_config 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: build_initial_monmap 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: monmap: 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:02.712279+0000 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:02.712279+0000 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:02.713 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 1 Processor -- start 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 1 -- start start 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: init 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cf40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.711+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0cf40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0cf413b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf406e140 con 0x7f0cf40a0750 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf409f910 con 0x7f0cf413b760 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf409ccd0 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cfb26c640 10 monclient(hunting): authenticate will time out at 1310.331033s 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cebfff640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f0cf40a0750 legacy=0x7f0cf409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43202/0 (socket says 10.20.193.51:43202) 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/2813179739 learned_addr learned my addr 10.20.193.51:0/2813179739 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): get_auth_request con 0x7f0cf40a3bb0 auth_method 0 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:02.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_done global_id 154148 payload 274 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/2813179739 >> v1:10.20.193.142:6789/0 conn(0x7f0cf413b760 legacy=0x7f0cf413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/2813179739 >> v1:10.20.193.51:6789/0 conn(0x7f0cf40a0750 legacy=0x7f0cf409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient: _finish_hunting 0 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 monclient: found mon.noname-b 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.712+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/2813179739 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf409eec0 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/2813179739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 msgr2=0x7f0cf409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0cf8fe1640 1 --2- 10.20.193.51:0/2813179739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cf409f230 tx=0x7f0ce40333c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9bca68899eb7e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 1 -- 10.20.193.51:0/2813179739 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4040070 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: dump: 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.716 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 1 -- 10.20.193.51:0/2813179739 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce403b640 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0cfb26c640 5 monclient: authenticate success, global_id 154148 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0cfb26c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0ceb7fe640 1 -- 10.20.193.51:0/2813179739 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce403ba10 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.714+0000 7f0cfb26c640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 4 set_mon_vals no callback set 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0ceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0ceb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0ceb7fe640 10 monclient: dump: 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:02.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 10 monclient: shutdown 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 -- 10.20.193.51:0/2813179739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 msgr2=0x7f0cf409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/2813179739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cf409f230 tx=0x7f0ce40333c0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 -- 10.20.193.51:0/2813179739 shutdown_connections 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/2813179739 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a3bb0 0x7f0cf409dac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 -- 10.20.193.51:0/2813179739 >> 10.20.193.51:0/2813179739 conn(0x7f0cf40a30c0 msgr2=0x7f0cf40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 -- 10.20.193.51:0/2813179739 shutdown_connections 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 1 -- 10.20.193.51:0/2813179739 wait complete. 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 10 monclient: build_initial_monmap 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.715+0000 7f0cfb26c640 10 monclient: monmap: 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 Processor -- start 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 -- start start 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient: init 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-c con 0x7f0cf40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 0x7f0cf41cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cf40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 0x7f0cf406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): picked mon.noname-a con 0x7f0cf413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:02.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf409e710 con 0x7f0cf413b760 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40a04b0 con 0x7f0cf40a3bb0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf409e890 con 0x7f0cf40a0750 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cfb26c640 10 monclient(hunting): authenticate will time out at 1310.335383s 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf97e2640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 msgr2=0x7f0cf406fe00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf97e2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 0x7f0cf406fe00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43204/0 (socket says 10.20.193.51:43204) 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/65450230 learned_addr learned my addr 10.20.193.51:0/65450230 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): get_auth_request con 0x7f0cf40a0750 auth_method 0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient(hunting): handle_auth_done global_id 154151 payload 824 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cebfff640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 0x7f0cf41cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 msgr2=0x7f0cf41cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 0x7f0cf41cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 msgr2=0x7f0cf406fe00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 0x7f0cf406fe00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient: _finish_hunting 0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 monclient: found mon.noname-c 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/65450230 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf4074120 con 0x7f0cf40a0750 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cebfff640 10 monclient: get_auth_request con 0x7f0cf40a3bb0 auth_method 0 2026-02-17T11:57:02.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.716+0000 7f0cebfff640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 0x7f0cf41cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cf8fe1640 1 -- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 msgr2=0x7f0cf41cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cf8fe1640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40098f0 tx=0x7f0ce40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce404a020 con 0x7f0cf40a0750 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: dump: 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: _finish_auth 0 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:02.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce4038ae0 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4040040 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ceaffd640 4 set_mon_vals no callback set 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0ce97fa640 10 monclient: dump: 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 5 monclient: authenticate success, global_id 154151 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 10 monclient: _renew_subs 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf4073a20 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 10 monclient: _renew_subs 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.718+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf409a850 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0cfb26c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0cfb26c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0cfb26c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf409e420 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0ce4043030 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0ce97fa640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 0x7f0cc40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f0ce407bbd0 con 0x7f0cf40a0750 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.719+0000 7f0cebfff640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 0x7f0cc40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:02.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.720+0000 7f0cebfff640 10 monclient: get_auth_request con 0x7f0cc403dd10 auth_method 0 2026-02-17T11:57:02.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.722+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0cf409e420 con 0x7f0cf40a0750 2026-02-17T11:57:02.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.722+0000 7f0ce97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:02.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.722+0000 7f0ce97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:02.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.722+0000 7f0cebfff640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 0x7f0cc40401d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4071610 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:02.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0cfb26c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:02.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0cfb26c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:02.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0cfb26c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:02.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0cf409d7b0 con 0x7f0cf40a0750 2026-02-17T11:57:02.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0ce97fa640 1 -- 10.20.193.51:0/65450230 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f0ce4054070 con 0x7f0cf40a0750 2026-02-17T11:57:02.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0ce97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:02.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.836+0000 7f0ce97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:02.839 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:02.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 msgr2=0x7f0cc40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 0x7f0cc40401d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4071610 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 10 monclient: shutdown 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 msgr2=0x7f0cf41cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40098f0 tx=0x7f0ce40047c0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 shutdown_connections 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0cc403dd10 0x7f0cc40401d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0cf413b760 0x7f0cf406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0cf40a3bb0 0x7f0cf41cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 --2- 10.20.193.51:0/65450230 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0cf40a0750 0x7f0cf41cba90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 >> 10.20.193.51:0/65450230 conn(0x7f0cf40a30c0 msgr2=0x7f0cf4099840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:02.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 shutdown_connections 2026-02-17T11:57:02.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:02.837+0000 7f0cfb26c640 1 -- 10.20.193.51:0/65450230 wait complete. 2026-02-17T11:57:05.847 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:05.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: get_monmap_and_config 2026-02-17T11:57:05.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: build_initial_monmap 2026-02-17T11:57:05.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: monmap: 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:05.916299+0000 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:05.916299+0000 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:05.920 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 1 Processor -- start 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 1 -- start start 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: init 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.915+0000 7f71657a9640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 0x7f716009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-a con 0x7f71600a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f71600a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:05.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f716013b760 0x7f716013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-c con 0x7f716013b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716006e140 con 0x7f71600a0750 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f716009f910 con 0x7f71600a3bb0 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f716009ccd0 con 0x7f716013b760 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f71657a9640 10 monclient(hunting): authenticate will time out at 1313.535051s 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715effd640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 msgr2=0x7f716009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715effd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 0x7f716009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715e7fc640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f71600a0750 0x7f716009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:34966/0 (socket says 10.20.193.51:34966) 2026-02-17T11:57:05.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715e7fc640 1 -- 10.20.193.51:0/956148033 learned_addr learned my addr 10.20.193.51:0/956148033 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 --2- 10.20.193.51:0/956148033 >> v2:10.20.193.142:3300/0 conn(0x7f716013b760 0x7f716013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): get_auth_request con 0x7f716013b760 auth_method 0 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient(hunting): handle_auth_done global_id 114403 payload 274 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 -- 10.20.193.51:0/956148033 >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 msgr2=0x7f716009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 --2- 10.20.193.51:0/956148033 >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 0x7f716009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 -- 10.20.193.51:0/956148033 >> v1:10.20.193.142:6789/0 conn(0x7f71600a0750 legacy=0x7f716009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:05.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:57:05.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:57:05.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:05.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:57:05.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.916+0000 7f715f7fe640 1 -- 10.20.193.51:0/956148033 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716009eec0 con 0x7f716013b760 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715f7fe640 1 -- 10.20.193.51:0/956148033 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f716013b760 msgr2=0x7f716013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715f7fe640 1 --2- 10.20.193.51:0/956148033 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f716013b760 0x7f716013db50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f716009f5f0 tx=0x7f715002f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bfffd4096acdd6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 1 -- 10.20.193.51:0/956148033 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715003c070 con 0x7f716013b760 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: dump: 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.932 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 5 monclient: authenticate success, global_id 114403 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:05.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 1 -- 10.20.193.51:0/956148033 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7150037640 con 0x7f716013b760 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 1 -- 10.20.193.51:0/956148033 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150037a10 con 0x7f716013b760 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f715dffb640 10 monclient: dump: 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 4 set_mon_vals no callback set 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 10 monclient: shutdown 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 -- 10.20.193.51:0/956148033 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f716013b760 msgr2=0x7f716013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 --2- 10.20.193.51:0/956148033 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f716013b760 0x7f716013db50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f716009f5f0 tx=0x7f715002f150 comp rx=0 tx=0).stop 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 -- 10.20.193.51:0/956148033 shutdown_connections 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 --2- 10.20.193.51:0/956148033 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f716013b760 0x7f716013db50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 --2- 10.20.193.51:0/956148033 >> v2:10.20.193.51:3300/0 conn(0x7f71600a3bb0 0x7f716009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.919+0000 7f71657a9640 1 -- 10.20.193.51:0/956148033 >> 10.20.193.51:0/956148033 conn(0x7f71600a30c0 msgr2=0x7f71600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- 10.20.193.51:0/956148033 shutdown_connections 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- 10.20.193.51:0/956148033 wait complete. 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient: build_initial_monmap 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient: monmap: 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:05.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 Processor -- start 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- start start 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient: init 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71600a0750 0x7f71600908f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-b con 0x7f71600a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:05.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-c con 0x7f71600a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 0x7f7160091370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): picked mon.noname-a con 0x7f716013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71600a04b0 con 0x7f716013b760 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f716009c850 con 0x7f71600a0750 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f716009e710 con 0x7f71600a3bb0 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f71657a9640 10 monclient(hunting): authenticate will time out at 1313.539918s 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f715f7fe640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 msgr2=0x7f7160091370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:05.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.920+0000 7f715f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 0x7f7160091370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:50692/0 (socket says 10.20.193.51:50692) 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 -- 10.20.193.51:0/16063898 learned_addr learned my addr 10.20.193.51:0/16063898 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): get_auth_request con 0x7f71600a3bb0 auth_method 0 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715effd640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71600a0750 0x7f71600908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715effd640 10 monclient(hunting): get_auth_request con 0x7f71600a0750 auth_method 0 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient(hunting): handle_auth_done global_id 154154 payload 824 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 -- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71600a0750 msgr2=0x7f71600908f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71600a0750 0x7f71600908f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 -- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 msgr2=0x7f7160091370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 0x7f7160091370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:05.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.921+0000 7f715e7fc640 1 -- 10.20.193.51:0/16063898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71600945a0 con 0x7f71600a3bb0 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f715e7fc640 1 -- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 msgr2=0x7f7160090e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f715e7fc640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f714800b530 tx=0x7f714800ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714800fa60 con 0x7f71600a3bb0 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: dump: 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 5 monclient: authenticate success, global_id 154154 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714800fc00 con 0x7f71600a3bb0 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 10 monclient: _renew_subs 2026-02-17T11:57:05.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71600929d0 con 0x7f71600a3bb0 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148017400 con 0x7f71600a3bb0 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f715d7fa640 4 set_mon_vals no callback set 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f713f7fe640 10 monclient: dump: 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:05.943 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 10 monclient: _renew_subs 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.923+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f716006f5a0 con 0x7f71600a3bb0 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f71657a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f71657a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f71657a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716009dac0 con 0x7f71600a3bb0 2026-02-17T11:57:05.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f71480048e0 con 0x7f71600a3bb0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f713f7fe640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 0x7f712c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(413..413 src has 167..413) ==== 4735+0+0 (secure 0 0 0) 0x7f7148052790 con 0x7f71600a3bb0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f715effd640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 0x7f712c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.924+0000 7f715effd640 10 monclient: get_auth_request con 0x7f712c03dcc0 auth_method 0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.926+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7148013030 con 0x7f71600a3bb0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.926+0000 7f713f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.926+0000 7f713f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:05.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:05.927+0000 7f715effd640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 0x7f712c040180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7154003a80 tx=0x7f7154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f71657a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f71657a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f71657a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f71600008d0 con 0x7f71600a3bb0 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f713f7fe640 1 -- 10.20.193.51:0/16063898 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f7148004de0 con 0x7f71600a3bb0 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f713f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:06.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.043+0000 7f713f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:06.047 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:06.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 msgr2=0x7f712c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:06.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 0x7f712c040180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7154003a80 tx=0x7f7154008040 comp rx=0 tx=0).stop 2026-02-17T11:57:06.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 10 monclient: shutdown 2026-02-17T11:57:06.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:06.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 msgr2=0x7f7160090e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f714800b530 tx=0x7f714800ba00 comp rx=0 tx=0).stop 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 shutdown_connections 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f712c03dcc0 0x7f712c040180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f716013b760 0x7f7160091370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71600a3bb0 0x7f7160090e30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 --2- 10.20.193.51:0/16063898 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71600a0750 0x7f71600908f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 >> 10.20.193.51:0/16063898 conn(0x7f71600a30c0 msgr2=0x7f716013acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 shutdown_connections 2026-02-17T11:57:06.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:06.044+0000 7f71657a9640 1 -- 10.20.193.51:0/16063898 wait complete. 2026-02-17T11:57:09.055 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:09.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.122+0000 7fd36fa29640 10 monclient: get_monmap_and_config 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.122+0000 7fd36fa29640 10 monclient: build_initial_monmap 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient: monmap: 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:09.123968+0000 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:09.123968+0000 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:09.127 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 Processor -- start 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 -- start start 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient: init 2026-02-17T11:57:09.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-a con 0x7fd3680a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd3680a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-b con 0x7fd36813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36806e140 con 0x7fd3680a0750 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd36809f910 con 0x7fd3680a3bb0 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd36809ccd0 con 0x7fd36813b760 2026-02-17T11:57:09.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36fa29640 10 monclient(hunting): authenticate will time out at 1316.742734s 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36d79e640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 msgr2=0x7fd36809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36d79e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:50708/0 (socket says 10.20.193.51:50708) 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 learned_addr learned my addr 10.20.193.51:0/3764632075 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 10 monclient(hunting): get_auth_request con 0x7fd36813b760 auth_method 0 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:09.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:09.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:09.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.123+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:09.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.126+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.142:6789/0 conn(0x7fd3680a0750 legacy=0x7fd36809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:09.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 msgr2=0x7fd36809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 10 monclient(hunting): get_auth_request con 0x7fd36813b760 auth_method 0 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:09.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.324+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:09.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 msgr2=0x7fd36809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 10 monclient(hunting): get_auth_request con 0x7fd36813b760 auth_method 0 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:09.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:09.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:09.725+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:10.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 msgr2=0x7fd36809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 10 monclient(hunting): get_auth_request con 0x7fd36813b760 auth_method 0 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:10.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:10.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:10.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:10.526+0000 7fd36df9f640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:12.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): tick 2026-02-17T11:57:12.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:57:12.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 monclient(hunting): continuing hunt 2026-02-17T11:57:12.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 msgr2=0x7fd36813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd36813b760 0x7fd36813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 msgr2=0x7fd36809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.51:3300/0 conn(0x7fd3680a3bb0 0x7fd36809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.142:6789/0 conn(0x7fd3680a0750 legacy=0x7fd36809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient: _add_conns ranks=[0,4] 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd34c003840 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fd34c007570 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36809eec0 con 0x7fd34c003840 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:12.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd36809f910 con 0x7fd34c007570 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd356ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.123+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c003840 legacy=0x7fd34c005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c007570 auth_method 0 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:12.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.124+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:12.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.324+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c003840 legacy=0x7fd34c005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:12.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:12.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c007570 auth_method 0 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:12.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.325+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:12.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.725+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c003840 legacy=0x7fd34c005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:12.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:12.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c007570 auth_method 0 2026-02-17T11:57:12.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:12.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:12.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:12.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:12.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:12.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:12.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:12.726+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:13.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.526+0000 7fd36d79e640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c003840 legacy=0x7fd34c005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:13.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.526+0000 7fd357fff640 1 -- 10.20.193.51:0/3764632075 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c007570 auth_method 0 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:13.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:13.527+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:13.863 INFO:tasks.rados.rados.0.trial142.stdout:1763: done (0 left) 2026-02-17T11:57:13.863 INFO:tasks.rados.rados.0.trial142.stdout:1764: delete oid 32 current snap is 195 2026-02-17T11:57:13.866 INFO:tasks.rados.rados.0.trial142.stdout:1764: done (0 left) 2026-02-17T11:57:13.866 INFO:tasks.rados.rados.0.trial142.stdout:1765: rollback oid 40 current snap is 195 2026-02-17T11:57:13.867 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 188 2026-02-17T11:57:13.867 INFO:tasks.rados.rados.0.trial142.stdout:1766: read oid 2 snap -1 2026-02-17T11:57:13.867 INFO:tasks.rados.rados.0.trial142.stdout:1766: expect (ObjNum 536 snap 165 seq_num 536) 2026-02-17T11:57:13.867 INFO:tasks.rados.rados.0.trial142.stdout:1767: write (excl) oid 10 current snap is 195 2026-02-17T11:57:13.867 INFO:tasks.rados.rados.0.trial142.stdout:1767: seq_num 624 ranges {487568=496322,1431705=519550} 2026-02-17T11:57:13.870 INFO:tasks.rados.rados.0.trial142.stdout:1767: writing trial14245205-10 from 487568 to 983890 tid 1 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:1767: writing trial14245205-10 from 1431705 to 1951255 tid 2 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:1768: snap_create 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:1765: finishing rollback tid 0 to trial14245205-40 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:1765: finishing rollback tid 1 to trial14245205-40 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:1765: finishing rollback tid 2 to trial14245205-40 2026-02-17T11:57:13.874 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 717 (ObjNum 601 snap 187 seq_num 601) dirty exists 2026-02-17T11:57:13.875 INFO:tasks.rados.rados.0.trial142.stdout:1767: finishing write tid 1 to trial14245205-10 2026-02-17T11:57:13.875 INFO:tasks.rados.rados.0.trial142.stdout:1766: expect (ObjNum 536 snap 165 seq_num 536) 2026-02-17T11:57:14.030 INFO:tasks.rados.rados.0.trial142.stdout:1767: finishing write tid 2 to trial14245205-10 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: finishing write tid 3 to trial14245205-10 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: finishing write tid 4 to trial14245205-10 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: oid 10 updating version 0 to 980 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: oid 10 version 980 is already newer than 979 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: oid 10 version 980 is already newer than 978 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 980 (ObjNum 624 snap 195 seq_num 624) dirty exists 2026-02-17T11:57:14.031 INFO:tasks.rados.rados.0.trial142.stdout:1767: left oid 10 (ObjNum 624 snap 195 seq_num 624) 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1765: done (3 left) 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1766: done (2 left) 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1767: done (1 left) 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1768: done (0 left) 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1769: read oid 1 snap -1 2026-02-17T11:57:14.631 INFO:tasks.rados.rados.0.trial142.stdout:1769: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:14.632 INFO:tasks.rados.rados.0.trial142.stdout:1770: delete oid 27 current snap is 196 2026-02-17T11:57:14.634 INFO:tasks.rados.rados.0.trial142.stdout:1770: done (1 left) 2026-02-17T11:57:14.634 INFO:tasks.rados.rados.0.trial142.stdout:1771: rollback oid 28 current snap is 196 2026-02-17T11:57:14.634 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 195 2026-02-17T11:57:14.634 INFO:tasks.rados.rados.0.trial142.stdout:1772: write (excl) oid 31 current snap is 196 2026-02-17T11:57:14.634 INFO:tasks.rados.rados.0.trial142.stdout:1772: seq_num 626 ranges {521182=646820,1948669=523219} 2026-02-17T11:57:14.638 INFO:tasks.rados.rados.0.trial142.stdout:1772: writing trial14245205-31 from 521182 to 1168002 tid 1 2026-02-17T11:57:14.644 INFO:tasks.rados.rados.0.trial142.stdout:1772: writing trial14245205-31 from 1948669 to 2471888 tid 2 2026-02-17T11:57:14.644 INFO:tasks.rados.rados.0.trial142.stdout:1773: read oid 8 snap -1 2026-02-17T11:57:14.644 INFO:tasks.rados.rados.0.trial142.stdout:1773: expect deleted 2026-02-17T11:57:14.644 INFO:tasks.rados.rados.0.trial142.stdout:1774: read oid 3 snap -1 2026-02-17T11:57:14.645 INFO:tasks.rados.rados.0.trial142.stdout:1774: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:57:14.645 INFO:tasks.rados.rados.0.trial142.stdout:1775: write oid 33 current snap is 196 2026-02-17T11:57:14.645 INFO:tasks.rados.rados.0.trial142.stdout:1769: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:14.690 INFO:tasks.rados.rados.0.trial142.stdout:1771: finishing rollback tid 0 to trial14245205-28 2026-02-17T11:57:14.691 INFO:tasks.rados.rados.0.trial142.stdout:1771: finishing rollback tid 1 to trial14245205-28 2026-02-17T11:57:14.691 INFO:tasks.rados.rados.0.trial142.stdout:1771: finishing rollback tid 2 to trial14245205-28 2026-02-17T11:57:14.691 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 1014 (ObjNum 566 snap 172 seq_num 566) dirty exists 2026-02-17T11:57:14.691 INFO:tasks.rados.rados.0.trial142.stdout:1772: finishing write tid 1 to trial14245205-31 2026-02-17T11:57:14.691 INFO:tasks.rados.rados.0.trial142.stdout:1775: seq_num 627 ranges {537989=722069,1890798=647191} 2026-02-17T11:57:14.695 INFO:tasks.rados.rados.0.trial142.stdout:1775: writing trial14245205-33 from 537989 to 1260058 tid 1 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1775: writing trial14245205-33 from 1890798 to 2537989 tid 2 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1769: done (5 left) 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1771: done (4 left) 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1776: snap_create 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1772: finishing write tid 2 to trial14245205-31 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1772: finishing write tid 3 to trial14245205-31 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1772: finishing write tid 4 to trial14245205-31 2026-02-17T11:57:14.701 INFO:tasks.rados.rados.0.trial142.stdout:1772: oid 31 updating version 0 to 1065 2026-02-17T11:57:14.702 INFO:tasks.rados.rados.0.trial142.stdout:1772: oid 31 updating version 1065 to 1066 2026-02-17T11:57:14.702 INFO:tasks.rados.rados.0.trial142.stdout:1772: oid 31 updating version 1066 to 1067 2026-02-17T11:57:14.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1067 (ObjNum 626 snap 196 seq_num 626) dirty exists 2026-02-17T11:57:14.702 INFO:tasks.rados.rados.0.trial142.stdout:1772: left oid 31 (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:57:14.702 INFO:tasks.rados.rados.0.trial142.stdout:1774: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:57:14.780 INFO:tasks.rados.rados.0.trial142.stdout:1775: finishing write tid 1 to trial14245205-33 2026-02-17T11:57:14.780 INFO:tasks.rados.rados.0.trial142.stdout:1775: finishing write tid 2 to trial14245205-33 2026-02-17T11:57:14.780 INFO:tasks.rados.rados.0.trial142.stdout:1775: finishing write tid 3 to trial14245205-33 2026-02-17T11:57:14.780 INFO:tasks.rados.rados.0.trial142.stdout:1775: finishing write tid 4 to trial14245205-33 2026-02-17T11:57:14.780 INFO:tasks.rados.rados.0.trial142.stdout:1775: oid 33 updating version 0 to 1071 2026-02-17T11:57:14.781 INFO:tasks.rados.rados.0.trial142.stdout:1775: oid 33 version 1071 is already newer than 1069 2026-02-17T11:57:14.781 INFO:tasks.rados.rados.0.trial142.stdout:1775: oid 33 version 1071 is already newer than 1070 2026-02-17T11:57:14.781 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1071 (ObjNum 627 snap 196 seq_num 627) dirty exists 2026-02-17T11:57:14.781 INFO:tasks.rados.rados.0.trial142.stdout:1775: left oid 33 (ObjNum 627 snap 196 seq_num 627) 2026-02-17T11:57:15.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): tick 2026-02-17T11:57:15.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:57:15.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 monclient(hunting): continuing hunt 2026-02-17T11:57:15.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 msgr2=0x7fd34c009a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c007570 0x7fd34c009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c003840 legacy=0x7fd34c005ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 reap_dead start 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd34c006470 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c009ad0 0x7fd34c006f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fd34c009ad0 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd34c005e30 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:15.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34c00b1c0 con 0x7fd34c005e30 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36809eec0 con 0x7fd34c006470 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 1 -- 10.20.193.51:0/3764632075 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd36809f910 con 0x7fd34c009ad0 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd356ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36df9f640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c005e30 legacy=0x7fd34c00d600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> v2:10.20.193.142:3300/0 conn(0x7fd34c009ad0 0x7fd34c006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c009ad0 auth_method 0 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient(hunting): handle_auth_done global_id 114409 payload 274 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.142:6789/0 conn(0x7fd34c006470 legacy=0x7fd34c006850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> v1:10.20.193.51:6789/0 conn(0x7fd34c005e30 legacy=0x7fd34c00d600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:57:15.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.124+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c010de0 con 0x7fd34c009ad0 2026-02-17T11:57:15.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd36cf9d640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c009ad0 msgr2=0x7fd34c006f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c009ad0 0x7fd34c006f60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd36806e310 tx=0x7fd35c02f9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3ae1bc1e89791f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 1 -- 10.20.193.51:0/3764632075 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c038400 con 0x7fd34c009ad0 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: dump: 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.141 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 1 -- 10.20.193.51:0/3764632075 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0385a0 con 0x7fd34c009ad0 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 1 -- 10.20.193.51:0/3764632075 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c038790 con 0x7fd34c009ad0 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd357fff640 10 monclient: dump: 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd36fa29640 5 monclient: authenticate success, global_id 114409 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd36fa29640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.127+0000 7fd36fa29640 4 set_mon_vals no callback set 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 10 monclient: shutdown 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 -- 10.20.193.51:0/3764632075 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c009ad0 msgr2=0x7fd34c006f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c009ad0 0x7fd34c006f60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd36806e310 tx=0x7fd35c02f9c0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 -- 10.20.193.51:0/3764632075 shutdown_connections 2026-02-17T11:57:15.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3764632075 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c009ad0 0x7fd34c006f60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 -- 10.20.193.51:0/3764632075 >> 10.20.193.51:0/3764632075 conn(0x7fd3680a30c0 msgr2=0x7fd3680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 -- 10.20.193.51:0/3764632075 shutdown_connections 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 1 -- 10.20.193.51:0/3764632075 wait complete. 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.128+0000 7fd36fa29640 10 monclient: monmap: 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.145 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 Processor -- start 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 -- start start 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient: init 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-c con 0x7fd34c005e30 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c006470 0x7fd3680965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-b con 0x7fd34c006470 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 0x7fd368096b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): picked mon.noname-a con 0x7fd34c009ad0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680a04b0 con 0x7fd34c009ad0 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd36809c850 con 0x7fd34c006470 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd36809dac0 con 0x7fd34c005e30 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36fa29640 10 monclient(hunting): authenticate will time out at 1322.748815s 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36df9f640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 msgr2=0x7fd368096b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36df9f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 0x7fd368096b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38018/0 (socket says 10.20.193.51:38018) 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 1 -- 10.20.193.51:0/3670727152 learned_addr learned my addr 10.20.193.51:0/3670727152 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): get_auth_request con 0x7fd34c005e30 auth_method 0 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36d79e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.129+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c006470 0x7fd3680965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request con 0x7fd34c006470 auth_method 0 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36cf9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36cf9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36cf9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 10 monclient(hunting): handle_auth_done global_id 154157 payload 824 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 -- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c006470 msgr2=0x7fd3680965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c006470 0x7fd3680965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 -- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 msgr2=0x7fd368096b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 0x7fd368096b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.130+0000 7fd36d79e640 1 -- 10.20.193.51:0/3670727152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368098260 con 0x7fd34c005e30 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36d79e640 1 -- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 msgr2=0x7fd368096080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36d79e640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c7c0 tx=0x7fd35800cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358018070 con 0x7fd34c005e30 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: dump: 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.151 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 5 monclient: authenticate success, global_id 154157 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd358007a20 con 0x7fd34c005e30 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358007df0 con 0x7fd34c005e30 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd3577fe640 4 set_mon_vals no callback set 2026-02-17T11:57:15.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd355ffb640 10 monclient: dump: 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 10 monclient: _renew_subs 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3680998b0 con 0x7fd34c005e30 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 10 monclient: _renew_subs 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.132+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36809d7b0 con 0x7fd34c005e30 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd3580113c0 con 0x7fd34c005e30 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36fa29640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36fa29640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36fa29640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36809de50 con 0x7fd34c005e30 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd355ffb640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 0x7fd338040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(415..415 src has 167..415) ==== 4735+0+0 (secure 0 0 0) 0x7fd358051db0 con 0x7fd34c005e30 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 0x7fd338040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.133+0000 7fd36cf9d640 10 monclient: get_auth_request con 0x7fd33803dcc0 auth_method 0 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.135+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd35800e040 con 0x7fd34c005e30 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.135+0000 7fd355ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.135+0000 7fd355ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:15.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.136+0000 7fd36cf9d640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 0x7fd338040180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd35c038000 tx=0x7fd35c034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd36fa29640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd36fa29640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd36fa29640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd3680008d0 con 0x7fd34c005e30 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd355ffb640 1 -- 10.20.193.51:0/3670727152 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fd3580507e0 con 0x7fd34c005e30 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd355ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:15.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.256+0000 7fd355ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:15.260 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":102,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:15.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 msgr2=0x7fd338040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 0x7fd338040180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd35c038000 tx=0x7fd35c034000 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 10 monclient: shutdown 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 msgr2=0x7fd368096080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c7c0 tx=0x7fd35800cc90 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 shutdown_connections 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd33803dcc0 0x7fd338040180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd34c009ad0 0x7fd368096b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd34c006470 0x7fd3680965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 --2- 10.20.193.51:0/3670727152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd34c005e30 0x7fd368096080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 >> 10.20.193.51:0/3670727152 conn(0x7fd3680a30c0 msgr2=0x7fd36813ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 shutdown_connections 2026-02-17T11:57:15.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.257+0000 7fd36fa29640 1 -- 10.20.193.51:0/3670727152 wait complete. 2026-02-17T11:57:15.268 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:57:15.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:57:15.268 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.337+0000 7f17f1d7e640 10 monclient: get_monmap_and_config 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.337+0000 7f17f1d7e640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient: monmap: 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:15.338959+0000 2026-02-17T11:57:15.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:15.338959+0000 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 Processor -- start 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 -- start start 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient: init 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 0x7f17ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-a con 0x7f17ec0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f17ec0a0750 0x7f17ec09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-c con 0x7f17ec0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-b con 0x7f17ec09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec0a3f90 con 0x7f17ec0a3bb0 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec06e140 con 0x7f17ec0a0750 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec09f910 con 0x7f17ec09e540 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17f1d7e640 10 monclient(hunting): authenticate will time out at 1322.957748s 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17eb7fe640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 msgr2=0x7f17ec09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:15.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17eb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 0x7f17ec09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38022/0 (socket says 10.20.193.51:38022) 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 1 -- 10.20.193.51:0/2630481266 learned_addr learned my addr 10.20.193.51:0/2630481266 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): get_auth_request con 0x7f17ec09e540 auth_method 0 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.338+0000 7f17eaffd640 1 --2- 10.20.193.51:0/2630481266 >> v2:10.20.193.142:3300/0 conn(0x7f17ec0a0750 0x7f17ec09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17eaffd640 10 monclient(hunting): get_auth_request con 0x7f17ec0a0750 auth_method 0 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 10 monclient(hunting): handle_auth_done global_id 154160 payload 274 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 -- 10.20.193.51:0/2630481266 >> v2:10.20.193.142:3300/0 conn(0x7f17ec0a0750 msgr2=0x7f17ec09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 --2- 10.20.193.51:0/2630481266 >> v2:10.20.193.142:3300/0 conn(0x7f17ec0a0750 0x7f17ec09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 -- 10.20.193.51:0/2630481266 >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 msgr2=0x7f17ec09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 --2- 10.20.193.51:0/2630481266 >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 0x7f17ec09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 monclient: found mon.noname-b 2026-02-17T11:57:15.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.339+0000 7f17ebfff640 1 -- 10.20.193.51:0/2630481266 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec09ccd0 con 0x7f17ec09e540 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ebfff640 1 -- 10.20.193.51:0/2630481266 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 msgr2=0x7f17ec13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ebfff640 1 --2- 10.20.193.51:0/2630481266 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06f3c0 tx=0x7f17e002f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0e0b6795e6ea1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 1 -- 10.20.193.51:0/2630481266 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e00373f0 con 0x7f17ec09e540 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: dump: 2026-02-17T11:57:15.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17f1d7e640 5 monclient: authenticate success, global_id 154160 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 1 -- 10.20.193.51:0/2630481266 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e0037590 con 0x7f17ec09e540 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17f1d7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 1 -- 10.20.193.51:0/2630481266 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0037960 con 0x7f17ec09e540 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17f1d7e640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17f1d7e640 4 set_mon_vals no callback set 2026-02-17T11:57:15.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.341+0000 7f17ea7fc640 10 monclient: dump: 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.364 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 10 monclient: shutdown 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- 10.20.193.51:0/2630481266 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 msgr2=0x7f17ec13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/2630481266 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06f3c0 tx=0x7f17e002f200 comp rx=0 tx=0).stop 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- 10.20.193.51:0/2630481266 shutdown_connections 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/2630481266 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09e540 0x7f17ec13c760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/2630481266 >> v2:10.20.193.142:3300/0 conn(0x7f17ec0a0750 0x7f17ec09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/2630481266 >> v2:10.20.193.51:3300/0 conn(0x7f17ec0a3bb0 0x7f17ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- 10.20.193.51:0/2630481266 >> 10.20.193.51:0/2630481266 conn(0x7f17ec0a30c0 msgr2=0x7f17ec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- 10.20.193.51:0/2630481266 shutdown_connections 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- 10.20.193.51:0/2630481266 wait complete. 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 10 monclient: monmap: 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:15.366 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 Processor -- start 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 1 -- start start 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.342+0000 7f17f1d7e640 10 monclient: init 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17ec09e540 0x7f17ec1cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-a con 0x7f17ec09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 0x7f17ec09be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-c con 0x7f17ec0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17ec0a3bb0 0x7f17ec1cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): picked mon.noname-b con 0x7f17ec0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0a04b0 con 0x7f17ec09e540 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec09c850 con 0x7f17ec0a3bb0 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec13cca0 con 0x7f17ec0a0750 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17f1d7e640 10 monclient(hunting): authenticate will time out at 1322.962145s 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eb7fe640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17ec09e540 msgr2=0x7f17ec1cbb60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eb7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17ec09e540 0x7f17ec1cbb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 0x7f17ec09be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 0x7f17ec09be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38032/0 (socket says 10.20.193.51:38032) 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 -- 10.20.193.51:0/906055121 learned_addr learned my addr 10.20.193.51:0/906055121 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:15.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): get_auth_request con 0x7f17ec0a0750 auth_method 0 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17ebfff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17ec0a3bb0 0x7f17ec1cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17ebfff640 10 monclient(hunting): get_auth_request con 0x7f17ec0a3bb0 auth_method 0 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient(hunting): handle_auth_done global_id 154163 payload 824 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17ec0a3bb0 msgr2=0x7f17ec1cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17ec0a3bb0 0x7f17ec1cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17ec09e540 msgr2=0x7f17ec1cbb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17ec09e540 0x7f17ec1cbb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.343+0000 7f17eaffd640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec09d7b0 con 0x7f17ec0a0750 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17eaffd640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 msgr2=0x7f17ec09be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17eaffd640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 0x7f17ec09be90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e7f0 tx=0x7f17dc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc017070 con 0x7f17ec0a0750 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: dump: 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.372 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc00cae0 con 0x7f17ec0a0750 2026-02-17T11:57:15.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00f040 con 0x7f17ec0a0750 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17e9ffb640 4 set_mon_vals no callback set 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17c7fff640 10 monclient: dump: 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.374 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 5 monclient: authenticate success, global_id 154163 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 10 monclient: _renew_subs 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec096930 con 0x7f17ec0a0750 2026-02-17T11:57:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 10 monclient: _renew_subs 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.345+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec0961a0 con 0x7f17ec0a0750 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17f1d7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 0x7f17ec1cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec06f8a0 con 0x7f17ec09c3d0 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 0x7f17ec1cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient: get_auth_request con 0x7f17ec09c3d0 auth_method 0 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f17dc012050 con 0x7f17ec0a0750 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_done global_id 154166 payload 824 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17eb7fe640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17ec1cc5e0 con 0x7f17ec09c3d0 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17c7fff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17bc03dd40 0x7f17bc040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(415..415 src has 167..415) ==== 4735+0+0 (secure 0 0 0) 0x7f17dc052400 con 0x7f17ec0a0750 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17ebfff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17bc03dd40 0x7f17bc040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.346+0000 7f17ebfff640 10 monclient: get_auth_request con 0x7f17bc03dd40 auth_method 0 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17eb7fe640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 msgr2=0x7f17ec1cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17eb7fe640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 0x7f17ec1cf5e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d800bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8005070 con 0x7f17ec09c3d0 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 10 monclient: dump: 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f17d8005070 con 0x7f17ec09c3d0 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 msgr2=0x7f17ec1cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 0x7f17ec1cf5e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 msgr2=0x7f17ec1cf5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.348+0000 7f17c7fff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec09c3d0 0x7f17ec1cf5e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d800bcf0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.349+0000 7f17ebfff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17bc03dd40 0x7f17bc040200 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06c1c0 tx=0x7f17e0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.351+0000 7f17f1d7e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.351+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 0x7f17ec1da450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.351+0000 7f17f1d7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.351+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec1cff30 con 0x7f17ec1cfb20 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 0x7f17ec1da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient: get_auth_request con 0x7f17ec1cfb20 auth_method 0 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 10 monclient(hunting): handle_auth_done global_id 154169 payload 824 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.352+0000 7f17eb7fe640 1 -- 10.20.193.51:0/906055121 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f17ec09cac0 con 0x7f17ec1cfb20 2026-02-17T11:57:15.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17eb7fe640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 msgr2=0x7f17ec1da450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17eb7fe640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 0x7f17ec1da450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d8005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d801a730 con 0x7f17ec1cfb20 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 10 monclient: dump: 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.381 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7f17d8014430 con 0x7f17ec1cfb20 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 msgr2=0x7f17ec1da450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 0x7f17ec1da450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d8005ad0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 msgr2=0x7f17ec1da450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:57:15.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17c7fff640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec1cfb20 0x7f17ec1da450 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17d800bcc0 tx=0x7f17d8005ad0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 102, 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28234, 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:57:15.383 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.384 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:57:15.386 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:57:15.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:57:15.390 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.391 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.392 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:57:15.393 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:57:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17bc03dd40 msgr2=0x7f17bc040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17bc03dd40 0x7f17bc040200 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06c1c0 tx=0x7f17e0033000 comp rx=0 tx=0).stop 2026-02-17T11:57:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 10 monclient: shutdown 2026-02-17T11:57:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 msgr2=0x7f17ec09be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 --2- 10.20.193.51:0/906055121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17ec0a0750 0x7f17ec09be90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e7f0 tx=0x7f17dc00ecc0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17ebfff640 1 -- 10.20.193.51:0/906055121 reap_dead start 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17ebfff640 1 -- 10.20.193.51:0/906055121 reap_dead start 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 shutdown_connections 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 >> 10.20.193.51:0/906055121 conn(0x7f17ec0a30c0 msgr2=0x7f17ec072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 shutdown_connections 2026-02-17T11:57:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.354+0000 7f17f1d7e640 1 -- 10.20.193.51:0/906055121 wait complete. 2026-02-17T11:57:15.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:57:15.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:57:15.395 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: get_monmap_and_config 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: monmap: 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:15.462016+0000 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:15.462016+0000 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.463 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 Processor -- start 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 -- start start 2026-02-17T11:57:15.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: init 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f59cc138600 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 0x7f59cc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-a con 0x7f59cc0a35a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f59cc13d8a0 0x7f59cc13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-c con 0x7f59cc13d8a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc0a1df0 con 0x7f59cc138600 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0a6830 con 0x7f59cc0a35a0 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0a2c00 con 0x7f59cc13d8a0 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59d1491640 10 monclient(hunting): authenticate will time out at 1323.080918s 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59ca7fc640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 msgr2=0x7f59cc13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59caffd640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f59cc138600 legacy=0x7f59cc1389e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.461+0000 7f59ca7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 0x7f59cc13d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f59cc13d8a0 0x7f59cc13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f59cc13d8a0 0x7f59cc13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:40432/0 (socket says 10.20.193.51:40432) 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 -- 10.20.193.51:0/1252380295 learned_addr learned my addr 10.20.193.51:0/1252380295 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): get_auth_request con 0x7f59cc13d8a0 auth_method 0 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient(hunting): handle_auth_done global_id 114421 payload 274 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 -- 10.20.193.51:0/1252380295 >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 msgr2=0x7f59cc13d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 --2- 10.20.193.51:0/1252380295 >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 0x7f59cc13d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 -- 10.20.193.51:0/1252380295 >> v1:10.20.193.51:6789/0 conn(0x7f59cc138600 legacy=0x7f59cc1389e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:57:15.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.462+0000 7f59cb7fe640 1 -- 10.20.193.51:0/1252380295 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0a65b0 con 0x7f59cc13d8a0 2026-02-17T11:57:15.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59cb7fe640 1 -- 10.20.193.51:0/1252380295 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 msgr2=0x7f59cc13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59cb7fe640 1 --2- 10.20.193.51:0/1252380295 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc13fc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06f470 tx=0x7f59bc02f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b2dbbb2226eb2f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 1 -- 10.20.193.51:0/1252380295 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0373f0 con 0x7f59cc13d8a0 2026-02-17T11:57:15.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: dump: 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 1 -- 10.20.193.51:0/1252380295 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc037590 con 0x7f59cc13d8a0 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 5 monclient: authenticate success, global_id 114421 2026-02-17T11:57:15.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 1 -- 10.20.193.51:0/1252380295 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc037960 con 0x7f59cc13d8a0 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 4 set_mon_vals no callback set 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59c9ffb640 10 monclient: dump: 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 10 monclient: shutdown 2026-02-17T11:57:15.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 -- 10.20.193.51:0/1252380295 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 msgr2=0x7f59cc13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 --2- 10.20.193.51:0/1252380295 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc13fc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06f470 tx=0x7f59bc02f200 comp rx=0 tx=0).stop 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 -- 10.20.193.51:0/1252380295 shutdown_connections 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 --2- 10.20.193.51:0/1252380295 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc13fc90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 --2- 10.20.193.51:0/1252380295 >> v2:10.20.193.51:3300/0 conn(0x7f59cc0a35a0 0x7f59cc13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 -- 10.20.193.51:0/1252380295 >> 10.20.193.51:0/1252380295 conn(0x7f59cc0a7460 msgr2=0x7f59cc0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 -- 10.20.193.51:0/1252380295 shutdown_connections 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.465+0000 7f59d1491640 1 -- 10.20.193.51:0/1252380295 wait complete. 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient: monmap: 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:15.475 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 Processor -- start 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 -- start start 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient: init 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59cc0a35a0 0x7f59cc1cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-a con 0x7f59cc0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 0x7f59cc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-c con 0x7f59cc138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): picked mon.noname-b con 0x7f59cc13d8a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0a15f0 con 0x7f59cc0a35a0 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0a25b0 con 0x7f59cc13d8a0 2026-02-17T11:57:15.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0a1770 con 0x7f59cc138600 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59caffd640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59cc0a35a0 msgr2=0x7f59cc1cf0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59d1491640 10 monclient(hunting): authenticate will time out at 1323.085821s 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59caffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59cc0a35a0 0x7f59cc1cf0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 0x7f59cc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 0x7f59cc136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38048/0 (socket says 10.20.193.51:38048) 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 1 -- 10.20.193.51:0/4252245107 learned_addr learned my addr 10.20.193.51:0/4252245107 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): get_auth_request con 0x7f59cc138600 auth_method 0 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.466+0000 7f59ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59cb7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59cb7fe640 10 monclient(hunting): get_auth_request con 0x7f59cc13d8a0 auth_method 0 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 10 monclient(hunting): handle_auth_done global_id 154172 payload 824 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 msgr2=0x7f59cc0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc13d8a0 0x7f59cc0713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59cc0a35a0 msgr2=0x7f59cc1cf0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59cc0a35a0 0x7f59cc1cf0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.467+0000 7f59ca7fc640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0a8f10 con 0x7f59cc138600 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ca7fc640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 msgr2=0x7f59cc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ca7fc640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 0x7f59cc136c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b780 tx=0x7f59b400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40052d0 con 0x7f59cc138600 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: dump: 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b4010070 con 0x7f59cc138600 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40056d0 con 0x7f59cc138600 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59ab7fe640 10 monclient: dump: 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59c97fa640 4 set_mon_vals no callback set 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 5 monclient: authenticate success, global_id 154172 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 monclient: _renew_subs 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc137b00 con 0x7f59cc138600 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 monclient: _renew_subs 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:15.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc121330 con 0x7f59cc138600 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 0x7f59cc071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1389e0 con 0x7f59cc1371c0 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.469+0000 7f59caffd640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 0x7f59cc071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient: get_auth_request con 0x7f59cc1371c0 auth_method 0 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f59b400c520 con 0x7f59cc138600 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 10 monclient(hunting): handle_auth_done global_id 114427 payload 824 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59caffd640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59cc074a80 con 0x7f59cc1371c0 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59ab7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599803dcc0 0x7f5998040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(415..415 src has 167..415) ==== 4735+0+0 (secure 0 0 0) 0x7f59b4051ef0 con 0x7f59cc138600 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59cb7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599803dcc0 0x7f5998040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.470+0000 7f59cb7fe640 10 monclient: get_auth_request con 0x7f599803dcc0 auth_method 0 2026-02-17T11:57:15.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59caffd640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 msgr2=0x7f59cc071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59caffd640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 0x7f59cc071920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59c0003a80 tx=0x7f59c000bcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0005070 con 0x7f59cc1371c0 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 10 monclient: dump: 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.484 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f59c0005070 con 0x7f59cc1371c0 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.472+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 msgr2=0x7f59cc071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.473+0000 7f59ab7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 0x7f59cc071920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59c0003a80 tx=0x7f59c000bcc0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.473+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 msgr2=0x7f59cc071920 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.473+0000 7f59ab7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc1371c0 0x7f59cc071920 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59c0003a80 tx=0x7f59c000bcc0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.473+0000 7f59cb7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599803dcc0 0x7f5998040180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0ab950 tx=0x7f59bc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59d1491640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59d1491640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 0x7f59cc1da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59d1491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc072270 con 0x7f59cc071e60 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 0x7f59cc1da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient: get_auth_request con 0x7f59cc071e60 auth_method 0 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 10 monclient(hunting): handle_auth_done global_id 114430 payload 824 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.476+0000 7f59caffd640 1 -- 10.20.193.51:0/4252245107 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59cc069780 con 0x7f59cc071e60 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59caffd640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 msgr2=0x7f59cc1da3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59caffd640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 0x7f59cc1da3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59c0014000 tx=0x7f59c0005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0005920 con 0x7f59cc071e60 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 10 monclient: dump: 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:15.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4867 (secure 0 0 0) 0x7f59c001a940 con 0x7f59cc071e60 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 msgr2=0x7f59cc1da3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 0x7f59cc1da3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59c0014000 tx=0x7f59c0005ad0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 msgr2=0x7f59cc1da3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59ab7fe640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59cc071e60 0x7f59cc1da3f0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59c0014000 tx=0x7f59c0005ad0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:57:15.487 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 102, 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 237354, 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.488 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.489 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:57:15.490 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:57:15.491 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:57:15.492 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.493 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.494 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.495 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.496 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:57:15.497 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:57:15.498 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:57:15.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599803dcc0 msgr2=0x7f5998040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599803dcc0 0x7f5998040180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0ab950 tx=0x7f59bc033000 comp rx=0 tx=0).stop 2026-02-17T11:57:15.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 10 monclient: shutdown 2026-02-17T11:57:15.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 msgr2=0x7f59cc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 --2- 10.20.193.51:0/4252245107 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59cc138600 0x7f59cc136c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b780 tx=0x7f59b400bc50 comp rx=0 tx=0).stop 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59cb7fe640 1 -- 10.20.193.51:0/4252245107 reap_dead start 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59cb7fe640 1 -- 10.20.193.51:0/4252245107 reap_dead start 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 shutdown_connections 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 >> 10.20.193.51:0/4252245107 conn(0x7f59cc0a7460 msgr2=0x7f59cc0a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 shutdown_connections 2026-02-17T11:57:15.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:15.479+0000 7f59d1491640 1 -- 10.20.193.51:0/4252245107 wait complete. 2026-02-17T11:57:15.500 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:57:15.500 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1772: done (4 left) 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1773: done (3 left) 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1774: done (2 left) 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1775: done (1 left) 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1776: done (0 left) 2026-02-17T11:57:15.632 INFO:tasks.rados.rados.0.trial142.stdout:1777: snap_remove snap 178 2026-02-17T11:57:16.632 INFO:tasks.rados.rados.0.trial142.stdout:1777: done (0 left) 2026-02-17T11:57:16.632 INFO:tasks.rados.rados.0.trial142.stdout:1778: rollback oid 12 current snap is 197 2026-02-17T11:57:16.633 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 12 to 193 2026-02-17T11:57:16.633 INFO:tasks.rados.rados.0.trial142.stdout:1779: write (excl) oid 16 current snap is 197 2026-02-17T11:57:16.633 INFO:tasks.rados.rados.0.trial142.stdout:1779: seq_num 628 ranges {554796=797318,1949280=526888} 2026-02-17T11:57:16.638 INFO:tasks.rados.rados.0.trial142.stdout:1779: writing trial14245205-16 from 554796 to 1352114 tid 1 2026-02-17T11:57:16.642 INFO:tasks.rados.rados.0.trial142.stdout:1779: writing trial14245205-16 from 1949280 to 2476168 tid 2 2026-02-17T11:57:16.643 INFO:tasks.rados.rados.0.trial142.stdout:1780: read oid 1 snap -1 2026-02-17T11:57:16.643 INFO:tasks.rados.rados.0.trial142.stdout:1780: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:16.643 INFO:tasks.rados.rados.0.trial142.stdout:1781: write (excl) oid 30 current snap is 197 2026-02-17T11:57:16.643 INFO:tasks.rados.rados.0.trial142.stdout:1781: seq_num 629 ranges {571603=472567,1607762=670546} 2026-02-17T11:57:16.646 INFO:tasks.rados.rados.0.trial142.stdout:1781: writing trial14245205-30 from 571603 to 1044170 tid 1 2026-02-17T11:57:16.651 INFO:tasks.rados.rados.0.trial142.stdout:1781: writing trial14245205-30 from 1607762 to 2278308 tid 2 2026-02-17T11:57:16.651 INFO:tasks.rados.rados.0.trial142.stdout:1782: read oid 13 snap 194 2026-02-17T11:57:16.651 INFO:tasks.rados.rados.0.trial142.stdout:1782: expect (ObjNum 620 snap 191 seq_num 620) 2026-02-17T11:57:16.651 INFO:tasks.rados.rados.0.trial142.stdout:1783: snap_remove snap 195 2026-02-17T11:57:17.634 INFO:tasks.rados.rados.0.trial142.stdout:1783: done (5 left) 2026-02-17T11:57:17.634 INFO:tasks.rados.rados.0.trial142.stdout:1784: write oid 5 current snap is 197 2026-02-17T11:57:17.635 INFO:tasks.rados.rados.0.trial142.stdout:1784: seq_num 630 ranges {588410=547816,1666244=414204,2484603=103807} 2026-02-17T11:57:17.638 INFO:tasks.rados.rados.0.trial142.stdout:1784: writing trial14245205-5 from 588410 to 1136226 tid 1 2026-02-17T11:57:17.642 INFO:tasks.rados.rados.0.trial142.stdout:1784: writing trial14245205-5 from 1666244 to 2080448 tid 2 2026-02-17T11:57:17.644 INFO:tasks.rados.rados.0.trial142.stdout:1784: writing trial14245205-5 from 2484603 to 2588410 tid 3 2026-02-17T11:57:17.645 INFO:tasks.rados.rados.0.trial142.stdout:1785: write oid 6 current snap is 197 2026-02-17T11:57:17.645 INFO:tasks.rados.rados.0.trial142.stdout:1785: seq_num 631 ranges {605217=739418,2124726=480491} 2026-02-17T11:57:17.649 INFO:tasks.rados.rados.0.trial142.stdout:1785: writing trial14245205-6 from 605217 to 1344635 tid 1 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1785: writing trial14245205-6 from 2124726 to 2605217 tid 2 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1786: read oid 20 snap -1 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1786: expect deleted 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1787: delete oid 41 current snap is 197 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1778: finishing rollback tid 0 to trial14245205-12 2026-02-17T11:57:17.655 INFO:tasks.rados.rados.0.trial142.stdout:1778: finishing rollback tid 1 to trial14245205-12 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1778: finishing rollback tid 2 to trial14245205-12 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1570 (ObjNum 536 snap 165 seq_num 536) dirty exists 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: finishing write tid 1 to trial14245205-16 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: finishing write tid 2 to trial14245205-16 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: finishing write tid 3 to trial14245205-16 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: finishing write tid 4 to trial14245205-16 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: oid 16 updating version 0 to 979 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: oid 16 version 979 is already newer than 978 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:1779: oid 16 updating version 979 to 980 2026-02-17T11:57:17.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 980 (ObjNum 628 snap 197 seq_num 628) dirty exists 2026-02-17T11:57:17.657 INFO:tasks.rados.rados.0.trial142.stdout:1779: left oid 16 (ObjNum 628 snap 197 seq_num 628) 2026-02-17T11:57:17.657 INFO:tasks.rados.rados.0.trial142.stdout:1780: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:17.704 INFO:tasks.rados.rados.0.trial142.stdout:1781: finishing write tid 1 to trial14245205-30 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: finishing write tid 2 to trial14245205-30 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: finishing write tid 3 to trial14245205-30 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: finishing write tid 4 to trial14245205-30 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: oid 30 updating version 0 to 755 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: oid 30 version 755 is already newer than 754 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: oid 30 updating version 755 to 756 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 756 (ObjNum 629 snap 197 seq_num 629) dirty exists 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1781: left oid 30 (ObjNum 629 snap 197 seq_num 629) 2026-02-17T11:57:17.705 INFO:tasks.rados.rados.0.trial142.stdout:1782: expect (ObjNum 620 snap 191 seq_num 620) 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1784: finishing write tid 1 to trial14245205-5 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1784: finishing write tid 2 to trial14245205-5 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1784: finishing write tid 3 to trial14245205-5 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1784: finishing write tid 4 to trial14245205-5 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1778: done (8 left) 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1779: done (7 left) 2026-02-17T11:57:17.790 INFO:tasks.rados.rados.0.trial142.stdout:1780: done (6 left) 2026-02-17T11:57:17.791 INFO:tasks.rados.rados.0.trial142.stdout:1781: done (5 left) 2026-02-17T11:57:17.791 INFO:tasks.rados.rados.0.trial142.stdout:1782: done (4 left) 2026-02-17T11:57:17.791 INFO:tasks.rados.rados.0.trial142.stdout:1787: done (3 left) 2026-02-17T11:57:17.791 INFO:tasks.rados.rados.0.trial142.stdout:1788: write (excl) oid 21 current snap is 197 2026-02-17T11:57:17.791 INFO:tasks.rados.rados.0.trial142.stdout:1788: seq_num 633 ranges {638831=489916,1841690=677884} 2026-02-17T11:57:17.794 INFO:tasks.rados.rados.0.trial142.stdout:1788: writing trial14245205-21 from 638831 to 1128747 tid 1 2026-02-17T11:57:17.799 INFO:tasks.rados.rados.0.trial142.stdout:1788: writing trial14245205-21 from 1841690 to 2519574 tid 2 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1789: delete oid 40 current snap is 197 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: finishing write tid 5 to trial14245205-5 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: oid 5 updating version 0 to 981 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: oid 5 updating version 981 to 984 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: oid 5 version 984 is already newer than 983 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: oid 5 version 984 is already newer than 982 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 984 (ObjNum 630 snap 197 seq_num 630) dirty exists 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1784: left oid 5 (ObjNum 630 snap 197 seq_num 630) 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1785: finishing write tid 1 to trial14245205-6 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1785: finishing write tid 2 to trial14245205-6 2026-02-17T11:57:17.800 INFO:tasks.rados.rados.0.trial142.stdout:1785: finishing write tid 3 to trial14245205-6 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1785: finishing write tid 4 to trial14245205-6 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1785: oid 6 updating version 0 to 719 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1785: oid 6 updating version 719 to 720 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1785: oid 6 version 720 is already newer than 718 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 720 (ObjNum 631 snap 197 seq_num 631) dirty exists 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1785: left oid 6 (ObjNum 631 snap 197 seq_num 631) 2026-02-17T11:57:17.801 INFO:tasks.rados.rados.0.trial142.stdout:1788: finishing write tid 1 to trial14245205-21 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1784: done (4 left) 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1785: done (3 left) 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1786: done (2 left) 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1789: done (1 left) 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1790: write (excl) oid 43 current snap is 197 2026-02-17T11:57:17.802 INFO:tasks.rados.rados.0.trial142.stdout:1790: seq_num 635 ranges {672445=640414,1842301=681553} 2026-02-17T11:57:17.806 INFO:tasks.rados.rados.0.trial142.stdout:1790: writing trial14245205-43 from 672445 to 1312859 tid 1 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1790: writing trial14245205-43 from 1842301 to 2523854 tid 2 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1791: read oid 32 snap -1 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1791: expect deleted 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1792: write oid 27 current snap is 197 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1788: finishing write tid 2 to trial14245205-21 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1788: finishing write tid 3 to trial14245205-21 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1788: finishing write tid 4 to trial14245205-21 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1788: oid 21 updating version 0 to 984 2026-02-17T11:57:17.811 INFO:tasks.rados.rados.0.trial142.stdout:1788: oid 21 version 984 is already newer than 982 2026-02-17T11:57:17.812 INFO:tasks.rados.rados.0.trial142.stdout:1788: oid 21 version 984 is already newer than 983 2026-02-17T11:57:17.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 984 (ObjNum 633 snap 197 seq_num 633) dirty exists 2026-02-17T11:57:17.812 INFO:tasks.rados.rados.0.trial142.stdout:1788: left oid 21 (ObjNum 633 snap 197 seq_num 633) 2026-02-17T11:57:17.812 INFO:tasks.rados.rados.0.trial142.stdout:1790: finishing write tid 1 to trial14245205-43 2026-02-17T11:57:17.812 INFO:tasks.rados.rados.0.trial142.stdout:1792: seq_num 636 ranges {689252=715663,1900783=425211} 2026-02-17T11:57:17.816 INFO:tasks.rados.rados.0.trial142.stdout:1792: writing trial14245205-27 from 689252 to 1404915 tid 1 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1792: writing trial14245205-27 from 1900783 to 2325994 tid 2 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1788: done (3 left) 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1793: copy_from oid 2 from oid 3 current snap is 197 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1790: finishing write tid 2 to trial14245205-43 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1790: finishing write tid 3 to trial14245205-43 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1790: finishing write tid 4 to trial14245205-43 2026-02-17T11:57:17.820 INFO:tasks.rados.rados.0.trial142.stdout:1790: oid 43 updating version 0 to 1587 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1790: oid 43 updating version 1587 to 1588 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1790: oid 43 version 1588 is already newer than 1586 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1588 (ObjNum 635 snap 197 seq_num 635) dirty exists 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1790: left oid 43 (ObjNum 635 snap 197 seq_num 635) 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1792: finishing write tid 1 to trial14245205-27 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1790: done (3 left) 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1791: done (2 left) 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1794: read oid 23 snap -1 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1794: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:1795: rollback oid 20 current snap is 197 2026-02-17T11:57:17.821 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 196 2026-02-17T11:57:17.822 INFO:tasks.rados.rados.0.trial142.stdout:1796: delete oid 37 current snap is 197 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1795: finishing rollback tid 1 to trial14245205-20 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1007 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1795: done (4 left) 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1796: done (3 left) 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1797: read oid 29 snap -1 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1797: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1798: read oid 18 snap -1 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1798: expect (ObjNum 609 snap 188 seq_num 609) 2026-02-17T11:57:17.823 INFO:tasks.rados.rados.0.trial142.stdout:1799: snap_create 2026-02-17T11:57:17.824 INFO:tasks.rados.rados.0.trial142.stdout:1794: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: finishing write tid 2 to trial14245205-27 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: finishing write tid 3 to trial14245205-27 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: finishing write tid 4 to trial14245205-27 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: oid 27 updating version 0 to 1084 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: oid 27 updating version 1084 to 1085 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: oid 27 updating version 1085 to 1086 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 1086 (ObjNum 636 snap 197 seq_num 636) dirty exists 2026-02-17T11:57:17.979 INFO:tasks.rados.rados.0.trial142.stdout:1792: left oid 27 (ObjNum 636 snap 197 seq_num 636) 2026-02-17T11:57:17.980 INFO:tasks.rados.rados.0.trial142.stdout:1797: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:18.067 INFO:tasks.rados.rados.0.trial142.stdout:1798: expect (ObjNum 609 snap 188 seq_num 609) 2026-02-17T11:57:18.197 INFO:tasks.rados.rados.0.trial142.stdout:1793: finishing copy_from racing read to trial14245205-2 2026-02-17T11:57:18.197 INFO:tasks.rados.rados.0.trial142.stdout:1793: finishing copy_from to trial14245205-2 2026-02-17T11:57:18.197 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1008 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1792: done (5 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1793: done (4 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1794: done (3 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1797: done (2 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1798: done (1 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1799: done (0 left) 2026-02-17T11:57:18.640 INFO:tasks.rados.rados.0.trial142.stdout:1800: rollback oid 15 current snap is 198 2026-02-17T11:57:18.641 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 189 2026-02-17T11:57:18.641 INFO:tasks.rados.rados.0.trial142.stdout:1801: snap_create 2026-02-17T11:57:18.641 INFO:tasks.rados.rados.0.trial142.stdout:1800: finishing rollback tid 0 to trial14245205-15 2026-02-17T11:57:18.642 INFO:tasks.rados.rados.0.trial142.stdout:1800: finishing rollback tid 1 to trial14245205-15 2026-02-17T11:57:18.642 INFO:tasks.rados.rados.0.trial142.stdout:1800: finishing rollback tid 2 to trial14245205-15 2026-02-17T11:57:18.642 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 1090 (ObjNum 554 snap 168 seq_num 554) dirty exists 2026-02-17T11:57:19.638 INFO:tasks.rados.rados.0.trial142.stdout:1800: done (1 left) 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1801: done (0 left) 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1802: read oid 42 snap -1 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1802: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1803: read oid 46 snap -1 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1803: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1804: read oid 14 snap -1 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1804: expect (ObjNum 619 snap 190 seq_num 619) 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1805: write oid 47 current snap is 199 2026-02-17T11:57:19.639 INFO:tasks.rados.rados.0.trial142.stdout:1805: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2026-02-17T11:57:19.643 INFO:tasks.rados.rados.0.trial142.stdout:1805: writing trial14245205-47 from 722866 to 1189027 tid 1 2026-02-17T11:57:19.647 INFO:tasks.rados.rados.0.trial142.stdout:1805: writing trial14245205-47 from 1617747 to 2046627 tid 2 2026-02-17T11:57:19.649 INFO:tasks.rados.rados.0.trial142.stdout:1805: writing trial14245205-47 from 2587634 to 2722866 tid 3 2026-02-17T11:57:19.649 INFO:tasks.rados.rados.0.trial142.stdout:1806: delete oid 10 current snap is 199 2026-02-17T11:57:19.649 INFO:tasks.rados.rados.0.trial142.stdout:1802: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:57:19.835 INFO:tasks.rados.rados.0.trial142.stdout:1803: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:19.909 INFO:tasks.rados.rados.0.trial142.stdout:1805: finishing write tid 1 to trial14245205-47 2026-02-17T11:57:19.909 INFO:tasks.rados.rados.0.trial142.stdout:1804: expect (ObjNum 619 snap 190 seq_num 619) 2026-02-17T11:57:20.024 INFO:tasks.rados.rados.0.trial142.stdout:1805: finishing write tid 2 to trial14245205-47 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1802: done (4 left) 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1803: done (3 left) 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1804: done (2 left) 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1806: done (1 left) 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1807: read oid 29 snap -1 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1807: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1808: write oid 32 current snap is 199 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1805: finishing write tid 3 to trial14245205-47 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1805: finishing write tid 4 to trial14245205-47 2026-02-17T11:57:20.025 INFO:tasks.rados.rados.0.trial142.stdout:1805: finishing write tid 5 to trial14245205-47 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1805: oid 47 updating version 0 to 981 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1805: oid 47 updating version 981 to 982 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1805: oid 47 updating version 982 to 983 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1805: oid 47 updating version 983 to 984 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 984 (ObjNum 638 snap 199 seq_num 638) dirty exists 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1805: left oid 47 (ObjNum 638 snap 199 seq_num 638) 2026-02-17T11:57:20.026 INFO:tasks.rados.rados.0.trial142.stdout:1808: seq_num 640 ranges {756480=733012,2134711=432549} 2026-02-17T11:57:20.029 INFO:tasks.rados.rados.0.trial142.stdout:1808: writing trial14245205-32 from 756480 to 1489492 tid 1 2026-02-17T11:57:20.034 INFO:tasks.rados.rados.0.trial142.stdout:1808: writing trial14245205-32 from 2134711 to 2567260 tid 2 2026-02-17T11:57:20.034 INFO:tasks.rados.rados.0.trial142.stdout:1805: done (2 left) 2026-02-17T11:57:20.034 INFO:tasks.rados.rados.0.trial142.stdout:1809: write oid 7 current snap is 199 2026-02-17T11:57:20.034 INFO:tasks.rados.rados.0.trial142.stdout:1809: seq_num 641 ranges {773287=408261,1793193=576207} 2026-02-17T11:57:20.038 INFO:tasks.rados.rados.0.trial142.stdout:1809: writing trial14245205-7 from 773287 to 1181548 tid 1 2026-02-17T11:57:20.043 INFO:tasks.rados.rados.0.trial142.stdout:1809: writing trial14245205-7 from 1793193 to 2369400 tid 2 2026-02-17T11:57:20.043 INFO:tasks.rados.rados.0.trial142.stdout:1810: copy_from oid 8 from oid 14 current snap is 199 2026-02-17T11:57:20.043 INFO:tasks.rados.rados.0.trial142.stdout:1807: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:20.129 INFO:tasks.rados.rados.0.trial142.stdout:1808: finishing write tid 1 to trial14245205-32 2026-02-17T11:57:20.130 INFO:tasks.rados.rados.0.trial142.stdout:1807: done (3 left) 2026-02-17T11:57:20.130 INFO:tasks.rados.rados.0.trial142.stdout:1811: snap_remove snap 193 2026-02-17T11:57:20.645 INFO:tasks.rados.rados.0.trial142.stdout:1811: done (3 left) 2026-02-17T11:57:20.645 INFO:tasks.rados.rados.0.trial142.stdout:1812: copy_from oid 45 from oid 40 current snap is 199 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: finishing write tid 2 to trial14245205-32 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: finishing write tid 3 to trial14245205-32 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: finishing write tid 4 to trial14245205-32 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: oid 32 updating version 0 to 1011 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: oid 32 version 1011 is already newer than 1010 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: oid 32 version 1011 is already newer than 1009 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1011 (ObjNum 640 snap 199 seq_num 640) dirty exists 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1808: left oid 32 (ObjNum 640 snap 199 seq_num 640) 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1809: finishing write tid 1 to trial14245205-7 2026-02-17T11:57:20.646 INFO:tasks.rados.rados.0.trial142.stdout:1809: finishing write tid 2 to trial14245205-7 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: finishing write tid 3 to trial14245205-7 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: finishing write tid 4 to trial14245205-7 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: oid 7 updating version 0 to 1590 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: oid 7 updating version 1590 to 1591 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: oid 7 version 1591 is already newer than 1589 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 1591 (ObjNum 641 snap 199 seq_num 641) dirty exists 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: left oid 7 (ObjNum 641 snap 199 seq_num 641) 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1810: finishing copy_from racing read to trial14245205-8 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1808: done (3 left) 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1809: done (2 left) 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1813: write (excl) oid 33 current snap is 199 2026-02-17T11:57:20.647 INFO:tasks.rados.rados.0.trial142.stdout:1813: seq_num 642 ranges {790094=483510,1851675=436218} 2026-02-17T11:57:20.650 INFO:tasks.rados.rados.0.trial142.stdout:1813: writing trial14245205-33 from 790094 to 1273604 tid 1 2026-02-17T11:57:20.654 INFO:tasks.rados.rados.0.trial142.stdout:1813: writing trial14245205-33 from 1851675 to 2287893 tid 2 2026-02-17T11:57:20.654 INFO:tasks.rados.rados.0.trial142.stdout:1814: write oid 27 current snap is 199 2026-02-17T11:57:20.654 INFO:tasks.rados.rados.0.trial142.stdout:1810: finishing copy_from to trial14245205-8 2026-02-17T11:57:20.654 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1566 (ObjNum 619 snap 190 seq_num 619) dirty exists 2026-02-17T11:57:20.654 INFO:tasks.rados.rados.0.trial142.stdout:1812: finishing copy_from to trial14245205-45 2026-02-17T11:57:20.655 INFO:tasks.rados.rados.0.trial142.stdout:1812: got expected ENOENT (src dne) 2026-02-17T11:57:20.655 INFO:tasks.rados.rados.0.trial142.stdout:1812: finishing copy_from racing read to trial14245205-45 2026-02-17T11:57:20.655 INFO:tasks.rados.rados.0.trial142.stdout:1813: finishing write tid 1 to trial14245205-33 2026-02-17T11:57:20.655 INFO:tasks.rados.rados.0.trial142.stdout:1814: seq_num 643 ranges {406901=558759,1393804=579876,2608396=198505} 2026-02-17T11:57:20.657 INFO:tasks.rados.rados.0.trial142.stdout:1814: writing trial14245205-27 from 406901 to 965660 tid 1 2026-02-17T11:57:20.661 INFO:tasks.rados.rados.0.trial142.stdout:1814: writing trial14245205-27 from 1393804 to 1973680 tid 2 2026-02-17T11:57:20.664 INFO:tasks.rados.rados.0.trial142.stdout:1814: writing trial14245205-27 from 2608396 to 2806901 tid 3 2026-02-17T11:57:20.664 INFO:tasks.rados.rados.0.trial142.stdout:1810: done (3 left) 2026-02-17T11:57:20.665 INFO:tasks.rados.rados.0.trial142.stdout:1812: done (2 left) 2026-02-17T11:57:20.665 INFO:tasks.rados.rados.0.trial142.stdout:1815: snap_remove snap 188 2026-02-17T11:57:21.648 INFO:tasks.rados.rados.0.trial142.stdout:1815: done (2 left) 2026-02-17T11:57:21.648 INFO:tasks.rados.rados.0.trial142.stdout:1816: rollback oid 16 current snap is 199 2026-02-17T11:57:21.648 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 198 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: finishing write tid 2 to trial14245205-33 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: finishing write tid 3 to trial14245205-33 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: finishing write tid 4 to trial14245205-33 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: oid 33 updating version 0 to 1569 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: oid 33 version 1569 is already newer than 1567 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: oid 33 version 1569 is already newer than 1568 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1569 (ObjNum 642 snap 199 seq_num 642) dirty exists 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1813: left oid 33 (ObjNum 642 snap 199 seq_num 642) 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1814: finishing write tid 1 to trial14245205-27 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1814: finishing write tid 2 to trial14245205-27 2026-02-17T11:57:21.649 INFO:tasks.rados.rados.0.trial142.stdout:1814: finishing write tid 3 to trial14245205-27 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: finishing write tid 4 to trial14245205-27 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: finishing write tid 5 to trial14245205-27 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: oid 27 updating version 0 to 1573 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: oid 27 version 1573 is already newer than 1572 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: oid 27 version 1573 is already newer than 1571 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: oid 27 version 1573 is already newer than 1570 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 1573 (ObjNum 643 snap 199 seq_num 643) dirty exists 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: left oid 27 (ObjNum 643 snap 199 seq_num 643) 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1813: done (2 left) 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1814: done (1 left) 2026-02-17T11:57:21.650 INFO:tasks.rados.rados.0.trial142.stdout:1817: snap_remove snap 190 2026-02-17T11:57:22.650 INFO:tasks.rados.rados.0.trial142.stdout:1817: done (1 left) 2026-02-17T11:57:22.651 INFO:tasks.rados.rados.0.trial142.stdout:1818: write (excl) oid 38 current snap is 199 2026-02-17T11:57:22.651 INFO:tasks.rados.rados.0.trial142.stdout:1818: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2026-02-17T11:57:22.654 INFO:tasks.rados.rados.0.trial142.stdout:1818: writing trial14245205-38 from 423708 to 1057716 tid 1 2026-02-17T11:57:22.659 INFO:tasks.rados.rados.0.trial142.stdout:1818: writing trial14245205-38 from 1852286 to 2292173 tid 2 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1818: writing trial14245205-38 from 2752172 to 2823708 tid 3 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1819: snap_create 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1816: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1816: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1816: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 987 (ObjNum 628 snap 197 seq_num 628) dirty exists 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1818: finishing write tid 1 to trial14245205-38 2026-02-17T11:57:22.661 INFO:tasks.rados.rados.0.trial142.stdout:1818: finishing write tid 2 to trial14245205-38 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: finishing write tid 3 to trial14245205-38 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: finishing write tid 4 to trial14245205-38 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: finishing write tid 5 to trial14245205-38 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: oid 38 updating version 0 to 1115 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: oid 38 updating version 1115 to 1116 2026-02-17T11:57:22.662 INFO:tasks.rados.rados.0.trial142.stdout:1818: oid 38 updating version 1116 to 1117 2026-02-17T11:57:22.663 INFO:tasks.rados.rados.0.trial142.stdout:1818: oid 38 version 1117 is already newer than 1114 2026-02-17T11:57:22.663 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1117 (ObjNum 644 snap 199 seq_num 644) dirty exists 2026-02-17T11:57:22.663 INFO:tasks.rados.rados.0.trial142.stdout:1818: left oid 38 (ObjNum 644 snap 199 seq_num 644) 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1816: done (2 left) 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1818: done (1 left) 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1819: done (0 left) 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1820: copy_from oid 11 from oid 20 current snap is 200 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1821: write oid 26 current snap is 200 2026-02-17T11:57:23.654 INFO:tasks.rados.rados.0.trial142.stdout:1821: seq_num 645 ranges {440515=709257,1910768=583545} 2026-02-17T11:57:23.658 INFO:tasks.rados.rados.0.trial142.stdout:1821: writing trial14245205-26 from 440515 to 1149772 tid 1 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1821: writing trial14245205-26 from 1910768 to 2494313 tid 2 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1822: read oid 21 snap -1 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1822: expect (ObjNum 633 snap 197 seq_num 633) 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1823: delete oid 39 current snap is 200 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1820: finishing copy_from to trial14245205-11 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1820: got expected ENOENT (src dne) 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1820: finishing copy_from racing read to trial14245205-11 2026-02-17T11:57:23.664 INFO:tasks.rados.rados.0.trial142.stdout:1821: finishing write tid 1 to trial14245205-26 2026-02-17T11:57:23.665 INFO:tasks.rados.rados.0.trial142.stdout:1821: finishing write tid 2 to trial14245205-26 2026-02-17T11:57:23.665 INFO:tasks.rados.rados.0.trial142.stdout:1821: finishing write tid 3 to trial14245205-26 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:1821: finishing write tid 4 to trial14245205-26 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:1821: oid 26 updating version 0 to 761 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:1821: oid 26 updating version 761 to 762 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:1821: oid 26 version 762 is already newer than 760 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 762 (ObjNum 645 snap 200 seq_num 645) dirty exists 2026-02-17T11:57:23.666 INFO:tasks.rados.rados.0.trial142.stdout:1821: left oid 26 (ObjNum 645 snap 200 seq_num 645) 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1820: done (3 left) 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1821: done (2 left) 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1823: done (1 left) 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1824: read oid 1 snap -1 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1824: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:23.668 INFO:tasks.rados.rados.0.trial142.stdout:1825: snap_remove snap 191 2026-02-17T11:57:24.633 INFO:tasks.rados.rados.0.trial142.stdout:1825: done (2 left) 2026-02-17T11:57:24.633 INFO:tasks.rados.rados.0.trial142.stdout:1826: delete oid 36 current snap is 200 2026-02-17T11:57:24.633 INFO:tasks.rados.rados.0.trial142.stdout:1822: expect (ObjNum 633 snap 197 seq_num 633) 2026-02-17T11:57:24.695 INFO:tasks.rados.rados.0.trial142.stdout:1824: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:24.742 INFO:tasks.rados.rados.0.trial142.stdout:1822: done (2 left) 2026-02-17T11:57:24.742 INFO:tasks.rados.rados.0.trial142.stdout:1824: done (1 left) 2026-02-17T11:57:24.742 INFO:tasks.rados.rados.0.trial142.stdout:1826: done (0 left) 2026-02-17T11:57:24.742 INFO:tasks.rados.rados.0.trial142.stdout:1827: write oid 45 current snap is 200 2026-02-17T11:57:24.742 INFO:tasks.rados.rados.0.trial142.stdout:1827: seq_num 648 ranges {490936=651357,1686214=447225,2861864=29072} 2026-02-17T11:57:24.746 INFO:tasks.rados.rados.0.trial142.stdout:1827: writing trial14245205-45 from 490936 to 1142293 tid 1 2026-02-17T11:57:24.750 INFO:tasks.rados.rados.0.trial142.stdout:1827: writing trial14245205-45 from 1686214 to 2133439 tid 2 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:1827: writing trial14245205-45 from 2861864 to 2890936 tid 3 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:1828: rollback oid 26 current snap is 200 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 194 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:1827: finishing write tid 1 to trial14245205-45 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:1827: finishing write tid 2 to trial14245205-45 2026-02-17T11:57:24.753 INFO:tasks.rados.rados.0.trial142.stdout:1829: delete oid 13 current snap is 200 2026-02-17T11:57:24.754 INFO:tasks.rados.rados.0.trial142.stdout:1828: finishing rollback tid 0 to trial14245205-26 2026-02-17T11:57:24.755 INFO:tasks.rados.rados.0.trial142.stdout:1828: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:57:24.755 INFO:tasks.rados.rados.0.trial142.stdout:1829: done (2 left) 2026-02-17T11:57:24.755 INFO:tasks.rados.rados.0.trial142.stdout:1830: write (excl) oid 49 current snap is 200 2026-02-17T11:57:24.755 INFO:tasks.rados.rados.0.trial142.stdout:1830: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2026-02-17T11:57:24.759 INFO:tasks.rados.rados.0.trial142.stdout:1830: writing trial14245205-49 from 524550 to 926405 tid 1 2026-02-17T11:57:24.762 INFO:tasks.rados.rados.0.trial142.stdout:1830: writing trial14245205-49 from 1403178 to 1854072 tid 2 2026-02-17T11:57:24.767 INFO:tasks.rados.rados.0.trial142.stdout:1830: writing trial14245205-49 from 2516710 to 2924550 tid 3 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:1831: rollback oid 9 current snap is 200 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 192 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:1828: finishing rollback tid 2 to trial14245205-26 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 765 (ObjNum 581 snap 181 seq_num 581) dirty exists 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:1828: done (3 left) 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:1832: rollback oid 26 current snap is 200 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 187 2026-02-17T11:57:24.768 INFO:tasks.rados.rados.0.trial142.stdout:1827: finishing write tid 3 to trial14245205-45 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: finishing write tid 4 to trial14245205-45 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: finishing write tid 5 to trial14245205-45 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: oid 45 updating version 0 to 988 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: oid 45 version 988 is already newer than 985 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: oid 45 version 988 is already newer than 986 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: oid 45 version 988 is already newer than 987 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 988 (ObjNum 648 snap 200 seq_num 648) dirty exists 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1827: left oid 45 (ObjNum 648 snap 200 seq_num 648) 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1830: finishing write tid 1 to trial14245205-49 2026-02-17T11:57:24.769 INFO:tasks.rados.rados.0.trial142.stdout:1830: finishing write tid 2 to trial14245205-49 2026-02-17T11:57:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1827: done (3 left) 2026-02-17T11:57:24.770 INFO:tasks.rados.rados.0.trial142.stdout:1833: delete oid 12 current snap is 200 2026-02-17T11:57:24.771 INFO:tasks.rados.rados.0.trial142.stdout:1832: finishing rollback tid 0 to trial14245205-26 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1832: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1832: finishing rollback tid 2 to trial14245205-26 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 768 (ObjNum 581 snap 181 seq_num 581) dirty exists 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: finishing write tid 3 to trial14245205-49 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: finishing write tid 4 to trial14245205-49 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: finishing write tid 5 to trial14245205-49 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: oid 49 updating version 0 to 1608 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: oid 49 version 1608 is already newer than 1607 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: oid 49 updating version 1608 to 1614 2026-02-17T11:57:24.772 INFO:tasks.rados.rados.0.trial142.stdout:1830: oid 49 version 1614 is already newer than 1613 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1614 (ObjNum 650 snap 200 seq_num 650) dirty exists 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1830: left oid 49 (ObjNum 650 snap 200 seq_num 650) 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1831: finishing rollback tid 0 to trial14245205-9 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1831: finishing rollback tid 1 to trial14245205-9 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1831: finishing rollback tid 2 to trial14245205-9 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 1618 (ObjNum 615 snap 189 seq_num 615) dirty exists 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1830: done (3 left) 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1831: done (2 left) 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1832: done (1 left) 2026-02-17T11:57:24.773 INFO:tasks.rados.rados.0.trial142.stdout:1833: done (0 left) 2026-02-17T11:57:24.774 INFO:tasks.rados.rados.0.trial142.stdout:1834: snap_remove snap 199 2026-02-17T11:57:25.659 INFO:tasks.rados.rados.0.trial142.stdout:1834: done (0 left) 2026-02-17T11:57:25.659 INFO:tasks.rados.rados.0.trial142.stdout:1835: copy_from oid 18 from oid 46 current snap is 200 2026-02-17T11:57:25.659 INFO:tasks.rados.rados.0.trial142.stdout:1836: write (excl) oid 14 current snap is 200 2026-02-17T11:57:25.659 INFO:tasks.rados.rados.0.trial142.stdout:1836: seq_num 652 ranges {558164=552353,1803789=454563,2855203=102961} 2026-02-17T11:57:25.662 INFO:tasks.rados.rados.0.trial142.stdout:1836: writing trial14245205-14 from 558164 to 1110517 tid 1 2026-02-17T11:57:25.667 INFO:tasks.rados.rados.0.trial142.stdout:1836: writing trial14245205-14 from 1803789 to 2258352 tid 2 2026-02-17T11:57:25.669 INFO:tasks.rados.rados.0.trial142.stdout:1836: writing trial14245205-14 from 2855203 to 2958164 tid 3 2026-02-17T11:57:25.669 INFO:tasks.rados.rados.0.trial142.stdout:1837: snap_remove snap 194 2026-02-17T11:57:26.663 INFO:tasks.rados.rados.0.trial142.stdout:1837: done (2 left) 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1838: copy_from oid 32 from oid 34 current snap is 200 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1835: finishing copy_from racing read to trial14245205-18 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1835: finishing copy_from to trial14245205-18 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1559 (ObjNum 613 snap 188 seq_num 613) dirty exists 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1836: finishing write tid 1 to trial14245205-14 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1836: finishing write tid 2 to trial14245205-14 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1836: finishing write tid 3 to trial14245205-14 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1836: finishing write tid 4 to trial14245205-14 2026-02-17T11:57:26.664 INFO:tasks.rados.rados.0.trial142.stdout:1836: finishing write tid 5 to trial14245205-14 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: oid 14 updating version 0 to 1630 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: oid 14 updating version 1630 to 1631 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: oid 14 updating version 1631 to 1632 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: oid 14 updating version 1632 to 1633 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1633 (ObjNum 652 snap 200 seq_num 652) dirty exists 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: left oid 14 (ObjNum 652 snap 200 seq_num 652) 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1835: done (2 left) 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1836: done (1 left) 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1839: copy_from oid 25 from oid 6 current snap is 200 2026-02-17T11:57:26.665 INFO:tasks.rados.rados.0.trial142.stdout:1840: delete oid 3 current snap is 200 2026-02-17T11:57:26.666 INFO:tasks.rados.rados.0.trial142.stdout:1840: done (2 left) 2026-02-17T11:57:26.667 INFO:tasks.rados.rados.0.trial142.stdout:1841: delete oid 35 current snap is 200 2026-02-17T11:57:26.668 INFO:tasks.rados.rados.0.trial142.stdout:1838: finishing copy_from racing read to trial14245205-32 2026-02-17T11:57:26.672 INFO:tasks.rados.rados.0.trial142.stdout:1839: finishing copy_from racing read to trial14245205-25 2026-02-17T11:57:26.673 INFO:tasks.rados.rados.0.trial142.stdout:1838: finishing copy_from to trial14245205-32 2026-02-17T11:57:26.673 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 756 (ObjNum 597 snap 186 seq_num 597) dirty exists 2026-02-17T11:57:26.673 INFO:tasks.rados.rados.0.trial142.stdout:1839: finishing copy_from to trial14245205-25 2026-02-17T11:57:26.673 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 720 (ObjNum 631 snap 197 seq_num 631) dirty exists 2026-02-17T11:57:26.674 INFO:tasks.rados.rados.0.trial142.stdout:1838: done (2 left) 2026-02-17T11:57:26.674 INFO:tasks.rados.rados.0.trial142.stdout:1839: done (1 left) 2026-02-17T11:57:26.675 INFO:tasks.rados.rados.0.trial142.stdout:1841: done (0 left) 2026-02-17T11:57:26.675 INFO:tasks.rados.rados.0.trial142.stdout:1842: snap_remove snap 192 2026-02-17T11:57:27.663 INFO:tasks.rados.rados.0.trial142.stdout:1842: done (0 left) 2026-02-17T11:57:27.663 INFO:tasks.rados.rados.0.trial142.stdout:1843: snap_create 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1843: done (0 left) 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1844: read oid 40 snap -1 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1844: expect deleted 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1845: read oid 18 snap -1 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1845: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:28.664 INFO:tasks.rados.rados.0.trial142.stdout:1846: snap_remove snap 187 2026-02-17T11:57:29.632 INFO:tasks.rados.rados.0.trial142.stdout:1846: done (2 left) 2026-02-17T11:57:29.633 INFO:tasks.rados.rados.0.trial142.stdout:1847: snap_remove snap 197 2026-02-17T11:57:30.634 INFO:tasks.rados.rados.0.trial142.stdout:1847: done (2 left) 2026-02-17T11:57:30.634 INFO:tasks.rados.rados.0.trial142.stdout:1848: read oid 29 snap -1 2026-02-17T11:57:30.634 INFO:tasks.rados.rados.0.trial142.stdout:1848: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:30.635 INFO:tasks.rados.rados.0.trial142.stdout:1849: write (excl) oid 36 current snap is 201 2026-02-17T11:57:30.635 INFO:tasks.rados.rados.0.trial142.stdout:1849: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2026-02-17T11:57:30.638 INFO:tasks.rados.rados.0.trial142.stdout:1849: writing trial14245205-36 from 608585 to 1103038 tid 1 2026-02-17T11:57:30.642 INFO:tasks.rados.rados.0.trial142.stdout:1849: writing trial14245205-36 from 1579235 to 2181125 tid 2 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:1849: writing trial14245205-36 from 2821119 to 3008585 tid 3 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:1850: read oid 24 snap 189 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:1850: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:1851: rollback oid 12 current snap is 201 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 12 to 200 2026-02-17T11:57:30.646 INFO:tasks.rados.rados.0.trial142.stdout:1845: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:30.719 INFO:tasks.rados.rados.0.trial142.stdout:1848: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:57:30.804 INFO:tasks.rados.rados.0.trial142.stdout:1849: finishing write tid 1 to trial14245205-36 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: finishing write tid 2 to trial14245205-36 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1844: done (5 left) 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1845: done (4 left) 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1848: done (3 left) 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1852: snap_create 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1851: finishing rollback tid 1 to trial14245205-12 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1620 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: finishing write tid 3 to trial14245205-36 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: finishing write tid 4 to trial14245205-36 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: finishing write tid 5 to trial14245205-36 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: oid 36 updating version 0 to 1012 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: oid 36 updating version 1012 to 1014 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: oid 36 version 1014 is already newer than 1013 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: oid 36 updating version 1014 to 1015 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1015 (ObjNum 655 snap 201 seq_num 655) dirty exists 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1849: left oid 36 (ObjNum 655 snap 201 seq_num 655) 2026-02-17T11:57:30.805 INFO:tasks.rados.rados.0.trial142.stdout:1850: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:57:31.670 INFO:tasks.rados.rados.0.trial142.stdout:1849: done (3 left) 2026-02-17T11:57:31.670 INFO:tasks.rados.rados.0.trial142.stdout:1850: done (2 left) 2026-02-17T11:57:31.670 INFO:tasks.rados.rados.0.trial142.stdout:1851: done (1 left) 2026-02-17T11:57:31.671 INFO:tasks.rados.rados.0.trial142.stdout:1852: done (0 left) 2026-02-17T11:57:31.671 INFO:tasks.rados.rados.0.trial142.stdout:1853: snap_create 2026-02-17T11:57:32.672 INFO:tasks.rados.rados.0.trial142.stdout:1853: done (0 left) 2026-02-17T11:57:32.672 INFO:tasks.rados.rados.0.trial142.stdout:1854: snap_create 2026-02-17T11:57:33.673 INFO:tasks.rados.rados.0.trial142.stdout:1854: done (0 left) 2026-02-17T11:57:33.673 INFO:tasks.rados.rados.0.trial142.stdout:1855: read oid 16 snap -1 2026-02-17T11:57:33.673 INFO:tasks.rados.rados.0.trial142.stdout:1855: expect (ObjNum 628 snap 197 seq_num 628) 2026-02-17T11:57:33.673 INFO:tasks.rados.rados.0.trial142.stdout:1856: rollback oid 23 current snap is 204 2026-02-17T11:57:33.674 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 203 2026-02-17T11:57:33.674 INFO:tasks.rados.rados.0.trial142.stdout:1857: delete oid 48 current snap is 204 2026-02-17T11:57:33.675 INFO:tasks.rados.rados.0.trial142.stdout:1857: done (2 left) 2026-02-17T11:57:33.675 INFO:tasks.rados.rados.0.trial142.stdout:1858: rollback oid 49 current snap is 204 2026-02-17T11:57:33.676 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 196 2026-02-17T11:57:33.676 INFO:tasks.rados.rados.0.trial142.stdout:1859: write (excl) oid 9 current snap is 204 2026-02-17T11:57:33.676 INFO:tasks.rados.rados.0.trial142.stdout:1859: seq_num 657 ranges {642199=644951,1696199=605559,2992318=49881} 2026-02-17T11:57:33.680 INFO:tasks.rados.rados.0.trial142.stdout:1859: writing trial14245205-9 from 642199 to 1287150 tid 1 2026-02-17T11:57:33.684 INFO:tasks.rados.rados.0.trial142.stdout:1859: writing trial14245205-9 from 1696199 to 2301758 tid 2 2026-02-17T11:57:33.687 INFO:tasks.rados.rados.0.trial142.stdout:1859: writing trial14245205-9 from 2992318 to 3042199 tid 3 2026-02-17T11:57:33.687 INFO:tasks.rados.rados.0.trial142.stdout:1860: read oid 50 snap 186 2026-02-17T11:57:33.687 INFO:tasks.rados.rados.0.trial142.stdout:1860: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:57:33.687 INFO:tasks.rados.rados.0.trial142.stdout:1861: delete oid 37 current snap is 204 2026-02-17T11:57:33.687 INFO:tasks.rados.rados.0.trial142.stdout:1856: finishing rollback tid 0 to trial14245205-23 2026-02-17T11:57:33.688 INFO:tasks.rados.rados.0.trial142.stdout:1858: finishing rollback tid 0 to trial14245205-49 2026-02-17T11:57:33.688 INFO:tasks.rados.rados.0.trial142.stdout:1858: finishing rollback tid 1 to trial14245205-49 2026-02-17T11:57:33.688 INFO:tasks.rados.rados.0.trial142.stdout:1858: finishing rollback tid 2 to trial14245205-49 2026-02-17T11:57:33.688 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1684 (ObjNum 573 snap 173 seq_num 573) dirty exists 2026-02-17T11:57:33.688 INFO:tasks.rados.rados.0.trial142.stdout:1855: expect (ObjNum 628 snap 197 seq_num 628) 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1856: finishing rollback tid 1 to trial14245205-23 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1856: finishing rollback tid 2 to trial14245205-23 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 988 (ObjNum 472 snap 141 seq_num 472) dirty exists 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1859: finishing write tid 1 to trial14245205-9 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1855: done (5 left) 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1856: done (4 left) 2026-02-17T11:57:33.843 INFO:tasks.rados.rados.0.trial142.stdout:1858: done (3 left) 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1861: done (2 left) 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1862: snap_create 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: finishing write tid 2 to trial14245205-9 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: finishing write tid 3 to trial14245205-9 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: finishing write tid 4 to trial14245205-9 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: finishing write tid 5 to trial14245205-9 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: oid 9 updating version 0 to 1687 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: oid 9 version 1687 is already newer than 1686 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: oid 9 updating version 1687 to 1689 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: oid 9 version 1689 is already newer than 1688 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 1689 (ObjNum 657 snap 204 seq_num 657) dirty exists 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1859: left oid 9 (ObjNum 657 snap 204 seq_num 657) 2026-02-17T11:57:33.844 INFO:tasks.rados.rados.0.trial142.stdout:1860: expect (ObjNum 559 snap 169 seq_num 559) 2026-02-17T11:57:34.634 INFO:tasks.rados.rados.0.trial142.stdout:1859: done (2 left) 2026-02-17T11:57:34.634 INFO:tasks.rados.rados.0.trial142.stdout:1860: done (1 left) 2026-02-17T11:57:34.634 INFO:tasks.rados.rados.0.trial142.stdout:1862: done (0 left) 2026-02-17T11:57:34.634 INFO:tasks.rados.rados.0.trial142.stdout:1863: copy_from oid 23 from oid 24 current snap is 205 2026-02-17T11:57:34.634 INFO:tasks.rados.rados.0.trial142.stdout:1864: snap_create 2026-02-17T11:57:34.641 INFO:tasks.rados.rados.0.trial142.stdout:1863: finishing copy_from racing read to trial14245205-23 2026-02-17T11:57:34.642 INFO:tasks.rados.rados.0.trial142.stdout:1863: finishing copy_from to trial14245205-23 2026-02-17T11:57:34.642 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1033 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:57:35.501 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T11:57:35.501 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T11:57:35.501 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:57:35.501 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:57:35.504 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:57:35.504 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:57:35.504 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 10 monclient: get_monmap_and_config 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 10 monclient: build_initial_monmap 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 10 monclient: monmap: 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:35.569340+0000 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:35.569340+0000 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:35.570 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:35.571 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:35.571 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:35.571 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 1 Processor -- start 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 1 -- start start 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.568+0000 7fa76eb85640 10 monclient: init 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T11:57:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-a con 0x7fa7680a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 0x7fa76809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-b con 0x7fa7680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa76809e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76806e140 con 0x7fa76809e540 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa7680a3f90 con 0x7fa7680a3bb0 2026-02-17T11:57:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa76809f910 con 0x7fa7680a0750 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76eb85640 10 monclient(hunting): authenticate will time out at 1343.188115s 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76d0fb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa76809e540 0x7fa76813c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44574/0 (socket says 10.20.193.51:44574) 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 0x7fa76809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76d0fb640 1 -- 10.20.193.51:0/2580157055 learned_addr learned my addr 10.20.193.51:0/2580157055 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50614/0 (socket says 10.20.193.51:50614) 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 10 monclient(hunting): get_auth_request con 0x7fa7680a3bb0 auth_method 0 2026-02-17T11:57:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): get_auth_request con 0x7fa7680a0750 auth_method 0 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 msgr2=0x7fa76809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 msgr2=0x7fa76809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 --2- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa76c8fa640 1 --2- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient(hunting): handle_auth_done global_id 154175 payload 274 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 -- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 msgr2=0x7fa76809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 -- 10.20.193.51:0/2580157055 >> v1:10.20.193.51:6789/0 conn(0x7fa76809e540 legacy=0x7fa76813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 monclient: found mon.noname-b 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.569+0000 7fa75ffff640 1 -- 10.20.193.51:0/2580157055 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76809ccd0 con 0x7fa7680a0750 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75ffff640 1 -- 10.20.193.51:0/2580157055 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 msgr2=0x7fa76809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2580157055 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 0x7fa76809e000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa76806c1c0 tx=0x7fa75002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd26ae89f89edb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 1 -- 10.20.193.51:0/2580157055 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75003c070 con 0x7fa7680a0750 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: dump: 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:35.587 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 1 -- 10.20.193.51:0/2580157055 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75002fbd0 con 0x7fa7680a0750 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa76eb85640 5 monclient: authenticate success, global_id 154175 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 1 -- 10.20.193.51:0/2580157055 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750037440 con 0x7fa7680a0750 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa76eb85640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa76eb85640 4 set_mon_vals no callback set 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.571+0000 7fa75f7fe640 10 monclient: dump: 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.589 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 10 monclient: shutdown 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- 10.20.193.51:0/2580157055 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 msgr2=0x7fa76809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2580157055 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 0x7fa76809e000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa76806c1c0 tx=0x7fa75002ed50 comp rx=0 tx=0).stop 2026-02-17T11:57:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- 10.20.193.51:0/2580157055 shutdown_connections 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2580157055 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7680a0750 0x7fa76809e000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2580157055 >> v2:10.20.193.51:3300/0 conn(0x7fa7680a3bb0 0x7fa76809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- 10.20.193.51:0/2580157055 >> 10.20.193.51:0/2580157055 conn(0x7fa7680a30c0 msgr2=0x7fa7680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- 10.20.193.51:0/2580157055 shutdown_connections 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- 10.20.193.51:0/2580157055 wait complete. 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 10 monclient: build_initial_monmap 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 10 monclient: monmap: 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:35.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 Processor -- start 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 1 -- start start 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.572+0000 7fa76eb85640 10 monclient: init 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:35.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-c con 0x7fa76809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-a con 0x7fa7680a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7680a3bb0 0x7fa7681c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): picked mon.noname-b con 0x7fa7680a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680a04b0 con 0x7fa7680a0750 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa76809c850 con 0x7fa7680a3bb0 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa76813de80 con 0x7fa76809e540 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76eb85640 10 monclient(hunting): authenticate will time out at 1343.192232s 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36122/0 (socket says 10.20.193.51:36122) 2026-02-17T11:57:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2890196083 learned_addr learned my addr 10.20.193.51:0/2890196083 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): get_auth_request con 0x7fa76809e540 auth_method 0 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 10 monclient(hunting): get_auth_request con 0x7fa7680a0750 auth_method 0 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 msgr2=0x7fa768096b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 msgr2=0x7fa768096b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient(hunting): handle_auth_done global_id 154178 payload 824 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7680a3bb0 msgr2=0x7fa7681c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7680a3bb0 0x7fa7681c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 msgr2=0x7fa768096b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient: _finish_hunting 0 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 monclient: found mon.noname-c 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.573+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2890196083 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76813d8e0 con 0x7fa76809e540 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76c8fa640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 msgr2=0x7fa7681cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76c8fa640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e790 tx=0x7fa75800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758017070 con 0x7fa76809e540 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: dump: 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.598 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 5 monclient: authenticate success, global_id 154178 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75800cae0 con 0x7fa76809e540 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 10 monclient: _renew_subs 2026-02-17T11:57:35.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76809d7b0 con 0x7fa76809e540 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75800f040 con 0x7fa76809e540 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75effd640 4 set_mon_vals no callback set 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa75d7fa640 10 monclient: dump: 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:35.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 10 monclient: _renew_subs 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.575+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76808e310 con 0x7fa76809e540 2026-02-17T11:57:35.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa76eb85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa76eb85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa76eb85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76813c3b0 con 0x7fa76809e540 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa758012050 con 0x7fa76809e540 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa75d7fa640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 0x7fa7380401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(435..435 src has 323..435) ==== 4799+0+0 (secure 0 0 0) 0x7fa7580524b0 con 0x7fa76809e540 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 0x7fa7380401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.576+0000 7fa75ffff640 10 monclient: get_auth_request con 0x7fa73803dd10 auth_method 0 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.579+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa758023d80 con 0x7fa76809e540 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.579+0000 7fa75d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:35.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.579+0000 7fa75d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:35.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.579+0000 7fa75ffff640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 0x7fa7380401d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa76809f230 tx=0x7fa750033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:35.634 INFO:tasks.rados.rados.0.trial142.stdout:1863: done (1 left) 2026-02-17T11:57:35.634 INFO:tasks.rados.rados.0.trial142.stdout:1864: done (0 left) 2026-02-17T11:57:35.634 INFO:tasks.rados.rados.0.trial142.stdout:1865: delete oid 23 current snap is 206 2026-02-17T11:57:35.637 INFO:tasks.rados.rados.0.trial142.stdout:1865: done (0 left) 2026-02-17T11:57:35.638 INFO:tasks.rados.rados.0.trial142.stdout:1866: read oid 37 snap 200 2026-02-17T11:57:35.638 INFO:tasks.rados.rados.0.trial142.stdout:1866: expect deleted 2026-02-17T11:57:35.638 INFO:tasks.rados.rados.0.trial142.stdout:1867: read oid 22 snap -1 2026-02-17T11:57:35.638 INFO:tasks.rados.rados.0.trial142.stdout:1867: expect deleted 2026-02-17T11:57:35.638 INFO:tasks.rados.rados.0.trial142.stdout:1868: snap_remove snap 202 2026-02-17T11:57:35.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa76eb85640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa76eb85640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa76eb85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa76806a290 con 0x7fa76809e540 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa75d7fa640 1 -- 10.20.193.51:0/2890196083 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fa76806a290 con 0x7fa76809e540 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa75d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:35.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.694+0000 7fa75d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:35.698 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":102,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:35.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 msgr2=0x7fa7380401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 0x7fa7380401d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa76809f230 tx=0x7fa750033000 comp rx=0 tx=0).stop 2026-02-17T11:57:35.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 10 monclient: shutdown 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 msgr2=0x7fa7681cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e790 tx=0x7fa75800ec60 comp rx=0 tx=0).stop 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 shutdown_connections 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa73803dd10 0x7fa7380401d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7680a3bb0 0x7fa7681c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7680a0750 0x7fa768096b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 --2- 10.20.193.51:0/2890196083 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa76809e540 0x7fa7681cd310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 >> 10.20.193.51:0/2890196083 conn(0x7fa7680a30c0 msgr2=0x7fa7680996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 shutdown_connections 2026-02-17T11:57:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:35.695+0000 7fa76eb85640 1 -- 10.20.193.51:0/2890196083 wait complete. 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:1868: done (2 left) 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:1869: rollback oid 13 current snap is 206 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 13 to 201 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:1866: done (2 left) 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:1867: done (1 left) 2026-02-17T11:57:36.635 INFO:tasks.rados.rados.0.trial142.stdout:1870: snap_create 2026-02-17T11:57:36.637 INFO:tasks.rados.rados.0.trial142.stdout:1869: finishing rollback tid 1 to trial14245205-13 2026-02-17T11:57:36.637 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 1574 (ObjNum 129 snap 0 seq_num 1213713400) dirty dne 2026-02-17T11:57:37.635 INFO:tasks.rados.rados.0.trial142.stdout:1869: done (1 left) 2026-02-17T11:57:37.636 INFO:tasks.rados.rados.0.trial142.stdout:1870: done (0 left) 2026-02-17T11:57:37.636 INFO:tasks.rados.rados.0.trial142.stdout:1871: copy_from oid 49 from oid 40 current snap is 207 2026-02-17T11:57:37.636 INFO:tasks.rados.rados.0.trial142.stdout:1872: write (excl) oid 16 current snap is 207 2026-02-17T11:57:37.636 INFO:tasks.rados.rados.0.trial142.stdout:1872: seq_num 660 ranges {692620=470698,1755292=752886} 2026-02-17T11:57:37.640 INFO:tasks.rados.rados.0.trial142.stdout:1872: writing trial14245205-16 from 692620 to 1163318 tid 1 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1872: writing trial14245205-16 from 1755292 to 2508178 tid 2 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1873: write oid 26 current snap is 207 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1871: finishing copy_from to trial14245205-49 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1871: got expected ENOENT (src dne) 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1871: finishing copy_from racing read to trial14245205-49 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1872: finishing write tid 1 to trial14245205-16 2026-02-17T11:57:37.645 INFO:tasks.rados.rados.0.trial142.stdout:1873: seq_num 661 ranges {709427=545947,1813774=612897,2985657=123770} 2026-02-17T11:57:37.650 INFO:tasks.rados.rados.0.trial142.stdout:1873: writing trial14245205-26 from 709427 to 1255374 tid 1 2026-02-17T11:57:37.654 INFO:tasks.rados.rados.0.trial142.stdout:1873: writing trial14245205-26 from 1813774 to 2426671 tid 2 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1873: writing trial14245205-26 from 2985657 to 3109427 tid 3 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1871: done (2 left) 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1874: rollback oid 24 current snap is 207 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 205 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: finishing write tid 2 to trial14245205-16 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: finishing write tid 3 to trial14245205-16 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: finishing write tid 4 to trial14245205-16 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: oid 16 updating version 0 to 990 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: oid 16 version 990 is already newer than 988 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: oid 16 version 990 is already newer than 989 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 990 (ObjNum 660 snap 207 seq_num 660) dirty exists 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: left oid 16 (ObjNum 660 snap 207 seq_num 660) 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1873: finishing write tid 1 to trial14245205-26 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1873: finishing write tid 2 to trial14245205-26 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1872: done (2 left) 2026-02-17T11:57:37.657 INFO:tasks.rados.rados.0.trial142.stdout:1875: copy_from oid 14 from oid 17 current snap is 207 2026-02-17T11:57:37.658 INFO:tasks.rados.rados.0.trial142.stdout:1876: snap_remove snap 196 2026-02-17T11:57:38.636 INFO:tasks.rados.rados.0.trial142.stdout:1876: done (3 left) 2026-02-17T11:57:38.636 INFO:tasks.rados.rados.0.trial142.stdout:1877: snap_remove snap 203 2026-02-17T11:57:38.707 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:38.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.771+0000 7f914bd51640 10 monclient: get_monmap_and_config 2026-02-17T11:57:38.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.771+0000 7f914bd51640 10 monclient: build_initial_monmap 2026-02-17T11:57:38.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.771+0000 7f914bd51640 10 monclient: monmap: 2026-02-17T11:57:38.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:38.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:38.772889+0000 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:38.772889+0000 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 Processor -- start 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 -- start start 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient: init 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 0x7f914409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-c con 0x7f91440a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-b con 0x7f91440a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f914409e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914406e140 con 0x7f914409e540 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f91440a3f90 con 0x7f91440a3bb0 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f914409f910 con 0x7f91440a0750 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914bd51640 10 monclient(hunting): authenticate will time out at 1346.391629s 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914a2c7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f914409e540 0x7f914413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44576/0 (socket says 10.20.193.51:44576) 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f914a2c7640 1 -- 10.20.193.51:0/3115704457 learned_addr learned my addr 10.20.193.51:0/3115704457 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36162/0 (socket says 10.20.193.51:36162) 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): get_auth_request con 0x7f91440a0750 auth_method 0 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f9149ac6640 1 --2- 10.20.193.51:0/3115704457 >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 0x7f914409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient(hunting): handle_auth_done global_id 154181 payload 274 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 -- 10.20.193.51:0/3115704457 >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 msgr2=0x7f914409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 --2- 10.20.193.51:0/3115704457 >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 0x7f914409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 -- 10.20.193.51:0/3115704457 >> v1:10.20.193.51:6789/0 conn(0x7f914409e540 legacy=0x7f914413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient: _finish_hunting 0 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 monclient: found mon.noname-b 2026-02-17T11:57:38.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:38.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f91492c5640 1 -- 10.20.193.51:0/3115704457 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914409ccd0 con 0x7f91440a0750 2026-02-17T11:57:38.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f9149ac6640 10 monclient: get_auth_request con 0x7f91440a3bb0 auth_method 0 2026-02-17T11:57:38.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.772+0000 7f9149ac6640 1 --2- 10.20.193.51:0/3115704457 >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 0x7f914409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f91492c5640 1 -- 10.20.193.51:0/3115704457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 msgr2=0x7f914409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f91492c5640 1 --2- 10.20.193.51:0/3115704457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f914406c1c0 tx=0x7f913802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17154db512ec6ea6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 1 -- 10.20.193.51:0/3115704457 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913803c070 con 0x7f91440a0750 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: dump: 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.788 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: _finish_auth 0 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: _check_auth_tickets 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 1 -- 10.20.193.51:0/3115704457 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913802fcb0 con 0x7f91440a0750 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 5 monclient: authenticate success, global_id 154181 2026-02-17T11:57:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 1 -- 10.20.193.51:0/3115704457 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913802fe60 con 0x7f91440a0750 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f9148ac4640 10 monclient: dump: 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.790 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 4 set_mon_vals no callback set 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 10 monclient: shutdown 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 -- 10.20.193.51:0/3115704457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 msgr2=0x7f914409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 --2- 10.20.193.51:0/3115704457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f914406c1c0 tx=0x7f913802ed50 comp rx=0 tx=0).stop 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 -- 10.20.193.51:0/3115704457 shutdown_connections 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 --2- 10.20.193.51:0/3115704457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91440a0750 0x7f914409e000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 --2- 10.20.193.51:0/3115704457 >> v2:10.20.193.142:3300/0 conn(0x7f91440a3bb0 0x7f914409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 -- 10.20.193.51:0/3115704457 >> 10.20.193.51:0/3115704457 conn(0x7f91440a30c0 msgr2=0x7f91440a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 -- 10.20.193.51:0/3115704457 shutdown_connections 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.775+0000 7f914bd51640 1 -- 10.20.193.51:0/3115704457 wait complete. 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient: build_initial_monmap 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient: monmap: 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 Processor -- start 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 -- start start 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient: init 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-c con 0x7f914409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-a con 0x7f91440a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91440a3bb0 0x7f9144138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): picked mon.noname-b con 0x7f91440a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f91440a04b0 con 0x7f91440a0750 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f914409c850 con 0x7f91440a3bb0 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f914413de80 con 0x7f914409e540 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f914bd51640 10 monclient(hunting): authenticate will time out at 1346.395897s 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36166/0 (socket says 10.20.193.51:36166) 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 1 -- 10.20.193.51:0/2235470274 learned_addr learned my addr 10.20.193.51:0/2235470274 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): get_auth_request con 0x7f914409e540 auth_method 0 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f91492c5640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f91492c5640 10 monclient(hunting): get_auth_request con 0x7f91440a0750 auth_method 0 2026-02-17T11:57:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f91492c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f91492c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f91492c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.776+0000 7f9149ac6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f91492c5640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 msgr2=0x7f9144137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f91492c5640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 msgr2=0x7f9144137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f91492c5640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f91492c5640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 10 monclient(hunting): handle_auth_done global_id 154184 payload 824 2026-02-17T11:57:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91440a3bb0 msgr2=0x7f9144138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91440a3bb0 0x7f9144138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 msgr2=0x7f9144137c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 10 monclient: _finish_hunting 0 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 monclient: found mon.noname-c 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.777+0000 7f9149ac6640 1 -- 10.20.193.51:0/2235470274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914412f0a0 con 0x7f914409e540 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f9149ac6640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 msgr2=0x7f91441ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f9149ac6640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f913400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134015070 con 0x7f914409e540 2026-02-17T11:57:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: dump: 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:38.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: _finish_auth 0 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: _check_auth_tickets 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913400acd0 con 0x7f914409e540 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 5 monclient: authenticate success, global_id 154184 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _renew_subs 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914412d7d0 con 0x7f914409e540 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134011630 con 0x7f914409e540 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f9133fff640 4 set_mon_vals no callback set 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f91327fc640 10 monclient: dump: 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _renew_subs 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f914412f380 con 0x7f914409e540 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.779+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914406e4a0 con 0x7f914409e540 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.780+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f91340117d0 con 0x7f914409e540 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.780+0000 7f91327fc640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 0x7f91140401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.780+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(439..439 src has 323..439) ==== 4843+0+0 (secure 0 0 0) 0x7f9134052b70 con 0x7f914409e540 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.780+0000 7f91492c5640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 0x7f91140401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.780+0000 7f91492c5640 10 monclient: get_auth_request con 0x7f911403dd10 auth_method 0 2026-02-17T11:57:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.782+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f914406e4a0 con 0x7f914409e540 2026-02-17T11:57:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.782+0000 7f91327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.782+0000 7f91327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.783+0000 7f91492c5640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 0x7f91140401d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f914409f230 tx=0x7f9138033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f914bd51640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f914bd51640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f914bd51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:38.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f914406f8d0 con 0x7f914409e540 2026-02-17T11:57:38.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f91327fc640 1 -- 10.20.193.51:0/2235470274 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f9134022c20 con 0x7f914409e540 2026-02-17T11:57:38.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f91327fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:38.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.898+0000 7f91327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:38.901 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":102,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:38.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 msgr2=0x7f91140401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 0x7f91140401d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f914409f230 tx=0x7f9138033000 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 10 monclient: shutdown 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 msgr2=0x7f91441ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f913400cc70 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 shutdown_connections 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f911403dd10 0x7f91140401d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91440a3bb0 0x7f9144138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f91440a0750 0x7f9144137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 --2- 10.20.193.51:0/2235470274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f914409e540 0x7f91441ccf50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 >> 10.20.193.51:0/2235470274 conn(0x7f91440a30c0 msgr2=0x7f9144073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:38.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 shutdown_connections 2026-02-17T11:57:38.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:38.899+0000 7f914bd51640 1 -- 10.20.193.51:0/2235470274 wait complete. 2026-02-17T11:57:39.635 INFO:tasks.rados.rados.0.trial142.stdout:1877: done (3 left) 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1878: rollback oid 6 current snap is 207 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 200 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: finishing write tid 3 to trial14245205-26 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: finishing write tid 4 to trial14245205-26 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: finishing write tid 5 to trial14245205-26 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: oid 26 updating version 0 to 772 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: oid 26 version 772 is already newer than 770 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: oid 26 version 772 is already newer than 771 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: oid 26 version 772 is already newer than 769 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 772 (ObjNum 661 snap 207 seq_num 661) dirty exists 2026-02-17T11:57:39.636 INFO:tasks.rados.rados.0.trial142.stdout:1873: left oid 26 (ObjNum 661 snap 207 seq_num 661) 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1874: finishing rollback tid 0 to trial14245205-24 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1874: finishing rollback tid 1 to trial14245205-24 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1874: finishing rollback tid 2 to trial14245205-24 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1037 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1875: finishing copy_from racing read to trial14245205-14 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1875: finishing copy_from to trial14245205-14 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1873: done (3 left) 2026-02-17T11:57:39.637 INFO:tasks.rados.rados.0.trial142.stdout:1874: done (2 left) 2026-02-17T11:57:39.638 INFO:tasks.rados.rados.0.trial142.stdout:1875: done (1 left) 2026-02-17T11:57:39.638 INFO:tasks.rados.rados.0.trial142.stdout:1879: rollback oid 45 current snap is 207 2026-02-17T11:57:39.638 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 204 2026-02-17T11:57:39.638 INFO:tasks.rados.rados.0.trial142.stdout:1880: snap_create 2026-02-17T11:57:39.638 INFO:tasks.rados.rados.0.trial142.stdout:1879: finishing rollback tid 0 to trial14245205-45 2026-02-17T11:57:39.639 INFO:tasks.rados.rados.0.trial142.stdout:1879: finishing rollback tid 1 to trial14245205-45 2026-02-17T11:57:39.639 INFO:tasks.rados.rados.0.trial142.stdout:1879: finishing rollback tid 2 to trial14245205-45 2026-02-17T11:57:39.639 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 991 (ObjNum 648 snap 200 seq_num 648) dirty exists 2026-02-17T11:57:39.640 INFO:tasks.rados.rados.0.trial142.stdout:1878: finishing rollback tid 0 to trial14245205-6 2026-02-17T11:57:39.640 INFO:tasks.rados.rados.0.trial142.stdout:1878: finishing rollback tid 1 to trial14245205-6 2026-02-17T11:57:39.640 INFO:tasks.rados.rados.0.trial142.stdout:1878: finishing rollback tid 2 to trial14245205-6 2026-02-17T11:57:39.640 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 724 (ObjNum 631 snap 197 seq_num 631) dirty exists 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1878: done (2 left) 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1879: done (1 left) 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1880: done (0 left) 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1881: read oid 21 snap -1 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1881: expect (ObjNum 633 snap 197 seq_num 633) 2026-02-17T11:57:40.638 INFO:tasks.rados.rados.0.trial142.stdout:1882: snap_create 2026-02-17T11:57:40.643 INFO:tasks.rados.rados.0.trial142.stdout:1881: expect (ObjNum 633 snap 197 seq_num 633) 2026-02-17T11:57:41.639 INFO:tasks.rados.rados.0.trial142.stdout:1881: done (1 left) 2026-02-17T11:57:41.639 INFO:tasks.rados.rados.0.trial142.stdout:1882: done (0 left) 2026-02-17T11:57:41.640 INFO:tasks.rados.rados.0.trial142.stdout:1883: rollback oid 28 current snap is 209 2026-02-17T11:57:41.640 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 207 2026-02-17T11:57:41.640 INFO:tasks.rados.rados.0.trial142.stdout:1884: delete oid 26 current snap is 209 2026-02-17T11:57:41.642 INFO:tasks.rados.rados.0.trial142.stdout:1884: done (1 left) 2026-02-17T11:57:41.642 INFO:tasks.rados.rados.0.trial142.stdout:1885: write (excl) oid 29 current snap is 209 2026-02-17T11:57:41.642 INFO:tasks.rados.rados.0.trial142.stdout:1885: seq_num 663 ranges {743041=412798,1930738=616566,3040503=102538} 2026-02-17T11:57:41.647 INFO:tasks.rados.rados.0.trial142.stdout:1885: writing trial14245205-29 from 743041 to 1155839 tid 1 2026-02-17T11:57:41.653 INFO:tasks.rados.rados.0.trial142.stdout:1885: writing trial14245205-29 from 1930738 to 2547304 tid 2 2026-02-17T11:57:41.655 INFO:tasks.rados.rados.0.trial142.stdout:1885: writing trial14245205-29 from 3040503 to 3143041 tid 3 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1886: write oid 12 current snap is 209 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1883: finishing rollback tid 0 to trial14245205-28 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1883: finishing rollback tid 1 to trial14245205-28 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1883: finishing rollback tid 2 to trial14245205-28 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 1019 (ObjNum 566 snap 172 seq_num 566) dirty exists 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1885: finishing write tid 1 to trial14245205-29 2026-02-17T11:57:41.656 INFO:tasks.rados.rados.0.trial142.stdout:1886: seq_num 664 ranges {759848=488047,1989220=760224} 2026-02-17T11:57:41.660 INFO:tasks.rados.rados.0.trial142.stdout:1886: writing trial14245205-12 from 759848 to 1247895 tid 1 2026-02-17T11:57:41.666 INFO:tasks.rados.rados.0.trial142.stdout:1886: writing trial14245205-12 from 1989220 to 2749444 tid 2 2026-02-17T11:57:41.666 INFO:tasks.rados.rados.0.trial142.stdout:1883: done (2 left) 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1887: read oid 3 snap -1 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1887: expect deleted 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1888: read oid 18 snap -1 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1888: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1889: read oid 39 snap 208 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1889: expect deleted 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1890: read oid 26 snap 206 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1890: expect (ObjNum 581 snap 181 seq_num 581) 2026-02-17T11:57:41.667 INFO:tasks.rados.rados.0.trial142.stdout:1891: snap_remove snap 201 2026-02-17T11:57:41.910 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 10 monclient: get_monmap_and_config 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 10 monclient: build_initial_monmap 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 10 monclient: monmap: 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:41.975431+0000 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:41.975431+0000 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:41.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 1 Processor -- start 2026-02-17T11:57:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 1 -- start start 2026-02-17T11:57:41.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.974+0000 7f3bf64fc640 10 monclient: init 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-a con 0x7f3bf00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3bf00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-b con 0x7f3bf013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf006e140 con 0x7f3bf00a0750 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf009f910 con 0x7f3bf00a3bb0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf009ccd0 con 0x7f3bf013b760 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf64fc640 10 monclient(hunting): authenticate will time out at 1349.594184s 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bef7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3bf00a0750 0x7f3bf009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44588/0 (socket says 10.20.193.51:44588) 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bef7fe640 1 -- 10.20.193.51:0/4184469092 learned_addr learned my addr 10.20.193.51:0/4184469092 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bf00a3bb0 auth_method 0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request con 0x7f3bf013b760 auth_method 0 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:41.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.975+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:41.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:41.977+0000 7f3bef7fe640 1 -- 10.20.193.51:0/4184469092 >> v1:10.20.193.51:6789/0 conn(0x7f3bf00a0750 legacy=0x7f3bf009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:42.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:42.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request con 0x7f3bf013b760 auth_method 0 2026-02-17T11:57:42.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:42.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bf00a3bb0 auth_method 0 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:42.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:42.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:42.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:42.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:42.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.175+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:42.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bf00a3bb0 auth_method 0 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request con 0x7f3bf013b760 auth_method 0 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:42.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:42.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:42.576+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bf00a3bb0 auth_method 0 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:43.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request con 0x7f3bf013b760 auth_method 0 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:43.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:43.377+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:44.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): tick 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 msgr2=0x7f3bf013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf013b760 0x7f3bf013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.51:3300/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 -- 10.20.193.51:0/4184469092 >> v1:10.20.193.51:6789/0 conn(0x7f3bf00a0750 legacy=0x7f3bf009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient: _add_conns ranks=[4,1] 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): picked mon.noname-c con 0x7f3bcc003820 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3bcc006370 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:44.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 -- 10.20.193.51:0/4184469092 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf009eec0 con 0x7f3bcc006370 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 1 -- 10.20.193.51:0/4184469092 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf009f910 con 0x7f3bcc003820 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3bedffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bcc003820 auth_method 0 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:44.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.975+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:44.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:44.977+0000 7f3bef7fe640 1 -- 10.20.193.51:0/4184469092 >> v1:10.20.193.142:6789/0 conn(0x7f3bcc006370 legacy=0x7f3bcc008830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bcc003820 auth_method 0 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:45.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.176+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bcc003820 auth_method 0 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:45.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:45.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:45.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:45.577+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bcc003820 auth_method 0 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:46.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:46.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:46.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:46.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.378+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:46.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377943117 0 0) 0x7f3bf009eec0 con 0x7f3bcc006370 2026-02-17T11:57:46.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): _negotiate 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): my global_id is 114433 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bd4003620 con 0x7f3bcc006370 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107865210 0 0) 0x7f3bd4003620 con 0x7f3bcc006370 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 msgr2=0x7f3bcc005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 --2- 10.20.193.51:0/4184469092 >> v2:10.20.193.142:3300/0 conn(0x7f3bcc003820 0x7f3bcc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _finish_hunting 0 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:46.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bcc00b1a0 con 0x7f3bcc006370 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _finish_auth 0 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f3be00032c0 con 0x7f3bcc006370 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: dump: 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:46.819 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:46.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 >> v1:10.20.193.142:6789/0 conn(0x7f3bcc006370 legacy=0x7f3bcc008830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf4a72640 1 -- 10.20.193.51:0/4184469092 reap_dead start 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 0x7f3bd4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): picked mon.c con 0x7f3bd4003b50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd4004900 0x7f3bd4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): picked mon.b con 0x7f3bd4004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 0x7f3bd400bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): picked mon.a con 0x7f3bd40054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf009f910 con 0x7f3bd40054c0 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400c3c0 con 0x7f3bd4004900 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd400c5c0 con 0x7f3bd4003b50 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beeffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 0x7f3bd4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bd4003b50 auth_method 0 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd4004900 0x7f3bd4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request con 0x7f3bd4004900 auth_method 0 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:46.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient(hunting): handle_auth_done global_id 114433 payload 293 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 0x7f3bd400bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd4004900 msgr2=0x7f3bd4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd4004900 0x7f3bd4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 msgr2=0x7f3bd400bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 0x7f3bd400bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 monclient: found mon.c 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd4003620 con 0x7f3bd4003b50 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient: _finish_auth 0 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:46.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3beffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf4a72640 10 monclient: get_auth_request con 0x7f3bd40054c0 auth_method 0 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 0x7f3bd400bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf64fc640 5 monclient: authenticate success, global_id 114433 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.805+0000 7f3bf64fc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beffff640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 msgr2=0x7f3bd4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:46.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beffff640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 0x7f3bd4003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc019ab0 tx=0x7f3bdc030ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379bfe3ce63170f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00f040 con 0x7f3bd4003b50 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: dump: 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:46.827 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc034650 con 0x7f3bd4003b50 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 1 -- 10.20.193.51:0/4184469092 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc034a40 con 0x7f3bd4003b50 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3beeffd640 10 monclient: dump: 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:46.829 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 4 set_mon_vals no callback set 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 10 monclient: shutdown 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 1 -- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 msgr2=0x7f3bd4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 0x7f3bd4003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc019ab0 tx=0x7f3bdc030ba0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 1 -- 10.20.193.51:0/4184469092 shutdown_connections 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd40054c0 0x7f3bd400bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.808+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd4004900 0x7f3bd4004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/4184469092 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4003b50 0x7f3bd4003f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 -- 10.20.193.51:0/4184469092 >> 10.20.193.51:0/4184469092 conn(0x7f3bf00a30c0 msgr2=0x7f3bf00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 -- 10.20.193.51:0/4184469092 shutdown_connections 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 -- 10.20.193.51:0/4184469092 wait complete. 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 10 monclient: build_initial_monmap 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 10 monclient: monmap: 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:46.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 Processor -- start 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 1 -- start start 2026-02-17T11:57:46.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.809+0000 7f3bf64fc640 10 monclient: init 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 0x7f3bf01ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-a con 0x7f3bd4003b50 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-c con 0x7f3bd4004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd40054c0 0x7f3bf0099e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): picked mon.noname-b con 0x7f3bd40054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:46.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf00a04b0 con 0x7f3bd4003b50 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf009c850 con 0x7f3bd40054c0 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf009dac0 con 0x7f3bd4004900 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf64fc640 10 monclient(hunting): authenticate will time out at 1354.429088s 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 0x7f3bf01ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46538/0 (socket says 10.20.193.51:46538) 2026-02-17T11:57:46.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2596312392 learned_addr learned my addr 10.20.193.51:0/2596312392 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request con 0x7f3bd4004900 auth_method 0 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): get_auth_request con 0x7f3bd4003b50 auth_method 0 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 msgr2=0x7f3bf0099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 msgr2=0x7f3bf0099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:46.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd40054c0 0x7f3bf0099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request con 0x7f3bd40054c0 auth_method 0 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3bf4a72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:46.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient(hunting): handle_auth_done global_id 164097 payload 824 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 msgr2=0x7f3bf0099940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd40054c0 msgr2=0x7f3bf0099e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd40054c0 0x7f3bf0099e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 monclient: found mon.noname-a 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.810+0000 7f3beffff640 1 -- 10.20.193.51:0/2596312392 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf01cda60 con 0x7f3bd4003b50 2026-02-17T11:57:46.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3beffff640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 msgr2=0x7f3bf01ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3beffff640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 0x7f3bf01ccd90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc038000 tx=0x7f3bdc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc03c810 con 0x7f3bd4003b50 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: dump: 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:46.838 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: _finish_auth 0 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: _check_auth_tickets 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc042040 con 0x7f3bd4003b50 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 5 monclient: authenticate success, global_id 164097 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 10 monclient: _renew_subs 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:46.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf0095100 con 0x7f3bd4003b50 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc03cc10 con 0x7f3bd4003b50 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3becff9640 10 monclient: dump: 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:46.840 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bee7fc640 4 set_mon_vals no callback set 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 10 monclient: _renew_subs 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.812+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf00935a0 con 0x7f3bd4003b50 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3bdc045070 con 0x7f3bd4003b50 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bf64fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bf64fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bf64fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:46.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf00a2380 con 0x7f3bd4003b50 2026-02-17T11:57:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3becff9640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 0x7f3bc0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(442..442 src has 323..442) ==== 4751+0+0 (secure 0 0 0) 0x7f3bdc079a00 con 0x7f3bd4003b50 2026-02-17T11:57:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 0x7f3bc0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:46.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.813+0000 7f3bef7fe640 10 monclient: get_auth_request con 0x7f3bc003dd60 auth_method 0 2026-02-17T11:57:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.816+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3bf00a2380 con 0x7f3bd4003b50 2026-02-17T11:57:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.816+0000 7f3becff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.816+0000 7f3becff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:46.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.816+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 0x7f3bc0040220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00a1890 tx=0x7f3be0007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:46.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.929+0000 7f3bf64fc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:46.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3bf64fc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:46.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3bf64fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:46.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3bf00a2770 con 0x7f3bd4003b50 2026-02-17T11:57:46.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3becff9640 1 -- 10.20.193.51:0/2596312392 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f3bdc038030 con 0x7f3bd4003b50 2026-02-17T11:57:46.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3becff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:46.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.930+0000 7f3becff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:46.932 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":106,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 msgr2=0x7f3bc0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 0x7f3bc0040220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00a1890 tx=0x7f3be0007c60 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 10 monclient: shutdown 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 msgr2=0x7f3bf01ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 0x7f3bf01ccd90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc038000 tx=0x7f3bdc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 shutdown_connections 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bc003dd60 0x7f3bc0040220 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bd40054c0 0x7f3bf0099e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bd4004900 0x7f3bf0099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 --2- 10.20.193.51:0/2596312392 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bd4003b50 0x7f3bf01ccd90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 >> 10.20.193.51:0/2596312392 conn(0x7f3bf00a30c0 msgr2=0x7f3bf013a980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 shutdown_connections 2026-02-17T11:57:46.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:46.931+0000 7f3bf64fc640 1 -- 10.20.193.51:0/2596312392 wait complete. 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1891: done (6 left) 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1892: copy_from oid 42 from oid 31 current snap is 209 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: finishing write tid 2 to trial14245205-29 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: finishing write tid 3 to trial14245205-29 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: finishing write tid 4 to trial14245205-29 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: finishing write tid 5 to trial14245205-29 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: oid 29 updating version 0 to 759 2026-02-17T11:57:47.785 INFO:tasks.rados.rados.0.trial142.stdout:1885: oid 29 updating version 759 to 761 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1885: oid 29 version 761 is already newer than 760 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1885: oid 29 version 761 is already newer than 758 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 761 (ObjNum 663 snap 209 seq_num 663) dirty exists 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1885: left oid 29 (ObjNum 663 snap 209 seq_num 663) 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1886: finishing write tid 1 to trial14245205-12 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1886: finishing write tid 2 to trial14245205-12 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1886: finishing write tid 3 to trial14245205-12 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1886: finishing write tid 4 to trial14245205-12 2026-02-17T11:57:47.786 INFO:tasks.rados.rados.0.trial142.stdout:1886: oid 12 updating version 0 to 1715 2026-02-17T11:57:47.787 INFO:tasks.rados.rados.0.trial142.stdout:1886: oid 12 updating version 1715 to 1716 2026-02-17T11:57:47.787 INFO:tasks.rados.rados.0.trial142.stdout:1886: oid 12 version 1716 is already newer than 1714 2026-02-17T11:57:47.787 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1716 (ObjNum 664 snap 209 seq_num 664) dirty exists 2026-02-17T11:57:47.787 INFO:tasks.rados.rados.0.trial142.stdout:1886: left oid 12 (ObjNum 664 snap 209 seq_num 664) 2026-02-17T11:57:47.787 INFO:tasks.rados.rados.0.trial142.stdout:1888: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:57:47.858 INFO:tasks.rados.rados.0.trial142.stdout:1890: expect (ObjNum 581 snap 181 seq_num 581) 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:1892: finishing copy_from racing read to trial14245205-42 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:1892: finishing copy_from to trial14245205-42 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1067 (ObjNum 626 snap 196 seq_num 626) dirty exists 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:1885: done (6 left) 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:1886: done (5 left) 2026-02-17T11:57:47.947 INFO:tasks.rados.rados.0.trial142.stdout:1887: done (4 left) 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1888: done (3 left) 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1889: done (2 left) 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1890: done (1 left) 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1892: done (0 left) 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1893: copy_from oid 48 from oid 2 current snap is 209 2026-02-17T11:57:47.948 INFO:tasks.rados.rados.0.trial142.stdout:1894: snap_create 2026-02-17T11:57:47.953 INFO:tasks.rados.rados.0.trial142.stdout:1893: finishing copy_from racing read to trial14245205-48 2026-02-17T11:57:47.954 INFO:tasks.rados.rados.0.trial142.stdout:1893: finishing copy_from to trial14245205-48 2026-02-17T11:57:47.954 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1008 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:57:49.941 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.009+0000 7fa563a6f640 10 monclient: get_monmap_and_config 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.009+0000 7fa563a6f640 10 monclient: build_initial_monmap 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.009+0000 7fa563a6f640 10 monclient: monmap: 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:50.013 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:50.010801+0000 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:50.010801+0000 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 Processor -- start 2026-02-17T11:57:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 -- start start 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient: init 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-a con 0x7fa55c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa55c09ff40 addr v1:10.20.193.142:6789/0 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c06e140 con 0x7fa55c09ff40 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c09aed0 con 0x7fa55c0a3bb0 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c09caa0 con 0x7fa55c09dac0 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa563a6f640 10 monclient(hunting): authenticate will time out at 1357.629604s 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46554/0 (socket says 10.20.193.51:46554) 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 learned_addr learned my addr 10.20.193.51:0/4215706317 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 10 monclient(hunting): get_auth_request con 0x7fa55c0a3bb0 auth_method 0 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:50.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:50.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.010+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:50.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.013+0000 7fa561fe5640 1 -- 10.20.193.51:0/4215706317 >> v1:10.20.193.142:6789/0 conn(0x7fa55c09ff40 legacy=0x7fa55c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 10 monclient(hunting): get_auth_request con 0x7fa55c0a3bb0 auth_method 0 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.211+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:50.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 10 monclient(hunting): get_auth_request con 0x7fa55c0a3bb0 auth_method 0 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:50.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:50.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:50.612+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 10 monclient(hunting): get_auth_request con 0x7fa55c0a3bb0 auth_method 0 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:51.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa5617e4640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:51.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:51.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:51.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:51.413+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:52.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646673955 0 0) 0x7fa55c06e140 con 0x7fa55c09ff40 2026-02-17T11:57:52.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:57:52.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:52.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): my global_id is 114439 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa544003620 con 0x7fa55c09ff40 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1538721885 0 0) 0x7fa544003620 con 0x7fa55c09ff40 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c09fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa55c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 msgr2=0x7fa55c09f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 --2- 10.20.193.51:0/4215706317 >> v2:10.20.193.51:3300/0 conn(0x7fa55c0a3bb0 0x7fa55c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:52.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c09ce60 con 0x7fa55c09ff40 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _finish_auth 0 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fa558003580 con 0x7fa55c09ff40 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: dump: 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.817 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 >> v1:10.20.193.142:6789/0 conn(0x7fa55c09ff40 legacy=0x7fa55c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:52.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa544003c20 0x7fa544004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): picked mon.a con 0x7fa544003c20 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa544004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): picked mon.c con 0x7fa55c09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa544004f60 0x7fa54400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): picked mon.b con 0x7fa544004f60 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c09aed0 con 0x7fa544003c20 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c09caa0 con 0x7fa544004f60 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa54400c000 con 0x7fa55c09dac0 2026-02-17T11:57:52.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa54bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa544004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient(hunting): handle_auth_done global_id 114439 payload 293 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa544004f60 msgr2=0x7fa54400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:52.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa544004f60 0x7fa54400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa544003c20 msgr2=0x7fa544004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa544003c20 0x7fa544004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient: _finish_hunting 0 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 monclient: found mon.c 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544003620 con 0x7fa55c09dac0 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient: _finish_auth 0 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 10 monclient: _check_auth_tickets 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa560fe3640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa563a6f640 5 monclient: authenticate success, global_id 114439 2026-02-17T11:57:52.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.806+0000 7fa563a6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa560fe3640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa544004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa560fe3640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa544004900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa550003b10 tx=0x7fa55002fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12af224d05602ae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550039070 con 0x7fa55c09dac0 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: dump: 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550034680 con 0x7fa55c09dac0 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa563a6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 1 -- 10.20.193.51:0/4215706317 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550003710 con 0x7fa55c09dac0 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:52.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa54bfff640 10 monclient: dump: 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa563a6f640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.809+0000 7fa563a6f640 4 set_mon_vals no callback set 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 10 monclient: shutdown 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 -- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 msgr2=0x7fa544004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 --2- 10.20.193.51:0/4215706317 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c09dac0 0x7fa544004900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa550003b10 tx=0x7fa55002fb70 comp rx=0 tx=0).stop 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa561fe5640 1 -- 10.20.193.51:0/4215706317 reap_dead start 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 -- 10.20.193.51:0/4215706317 shutdown_connections 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 -- 10.20.193.51:0/4215706317 >> 10.20.193.51:0/4215706317 conn(0x7fa55c0a30c0 msgr2=0x7fa55c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 -- 10.20.193.51:0/4215706317 shutdown_connections 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.810+0000 7fa563a6f640 1 -- 10.20.193.51:0/4215706317 wait complete. 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient: build_initial_monmap 2026-02-17T11:57:52.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient: monmap: 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 Processor -- start 2026-02-17T11:57:52.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 -- start start 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient: init 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 0x7fa55c1caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-a con 0x7fa55c09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 0x7fa55c090840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c1cb480 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): picked mon.noname-c con 0x7fa55c1cb8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c09a880 con 0x7fa55c09dac0 2026-02-17T11:57:52.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0a3f90 con 0x7fa55c1cb480 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c0a0370 con 0x7fa55c1cb8a0 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa563a6f640 10 monclient(hunting): authenticate will time out at 1360.430608s 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 0x7fa55c1caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46620/0 (socket says 10.20.193.51:46620) 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 -- 10.20.193.51:0/1866502631 learned_addr learned my addr 10.20.193.51:0/1866502631 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 10 monclient(hunting): get_auth_request con 0x7fa55c1cb8a0 auth_method 0 2026-02-17T11:57:52.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): get_auth_request con 0x7fa55c09dac0 auth_method 0 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 msgr2=0x7fa55c090d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 msgr2=0x7fa55c090d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa561fe5640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:52.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient(hunting): handle_auth_done global_id 164100 payload 824 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 msgr2=0x7fa55c090d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa560fe3640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 0x7fa55c090840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 msgr2=0x7fa55c090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 0x7fa55c090840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient: _finish_hunting 0 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 monclient: found mon.noname-a 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa5617e4640 1 -- 10.20.193.51:0/1866502631 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c094670 con 0x7fa55c09dac0 2026-02-17T11:57:52.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa560fe3640 10 monclient: get_auth_request con 0x7fa55c1cb480 auth_method 0 2026-02-17T11:57:52.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.811+0000 7fa560fe3640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 0x7fa55c090840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:57:52.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.813+0000 7fa5617e4640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c1caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:52.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.813+0000 7fa5617e4640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 0x7fa55c1caf40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00d540 tx=0x7fa54c017250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:52.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c004030 con 0x7fa55c09dac0 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: dump: 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:52.834 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 5 monclient: authenticate success, global_id 164100 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c0041d0 con 0x7fa55c09dac0 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _renew_subs 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c09d7b0 con 0x7fa55c09dac0 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0045c0 con 0x7fa55c09dac0 2026-02-17T11:57:52.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa54b7fe640 4 set_mon_vals no callback set 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 10 monclient: dump: 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:52.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _renew_subs 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c094390 con 0x7fa55c09dac0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa54c02c060 con 0x7fa55c09dac0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.814+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c09e370 con 0x7fa55c09dac0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.815+0000 7fa549ffb640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 0x7fa52c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.815+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(443..443 src has 323..443) ==== 4779+0+0 (secure 0 0 0) 0x7fa54c0572a0 con 0x7fa55c09dac0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.815+0000 7fa560fe3640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 0x7fa52c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:52.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.815+0000 7fa560fe3640 10 monclient: get_auth_request con 0x7fa52c03dd60 auth_method 0 2026-02-17T11:57:52.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.817+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa54c055ca0 con 0x7fa55c09dac0 2026-02-17T11:57:52.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.817+0000 7fa549ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:52.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.817+0000 7fa549ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:52.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.818+0000 7fa560fe3640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 0x7fa52c040220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa550038000 tx=0x7fa550034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:52.864 INFO:tasks.rados.rados.0.trial142.stdout:1893: done (1 left) 2026-02-17T11:57:52.864 INFO:tasks.rados.rados.0.trial142.stdout:1894: done (0 left) 2026-02-17T11:57:52.864 INFO:tasks.rados.rados.0.trial142.stdout:1895: snap_remove snap 198 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa563a6f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa563a6f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa563a6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa55c09fb80 con 0x7fa55c09dac0 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa549ffb640 1 -- 10.20.193.51:0/1866502631 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fa54c019da0 con 0x7fa55c09dac0 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa549ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:52.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.929+0000 7fa549ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:52.933 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":110,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 msgr2=0x7fa52c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 0x7fa52c040220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa550038000 tx=0x7fa550034000 comp rx=0 tx=0).stop 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 10 monclient: shutdown 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 msgr2=0x7fa55c1caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 0x7fa55c1caf40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00d540 tx=0x7fa54c017250 comp rx=0 tx=0).stop 2026-02-17T11:57:52.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 shutdown_connections 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa52c03dd60 0x7fa52c040220 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa55c1cb8a0 0x7fa55c090d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa55c1cb480 0x7fa55c090840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 --2- 10.20.193.51:0/1866502631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa55c09dac0 0x7fa55c1caf40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 >> 10.20.193.51:0/1866502631 conn(0x7fa55c0a30c0 msgr2=0x7fa55c071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 shutdown_connections 2026-02-17T11:57:52.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:52.930+0000 7fa563a6f640 1 -- 10.20.193.51:0/1866502631 wait complete. 2026-02-17T11:57:55.941 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:57:56.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 10 monclient: get_monmap_and_config 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 10 monclient: build_initial_monmap 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 10 monclient: monmap: 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:57:56.007201+0000 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:57:56.007201+0000 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:57:56.011 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 1 Processor -- start 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 1 -- start start 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 10 monclient: init 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.006+0000 7f58eb5a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f58e406eb80 addr v1:10.20.193.51:6789/0 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-b con 0x7f58e4138460 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:56.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-c con 0x7f58e4138860 addr v2:10.20.193.142:3300/0 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e406ff80 con 0x7f58e406eb80 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f58e406ef60 con 0x7f58e4138860 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f58e4070d90 con 0x7f58e4138460 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58eb5a9640 10 monclient(hunting): authenticate will time out at 1363.626075s 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e931e640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f58e406eb80 0x7f58e4137d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58736/0 (socket says 10.20.193.51:58736) 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e931e640 1 -- 10.20.193.51:0/119992253 learned_addr learned my addr 10.20.193.51:0/119992253 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58e4138460 auth_method 0 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e4138860 auth_method 0 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:56.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:56.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.007+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:56.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.009+0000 7f58e931e640 1 -- 10.20.193.51:0/119992253 >> v1:10.20.193.51:6789/0 conn(0x7f58e406eb80 legacy=0x7f58e4137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:56.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58e4138460 auth_method 0 2026-02-17T11:57:56.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e4138860 auth_method 0 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:56.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:56.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.208+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:57:56.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58e4138460 auth_method 0 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e4138860 auth_method 0 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:56.609+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58e4138460 auth_method 0 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:57:57.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e4138860 auth_method 0 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:57:57.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:57.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:57.410+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:57:58.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458219898 0 0) 0x7f58d4002c60 con 0x7f58e406eb80 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 10 monclient(hunting): _negotiate 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 10 monclient(hunting): my global_id is 164103 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.809+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc003620 con 0x7f58e406eb80 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619567277 0 0) 0x7f58cc003620 con 0x7f58e406eb80 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58e413d090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58e413d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 msgr2=0x7f58e413f5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:57:58.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 --2- 10.20.193.51:0/119992253 >> v2:10.20.193.142:3300/0 conn(0x7f58e4138860 0x7f58e413f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e406f9c0 con 0x7f58e406eb80 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f58d4003380 con 0x7f58e406eb80 2026-02-17T11:57:58.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: dump: 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:58.817 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 >> v1:10.20.193.51:6789/0 conn(0x7f58e406eb80 legacy=0x7f58e4137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58cc003bd0 0x7f58cc003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): picked mon.b con 0x7f58cc003bd0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 0x7f58cc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): picked mon.a con 0x7f58cc004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58cc00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): picked mon.c con 0x7f58e4138460 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f58e406ef60 con 0x7f58cc004900 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4070d90 con 0x7f58cc003bd0 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f58cc005720 con 0x7f58e4138460 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 0x7f58cc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58cc004900 auth_method 0 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58cc00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e4138460 auth_method 0 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient(hunting): handle_auth_done global_id 164103 payload 293 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 msgr2=0x7f58cc00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58e4138460 0x7f58cc00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58cc003bd0 msgr2=0x7f58cc003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58cc003bd0 0x7f58cc003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient: _finish_hunting 0 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 monclient: found mon.a 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc003620 con 0x7f58cc004900 2026-02-17T11:57:58.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient: _finish_auth 0 2026-02-17T11:57:58.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 10 monclient: _check_auth_tickets 2026-02-17T11:57:58.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58e8b1d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:58.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58eb5a9640 5 monclient: authenticate success, global_id 164103 2026-02-17T11:57:58.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.810+0000 7f58eb5a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58e8b1d640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 msgr2=0x7f58cc004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 0x7f58cc004d80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58d80129a0 tx=0x7f58d802fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84395d9a137d2fb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8039070 con 0x7f58cc004900 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:58.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: dump: 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:58.830 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d8035660 con 0x7f58cc004900 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 1 -- 10.20.193.51:0/119992253 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d800f040 con 0x7f58cc004900 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 4 set_mon_vals no callback set 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58d3fff640 10 monclient: dump: 2026-02-17T11:57:58.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 10 monclient: shutdown 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:58.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 -- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 msgr2=0x7f58cc004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/119992253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58cc004900 0x7f58cc004d80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58d80129a0 tx=0x7f58d802fbc0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58e9b1f640 1 -- 10.20.193.51:0/119992253 reap_dead start 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 -- 10.20.193.51:0/119992253 shutdown_connections 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 -- 10.20.193.51:0/119992253 >> 10.20.193.51:0/119992253 conn(0x7f58e40a8c80 msgr2=0x7f58e40a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 -- 10.20.193.51:0/119992253 shutdown_connections 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.813+0000 7f58eb5a9640 1 -- 10.20.193.51:0/119992253 wait complete. 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient: build_initial_monmap 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient: monmap: 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:58.833 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 Processor -- start 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 -- start start 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient: init 2026-02-17T11:57:58.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-c con 0x7f58cc004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58e409cd00 0x7f58e409d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-b con 0x7f58e409cd00 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): picked mon.noname-a con 0x7f58e409d660 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f58e413b200 con 0x7f58e409d660 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58e413b080 con 0x7f58e409cd00 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f58e413b380 con 0x7f58cc004900 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58eb5a9640 10 monclient(hunting): authenticate will time out at 1366.433952s 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.814+0000 7f58e9b1f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36412/0 (socket says 10.20.193.51:36412) 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 -- 10.20.193.51:0/1025986724 learned_addr learned my addr 10.20.193.51:0/1025986724 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request con 0x7f58e409d660 auth_method 0 2026-02-17T11:57:58.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 10 monclient(hunting): get_auth_request con 0x7f58cc004900 auth_method 0 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e8b1d640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58e409cd00 0x7f58e409d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 msgr2=0x7f58e409c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 msgr2=0x7f58e409c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request con 0x7f58e409cd00 auth_method 0 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e8b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e8b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e8b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient(hunting): handle_auth_done global_id 164106 payload 824 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e931e640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 msgr2=0x7f58e409c7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:57:58.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58e409cd00 msgr2=0x7f58e409d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58e409cd00 0x7f58e409d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient: _finish_hunting 0 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 monclient: found mon.noname-a 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.815+0000 7f58e9b1f640 1 -- 10.20.193.51:0/1025986724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e409df20 con 0x7f58e409d660 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58e9b1f640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 msgr2=0x7f58e41d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58e9b1f640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f58e0003fd0 tx=0x7f58e0015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e001b070 con 0x7f58e409d660 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: dump: 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.840 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e0020680 con 0x7f58e409d660 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 5 monclient: authenticate success, global_id 164106 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0020a70 con 0x7f58e409d660 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d37fe640 4 set_mon_vals no callback set 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 10 monclient: dump: 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:57:58.842 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 10 monclient: _renew_subs 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e409f7a0 con 0x7f58e409d660 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 10 monclient: _renew_subs 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e409e820 con 0x7f58e409d660 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.817+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f58e0028020 con 0x7f58e409d660 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58d1ffb640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 0x7f58b40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(444..444 src has 323..444) ==== 4751+0+0 (secure 0 0 0) 0x7f58e0053cb0 con 0x7f58e409d660 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58eb5a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58eb5a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58eb5a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e4137d50 con 0x7f58e409d660 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58e931e640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 0x7f58b40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.818+0000 7f58e931e640 10 monclient: get_auth_request con 0x7f58b403dd10 auth_method 0 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.820+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f58e0010050 con 0x7f58e409d660 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.820+0000 7f58d1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.820+0000 7f58d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:58.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.820+0000 7f58e931e640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 0x7f58b40401d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f58d40036e0 tx=0x7f58d4002d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.865 INFO:tasks.rados.rados.0.trial142.stdout:1895: done (0 left) 2026-02-17T11:57:58.865 INFO:tasks.rados.rados.0.trial142.stdout:1896: read oid 42 snap -1 2026-02-17T11:57:58.866 INFO:tasks.rados.rados.0.trial142.stdout:1896: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:57:58.866 INFO:tasks.rados.rados.0.trial142.stdout:1897: delete oid 48 current snap is 210 2026-02-17T11:57:58.869 INFO:tasks.rados.rados.0.trial142.stdout:1897: done (1 left) 2026-02-17T11:57:58.869 INFO:tasks.rados.rados.0.trial142.stdout:1898: write (excl) oid 21 current snap is 210 2026-02-17T11:57:58.869 INFO:tasks.rados.rados.0.trial142.stdout:1898: seq_num 666 ranges {793462=638545,2106184=763893} 2026-02-17T11:57:58.875 INFO:tasks.rados.rados.0.trial142.stdout:1898: writing trial14245205-21 from 793462 to 1432007 tid 1 2026-02-17T11:57:58.880 INFO:tasks.rados.rados.0.trial142.stdout:1898: writing trial14245205-21 from 2106184 to 2870077 tid 2 2026-02-17T11:57:58.880 INFO:tasks.rados.rados.0.trial142.stdout:1899: copy_from oid 12 from oid 20 current snap is 210 2026-02-17T11:57:58.880 INFO:tasks.rados.rados.0.trial142.stdout:1896: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:57:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.934+0000 7f58eb5a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:57:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.934+0000 7f58eb5a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:58.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.934+0000 7f58eb5a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:57:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.934+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58e409e160 con 0x7f58e409d660 2026-02-17T11:57:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.935+0000 7f58d1ffb640 1 -- 10.20.193.51:0/1025986724 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f58e001dd90 con 0x7f58e409d660 2026-02-17T11:57:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.935+0000 7f58d1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:57:58.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.935+0000 7f58d1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:58.938 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:57:58.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 msgr2=0x7f58b40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 0x7f58b40401d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f58d40036e0 tx=0x7f58d4002d80 comp rx=0 tx=0).stop 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 10 monclient: shutdown 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 msgr2=0x7f58e41d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f58e0003fd0 tx=0x7f58e0015700 comp rx=0 tx=0).stop 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 shutdown_connections 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f58b403dd10 0x7f58b40401d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f58e409d660 0x7f58e41d5460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f58e409cd00 0x7f58e409d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 --2- 10.20.193.51:0/1025986724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f58cc004900 0x7f58e409c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 >> 10.20.193.51:0/1025986724 conn(0x7f58e40a8c80 msgr2=0x7f58e4071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 shutdown_connections 2026-02-17T11:57:58.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:57:58.936+0000 7f58eb5a9640 1 -- 10.20.193.51:0/1025986724 wait complete. 2026-02-17T11:57:58.942 INFO:tasks.rados.rados.0.trial142.stdout:1898: finishing write tid 1 to trial14245205-21 2026-02-17T11:57:58.942 INFO:tasks.rados.rados.0.trial142.stdout:1896: done (2 left) 2026-02-17T11:57:58.942 INFO:tasks.rados.rados.0.trial142.stdout:1900: rollback oid 35 current snap is 210 2026-02-17T11:57:58.942 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 200 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1899: finishing copy_from to trial14245205-12 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1899: got expected ENOENT (src dne) 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1899: finishing copy_from racing read to trial14245205-12 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: finishing write tid 2 to trial14245205-21 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: finishing write tid 3 to trial14245205-21 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: finishing write tid 4 to trial14245205-21 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: oid 21 updating version 0 to 993 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: oid 21 updating version 993 to 994 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: oid 21 version 994 is already newer than 992 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 994 (ObjNum 666 snap 210 seq_num 666) dirty exists 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: left oid 21 (ObjNum 666 snap 210 seq_num 666) 2026-02-17T11:57:58.943 INFO:tasks.rados.rados.0.trial142.stdout:1898: done (2 left) 2026-02-17T11:57:58.944 INFO:tasks.rados.rados.0.trial142.stdout:1899: done (1 left) 2026-02-17T11:57:58.944 INFO:tasks.rados.rados.0.trial142.stdout:1901: write oid 25 current snap is 210 2026-02-17T11:57:58.944 INFO:tasks.rados.rados.0.trial142.stdout:1901: seq_num 667 ranges {410269=713794,1648313=507551,2917489=292780} 2026-02-17T11:57:58.944 INFO:tasks.rados.rados.0.trial142.stdout:1901: writing trial14245205-25 from 410269 to 1124063 tid 1 2026-02-17T11:57:58.947 INFO:tasks.rados.rados.0.trial142.stdout:1901: writing trial14245205-25 from 1648313 to 2155864 tid 2 2026-02-17T11:57:58.951 INFO:tasks.rados.rados.0.trial142.stdout:1901: writing trial14245205-25 from 2917489 to 3210269 tid 3 2026-02-17T11:57:58.951 INFO:tasks.rados.rados.0.trial142.stdout:1902: write (excl) oid 46 current snap is 210 2026-02-17T11:57:58.951 INFO:tasks.rados.rados.0.trial142.stdout:1902: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2026-02-17T11:57:58.956 INFO:tasks.rados.rados.0.trial142.stdout:1902: writing trial14245205-46 from 427076 to 1216119 tid 1 2026-02-17T11:57:58.960 INFO:tasks.rados.rados.0.trial142.stdout:1902: writing trial14245205-46 from 1706795 to 2474357 tid 2 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1902: writing trial14245205-46 from 2944912 to 3227076 tid 3 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1903: snap_create 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1900: finishing rollback tid 1 to trial14245205-35 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1575 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: finishing write tid 1 to trial14245205-25 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: finishing write tid 2 to trial14245205-25 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: finishing write tid 3 to trial14245205-25 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: finishing write tid 4 to trial14245205-25 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: finishing write tid 5 to trial14245205-25 2026-02-17T11:57:58.964 INFO:tasks.rados.rados.0.trial142.stdout:1901: oid 25 updating version 0 to 777 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1901: oid 25 version 777 is already newer than 776 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1901: oid 25 version 777 is already newer than 774 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1901: oid 25 version 777 is already newer than 775 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 777 (ObjNum 667 snap 210 seq_num 667) dirty exists 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1901: left oid 25 (ObjNum 667 snap 210 seq_num 667) 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1902: finishing write tid 1 to trial14245205-46 2026-02-17T11:57:58.965 INFO:tasks.rados.rados.0.trial142.stdout:1902: finishing write tid 2 to trial14245205-46 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: finishing write tid 3 to trial14245205-46 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: finishing write tid 4 to trial14245205-46 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: finishing write tid 5 to trial14245205-46 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: oid 46 updating version 0 to 1736 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: oid 46 updating version 1736 to 1737 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: oid 46 version 1737 is already newer than 1735 2026-02-17T11:57:58.966 INFO:tasks.rados.rados.0.trial142.stdout:1902: oid 46 version 1737 is already newer than 1734 2026-02-17T11:57:58.967 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1737 (ObjNum 668 snap 210 seq_num 668) dirty exists 2026-02-17T11:57:58.967 INFO:tasks.rados.rados.0.trial142.stdout:1902: left oid 46 (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:58:01.063 INFO:tasks.rados.rados.0.trial142.stdout:1900: done (3 left) 2026-02-17T11:58:01.063 INFO:tasks.rados.rados.0.trial142.stdout:1901: done (2 left) 2026-02-17T11:58:01.063 INFO:tasks.rados.rados.0.trial142.stdout:1902: done (1 left) 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:1903: done (0 left) 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:1904: rollback oid 1 current snap is 211 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 209 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:1905: copy_from oid 48 from oid 43 current snap is 211 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:1906: write (excl) oid 22 current snap is 211 2026-02-17T11:58:01.064 INFO:tasks.rados.rados.0.trial142.stdout:1906: seq_num 669 ranges {443883=464292,1365277=511220,2572335=671548} 2026-02-17T11:58:01.066 INFO:tasks.rados.rados.0.trial142.stdout:1906: writing trial14245205-22 from 443883 to 908175 tid 1 2026-02-17T11:58:01.069 INFO:tasks.rados.rados.0.trial142.stdout:1906: writing trial14245205-22 from 1365277 to 1876497 tid 2 2026-02-17T11:58:01.075 INFO:tasks.rados.rados.0.trial142.stdout:1906: writing trial14245205-22 from 2572335 to 3243883 tid 3 2026-02-17T11:58:01.075 INFO:tasks.rados.rados.0.trial142.stdout:1907: write oid 8 current snap is 211 2026-02-17T11:58:01.075 INFO:tasks.rados.rados.0.trial142.stdout:1907: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2026-02-17T11:58:01.079 INFO:tasks.rados.rados.0.trial142.stdout:1907: writing trial14245205-8 from 460690 to 1116584 tid 1 2026-02-17T11:58:01.083 INFO:tasks.rados.rados.0.trial142.stdout:1907: writing trial14245205-8 from 1540112 to 2311343 tid 2 2026-02-17T11:58:01.087 INFO:tasks.rados.rados.0.trial142.stdout:1907: writing trial14245205-8 from 2716111 to 3255889 tid 3 2026-02-17T11:58:01.087 INFO:tasks.rados.rados.0.trial142.stdout:1908: snap_remove snap 189 2026-02-17T11:58:01.947 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.014+0000 7f9e7e038640 10 monclient: get_monmap_and_config 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.014+0000 7f9e7e038640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.014+0000 7f9e7e038640 10 monclient: monmap: 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:02.015756+0000 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:02.015756+0000 2026-02-17T11:58:02.019 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 Processor -- start 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 -- start start 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient: init 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9e780a3bb0 0x7f9e7809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-a con 0x7f9e780a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9e7809dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9e780a0110 0x7f9e7813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-c con 0x7f9e780a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7806e140 con 0x7f9e7809dac0 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7809aed0 con 0x7f9e780a3bb0 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7809caa0 con 0x7f9e780a0110 2026-02-17T11:58:02.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e7e038640 10 monclient(hunting): authenticate will time out at 1369.634551s 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9e780a3bb0 0x7f9e7809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e76ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9e7809dac0 0x7f9e7809fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58740/0 (socket says 10.20.193.51:58740) 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e76ffd640 1 -- 10.20.193.51:0/3399201238 learned_addr learned my addr 10.20.193.51:0/3399201238 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): get_auth_request con 0x7f9e780a3bb0 auth_method 0 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e77fff640 1 --2- 10.20.193.51:0/3399201238 >> v2:10.20.193.142:3300/0 conn(0x7f9e780a0110 0x7f9e7813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e77fff640 10 monclient(hunting): get_auth_request con 0x7f9e780a0110 auth_method 0 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient(hunting): handle_auth_done global_id 164109 payload 274 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 -- 10.20.193.51:0/3399201238 >> v2:10.20.193.142:3300/0 conn(0x7f9e780a0110 msgr2=0x7f9e7813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 --2- 10.20.193.51:0/3399201238 >> v2:10.20.193.142:3300/0 conn(0x7f9e780a0110 0x7f9e7813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 -- 10.20.193.51:0/3399201238 >> v1:10.20.193.51:6789/0 conn(0x7f9e7809dac0 legacy=0x7f9e7809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.015+0000 7f9e777fe640 1 -- 10.20.193.51:0/3399201238 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7809ce60 con 0x7f9e780a3bb0 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e777fe640 1 -- 10.20.193.51:0/3399201238 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e780a3bb0 msgr2=0x7f9e7809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e777fe640 1 --2- 10.20.193.51:0/3399201238 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e780a3bb0 0x7f9e7809f4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e7809cc20 tx=0x7f9e6402ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929905f42e49f672 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 1 -- 10.20.193.51:0/3399201238 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6403c070 con 0x7f9e780a3bb0 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: dump: 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 5 monclient: authenticate success, global_id 164109 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 1 -- 10.20.193.51:0/3399201238 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6402fbd0 con 0x7f9e780a3bb0 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 1 -- 10.20.193.51:0/3399201238 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64037440 con 0x7f9e780a3bb0 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 4 set_mon_vals no callback set 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e767fc640 10 monclient: dump: 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 10 monclient: shutdown 2026-02-17T11:58:02.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 -- 10.20.193.51:0/3399201238 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e780a3bb0 msgr2=0x7f9e7809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 --2- 10.20.193.51:0/3399201238 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e780a3bb0 0x7f9e7809f4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e7809cc20 tx=0x7f9e6402ed50 comp rx=0 tx=0).stop 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 -- 10.20.193.51:0/3399201238 shutdown_connections 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 --2- 10.20.193.51:0/3399201238 >> v2:10.20.193.142:3300/0 conn(0x7f9e780a0110 0x7f9e7813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 --2- 10.20.193.51:0/3399201238 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e780a3bb0 0x7f9e7809f4c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 -- 10.20.193.51:0/3399201238 >> 10.20.193.51:0/3399201238 conn(0x7f9e780a30c0 msgr2=0x7f9e780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 -- 10.20.193.51:0/3399201238 shutdown_connections 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.018+0000 7f9e7e038640 1 -- 10.20.193.51:0/3399201238 wait complete. 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient: monmap: 2026-02-17T11:58:02.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 Processor -- start 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 -- start start 2026-02-17T11:58:02.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient: init 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-a con 0x7f9e7809dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e780a0110 0x7f9e78099c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-c con 0x7f9e780a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e780a3bb0 0x7f9e781cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): picked mon.noname-b con 0x7f9e780a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780a0540 con 0x7f9e7809dac0 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7809a880 con 0x7f9e780a3bb0 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7813cca0 con 0x7f9e780a0110 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e7e038640 10 monclient(hunting): authenticate will time out at 1369.638919s 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36420/0 (socket says 10.20.193.51:36420) 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 1 -- 10.20.193.51:0/1957970486 learned_addr learned my addr 10.20.193.51:0/1957970486 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 10 monclient(hunting): get_auth_request con 0x7f9e7809dac0 auth_method 0 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.019+0000 7f9e76ffd640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e780a0110 0x7f9e78099c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): get_auth_request con 0x7f9e780a0110 auth_method 0 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e76ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient(hunting): handle_auth_done global_id 164112 payload 824 2026-02-17T11:58:02.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 -- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e780a0110 msgr2=0x7f9e78099c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e780a0110 0x7f9e78099c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 -- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e780a3bb0 msgr2=0x7f9e781cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e780a3bb0 0x7f9e781cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.020+0000 7f9e777fe640 1 -- 10.20.193.51:0/1957970486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78095c80 con 0x7f9e7809dac0 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e777fe640 1 -- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 msgr2=0x7f9e781cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e777fe640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e64002410 tx=0x7f9e640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6403c040 con 0x7f9e7809dac0 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: dump: 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e64047070 con 0x7f9e7809dac0 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 5 monclient: authenticate success, global_id 164112 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 10 monclient: _renew_subs 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e78098480 con 0x7f9e7809dac0 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64040a60 con 0x7f9e7809dac0 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e75ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 10 monclient: dump: 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.042 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 10 monclient: _renew_subs 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7809d7b0 con 0x7f9e7809dac0 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.022+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9e6403f030 con 0x7f9e7809dac0 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e7e038640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e7e038640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e7e038640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e780a29a0 con 0x7f9e7809dac0 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e53fff640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 0x7f9e48040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(446..446 src has 323..446) ==== 4767+0+0 (secure 0 0 0) 0x7f9e64077920 con 0x7f9e7809dac0 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e76ffd640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 0x7f9e48040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.023+0000 7f9e76ffd640 10 monclient: get_auth_request con 0x7f9e4803dd60 auth_method 0 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.025+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9e64076330 con 0x7f9e7809dac0 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.025+0000 7f9e53fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.025+0000 7f9e53fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:02.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.025+0000 7f9e76ffd640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 0x7f9e48040220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9e68007d90 tx=0x7f9e68007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1908: done (4 left) 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1909: delete oid 33 current snap is 211 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1904: finishing rollback tid 0 to trial14245205-1 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1904: finishing rollback tid 1 to trial14245205-1 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1904: finishing rollback tid 2 to trial14245205-1 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1036 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1906: finishing write tid 1 to trial14245205-22 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1905: finishing copy_from racing read to trial14245205-48 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:1905: finishing copy_from to trial14245205-48 2026-02-17T11:58:02.072 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1588 (ObjNum 635 snap 197 seq_num 635) dirty exists 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: finishing write tid 2 to trial14245205-22 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: finishing write tid 3 to trial14245205-22 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: finishing write tid 4 to trial14245205-22 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: finishing write tid 5 to trial14245205-22 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: oid 22 updating version 0 to 1039 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: oid 22 version 1039 is already newer than 1038 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: oid 22 updating version 1039 to 1040 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: oid 22 version 1040 is already newer than 1037 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 1040 (ObjNum 669 snap 211 seq_num 669) dirty exists 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1906: left oid 22 (ObjNum 669 snap 211 seq_num 669) 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: finishing write tid 1 to trial14245205-8 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: finishing write tid 2 to trial14245205-8 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: finishing write tid 3 to trial14245205-8 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: finishing write tid 4 to trial14245205-8 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: finishing write tid 5 to trial14245205-8 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: oid 8 updating version 0 to 1576 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: oid 8 updating version 1576 to 1578 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: oid 8 version 1578 is already newer than 1577 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: oid 8 updating version 1578 to 1579 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1579 (ObjNum 670 snap 211 seq_num 670) dirty exists 2026-02-17T11:58:02.073 INFO:tasks.rados.rados.0.trial142.stdout:1907: left oid 8 (ObjNum 670 snap 211 seq_num 670) 2026-02-17T11:58:02.074 INFO:tasks.rados.rados.0.trial142.stdout:1904: done (4 left) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1905: done (3 left) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1906: done (2 left) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1907: done (1 left) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1909: done (0 left) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1910: read oid 8 snap -1 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1910: expect (ObjNum 670 snap 211 seq_num 670) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1911: read oid 12 snap -1 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1911: expect (ObjNum 664 snap 209 seq_num 664) 2026-02-17T11:58:02.075 INFO:tasks.rados.rados.0.trial142.stdout:1912: delete oid 39 current snap is 211 2026-02-17T11:58:02.076 INFO:tasks.rados.rados.0.trial142.stdout:1912: done (2 left) 2026-02-17T11:58:02.076 INFO:tasks.rados.rados.0.trial142.stdout:1913: write (excl) oid 49 current snap is 211 2026-02-17T11:58:02.076 INFO:tasks.rados.rados.0.trial142.stdout:1913: seq_num 673 ranges {511111=481641,1599205=518558,2682027=489947} 2026-02-17T11:58:02.080 INFO:tasks.rados.rados.0.trial142.stdout:1913: writing trial14245205-49 from 511111 to 992752 tid 1 2026-02-17T11:58:02.085 INFO:tasks.rados.rados.0.trial142.stdout:1913: writing trial14245205-49 from 1599205 to 2117763 tid 2 2026-02-17T11:58:02.090 INFO:tasks.rados.rados.0.trial142.stdout:1913: writing trial14245205-49 from 2682027 to 3171974 tid 3 2026-02-17T11:58:02.090 INFO:tasks.rados.rados.0.trial142.stdout:1914: delete oid 28 current snap is 211 2026-02-17T11:58:02.090 INFO:tasks.rados.rados.0.trial142.stdout:1911: expect (ObjNum 664 snap 209 seq_num 664) 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e7e038640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e7e038640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e7e038640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e7809f4c0 con 0x7f9e7809dac0 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e53fff640 1 -- 10.20.193.51:0/1957970486 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f9e64035d70 con 0x7f9e7809dac0 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e53fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:02.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.142+0000 7f9e53fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:02.146 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:02.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 msgr2=0x7f9e48040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 0x7f9e48040220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9e68007d90 tx=0x7f9e68007ce0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 10 monclient: shutdown 2026-02-17T11:58:02.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 msgr2=0x7f9e781cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e64002410 tx=0x7f9e640047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 shutdown_connections 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e4803dd60 0x7f9e48040220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e780a3bb0 0x7f9e781cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e780a0110 0x7f9e78099c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 --2- 10.20.193.51:0/1957970486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e7809dac0 0x7f9e781cbbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 >> 10.20.193.51:0/1957970486 conn(0x7f9e780a30c0 msgr2=0x7f9e78073a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 shutdown_connections 2026-02-17T11:58:02.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.144+0000 7f9e7e038640 1 -- 10.20.193.51:0/1957970486 wait complete. 2026-02-17T11:58:02.154 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:58:02.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:58:02.155 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:58:02.166 INFO:tasks.rados.rados.0.trial142.stdout:1910: expect (ObjNum 670 snap 211 seq_num 670) 2026-02-17T11:58:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: get_monmap_and_config 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: monmap: 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:02.223264+0000 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:02.223264+0000 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.227 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 1 Processor -- start 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 1 -- start start 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: init 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.222+0000 7fcc24676640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcc1c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a0750 0x7fcc1c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-b con 0x7fcc1c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcc1c13b760 0x7fcc1c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-a con 0x7fcc1c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc1c06e140 con 0x7fcc1c0a3bb0 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1c09f910 con 0x7fcc1c13b760 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c09ccd0 con 0x7fcc1c0a0750 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc24676640 10 monclient(hunting): authenticate will time out at 1369.842052s 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcc1c13b760 0x7fcc1c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc223eb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fcc1c0a3bb0 0x7fcc1c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58744/0 (socket says 10.20.193.51:58744) 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc223eb640 1 -- 10.20.193.51:0/1072044187 learned_addr learned my addr 10.20.193.51:0/1072044187 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): get_auth_request con 0x7fcc1c13b760 auth_method 0 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a0750 0x7fcc1c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): get_auth_request con 0x7fcc1c0a0750 auth_method 0 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient(hunting): handle_auth_done global_id 164115 payload 274 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 -- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a0750 msgr2=0x7fcc1c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a0750 0x7fcc1c09e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 -- 10.20.193.51:0/1072044187 >> v1:10.20.193.51:6789/0 conn(0x7fcc1c0a3bb0 legacy=0x7fcc1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.223+0000 7fcc22bec640 1 -- 10.20.193.51:0/1072044187 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c09eec0 con 0x7fcc1c13b760 2026-02-17T11:58:02.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc22bec640 1 -- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 msgr2=0x7fcc1c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc22bec640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c13db50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c09f230 tx=0x7fcc1802f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec6bc11f7b0ea9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 1 -- 10.20.193.51:0/1072044187 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1803c070 con 0x7fcc1c13b760 2026-02-17T11:58:02.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: dump: 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 1 -- 10.20.193.51:0/1072044187 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18037440 con 0x7fcc1c13b760 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc24676640 5 monclient: authenticate success, global_id 164115 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc24676640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:02.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.225+0000 7fcc213e9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc213e9640 1 -- 10.20.193.51:0/1072044187 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18037810 con 0x7fcc1c13b760 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc213e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc213e9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc213e9640 10 monclient: dump: 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.245 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 4 set_mon_vals no callback set 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 10 monclient: shutdown 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 -- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 msgr2=0x7fcc1c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c13db50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c09f230 tx=0x7fcc1802f130 comp rx=0 tx=0).stop 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 -- 10.20.193.51:0/1072044187 shutdown_connections 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c13db50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 --2- 10.20.193.51:0/1072044187 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a0750 0x7fcc1c09e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 -- 10.20.193.51:0/1072044187 >> 10.20.193.51:0/1072044187 conn(0x7fcc1c0a30c0 msgr2=0x7fcc1c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 -- 10.20.193.51:0/1072044187 shutdown_connections 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.226+0000 7fcc24676640 1 -- 10.20.193.51:0/1072044187 wait complete. 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient: monmap: 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:02.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 Processor -- start 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 -- start start 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient: init 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc1c0a0750 0x7fcc1c09be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-b con 0x7fcc1c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a3bb0 0x7fcc1c132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-c con 0x7fcc1c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c132b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): picked mon.noname-a con 0x7fcc1c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0a04b0 con 0x7fcc1c13b760 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c09c850 con 0x7fcc1c0a0750 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c09e710 con 0x7fcc1c0a3bb0 2026-02-17T11:58:02.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc24676640 10 monclient(hunting): authenticate will time out at 1369.846557s 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a3bb0 0x7fcc1c132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a3bb0 0x7fcc1c132630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34142/0 (socket says 10.20.193.51:34142) 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 1 -- 10.20.193.51:0/3323060954 learned_addr learned my addr 10.20.193.51:0/3323060954 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c132b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36432/0 (socket says 10.20.193.51:36432) 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): get_auth_request con 0x7fcc1c0a3bb0 auth_method 0 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): get_auth_request con 0x7fcc1c13b760 auth_method 0 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc21bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc223eb640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc1c0a0750 0x7fcc1c09be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc223eb640 10 monclient(hunting): get_auth_request con 0x7fcc1c0a0750 auth_method 0 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc223eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc223eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc223eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient(hunting): handle_auth_done global_id 164118 payload 824 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a3bb0 msgr2=0x7fcc1c132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcc1c0a3bb0 0x7fcc1c132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc1c0a0750 msgr2=0x7fcc1c09be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcc1c0a0750 0x7fcc1c09be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.227+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c135fb0 con 0x7fcc1c13b760 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.229+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 msgr2=0x7fcc1c132b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.229+0000 7fcc22bec640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c132b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc18036000 tx=0x7fcc18004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1803c050 con 0x7fcc1c13b760 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: dump: 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1803d040 con 0x7fcc1c13b760 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18037e60 con 0x7fcc1c13b760 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 10 monclient: dump: 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc20be8640 4 set_mon_vals no callback set 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 5 monclient: authenticate success, global_id 164118 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 monclient: _renew_subs 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c134de0 con 0x7fcc1c13b760 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 monclient: _renew_subs 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c135cd0 con 0x7fcc1c13b760 2026-02-17T11:58:02.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 0x7fcc1c1330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0a2bb0 con 0x7fcc1c09c370 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 0x7fcc1c1330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient: get_auth_request con 0x7fcc1c09c370 auth_method 0 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcc18041a60 con 0x7fcc1c13b760 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 10 monclient(hunting): handle_auth_done global_id 164121 payload 824 2026-02-17T11:58:02.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.230+0000 7fcc223eb640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc1c09d810 con 0x7fcc1c09c370 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.231+0000 7fcc02ffd640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcbec03dd60 0x7fcbec040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.231+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(447..447 src has 323..447) ==== 4811+0+0 (secure 0 0 0) 0x7fcc18077e80 con 0x7fcc1c13b760 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.231+0000 7fcc21bea640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcbec03dd60 0x7fcbec040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.231+0000 7fcc21bea640 10 monclient: get_auth_request con 0x7fcbec03dd60 auth_method 0 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc223eb640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 msgr2=0x7fcc1c1330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc223eb640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 0x7fcc1c1330b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00e730 tx=0x7fcc0c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c004d20 con 0x7fcc1c09c370 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 10 monclient: dump: 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fcc0c018070 con 0x7fcc1c09c370 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:02.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 msgr2=0x7fcc1c1330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 0x7fcc1c1330b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00e730 tx=0x7fcc0c00ec00 comp rx=0 tx=0).stop 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 msgr2=0x7fcc1c1330b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc02ffd640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c09c370 0x7fcc1c1330b0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00e730 tx=0x7fcc0c00ec00 comp rx=0 tx=0).stop 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.233+0000 7fcc21bea640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcbec03dd60 0x7fcbec040220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c1361c0 tx=0x7fcc10009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc24676640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc24676640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 0x7fcc1c1dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc24676640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c136f70 con 0x7fcc1c1335f0 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 0x7fcc1c1dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient: get_auth_request con 0x7fcc1c1335f0 auth_method 0 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 10 monclient(hunting): handle_auth_done global_id 164124 payload 824 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.236+0000 7fcc223eb640 1 -- 10.20.193.51:0/3323060954 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc1c06a290 con 0x7fcc1c1335f0 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.238+0000 7fcc223eb640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 msgr2=0x7fcc1c1dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.238+0000 7fcc223eb640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 0x7fcc1c1dab40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c017000 tx=0x7fcc0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c007590 con 0x7fcc1c1335f0 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 10 monclient: dump: 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.261 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fcc0c01ee50 con 0x7fcc1c1335f0 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 msgr2=0x7fcc1c1dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 0x7fcc1c1dab40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c017000 tx=0x7fcc0c004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 msgr2=0x7fcc1c1dab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc02ffd640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c1335f0 0x7fcc1c1dab40 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c017000 tx=0x7fcc0c004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26677, 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:02.263 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.264 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.265 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:02.266 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.267 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:02.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:02.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.270 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.271 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.272 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:02.273 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:02.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcbec03dd60 msgr2=0x7fcbec040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcbec03dd60 0x7fcbec040220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c1361c0 tx=0x7fcc10009290 comp rx=0 tx=0).stop 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 10 monclient: shutdown 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 msgr2=0x7fcc1c132b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 --2- 10.20.193.51:0/3323060954 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcc1c13b760 0x7fcc1c132b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc18036000 tx=0x7fcc18004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 reap_dead start 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc22bec640 1 -- 10.20.193.51:0/3323060954 reap_dead start 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 shutdown_connections 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 >> 10.20.193.51:0/3323060954 conn(0x7fcc1c0a30c0 msgr2=0x7fcc1c072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 shutdown_connections 2026-02-17T11:58:02.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.239+0000 7fcc24676640 1 -- 10.20.193.51:0/3323060954 wait complete. 2026-02-17T11:58:02.275 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:02.275 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:58:02.276 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:58:02.325 INFO:tasks.rados.rados.0.trial142.stdout:1913: finishing write tid 1 to trial14245205-49 2026-02-17T11:58:02.325 INFO:tasks.rados.rados.0.trial142.stdout:1910: done (3 left) 2026-02-17T11:58:02.325 INFO:tasks.rados.rados.0.trial142.stdout:1911: done (2 left) 2026-02-17T11:58:02.325 INFO:tasks.rados.rados.0.trial142.stdout:1914: done (1 left) 2026-02-17T11:58:02.326 INFO:tasks.rados.rados.0.trial142.stdout:1915: write (excl) oid 27 current snap is 211 2026-02-17T11:58:02.326 INFO:tasks.rados.rados.0.trial142.stdout:1913: finishing write tid 2 to trial14245205-49 2026-02-17T11:58:02.326 INFO:tasks.rados.rados.0.trial142.stdout:1915: seq_num 675 ranges {544725=632139,1716169=522227,2736873=512491} 2026-02-17T11:58:02.330 INFO:tasks.rados.rados.0.trial142.stdout:1915: writing trial14245205-27 from 544725 to 1176864 tid 1 2026-02-17T11:58:02.334 INFO:tasks.rados.rados.0.trial142.stdout:1915: writing trial14245205-27 from 1716169 to 2238396 tid 2 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1915: writing trial14245205-27 from 2736873 to 3249364 tid 3 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1916: write oid 47 current snap is 211 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1913: finishing write tid 3 to trial14245205-49 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1913: finishing write tid 4 to trial14245205-49 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1913: finishing write tid 5 to trial14245205-49 2026-02-17T11:58:02.338 INFO:tasks.rados.rados.0.trial142.stdout:1913: oid 49 updating version 0 to 1752 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1913: oid 49 updating version 1752 to 1755 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1913: oid 49 updating version 1755 to 1756 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1913: oid 49 version 1756 is already newer than 1743 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1756 (ObjNum 673 snap 211 seq_num 673) dirty exists 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1913: left oid 49 (ObjNum 673 snap 211 seq_num 673) 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1915: finishing write tid 1 to trial14245205-27 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1915: finishing write tid 2 to trial14245205-27 2026-02-17T11:58:02.339 INFO:tasks.rados.rados.0.trial142.stdout:1916: seq_num 676 ranges {561532=707388,2058298=782238} 2026-02-17T11:58:02.343 INFO:tasks.rados.rados.0.trial142.stdout:1916: writing trial14245205-47 from 561532 to 1268920 tid 1 2026-02-17T11:58:02.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.342+0000 7f1563c1a640 10 monclient: get_monmap_and_config 2026-02-17T11:58:02.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.342+0000 7f1563c1a640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.342+0000 7f1563c1a640 10 monclient: monmap: 2026-02-17T11:58:02.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:02.343684+0000 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:02.343684+0000 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:02.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.353 INFO:tasks.rados.rados.0.trial142.stdout:1916: writing trial14245205-47 from 2058298 to 2840536 tid 2 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1913: done (2 left) 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1917: rollback oid 18 current snap is 211 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 209 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: finishing write tid 3 to trial14245205-27 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: finishing write tid 4 to trial14245205-27 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: finishing write tid 5 to trial14245205-27 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: oid 27 updating version 0 to 1582 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: oid 27 updating version 1582 to 1583 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: oid 27 version 1583 is already newer than 1581 2026-02-17T11:58:02.354 INFO:tasks.rados.rados.0.trial142.stdout:1915: oid 27 updating version 1583 to 1584 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 1584 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1915: left oid 27 (ObjNum 675 snap 211 seq_num 675) 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1916: finishing write tid 1 to trial14245205-47 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1915: done (2 left) 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1918: write (excl) oid 20 current snap is 211 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1918: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2026-02-17T11:58:02.355 INFO:tasks.rados.rados.0.trial142.stdout:1918: writing trial14245205-20 from 578339 to 1077329 tid 1 2026-02-17T11:58:02.359 INFO:tasks.rados.rados.0.trial142.stdout:1918: writing trial14245205-20 from 1833133 to 2359029 tid 2 2026-02-17T11:58:02.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 Processor -- start 2026-02-17T11:58:02.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 -- start start 2026-02-17T11:58:02.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient: init 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 0x7f155c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-b con 0x7f155c138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f155c0a35a0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f155c0a5a70 0x7f155c140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-c con 0x7f155c0a5a70 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:02.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155c0a1df0 con 0x7f155c0a35a0 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f155c0a6830 con 0x7f155c0a5a70 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f155c0a2c00 con 0x7f155c138600 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f1563c1a640 10 monclient(hunting): authenticate will time out at 1369.962827s 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156118e640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f155c0a35a0 0x7f155c0a5360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58756/0 (socket says 10.20.193.51:58756) 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156118e640 1 -- 10.20.193.51:0/3518545360 learned_addr learned my addr 10.20.193.51:0/3518545360 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:02.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156198f640 1 --2- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 0x7f155c1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156198f640 10 monclient(hunting): get_auth_request con 0x7f155c138600 auth_method 0 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156198f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.343+0000 7f156198f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient(hunting): handle_auth_done global_id 154196 payload 274 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 1 -- 10.20.193.51:0/3518545360 >> v2:10.20.193.142:3300/0 conn(0x7f155c0a5a70 msgr2=0x7f155c140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 1 --2- 10.20.193.51:0/3518545360 >> v2:10.20.193.142:3300/0 conn(0x7f155c0a5a70 0x7f155c140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 1 -- 10.20.193.51:0/3518545360 >> v1:10.20.193.51:6789/0 conn(0x7f155c0a35a0 legacy=0x7f155c0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 1 monclient: found mon.noname-b 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.344+0000 7f156198f640 1 -- 10.20.193.51:0/3518545360 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c138f20 con 0x7f155c138600 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156198f640 1 -- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 msgr2=0x7f155c1389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156198f640 1 --2- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 0x7f155c1389e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f154c0098a0 tx=0x7f154c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0d71e3512e2cfe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 1 -- 10.20.193.51:0/3518545360 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c03c070 con 0x7f155c138600 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:02.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: dump: 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 1 -- 10.20.193.51:0/3518545360 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154c02fce0 con 0x7f155c138600 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f1563c1a640 5 monclient: authenticate success, global_id 154196 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f1563c1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 1 -- 10.20.193.51:0/3518545360 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c037660 con 0x7f155c138600 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f1563c1a640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f1563c1a640 4 set_mon_vals no callback set 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.346+0000 7f156098d640 10 monclient: dump: 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.368 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 10 monclient: shutdown 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 msgr2=0x7f155c1389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 --2- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 0x7f155c1389e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f154c0098a0 tx=0x7f154c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- 10.20.193.51:0/3518545360 shutdown_connections 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 --2- 10.20.193.51:0/3518545360 >> v2:10.20.193.142:3300/0 conn(0x7f155c0a5a70 0x7f155c140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 --2- 10.20.193.51:0/3518545360 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c138600 0x7f155c1389e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- 10.20.193.51:0/3518545360 >> 10.20.193.51:0/3518545360 conn(0x7f155c0a7460 msgr2=0x7f155c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- 10.20.193.51:0/3518545360 shutdown_connections 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- 10.20.193.51:0/3518545360 wait complete. 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 10 monclient: monmap: 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:02.370 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 Processor -- start 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 1 -- start start 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.347+0000 7f1563c1a640 10 monclient: init 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 0x7f155c1cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-a con 0x7f155c0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 0x7f155c136220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-c con 0x7f155c0a5a70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f155c138600 0x7f155c121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): picked mon.noname-b con 0x7f155c138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f155c0a25b0 con 0x7f155c0a35a0 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f155c0a22d0 con 0x7f155c138600 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f155c0a15f0 con 0x7f155c0a5a70 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1563c1a640 10 monclient(hunting): authenticate will time out at 1369.967160s 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 0x7f155c1cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 0x7f155c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 0x7f155c1cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36456/0 (socket says 10.20.193.51:36456) 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 1 -- 10.20.193.51:0/239233813 learned_addr learned my addr 10.20.193.51:0/239233813 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): get_auth_request con 0x7f155c0a35a0 auth_method 0 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): get_auth_request con 0x7f155c0a5a70 auth_method 0 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1562190640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f155c138600 0x7f155c121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1562190640 10 monclient(hunting): get_auth_request con 0x7f155c138600 auth_method 0 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1562190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1562190640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f1562190640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient(hunting): handle_auth_done global_id 154199 payload 824 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f155c138600 msgr2=0x7f155c121c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f155c138600 0x7f155c121c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 msgr2=0x7f155c1cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 0x7f155c1cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 monclient: found mon.noname-c 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156118e640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c125c00 con 0x7f155c0a5a70 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.348+0000 7f156198f640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f155c0a35a0 0x7f155c1cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f156118e640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 msgr2=0x7f155c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f156118e640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 0x7f155c136220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f155000c4d0 tx=0x7f155000c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550007070 con 0x7f155c0a5a70 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: dump: 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.375 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550007230 con 0x7f155c0a5a70 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 5 monclient: authenticate success, global_id 154199 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 10 monclient: _renew_subs 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c0a1ae0 con 0x7f155c0a5a70 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550007620 con 0x7f155c0a5a70 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154a7fc640 10 monclient: dump: 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f154bfff640 4 set_mon_vals no callback set 2026-02-17T11:58:02.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 10 monclient: _renew_subs 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.350+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c136b90 con 0x7f155c0a5a70 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1563c1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1563c1a640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 0x7f155c1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f155c0a5ee0 con 0x7f155c136760 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 0x7f155c1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient: get_auth_request con 0x7f155c136760 auth_method 0 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f155001b400 con 0x7f155c0a5a70 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 10 monclient(hunting): handle_auth_done global_id 154202 payload 824 2026-02-17T11:58:02.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f156198f640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f155c0a7ca0 con 0x7f155c136760 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f154a7fc640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f152c03dd10 0x7f152c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(447..447 src has 323..447) ==== 4811+0+0 (secure 0 0 0) 0x7f1550052310 con 0x7f155c0a5a70 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1562190640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f152c03dd10 0x7f152c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.351+0000 7f1562190640 10 monclient: get_auth_request con 0x7f152c03dd10 auth_method 0 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f156198f640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 msgr2=0x7f155c1221b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f156198f640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 0x7f155c1221b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f154c002410 tx=0x7f154c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c049070 con 0x7f155c136760 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 10 monclient: dump: 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f154c043870 con 0x7f155c136760 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 msgr2=0x7f155c1221b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 0x7f155c1221b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f154c002410 tx=0x7f154c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 msgr2=0x7f155c1221b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.353+0000 7f154a7fc640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c136760 0x7f155c1221b0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f154c002410 tx=0x7f154c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.354+0000 7f1562190640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f152c03dd10 0x7f152c0401d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1558004560 tx=0x7f1558002aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f1563c1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f1563c1a640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 0x7f155c1da760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f1563c1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f155c122b00 con 0x7f155c1226f0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f156198f640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 0x7f155c1da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f156198f640 10 monclient: get_auth_request con 0x7f155c1226f0 auth_method 0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f156198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f156198f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.356+0000 7f156198f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.357+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.357+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.357+0000 7f156198f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.357+0000 7f156198f640 10 monclient(hunting): handle_auth_done global_id 154205 payload 824 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.357+0000 7f156198f640 1 -- 10.20.193.51:0/239233813 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f155c1d0260 con 0x7f155c1226f0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f156198f640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 msgr2=0x7f155c1da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f156198f640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 0x7f155c1da760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f155c123340 tx=0x7f154c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c03c040 con 0x7f155c1226f0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:02.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 10 monclient: dump: 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f154c0423c0 con 0x7f155c1226f0 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 msgr2=0x7f155c1da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 0x7f155c1da760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f155c123340 tx=0x7f154c009290 comp rx=0 tx=0).stop 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 msgr2=0x7f155c1da760 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f154a7fc640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c1226f0 0x7f155c1da760 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f155c123340 tx=0x7f154c009290 comp rx=0 tx=0).stop 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 75239, 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:02.383 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.384 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:02.385 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.386 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:02.387 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.388 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.389 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:02.390 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:02.391 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f152c03dd10 msgr2=0x7f152c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f152c03dd10 0x7f152c0401d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1558004560 tx=0x7f1558002aa0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 10 monclient: shutdown 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 msgr2=0x7f155c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 --2- 10.20.193.51:0/239233813 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f155c0a5a70 0x7f155c136220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f155000c4d0 tx=0x7f155000c9a0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1562190640 1 -- 10.20.193.51:0/239233813 reap_dead start 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1562190640 1 -- 10.20.193.51:0/239233813 reap_dead start 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 shutdown_connections 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 >> 10.20.193.51:0/239233813 conn(0x7f155c0a7460 msgr2=0x7f155c0a9080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 shutdown_connections 2026-02-17T11:58:02.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.359+0000 7f1563c1a640 1 -- 10.20.193.51:0/239233813 wait complete. 2026-02-17T11:58:02.393 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:02.393 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:58:02.393 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1918: writing trial14245205-20 from 2791719 to 3378339 tid 3 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1919: copy_from oid 17 from oid 30 current snap is 211 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1917: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1917: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1916: finishing write tid 2 to trial14245205-47 2026-02-17T11:58:02.395 INFO:tasks.rados.rados.0.trial142.stdout:1917: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1760 (ObjNum 613 snap 188 seq_num 613) dirty exists 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: finishing write tid 3 to trial14245205-47 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: finishing write tid 4 to trial14245205-47 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: oid 47 updating version 0 to 1037 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: oid 47 version 1037 is already newer than 1035 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: oid 47 version 1037 is already newer than 1036 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 1037 (ObjNum 676 snap 211 seq_num 676) dirty exists 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: left oid 47 (ObjNum 676 snap 211 seq_num 676) 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: finishing write tid 1 to trial14245205-20 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: finishing write tid 2 to trial14245205-20 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1916: done (3 left) 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1917: done (2 left) 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1920: read oid 49 snap -1 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1920: expect (ObjNum 673 snap 211 seq_num 673) 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1921: delete oid 26 current snap is 211 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1921: done (3 left) 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1922: rollback oid 3 current snap is 211 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 186 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1923: delete oid 25 current snap is 211 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: finishing write tid 3 to trial14245205-20 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: finishing write tid 4 to trial14245205-20 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: finishing write tid 5 to trial14245205-20 2026-02-17T11:58:02.396 INFO:tasks.rados.rados.0.trial142.stdout:1918: oid 20 updating version 0 to 1068 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1918: oid 20 updating version 1068 to 1071 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1918: oid 20 version 1071 is already newer than 1069 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1918: oid 20 version 1071 is already newer than 1070 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1071 (ObjNum 677 snap 211 seq_num 677) dirty exists 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1918: left oid 20 (ObjNum 677 snap 211 seq_num 677) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1922: finishing rollback tid 1 to trial14245205-3 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1922: finishing rollback tid 2 to trial14245205-3 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1022 (ObjNum 558 snap 168 seq_num 558) dirty exists 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1918: done (4 left) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1922: done (3 left) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1923: done (2 left) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1924: delete oid 45 current snap is 211 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1924: done (2 left) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1925: read oid 29 snap 204 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1925: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1926: rollback oid 32 current snap is 211 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 208 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1927: read oid 21 snap -1 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1927: expect (ObjNum 666 snap 210 seq_num 666) 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1928: delete oid 34 current snap is 211 2026-02-17T11:58:02.397 INFO:tasks.rados.rados.0.trial142.stdout:1920: expect (ObjNum 673 snap 211 seq_num 673) 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: get_monmap_and_config 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: monmap: 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:02.465258+0000 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:02.465258+0000 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:02.466 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 1 Processor -- start 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 1 -- start start 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: init 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.464+0000 7f496743f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49600a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f496013b380 0x7f496013d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 10 monclient(hunting): picked mon.noname-c con 0x7f496013b380 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f496013dcb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4960135430 con 0x7f49600a3bb0 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496009af60 con 0x7f496013dcb0 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f496009a5c0 con 0x7f496013b380 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f496743f640 10 monclient(hunting): authenticate will time out at 1370.084046s 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49651b4640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f49600a3bb0 0x7f496009cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58768/0 (socket says 10.20.193.51:58768) 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49651b4640 1 -- 10.20.193.51:0/2202776702 learned_addr learned my addr 10.20.193.51:0/2202776702 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 1 --2- 10.20.193.51:0/2202776702 >> v2:10.20.193.142:3300/0 conn(0x7f496013b380 0x7f496013d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): get_auth_request con 0x7f496013b380 auth_method 0 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient(hunting): handle_auth_done global_id 114454 payload 274 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 1 -- 10.20.193.51:0/2202776702 >> v1:10.20.193.142:6789/0 conn(0x7f496013dcb0 legacy=0x7f49601400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 1 -- 10.20.193.51:0/2202776702 >> v1:10.20.193.51:6789/0 conn(0x7f49600a3bb0 legacy=0x7f496009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 1 monclient: found mon.noname-c 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:58:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.465+0000 7f49649b3640 1 -- 10.20.193.51:0/2202776702 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496009b240 con 0x7f496013b380 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f49649b3640 1 -- 10.20.193.51:0/2202776702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496013b380 msgr2=0x7f496013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f49649b3640 1 --2- 10.20.193.51:0/2202776702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496013b380 0x7f496013d770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4960069d30 tx=0x7f495402ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c2028319601bb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 1 -- 10.20.193.51:0/2202776702 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495403c070 con 0x7f496013b380 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: dump: 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.472 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 1 -- 10.20.193.51:0/2202776702 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495402fcb0 con 0x7f496013b380 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 5 monclient: authenticate success, global_id 114454 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 1 -- 10.20.193.51:0/2202776702 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495402fe60 con 0x7f496013b380 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f494ffff640 10 monclient: dump: 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.473 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 4 set_mon_vals no callback set 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 10 monclient: shutdown 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 -- 10.20.193.51:0/2202776702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496013b380 msgr2=0x7f496013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 --2- 10.20.193.51:0/2202776702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496013b380 0x7f496013d770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4960069d30 tx=0x7f495402ed50 comp rx=0 tx=0).stop 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 -- 10.20.193.51:0/2202776702 shutdown_connections 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 --2- 10.20.193.51:0/2202776702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496013b380 0x7f496013d770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 -- 10.20.193.51:0/2202776702 >> 10.20.193.51:0/2202776702 conn(0x7f49600a30c0 msgr2=0x7f49600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 -- 10.20.193.51:0/2202776702 shutdown_connections 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.468+0000 7f496743f640 1 -- 10.20.193.51:0/2202776702 wait complete. 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient: monmap: 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:02.474 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 Processor -- start 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 -- start start 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient: init 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49600a3bb0 0x7f4960137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): picked mon.noname-b con 0x7f49600a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 0x7f49601377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): picked mon.noname-a con 0x7f496013b380 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f496013dcb0 0x7f4960137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): picked mon.noname-c con 0x7f496013dcb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4960135040 con 0x7f496013b380 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49600a3f90 con 0x7f49600a3bb0 2026-02-17T11:58:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f49601351c0 con 0x7f496013dcb0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f496743f640 10 monclient(hunting): authenticate will time out at 1370.088651s 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 0x7f49601377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 0x7f49601377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36468/0 (socket says 10.20.193.51:36468) 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 -- 10.20.193.51:0/3470336603 learned_addr learned my addr 10.20.193.51:0/3470336603 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): get_auth_request con 0x7f496013b380 auth_method 0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f496013dcb0 0x7f4960137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): get_auth_request con 0x7f496013dcb0 auth_method 0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49600a3bb0 0x7f4960137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): get_auth_request con 0x7f49600a3bb0 auth_method 0 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient(hunting): handle_auth_done global_id 164130 payload 824 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f496013dcb0 msgr2=0x7f4960137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f496013dcb0 0x7f4960137cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49600a3bb0 msgr2=0x7f4960137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49600a3bb0 0x7f4960137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49649b3640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960134170 con 0x7f496013b380 2026-02-17T11:58:02.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.469+0000 7f49659b5640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f496013dcb0 0x7f4960137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:02.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f49649b3640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 msgr2=0x7f49601377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f49649b3640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 0x7f49601377b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4954002410 tx=0x7f49540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954046070 con 0x7f496013b380 2026-02-17T11:58:02.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: dump: 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 5 monclient: authenticate success, global_id 164130 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4954041890 con 0x7f496013b380 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495403c040 con 0x7f496013b380 2026-02-17T11:58:02.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 10 monclient: dump: 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494f7fe640 4 set_mon_vals no callback set 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 monclient: _renew_subs 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496013d780 con 0x7f496013b380 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 monclient: _renew_subs 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496012b7b0 con 0x7f496013b380 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 0x7f4960138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f496009cd30 con 0x7f4960139250 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4954041cc0 con 0x7f496013b380 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.472+0000 7f49651b4640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 0x7f4960138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient: get_auth_request con 0x7f4960139250 auth_method 0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f494dffb640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f493003dd10 0x7f49300401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(447..447 src has 323..447) ==== 4811+0+0 (secure 0 0 0) 0x7f4954077d70 con 0x7f496013b380 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 10 monclient(hunting): handle_auth_done global_id 114460 payload 824 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49651b4640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4960074db0 con 0x7f4960139250 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49659b5640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f493003dd10 0x7f49300401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.473+0000 7f49659b5640 10 monclient: get_auth_request con 0x7f493003dd10 auth_method 0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f49651b4640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 msgr2=0x7f4960138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f49651b4640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 0x7f4960138230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f495000e770 tx=0x7f495000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950017070 con 0x7f4960139250 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 10 monclient: dump: 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f495000caf0 con 0x7f4960139250 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 msgr2=0x7f4960138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 0x7f4960138230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f495000e770 tx=0x7f495000ec40 comp rx=0 tx=0).stop 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 msgr2=0x7f4960138230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f494dffb640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4960139250 0x7f4960138230 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f495000e770 tx=0x7f495000ec40 comp rx=0 tx=0).stop 2026-02-17T11:58:02.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.475+0000 7f49659b5640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f493003dd10 0x7f49300401d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f496009d7f0 tx=0x7f495c004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.478+0000 7f496743f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.478+0000 7f496743f640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 0x7f49600638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.478+0000 7f496743f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.478+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49600008d0 con 0x7f496009ea80 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 0x7f49600638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient: get_auth_request con 0x7f496009ea80 auth_method 0 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 10 monclient(hunting): handle_auth_done global_id 114463 payload 824 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.479+0000 7f49651b4640 1 -- 10.20.193.51:0/3470336603 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4960050ac0 con 0x7f496009ea80 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f49651b4640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 msgr2=0x7f49600638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f49651b4640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 0x7f49600638c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4950019000 tx=0x7f49500059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950017070 con 0x7f496009ea80 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 10 monclient: dump: 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f4950006950 con 0x7f496009ea80 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 msgr2=0x7f49600638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 0x7f49600638c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4950019000 tx=0x7f49500059d0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 msgr2=0x7f49600638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.481+0000 7f494dffb640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f496009ea80 0x7f49600638c0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4950019000 tx=0x7f49500059d0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.486 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 284356, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.487 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.488 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:02.489 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.490 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.491 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.492 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.493 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:02.494 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:02.495 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:02.495 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:02.495 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:02.495 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:02.495 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f493003dd10 msgr2=0x7f49300401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f493003dd10 0x7f49300401d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f496009d7f0 tx=0x7f495c004200 comp rx=0 tx=0).stop 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 10 monclient: shutdown 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 msgr2=0x7f49601377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 --2- 10.20.193.51:0/3470336603 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f496013b380 0x7f49601377b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4954002410 tx=0x7f49540047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f49659b5640 1 -- 10.20.193.51:0/3470336603 reap_dead start 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f49659b5640 1 -- 10.20.193.51:0/3470336603 reap_dead start 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 shutdown_connections 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 >> 10.20.193.51:0/3470336603 conn(0x7f49600a30c0 msgr2=0x7f49600a1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 shutdown_connections 2026-02-17T11:58:02.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.482+0000 7f496743f640 1 -- 10.20.193.51:0/3470336603 wait complete. 2026-02-17T11:58:02.497 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:02.497 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:58:02.497 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:58:02.499 INFO:tasks.rados.rados.0.trial142.stdout:1926: finishing rollback tid 0 to trial14245205-32 2026-02-17T11:58:02.499 INFO:tasks.rados.rados.0.trial142.stdout:1926: finishing rollback tid 1 to trial14245205-32 2026-02-17T11:58:02.499 INFO:tasks.rados.rados.0.trial142.stdout:1926: finishing rollback tid 2 to trial14245205-32 2026-02-17T11:58:02.499 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1074 (ObjNum 597 snap 186 seq_num 597) dirty exists 2026-02-17T11:58:02.499 INFO:tasks.rados.rados.0.trial142.stdout:1927: expect (ObjNum 666 snap 210 seq_num 666) 2026-02-17T11:58:02.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.560+0000 7f2af97d3640 10 monclient: get_monmap_and_config 2026-02-17T11:58:02.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.560+0000 7f2af97d3640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient: monmap: 2026-02-17T11:58:02.562 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.562 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:02.561966+0000 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:02.561966+0000 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 Processor -- start 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 -- start start 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient: init 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2af40a3bb0 0x7f2af409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-a con 0x7f2af40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2af40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2af413b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af406e140 con 0x7f2af413b760 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af409f910 con 0x7f2af40a0750 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2af409ccd0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af97d3640 10 monclient(hunting): authenticate will time out at 1370.180755s 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2af40a3bb0 0x7f2af409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f2af413b760 0x7f2af413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58770/0 (socket says 10.20.193.51:58770) 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af37fe640 1 -- 10.20.193.51:0/294362891 learned_addr learned my addr 10.20.193.51:0/294362891 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 1 --2- 10.20.193.51:0/294362891 >> v2:10.20.193.51:3300/0 conn(0x7f2af40a3bb0 0x7f2af409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36480/0 (socket says 10.20.193.51:36480) 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): get_auth_request con 0x7f2af40a3bb0 auth_method 0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.561+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_done global_id 164133 payload 274 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 1 -- 10.20.193.51:0/294362891 >> v1:10.20.193.142:6789/0 conn(0x7f2af40a0750 legacy=0x7f2af409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 1 -- 10.20.193.51:0/294362891 >> v1:10.20.193.51:6789/0 conn(0x7f2af413b760 legacy=0x7f2af413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.562+0000 7f2af2ffd640 1 -- 10.20.193.51:0/294362891 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af409eec0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af2ffd640 1 -- 10.20.193.51:0/294362891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 msgr2=0x7f2af409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af2ffd640 1 --2- 10.20.193.51:0/294362891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af409dac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80098a0 tx=0x7f2ae802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4296241c13e20efe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 1 -- 10.20.193.51:0/294362891 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae803c070 con 0x7f2af40a3bb0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: dump: 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 1 -- 10.20.193.51:0/294362891 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae802fce0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 5 monclient: authenticate success, global_id 164133 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 1 -- 10.20.193.51:0/294362891 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8037660 con 0x7f2af40a3bb0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af1ffb640 10 monclient: dump: 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.566 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:02.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 4 set_mon_vals no callback set 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 10 monclient: shutdown 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 1 -- 10.20.193.51:0/294362891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 msgr2=0x7f2af409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 1 --2- 10.20.193.51:0/294362891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af409dac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80098a0 tx=0x7f2ae802ed80 comp rx=0 tx=0).stop 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 1 -- 10.20.193.51:0/294362891 shutdown_connections 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 1 --2- 10.20.193.51:0/294362891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af409dac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.564+0000 7f2af97d3640 1 -- 10.20.193.51:0/294362891 >> 10.20.193.51:0/294362891 conn(0x7f2af40a30c0 msgr2=0x7f2af40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 1 -- 10.20.193.51:0/294362891 shutdown_connections 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 1 -- 10.20.193.51:0/294362891 wait complete. 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 10 monclient: build_initial_monmap 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 10 monclient: monmap: 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 1 Processor -- start 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 1 -- start start 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 10 monclient: init 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.565+0000 7f2af97d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:02.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2af40a0750 0x7f2af41cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-c con 0x7f2af40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-a con 0x7f2af40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2af413b760 0x7f2af4090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): picked mon.noname-b con 0x7f2af413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2af40a04b0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2af409c850 con 0x7f2af413b760 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2af409e710 con 0x7f2af40a0750 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af97d3640 10 monclient(hunting): authenticate will time out at 1370.185060s 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2af40a0750 0x7f2af41cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36494/0 (socket says 10.20.193.51:36494) 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 -- 10.20.193.51:0/3307690093 learned_addr learned my addr 10.20.193.51:0/3307690093 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): get_auth_request con 0x7f2af40a3bb0 auth_method 0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): get_auth_request con 0x7f2af40a0750 auth_method 0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af37fe640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2af413b760 0x7f2af4090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient(hunting): handle_auth_done global_id 164136 payload 824 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 -- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2af40a0750 msgr2=0x7f2af41cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2af40a0750 0x7f2af41cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 -- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2af413b760 msgr2=0x7f2af4090dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2af413b760 0x7f2af4090dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 monclient: found mon.noname-a 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:02.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.566+0000 7f2af27fc640 1 -- 10.20.193.51:0/3307690093 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af4094600 con 0x7f2af40a3bb0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af27fc640 1 -- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 msgr2=0x7f2af41cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af27fc640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c5d0 tx=0x7f2adc00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc016020 con 0x7f2af40a3bb0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: dump: 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc012a60 con 0x7f2af40a3bb0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc012e50 con 0x7f2af40a3bb0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:02.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2ad37fe640 10 monclient: dump: 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 5 monclient: authenticate success, global_id 164136 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 10 monclient: _renew_subs 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af17fa640 4 set_mon_vals no callback set 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af40948e0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 10 monclient: _renew_subs 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.568+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af409d7b0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af97d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af97d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af97d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af40a2490 con 0x7f2af40a3bb0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2adc01b400 con 0x7f2af40a3bb0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2ad37fe640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 0x7f2ac00403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(447..447 src has 323..447) ==== 4811+0+0 (secure 0 0 0) 0x7f2adc052610 con 0x7f2af40a3bb0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af2ffd640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 0x7f2ac00403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:02.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.569+0000 7f2af2ffd640 10 monclient: get_auth_request con 0x7f2ac003df00 auth_method 0 2026-02-17T11:58:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.571+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2adc020030 con 0x7f2af40a3bb0 2026-02-17T11:58:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.571+0000 7f2ad37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.571+0000 7f2ad37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.571+0000 7f2af2ffd640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 0x7f2ac00403c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2af409f5f0 tx=0x7f2ae8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:02.601 INFO:tasks.rados.rados.0.trial142.stdout:1925: expect (ObjNum 579 snap 181 seq_num 579) 2026-02-17T11:58:02.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2af97d3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:58:02.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2af97d3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:58:02.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2af97d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:02.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2af409dac0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2ad37fe640 1 -- 10.20.193.51:0/3307690093 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f2adc01b9b0 con 0x7f2af40a3bb0 2026-02-17T11:58:02.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2ad37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:58:02.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.686+0000 7f2ad37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:02.690 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=1549713612,config=692619927,health=3152313405,kv=643764953,logm=693160747}) 2026-02-17T11:58:02.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=2930946304,config=692619927,health=3152313405,kv=643764953,logm=2817056467}) 2026-02-17T11:58:02.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=1549713612,config=692619927,health=3152313405,kv=643764953,logm=693160747}) 2026-02-17T11:58:02.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.686+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=1586965304,config=692619927,health=3152313405,kv=643764953,logm=2576060315}) 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 msgr2=0x7f2ac00403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 0x7f2ac00403c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2af409f5f0 tx=0x7f2ae8033000 comp rx=0 tx=0).stop 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 10 monclient: shutdown 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 msgr2=0x7f2af41cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:02.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c5d0 tx=0x7f2adc00caa0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.693 INFO:tasks.rados.rados.0.trial142.stdout:1919: finishing copy_from racing read to trial14245205-17 2026-02-17T11:58:02.693 INFO:tasks.rados.rados.0.trial142.stdout:1919: finishing copy_from to trial14245205-17 2026-02-17T11:58:02.693 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 756 (ObjNum 629 snap 197 seq_num 629) dirty exists 2026-02-17T11:58:02.693 INFO:tasks.rados.rados.0.trial142.stdout:1919: done (5 left) 2026-02-17T11:58:02.693 INFO:tasks.rados.rados.0.trial142.stdout:1920: done (4 left) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1925: done (3 left) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1926: done (2 left) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1927: done (1 left) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1928: done (0 left) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1929: read oid 48 snap -1 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1929: expect (ObjNum 635 snap 197 seq_num 635) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1930: rollback oid 16 current snap is 211 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 209 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1931: read oid 36 snap -1 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1931: expect (ObjNum 655 snap 201 seq_num 655) 2026-02-17T11:58:02.694 INFO:tasks.rados.rados.0.trial142.stdout:1932: snap_create 2026-02-17T11:58:02.695 INFO:tasks.rados.rados.0.trial142.stdout:1931: expect (ObjNum 655 snap 201 seq_num 655) 2026-02-17T11:58:02.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2752610723}) 2026-02-17T11:58:02.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3290304755}) 2026-02-17T11:58:02.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2752610723}) 2026-02-17T11:58:02.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.687+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1703651344}) 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 shutdown_connections 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ac003df00 0x7f2ac00403c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2af413b760 0x7f2af4090dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2af40a3bb0 0x7f2af41cdff0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 --2- 10.20.193.51:0/3307690093 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2af40a0750 0x7f2af41cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 >> 10.20.193.51:0/3307690093 conn(0x7f2af40a30c0 msgr2=0x7f2af413ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:02.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 shutdown_connections 2026-02-17T11:58:02.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:02.687+0000 7f2af97d3640 1 -- 10.20.193.51:0/3307690093 wait complete. 2026-02-17T11:58:02.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594089708}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1920830221}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594089708}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=183648465}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3036330282}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1406996798}) 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3036330282}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.688+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=623420075}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1745100411}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3701039990}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1745100411}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1018505395}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2094445511}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3405270524}) 2026-02-17T11:58:02.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2094445511}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.689+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3635317602}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284671929}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=551344257}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284671929}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2043101934}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536159377}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3662703128}) 2026-02-17T11:58:02.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536159377}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.690+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1153163605}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=410316529}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4071623101}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=410316529}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=442521822}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493458488}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3520628178}) 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493458488}) 2026-02-17T11:58:02.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.691+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=603955202}) 2026-02-17T11:58:02.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:58:02.763 INFO:tasks.rados.rados.0.trial142.stdout:1930: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:58:02.763 INFO:tasks.rados.rados.0.trial142.stdout:1930: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:58:02.763 INFO:tasks.rados.rados.0.trial142.stdout:1930: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:58:02.763 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 993 (ObjNum 660 snap 207 seq_num 660) dirty exists 2026-02-17T11:58:02.763 INFO:tasks.rados.rados.0.trial142.stdout:1929: expect (ObjNum 635 snap 197 seq_num 635) 2026-02-17T11:58:02.788 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557928109}) 2026-02-17T11:58:02.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=156135193}) 2026-02-17T11:58:02.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557928109}) 2026-02-17T11:58:02.789 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.786+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4042467455}) 2026-02-17T11:58:02.798 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3895319337}) 2026-02-17T11:58:02.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2859017217}) 2026-02-17T11:58:02.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3895319337}) 2026-02-17T11:58:02.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.796+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2286588227}) 2026-02-17T11:58:02.807 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.807 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2135289894}) 2026-02-17T11:58:02.807 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=874222928}) 2026-02-17T11:58:02.807 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.807 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2135289894}) 2026-02-17T11:58:02.808 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.805+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2444684555}) 2026-02-17T11:58:02.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=148608909}) 2026-02-17T11:58:02.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3281534295}) 2026-02-17T11:58:02.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=148608909}) 2026-02-17T11:58:02.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4294131894}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706918848}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=919817449}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706918848}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3754033826}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=646584637}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2958376111}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=646584637}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2965496364}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1137376978}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3107394689}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1137376978}) 2026-02-17T11:58:02.922 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=117327570}) 2026-02-17T11:58:02.923 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.923 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1197540925}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1301349498}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1197540925}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=659907354}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1918122127}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3130978414}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1918122127}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1715633646}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359555343}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3313929878}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359555343}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.921+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3665063960}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477844819}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2483973921}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477844819}) 2026-02-17T11:58:02.924 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1858896820}) 2026-02-17T11:58:02.925 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4236596733}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4074596609}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4236596733}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2368924959}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447430509}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811669830}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447430509}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=932364745}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516274483}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1452035206}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516274483}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=22594765}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714683204}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3174569291}) 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714683204}) 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.923+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2179975336}) 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353271866}) 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4035457437}) 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353271866}) 2026-02-17T11:58:02.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=476950415}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737404836}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1862942034}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737404836}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.924+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2410550752}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1671440844}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2327275452}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1671440844}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1340844842}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1990145388}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2534795013}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1990145388}) 2026-02-17T11:58:02.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3179706543}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1607587944}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3285201848}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1607587944}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.925+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4168126493}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131181761}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4120895621}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131181761}) 2026-02-17T11:58:02.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1263731283}) 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2203744135}) 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=158575980}) 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2203744135}) 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.926+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4151023460}) 2026-02-17T11:58:02.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126068910}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3857164591}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126068910}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2429734356}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=743034516}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4015195111}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=743034516}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.927+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=152518147}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370705456}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=48327799}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370705456}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1285581462}) 2026-02-17T11:58:02.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272319039}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1125985521}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272319039}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2092902722}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3360986683}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1620564655}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3360986683}) 2026-02-17T11:58:02.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.928+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2332760821}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4274556112}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3563214973}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4274556112}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3443011034}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319619963}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4266782570}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319619963}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.929+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2374335632}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=849038920}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2958718958}) 2026-02-17T11:58:02.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=849038920}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=279065843}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3760702864}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=685973494}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3760702864}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.930+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=490489896}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2641247024}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1340458577}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2641247024}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3282466069}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1231778018}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3927580315}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1231778018}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.931+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1764337617}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=436618037}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1889426617}) 2026-02-17T11:58:02.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=436618037}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=636998537}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=89,mdsmap=3,mgr=8} crc {logm=2266378628,mdsmap=3207544932,mgr=2354395410}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=1777811901,mdsmap=3207544932,mgr=2479357392}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=89,mdsmap=3,mgr=8} crc {logm=2266378628,mdsmap=3207544932,mgr=2354395410}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=96,mdsmap=3,mgr=1} crc {logm=4195589642,mdsmap=3207544932,mgr=4133961934}) 2026-02-17T11:58:02.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=64} crc {mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3531995974,mon_config_key=2639384377,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1780293062,osd_snap=3897918276}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=63} crc {mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2693370177,mon_config_key=829000412,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1780293062,osd_snap=2545404926}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=64} crc {mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3531995974,mon_config_key=2639384377,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1780293062,osd_snap=3897918276}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.932+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3221019308,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1780293062,osd_snap=2138282931}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=10,osdmap=90} crc {osd_snap=323563538,osdmap=3193693432}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=80321857,osdmap=1675426160}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=10,osdmap=90} crc {osd_snap=323563538,osdmap=3193693432}) 2026-02-17T11:58:02.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:02.933+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=3742920916,osdmap=3540668808}) 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3972788446}) 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=335216278}) 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3972788446}) 2026-02-17T11:58:03.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:03.004+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=898813923}) 2026-02-17T11:58:03.708 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:58:03.708 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:03.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.774+0000 7f2ef9b61640 10 monclient: get_monmap_and_config 2026-02-17T11:58:03.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.774+0000 7f2ef9b61640 10 monclient: build_initial_monmap 2026-02-17T11:58:03.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.774+0000 7f2ef9b61640 10 monclient: monmap: 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:03.775591+0000 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:03.775591+0000 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:03.787 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.774+0000 7f2ef9b61640 1 Processor -- start 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 -- start start 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient: init 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-a con 0x7f2ef40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:03.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-b con 0x7f2ef409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2ef409ff40 0x7f2ef413b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-c con 0x7f2ef409ff40 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef409aed0 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef409caa0 con 0x7f2ef409ff40 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef40a3f90 con 0x7f2ef409dac0 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef9b61640 10 monclient(hunting): authenticate will time out at 1371.394429s 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36508/0 (socket says 10.20.193.51:36508) 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 -- 10.20.193.51:0/1327607514 learned_addr learned my addr 10.20.193.51:0/1327607514 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): get_auth_request con 0x7f2ef40a3bb0 auth_method 0 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): get_auth_request con 0x7f2ef409dac0 auth_method 0 2026-02-17T11:58:03.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef3fff640 1 --2- 10.20.193.51:0/1327607514 >> v2:10.20.193.142:3300/0 conn(0x7f2ef409ff40 0x7f2ef413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef3fff640 10 monclient(hunting): get_auth_request con 0x7f2ef409ff40 auth_method 0 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient(hunting): handle_auth_done global_id 164139 payload 274 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 -- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 msgr2=0x7f2ef409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 -- 10.20.193.51:0/1327607514 >> v2:10.20.193.142:3300/0 conn(0x7f2ef409ff40 msgr2=0x7f2ef413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/1327607514 >> v2:10.20.193.142:3300/0 conn(0x7f2ef409ff40 0x7f2ef413b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:03.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef37fe640 1 -- 10.20.193.51:0/1327607514 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef406e140 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.775+0000 7f2ef2ffd640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef409fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef37fe640 1 -- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 msgr2=0x7f2ef409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4076590 tx=0x7f2ee002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df59957567b9b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 1 -- 10.20.193.51:0/1327607514 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee003c070 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: dump: 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:03.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:03.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 1 -- 10.20.193.51:0/1327607514 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee002fca0 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 1 -- 10.20.193.51:0/1327607514 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0037660 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 5 monclient: authenticate success, global_id 164139 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 4 set_mon_vals no callback set 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef27fc640 10 monclient: dump: 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.795 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 10 monclient: shutdown 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 -- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 msgr2=0x7f2ef409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:03.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4076590 tx=0x7f2ee002ee60 comp rx=0 tx=0).stop 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 -- 10.20.193.51:0/1327607514 shutdown_connections 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/1327607514 >> v2:10.20.193.142:3300/0 conn(0x7f2ef409ff40 0x7f2ef413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef409fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/1327607514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef409f4c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 -- 10.20.193.51:0/1327607514 >> 10.20.193.51:0/1327607514 conn(0x7f2ef40a30c0 msgr2=0x7f2ef40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 -- 10.20.193.51:0/1327607514 shutdown_connections 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.778+0000 7f2ef9b61640 1 -- 10.20.193.51:0/1327607514 wait complete. 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient: build_initial_monmap 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient: monmap: 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:03.797 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 Processor -- start 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 -- start start 2026-02-17T11:58:03.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient: init 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-c con 0x7f2ef409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 0x7f2ef40946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-b con 0x7f2ef409ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef4094be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): picked mon.noname-a con 0x7f2ef40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40a0370 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef409a880 con 0x7f2ef409ff40 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef40a04f0 con 0x7f2ef409dac0 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef9b61640 10 monclient(hunting): authenticate will time out at 1371.398805s 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef4094be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34204/0 (socket says 10.20.193.51:34204) 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 -- 10.20.193.51:0/2309145864 learned_addr learned my addr 10.20.193.51:0/2309145864 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:03.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 10 monclient(hunting): get_auth_request con 0x7f2ef409dac0 auth_method 0 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): get_auth_request con 0x7f2ef40a3bb0 auth_method 0 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 msgr2=0x7f2ef4094160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 msgr2=0x7f2ef4094160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:03.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.779+0000 7f2ef3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef2ffd640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 0x7f2ef40946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 10 monclient(hunting): handle_auth_done global_id 164142 payload 824 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 msgr2=0x7f2ef4094160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 msgr2=0x7f2ef40946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 0x7f2ef40946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef3fff640 1 -- 10.20.193.51:0/2309145864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef4097b30 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef2ffd640 10 monclient: get_auth_request con 0x7f2ef409ff40 auth_method 0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.780+0000 7f2ef2ffd640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 0x7f2ef40946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef3fff640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 msgr2=0x7f2ef4094be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef3fff640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef4094be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007d40 tx=0x7f2ee800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003a90 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: dump: 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:03.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: _finish_auth 0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8003c50 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 5 monclient: authenticate success, global_id 164142 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _renew_subs 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef4096960 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8004020 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:03.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ecffff640 10 monclient: dump: 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef1ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _renew_subs 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef406d5e0 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.782+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef406cd40 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.783+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2ee8004240 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.783+0000 7f2ecffff640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 0x7f2ec40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.783+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(447..447 src has 323..447) ==== 4811+0+0 (secure 0 0 0) 0x7f2ee8052a10 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.783+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 0x7f2ec40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.783+0000 7f2ef37fe640 10 monclient: get_auth_request con 0x7f2ec403dd10 auth_method 0 2026-02-17T11:58:03.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.785+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2ef406cd40 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.785+0000 7f2ecffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:03.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.785+0000 7f2ecffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:03.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.786+0000 7f2ef37fe640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 0x7f2ec40401d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00090b0 tx=0x7f2ee0039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1929: done (3 left) 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1930: done (2 left) 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1931: done (1 left) 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1932: done (0 left) 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1933: rollback oid 5 current snap is 212 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 5 to 204 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1934: read oid 42 snap -1 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1934: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1935: read oid 6 snap -1 2026-02-17T11:58:03.811 INFO:tasks.rados.rados.0.trial142.stdout:1935: expect (ObjNum 631 snap 197 seq_num 631) 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1936: delete oid 30 current snap is 212 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1933: finishing rollback tid 0 to trial14245205-5 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1936: done (3 left) 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1937: copy_from oid 50 from oid 31 current snap is 212 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1938: snap_create 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1933: finishing rollback tid 1 to trial14245205-5 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1933: finishing rollback tid 2 to trial14245205-5 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 996 (ObjNum 630 snap 197 seq_num 630) dirty exists 2026-02-17T11:58:03.812 INFO:tasks.rados.rados.0.trial142.stdout:1934: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:03.858 INFO:tasks.rados.rados.0.trial142.stdout:1935: expect (ObjNum 631 snap 197 seq_num 631) 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.901+0000 7f2ef9b61640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.901+0000 7f2ef9b61640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.901+0000 7f2ef9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.901+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2ef40008d0 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.902+0000 7f2ecffff640 1 -- 10.20.193.51:0/2309145864 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f2ee801a2c0 con 0x7f2ef40a3bb0 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.902+0000 7f2ecffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:03.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.902+0000 7f2ecffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:03.905 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:03.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 msgr2=0x7f2ec40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:03.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 0x7f2ec40401d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00090b0 tx=0x7f2ee0039040 comp rx=0 tx=0).stop 2026-02-17T11:58:03.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 10 monclient: shutdown 2026-02-17T11:58:03.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 msgr2=0x7f2ef4094be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef4094be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007d40 tx=0x7f2ee800e4b0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 shutdown_connections 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2ec403dd10 0x7f2ec40401d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2ef40a3bb0 0x7f2ef4094be0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2ef409ff40 0x7f2ef40946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 --2- 10.20.193.51:0/2309145864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2ef409dac0 0x7f2ef4094160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 >> 10.20.193.51:0/2309145864 conn(0x7f2ef40a30c0 msgr2=0x7f2ef409e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 shutdown_connections 2026-02-17T11:58:03.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.903+0000 7f2ef9b61640 1 -- 10.20.193.51:0/2309145864 wait complete. 2026-02-17T11:58:03.913 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:58:03.913 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:58:03.913 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:58:03.913 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:58:03.937 INFO:tasks.rados.rados.0.trial142.stdout:1937: finishing copy_from racing read to trial14245205-50 2026-02-17T11:58:03.937 INFO:tasks.rados.rados.0.trial142.stdout:1937: finishing copy_from to trial14245205-50 2026-02-17T11:58:03.937 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1067 (ObjNum 626 snap 196 seq_num 626) dirty exists 2026-02-17T11:58:03.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.979+0000 7f7efb985640 10 monclient: get_monmap_and_config 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.979+0000 7f7efb985640 10 monclient: build_initial_monmap 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.979+0000 7f7efb985640 10 monclient: monmap: 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:03.980769+0000 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:03.980769+0000 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:03.982 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:03.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:03.983 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:03.983 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:03.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 Processor -- start 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 -- start start 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient: init 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7ef406c8d0 0x7f7ef406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-a con 0x7f7ef406c8d0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:03.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 0x7f7ef406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-b con 0x7f7ef40a0570 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7ef413c350 0x7f7ef413e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-c con 0x7f7ef413c350 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef40a09f0 con 0x7f7ef406c8d0 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef40a25a0 con 0x7f7ef413c350 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef406d730 con 0x7f7ef40a0570 2026-02-17T11:58:03.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7efb985640 10 monclient(hunting): authenticate will time out at 1371.599728s 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7ef406c8d0 0x7f7ef406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 0x7f7ef406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7ef406c8d0 0x7f7ef406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36530/0 (socket says 10.20.193.51:36530) 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 1 -- 10.20.193.51:0/1722856783 learned_addr learned my addr 10.20.193.51:0/1722856783 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): get_auth_request con 0x7f7ef406c8d0 auth_method 0 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request con 0x7f7ef40a0570 auth_method 0 2026-02-17T11:58:03.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef9efb640 1 --2- 10.20.193.51:0/1722856783 >> v2:10.20.193.142:3300/0 conn(0x7f7ef413c350 0x7f7ef413e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.980+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_done global_id 164145 payload 274 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 -- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 msgr2=0x7f7ef406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:03.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 0x7f7ef406d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 -- 10.20.193.51:0/1722856783 >> v2:10.20.193.142:3300/0 conn(0x7f7ef413c350 msgr2=0x7f7ef413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/1722856783 >> v2:10.20.193.142:3300/0 conn(0x7f7ef413c350 0x7f7ef413e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef96fa640 1 -- 10.20.193.51:0/1722856783 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40a19f0 con 0x7f7ef406c8d0 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.981+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 0x7f7ef406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ef96fa640 1 -- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef406c8d0 msgr2=0x7f7ef406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef406c8d0 0x7f7ef406ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ef406d9e0 tx=0x7f7ee402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc883275713d22e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 1 -- 10.20.193.51:0/1722856783 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee403c070 con 0x7f7ef406c8d0 2026-02-17T11:58:04.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: dump: 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.001 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 1 -- 10.20.193.51:0/1722856783 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee402fca0 con 0x7f7ef406c8d0 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7efb985640 5 monclient: authenticate success, global_id 164145 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 1 -- 10.20.193.51:0/1722856783 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4037660 con 0x7f7ef406c8d0 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7ee3fff640 10 monclient: dump: 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7efb985640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.983+0000 7f7efb985640 4 set_mon_vals no callback set 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: shutdown 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef406c8d0 msgr2=0x7f7ef406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef406c8d0 0x7f7ef406ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ef406d9e0 tx=0x7f7ee402ee60 comp rx=0 tx=0).stop 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- 10.20.193.51:0/1722856783 shutdown_connections 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 --2- 10.20.193.51:0/1722856783 >> v2:10.20.193.142:3300/0 conn(0x7f7ef413c350 0x7f7ef413e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef40a0570 0x7f7ef406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 --2- 10.20.193.51:0/1722856783 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef406c8d0 0x7f7ef406ccb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- 10.20.193.51:0/1722856783 >> 10.20.193.51:0/1722856783 conn(0x7f7ef40aab70 msgr2=0x7f7ef40aaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- 10.20.193.51:0/1722856783 shutdown_connections 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- 10.20.193.51:0/1722856783 wait complete. 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: monmap: 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:04.005 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 Processor -- start 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 -- start start 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: init 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.984+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-c con 0x7f7ef406c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 0x7f7ef413b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-a con 0x7f7ef40a0570 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ef413c350 0x7f7ef4122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): picked mon.noname-b con 0x7f7ef413c350 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40a10e0 con 0x7f7ef40a0570 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40a0f60 con 0x7f7ef413c350 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef413ec80 con 0x7f7ef406c8d0 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7efb985640 10 monclient(hunting): authenticate will time out at 1371.604027s 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 0x7f7ef413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:34214/0 (socket says 10.20.193.51:34214) 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 0x7f7ef413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36536/0 (socket says 10.20.193.51:36536) 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 -- 10.20.193.51:0/3847741503 learned_addr learned my addr 10.20.193.51:0/3847741503 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): get_auth_request con 0x7f7ef406c8d0 auth_method 0 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request con 0x7f7ef40a0570 auth_method 0 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient(hunting): handle_auth_done global_id 154223 payload 824 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ef413c350 msgr2=0x7f7ef4122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ef413c350 0x7f7ef4122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 msgr2=0x7f7ef413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 0x7f7ef413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 monclient: found mon.noname-c 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef96fa640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40a1d60 con 0x7f7ef406c8d0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.985+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef40a0570 0x7f7ef413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ef96fa640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 msgr2=0x7f7ef41cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4002410 tx=0x7f7ee4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4047070 con 0x7f7ef406c8d0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: dump: 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee402fe50 con 0x7f7ef406c8d0 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee403c040 con 0x7f7ef406c8d0 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee37fe640 4 set_mon_vals no callback set 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7ee1ffb640 10 monclient: dump: 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.012 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 5 monclient: authenticate success, global_id 154223 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 monclient: _renew_subs 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef4126ef0 con 0x7f7ef406c8d0 2026-02-17T11:58:04.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 monclient: _renew_subs 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef413e9b0 con 0x7f7ef406c8d0 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 0x7f7ef41234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.987+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef406ccb0 con 0x7f7ef413ba90 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 0x7f7ef41234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient: get_auth_request con 0x7f7ef413ba90 auth_method 0 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef96fa640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4002410 tx=0x7f7ee4004830 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f7ee4076f30 osd_map(448..448 src has 323..448) 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7ee403f9f0 con 0x7f7ef406c8d0 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_done global_id 164151 payload 824 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef8ef9640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ef4124c00 con 0x7f7ef413ba90 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ee1ffb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ec403dd10 0x7f7ec40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef9efb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ec403dd10 0x7f7ec40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.988+0000 7f7ef9efb640 10 monclient: get_auth_request con 0x7f7ec403dd10 auth_method 0 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ef8ef9640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 msgr2=0x7f7ef41234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 0x7f7ef41234a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8019070 con 0x7f7ef413ba90 2026-02-17T11:58:04.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 10 monclient: dump: 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.016 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7ee8004450 con 0x7f7ef413ba90 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 msgr2=0x7f7ef41234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 0x7f7ef41234a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee800f610 comp rx=0 tx=0).stop 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 msgr2=0x7f7ef41234a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.990+0000 7f7ee1ffb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef413ba90 0x7f7ef41234a0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee800f610 comp rx=0 tx=0).stop 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.991+0000 7f7ef9efb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ec403dd10 0x7f7ec40401d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ef413e130 tx=0x7f7ef00072f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7efb985640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7efb985640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 0x7f7ef41da010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7efb985640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4123df0 con 0x7f7ef41239e0 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 0x7f7ef41da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient: get_auth_request con 0x7f7ef41239e0 auth_method 0 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 10 monclient(hunting): handle_auth_done global_id 164154 payload 824 2026-02-17T11:58:04.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.993+0000 7f7ef8ef9640 1 -- 10.20.193.51:0/3847741503 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ef4069780 con 0x7f7ef41239e0 2026-02-17T11:58:04.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ef8ef9640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 msgr2=0x7f7ef41da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ef8ef9640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 0x7f7ef41da010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8019040 con 0x7f7ef41239e0 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ee1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ee1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.995+0000 7f7ee1ffb640 10 monclient: dump: 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.020 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f7ee8003e00 con 0x7f7ef41239e0 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 msgr2=0x7f7ef41da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 0x7f7ef41da010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee80047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 msgr2=0x7f7ef41da010 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ef41239e0 0x7f7ef41da010 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4124800 tx=0x7f7ee80047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.021 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28433, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:04.022 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:04.023 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:04.024 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.025 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:04.026 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.027 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.028 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.029 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.030 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:04.031 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:04.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ec403dd10 msgr2=0x7f7ec40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ec403dd10 0x7f7ec40401d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ef413e130 tx=0x7f7ef00072f0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 10 monclient: shutdown 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 msgr2=0x7f7ef41cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4002410 tx=0x7f7ee4004830 comp rx=0 tx=0).stop 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ef9efb640 1 -- 10.20.193.51:0/3847741503 reap_dead start 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7ee1ffb640 1 -- 10.20.193.51:0/3847741503 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (unknown 0 0 0) 0x7f7ee4076f30 con 0x7f7ef406c8d0 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 shutdown_connections 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 --2- 10.20.193.51:0/3847741503 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ef406c8d0 0x7f7ef41cecc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 >> 10.20.193.51:0/3847741503 conn(0x7f7ef40aab70 msgr2=0x7f7ef413caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 shutdown_connections 2026-02-17T11:58:04.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:03.996+0000 7f7efb985640 1 -- 10.20.193.51:0/3847741503 wait complete. 2026-02-17T11:58:04.033 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:04.033 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:58:04.034 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.098+0000 7f3bf5491640 10 monclient: get_monmap_and_config 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.098+0000 7f3bf5491640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.098+0000 7f3bf5491640 10 monclient: monmap: 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:04.099523+0000 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:04.099523+0000 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.100 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:04.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.098+0000 7f3bf5491640 1 Processor -- start 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 1 -- start start 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient: init 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3bf00a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3bf00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3bf013c770 0x7f3bf013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-a con 0x7f3bf013c770 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf009e8e0 con 0x7f3bf00a3bb0 2026-02-17T11:58:04.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf006e140 con 0x7f3bf00a0750 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf009f910 con 0x7f3bf013c770 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bf5491640 10 monclient(hunting): authenticate will time out at 1371.718334s 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3beeffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3bf00a3bb0 0x7f3bf009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58774/0 (socket says 10.20.193.51:58774) 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3beeffd640 1 -- 10.20.193.51:0/2217526469 learned_addr learned my addr 10.20.193.51:0/2217526469 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2217526469 >> v2:10.20.193.51:3300/0 conn(0x7f3bf013c770 0x7f3bf013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request con 0x7f3bf013c770 auth_method 0 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_done global_id 164157 payload 274 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2217526469 >> v1:10.20.193.142:6789/0 conn(0x7f3bf00a0750 legacy=0x7f3bf009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2217526469 >> v1:10.20.193.51:6789/0 conn(0x7f3bf00a3bb0 legacy=0x7f3bf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.099+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2217526469 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf009ccd0 con 0x7f3bf013c770 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bef7fe640 1 -- 10.20.193.51:0/2217526469 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 msgr2=0x7f3bf013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/2217526469 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf013eb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009d90 tx=0x7f3be002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a319f2197020f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 1 -- 10.20.193.51:0/2217526469 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be003c070 con 0x7f3bf013c770 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: dump: 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.112 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 1 -- 10.20.193.51:0/2217526469 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be0037640 con 0x7f3bf013c770 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 5 monclient: authenticate success, global_id 164157 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 1 -- 10.20.193.51:0/2217526469 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0037a10 con 0x7f3bf013c770 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 4 set_mon_vals no callback set 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bedffb640 10 monclient: dump: 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.114 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 10 monclient: shutdown 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 -- 10.20.193.51:0/2217526469 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 msgr2=0x7f3bf013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 --2- 10.20.193.51:0/2217526469 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf013eb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009d90 tx=0x7f3be002f190 comp rx=0 tx=0).stop 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 -- 10.20.193.51:0/2217526469 shutdown_connections 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 --2- 10.20.193.51:0/2217526469 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf013eb60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 -- 10.20.193.51:0/2217526469 >> 10.20.193.51:0/2217526469 conn(0x7f3bf00a30c0 msgr2=0x7f3bf00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 -- 10.20.193.51:0/2217526469 shutdown_connections 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 1 -- 10.20.193.51:0/2217526469 wait complete. 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.102+0000 7f3bf5491640 10 monclient: monmap: 2026-02-17T11:58:04.115 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 Processor -- start 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 -- start start 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient: init 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf00a0750 0x7f3bf0099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-c con 0x7f3bf00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bf00a3bb0 0x7f3bf009a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-b con 0x7f3bf00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): picked mon.noname-a con 0x7f3bf013c770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf009c850 con 0x7f3bf013c770 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf009ebe0 con 0x7f3bf00a3bb0 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf00a04b0 con 0x7f3bf00a0750 2026-02-17T11:58:04.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bf5491640 10 monclient(hunting): authenticate will time out at 1371.722398s 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36578/0 (socket says 10.20.193.51:36578) 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 learned_addr learned my addr 10.20.193.51:0/3855854376 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request con 0x7f3bf013c770 auth_method 0 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf00a0750 0x7f3bf0099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): get_auth_request con 0x7f3bf00a0750 auth_method 0 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bee7fc640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bf00a3bb0 0x7f3bf009a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient(hunting): handle_auth_done global_id 164160 payload 824 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf00a0750 msgr2=0x7f3bf0099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf00a0750 0x7f3bf0099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bf00a3bb0 msgr2=0x7f3bf009a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bf00a3bb0 0x7f3bf009a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf0095b90 con 0x7f3bf013c770 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bee7fc640 10 monclient: get_auth_request con 0x7f3bf00a3bb0 auth_method 0 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.103+0000 7f3bee7fc640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3bf00a3bb0 0x7f3bf009a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 msgr2=0x7f3bf009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bef7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009d90 tx=0x7f3be0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0047020 con 0x7f3bf013c770 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.120 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be0042880 con 0x7f3bf013c770 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 5 monclient: authenticate success, global_id 164160 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 10 monclient: _renew_subs 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf0096430 con 0x7f3bf013c770 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be003c040 con 0x7f3bf013c770 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bed7fa640 4 set_mon_vals no callback set 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 10 monclient: _renew_subs 2026-02-17T11:58:04.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.105+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf013cb50 con 0x7f3bf013c770 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bf5491640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bf5491640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 0x7f3bf0095dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf009b450 con 0x7f3bf009b070 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 0x7f3bf0095dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient: get_auth_request con 0x7f3bf009b070 auth_method 0 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3be0043420 con 0x7f3bf013c770 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 10 monclient(hunting): handle_auth_done global_id 154229 payload 824 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3beeffd640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bf009dac0 con 0x7f3bf009b070 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bcf7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bbc03dd10 0x7f3bbc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7f3be0078600 con 0x7f3bf013c770 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bee7fc640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bbc03dd10 0x7f3bbc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.106+0000 7f3bee7fc640 10 monclient: get_auth_request con 0x7f3bbc03dd10 auth_method 0 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3beeffd640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 msgr2=0x7f3bf0095dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3beeffd640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 0x7f3bf0095dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be400ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be400cbf0 con 0x7f3bf009b070 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.108+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.124 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3be4019070 con 0x7f3bf009b070 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 msgr2=0x7f3bf0095dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 0x7f3bf0095dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be400ef70 comp rx=0 tx=0).stop 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 msgr2=0x7f3bf0095dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bcf7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf009b070 0x7f3bf0095dd0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be400ef70 comp rx=0 tx=0).stop 2026-02-17T11:58:04.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.109+0000 7f3bee7fc640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bbc03dd10 0x7f3bbc0401d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0095330 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3bf5491640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3bf5491640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 0x7f3bf01d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3bf5491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf0069830 con 0x7f3bf0072820 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 0x7f3bf01d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient: get_auth_request con 0x7f3bf0072820 auth_method 0 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 10 monclient(hunting): handle_auth_done global_id 154232 payload 824 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.112+0000 7f3beeffd640 1 -- 10.20.193.51:0/3855854376 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3bf00008d0 con 0x7f3bf0072820 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.114+0000 7f3beeffd640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 msgr2=0x7f3bf01d9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3beeffd640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 0x7f3bf01d9f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be401e250 con 0x7f3bf0072820 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f3be401e250 con 0x7f3bf0072820 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 msgr2=0x7f3bf01d9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 0x7f3bf01d9f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be4004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 msgr2=0x7f3bf01d9f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bcf7fe640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3bf0072820 0x7f3bf01d9f00 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eaa0 tx=0x7f3be4004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.130 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 76995, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:04.131 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.132 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:04.133 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.134 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.135 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.136 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.137 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.138 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.139 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:04.140 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bbc03dd10 msgr2=0x7f3bbc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3bbc03dd10 0x7f3bbc0401d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0095330 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 10 monclient: shutdown 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 msgr2=0x7f3bf009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009d90 tx=0x7f3be0004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bef7fe640 1 -- 10.20.193.51:0/3855854376 reap_dead start 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 shutdown_connections 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 --2- 10.20.193.51:0/3855854376 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3bf013c770 0x7f3bf009ab30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 >> 10.20.193.51:0/3855854376 conn(0x7f3bf00a30c0 msgr2=0x7f3bf00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 shutdown_connections 2026-02-17T11:58:04.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.115+0000 7f3bf5491640 1 -- 10.20.193.51:0/3855854376 wait complete. 2026-02-17T11:58:04.142 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:04.143 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:58:04.143 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.208+0000 7fd0069a8640 10 monclient: get_monmap_and_config 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.208+0000 7fd0069a8640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.208+0000 7fd0069a8640 10 monclient: monmap: 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:04.209568+0000 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:04.209568+0000 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.210 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:04.211 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:04.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:04.211 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:04.211 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:04.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.208+0000 7fd0069a8640 1 Processor -- start 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 -- start start 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient: init 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd00009a5c0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd00009d340 0x7fd000141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-c con 0x7fd00009d340 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd000144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-b con 0x7fd00009b0b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00006e140 con 0x7fd00009a5c0 2026-02-17T11:58:04.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd00009cf20 con 0x7fd00009d340 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd00006daa0 con 0x7fd00009b0b0 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd0069a8640 10 monclient(hunting): authenticate will time out at 1371.828477s 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcffffff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd00009a5c0 0x7fd00009a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58788/0 (socket says 10.20.193.51:58788) 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcffffff640 1 -- 10.20.193.51:0/3805591201 learned_addr learned my addr 10.20.193.51:0/3805591201 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd000144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): get_auth_request con 0x7fd00009b0b0 auth_method 0 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcfff7fe640 1 --2- 10.20.193.51:0/3805591201 >> v2:10.20.193.142:3300/0 conn(0x7fd00009d340 0x7fd000141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcfff7fe640 10 monclient(hunting): get_auth_request con 0x7fd00009d340 auth_method 0 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcfff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcfff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fcfff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient(hunting): handle_auth_done global_id 154235 payload 274 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 -- 10.20.193.51:0/3805591201 >> v2:10.20.193.142:3300/0 conn(0x7fd00009d340 msgr2=0x7fd000141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3805591201 >> v2:10.20.193.142:3300/0 conn(0x7fd00009d340 0x7fd000141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 -- 10.20.193.51:0/3805591201 >> v1:10.20.193.51:6789/0 conn(0x7fd00009a5c0 legacy=0x7fd00009a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 monclient: found mon.noname-b 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:04.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.209+0000 7fd004f1e640 1 -- 10.20.193.51:0/3805591201 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00009c610 con 0x7fd00009b0b0 2026-02-17T11:58:04.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd004f1e640 1 -- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 msgr2=0x7fd000144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd000144000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd00009a290 tx=0x7fcff402f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462325d44285b9d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 1 -- 10.20.193.51:0/3805591201 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff403c070 con 0x7fd00009b0b0 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: dump: 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 5 monclient: authenticate success, global_id 154235 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 1 -- 10.20.193.51:0/3805591201 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff4037440 con 0x7fd00009b0b0 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 1 -- 10.20.193.51:0/3805591201 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4037810 con 0x7fd00009b0b0 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 4 set_mon_vals no callback set 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fcffeffd640 10 monclient: dump: 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.222 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 10 monclient: shutdown 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 -- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 msgr2=0x7fd000144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd000144000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd00009a290 tx=0x7fcff402f130 comp rx=0 tx=0).stop 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 -- 10.20.193.51:0/3805591201 shutdown_connections 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3805591201 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd000144000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3805591201 >> v2:10.20.193.142:3300/0 conn(0x7fd00009d340 0x7fd000141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 -- 10.20.193.51:0/3805591201 >> 10.20.193.51:0/3805591201 conn(0x7fd0000a30c0 msgr2=0x7fd0000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 -- 10.20.193.51:0/3805591201 shutdown_connections 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.212+0000 7fd0069a8640 1 -- 10.20.193.51:0/3805591201 wait complete. 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient: monmap: 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.223 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 Processor -- start 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 -- start start 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient: init 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009a5c0 0x7fd00013ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-b con 0x7fd00009a5c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd00013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-c con 0x7fd00009b0b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): picked mon.noname-a con 0x7fd000072260 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd0000a3fa0 con 0x7fd000072260 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd0000a3e20 con 0x7fd00009a5c0 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd000144540 con 0x7fd00009b0b0 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd0069a8640 10 monclient(hunting): authenticate will time out at 1371.832734s 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd00013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36584/0 (socket says 10.20.193.51:36584) 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 learned_addr learned my addr 10.20.193.51:0/3187946569 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): get_auth_request con 0x7fd000072260 auth_method 0 2026-02-17T11:58:04.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 10 monclient(hunting): get_auth_request con 0x7fd00009b0b0 auth_method 0 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 msgr2=0x7fd00013cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 msgr2=0x7fd00013cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd00013cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcfff7fe640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd00013cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009a5c0 0x7fd00013ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient(hunting): handle_auth_done global_id 164163 payload 824 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 msgr2=0x7fd00013cf40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd00009b0b0 0x7fd00013cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009a5c0 msgr2=0x7fd00013ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009a5c0 0x7fd00013ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00013f3f0 con 0x7fd000072260 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcffffff640 10 monclient: get_auth_request con 0x7fd00009a5c0 auth_method 0 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.213+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009a5c0 0x7fd00013ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 msgr2=0x7fd0000726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd004f1e640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009e90 tx=0x7fcff4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff403c050 con 0x7fd000072260 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: dump: 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.227 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff4048070 con 0x7fd000072260 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 5 monclient: authenticate success, global_id 164163 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 monclient: _renew_subs 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00009dbf0 con 0x7fd000072260 2026-02-17T11:58:04.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4041c60 con 0x7fd000072260 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffe7fc640 4 set_mon_vals no callback set 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 10 monclient: dump: 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.229 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 monclient: _renew_subs 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00013f110 con 0x7fd000072260 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 0x7fd000097e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd000069d90 con 0x7fd00009d340 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 0x7fd000097e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient: get_auth_request con 0x7fd00009d340 auth_method 0 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcff4003a90 con 0x7fd000072260 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.216+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcffcff9640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcfd003dd60 0x7fcfd0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcffffff640 10 monclient(hunting): handle_auth_done global_id 114472 payload 824 2026-02-17T11:58:04.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcffffff640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd00009a9a0 con 0x7fd00009d340 2026-02-17T11:58:04.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7fcff40781f0 con 0x7fd000072260 2026-02-17T11:58:04.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcfff7fe640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcfd003dd60 0x7fcfd0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.217+0000 7fcfff7fe640 10 monclient: get_auth_request con 0x7fcfd003dd60 auth_method 0 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffffff640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 msgr2=0x7fd000097e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 0x7fd000097e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec00dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec005de0 con 0x7fd00009d340 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 10 monclient: dump: 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.234 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fcfec017070 con 0x7fd00009d340 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 msgr2=0x7fd000097e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 0x7fd000097e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec00dbf0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 msgr2=0x7fd000097e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcffcff9640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd00009d340 0x7fd000097e10 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec00dbf0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.219+0000 7fcfff7fe640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcfd003dd60 0x7fcfd0040220 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd00013f600 tx=0x7fcff0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.222+0000 7fd0069a8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.222+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 0x7fd0001dead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.222+0000 7fd0069a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.222+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd00013dc20 con 0x7fd0000733f0 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 0x7fd0001dead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient: get_auth_request con 0x7fd0000733f0 auth_method 0 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 10 monclient(hunting): handle_auth_done global_id 114475 payload 824 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.223+0000 7fcffffff640 1 -- 10.20.193.51:0/3187946569 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd0000994d0 con 0x7fd0000733f0 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffffff640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 msgr2=0x7fd0001dead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffffff640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 0x7fd0001dead0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00bb40 con 0x7fd0000733f0 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 10 monclient: dump: 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.236 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fcfec00bb40 con 0x7fd0000733f0 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 msgr2=0x7fd0001dead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 0x7fd0001dead0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 msgr2=0x7fd0001dead0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:04.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.225+0000 7fcffcff9640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd0000733f0 0x7fd0001dead0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00d720 tx=0x7fcfec004a40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 118, 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 286100, 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.238 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.239 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:04.240 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:04.241 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.242 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:04.243 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.244 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:04.245 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.246 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:04.247 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:04.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcfd003dd60 msgr2=0x7fcfd0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcfd003dd60 0x7fcfd0040220 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd00013f600 tx=0x7fcff0008040 comp rx=0 tx=0).stop 2026-02-17T11:58:04.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 10 monclient: shutdown 2026-02-17T11:58:04.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 msgr2=0x7fd0000726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009e90 tx=0x7fcff4004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd004f1e640 1 -- 10.20.193.51:0/3187946569 reap_dead start 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 shutdown_connections 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 --2- 10.20.193.51:0/3187946569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd000072260 0x7fd0000726f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 >> 10.20.193.51:0/3187946569 conn(0x7fd0000a30c0 msgr2=0x7fd00009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 shutdown_connections 2026-02-17T11:58:04.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.226+0000 7fd0069a8640 1 -- 10.20.193.51:0/3187946569 wait complete. 2026-02-17T11:58:04.249 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:04.249 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:58:04.249 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:58:04.249 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:58:04.249 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:58:04.250 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:58:04.250 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:58:04.259 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:58:04.259 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:58:04.259 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:04.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.362+0000 7fb957291640 10 monclient: get_monmap_and_config 2026-02-17T11:58:04.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.362+0000 7fb957291640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.362+0000 7fb957291640 10 monclient: monmap: 2026-02-17T11:58:04.364 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.364 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:04.363570+0000 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:04.363570+0000 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:04.365 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 Processor -- start 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 -- start start 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient: init 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T11:58:04.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb950138600 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9500a35a0 0x7fb95013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): picked mon.noname-c con 0x7fb9500a35a0 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb95013d8a0 0x7fb95013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): picked mon.noname-a con 0x7fb95013d8a0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9500a1df0 con 0x7fb950138600 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500a6830 con 0x7fb95013d8a0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500a2c00 con 0x7fb9500a35a0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb957291640 10 monclient(hunting): authenticate will time out at 1371.982562s 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb95013d8a0 0x7fb95013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb95013d8a0 0x7fb95013fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36602/0 (socket says 10.20.193.51:36602) 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 -- 10.20.193.51:0/1481517926 learned_addr learned my addr 10.20.193.51:0/1481517926 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): get_auth_request con 0x7fb95013d8a0 auth_method 0 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb954805640 1 --2- 10.20.193.51:0/1481517926 >> v2:10.20.193.142:3300/0 conn(0x7fb9500a35a0 0x7fb95013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb954805640 10 monclient(hunting): get_auth_request con 0x7fb9500a35a0 auth_method 0 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb954805640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb954805640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb954805640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient(hunting): handle_auth_done global_id 164166 payload 274 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 -- 10.20.193.51:0/1481517926 >> v2:10.20.193.142:3300/0 conn(0x7fb9500a35a0 msgr2=0x7fb95013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 --2- 10.20.193.51:0/1481517926 >> v2:10.20.193.142:3300/0 conn(0x7fb9500a35a0 0x7fb95013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 -- 10.20.193.51:0/1481517926 >> v1:10.20.193.142:6789/0 conn(0x7fb950138600 legacy=0x7fb9501389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.363+0000 7fb955807640 1 -- 10.20.193.51:0/1481517926 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9500a65b0 con 0x7fb95013d8a0 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb955807640 1 -- 10.20.193.51:0/1481517926 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 msgr2=0x7fb95013fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb955807640 1 --2- 10.20.193.51:0/1481517926 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb95013fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb950075290 tx=0x7fb94c02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f87b540cefc72d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 1 -- 10.20.193.51:0/1481517926 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c02fe60 con 0x7fb95013d8a0 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: dump: 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.376 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 1 -- 10.20.193.51:0/1481517926 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c0373f0 con 0x7fb95013d8a0 2026-02-17T11:58:04.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 1 -- 10.20.193.51:0/1481517926 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0377c0 con 0x7fb95013d8a0 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 5 monclient: authenticate success, global_id 164166 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 4 set_mon_vals no callback set 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb93ffff640 10 monclient: dump: 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 10 monclient: shutdown 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 -- 10.20.193.51:0/1481517926 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 msgr2=0x7fb95013fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 --2- 10.20.193.51:0/1481517926 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb95013fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb950075290 tx=0x7fb94c02f230 comp rx=0 tx=0).stop 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 -- 10.20.193.51:0/1481517926 shutdown_connections 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 --2- 10.20.193.51:0/1481517926 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb95013fc90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 --2- 10.20.193.51:0/1481517926 >> v2:10.20.193.142:3300/0 conn(0x7fb9500a35a0 0x7fb95013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 -- 10.20.193.51:0/1481517926 >> 10.20.193.51:0/1481517926 conn(0x7fb9500a7460 msgr2=0x7fb9500a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 -- 10.20.193.51:0/1481517926 shutdown_connections 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.366+0000 7fb957291640 1 -- 10.20.193.51:0/1481517926 wait complete. 2026-02-17T11:58:04.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient: monmap: 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 Processor -- start 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 -- start start 2026-02-17T11:58:04.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient: init 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9500a35a0 0x7fb9501cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): picked mon.noname-b con 0x7fb9500a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 0x7fb950136be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): picked mon.noname-c con 0x7fb950138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): picked mon.noname-a con 0x7fb95013d8a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500a15f0 con 0x7fb95013d8a0 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500a25b0 con 0x7fb9500a35a0 2026-02-17T11:58:04.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500a1770 con 0x7fb950138600 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb957291640 10 monclient(hunting): authenticate will time out at 1371.986707s 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb954805640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 msgr2=0x7fb950136be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb954805640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 0x7fb950136be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36606/0 (socket says 10.20.193.51:36606) 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 -- 10.20.193.51:0/2699159683 learned_addr learned my addr 10.20.193.51:0/2699159683 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): get_auth_request con 0x7fb95013d8a0 auth_method 0 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955006640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9500a35a0 0x7fb9501cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955006640 10 monclient(hunting): get_auth_request con 0x7fb9500a35a0 auth_method 0 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955006640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955006640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient(hunting): handle_auth_done global_id 164169 payload 824 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 -- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 msgr2=0x7fb950136be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 0x7fb950136be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 -- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9500a35a0 msgr2=0x7fb9501cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9500a35a0 0x7fb9501cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 monclient: found mon.noname-a 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.367+0000 7fb955807640 1 -- 10.20.193.51:0/2699159683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950120fb0 con 0x7fb95013d8a0 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.370+0000 7fb955807640 1 -- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 msgr2=0x7fb9500711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.370+0000 7fb955807640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009f50 tx=0x7fb94c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.370+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c046020 con 0x7fb95013d8a0 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: dump: 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.384 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c041870 con 0x7fb95013d8a0 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 5 monclient: authenticate success, global_id 164169 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _renew_subs 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb950073bf0 con 0x7fb95013d8a0 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:04.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c041c40 con 0x7fb95013d8a0 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 10 monclient: dump: 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93f7fe640 4 set_mon_vals no callback set 2026-02-17T11:58:04.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _renew_subs 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb950121290 con 0x7fb95013d8a0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9500512a0 con 0x7fb95013d8a0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.372+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb94c04b450 con 0x7fb95013d8a0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.373+0000 7fb93dffb640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 0x7fb9200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.373+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7fb94c078150 con 0x7fb95013d8a0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.373+0000 7fb955006640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 0x7fb9200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.373+0000 7fb955006640 10 monclient: get_auth_request con 0x7fb92003dd10 auth_method 0 2026-02-17T11:58:04.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.375+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9500512a0 con 0x7fb95013d8a0 2026-02-17T11:58:04.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.375+0000 7fb93dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:04.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.375+0000 7fb93dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:04.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.375+0000 7fb955006640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 0x7fb9200401d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb940005020 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:04.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb957291640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:04.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb957291640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb957291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb950073790 con 0x7fb95013d8a0 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb93dffb640 1 -- 10.20.193.51:0/2699159683 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fb94c050020 con 0x7fb95013d8a0 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb93dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.492+0000 7fb93dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:04.495 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:04.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 msgr2=0x7fb9200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 0x7fb9200401d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb940005020 tx=0x7fb940009040 comp rx=0 tx=0).stop 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 10 monclient: shutdown 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 msgr2=0x7fb9500711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009f50 tx=0x7fb94c004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 shutdown_connections 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb92003dd10 0x7fb9200401d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb95013d8a0 0x7fb9500711d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb950138600 0x7fb950136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 --2- 10.20.193.51:0/2699159683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9500a35a0 0x7fb9501cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:04.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 >> 10.20.193.51:0/2699159683 conn(0x7fb9500a7460 msgr2=0x7fb95013ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:04.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 shutdown_connections 2026-02-17T11:58:04.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:04.493+0000 7fb957291640 1 -- 10.20.193.51:0/2699159683 wait complete. 2026-02-17T11:58:07.503 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:07.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.569+0000 7f83e7ede640 10 monclient: get_monmap_and_config 2026-02-17T11:58:07.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.569+0000 7f83e7ede640 10 monclient: build_initial_monmap 2026-02-17T11:58:07.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.569+0000 7f83e7ede640 10 monclient: monmap: 2026-02-17T11:58:07.573 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:07.570899+0000 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:07.570899+0000 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 Processor -- start 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 -- start start 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient: init 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f83e00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83e013d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-b con 0x7f83e013b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f83e013dcb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e0135430 con 0x7f83e013dcb0 2026-02-17T11:58:07.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e009af60 con 0x7f83e00a3bb0 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f83e009a5c0 con 0x7f83e013b380 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e7ede640 10 monclient(hunting): authenticate will time out at 1375.189667s 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e5452640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 msgr2=0x7f83e013d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e5452640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83e013d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e6454640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f83e013dcb0 0x7f83e01400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:51482/0 (socket says 10.20.193.51:51482) 2026-02-17T11:58:07.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.570+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 learned_addr learned my addr 10.20.193.51:0/2561284298 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:07.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.572+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 >> v1:10.20.193.51:6789/0 conn(0x7f83e013dcb0 legacy=0x7f83e01400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:07.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478511042 0 0) 0x7f83e0135430 con 0x7f83e013dcb0 2026-02-17T11:58:07.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): _negotiate 2026-02-17T11:58:07.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): my global_id is 164172 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c8003620 con 0x7f83e013dcb0 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5c53640 1 -- 10.20.193.51:0/2561284298 >> v1:10.20.193.142:6789/0 conn(0x7f83e00a3bb0 legacy=0x7f83e009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526229856 0 0) 0x7f83c8003620 con 0x7f83e013dcb0 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 msgr2=0x7f83e013d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83e013d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 >> v1:10.20.193.142:6789/0 conn(0x7f83e00a3bb0 legacy=0x7f83e009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _finish_hunting 0 2026-02-17T11:58:07.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e009b240 con 0x7f83e013dcb0 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _finish_auth 0 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _check_auth_tickets 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f83dc003520 con 0x7f83e013dcb0 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:07.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: dump: 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 >> v1:10.20.193.51:6789/0 conn(0x7f83e013dcb0 legacy=0x7f83e01400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83c8003b30 0x7f83c8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): picked mon.b con 0x7f83c8003b30 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83c8004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): picked mon.c con 0x7f83e013b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 0x7f83c800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): picked mon.a con 0x7f83c8005020 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:07.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f83e009a5c0 con 0x7f83c8005020 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f83c800c000 con 0x7f83c8003b30 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f83c800c180 con 0x7f83e013b380 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e4c51640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5452640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 msgr2=0x7f83c8004900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5452640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83c8004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 0x7f83c800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:07.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): get_auth_request con 0x7f83c8005020 auth_method 0 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5c53640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83c8003b30 0x7f83c8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient(hunting): handle_auth_done global_id 164172 payload 293 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 msgr2=0x7f83c8004900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:07.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e013b380 0x7f83c8004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83c8003b30 msgr2=0x7f83c8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83c8003b30 0x7f83c8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient: _finish_hunting 0 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 monclient: found mon.a 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c8003620 con 0x7f83c8005020 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient: _finish_auth 0 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 10 monclient: _check_auth_tickets 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e6454640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:07.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5c53640 10 monclient: get_auth_request con 0x7f83c8003b30 auth_method 0 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e5c53640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83c8003b30 0x7f83c8003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e7ede640 5 monclient: authenticate success, global_id 164172 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.573+0000 7f83e7ede640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 msgr2=0x7f83c800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e6454640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 0x7f83c800bac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83dc003740 tx=0x7f83dc02fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48bd6979f3f4adc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00a6b0 con 0x7f83c8005020 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e4c51640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e4c51640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.575+0000 7f83e4c51640 10 monclient: dump: 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc034070 con 0x7f83c8005020 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 1 -- 10.20.193.51:0/2561284298 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc030a50 con 0x7f83c8005020 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:07.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 4 set_mon_vals no callback set 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e4c51640 10 monclient: dump: 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:07.597 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 10 monclient: shutdown 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 msgr2=0x7f83c800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 --2- 10.20.193.51:0/2561284298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83c8005020 0x7f83c800bac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83dc003740 tx=0x7f83dc02fdb0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e6454640 1 -- 10.20.193.51:0/2561284298 reap_dead start 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- 10.20.193.51:0/2561284298 shutdown_connections 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- 10.20.193.51:0/2561284298 >> 10.20.193.51:0/2561284298 conn(0x7f83e00a30c0 msgr2=0x7f83e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- 10.20.193.51:0/2561284298 shutdown_connections 2026-02-17T11:58:07.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- 10.20.193.51:0/2561284298 wait complete. 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 10 monclient: build_initial_monmap 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 10 monclient: monmap: 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:07.599 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 Processor -- start 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 1 -- start start 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.576+0000 7f83e7ede640 10 monclient: init 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83e0136540 0x7f83e0136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-b con 0x7f83e0136540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-a con 0x7f83e0136e60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 0x7f83e01d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): picked mon.noname-c con 0x7f83e01d42f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f83e0135040 con 0x7f83e0136e60 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f83e00a3f90 con 0x7f83e0136540 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f83e01351c0 con 0x7f83e01d42f0 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:07.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e7ede640 10 monclient(hunting): authenticate will time out at 1375.196227s 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e6454640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 msgr2=0x7f83e01d66e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e6454640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 0x7f83e01d66e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52762/0 (socket says 10.20.193.51:52762) 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 -- 10.20.193.51:0/1384901443 learned_addr learned my addr 10.20.193.51:0/1384901443 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): get_auth_request con 0x7f83e0136e60 auth_method 0 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:07.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5c53640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83e0136540 0x7f83e0136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5c53640 10 monclient(hunting): get_auth_request con 0x7f83e0136540 auth_method 0 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5c53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5c53640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5c53640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient(hunting): handle_auth_done global_id 164175 payload 824 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 -- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 msgr2=0x7f83e01d66e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:07.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 0x7f83e01d66e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 -- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83e0136540 msgr2=0x7f83e0136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83e0136540 0x7f83e0136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient: _finish_hunting 0 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 monclient: found mon.noname-a 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.577+0000 7f83e5452640 1 -- 10.20.193.51:0/1384901443 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e01381e0 con 0x7f83e0136e60 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e5452640 1 -- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 msgr2=0x7f83e01d3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e5452640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83d400bdb0 tx=0x7f83d400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4003cb0 con 0x7f83e0136e60 2026-02-17T11:58:07.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: dump: 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:07.605 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4010070 con 0x7f83e0136e60 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 5 monclient: authenticate success, global_id 164175 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 10 monclient: _renew_subs 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e013a4d0 con 0x7f83e0136e60 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d40052b0 con 0x7f83e0136e60 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:07.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83cffff640 4 set_mon_vals no callback set 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83ce7fc640 10 monclient: dump: 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:07.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 10 monclient: _renew_subs 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.579+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e009d7b0 con 0x7f83e0136e60 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e7ede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e7ede640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e7ede640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e009d560 con 0x7f83e0136e60 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f83d401d030 con 0x7f83e0136e60 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83ce7fc640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 0x7f83b0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7f83d40524e0 con 0x7f83e0136e60 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e5c53640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 0x7f83b0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:07.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.580+0000 7f83e5c53640 10 monclient: get_auth_request con 0x7f83b003dcc0 auth_method 0 2026-02-17T11:58:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.582+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f83d401c2f0 con 0x7f83e0136e60 2026-02-17T11:58:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.582+0000 7f83ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.582+0000 7f83ce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.583+0000 7f83e5c53640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 0x7f83b0040180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f83d0007fd0 tx=0x7f83d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83e7ede640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83e7ede640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83e7ede640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f83e0138f60 con 0x7f83e0136e60 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83ce7fc640 1 -- 10.20.193.51:0/1384901443 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f83d4014e80 con 0x7f83e0136e60 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:07.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.697+0000 7f83ce7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 msgr2=0x7f83b0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 0x7f83b0040180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f83d0007fd0 tx=0x7f83d0009040 comp rx=0 tx=0).stop 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 10 monclient: shutdown 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 msgr2=0x7f83e01d3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83d400bdb0 tx=0x7f83d400beb0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 shutdown_connections 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f83b003dcc0 0x7f83b0040180 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83e01d42f0 0x7f83e01d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f83e0136e60 0x7f83e01d3db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 --2- 10.20.193.51:0/1384901443 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83e0136540 0x7f83e0136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:07.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 >> 10.20.193.51:0/1384901443 conn(0x7f83e00a30c0 msgr2=0x7f83e00997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:07.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 shutdown_connections 2026-02-17T11:58:07.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:07.698+0000 7f83e7ede640 1 -- 10.20.193.51:0/1384901443 wait complete. 2026-02-17T11:58:10.708 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:10.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.774+0000 7fe81846f640 10 monclient: get_monmap_and_config 2026-02-17T11:58:10.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.774+0000 7fe81846f640 10 monclient: build_initial_monmap 2026-02-17T11:58:10.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.774+0000 7fe81846f640 10 monclient: monmap: 2026-02-17T11:58:10.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:10.779 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:10.775919+0000 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:10.775919+0000 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 Processor -- start 2026-02-17T11:58:10.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 -- start start 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient: init 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 0x7fe81009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-b con 0x7fe8100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe81009dac0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe8100a0110 0x7fe81013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-c con 0x7fe8100a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81006e140 con 0x7fe81009dac0 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:10.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe81009aed0 con 0x7fe8100a0110 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe81009caa0 con 0x7fe8100a3bb0 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe81846f640 10 monclient(hunting): authenticate will time out at 1378.394717s 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8161e4640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 msgr2=0x7fe81009f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8161e4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 0x7fe81009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8169e5640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe8100a0110 0x7fe81013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8159e3640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fe81009dac0 0x7fe81009fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:55866/0 (socket says 10.20.193.51:55866) 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8159e3640 1 -- 10.20.193.51:0/1549863923 learned_addr learned my addr 10.20.193.51:0/1549863923 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8169e5640 10 monclient(hunting): get_auth_request con 0x7fe8100a0110 auth_method 0 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8169e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8169e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:10.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.775+0000 7fe8169e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient(hunting): handle_auth_done global_id 114487 payload 274 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 1 -- 10.20.193.51:0/1549863923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 msgr2=0x7fe81009f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 1 --2- 10.20.193.51:0/1549863923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 0x7fe81009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 1 -- 10.20.193.51:0/1549863923 >> v1:10.20.193.142:6789/0 conn(0x7fe81009dac0 legacy=0x7fe81009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient: _finish_hunting 0 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 1 monclient: found mon.noname-c 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:58:10.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.776+0000 7fe8169e5640 1 -- 10.20.193.51:0/1549863923 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81009ce60 con 0x7fe8100a0110 2026-02-17T11:58:10.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.778+0000 7fe8169e5640 1 -- 10.20.193.51:0/1549863923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 msgr2=0x7fe81013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.778+0000 7fe8169e5640 1 --2- 10.20.193.51:0/1549863923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe81006dc20 tx=0x7fe80c02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d43835b01c4e2b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 1 -- 10.20.193.51:0/1549863923 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c03c070 con 0x7fe8100a0110 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: dump: 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:10.791 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: _finish_auth 0 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: _check_auth_tickets 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 1 -- 10.20.193.51:0/1549863923 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c037640 con 0x7fe8100a0110 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 5 monclient: authenticate success, global_id 114487 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 1 -- 10.20.193.51:0/1549863923 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c037a10 con 0x7fe8100a0110 2026-02-17T11:58:10.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe8151e2640 10 monclient: dump: 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:10.793 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 4 set_mon_vals no callback set 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 10 monclient: shutdown 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 -- 10.20.193.51:0/1549863923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 msgr2=0x7fe81013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 --2- 10.20.193.51:0/1549863923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe81006dc20 tx=0x7fe80c02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 -- 10.20.193.51:0/1549863923 shutdown_connections 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 --2- 10.20.193.51:0/1549863923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 --2- 10.20.193.51:0/1549863923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe8100a3bb0 0x7fe81009f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 -- 10.20.193.51:0/1549863923 >> 10.20.193.51:0/1549863923 conn(0x7fe8100a30c0 msgr2=0x7fe8100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 -- 10.20.193.51:0/1549863923 shutdown_connections 2026-02-17T11:58:10.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 1 -- 10.20.193.51:0/1549863923 wait complete. 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 10 monclient: build_initial_monmap 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.779+0000 7fe81846f640 10 monclient: monmap: 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:10.795 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 Processor -- start 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 -- start start 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient: init 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 0x7fe8101c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-c con 0x7fe81009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-b con 0x7fe8100a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): picked mon.noname-a con 0x7fe8100a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:10.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe81009a880 con 0x7fe8100a3bb0 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100a0520 con 0x7fe8100a0110 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe81013cca0 con 0x7fe81009dac0 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe81846f640 10 monclient(hunting): authenticate will time out at 1378.399494s 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8161e4640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 msgr2=0x7fe8101c9c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8161e4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 0x7fe8101c9c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52772/0 (socket says 10.20.193.51:52772) 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 -- 10.20.193.51:0/1634358208 learned_addr learned my addr 10.20.193.51:0/1634358208 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:10.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): get_auth_request con 0x7fe8100a3bb0 auth_method 0 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8159e3640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8159e3640 10 monclient(hunting): get_auth_request con 0x7fe8100a0110 auth_method 0 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8159e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8159e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8159e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:10.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient(hunting): handle_auth_done global_id 164178 payload 824 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 -- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 msgr2=0x7fe8101c9c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 0x7fe8101c9c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 -- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 msgr2=0x7fe81013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient: _finish_hunting 0 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 monclient: found mon.noname-a 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.780+0000 7fe8169e5640 1 -- 10.20.193.51:0/1634358208 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101ca690 con 0x7fe8100a3bb0 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.782+0000 7fe8169e5640 1 -- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 msgr2=0x7fe8101cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.782+0000 7fe8169e5640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009e90 tx=0x7fe80c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:10.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c047020 con 0x7fe8100a3bb0 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: dump: 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:10.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c042680 con 0x7fe8100a3bb0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 5 monclient: authenticate success, global_id 164178 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _renew_subs 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810137b70 con 0x7fe8100a3bb0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c03c040 con 0x7fe8100a3bb0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:10.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe8149e1640 4 set_mon_vals no callback set 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 10 monclient: dump: 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:10.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _renew_subs 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81009f4a0 con 0x7fe8100a3bb0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe80c042ad0 con 0x7fe8100a3bb0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81009ef70 con 0x7fe8100a3bb0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 0x7fe7e0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.783+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7fe80c0782b0 con 0x7fe8100a3bb0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.784+0000 7fe8161e4640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 0x7fe7e0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.784+0000 7fe8161e4640 10 monclient: get_auth_request con 0x7fe7e003dcc0 auth_method 0 2026-02-17T11:58:10.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.786+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe80c051070 con 0x7fe8100a3bb0 2026-02-17T11:58:10.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.786+0000 7fe7f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:10.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.786+0000 7fe7f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:10.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.786+0000 7fe8161e4640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 0x7fe7e0040180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe800003a80 tx=0x7fe800009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:10.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe81846f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe81846f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe81846f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe81013d0f0 con 0x7fe8100a3bb0 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe7f6ffd640 1 -- 10.20.193.51:0/1634358208 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fe8101ca690 con 0x7fe8100a3bb0 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe7f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:10.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.905+0000 7fe7f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:10.909 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 msgr2=0x7fe7e0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 0x7fe7e0040180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe800003a80 tx=0x7fe800009270 comp rx=0 tx=0).stop 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 10 monclient: shutdown 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 msgr2=0x7fe8101cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009e90 tx=0x7fe80c004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 shutdown_connections 2026-02-17T11:58:10.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe7e003dcc0 0x7fe7e0040180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe8100a3bb0 0x7fe8101cd130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe8100a0110 0x7fe81013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 --2- 10.20.193.51:0/1634358208 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe81009dac0 0x7fe8101c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 >> 10.20.193.51:0/1634358208 conn(0x7fe8100a30c0 msgr2=0x7fe8100a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 shutdown_connections 2026-02-17T11:58:10.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:10.906+0000 7fe81846f640 1 -- 10.20.193.51:0/1634358208 wait complete. 2026-02-17T11:58:13.917 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.983+0000 7f57410ca640 10 monclient: get_monmap_and_config 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.983+0000 7f57410ca640 10 monclient: build_initial_monmap 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.983+0000 7f57410ca640 10 monclient: monmap: 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:13.984667+0000 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:13.984667+0000 2026-02-17T11:58:13.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 Processor -- start 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 -- start start 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient: init 2026-02-17T11:58:13.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-c con 0x7f573c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-b con 0x7f573c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f573c09e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573c06e140 con 0x7f573c09e540 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f573c0a3f90 con 0x7f573c0a3bb0 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f573c09f910 con 0x7f573c0a0750 2026-02-17T11:58:13.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f57410ca640 10 monclient(hunting): authenticate will time out at 1381.603497s 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573a575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 msgr2=0x7f573c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573a575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573b577640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f573c09e540 0x7f573c13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:55882/0 (socket says 10.20.193.51:55882) 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 learned_addr learned my addr 10.20.193.51:0/3887584701 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f573c0a3bb0 auth_method 0 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:13.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:13.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:13.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:13.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.984+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:13.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:13.986+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 >> v1:10.20.193.142:6789/0 conn(0x7f573c09e540 legacy=0x7f573c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573a575640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 msgr2=0x7f573c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:14.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573a575640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f573c0a3bb0 auth_method 0 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:14.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573a575640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 msgr2=0x7f573c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573a575640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f573c0a3bb0 auth_method 0 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:14.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:14.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:14.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:14.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:14.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:14.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:14.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:58:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573a575640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 msgr2=0x7f573c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573a575640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f573c0a3bb0 auth_method 0 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:15.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:58:16.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): tick 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 monclient(hunting): continuing hunt 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 msgr2=0x7f573c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f573c0a0750 0x7f573c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 msgr2=0x7f573c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:16.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.142:3300/0 conn(0x7f573c0a3bb0 0x7f573c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 -- 10.20.193.51:0/3887584701 >> v1:10.20.193.142:6789/0 conn(0x7f573c09e540 legacy=0x7f573c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient: _add_conns ranks=[3,0] 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): picked mon.noname-a con 0x7f5720003840 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5720006390 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 -- 10.20.193.51:0/3887584701 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573c09ccd0 con 0x7f5720006390 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 1 -- 10.20.193.51:0/3887584701 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f573c0a3f90 con 0x7f5720003840 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f5738d72640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:16.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f5720003840 auth_method 0 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:16.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.984+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:16.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:16.986+0000 7f573a575640 1 -- 10.20.193.51:0/3887584701 >> v1:10.20.193.51:6789/0 conn(0x7f5720006390 legacy=0x7f5720008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:17.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:17.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f5720003840 auth_method 0 2026-02-17T11:58:17.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:17.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.185+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f5720003840 auth_method 0 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:17.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:17.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:17.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:17.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:17.586+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:58:18.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 10 monclient(hunting): get_auth_request con 0x7f5720003840 auth_method 0 2026-02-17T11:58:18.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:18.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:18.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:18.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:18.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.387+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:58:18.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280737729 0 0) 0x7f573c09ccd0 con 0x7f5720006390 2026-02-17T11:58:18.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 10 monclient(hunting): _negotiate 2026-02-17T11:58:18.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 10 monclient(hunting): my global_id is 164181 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.803+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5728003620 con 0x7f5720006390 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3945301129 0 0) 0x7f5728003620 con 0x7f5720006390 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 msgr2=0x7f5720005cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 --2- 10.20.193.51:0/3887584701 >> v2:10.20.193.51:3300/0 conn(0x7f5720003840 0x7f5720005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _finish_hunting 0 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572000b1c0 con 0x7f5720006390 2026-02-17T11:58:18.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _finish_auth 0 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _check_auth_tickets 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f57240046f0 con 0x7f5720006390 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: dump: 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.818 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 >> v1:10.20.193.51:6789/0 conn(0x7f5720006390 legacy=0x7f5720008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 reap_dead start 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 0x7f5728003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): picked mon.c con 0x7f5728003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:18.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728004900 0x7f5728004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): picked mon.b con 0x7f5728004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 0x7f572800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): picked mon.a con 0x7f5728005390 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f573c0a3f90 con 0x7f5728005390 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f572800c2e0 con 0x7f5728004900 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f572800c4e0 con 0x7f5728003ab0 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:18.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f5739d74640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573ad76640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 msgr2=0x7f5728003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573ad76640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 0x7f5728003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 0x7f572800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): get_auth_request con 0x7f5728005390 auth_method 0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728004900 0x7f5728004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): get_auth_request con 0x7f5728004900 auth_method 0 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient(hunting): handle_auth_done global_id 164181 payload 293 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 msgr2=0x7f5728003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 0x7f5728003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728004900 msgr2=0x7f5728004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728004900 0x7f5728004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient: _finish_hunting 0 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 monclient: found mon.a 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5728003620 con 0x7f5728005390 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient: _finish_auth 0 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 10 monclient: _check_auth_tickets 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f573b577640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f57410ca640 5 monclient: authenticate success, global_id 164181 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.804+0000 7f57410ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f573b577640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 msgr2=0x7f572800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f573b577640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 0x7f572800bac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f573c09d3f0 tx=0x7f572c02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83905a7966086478 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c0038b0 con 0x7f5728005390 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: dump: 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:18.824 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c033070 con 0x7f5728005390 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 1 -- 10.20.193.51:0/3887584701 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c0386b0 con 0x7f5728005390 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 4 set_mon_vals no callback set 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f5739d74640 10 monclient: dump: 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:18.825 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 10 monclient: shutdown 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 -- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 msgr2=0x7f572800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 0x7f572800bac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f573c09d3f0 tx=0x7f572c02f4c0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 -- 10.20.193.51:0/3887584701 shutdown_connections 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728005390 0x7f572800bac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728004900 0x7f5728004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 --2- 10.20.193.51:0/3887584701 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728003ab0 0x7f5728003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 -- 10.20.193.51:0/3887584701 >> 10.20.193.51:0/3887584701 conn(0x7f573c0a30c0 msgr2=0x7f573c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 -- 10.20.193.51:0/3887584701 shutdown_connections 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.807+0000 7f57410ca640 1 -- 10.20.193.51:0/3887584701 wait complete. 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient: build_initial_monmap 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient: monmap: 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:18.827 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 Processor -- start 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 -- start start 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient: init 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:18.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 0x7f573c09c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-b con 0x7f5728003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-a con 0x7f5728004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 0x7f573c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): picked mon.noname-c con 0x7f5728005390 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f573c09c850 con 0x7f5728004900 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f573c09ef20 con 0x7f5728003ab0 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f573c0a04b0 con 0x7f5728005390 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f57410ca640 10 monclient(hunting): authenticate will time out at 1386.427922s 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f573b577640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 msgr2=0x7f573c0975d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f573b577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 0x7f573c0975d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f573a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.808+0000 7f573a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:47954/0 (socket says 10.20.193.51:47954) 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 -- 10.20.193.51:0/1009106352 learned_addr learned my addr 10.20.193.51:0/1009106352 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): get_auth_request con 0x7f5728004900 auth_method 0 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573ad76640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 0x7f573c09c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient(hunting): handle_auth_done global_id 164184 payload 824 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 -- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 msgr2=0x7f573c0975d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 0x7f573c0975d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 -- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 msgr2=0x7f573c09c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 0x7f573c09c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient: _finish_hunting 0 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 monclient: found mon.noname-a 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:18.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573a575640 1 -- 10.20.193.51:0/1009106352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c09d7b0 con 0x7f5728004900 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573ad76640 10 monclient: get_auth_request con 0x7f5728003ab0 auth_method 0 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.809+0000 7f573ad76640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 0x7f573c09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f573a575640 1 -- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 msgr2=0x7f573c097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f573a575640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5724004fd0 tx=0x7f5724006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724017070 con 0x7f5728004900 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: dump: 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:18.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572400fba0 con 0x7f5728004900 2026-02-17T11:58:18.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 5 monclient: authenticate success, global_id 164184 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 10 monclient: _renew_subs 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c099b70 con 0x7f5728004900 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240133f0 con 0x7f5728004900 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f571b7fe640 10 monclient: dump: 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.834 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f5739573640 4 set_mon_vals no callback set 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 10 monclient: _renew_subs 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.811+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c09a3f0 con 0x7f5728004900 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f57410ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f57410ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f57410ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c09dc30 con 0x7f5728004900 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f57240135d0 con 0x7f5728004900 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f571b7fe640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 0x7f5708040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7f5724052a50 con 0x7f5728004900 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f573ad76640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 0x7f5708040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.812+0000 7f573ad76640 10 monclient: get_auth_request con 0x7f570803dcc0 auth_method 0 2026-02-17T11:58:18.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.815+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5724012c50 con 0x7f5728004900 2026-02-17T11:58:18.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.815+0000 7f571b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.815+0000 7f571b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:18.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.815+0000 7f573ad76640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 0x7f5708040180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fb0 tx=0x7f5730008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.927+0000 7f57410ca640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:18.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.927+0000 7f57410ca640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:18.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.927+0000 7f57410ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:18.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.927+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f573c09aad0 con 0x7f5728004900 2026-02-17T11:58:18.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.928+0000 7f571b7fe640 1 -- 10.20.193.51:0/1009106352 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f572401bcb0 con 0x7f5728004900 2026-02-17T11:58:18.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.928+0000 7f571b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:18.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.928+0000 7f571b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:18.931 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":122,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:18.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 msgr2=0x7f5708040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 0x7f5708040180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fb0 tx=0x7f5730008040 comp rx=0 tx=0).stop 2026-02-17T11:58:18.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 10 monclient: shutdown 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 msgr2=0x7f573c097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5724004fd0 tx=0x7f5724006720 comp rx=0 tx=0).stop 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 shutdown_connections 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f570803dcc0 0x7f5708040180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5728005390 0x7f573c0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5728004900 0x7f573c097090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 --2- 10.20.193.51:0/1009106352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5728003ab0 0x7f573c09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 >> 10.20.193.51:0/1009106352 conn(0x7f573c0a30c0 msgr2=0x7f573c0a1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 shutdown_connections 2026-02-17T11:58:18.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:18.929+0000 7f57410ca640 1 -- 10.20.193.51:0/1009106352 wait complete. 2026-02-17T11:58:18.939 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:58:18.939 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:58:18.939 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:58:19.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.005+0000 7f60a1c91640 10 monclient: get_monmap_and_config 2026-02-17T11:58:19.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.005+0000 7f60a1c91640 10 monclient: build_initial_monmap 2026-02-17T11:58:19.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.005+0000 7f60a1c91640 10 monclient: monmap: 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:19.006616+0000 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:19.006616+0000 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:19.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 Processor -- start 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 -- start start 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient: init 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T11:58:19.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f609c0a3bb0 0x7f609c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-a con 0x7f609c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f609c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f609c13b760 0x7f609c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-c con 0x7f609c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c06e140 con 0x7f609c0a0750 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f609c09f910 con 0x7f609c0a3bb0 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f609c09ccd0 con 0x7f609c13b760 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f60a1c91640 10 monclient(hunting): authenticate will time out at 1386.625400s 2026-02-17T11:58:19.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f609c0a3bb0 0x7f609c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609affd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f609c0a0750 0x7f609c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36306/0 (socket says 10.20.193.51:36306) 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609affd640 1 -- 10.20.193.51:0/3356059532 learned_addr learned my addr 10.20.193.51:0/3356059532 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): get_auth_request con 0x7f609c0a3bb0 auth_method 0 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609bfff640 1 --2- 10.20.193.51:0/3356059532 >> v2:10.20.193.142:3300/0 conn(0x7f609c13b760 0x7f609c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609bfff640 10 monclient(hunting): get_auth_request con 0x7f609c13b760 auth_method 0 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient(hunting): handle_auth_done global_id 164187 payload 274 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 -- 10.20.193.51:0/3356059532 >> v2:10.20.193.142:3300/0 conn(0x7f609c13b760 msgr2=0x7f609c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 --2- 10.20.193.51:0/3356059532 >> v2:10.20.193.142:3300/0 conn(0x7f609c13b760 0x7f609c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 -- 10.20.193.51:0/3356059532 >> v1:10.20.193.51:6789/0 conn(0x7f609c0a0750 legacy=0x7f609c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.006+0000 7f609b7fe640 1 -- 10.20.193.51:0/3356059532 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c09eec0 con 0x7f609c0a3bb0 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609b7fe640 1 -- 10.20.193.51:0/3356059532 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a3bb0 msgr2=0x7f609c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609b7fe640 1 --2- 10.20.193.51:0/3356059532 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a3bb0 0x7f609c09dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f609c09f5f0 tx=0x7f608802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d88c557268648bf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 1 -- 10.20.193.51:0/3356059532 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608803c070 con 0x7f609c0a3bb0 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: dump: 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.023 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 5 monclient: authenticate success, global_id 164187 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 1 -- 10.20.193.51:0/3356059532 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608802fbd0 con 0x7f609c0a3bb0 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:19.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 1 -- 10.20.193.51:0/3356059532 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088037440 con 0x7f609c0a3bb0 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 4 set_mon_vals no callback set 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f609a7fc640 10 monclient: dump: 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.025 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 10 monclient: shutdown 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 -- 10.20.193.51:0/3356059532 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a3bb0 msgr2=0x7f609c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3356059532 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a3bb0 0x7f609c09dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f609c09f5f0 tx=0x7f608802ed50 comp rx=0 tx=0).stop 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 -- 10.20.193.51:0/3356059532 shutdown_connections 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3356059532 >> v2:10.20.193.142:3300/0 conn(0x7f609c13b760 0x7f609c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3356059532 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a3bb0 0x7f609c09dac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 -- 10.20.193.51:0/3356059532 >> 10.20.193.51:0/3356059532 conn(0x7f609c0a30c0 msgr2=0x7f609c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 -- 10.20.193.51:0/3356059532 shutdown_connections 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.009+0000 7f60a1c91640 1 -- 10.20.193.51:0/3356059532 wait complete. 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient: build_initial_monmap 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient: monmap: 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.027 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 Processor -- start 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 -- start start 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient: init 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 0x7f609c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-a con 0x7f609c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f609c0a3bb0 0x7f609c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-c con 0x7f609c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f609c13b760 0x7f609c131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): picked mon.noname-b con 0x7f609c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0a04b0 con 0x7f609c0a0750 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f609c09c850 con 0x7f609c13b760 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f609c09e710 con 0x7f609c0a3bb0 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f60a1c91640 10 monclient(hunting): authenticate will time out at 1386.629717s 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609affd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f609c0a3bb0 msgr2=0x7f609c1d0010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:19.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 0x7f609c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f609c0a3bb0 0x7f609c1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 0x7f609c1cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:47962/0 (socket says 10.20.193.51:47962) 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 -- 10.20.193.51:0/3636409598 learned_addr learned my addr 10.20.193.51:0/3636409598 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): get_auth_request con 0x7f609c0a0750 auth_method 0 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient(hunting): handle_auth_done global_id 164190 payload 824 2026-02-17T11:58:19.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f609c0a3bb0 msgr2=0x7f609c1d0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f609c0a3bb0 0x7f609c1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f609c13b760 msgr2=0x7f609c131190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609bfff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f609c13b760 0x7f609c131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f609c13b760 0x7f609c131190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609b7fe640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c134f50 con 0x7f609c0a0750 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609bfff640 10 monclient: get_auth_request con 0x7f609c13b760 auth_method 0 2026-02-17T11:58:19.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.010+0000 7f609bfff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f609c13b760 0x7f609c131190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609b7fe640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 msgr2=0x7f609c1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609b7fe640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 0x7f609c1cfad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6088002410 tx=0x7f60880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608803c040 con 0x7f609c0a0750 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: dump: 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088047070 con 0x7f609c0a0750 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 5 monclient: authenticate success, global_id 164190 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 monclient: _renew_subs 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c09d7b0 con 0x7f609c0a0750 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088040a60 con 0x7f609c0a0750 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 10 monclient: dump: 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.034 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6099ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 monclient: _renew_subs 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c1346b0 con 0x7f609c0a0750 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 0x7f609c131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f609c09dac0 con 0x7f609c1316d0 2026-02-17T11:58:19.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 0x7f609c131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient: get_auth_request con 0x7f609c1316d0 auth_method 0 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f608803f030 con 0x7f609c0a0750 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.013+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f609affd640 10 monclient(hunting): handle_auth_done global_id 164193 payload 824 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f609affd640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f609c0a2820 con 0x7f609c1316d0 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f6077fff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f606c03dcc0 0x7f606c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (secure 0 0 0) 0x7f6088077b40 con 0x7f609c0a0750 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f609bfff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f606c03dcc0 0x7f606c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.014+0000 7f609bfff640 10 monclient: get_auth_request con 0x7f606c03dcc0 auth_method 0 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f609affd640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 msgr2=0x7f609c131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f609affd640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 0x7f609c131ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f608c004910 tx=0x7f608c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c017070 con 0x7f609c1316d0 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 10 monclient: dump: 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f608c005d40 con 0x7f609c1316d0 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 msgr2=0x7f609c131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 0x7f609c131ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f608c004910 tx=0x7f608c00cb20 comp rx=0 tx=0).stop 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 msgr2=0x7f609c131ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:19.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.016+0000 7f6077fff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c1316d0 0x7f609c131ab0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f608c004910 tx=0x7f608c00cb20 comp rx=0 tx=0).stop 2026-02-17T11:58:19.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.017+0000 7f609bfff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f606c03dcc0 0x7f606c040180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f609c1332a0 tx=0x7f609000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f60a1c91640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 0x7f609c1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f60a1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0008d0 con 0x7f609c131ff0 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 0x7f609c1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient: get_auth_request con 0x7f609c131ff0 auth_method 0 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 10 monclient(hunting): handle_auth_done global_id 164196 payload 824 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.019+0000 7f609affd640 1 -- 10.20.193.51:0/3636409598 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f609c050ac0 con 0x7f609c131ff0 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f609affd640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 msgr2=0x7f609c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f609affd640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 0x7f609c1daad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f609c138aa0 tx=0x7f608c004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c017070 con 0x7f609c131ff0 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f6077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f6077fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.021+0000 7f6077fff640 10 monclient: dump: 2026-02-17T11:58:19.042 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f608c007280 con 0x7f609c131ff0 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 msgr2=0x7f609c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 0x7f609c1daad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f609c138aa0 tx=0x7f608c004b10 comp rx=0 tx=0).stop 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 msgr2=0x7f609c1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f6077fff640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c131ff0 0x7f609c1daad0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f609c138aa0 tx=0x7f608c004b10 comp rx=0 tx=0).stop 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 122, 2026-02-17T11:58:19.044 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 43459, 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.045 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.046 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:19.047 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.048 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.050 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:19.051 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.052 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.053 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:19.054 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f606c03dcc0 msgr2=0x7f606c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f606c03dcc0 0x7f606c040180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f609c1332a0 tx=0x7f609000b040 comp rx=0 tx=0).stop 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 10 monclient: shutdown 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 msgr2=0x7f609c1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 --2- 10.20.193.51:0/3636409598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f609c0a0750 0x7f609c1cfad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6088002410 tx=0x7f60880047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f609bfff640 1 -- 10.20.193.51:0/3636409598 reap_dead start 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f609bfff640 1 -- 10.20.193.51:0/3636409598 reap_dead start 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 shutdown_connections 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 >> 10.20.193.51:0/3636409598 conn(0x7f609c0a30c0 msgr2=0x7f609c13a050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 shutdown_connections 2026-02-17T11:58:19.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.022+0000 7f60a1c91640 1 -- 10.20.193.51:0/3636409598 wait complete. 2026-02-17T11:58:19.056 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:58:19.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:58:19.057 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:58:19.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.122+0000 7f7bd5349640 10 monclient: get_monmap_and_config 2026-02-17T11:58:19.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.122+0000 7f7bd5349640 10 monclient: build_initial_monmap 2026-02-17T11:58:19.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.122+0000 7f7bd5349640 10 monclient: monmap: 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:19.123657+0000 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:19.123657+0000 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 Processor -- start 2026-02-17T11:58:19.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 -- start start 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient: init 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7bd00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7bd009dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bd013d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-b con 0x7f7bd00a02e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd006e140 con 0x7f7bd009dac0 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd009ce60 con 0x7f7bd00a3bb0 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd009aed0 con 0x7f7bd00a02e0 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bd5349640 10 monclient(hunting): authenticate will time out at 1386.742444s 2026-02-17T11:58:19.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bcf7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 msgr2=0x7f7bd013d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:19.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bcf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bd013d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:19.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bce7fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7bd009dac0 0x7f7bd009fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36316/0 (socket says 10.20.193.51:36316) 2026-02-17T11:58:19.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.123+0000 7f7bce7fc640 1 -- 10.20.193.51:0/3322634471 learned_addr learned my addr 10.20.193.51:0/3322634471 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:19.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bce7fc640 1 -- 10.20.193.51:0/3322634471 >> v1:10.20.193.51:6789/0 conn(0x7f7bd009dac0 legacy=0x7f7bd009fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409455568 0 0) 0x7f7bd006e140 con 0x7f7bd009dac0 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient(hunting): _negotiate 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient(hunting): my global_id is 164199 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003620 con 0x7f7bd009dac0 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bceffd640 1 -- 10.20.193.51:0/3322634471 >> v1:10.20.193.142:6789/0 conn(0x7f7bd00a3bb0 legacy=0x7f7bd009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2361206319 0 0) 0x7f7bbc003620 con 0x7f7bd009dac0 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 msgr2=0x7f7bd013d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bd013d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 >> v1:10.20.193.142:6789/0 conn(0x7f7bd00a3bb0 legacy=0x7f7bd009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _finish_hunting 0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd009a5c0 con 0x7f7bd009dac0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f7bb80031b0 con 0x7f7bd009dac0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: dump: 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.137 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 >> v1:10.20.193.51:6789/0 conn(0x7f7bd009dac0 legacy=0x7f7bd009fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.125+0000 7f7bcdffb640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bbc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): picked mon.c con 0x7f7bd00a02e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:19.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bbc0042b0 0x7f7bbc004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): picked mon.b con 0x7f7bbc0042b0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 0x7f7bbc00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): picked mon.a con 0x7f7bbc005020 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd009aed0 con 0x7f7bbc005020 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c000 con 0x7f7bbc0042b0 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c180 con 0x7f7bd00a02e0 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bceffd640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 msgr2=0x7f7bbc003b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcdffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bceffd640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bbc003b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 0x7f7bbc00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): get_auth_request con 0x7f7bbc005020 auth_method 0 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bbc0042b0 0x7f7bbc004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient(hunting): handle_auth_done global_id 164199 payload 293 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 msgr2=0x7f7bbc003b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd00a02e0 0x7f7bbc003b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bbc0042b0 msgr2=0x7f7bbc004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bbc0042b0 0x7f7bbc004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 monclient: found mon.a 2026-02-17T11:58:19.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/3322634471 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc003620 con 0x7f7bbc005020 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bd5349640 5 monclient: authenticate success, global_id 164199 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bd5349640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bce7fc640 10 monclient: get_auth_request con 0x7f7bbc0042b0 auth_method 0 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.126+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bbc0042b0 0x7f7bbc004900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 msgr2=0x7f7bbc00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 0x7f7bbc00bac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e10 tx=0x7f7bc002f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28588b1ef8c9c0a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0008050 con 0x7f7bbc005020 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: dump: 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bd5349640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0037630 con 0x7f7bbc005020 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 1 -- 10.20.193.51:0/3322634471 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0009a10 con 0x7f7bbc005020 2026-02-17T11:58:19.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bcdffb640 10 monclient: dump: 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bd5349640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.128+0000 7f7bd5349640 4 set_mon_vals no callback set 2026-02-17T11:58:19.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: shutdown 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 msgr2=0x7f7bbc00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 --2- 10.20.193.51:0/3322634471 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bbc005020 0x7f7bbc00bac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e10 tx=0x7f7bc002f600 comp rx=0 tx=0).stop 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/3322634471 reap_dead start 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- 10.20.193.51:0/3322634471 shutdown_connections 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- 10.20.193.51:0/3322634471 >> 10.20.193.51:0/3322634471 conn(0x7f7bd00a30c0 msgr2=0x7f7bd00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- 10.20.193.51:0/3322634471 shutdown_connections 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- 10.20.193.51:0/3322634471 wait complete. 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: build_initial_monmap 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: monmap: 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:19.144 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 Processor -- start 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 1 -- start start 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: init 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.129+0000 7f7bd5349640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd006f440 0x7f7bd006f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-b con 0x7f7bd006f440 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-a con 0x7f7bd006fd60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:19.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd01d3d10 0x7f7bd01d6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): picked mon.noname-c con 0x7f7bd01d3d10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00a3f90 con 0x7f7bd006fd60 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd009caa0 con 0x7f7bd006f440 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd013b760 con 0x7f7bd01d3d10 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bd5349640 10 monclient(hunting): authenticate will time out at 1386.749038s 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bcf7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd01d3d10 msgr2=0x7f7bd01d6100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bcf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd01d3d10 0x7f7bd01d6100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48014/0 (socket says 10.20.193.51:48014) 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 -- 10.20.193.51:0/993526560 learned_addr learned my addr 10.20.193.51:0/993526560 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:19.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): get_auth_request con 0x7f7bd006fd60 auth_method 0 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bceffd640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd006f440 0x7f7bd006f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bceffd640 10 monclient(hunting): get_auth_request con 0x7f7bd006f440 auth_method 0 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient(hunting): handle_auth_done global_id 164202 payload 824 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd01d3d10 msgr2=0x7f7bd01d6100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bd01d3d10 0x7f7bd01d6100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd006f440 msgr2=0x7f7bd006f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd006f440 0x7f7bd006f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 monclient: found mon.noname-a 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.130+0000 7f7bce7fc640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd0070e90 con 0x7f7bd006fd60 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bce7fc640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 msgr2=0x7f7bd01d37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800d8b0 tx=0x7f7bb800dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bce7fc640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800d8b0 tx=0x7f7bb800dd80 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f7bb8007110 mon_map magic: 0 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8007110 con 0x7f7bd006fd60 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: dump: 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.148 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb80072b0 con 0x7f7bd006fd60 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 5 monclient: authenticate success, global_id 164202 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 10 monclient: _renew_subs 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00963c0 con 0x7f7bd006fd60 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7baf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bcd7fa640 4 set_mon_vals no callback set 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 10 monclient: _renew_subs 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.132+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd0096980 con 0x7f7bd006fd60 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bd5349640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bd5349640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 0x7f7bd008d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd006d420 con 0x7f7bd008d3f0 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8007660 con 0x7f7bd006fd60 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 10 monclient: dump: 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.150 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7bb800b6b0 con 0x7f7bd006fd60 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 0x7f7bd008d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient: get_auth_request con 0x7f7bd008d3f0 auth_method 0 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7baf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b9c03dcc0 0x7f7b9c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b9c03dcc0 0x7f7b9c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bcf7fe640 10 monclient: get_auth_request con 0x7f7b9c03dcc0 auth_method 0 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 10 monclient(hunting): handle_auth_done global_id 114502 payload 824 2026-02-17T11:58:19.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.133+0000 7f7bceffd640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bd009f4c0 con 0x7f7bd008d3f0 2026-02-17T11:58:19.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7bcf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b9c03dcc0 0x7f7b9c040180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0003e00 tx=0x7f7bc0005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7bceffd640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 msgr2=0x7f7bd008d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7bceffd640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 0x7f7bd008d7d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc400ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4005ce0 con 0x7f7bd008d3f0 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 10 monclient: dump: 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.155 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7bc4018070 con 0x7f7bd008d3f0 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 msgr2=0x7f7bd008d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 0x7f7bd008d7d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc400ead0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 msgr2=0x7f7bd008d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.136+0000 7f7baf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008d3f0 0x7f7bd008d7d0 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc400ead0 comp rx=0 tx=0).stop 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bd5349640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bd5349640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 0x7f7bd01da660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bd5349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd009d7b0 con 0x7f7bd008dd10 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bceffd640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 0x7f7bd01da660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bceffd640 10 monclient: get_auth_request con 0x7f7bd008dd10 auth_method 0 2026-02-17T11:58:19.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.139+0000 7f7bceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.140+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.140+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.140+0000 7f7bceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.140+0000 7f7bceffd640 10 monclient(hunting): handle_auth_done global_id 114505 payload 824 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.140+0000 7f7bceffd640 1 -- 10.20.193.51:0/993526560 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7bd009a220 con 0x7f7bd008dd10 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bceffd640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 msgr2=0x7f7bd01da660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bceffd640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 0x7f7bd01da660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc4002d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40072d0 con 0x7f7bd008dd10 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 10 monclient: dump: 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.157 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7f7bc40072d0 con 0x7f7bd008dd10 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 msgr2=0x7f7bd01da660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 0x7f7bd01da660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc4002d30 comp rx=0 tx=0).stop 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 msgr2=0x7f7bd01da660 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:19.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bd008dd10 0x7f7bd01da660 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40026b0 tx=0x7f7bc4002d30 comp rx=0 tx=0).stop 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 122, 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 301017, 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:58:19.159 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.160 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:19.161 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:19.162 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.163 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.164 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:19.165 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.166 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.167 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:19.168 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b9c03dcc0 msgr2=0x7f7b9c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7b9c03dcc0 0x7f7b9c040180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0003e00 tx=0x7f7bc0005000 comp rx=0 tx=0).stop 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 10 monclient: shutdown 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 msgr2=0x7f7bd01d37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 --2- 10.20.193.51:0/993526560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bd006fd60 0x7f7bd01d37d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800d8b0 tx=0x7f7bb800dd80 comp rx=0 tx=0).stop 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/993526560 reap_dead start 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7baf7fe640 1 -- 10.20.193.51:0/993526560 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(448..448 src has 323..448) ==== 4783+0+0 (unknown 0 0 0) 0x7f7bb8052a60 con 0x7f7bd006fd60 2026-02-17T11:58:19.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bcf7fe640 1 -- 10.20.193.51:0/993526560 reap_dead start 2026-02-17T11:58:19.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 shutdown_connections 2026-02-17T11:58:19.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 >> 10.20.193.51:0/993526560 conn(0x7f7bd00a30c0 msgr2=0x7f7bd013ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:19.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 shutdown_connections 2026-02-17T11:58:19.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:19.142+0000 7f7bd5349640 1 -- 10.20.193.51:0/993526560 wait complete. 2026-02-17T11:58:19.170 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:58:19.170 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:58:19.804 INFO:tasks.rados.rados.0.trial142.stdout:1933: done (4 left) 2026-02-17T11:58:19.805 INFO:tasks.rados.rados.0.trial142.stdout:1934: done (3 left) 2026-02-17T11:58:19.805 INFO:tasks.rados.rados.0.trial142.stdout:1935: done (2 left) 2026-02-17T11:58:19.805 INFO:tasks.rados.rados.0.trial142.stdout:1937: done (1 left) 2026-02-17T11:58:19.805 INFO:tasks.rados.rados.0.trial142.stdout:1938: done (0 left) 2026-02-17T11:58:19.805 INFO:tasks.rados.rados.0.trial142.stdout:1939: delete oid 43 current snap is 213 2026-02-17T11:58:19.807 INFO:tasks.rados.rados.0.trial142.stdout:1939: done (0 left) 2026-02-17T11:58:19.807 INFO:tasks.rados.rados.0.trial142.stdout:1940: write (excl) oid 47 current snap is 213 2026-02-17T11:58:19.807 INFO:tasks.rados.rados.0.trial142.stdout:1940: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2026-02-17T11:58:19.812 INFO:tasks.rados.rados.0.trial142.stdout:1940: writing trial14245205-47 from 695988 to 1321721 tid 1 2026-02-17T11:58:19.817 INFO:tasks.rados.rados.0.trial142.stdout:1940: writing trial14245205-47 from 2009801 to 2690362 tid 2 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1940: writing trial14245205-47 from 3150974 to 3495988 tid 3 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1941: copy_from oid 38 from oid 39 current snap is 213 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1940: finishing write tid 1 to trial14245205-47 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1940: finishing write tid 2 to trial14245205-47 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1942: read oid 17 snap -1 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1942: expect (ObjNum 629 snap 197 seq_num 629) 2026-02-17T11:58:19.821 INFO:tasks.rados.rados.0.trial142.stdout:1943: delete oid 12 current snap is 213 2026-02-17T11:58:19.822 INFO:tasks.rados.rados.0.trial142.stdout:1941: finishing copy_from to trial14245205-38 2026-02-17T11:58:19.822 INFO:tasks.rados.rados.0.trial142.stdout:1941: got expected ENOENT (src dne) 2026-02-17T11:58:19.822 INFO:tasks.rados.rados.0.trial142.stdout:1941: finishing copy_from racing read to trial14245205-38 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1940: finishing write tid 3 to trial14245205-47 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1940: finishing write tid 4 to trial14245205-47 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1941: done (3 left) 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1943: done (2 left) 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1944: copy_from oid 40 from oid 28 current snap is 213 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1940: finishing write tid 5 to trial14245205-47 2026-02-17T11:58:19.823 INFO:tasks.rados.rados.0.trial142.stdout:1940: oid 47 updating version 0 to 1040 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1940: oid 47 version 1040 is already newer than 1039 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1940: oid 47 version 1040 is already newer than 1038 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1940: oid 47 updating version 1040 to 1041 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 1041 (ObjNum 684 snap 213 seq_num 684) dirty exists 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1940: left oid 47 (ObjNum 684 snap 213 seq_num 684) 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1940: done (2 left) 2026-02-17T11:58:19.824 INFO:tasks.rados.rados.0.trial142.stdout:1945: snap_remove snap 208 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1945: done (2 left) 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1946: write (excl) oid 45 current snap is 213 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1944: finishing copy_from to trial14245205-40 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1944: got expected ENOENT (src dne) 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1944: finishing copy_from racing read to trial14245205-40 2026-02-17T11:58:20.572 INFO:tasks.rados.rados.0.trial142.stdout:1942: expect (ObjNum 629 snap 197 seq_num 629) 2026-02-17T11:58:20.657 INFO:tasks.rados.rados.0.trial142.stdout:1946: seq_num 686 ranges {729602=492584,1843118=684230,3322173=207429} 2026-02-17T11:58:20.661 INFO:tasks.rados.rados.0.trial142.stdout:1946: writing trial14245205-45 from 729602 to 1222186 tid 1 2026-02-17T11:58:20.666 INFO:tasks.rados.rados.0.trial142.stdout:1946: writing trial14245205-45 from 1843118 to 2527348 tid 2 2026-02-17T11:58:20.670 INFO:tasks.rados.rados.0.trial142.stdout:1946: writing trial14245205-45 from 3322173 to 3529602 tid 3 2026-02-17T11:58:20.670 INFO:tasks.rados.rados.0.trial142.stdout:1942: done (2 left) 2026-02-17T11:58:20.671 INFO:tasks.rados.rados.0.trial142.stdout:1944: done (1 left) 2026-02-17T11:58:20.671 INFO:tasks.rados.rados.0.trial142.stdout:1947: delete oid 47 current snap is 213 2026-02-17T11:58:20.671 INFO:tasks.rados.rados.0.trial142.stdout:1946: finishing write tid 1 to trial14245205-45 2026-02-17T11:58:20.671 INFO:tasks.rados.rados.0.trial142.stdout:1946: finishing write tid 2 to trial14245205-45 2026-02-17T11:58:20.671 INFO:tasks.rados.rados.0.trial142.stdout:1946: finishing write tid 3 to trial14245205-45 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: finishing write tid 4 to trial14245205-45 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: finishing write tid 5 to trial14245205-45 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: oid 45 updating version 0 to 998 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: oid 45 version 998 is already newer than 997 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: oid 45 updating version 998 to 1000 2026-02-17T11:58:20.672 INFO:tasks.rados.rados.0.trial142.stdout:1946: oid 45 version 1000 is already newer than 999 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 1000 (ObjNum 686 snap 213 seq_num 686) dirty exists 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:1946: left oid 45 (ObjNum 686 snap 213 seq_num 686) 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:1946: done (1 left) 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:1947: done (0 left) 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:1948: write oid 20 current snap is 213 2026-02-17T11:58:20.673 INFO:tasks.rados.rados.0.trial142.stdout:1948: seq_num 688 ranges {763216=643082,1843729=687899,3260666=302550} 2026-02-17T11:58:20.677 INFO:tasks.rados.rados.0.trial142.stdout:1948: writing trial14245205-20 from 763216 to 1406298 tid 1 2026-02-17T11:58:20.681 INFO:tasks.rados.rados.0.trial142.stdout:1948: writing trial14245205-20 from 1843729 to 2531628 tid 2 2026-02-17T11:58:20.685 INFO:tasks.rados.rados.0.trial142.stdout:1948: writing trial14245205-20 from 3260666 to 3563216 tid 3 2026-02-17T11:58:20.685 INFO:tasks.rados.rados.0.trial142.stdout:1949: snap_create 2026-02-17T11:58:20.685 INFO:tasks.rados.rados.0.trial142.stdout:1948: finishing write tid 1 to trial14245205-20 2026-02-17T11:58:20.686 INFO:tasks.rados.rados.0.trial142.stdout:1948: finishing write tid 2 to trial14245205-20 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: finishing write tid 3 to trial14245205-20 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: finishing write tid 4 to trial14245205-20 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: finishing write tid 5 to trial14245205-20 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: oid 20 updating version 0 to 1076 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: oid 20 updating version 1076 to 1077 2026-02-17T11:58:20.687 INFO:tasks.rados.rados.0.trial142.stdout:1948: oid 20 updating version 1077 to 1078 2026-02-17T11:58:20.688 INFO:tasks.rados.rados.0.trial142.stdout:1948: oid 20 version 1078 is already newer than 1075 2026-02-17T11:58:20.688 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1078 (ObjNum 688 snap 213 seq_num 688) dirty exists 2026-02-17T11:58:20.688 INFO:tasks.rados.rados.0.trial142.stdout:1948: left oid 20 (ObjNum 688 snap 213 seq_num 688) 2026-02-17T11:58:21.574 INFO:tasks.rados.rados.0.trial142.stdout:1948: done (1 left) 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1949: done (0 left) 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1950: copy_from oid 32 from oid 14 current snap is 214 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1951: copy_from oid 13 from oid 25 current snap is 214 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1952: copy_from oid 6 from oid 37 current snap is 214 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1953: write oid 1 current snap is 214 2026-02-17T11:58:21.575 INFO:tasks.rados.rados.0.trial142.stdout:1953: seq_num 689 ranges {780023=718331,1902211=547910,3004442=575581} 2026-02-17T11:58:21.580 INFO:tasks.rados.rados.0.trial142.stdout:1953: writing trial14245205-1 from 780023 to 1498354 tid 1 2026-02-17T11:58:21.584 INFO:tasks.rados.rados.0.trial142.stdout:1953: writing trial14245205-1 from 1902211 to 2450121 tid 2 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1953: writing trial14245205-1 from 3004442 to 3580023 tid 3 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1954: read oid 12 snap 204 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1954: expect deleted 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1955: read oid 49 snap 200 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1955: expect (ObjNum 650 snap 200 seq_num 650) 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1956: delete oid 2 current snap is 214 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1951: finishing copy_from to trial14245205-13 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1951: got expected ENOENT (src dne) 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1951: finishing copy_from racing read to trial14245205-13 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1952: finishing copy_from to trial14245205-6 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1952: got expected ENOENT (src dne) 2026-02-17T11:58:21.588 INFO:tasks.rados.rados.0.trial142.stdout:1952: finishing copy_from racing read to trial14245205-6 2026-02-17T11:58:21.589 INFO:tasks.rados.rados.0.trial142.stdout:1953: finishing write tid 1 to trial14245205-1 2026-02-17T11:58:21.589 INFO:tasks.rados.rados.0.trial142.stdout:1950: finishing copy_from racing read to trial14245205-32 2026-02-17T11:58:21.589 INFO:tasks.rados.rados.0.trial142.stdout:1953: finishing write tid 2 to trial14245205-1 2026-02-17T11:58:21.589 INFO:tasks.rados.rados.0.trial142.stdout:1950: finishing copy_from to trial14245205-32 2026-02-17T11:58:21.589 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: finishing write tid 3 to trial14245205-1 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: finishing write tid 4 to trial14245205-1 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: finishing write tid 5 to trial14245205-1 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: oid 1 updating version 0 to 1044 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: oid 1 version 1044 is already newer than 1041 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: oid 1 version 1044 is already newer than 1043 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: oid 1 version 1044 is already newer than 1042 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1044 (ObjNum 689 snap 214 seq_num 689) dirty exists 2026-02-17T11:58:21.590 INFO:tasks.rados.rados.0.trial142.stdout:1953: left oid 1 (ObjNum 689 snap 214 seq_num 689) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1950: done (6 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1951: done (5 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1952: done (4 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1953: done (3 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1954: done (2 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1956: done (1 left) 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1957: write oid 28 current snap is 214 2026-02-17T11:58:21.591 INFO:tasks.rados.rados.0.trial142.stdout:1957: seq_num 691 ranges {413637=468829,1619175=435226,2542935=758255} 2026-02-17T11:58:21.594 INFO:tasks.rados.rados.0.trial142.stdout:1957: writing trial14245205-28 from 413637 to 882466 tid 1 2026-02-17T11:58:21.599 INFO:tasks.rados.rados.0.trial142.stdout:1957: writing trial14245205-28 from 1619175 to 2054401 tid 2 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1957: writing trial14245205-28 from 2542935 to 3301190 tid 3 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1958: read oid 34 snap 210 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1958: expect (ObjNum 597 snap 186 seq_num 597) 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1959: read oid 26 snap -1 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1959: expect deleted 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1960: copy_from oid 24 from oid 15 current snap is 214 2026-02-17T11:58:21.604 INFO:tasks.rados.rados.0.trial142.stdout:1955: expect (ObjNum 650 snap 200 seq_num 650) 2026-02-17T11:58:21.714 INFO:tasks.rados.rados.0.trial142.stdout:1957: finishing write tid 1 to trial14245205-28 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1957: finishing write tid 2 to trial14245205-28 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1955: done (4 left) 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1961: read oid 4 snap -1 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1961: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1962: copy_from oid 45 from oid 41 current snap is 214 2026-02-17T11:58:21.715 INFO:tasks.rados.rados.0.trial142.stdout:1958: expect (ObjNum 597 snap 186 seq_num 597) 2026-02-17T11:58:21.760 INFO:tasks.rados.rados.0.trial142.stdout:1960: finishing copy_from racing read to trial14245205-24 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: finishing write tid 3 to trial14245205-28 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: finishing write tid 4 to trial14245205-28 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: finishing write tid 5 to trial14245205-28 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: oid 28 updating version 0 to 1026 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: oid 28 version 1026 is already newer than 1024 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: oid 28 version 1026 is already newer than 1025 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: oid 28 version 1026 is already newer than 1023 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 1026 (ObjNum 691 snap 214 seq_num 691) dirty exists 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1957: left oid 28 (ObjNum 691 snap 214 seq_num 691) 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:1960: finishing copy_from to trial14245205-24 2026-02-17T11:58:21.761 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1090 (ObjNum 554 snap 168 seq_num 554) dirty exists 2026-02-17T11:58:21.762 INFO:tasks.rados.rados.0.trial142.stdout:1962: finishing copy_from to trial14245205-45 2026-02-17T11:58:21.762 INFO:tasks.rados.rados.0.trial142.stdout:1962: got expected ENOENT (src dne) 2026-02-17T11:58:21.762 INFO:tasks.rados.rados.0.trial142.stdout:1962: finishing copy_from racing read to trial14245205-45 2026-02-17T11:58:21.762 INFO:tasks.rados.rados.0.trial142.stdout:1961: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1957: done (5 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1958: done (4 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1959: done (3 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1960: done (2 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1961: done (1 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1962: done (0 left) 2026-02-17T11:58:21.872 INFO:tasks.rados.rados.0.trial142.stdout:1963: delete oid 22 current snap is 214 2026-02-17T11:58:21.873 INFO:tasks.rados.rados.0.trial142.stdout:1963: done (0 left) 2026-02-17T11:58:21.873 INFO:tasks.rados.rados.0.trial142.stdout:1964: snap_create 2026-02-17T11:58:22.578 INFO:tasks.rados.rados.0.trial142.stdout:1964: done (0 left) 2026-02-17T11:58:22.579 INFO:tasks.rados.rados.0.trial142.stdout:1965: snap_remove snap 210 2026-02-17T11:58:23.581 INFO:tasks.rados.rados.0.trial142.stdout:1965: done (0 left) 2026-02-17T11:58:23.581 INFO:tasks.rados.rados.0.trial142.stdout:1966: snap_create 2026-02-17T11:58:24.583 INFO:tasks.rados.rados.0.trial142.stdout:1966: done (0 left) 2026-02-17T11:58:24.584 INFO:tasks.rados.rados.0.trial142.stdout:1967: copy_from oid 5 from oid 38 current snap is 216 2026-02-17T11:58:24.584 INFO:tasks.rados.rados.0.trial142.stdout:1968: copy_from oid 27 from oid 39 current snap is 216 2026-02-17T11:58:24.584 INFO:tasks.rados.rados.0.trial142.stdout:1969: write (excl) oid 29 current snap is 216 2026-02-17T11:58:24.584 INFO:tasks.rados.rados.0.trial142.stdout:1969: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2026-02-17T11:58:24.588 INFO:tasks.rados.rados.0.trial142.stdout:1969: writing trial14245205-29 from 447251 to 1182931 tid 1 2026-02-17T11:58:24.592 INFO:tasks.rados.rados.0.trial142.stdout:1969: writing trial14245205-29 from 1736139 to 2175034 tid 2 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1969: writing trial14245205-29 from 2597781 to 3378580 tid 3 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1970: delete oid 22 current snap is 216 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1968: finishing copy_from to trial14245205-27 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1968: got expected ENOENT (src dne) 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1968: finishing copy_from racing read to trial14245205-27 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1969: finishing write tid 1 to trial14245205-29 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1969: finishing write tid 2 to trial14245205-29 2026-02-17T11:58:24.597 INFO:tasks.rados.rados.0.trial142.stdout:1967: finishing copy_from racing read to trial14245205-5 2026-02-17T11:58:24.598 INFO:tasks.rados.rados.0.trial142.stdout:1967: finishing copy_from to trial14245205-5 2026-02-17T11:58:24.598 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1117 (ObjNum 644 snap 199 seq_num 644) dirty exists 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1967: done (3 left) 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1968: done (2 left) 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1970: done (1 left) 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1971: rollback oid 31 current snap is 216 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 31 to 205 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1972: write oid 25 current snap is 216 2026-02-17T11:58:24.599 INFO:tasks.rados.rados.0.trial142.stdout:1972: seq_num 695 ranges {480865=486178,1453103=442564,2652627=519696} 2026-02-17T11:58:24.602 INFO:tasks.rados.rados.0.trial142.stdout:1972: writing trial14245205-25 from 480865 to 967043 tid 1 2026-02-17T11:58:24.605 INFO:tasks.rados.rados.0.trial142.stdout:1972: writing trial14245205-25 from 1453103 to 1895667 tid 2 2026-02-17T11:58:24.611 INFO:tasks.rados.rados.0.trial142.stdout:1972: writing trial14245205-25 from 2652627 to 3172323 tid 3 2026-02-17T11:58:24.611 INFO:tasks.rados.rados.0.trial142.stdout:1973: rollback oid 41 current snap is 216 2026-02-17T11:58:24.611 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 41 to 200 2026-02-17T11:58:24.611 INFO:tasks.rados.rados.0.trial142.stdout:1969: finishing write tid 3 to trial14245205-29 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: finishing write tid 4 to trial14245205-29 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: finishing write tid 5 to trial14245205-29 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: oid 29 updating version 0 to 1591 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: oid 29 updating version 1591 to 1593 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: oid 29 version 1593 is already newer than 1590 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: oid 29 version 1593 is already newer than 1592 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1593 (ObjNum 693 snap 216 seq_num 693) dirty exists 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: left oid 29 (ObjNum 693 snap 216 seq_num 693) 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1971: finishing rollback tid 0 to trial14245205-31 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1969: done (3 left) 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:1974: rollback oid 38 current snap is 216 2026-02-17T11:58:24.612 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 212 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1971: finishing rollback tid 1 to trial14245205-31 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1971: finishing rollback tid 2 to trial14245205-31 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1587 (ObjNum 626 snap 196 seq_num 626) dirty exists 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1972: finishing write tid 1 to trial14245205-25 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1972: finishing write tid 2 to trial14245205-25 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1971: done (3 left) 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1975: read oid 7 snap -1 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1975: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1976: write (excl) oid 34 current snap is 216 2026-02-17T11:58:24.613 INFO:tasks.rados.rados.0.trial142.stdout:1976: seq_num 696 ranges {497672=561427,1795232=702575,2963697=730968} 2026-02-17T11:58:24.614 INFO:tasks.rados.rados.0.trial142.stdout:1976: writing trial14245205-34 from 497672 to 1059099 tid 1 2026-02-17T11:58:24.619 INFO:tasks.rados.rados.0.trial142.stdout:1976: writing trial14245205-34 from 1795232 to 2497807 tid 2 2026-02-17T11:58:24.624 INFO:tasks.rados.rados.0.trial142.stdout:1976: writing trial14245205-34 from 2963697 to 3694665 tid 3 2026-02-17T11:58:24.624 INFO:tasks.rados.rados.0.trial142.stdout:1977: copy_from oid 18 from oid 19 current snap is 216 2026-02-17T11:58:24.624 INFO:tasks.rados.rados.0.trial142.stdout:1972: finishing write tid 3 to trial14245205-25 2026-02-17T11:58:24.625 INFO:tasks.rados.rados.0.trial142.stdout:1972: finishing write tid 4 to trial14245205-25 2026-02-17T11:58:24.625 INFO:tasks.rados.rados.0.trial142.stdout:1978: read oid 40 snap -1 2026-02-17T11:58:24.625 INFO:tasks.rados.rados.0.trial142.stdout:1978: expect deleted 2026-02-17T11:58:24.625 INFO:tasks.rados.rados.0.trial142.stdout:1979: snap_remove snap 206 2026-02-17T11:58:25.573 INFO:tasks.rados.rados.0.trial142.stdout:1979: done (7 left) 2026-02-17T11:58:25.573 INFO:tasks.rados.rados.0.trial142.stdout:1980: write (excl) oid 22 current snap is 216 2026-02-17T11:58:25.574 INFO:tasks.rados.rados.0.trial142.stdout:1980: seq_num 697 ranges {514479=636676,1853714=446233,2991120=542240} 2026-02-17T11:58:25.577 INFO:tasks.rados.rados.0.trial142.stdout:1980: writing trial14245205-22 from 514479 to 1151155 tid 1 2026-02-17T11:58:25.582 INFO:tasks.rados.rados.0.trial142.stdout:1980: writing trial14245205-22 from 1853714 to 2299947 tid 2 2026-02-17T11:58:25.587 INFO:tasks.rados.rados.0.trial142.stdout:1980: writing trial14245205-22 from 2991120 to 3533360 tid 3 2026-02-17T11:58:25.587 INFO:tasks.rados.rados.0.trial142.stdout:1981: snap_create 2026-02-17T11:58:25.587 INFO:tasks.rados.rados.0.trial142.stdout:1973: finishing rollback tid 1 to trial14245205-41 2026-02-17T11:58:25.587 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1229 (ObjNum 33 snap 0 seq_num 1201977176) dirty dne 2026-02-17T11:58:25.587 INFO:tasks.rados.rados.0.trial142.stdout:1972: finishing write tid 5 to trial14245205-25 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: oid 25 updating version 0 to 1069 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: oid 25 updating version 1069 to 1071 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: oid 25 version 1071 is already newer than 1068 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: oid 25 version 1071 is already newer than 1070 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 1071 (ObjNum 695 snap 216 seq_num 695) dirty exists 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: left oid 25 (ObjNum 695 snap 216 seq_num 695) 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1974: finishing rollback tid 0 to trial14245205-38 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1974: finishing rollback tid 1 to trial14245205-38 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:1974: finishing rollback tid 2 to trial14245205-38 2026-02-17T11:58:25.588 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1120 (ObjNum 644 snap 199 seq_num 644) dirty exists 2026-02-17T11:58:25.589 INFO:tasks.rados.rados.0.trial142.stdout:1975: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: finishing write tid 1 to trial14245205-34 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: finishing write tid 2 to trial14245205-34 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: finishing write tid 3 to trial14245205-34 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: finishing write tid 4 to trial14245205-34 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: finishing write tid 5 to trial14245205-34 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: oid 34 updating version 0 to 1003 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: oid 34 version 1003 is already newer than 1002 2026-02-17T11:58:25.655 INFO:tasks.rados.rados.0.trial142.stdout:1976: oid 34 version 1003 is already newer than 1001 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1976: oid 34 updating version 1003 to 1004 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1004 (ObjNum 696 snap 216 seq_num 696) dirty exists 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1976: left oid 34 (ObjNum 696 snap 216 seq_num 696) 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1977: finishing copy_from racing read to trial14245205-18 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1977: finishing copy_from to trial14245205-18 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 971 (ObjNum 583 snap 181 seq_num 583) dirty exists 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1980: finishing write tid 1 to trial14245205-22 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1980: finishing write tid 2 to trial14245205-22 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1980: finishing write tid 3 to trial14245205-22 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1980: finishing write tid 4 to trial14245205-22 2026-02-17T11:58:25.656 INFO:tasks.rados.rados.0.trial142.stdout:1980: finishing write tid 5 to trial14245205-22 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:1980: oid 22 updating version 0 to 1049 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:1980: oid 22 version 1049 is already newer than 1048 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:1980: oid 22 version 1049 is already newer than 1047 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:1980: oid 22 version 1049 is already newer than 1046 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 1049 (ObjNum 697 snap 216 seq_num 697) dirty exists 2026-02-17T11:58:25.657 INFO:tasks.rados.rados.0.trial142.stdout:1980: left oid 22 (ObjNum 697 snap 216 seq_num 697) 2026-02-17T11:58:26.588 INFO:tasks.rados.rados.0.trial142.stdout:1972: done (8 left) 2026-02-17T11:58:26.588 INFO:tasks.rados.rados.0.trial142.stdout:1973: done (7 left) 2026-02-17T11:58:26.588 INFO:tasks.rados.rados.0.trial142.stdout:1974: done (6 left) 2026-02-17T11:58:26.588 INFO:tasks.rados.rados.0.trial142.stdout:1975: done (5 left) 2026-02-17T11:58:26.588 INFO:tasks.rados.rados.0.trial142.stdout:1976: done (4 left) 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1977: done (3 left) 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1978: done (2 left) 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1980: done (1 left) 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1981: done (0 left) 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1982: copy_from oid 13 from oid 27 current snap is 217 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1983: write (excl) oid 36 current snap is 217 2026-02-17T11:58:26.589 INFO:tasks.rados.rados.0.trial142.stdout:1983: seq_num 698 ranges {531286=711925,1912196=706244,3018543=712743} 2026-02-17T11:58:26.592 INFO:tasks.rados.rados.0.trial142.stdout:1983: writing trial14245205-36 from 531286 to 1243211 tid 1 2026-02-17T11:58:26.597 INFO:tasks.rados.rados.0.trial142.stdout:1983: writing trial14245205-36 from 1912196 to 2618440 tid 2 2026-02-17T11:58:26.602 INFO:tasks.rados.rados.0.trial142.stdout:1983: writing trial14245205-36 from 3018543 to 3731286 tid 3 2026-02-17T11:58:26.602 INFO:tasks.rados.rados.0.trial142.stdout:1982: finishing copy_from racing read to trial14245205-13 2026-02-17T11:58:26.602 INFO:tasks.rados.rados.0.trial142.stdout:1983: finishing write tid 1 to trial14245205-36 2026-02-17T11:58:26.602 INFO:tasks.rados.rados.0.trial142.stdout:1982: finishing copy_from to trial14245205-13 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 1584 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1983: finishing write tid 2 to trial14245205-36 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1984: read oid 31 snap -1 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1984: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1982: done (2 left) 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1985: rollback oid 46 current snap is 217 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 215 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1986: read oid 3 snap -1 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1986: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1987: copy_from oid 2 from oid 33 current snap is 217 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1988: write oid 28 current snap is 217 2026-02-17T11:58:26.603 INFO:tasks.rados.rados.0.trial142.stdout:1988: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2026-02-17T11:58:26.606 INFO:tasks.rados.rados.0.trial142.stdout:1988: writing trial14245205-28 from 548093 to 1335267 tid 1 2026-02-17T11:58:26.610 INFO:tasks.rados.rados.0.trial142.stdout:1988: writing trial14245205-28 from 1970678 to 2420580 tid 2 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1988: writing trial14245205-28 from 3045966 to 3727103 tid 3 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1989: read oid 16 snap -1 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1989: expect (ObjNum 660 snap 207 seq_num 660) 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1990: read oid 7 snap -1 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1990: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1991: read oid 26 snap 214 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1991: expect deleted 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1992: snap_create 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: finishing write tid 3 to trial14245205-36 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: finishing write tid 4 to trial14245205-36 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: finishing write tid 5 to trial14245205-36 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: oid 36 updating version 0 to 1082 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: oid 36 version 1082 is already newer than 1080 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: oid 36 version 1082 is already newer than 1081 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: oid 36 version 1082 is already newer than 1079 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1082 (ObjNum 698 snap 217 seq_num 698) dirty exists 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1983: left oid 36 (ObjNum 698 snap 217 seq_num 698) 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1987: finishing copy_from to trial14245205-2 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1987: got expected ENOENT (src dne) 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1987: finishing copy_from racing read to trial14245205-2 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1985: finishing rollback tid 0 to trial14245205-46 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1985: finishing rollback tid 1 to trial14245205-46 2026-02-17T11:58:26.616 INFO:tasks.rados.rados.0.trial142.stdout:1984: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:26.674 INFO:tasks.rados.rados.0.trial142.stdout:1985: finishing rollback tid 2 to trial14245205-46 2026-02-17T11:58:26.674 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 1796 (ObjNum 668 snap 210 seq_num 668) dirty exists 2026-02-17T11:58:26.675 INFO:tasks.rados.rados.0.trial142.stdout:1986: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:58:26.753 INFO:tasks.rados.rados.0.trial142.stdout:1988: finishing write tid 1 to trial14245205-28 2026-02-17T11:58:26.753 INFO:tasks.rados.rados.0.trial142.stdout:1988: finishing write tid 2 to trial14245205-28 2026-02-17T11:58:26.753 INFO:tasks.rados.rados.0.trial142.stdout:1988: finishing write tid 3 to trial14245205-28 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: finishing write tid 4 to trial14245205-28 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: finishing write tid 5 to trial14245205-28 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: oid 28 updating version 0 to 1030 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: oid 28 version 1030 is already newer than 1029 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: oid 28 version 1030 is already newer than 1027 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: oid 28 version 1030 is already newer than 1028 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 1030 (ObjNum 699 snap 217 seq_num 699) dirty exists 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1988: left oid 28 (ObjNum 699 snap 217 seq_num 699) 2026-02-17T11:58:26.754 INFO:tasks.rados.rados.0.trial142.stdout:1989: expect (ObjNum 660 snap 207 seq_num 660) 2026-02-17T11:58:26.937 INFO:tasks.rados.rados.0.trial142.stdout:1990: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1983: done (9 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1984: done (8 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1985: done (7 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1986: done (6 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1987: done (5 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1988: done (4 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1989: done (3 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1990: done (2 left) 2026-02-17T11:58:27.593 INFO:tasks.rados.rados.0.trial142.stdout:1991: done (1 left) 2026-02-17T11:58:27.594 INFO:tasks.rados.rados.0.trial142.stdout:1992: done (0 left) 2026-02-17T11:58:27.594 INFO:tasks.rados.rados.0.trial142.stdout:1993: rollback oid 24 current snap is 218 2026-02-17T11:58:27.594 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 213 2026-02-17T11:58:27.594 INFO:tasks.rados.rados.0.trial142.stdout:1994: snap_create 2026-02-17T11:58:27.595 INFO:tasks.rados.rados.0.trial142.stdout:1993: finishing rollback tid 0 to trial14245205-24 2026-02-17T11:58:27.595 INFO:tasks.rados.rados.0.trial142.stdout:1993: finishing rollback tid 1 to trial14245205-24 2026-02-17T11:58:27.595 INFO:tasks.rados.rados.0.trial142.stdout:1993: finishing rollback tid 2 to trial14245205-24 2026-02-17T11:58:27.595 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1093 (ObjNum 595 snap 184 seq_num 595) dirty exists 2026-02-17T11:58:28.592 INFO:tasks.rados.rados.0.trial142.stdout:1993: done (1 left) 2026-02-17T11:58:28.592 INFO:tasks.rados.rados.0.trial142.stdout:1994: done (0 left) 2026-02-17T11:58:28.592 INFO:tasks.rados.rados.0.trial142.stdout:1995: write (excl) oid 17 current snap is 219 2026-02-17T11:58:28.592 INFO:tasks.rados.rados.0.trial142.stdout:1995: seq_num 700 ranges {564900=578776,1629160=709913,3073389=492409} 2026-02-17T11:58:28.596 INFO:tasks.rados.rados.0.trial142.stdout:1995: writing trial14245205-17 from 564900 to 1143676 tid 1 2026-02-17T11:58:28.601 INFO:tasks.rados.rados.0.trial142.stdout:1995: writing trial14245205-17 from 1629160 to 2339073 tid 2 2026-02-17T11:58:28.606 INFO:tasks.rados.rados.0.trial142.stdout:1995: writing trial14245205-17 from 3073389 to 3565798 tid 3 2026-02-17T11:58:28.606 INFO:tasks.rados.rados.0.trial142.stdout:1996: write (excl) oid 35 current snap is 219 2026-02-17T11:58:28.606 INFO:tasks.rados.rados.0.trial142.stdout:1996: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2026-02-17T11:58:28.610 INFO:tasks.rados.rados.0.trial142.stdout:1996: writing trial14245205-35 from 581707 to 1235732 tid 1 2026-02-17T11:58:28.613 INFO:tasks.rados.rados.0.trial142.stdout:1996: writing trial14245205-35 from 1687642 to 2141213 tid 2 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1996: writing trial14245205-35 from 2700812 to 3404493 tid 3 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1997: rollback oid 18 current snap is 219 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 214 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: finishing write tid 1 to trial14245205-17 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: finishing write tid 2 to trial14245205-17 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: finishing write tid 3 to trial14245205-17 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: finishing write tid 4 to trial14245205-17 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: finishing write tid 5 to trial14245205-17 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: oid 17 updating version 0 to 1120 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: oid 17 version 1120 is already newer than 1119 2026-02-17T11:58:28.619 INFO:tasks.rados.rados.0.trial142.stdout:1995: oid 17 version 1120 is already newer than 1118 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1995: oid 17 updating version 1120 to 1121 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1121 (ObjNum 700 snap 219 seq_num 700) dirty exists 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1995: left oid 17 (ObjNum 700 snap 219 seq_num 700) 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1996: finishing write tid 1 to trial14245205-35 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1996: finishing write tid 2 to trial14245205-35 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1995: done (2 left) 2026-02-17T11:58:28.620 INFO:tasks.rados.rados.0.trial142.stdout:1998: delete oid 37 current snap is 219 2026-02-17T11:58:28.621 INFO:tasks.rados.rados.0.trial142.stdout:1998: done (2 left) 2026-02-17T11:58:28.621 INFO:tasks.rados.rados.0.trial142.stdout:1999: write (excl) oid 6 current snap is 219 2026-02-17T11:58:28.621 INFO:tasks.rados.rados.0.trial142.stdout:1999: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2026-02-17T11:58:28.624 INFO:tasks.rados.rados.0.trial142.stdout:1999: writing trial14245205-6 from 615321 to 1019844 tid 1 2026-02-17T11:58:28.629 INFO:tasks.rados.rados.0.trial142.stdout:1999: writing trial14245205-6 from 1804606 to 2261846 tid 2 2026-02-17T11:58:28.634 INFO:tasks.rados.rados.0.trial142.stdout:1999: writing trial14245205-6 from 2755658 to 3481883 tid 3 2026-02-17T11:58:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2000: snap_create 2026-02-17T11:58:28.634 INFO:tasks.rados.rados.0.trial142.stdout:1996: finishing write tid 3 to trial14245205-35 2026-02-17T11:58:28.634 INFO:tasks.rados.rados.0.trial142.stdout:1996: finishing write tid 4 to trial14245205-35 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: finishing write tid 5 to trial14245205-35 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: oid 35 updating version 0 to 1590 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: oid 35 version 1590 is already newer than 1588 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: oid 35 updating version 1590 to 1591 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: oid 35 version 1591 is already newer than 1589 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1591 (ObjNum 701 snap 219 seq_num 701) dirty exists 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1996: left oid 35 (ObjNum 701 snap 219 seq_num 701) 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1997: finishing rollback tid 0 to trial14245205-18 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1997: finishing rollback tid 1 to trial14245205-18 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1997: finishing rollback tid 2 to trial14245205-18 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1800 (ObjNum 613 snap 188 seq_num 613) dirty exists 2026-02-17T11:58:28.635 INFO:tasks.rados.rados.0.trial142.stdout:1999: finishing write tid 1 to trial14245205-6 2026-02-17T11:58:28.636 INFO:tasks.rados.rados.0.trial142.stdout:1999: finishing write tid 2 to trial14245205-6 2026-02-17T11:58:28.636 INFO:tasks.rados.rados.0.trial142.stdout:1999: finishing write tid 3 to trial14245205-6 2026-02-17T11:58:28.636 INFO:tasks.rados.rados.0.trial142.stdout:1999: finishing write tid 4 to trial14245205-6 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: finishing write tid 5 to trial14245205-6 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: oid 6 updating version 0 to 728 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: oid 6 version 728 is already newer than 725 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: oid 6 version 728 is already newer than 727 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: oid 6 version 728 is already newer than 726 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 728 (ObjNum 703 snap 219 seq_num 703) dirty exists 2026-02-17T11:58:28.637 INFO:tasks.rados.rados.0.trial142.stdout:1999: left oid 6 (ObjNum 703 snap 219 seq_num 703) 2026-02-17T11:58:29.593 INFO:tasks.rados.rados.0.trial142.stdout:1996: done (3 left) 2026-02-17T11:58:29.593 INFO:tasks.rados.rados.0.trial142.stdout:1997: done (2 left) 2026-02-17T11:58:29.593 INFO:tasks.rados.rados.0.trial142.stdout:1999: done (1 left) 2026-02-17T11:58:29.594 INFO:tasks.rados.rados.0.trial142.stdout:2000: done (0 left) 2026-02-17T11:58:29.594 INFO:tasks.rados.rados.0.trial142.stdout:2001: write oid 38 current snap is 220 2026-02-17T11:58:29.594 INFO:tasks.rados.rados.0.trial142.stdout:2001: seq_num 704 ranges {632128=479772,1746735=600898,3066728=653850} 2026-02-17T11:58:29.597 INFO:tasks.rados.rados.0.trial142.stdout:2001: writing trial14245205-38 from 632128 to 1111900 tid 1 2026-02-17T11:58:29.602 INFO:tasks.rados.rados.0.trial142.stdout:2001: writing trial14245205-38 from 1746735 to 2347633 tid 2 2026-02-17T11:58:29.607 INFO:tasks.rados.rados.0.trial142.stdout:2001: writing trial14245205-38 from 3066728 to 3720578 tid 3 2026-02-17T11:58:29.607 INFO:tasks.rados.rados.0.trial142.stdout:2002: read oid 3 snap 209 2026-02-17T11:58:29.607 INFO:tasks.rados.rados.0.trial142.stdout:2002: expect deleted 2026-02-17T11:58:29.607 INFO:tasks.rados.rados.0.trial142.stdout:2003: snap_remove snap 217 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2003: done (2 left) 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2004: read oid 6 snap -1 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2004: expect (ObjNum 703 snap 219 seq_num 703) 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2005: copy_from oid 26 from oid 43 current snap is 220 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2001: finishing write tid 1 to trial14245205-38 2026-02-17T11:58:30.573 INFO:tasks.rados.rados.0.trial142.stdout:2001: finishing write tid 2 to trial14245205-38 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: finishing write tid 3 to trial14245205-38 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2002: done (3 left) 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2006: read oid 50 snap -1 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2006: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2007: delete oid 29 current snap is 220 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: finishing write tid 4 to trial14245205-38 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: finishing write tid 5 to trial14245205-38 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: oid 38 updating version 0 to 1122 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: oid 38 version 1122 is already newer than 1121 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: oid 38 updating version 1122 to 1124 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:2001: oid 38 version 1124 is already newer than 1123 2026-02-17T11:58:30.574 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1124 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:58:30.575 INFO:tasks.rados.rados.0.trial142.stdout:2001: left oid 38 (ObjNum 704 snap 220 seq_num 704) 2026-02-17T11:58:30.577 INFO:tasks.rados.rados.0.trial142.stdout:2001: done (4 left) 2026-02-17T11:58:30.577 INFO:tasks.rados.rados.0.trial142.stdout:2007: done (3 left) 2026-02-17T11:58:30.577 INFO:tasks.rados.rados.0.trial142.stdout:2008: write (excl) oid 48 current snap is 220 2026-02-17T11:58:30.577 INFO:tasks.rados.rados.0.trial142.stdout:2008: seq_num 706 ranges {665742=630270,1863699=604567,3121574=676394} 2026-02-17T11:58:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2008: writing trial14245205-48 from 665742 to 1296012 tid 1 2026-02-17T11:58:30.587 INFO:tasks.rados.rados.0.trial142.stdout:2008: writing trial14245205-48 from 1863699 to 2468266 tid 2 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2008: writing trial14245205-48 from 3121574 to 3797968 tid 3 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2009: read oid 32 snap -1 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2009: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2010: delete oid 49 current snap is 220 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2005: finishing copy_from to trial14245205-26 2026-02-17T11:58:30.593 INFO:tasks.rados.rados.0.trial142.stdout:2005: got expected ENOENT (src dne) 2026-02-17T11:58:30.594 INFO:tasks.rados.rados.0.trial142.stdout:2005: finishing copy_from racing read to trial14245205-26 2026-02-17T11:58:30.594 INFO:tasks.rados.rados.0.trial142.stdout:2006: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:30.651 INFO:tasks.rados.rados.0.trial142.stdout:2004: expect (ObjNum 703 snap 219 seq_num 703) 2026-02-17T11:58:30.790 INFO:tasks.rados.rados.0.trial142.stdout:2008: finishing write tid 1 to trial14245205-48 2026-02-17T11:58:30.790 INFO:tasks.rados.rados.0.trial142.stdout:2008: finishing write tid 2 to trial14245205-48 2026-02-17T11:58:30.790 INFO:tasks.rados.rados.0.trial142.stdout:2008: finishing write tid 3 to trial14245205-48 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: finishing write tid 4 to trial14245205-48 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: finishing write tid 5 to trial14245205-48 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: oid 48 updating version 0 to 1596 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: oid 48 updating version 1596 to 1597 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: oid 48 updating version 1597 to 1598 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: oid 48 version 1598 is already newer than 1595 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1598 (ObjNum 706 snap 220 seq_num 706) dirty exists 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2008: left oid 48 (ObjNum 706 snap 220 seq_num 706) 2026-02-17T11:58:30.791 INFO:tasks.rados.rados.0.trial142.stdout:2009: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:30.904 INFO:tasks.rados.rados.0.trial142.stdout:2004: done (5 left) 2026-02-17T11:58:30.904 INFO:tasks.rados.rados.0.trial142.stdout:2005: done (4 left) 2026-02-17T11:58:30.904 INFO:tasks.rados.rados.0.trial142.stdout:2006: done (3 left) 2026-02-17T11:58:30.904 INFO:tasks.rados.rados.0.trial142.stdout:2008: done (2 left) 2026-02-17T11:58:30.904 INFO:tasks.rados.rados.0.trial142.stdout:2009: done (1 left) 2026-02-17T11:58:30.905 INFO:tasks.rados.rados.0.trial142.stdout:2010: done (0 left) 2026-02-17T11:58:30.905 INFO:tasks.rados.rados.0.trial142.stdout:2011: read oid 32 snap -1 2026-02-17T11:58:30.905 INFO:tasks.rados.rados.0.trial142.stdout:2011: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:30.905 INFO:tasks.rados.rados.0.trial142.stdout:2012: write oid 3 current snap is 220 2026-02-17T11:58:30.905 INFO:tasks.rados.rados.0.trial142.stdout:2012: seq_num 708 ranges {699356=497121,1980663=608236,3176420=415291} 2026-02-17T11:58:30.908 INFO:tasks.rados.rados.0.trial142.stdout:2012: writing trial14245205-3 from 699356 to 1196477 tid 1 2026-02-17T11:58:30.914 INFO:tasks.rados.rados.0.trial142.stdout:2012: writing trial14245205-3 from 1980663 to 2588899 tid 2 2026-02-17T11:58:30.917 INFO:tasks.rados.rados.0.trial142.stdout:2012: writing trial14245205-3 from 3176420 to 3591711 tid 3 2026-02-17T11:58:30.918 INFO:tasks.rados.rados.0.trial142.stdout:2013: snap_create 2026-02-17T11:58:30.918 INFO:tasks.rados.rados.0.trial142.stdout:2011: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:31.031 INFO:tasks.rados.rados.0.trial142.stdout:2012: finishing write tid 1 to trial14245205-3 2026-02-17T11:58:31.031 INFO:tasks.rados.rados.0.trial142.stdout:2012: finishing write tid 2 to trial14245205-3 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: finishing write tid 3 to trial14245205-3 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: finishing write tid 4 to trial14245205-3 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: finishing write tid 5 to trial14245205-3 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: oid 3 updating version 0 to 1033 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: oid 3 updating version 1033 to 1034 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: oid 3 version 1034 is already newer than 1032 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: oid 3 version 1034 is already newer than 1031 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1034 (ObjNum 708 snap 220 seq_num 708) dirty exists 2026-02-17T11:58:31.032 INFO:tasks.rados.rados.0.trial142.stdout:2012: left oid 3 (ObjNum 708 snap 220 seq_num 708) 2026-02-17T11:58:31.796 INFO:tasks.rados.rados.0.trial142.stdout:2011: done (2 left) 2026-02-17T11:58:31.796 INFO:tasks.rados.rados.0.trial142.stdout:2012: done (1 left) 2026-02-17T11:58:31.796 INFO:tasks.rados.rados.0.trial142.stdout:2013: done (0 left) 2026-02-17T11:58:31.796 INFO:tasks.rados.rados.0.trial142.stdout:2014: snap_remove snap 214 2026-02-17T11:58:32.798 INFO:tasks.rados.rados.0.trial142.stdout:2014: done (0 left) 2026-02-17T11:58:32.798 INFO:tasks.rados.rados.0.trial142.stdout:2015: copy_from oid 11 from oid 5 current snap is 221 2026-02-17T11:58:32.798 INFO:tasks.rados.rados.0.trial142.stdout:2016: rollback oid 29 current snap is 221 2026-02-17T11:58:32.798 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 205 2026-02-17T11:58:32.798 INFO:tasks.rados.rados.0.trial142.stdout:2017: read oid 42 snap -1 2026-02-17T11:58:32.799 INFO:tasks.rados.rados.0.trial142.stdout:2017: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:32.799 INFO:tasks.rados.rados.0.trial142.stdout:2018: snap_create 2026-02-17T11:58:32.801 INFO:tasks.rados.rados.0.trial142.stdout:2017: expect (ObjNum 626 snap 196 seq_num 626) 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:2016: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:2016: finishing rollback tid 2 to trial14245205-29 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1600 (ObjNum 579 snap 181 seq_num 579) dirty exists 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:2015: finishing copy_from racing read to trial14245205-11 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:2015: finishing copy_from to trial14245205-11 2026-02-17T11:58:32.860 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1117 (ObjNum 644 snap 199 seq_num 644) dirty exists 2026-02-17T11:58:33.799 INFO:tasks.rados.rados.0.trial142.stdout:2015: done (3 left) 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2016: done (2 left) 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2017: done (1 left) 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2018: done (0 left) 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2019: read oid 17 snap -1 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2019: expect (ObjNum 700 snap 219 seq_num 700) 2026-02-17T11:58:33.800 INFO:tasks.rados.rados.0.trial142.stdout:2020: delete oid 47 current snap is 222 2026-02-17T11:58:33.803 INFO:tasks.rados.rados.0.trial142.stdout:2020: done (1 left) 2026-02-17T11:58:33.803 INFO:tasks.rados.rados.0.trial142.stdout:2021: snap_remove snap 207 2026-02-17T11:58:34.803 INFO:tasks.rados.rados.0.trial142.stdout:2021: done (1 left) 2026-02-17T11:58:34.803 INFO:tasks.rados.rados.0.trial142.stdout:2022: copy_from oid 23 from oid 29 current snap is 222 2026-02-17T11:58:34.803 INFO:tasks.rados.rados.0.trial142.stdout:2019: expect (ObjNum 700 snap 219 seq_num 700) 2026-02-17T11:58:34.937 INFO:tasks.rados.rados.0.trial142.stdout:2022: finishing copy_from racing read to trial14245205-23 2026-02-17T11:58:34.937 INFO:tasks.rados.rados.0.trial142.stdout:2022: finishing copy_from to trial14245205-23 2026-02-17T11:58:34.938 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1600 (ObjNum 579 snap 181 seq_num 579) dirty exists 2026-02-17T11:58:34.938 INFO:tasks.rados.rados.0.trial142.stdout:2019: done (1 left) 2026-02-17T11:58:34.938 INFO:tasks.rados.rados.0.trial142.stdout:2022: done (0 left) 2026-02-17T11:58:34.938 INFO:tasks.rados.rados.0.trial142.stdout:2023: delete oid 47 current snap is 222 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2023: done (0 left) 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2024: read oid 18 snap -1 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2024: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2025: read oid 27 snap -1 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2025: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T11:58:34.939 INFO:tasks.rados.rados.0.trial142.stdout:2026: snap_remove snap 213 2026-02-17T11:58:35.575 INFO:tasks.rados.rados.0.trial142.stdout:2026: done (2 left) 2026-02-17T11:58:35.575 INFO:tasks.rados.rados.0.trial142.stdout:2027: snap_create 2026-02-17T11:58:35.575 INFO:tasks.rados.rados.0.trial142.stdout:2025: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T11:58:35.704 INFO:tasks.rados.rados.0.trial142.stdout:2024: expect (ObjNum 613 snap 188 seq_num 613) 2026-02-17T11:58:36.578 INFO:tasks.rados.rados.0.trial142.stdout:2024: done (2 left) 2026-02-17T11:58:36.579 INFO:tasks.rados.rados.0.trial142.stdout:2025: done (1 left) 2026-02-17T11:58:36.579 INFO:tasks.rados.rados.0.trial142.stdout:2027: done (0 left) 2026-02-17T11:58:36.579 INFO:tasks.rados.rados.0.trial142.stdout:2028: snap_remove snap 218 2026-02-17T11:58:37.578 INFO:tasks.rados.rados.0.trial142.stdout:2028: done (0 left) 2026-02-17T11:58:37.578 INFO:tasks.rados.rados.0.trial142.stdout:2029: read oid 12 snap -1 2026-02-17T11:58:37.579 INFO:tasks.rados.rados.0.trial142.stdout:2029: expect deleted 2026-02-17T11:58:37.579 INFO:tasks.rados.rados.0.trial142.stdout:2030: read oid 32 snap -1 2026-02-17T11:58:37.579 INFO:tasks.rados.rados.0.trial142.stdout:2030: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:37.579 INFO:tasks.rados.rados.0.trial142.stdout:2031: delete oid 10 current snap is 223 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2029: done (2 left) 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2031: done (1 left) 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2032: read oid 39 snap -1 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2032: expect deleted 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2033: copy_from oid 26 from oid 4 current snap is 223 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2034: read oid 15 snap 220 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2034: expect (ObjNum 554 snap 168 seq_num 554) 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2035: write oid 48 current snap is 223 2026-02-17T11:58:37.581 INFO:tasks.rados.rados.0.trial142.stdout:2035: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2026-02-17T11:58:37.587 INFO:tasks.rados.rados.0.trial142.stdout:2035: writing trial14245205-48 from 766584 to 1564701 tid 1 2026-02-17T11:58:37.592 INFO:tasks.rados.rados.0.trial142.stdout:2035: writing trial14245205-48 from 2098238 to 2713812 tid 2 2026-02-17T11:58:37.596 INFO:tasks.rados.rados.0.trial142.stdout:2035: writing trial14245205-48 from 3169759 to 3630138 tid 3 2026-02-17T11:58:37.596 INFO:tasks.rados.rados.0.trial142.stdout:2036: write (excl) oid 43 current snap is 223 2026-02-17T11:58:37.596 INFO:tasks.rados.rados.0.trial142.stdout:2036: seq_num 713 ranges {783391=473366,1756720=475585,2797182=788004} 2026-02-17T11:58:37.600 INFO:tasks.rados.rados.0.trial142.stdout:2036: writing trial14245205-43 from 783391 to 1256757 tid 1 2026-02-17T11:58:37.604 INFO:tasks.rados.rados.0.trial142.stdout:2036: writing trial14245205-43 from 1756720 to 2232305 tid 2 2026-02-17T11:58:37.609 INFO:tasks.rados.rados.0.trial142.stdout:2036: writing trial14245205-43 from 2797182 to 3585186 tid 3 2026-02-17T11:58:37.609 INFO:tasks.rados.rados.0.trial142.stdout:2037: read oid 16 snap -1 2026-02-17T11:58:37.610 INFO:tasks.rados.rados.0.trial142.stdout:2037: expect (ObjNum 660 snap 207 seq_num 660) 2026-02-17T11:58:37.610 INFO:tasks.rados.rados.0.trial142.stdout:2038: snap_remove snap 221 2026-02-17T11:58:38.584 INFO:tasks.rados.rados.0.trial142.stdout:2038: done (7 left) 2026-02-17T11:58:38.584 INFO:tasks.rados.rados.0.trial142.stdout:2039: snap_remove snap 215 2026-02-17T11:58:39.171 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:58:39.171 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T11:58:39.171 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:58:39.171 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T11:58:39.174 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:58:39.175 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:58:39.175 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:39.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.241+0000 7f74f6161640 10 monclient: get_monmap_and_config 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.241+0000 7f74f6161640 10 monclient: build_initial_monmap 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.241+0000 7f74f6161640 10 monclient: monmap: 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:39.242785+0000 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:39.242785+0000 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:39.244 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:39.245 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:39.245 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:39.245 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:39.245 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 Processor -- start 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 -- start start 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient: init 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f74f0138600 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74f013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-b con 0x7f74f00a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74f013d8a0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f00a1df0 con 0x7f74f0138600 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f00a65b0 con 0x7f74f013d8a0 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00a6830 con 0x7f74f00a35a0 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74f6161640 10 monclient(hunting): authenticate will time out at 1406.861646s 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74f013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74ef7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f74f0138600 0x7f74f01389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58698/0 (socket says 10.20.193.51:58698) 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 learned_addr learned my addr 10.20.193.51:0/3856394738 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:39.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 10 monclient(hunting): get_auth_request con 0x7f74f00a35a0 auth_method 0 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 msgr2=0x7f74f013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 msgr2=0x7f74f013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74f013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.242+0000 7f74eeffd640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74f013d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 >> v1:10.20.193.51:6789/0 conn(0x7f74f0138600 legacy=0x7f74f01389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848333917 0 0) 0x7f74f00a1df0 con 0x7f74f0138600 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 10 monclient(hunting): my global_id is 164205 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.244+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d4003620 con 0x7f74f0138600 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 369158688 0 0) 0x7f74d4003620 con 0x7f74f0138600 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 1 -- 10.20.193.51:0/3856394738 >> v1:10.20.193.142:6789/0 conn(0x7f74f013d8a0 legacy=0x7f74f013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 msgr2=0x7f74f013d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74f013d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 >> v1:10.20.193.142:6789/0 conn(0x7f74f013d8a0 legacy=0x7f74f013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:58:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f00a22d0 con 0x7f74f0138600 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f74dc0031b0 con 0x7f74f0138600 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: dump: 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:39.261 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 >> v1:10.20.193.51:6789/0 conn(0x7f74f0138600 legacy=0x7f74f01389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74d4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): picked mon.a con 0x7f74d4003b30 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74d4004900 0x7f74d4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): picked mon.b con 0x7f74d4004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74d400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): picked mon.c con 0x7f74f00a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40056e0 con 0x7f74d4003b30 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f74d400c000 con 0x7f74d4004900 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74d400c180 con 0x7f74f00a35a0 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ee7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74d4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request con 0x7f74d4003b30 auth_method 0 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74d400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): get_auth_request con 0x7f74f00a35a0 auth_method 0 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74effff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_done global_id 164205 payload 293 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 msgr2=0x7f74d400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f00a35a0 0x7f74d400bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74d4004900 msgr2=0x7f74d4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74d4004900 0x7f74d4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 monclient: found mon.a 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d4003620 con 0x7f74d4003b30 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74f6161640 5 monclient: authenticate success, global_id 164205 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.245+0000 7f74f6161640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ef7fe640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74d4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74d4003f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0033d0 tx=0x7f74dc02f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e294982d88eb00d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00c200 con 0x7f74d4003b30 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: dump: 2026-02-17T11:58:39.266 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74dc005cb0 con 0x7f74d4003b30 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74f6161640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:39.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 1 -- 10.20.193.51:0/3856394738 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc005e60 con 0x7f74d4003b30 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74f6161640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74f6161640 4 set_mon_vals no callback set 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.247+0000 7f74ee7fc640 10 monclient: dump: 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:39.268 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 10 monclient: shutdown 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74d4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 --2- 10.20.193.51:0/3856394738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74d4003f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0033d0 tx=0x7f74dc02f7d0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74effff640 1 -- 10.20.193.51:0/3856394738 reap_dead start 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- 10.20.193.51:0/3856394738 shutdown_connections 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- 10.20.193.51:0/3856394738 >> 10.20.193.51:0/3856394738 conn(0x7f74f00a7460 msgr2=0x7f74f00a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- 10.20.193.51:0/3856394738 shutdown_connections 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- 10.20.193.51:0/3856394738 wait complete. 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 10 monclient: build_initial_monmap 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 10 monclient: monmap: 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:39.270 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 Processor -- start 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 1 -- start start 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.248+0000 7f74f6161640 10 monclient: init 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-a con 0x7f74d4003b30 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-c con 0x7f74f013a790 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 0x7f74f01cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): picked mon.noname-b con 0x7f74f00748d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:39.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00a15f0 con 0x7f74d4003b30 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00a2c00 con 0x7f74f00748d0 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00a1770 con 0x7f74f013a790 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74f6161640 10 monclient(hunting): authenticate will time out at 1406.868223s 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56824/0 (socket says 10.20.193.51:56824) 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 -- 10.20.193.51:0/538813918 learned_addr learned my addr 10.20.193.51:0/538813918 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request con 0x7f74d4003b30 auth_method 0 2026-02-17T11:58:39.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 10 monclient(hunting): get_auth_request con 0x7f74f013a790 auth_method 0 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 msgr2=0x7f74f0074390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:58:39.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 msgr2=0x7f74f0074390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74eeffd640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient(hunting): handle_auth_done global_id 164208 payload 824 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74effff640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 0x7f74f01cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 msgr2=0x7f74f0074390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 msgr2=0x7f74f01cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 0x7f74f01cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 monclient: found mon.noname-a 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:39.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74ef7fe640 1 -- 10.20.193.51:0/538813918 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f01cc570 con 0x7f74d4003b30 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74effff640 10 monclient: get_auth_request con 0x7f74f00748d0 auth_method 0 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.249+0000 7f74effff640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 0x7f74f01cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74ef7fe640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74f01cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74ef7fe640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0033d0 tx=0x7f74f00a24a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc047070 con 0x7f74d4003b30 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.275 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: _finish_auth 0 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74dc002fb0 con 0x7f74d4003b30 2026-02-17T11:58:39.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc005e60 con 0x7f74d4003b30 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74edffb640 4 set_mon_vals no callback set 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74cbfff640 10 monclient: dump: 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:39.277 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 5 monclient: authenticate success, global_id 164208 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 10 monclient: _renew_subs 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f0070900 con 0x7f74d4003b30 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 10 monclient: _renew_subs 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.251+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f01cf640 con 0x7f74d4003b30 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f74dc036020 con 0x7f74d4003b30 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74f6161640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:39.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74f6161640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74f6161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f01389e0 con 0x7f74d4003b30 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74cbfff640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 0x7f74c0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(468..468 src has 323..468) ==== 4811+0+0 (secure 0 0 0) 0x7f74dc077180 con 0x7f74d4003b30 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74eeffd640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 0x7f74c0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.252+0000 7f74eeffd640 10 monclient: get_auth_request con 0x7f74c003dd60 auth_method 0 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.254+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f74dc075b60 con 0x7f74d4003b30 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.254+0000 7f74cbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.254+0000 7f74cbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:39.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.255+0000 7f74eeffd640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 0x7f74c0040220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f74f013acd0 tx=0x7f74e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.368+0000 7f74f6161640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.368+0000 7f74f6161640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.368+0000 7f74f6161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.368+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f74f0070440 con 0x7f74d4003b30 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.369+0000 7f74cbfff640 1 -- 10.20.193.51:0/538813918 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f74dc04bc50 con 0x7f74d4003b30 2026-02-17T11:58:39.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.369+0000 7f74cbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:39.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.369+0000 7f74cbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:39.372 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":122,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:39.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 msgr2=0x7f74c0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 0x7f74c0040220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f74f013acd0 tx=0x7f74e0008040 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 10 monclient: shutdown 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74f01cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0033d0 tx=0x7f74f00a24a0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 shutdown_connections 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f74c003dd60 0x7f74c0040220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74f00748d0 0x7f74f01cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74f013a790 0x7f74f0074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 --2- 10.20.193.51:0/538813918 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74d4003b30 0x7f74f01cba20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 >> 10.20.193.51:0/538813918 conn(0x7f74f00a7460 msgr2=0x7f74f01355b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:39.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 shutdown_connections 2026-02-17T11:58:39.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:39.370+0000 7f74f6161640 1 -- 10.20.193.51:0/538813918 wait complete. 2026-02-17T11:58:39.587 INFO:tasks.rados.rados.0.trial142.stdout:2039: done (7 left) 2026-02-17T11:58:39.587 INFO:tasks.rados.rados.0.trial142.stdout:2040: read oid 47 snap -1 2026-02-17T11:58:39.587 INFO:tasks.rados.rados.0.trial142.stdout:2040: expect deleted 2026-02-17T11:58:39.587 INFO:tasks.rados.rados.0.trial142.stdout:2041: rollback oid 9 current snap is 223 2026-02-17T11:58:39.587 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 212 2026-02-17T11:58:39.588 INFO:tasks.rados.rados.0.trial142.stdout:2030: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:58:39.700 INFO:tasks.rados.rados.0.trial142.stdout:2034: expect (ObjNum 554 snap 168 seq_num 554) 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2033: finishing copy_from racing read to trial14245205-26 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2030: done (8 left) 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2032: done (7 left) 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2034: done (6 left) 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2042: snap_create 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2033: finishing copy_from to trial14245205-26 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1487 (ObjNum 447 snap 134 seq_num 447) dirty exists 2026-02-17T11:58:39.781 INFO:tasks.rados.rados.0.trial142.stdout:2035: finishing write tid 1 to trial14245205-48 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: finishing write tid 2 to trial14245205-48 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: finishing write tid 3 to trial14245205-48 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: finishing write tid 4 to trial14245205-48 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: finishing write tid 5 to trial14245205-48 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: oid 48 updating version 0 to 1602 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: oid 48 version 1602 is already newer than 1601 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: oid 48 updating version 1602 to 1604 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: oid 48 version 1604 is already newer than 1603 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1604 (ObjNum 712 snap 223 seq_num 712) dirty exists 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2035: left oid 48 (ObjNum 712 snap 223 seq_num 712) 2026-02-17T11:58:39.782 INFO:tasks.rados.rados.0.trial142.stdout:2036: finishing write tid 1 to trial14245205-43 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: finishing write tid 2 to trial14245205-43 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: finishing write tid 3 to trial14245205-43 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: finishing write tid 4 to trial14245205-43 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: finishing write tid 5 to trial14245205-43 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: oid 43 updating version 0 to 1830 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: oid 43 version 1830 is already newer than 1829 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: oid 43 updating version 1830 to 1831 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: oid 43 updating version 1831 to 1832 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1832 (ObjNum 713 snap 223 seq_num 713) dirty exists 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2036: left oid 43 (ObjNum 713 snap 223 seq_num 713) 2026-02-17T11:58:39.783 INFO:tasks.rados.rados.0.trial142.stdout:2037: expect (ObjNum 660 snap 207 seq_num 660) 2026-02-17T11:58:39.962 INFO:tasks.rados.rados.0.trial142.stdout:2041: finishing rollback tid 0 to trial14245205-9 2026-02-17T11:58:39.962 INFO:tasks.rados.rados.0.trial142.stdout:2041: finishing rollback tid 1 to trial14245205-9 2026-02-17T11:58:39.963 INFO:tasks.rados.rados.0.trial142.stdout:2041: finishing rollback tid 2 to trial14245205-9 2026-02-17T11:58:39.963 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 1840 (ObjNum 657 snap 204 seq_num 657) dirty exists 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2033: done (6 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2035: done (5 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2036: done (4 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2037: done (3 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2040: done (2 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2041: done (1 left) 2026-02-17T11:58:40.576 INFO:tasks.rados.rados.0.trial142.stdout:2042: done (0 left) 2026-02-17T11:58:40.577 INFO:tasks.rados.rados.0.trial142.stdout:2043: read oid 38 snap 220 2026-02-17T11:58:40.577 INFO:tasks.rados.rados.0.trial142.stdout:2043: expect (ObjNum 704 snap 220 seq_num 704) 2026-02-17T11:58:40.577 INFO:tasks.rados.rados.0.trial142.stdout:2044: write (excl) oid 17 current snap is 224 2026-02-17T11:58:40.577 INFO:tasks.rados.rados.0.trial142.stdout:2044: seq_num 714 ranges {400198=548615,1415202=584996} 2026-02-17T11:58:40.580 INFO:tasks.rados.rados.0.trial142.stdout:2044: writing trial14245205-17 from 400198 to 948813 tid 1 2026-02-17T11:58:40.584 INFO:tasks.rados.rados.0.trial142.stdout:2044: writing trial14245205-17 from 1415202 to 2000198 tid 2 2026-02-17T11:58:40.584 INFO:tasks.rados.rados.0.trial142.stdout:2045: snap_create 2026-02-17T11:58:40.584 INFO:tasks.rados.rados.0.trial142.stdout:2043: expect (ObjNum 704 snap 220 seq_num 704) 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: finishing write tid 1 to trial14245205-17 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: finishing write tid 2 to trial14245205-17 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: finishing write tid 3 to trial14245205-17 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: finishing write tid 4 to trial14245205-17 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: oid 17 updating version 0 to 1124 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: oid 17 version 1124 is already newer than 1122 2026-02-17T11:58:40.738 INFO:tasks.rados.rados.0.trial142.stdout:2044: oid 17 version 1124 is already newer than 1123 2026-02-17T11:58:40.739 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1124 (ObjNum 714 snap 224 seq_num 714) dirty exists 2026-02-17T11:58:40.739 INFO:tasks.rados.rados.0.trial142.stdout:2044: left oid 17 (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:58:42.380 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:42.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: get_monmap_and_config 2026-02-17T11:58:42.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: build_initial_monmap 2026-02-17T11:58:42.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: monmap: 2026-02-17T11:58:42.452 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:42.449253+0000 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:42.449253+0000 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 Processor -- start 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 -- start start 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: init 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f4d1c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4d1c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f4d1c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c06e140 con 0x7f4d1c0a0750 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c09f910 con 0x7f4d1c0a3bb0 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c09ccd0 con 0x7f4d1c13b760 2026-02-17T11:58:42.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.448+0000 7f4d20ebf640 10 monclient(hunting): authenticate will time out at 1410.067992s 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40012/0 (socket says 10.20.193.51:40012) 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 learned_addr learned my addr 10.20.193.51:0/1960009569 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d1c13b760 auth_method 0 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1a575640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a3bb0 auth_method 0 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.449+0000 7f4d1a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:42.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.451+0000 7f4d19d74640 1 -- 10.20.193.51:0/1960009569 >> v1:10.20.193.142:6789/0 conn(0x7f4d1c0a0750 legacy=0x7f4d1c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:42.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.451+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:42.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.451+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:42.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.451+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:42.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.451+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:42.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:42.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d1c13b760 auth_method 0 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:42.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.650+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:42.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:42.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a3bb0 auth_method 0 2026-02-17T11:58:42.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:42.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:42.652+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:43.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:43.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d1c13b760 auth_method 0 2026-02-17T11:58:43.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:43.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.051+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:58:43.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:43.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a3bb0 auth_method 0 2026-02-17T11:58:43.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:43.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.053+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:58:43.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d1c13b760 auth_method 0 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:43.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.852+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:58:43.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a3bb0 auth_method 0 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:43.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:43.854+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:58:45.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 10 monclient(hunting): tick 2026-02-17T11:58:45.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:58:45.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 msgr2=0x7f4d1c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c13b760 0x7f4d1c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.448+0000 7f4d03fff640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c0a3bb0 0x7f4d1c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 1 -- 10.20.193.51:0/1960009569 >> v1:10.20.193.142:6789/0 conn(0x7f4d1c0a0750 legacy=0x7f4d1c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 10 monclient: _add_conns ranks=[0,3] 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4cf8003840 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:45.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 10 monclient(hunting): picked mon.noname-a con 0x7f4cf8007590 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 1 -- 10.20.193.51:0/1960009569 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c09eec0 con 0x7f4cf8003840 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 1 -- 10.20.193.51:0/1960009569 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c09f910 con 0x7f4cf8007590 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d03fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 10 monclient(hunting): get_auth_request con 0x7f4cf8007590 auth_method 0 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:45.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 msgr2=0x7f4cf8009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 msgr2=0x7f4cf8009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.449+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:45.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.451+0000 7f4d1a575640 1 -- 10.20.193.51:0/1960009569 >> v1:10.20.193.51:6789/0 conn(0x7f4cf8003840 legacy=0x7f4cf8005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 10 monclient(hunting): get_auth_request con 0x7f4cf8007590 auth_method 0 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 msgr2=0x7f4cf8009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 msgr2=0x7f4cf8009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:45.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.650+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:58:45.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.669+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434769524 0 0) 0x7f4d1c09eec0 con 0x7f4cf8003840 2026-02-17T11:58:45.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.670+0000 7f4d19573640 10 monclient(hunting): _negotiate 2026-02-17T11:58:45.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.670+0000 7f4d19573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.670+0000 7f4d19573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:45.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.670+0000 7f4d19573640 10 monclient(hunting): my global_id is 164211 2026-02-17T11:58:45.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.670+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d08003620 con 0x7f4cf8003840 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 337300681 0 0) 0x7f4d08003620 con 0x7f4cf8003840 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 msgr2=0x7f4cf8009a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 --2- 10.20.193.51:0/1960009569 >> v2:10.20.193.51:3300/0 conn(0x7f4cf8007590 0x7f4cf8009a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _finish_hunting 0 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf800b1c0 con 0x7f4cf8003840 2026-02-17T11:58:45.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _finish_auth 0 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _check_auth_tickets 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f4d1000f040 con 0x7f4cf8003840 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: dump: 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 >> v1:10.20.193.51:6789/0 conn(0x7f4cf8003840 legacy=0x7f4cf8005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 reap_dead start 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d08003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): picked mon.b con 0x7f4d08003ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 0x7f4d08004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): picked mon.a con 0x7f4d08004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 0x7f4d08010050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): picked mon.c con 0x7f4d08005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c09f910 con 0x7f4d08004900 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08010930 con 0x7f4d08003ba0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d08010b30 con 0x7f4d08005510 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 0x7f4d08010050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 0x7f4d08004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d08005510 auth_method 0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): get_auth_request con 0x7f4d08004900 auth_method 0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_done global_id 164211 payload 293 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 msgr2=0x7f4d08003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d08003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d08003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 msgr2=0x7f4d08004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 0x7f4d08004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 monclient: found mon.c 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d08003620 con 0x7f4d08005510 2026-02-17T11:58:45.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient: _finish_auth 0 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 10 monclient: _check_auth_tickets 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1ad76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d20ebf640 5 monclient: authenticate success, global_id 164211 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d20ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1a575640 10 monclient: get_auth_request con 0x7f4d08003ba0 auth_method 0 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d1a575640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d08003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:45.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.671+0000 7f4d19d74640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 0x7f4d08004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:45.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d1ad76640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 msgr2=0x7f4d08010050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 0x7f4d08010050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c06dd20 tx=0x7f4d0c02fa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c6c8bafa307dad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c009700 con 0x7f4d08005510 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: dump: 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d20ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c03c070 con 0x7f4d08005510 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 1 -- 10.20.193.51:0/1960009569 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0367d0 con 0x7f4d08005510 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d20ebf640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d20ebf640 4 set_mon_vals no callback set 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.673+0000 7f4d19573640 10 monclient: dump: 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:45.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 10 monclient: shutdown 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 -- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 msgr2=0x7f4d08010050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 0x7f4d08010050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c06dd20 tx=0x7f4d0c02fa40 comp rx=0 tx=0).stop 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 -- 10.20.193.51:0/1960009569 shutdown_connections 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08005510 0x7f4d08010050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08004900 0x7f4d08004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/1960009569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d08003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 -- 10.20.193.51:0/1960009569 >> 10.20.193.51:0/1960009569 conn(0x7f4d1c0a30c0 msgr2=0x7f4d1c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 -- 10.20.193.51:0/1960009569 shutdown_connections 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 1 -- 10.20.193.51:0/1960009569 wait complete. 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 10 monclient: build_initial_monmap 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.674+0000 7f4d20ebf640 10 monclient: monmap: 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 Processor -- start 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 -- start start 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient: init 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d1c09b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f4d08003ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f4d08004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 0x7f4d1c091e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f4d08005510 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c09dac0 con 0x7f4d08005510 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0a04b0 con 0x7f4d08003ba0 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c09dc40 con 0x7f4d08004900 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d20ebf640 10 monclient(hunting): authenticate will time out at 1413.294417s 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 0x7f4d1c091e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55304/0 (socket says 10.20.193.51:55304) 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 -- 10.20.193.51:0/3820899035 learned_addr learned my addr 10.20.193.51:0/3820899035 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 10 monclient(hunting): get_auth_request con 0x7f4d08004900 auth_method 0 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request con 0x7f4d08005510 auth_method 0 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 msgr2=0x7f4d1c09b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 msgr2=0x7f4d1c09b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d19d74640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:45.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient(hunting): handle_auth_done global_id 164214 payload 824 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1a575640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d1c09b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 msgr2=0x7f4d1c09b870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 msgr2=0x7f4d1c09b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d1c09b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 monclient: found mon.noname-a 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1ad76640 1 -- 10.20.193.51:0/3820899035 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c095dc0 con 0x7f4d08005510 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1a575640 10 monclient: get_auth_request con 0x7f4d08003ba0 auth_method 0 2026-02-17T11:58:45.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.675+0000 7f4d1a575640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d1c09b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d1ad76640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 msgr2=0x7f4d1c091e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d1ad76640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 0x7f4d1c091e30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c038000 tx=0x7f4d0c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0130b0 con 0x7f4d08005510 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: dump: 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c003490 con 0x7f4d08005510 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c003880 con 0x7f4d08005510 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 5 monclient: authenticate success, global_id 164214 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 10 monclient: _renew_subs 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d18d72640 4 set_mon_vals no callback set 2026-02-17T11:58:45.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c093f70 con 0x7f4d08005510 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d02ffd640 10 monclient: dump: 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 10 monclient: _renew_subs 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.677+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c09d7b0 con 0x7f4d08005510 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4d0c053030 con 0x7f4d08005510 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d20ebf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d20ebf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d20ebf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c09e020 con 0x7f4d08005510 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d02ffd640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 0x7f4ce80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(470..470 src has 323..470) ==== 4843+0+0 (secure 0 0 0) 0x7f4d0c078080 con 0x7f4d08005510 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.678+0000 7f4d1a575640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 0x7f4ce80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.679+0000 7f4d1a575640 10 monclient: get_auth_request con 0x7f4ce803dd10 auth_method 0 2026-02-17T11:58:45.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.681+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4d0c032070 con 0x7f4d08005510 2026-02-17T11:58:45.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.681+0000 7f4d02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:45.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.681+0000 7f4d02ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:45.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.681+0000 7f4d1a575640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 0x7f4ce80401d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c7a0 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:45.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d20ebf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d20ebf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d20ebf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d1c093ad0 con 0x7f4d08005510 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d02ffd640 1 -- 10.20.193.51:0/3820899035 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f4d0c076a40 con 0x7f4d08005510 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d02ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.800+0000 7f4d02ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:45.803 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":126,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 msgr2=0x7f4ce80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 0x7f4ce80401d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c7a0 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 10 monclient: shutdown 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 msgr2=0x7f4d1c091e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 0x7f4d1c091e30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c038000 tx=0x7f4d0c004bb0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 shutdown_connections 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ce803dd10 0x7f4ce80401d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d08005510 0x7f4d1c091e30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d08004900 0x7f4d1c09b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 --2- 10.20.193.51:0/3820899035 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d08003ba0 0x7f4d1c09b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 >> 10.20.193.51:0/3820899035 conn(0x7f4d1c0a30c0 msgr2=0x7f4d1c0738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 shutdown_connections 2026-02-17T11:58:45.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:45.801+0000 7f4d20ebf640 1 -- 10.20.193.51:0/3820899035 wait complete. 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2043: done (2 left) 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2044: done (1 left) 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2045: done (0 left) 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2046: read oid 19 snap -1 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2046: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2047: read oid 41 snap -1 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2047: expect deleted 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2048: write oid 12 current snap is 225 2026-02-17T11:58:46.675 INFO:tasks.rados.rados.0.trial142.stdout:2048: seq_num 715 ranges {417005=740217,1590037=426968} 2026-02-17T11:58:46.679 INFO:tasks.rados.rados.0.trial142.stdout:2048: writing trial14245205-12 from 417005 to 1157222 tid 1 2026-02-17T11:58:46.682 INFO:tasks.rados.rados.0.trial142.stdout:2048: writing trial14245205-12 from 1590037 to 2017005 tid 2 2026-02-17T11:58:46.682 INFO:tasks.rados.rados.0.trial142.stdout:2049: snap_remove snap 219 2026-02-17T11:58:47.679 INFO:tasks.rados.rados.0.trial142.stdout:2049: done (3 left) 2026-02-17T11:58:47.680 INFO:tasks.rados.rados.0.trial142.stdout:2050: write (excl) oid 5 current snap is 225 2026-02-17T11:58:47.680 INFO:tasks.rados.rados.0.trial142.stdout:2050: seq_num 716 ranges {433812=415466,1648519=385293} 2026-02-17T11:58:47.683 INFO:tasks.rados.rados.0.trial142.stdout:2050: writing trial14245205-5 from 433812 to 849278 tid 1 2026-02-17T11:58:47.687 INFO:tasks.rados.rados.0.trial142.stdout:2050: writing trial14245205-5 from 1648519 to 2033812 tid 2 2026-02-17T11:58:47.688 INFO:tasks.rados.rados.0.trial142.stdout:2051: write oid 31 current snap is 225 2026-02-17T11:58:47.688 INFO:tasks.rados.rados.0.trial142.stdout:2051: seq_num 717 ranges {450619=490715,1590648=459971} 2026-02-17T11:58:47.691 INFO:tasks.rados.rados.0.trial142.stdout:2051: writing trial14245205-31 from 450619 to 941334 tid 1 2026-02-17T11:58:47.695 INFO:tasks.rados.rados.0.trial142.stdout:2051: writing trial14245205-31 from 1590648 to 2050619 tid 2 2026-02-17T11:58:47.695 INFO:tasks.rados.rados.0.trial142.stdout:2052: write (excl) oid 50 current snap is 225 2026-02-17T11:58:47.695 INFO:tasks.rados.rados.0.trial142.stdout:2046: expect (ObjNum 583 snap 181 seq_num 583) 2026-02-17T11:58:47.783 INFO:tasks.rados.rados.0.trial142.stdout:2048: finishing write tid 1 to trial14245205-12 2026-02-17T11:58:47.784 INFO:tasks.rados.rados.0.trial142.stdout:2052: seq_num 718 ranges {467426=565964,1649130=418296} 2026-02-17T11:58:47.787 INFO:tasks.rados.rados.0.trial142.stdout:2052: writing trial14245205-50 from 467426 to 1033390 tid 1 2026-02-17T11:58:47.791 INFO:tasks.rados.rados.0.trial142.stdout:2052: writing trial14245205-50 from 1649130 to 2067426 tid 2 2026-02-17T11:58:47.792 INFO:tasks.rados.rados.0.trial142.stdout:2046: done (5 left) 2026-02-17T11:58:47.792 INFO:tasks.rados.rados.0.trial142.stdout:2047: done (4 left) 2026-02-17T11:58:47.792 INFO:tasks.rados.rados.0.trial142.stdout:2053: snap_remove snap 204 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2053: done (4 left) 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2054: delete oid 28 current snap is 225 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: finishing write tid 2 to trial14245205-12 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: finishing write tid 3 to trial14245205-12 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: finishing write tid 4 to trial14245205-12 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: oid 12 updating version 0 to 1845 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: oid 12 version 1845 is already newer than 1843 2026-02-17T11:58:48.683 INFO:tasks.rados.rados.0.trial142.stdout:2048: oid 12 version 1845 is already newer than 1844 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1845 (ObjNum 715 snap 225 seq_num 715) dirty exists 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2048: left oid 12 (ObjNum 715 snap 225 seq_num 715) 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: finishing write tid 1 to trial14245205-5 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: finishing write tid 2 to trial14245205-5 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: finishing write tid 3 to trial14245205-5 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: finishing write tid 4 to trial14245205-5 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: oid 5 updating version 0 to 1127 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: oid 5 version 1127 is already newer than 1126 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:2050: oid 5 version 1127 is already newer than 1125 2026-02-17T11:58:48.684 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1127 (ObjNum 716 snap 225 seq_num 716) dirty exists 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2050: left oid 5 (ObjNum 716 snap 225 seq_num 716) 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: finishing write tid 1 to trial14245205-31 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: finishing write tid 2 to trial14245205-31 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: finishing write tid 3 to trial14245205-31 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: finishing write tid 4 to trial14245205-31 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: oid 31 updating version 0 to 1592 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: oid 31 updating version 1592 to 1593 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: oid 31 updating version 1593 to 1594 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1594 (ObjNum 717 snap 225 seq_num 717) dirty exists 2026-02-17T11:58:48.685 INFO:tasks.rados.rados.0.trial142.stdout:2051: left oid 31 (ObjNum 717 snap 225 seq_num 717) 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: finishing write tid 1 to trial14245205-50 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: finishing write tid 2 to trial14245205-50 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: finishing write tid 3 to trial14245205-50 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: finishing write tid 4 to trial14245205-50 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: oid 50 updating version 0 to 1488 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: oid 50 updating version 1488 to 1489 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: oid 50 updating version 1489 to 1490 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1490 (ObjNum 718 snap 225 seq_num 718) dirty exists 2026-02-17T11:58:48.686 INFO:tasks.rados.rados.0.trial142.stdout:2052: left oid 50 (ObjNum 718 snap 225 seq_num 718) 2026-02-17T11:58:48.687 INFO:tasks.rados.rados.0.trial142.stdout:2048: done (4 left) 2026-02-17T11:58:48.687 INFO:tasks.rados.rados.0.trial142.stdout:2050: done (3 left) 2026-02-17T11:58:48.687 INFO:tasks.rados.rados.0.trial142.stdout:2051: done (2 left) 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2052: done (1 left) 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2054: done (0 left) 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2055: delete oid 42 current snap is 225 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2055: done (0 left) 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2056: write oid 23 current snap is 225 2026-02-17T11:58:48.688 INFO:tasks.rados.rados.0.trial142.stdout:2056: seq_num 721 ranges {517847=791711,2108223=9624} 2026-02-17T11:58:48.692 INFO:tasks.rados.rados.0.trial142.stdout:2056: writing trial14245205-23 from 517847 to 1309558 tid 1 2026-02-17T11:58:48.695 INFO:tasks.rados.rados.0.trial142.stdout:2056: writing trial14245205-23 from 2108223 to 2117847 tid 2 2026-02-17T11:58:48.695 INFO:tasks.rados.rados.0.trial142.stdout:2057: snap_remove snap 216 2026-02-17T11:58:48.812 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: get_monmap_and_config 2026-02-17T11:58:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: build_initial_monmap 2026-02-17T11:58:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: monmap: 2026-02-17T11:58:48.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:48.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:48.879123+0000 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:48.879123+0000 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 Processor -- start 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 -- start start 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: init 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-a con 0x7f9b2c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9b2c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9b2c13b760 0x7f9b2c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f9b2c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2c06e140 con 0x7f9b2c0a0750 2026-02-17T11:58:48.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2c09f910 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2c09ccd0 con 0x7f9b2c13b760 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.878+0000 7f9b32ca7640 10 monclient(hunting): authenticate will time out at 1416.497940s 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58176/0 (socket says 10.20.193.51:58176) 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 -- 10.20.193.51:0/3617195616 learned_addr learned my addr 10.20.193.51:0/3617195616 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): get_auth_request con 0x7f9b2c0a3bb0 auth_method 0 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b3121d640 1 --2- 10.20.193.51:0/3617195616 >> v2:10.20.193.142:3300/0 conn(0x7f9b2c13b760 0x7f9b2c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b3121d640 10 monclient(hunting): get_auth_request con 0x7f9b2c13b760 auth_method 0 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b3121d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b3121d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b3121d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_done global_id 164217 payload 274 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 -- 10.20.193.51:0/3617195616 >> v2:10.20.193.142:3300/0 conn(0x7f9b2c13b760 msgr2=0x7f9b2c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:48.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 --2- 10.20.193.51:0/3617195616 >> v2:10.20.193.142:3300/0 conn(0x7f9b2c13b760 0x7f9b2c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 -- 10.20.193.51:0/3617195616 >> v1:10.20.193.142:6789/0 conn(0x7f9b2c0a0750 legacy=0x7f9b2c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient: _finish_hunting 0 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 monclient: found mon.noname-a 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:48.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.879+0000 7f9b30a1c640 1 -- 10.20.193.51:0/3617195616 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c09eec0 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b30a1c640 1 -- 10.20.193.51:0/3617195616 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a3bb0 msgr2=0x7f9b2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b30a1c640 1 --2- 10.20.193.51:0/3617195616 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c09f5f0 tx=0x7f9b1c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d94b457a545896f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 1 -- 10.20.193.51:0/3617195616 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c03c070 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 10 monclient: dump: 2026-02-17T11:58:48.894 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b237fe640 1 -- 10.20.193.51:0/3617195616 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c02fca0 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b32ca7640 5 monclient: authenticate success, global_id 164217 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.881+0000 7f9b32ca7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b237fe640 1 -- 10.20.193.51:0/3617195616 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c037660 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 4 set_mon_vals no callback set 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b237fe640 10 monclient: dump: 2026-02-17T11:58:48.896 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 10 monclient: shutdown 2026-02-17T11:58:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 -- 10.20.193.51:0/3617195616 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a3bb0 msgr2=0x7f9b2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/3617195616 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c09f5f0 tx=0x7f9b1c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 -- 10.20.193.51:0/3617195616 shutdown_connections 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/3617195616 >> v2:10.20.193.142:3300/0 conn(0x7f9b2c13b760 0x7f9b2c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/3617195616 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c09dac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 -- 10.20.193.51:0/3617195616 >> 10.20.193.51:0/3617195616 conn(0x7f9b2c0a30c0 msgr2=0x7f9b2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 -- 10.20.193.51:0/3617195616 shutdown_connections 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 1 -- 10.20.193.51:0/3617195616 wait complete. 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 10 monclient: build_initial_monmap 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.882+0000 7f9b32ca7640 10 monclient: monmap: 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:48.898 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 Processor -- start 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 -- start start 2026-02-17T11:58:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient: init 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-a con 0x7f9b2c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-b con 0x7f9b2c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f9b2c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0a04b0 con 0x7f9b2c0a0750 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c09c850 con 0x7f9b2c0a3bb0 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c09e710 con 0x7f9b2c13b760 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b32ca7640 10 monclient(hunting): authenticate will time out at 1416.502366s 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58178/0 (socket says 10.20.193.51:58178) 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 -- 10.20.193.51:0/2692067877 learned_addr learned my addr 10.20.193.51:0/2692067877 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): get_auth_request con 0x7f9b2c0a0750 auth_method 0 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 10 monclient(hunting): get_auth_request con 0x7f9b2c13b760 auth_method 0 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b23fff640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b23fff640 10 monclient(hunting): get_auth_request con 0x7f9b2c0a3bb0 auth_method 0 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 msgr2=0x7f9b2c131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 msgr2=0x7f9b2c131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient(hunting): handle_auth_done global_id 164220 payload 824 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 msgr2=0x7f9b2c131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b3121d640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b2c0a3bb0 msgr2=0x7f9b2c1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient: _finish_hunting 0 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 monclient: found mon.noname-a 2026-02-17T11:58:48.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.883+0000 7f9b30a1c640 1 -- 10.20.193.51:0/2692067877 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c134d50 con 0x7f9b2c0a0750 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b30a1c640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 msgr2=0x7f9b2c1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b30a1c640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009a70 tx=0x7f9b1c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c047070 con 0x7f9b2c0a0750 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: dump: 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.904 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c02fe50 con 0x7f9b2c0a0750 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 5 monclient: authenticate success, global_id 164220 2026-02-17T11:58:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 10 monclient: _renew_subs 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c09d7b0 con 0x7f9b2c0a0750 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c03c040 con 0x7f9b2c0a0750 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b22ffd640 4 set_mon_vals no callback set 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b217fa640 10 monclient: dump: 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:48.906 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 10 monclient: _renew_subs 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.885+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c1d0550 con 0x7f9b2c0a0750 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b32ca7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b32ca7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b32ca7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c09dac0 con 0x7f9b2c0a0750 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9b1c03fa10 con 0x7f9b2c0a0750 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b217fa640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 0x7f9afc040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.886+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(473..473 src has 323..473) ==== 4843+0+0 (secure 0 0 0) 0x7f9b1c077430 con 0x7f9b2c0a0750 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.887+0000 7f9b23fff640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 0x7f9afc040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.887+0000 7f9b23fff640 10 monclient: get_auth_request con 0x7f9afc03dd60 auth_method 0 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.889+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9b1c035340 con 0x7f9b2c0a0750 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.889+0000 7f9b217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.889+0000 7f9b217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:48.889+0000 7f9b23fff640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 0x7f9afc040220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c134f60 tx=0x7f9b14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b32ca7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b32ca7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b32ca7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b2c0008d0 con 0x7f9b2c0a0750 2026-02-17T11:58:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b217fa640 1 -- 10.20.193.51:0/2692067877 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f9b1c03fde0 con 0x7f9b2c0a0750 2026-02-17T11:58:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.002+0000 7f9b217fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:49.006 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 msgr2=0x7f9afc040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 0x7f9afc040220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c134f60 tx=0x7f9b14009040 comp rx=0 tx=0).stop 2026-02-17T11:58:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 10 monclient: shutdown 2026-02-17T11:58:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 msgr2=0x7f9b2c1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009a70 tx=0x7f9b1c004830 comp rx=0 tx=0).stop 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 shutdown_connections 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9afc03dd60 0x7f9afc040220 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9b2c13b760 0x7f9b2c131010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9b2c0a3bb0 0x7f9b2c1d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 --2- 10.20.193.51:0/2692067877 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9b2c0a0750 0x7f9b2c1cfad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 >> 10.20.193.51:0/2692067877 conn(0x7f9b2c0a30c0 msgr2=0x7f9b2c13a210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 shutdown_connections 2026-02-17T11:58:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.003+0000 7f9b32ca7640 1 -- 10.20.193.51:0/2692067877 wait complete. 2026-02-17T11:58:49.013 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:58:49.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:58:49.013 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:58:49.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: get_monmap_and_config 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: monmap: 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:49.082163+0000 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:49.082163+0000 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.085 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 Processor -- start 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 -- start start 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: init 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T11:58:49.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc5140a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc5140a0750 0x7fc51409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-c con 0x7fc5140a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-b con 0x7fc51413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51406e140 con 0x7fc5140a3bb0 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc51409f910 con 0x7fc5140a0750 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc51409ccd0 con 0x7fc51413b760 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.081+0000 7fc51afb6640 10 monclient(hunting): authenticate will time out at 1416.700934s 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55334/0 (socket says 10.20.193.51:55334) 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 -- 10.20.193.51:0/3570425011 learned_addr learned my addr 10.20.193.51:0/3570425011 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 10 monclient(hunting): get_auth_request con 0x7fc51413b760 auth_method 0 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 -- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 msgr2=0x7fc51413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 -- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 msgr2=0x7fc51413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc51952c640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:49.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 1 --2- 10.20.193.51:0/3570425011 >> v2:10.20.193.142:3300/0 conn(0x7fc5140a0750 0x7fc51409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): get_auth_request con 0x7fc5140a0750 auth_method 0 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.082+0000 7fc50bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc518d2b640 1 -- 10.20.193.51:0/3570425011 >> v1:10.20.193.142:6789/0 conn(0x7fc5140a3bb0 legacy=0x7fc51409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 10 monclient(hunting): handle_auth_done global_id 114514 payload 274 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 1 -- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 msgr2=0x7fc51413db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 1 -- 10.20.193.51:0/3570425011 >> v1:10.20.193.142:6789/0 conn(0x7fc5140a3bb0 legacy=0x7fc51409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 1 monclient: found mon.noname-c 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.084+0000 7fc50bfff640 1 -- 10.20.193.51:0/3570425011 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51409eec0 con 0x7fc5140a0750 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50bfff640 1 -- 10.20.193.51:0/3570425011 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a0750 msgr2=0x7fc51409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50bfff640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a0750 0x7fc51409e1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009920 tx=0x7fc4fc02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d64232dbd100f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 1 -- 10.20.193.51:0/3570425011 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc03c070 con 0x7fc5140a0750 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: dump: 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 1 -- 10.20.193.51:0/3570425011 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc02fce0 con 0x7fc5140a0750 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 5 monclient: authenticate success, global_id 114514 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 1 -- 10.20.193.51:0/3570425011 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc037660 con 0x7fc5140a0750 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc50b7fe640 10 monclient: dump: 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.102 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 4 set_mon_vals no callback set 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 10 monclient: shutdown 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 -- 10.20.193.51:0/3570425011 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a0750 msgr2=0x7fc51409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a0750 0x7fc51409e1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009920 tx=0x7fc4fc02ee10 comp rx=0 tx=0).stop 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 -- 10.20.193.51:0/3570425011 shutdown_connections 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc51413b760 0x7fc51413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 --2- 10.20.193.51:0/3570425011 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a0750 0x7fc51409e1d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 -- 10.20.193.51:0/3570425011 >> 10.20.193.51:0/3570425011 conn(0x7fc5140a30c0 msgr2=0x7fc5140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 -- 10.20.193.51:0/3570425011 shutdown_connections 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.087+0000 7fc51afb6640 1 -- 10.20.193.51:0/3570425011 wait complete. 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient: monmap: 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.104 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 Processor -- start 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 -- start start 2026-02-17T11:58:49.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient: init 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-c con 0x7fc5140a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a3bb0 0x7fc514139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-b con 0x7fc5140a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 0x7fc514095400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): picked mon.noname-a con 0x7fc51413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140a04b0 con 0x7fc51413b760 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc51409c850 con 0x7fc5140a3bb0 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc51409e710 con 0x7fc5140a0750 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51afb6640 10 monclient(hunting): authenticate will time out at 1416.707682s 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 0x7fc514095400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55338/0 (socket says 10.20.193.51:55338) 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 learned_addr learned my addr 10.20.193.51:0/1021730260 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 10 monclient(hunting): get_auth_request con 0x7fc5140a0750 auth_method 0 2026-02-17T11:58:49.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): get_auth_request con 0x7fc51413b760 auth_method 0 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 msgr2=0x7fc514138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 msgr2=0x7fc514138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc50bfff640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a3bb0 0x7fc514139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc50bfff640 10 monclient(hunting): get_auth_request con 0x7fc5140a3bb0 auth_method 0 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient(hunting): handle_auth_done global_id 164223 payload 824 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 msgr2=0x7fc514138d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5140a0750 0x7fc514138d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a3bb0 msgr2=0x7fc514139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5140a3bb0 0x7fc514139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.088+0000 7fc51952c640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5140a2590 con 0x7fc51413b760 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51952c640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 msgr2=0x7fc514095400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51952c640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 0x7fc514095400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc510009fd0 tx=0x7fc510007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51001a070 con 0x7fc51413b760 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: dump: 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.110 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51000ddb0 con 0x7fc51413b760 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 5 monclient: authenticate success, global_id 164223 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 monclient: _renew_subs 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51409d7b0 con 0x7fc51413b760 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510015640 con 0x7fc51413b760 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc50affd640 4 set_mon_vals no callback set 2026-02-17T11:58:49.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 10 monclient: dump: 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 monclient: _renew_subs 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc514098ed0 con 0x7fc51413b760 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 0x7fc514095940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc51409dac0 con 0x7fc514096f00 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 0x7fc514095940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc510015820 con 0x7fc51413b760 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient: get_auth_request con 0x7fc514096f00 auth_method 0 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.091+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc518d2b640 10 monclient(hunting): handle_auth_done global_id 164226 payload 824 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc51406f7e0 con 0x7fc514096f00 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc5097fa640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 0x7fc4e40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(473..473 src has 323..473) ==== 4843+0+0 (secure 0 0 0) 0x7fc510052440 con 0x7fc51413b760 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 0x7fc4e40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 10 monclient: get_auth_request con 0x7fc4e403dd10 auth_method 0 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 msgr2=0x7fc4e40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T11:58:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 msgr2=0x7fc4e40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 0x7fc4e40401d0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fc51406c1c0 tx=0x7fc4fc033000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.092+0000 7fc50bfff640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 0x7fc4e40401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 msgr2=0x7fc514095940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 0x7fc514095940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc50400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504005ad0 con 0x7fc514096f00 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 10 monclient: dump: 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.116 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc504018070 con 0x7fc514096f00 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 msgr2=0x7fc514095940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 0x7fc514095940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc50400ebd0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 msgr2=0x7fc514095940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.094+0000 7fc5097fa640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514096f00 0x7fc514095940 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc50400ebd0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc51afb6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc51afb6640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 0x7fc5141daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc51afb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc514099210 con 0x7fc514095e80 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 0x7fc5141daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient: get_auth_request con 0x7fc514095e80 auth_method 0 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 10 monclient(hunting): handle_auth_done global_id 164229 payload 824 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.097+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5140008d0 con 0x7fc514095e80 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.099+0000 7fc518d2b640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 msgr2=0x7fc5141daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.099+0000 7fc518d2b640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 0x7fc5141daad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc5040026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5040070d0 con 0x7fc514095e80 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 10 monclient: dump: 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fc5040070d0 con 0x7fc514095e80 2026-02-17T11:58:49.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 msgr2=0x7fc5141daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 0x7fc5141daad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc5040026e0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 msgr2=0x7fc5141daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc5097fa640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc514095e80 0x7fc5141daad0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e700 tx=0x7fc5040026e0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:49.123 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 73538, 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.124 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.125 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:49.126 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.127 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.129 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.130 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.131 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.132 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:49.133 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:49.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 msgr2=0x7fc4e40401d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:49.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc4e403dd10 0x7fc4e40401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 10 monclient: shutdown 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 msgr2=0x7fc514095400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51952c640 1 -- 10.20.193.51:0/1021730260 reap_dead start 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 0x7fc514095400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc510009fd0 tx=0x7fc510007f00 comp rx=0 tx=0).stop 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 shutdown_connections 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 --2- 10.20.193.51:0/1021730260 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc51413b760 0x7fc514095400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 >> 10.20.193.51:0/1021730260 conn(0x7fc5140a30c0 msgr2=0x7fc51413ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 shutdown_connections 2026-02-17T11:58:49.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.100+0000 7fc51afb6640 1 -- 10.20.193.51:0/1021730260 wait complete. 2026-02-17T11:58:49.135 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:49.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:58:49.136 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:58:49.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: get_monmap_and_config 2026-02-17T11:58:49.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: monmap: 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:49.203187+0000 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:49.203187+0000 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 Processor -- start 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 -- start start 2026-02-17T11:58:49.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: init 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f054c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f054c09dac0 0x7f054c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-a con 0x7f054c09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f054c0a0110 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c06e140 con 0x7f054c0a3bb0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c09ce60 con 0x7f054c0a0110 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f054c09aed0 con 0x7f054c09dac0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.202+0000 7f0553d1c640 10 monclient(hunting): authenticate will time out at 1416.821945s 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551a91640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f054c0a3bb0 0x7f054c09f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60280/0 (socket says 10.20.193.51:60280) 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f054c09dac0 0x7f054c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551a91640 1 -- 10.20.193.51:0/4106611295 learned_addr learned my addr 10.20.193.51:0/4106611295 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): get_auth_request con 0x7f054c09dac0 auth_method 0 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient(hunting): handle_auth_done global_id 164232 payload 274 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 1 -- 10.20.193.51:0/4106611295 >> v1:10.20.193.142:6789/0 conn(0x7f054c0a0110 legacy=0x7f054c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 1 -- 10.20.193.51:0/4106611295 >> v1:10.20.193.51:6789/0 conn(0x7f054c0a3bb0 legacy=0x7f054c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.203+0000 7f0551290640 1 -- 10.20.193.51:0/4106611295 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c09a5c0 con 0x7f054c09dac0 2026-02-17T11:58:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0551290640 1 -- 10.20.193.51:0/4106611295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c09dac0 msgr2=0x7f054c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0551290640 1 --2- 10.20.193.51:0/4106611295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c09dac0 0x7f054c09fbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f054002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345111139b2ca319 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 1 -- 10.20.193.51:0/4106611295 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054003c070 con 0x7f054c09dac0 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: dump: 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 1 -- 10.20.193.51:0/4106611295 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054002fce0 con 0x7f054c09dac0 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 1 -- 10.20.193.51:0/4106611295 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540037660 con 0x7f054c09dac0 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0553d1c640 5 monclient: authenticate success, global_id 164232 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0553d1c640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0553d1c640 4 set_mon_vals no callback set 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.205+0000 7f0550a8f640 10 monclient: dump: 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.214 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 10 monclient: shutdown 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- 10.20.193.51:0/4106611295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c09dac0 msgr2=0x7f054c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 --2- 10.20.193.51:0/4106611295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c09dac0 0x7f054c09fbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f054002ed80 comp rx=0 tx=0).stop 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- 10.20.193.51:0/4106611295 shutdown_connections 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 --2- 10.20.193.51:0/4106611295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c09dac0 0x7f054c09fbd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- 10.20.193.51:0/4106611295 >> 10.20.193.51:0/4106611295 conn(0x7f054c0a30c0 msgr2=0x7f054c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- 10.20.193.51:0/4106611295 shutdown_connections 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- 10.20.193.51:0/4106611295 wait complete. 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 10 monclient: monmap: 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 Processor -- start 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 1 -- start start 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.206+0000 7f0553d1c640 10 monclient: init 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 0x7f054c1b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-c con 0x7f054c09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-a con 0x7f054c0a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f054c0a3bb0 0x7f054c1b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): picked mon.noname-b con 0x7f054c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0a3f90 con 0x7f054c0a0110 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f054c09caa0 con 0x7f054c0a3bb0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f054c0a0540 con 0x7f054c09dac0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0553d1c640 10 monclient(hunting): authenticate will time out at 1416.826308s 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58216/0 (socket says 10.20.193.51:58216) 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 -- 10.20.193.51:0/1333531034 learned_addr learned my addr 10.20.193.51:0/1333531034 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 0x7f054c1b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): get_auth_request con 0x7f054c0a0110 auth_method 0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 10 monclient(hunting): get_auth_request con 0x7f054c09dac0 auth_method 0 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 msgr2=0x7f054c1b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 msgr2=0x7f054c1b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 0x7f054c1b8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 0x7f054c1b8930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0552292640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f054c0a3bb0 0x7f054c1b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient(hunting): handle_auth_done global_id 164235 payload 824 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 msgr2=0x7f054c1b8930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c09dac0 0x7f054c1b8930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f054c0a3bb0 msgr2=0x7f054c1b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f054c0a3bb0 0x7f054c1b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0551290640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c1bc8c0 con 0x7f054c0a0110 2026-02-17T11:58:49.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0552292640 10 monclient: get_auth_request con 0x7f054c0a3bb0 auth_method 0 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.207+0000 7f0552292640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f054c0a3bb0 0x7f054c1b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0551290640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 msgr2=0x7f054c1b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0551290640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f05400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540046070 con 0x7f054c0a0110 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: dump: 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540041870 con 0x7f054c0a0110 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054003c040 con 0x7f054c0a0110 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053a7fc640 10 monclient: dump: 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f053bfff640 4 set_mon_vals no callback set 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 5 monclient: authenticate success, global_id 164235 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 10 monclient: _renew_subs 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c09d7b0 con 0x7f054c0a0110 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 10 monclient: _renew_subs 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.209+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1bc300 con 0x7f054c0a0110 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0553d1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0553d1c640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f054c09e570 con 0x7f054c072430 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0540041c60 con 0x7f054c0a0110 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 10 monclient: get_auth_request con 0x7f054c072430 auth_method 0 2026-02-17T11:58:49.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 msgr2=0x7f054c072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 msgr2=0x7f054c072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f053a7fc640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f051c03dd10 0x7f051c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(473..473 src has 323..473) ==== 4843+0+0 (secure 0 0 0) 0x7f0540077ec0 con 0x7f054c0a0110 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0552292640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f051c03dd10 0x7f051c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.210+0000 7f0552292640 10 monclient: get_auth_request con 0x7f051c03dd10 auth_method 0 2026-02-17T11:58:49.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.213+0000 7f0552292640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f051c03dd10 0x7f051c0401d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f054c1bcdb0 tx=0x7f0548009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient: get_auth_request con 0x7f054c072430 auth_method 0 2026-02-17T11:58:49.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 10 monclient(hunting): handle_auth_done global_id 174101 payload 824 2026-02-17T11:58:49.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.411+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f054c1bb470 con 0x7f054c072430 2026-02-17T11:58:49.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 msgr2=0x7f054c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c0107e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c018030 con 0x7f054c072430 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 10 monclient: dump: 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.416 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f053c014820 con 0x7f054c072430 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 msgr2=0x7f054c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c0107e0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 msgr2=0x7f054c072810 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.413+0000 7f053a7fc640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072430 0x7f054c072810 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c0107e0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0553d1c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0553d1c640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 0x7f054c1d9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0553d1c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f054c1ba5d0 con 0x7f054c072d50 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 0x7f054c1d9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient: get_auth_request con 0x7f054c072d50 auth_method 0 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 10 monclient(hunting): handle_auth_done global_id 174104 payload 824 2026-02-17T11:58:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.417+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f054c0008d0 con 0x7f054c072d50 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f0551a91640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 msgr2=0x7f054c1d9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f0551a91640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 0x7f054c1d9640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c003030 con 0x7f054c072d50 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 10 monclient: dump: 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.422 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f053c01c8d0 con 0x7f054c072d50 2026-02-17T11:58:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 msgr2=0x7f054c1d9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 0x7f054c1d9640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c007d20 comp rx=0 tx=0).stop 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 msgr2=0x7f054c1d9640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.419+0000 7f053a7fc640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f054c072d50 0x7f054c1d9640 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f053c007fd0 tx=0x7f053c007d20 comp rx=0 tx=0).stop 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:49.424 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10185, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:58:49.425 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.426 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.427 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:49.428 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.429 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.430 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:49.431 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.432 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.433 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.434 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.435 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.436 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.437 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:49.438 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:49.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f051c03dd10 msgr2=0x7f051c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f051c03dd10 0x7f051c0401d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f054c1bcdb0 tx=0x7f0548009040 comp rx=0 tx=0).stop 2026-02-17T11:58:49.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 10 monclient: shutdown 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 msgr2=0x7f054c1b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f05400047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0552292640 1 -- 10.20.193.51:0/1333531034 reap_dead start 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 shutdown_connections 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 --2- 10.20.193.51:0/1333531034 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f054c0a0110 0x7f054c1b8e70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 >> 10.20.193.51:0/1333531034 conn(0x7f054c0a30c0 msgr2=0x7f054c09e780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 shutdown_connections 2026-02-17T11:58:49.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.420+0000 7f0553d1c640 1 -- 10.20.193.51:0/1333531034 wait complete. 2026-02-17T11:58:49.442 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:49.442 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:58:49.442 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:58:49.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 10 monclient: get_monmap_and_config 2026-02-17T11:58:49.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 10 monclient: monmap: 2026-02-17T11:58:49.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:49.508478+0000 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:49.508478+0000 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:49.513 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 1 Processor -- start 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 1 -- start start 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.507+0000 7f6dae44d640 10 monclient: init 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-b con 0x7f6da80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6da809dac0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:49.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6da80a0110 0x7f6da813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-a con 0x7f6da80a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da806e140 con 0x7f6da809dac0 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6da809aed0 con 0x7f6da80a0110 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6da809caa0 con 0x7f6da80a3bb0 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dae44d640 10 monclient(hunting): authenticate will time out at 1417.127213s 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6da80a0110 0x7f6da813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55368/0 (socket says 10.20.193.51:55368) 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 -- 10.20.193.51:0/526826001 learned_addr learned my addr 10.20.193.51:0/526826001 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): get_auth_request con 0x7f6da80a3bb0 auth_method 0 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): get_auth_request con 0x7f6da80a0110 auth_method 0 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient(hunting): handle_auth_done global_id 174107 payload 274 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 -- 10.20.193.51:0/526826001 >> v2:10.20.193.51:3300/0 conn(0x7f6da80a0110 msgr2=0x7f6da813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 --2- 10.20.193.51:0/526826001 >> v2:10.20.193.51:3300/0 conn(0x7f6da80a0110 0x7f6da813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 -- 10.20.193.51:0/526826001 >> v1:10.20.193.142:6789/0 conn(0x7f6da809dac0 legacy=0x7f6da809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 monclient: found mon.noname-b 2026-02-17T11:58:49.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:49.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.508+0000 7f6da7fff640 1 -- 10.20.193.51:0/526826001 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da809ce60 con 0x7f6da80a3bb0 2026-02-17T11:58:49.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da7fff640 1 -- 10.20.193.51:0/526826001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 msgr2=0x7f6da809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da7fff640 1 --2- 10.20.193.51:0/526826001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6da806dc20 tx=0x7f6d9402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f354d072bf89b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 1 -- 10.20.193.51:0/526826001 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9403c070 con 0x7f6da80a3bb0 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: dump: 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.528 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 1 -- 10.20.193.51:0/526826001 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9402fd50 con 0x7f6da80a3bb0 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 5 monclient: authenticate success, global_id 174107 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 1 -- 10.20.193.51:0/526826001 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94037660 con 0x7f6da80a3bb0 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6da6ffd640 10 monclient: dump: 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.530 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 4 set_mon_vals no callback set 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 10 monclient: shutdown 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 -- 10.20.193.51:0/526826001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 msgr2=0x7f6da809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 --2- 10.20.193.51:0/526826001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6da806dc20 tx=0x7f6d9402eed0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 -- 10.20.193.51:0/526826001 shutdown_connections 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 --2- 10.20.193.51:0/526826001 >> v2:10.20.193.51:3300/0 conn(0x7f6da80a0110 0x7f6da813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 --2- 10.20.193.51:0/526826001 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da809f4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 -- 10.20.193.51:0/526826001 >> 10.20.193.51:0/526826001 conn(0x7f6da80a30c0 msgr2=0x7f6da80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 -- 10.20.193.51:0/526826001 shutdown_connections 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.511+0000 7f6dae44d640 1 -- 10.20.193.51:0/526826001 wait complete. 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient: monmap: 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:49.532 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 Processor -- start 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 -- start start 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient: init 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-a con 0x7f6da809dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da80a0110 0x7f6da806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-b con 0x7f6da80a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): picked mon.noname-c con 0x7f6da80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6da809a880 con 0x7f6da809dac0 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6da80a0520 con 0x7f6da80a0110 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6da813cca0 con 0x7f6da80a3bb0 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dae44d640 10 monclient(hunting): authenticate will time out at 1417.131623s 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58256/0 (socket says 10.20.193.51:58256) 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 -- 10.20.193.51:0/1765227976 learned_addr learned my addr 10.20.193.51:0/1765227976 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): get_auth_request con 0x7f6da809dac0 auth_method 0 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): get_auth_request con 0x7f6da80a3bb0 auth_method 0 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient(hunting): handle_auth_done global_id 164241 payload 824 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 msgr2=0x7f6da806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da806fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da80a0110 msgr2=0x7f6da806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da80a0110 0x7f6da806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6da7fff640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da8071270 con 0x7f6da809dac0 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.512+0000 7f6dac9c3640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6da80a3bb0 0x7f6da806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.514+0000 7f6da7fff640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 msgr2=0x7f6da806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da7fff640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d94002410 tx=0x7f6d94004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9403c040 con 0x7f6da809dac0 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: dump: 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.538 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d94047070 con 0x7f6da809dac0 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 5 monclient: authenticate success, global_id 164241 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 monclient: _renew_subs 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da8070df0 con 0x7f6da809dac0 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94042690 con 0x7f6da809dac0 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da67fc640 4 set_mon_vals no callback set 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 10 monclient: dump: 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.540 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 monclient: _renew_subs 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81312f0 con 0x7f6da809dac0 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 0x7f6da81cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6da80a3fc0 con 0x7f6da81314c0 2026-02-17T11:58:49.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da77fe640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 0x7f6da81cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6d94042870 con 0x7f6da809dac0 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da77fe640 10 monclient: get_auth_request con 0x7f6da81314c0 auth_method 0 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.515+0000 7f6da77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da4ff9640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6d7803dd10 0x7f6d780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(473..473 src has 323..473) ==== 4843+0+0 (secure 0 0 0) 0x7f6d94077890 con 0x7f6da809dac0 2026-02-17T11:58:49.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da77fe640 10 monclient(hunting): handle_auth_done global_id 114520 payload 824 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6da77fe640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6da809f4c0 con 0x7f6da81314c0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6dac9c3640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6d7803dd10 0x7f6d780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.516+0000 7f6dac9c3640 10 monclient: get_auth_request con 0x7f6d7803dd10 auth_method 0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da77fe640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 msgr2=0x7f6da81cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da77fe640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 0x7f6da81cf160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d9800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98011a80 con 0x7f6da81314c0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6da4ff9640 10 monclient: dump: 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.543 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.518+0000 7f6dac9c3640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6d7803dd10 0x7f6d780401d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6da80a2b90 tx=0x7f6d9c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6d98017070 con 0x7f6da81314c0 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:49.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 msgr2=0x7f6da81cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 0x7f6da81cf160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d9800c800 comp rx=0 tx=0).stop 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 msgr2=0x7f6da81cf160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.519+0000 7f6da4ff9640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81314c0 0x7f6da81cf160 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d9800c800 comp rx=0 tx=0).stop 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6dae44d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6dae44d640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 0x7f6da81da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6dae44d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6da80008d0 con 0x7f6da81cf6a0 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 0x7f6da81da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient: get_auth_request con 0x7f6da81cf6a0 auth_method 0 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 10 monclient(hunting): handle_auth_done global_id 114523 payload 824 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.522+0000 7f6da77fe640 1 -- 10.20.193.51:0/1765227976 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6da8050ac0 con 0x7f6da81cf6a0 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.524+0000 7f6da77fe640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 msgr2=0x7f6da81da4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da77fe640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 0x7f6da81da4b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d98003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9801caf0 con 0x7f6da81cf6a0 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 10 monclient: dump: 2026-02-17T11:58:49.546 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f6d9801caf0 con 0x7f6da81cf6a0 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:49.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 msgr2=0x7f6da81da4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 0x7f6da81da4b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d98003860 comp rx=0 tx=0).stop 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 msgr2=0x7f6da81da4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6da4ff9640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6da81cf6a0 0x7f6da81da4b0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cd00 tx=0x7f6d98003860 comp rx=0 tx=0).stop 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:49.548 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 331400, 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.549 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.550 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:49.551 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:49.552 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.553 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.554 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.555 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:49.556 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.557 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:49.558 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:49.559 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6d7803dd10 msgr2=0x7f6d780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6d7803dd10 0x7f6d780401d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6da80a2b90 tx=0x7f6d9c00b040 comp rx=0 tx=0).stop 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 10 monclient: shutdown 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 msgr2=0x7f6da806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d94002410 tx=0x7f6d94004830 comp rx=0 tx=0).stop 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dac9c3640 1 -- 10.20.193.51:0/1765227976 reap_dead start 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 shutdown_connections 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 --2- 10.20.193.51:0/1765227976 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6da809dac0 0x7f6da806f410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 >> 10.20.193.51:0/1765227976 conn(0x7f6da80a30c0 msgr2=0x7f6da809e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 shutdown_connections 2026-02-17T11:58:49.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.525+0000 7f6dae44d640 1 -- 10.20.193.51:0/1765227976 wait complete. 2026-02-17T11:58:49.561 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:49.561 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:58:49.561 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.625+0000 7fa12fa32640 10 monclient: get_monmap_and_config 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.625+0000 7fa12fa32640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.625+0000 7fa12fa32640 10 monclient: monmap: 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:49.626924+0000 2026-02-17T11:58:49.629 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:49.626924+0000 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 Processor -- start 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 -- start start 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient: init 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa1280a3bb0 0x7fa12809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-a con 0x7fa1280a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa1280a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa12813b760 0x7fa12813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-b con 0x7fa12813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12806e140 con 0x7fa1280a0750 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa12809f910 con 0x7fa1280a3bb0 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa12809ccd0 con 0x7fa12813b760 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12fa32640 10 monclient(hunting): authenticate will time out at 1417.245667s 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa1280a3bb0 0x7fa12809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa12813b760 0x7fa12813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12cfa6640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa1280a0750 0x7fa12809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60292/0 (socket says 10.20.193.51:60292) 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12cfa6640 1 -- 10.20.193.51:0/3448107924 learned_addr learned my addr 10.20.193.51:0/3448107924 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): get_auth_request con 0x7fa1280a3bb0 auth_method 0 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): get_auth_request con 0x7fa12813b760 auth_method 0 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_done global_id 164244 payload 274 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 -- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa12813b760 msgr2=0x7fa12813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 --2- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa12813b760 0x7fa12813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 -- 10.20.193.51:0/3448107924 >> v1:10.20.193.51:6789/0 conn(0x7fa1280a0750 legacy=0x7fa12809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.626+0000 7fa12d7a7640 1 -- 10.20.193.51:0/3448107924 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12809eec0 con 0x7fa1280a3bb0 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12d7a7640 1 -- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa1280a3bb0 msgr2=0x7fa12809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12d7a7640 1 --2- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa1280a3bb0 0x7fa12809dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa12806c1c0 tx=0x7fa11802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb08f6da46ec49c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 1 -- 10.20.193.51:0/3448107924 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11803c070 con 0x7fa1280a3bb0 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: dump: 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.636 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 1 -- 10.20.193.51:0/3448107924 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11802fbd0 con 0x7fa1280a3bb0 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 1 -- 10.20.193.51:0/3448107924 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118037440 con 0x7fa1280a3bb0 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa117fff640 10 monclient: dump: 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.637 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 5 monclient: authenticate success, global_id 164244 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 4 set_mon_vals no callback set 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 10 monclient: shutdown 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 -- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa1280a3bb0 msgr2=0x7fa12809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 --2- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa1280a3bb0 0x7fa12809dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa12806c1c0 tx=0x7fa11802ed50 comp rx=0 tx=0).stop 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 -- 10.20.193.51:0/3448107924 shutdown_connections 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 --2- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa12813b760 0x7fa12813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 --2- 10.20.193.51:0/3448107924 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa1280a3bb0 0x7fa12809dac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 -- 10.20.193.51:0/3448107924 >> 10.20.193.51:0/3448107924 conn(0x7fa1280a30c0 msgr2=0x7fa1280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 -- 10.20.193.51:0/3448107924 shutdown_connections 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.629+0000 7fa12fa32640 1 -- 10.20.193.51:0/3448107924 wait complete. 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient: build_initial_monmap 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient: monmap: 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 Processor -- start 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 -- start start 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient: init 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 0x7fa1281cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-c con 0x7fa1280a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1280a3bb0 0x7fa1281d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-b con 0x7fa1280a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): picked mon.noname-a con 0x7fa12813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280a04b0 con 0x7fa12813b760 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa12809c850 con 0x7fa1280a3bb0 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa12809e710 con 0x7fa1280a0750 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12fa32640 10 monclient(hunting): authenticate will time out at 1417.249782s 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 0x7fa1281cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58278/0 (socket says 10.20.193.51:58278) 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 -- 10.20.193.51:0/1310933923 learned_addr learned my addr 10.20.193.51:0/1310933923 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): get_auth_request con 0x7fa12813b760 auth_method 0 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): get_auth_request con 0x7fa1280a0750 auth_method 0 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient(hunting): handle_auth_done global_id 164247 payload 824 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 -- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 msgr2=0x7fa1281cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 0x7fa1281cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 -- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1280a3bb0 msgr2=0x7fa1281d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1280a3bb0 0x7fa1281d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient: _finish_hunting 0 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 monclient: found mon.noname-a 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:49.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12dfa8640 1 -- 10.20.193.51:0/1310933923 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12809d7b0 con 0x7fa12813b760 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.630+0000 7fa12d7a7640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 0x7fa1281cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12dfa8640 1 -- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 msgr2=0x7fa128094e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12dfa8640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa12400efc0 tx=0x7fa12400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124018020 con 0x7fa12813b760 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: dump: 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:49.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa124014480 con 0x7fa12813b760 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 5 monclient: authenticate success, global_id 164247 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124014870 con 0x7fa12813b760 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 10 monclient: dump: 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa1177fe640 4 set_mon_vals no callback set 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _renew_subs 2026-02-17T11:58:49.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa128098760 con 0x7fa12813b760 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _renew_subs 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12809c530 con 0x7fa12813b760 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa124014a10 con 0x7fa12813b760 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.633+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1280a2400 con 0x7fa12813b760 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.634+0000 7fa115ffb640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 0x7fa0f80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.634+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(473..473 src has 323..473) ==== 4843+0+0 (secure 0 0 0) 0x7fa124053720 con 0x7fa12813b760 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.634+0000 7fa12d7a7640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 0x7fa0f80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:49.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.634+0000 7fa12d7a7640 10 monclient: get_auth_request con 0x7fa0f803dd10 auth_method 0 2026-02-17T11:58:49.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.636+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa124022030 con 0x7fa12813b760 2026-02-17T11:58:49.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.636+0000 7fa115ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:49.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.636+0000 7fa115ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:49.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.636+0000 7fa12d7a7640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 0x7fa0f80401d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa12806f3c0 tx=0x7fa118033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:49.684 INFO:tasks.rados.rados.0.trial142.stdout:2057: done (1 left) 2026-02-17T11:58:49.684 INFO:tasks.rados.rados.0.trial142.stdout:2058: snap_remove snap 222 2026-02-17T11:58:49.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa12fa32640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:58:49.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa12fa32640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:58:49.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa12fa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:49.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa12809dac0 con 0x7fa12813b760 2026-02-17T11:58:49.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa115ffb640 1 -- 10.20.193.51:0/1310933923 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa12809d7b0 con 0x7fa12813b760 2026-02-17T11:58:49.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa115ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:58:49.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.750+0000 7fa115ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=10,kv=12,logm=50} crc {auth=1676174245,config=692619927,health=4177358965,kv=643764953,logm=2773714730}) 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=12,kv=11,logm=52} crc {auth=779812040,config=692619927,health=2510573225,kv=1957464524,logm=4286325975}) 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=10,kv=12,logm=50} crc {auth=1676174245,config=692619927,health=4177358965,kv=643764953,logm=2773714730}) 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.750+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=11,kv=12,logm=50} crc {auth=1348607911,config=692619927,health=3686469583,kv=643764953,logm=3878130194}) 2026-02-17T11:58:49.754 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.755 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697269348}) 2026-02-17T11:58:49.755 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=98546578}) 2026-02-17T11:58:49.755 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.755 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697269348}) 2026-02-17T11:58:49.755 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.751+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=736282324}) 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 msgr2=0x7fa0f80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 0x7fa0f80401d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa12806f3c0 tx=0x7fa118033000 comp rx=0 tx=0).stop 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 10 monclient: shutdown 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 msgr2=0x7fa128094e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:49.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa12400efc0 tx=0x7fa12400c490 comp rx=0 tx=0).stop 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 shutdown_connections 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa0f803dd10 0x7fa0f80401d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa12813b760 0x7fa128094e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1280a3bb0 0x7fa1281d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 --2- 10.20.193.51:0/1310933923 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1280a0750 0x7fa1281cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 >> 10.20.193.51:0/1310933923 conn(0x7fa1280a30c0 msgr2=0x7fa12813acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 shutdown_connections 2026-02-17T11:58:49.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:49.751+0000 7fa12fa32640 1 -- 10.20.193.51:0/1310933923 wait complete. 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2840488398}) 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1996048122}) 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2840488398}) 2026-02-17T11:58:49.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3791476167}) 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105180388}) 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.758+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2517855129}) 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105180388}) 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=746837400}) 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.762 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2797009106}) 2026-02-17T11:58:49.763 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3020531182}) 2026-02-17T11:58:49.763 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.763 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2797009106}) 2026-02-17T11:58:49.763 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1883901847}) 2026-02-17T11:58:49.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:58:49.773 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.773 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2515760932}) 2026-02-17T11:58:49.773 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1810453913}) 2026-02-17T11:58:49.773 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2515760932}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.759+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2220519851}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=399772370}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=370980320}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=399772370}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=836454532}) 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.774 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2885640636}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=908387187}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2885640636}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.760+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1408285967}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=301841076}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1274911135}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=301841076}) 2026-02-17T11:58:49.775 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2606873668}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2395889454}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1712172549}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2395889454}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.761+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3225838813}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218486963}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2274055708}) 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.776 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218486963}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1970717190}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=333516980}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=487326327}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=333516980}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968731878}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=787059784}) 2026-02-17T11:58:49.777 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1430543679}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=787059784}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.762+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1953041149}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3938682084}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1652760038}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3938682084}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3623459838}) 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.778 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=815911817}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1892406799}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=815911817}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.763+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2259778452}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=241631130}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1105603106}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=241631130}) 2026-02-17T11:58:49.779 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3829696595}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995168981}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1924339547}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995168981}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.764+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2535827606}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3705890685}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1089391177}) 2026-02-17T11:58:49.780 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3705890685}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4256223657}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995475302}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1300957912}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995475302}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3313608549}) 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.781 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089317136}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3646785592}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089317136}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.765+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3642179376}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030752144}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=176134637}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030752144}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3746270679}) 2026-02-17T11:58:49.782 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032975743}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=9398369}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032975743}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.766+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2369285118}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945736739}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2036062414}) 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.783 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945736739}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1736271894}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3063764970}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1584069531}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3063764970}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.767+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2335115652}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3878225871}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1369171400}) 2026-02-17T11:58:49.784 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3878225871}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=582632934}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=731159747}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4286260317}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=731159747}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2945459020}) 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.785 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.768+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=13792415}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3304355346}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=13792415}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2569020841}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=89898304}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3069929298}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=89898304}) 2026-02-17T11:58:49.786 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3471517096}) 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2988031935}) 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1015979778}) 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2988031935}) 2026-02-17T11:58:49.787 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:49.769+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1040055011}) 2026-02-17T11:58:50.218 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.218 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2045873735}) 2026-02-17T11:58:50.219 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3499467792}) 2026-02-17T11:58:50.219 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.219 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2045873735}) 2026-02-17T11:58:50.219 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.216+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3047223462}) 2026-02-17T11:58:50.336 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.336 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652579334}) 2026-02-17T11:58:50.336 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1244119155}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652579334}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=436608040}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=847067317}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3275447167}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=847067317}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.333+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3228119916}) 2026-02-17T11:58:50.337 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826790318}) 2026-02-17T11:58:50.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1161193702}) 2026-02-17T11:58:50.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826790318}) 2026-02-17T11:58:50.338 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.334+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3904698826}) 2026-02-17T11:58:50.343 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.344 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3278636529}) 2026-02-17T11:58:50.344 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1052102224}) 2026-02-17T11:58:50.344 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.344 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3278636529}) 2026-02-17T11:58:50.344 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.341+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3372833465}) 2026-02-17T11:58:50.351 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.351 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132042351}) 2026-02-17T11:58:50.351 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1094058633}) 2026-02-17T11:58:50.351 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.352 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132042351}) 2026-02-17T11:58:50.352 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.349+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1458790781}) 2026-02-17T11:58:50.546 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.546 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1015702167}) 2026-02-17T11:58:50.546 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3992148111}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1015702167}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2490789756}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180490116}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=763146304}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180490116}) 2026-02-17T11:58:50.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.537+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4243782335}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587827430}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1540038064}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587827430}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=139519756}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1410850311}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=140203840}) 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1410850311}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1712332080}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2351245566}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.538+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1754143443}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2351245566}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=832694186}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145384293}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3680201193}) 2026-02-17T11:58:50.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145384293}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1061070642}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2276871200}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4122959358}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2276871200}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.539+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2023820704}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=301923919}) 2026-02-17T11:58:50.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=930357621}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=301923919}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3138802840}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2098466213}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2591765606}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2098466213}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2287518760}) 2026-02-17T11:58:50.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2906193283}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2705961202}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2906193283}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.540+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=115524272}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785776813}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=311340643}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785776813}) 2026-02-17T11:58:50.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4030821952}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086835587}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4099846731}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086835587}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3339899909}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100841809}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1669537021}) 2026-02-17T11:58:50.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100841809}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.541+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2054635337}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=97,mdsmap=2,mgr=1} crc {logm=1797979587,mdsmap=1949618592,mgr=4133961934}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=89,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1} crc {logm=3333794490,mdsmap=1792248956,mgr=1921119086,mgr_command_descs=1238205435,mgr_metadata=3312392843}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=97,mdsmap=2,mgr=1} crc {logm=1797979587,mdsmap=1949618592,mgr=4133961934}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.542+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=89,mdsmap=2,mgr=8,mgr_command_descs=1} crc {logm=1814755333,mdsmap=1949618592,mgr=2354395410,mgr_command_descs=1238205435}) 2026-02-17T11:58:50.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=59} crc {mgr=2645453887,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2056753466,mon_config_key=1638176859,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1038009913,osd_snap=2882703355}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=59} crc {mgr=2645453887,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2056753466,mon_config_key=3390328712,monmap=263989209,osd_metadata=3812721542,osd_pg_creating=1038009913,osd_snap=1817699764}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=59} crc {mgr=2645453887,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2056753466,mon_config_key=1638176859,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1038009913,osd_snap=2882703355}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr=2645453887,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=4000642502,mon_config_key=2821023693,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=1038009913,osd_snap=1686662120}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=20,osdmap=80} crc {osd_snap=1456597381,osdmap=2795903087}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=19,osdmap=81} crc {osd_snap=3185737917,osdmap=1140992418}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=20,osdmap=80} crc {osd_snap=1456597381,osdmap=2795903087}) 2026-02-17T11:58:50.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=20,osdmap=80} crc {osd_snap=1456597381,osdmap=2321526254}) 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3679852270}) 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3477461550}) 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3679852270}) 2026-02-17T11:58:50.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.543+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=746717518}) 2026-02-17T11:58:50.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=51} crc {osdmap=829880487}) 2026-02-17T11:58:50.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=52} crc {osdmap=3313494114}) 2026-02-17T11:58:50.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:58:50.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=51} crc {osdmap=829880487}) 2026-02-17T11:58:50.558 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:58:50.546+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=54} crc {osdmap=1401169760}) 2026-02-17T11:58:50.574 INFO:tasks.rados.rados.0.trial142.stdout:2058: done (1 left) 2026-02-17T11:58:50.574 INFO:tasks.rados.rados.0.trial142.stdout:2059: snap_remove snap 200 2026-02-17T11:58:50.764 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:58:50.764 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 10 monclient: get_monmap_and_config 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 10 monclient: build_initial_monmap 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 10 monclient: monmap: 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:50.830491+0000 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:50.830491+0000 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:50.831 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 1 Processor -- start 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 1 -- start start 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.829+0000 7fc1802f3640 10 monclient: init 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1780a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc1780a0750 0x7fc17809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-c con 0x7fc1780a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc17813b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17806e140 con 0x7fc1780a3bb0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17809f910 con 0x7fc17813b760 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc17809ccd0 con 0x7fc1780a0750 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc1802f3640 10 monclient(hunting): authenticate will time out at 1418.449265s 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17e068640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc1780a3bb0 0x7fc17809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60306/0 (socket says 10.20.193.51:60306) 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17e068640 1 -- 10.20.193.51:0/1546295020 learned_addr learned my addr 10.20.193.51:0/1546295020 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 1 --2- 10.20.193.51:0/1546295020 >> v2:10.20.193.142:3300/0 conn(0x7fc1780a0750 0x7fc17809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): get_auth_request con 0x7fc1780a0750 auth_method 0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient(hunting): handle_auth_done global_id 114526 payload 274 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 1 -- 10.20.193.51:0/1546295020 >> v1:10.20.193.142:6789/0 conn(0x7fc17813b760 legacy=0x7fc17813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 1 -- 10.20.193.51:0/1546295020 >> v1:10.20.193.51:6789/0 conn(0x7fc1780a3bb0 legacy=0x7fc17809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient: _finish_hunting 0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 1 monclient: found mon.noname-c 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:58:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.830+0000 7fc17d867640 1 -- 10.20.193.51:0/1546295020 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17809eec0 con 0x7fc1780a0750 2026-02-17T11:58:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d867640 1 -- 10.20.193.51:0/1546295020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1780a0750 msgr2=0x7fc17809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d867640 1 --2- 10.20.193.51:0/1546295020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1780a0750 0x7fc17809e1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098a0 tx=0x7fc16c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb6e872e5d23401a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 1 -- 10.20.193.51:0/1546295020 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c03c070 con 0x7fc1780a0750 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: dump: 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.835 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: _finish_auth 0 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: _check_auth_tickets 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 5 monclient: authenticate success, global_id 114526 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 1 -- 10.20.193.51:0/1546295020 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c02fce0 con 0x7fc1780a0750 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 1 -- 10.20.193.51:0/1546295020 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c037660 con 0x7fc1780a0750 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 4 set_mon_vals no callback set 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc17d066640 10 monclient: dump: 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 10 monclient: shutdown 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:50.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 -- 10.20.193.51:0/1546295020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1780a0750 msgr2=0x7fc17809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 --2- 10.20.193.51:0/1546295020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1780a0750 0x7fc17809e1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098a0 tx=0x7fc16c02ed80 comp rx=0 tx=0).stop 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 -- 10.20.193.51:0/1546295020 shutdown_connections 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 --2- 10.20.193.51:0/1546295020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc1780a0750 0x7fc17809e1d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 -- 10.20.193.51:0/1546295020 >> 10.20.193.51:0/1546295020 conn(0x7fc1780a30c0 msgr2=0x7fc1780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 -- 10.20.193.51:0/1546295020 shutdown_connections 2026-02-17T11:58:50.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.833+0000 7fc1802f3640 1 -- 10.20.193.51:0/1546295020 wait complete. 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient: build_initial_monmap 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient: monmap: 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 Processor -- start 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 -- start start 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient: init 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:50.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-a con 0x7fc1780a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1780a3bb0 0x7fc1781cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-c con 0x7fc1780a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc17813b760 0x7fc1781ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): picked mon.noname-b con 0x7fc17813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc1780a04b0 con 0x7fc1780a0750 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc17809c850 con 0x7fc17813b760 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc17809e710 con 0x7fc1780a3bb0 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc1802f3640 10 monclient(hunting): authenticate will time out at 1418.453759s 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58300/0 (socket says 10.20.193.51:58300) 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 1 -- 10.20.193.51:0/4217787774 learned_addr learned my addr 10.20.193.51:0/4217787774 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): get_auth_request con 0x7fc1780a0750 auth_method 0 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1780a3bb0 0x7fc1781cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): get_auth_request con 0x7fc1780a3bb0 auth_method 0 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:50.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e869640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc17813b760 0x7fc1781ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17d867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e869640 10 monclient(hunting): get_auth_request con 0x7fc17813b760 auth_method 0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e869640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e869640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e869640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 10 monclient(hunting): handle_auth_done global_id 164250 payload 824 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 1 -- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1780a3bb0 msgr2=0x7fc1781cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.834+0000 7fc17e068640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1780a3bb0 0x7fc1781cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 1 -- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc17813b760 msgr2=0x7fc1781ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc17813b760 0x7fc1781ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 10 monclient: _finish_hunting 0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 1 monclient: found mon.noname-a 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.835+0000 7fc17e068640 1 -- 10.20.193.51:0/4217787774 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781301d0 con 0x7fc1780a0750 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc17e068640 1 -- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 msgr2=0x7fc1781cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc17e068640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c750 tx=0x7fc16800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168005de0 con 0x7fc1780a0750 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: dump: 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.841 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: _finish_auth 0 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 5 monclient: authenticate success, global_id 164250 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc168007070 con 0x7fc1780a0750 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _renew_subs 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1780a23c0 con 0x7fc1780a0750 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168007440 con 0x7fc1780a0750 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc17c865640 4 set_mon_vals no callback set 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc15effd640 10 monclient: dump: 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _renew_subs 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1780a2760 con 0x7fc1780a0750 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.837+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17809cac0 con 0x7fc1780a0750 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.838+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc168007620 con 0x7fc1780a0750 2026-02-17T11:58:50.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.838+0000 7fc15effd640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 0x7fc1480401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.838+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7fc168052450 con 0x7fc1780a0750 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.838+0000 7fc17d867640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 0x7fc1480401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.838+0000 7fc17d867640 10 monclient: get_auth_request con 0x7fc14803dd10 auth_method 0 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.840+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc17809cac0 con 0x7fc1780a0750 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.840+0000 7fc15effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.840+0000 7fc15effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:50.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.841+0000 7fc17d867640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 0x7fc1480401d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc16c036000 tx=0x7fc16c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.954+0000 7fc1802f3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.954+0000 7fc1802f3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.954+0000 7fc1802f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.954+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc17809d7b0 con 0x7fc1780a0750 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc15effd640 1 -- 10.20.193.51:0/4217787774 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fc1780a23c0 con 0x7fc1780a0750 2026-02-17T11:58:50.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc15effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:50.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc15effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:50.958 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:50.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 msgr2=0x7fc1480401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:50.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 0x7fc1480401d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc16c036000 tx=0x7fc16c033000 comp rx=0 tx=0).stop 2026-02-17T11:58:50.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 10 monclient: shutdown 2026-02-17T11:58:50.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:50.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 msgr2=0x7fc1781cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c750 tx=0x7fc16800cc20 comp rx=0 tx=0).stop 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 shutdown_connections 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc14803dd10 0x7fc1480401d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc17813b760 0x7fc1781ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc1780a3bb0 0x7fc1781cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 --2- 10.20.193.51:0/4217787774 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc1780a0750 0x7fc1781cd840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 >> 10.20.193.51:0/4217787774 conn(0x7fc1780a30c0 msgr2=0x7fc17813ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 shutdown_connections 2026-02-17T11:58:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:50.955+0000 7fc1802f3640 1 -- 10.20.193.51:0/4217787774 wait complete. 2026-02-17T11:58:50.965 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:58:50.965 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:58:50.965 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:58:50.965 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.032+0000 7fda705ce640 10 monclient: get_monmap_and_config 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.032+0000 7fda705ce640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.032+0000 7fda705ce640 10 monclient: monmap: 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:51.033830+0000 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:51.033830+0000 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:51.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 Processor -- start 2026-02-17T11:58:51.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 -- start start 2026-02-17T11:58:51.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient: init 2026-02-17T11:58:51.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fda680a3bb0 0x7fda6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-c con 0x7fda680a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fda680a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fda6813b760 0x7fda6813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-a con 0x7fda6813b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806e140 con 0x7fda680a0750 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fda6809f910 con 0x7fda6813b760 2026-02-17T11:58:51.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fda6809ccd0 con 0x7fda680a3bb0 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda705ce640 10 monclient(hunting): authenticate will time out at 1418.652613s 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fda6813b760 0x7fda6813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6db42640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fda680a0750 0x7fda6809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60318/0 (socket says 10.20.193.51:60318) 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6db42640 1 -- 10.20.193.51:0/1926992353 learned_addr learned my addr 10.20.193.51:0/1926992353 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): get_auth_request con 0x7fda6813b760 auth_method 0 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6e343640 1 --2- 10.20.193.51:0/1926992353 >> v2:10.20.193.142:3300/0 conn(0x7fda680a3bb0 0x7fda6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6e343640 10 monclient(hunting): get_auth_request con 0x7fda680a3bb0 auth_method 0 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6e343640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6e343640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6e343640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient(hunting): handle_auth_done global_id 164253 payload 274 2026-02-17T11:58:51.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 -- 10.20.193.51:0/1926992353 >> v2:10.20.193.142:3300/0 conn(0x7fda680a3bb0 msgr2=0x7fda6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 --2- 10.20.193.51:0/1926992353 >> v2:10.20.193.142:3300/0 conn(0x7fda680a3bb0 0x7fda6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 -- 10.20.193.51:0/1926992353 >> v1:10.20.193.51:6789/0 conn(0x7fda680a0750 legacy=0x7fda6809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 monclient: found mon.noname-a 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.033+0000 7fda6eb44640 1 -- 10.20.193.51:0/1926992353 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6809eec0 con 0x7fda6813b760 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6eb44640 1 -- 10.20.193.51:0/1926992353 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6813b760 msgr2=0x7fda6813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6eb44640 1 --2- 10.20.193.51:0/1926992353 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6813b760 0x7fda6813db50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda6806c1c0 tx=0x7fda6402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47483fa313741dd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 1 -- 10.20.193.51:0/1926992353 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6403c070 con 0x7fda6813b760 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: dump: 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.052 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 1 -- 10.20.193.51:0/1926992353 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64037440 con 0x7fda6813b760 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 1 -- 10.20.193.51:0/1926992353 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64037810 con 0x7fda6813b760 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 5 monclient: authenticate success, global_id 164253 2026-02-17T11:58:51.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 4 set_mon_vals no callback set 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda6d341640 10 monclient: dump: 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.054 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 10 monclient: shutdown 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 -- 10.20.193.51:0/1926992353 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6813b760 msgr2=0x7fda6813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 --2- 10.20.193.51:0/1926992353 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6813b760 0x7fda6813db50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda6806c1c0 tx=0x7fda6402f130 comp rx=0 tx=0).stop 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 -- 10.20.193.51:0/1926992353 shutdown_connections 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 --2- 10.20.193.51:0/1926992353 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6813b760 0x7fda6813db50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 --2- 10.20.193.51:0/1926992353 >> v2:10.20.193.142:3300/0 conn(0x7fda680a3bb0 0x7fda6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 -- 10.20.193.51:0/1926992353 >> 10.20.193.51:0/1926992353 conn(0x7fda680a30c0 msgr2=0x7fda680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 -- 10.20.193.51:0/1926992353 shutdown_connections 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.036+0000 7fda705ce640 1 -- 10.20.193.51:0/1926992353 wait complete. 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient: monmap: 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:51.056 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 Processor -- start 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 -- start start 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient: init 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:51.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda680a0750 0x7fda68099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-c con 0x7fda680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-a con 0x7fda680a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda6813b760 0x7fda68091e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): picked mon.noname-b con 0x7fda6813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fda680a04b0 con 0x7fda680a3bb0 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fda6809c850 con 0x7fda6813b760 2026-02-17T11:58:51.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fda6809e710 con 0x7fda680a0750 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.037+0000 7fda705ce640 10 monclient(hunting): authenticate will time out at 1418.656977s 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda680a0750 0x7fda68099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58322/0 (socket says 10.20.193.51:58322) 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 -- 10.20.193.51:0/3101549781 learned_addr learned my addr 10.20.193.51:0/3101549781 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): get_auth_request con 0x7fda680a3bb0 auth_method 0 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): get_auth_request con 0x7fda680a0750 auth_method 0 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda6813b760 0x7fda68091e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 10 monclient(hunting): get_auth_request con 0x7fda6813b760 auth_method 0 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient(hunting): handle_auth_done global_id 164256 payload 824 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda680a0750 msgr2=0x7fda68099090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda680a0750 0x7fda68099090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda6813b760 msgr2=0x7fda68091e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda6813b760 0x7fda68091e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 monclient: found mon.noname-a 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6db42640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68094fe0 con 0x7fda680a3bb0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.038+0000 7fda6eb44640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda6813b760 0x7fda68091e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda6db42640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 msgr2=0x7fda68091940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda6db42640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c750 tx=0x7fda5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c005de0 con 0x7fda680a3bb0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: dump: 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.063 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c007070 con 0x7fda680a3bb0 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c007440 con 0x7fda680a3bb0 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 5 monclient: authenticate success, global_id 164256 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 monclient: _renew_subs 2026-02-17T11:58:51.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda6cb40640 4 set_mon_vals no callback set 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda680955a0 con 0x7fda680a3bb0 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda4effd640 10 monclient: dump: 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.065 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 monclient: _renew_subs 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda68093590 con 0x7fda680a3bb0 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 0x7fda680923c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.040+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fda680a2d60 con 0x7fda6809a080 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 0x7fda680923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient: get_auth_request con 0x7fda6809a080 auth_method 0 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fda5c007660 con 0x7fda680a3bb0 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 10 monclient(hunting): handle_auth_done global_id 164259 payload 824 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6e343640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda680953e0 con 0x7fda6809a080 2026-02-17T11:58:51.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda4effd640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda3803dd60 0x7fda38040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7fda5c052400 con 0x7fda680a3bb0 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6eb44640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda3803dd60 0x7fda38040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.041+0000 7fda6eb44640 10 monclient: get_auth_request con 0x7fda3803dd60 auth_method 0 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda6e343640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 msgr2=0x7fda680923c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda6e343640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 0x7fda680923c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5800f040 con 0x7fda6809a080 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 10 monclient: dump: 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.068 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fda5800fe50 con 0x7fda6809a080 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 msgr2=0x7fda680923c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 0x7fda680923c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58011d00 comp rx=0 tx=0).stop 2026-02-17T11:58:51.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 msgr2=0x7fda680923c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.043+0000 7fda4effd640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6809a080 0x7fda680923c0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58011d00 comp rx=0 tx=0).stop 2026-02-17T11:58:51.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.044+0000 7fda6eb44640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda3803dd60 0x7fda38040220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda6806f3c0 tx=0x7fda64033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda705ce640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda705ce640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 0x7fda680638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda705ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fda6809dac0 con 0x7fda6808e570 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda6e343640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 0x7fda680638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda6e343640 10 monclient: get_auth_request con 0x7fda6808e570 auth_method 0 2026-02-17T11:58:51.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda6e343640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda6e343640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.046+0000 7fda6e343640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.047+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.047+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.047+0000 7fda6e343640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.047+0000 7fda6e343640 10 monclient(hunting): handle_auth_done global_id 164262 payload 824 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.047+0000 7fda6e343640 1 -- 10.20.193.51:0/3101549781 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda680939d0 con 0x7fda6808e570 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda6e343640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 msgr2=0x7fda680638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda6e343640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 0x7fda680638c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58015660 con 0x7fda6808e570 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 10 monclient: dump: 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fda58015660 con 0x7fda6808e570 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:51.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 msgr2=0x7fda680638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 0x7fda680638c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58004830 comp rx=0 tx=0).stop 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 msgr2=0x7fda680638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda4effd640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda6808e570 0x7fda680638c0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda58011830 tx=0x7fda58004830 comp rx=0 tx=0).stop 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:51.075 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 75487, 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.076 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.077 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:51.078 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.079 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.080 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.081 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.082 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.083 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.084 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.085 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.086 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:51.086 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda3803dd60 msgr2=0x7fda38040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda3803dd60 0x7fda38040220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda6806f3c0 tx=0x7fda64033000 comp rx=0 tx=0).stop 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 10 monclient: shutdown 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 msgr2=0x7fda68091940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c750 tx=0x7fda5c00cc20 comp rx=0 tx=0).stop 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda6eb44640 1 -- 10.20.193.51:0/3101549781 reap_dead start 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 shutdown_connections 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 --2- 10.20.193.51:0/3101549781 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda680a3bb0 0x7fda68091940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 >> 10.20.193.51:0/3101549781 conn(0x7fda680a30c0 msgr2=0x7fda6813ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 shutdown_connections 2026-02-17T11:58:51.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.049+0000 7fda705ce640 1 -- 10.20.193.51:0/3101549781 wait complete. 2026-02-17T11:58:51.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:51.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:58:51.088 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:58:51.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: get_monmap_and_config 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: monmap: 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:51.155107+0000 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:51.155107+0000 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:51.156 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 Processor -- start 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 -- start start 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: init 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 0x7ff4d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff4d00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff4d00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff4d009e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d006e140 con 0x7ff4d009e540 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d00a3f90 con 0x7ff4d00a3bb0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d009f910 con 0x7ff4d00a0750 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4d4eb0640 10 monclient(hunting): authenticate will time out at 1418.773854s 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 0x7ff4d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55412/0 (socket says 10.20.193.51:55412) 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 1 -- 10.20.193.51:0/2804806738 learned_addr learned my addr 10.20.193.51:0/2804806738 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 10 monclient(hunting): get_auth_request con 0x7ff4d00a0750 auth_method 0 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 0x7ff4d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58352/0 (socket says 10.20.193.51:58352) 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4cdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 10 monclient(hunting): get_auth_request con 0x7ff4d00a3bb0 auth_method 0 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.154+0000 7ff4ce575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_done global_id 174125 payload 274 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 1 -- 10.20.193.51:0/2804806738 >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 msgr2=0x7ff4d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 1 --2- 10.20.193.51:0/2804806738 >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 0x7ff4d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 1 -- 10.20.193.51:0/2804806738 >> v1:10.20.193.142:6789/0 conn(0x7ff4d009e540 legacy=0x7ff4d013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 1 monclient: found mon.noname-b 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.155+0000 7ff4cdd74640 1 -- 10.20.193.51:0/2804806738 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d009ccd0 con 0x7ff4d00a0750 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cdd74640 1 -- 10.20.193.51:0/2804806738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 msgr2=0x7ff4d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cdd74640 1 --2- 10.20.193.51:0/2804806738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4d006c1c0 tx=0x7ff4b802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bfb0118a81e8afe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 1 -- 10.20.193.51:0/2804806738 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b803c070 con 0x7ff4d00a0750 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: dump: 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.160 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 1 -- 10.20.193.51:0/2804806738 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b802fca0 con 0x7ff4d00a0750 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 1 -- 10.20.193.51:0/2804806738 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8037660 con 0x7ff4d00a0750 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4cd573640 10 monclient: dump: 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 5 monclient: authenticate success, global_id 174125 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 4 set_mon_vals no callback set 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 10 monclient: shutdown 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/2804806738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 msgr2=0x7ff4d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.157+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/2804806738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4d006c1c0 tx=0x7ff4b802ee60 comp rx=0 tx=0).stop 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/2804806738 shutdown_connections 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/2804806738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d009e000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/2804806738 >> v2:10.20.193.51:3300/0 conn(0x7ff4d00a3bb0 0x7ff4d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/2804806738 >> 10.20.193.51:0/2804806738 conn(0x7ff4d00a30c0 msgr2=0x7ff4d00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/2804806738 shutdown_connections 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/2804806738 wait complete. 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 10 monclient: monmap: 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 Processor -- start 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 1 -- start start 2026-02-17T11:58:51.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.158+0000 7ff4d4eb0640 10 monclient: init 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff4d009e540 0x7ff4d012bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff4d009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-c con 0x7ff4d00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff4d00a3bb0 0x7ff4d012c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff4d00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00a04b0 con 0x7ff4d00a3bb0 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d009c850 con 0x7ff4d009e540 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d013de80 con 0x7ff4d00a0750 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4d4eb0640 10 monclient(hunting): authenticate will time out at 1418.778210s 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55426/0 (socket says 10.20.193.51:55426) 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 -- 10.20.193.51:0/1919906829 learned_addr learned my addr 10.20.193.51:0/1919906829 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): get_auth_request con 0x7ff4d00a0750 auth_method 0 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff4d00a3bb0 0x7ff4d012c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): get_auth_request con 0x7ff4d00a3bb0 auth_method 0 2026-02-17T11:58:51.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ce575640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff4d009e540 0x7ff4d012bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4ced76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient(hunting): handle_auth_done global_id 174128 payload 824 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff4d009e540 msgr2=0x7ff4d012bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff4d009e540 0x7ff4d012bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff4d00a3bb0 msgr2=0x7ff4d012c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff4d00a3bb0 0x7ff4d012c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 monclient: found mon.noname-c 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.159+0000 7ff4cdd74640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d012d560 con 0x7ff4d00a0750 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4cdd74640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 msgr2=0x7ff4d012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4cdd74640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8002410 tx=0x7ff4b8004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b803c040 con 0x7ff4d00a0750 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: dump: 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.166 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b8047070 con 0x7ff4d00a0750 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 5 monclient: authenticate success, global_id 174128 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 10 monclient: _renew_subs 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d012efb0 con 0x7ff4d00a0750 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80428b0 con 0x7ff4d00a0750 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4ccd72640 4 set_mon_vals no callback set 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4b6ffd640 10 monclient: dump: 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.167 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 10 monclient: _renew_subs 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.161+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d006f8d0 con 0x7ff4d00a0750 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff4b8042a50 con 0x7ff4d00a0750 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4d4eb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 0x7ff4d01cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d012e0c0 con 0x7ff4d012f1f0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 0x7ff4d01cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient: get_auth_request con 0x7ff4d012f1f0 auth_method 0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4b6ffd640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff49c03dd10 0x7ff49c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7ff4b8077990 con 0x7ff4d00a0750 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 10 monclient(hunting): handle_auth_done global_id 174131 payload 824 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ce575640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4d006f410 con 0x7ff4d012f1f0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ced76640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff49c03dd10 0x7ff49c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.162+0000 7ff4ced76640 10 monclient: get_auth_request con 0x7ff49c03dd10 auth_method 0 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4ce575640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 msgr2=0x7ff4d01cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4ce575640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 0x7ff4d01cd1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c4010d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400f040 con 0x7ff4d012f1f0 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 10 monclient: dump: 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.169 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff4c401c400 con 0x7ff4d012f1f0 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 msgr2=0x7ff4d01cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 0x7ff4d01cd1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c4010d20 comp rx=0 tx=0).stop 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 msgr2=0x7ff4d01cd1a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.164+0000 7ff4b6ffd640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d012f1f0 0x7ff4d01cd1a0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c4010d20 comp rx=0 tx=0).stop 2026-02-17T11:58:51.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.165+0000 7ff4ced76640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff49c03dd10 0x7ff49c0401d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000f2e0 tx=0x7ff4c0004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4d4eb0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 0x7ff4d01d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4d4eb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d009dac0 con 0x7ff4d01cd6e0 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 0x7ff4d01d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient: get_auth_request con 0x7ff4d01cd6e0 auth_method 0 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 10 monclient(hunting): handle_auth_done global_id 174134 payload 824 2026-02-17T11:58:51.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.168+0000 7ff4ce575640 1 -- 10.20.193.51:0/1919906829 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4d00008d0 con 0x7ff4d01cd6e0 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4ce575640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 msgr2=0x7ff4d01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4ce575640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 0x7ff4d01d84f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4003230 con 0x7ff4d01cd6e0 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 10 monclient: dump: 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.172 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7ff4c4025070 con 0x7ff4d01cd6e0 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 msgr2=0x7ff4d01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 0x7ff4d01d84f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c40047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 msgr2=0x7ff4d01d84f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4b6ffd640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d01cd6e0 0x7ff4d01d84f0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4010850 tx=0x7ff4c40047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 11936, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:51.173 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.174 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.175 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:51.176 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.177 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.178 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.179 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.180 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:51.181 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff49c03dd10 msgr2=0x7ff49c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff49c03dd10 0x7ff49c0401d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000f2e0 tx=0x7ff4c0004200 comp rx=0 tx=0).stop 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 10 monclient: shutdown 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 msgr2=0x7ff4d012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8002410 tx=0x7ff4b8004830 comp rx=0 tx=0).stop 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4ced76640 1 -- 10.20.193.51:0/1919906829 reap_dead start 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 shutdown_connections 2026-02-17T11:58:51.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 --2- 10.20.193.51:0/1919906829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff4d00a0750 0x7ff4d012c050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.170+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 >> 10.20.193.51:0/1919906829 conn(0x7ff4d00a30c0 msgr2=0x7ff4d00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.171+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 shutdown_connections 2026-02-17T11:58:51.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.171+0000 7ff4d4eb0640 1 -- 10.20.193.51:0/1919906829 wait complete. 2026-02-17T11:58:51.183 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:51.183 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:58:51.183 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.249+0000 7f25d1e4d640 10 monclient: get_monmap_and_config 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.249+0000 7f25d1e4d640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.249+0000 7f25d1e4d640 10 monclient: monmap: 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.251 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:51.250771+0000 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:51.250771+0000 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:51.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 Processor -- start 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 -- start start 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient: init 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-17T11:58:51.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-a con 0x7f25cc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-c con 0x7f25cc0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 0x7f25cc13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0a3f90 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc06e140 con 0x7f25cc0a0750 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc09f910 con 0x7f25cc09e540 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25d1e4d640 10 monclient(hunting): authenticate will time out at 1418.869536s 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 0x7f25cc13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58370/0 (socket says 10.20.193.51:58370) 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 1 -- 10.20.193.51:0/2224972569 learned_addr learned my addr 10.20.193.51:0/2224972569 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request con 0x7f25cc0a3bb0 auth_method 0 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): get_auth_request con 0x7f25cc09e540 auth_method 0 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient(hunting): handle_auth_done global_id 174137 payload 274 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25caffd640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 -- 10.20.193.51:0/2224972569 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 msgr2=0x7f25cc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 -- 10.20.193.51:0/2224972569 >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 msgr2=0x7f25cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 monclient: found mon.noname-b 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cbfff640 1 -- 10.20.193.51:0/2224972569 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc09ccd0 con 0x7f25cc09e540 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25caffd640 10 monclient: get_auth_request con 0x7f25cc0a0750 auth_method 0 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25caffd640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:51.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.250+0000 7f25cb7fe640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25cbfff640 1 -- 10.20.193.51:0/2224972569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 msgr2=0x7f25cc13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25cbfff640 1 --2- 10.20.193.51:0/2224972569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 0x7f25cc13c760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f25cc06f3c0 tx=0x7f25c002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01fa8addc7b3245 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 1 -- 10.20.193.51:0/2224972569 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c003c070 con 0x7f25cc09e540 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: dump: 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.263 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 5 monclient: authenticate success, global_id 174137 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 1 -- 10.20.193.51:0/2224972569 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0037440 con 0x7f25cc09e540 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 4 set_mon_vals no callback set 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 1 -- 10.20.193.51:0/2224972569 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0037810 con 0x7f25cc09e540 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25ca7fc640 10 monclient: dump: 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.264 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 10 monclient: shutdown 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 -- 10.20.193.51:0/2224972569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 msgr2=0x7f25cc13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/2224972569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 0x7f25cc13c760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f25cc06f3c0 tx=0x7f25c002f130 comp rx=0 tx=0).stop 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 -- 10.20.193.51:0/2224972569 shutdown_connections 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/2224972569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc09e540 0x7f25cc13c760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/2224972569 >> v2:10.20.193.51:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 -- 10.20.193.51:0/2224972569 >> 10.20.193.51:0/2224972569 conn(0x7f25cc0a30c0 msgr2=0x7f25cc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 -- 10.20.193.51:0/2224972569 shutdown_connections 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.253+0000 7f25d1e4d640 1 -- 10.20.193.51:0/2224972569 wait complete. 2026-02-17T11:58:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient: monmap: 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 Processor -- start 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 -- start start 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient: init 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc095630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-a con 0x7f25cc09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:51.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a0750 0x7f25cc1cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): picked mon.noname-c con 0x7f25cc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0a04b0 con 0x7f25cc09e540 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc09c850 con 0x7f25cc0a0750 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc13cca0 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25d1e4d640 10 monclient(hunting): authenticate will time out at 1418.873743s 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc095630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55454/0 (socket says 10.20.193.51:55454) 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 learned_addr learned my addr 10.20.193.51:0/731698934 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): get_auth_request con 0x7f25cc0a3bb0 auth_method 0 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request con 0x7f25cc09e540 auth_method 0 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25caffd640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a0750 0x7f25cc1cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient(hunting): handle_auth_done global_id 174140 payload 824 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a0750 msgr2=0x7f25cc1cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a0750 0x7f25cc1cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 msgr2=0x7f25cc095630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc095630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 monclient: found mon.noname-c 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc097310 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25caffd640 10 monclient: get_auth_request con 0x7f25cc0a0750 auth_method 0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.254+0000 7f25caffd640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a0750 0x7f25cc1cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 msgr2=0x7f25cc09be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cbfff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e90 tx=0x7f25c0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c003c050 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: dump: 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.269 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0048070 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0041a50 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25c9ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 10 monclient: dump: 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.270 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 5 monclient: authenticate success, global_id 174140 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 monclient: _renew_subs 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc097030 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 monclient: _renew_subs 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc0962f0 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 0x7f25cc1cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc097810 con 0x7f25cc09c370 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f25c0041c70 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cb7fe640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 0x7f25cc1cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cb7fe640 10 monclient: get_auth_request con 0x7f25cc09c370 auth_method 0 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.257+0000 7f25cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25a7fff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd60 0x7f259c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7f25c0077f80 con 0x7f25cc0a3bb0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25caffd640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd60 0x7f259c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25caffd640 10 monclient: get_auth_request con 0x7f259c03dd60 auth_method 0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_done global_id 114538 payload 824 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.258+0000 7f25cb7fe640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25cc09dac0 con 0x7f25cc09c370 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25caffd640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd60 0x7f259c040220 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006fd0 tx=0x7f25bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25cb7fe640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 msgr2=0x7f25cc1cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25cb7fe640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 0x7f25cc1cf060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b800fe80 con 0x7f25cc09c370 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.260+0000 7f25a7fff640 10 monclient: dump: 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.272 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f25b800fe80 con 0x7f25cc09c370 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 msgr2=0x7f25cc1cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 0x7f25cc1cf060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b800f610 comp rx=0 tx=0).stop 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 msgr2=0x7f25cc1cf060 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.261+0000 7f25a7fff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc09c370 0x7f25cc1cf060 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b800f610 comp rx=0 tx=0).stop 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25d1e4d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 0x7f25cc1da3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25d1e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0008d0 con 0x7f25cc1cf5a0 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 0x7f25cc1da3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient: get_auth_request con 0x7f25cc1cf5a0 auth_method 0 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 10 monclient(hunting): handle_auth_done global_id 114541 payload 824 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.264+0000 7f25cb7fe640 1 -- 10.20.193.51:0/731698934 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f25cc050ac0 con 0x7f25cc1cf5a0 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25cb7fe640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 msgr2=0x7f25cc1da3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25cb7fe640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 0x7f25cc1da3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b802b020 con 0x7f25cc1cf5a0 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 10 monclient: dump: 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f25b80133a0 con 0x7f25cc1cf5a0 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 msgr2=0x7f25cc1da3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 0x7f25cc1da3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b80047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 msgr2=0x7f25cc1da3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25a7fff640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc1cf5a0 0x7f25cc1da3b0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006fd0 tx=0x7f25b80047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 128, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 333143, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:58:51.277 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.278 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:58:51.279 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.280 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.281 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:58:51.282 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.283 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.284 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:58:51.285 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:58:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd60 msgr2=0x7f259c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd60 0x7f259c040220 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006fd0 tx=0x7f25bc008040 comp rx=0 tx=0).stop 2026-02-17T11:58:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25cbfff640 1 -- 10.20.193.51:0/731698934 reap_dead start 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 10 monclient: shutdown 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 msgr2=0x7f25cc09be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e90 tx=0x7f25c0004b40 comp rx=0 tx=0).stop 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 shutdown_connections 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 --2- 10.20.193.51:0/731698934 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a3bb0 0x7f25cc09be30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 >> 10.20.193.51:0/731698934 conn(0x7f25cc0a30c0 msgr2=0x7f25cc072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 shutdown_connections 2026-02-17T11:58:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.267+0000 7f25d1e4d640 1 -- 10.20.193.51:0/731698934 wait complete. 2026-02-17T11:58:51.287 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:58:51.287 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T11:58:51.287 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:58:51.287 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T11:58:51.288 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:58:51.288 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T11:58:51.288 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:58:51.300 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T11:58:51.300 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:58:51.300 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:51.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: get_monmap_and_config 2026-02-17T11:58:51.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: monmap: 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:51.366023+0000 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:51.366023+0000 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 Processor -- start 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 -- start start 2026-02-17T11:58:51.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: init 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6c180a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c1813b380 0x7f6c1813d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-a con 0x7f6c1813b380 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 0x7f6c181400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-c con 0x7f6c1813dcb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c18135430 con 0x7f6c180a3bb0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1809a5c0 con 0x7f6c1813b380 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1809b520 con 0x7f6c1813dcb0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c1d5b4640 10 monclient(hunting): authenticate will time out at 1418.984765s 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c16ffd640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f6c180a3bb0 legacy=0x7f6c1809cd30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:58:51.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c177fe640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 msgr2=0x7f6c181400a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c1813b380 0x7f6c1813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c177fe640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 0x7f6c181400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c1813b380 0x7f6c1813d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58392/0 (socket says 10.20.193.51:58392) 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 1 -- 10.20.193.51:0/2116289342 learned_addr learned my addr 10.20.193.51:0/2116289342 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): get_auth_request con 0x7f6c1813b380 auth_method 0 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.365+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 10 monclient(hunting): handle_auth_done global_id 164277 payload 274 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 1 -- 10.20.193.51:0/2116289342 >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 msgr2=0x7f6c181400a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 1 --2- 10.20.193.51:0/2116289342 >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 0x7f6c181400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 1 -- 10.20.193.51:0/2116289342 >> v1:10.20.193.142:6789/0 conn(0x7f6c180a3bb0 legacy=0x7f6c1809cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:51.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 1 monclient: found mon.noname-a 2026-02-17T11:58:51.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.366+0000 7f6c167fc640 1 -- 10.20.193.51:0/2116289342 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1809af60 con 0x7f6c1813b380 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c167fc640 1 -- 10.20.193.51:0/2116289342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 msgr2=0x7f6c1813d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c167fc640 1 --2- 10.20.193.51:0/2116289342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c1813d770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c180694e0 tx=0x7f6c0002ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551cfc6fef8fa647 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 1 -- 10.20.193.51:0/2116289342 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0003c070 con 0x7f6c1813b380 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:51.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: dump: 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 5 monclient: authenticate success, global_id 164277 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 1 -- 10.20.193.51:0/2116289342 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0002fd90 con 0x7f6c1813b380 2026-02-17T11:58:51.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 1 -- 10.20.193.51:0/2116289342 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00037660 con 0x7f6c1813b380 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c15ffb640 10 monclient: dump: 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:51.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 4 set_mon_vals no callback set 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 10 monclient: shutdown 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/2116289342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 msgr2=0x7f6c1813d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/2116289342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c1813d770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c180694e0 tx=0x7f6c0002ee30 comp rx=0 tx=0).stop 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/2116289342 shutdown_connections 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/2116289342 >> v2:10.20.193.142:3300/0 conn(0x7f6c1813dcb0 0x7f6c181400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/2116289342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c1813d770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/2116289342 >> 10.20.193.51:0/2116289342 conn(0x7f6c180a30c0 msgr2=0x7f6c180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/2116289342 shutdown_connections 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.368+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/2116289342 wait complete. 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient: monmap: 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:51.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 Processor -- start 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 -- start start 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient: init 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c180a3bb0 0x7f6c18137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-c con 0x7f6c180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-a con 0x7f6c1813b380 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:51.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 0x7f6c181380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): picked mon.noname-b con 0x7f6c1813dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18135040 con 0x7f6c1813b380 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18074ac0 con 0x7f6c1813dcb0 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c181351c0 con 0x7f6c180a3bb0 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c1d5b4640 10 monclient(hunting): authenticate will time out at 1418.988819s 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58406/0 (socket says 10.20.193.51:58406) 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 1 -- 10.20.193.51:0/3358174031 learned_addr learned my addr 10.20.193.51:0/3358174031 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): get_auth_request con 0x7f6c1813b380 auth_method 0 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c180a3bb0 0x7f6c18137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c177fe640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 msgr2=0x7f6c181380e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c177fe640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 0x7f6c181380e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): get_auth_request con 0x7f6c180a3bb0 auth_method 0 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c16ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 10 monclient(hunting): handle_auth_done global_id 164280 payload 824 2026-02-17T11:58:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c180a3bb0 msgr2=0x7f6c18137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.369+0000 7f6c167fc640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c180a3bb0 0x7f6c18137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 msgr2=0x7f6c181380e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 0x7f6c181380e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 1 monclient: found mon.noname-a 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.370+0000 7f6c167fc640 1 -- 10.20.193.51:0/3358174031 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1812b960 con 0x7f6c1813b380 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c167fc640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 msgr2=0x7f6c18137ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c167fc640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009a40 tx=0x7f6c000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00046020 con 0x7f6c1813b380 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: dump: 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00042620 con 0x7f6c1813b380 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 5 monclient: authenticate success, global_id 164280 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _renew_subs 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1812bc40 con 0x7f6c1813b380 2026-02-17T11:58:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0003c040 con 0x7f6c1813b380 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c157fa640 4 set_mon_vals no callback set 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 10 monclient: dump: 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _renew_subs 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1813d780 con 0x7f6c1813b380 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1809d4f0 con 0x7f6c1813b380 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.372+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6c0003f030 con 0x7f6c1813b380 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.373+0000 7f6bf77fe640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.373+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7f6c00077870 con 0x7f6c1813b380 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.373+0000 7f6c16ffd640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.373+0000 7f6c16ffd640 10 monclient: get_auth_request con 0x7f6be403dcc0 auth_method 0 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.375+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6c00050030 con 0x7f6c1813b380 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.375+0000 7f6bf77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.375+0000 7f6bf77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:51.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.375+0000 7f6c16ffd640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0094d0 tx=0x7f6c0c009460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6c1d5b4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6c1d5b4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6c1d5b4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c18074d80 con 0x7f6c1813b380 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6bf77fe640 1 -- 10.20.193.51:0/3358174031 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f6c00035dd0 con 0x7f6c1813b380 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6bf77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:51.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.488+0000 7f6bf77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:51.492 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:51.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 msgr2=0x7f6be4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0094d0 tx=0x7f6c0c009460 comp rx=0 tx=0).stop 2026-02-17T11:58:51.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 10 monclient: shutdown 2026-02-17T11:58:51.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 msgr2=0x7f6c18137ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009a40 tx=0x7f6c000047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 shutdown_connections 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6be403dcc0 0x7f6be4040180 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c1813dcb0 0x7f6c181380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c1813b380 0x7f6c18137ba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 --2- 10.20.193.51:0/3358174031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c180a3bb0 0x7f6c18137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 >> 10.20.193.51:0/3358174031 conn(0x7f6c180a30c0 msgr2=0x7f6c1809c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 shutdown_connections 2026-02-17T11:58:51.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:51.489+0000 7f6c1d5b4640 1 -- 10.20.193.51:0/3358174031 wait complete. 2026-02-17T11:58:54.500 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:54.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 10 monclient: get_monmap_and_config 2026-02-17T11:58:54.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 10 monclient: build_initial_monmap 2026-02-17T11:58:54.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 10 monclient: monmap: 2026-02-17T11:58:54.572 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:54.572 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:54.569303+0000 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:54.569303+0000 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 1 Processor -- start 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 1 -- start start 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.568+0000 7f3b2fc3b640 10 monclient: init 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3b280a3bb0 0x7f3b2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-a con 0x7f3b280a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3b280a0750 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3b2813b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2806e140 con 0x7f3b2813b760 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2809f910 con 0x7f3b280a0750 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2809ccd0 con 0x7f3b280a3bb0 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2fc3b640 10 monclient(hunting): authenticate will time out at 1422.188116s 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d1af640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f3b280a0750 legacy=0x7f3b2809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3b280a3bb0 0x7f3b2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3b280a3bb0 0x7f3b2809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58422/0 (socket says 10.20.193.51:58422) 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 -- 10.20.193.51:0/1232861670 learned_addr learned my addr 10.20.193.51:0/1232861670 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): get_auth_request con 0x7f3b280a3bb0 auth_method 0 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2e1b1640 1 --1- 10.20.193.51:0/1232861670 >> v1:10.20.193.51:6789/0 conn(0x7f3b2813b760 0x7f3b2813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60328/0 (socket says 10.20.193.51:60328) 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient(hunting): handle_auth_done global_id 164283 payload 274 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 -- 10.20.193.51:0/1232861670 >> v1:10.20.193.142:6789/0 conn(0x7f3b280a0750 legacy=0x7f3b2809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 -- 10.20.193.51:0/1232861670 >> v1:10.20.193.51:6789/0 conn(0x7f3b2813b760 legacy=0x7f3b2813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient: _finish_hunting 0 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 monclient: found mon.noname-a 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.569+0000 7f3b2d9b0640 1 -- 10.20.193.51:0/1232861670 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2809eec0 con 0x7f3b280a3bb0 2026-02-17T11:58:54.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.571+0000 7f3b2d9b0640 1 -- 10.20.193.51:0/1232861670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b280a3bb0 msgr2=0x7f3b2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.571+0000 7f3b2d9b0640 1 --2- 10.20.193.51:0/1232861670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b280a3bb0 0x7f3b2809dac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009970 tx=0x7f3b1802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902871deddf866e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 1 -- 10.20.193.51:0/1232861670 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1803c070 con 0x7f3b280a3bb0 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: dump: 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.584 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: _finish_auth 0 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: _check_auth_tickets 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 1 -- 10.20.193.51:0/1232861670 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1802fdb0 con 0x7f3b280a3bb0 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:54.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 5 monclient: authenticate success, global_id 164283 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 1 -- 10.20.193.51:0/1232861670 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18037660 con 0x7f3b280a3bb0 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2c9ae640 10 monclient: dump: 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:54.586 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 4 set_mon_vals no callback set 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 10 monclient: shutdown 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/1232861670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b280a3bb0 msgr2=0x7f3b2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/1232861670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b280a3bb0 0x7f3b2809dac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009970 tx=0x7f3b1802ee90 comp rx=0 tx=0).stop 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/1232861670 shutdown_connections 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/1232861670 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b280a3bb0 0x7f3b2809dac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/1232861670 >> 10.20.193.51:0/1232861670 conn(0x7f3b280a30c0 msgr2=0x7f3b280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:54.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/1232861670 shutdown_connections 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.572+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/1232861670 wait complete. 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient: build_initial_monmap 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient: monmap: 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:54.588 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 Processor -- start 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 -- start start 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient: init 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 0x7f3b28099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-b con 0x7f3b280a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b280a3bb0 0x7f3b28090980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-c con 0x7f3b280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): picked mon.noname-a con 0x7f3b2813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3b280a04b0 con 0x7f3b2813b760 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2809c850 con 0x7f3b280a0750 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2809e710 con 0x7f3b280a3bb0 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2fc3b640 10 monclient(hunting): authenticate will time out at 1422.192579s 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d9b0640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 msgr2=0x7f3b28099ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b280a3bb0 0x7f3b28090980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d9b0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 0x7f3b28099ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:58434/0 (socket says 10.20.193.51:58434) 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 -- 10.20.193.51:0/3873592822 learned_addr learned my addr 10.20.193.51:0/3873592822 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): get_auth_request con 0x7f3b2813b760 auth_method 0 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): get_auth_request con 0x7f3b280a3bb0 auth_method 0 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2d1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient(hunting): handle_auth_done global_id 164286 payload 824 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 -- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b280a3bb0 msgr2=0x7f3b28090980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b280a3bb0 0x7f3b28090980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 -- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 msgr2=0x7f3b28099ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:54.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 0x7f3b28099ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient: _finish_hunting 0 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 monclient: found mon.noname-a 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.573+0000 7f3b2e1b1640 1 -- 10.20.193.51:0/3873592822 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280941d0 con 0x7f3b2813b760 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.575+0000 7f3b2e1b1640 1 -- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 msgr2=0x7f3b28090ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.575+0000 7f3b2e1b1640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400caf0 tx=0x7f3b2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24017070 con 0x7f3b2813b760 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: dump: 2026-02-17T11:58:54.593 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:54.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b24012400 con 0x7f3b2813b760 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 5 monclient: authenticate success, global_id 164286 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _renew_subs 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b28094790 con 0x7f3b2813b760 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b240127f0 con 0x7f3b2813b760 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b17fff640 4 set_mon_vals no callback set 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 10 monclient: dump: 2026-02-17T11:58:54.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _renew_subs 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b280944b0 con 0x7f3b2813b760 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2809dac0 con 0x7f3b2813b760 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3b24007070 con 0x7f3b2813b760 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 0x7f3af8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.576+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7f3b24052760 con 0x7f3b2813b760 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.577+0000 7f3b2d9b0640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 0x7f3af8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.577+0000 7f3b2d9b0640 10 monclient: get_auth_request con 0x7f3af803dcc0 auth_method 0 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.579+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3b24007570 con 0x7f3b2813b760 2026-02-17T11:58:54.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.579+0000 7f3b167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.579+0000 7f3b167fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:54.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.579+0000 7f3b2d9b0640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 0x7f3af8040180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b2809fb00 tx=0x7f3b18033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b2fc3b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b2fc3b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b2fc3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b28092b10 con 0x7f3b2813b760 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b167fc640 1 -- 10.20.193.51:0/3873592822 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f3b240078a0 con 0x7f3b2813b760 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b167fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:54.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.692+0000 7f3b167fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:54.696 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 msgr2=0x7f3af8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 0x7f3af8040180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b2809fb00 tx=0x7f3b18033000 comp rx=0 tx=0).stop 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 10 monclient: shutdown 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 msgr2=0x7f3b28090ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400caf0 tx=0x7f3b2400a060 comp rx=0 tx=0).stop 2026-02-17T11:58:54.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 shutdown_connections 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3af803dcc0 0x7f3af8040180 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3b2813b760 0x7f3b28090ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3b280a3bb0 0x7f3b28090980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 --2- 10.20.193.51:0/3873592822 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3b280a0750 0x7f3b28099ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 >> 10.20.193.51:0/3873592822 conn(0x7f3b280a30c0 msgr2=0x7f3b280a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 shutdown_connections 2026-02-17T11:58:54.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:54.693+0000 7f3b2fc3b640 1 -- 10.20.193.51:0/3873592822 wait complete. 2026-02-17T11:58:57.704 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:58:57.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 10 monclient: get_monmap_and_config 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 10 monclient: build_initial_monmap 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 10 monclient: monmap: 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:58:57.773323+0000 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:58:57.773323+0000 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:57.777 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 1 Processor -- start 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 1 -- start start 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 10 monclient: init 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.772+0000 7f5f05b72640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T11:58:57.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-b con 0x7f5f000a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f000a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5f0013b760 addr v1:10.20.193.142:6789/0 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0006e140 con 0x7f5f000a0750 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0009f910 con 0x7f5f0013b760 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0009ccd0 con 0x7f5f000a3bb0 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5f05b72640 10 monclient(hunting): authenticate will time out at 1425.392114s 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5efeffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f5f000a0750 0x7f5f0009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42542/0 (socket says 10.20.193.51:42542) 2026-02-17T11:58:57.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5efeffd640 1 -- 10.20.193.51:0/1386769308 learned_addr learned my addr 10.20.193.51:0/1386769308 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5efffff640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f5f0013b760 legacy=0x7f5f0013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): get_auth_request con 0x7f5f000a3bb0 auth_method 0 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_done global_id 174149 payload 274 2026-02-17T11:58:57.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 1 -- 10.20.193.51:0/1386769308 >> v1:10.20.193.142:6789/0 conn(0x7f5f0013b760 legacy=0x7f5f0013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 1 -- 10.20.193.51:0/1386769308 >> v1:10.20.193.51:6789/0 conn(0x7f5f000a0750 legacy=0x7f5f0009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 1 monclient: found mon.noname-b 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.773+0000 7f5eff7fe640 1 -- 10.20.193.51:0/1386769308 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0009eec0 con 0x7f5f000a3bb0 2026-02-17T11:58:57.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.775+0000 7f5eff7fe640 1 -- 10.20.193.51:0/1386769308 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 msgr2=0x7f5f0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:57.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.775+0000 7f5eff7fe640 1 --2- 10.20.193.51:0/1386769308 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 0x7f5f0009dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009f230 tx=0x7f5eec02eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4530c66ef5a576a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 1 -- 10.20.193.51:0/1386769308 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec03c070 con 0x7f5f000a3bb0 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: dump: 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 1 -- 10.20.193.51:0/1386769308 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec02fd00 con 0x7f5f000a3bb0 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 5 monclient: authenticate success, global_id 174149 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:57.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 1 -- 10.20.193.51:0/1386769308 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec037660 con 0x7f5f000a3bb0 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 4 set_mon_vals no callback set 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:57.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5efe7fc640 10 monclient: dump: 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:57.793 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 10 monclient: shutdown 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:57.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 -- 10.20.193.51:0/1386769308 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 msgr2=0x7f5f0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 --2- 10.20.193.51:0/1386769308 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 0x7f5f0009dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009f230 tx=0x7f5eec02eda0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 -- 10.20.193.51:0/1386769308 shutdown_connections 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 --2- 10.20.193.51:0/1386769308 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 -- 10.20.193.51:0/1386769308 >> 10.20.193.51:0/1386769308 conn(0x7f5f000a30c0 msgr2=0x7f5f000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 -- 10.20.193.51:0/1386769308 shutdown_connections 2026-02-17T11:58:57.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 1 -- 10.20.193.51:0/1386769308 wait complete. 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 10 monclient: build_initial_monmap 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.776+0000 7f5f05b72640 10 monclient: monmap: 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:58:57.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 Processor -- start 2026-02-17T11:58:57.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 -- start start 2026-02-17T11:58:57.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient: init 2026-02-17T11:58:57.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:57.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:57.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-c con 0x7f5f000a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 0x7f5f0009ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-b con 0x7f5f000a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 0x7f5f0009b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): picked mon.noname-a con 0x7f5f0013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:58:57.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000a04b0 con 0x7f5f0013b760 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0009c850 con 0x7f5f000a3bb0 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0009e710 con 0x7f5f000a0750 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:57.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5f05b72640 10 monclient(hunting): authenticate will time out at 1425.396443s 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 0x7f5f0009b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efeffd640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 msgr2=0x7f5f0009ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efeffd640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 0x7f5f0009ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:50492/0 (socket says 10.20.193.51:50492) 2026-02-17T11:58:57.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 -- 10.20.193.51:0/2583527539 learned_addr learned my addr 10.20.193.51:0/2583527539 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): get_auth_request con 0x7f5f000a0750 auth_method 0 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): get_auth_request con 0x7f5f0013b760 auth_method 0 2026-02-17T11:58:57.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:57.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient(hunting): handle_auth_done global_id 174152 payload 824 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 -- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 msgr2=0x7f5f0009ada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 0x7f5f0009ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 -- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 msgr2=0x7f5f0009b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 0x7f5f0009b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 monclient: found mon.noname-c 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5eff7fe640 1 -- 10.20.193.51:0/2583527539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0009d7b0 con 0x7f5f000a0750 2026-02-17T11:58:57.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.777+0000 7f5efffff640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 0x7f5f0009b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5eff7fe640 1 -- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 msgr2=0x7f5f0009a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5eff7fe640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009820 tx=0x7f5eec0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec046070 con 0x7f5f000a0750 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5edbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5edbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.779+0000 7f5edbfff640 10 monclient: dump: 2026-02-17T11:58:57.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:57.807 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: _finish_auth 0 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:57.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 5 monclient: authenticate success, global_id 174152 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _renew_subs 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec041870 con 0x7f5f000a0750 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f000967d0 con 0x7f5f000a0750 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec03c040 con 0x7f5f000a0750 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:57.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5efdffb640 4 set_mon_vals no callback set 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 10 monclient: dump: 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:58:57.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _renew_subs 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f0009c170 con 0x7f5f000a0750 2026-02-17T11:58:57.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0009dac0 con 0x7f5f000a0750 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5eec041c60 con 0x7f5f000a0750 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.780+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(475..475 src has 323..475) ==== 4903+0+0 (secure 0 0 0) 0x7f5eec0776d0 con 0x7f5f000a0750 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.781+0000 7f5efeffd640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:57.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.781+0000 7f5efeffd640 10 monclient: get_auth_request con 0x7f5ed003dd40 auth_method 0 2026-02-17T11:58:57.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.783+0000 7f5efeffd640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009bd70 tx=0x7f5ef0007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:57.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.783+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5eec050020 con 0x7f5f000a0750 2026-02-17T11:58:57.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.783+0000 7f5edbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:57.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.783+0000 7f5edbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.905+0000 7f5f05b72640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.905+0000 7f5f05b72640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.905+0000 7f5f05b72640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.905+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5f000008d0 con 0x7f5f000a0750 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5edbfff640 1 -- 10.20.193.51:0/2583527539 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f5f0009d7b0 con 0x7f5f000a0750 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5edbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:58:57.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5edbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:57.909 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 msgr2=0x7f5ed0040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009bd70 tx=0x7f5ef0007c20 comp rx=0 tx=0).stop 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 10 monclient: shutdown 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 msgr2=0x7f5f0009a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009820 tx=0x7f5eec0047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 shutdown_connections 2026-02-17T11:58:57.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f0013b760 0x7f5f0009b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f000a3bb0 0x7f5f0009ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 --2- 10.20.193.51:0/2583527539 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f0009a860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 >> 10.20.193.51:0/2583527539 conn(0x7f5f000a30c0 msgr2=0x7f5f00072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.906+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 shutdown_connections 2026-02-17T11:58:57.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:58:57.907+0000 7f5f05b72640 1 -- 10.20.193.51:0/2583527539 wait complete. 2026-02-17T11:59:00.918 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:00.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.985+0000 7f9f5106f640 10 monclient: get_monmap_and_config 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.985+0000 7f9f5106f640 10 monclient: build_initial_monmap 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.985+0000 7f9f5106f640 10 monclient: monmap: 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:00.986758+0000 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:00.986758+0000 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:00.990 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 Processor -- start 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 -- start start 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient: init 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:00.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9f4c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-c con 0x7f9f4c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-a con 0x7f9f4c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4c06e140 con 0x7f9f4c0a3bb0 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c09f910 con 0x7f9f4c13b760 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c09ccd0 con 0x7f9f4c0a0750 2026-02-17T11:59:00.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f5106f640 10 monclient(hunting): authenticate will time out at 1428.605505s 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4a575640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 msgr2=0x7f9f4c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4a575640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32976/0 (socket says 10.20.193.51:32976) 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4ad76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9f4c0a3bb0 0x7f9f4c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42548/0 (socket says 10.20.193.51:42548) 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 learned_addr learned my addr 10.20.193.51:0/1477240707 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 10 monclient(hunting): get_auth_request con 0x7f9f4c13b760 auth_method 0 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:00.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.986+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:00.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:00.988+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.51:6789/0 conn(0x7f9f4c0a3bb0 legacy=0x7f9f4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:01.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 msgr2=0x7f9f4c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4a575640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 10 monclient(hunting): get_auth_request con 0x7f9f4c13b760 auth_method 0 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:01.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:01.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:01.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.187+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:01.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 msgr2=0x7f9f4c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4a575640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 10 monclient(hunting): get_auth_request con 0x7f9f4c13b760 auth_method 0 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:01.588+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:02.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:02.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 10 monclient(hunting): get_auth_request con 0x7f9f4c13b760 auth_method 0 2026-02-17T11:59:02.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4b577640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 msgr2=0x7f9f4c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:02.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:02.389+0000 7f9f4a575640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): tick 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 monclient(hunting): continuing hunt 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 msgr2=0x7f9f4c09e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f4c0a0750 0x7f9f4c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:03.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 msgr2=0x7f9f4c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.51:3300/0 conn(0x7f9f4c13b760 0x7f9f4c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.51:6789/0 conn(0x7f9f4c0a3bb0 legacy=0x7f9f4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient: _add_conns ranks=[2,1] 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): picked mon.noname-b con 0x7f9f30003810 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9f30006390 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4c09eec0 con 0x7f9f30006390 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c09f910 con 0x7f9f30003810 2026-02-17T11:59:03.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f48d72640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.142:6789/0 conn(0x7f9f30006390 legacy=0x7f9f30008830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f30003810 auth_method 0 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:03.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:03.986+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:04.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.142:6789/0 conn(0x7f9f30006390 legacy=0x7f9f30008830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f30003810 auth_method 0 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:04.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.187+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:04.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.142:6789/0 conn(0x7f9f30006390 legacy=0x7f9f30008830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f30003810 auth_method 0 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:04.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:04.588+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:05.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.142:6789/0 conn(0x7f9f30006390 legacy=0x7f9f30008830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f30003810 auth_method 0 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:05.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:05.389+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:05.700 INFO:tasks.rados.rados.0.trial142.stdout:2059: done (1 left) 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2060: read oid 2 snap 220 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2060: expect deleted 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2061: snap_create 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2056: finishing write tid 1 to trial14245205-23 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2056: finishing write tid 2 to trial14245205-23 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2056: finishing write tid 3 to trial14245205-23 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2056: finishing write tid 4 to trial14245205-23 2026-02-17T11:59:05.701 INFO:tasks.rados.rados.0.trial142.stdout:2056: oid 23 updating version 0 to 1601 2026-02-17T11:59:05.702 INFO:tasks.rados.rados.0.trial142.stdout:2056: oid 23 updating version 1601 to 1603 2026-02-17T11:59:05.702 INFO:tasks.rados.rados.0.trial142.stdout:2056: oid 23 version 1603 is already newer than 1602 2026-02-17T11:59:05.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1603 (ObjNum 721 snap 225 seq_num 721) dirty exists 2026-02-17T11:59:05.702 INFO:tasks.rados.rados.0.trial142.stdout:2056: left oid 23 (ObjNum 721 snap 225 seq_num 721) 2026-02-17T11:59:06.702 INFO:tasks.rados.rados.0.trial142.stdout:2056: done (2 left) 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2060: done (1 left) 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2061: done (0 left) 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2062: read oid 15 snap -1 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2062: expect (ObjNum 554 snap 168 seq_num 554) 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2063: read oid 17 snap -1 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2063: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2064: read oid 47 snap -1 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2064: expect deleted 2026-02-17T11:59:06.703 INFO:tasks.rados.rados.0.trial142.stdout:2065: copy_from oid 39 from oid 30 current snap is 226 2026-02-17T11:59:06.704 INFO:tasks.rados.rados.0.trial142.stdout:2066: rollback oid 1 current snap is 226 2026-02-17T11:59:06.704 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 225 2026-02-17T11:59:06.704 INFO:tasks.rados.rados.0.trial142.stdout:2067: snap_create 2026-02-17T11:59:06.705 INFO:tasks.rados.rados.0.trial142.stdout:2065: finishing copy_from to trial14245205-39 2026-02-17T11:59:06.705 INFO:tasks.rados.rados.0.trial142.stdout:2065: got expected ENOENT (src dne) 2026-02-17T11:59:06.705 INFO:tasks.rados.rados.0.trial142.stdout:2065: finishing copy_from racing read to trial14245205-39 2026-02-17T11:59:06.707 INFO:tasks.rados.rados.0.trial142.stdout:2066: finishing rollback tid 0 to trial14245205-1 2026-02-17T11:59:06.707 INFO:tasks.rados.rados.0.trial142.stdout:2066: finishing rollback tid 1 to trial14245205-1 2026-02-17T11:59:06.707 INFO:tasks.rados.rados.0.trial142.stdout:2066: finishing rollback tid 2 to trial14245205-1 2026-02-17T11:59:06.707 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1052 (ObjNum 689 snap 214 seq_num 689) dirty exists 2026-02-17T11:59:06.708 INFO:tasks.rados.rados.0.trial142.stdout:2062: expect (ObjNum 554 snap 168 seq_num 554) 2026-02-17T11:59:06.788 INFO:tasks.rados.rados.0.trial142.stdout:2063: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): tick 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 monclient(hunting): continuing hunt 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 msgr2=0x7f9f30005c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f30003810 0x7f9f30005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.142:6789/0 conn(0x7f9f30006390 legacy=0x7f9f30008830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:06.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4b577640 1 -- 10.20.193.51:0/1477240707 reap_dead start 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 0x7f9f30005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): picked mon.noname-b con 0x7f9f3000a0d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 0x7f9f3000a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): picked mon.noname-c con 0x7f9f3000a550 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9f30008780 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3000b1e0 con 0x7f9f30008780 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c09f910 con 0x7f9f3000a550 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 1 -- 10.20.193.51:0/1477240707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c09ccd0 con 0x7f9f3000a0d0 2026-02-17T11:59:06.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f48d72640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4a575640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 msgr2=0x7f9f3000a9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4a575640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 0x7f9f3000a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 0x7f9f30005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f3000a0d0 auth_method 0 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_done global_id 174155 payload 274 2026-02-17T11:59:06.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 msgr2=0x7f9f3000a9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 0x7f9f3000a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> v1:10.20.193.51:6789/0 conn(0x7f9f30008780 legacy=0x7f9f30009000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 monclient: found mon.noname-b 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:06.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.987+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c09eec0 con 0x7f9f3000a0d0 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f4ad76640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 msgr2=0x7f9f30005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 0x7f9f30005c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007ca0 tx=0x7f9f4002fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465c9faa3c7b73e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 1 -- 10.20.193.51:0/1477240707 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f400317a0 con 0x7f9f3000a0d0 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: dump: 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 1 -- 10.20.193.51:0/1477240707 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f40031960 con 0x7f9f3000a0d0 2026-02-17T11:59:07.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 1 -- 10.20.193.51:0/1477240707 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40031d50 con 0x7f9f3000a0d0 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 5 monclient: authenticate success, global_id 174155 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 4 set_mon_vals no callback set 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f49d74640 10 monclient: dump: 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.004 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 10 monclient: shutdown 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 -- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 msgr2=0x7f9f30005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 0x7f9f30005c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007ca0 tx=0x7f9f4002fc90 comp rx=0 tx=0).stop 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 -- 10.20.193.51:0/1477240707 shutdown_connections 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 --2- 10.20.193.51:0/1477240707 >> v2:10.20.193.142:3300/0 conn(0x7f9f3000a550 0x7f9f3000a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 --2- 10.20.193.51:0/1477240707 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a0d0 0x7f9f30005c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 -- 10.20.193.51:0/1477240707 >> 10.20.193.51:0/1477240707 conn(0x7f9f4c0a30c0 msgr2=0x7f9f4c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.990+0000 7f9f5106f640 1 -- 10.20.193.51:0/1477240707 shutdown_connections 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 1 -- 10.20.193.51:0/1477240707 wait complete. 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 10 monclient: build_initial_monmap 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 10 monclient: monmap: 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:07.006 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 1 Processor -- start 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 1 -- start start 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.991+0000 7f9f5106f640 10 monclient: init 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-a con 0x7f9f30008780 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 0x7f9f4c09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-b con 0x7f9f3000a0d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:07.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a550 0x7f9f4c094600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): picked mon.noname-c con 0x7f9f3000a550 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c0a04b0 con 0x7f9f30008780 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c09c850 con 0x7f9f3000a0d0 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c09dac0 con 0x7f9f3000a550 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f5106f640 10 monclient(hunting): authenticate will time out at 1434.611204s 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56054/0 (socket says 10.20.193.51:56054) 2026-02-17T11:59:07.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 -- 10.20.193.51:0/3156116241 learned_addr learned my addr 10.20.193.51:0/3156116241 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request con 0x7f9f30008780 auth_method 0 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a550 0x7f9f4c094600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4a575640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 msgr2=0x7f9f4c09bf40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): get_auth_request con 0x7f9f3000a550 auth_method 0 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4a575640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 0x7f9f4c09bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient(hunting): handle_auth_done global_id 164292 payload 824 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a550 msgr2=0x7f9f4c094600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a550 0x7f9f4c094600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 msgr2=0x7f9f4c09bf40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 0x7f9f4c09bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:59:07.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 monclient: found mon.noname-a 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.992+0000 7f9f4ad76640 1 -- 10.20.193.51:0/3156116241 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c0984d0 con 0x7f9f30008780 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f4ad76640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 msgr2=0x7f9f4c09ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f4ad76640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f400028f0 tx=0x7f9f40002c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4004a030 con 0x7f9f30008780 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: dump: 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.011 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f400468a0 con 0x7f9f30008780 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 5 monclient: authenticate success, global_id 164292 2026-02-17T11:59:07.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40046a70 con 0x7f9f30008780 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f2b7fe640 10 monclient: dump: 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.013 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f49573640 4 set_mon_vals no callback set 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 10 monclient: _renew_subs 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0a2640 con 0x7f9f30008780 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 10 monclient: _renew_subs 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.994+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c09d7b0 con 0x7f9f30008780 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f5106f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f5106f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f5106f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c09de50 con 0x7f9f30008780 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9f40046c10 con 0x7f9f30008780 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f2b7fe640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 0x7f9f18040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.995+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(477..477 src has 323..477) ==== 4799+0+0 (secure 0 0 0) 0x7f9f40078a70 con 0x7f9f30008780 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.996+0000 7f9f4a575640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 0x7f9f18040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.996+0000 7f9f4a575640 10 monclient: get_auth_request con 0x7f9f1803dcc0 auth_method 0 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.998+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f40054070 con 0x7f9f30008780 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.998+0000 7f9f2b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.998+0000 7f9f2b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:07.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:06.999+0000 7f9f4a575640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 0x7f9f18040180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c095e20 tx=0x7f9f34007120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f5106f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:07.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f5106f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:07.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f5106f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f4c09de50 con 0x7f9f30008780 2026-02-17T11:59:07.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f2b7fe640 1 -- 10.20.193.51:0/3156116241 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f9f40030e50 con 0x7f9f30008780 2026-02-17T11:59:07.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f2b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:07.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.111+0000 7f9f2b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:07.114 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:07.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 msgr2=0x7f9f18040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 0x7f9f18040180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c095e20 tx=0x7f9f34007120 comp rx=0 tx=0).stop 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 10 monclient: shutdown 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 msgr2=0x7f9f4c09ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f400028f0 tx=0x7f9f40002c70 comp rx=0 tx=0).stop 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 shutdown_connections 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f1803dcc0 0x7f9f18040180 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f3000a550 0x7f9f4c094600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f3000a0d0 0x7f9f4c09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 --2- 10.20.193.51:0/3156116241 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f30008780 0x7f9f4c09ba00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 >> 10.20.193.51:0/3156116241 conn(0x7f9f4c0a30c0 msgr2=0x7f9f4c1c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 shutdown_connections 2026-02-17T11:59:07.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.112+0000 7f9f5106f640 1 -- 10.20.193.51:0/3156116241 wait complete. 2026-02-17T11:59:07.122 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:59:07.122 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:59:07.122 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:59:07.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 10 monclient: get_monmap_and_config 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 10 monclient: build_initial_monmap 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 10 monclient: monmap: 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:07.189469+0000 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:07.189469+0000 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:07.193 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 1 Processor -- start 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 1 -- start start 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.188+0000 7f77a77bc640 10 monclient: init 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f77a00a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:07.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 0x7f77a009fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-c con 0x7f77a009dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f77a00a0110 0x7f77a013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-a con 0x7f77a00a0110 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a006e140 con 0x7f77a00a3bb0 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f77a009aed0 con 0x7f77a00a0110 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f77a009caa0 con 0x7f77a009dac0 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a77bc640 10 monclient(hunting): authenticate will time out at 1434.808227s 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a4d30640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 msgr2=0x7f77a009fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:07.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5531640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f77a00a3bb0 0x7f77a009f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35946/0 (socket says 10.20.193.51:35946) 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5531640 1 -- 10.20.193.51:0/271608885 learned_addr learned my addr 10.20.193.51:0/271608885 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a4d30640 1 --2- 10.20.193.51:0/271608885 >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 0x7f77a009fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 --2- 10.20.193.51:0/271608885 >> v2:10.20.193.51:3300/0 conn(0x7f77a00a0110 0x7f77a013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): get_auth_request con 0x7f77a00a0110 auth_method 0 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient(hunting): handle_auth_done global_id 164295 payload 274 2026-02-17T11:59:07.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 -- 10.20.193.51:0/271608885 >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 msgr2=0x7f77a009fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 --2- 10.20.193.51:0/271608885 >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 0x7f77a009fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 -- 10.20.193.51:0/271608885 >> v1:10.20.193.51:6789/0 conn(0x7f77a00a3bb0 legacy=0x7f77a009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient: _finish_hunting 0 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 monclient: found mon.noname-a 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.189+0000 7f77a5d32640 1 -- 10.20.193.51:0/271608885 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a009ce60 con 0x7f77a00a0110 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.191+0000 7f77a5d32640 1 -- 10.20.193.51:0/271608885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 msgr2=0x7f77a013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.191+0000 7f77a5d32640 1 --2- 10.20.193.51:0/271608885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a013c760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77a009cc20 tx=0x7f779c02f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36844523f19e23a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 1 -- 10.20.193.51:0/271608885 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c03c070 con 0x7f77a00a0110 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:07.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: dump: 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 1 -- 10.20.193.51:0/271608885 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c037640 con 0x7f77a00a0110 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 5 monclient: authenticate success, global_id 164295 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 1 -- 10.20.193.51:0/271608885 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c037a10 con 0x7f77a00a0110 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 4 set_mon_vals no callback set 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f778ffff640 10 monclient: dump: 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 10 monclient: shutdown 2026-02-17T11:59:07.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 -- 10.20.193.51:0/271608885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 msgr2=0x7f77a013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 --2- 10.20.193.51:0/271608885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a013c760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77a009cc20 tx=0x7f779c02f170 comp rx=0 tx=0).stop 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 -- 10.20.193.51:0/271608885 shutdown_connections 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 --2- 10.20.193.51:0/271608885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a013c760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 --2- 10.20.193.51:0/271608885 >> v2:10.20.193.142:3300/0 conn(0x7f77a009dac0 0x7f77a009fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 -- 10.20.193.51:0/271608885 >> 10.20.193.51:0/271608885 conn(0x7f77a00a30c0 msgr2=0x7f77a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 -- 10.20.193.51:0/271608885 shutdown_connections 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 1 -- 10.20.193.51:0/271608885 wait complete. 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 10 monclient: build_initial_monmap 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.192+0000 7f77a77bc640 10 monclient: monmap: 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:07.209 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 Processor -- start 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 -- start start 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient: init 2026-02-17T11:59:07.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77a009dac0 0x7f77a01cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-b con 0x7f77a009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a0099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-a con 0x7f77a00a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 0x7f77a009a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): picked mon.noname-c con 0x7f77a00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00a0540 con 0x7f77a00a0110 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f77a009a880 con 0x7f77a009dac0 2026-02-17T11:59:07.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f77a013cca0 con 0x7f77a00a3bb0 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a77bc640 10 monclient(hunting): authenticate will time out at 1434.812505s 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a0099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5531640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77a009dac0 msgr2=0x7f77a01cce70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a0099b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56072/0 (socket says 10.20.193.51:56072) 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 1 -- 10.20.193.51:0/2708000145 learned_addr learned my addr 10.20.193.51:0/2708000145 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): get_auth_request con 0x7f77a00a0110 auth_method 0 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77a009dac0 0x7f77a01cce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 0x7f77a009a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): get_auth_request con 0x7f77a00a3bb0 auth_method 0 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient(hunting): handle_auth_done global_id 174161 payload 824 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77a009dac0 msgr2=0x7f77a01cce70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f77a009dac0 0x7f77a01cce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 msgr2=0x7f77a0099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a0099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient: _finish_hunting 0 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 monclient: found mon.noname-c 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a5d32640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a009d7b0 con 0x7f77a00a3bb0 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.193+0000 7f77a4d30640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a00a0110 0x7f77a0099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.195+0000 7f77a5d32640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 msgr2=0x7f77a009a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.195+0000 7f77a5d32640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 0x7f77a009a080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f779c036000 tx=0x7f779c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.195+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c047030 con 0x7f77a00a3bb0 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: dump: 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c042680 con 0x7f77a00a3bb0 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 5 monclient: authenticate success, global_id 174161 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 monclient: _renew_subs 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:07.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a0093000 con 0x7f77a00a3bb0 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c03c040 con 0x7f77a00a3bb0 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778f7fe640 4 set_mon_vals no callback set 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 10 monclient: dump: 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.217 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 monclient: _renew_subs 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a009ec30 con 0x7f77a00a3bb0 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77a013d0d0 con 0x7f77a008f6d0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f779c042ad0 con 0x7f77a00a3bb0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 msgr2=0x7f77a008fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 msgr2=0x7f77a008fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.196+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(477..477 src has 323..477) ==== 4799+0+0 (secure 0 0 0) 0x7f779c077bf0 con 0x7f77a00a3bb0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.197+0000 7f77a4d30640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.197+0000 7f77a4d30640 10 monclient: get_auth_request con 0x7f777003dcc0 auth_method 0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f77a4d30640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f77a0092c50 tx=0x7f7794008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f77a4d30640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 msgr2=0x7f7770040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:59:07.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f77a4d30640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 msgr2=0x7f7770040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:59:07.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f77a4d30640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f77a0092c50 tx=0x7f7794008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:07.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f77a4d30640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f77a0092c50 tx=0x7f7794008040 comp rx=0 tx=0).stop 2026-02-17T11:59:07.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 msgr2=0x7f7770040180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:07.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.199+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f777003dcc0 0x7f7770040180 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient: get_auth_request con 0x7f77a008f6d0 auth_method 0 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 10 monclient(hunting): handle_auth_done global_id 164301 payload 824 2026-02-17T11:59:07.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.397+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77a0091bb0 con 0x7f77a008f6d0 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 msgr2=0x7f77a008fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7790004910 tx=0x7f779000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790005de0 con 0x7f77a008f6d0 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 10 monclient: dump: 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.402 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7790017070 con 0x7f77a008f6d0 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:07.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 msgr2=0x7f77a008fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7790004910 tx=0x7f779000db90 comp rx=0 tx=0).stop 2026-02-17T11:59:07.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 msgr2=0x7f77a008fab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:07.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.399+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008f6d0 0x7f77a008fab0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7790004910 tx=0x7f779000db90 comp rx=0 tx=0).stop 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a77bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a77bc640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 0x7f77a01d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a77bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f77a01cd3b0 con 0x7f77a008fff0 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 0x7f77a01d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient: get_auth_request con 0x7f77a008fff0 auth_method 0 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 10 monclient(hunting): handle_auth_done global_id 164304 payload 824 2026-02-17T11:59:07.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.403+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77a0069830 con 0x7f77a008fff0 2026-02-17T11:59:07.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a5531640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 msgr2=0x7f77a01d81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a5531640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 0x7f77a01d81c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7790016000 tx=0x7f7790004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779000bbf0 con 0x7f77a008fff0 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 10 monclient: dump: 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.409 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4866 (secure 0 0 0) 0x7f779000bbf0 con 0x7f77a008fff0 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 msgr2=0x7f77a01d81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 0x7f77a01d81c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7790016000 tx=0x7f7790004b80 comp rx=0 tx=0).stop 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 msgr2=0x7f77a01d81c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f778dffb640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f77a008fff0 0x7f77a01d81c0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7790016000 tx=0x7f7790004b80 comp rx=0 tx=0).stop 2026-02-17T11:59:07.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a5d32640 1 -- 10.20.193.51:0/2708000145 reap_dead start 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 132, 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 91844, 2026-02-17T11:59:07.411 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.412 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.413 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:07.414 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:07.415 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.416 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:07.417 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.418 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.419 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.420 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.421 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.422 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.423 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.424 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:07.425 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:07.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 10 monclient: shutdown 2026-02-17T11:59:07.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 msgr2=0x7f77a009a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 0x7f77a009a080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f779c036000 tx=0x7f779c004b40 comp rx=0 tx=0).stop 2026-02-17T11:59:07.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 shutdown_connections 2026-02-17T11:59:07.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 --2- 10.20.193.51:0/2708000145 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f77a00a3bb0 0x7f77a009a080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 >> 10.20.193.51:0/2708000145 conn(0x7f77a00a30c0 msgr2=0x7f77a00a1960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 shutdown_connections 2026-02-17T11:59:07.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.406+0000 7f77a77bc640 1 -- 10.20.193.51:0/2708000145 wait complete. 2026-02-17T11:59:07.428 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:59:07.429 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T11:59:07.429 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:59:07.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: get_monmap_and_config 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: build_initial_monmap 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: monmap: 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:07.497145+0000 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:07.497145+0000 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.501 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 Processor -- start 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 -- start start 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: init 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T11:59:07.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 0x7f9e6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-c con 0x7f9e640a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9e640a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9e6413b760 0x7f9e6413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-a con 0x7f9e6413b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6406e140 con 0x7f9e640a0750 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6409f910 con 0x7f9e6413b760 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6409ccd0 con 0x7f9e640a3bb0 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.496+0000 7f9e6c379640 10 monclient(hunting): authenticate will time out at 1435.115947s 2026-02-17T11:59:07.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a0ee640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 msgr2=0x7f9e6409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a0ee640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 0x7f9e6409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9e6413b760 0x7f9e6413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e698ed640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9e640a0750 0x7f9e6409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35960/0 (socket says 10.20.193.51:35960) 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9e6413b760 0x7f9e6413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56092/0 (socket says 10.20.193.51:56092) 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e698ed640 1 -- 10.20.193.51:0/674096871 learned_addr learned my addr 10.20.193.51:0/674096871 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): get_auth_request con 0x7f9e6413b760 auth_method 0 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_done global_id 164307 payload 274 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/674096871 >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 msgr2=0x7f9e6409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 --2- 10.20.193.51:0/674096871 >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 0x7f9e6409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/674096871 >> v1:10.20.193.51:6789/0 conn(0x7f9e640a0750 legacy=0x7f9e6409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient: _finish_hunting 0 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 monclient: found mon.noname-a 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.497+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/674096871 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6409eec0 con 0x7f9e6413b760 2026-02-17T11:59:07.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/674096871 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e6413b760 msgr2=0x7f9e6413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6a8ef640 1 --2- 10.20.193.51:0/674096871 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e6413b760 0x7f9e6413db50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406c1c0 tx=0x7f9e6002f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1977cb51ac1f9a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 1 -- 10.20.193.51:0/674096871 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6003c070 con 0x7f9e6413b760 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: dump: 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.516 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6c379640 5 monclient: authenticate success, global_id 164307 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 1 -- 10.20.193.51:0/674096871 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60037640 con 0x7f9e6413b760 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6c379640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 1 -- 10.20.193.51:0/674096871 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60037a10 con 0x7f9e6413b760 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e690ec640 10 monclient: dump: 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.518 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6c379640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.499+0000 7f9e6c379640 4 set_mon_vals no callback set 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 10 monclient: shutdown 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 -- 10.20.193.51:0/674096871 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e6413b760 msgr2=0x7f9e6413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 --2- 10.20.193.51:0/674096871 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e6413b760 0x7f9e6413db50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406c1c0 tx=0x7f9e6002f150 comp rx=0 tx=0).stop 2026-02-17T11:59:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 -- 10.20.193.51:0/674096871 shutdown_connections 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 --2- 10.20.193.51:0/674096871 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e6413b760 0x7f9e6413db50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 --2- 10.20.193.51:0/674096871 >> v2:10.20.193.142:3300/0 conn(0x7f9e640a3bb0 0x7f9e6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 -- 10.20.193.51:0/674096871 >> 10.20.193.51:0/674096871 conn(0x7f9e640a30c0 msgr2=0x7f9e640a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 -- 10.20.193.51:0/674096871 shutdown_connections 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 1 -- 10.20.193.51:0/674096871 wait complete. 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 10 monclient: build_initial_monmap 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.500+0000 7f9e6c379640 10 monclient: monmap: 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:07.520 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 Processor -- start 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 -- start start 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient: init 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e640a0750 0x7f9e64099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-b con 0x7f9e640a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 0x7f9e640908b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-a con 0x7f9e640a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6413b760 0x7f9e64090df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): picked mon.noname-c con 0x7f9e6413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9e640a04b0 con 0x7f9e640a3bb0 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6409c850 con 0x7f9e640a0750 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6409e710 con 0x7f9e6413b760 2026-02-17T11:59:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6c379640 10 monclient(hunting): authenticate will time out at 1435.120371s 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a0ee640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e640a0750 msgr2=0x7f9e64099fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 0x7f9e640908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a0ee640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e640a0750 0x7f9e64099fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 0x7f9e640908b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56108/0 (socket says 10.20.193.51:56108) 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 -- 10.20.193.51:0/3440635712 learned_addr learned my addr 10.20.193.51:0/3440635712 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): get_auth_request con 0x7f9e640a3bb0 auth_method 0 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6413b760 0x7f9e64090df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): get_auth_request con 0x7f9e6413b760 auth_method 0 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e6a8ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient(hunting): handle_auth_done global_id 164310 payload 824 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6413b760 msgr2=0x7f9e64090df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6413b760 0x7f9e64090df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e640a0750 msgr2=0x7f9e64099fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9e640a0750 0x7f9e64099fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient: _finish_hunting 0 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 monclient: found mon.noname-a 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.501+0000 7f9e698ed640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e64094240 con 0x7f9e640a3bb0 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e698ed640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 msgr2=0x7f9e640908b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e698ed640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 0x7f9e640908b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800b530 tx=0x7f9e5800ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5800fa60 con 0x7f9e640a3bb0 2026-02-17T11:59:07.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: dump: 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.526 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: _finish_auth 0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5800fc00 con 0x7f9e640a3bb0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 5 monclient: authenticate success, global_id 164310 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 10 monclient: _renew_subs 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e640a2400 con 0x7f9e640a3bb0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58017400 con 0x7f9e640a3bb0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e4affd640 10 monclient: dump: 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e688eb640 4 set_mon_vals no callback set 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 10 monclient: _renew_subs 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.503+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e64093f60 con 0x7f9e640a3bb0 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6c379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6c379640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 0x7f9e6408d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9e640a2c10 con 0x7f9e64091330 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 0x7f9e6408d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient: get_auth_request con 0x7f9e64091330 auth_method 0 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9e580048e0 con 0x7f9e640a3bb0 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_done global_id 174167 payload 824 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a0ee640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e64091710 con 0x7f9e64091330 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e4affd640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e3403dcf0 0x7f9e340401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(477..477 src has 323..477) ==== 4799+0+0 (secure 0 0 0) 0x7f9e580526d0 con 0x7f9e640a3bb0 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a8ef640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e3403dcf0 0x7f9e340401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.504+0000 7f9e6a8ef640 10 monclient: get_auth_request con 0x7f9e3403dcf0 auth_method 0 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e6a0ee640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 msgr2=0x7f9e6408d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e6a0ee640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 0x7f9e6408d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e5400bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54005070 con 0x7f9e64091330 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.506+0000 7f9e4affd640 10 monclient: dump: 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9e54005070 con 0x7f9e64091330 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 msgr2=0x7f9e6408d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 0x7f9e6408d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e5400bcf0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 msgr2=0x7f9e6408d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e4affd640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e64091330 0x7f9e6408d3f0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e5400bcf0 comp rx=0 tx=0).stop 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.507+0000 7f9e6a8ef640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e3403dcf0 0x7f9e340401b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406f3c0 tx=0x7f9e60033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6c379640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6c379640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 0x7f9e6408dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6c379640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9e64093850 con 0x7f9e6408d930 2026-02-17T11:59:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 0x7f9e6408dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient: get_auth_request con 0x7f9e6408d930 auth_method 0 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 10 monclient(hunting): handle_auth_done global_id 174170 payload 824 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.510+0000 7f9e6a0ee640 1 -- 10.20.193.51:0/3440635712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9e6409dac0 con 0x7f9e6408d930 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e6a0ee640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 msgr2=0x7f9e6408dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e6a0ee640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 0x7f9e6408dd40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e54005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54005220 con 0x7f9e6408d930 2026-02-17T11:59:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 10 monclient: dump: 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7f9e54005220 con 0x7f9e6408d930 2026-02-17T11:59:07.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 msgr2=0x7f9e6408dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 0x7f9e6408dd40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e54005b20 comp rx=0 tx=0).stop 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 msgr2=0x7f9e6408dd40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.512+0000 7f9e4affd640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9e6408d930 0x7f9e6408dd40 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bcc0 tx=0x7f9e54005b20 comp rx=0 tx=0).stop 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 132, 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28278, 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:07.539 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.540 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.541 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:07.542 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.543 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:07.544 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:07.545 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:07.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e3403dcf0 msgr2=0x7f9e340401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9e3403dcf0 0x7f9e340401b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406f3c0 tx=0x7f9e60033000 comp rx=0 tx=0).stop 2026-02-17T11:59:07.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 10 monclient: shutdown 2026-02-17T11:59:07.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 msgr2=0x7f9e640908b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 --2- 10.20.193.51:0/3440635712 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9e640a3bb0 0x7f9e640908b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800b530 tx=0x7f9e5800ba00 comp rx=0 tx=0).stop 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/3440635712 reap_dead start 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6a8ef640 1 -- 10.20.193.51:0/3440635712 reap_dead start 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 shutdown_connections 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 >> 10.20.193.51:0/3440635712 conn(0x7f9e640a30c0 msgr2=0x7f9e6413acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 shutdown_connections 2026-02-17T11:59:07.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:07.513+0000 7f9e6c379640 1 -- 10.20.193.51:0/3440635712 wait complete. 2026-02-17T11:59:07.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:59:07.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2062: done (5 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2063: done (4 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2064: done (3 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2065: done (2 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2066: done (1 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2067: done (0 left) 2026-02-17T11:59:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2068: read oid 28 snap -1 2026-02-17T11:59:07.705 INFO:tasks.rados.rados.0.trial142.stdout:2068: expect deleted 2026-02-17T11:59:07.705 INFO:tasks.rados.rados.0.trial142.stdout:2069: snap_remove snap 209 2026-02-17T11:59:08.714 INFO:tasks.rados.rados.0.trial142.stdout:2069: done (1 left) 2026-02-17T11:59:08.715 INFO:tasks.rados.rados.0.trial142.stdout:2070: snap_remove snap 220 2026-02-17T11:59:09.715 INFO:tasks.rados.rados.0.trial142.stdout:2070: done (1 left) 2026-02-17T11:59:09.715 INFO:tasks.rados.rados.0.trial142.stdout:2071: read oid 26 snap -1 2026-02-17T11:59:09.715 INFO:tasks.rados.rados.0.trial142.stdout:2071: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:59:09.715 INFO:tasks.rados.rados.0.trial142.stdout:2072: rollback oid 21 current snap is 227 2026-02-17T11:59:09.716 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 212 2026-02-17T11:59:09.716 INFO:tasks.rados.rados.0.trial142.stdout:2068: done (2 left) 2026-02-17T11:59:09.716 INFO:tasks.rados.rados.0.trial142.stdout:2073: write (excl) oid 43 current snap is 227 2026-02-17T11:59:09.716 INFO:tasks.rados.rados.0.trial142.stdout:2073: seq_num 722 ranges {534654=466960,1766705=367949} 2026-02-17T11:59:09.719 INFO:tasks.rados.rados.0.trial142.stdout:2073: writing trial14245205-43 from 534654 to 1001614 tid 1 2026-02-17T11:59:09.724 INFO:tasks.rados.rados.0.trial142.stdout:2073: writing trial14245205-43 from 1766705 to 2134654 tid 2 2026-02-17T11:59:09.724 INFO:tasks.rados.rados.0.trial142.stdout:2074: snap_remove snap 224 2026-02-17T11:59:10.576 INFO:tasks.rados.rados.0.trial142.stdout:2074: done (3 left) 2026-02-17T11:59:10.576 INFO:tasks.rados.rados.0.trial142.stdout:2075: delete oid 13 current snap is 227 2026-02-17T11:59:10.577 INFO:tasks.rados.rados.0.trial142.stdout:2072: finishing rollback tid 0 to trial14245205-21 2026-02-17T11:59:10.577 INFO:tasks.rados.rados.0.trial142.stdout:2072: finishing rollback tid 1 to trial14245205-21 2026-02-17T11:59:10.577 INFO:tasks.rados.rados.0.trial142.stdout:2072: finishing rollback tid 2 to trial14245205-21 2026-02-17T11:59:10.577 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1007 (ObjNum 666 snap 210 seq_num 666) dirty exists 2026-02-17T11:59:10.577 INFO:tasks.rados.rados.0.trial142.stdout:2071: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2073: finishing write tid 1 to trial14245205-43 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2073: finishing write tid 2 to trial14245205-43 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2071: done (3 left) 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2072: done (2 left) 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2075: done (1 left) 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2076: rollback oid 31 current snap is 227 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 31 to 205 2026-02-17T11:59:10.688 INFO:tasks.rados.rados.0.trial142.stdout:2073: finishing write tid 3 to trial14245205-43 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: finishing write tid 4 to trial14245205-43 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: oid 43 updating version 0 to 1900 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: oid 43 version 1900 is already newer than 1899 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: oid 43 updating version 1900 to 1901 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1901 (ObjNum 722 snap 227 seq_num 722) dirty exists 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: left oid 43 (ObjNum 722 snap 227 seq_num 722) 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2073: done (1 left) 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2077: copy_from oid 20 from oid 41 current snap is 227 2026-02-17T11:59:10.689 INFO:tasks.rados.rados.0.trial142.stdout:2078: delete oid 1 current snap is 227 2026-02-17T11:59:10.690 INFO:tasks.rados.rados.0.trial142.stdout:2076: finishing rollback tid 0 to trial14245205-31 2026-02-17T11:59:10.690 INFO:tasks.rados.rados.0.trial142.stdout:2076: finishing rollback tid 1 to trial14245205-31 2026-02-17T11:59:10.690 INFO:tasks.rados.rados.0.trial142.stdout:2076: finishing rollback tid 2 to trial14245205-31 2026-02-17T11:59:10.690 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1598 (ObjNum 626 snap 196 seq_num 626) dirty exists 2026-02-17T11:59:10.692 INFO:tasks.rados.rados.0.trial142.stdout:2077: finishing copy_from to trial14245205-20 2026-02-17T11:59:10.692 INFO:tasks.rados.rados.0.trial142.stdout:2077: got expected ENOENT (src dne) 2026-02-17T11:59:10.692 INFO:tasks.rados.rados.0.trial142.stdout:2077: finishing copy_from racing read to trial14245205-20 2026-02-17T11:59:10.693 INFO:tasks.rados.rados.0.trial142.stdout:2076: done (2 left) 2026-02-17T11:59:10.693 INFO:tasks.rados.rados.0.trial142.stdout:2077: done (1 left) 2026-02-17T11:59:10.693 INFO:tasks.rados.rados.0.trial142.stdout:2078: done (0 left) 2026-02-17T11:59:10.694 INFO:tasks.rados.rados.0.trial142.stdout:2079: read oid 5 snap -1 2026-02-17T11:59:10.694 INFO:tasks.rados.rados.0.trial142.stdout:2079: expect (ObjNum 716 snap 225 seq_num 716) 2026-02-17T11:59:10.694 INFO:tasks.rados.rados.0.trial142.stdout:2080: snap_remove snap 205 2026-02-17T11:59:11.578 INFO:tasks.rados.rados.0.trial142.stdout:2080: done (1 left) 2026-02-17T11:59:11.578 INFO:tasks.rados.rados.0.trial142.stdout:2081: delete oid 26 current snap is 227 2026-02-17T11:59:11.579 INFO:tasks.rados.rados.0.trial142.stdout:2079: expect (ObjNum 716 snap 225 seq_num 716) 2026-02-17T11:59:11.637 INFO:tasks.rados.rados.0.trial142.stdout:2079: done (1 left) 2026-02-17T11:59:11.637 INFO:tasks.rados.rados.0.trial142.stdout:2081: done (0 left) 2026-02-17T11:59:11.637 INFO:tasks.rados.rados.0.trial142.stdout:2082: snap_remove snap 223 2026-02-17T11:59:12.670 INFO:tasks.rados.rados.0.trial142.stdout:2082: done (0 left) 2026-02-17T11:59:12.671 INFO:tasks.rados.rados.0.trial142.stdout:2083: read oid 46 snap -1 2026-02-17T11:59:12.671 INFO:tasks.rados.rados.0.trial142.stdout:2083: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:12.671 INFO:tasks.rados.rados.0.trial142.stdout:2084: copy_from oid 25 from oid 13 current snap is 227 2026-02-17T11:59:12.671 INFO:tasks.rados.rados.0.trial142.stdout:2085: copy_from oid 9 from oid 40 current snap is 227 2026-02-17T11:59:12.671 INFO:tasks.rados.rados.0.trial142.stdout:2086: snap_create 2026-02-17T11:59:12.673 INFO:tasks.rados.rados.0.trial142.stdout:2084: finishing copy_from to trial14245205-25 2026-02-17T11:59:12.673 INFO:tasks.rados.rados.0.trial142.stdout:2084: got expected ENOENT (src dne) 2026-02-17T11:59:12.673 INFO:tasks.rados.rados.0.trial142.stdout:2084: finishing copy_from racing read to trial14245205-25 2026-02-17T11:59:12.677 INFO:tasks.rados.rados.0.trial142.stdout:2083: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:12.776 INFO:tasks.rados.rados.0.trial142.stdout:2085: finishing copy_from to trial14245205-9 2026-02-17T11:59:12.776 INFO:tasks.rados.rados.0.trial142.stdout:2085: got expected ENOENT (src dne) 2026-02-17T11:59:12.777 INFO:tasks.rados.rados.0.trial142.stdout:2085: finishing copy_from racing read to trial14245205-9 2026-02-17T11:59:13.581 INFO:tasks.rados.rados.0.trial142.stdout:2083: done (3 left) 2026-02-17T11:59:13.581 INFO:tasks.rados.rados.0.trial142.stdout:2084: done (2 left) 2026-02-17T11:59:13.581 INFO:tasks.rados.rados.0.trial142.stdout:2085: done (1 left) 2026-02-17T11:59:13.581 INFO:tasks.rados.rados.0.trial142.stdout:2086: done (0 left) 2026-02-17T11:59:13.581 INFO:tasks.rados.rados.0.trial142.stdout:2087: snap_create 2026-02-17T11:59:14.581 INFO:tasks.rados.rados.0.trial142.stdout:2087: done (0 left) 2026-02-17T11:59:14.582 INFO:tasks.rados.rados.0.trial142.stdout:2088: write (excl) oid 1 current snap is 229 2026-02-17T11:59:14.582 INFO:tasks.rados.rados.0.trial142.stdout:2088: seq_num 726 ranges {601882=484309,1600633=524904} 2026-02-17T11:59:14.586 INFO:tasks.rados.rados.0.trial142.stdout:2088: writing trial14245205-1 from 601882 to 1086191 tid 1 2026-02-17T11:59:14.590 INFO:tasks.rados.rados.0.trial142.stdout:2088: writing trial14245205-1 from 1600633 to 2125537 tid 2 2026-02-17T11:59:14.590 INFO:tasks.rados.rados.0.trial142.stdout:2089: snap_remove snap 211 2026-02-17T11:59:15.577 INFO:tasks.rados.rados.0.trial142.stdout:2089: done (1 left) 2026-02-17T11:59:15.577 INFO:tasks.rados.rados.0.trial142.stdout:2090: read oid 3 snap 212 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2090: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2091: copy_from oid 48 from oid 38 current snap is 229 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: finishing write tid 1 to trial14245205-1 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: finishing write tid 2 to trial14245205-1 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: finishing write tid 3 to trial14245205-1 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: finishing write tid 4 to trial14245205-1 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: oid 1 updating version 0 to 1056 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: oid 1 version 1056 is already newer than 1055 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: oid 1 version 1056 is already newer than 1054 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1056 (ObjNum 726 snap 229 seq_num 726) dirty exists 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: left oid 1 (ObjNum 726 snap 229 seq_num 726) 2026-02-17T11:59:15.578 INFO:tasks.rados.rados.0.trial142.stdout:2088: done (2 left) 2026-02-17T11:59:15.579 INFO:tasks.rados.rados.0.trial142.stdout:2092: read oid 17 snap -1 2026-02-17T11:59:15.579 INFO:tasks.rados.rados.0.trial142.stdout:2092: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:15.579 INFO:tasks.rados.rados.0.trial142.stdout:2093: snap_remove snap 228 2026-02-17T11:59:16.579 INFO:tasks.rados.rados.0.trial142.stdout:2093: done (3 left) 2026-02-17T11:59:16.579 INFO:tasks.rados.rados.0.trial142.stdout:2094: delete oid 28 current snap is 229 2026-02-17T11:59:16.580 INFO:tasks.rados.rados.0.trial142.stdout:2090: expect (ObjNum 558 snap 168 seq_num 558) 2026-02-17T11:59:16.658 INFO:tasks.rados.rados.0.trial142.stdout:2092: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:16.713 INFO:tasks.rados.rados.0.trial142.stdout:2091: finishing copy_from racing read to trial14245205-48 2026-02-17T11:59:16.713 INFO:tasks.rados.rados.0.trial142.stdout:2091: finishing copy_from to trial14245205-48 2026-02-17T11:59:16.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1124 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:59:16.714 INFO:tasks.rados.rados.0.trial142.stdout:2090: done (3 left) 2026-02-17T11:59:16.714 INFO:tasks.rados.rados.0.trial142.stdout:2091: done (2 left) 2026-02-17T11:59:16.714 INFO:tasks.rados.rados.0.trial142.stdout:2092: done (1 left) 2026-02-17T11:59:16.714 INFO:tasks.rados.rados.0.trial142.stdout:2094: done (0 left) 2026-02-17T11:59:16.714 INFO:tasks.rados.rados.0.trial142.stdout:2095: snap_remove snap 226 2026-02-17T11:59:17.584 INFO:tasks.rados.rados.0.trial142.stdout:2095: done (0 left) 2026-02-17T11:59:17.585 INFO:tasks.rados.rados.0.trial142.stdout:2096: delete oid 22 current snap is 229 2026-02-17T11:59:17.589 INFO:tasks.rados.rados.0.trial142.stdout:2096: done (0 left) 2026-02-17T11:59:17.589 INFO:tasks.rados.rados.0.trial142.stdout:2097: copy_from oid 5 from oid 48 current snap is 229 2026-02-17T11:59:17.589 INFO:tasks.rados.rados.0.trial142.stdout:2098: copy_from oid 15 from oid 35 current snap is 229 2026-02-17T11:59:17.589 INFO:tasks.rados.rados.0.trial142.stdout:2099: rollback oid 44 current snap is 229 2026-02-17T11:59:17.590 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 227 2026-02-17T11:59:17.590 INFO:tasks.rados.rados.0.trial142.stdout:2100: snap_create 2026-02-17T11:59:17.590 INFO:tasks.rados.rados.0.trial142.stdout:2099: finishing rollback tid 1 to trial14245205-44 2026-02-17T11:59:17.590 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T11:59:17.596 INFO:tasks.rados.rados.0.trial142.stdout:2098: finishing copy_from racing read to trial14245205-15 2026-02-17T11:59:17.599 INFO:tasks.rados.rados.0.trial142.stdout:2098: finishing copy_from to trial14245205-15 2026-02-17T11:59:17.599 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 1591 (ObjNum 701 snap 219 seq_num 701) dirty exists 2026-02-17T11:59:17.600 INFO:tasks.rados.rados.0.trial142.stdout:2097: finishing copy_from racing read to trial14245205-5 2026-02-17T11:59:17.601 INFO:tasks.rados.rados.0.trial142.stdout:2097: finishing copy_from to trial14245205-5 2026-02-17T11:59:17.601 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1124 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:59:18.588 INFO:tasks.rados.rados.0.trial142.stdout:2097: done (3 left) 2026-02-17T11:59:18.589 INFO:tasks.rados.rados.0.trial142.stdout:2098: done (2 left) 2026-02-17T11:59:18.589 INFO:tasks.rados.rados.0.trial142.stdout:2099: done (1 left) 2026-02-17T11:59:18.589 INFO:tasks.rados.rados.0.trial142.stdout:2100: done (0 left) 2026-02-17T11:59:18.589 INFO:tasks.rados.rados.0.trial142.stdout:2101: write oid 49 current snap is 230 2026-02-17T11:59:18.589 INFO:tasks.rados.rados.0.trial142.stdout:2101: seq_num 729 ranges {652303=710056,2059726=192577} 2026-02-17T11:59:18.594 INFO:tasks.rados.rados.0.trial142.stdout:2101: writing trial14245205-49 from 652303 to 1362359 tid 1 2026-02-17T11:59:18.597 INFO:tasks.rados.rados.0.trial142.stdout:2101: writing trial14245205-49 from 2059726 to 2252303 tid 2 2026-02-17T11:59:18.598 INFO:tasks.rados.rados.0.trial142.stdout:2102: rollback oid 26 current snap is 230 2026-02-17T11:59:18.598 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 227 2026-02-17T11:59:18.598 INFO:tasks.rados.rados.0.trial142.stdout:2101: finishing write tid 1 to trial14245205-49 2026-02-17T11:59:18.598 INFO:tasks.rados.rados.0.trial142.stdout:2103: delete oid 19 current snap is 230 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: finishing write tid 2 to trial14245205-49 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: finishing write tid 3 to trial14245205-49 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: finishing write tid 4 to trial14245205-49 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: oid 49 updating version 0 to 1934 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: oid 49 version 1934 is already newer than 1933 2026-02-17T11:59:18.599 INFO:tasks.rados.rados.0.trial142.stdout:2101: oid 49 version 1934 is already newer than 1932 2026-02-17T11:59:18.600 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1934 (ObjNum 729 snap 230 seq_num 729) dirty exists 2026-02-17T11:59:18.600 INFO:tasks.rados.rados.0.trial142.stdout:2101: left oid 49 (ObjNum 729 snap 230 seq_num 729) 2026-02-17T11:59:18.600 INFO:tasks.rados.rados.0.trial142.stdout:2102: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:59:18.600 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1491 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:59:18.601 INFO:tasks.rados.rados.0.trial142.stdout:2101: done (2 left) 2026-02-17T11:59:18.601 INFO:tasks.rados.rados.0.trial142.stdout:2102: done (1 left) 2026-02-17T11:59:18.601 INFO:tasks.rados.rados.0.trial142.stdout:2103: done (0 left) 2026-02-17T11:59:18.601 INFO:tasks.rados.rados.0.trial142.stdout:2104: copy_from oid 31 from oid 33 current snap is 230 2026-02-17T11:59:18.601 INFO:tasks.rados.rados.0.trial142.stdout:2105: snap_remove snap 227 2026-02-17T11:59:19.589 INFO:tasks.rados.rados.0.trial142.stdout:2105: done (1 left) 2026-02-17T11:59:19.589 INFO:tasks.rados.rados.0.trial142.stdout:2106: read oid 34 snap -1 2026-02-17T11:59:19.589 INFO:tasks.rados.rados.0.trial142.stdout:2106: expect (ObjNum 696 snap 216 seq_num 696) 2026-02-17T11:59:19.590 INFO:tasks.rados.rados.0.trial142.stdout:2107: write oid 8 current snap is 230 2026-02-17T11:59:19.590 INFO:tasks.rados.rados.0.trial142.stdout:2107: seq_num 731 ranges {685917=576907,1893043=392874} 2026-02-17T11:59:19.594 INFO:tasks.rados.rados.0.trial142.stdout:2107: writing trial14245205-8 from 685917 to 1262824 tid 1 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2107: writing trial14245205-8 from 1893043 to 2285917 tid 2 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2108: snap_create 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2104: finishing copy_from to trial14245205-31 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2104: got expected ENOENT (src dne) 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2104: finishing copy_from racing read to trial14245205-31 2026-02-17T11:59:19.599 INFO:tasks.rados.rados.0.trial142.stdout:2106: expect (ObjNum 696 snap 216 seq_num 696) 2026-02-17T11:59:19.681 INFO:tasks.rados.rados.0.trial142.stdout:2107: finishing write tid 1 to trial14245205-8 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: finishing write tid 2 to trial14245205-8 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: finishing write tid 3 to trial14245205-8 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: finishing write tid 4 to trial14245205-8 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: oid 8 updating version 0 to 1600 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: oid 8 updating version 1600 to 1601 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: oid 8 version 1601 is already newer than 1599 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1601 (ObjNum 731 snap 230 seq_num 731) dirty exists 2026-02-17T11:59:19.682 INFO:tasks.rados.rados.0.trial142.stdout:2107: left oid 8 (ObjNum 731 snap 230 seq_num 731) 2026-02-17T11:59:20.577 INFO:tasks.rados.rados.0.trial142.stdout:2104: done (3 left) 2026-02-17T11:59:20.577 INFO:tasks.rados.rados.0.trial142.stdout:2106: done (2 left) 2026-02-17T11:59:20.577 INFO:tasks.rados.rados.0.trial142.stdout:2107: done (1 left) 2026-02-17T11:59:20.578 INFO:tasks.rados.rados.0.trial142.stdout:2108: done (0 left) 2026-02-17T11:59:20.578 INFO:tasks.rados.rados.0.trial142.stdout:2109: snap_create 2026-02-17T11:59:21.580 INFO:tasks.rados.rados.0.trial142.stdout:2109: done (0 left) 2026-02-17T11:59:21.581 INFO:tasks.rados.rados.0.trial142.stdout:2110: copy_from oid 45 from oid 44 current snap is 232 2026-02-17T11:59:21.581 INFO:tasks.rados.rados.0.trial142.stdout:2111: copy_from oid 33 from oid 46 current snap is 232 2026-02-17T11:59:21.581 INFO:tasks.rados.rados.0.trial142.stdout:2112: write oid 26 current snap is 232 2026-02-17T11:59:21.581 INFO:tasks.rados.rados.0.trial142.stdout:2112: seq_num 732 ranges {702724=652156,1951525=351199} 2026-02-17T11:59:21.585 INFO:tasks.rados.rados.0.trial142.stdout:2112: writing trial14245205-26 from 702724 to 1354880 tid 1 2026-02-17T11:59:21.589 INFO:tasks.rados.rados.0.trial142.stdout:2112: writing trial14245205-26 from 1951525 to 2302724 tid 2 2026-02-17T11:59:21.589 INFO:tasks.rados.rados.0.trial142.stdout:2113: write (excl) oid 2 current snap is 232 2026-02-17T11:59:21.589 INFO:tasks.rados.rados.0.trial142.stdout:2113: seq_num 733 ranges {719531=727405,1893654=425877} 2026-02-17T11:59:21.594 INFO:tasks.rados.rados.0.trial142.stdout:2113: writing trial14245205-2 from 719531 to 1446936 tid 1 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2113: writing trial14245205-2 from 1893654 to 2319531 tid 2 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2114: snap_create 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2110: finishing copy_from to trial14245205-45 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2110: got expected ENOENT (src dne) 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2110: finishing copy_from racing read to trial14245205-45 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2112: finishing write tid 1 to trial14245205-26 2026-02-17T11:59:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2111: finishing copy_from racing read to trial14245205-33 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: finishing write tid 2 to trial14245205-26 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: finishing write tid 3 to trial14245205-26 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: finishing write tid 4 to trial14245205-26 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: oid 26 updating version 0 to 1494 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: oid 26 version 1494 is already newer than 1493 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: oid 26 version 1494 is already newer than 1492 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1494 (ObjNum 732 snap 232 seq_num 732) dirty exists 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2112: left oid 26 (ObjNum 732 snap 232 seq_num 732) 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:2111: finishing copy_from to trial14245205-33 2026-02-17T11:59:21.599 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1796 (ObjNum 668 snap 210 seq_num 668) dirty exists 2026-02-17T11:59:21.600 INFO:tasks.rados.rados.0.trial142.stdout:2113: finishing write tid 1 to trial14245205-2 2026-02-17T11:59:21.600 INFO:tasks.rados.rados.0.trial142.stdout:2113: finishing write tid 2 to trial14245205-2 2026-02-17T11:59:21.600 INFO:tasks.rados.rados.0.trial142.stdout:2113: finishing write tid 3 to trial14245205-2 2026-02-17T11:59:21.600 INFO:tasks.rados.rados.0.trial142.stdout:2113: finishing write tid 4 to trial14245205-2 2026-02-17T11:59:21.601 INFO:tasks.rados.rados.0.trial142.stdout:2113: oid 2 updating version 0 to 1233 2026-02-17T11:59:21.601 INFO:tasks.rados.rados.0.trial142.stdout:2113: oid 2 version 1233 is already newer than 1232 2026-02-17T11:59:21.601 INFO:tasks.rados.rados.0.trial142.stdout:2113: oid 2 version 1233 is already newer than 1231 2026-02-17T11:59:21.601 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1233 (ObjNum 733 snap 232 seq_num 733) dirty exists 2026-02-17T11:59:21.601 INFO:tasks.rados.rados.0.trial142.stdout:2113: left oid 2 (ObjNum 733 snap 232 seq_num 733) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2110: done (4 left) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2111: done (3 left) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2112: done (2 left) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2113: done (1 left) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2114: done (0 left) 2026-02-17T11:59:22.596 INFO:tasks.rados.rados.0.trial142.stdout:2115: read oid 40 snap -1 2026-02-17T11:59:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2115: expect deleted 2026-02-17T11:59:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2116: snap_create 2026-02-17T11:59:23.596 INFO:tasks.rados.rados.0.trial142.stdout:2115: done (1 left) 2026-02-17T11:59:23.596 INFO:tasks.rados.rados.0.trial142.stdout:2116: done (0 left) 2026-02-17T11:59:23.596 INFO:tasks.rados.rados.0.trial142.stdout:2117: snap_remove snap 225 2026-02-17T11:59:24.600 INFO:tasks.rados.rados.0.trial142.stdout:2117: done (0 left) 2026-02-17T11:59:24.601 INFO:tasks.rados.rados.0.trial142.stdout:2118: snap_remove snap 230 2026-02-17T11:59:25.578 INFO:tasks.rados.rados.0.trial142.stdout:2118: done (0 left) 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2119: read oid 11 snap -1 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2119: expect (ObjNum 644 snap 199 seq_num 644) 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2120: copy_from oid 49 from oid 5 current snap is 234 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2121: read oid 27 snap -1 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2121: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2122: write oid 16 current snap is 234 2026-02-17T11:59:25.579 INFO:tasks.rados.rados.0.trial142.stdout:2122: seq_num 734 ranges {736338=402654,1552136=539580} 2026-02-17T11:59:25.582 INFO:tasks.rados.rados.0.trial142.stdout:2122: writing trial14245205-16 from 736338 to 1138992 tid 1 2026-02-17T11:59:25.586 INFO:tasks.rados.rados.0.trial142.stdout:2122: writing trial14245205-16 from 1552136 to 2091716 tid 2 2026-02-17T11:59:25.586 INFO:tasks.rados.rados.0.trial142.stdout:2123: write (excl) oid 9 current snap is 234 2026-02-17T11:59:25.586 INFO:tasks.rados.rados.0.trial142.stdout:2123: seq_num 735 ranges {753145=477903,2010618=342527} 2026-02-17T11:59:25.590 INFO:tasks.rados.rados.0.trial142.stdout:2123: writing trial14245205-9 from 753145 to 1231048 tid 1 2026-02-17T11:59:25.595 INFO:tasks.rados.rados.0.trial142.stdout:2123: writing trial14245205-9 from 2010618 to 2353145 tid 2 2026-02-17T11:59:25.595 INFO:tasks.rados.rados.0.trial142.stdout:2124: rollback oid 38 current snap is 234 2026-02-17T11:59:25.595 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 186 2026-02-17T11:59:25.595 INFO:tasks.rados.rados.0.trial142.stdout:2121: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T11:59:25.725 INFO:tasks.rados.rados.0.trial142.stdout:2119: expect (ObjNum 644 snap 199 seq_num 644) 2026-02-17T11:59:25.818 INFO:tasks.rados.rados.0.trial142.stdout:2122: finishing write tid 1 to trial14245205-16 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: finishing write tid 2 to trial14245205-16 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: finishing write tid 3 to trial14245205-16 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: finishing write tid 4 to trial14245205-16 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: oid 16 updating version 0 to 1129 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: oid 16 updating version 1129 to 1130 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: oid 16 version 1130 is already newer than 1128 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1130 (ObjNum 734 snap 234 seq_num 734) dirty exists 2026-02-17T11:59:25.819 INFO:tasks.rados.rados.0.trial142.stdout:2122: left oid 16 (ObjNum 734 snap 234 seq_num 734) 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2120: finishing copy_from racing read to trial14245205-49 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2120: finishing copy_from to trial14245205-49 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1124 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2123: finishing write tid 1 to trial14245205-9 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2123: finishing write tid 2 to trial14245205-9 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2119: done (5 left) 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2120: done (4 left) 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2121: done (3 left) 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2122: done (2 left) 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2125: copy_from oid 34 from oid 43 current snap is 234 2026-02-17T11:59:25.820 INFO:tasks.rados.rados.0.trial142.stdout:2123: finishing write tid 3 to trial14245205-9 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2123: finishing write tid 4 to trial14245205-9 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2123: oid 9 updating version 0 to 1942 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2123: oid 9 version 1942 is already newer than 1941 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2123: oid 9 version 1942 is already newer than 1940 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 1942 (ObjNum 735 snap 234 seq_num 735) dirty exists 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2123: left oid 9 (ObjNum 735 snap 234 seq_num 735) 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2124: finishing rollback tid 0 to trial14245205-38 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:2124: finishing rollback tid 1 to trial14245205-38 2026-02-17T11:59:25.821 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1126 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T11:59:25.822 INFO:tasks.rados.rados.0.trial142.stdout:2123: done (2 left) 2026-02-17T11:59:25.822 INFO:tasks.rados.rados.0.trial142.stdout:2124: done (1 left) 2026-02-17T11:59:25.822 INFO:tasks.rados.rados.0.trial142.stdout:2126: copy_from oid 30 from oid 10 current snap is 234 2026-02-17T11:59:25.822 INFO:tasks.rados.rados.0.trial142.stdout:2127: write (excl) oid 20 current snap is 234 2026-02-17T11:59:25.822 INFO:tasks.rados.rados.0.trial142.stdout:2127: seq_num 736 ranges {769952=553152,2069100=300852} 2026-02-17T11:59:25.823 INFO:tasks.rados.rados.0.trial142.stdout:2127: writing trial14245205-20 from 769952 to 1323104 tid 1 2026-02-17T11:59:25.827 INFO:tasks.rados.rados.0.trial142.stdout:2127: writing trial14245205-20 from 2069100 to 2369952 tid 2 2026-02-17T11:59:25.827 INFO:tasks.rados.rados.0.trial142.stdout:2128: delete oid 46 current snap is 234 2026-02-17T11:59:25.827 INFO:tasks.rados.rados.0.trial142.stdout:2126: finishing copy_from to trial14245205-30 2026-02-17T11:59:25.827 INFO:tasks.rados.rados.0.trial142.stdout:2126: got expected ENOENT (src dne) 2026-02-17T11:59:25.827 INFO:tasks.rados.rados.0.trial142.stdout:2126: finishing copy_from racing read to trial14245205-30 2026-02-17T11:59:25.828 INFO:tasks.rados.rados.0.trial142.stdout:2125: finishing copy_from racing read to trial14245205-34 2026-02-17T11:59:25.828 INFO:tasks.rados.rados.0.trial142.stdout:2125: finishing copy_from to trial14245205-34 2026-02-17T11:59:25.828 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1901 (ObjNum 722 snap 227 seq_num 722) dirty exists 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:2125: done (3 left) 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:2126: done (2 left) 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:2128: done (1 left) 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:2129: rollback oid 27 current snap is 234 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 231 2026-02-17T11:59:25.829 INFO:tasks.rados.rados.0.trial142.stdout:2130: write oid 35 current snap is 234 2026-02-17T11:59:25.830 INFO:tasks.rados.rados.0.trial142.stdout:2130: seq_num 738 ranges {403566=420003,1386064=546918} 2026-02-17T11:59:25.832 INFO:tasks.rados.rados.0.trial142.stdout:2130: writing trial14245205-35 from 403566 to 823569 tid 1 2026-02-17T11:59:25.836 INFO:tasks.rados.rados.0.trial142.stdout:2130: writing trial14245205-35 from 1386064 to 1932982 tid 2 2026-02-17T11:59:25.836 INFO:tasks.rados.rados.0.trial142.stdout:2131: write oid 11 current snap is 234 2026-02-17T11:59:25.836 INFO:tasks.rados.rados.0.trial142.stdout:2131: seq_num 739 ranges {420373=495252,1444546=690576} 2026-02-17T11:59:25.839 INFO:tasks.rados.rados.0.trial142.stdout:2131: writing trial14245205-11 from 420373 to 915625 tid 1 2026-02-17T11:59:25.844 INFO:tasks.rados.rados.0.trial142.stdout:2131: writing trial14245205-11 from 1444546 to 2135122 tid 2 2026-02-17T11:59:25.844 INFO:tasks.rados.rados.0.trial142.stdout:2132: snap_remove snap 229 2026-02-17T11:59:26.604 INFO:tasks.rados.rados.0.trial142.stdout:2132: done (4 left) 2026-02-17T11:59:26.604 INFO:tasks.rados.rados.0.trial142.stdout:2133: read oid 16 snap -1 2026-02-17T11:59:26.604 INFO:tasks.rados.rados.0.trial142.stdout:2133: expect (ObjNum 734 snap 234 seq_num 734) 2026-02-17T11:59:26.604 INFO:tasks.rados.rados.0.trial142.stdout:2134: snap_remove snap 186 2026-02-17T11:59:27.548 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T11:59:27.549 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T11:59:27.549 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:59:27.549 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T11:59:27.552 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:59:27.552 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:59:27.552 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:27.607 INFO:tasks.rados.rados.0.trial142.stdout:2134: done (5 left) 2026-02-17T11:59:27.607 INFO:tasks.rados.rados.0.trial142.stdout:2135: read oid 14 snap 212 2026-02-17T11:59:27.607 INFO:tasks.rados.rados.0.trial142.stdout:2135: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:59:27.607 INFO:tasks.rados.rados.0.trial142.stdout:2136: read oid 24 snap -1 2026-02-17T11:59:27.608 INFO:tasks.rados.rados.0.trial142.stdout:2136: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:59:27.608 INFO:tasks.rados.rados.0.trial142.stdout:2137: write (excl) oid 5 current snap is 234 2026-02-17T11:59:27.608 INFO:tasks.rados.rados.0.trial142.stdout:2137: seq_num 740 ranges {437180=570501,1503028=550587} 2026-02-17T11:59:27.611 INFO:tasks.rados.rados.0.trial142.stdout:2137: writing trial14245205-5 from 437180 to 1007681 tid 1 2026-02-17T11:59:27.616 INFO:tasks.rados.rados.0.trial142.stdout:2137: writing trial14245205-5 from 1503028 to 2053615 tid 2 2026-02-17T11:59:27.616 INFO:tasks.rados.rados.0.trial142.stdout:2138: delete oid 47 current snap is 234 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2129: finishing rollback tid 0 to trial14245205-27 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: finishing write tid 1 to trial14245205-20 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: finishing write tid 2 to trial14245205-20 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: finishing write tid 3 to trial14245205-20 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: finishing write tid 4 to trial14245205-20 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: oid 20 updating version 0 to 1084 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: oid 20 updating version 1084 to 1085 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: oid 20 updating version 1085 to 1086 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1086 (ObjNum 736 snap 234 seq_num 736) dirty exists 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2127: left oid 20 (ObjNum 736 snap 234 seq_num 736) 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2129: finishing rollback tid 1 to trial14245205-27 2026-02-17T11:59:27.617 INFO:tasks.rados.rados.0.trial142.stdout:2129: finishing rollback tid 2 to trial14245205-27 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 1799 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: finishing write tid 1 to trial14245205-35 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: finishing write tid 2 to trial14245205-35 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: finishing write tid 3 to trial14245205-35 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: finishing write tid 4 to trial14245205-35 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: oid 35 updating version 0 to 1800 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: oid 35 updating version 1800 to 1801 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: oid 35 updating version 1801 to 1802 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1802 (ObjNum 738 snap 234 seq_num 738) dirty exists 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2130: left oid 35 (ObjNum 738 snap 234 seq_num 738) 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2131: finishing write tid 1 to trial14245205-11 2026-02-17T11:59:27.618 INFO:tasks.rados.rados.0.trial142.stdout:2131: finishing write tid 2 to trial14245205-11 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: finishing write tid 3 to trial14245205-11 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: finishing write tid 4 to trial14245205-11 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: oid 11 updating version 0 to 1119 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: oid 11 version 1119 is already newer than 1118 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: oid 11 updating version 1119 to 1120 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1120 (ObjNum 739 snap 234 seq_num 739) dirty exists 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2131: left oid 11 (ObjNum 739 snap 234 seq_num 739) 2026-02-17T11:59:27.619 INFO:tasks.rados.rados.0.trial142.stdout:2133: expect (ObjNum 734 snap 234 seq_num 734) 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: get_monmap_and_config 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: build_initial_monmap 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: monmap: 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:27.624157+0000 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:27.624157+0000 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.625 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:27.626 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:27.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:27.626 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:27.626 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:27.626 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 Processor -- start 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 -- start start 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: init 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb5e009dac0 0x7fb5e009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e009dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5e009ff40 0x7fb5e013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e009ff40 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e009aed0 con 0x7fb5e009ff40 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e009caa0 con 0x7fb5e009dac0 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e00a3f90 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.623+0000 7fb5e622c640 10 monclient(hunting): authenticate will time out at 1455.242943s 2026-02-17T11:59:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38990/0 (socket says 10.20.193.51:38990) 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 -- 10.20.193.51:0/1423531630 learned_addr learned my addr 10.20.193.51:0/1423531630 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): get_auth_request con 0x7fb5e00a3bb0 auth_method 0 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 1 --2- 10.20.193.51:0/1423531630 >> v2:10.20.193.51:3300/0 conn(0x7fb5e009ff40 0x7fb5e013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): get_auth_request con 0x7fb5e009ff40 auth_method 0 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient(hunting): handle_auth_done global_id 174173 payload 274 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 -- 10.20.193.51:0/1423531630 >> v2:10.20.193.142:3300/0 conn(0x7fb5e009dac0 msgr2=0x7fb5e009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/1423531630 >> v2:10.20.193.142:3300/0 conn(0x7fb5e009dac0 0x7fb5e009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 -- 10.20.193.51:0/1423531630 >> v2:10.20.193.51:3300/0 conn(0x7fb5e009ff40 msgr2=0x7fb5e013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/1423531630 >> v2:10.20.193.51:3300/0 conn(0x7fb5e009ff40 0x7fb5e013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 monclient: found mon.noname-b 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.624+0000 7fb5df7fe640 1 -- 10.20.193.51:0/1423531630 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e006e140 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5df7fe640 1 -- 10.20.193.51:0/1423531630 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 msgr2=0x7fb5e009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/1423531630 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006e310 tx=0x7fb5cc02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=314b16beac58c46d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 1 -- 10.20.193.51:0/1423531630 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc03c070 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: dump: 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 1 -- 10.20.193.51:0/1423531630 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5cc02fd30 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5e622c640 5 monclient: authenticate success, global_id 174173 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5e622c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 1 -- 10.20.193.51:0/1423531630 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc037660 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5e622c640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5e622c640 4 set_mon_vals no callback set 2026-02-17T11:59:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.626+0000 7fb5de7fc640 10 monclient: dump: 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:27.644 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 10 monclient: shutdown 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- 10.20.193.51:0/1423531630 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 msgr2=0x7fb5e009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 --2- 10.20.193.51:0/1423531630 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006e310 tx=0x7fb5cc02eeb0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- 10.20.193.51:0/1423531630 shutdown_connections 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 --2- 10.20.193.51:0/1423531630 >> v2:10.20.193.51:3300/0 conn(0x7fb5e009ff40 0x7fb5e013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 --2- 10.20.193.51:0/1423531630 >> v2:10.20.193.142:3300/0 conn(0x7fb5e009dac0 0x7fb5e009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 --2- 10.20.193.51:0/1423531630 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e009f4c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- 10.20.193.51:0/1423531630 >> 10.20.193.51:0/1423531630 conn(0x7fb5e00a30c0 msgr2=0x7fb5e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- 10.20.193.51:0/1423531630 shutdown_connections 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- 10.20.193.51:0/1423531630 wait complete. 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 10 monclient: build_initial_monmap 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 10 monclient: monmap: 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:27.646 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 Processor -- start 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 1 -- start start 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.627+0000 7fb5e622c640 10 monclient: init 2026-02-17T11:59:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5e009dac0 0x7fb5e0137180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5e009ff40 0x7fb5e012cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e009ff40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e009a880 con 0x7fb5e009ff40 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e009a5c0 con 0x7fb5e009dac0 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e00a0350 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5e622c640 10 monclient(hunting): authenticate will time out at 1455.247118s 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5e009ff40 0x7fb5e012cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39002/0 (socket says 10.20.193.51:39002) 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 -- 10.20.193.51:0/922902972 learned_addr learned my addr 10.20.193.51:0/922902972 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): get_auth_request con 0x7fb5e00a3bb0 auth_method 0 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): get_auth_request con 0x7fb5e009ff40 auth_method 0 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5e009dac0 0x7fb5e0137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5df7fe640 10 monclient(hunting): get_auth_request con 0x7fb5e009dac0 auth_method 0 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient(hunting): handle_auth_done global_id 174176 payload 824 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 -- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5e009dac0 msgr2=0x7fb5e0137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5e009dac0 0x7fb5e0137180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 -- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5e009ff40 msgr2=0x7fb5e012cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5e009ff40 0x7fb5e012cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 monclient: found mon.noname-c 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.628+0000 7fb5dffff640 1 -- 10.20.193.51:0/922902972 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e00a2d90 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5dffff640 1 -- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 msgr2=0x7fb5e012d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5dffff640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d20 tx=0x7fb5d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4018020 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: dump: 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:27.653 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: _finish_auth 0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 5 monclient: authenticate success, global_id 174176 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d4014680 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 10 monclient: _renew_subs 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e012f440 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4014a70 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5ddffb640 4 set_mon_vals no callback set 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5bbfff640 10 monclient: dump: 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:27.655 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 10 monclient: _renew_subs 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.630+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e0136670 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5e622c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5e622c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5e622c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e009e370 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb5d4014c10 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5bbfff640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 0x7fb5b0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(498..498 src has 323..498) ==== 4811+0+0 (secure 0 0 0) 0x7fb5d4053290 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 0x7fb5b0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.631+0000 7fb5df7fe640 10 monclient: get_auth_request con 0x7fb5b003dd60 auth_method 0 2026-02-17T11:59:27.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.634+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb5d4022070 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.634+0000 7fb5bbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.634+0000 7fb5bbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:27.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.634+0000 7fb5df7fe640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 0x7fb5b0040220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006dc20 tx=0x7fb5cc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.748 INFO:tasks.rados.rados.0.trial142.stdout:2136: expect (ObjNum 595 snap 184 seq_num 595) 2026-02-17T11:59:27.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5e622c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5e622c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5e622c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5e012eb30 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5bbfff640 1 -- 10.20.193.51:0/922902972 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fb5d4010040 con 0x7fb5e00a3bb0 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5bbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:27.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.754+0000 7fb5bbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:27.758 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 msgr2=0x7fb5b0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 0x7fb5b0040220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006dc20 tx=0x7fb5cc033000 comp rx=0 tx=0).stop 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 10 monclient: shutdown 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 msgr2=0x7fb5e012d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d20 tx=0x7fb5d400c490 comp rx=0 tx=0).stop 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 shutdown_connections 2026-02-17T11:59:27.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5b003dd60 0x7fb5b0040220 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5e00a3bb0 0x7fb5e012d0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5e009ff40 0x7fb5e012cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.755+0000 7fb5e622c640 1 --2- 10.20.193.51:0/922902972 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5e009dac0 0x7fb5e0137180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.756+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 >> 10.20.193.51:0/922902972 conn(0x7fb5e00a30c0 msgr2=0x7fb5e0073920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.756+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 shutdown_connections 2026-02-17T11:59:27.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:27.756+0000 7fb5e622c640 1 -- 10.20.193.51:0/922902972 wait complete. 2026-02-17T11:59:27.794 INFO:tasks.rados.rados.0.trial142.stdout:2135: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2137: finishing write tid 1 to trial14245205-5 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2127: done (8 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2129: done (7 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2130: done (6 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2131: done (5 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2133: done (4 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2135: done (3 left) 2026-02-17T11:59:27.909 INFO:tasks.rados.rados.0.trial142.stdout:2136: done (2 left) 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2138: done (1 left) 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2139: copy_from oid 12 from oid 29 current snap is 234 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: finishing write tid 2 to trial14245205-5 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: finishing write tid 3 to trial14245205-5 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: finishing write tid 4 to trial14245205-5 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: oid 5 updating version 0 to 1132 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: oid 5 version 1132 is already newer than 1131 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: oid 5 updating version 1132 to 1133 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1133 (ObjNum 740 snap 234 seq_num 740) dirty exists 2026-02-17T11:59:27.910 INFO:tasks.rados.rados.0.trial142.stdout:2137: left oid 5 (ObjNum 740 snap 234 seq_num 740) 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2137: done (1 left) 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2140: read oid 44 snap 212 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2140: expect deleted 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2141: read oid 34 snap -1 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2141: expect (ObjNum 722 snap 227 seq_num 722) 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2142: write (excl) oid 43 current snap is 234 2026-02-17T11:59:27.911 INFO:tasks.rados.rados.0.trial142.stdout:2142: seq_num 742 ranges {470794=720999,1903639=554256} 2026-02-17T11:59:27.914 INFO:tasks.rados.rados.0.trial142.stdout:2142: writing trial14245205-43 from 470794 to 1191793 tid 1 2026-02-17T11:59:27.919 INFO:tasks.rados.rados.0.trial142.stdout:2142: writing trial14245205-43 from 1903639 to 2457895 tid 2 2026-02-17T11:59:27.919 INFO:tasks.rados.rados.0.trial142.stdout:2143: read oid 14 snap -1 2026-02-17T11:59:27.919 INFO:tasks.rados.rados.0.trial142.stdout:2143: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:59:27.919 INFO:tasks.rados.rados.0.trial142.stdout:2144: write oid 18 current snap is 234 2026-02-17T11:59:27.919 INFO:tasks.rados.rados.0.trial142.stdout:2144: seq_num 743 ranges {487601=796248,1962121=525480} 2026-02-17T11:59:27.923 INFO:tasks.rados.rados.0.trial142.stdout:2144: writing trial14245205-18 from 487601 to 1283849 tid 1 2026-02-17T11:59:27.928 INFO:tasks.rados.rados.0.trial142.stdout:2144: writing trial14245205-18 from 1962121 to 2487601 tid 2 2026-02-17T11:59:27.928 INFO:tasks.rados.rados.0.trial142.stdout:2145: copy_from oid 1 from oid 26 current snap is 234 2026-02-17T11:59:27.928 INFO:tasks.rados.rados.0.trial142.stdout:2141: expect (ObjNum 722 snap 227 seq_num 722) 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2139: finishing copy_from racing read to trial14245205-12 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2139: finishing copy_from to trial14245205-12 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1600 (ObjNum 579 snap 181 seq_num 579) dirty exists 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2142: finishing write tid 1 to trial14245205-43 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2139: done (6 left) 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2140: done (5 left) 2026-02-17T11:59:27.997 INFO:tasks.rados.rados.0.trial142.stdout:2141: done (4 left) 2026-02-17T11:59:27.998 INFO:tasks.rados.rados.0.trial142.stdout:2146: write oid 22 current snap is 234 2026-02-17T11:59:27.998 INFO:tasks.rados.rados.0.trial142.stdout:2146: seq_num 744 ranges {504408=471497,1620603=557925} 2026-02-17T11:59:28.001 INFO:tasks.rados.rados.0.trial142.stdout:2146: writing trial14245205-22 from 504408 to 975905 tid 1 2026-02-17T11:59:28.005 INFO:tasks.rados.rados.0.trial142.stdout:2146: writing trial14245205-22 from 1620603 to 2178528 tid 2 2026-02-17T11:59:28.005 INFO:tasks.rados.rados.0.trial142.stdout:2147: delete oid 29 current snap is 234 2026-02-17T11:59:28.006 INFO:tasks.rados.rados.0.trial142.stdout:2143: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T11:59:28.119 INFO:tasks.rados.rados.0.trial142.stdout:2142: finishing write tid 2 to trial14245205-43 2026-02-17T11:59:28.119 INFO:tasks.rados.rados.0.trial142.stdout:2142: finishing write tid 3 to trial14245205-43 2026-02-17T11:59:28.119 INFO:tasks.rados.rados.0.trial142.stdout:2143: done (5 left) 2026-02-17T11:59:28.119 INFO:tasks.rados.rados.0.trial142.stdout:2147: done (4 left) 2026-02-17T11:59:28.120 INFO:tasks.rados.rados.0.trial142.stdout:2148: snap_remove snap 231 2026-02-17T11:59:28.611 INFO:tasks.rados.rados.0.trial142.stdout:2148: done (4 left) 2026-02-17T11:59:28.611 INFO:tasks.rados.rados.0.trial142.stdout:2149: snap_remove snap 212 2026-02-17T11:59:29.612 INFO:tasks.rados.rados.0.trial142.stdout:2149: done (4 left) 2026-02-17T11:59:29.612 INFO:tasks.rados.rados.0.trial142.stdout:2150: snap_remove snap 232 2026-02-17T11:59:30.580 INFO:tasks.rados.rados.0.trial142.stdout:2150: done (4 left) 2026-02-17T11:59:30.580 INFO:tasks.rados.rados.0.trial142.stdout:2151: read oid 33 snap -1 2026-02-17T11:59:30.580 INFO:tasks.rados.rados.0.trial142.stdout:2151: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:30.580 INFO:tasks.rados.rados.0.trial142.stdout:2152: delete oid 14 current snap is 234 2026-02-17T11:59:30.580 INFO:tasks.rados.rados.0.trial142.stdout:2142: finishing write tid 4 to trial14245205-43 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2142: oid 43 updating version 0 to 1965 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2142: oid 43 updating version 1965 to 1966 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2142: oid 43 version 1966 is already newer than 1964 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1966 (ObjNum 742 snap 234 seq_num 742) dirty exists 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2142: left oid 43 (ObjNum 742 snap 234 seq_num 742) 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: finishing write tid 1 to trial14245205-18 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: finishing write tid 2 to trial14245205-18 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: finishing write tid 3 to trial14245205-18 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: finishing write tid 4 to trial14245205-18 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: oid 18 updating version 0 to 1970 2026-02-17T11:59:30.581 INFO:tasks.rados.rados.0.trial142.stdout:2144: oid 18 version 1970 is already newer than 1969 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2144: oid 18 version 1970 is already newer than 1968 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1970 (ObjNum 743 snap 234 seq_num 743) dirty exists 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2144: left oid 18 (ObjNum 743 snap 234 seq_num 743) 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2145: finishing copy_from racing read to trial14245205-1 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2145: finishing copy_from to trial14245205-1 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1494 (ObjNum 732 snap 232 seq_num 732) dirty exists 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2146: finishing write tid 1 to trial14245205-22 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2146: finishing write tid 2 to trial14245205-22 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2146: finishing write tid 3 to trial14245205-22 2026-02-17T11:59:30.582 INFO:tasks.rados.rados.0.trial142.stdout:2146: finishing write tid 4 to trial14245205-22 2026-02-17T11:59:30.583 INFO:tasks.rados.rados.0.trial142.stdout:2146: oid 22 updating version 0 to 1497 2026-02-17T11:59:30.583 INFO:tasks.rados.rados.0.trial142.stdout:2146: oid 22 version 1497 is already newer than 1496 2026-02-17T11:59:30.583 INFO:tasks.rados.rados.0.trial142.stdout:2146: oid 22 version 1497 is already newer than 1495 2026-02-17T11:59:30.583 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 1497 (ObjNum 744 snap 234 seq_num 744) dirty exists 2026-02-17T11:59:30.583 INFO:tasks.rados.rados.0.trial142.stdout:2146: left oid 22 (ObjNum 744 snap 234 seq_num 744) 2026-02-17T11:59:30.585 INFO:tasks.rados.rados.0.trial142.stdout:2142: done (5 left) 2026-02-17T11:59:30.585 INFO:tasks.rados.rados.0.trial142.stdout:2144: done (4 left) 2026-02-17T11:59:30.585 INFO:tasks.rados.rados.0.trial142.stdout:2145: done (3 left) 2026-02-17T11:59:30.585 INFO:tasks.rados.rados.0.trial142.stdout:2146: done (2 left) 2026-02-17T11:59:30.586 INFO:tasks.rados.rados.0.trial142.stdout:2152: done (1 left) 2026-02-17T11:59:30.586 INFO:tasks.rados.rados.0.trial142.stdout:2153: snap_remove snap 233 2026-02-17T11:59:30.767 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: get_monmap_and_config 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: build_initial_monmap 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: monmap: 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:30.834160+0000 2026-02-17T11:59:30.844 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:30.834160+0000 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 Processor -- start 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 -- start start 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: init 2026-02-17T11:59:30.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcd0c0a3bb0 0x7fcd0c09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-a con 0x7fcd0c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fcd0c09d270 0x7fcd0c138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-c con 0x7fcd0c09d270 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-b con 0x7fcd0c1385b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c09a5c0 con 0x7fcd0c0a3bb0 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c09b520 con 0x7fcd0c09d270 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c0a3f90 con 0x7fcd0c1385b0 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.833+0000 7fcd145de640 10 monclient(hunting): authenticate will time out at 1458.452980s 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcd0c0a3bb0 0x7fcd0c09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39016/0 (socket says 10.20.193.51:39016) 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 -- 10.20.193.51:0/203813215 learned_addr learned my addr 10.20.193.51:0/203813215 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): get_auth_request con 0x7fcd0c1385b0 auth_method 0 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:30.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): get_auth_request con 0x7fcd0c0a3bb0 auth_method 0 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd11b52640 1 --2- 10.20.193.51:0/203813215 >> v2:10.20.193.142:3300/0 conn(0x7fcd0c09d270 0x7fcd0c138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd11b52640 10 monclient(hunting): get_auth_request con 0x7fcd0c09d270 auth_method 0 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd11b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd11b52640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd11b52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient(hunting): handle_auth_done global_id 174179 payload 274 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 -- 10.20.193.51:0/203813215 >> v2:10.20.193.142:3300/0 conn(0x7fcd0c09d270 msgr2=0x7fcd0c138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 --2- 10.20.193.51:0/203813215 >> v2:10.20.193.142:3300/0 conn(0x7fcd0c09d270 0x7fcd0c138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 -- 10.20.193.51:0/203813215 >> v2:10.20.193.51:3300/0 conn(0x7fcd0c0a3bb0 msgr2=0x7fcd0c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 --2- 10.20.193.51:0/203813215 >> v2:10.20.193.51:3300/0 conn(0x7fcd0c0a3bb0 0x7fcd0c09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient: _finish_hunting 0 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 monclient: found mon.noname-b 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:30.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.834+0000 7fcd12b54640 1 -- 10.20.193.51:0/203813215 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c135430 con 0x7fcd0c1385b0 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd12b54640 1 -- 10.20.193.51:0/203813215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 msgr2=0x7fcd0c138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd12b54640 1 --2- 10.20.193.51:0/203813215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c09b6a0 tx=0x7fcd0802f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9a900588613180 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 1 -- 10.20.193.51:0/203813215 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0802fe50 con 0x7fcd0c1385b0 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: dump: 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.850 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: _finish_auth 0 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: _check_auth_tickets 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 1 -- 10.20.193.51:0/203813215 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd080373f0 con 0x7fcd0c1385b0 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd145de640 5 monclient: authenticate success, global_id 174179 2026-02-17T11:59:30.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd145de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 1 -- 10.20.193.51:0/203813215 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080377c0 con 0x7fcd0c1385b0 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd145de640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd145de640 4 set_mon_vals no callback set 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.836+0000 7fcd11351640 10 monclient: dump: 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 10 monclient: shutdown 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- 10.20.193.51:0/203813215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 msgr2=0x7fcd0c138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 --2- 10.20.193.51:0/203813215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c09b6a0 tx=0x7fcd0802f1e0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- 10.20.193.51:0/203813215 shutdown_connections 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 --2- 10.20.193.51:0/203813215 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c1385b0 0x7fcd0c138a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 --2- 10.20.193.51:0/203813215 >> v2:10.20.193.142:3300/0 conn(0x7fcd0c09d270 0x7fcd0c138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 --2- 10.20.193.51:0/203813215 >> v2:10.20.193.51:3300/0 conn(0x7fcd0c0a3bb0 0x7fcd0c09cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- 10.20.193.51:0/203813215 >> 10.20.193.51:0/203813215 conn(0x7fcd0c0a30c0 msgr2=0x7fcd0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- 10.20.193.51:0/203813215 shutdown_connections 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- 10.20.193.51:0/203813215 wait complete. 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 10 monclient: build_initial_monmap 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 10 monclient: monmap: 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:30.854 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 Processor -- start 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 1 -- start start 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.837+0000 7fcd145de640 10 monclient: init 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-c con 0x7fcd0c09d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:30.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd0c0a3bb0 0x7fcd0c12d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-a con 0x7fcd0c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd0c1385b0 0x7fcd0c12d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): picked mon.noname-b con 0x7fcd0c1385b0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c074ac0 con 0x7fcd0c0a3bb0 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c09b240 con 0x7fcd0c1385b0 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c135040 con 0x7fcd0c09d270 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd145de640 10 monclient(hunting): authenticate will time out at 1458.457146s 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39022/0 (socket says 10.20.193.51:39022) 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 -- 10.20.193.51:0/2597712126 learned_addr learned my addr 10.20.193.51:0/2597712126 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): get_auth_request con 0x7fcd0c09d270 auth_method 0 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd0c0a3bb0 0x7fcd0c12d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): get_auth_request con 0x7fcd0c0a3bb0 auth_method 0 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:30.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd11b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient(hunting): handle_auth_done global_id 174182 payload 824 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 -- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd0c1385b0 msgr2=0x7fcd0c12d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd0c1385b0 0x7fcd0c12d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 -- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd0c0a3bb0 msgr2=0x7fcd0c12d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd0c0a3bb0 0x7fcd0c12d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient: _finish_hunting 0 2026-02-17T11:59:30.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 monclient: found mon.noname-c 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.838+0000 7fcd12353640 1 -- 10.20.193.51:0/2597712126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c12e2d0 con 0x7fcd0c09d270 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd12353640 1 -- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 msgr2=0x7fcd0c12ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd12353640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ebe0 tx=0x7fccfc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc017070 con 0x7fcd0c09d270 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: dump: 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:30.859 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc00cdd0 con 0x7fcd0c09d270 2026-02-17T11:59:30.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 5 monclient: authenticate success, global_id 174182 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 10 monclient: _renew_subs 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c130700 con 0x7fcd0c09d270 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0136b0 con 0x7fcd0c09d270 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fccf2ffd640 10 monclient: dump: 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:30.861 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd10b50640 4 set_mon_vals no callback set 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 10 monclient: _renew_subs 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.840+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c0a19e0 con 0x7fcd0c09d270 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd145de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd145de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:30.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd145de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c138070 con 0x7fcd0c09d270 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fccfc024060 con 0x7fcd0c09d270 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fccf2ffd640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 0x7fccdc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(501..501 src has 323..501) ==== 4839+0+0 (secure 0 0 0) 0x7fccfc0526a0 con 0x7fcd0c09d270 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd11b52640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 0x7fccdc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:30.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.841+0000 7fcd11b52640 10 monclient: get_auth_request con 0x7fccdc03dd10 auth_method 0 2026-02-17T11:59:30.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.843+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcd0c12e2d0 con 0x7fcd0c09d270 2026-02-17T11:59:30.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.843+0000 7fccf2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:30.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.843+0000 7fccf2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:30.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.844+0000 7fcd11b52640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 0x7fccdc0401d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c131a90 tx=0x7fcd00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fcd145de640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fcd145de640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fcd145de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcd0c0008d0 con 0x7fcd0c09d270 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fccf2ffd640 1 -- 10.20.193.51:0/2597712126 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fccfc013850 con 0x7fcd0c09d270 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fccf2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:30.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.957+0000 7fccf2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:30.961 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:30.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 msgr2=0x7fccdc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:30.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 0x7fccdc0401d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c131a90 tx=0x7fcd00008040 comp rx=0 tx=0).stop 2026-02-17T11:59:30.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 10 monclient: shutdown 2026-02-17T11:59:30.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:30.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 msgr2=0x7fcd0c12ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ebe0 tx=0x7fccfc00c520 comp rx=0 tx=0).stop 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 shutdown_connections 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fccdc03dd10 0x7fccdc0401d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd0c1385b0 0x7fcd0c12d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd0c0a3bb0 0x7fcd0c12d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 --2- 10.20.193.51:0/2597712126 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd0c09d270 0x7fcd0c12ce90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 >> 10.20.193.51:0/2597712126 conn(0x7fcd0c0a30c0 msgr2=0x7fcd0c1336d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 shutdown_connections 2026-02-17T11:59:30.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:30.958+0000 7fcd145de640 1 -- 10.20.193.51:0/2597712126 wait complete. 2026-02-17T11:59:31.584 INFO:tasks.rados.rados.0.trial142.stdout:2153: done (1 left) 2026-02-17T11:59:31.584 INFO:tasks.rados.rados.0.trial142.stdout:2154: copy_from oid 12 from oid 3 current snap is 234 2026-02-17T11:59:31.584 INFO:tasks.rados.rados.0.trial142.stdout:2151: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:31.682 INFO:tasks.rados.rados.0.trial142.stdout:2154: finishing copy_from racing read to trial14245205-12 2026-02-17T11:59:31.682 INFO:tasks.rados.rados.0.trial142.stdout:2154: finishing copy_from to trial14245205-12 2026-02-17T11:59:31.682 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 1034 (ObjNum 708 snap 220 seq_num 708) dirty exists 2026-02-17T11:59:31.683 INFO:tasks.rados.rados.0.trial142.stdout:2151: done (1 left) 2026-02-17T11:59:31.683 INFO:tasks.rados.rados.0.trial142.stdout:2154: done (0 left) 2026-02-17T11:59:31.683 INFO:tasks.rados.rados.0.trial142.stdout:2155: snap_create 2026-02-17T11:59:32.616 INFO:tasks.rados.rados.0.trial142.stdout:2155: done (0 left) 2026-02-17T11:59:32.616 INFO:tasks.rados.rados.0.trial142.stdout:2156: write oid 11 current snap is 235 2026-02-17T11:59:32.616 INFO:tasks.rados.rados.0.trial142.stdout:2156: seq_num 747 ranges {554829=413597,1396049=705252} 2026-02-17T11:59:32.620 INFO:tasks.rados.rados.0.trial142.stdout:2156: writing trial14245205-11 from 554829 to 968426 tid 1 2026-02-17T11:59:32.625 INFO:tasks.rados.rados.0.trial142.stdout:2156: writing trial14245205-11 from 1396049 to 2101301 tid 2 2026-02-17T11:59:32.625 INFO:tasks.rados.rados.0.trial142.stdout:2157: read oid 33 snap 234 2026-02-17T11:59:32.625 INFO:tasks.rados.rados.0.trial142.stdout:2157: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:32.625 INFO:tasks.rados.rados.0.trial142.stdout:2158: rollback oid 29 current snap is 235 2026-02-17T11:59:32.625 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 234 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:2156: finishing write tid 1 to trial14245205-11 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:2159: read oid 34 snap -1 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:2159: expect (ObjNum 722 snap 227 seq_num 722) 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:2160: snap_create 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:2158: finishing rollback tid 1 to trial14245205-29 2026-02-17T11:59:32.626 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 0 (ObjNum 81 snap 0 seq_num 321897418) dirty dne 2026-02-17T11:59:32.628 INFO:tasks.rados.rados.0.trial142.stdout:2159: expect (ObjNum 722 snap 227 seq_num 722) 2026-02-17T11:59:32.696 INFO:tasks.rados.rados.0.trial142.stdout:2156: finishing write tid 2 to trial14245205-11 2026-02-17T11:59:32.696 INFO:tasks.rados.rados.0.trial142.stdout:2156: finishing write tid 3 to trial14245205-11 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2156: finishing write tid 4 to trial14245205-11 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2156: oid 11 updating version 0 to 1122 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2156: oid 11 updating version 1122 to 1123 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2156: oid 11 version 1123 is already newer than 1121 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1123 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2156: left oid 11 (ObjNum 747 snap 235 seq_num 747) 2026-02-17T11:59:32.697 INFO:tasks.rados.rados.0.trial142.stdout:2157: expect (ObjNum 668 snap 210 seq_num 668) 2026-02-17T11:59:33.622 INFO:tasks.rados.rados.0.trial142.stdout:2156: done (4 left) 2026-02-17T11:59:33.622 INFO:tasks.rados.rados.0.trial142.stdout:2157: done (3 left) 2026-02-17T11:59:33.623 INFO:tasks.rados.rados.0.trial142.stdout:2158: done (2 left) 2026-02-17T11:59:33.623 INFO:tasks.rados.rados.0.trial142.stdout:2159: done (1 left) 2026-02-17T11:59:33.623 INFO:tasks.rados.rados.0.trial142.stdout:2160: done (0 left) 2026-02-17T11:59:33.623 INFO:tasks.rados.rados.0.trial142.stdout:2161: write oid 23 current snap is 236 2026-02-17T11:59:33.623 INFO:tasks.rados.rados.0.trial142.stdout:2161: seq_num 748 ranges {571636=488846,1854531=565263} 2026-02-17T11:59:33.626 INFO:tasks.rados.rados.0.trial142.stdout:2161: writing trial14245205-23 from 571636 to 1060482 tid 1 2026-02-17T11:59:33.631 INFO:tasks.rados.rados.0.trial142.stdout:2161: writing trial14245205-23 from 1854531 to 2419794 tid 2 2026-02-17T11:59:33.631 INFO:tasks.rados.rados.0.trial142.stdout:2162: copy_from oid 18 from oid 17 current snap is 236 2026-02-17T11:59:33.632 INFO:tasks.rados.rados.0.trial142.stdout:2161: finishing write tid 1 to trial14245205-23 2026-02-17T11:59:33.632 INFO:tasks.rados.rados.0.trial142.stdout:2163: delete oid 49 current snap is 236 2026-02-17T11:59:33.633 INFO:tasks.rados.rados.0.trial142.stdout:2161: finishing write tid 2 to trial14245205-23 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: finishing write tid 3 to trial14245205-23 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: finishing write tid 4 to trial14245205-23 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: oid 23 updating version 0 to 1605 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: oid 23 updating version 1605 to 1607 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: oid 23 version 1607 is already newer than 1606 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1607 (ObjNum 748 snap 236 seq_num 748) dirty exists 2026-02-17T11:59:33.634 INFO:tasks.rados.rados.0.trial142.stdout:2161: left oid 23 (ObjNum 748 snap 236 seq_num 748) 2026-02-17T11:59:33.635 INFO:tasks.rados.rados.0.trial142.stdout:2161: done (2 left) 2026-02-17T11:59:33.635 INFO:tasks.rados.rados.0.trial142.stdout:2163: done (1 left) 2026-02-17T11:59:33.635 INFO:tasks.rados.rados.0.trial142.stdout:2164: write (excl) oid 6 current snap is 236 2026-02-17T11:59:33.635 INFO:tasks.rados.rados.0.trial142.stdout:2164: seq_num 750 ranges {605250=639344,1855142=452579} 2026-02-17T11:59:33.639 INFO:tasks.rados.rados.0.trial142.stdout:2164: writing trial14245205-6 from 605250 to 1244594 tid 1 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:2164: writing trial14245205-6 from 1855142 to 2307721 tid 2 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:2165: copy_from oid 50 from oid 2 current snap is 236 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:2162: finishing copy_from racing read to trial14245205-18 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:2162: finishing copy_from to trial14245205-18 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 1124 (ObjNum 714 snap 224 seq_num 714) dirty exists 2026-02-17T11:59:33.643 INFO:tasks.rados.rados.0.trial142.stdout:2164: finishing write tid 1 to trial14245205-6 2026-02-17T11:59:33.644 INFO:tasks.rados.rados.0.trial142.stdout:2162: done (2 left) 2026-02-17T11:59:33.644 INFO:tasks.rados.rados.0.trial142.stdout:2166: snap_remove snap 234 2026-02-17T11:59:33.968 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.035+0000 7fb48dd34640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.035+0000 7fb48dd34640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient: monmap: 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:34.036971+0000 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:34.036971+0000 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.040 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 Processor -- start 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 -- start start 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient: init 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb4880a3bb0 0x7fb48809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-a con 0x7fb4880a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb48809dac0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb4880a0110 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48806e140 con 0x7fb48809dac0 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48809ce60 con 0x7fb4880a0110 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb48809aed0 con 0x7fb4880a3bb0 2026-02-17T11:59:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb48dd34640 10 monclient(hunting): authenticate will time out at 1461.655719s 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb4880a3bb0 0x7fb48809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb486ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb48809dac0 0x7fb48809fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55864/0 (socket says 10.20.193.51:55864) 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb4880a3bb0 0x7fb48809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54496/0 (socket says 10.20.193.51:54496) 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb486ffd640 1 -- 10.20.193.51:0/3079496818 learned_addr learned my addr 10.20.193.51:0/3079496818 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): get_auth_request con 0x7fb4880a3bb0 auth_method 0 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.036+0000 7fb4877fe640 10 monclient(hunting): handle_auth_done global_id 164325 payload 274 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 1 -- 10.20.193.51:0/3079496818 >> v1:10.20.193.142:6789/0 conn(0x7fb4880a0110 legacy=0x7fb48813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 1 -- 10.20.193.51:0/3079496818 >> v1:10.20.193.51:6789/0 conn(0x7fb48809dac0 legacy=0x7fb48809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:34.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.037+0000 7fb4877fe640 1 -- 10.20.193.51:0/3079496818 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48809a5c0 con 0x7fb4880a3bb0 2026-02-17T11:59:34.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4877fe640 1 -- 10.20.193.51:0/3079496818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 msgr2=0x7fb48809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4877fe640 1 --2- 10.20.193.51:0/3079496818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48809f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098a0 tx=0x7fb47402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1d76883e2cdef2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 1 -- 10.20.193.51:0/3079496818 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47403c070 con 0x7fb4880a3bb0 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: dump: 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.052 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 1 -- 10.20.193.51:0/3079496818 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47402fce0 con 0x7fb4880a3bb0 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 1 -- 10.20.193.51:0/3079496818 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474037660 con 0x7fb4880a3bb0 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 5 monclient: authenticate success, global_id 164325 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 4 set_mon_vals no callback set 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb4867fc640 10 monclient: dump: 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.054 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 10 monclient: shutdown 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 1 -- 10.20.193.51:0/3079496818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 msgr2=0x7fb48809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.039+0000 7fb48dd34640 1 --2- 10.20.193.51:0/3079496818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48809f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098a0 tx=0x7fb47402ed80 comp rx=0 tx=0).stop 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- 10.20.193.51:0/3079496818 shutdown_connections 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 --2- 10.20.193.51:0/3079496818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48809f4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- 10.20.193.51:0/3079496818 >> 10.20.193.51:0/3079496818 conn(0x7fb4880a30c0 msgr2=0x7fb4880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- 10.20.193.51:0/3079496818 shutdown_connections 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- 10.20.193.51:0/3079496818 wait complete. 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient: monmap: 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:34.056 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 Processor -- start 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- start start 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient: init 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-c con 0x7fb48809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4880a0110 0x7fb48806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-b con 0x7fb4880a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): picked mon.noname-a con 0x7fb4880a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb4880a3f90 con 0x7fb4880a3bb0 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb48809caa0 con 0x7fb4880a0110 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb4880a0540 con 0x7fb48809dac0 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb48dd34640 10 monclient(hunting): authenticate will time out at 1461.659907s 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb487fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39032/0 (socket says 10.20.193.51:39032) 2026-02-17T11:59:34.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 1 -- 10.20.193.51:0/1830212170 learned_addr learned my addr 10.20.193.51:0/1830212170 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 10 monclient(hunting): get_auth_request con 0x7fb48809dac0 auth_method 0 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb487fff640 10 monclient(hunting): get_auth_request con 0x7fb4880a3bb0 auth_method 0 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.040+0000 7fb487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb487fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb486ffd640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4880a0110 0x7fb48806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb486ffd640 10 monclient(hunting): get_auth_request con 0x7fb4880a0110 auth_method 0 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb486ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb486ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb486ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient(hunting): handle_auth_done global_id 174185 payload 824 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 -- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4880a0110 msgr2=0x7fb48806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4880a0110 0x7fb48806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 -- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 msgr2=0x7fb48806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48806fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb4877fe640 1 -- 10.20.193.51:0/1830212170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48809d7b0 con 0x7fb48809dac0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.041+0000 7fb487fff640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb4877fe640 1 -- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 msgr2=0x7fb48806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb4877fe640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4740099d0 tx=0x7fb4740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474046070 con 0x7fb48809dac0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: dump: 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb474041870 con 0x7fb48809dac0 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 5 monclient: authenticate success, global_id 174185 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 10 monclient: _renew_subs 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb488094bb0 con 0x7fb48809dac0 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47403c040 con 0x7fb48809dac0 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb485ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb463fff640 10 monclient: dump: 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 10 monclient: _renew_subs 2026-02-17T11:59:34.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb488093cc0 con 0x7fb48809dac0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.043+0000 7fb48dd34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb48dd34640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb48dd34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48809f4c0 con 0x7fb48809dac0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb474041c60 con 0x7fb48809dac0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb463fff640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 0x7fb4580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(504..504 src has 323..504) ==== 4783+0+0 (secure 0 0 0) 0x7fb474077e80 con 0x7fb48809dac0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb486ffd640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 0x7fb4580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.044+0000 7fb486ffd640 10 monclient: get_auth_request con 0x7fb45803dd10 auth_method 0 2026-02-17T11:59:34.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.046+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb48809d7b0 con 0x7fb48809dac0 2026-02-17T11:59:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.046+0000 7fb463fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.046+0000 7fb463fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.047+0000 7fb486ffd640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 0x7fb4580401d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb488093f40 tx=0x7fb478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb48dd34640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb48dd34640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb48dd34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb4880950d0 con 0x7fb48809dac0 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb463fff640 1 -- 10.20.193.51:0/1830212170 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fb474049e10 con 0x7fb48809dac0 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb463fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:34.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.163+0000 7fb463fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.167 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 msgr2=0x7fb4580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 0x7fb4580401d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb488093f40 tx=0x7fb478009040 comp rx=0 tx=0).stop 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 10 monclient: shutdown 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 msgr2=0x7fb48806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4740099d0 tx=0x7fb4740047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 shutdown_connections 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb45803dd10 0x7fb4580401d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4880a3bb0 0x7fb48806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4880a0110 0x7fb48806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 --2- 10.20.193.51:0/1830212170 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb48809dac0 0x7fb48806f410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 >> 10.20.193.51:0/1830212170 conn(0x7fb4880a30c0 msgr2=0x7fb48809e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 shutdown_connections 2026-02-17T11:59:34.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.165+0000 7fb48dd34640 1 -- 10.20.193.51:0/1830212170 wait complete. 2026-02-17T11:59:34.175 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:59:34.175 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:59:34.175 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:59:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.240+0000 7f1b65bcc640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.240+0000 7f1b65bcc640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.240+0000 7f1b65bcc640 10 monclient: monmap: 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:34.241777+0000 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:34.241777+0000 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:34.244 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:34.244 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:34.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 Processor -- start 2026-02-17T11:59:34.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 -- start start 2026-02-17T11:59:34.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient: init 2026-02-17T11:59:34.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1b600a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1b6009dac0 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 0x7f1b6013d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-b con 0x7f1b600a02e0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6006e140 con 0x7f1b600a3bb0 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6009ce60 con 0x7f1b6009dac0 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6009aed0 con 0x7f1b600a02e0 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b65bcc640 10 monclient(hunting): authenticate will time out at 1461.860729s 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5f7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f1b600a3bb0 0x7f1b6009f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55874/0 (socket says 10.20.193.51:55874) 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/67007595 learned_addr learned my addr 10.20.193.51:0/67007595 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 0x7f1b6013d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): get_auth_request con 0x7f1b600a02e0 auth_method 0 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_done global_id 174188 payload 274 2026-02-17T11:59:34.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 1 -- 10.20.193.51:0/67007595 >> v1:10.20.193.142:6789/0 conn(0x7f1b6009dac0 legacy=0x7f1b6009fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 1 -- 10.20.193.51:0/67007595 >> v1:10.20.193.51:6789/0 conn(0x7f1b600a3bb0 legacy=0x7f1b6009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 1 monclient: found mon.noname-b 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.241+0000 7f1b5ffff640 1 -- 10.20.193.51:0/67007595 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6009a5c0 con 0x7f1b600a02e0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5ffff640 1 -- 10.20.193.51:0/67007595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 msgr2=0x7f1b6013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5ffff640 1 --2- 10.20.193.51:0/67007595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 0x7f1b6013d770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009d90 tx=0x7f1b5402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad00ef07fc98eef6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 1 -- 10.20.193.51:0/67007595 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5403c070 con 0x7f1b600a02e0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: dump: 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.258 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 5 monclient: authenticate success, global_id 174188 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 1 -- 10.20.193.51:0/67007595 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54037640 con 0x7f1b600a02e0 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 1 -- 10.20.193.51:0/67007595 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54037a10 con 0x7f1b600a02e0 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 4 set_mon_vals no callback set 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b5e7fc640 10 monclient: dump: 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 10 monclient: shutdown 2026-02-17T11:59:34.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 -- 10.20.193.51:0/67007595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 msgr2=0x7f1b6013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/67007595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 0x7f1b6013d770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009d90 tx=0x7f1b5402f190 comp rx=0 tx=0).stop 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 -- 10.20.193.51:0/67007595 shutdown_connections 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/67007595 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a02e0 0x7f1b6013d770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 -- 10.20.193.51:0/67007595 >> 10.20.193.51:0/67007595 conn(0x7f1b600a30c0 msgr2=0x7f1b600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 -- 10.20.193.51:0/67007595 shutdown_connections 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.244+0000 7f1b65bcc640 1 -- 10.20.193.51:0/67007595 wait complete. 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient: monmap: 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.261 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 Processor -- start 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 -- start start 2026-02-17T11:59:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient: init 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 0x7f1b601cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-a con 0x7f1b6009dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1b600a02e0 0x7f1b60099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-b con 0x7f1b600a02e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 0x7f1b601cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): picked mon.noname-c con 0x7f1b600a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600a3f90 con 0x7f1b6009dac0 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6009caa0 con 0x7f1b600a02e0 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6013dcb0 con 0x7f1b600a3bb0 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b65bcc640 10 monclient(hunting): authenticate will time out at 1461.864610s 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 0x7f1b601cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 0x7f1b601cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54518/0 (socket says 10.20.193.51:54518) 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/1750289711 learned_addr learned my addr 10.20.193.51:0/1750289711 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 0x7f1b601cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): get_auth_request con 0x7f1b6009dac0 auth_method 0 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): get_auth_request con 0x7f1b600a3bb0 auth_method 0 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient(hunting): handle_auth_done global_id 174191 payload 824 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1b600a02e0 msgr2=0x7f1b60099c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1b600a02e0 0x7f1b60099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 msgr2=0x7f1b601cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 0x7f1b601cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5ffff640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b600a2b40 con 0x7f1b600a3bb0 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.245+0000 7f1b5f7fe640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009dac0 0x7f1b601cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.247+0000 7f1b5ffff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 msgr2=0x7f1b601cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.247+0000 7f1b5ffff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 0x7f1b601cf380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b54036000 tx=0x7f1b54004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54047020 con 0x7f1b600a3bb0 2026-02-17T11:59:34.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: dump: 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.267 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54042880 con 0x7f1b600a3bb0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 5 monclient: authenticate success, global_id 174191 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 monclient: _renew_subs 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b60094780 con 0x7f1b600a3bb0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5403c040 con 0x7f1b600a3bb0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 10 monclient: dump: 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5dffb640 4 set_mon_vals no callback set 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 monclient: _renew_subs 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b60095430 con 0x7f1b600a3bb0 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 0x7f1b601cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6009d7b0 con 0x7f1b6009a1b0 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 0x7f1b601cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient: get_auth_request con 0x7f1b6009a1b0 auth_method 0 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_done global_id 164334 payload 824 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b600a2860 con 0x7f1b6009a1b0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.248+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1b540374c0 con 0x7f1b600a3bb0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.249+0000 7f1b3bfff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b3003dd10 0x7f1b300401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.249+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(504..504 src has 323..504) ==== 4783+0+0 (secure 0 0 0) 0x7f1b54078390 con 0x7f1b600a3bb0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.249+0000 7f1b5effd640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b3003dd10 0x7f1b300401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.249+0000 7f1b5effd640 10 monclient: get_auth_request con 0x7f1b3003dd10 auth_method 0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 msgr2=0x7f1b601cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b5f7fe640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 0x7f1b601cf8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0075e0 tx=0x7f1b4c00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00fe50 con 0x7f1b6009a1b0 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.250+0000 7f1b3bfff640 10 monclient: dump: 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.272 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1b4c00fe50 con 0x7f1b6009a1b0 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 msgr2=0x7f1b601cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 0x7f1b601cf8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0075e0 tx=0x7f1b4c00f5a0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 msgr2=0x7f1b601cf8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b3bfff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b6009a1b0 0x7f1b601cf8c0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0075e0 tx=0x7f1b4c00f5a0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.251+0000 7f1b5effd640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b3003dd10 0x7f1b300401d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b60070c90 tx=0x7f1b50007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b65bcc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 0x7f1b601da730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b65bcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60094f00 con 0x7f1b60093f80 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 0x7f1b601da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient: get_auth_request con 0x7f1b60093f80 auth_method 0 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 10 monclient(hunting): handle_auth_done global_id 164337 payload 824 2026-02-17T11:59:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.254+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/1750289711 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1b60068450 con 0x7f1b60093f80 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b5f7fe640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 msgr2=0x7f1b601da730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b5f7fe640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 0x7f1b601da730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c006fd0 tx=0x7f1b4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c006240 con 0x7f1b60093f80 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 10 monclient: dump: 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.277 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f1b4c006240 con 0x7f1b60093f80 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 msgr2=0x7f1b601da730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 0x7f1b601da730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c006fd0 tx=0x7f1b4c004a40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 msgr2=0x7f1b601da730 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.256+0000 7f1b3bfff640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1b60093f80 0x7f1b601da730 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c006fd0 tx=0x7f1b4c004a40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.278 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 118694, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:34.279 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:34.280 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:34.281 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:34.282 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.283 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.284 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.285 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:34.286 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.287 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.288 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:34.289 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b3003dd10 msgr2=0x7f1b300401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1b3003dd10 0x7f1b300401d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b60070c90 tx=0x7f1b50007ab0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 10 monclient: shutdown 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 msgr2=0x7f1b601cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b5ffff640 1 -- 10.20.193.51:0/1750289711 reap_dead start 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 0x7f1b601cf380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b54036000 tx=0x7f1b54004b40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 shutdown_connections 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 --2- 10.20.193.51:0/1750289711 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1b600a3bb0 0x7f1b601cf380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 >> 10.20.193.51:0/1750289711 conn(0x7f1b600a30c0 msgr2=0x7f1b6006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 shutdown_connections 2026-02-17T11:59:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.257+0000 7f1b65bcc640 1 -- 10.20.193.51:0/1750289711 wait complete. 2026-02-17T11:59:34.291 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:34.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:59:34.292 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:59:34.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.356+0000 7fddad385640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.356+0000 7fddad385640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.356+0000 7fddad385640 10 monclient: monmap: 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:34.357599+0000 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:34.357599+0000 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.361 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 Processor -- start 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 -- start start 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient: init 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdda80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:34.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 0x7fdda809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): picked mon.noname-b con 0x7fdda80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdda813b760 0x7fdda813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): picked mon.noname-c con 0x7fdda813b760 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda806e140 con 0x7fdda80a3bb0 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdda809f910 con 0x7fdda813b760 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdda809ccd0 con 0x7fdda80a0750 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fddad385640 10 monclient(hunting): authenticate will time out at 1461.976371s 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda6ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fdda80a3bb0 0x7fdda809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55880/0 (socket says 10.20.193.51:55880) 2026-02-17T11:59:34.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 0x7fdda809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda6ffd640 1 -- 10.20.193.51:0/3789623259 learned_addr learned my addr 10.20.193.51:0/3789623259 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): get_auth_request con 0x7fdda80a0750 auth_method 0 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda77fe640 1 --2- 10.20.193.51:0/3789623259 >> v2:10.20.193.142:3300/0 conn(0x7fdda813b760 0x7fdda813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda77fe640 10 monclient(hunting): get_auth_request con 0x7fdda813b760 auth_method 0 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient(hunting): handle_auth_done global_id 174194 payload 274 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 -- 10.20.193.51:0/3789623259 >> v2:10.20.193.142:3300/0 conn(0x7fdda813b760 msgr2=0x7fdda813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 --2- 10.20.193.51:0/3789623259 >> v2:10.20.193.142:3300/0 conn(0x7fdda813b760 0x7fdda813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 -- 10.20.193.51:0/3789623259 >> v1:10.20.193.51:6789/0 conn(0x7fdda80a3bb0 legacy=0x7fdda809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 monclient: found mon.noname-b 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.357+0000 7fdda67fc640 1 -- 10.20.193.51:0/3789623259 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda809eec0 con 0x7fdda80a0750 2026-02-17T11:59:34.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda67fc640 1 -- 10.20.193.51:0/3789623259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 msgr2=0x7fdda809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda67fc640 1 --2- 10.20.193.51:0/3789623259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 0x7fdda809e1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdda809f230 tx=0x7fdd9002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b717155dbcc1f70 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 1 -- 10.20.193.51:0/3789623259 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9003c070 con 0x7fdda80a0750 2026-02-17T11:59:34.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: dump: 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.374 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 1 -- 10.20.193.51:0/3789623259 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9002fbd0 con 0x7fdda80a0750 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 1 -- 10.20.193.51:0/3789623259 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90037440 con 0x7fdda80a0750 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 5 monclient: authenticate success, global_id 174194 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 4 set_mon_vals no callback set 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fdda5ffb640 10 monclient: dump: 2026-02-17T11:59:34.375 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 10 monclient: shutdown 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 -- 10.20.193.51:0/3789623259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 msgr2=0x7fdda809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 --2- 10.20.193.51:0/3789623259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 0x7fdda809e1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdda809f230 tx=0x7fdd9002ed50 comp rx=0 tx=0).stop 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 -- 10.20.193.51:0/3789623259 shutdown_connections 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 --2- 10.20.193.51:0/3789623259 >> v2:10.20.193.142:3300/0 conn(0x7fdda813b760 0x7fdda813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 --2- 10.20.193.51:0/3789623259 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a0750 0x7fdda809e1d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 -- 10.20.193.51:0/3789623259 >> 10.20.193.51:0/3789623259 conn(0x7fdda80a30c0 msgr2=0x7fdda80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 -- 10.20.193.51:0/3789623259 shutdown_connections 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.360+0000 7fddad385640 1 -- 10.20.193.51:0/3789623259 wait complete. 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient: monmap: 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:34.377 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 Processor -- start 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 -- start start 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient: init 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdda80a0750 0x7fdda81cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): picked mon.noname-a con 0x7fdda80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 0x7fdda81d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): picked mon.noname-c con 0x7fdda80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdda813b760 0x7fdda8131260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): picked mon.noname-b con 0x7fdda813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdda80a04b0 con 0x7fdda80a0750 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdda809c850 con 0x7fdda813b760 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdda809e710 con 0x7fdda80a3bb0 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fddad385640 10 monclient(hunting): authenticate will time out at 1461.980679s 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdda80a0750 0x7fdda81cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 0x7fdda81d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdda80a0750 0x7fdda81cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54542/0 (socket says 10.20.193.51:54542) 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 0x7fdda81d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39076/0 (socket says 10.20.193.51:39076) 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 1 -- 10.20.193.51:0/2845951845 learned_addr learned my addr 10.20.193.51:0/2845951845 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): get_auth_request con 0x7fdda80a0750 auth_method 0 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): get_auth_request con 0x7fdda80a3bb0 auth_method 0 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient(hunting): handle_auth_done global_id 174197 payload 824 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdda813b760 msgr2=0x7fdda8131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdda813b760 0x7fdda8131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdda80a0750 msgr2=0x7fdda81cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdda80a0750 0x7fdda81cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.361+0000 7fdda67fc640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda8134a70 con 0x7fdda80a3bb0 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda67fc640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 msgr2=0x7fdda81d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda67fc640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 0x7fdda81d0010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd90036000 tx=0x7fdd900047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90046020 con 0x7fdda80a3bb0 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: dump: 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.382 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90037e50 con 0x7fdda80a3bb0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 5 monclient: authenticate success, global_id 174197 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 monclient: _renew_subs 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda809d7b0 con 0x7fdda80a3bb0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9003c040 con 0x7fdda80a3bb0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 10 monclient: dump: 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda4ff9640 4 set_mon_vals no callback set 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 monclient: _renew_subs 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda8134d50 con 0x7fdda80a3bb0 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 0x7fdda8131b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdda809dac0 con 0x7fdda81317a0 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 0x7fdda8131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient: get_auth_request con 0x7fdda81317a0 auth_method 0 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdd9003f030 con 0x7fdda80a3bb0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_done global_id 174200 payload 824 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.364+0000 7fdda6ffd640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdda8132d10 con 0x7fdda81317a0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.365+0000 7fdd877fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdd7403dd10 0x7fdd740401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.365+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(504..504 src has 323..504) ==== 4783+0+0 (secure 0 0 0) 0x7fdd90076eb0 con 0x7fdda80a3bb0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.365+0000 7fdda77fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdd7403dd10 0x7fdd740401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.365+0000 7fdda77fe640 10 monclient: get_auth_request con 0x7fdd7403dd10 auth_method 0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdda6ffd640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 msgr2=0x7fdda8131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdda6ffd640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 0x7fdda8131b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00ea70 tx=0x7fdd9c00ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c01a070 con 0x7fdda81317a0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 10 monclient: dump: 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fdd9c00cba0 con 0x7fdda81317a0 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 msgr2=0x7fdda8131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 0x7fdda8131b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00ea70 tx=0x7fdd9c00ef40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 msgr2=0x7fdda8131b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdd877fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81317a0 0x7fdda8131b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.367+0000 7fdda77fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdd7403dd10 0x7fdd740401d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009fa0 tx=0x7fdd980096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fddad385640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fddad385640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 0x7fdda81daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fddad385640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdda80008d0 con 0x7fdda81320c0 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 0x7fdda81daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient: get_auth_request con 0x7fdda81320c0 auth_method 0 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 10 monclient(hunting): handle_auth_done global_id 174203 payload 824 2026-02-17T11:59:34.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.370+0000 7fdda6ffd640 1 -- 10.20.193.51:0/2845951845 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdda8050ac0 con 0x7fdda81320c0 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.372+0000 7fdda6ffd640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 msgr2=0x7fdda81daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.372+0000 7fdda6ffd640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 0x7fdda81daad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c017000 tx=0x7fdd9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c01a050 con 0x7fdda81320c0 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 10 monclient: dump: 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.390 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7fdd9c01b040 con 0x7fdda81320c0 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 msgr2=0x7fdda81daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 0x7fdda81daad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c017000 tx=0x7fdd9c004a40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 msgr2=0x7fdda81daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdd877fe640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda81320c0 0x7fdda81daad0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c017000 tx=0x7fdd9c004a40 comp rx=0 tx=0).stop 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 55139, 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.392 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.393 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:34.394 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.395 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:34.396 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.397 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.398 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdd7403dd10 msgr2=0x7fdd740401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdd7403dd10 0x7fdd740401d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009fa0 tx=0x7fdd980096a0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 10 monclient: shutdown 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 msgr2=0x7fdda81d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 --2- 10.20.193.51:0/2845951845 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdda80a3bb0 0x7fdda81d0010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd90036000 tx=0x7fdd900047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdda77fe640 1 -- 10.20.193.51:0/2845951845 reap_dead start 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fdda77fe640 1 -- 10.20.193.51:0/2845951845 reap_dead start 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 shutdown_connections 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 >> 10.20.193.51:0/2845951845 conn(0x7fdda80a30c0 msgr2=0x7fdda8139dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 shutdown_connections 2026-02-17T11:59:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.373+0000 7fddad385640 1 -- 10.20.193.51:0/2845951845 wait complete. 2026-02-17T11:59:34.403 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:34.403 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:59:34.403 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:59:34.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.470+0000 7f48569a9640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.470+0000 7f48569a9640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.470+0000 7f48569a9640 10 monclient: monmap: 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:34.471745+0000 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:34.471745+0000 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:34.475 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 Processor -- start 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 -- start start 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient: init 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f48500a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48500a0750 0x7f485009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-a con 0x7f48500a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f485013b760 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485006e140 con 0x7f485013b760 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485009f910 con 0x7f48500a3bb0 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f485009ccd0 con 0x7f48500a0750 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f48569a9640 10 monclient(hunting): authenticate will time out at 1462.090511s 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48500a0750 0x7f485009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f48500a0750 0x7f485009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54548/0 (socket says 10.20.193.51:54548) 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 -- 10.20.193.51:0/978749776 learned_addr learned my addr 10.20.193.51:0/978749776 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): get_auth_request con 0x7f48500a0750 auth_method 0 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f4854f1f640 1 --1- 10.20.193.51:0/978749776 >> v1:10.20.193.51:6789/0 conn(0x7f485013b760 0x7f485013db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55896/0 (socket says 10.20.193.51:55896) 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient(hunting): handle_auth_done global_id 164343 payload 274 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 -- 10.20.193.51:0/978749776 >> v1:10.20.193.142:6789/0 conn(0x7f48500a3bb0 legacy=0x7f485009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 -- 10.20.193.51:0/978749776 >> v1:10.20.193.51:6789/0 conn(0x7f485013b760 legacy=0x7f485013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:34.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.471+0000 7f484f7fe640 1 -- 10.20.193.51:0/978749776 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485009eec0 con 0x7f48500a0750 2026-02-17T11:59:34.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484f7fe640 1 -- 10.20.193.51:0/978749776 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a0750 msgr2=0x7f485009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484f7fe640 1 --2- 10.20.193.51:0/978749776 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a0750 0x7f485009e1d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4840009970 tx=0x7f484002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dbf1854831709 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 1 -- 10.20.193.51:0/978749776 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484003c070 con 0x7f48500a0750 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: dump: 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.484 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 1 -- 10.20.193.51:0/978749776 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484002fdb0 con 0x7f48500a0750 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 1 -- 10.20.193.51:0/978749776 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840037660 con 0x7f48500a0750 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 5 monclient: authenticate success, global_id 164343 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 4 set_mon_vals no callback set 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:34.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f484effd640 10 monclient: dump: 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 10 monclient: shutdown 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 -- 10.20.193.51:0/978749776 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a0750 msgr2=0x7f485009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 --2- 10.20.193.51:0/978749776 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a0750 0x7f485009e1d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4840009970 tx=0x7f484002ee90 comp rx=0 tx=0).stop 2026-02-17T11:59:34.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 -- 10.20.193.51:0/978749776 shutdown_connections 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 --2- 10.20.193.51:0/978749776 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a0750 0x7f485009e1d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 -- 10.20.193.51:0/978749776 >> 10.20.193.51:0/978749776 conn(0x7f48500a30c0 msgr2=0x7f48500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 -- 10.20.193.51:0/978749776 shutdown_connections 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.474+0000 7f48569a9640 1 -- 10.20.193.51:0/978749776 wait complete. 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient: monmap: 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:34.487 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 Processor -- start 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 -- start start 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient: init 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48500a0750 0x7f48501cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-b con 0x7f48500a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 0x7f485009a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-a con 0x7f48500a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f485013b760 0x7f485009ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): picked mon.noname-c con 0x7f485013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f48500a04b0 con 0x7f48500a3bb0 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f485009c850 con 0x7f48500a0750 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f485009e710 con 0x7f485013b760 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f48569a9640 10 monclient(hunting): authenticate will time out at 1462.094636s 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 0x7f485009a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 0x7f485009a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54558/0 (socket says 10.20.193.51:54558) 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 -- 10.20.193.51:0/90943149 learned_addr learned my addr 10.20.193.51:0/90943149 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): get_auth_request con 0x7f48500a3bb0 auth_method 0 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f485013b760 0x7f485009ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): get_auth_request con 0x7f485013b760 auth_method 0 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f4854f1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient(hunting): handle_auth_done global_id 164346 payload 824 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f485013b760 msgr2=0x7f485009ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f485013b760 0x7f485009ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48500a0750 msgr2=0x7f48501cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48500a0750 0x7f48501cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.475+0000 7f484f7fe640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485006f6c0 con 0x7f48500a3bb0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.477+0000 7f484f7fe640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 msgr2=0x7f485009a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.477+0000 7f484f7fe640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 0x7f485009a5c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4840009970 tx=0x7f48400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840046070 con 0x7f48500a3bb0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: dump: 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.491 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4840037e10 con 0x7f48500a3bb0 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484003c040 con 0x7f48500a3bb0 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484e7fc640 4 set_mon_vals no callback set 2026-02-17T11:59:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 10 monclient: dump: 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 5 monclient: authenticate success, global_id 164346 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 monclient: _renew_subs 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48500a28c0 con 0x7f48500a3bb0 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 monclient: _renew_subs 2026-02-17T11:59:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4850133e60 con 0x7f48500a3bb0 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f485009d840 con 0x7f4850134030 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient: get_auth_request con 0x7f4850134030 auth_method 0 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f48400418b0 con 0x7f48500a3bb0 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 msgr2=0x7f485009b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 msgr2=0x7f485009b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.478+0000 7f484cff9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f482003dd10 0x7f48200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.479+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(504..504 src has 323..504) ==== 4783+0+0 (secure 0 0 0) 0x7f4840077db0 con 0x7f48500a3bb0 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.479+0000 7f4854f1f640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f482003dd10 0x7f48200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.479+0000 7f4854f1f640 10 monclient: get_auth_request con 0x7f482003dd10 auth_method 0 2026-02-17T11:59:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.481+0000 7f4854f1f640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f482003dd10 0x7f48200401d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f485006dab0 tx=0x7f4844005380 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2166: done (2 left) 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2167: copy_from oid 13 from oid 1 current snap is 236 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2164: finishing write tid 2 to trial14245205-6 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2164: finishing write tid 3 to trial14245205-6 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2164: finishing write tid 4 to trial14245205-6 2026-02-17T11:59:34.626 INFO:tasks.rados.rados.0.trial142.stdout:2164: oid 6 updating version 0 to 730 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2164: oid 6 updating version 730 to 731 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2164: oid 6 version 731 is already newer than 729 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 731 (ObjNum 750 snap 236 seq_num 750) dirty exists 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2164: left oid 6 (ObjNum 750 snap 236 seq_num 750) 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2165: finishing copy_from racing read to trial14245205-50 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2165: finishing copy_from to trial14245205-50 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1233 (ObjNum 733 snap 232 seq_num 733) dirty exists 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2164: done (2 left) 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2165: done (1 left) 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:2168: rollback oid 50 current snap is 236 2026-02-17T11:59:34.627 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 235 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2169: read oid 4 snap -1 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2169: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2170: read oid 17 snap 235 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2170: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2171: rollback oid 48 current snap is 236 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 235 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2172: copy_from oid 22 from oid 37 current snap is 236 2026-02-17T11:59:34.628 INFO:tasks.rados.rados.0.trial142.stdout:2173: snap_create 2026-02-17T11:59:34.629 INFO:tasks.rados.rados.0.trial142.stdout:2172: finishing copy_from to trial14245205-22 2026-02-17T11:59:34.629 INFO:tasks.rados.rados.0.trial142.stdout:2172: got expected ENOENT (src dne) 2026-02-17T11:59:34.629 INFO:tasks.rados.rados.0.trial142.stdout:2172: finishing copy_from racing read to trial14245205-22 2026-02-17T11:59:34.629 INFO:tasks.rados.rados.0.trial142.stdout:2171: finishing rollback tid 0 to trial14245205-48 2026-02-17T11:59:34.629 INFO:tasks.rados.rados.0.trial142.stdout:2171: finishing rollback tid 1 to trial14245205-48 2026-02-17T11:59:34.630 INFO:tasks.rados.rados.0.trial142.stdout:2171: finishing rollback tid 2 to trial14245205-48 2026-02-17T11:59:34.630 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1608 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:59:34.630 INFO:tasks.rados.rados.0.trial142.stdout:2168: finishing rollback tid 0 to trial14245205-50 2026-02-17T11:59:34.630 INFO:tasks.rados.rados.0.trial142.stdout:2169: expect (ObjNum 447 snap 134 seq_num 447) 2026-02-17T11:59:34.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient: get_auth_request con 0x7f4850134030 auth_method 0 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 10 monclient(hunting): handle_auth_done global_id 184108 payload 824 2026-02-17T11:59:34.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.679+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f485009dac0 con 0x7f4850134030 2026-02-17T11:59:34.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 msgr2=0x7f485009b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c00fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c017030 con 0x7f4850134030 2026-02-17T11:59:34.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 10 monclient: dump: 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.685 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f483c003e50 con 0x7f4850134030 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 msgr2=0x7f485009b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c00fa10 comp rx=0 tx=0).stop 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 msgr2=0x7f485009b040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.682+0000 7f484cff9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4850134030 0x7f485009b040 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c00fa10 comp rx=0 tx=0).stop 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f48569a9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f48569a9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 0x7f48501daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f48569a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48501335c0 con 0x7f48501d0360 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 0x7f48501daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient: get_auth_request con 0x7f48501d0360 auth_method 0 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 10 monclient(hunting): handle_auth_done global_id 184111 payload 824 2026-02-17T11:59:34.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.685+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f485009c0a0 con 0x7f48501d0360 2026-02-17T11:59:34.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484ffff640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 msgr2=0x7f48501daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484ffff640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 0x7f48501daad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c0038d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c01d930 con 0x7f48501d0360 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 10 monclient: dump: 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f483c01d930 con 0x7f48501d0360 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 msgr2=0x7f48501daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 0x7f48501daad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c0038d0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 msgr2=0x7f48501daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:34.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f484cff9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f48501d0360 0x7f48501daad0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f483c00f540 tx=0x7f483c0038d0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 7074, 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:34.693 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.694 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.695 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.696 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:34.697 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:34.698 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:34.699 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.700 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.701 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:34.703 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.704 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.705 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:34.706 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:34.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f482003dd10 msgr2=0x7f48200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f482003dd10 0x7f48200401d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f485006dab0 tx=0x7f4844005380 comp rx=0 tx=0).stop 2026-02-17T11:59:34.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 10 monclient: shutdown 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 msgr2=0x7f485009a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 --2- 10.20.193.51:0/90943149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f48500a3bb0 0x7f485009a5c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4840009970 tx=0x7f48400047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f4854f1f640 1 -- 10.20.193.51:0/90943149 reap_dead start 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f4854f1f640 1 -- 10.20.193.51:0/90943149 reap_dead start 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 shutdown_connections 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 >> 10.20.193.51:0/90943149 conn(0x7f48500a30c0 msgr2=0x7f4850072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 shutdown_connections 2026-02-17T11:59:34.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.688+0000 7f48569a9640 1 -- 10.20.193.51:0/90943149 wait complete. 2026-02-17T11:59:34.710 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:34.710 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T11:59:34.710 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T11:59:34.742 INFO:tasks.rados.rados.0.trial142.stdout:2168: finishing rollback tid 1 to trial14245205-50 2026-02-17T11:59:34.742 INFO:tasks.rados.rados.0.trial142.stdout:2168: finishing rollback tid 2 to trial14245205-50 2026-02-17T11:59:34.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1497 (ObjNum 718 snap 225 seq_num 718) dirty exists 2026-02-17T11:59:34.742 INFO:tasks.rados.rados.0.trial142.stdout:2170: expect (ObjNum 714 snap 224 seq_num 714) 2026-02-17T11:59:34.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: monmap: 2026-02-17T11:59:34.780 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:34.777120+0000 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:34.777120+0000 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:34.781 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 Processor -- start 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 -- start start 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: init 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-b con 0x7fa1500a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa1500a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa15013b760 0x7fa15013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-a con 0x7fa15013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15006e140 con 0x7fa1500a0750 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa15009f910 con 0x7fa15013b760 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa15009ccd0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa1577b6640 10 monclient(hunting): authenticate will time out at 1462.395884s 2026-02-17T11:59:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa155d2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa15013b760 0x7fa15013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39114/0 (socket says 10.20.193.51:39114) 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 1 -- 10.20.193.51:0/250573243 learned_addr learned my addr 10.20.193.51:0/250573243 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa154d2a640 1 --1- 10.20.193.51:0/250573243 >> v1:10.20.193.51:6789/0 conn(0x7fa1500a0750 0x7fa15009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55898/0 (socket says 10.20.193.51:55898) 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 10 monclient(hunting): get_auth_request con 0x7fa1500a3bb0 auth_method 0 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa15552b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.776+0000 7fa155d2c640 10 monclient(hunting): get_auth_request con 0x7fa15013b760 auth_method 0 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient(hunting): handle_auth_done global_id 174209 payload 274 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 1 -- 10.20.193.51:0/250573243 >> v2:10.20.193.51:3300/0 conn(0x7fa15013b760 msgr2=0x7fa15013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 1 --2- 10.20.193.51:0/250573243 >> v2:10.20.193.51:3300/0 conn(0x7fa15013b760 0x7fa15013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 1 -- 10.20.193.51:0/250573243 >> v1:10.20.193.51:6789/0 conn(0x7fa1500a0750 legacy=0x7fa15009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 1 monclient: found mon.noname-b 2026-02-17T11:59:34.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.777+0000 7fa15552b640 1 -- 10.20.193.51:0/250573243 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15009eec0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa15552b640 1 -- 10.20.193.51:0/250573243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 msgr2=0x7fa15009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa15552b640 1 --2- 10.20.193.51:0/250573243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa15009f230 tx=0x7fa14002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9b5d77dbbd996b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 1 -- 10.20.193.51:0/250573243 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14003c070 con 0x7fa1500a3bb0 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: dump: 2026-02-17T11:59:34.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa1577b6640 5 monclient: authenticate success, global_id 174209 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa1577b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 1 -- 10.20.193.51:0/250573243 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14002fcc0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 1 -- 10.20.193.51:0/250573243 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140037660 con 0x7fa1500a3bb0 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa1577b6640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa1577b6640 4 set_mon_vals no callback set 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.779+0000 7fa13ffff640 10 monclient: dump: 2026-02-17T11:59:34.795 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 10 monclient: shutdown 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- 10.20.193.51:0/250573243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 msgr2=0x7fa15009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 --2- 10.20.193.51:0/250573243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa15009f230 tx=0x7fa14002ee80 comp rx=0 tx=0).stop 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- 10.20.193.51:0/250573243 shutdown_connections 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 --2- 10.20.193.51:0/250573243 >> v2:10.20.193.51:3300/0 conn(0x7fa15013b760 0x7fa15013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 --2- 10.20.193.51:0/250573243 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa15009dac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- 10.20.193.51:0/250573243 >> 10.20.193.51:0/250573243 conn(0x7fa1500a30c0 msgr2=0x7fa1500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- 10.20.193.51:0/250573243 shutdown_connections 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- 10.20.193.51:0/250573243 wait complete. 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 10 monclient: monmap: 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:34.797 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 Processor -- start 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 1 -- start start 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.780+0000 7fa1577b6640 10 monclient: init 2026-02-17T11:59:34.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1500a0750 0x7fa150099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-b con 0x7fa1500a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-c con 0x7fa1500a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa15013b760 0x7fa150091070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): picked mon.noname-a con 0x7fa15013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa1500a04b0 con 0x7fa15013b760 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa15009c850 con 0x7fa1500a0750 2026-02-17T11:59:34.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa15009e710 con 0x7fa1500a3bb0 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa1577b6640 10 monclient(hunting): authenticate will time out at 1462.400273s 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa15013b760 0x7fa150091070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39120/0 (socket says 10.20.193.51:39120) 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 -- 10.20.193.51:0/2598501300 learned_addr learned my addr 10.20.193.51:0/2598501300 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): get_auth_request con 0x7fa1500a3bb0 auth_method 0 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): get_auth_request con 0x7fa15013b760 auth_method 0 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa15552b640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1500a0750 0x7fa150099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa155d2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa15552b640 10 monclient(hunting): get_auth_request con 0x7fa1500a0750 auth_method 0 2026-02-17T11:59:34.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa15552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa15552b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa15552b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient(hunting): handle_auth_done global_id 174212 payload 824 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 -- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1500a0750 msgr2=0x7fa150099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1500a0750 0x7fa150099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 -- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa15013b760 msgr2=0x7fa150091070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa15013b760 0x7fa150091070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.781+0000 7fa154d2a640 1 -- 10.20.193.51:0/2598501300 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa150093260 con 0x7fa1500a3bb0 2026-02-17T11:59:34.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa154d2a640 1 -- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 msgr2=0x7fa150090b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa154d2a640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa14400c520 tx=0x7fa14400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144017070 con 0x7fa1500a3bb0 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: dump: 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa144007070 con 0x7fa1500a3bb0 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144007460 con 0x7fa1500a3bb0 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13dffb640 10 monclient: dump: 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa13f7fe640 4 set_mon_vals no callback set 2026-02-17T11:59:34.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 5 monclient: authenticate success, global_id 174212 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 10 monclient: _renew_subs 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15009d7b0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 10 monclient: _renew_subs 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.783+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa150094860 con 0x7fa1500a3bb0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa1577b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa1577b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa1577b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa150139ab0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa14401b3b0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa13dffb640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 0x7fa1200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(505..505 src has 323..505) ==== 4811+0+0 (secure 0 0 0) 0x7fa144051e30 con 0x7fa1500a3bb0 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa15552b640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 0x7fa1200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.784+0000 7fa15552b640 10 monclient: get_auth_request con 0x7fa12003dd10 auth_method 0 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.787+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa150139ab0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.787+0000 7fa13dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.787+0000 7fa13dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.787+0000 7fa15552b640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 0x7fa1200401d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa140036000 tx=0x7fa140039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.807 INFO:tasks.rados.rados.0.trial142.stdout:2167: finishing copy_from racing read to trial14245205-13 2026-02-17T11:59:34.808 INFO:tasks.rados.rados.0.trial142.stdout:2167: finishing copy_from to trial14245205-13 2026-02-17T11:59:34.808 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 1494 (ObjNum 732 snap 232 seq_num 732) dirty exists 2026-02-17T11:59:34.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.900+0000 7fa1577b6640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.900+0000 7fa1577b6640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.900+0000 7fa1577b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.900+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa15009dac0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.901+0000 7fa13dffb640 1 -- 10.20.193.51:0/2598501300 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa14400a2e0 con 0x7fa1500a3bb0 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.901+0000 7fa13dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T11:59:34.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.901+0000 7fa13dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 msgr2=0x7fa1200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 0x7fa1200401d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa140036000 tx=0x7fa140039040 comp rx=0 tx=0).stop 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 10 monclient: shutdown 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 msgr2=0x7fa150090b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa14400c520 tx=0x7fa14400c9f0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 shutdown_connections 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa12003dd10 0x7fa1200401d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa15013b760 0x7fa150091070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa1500a3bb0 0x7fa150090b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 --2- 10.20.193.51:0/2598501300 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa1500a0750 0x7fa150099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 >> 10.20.193.51:0/2598501300 conn(0x7fa1500a30c0 msgr2=0x7fa15013a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 shutdown_connections 2026-02-17T11:59:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:34.902+0000 7fa1577b6640 1 -- 10.20.193.51:0/2598501300 wait complete. 2026-02-17T11:59:34.910 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=11,logm=49} crc {auth=3801979529,config=692619927,health=1458845976,kv=3197728122,logm=825925553}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=2,health=12,kv=10,logm=49} crc {auth=3716222801,config=692619927,health=4252548296,kv=4015639851,logm=2889240013}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=11,logm=49} crc {auth=3801979529,config=692619927,health=1458845976,kv=3197728122,logm=825925553}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=10,kv=11,logm=50} crc {auth=1377524403,config=692619927,health=4228488763,kv=124369429,logm=3976000006}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1905794498}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=61611078}) 2026-02-17T11:59:34.911 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.912 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1905794498}) 2026-02-17T11:59:34.912 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.908+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3853670373}) 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800857587}) 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=513820647}) 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800857587}) 2026-02-17T11:59:34.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=333325682}) 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813405332}) 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3732837260}) 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813405332}) 2026-02-17T11:59:34.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=521377787}) 2026-02-17T11:59:34.915 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=579179382}) 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=755971134}) 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=579179382}) 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1827208476}) 2026-02-17T11:59:34.918 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1607971105}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3554347976}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1607971105}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=948712127}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1922606319}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4288994317}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1922606319}) 2026-02-17T11:59:34.919 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1194003128}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3960465865}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3348653054}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3960465865}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2328388020}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2644445120}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2052853965}) 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:34.920 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2644445120}) 2026-02-17T11:59:34.921 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:34.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1463180388}) 2026-02-17T11:59:35.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3245318894}) 2026-02-17T11:59:35.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3224002746}) 2026-02-17T11:59:35.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3245318894}) 2026-02-17T11:59:35.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.220+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3441640612}) 2026-02-17T11:59:35.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118668508}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=457423070}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118668508}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3547567532}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2770155782}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1729977186}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2770155782}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=319710925}) 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=204773211}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1874051223}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=204773211}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.291+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3256931152}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1661385395}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2028826918}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1661385395}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=354842067}) 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=994061655}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2950196294}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=994061655}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2225528396}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.292+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913740208}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=255234615}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913740208}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3668978841}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134530080}) 2026-02-17T11:59:35.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=599386044}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134530080}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1378385929}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2864965439}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3815162487}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2864965439}) 2026-02-17T11:59:35.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.293+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=888717193}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743367735}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=575092580}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743367735}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2776946770}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448826615}) 2026-02-17T11:59:35.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2169356081}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448826615}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=394886569}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2049958389}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3685180868}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2049958389}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.294+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2080455747}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=289231198}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3910814988}) 2026-02-17T11:59:35.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=289231198}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2850959541}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2851243378}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=590725484}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2851243378}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2599966452}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3717457563}) 2026-02-17T11:59:35.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3688419162}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.295+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3717457563}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=905629544}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4215507081}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2378067754}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4215507081}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1247830382}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551429196}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2716093950}) 2026-02-17T11:59:35.312 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551429196}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.296+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=695922783}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082442963}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1733023840}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082442963}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2389459144}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639992329}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1441218389}) 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.313 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639992329}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4085542862}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1841319377}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1587536047}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1841319377}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.297+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1790339933}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052862379}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1798334067}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052862379}) 2026-02-17T11:59:35.314 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1652379831}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770403639}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1827470965}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770403639}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3707714074}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.298+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155908260}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4060968241}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155908260}) 2026-02-17T11:59:35.315 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1635959345}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451755828}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2292211164}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451755828}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3942981036}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884672170}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=274380318}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884672170}) 2026-02-17T11:59:35.316 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.299+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=960253405}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2090895816}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3320475249}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2090895816}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=456279952}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3021957754}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3679673124}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3021957754}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3531139416}) 2026-02-17T11:59:35.317 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999614172}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3324827489}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999614172}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.300+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3048408369}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1825315112}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=735101213}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1825315112}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2846446405}) 2026-02-17T11:59:35.318 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158064042}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3986888346}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158064042}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3277360663}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935912716}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2277038263}) 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.319 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935912716}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.301+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3107301238}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=676685897}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4161221382}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=676685897}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2118359430}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=538543256}) 2026-02-17T11:59:35.320 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1899294454}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=538543256}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2576410191}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990833043}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2983265081}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990833043}) 2026-02-17T11:59:35.321 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.302+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4190760345}) 2026-02-17T11:59:35.327 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.327 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2851389033}) 2026-02-17T11:59:35.327 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1265007144}) 2026-02-17T11:59:35.327 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2851389033}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.309+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=634542838}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361134364}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3126195193}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361134364}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3114843718}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2423633468}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2718938352}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2423633468}) 2026-02-17T11:59:35.328 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.310+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3426637218}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2378595491}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2420114330}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2378595491}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2186250699}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781010994}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=692325500}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781010994}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3421920865}) 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.329 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465281671}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=771079513}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465281671}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.311+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=549759818}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=660334122}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3356836200}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=660334122}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3097385964}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1583649419}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2774371069}) 2026-02-17T11:59:35.330 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1583649419}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3361869116}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2937777180}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=650102346}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2937777180}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.312+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3201179890}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1920898225}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3879890214}) 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1920898225}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1235523706}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=20} crc {logm=4120991329,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1678651402,mon_config_key=2169156338,monmap=263989209,osd_metadata=4184050976,osd_pg_creating=663500281,osd_snap=1828123373}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=19} crc {logm=1936363185,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1678651402,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=663500281,osd_snap=3800218268}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=20} crc {logm=4120991329,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1678651402,mon_config_key=2169156338,monmap=263989209,osd_metadata=4184050976,osd_pg_creating=663500281,osd_snap=1828123373}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.313+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=18} crc {logm=3475238823,mdsmap=3207544932,mgr=907738012,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1678651402,mon_config_key=3390328712,monmap=263989209,osd_metadata=101123558,osd_pg_creating=663500281,osd_snap=1388337451}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=60,osdmap=40} crc {osd_snap=1241886367,osdmap=1948703464}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=59,osdmap=41} crc {osd_snap=1580147223,osdmap=2710742486}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=60,osdmap=40} crc {osd_snap=1241886367,osdmap=1948703464}) 2026-02-17T11:59:35.332 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=59,osdmap=41} crc {osd_snap=3034181907,osdmap=1085769065}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2988515353}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2149767538}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2988515353}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.314+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=881375299}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1678407627}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2925228818}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1678407627}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.315+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3380987203}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2389478591}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=41} crc {osdmap=142554593}) 2026-02-17T11:59:35.333 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T11:59:35.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2389478591}) 2026-02-17T11:59:35.334 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T11:59:35.318+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=39} crc {osdmap=1359275768}) 2026-02-17T11:59:35.580 INFO:tasks.rados.rados.0.trial142.stdout:2167: done (6 left) 2026-02-17T11:59:35.580 INFO:tasks.rados.rados.0.trial142.stdout:2168: done (5 left) 2026-02-17T11:59:35.580 INFO:tasks.rados.rados.0.trial142.stdout:2169: done (4 left) 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2170: done (3 left) 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2171: done (2 left) 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2172: done (1 left) 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2173: done (0 left) 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2174: write oid 37 current snap is 237 2026-02-17T11:59:35.581 INFO:tasks.rados.rados.0.trial142.stdout:2174: seq_num 751 ranges {622057=714593,1913624=708433} 2026-02-17T11:59:35.585 INFO:tasks.rados.rados.0.trial142.stdout:2174: writing trial14245205-37 from 622057 to 1336650 tid 1 2026-02-17T11:59:35.589 INFO:tasks.rados.rados.0.trial142.stdout:2174: writing trial14245205-37 from 1913624 to 2622057 tid 2 2026-02-17T11:59:35.590 INFO:tasks.rados.rados.0.trial142.stdout:2175: snap_create 2026-02-17T11:59:35.590 INFO:tasks.rados.rados.0.trial142.stdout:2174: finishing write tid 1 to trial14245205-37 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: finishing write tid 2 to trial14245205-37 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: finishing write tid 3 to trial14245205-37 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: finishing write tid 4 to trial14245205-37 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: oid 37 updating version 0 to 1037 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: oid 37 version 1037 is already newer than 1036 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: oid 37 updating version 1037 to 1038 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 1038 (ObjNum 751 snap 237 seq_num 751) dirty exists 2026-02-17T11:59:35.592 INFO:tasks.rados.rados.0.trial142.stdout:2174: left oid 37 (ObjNum 751 snap 237 seq_num 751) 2026-02-17T11:59:35.916 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T11:59:35.917 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:35.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 10 monclient: get_monmap_and_config 2026-02-17T11:59:35.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 10 monclient: build_initial_monmap 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 10 monclient: monmap: 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:35.984445+0000 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:35.984445+0000 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:35.988 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 1 Processor -- start 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 1 -- start start 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.983+0000 7f35a360e640 10 monclient: init 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:35.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 0x7f359c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-b con 0x7f359c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f359c0a0750 0x7f359c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-c con 0x7f359c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f359c09e540 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c06e140 con 0x7f359c09e540 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f359c0a3f90 con 0x7f359c0a0750 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f359c09f910 con 0x7f359c0a3bb0 2026-02-17T11:59:35.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a360e640 10 monclient(hunting): authenticate will time out at 1463.603189s 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 0x7f359c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1b84640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f359c09e540 0x7f359c13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42028/0 (socket says 10.20.193.51:42028) 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1b84640 1 -- 10.20.193.51:0/2512991152 learned_addr learned my addr 10.20.193.51:0/2512991152 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): get_auth_request con 0x7f359c0a3bb0 auth_method 0 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a0b82640 1 --2- 10.20.193.51:0/2512991152 >> v2:10.20.193.142:3300/0 conn(0x7f359c0a0750 0x7f359c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a0b82640 10 monclient(hunting): get_auth_request con 0x7f359c0a0750 auth_method 0 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a0b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a0b82640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a0b82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient(hunting): handle_auth_done global_id 174215 payload 274 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 -- 10.20.193.51:0/2512991152 >> v2:10.20.193.142:3300/0 conn(0x7f359c0a0750 msgr2=0x7f359c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 --2- 10.20.193.51:0/2512991152 >> v2:10.20.193.142:3300/0 conn(0x7f359c0a0750 0x7f359c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 -- 10.20.193.51:0/2512991152 >> v1:10.20.193.51:6789/0 conn(0x7f359c09e540 legacy=0x7f359c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient: _finish_hunting 0 2026-02-17T11:59:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 monclient: found mon.noname-b 2026-02-17T11:59:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.984+0000 7f35a1383640 1 -- 10.20.193.51:0/2512991152 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c09ccd0 con 0x7f359c0a3bb0 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a1383640 1 -- 10.20.193.51:0/2512991152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 msgr2=0x7f359c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a1383640 1 --2- 10.20.193.51:0/2512991152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 0x7f359c09dac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f359c069d60 tx=0x7f358c02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3430e81a1d13b00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 1 -- 10.20.193.51:0/2512991152 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c03c070 con 0x7f359c0a3bb0 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: dump: 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.001 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 1 -- 10.20.193.51:0/2512991152 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c02fbd0 con 0x7f359c0a3bb0 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 5 monclient: authenticate success, global_id 174215 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 1 -- 10.20.193.51:0/2512991152 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c037440 con 0x7f359c0a3bb0 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 4 set_mon_vals no callback set 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f358bfff640 10 monclient: dump: 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 10 monclient: shutdown 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 -- 10.20.193.51:0/2512991152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 msgr2=0x7f359c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 --2- 10.20.193.51:0/2512991152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 0x7f359c09dac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f359c069d60 tx=0x7f358c02ed50 comp rx=0 tx=0).stop 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 -- 10.20.193.51:0/2512991152 shutdown_connections 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 --2- 10.20.193.51:0/2512991152 >> v2:10.20.193.142:3300/0 conn(0x7f359c0a0750 0x7f359c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 --2- 10.20.193.51:0/2512991152 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a3bb0 0x7f359c09dac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 -- 10.20.193.51:0/2512991152 >> 10.20.193.51:0/2512991152 conn(0x7f359c0a30c0 msgr2=0x7f359c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 -- 10.20.193.51:0/2512991152 shutdown_connections 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 1 -- 10.20.193.51:0/2512991152 wait complete. 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.987+0000 7f35a360e640 10 monclient: monmap: 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:36.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 Processor -- start 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 -- start start 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient: init 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 0x7f359c138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-b con 0x7f359c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-c con 0x7f359c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 0x7f359c130520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): picked mon.noname-a con 0x7f359c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0a04b0 con 0x7f359c0a3bb0 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f359c09c850 con 0x7f359c09e540 2026-02-17T11:59:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f359c13de80 con 0x7f359c0a0750 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a360e640 10 monclient(hunting): authenticate will time out at 1463.607447s 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43410/0 (socket says 10.20.193.51:43410) 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 0x7f359c130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 -- 10.20.193.51:0/2177487598 learned_addr learned my addr 10.20.193.51:0/2177487598 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): get_auth_request con 0x7f359c0a0750 auth_method 0 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): get_auth_request con 0x7f359c0a3bb0 auth_method 0 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient(hunting): handle_auth_done global_id 174218 payload 824 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 -- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 msgr2=0x7f359c138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1383640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 0x7f359c138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 0x7f359c138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 -- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 msgr2=0x7f359c130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 0x7f359c130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 monclient: found mon.noname-c 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a0b82640 1 -- 10.20.193.51:0/2177487598 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c06f410 con 0x7f359c0a0750 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1383640 10 monclient: get_auth_request con 0x7f359c09e540 auth_method 0 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1383640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 0x7f359c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.988+0000 7f35a1b84640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 0x7f359c130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a0b82640 1 -- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 msgr2=0x7f359c12ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a0b82640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f359000e7a0 tx=0x7f359000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590017020 con 0x7f359c0a0750 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: dump: 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.011 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3590004440 con 0x7f359c0a0750 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359000f040 con 0x7f359c0a0750 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f3589ffb640 10 monclient: dump: 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f358b7fe640 4 set_mon_vals no callback set 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 5 monclient: authenticate success, global_id 174218 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 10 monclient: _renew_subs 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c06f8d0 con 0x7f359c0a0750 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 10 monclient: _renew_subs 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.990+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c133b00 con 0x7f359c0a0750 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3590012050 con 0x7f359c0a0750 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a360e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a360e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a360e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c133620 con 0x7f359c0a0750 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f3589ffb640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 0x7f356c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7f3590052570 con 0x7f359c0a0750 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a1383640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 0x7f356c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.991+0000 7f35a1383640 10 monclient: get_auth_request con 0x7f356c03dd10 auth_method 0 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.994+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3590021020 con 0x7f359c0a0750 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.994+0000 7f3589ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.994+0000 7f3589ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:36.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:35.994+0000 7f35a1383640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 0x7f356c0401d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f359c09f230 tx=0x7f358c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f35a360e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f35a360e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f35a360e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f359c09dac0 con 0x7f359c0a0750 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f3589ffb640 1 -- 10.20.193.51:0/2177487598 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f3590050f50 con 0x7f359c0a0750 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f3589ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:36.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.107+0000 7f3589ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:36.111 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:36.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 msgr2=0x7f356c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 0x7f356c0401d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f359c09f230 tx=0x7f358c033000 comp rx=0 tx=0).stop 2026-02-17T11:59:36.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 10 monclient: shutdown 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 msgr2=0x7f359c12ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f359000e7a0 tx=0x7f359000ec70 comp rx=0 tx=0).stop 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 shutdown_connections 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f356c03dd10 0x7f356c0401d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f359c0a3bb0 0x7f359c130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f359c0a0750 0x7f359c12ffe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 --2- 10.20.193.51:0/2177487598 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f359c09e540 0x7f359c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 >> 10.20.193.51:0/2177487598 conn(0x7f359c0a30c0 msgr2=0x7f359c073000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 shutdown_connections 2026-02-17T11:59:36.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.109+0000 7f35a360e640 1 -- 10.20.193.51:0/2177487598 wait complete. 2026-02-17T11:59:36.119 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T11:59:36.119 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T11:59:36.119 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T11:59:36.119 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:59:36.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 10 monclient: get_monmap_and_config 2026-02-17T11:59:36.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 10 monclient: monmap: 2026-02-17T11:59:36.192 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.192 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:36.188436+0000 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:36.188436+0000 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:36.193 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 1 Processor -- start 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 1 -- start start 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.187+0000 7f0db5953640 10 monclient: init 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0db00a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f0db00a0750 0x7f0db009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-c con 0x7f0db00a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f0db013b760 0x7f0db013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-a con 0x7f0db013b760 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db006e140 con 0x7f0db00a3bb0 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f0db009f910 con 0x7f0db013b760 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0db009ccd0 con 0x7f0db00a0750 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0db5953640 10 monclient(hunting): authenticate will time out at 1463.807284s 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daeffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f0db00a3bb0 0x7f0db009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42036/0 (socket says 10.20.193.51:42036) 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daeffd640 1 -- 10.20.193.51:0/3628001665 learned_addr learned my addr 10.20.193.51:0/3628001665 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 --2- 10.20.193.51:0/3628001665 >> v2:10.20.193.51:3300/0 conn(0x7f0db013b760 0x7f0db013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): get_auth_request con 0x7f0db013b760 auth_method 0 2026-02-17T11:59:36.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3628001665 >> v2:10.20.193.142:3300/0 conn(0x7f0db00a0750 0x7f0db009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request con 0x7f0db00a0750 auth_method 0 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0dae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0dae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient(hunting): handle_auth_done global_id 164358 payload 274 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3628001665 >> v2:10.20.193.142:3300/0 conn(0x7f0db00a0750 msgr2=0x7f0db009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 --2- 10.20.193.51:0/3628001665 >> v2:10.20.193.142:3300/0 conn(0x7f0db00a0750 0x7f0db009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3628001665 >> v1:10.20.193.51:6789/0 conn(0x7f0db00a3bb0 legacy=0x7f0db009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.188+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3628001665 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db009eec0 con 0x7f0db013b760 2026-02-17T11:59:36.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3628001665 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db013b760 msgr2=0x7f0db013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0daf7fe640 1 --2- 10.20.193.51:0/3628001665 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db013b760 0x7f0db013db50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0db006f3c0 tx=0x7f0da002f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530d86efedf72d2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 1 -- 10.20.193.51:0/3628001665 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da003c070 con 0x7f0db013b760 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: dump: 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.208 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 1 -- 10.20.193.51:0/3628001665 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da0037440 con 0x7f0db013b760 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 5 monclient: authenticate success, global_id 164358 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:36.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 1 -- 10.20.193.51:0/3628001665 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0037810 con 0x7f0db013b760 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 4 set_mon_vals no callback set 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0dadffb640 10 monclient: dump: 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 10 monclient: shutdown 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 -- 10.20.193.51:0/3628001665 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db013b760 msgr2=0x7f0db013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 --2- 10.20.193.51:0/3628001665 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db013b760 0x7f0db013db50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0db006f3c0 tx=0x7f0da002f130 comp rx=0 tx=0).stop 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 -- 10.20.193.51:0/3628001665 shutdown_connections 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 --2- 10.20.193.51:0/3628001665 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db013b760 0x7f0db013db50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 --2- 10.20.193.51:0/3628001665 >> v2:10.20.193.142:3300/0 conn(0x7f0db00a0750 0x7f0db009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 -- 10.20.193.51:0/3628001665 >> 10.20.193.51:0/3628001665 conn(0x7f0db00a30c0 msgr2=0x7f0db00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 -- 10.20.193.51:0/3628001665 shutdown_connections 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.191+0000 7f0db5953640 1 -- 10.20.193.51:0/3628001665 wait complete. 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient: monmap: 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:36.212 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 Processor -- start 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 -- start start 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient: init 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-a con 0x7f0db00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0db00a3bb0 0x7f0db013b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-c con 0x7f0db00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0db013b760 0x7f0db0092de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): picked mon.noname-b con 0x7f0db013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00a04b0 con 0x7f0db00a0750 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0db009c850 con 0x7f0db013b760 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0db009e710 con 0x7f0db00a3bb0 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0db5953640 10 monclient(hunting): authenticate will time out at 1463.811694s 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53992/0 (socket says 10.20.193.51:53992) 2026-02-17T11:59:36.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 -- 10.20.193.51:0/3639519773 learned_addr learned my addr 10.20.193.51:0/3639519773 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): get_auth_request con 0x7f0db00a0750 auth_method 0 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0db00a3bb0 0x7f0db013b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request con 0x7f0db00a3bb0 auth_method 0 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient(hunting): handle_auth_done global_id 164361 payload 824 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0db00a3bb0 msgr2=0x7f0db013b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0db00a3bb0 0x7f0db013b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0db013b760 msgr2=0x7f0db0092de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0db013b760 0x7f0db0092de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 monclient: found mon.noname-a 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.192+0000 7f0daeffd640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db00a2d20 con 0x7f0db00a0750 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0daeffd640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 msgr2=0x7f0db013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0daeffd640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c750 tx=0x7f0da400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4005de0 con 0x7f0db00a0750 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: dump: 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da4007070 con 0x7f0db00a0750 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 5 monclient: authenticate success, global_id 164361 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 monclient: _renew_subs 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db00a2450 con 0x7f0db00a0750 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4007440 con 0x7f0db00a0750 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dad7fa640 4 set_mon_vals no callback set 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 10 monclient: dump: 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 monclient: _renew_subs 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db0096910 con 0x7f0db00a0750 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 0x7f0db0093700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00a2b90 con 0x7f0db0093320 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 0x7f0db0093700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient: get_auth_request con 0x7f0db0093320 auth_method 0 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_done global_id 164364 payload 824 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0dae7fc640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0db009dac0 con 0x7f0db0093320 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0daeffd640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c750 tx=0x7f0da400cc20 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f0da4007620 mgrmap(e 5) 2026-02-17T11:59:36.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.195+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0da4007620 con 0x7f0db00a0750 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.196+0000 7f0d87fff640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0d8003dd10 0x7f0d800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.196+0000 7f0daf7fe640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0d8003dd10 0x7f0d800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.196+0000 7f0daf7fe640 10 monclient: get_auth_request con 0x7f0d8003dd10 auth_method 0 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.197+0000 7f0dae7fc640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 msgr2=0x7f0db0093700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.197+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 0x7f0db0093700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800f040 con 0x7f0db0093320 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 10 monclient: dump: 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.222 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f0d9800fe50 con 0x7f0db0093320 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 msgr2=0x7f0db0093700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 0x7f0db0093700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98011ca0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 msgr2=0x7f0db0093700 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.198+0000 7f0d87fff640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093320 0x7f0db0093700 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98011ca0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.199+0000 7f0daf7fe640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0d8003dd10 0x7f0d800401d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0db006c1c0 tx=0x7f0da0031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0db5953640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0db5953640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 0x7f0db01d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0db5953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0db006fe50 con 0x7f0db0093c40 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 0x7f0db01d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient: get_auth_request con 0x7f0db0093c40 auth_method 0 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 10 monclient(hunting): handle_auth_done global_id 164367 payload 824 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.201+0000 7f0dae7fc640 1 -- 10.20.193.51:0/3639519773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0db00951e0 con 0x7f0db0093c40 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0dae7fc640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 msgr2=0x7f0db01d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0dae7fc640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 0x7f0db01d88a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98015660 con 0x7f0db0093c40 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0d87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0d87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.203+0000 7f0d87fff640 10 monclient: dump: 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.225 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f0d98003e30 con 0x7f0db0093c40 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 msgr2=0x7f0db01d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 0x7f0db01d88a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98004830 comp rx=0 tx=0).stop 2026-02-17T11:59:36.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 msgr2=0x7f0db01d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db0093c40 0x7f0db01d88a0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0db0094600 tx=0x7f0d98004830 comp rx=0 tx=0).stop 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 120641, 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:36.227 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.228 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.229 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:36.230 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.231 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.232 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.233 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.234 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.235 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:36.236 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:36.237 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0d8003dd10 msgr2=0x7f0d800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0d8003dd10 0x7f0d800401d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0db006c1c0 tx=0x7f0da0031000 comp rx=0 tx=0).stop 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 10 monclient: shutdown 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 msgr2=0x7f0db013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 --2- 10.20.193.51:0/3639519773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0db00a0750 0x7f0db013ac10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c750 tx=0x7f0da400cc20 comp rx=0 tx=0).stop 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3639519773 reap_dead start 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0d87fff640 1 -- 10.20.193.51:0/3639519773 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (unknown 0 0 0) 0x7f0da4052400 con 0x7f0db00a0750 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0daf7fe640 1 -- 10.20.193.51:0/3639519773 reap_dead start 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 shutdown_connections 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 >> 10.20.193.51:0/3639519773 conn(0x7f0db00a30c0 msgr2=0x7f0db0072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 shutdown_connections 2026-02-17T11:59:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.204+0000 7f0db5953640 1 -- 10.20.193.51:0/3639519773 wait complete. 2026-02-17T11:59:36.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:36.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T11:59:36.240 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T11:59:36.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 10 monclient: get_monmap_and_config 2026-02-17T11:59:36.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 10 monclient: monmap: 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:36.307310+0000 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:36.307310+0000 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:36.311 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 1 Processor -- start 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 1 -- start start 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.306+0000 7fb4d742c640 10 monclient: init 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 0x7fb4d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-c con 0x7fb4d00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-b con 0x7fb4d00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb4d009e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d006e140 con 0x7fb4d009e540 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d00a3f90 con 0x7fb4d00a3bb0 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d009f910 con 0x7fb4d00a0750 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d742c640 10 monclient(hunting): authenticate will time out at 1463.926077s 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43426/0 (socket says 10.20.193.51:43426) 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3720834450 learned_addr learned my addr 10.20.193.51:0/3720834450 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): get_auth_request con 0x7fb4d00a0750 auth_method 0 2026-02-17T11:59:36.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3720834450 >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 0x7fb4d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request con 0x7fb4d00a3bb0 auth_method 0 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_done global_id 174224 payload 274 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3720834450 >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 msgr2=0x7fb4d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 --2- 10.20.193.51:0/3720834450 >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 0x7fb4d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3720834450 >> v1:10.20.193.142:6789/0 conn(0x7fb4d009e540 legacy=0x7fb4d013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 monclient: found mon.noname-b 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3720834450 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d009ccd0 con 0x7fb4d00a0750 2026-02-17T11:59:36.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.307+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3720834450 >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 0x7fb4d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3720834450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 msgr2=0x7fb4d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4d49a0640 1 --2- 10.20.193.51:0/3720834450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4d006c1c0 tx=0x7fb4c402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55d63cb3713044 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 1 -- 10.20.193.51:0/3720834450 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c403c070 con 0x7fb4d00a0750 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: dump: 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.323 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 1 -- 10.20.193.51:0/3720834450 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c402fca0 con 0x7fb4d00a0750 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4d742c640 5 monclient: authenticate success, global_id 174224 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 1 -- 10.20.193.51:0/3720834450 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4037660 con 0x7fb4d00a0750 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4bffff640 10 monclient: dump: 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.325 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4d742c640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.309+0000 7fb4d742c640 4 set_mon_vals no callback set 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 10 monclient: shutdown 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- 10.20.193.51:0/3720834450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 msgr2=0x7fb4d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3720834450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4d006c1c0 tx=0x7fb4c402ee60 comp rx=0 tx=0).stop 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- 10.20.193.51:0/3720834450 shutdown_connections 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3720834450 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d009e000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3720834450 >> v2:10.20.193.142:3300/0 conn(0x7fb4d00a3bb0 0x7fb4d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- 10.20.193.51:0/3720834450 >> 10.20.193.51:0/3720834450 conn(0x7fb4d00a30c0 msgr2=0x7fb4d00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- 10.20.193.51:0/3720834450 shutdown_connections 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- 10.20.193.51:0/3720834450 wait complete. 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 10 monclient: monmap: 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 Processor -- start 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 1 -- start start 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.310+0000 7fb4d742c640 10 monclient: init 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4d009e540 0x7fb4d012bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-a con 0x7fb4d009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-c con 0x7fb4d00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4d00a3bb0 0x7fb4d012c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): picked mon.noname-b con 0x7fb4d00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00a04b0 con 0x7fb4d009e540 2026-02-17T11:59:36.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d009c850 con 0x7fb4d00a3bb0 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d013de80 con 0x7fb4d00a0750 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d742c640 10 monclient(hunting): authenticate will time out at 1463.930197s 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43428/0 (socket says 10.20.193.51:43428) 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3968882097 learned_addr learned my addr 10.20.193.51:0/3968882097 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): get_auth_request con 0x7fb4d00a0750 auth_method 0 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4d009e540 0x7fb4d012bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request con 0x7fb4d009e540 auth_method 0 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient(hunting): handle_auth_done global_id 174227 payload 824 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4d00a3bb0 msgr2=0x7fb4d012c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb4d00a3bb0 0x7fb4d012c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4d009e540 msgr2=0x7fb4d012bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb4d009e540 0x7fb4d012bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 monclient: found mon.noname-c 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.311+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d012d560 con 0x7fb4d00a0750 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d49a0640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 msgr2=0x7fb4d012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d49a0640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4002410 tx=0x7fb4c4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c403c040 con 0x7fb4d00a0750 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: dump: 2026-02-17T11:59:36.331 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c4047070 con 0x7fb4d00a0750 2026-02-17T11:59:36.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4042890 con 0x7fb4d00a0750 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bf7fe640 4 set_mon_vals no callback set 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4bdffb640 10 monclient: dump: 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.333 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 5 monclient: authenticate success, global_id 174227 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 10 monclient: _renew_subs 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d012efb0 con 0x7fb4d00a0750 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 10 monclient: _renew_subs 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.313+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d006f8d0 con 0x7fb4d00a0750 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d742c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 0x7fb4d01cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d012e0c0 con 0x7fb4d012f1f0 2026-02-17T11:59:36.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 0x7fb4d01cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient: get_auth_request con 0x7fb4d012f1f0 auth_method 0 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb4c4042a70 con 0x7fb4d00a0750 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_done global_id 174230 payload 824 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d51a1640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4d006f410 con 0x7fb4d012f1f0 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4bdffb640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4a003dd10 0x7fb4a00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7fb4c4077970 con 0x7fb4d00a0750 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d59a2640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4a003dd10 0x7fb4a00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.314+0000 7fb4d59a2640 10 monclient: get_auth_request con 0x7fb4a003dd10 auth_method 0 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4d51a1640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 msgr2=0x7fb4d01cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 0x7fb4d01cd1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c0011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0019020 con 0x7fb4d012f1f0 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 10 monclient: dump: 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.336 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb4c000f7d0 con 0x7fb4d012f1f0 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 msgr2=0x7fb4d01cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 0x7fb4d01cd1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c0011cd0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 msgr2=0x7fb4d01cd1a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.316+0000 7fb4bdffb640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d012f1f0 0x7fb4d01cd1a0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c0011cd0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.317+0000 7fb4d59a2640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4a003dd10 0x7fb4a00401d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004980 tx=0x7fb4cc003fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d742c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:36.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 0x7fb4d01d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d742c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d009dac0 con 0x7fb4d01cd6e0 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 0x7fb4d01d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient: get_auth_request con 0x7fb4d01cd6e0 auth_method 0 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 10 monclient(hunting): handle_auth_done global_id 174233 payload 824 2026-02-17T11:59:36.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.320+0000 7fb4d51a1640 1 -- 10.20.193.51:0/3968882097 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb4d00008d0 con 0x7fb4d01cd6e0 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d51a1640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 msgr2=0x7fb4d01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d51a1640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 0x7fb4d01d84f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0019070 con 0x7fb4d01cd6e0 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 10 monclient: dump: 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.340 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7fb4c000fd90 con 0x7fb4d01cd6e0 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 msgr2=0x7fb4d01d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 0x7fb4d01d84f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c00047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 msgr2=0x7fb4d01d84f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4bdffb640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d01cd6e0 0x7fb4d01d84f0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0011800 tx=0x7fb4c00047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 57088, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:59:36.342 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.343 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:36.344 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:36.345 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:36.346 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.347 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.348 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.349 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:36.350 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:36.351 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:36.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4a003dd10 msgr2=0x7fb4a00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb4a003dd10 0x7fb4a00401d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004980 tx=0x7fb4cc003fc0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 10 monclient: shutdown 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 msgr2=0x7fb4d012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4002410 tx=0x7fb4c4004830 comp rx=0 tx=0).stop 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d59a2640 1 -- 10.20.193.51:0/3968882097 reap_dead start 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 shutdown_connections 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 --2- 10.20.193.51:0/3968882097 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb4d00a0750 0x7fb4d012c050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 >> 10.20.193.51:0/3968882097 conn(0x7fb4d00a30c0 msgr2=0x7fb4d00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 shutdown_connections 2026-02-17T11:59:36.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.322+0000 7fb4d742c640 1 -- 10.20.193.51:0/3968882097 wait complete. 2026-02-17T11:59:36.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:36.353 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T11:59:36.354 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:59:36.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.419+0000 7f0ee1087640 10 monclient: get_monmap_and_config 2026-02-17T11:59:36.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.419+0000 7f0ee1087640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.419+0000 7f0ee1087640 10 monclient: monmap: 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:36.420820+0000 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:36.420820+0000 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 Processor -- start 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 -- start start 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient: init 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0edc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0edc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f0edc13c770 0x7f0edc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-c con 0x7f0edc13c770 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0edc09e8e0 con 0x7f0edc0a0750 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0edc06e140 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0edc09f910 con 0x7f0edc13c770 2026-02-17T11:59:36.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0ee1087640 10 monclient(hunting): authenticate will time out at 1464.039565s 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0eda575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f0edc0a0750 0x7f0edc09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42050/0 (socket says 10.20.193.51:42050) 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0eda575640 1 -- 10.20.193.51:0/102802502 learned_addr learned my addr 10.20.193.51:0/102802502 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 1 --2- 10.20.193.51:0/102802502 >> v2:10.20.193.142:3300/0 conn(0x7f0edc13c770 0x7f0edc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): get_auth_request con 0x7f0edc13c770 auth_method 0 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.420+0000 7f0edb577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 10 monclient(hunting): handle_auth_done global_id 184126 payload 274 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 1 -- 10.20.193.51:0/102802502 >> v1:10.20.193.142:6789/0 conn(0x7f0edc0a3bb0 legacy=0x7f0edc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 1 -- 10.20.193.51:0/102802502 >> v1:10.20.193.51:6789/0 conn(0x7f0edc0a0750 legacy=0x7f0edc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 1 monclient: found mon.noname-c 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:59:36.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.421+0000 7f0edb577640 1 -- 10.20.193.51:0/102802502 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc09ccd0 con 0x7f0edc13c770 2026-02-17T11:59:36.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0edb577640 1 -- 10.20.193.51:0/102802502 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 msgr2=0x7f0edc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0edb577640 1 --2- 10.20.193.51:0/102802502 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc13eb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009d90 tx=0x7f0ecc02f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891b9b76428aaa4a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 1 -- 10.20.193.51:0/102802502 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc03c070 con 0x7f0edc13c770 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 10 monclient: dump: 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ed9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ee1087640 5 monclient: authenticate success, global_id 184126 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.423+0000 7f0ee1087640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 1 -- 10.20.193.51:0/102802502 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc037640 con 0x7f0edc13c770 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 1 -- 10.20.193.51:0/102802502 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc037a10 con 0x7f0edc13c770 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ed9d74640 10 monclient: dump: 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.435 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 4 set_mon_vals no callback set 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 10 monclient: shutdown 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- 10.20.193.51:0/102802502 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 msgr2=0x7f0edc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 --2- 10.20.193.51:0/102802502 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc13eb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009d90 tx=0x7f0ecc02f190 comp rx=0 tx=0).stop 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- 10.20.193.51:0/102802502 shutdown_connections 2026-02-17T11:59:36.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 --2- 10.20.193.51:0/102802502 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc13eb60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- 10.20.193.51:0/102802502 >> 10.20.193.51:0/102802502 conn(0x7f0edc0a30c0 msgr2=0x7f0edc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- 10.20.193.51:0/102802502 shutdown_connections 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- 10.20.193.51:0/102802502 wait complete. 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 10 monclient: monmap: 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 Processor -- start 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 1 -- start start 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.424+0000 7f0ee1087640 10 monclient: init 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0edc0a0750 0x7f0edc0998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-c con 0x7f0edc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-a con 0x7f0edc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc090420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): picked mon.noname-b con 0x7f0edc13c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc09c850 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc09ebe0 con 0x7f0edc13c770 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0a04b0 con 0x7f0edc0a0750 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0ee1087640 10 monclient(hunting): authenticate will time out at 1464.044108s 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0edc0a0750 0x7f0edc0998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54042/0 (socket says 10.20.193.51:54042) 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 -- 10.20.193.51:0/2284117121 learned_addr learned my addr 10.20.193.51:0/2284117121 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): get_auth_request con 0x7f0edc0a3bb0 auth_method 0 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): get_auth_request con 0x7f0edc0a0750 auth_method 0 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edb577640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc090420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edb577640 10 monclient(hunting): get_auth_request con 0x7f0edc13c770 auth_method 0 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edb577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0edb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient(hunting): handle_auth_done global_id 164373 payload 824 2026-02-17T11:59:36.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0edc0a0750 msgr2=0x7f0edc0998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0edc0a0750 0x7f0edc0998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 msgr2=0x7f0edc090420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc13c770 0x7f0edc090420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 monclient: found mon.noname-a 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.425+0000 7f0eda575640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc094050 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0eda575640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 msgr2=0x7f0edc099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0eda575640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400b530 tx=0x7f0ec400ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400fa60 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: dump: 2026-02-17T11:59:36.441 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec400fc00 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017400 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ed9573640 4 set_mon_vals no callback set 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ebb7fe640 10 monclient: dump: 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 5 monclient: authenticate success, global_id 164373 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 10 monclient: _renew_subs 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc094330 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 10 monclient: _renew_subs 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.427+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc093d70 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ee1087640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ee1087640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 0x7f0edc090960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc13e690 con 0x7f0edc1cf390 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0ec400d3e0 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 0x7f0edc090960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient: get_auth_request con 0x7f0edc1cf390 auth_method 0 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ebb7fe640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0ea803dd10 0x7f0ea80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7f0ec40526b0 con 0x7f0edc0a3bb0 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 10 monclient(hunting): handle_auth_done global_id 184132 payload 824 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edad76640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0edc09dac0 con 0x7f0edc1cf390 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edb577640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0ea803dd10 0x7f0ea80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.428+0000 7f0edb577640 10 monclient: get_auth_request con 0x7f0ea803dd10 auth_method 0 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.430+0000 7f0edad76640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 msgr2=0x7f0edc090960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.430+0000 7f0edad76640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 0x7f0edc090960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000f7a0 tx=0x7f0ed000fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0018030 con 0x7f0edc1cf390 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 10 monclient: dump: 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0edb577640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0ea803dd10 0x7f0ea80401d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0edc06f3c0 tx=0x7f0ecc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f0ed000dbc0 con 0x7f0edc1cf390 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 msgr2=0x7f0edc090960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 0x7f0edc090960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000f7a0 tx=0x7f0ed000fc70 comp rx=0 tx=0).stop 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 msgr2=0x7f0edc090960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.431+0000 7f0ebb7fe640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc1cf390 0x7f0edc090960 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000f7a0 tx=0x7f0ed000fc70 comp rx=0 tx=0).stop 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0ee1087640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0ee1087640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 0x7f0edc1da490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0ee1087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0912b0 con 0x7f0edc090ea0 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 0x7f0edc1da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient: get_auth_request con 0x7f0edc090ea0 auth_method 0 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 10 monclient(hunting): handle_auth_done global_id 184135 payload 824 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.434+0000 7f0edad76640 1 -- 10.20.193.51:0/2284117121 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0edc09d7b0 con 0x7f0edc090ea0 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0edad76640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 msgr2=0x7f0edc1da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0edad76640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 0x7f0edc1da490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0018000 tx=0x7f0ed0003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0004230 con 0x7f0edc090ea0 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 10 monclient: dump: 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.450 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f0ed0004230 con 0x7f0edc090ea0 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 msgr2=0x7f0edc1da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 0x7f0edc1da490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0018000 tx=0x7f0ed0003860 comp rx=0 tx=0).stop 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 msgr2=0x7f0edc1da490 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:36.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ebb7fe640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0edc090ea0 0x7f0edc1da490 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0018000 tx=0x7f0ed0003860 comp rx=0 tx=0).stop 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 134, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 8823, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T11:59:36.452 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:36.453 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:36.454 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:36.455 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.456 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.457 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:36.458 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:36.460 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:36.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0ea803dd10 msgr2=0x7f0ea80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f0ea803dd10 0x7f0ea80401d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0edc06f3c0 tx=0x7f0ecc033000 comp rx=0 tx=0).stop 2026-02-17T11:59:36.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 10 monclient: shutdown 2026-02-17T11:59:36.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 msgr2=0x7f0edc099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0edb577640 1 -- 10.20.193.51:0/2284117121 reap_dead start 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400b530 tx=0x7f0ec400ba00 comp rx=0 tx=0).stop 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 shutdown_connections 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 --2- 10.20.193.51:0/2284117121 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0edc0a3bb0 0x7f0edc099de0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 >> 10.20.193.51:0/2284117121 conn(0x7f0edc0a30c0 msgr2=0x7f0edc0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 shutdown_connections 2026-02-17T11:59:36.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.437+0000 7f0ee1087640 1 -- 10.20.193.51:0/2284117121 wait complete. 2026-02-17T11:59:36.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T11:59:36.462 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T11:59:36.462 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T11:59:36.462 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T11:59:36.462 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T11:59:36.463 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:59:36.463 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:59:36.472 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:59:36.472 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T11:59:36.472 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:36.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: get_monmap_and_config 2026-02-17T11:59:36.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: monmap: 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:36.578099+0000 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:36.578099+0000 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:36.579 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 Processor -- start 2026-02-17T11:59:36.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 -- start start 2026-02-17T11:59:36.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: init 2026-02-17T11:59:36.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff48806c8d0 0x7ff4880a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-c con 0x7ff48806c8d0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff488074d60 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff48813f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-b con 0x7ff48806d3c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4880a0210 con 0x7ff488074d60 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff4880a07d0 con 0x7ff48806c8d0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff4880a04f0 con 0x7ff48806d3c0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff48dd85640 10 monclient(hunting): authenticate will time out at 1464.196889s 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff487fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 msgr2=0x7ff48813f360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff487fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff48813f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff486ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff488074d60 0x7ff48806ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42062/0 (socket says 10.20.193.51:42062) 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff486ffd640 1 -- 10.20.193.51:0/470187649 learned_addr learned my addr 10.20.193.51:0/470187649 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.577+0000 7ff486ffd640 1 -- 10.20.193.51:0/470187649 >> v1:10.20.193.51:6789/0 conn(0x7ff488074d60 legacy=0x7ff48806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send send error: (32) Broken pipe 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 --2- 10.20.193.51:0/470187649 >> v2:10.20.193.142:3300/0 conn(0x7ff48806c8d0 0x7ff4880a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): get_auth_request con 0x7ff48806c8d0 auth_method 0 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient(hunting): handle_auth_done global_id 184138 payload 274 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 -- 10.20.193.51:0/470187649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 msgr2=0x7ff48813f360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 --2- 10.20.193.51:0/470187649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff48813f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 -- 10.20.193.51:0/470187649 >> v1:10.20.193.51:6789/0 conn(0x7ff488074d60 legacy=0x7ff48806ccb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 monclient: found mon.noname-c 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T11:59:36.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.578+0000 7ff4877fe640 1 -- 10.20.193.51:0/470187649 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48809ecd0 con 0x7ff48806c8d0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4877fe640 1 -- 10.20.193.51:0/470187649 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 msgr2=0x7ff4880a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4877fe640 1 --2- 10.20.193.51:0/470187649 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4880a13b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098a0 tx=0x7ff47402eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0294af08d693c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 1 -- 10.20.193.51:0/470187649 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47403c070 con 0x7ff48806c8d0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: dump: 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 5 monclient: authenticate success, global_id 184138 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 1 -- 10.20.193.51:0/470187649 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47402fd00 con 0x7ff48806c8d0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 1 -- 10.20.193.51:0/470187649 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474037660 con 0x7ff48806c8d0 2026-02-17T11:59:36.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 4 set_mon_vals no callback set 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff4867fc640 10 monclient: dump: 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.584 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 10 monclient: shutdown 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 -- 10.20.193.51:0/470187649 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 msgr2=0x7ff4880a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 --2- 10.20.193.51:0/470187649 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4880a13b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098a0 tx=0x7ff47402eda0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 -- 10.20.193.51:0/470187649 shutdown_connections 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 --2- 10.20.193.51:0/470187649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff48813f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 --2- 10.20.193.51:0/470187649 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4880a13b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 -- 10.20.193.51:0/470187649 >> 10.20.193.51:0/470187649 conn(0x7ff4880aaa60 msgr2=0x7ff4880aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 -- 10.20.193.51:0/470187649 shutdown_connections 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.581+0000 7ff48dd85640 1 -- 10.20.193.51:0/470187649 wait complete. 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient: build_initial_monmap 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient: monmap: 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 Processor -- start 2026-02-17T11:59:36.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 -- start start 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient: init 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4881cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-b con 0x7ff48806c8d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff488135000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-c con 0x7ff48806d3c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): picked mon.noname-a con 0x7ff488074d60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff48813fa20 con 0x7ff488074d60 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff48813f8a0 con 0x7ff48806c8d0 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff48813fba0 con 0x7ff48806d3c0 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff48dd85640 10 monclient(hunting): authenticate will time out at 1464.201643s 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff486ffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 msgr2=0x7ff488135000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff486ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff488135000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54054/0 (socket says 10.20.193.51:54054) 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 -- 10.20.193.51:0/3774241634 learned_addr learned my addr 10.20.193.51:0/3774241634 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): get_auth_request con 0x7ff488074d60 auth_method 0 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4881cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 10 monclient(hunting): get_auth_request con 0x7ff48806c8d0 auth_method 0 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient(hunting): handle_auth_done global_id 164376 payload 824 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 -- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 msgr2=0x7ff488135000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff488135000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 -- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 msgr2=0x7ff4881cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4881cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 monclient: found mon.noname-a 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff487fff640 1 -- 10.20.193.51:0/3774241634 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff488136000 con 0x7ff488074d60 2026-02-17T11:59:36.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.582+0000 7ff4877fe640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4881cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff487fff640 1 -- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 msgr2=0x7ff488135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff487fff640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00be60 tx=0x7ff47c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c006e60 con 0x7ff488074d60 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: dump: 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.589 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 5 monclient: authenticate success, global_id 164376 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c010030 con 0x7ff488074d60 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _renew_subs 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff488074930 con 0x7ff488074d60 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0168b0 con 0x7ff488074d60 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff485ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 10 monclient: dump: 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.590 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _renew_subs 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4881364e0 con 0x7ff488074d60 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4880a1430 con 0x7ff488074d60 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff47c008070 con 0x7ff488074d60 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.585+0000 7ff463fff640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 0x7ff458040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.586+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7ff47c052570 con 0x7ff488074d60 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.586+0000 7ff4877fe640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 0x7ff458040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.586+0000 7ff4877fe640 10 monclient: get_auth_request con 0x7ff45803dcc0 auth_method 0 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.588+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff488136000 con 0x7ff488074d60 2026-02-17T11:59:36.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.588+0000 7ff463fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:36.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.588+0000 7ff463fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:36.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.589+0000 7ff4877fe640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 0x7ff458040180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff4880a8930 tx=0x7ff474033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:36.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.701+0000 7ff48dd85640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:36.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.701+0000 7ff48dd85640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:36.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.701+0000 7ff48dd85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:36.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.701+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff488073000 con 0x7ff488074d60 2026-02-17T11:59:36.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff463fff640 1 -- 10.20.193.51:0/3774241634 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7ff47c0132e0 con 0x7ff488074d60 2026-02-17T11:59:36.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff463fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:36.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff463fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:36.705 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:36.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 msgr2=0x7ff458040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 0x7ff458040180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff4880a8930 tx=0x7ff474033000 comp rx=0 tx=0).stop 2026-02-17T11:59:36.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 10 monclient: shutdown 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 msgr2=0x7ff488135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00be60 tx=0x7ff47c00be90 comp rx=0 tx=0).stop 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 shutdown_connections 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff45803dcc0 0x7ff458040180 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff488074d60 0x7ff488135540 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff48806d3c0 0x7ff488135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 --2- 10.20.193.51:0/3774241634 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff48806c8d0 0x7ff4881cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 >> 10.20.193.51:0/3774241634 conn(0x7ff4880aaa60 msgr2=0x7ff4880a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.702+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 shutdown_connections 2026-02-17T11:59:36.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:36.703+0000 7ff48dd85640 1 -- 10.20.193.51:0/3774241634 wait complete. 2026-02-17T11:59:39.713 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 10 monclient: get_monmap_and_config 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 10 monclient: build_initial_monmap 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 10 monclient: monmap: 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:39.783388+0000 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:39.783388+0000 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.784 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:39.785 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:39.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:39.785 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:39.785 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:39.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 1 Processor -- start 2026-02-17T11:59:39.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 1 -- start start 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.782+0000 7f644f4e8640 10 monclient: init 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f64480a3bb0 0x7f644809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-a con 0x7f64480a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f64480a0750 0x7f644809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-c con 0x7f64480a0750 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f644809e540 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644806e140 con 0x7f644809e540 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f64480a3f90 con 0x7f64480a3bb0 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f644809f910 con 0x7f64480a0750 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644f4e8640 10 monclient(hunting): authenticate will time out at 1467.402138s 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f64480a3bb0 0x7f644809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:39.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f64480a3bb0 0x7f644809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54058/0 (socket says 10.20.193.51:54058) 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 -- 10.20.193.51:0/2760233646 learned_addr learned my addr 10.20.193.51:0/2760233646 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): get_auth_request con 0x7f64480a3bb0 auth_method 0 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644ca5c640 1 --2- 10.20.193.51:0/2760233646 >> v2:10.20.193.142:3300/0 conn(0x7f64480a0750 0x7f644809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient(hunting): handle_auth_done global_id 164379 payload 274 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 -- 10.20.193.51:0/2760233646 >> v2:10.20.193.142:3300/0 conn(0x7f64480a0750 msgr2=0x7f644809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 --2- 10.20.193.51:0/2760233646 >> v2:10.20.193.142:3300/0 conn(0x7f64480a0750 0x7f644809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 -- 10.20.193.51:0/2760233646 >> v1:10.20.193.142:6789/0 conn(0x7f644809e540 legacy=0x7f644813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient: _finish_hunting 0 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 monclient: found mon.noname-a 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.783+0000 7f644d25d640 1 -- 10.20.193.51:0/2760233646 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644809ccd0 con 0x7f64480a3bb0 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f644d25d640 1 -- 10.20.193.51:0/2760233646 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f64480a3bb0 msgr2=0x7f644809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f644d25d640 1 --2- 10.20.193.51:0/2760233646 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f64480a3bb0 0x7f644809dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f644806c1c0 tx=0x7f643802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4226c0fef3f74f84 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 1 -- 10.20.193.51:0/2760233646 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643803c070 con 0x7f64480a3bb0 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: dump: 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:39.793 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 1 -- 10.20.193.51:0/2760233646 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643802fd50 con 0x7f64480a3bb0 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f644f4e8640 5 monclient: authenticate success, global_id 164379 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.785+0000 7f6437fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f6437fff640 1 -- 10.20.193.51:0/2760233646 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438037660 con 0x7f64480a3bb0 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 4 set_mon_vals no callback set 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:39.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f6437fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f6437fff640 10 monclient: dump: 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 10 monclient: shutdown 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 -- 10.20.193.51:0/2760233646 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f64480a3bb0 msgr2=0x7f644809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:39.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 --2- 10.20.193.51:0/2760233646 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f64480a3bb0 0x7f644809dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f644806c1c0 tx=0x7f643802edf0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 -- 10.20.193.51:0/2760233646 shutdown_connections 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 --2- 10.20.193.51:0/2760233646 >> v2:10.20.193.142:3300/0 conn(0x7f64480a0750 0x7f644809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 --2- 10.20.193.51:0/2760233646 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f64480a3bb0 0x7f644809dac0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 -- 10.20.193.51:0/2760233646 >> 10.20.193.51:0/2760233646 conn(0x7f64480a30c0 msgr2=0x7f64480a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 -- 10.20.193.51:0/2760233646 shutdown_connections 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 1 -- 10.20.193.51:0/2760233646 wait complete. 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 10 monclient: build_initial_monmap 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.786+0000 7f644f4e8640 10 monclient: monmap: 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 Processor -- start 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 -- start start 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient: init 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-a con 0x7f644809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f64480a0750 0x7f6448099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-b con 0x7f64480a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 0x7f644808e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): picked mon.noname-c con 0x7f64480a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:39.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f64480a04b0 con 0x7f644809e540 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f644809c850 con 0x7f64480a0750 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f644813de80 con 0x7f64480a3bb0 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644f4e8640 10 monclient(hunting): authenticate will time out at 1467.406354s 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644da5e640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 msgr2=0x7f644808e6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644da5e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 0x7f644808e6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54064/0 (socket says 10.20.193.51:54064) 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 -- 10.20.193.51:0/4049658863 learned_addr learned my addr 10.20.193.51:0/4049658863 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): get_auth_request con 0x7f644809e540 auth_method 0 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:39.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient(hunting): handle_auth_done global_id 164382 payload 824 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 -- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 msgr2=0x7f644808e6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 0x7f644808e6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 -- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f64480a0750 msgr2=0x7f6448099f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f64480a0750 0x7f6448099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient: _finish_hunting 0 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 monclient: found mon.noname-a 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.787+0000 7f644d25d640 1 -- 10.20.193.51:0/4049658863 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64480921a0 con 0x7f644809e540 2026-02-17T11:59:39.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644d25d640 1 -- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 msgr2=0x7f6448099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644d25d640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6438009a40 tx=0x7f6438004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438047070 con 0x7f644809e540 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: dump: 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:39.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643803f870 con 0x7f644809e540 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 5 monclient: authenticate success, global_id 164382 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 10 monclient: _renew_subs 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644806f730 con 0x7f644809e540 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643803c040 con 0x7f644809e540 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f6435ffb640 10 monclient: dump: 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:39.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f64377fe640 4 set_mon_vals no callback set 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 10 monclient: _renew_subs 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.789+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6448091ec0 con 0x7f644809e540 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644f4e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644f4e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644f4e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64480a2c70 con 0x7f644809e540 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f643803fc60 con 0x7f644809e540 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f6435ffb640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 0x7f64180401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7f64380776c0 con 0x7f644809e540 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644ca5c640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 0x7f64180401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.790+0000 7f644ca5c640 10 monclient: get_auth_request con 0x7f641803dd10 auth_method 0 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.793+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64480a2c70 con 0x7f644809e540 2026-02-17T11:59:39.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.793+0000 7f6435ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:39.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.793+0000 7f6435ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:39.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.793+0000 7f644ca5c640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 0x7f64180401d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f643c006fd0 tx=0x7f643c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.907+0000 7f644f4e8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.907+0000 7f644f4e8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.907+0000 7f644f4e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.907+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f644809dac0 con 0x7f644809e540 2026-02-17T11:59:39.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.908+0000 7f6435ffb640 1 -- 10.20.193.51:0/4049658863 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f6438035340 con 0x7f644809e540 2026-02-17T11:59:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.908+0000 7f6435ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:39.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.908+0000 7f6435ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:39.911 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 msgr2=0x7f64180401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 0x7f64180401d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f643c006fd0 tx=0x7f643c008040 comp rx=0 tx=0).stop 2026-02-17T11:59:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 10 monclient: shutdown 2026-02-17T11:59:39.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 msgr2=0x7f6448099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6438009a40 tx=0x7f6438004830 comp rx=0 tx=0).stop 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 shutdown_connections 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f641803dd10 0x7f64180401d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f64480a3bb0 0x7f644808e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f64480a0750 0x7f6448099f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 --2- 10.20.193.51:0/4049658863 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f644809e540 0x7f6448099a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 >> 10.20.193.51:0/4049658863 conn(0x7f64480a30c0 msgr2=0x7f6448072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 shutdown_connections 2026-02-17T11:59:39.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:39.909+0000 7f644f4e8640 1 -- 10.20.193.51:0/4049658863 wait complete. 2026-02-17T11:59:42.920 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:42.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.987+0000 7f4a25b22640 10 monclient: get_monmap_and_config 2026-02-17T11:59:42.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.987+0000 7f4a25b22640 10 monclient: build_initial_monmap 2026-02-17T11:59:42.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.987+0000 7f4a25b22640 10 monclient: monmap: 2026-02-17T11:59:42.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:42.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:42.988846+0000 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:42.988846+0000 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:42.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 Processor -- start 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 -- start start 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient: init 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-b con 0x7f4a200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a200a0750 0x7f4a2009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-a con 0x7f4a200a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4a2009e540 0x7f4a2013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-c con 0x7f4a2009e540 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:42.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4a200a3f90 con 0x7f4a200a0750 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2006e140 con 0x7f4a2009e540 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2009f910 con 0x7f4a200a3bb0 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a25b22640 10 monclient(hunting): authenticate will time out at 1470.607579s 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1f7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 msgr2=0x7f4a2009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a200a0750 0x7f4a2009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4a200a0750 0x7f4a2009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54076/0 (socket says 10.20.193.51:54076) 2026-02-17T11:59:42.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 -- 10.20.193.51:0/3347853109 learned_addr learned my addr 10.20.193.51:0/3347853109 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): get_auth_request con 0x7f4a200a0750 auth_method 0 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1ffff640 1 --2- 10.20.193.51:0/3347853109 >> v2:10.20.193.142:3300/0 conn(0x7f4a2009e540 0x7f4a2013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1ffff640 10 monclient(hunting): get_auth_request con 0x7f4a2009e540 auth_method 0 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:42.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient(hunting): handle_auth_done global_id 164385 payload 274 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 -- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 msgr2=0x7f4a2009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 --2- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 -- 10.20.193.51:0/3347853109 >> v2:10.20.193.142:3300/0 conn(0x7f4a2009e540 msgr2=0x7f4a2013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 --2- 10.20.193.51:0/3347853109 >> v2:10.20.193.142:3300/0 conn(0x7f4a2009e540 0x7f4a2013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 monclient: found mon.noname-a 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:42.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.988+0000 7f4a1effd640 1 -- 10.20.193.51:0/3347853109 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2009ccd0 con 0x7f4a200a0750 2026-02-17T11:59:43.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1effd640 1 -- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 msgr2=0x7f4a2009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:43.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1effd640 1 --2- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a2009e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a2009f230 tx=0x7f4a1002ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2606eed88d1c45 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:43.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 1 -- 10.20.193.51:0/3347853109 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1003c070 con 0x7f4a200a0750 2026-02-17T11:59:43.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: dump: 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:43.005 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 1 -- 10.20.193.51:0/3347853109 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1002fcc0 con 0x7f4a200a0750 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 5 monclient: authenticate success, global_id 164385 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 1 -- 10.20.193.51:0/3347853109 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10037660 con 0x7f4a200a0750 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a1e7fc640 10 monclient: dump: 2026-02-17T11:59:43.006 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 4 set_mon_vals no callback set 2026-02-17T11:59:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 10 monclient: shutdown 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 -- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 msgr2=0x7f4a2009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 --2- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a2009e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a2009f230 tx=0x7f4a1002ee80 comp rx=0 tx=0).stop 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 -- 10.20.193.51:0/3347853109 shutdown_connections 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 --2- 10.20.193.51:0/3347853109 >> v2:10.20.193.142:3300/0 conn(0x7f4a2009e540 0x7f4a2013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 --2- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a2009e000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 --2- 10.20.193.51:0/3347853109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 -- 10.20.193.51:0/3347853109 >> 10.20.193.51:0/3347853109 conn(0x7f4a200a30c0 msgr2=0x7f4a200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 -- 10.20.193.51:0/3347853109 shutdown_connections 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.991+0000 7f4a25b22640 1 -- 10.20.193.51:0/3347853109 wait complete. 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient: build_initial_monmap 2026-02-17T11:59:43.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient: monmap: 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 Processor -- start 2026-02-17T11:59:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 -- start start 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient: init 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a2009e540 0x7f4a20097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-b con 0x7f4a2009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-a con 0x7f4a200a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2008d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): picked mon.noname-c con 0x7f4a200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4a200a04b0 con 0x7f4a200a0750 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2009c850 con 0x7f4a2009e540 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2013cca0 con 0x7f4a200a3bb0 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a25b22640 10 monclient(hunting): authenticate will time out at 1470.611746s 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1ffff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 msgr2=0x7f4a2008d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2008d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:54078/0 (socket says 10.20.193.51:54078) 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 -- 10.20.193.51:0/1666297321 learned_addr learned my addr 10.20.193.51:0/1666297321 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): get_auth_request con 0x7f4a200a0750 auth_method 0 2026-02-17T11:59:43.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient(hunting): handle_auth_done global_id 164388 payload 824 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1f7fe640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a2009e540 0x7f4a20097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 -- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 msgr2=0x7f4a2008d3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2008d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 -- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a2009e540 msgr2=0x7f4a20097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a2009e540 0x7f4a20097a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:43.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 monclient: found mon.noname-a 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.992+0000 7f4a1effd640 1 -- 10.20.193.51:0/1666297321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a201cd240 con 0x7f4a200a0750 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a1effd640 1 -- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 msgr2=0x7f4a20097f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a1effd640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a10002410 tx=0x7f4a10004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1003c040 con 0x7f4a200a0750 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: dump: 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:43.013 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: _finish_auth 0 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a10047070 con 0x7f4a200a0750 2026-02-17T11:59:43.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 5 monclient: authenticate success, global_id 164388 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _renew_subs 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2008ed20 con 0x7f4a200a0750 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10042890 con 0x7f4a200a0750 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 10 monclient: dump: 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.015 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a1dffb640 4 set_mon_vals no callback set 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _renew_subs 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2006f920 con 0x7f4a200a0750 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:43.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2009dac0 con 0x7f4a200a0750 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.995+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4a10042a70 con 0x7f4a200a0750 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.996+0000 7f49fbfff640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 0x7f49f0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.996+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(506..506 src has 323..506) ==== 4811+0+0 (secure 0 0 0) 0x7f4a10077480 con 0x7f4a200a0750 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.996+0000 7f4a1f7fe640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 0x7f49f0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.996+0000 7f4a1f7fe640 10 monclient: get_auth_request con 0x7f49f003dcc0 auth_method 0 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.998+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4a10050020 con 0x7f4a200a0750 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.998+0000 7f49fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.998+0000 7f49fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.999+0000 7f4a1f7fe640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 0x7f49f0040180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c003a80 tx=0x7f4a0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:43.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:42.999+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 DispatchQueue::entry inject delay of 0.002000 2026-02-17T11:59:43.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f4a25b22640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f4a25b22640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f4a25b22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a200008d0 con 0x7f4a200a0750 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f49fbfff640 1 -- 10.20.193.51:0/1666297321 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f4a201cd240 con 0x7f4a200a0750 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f49fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:43.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.111+0000 7f49fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:43.115 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 msgr2=0x7f49f0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 0x7f49f0040180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c003a80 tx=0x7f4a0c008040 comp rx=0 tx=0).stop 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 10 monclient: shutdown 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 msgr2=0x7f4a20097f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a10002410 tx=0x7f4a10004830 comp rx=0 tx=0).stop 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 shutdown_connections 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f49f003dcc0 0x7f49f0040180 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4a200a3bb0 0x7f4a2008d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4a200a0750 0x7f4a20097f80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 --2- 10.20.193.51:0/1666297321 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4a2009e540 0x7f4a20097a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:43.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 >> 10.20.193.51:0/1666297321 conn(0x7f4a200a30c0 msgr2=0x7f4a20072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:43.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 shutdown_connections 2026-02-17T11:59:43.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:43.112+0000 7f4a25b22640 1 -- 10.20.193.51:0/1666297321 wait complete. 2026-02-17T11:59:46.124 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T11:59:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: get_monmap_and_config 2026-02-17T11:59:46.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: build_initial_monmap 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: monmap: 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:46.193093+0000 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:46.193093+0000 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:46.197 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 Processor -- start 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 -- start start 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: init 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f33380a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-a con 0x7f333809dac0 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:46.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-c con 0x7f33380a0110 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333806e140 con 0x7f33380a3bb0 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f333809aed0 con 0x7f333809dac0 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f333809caa0 con 0x7f33380a0110 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f333e78d640 10 monclient(hunting): authenticate will time out at 1473.811843s 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40036/0 (socket says 10.20.193.51:40036) 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 learned_addr learned my addr 10.20.193.51:0/3661925553 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:46.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f333809dac0 auth_method 0 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.192+0000 7f33377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 10 monclient(hunting): get_auth_request con 0x7f33380a0110 auth_method 0 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:46.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:46.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.193+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:46.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.195+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> v1:10.20.193.142:6789/0 conn(0x7f33380a3bb0 legacy=0x7f333809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:46.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f333809dac0 auth_method 0 2026-02-17T11:59:46.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 10 monclient(hunting): get_auth_request con 0x7f33380a0110 auth_method 0 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:46.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:46.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.394+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:46.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f333809dac0 auth_method 0 2026-02-17T11:59:46.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 10 monclient(hunting): get_auth_request con 0x7f33380a0110 auth_method 0 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:46.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:46.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:59:46.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:46.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:46.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:46.795+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:47.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f333809dac0 auth_method 0 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 10 monclient(hunting): get_auth_request con 0x7f33380a0110 auth_method 0 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:59:47.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:47.596+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:49.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): tick 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 monclient(hunting): continuing hunt 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 msgr2=0x7f333813c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.142:3300/0 conn(0x7f33380a0110 0x7f333813c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 -- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 msgr2=0x7f333809fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 --2- 10.20.193.51:0/3661925553 >> v2:10.20.193.51:3300/0 conn(0x7f333809dac0 0x7f333809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 -- 10.20.193.51:0/3661925553 >> v1:10.20.193.142:6789/0 conn(0x7f33380a3bb0 legacy=0x7f333809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:49.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient: _add_conns ranks=[2,0] 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f3314005a80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f33140085e0 addr v1:10.20.193.51:6789/0 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 -- 10.20.193.51:0/3661925553 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333809ce60 con 0x7f33140085e0 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 1 -- 10.20.193.51:0/3661925553 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f333809aed0 con 0x7f3314005a80 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3335ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 msgr2=0x7f3314007eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:49.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.193+0000 7f3337fff640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:49.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.195+0000 7f33377fe640 1 -- 10.20.193.51:0/3661925553 >> v1:10.20.193.51:6789/0 conn(0x7f33140085e0 legacy=0x7f331400aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:49.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.394+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 msgr2=0x7f3314007eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:49.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.394+0000 7f3337fff640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:59:49.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.795+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 msgr2=0x7f3314007eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:49.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:49.795+0000 7f3337fff640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:59:50.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.596+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 msgr2=0x7f3314007eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.596+0000 7f3337fff640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:59:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691369802 0 0) 0x7f333809ce60 con 0x7f33140085e0 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient(hunting): my global_id is 164391 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f331c003620 con 0x7f33140085e0 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3056467836 0 0) 0x7f331c003620 con 0x7f33140085e0 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 msgr2=0x7f3314007eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3314005a80 0x7f3314007eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331400d4a0 con 0x7f33140085e0 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f33280096c0 con 0x7f33140085e0 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: dump: 2026-02-17T11:59:50.649 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T11:59:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 >> v1:10.20.193.51:6789/0 conn(0x7f33140085e0 legacy=0x7f331400aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 reap_dead start 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.637+0000 7f3336ffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f331c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): picked mon.c con 0x7f331c003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c004900 0x7f331c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): picked mon.b con 0x7f331c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 0x7f331c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): picked mon.a con 0x7f331c0054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f333809aed0 con 0x7f331c0054c0 2026-02-17T11:59:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f331c00c360 con 0x7f331c004900 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f331c00c560 con 0x7f331c003ab0 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3336ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3337fff640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 msgr2=0x7f331c003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f3337fff640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f331c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 0x7f331c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): get_auth_request con 0x7f331c0054c0 auth_method 0 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f33377fe640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c004900 0x7f331c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f331c004900 auth_method 0 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f33377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient(hunting): handle_auth_done global_id 164391 payload 293 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 msgr2=0x7f331c003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f331c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c004900 msgr2=0x7f331c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c004900 0x7f331c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 monclient: found mon.a 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c003620 con 0x7f331c0054c0 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333cd03640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333e78d640 5 monclient: authenticate success, global_id 164391 2026-02-17T11:59:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.638+0000 7f333e78d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f333cd03640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 msgr2=0x7f331c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f333cd03640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 0x7f331c00bac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f33380a3020 tx=0x7f332c02fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6adeda5b2e659 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c039070 con 0x7f331c0054c0 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: dump: 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.655 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c034890 con 0x7f331c0054c0 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 1 -- 10.20.193.51:0/3661925553 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c009640 con 0x7f331c0054c0 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f333e78d640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f333e78d640 4 set_mon_vals no callback set 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.640+0000 7f3336ffd640 10 monclient: dump: 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 10 monclient: shutdown 2026-02-17T11:59:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 -- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 msgr2=0x7f331c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 0x7f331c00bac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f33380a3020 tx=0x7f332c02fb70 comp rx=0 tx=0).stop 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 -- 10.20.193.51:0/3661925553 shutdown_connections 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c0054c0 0x7f331c00bac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c004900 0x7f331c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 --2- 10.20.193.51:0/3661925553 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f331c003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 -- 10.20.193.51:0/3661925553 >> 10.20.193.51:0/3661925553 conn(0x7f33380a30c0 msgr2=0x7f33380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 -- 10.20.193.51:0/3661925553 shutdown_connections 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 1 -- 10.20.193.51:0/3661925553 wait complete. 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 10 monclient: build_initial_monmap 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.641+0000 7f333e78d640 10 monclient: monmap: 2026-02-17T11:59:50.658 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 Processor -- start 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 -- start start 2026-02-17T11:59:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient: init 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f33381ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-c con 0x7f331c003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-a con 0x7f331c004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 0x7f333809a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): picked mon.noname-b con 0x7f331c0054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f333809a880 con 0x7f331c004900 2026-02-17T11:59:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f3337fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 msgr2=0x7f33381ceb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33380a3f90 con 0x7f331c0054c0 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f33380a0540 con 0x7f331c003ab0 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f3337fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f33381ceb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333e78d640 10 monclient(hunting): authenticate will time out at 1478.261394s 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40080/0 (socket says 10.20.193.51:40080) 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 -- 10.20.193.51:0/2709107231 learned_addr learned my addr 10.20.193.51:0/2709107231 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): get_auth_request con 0x7f331c004900 auth_method 0 2026-02-17T11:59:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient(hunting): handle_auth_done global_id 164394 payload 824 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 -- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 msgr2=0x7f33381ceb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f33381ceb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 -- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 msgr2=0x7f333809a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333cd03640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 0x7f333809a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 0x7f333809a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f33377fe640 1 -- 10.20.193.51:0/2709107231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333809f820 con 0x7f331c004900 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333cd03640 10 monclient: get_auth_request con 0x7f331c0054c0 auth_method 0 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.642+0000 7f333cd03640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 0x7f333809a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f33377fe640 1 -- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 msgr2=0x7f3338099b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f33377fe640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3328004660 tx=0x7f3328003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332801a070 con 0x7f331c004900 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: dump: 2026-02-17T11:59:50.663 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3328016a20 con 0x7f331c004900 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328016e10 con 0x7f331c004900 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f3334ff9640 10 monclient: dump: 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.665 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f33367fc640 4 set_mon_vals no callback set 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 5 monclient: authenticate success, global_id 164394 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 10 monclient: _renew_subs 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33381cfa90 con 0x7f331c004900 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 10 monclient: _renew_subs 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.644+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33380985f0 con 0x7f331c004900 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f333e78d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f333e78d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f333e78d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3338068450 con 0x7f331c004900 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f33280153c0 con 0x7f331c004900 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f3334ff9640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 0x7f33080401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(507..507 src has 323..507) ==== 4751+0+0 (secure 0 0 0) 0x7f33280534d0 con 0x7f331c004900 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.645+0000 7f3337fff640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 0x7f33080401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.646+0000 7f3337fff640 10 monclient: get_auth_request con 0x7f330803dd10 auth_method 0 2026-02-17T11:59:50.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.648+0000 7f3337fff640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 0x7f33080401d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3324002d00 tx=0x7f3324007b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.648+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3338068450 con 0x7f331c004900 2026-02-17T11:59:50.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.648+0000 7f3334ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.648+0000 7f3334ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:50.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f333e78d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T11:59:50.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f333e78d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:50.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f333e78d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f333809d7b0 con 0x7f331c004900 2026-02-17T11:59:50.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f3334ff9640 1 -- 10.20.193.51:0/2709107231 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f333809f820 con 0x7f331c004900 2026-02-17T11:59:50.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f3334ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T11:59:50.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.762+0000 7f3334ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:50.765 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":138,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T11:59:50.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 msgr2=0x7f33080401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 0x7f33080401d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3324002d00 tx=0x7f3324007b30 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 10 monclient: shutdown 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 msgr2=0x7f3338099b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3328004660 tx=0x7f3328003ae0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 shutdown_connections 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f330803dd10 0x7f33080401d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f331c0054c0 0x7f333809a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f331c004900 0x7f3338099b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 --2- 10.20.193.51:0/2709107231 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f331c003ab0 0x7f33381ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 >> 10.20.193.51:0/2709107231 conn(0x7f33380a30c0 msgr2=0x7f333809e490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 shutdown_connections 2026-02-17T11:59:50.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.763+0000 7f333e78d640 1 -- 10.20.193.51:0/2709107231 wait complete. 2026-02-17T11:59:50.773 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T11:59:50.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T11:59:50.774 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: get_monmap_and_config 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: build_initial_monmap 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: monmap: 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:50.840166+0000 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:50.840166+0000 2026-02-17T11:59:50.841 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:50.842 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 Processor -- start 2026-02-17T11:59:50.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 -- start start 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: init 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-b con 0x7fdcec0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdcec09dac0 0x7fdcec09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-c con 0x7fdcec09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdcec09ff40 0x7fdcec13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-a con 0x7fdcec09ff40 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:50.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fdcec09aed0 con 0x7fdcec09ff40 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdcec09caa0 con 0x7fdcec09dac0 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdcec0a3f90 con 0x7fdcec0a3bb0 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcf28d3640 10 monclient(hunting): authenticate will time out at 1478.458961s 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcebfff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 msgr2=0x7fdcec09f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.839+0000 7fdcebfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdcec09ff40 0x7fdcec13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fdcec09ff40 0x7fdcec13b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40086/0 (socket says 10.20.193.51:40086) 2026-02-17T11:59:50.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 -- 10.20.193.51:0/1325043578 learned_addr learned my addr 10.20.193.51:0/1325043578 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): get_auth_request con 0x7fdcec09ff40 auth_method 0 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/1325043578 >> v2:10.20.193.142:3300/0 conn(0x7fdcec09dac0 0x7fdcec09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request con 0x7fdcec09dac0 auth_method 0 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdceb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdceb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient(hunting): handle_auth_done global_id 164397 payload 274 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 -- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 msgr2=0x7fdcec09f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 --2- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 -- 10.20.193.51:0/1325043578 >> v2:10.20.193.142:3300/0 conn(0x7fdcec09dac0 msgr2=0x7fdcec09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 --2- 10.20.193.51:0/1325043578 >> v2:10.20.193.142:3300/0 conn(0x7fdcec09dac0 0x7fdcec09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 monclient: found mon.noname-a 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.840+0000 7fdcf0e49640 1 -- 10.20.193.51:0/1325043578 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec06e140 con 0x7fdcec09ff40 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf0e49640 1 -- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09ff40 msgr2=0x7fdcec13b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf0e49640 1 --2- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09ff40 0x7fdcec13b750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06e310 tx=0x7fdce002f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d150cb15d94a5d8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 1 -- 10.20.193.51:0/1325043578 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce00373f0 con 0x7fdcec09ff40 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: dump: 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.858 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 1 -- 10.20.193.51:0/1325043578 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce0037590 con 0x7fdcec09ff40 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf28d3640 5 monclient: authenticate success, global_id 164397 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf28d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 1 -- 10.20.193.51:0/1325043578 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0037960 con 0x7fdcec09ff40 2026-02-17T11:59:50.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdceaffd640 10 monclient: dump: 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.860 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf28d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.842+0000 7fdcf28d3640 4 set_mon_vals no callback set 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 10 monclient: shutdown 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 -- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09ff40 msgr2=0x7fdcec13b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09ff40 0x7fdcec13b750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06e310 tx=0x7fdce002f2c0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 -- 10.20.193.51:0/1325043578 shutdown_connections 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09ff40 0x7fdcec13b750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/1325043578 >> v2:10.20.193.142:3300/0 conn(0x7fdcec09dac0 0x7fdcec09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/1325043578 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 -- 10.20.193.51:0/1325043578 >> 10.20.193.51:0/1325043578 conn(0x7fdcec0a30c0 msgr2=0x7fdcec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 -- 10.20.193.51:0/1325043578 shutdown_connections 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 1 -- 10.20.193.51:0/1325043578 wait complete. 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 10 monclient: build_initial_monmap 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.843+0000 7fdcf28d3640 10 monclient: monmap: 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:50.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 Processor -- start 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 -- start start 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient: init 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-a con 0x7fdcec09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdcec09ff40 0x7fdcec1bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-b con 0x7fdcec09ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec06f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): picked mon.noname-c con 0x7fdcec0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec09a880 con 0x7fdcec09dac0 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec09a5c0 con 0x7fdcec09ff40 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdcec0a0350 con 0x7fdcec0a3bb0 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf28d3640 10 monclient(hunting): authenticate will time out at 1478.463454s 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf0e49640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 msgr2=0x7fdcec06f410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcf0e49640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec06f410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40096/0 (socket says 10.20.193.51:40096) 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 -- 10.20.193.51:0/4030186316 learned_addr learned my addr 10.20.193.51:0/4030186316 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): get_auth_request con 0x7fdcec09dac0 auth_method 0 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdcec09ff40 0x7fdcec1bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request con 0x7fdcec09ff40 auth_method 0 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdceb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdceb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient(hunting): handle_auth_done global_id 164400 payload 824 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 msgr2=0x7fdcec06f410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdcec0a3bb0 0x7fdcec06f410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdcec09ff40 msgr2=0x7fdcec1bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdcec09ff40 0x7fdcec1bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 monclient: found mon.noname-a 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.844+0000 7fdcebfff640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec09d7b0 con 0x7fdcec09dac0 2026-02-17T11:59:50.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcebfff640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 msgr2=0x7fdcec1cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcebfff640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800b780 tx=0x7fdcd800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005270 con 0x7fdcec09dac0 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: dump: 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.867 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 5 monclient: authenticate success, global_id 164400 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8010070 con 0x7fdcec09dac0 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 10 monclient: _renew_subs 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcec09f0c0 con 0x7fdcec09dac0 2026-02-17T11:59:50.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005650 con 0x7fdcec09dac0 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdce8ff9640 10 monclient: dump: 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.869 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcea7fc640 4 set_mon_vals no callback set 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 10 monclient: _renew_subs 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.846+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcec1b9a20 con 0x7fdcec09dac0 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdcf28d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 0x7fdcec06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec09f4c0 con 0x7fdcec1bdd50 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 0x7fdcec06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient: get_auth_request con 0x7fdcec1bdd50 auth_method 0 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdcd801d070 con 0x7fdcec09dac0 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_done global_id 164403 payload 824 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdceb7fe640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcec1be130 con 0x7fdcec1bdd50 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdce8ff9640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdcbc03dcc0 0x7fdcbc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.847+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(507..507 src has 323..507) ==== 4751+0+0 (secure 0 0 0) 0x7fdcd8052060 con 0x7fdcec09dac0 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.848+0000 7fdcf0e49640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdcbc03dcc0 0x7fdcbc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.848+0000 7fdcf0e49640 10 monclient: get_auth_request con 0x7fdcbc03dcc0 auth_method 0 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdceb7fe640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 msgr2=0x7fdcec06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 0x7fdcec06f950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc01a030 con 0x7fdcec1bdd50 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdce8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.849+0000 7fdce8ff9640 10 monclient: dump: 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.872 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fdcdc00eb80 con 0x7fdcec1bdd50 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 msgr2=0x7fdcec06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 0x7fdcec06f950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc010cd0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 msgr2=0x7fdcec06f950 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:50.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdce8ff9640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec1bdd50 0x7fdcec06f950 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc010cd0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.850+0000 7fdcf0e49640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdcbc03dcc0 0x7fdcbc040180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06dc20 tx=0x7fdce0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdcf28d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 0x7fdcec1da160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdcf28d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec0702a0 con 0x7fdcec06fe90 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 0x7fdcec1da160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient: get_auth_request con 0x7fdcec06fe90 auth_method 0 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 10 monclient(hunting): handle_auth_done global_id 164406 payload 824 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.853+0000 7fdceb7fe640 1 -- 10.20.193.51:0/4030186316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdcec050ac0 con 0x7fdcec06fe90 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdceb7fe640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 msgr2=0x7fdcec1da160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdceb7fe640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 0x7fdcec1da160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00f040 con 0x7fdcec06fe90 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 10 monclient: dump: 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.877 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4867 (secure 0 0 0) 0x7fdcdc015470 con 0x7fdcec06fe90 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 msgr2=0x7fdcec1da160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 0x7fdcec1da160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 msgr2=0x7fdcec1da160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:50.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.855+0000 7fdce8ff9640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec06fe90 0x7fdcec1da160 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc010800 tx=0x7fdcdc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 138, 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 135293, 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:59:50.879 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.880 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.881 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:50.882 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:50.883 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.884 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.885 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:50.886 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.887 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.888 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:50.889 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdcbc03dcc0 msgr2=0x7fdcbc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdcbc03dcc0 0x7fdcbc040180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06dc20 tx=0x7fdce0033000 comp rx=0 tx=0).stop 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 10 monclient: shutdown 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 msgr2=0x7fdcec1cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800b780 tx=0x7fdcd800bc50 comp rx=0 tx=0).stop 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf0e49640 1 -- 10.20.193.51:0/4030186316 reap_dead start 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 shutdown_connections 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 --2- 10.20.193.51:0/4030186316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdcec09dac0 0x7fdcec1cf060 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 >> 10.20.193.51:0/4030186316 conn(0x7fdcec0a30c0 msgr2=0x7fdcec06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 shutdown_connections 2026-02-17T11:59:50.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.856+0000 7fdcf28d3640 1 -- 10.20.193.51:0/4030186316 wait complete. 2026-02-17T11:59:50.892 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:59:50.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T11:59:50.892 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T11:59:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.958+0000 7f88e346f640 10 monclient: get_monmap_and_config 2026-02-17T11:59:50.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.958+0000 7f88e346f640 10 monclient: build_initial_monmap 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.958+0000 7f88e346f640 10 monclient: monmap: 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:59:50.959650+0000 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:59:50.959650+0000 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T11:59:50.961 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 Processor -- start 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 -- start start 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient: init 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient: _add_conns ranks=[1,3,2,4,0] 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f88dc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f88dc0a0750 0x7f88dc09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-a con 0x7f88dc0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 0x7f88dc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-b con 0x7f88dc13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88dc06e140 con 0x7f88dc0a3bb0 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f88dc09f910 con 0x7f88dc0a0750 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc09ccd0 con 0x7f88dc13b760 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e346f640 10 monclient(hunting): authenticate will time out at 1478.578451s 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e19e5640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 msgr2=0x7f88dc13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e19e5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 0x7f88dc13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f88dc0a0750 0x7f88dc09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f88dc0a0750 0x7f88dc09e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40126/0 (socket says 10.20.193.51:40126) 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 -- 10.20.193.51:0/2484468299 learned_addr learned my addr 10.20.193.51:0/2484468299 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): get_auth_request con 0x7f88dc0a0750 auth_method 0 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient(hunting): handle_auth_done global_id 164409 payload 274 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 -- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 msgr2=0x7f88dc13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 --2- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 0x7f88dc13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 -- 10.20.193.51:0/2484468299 >> v1:10.20.193.142:6789/0 conn(0x7f88dc0a3bb0 legacy=0x7f88dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 monclient: found mon.noname-a 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.959+0000 7f88e09e3640 1 -- 10.20.193.51:0/2484468299 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc09eec0 con 0x7f88dc0a0750 2026-02-17T11:59:50.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e09e3640 1 -- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc0a0750 msgr2=0x7f88dc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e09e3640 1 --2- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc0a0750 0x7f88dc09e1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88dc06f3c0 tx=0x7f88d0033280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a2ad4c97b4f3d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 1 -- 10.20.193.51:0/2484468299 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0033ca0 con 0x7f88dc0a0750 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: dump: 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.971 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 1 -- 10.20.193.51:0/2484468299 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0033e40 con 0x7f88dc0a0750 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 1 -- 10.20.193.51:0/2484468299 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d000b750 con 0x7f88dc0a0750 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 5 monclient: authenticate success, global_id 164409 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 4 set_mon_vals no callback set 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88cbfff640 10 monclient: dump: 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.972 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 10 monclient: shutdown 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 -- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc0a0750 msgr2=0x7f88dc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 --2- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc0a0750 0x7f88dc09e1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88dc06f3c0 tx=0x7f88d0033280 comp rx=0 tx=0).stop 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 -- 10.20.193.51:0/2484468299 shutdown_connections 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 --2- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc13b760 0x7f88dc13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 --2- 10.20.193.51:0/2484468299 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc0a0750 0x7f88dc09e1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 -- 10.20.193.51:0/2484468299 >> 10.20.193.51:0/2484468299 conn(0x7f88dc0a30c0 msgr2=0x7f88dc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 -- 10.20.193.51:0/2484468299 shutdown_connections 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.962+0000 7f88e346f640 1 -- 10.20.193.51:0/2484468299 wait complete. 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient: build_initial_monmap 2026-02-17T11:59:50.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient: monmap: 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 Processor -- start 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 -- start start 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient: init 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc0a0750 0x7f88dc096ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-b con 0x7f88dc0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc0709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-c con 0x7f88dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): picked mon.noname-a con 0x7f88dc13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc09e710 con 0x7f88dc13b760 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc0a04b0 con 0x7f88dc0a0750 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc09e890 con 0x7f88dc0a3bb0 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e346f640 10 monclient(hunting): authenticate will time out at 1478.582736s 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e09e3640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc0709c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e09e3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc0709c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40130/0 (socket says 10.20.193.51:40130) 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 learned_addr learned my addr 10.20.193.51:0/510204771 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): get_auth_request con 0x7f88dc13b760 auth_method 0 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient(hunting): handle_auth_done global_id 164412 payload 824 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 msgr2=0x7f88dc0709c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88dc0a3bb0 0x7f88dc0709c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc0a0750 msgr2=0x7f88dc096ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc0a0750 0x7f88dc096ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient: _finish_hunting 0 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 monclient: found mon.noname-a 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:50.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.963+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc0740b0 con 0x7f88dc13b760 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 msgr2=0x7f88dc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e19e5640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88d800be30 tx=0x7f88d800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8006e60 con 0x7f88dc13b760 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: dump: 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.977 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d8010030 con 0x7f88dc13b760 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 5 monclient: authenticate success, global_id 164412 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 monclient: _renew_subs 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc08d850 con 0x7f88dc13b760 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8016430 con 0x7f88dc13b760 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 10 monclient: dump: 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.978 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88cb7fe640 4 set_mon_vals no callback set 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 monclient: _renew_subs 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc072660 con 0x7f88dc13b760 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 0x7f88dc071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc072ff0 con 0x7f88dc08d460 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e11e4640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 0x7f88dc071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e11e4640 10 monclient: get_auth_request con 0x7f88dc08d460 auth_method 0 2026-02-17T11:59:50.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e11e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e11e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88e11e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.966+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f88d80153e0 con 0x7f88dc13b760 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88c9ffb640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dd10 0x7f88ac0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(507..507 src has 323..507) ==== 4751+0+0 (secure 0 0 0) 0x7f88d8052370 con 0x7f88dc13b760 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e11e4640 10 monclient(hunting): handle_auth_done global_id 184153 payload 824 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e11e4640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88dc09dac0 con 0x7f88dc08d460 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e09e3640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dd10 0x7f88ac0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.967+0000 7f88e09e3640 10 monclient: get_auth_request con 0x7f88ac03dd10 auth_method 0 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88e11e4640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 msgr2=0x7f88dc071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88e11e4640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 0x7f88dc071440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88e09e3640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dd10 0x7f88ac0401d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88d0039000 tx=0x7f88d0037000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011a80 con 0x7f88dc08d460 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.969+0000 7f88c9ffb640 10 monclient: dump: 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f88cc017070 con 0x7f88dc08d460 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 msgr2=0x7f88dc071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 0x7f88dc071440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc00c860 comp rx=0 tx=0).stop 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 msgr2=0x7f88dc071440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.970+0000 7f88c9ffb640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc08d460 0x7f88dc071440 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc00c860 comp rx=0 tx=0).stop 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e346f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e346f640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 0x7f88dc0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e346f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc09c740 con 0x7f88dc1393d0 2026-02-17T11:59:50.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 0x7f88dc0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient: get_auth_request con 0x7f88dc1393d0 auth_method 0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 10 monclient(hunting): handle_auth_done global_id 184156 payload 824 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.973+0000 7f88e11e4640 1 -- 10.20.193.51:0/510204771 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88dc072ac0 con 0x7f88dc1393d0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88e11e4640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 msgr2=0x7f88dc0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88e11e4640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 0x7f88dc0638c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc01caf0 con 0x7f88dc1393d0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.975+0000 7f88c9ffb640 10 monclient: dump: 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T11:59:50.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7f88cc01caf0 con 0x7f88dc1393d0 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 msgr2=0x7f88dc0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 0x7f88dc0638c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc003860 comp rx=0 tx=0).stop 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 msgr2=0x7f88dc0638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:59:50.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88c9ffb640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88dc1393d0 0x7f88dc0638c0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c390 tx=0x7f88cc003860 comp rx=0 tx=0).stop 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 138, 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 23362, 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T11:59:50.987 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T11:59:50.988 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T11:59:50.989 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T11:59:50.990 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.991 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.992 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T11:59:50.993 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.994 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.995 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T11:59:50.996 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T11:59:50.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dd10 msgr2=0x7f88ac0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f88ac03dd10 0x7f88ac0401d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88d0039000 tx=0x7f88d0037000 comp rx=0 tx=0).stop 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 10 monclient: shutdown 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 msgr2=0x7f88dc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88d800be30 tx=0x7f88d800bf30 comp rx=0 tx=0).stop 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e19e5640 1 -- 10.20.193.51:0/510204771 reap_dead start 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 shutdown_connections 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 --2- 10.20.193.51:0/510204771 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88dc13b760 0x7f88dc070f00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 >> 10.20.193.51:0/510204771 conn(0x7f88dc0a30c0 msgr2=0x7f88dc0996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 shutdown_connections 2026-02-17T11:59:50.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T11:59:50.976+0000 7f88e346f640 1 -- 10.20.193.51:0/510204771 wait complete. 2026-02-17T11:59:50.998 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T11:59:50.999 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:2174: done (1 left) 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:2175: done (0 left) 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:2176: rollback oid 22 current snap is 238 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 237 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:2177: write (excl) oid 14 current snap is 238 2026-02-17T11:59:51.639 INFO:tasks.rados.rados.0.trial142.stdout:2177: seq_num 752 ranges {638864=789842,1972106=456248} 2026-02-17T11:59:51.644 INFO:tasks.rados.rados.0.trial142.stdout:2177: writing trial14245205-14 from 638864 to 1428706 tid 1 2026-02-17T11:59:51.648 INFO:tasks.rados.rados.0.trial142.stdout:2177: writing trial14245205-14 from 1972106 to 2428354 tid 2 2026-02-17T11:59:51.648 INFO:tasks.rados.rados.0.trial142.stdout:2178: write oid 4 current snap is 238 2026-02-17T11:59:51.648 INFO:tasks.rados.rados.0.trial142.stdout:2178: seq_num 753 ranges {655671=581444,2030588=625083} 2026-02-17T11:59:51.652 INFO:tasks.rados.rados.0.trial142.stdout:2178: writing trial14245205-4 from 655671 to 1237115 tid 1 2026-02-17T11:59:51.658 INFO:tasks.rados.rados.0.trial142.stdout:2178: writing trial14245205-4 from 2030588 to 2655671 tid 2 2026-02-17T11:59:51.658 INFO:tasks.rados.rados.0.trial142.stdout:2179: write oid 31 current snap is 238 2026-02-17T11:59:51.658 INFO:tasks.rados.rados.0.trial142.stdout:2176: finishing rollback tid 0 to trial14245205-22 2026-02-17T11:59:51.658 INFO:tasks.rados.rados.0.trial142.stdout:2179: seq_num 754 ranges {672478=656693,2089070=459917} 2026-02-17T11:59:51.662 INFO:tasks.rados.rados.0.trial142.stdout:2179: writing trial14245205-31 from 672478 to 1329171 tid 1 2026-02-17T11:59:51.668 INFO:tasks.rados.rados.0.trial142.stdout:2179: writing trial14245205-31 from 2089070 to 2548987 tid 2 2026-02-17T11:59:51.668 INFO:tasks.rados.rados.0.trial142.stdout:2180: copy_from oid 6 from oid 42 current snap is 238 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2176: finishing rollback tid 1 to trial14245205-22 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2176: finishing rollback tid 2 to trial14245205-22 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 1500 (ObjNum 744 snap 234 seq_num 744) dirty exists 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: finishing write tid 1 to trial14245205-14 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: finishing write tid 2 to trial14245205-14 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: finishing write tid 3 to trial14245205-14 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: finishing write tid 4 to trial14245205-14 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: oid 14 updating version 0 to 2033 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: oid 14 version 2033 is already newer than 2032 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:2177: oid 14 updating version 2033 to 2034 2026-02-17T11:59:51.669 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2034 (ObjNum 752 snap 238 seq_num 752) dirty exists 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2177: left oid 14 (ObjNum 752 snap 238 seq_num 752) 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: finishing write tid 1 to trial14245205-4 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2176: done (4 left) 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2177: done (3 left) 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2181: copy_from oid 40 from oid 37 current snap is 238 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: finishing write tid 2 to trial14245205-4 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: finishing write tid 3 to trial14245205-4 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: finishing write tid 4 to trial14245205-4 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: oid 4 updating version 0 to 2036 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: oid 4 updating version 2036 to 2038 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:2178: oid 4 version 2038 is already newer than 2037 2026-02-17T11:59:51.670 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2038 (ObjNum 753 snap 238 seq_num 753) dirty exists 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2178: left oid 4 (ObjNum 753 snap 238 seq_num 753) 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2178: done (3 left) 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2182: read oid 49 snap -1 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2182: expect deleted 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2183: rollback oid 30 current snap is 238 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 30 to 235 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2184: read oid 14 snap 236 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2184: expect deleted 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2185: delete oid 41 current snap is 238 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2183: finishing rollback tid 1 to trial14245205-30 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2180: finishing copy_from to trial14245205-6 2026-02-17T11:59:51.671 INFO:tasks.rados.rados.0.trial142.stdout:2180: got expected ENOENT (src dne) 2026-02-17T11:59:51.672 INFO:tasks.rados.rados.0.trial142.stdout:2180: finishing copy_from racing read to trial14245205-6 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2179: finishing write tid 1 to trial14245205-31 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2180: done (6 left) 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2182: done (5 left) 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2183: done (4 left) 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2184: done (3 left) 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2185: done (2 left) 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2186: delete oid 5 current snap is 238 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2179: finishing write tid 2 to trial14245205-31 2026-02-17T11:59:51.673 INFO:tasks.rados.rados.0.trial142.stdout:2179: finishing write tid 3 to trial14245205-31 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: finishing write tid 4 to trial14245205-31 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: oid 31 updating version 0 to 1805 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: oid 31 version 1805 is already newer than 1803 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: oid 31 version 1805 is already newer than 1804 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1805 (ObjNum 754 snap 238 seq_num 754) dirty exists 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: left oid 31 (ObjNum 754 snap 238 seq_num 754) 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2179: done (2 left) 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2186: done (1 left) 2026-02-17T11:59:51.674 INFO:tasks.rados.rados.0.trial142.stdout:2187: snap_remove snap 235 2026-02-17T11:59:52.643 INFO:tasks.rados.rados.0.trial142.stdout:2187: done (1 left) 2026-02-17T11:59:52.643 INFO:tasks.rados.rados.0.trial142.stdout:2188: delete oid 26 current snap is 238 2026-02-17T11:59:52.644 INFO:tasks.rados.rados.0.trial142.stdout:2181: finishing copy_from racing read to trial14245205-40 2026-02-17T11:59:52.644 INFO:tasks.rados.rados.0.trial142.stdout:2181: finishing copy_from to trial14245205-40 2026-02-17T11:59:52.644 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1038 (ObjNum 751 snap 237 seq_num 751) dirty exists 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2181: done (1 left) 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2188: done (0 left) 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2189: rollback oid 16 current snap is 238 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 237 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2190: read oid 3 snap 237 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2190: expect (ObjNum 708 snap 220 seq_num 708) 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2191: write oid 26 current snap is 238 2026-02-17T11:59:52.646 INFO:tasks.rados.rados.0.trial142.stdout:2191: seq_num 758 ranges {739706=557689,1806645=467255} 2026-02-17T11:59:52.650 INFO:tasks.rados.rados.0.trial142.stdout:2191: writing trial14245205-26 from 739706 to 1297395 tid 1 2026-02-17T11:59:52.654 INFO:tasks.rados.rados.0.trial142.stdout:2191: writing trial14245205-26 from 1806645 to 2273900 tid 2 2026-02-17T11:59:52.654 INFO:tasks.rados.rados.0.trial142.stdout:2192: snap_create 2026-02-17T11:59:52.654 INFO:tasks.rados.rados.0.trial142.stdout:2190: expect (ObjNum 708 snap 220 seq_num 708) 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2189: finishing rollback tid 0 to trial14245205-16 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2189: finishing rollback tid 1 to trial14245205-16 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2189: finishing rollback tid 2 to trial14245205-16 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1137 (ObjNum 734 snap 234 seq_num 734) dirty exists 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2191: finishing write tid 1 to trial14245205-26 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2191: finishing write tid 2 to trial14245205-26 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2191: finishing write tid 3 to trial14245205-26 2026-02-17T11:59:52.779 INFO:tasks.rados.rados.0.trial142.stdout:2191: finishing write tid 4 to trial14245205-26 2026-02-17T11:59:52.780 INFO:tasks.rados.rados.0.trial142.stdout:2191: oid 26 updating version 0 to 1500 2026-02-17T11:59:52.780 INFO:tasks.rados.rados.0.trial142.stdout:2191: oid 26 updating version 1500 to 1501 2026-02-17T11:59:52.780 INFO:tasks.rados.rados.0.trial142.stdout:2191: oid 26 version 1501 is already newer than 1499 2026-02-17T11:59:52.780 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1501 (ObjNum 758 snap 238 seq_num 758) dirty exists 2026-02-17T11:59:52.780 INFO:tasks.rados.rados.0.trial142.stdout:2191: left oid 26 (ObjNum 758 snap 238 seq_num 758) 2026-02-17T11:59:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2189: done (3 left) 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2190: done (2 left) 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2191: done (1 left) 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2192: done (0 left) 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2193: read oid 29 snap -1 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2193: expect deleted 2026-02-17T11:59:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2194: snap_remove snap 238 2026-02-17T11:59:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2194: done (1 left) 2026-02-17T11:59:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2195: copy_from oid 37 from oid 28 current snap is 239 2026-02-17T11:59:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2193: done (1 left) 2026-02-17T11:59:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2196: delete oid 18 current snap is 239 2026-02-17T11:59:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2195: finishing copy_from to trial14245205-37 2026-02-17T11:59:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2195: got expected ENOENT (src dne) 2026-02-17T11:59:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2195: finishing copy_from racing read to trial14245205-37 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2195: done (1 left) 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2196: done (0 left) 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2197: read oid 30 snap -1 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2197: expect deleted 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2198: rollback oid 26 current snap is 239 2026-02-17T11:59:54.651 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 237 2026-02-17T11:59:54.652 INFO:tasks.rados.rados.0.trial142.stdout:2199: snap_create 2026-02-17T11:59:54.653 INFO:tasks.rados.rados.0.trial142.stdout:2198: finishing rollback tid 0 to trial14245205-26 2026-02-17T11:59:54.654 INFO:tasks.rados.rados.0.trial142.stdout:2198: finishing rollback tid 1 to trial14245205-26 2026-02-17T11:59:54.654 INFO:tasks.rados.rados.0.trial142.stdout:2198: finishing rollback tid 2 to trial14245205-26 2026-02-17T11:59:54.654 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1504 (ObjNum 732 snap 232 seq_num 732) dirty exists 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2197: done (2 left) 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2198: done (1 left) 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2199: done (0 left) 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2200: copy_from oid 26 from oid 48 current snap is 240 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2201: write (excl) oid 24 current snap is 240 2026-02-17T11:59:55.581 INFO:tasks.rados.rados.0.trial142.stdout:2201: seq_num 760 ranges {773320=708187,1923609=470924} 2026-02-17T11:59:55.587 INFO:tasks.rados.rados.0.trial142.stdout:2201: writing trial14245205-24 from 773320 to 1481507 tid 1 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2201: writing trial14245205-24 from 1923609 to 2394533 tid 2 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2202: read oid 38 snap 239 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2202: expect deleted 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2203: read oid 8 snap -1 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2203: expect (ObjNum 731 snap 230 seq_num 731) 2026-02-17T11:59:55.591 INFO:tasks.rados.rados.0.trial142.stdout:2204: snap_create 2026-02-17T11:59:55.593 INFO:tasks.rados.rados.0.trial142.stdout:2200: finishing copy_from racing read to trial14245205-26 2026-02-17T11:59:55.593 INFO:tasks.rados.rados.0.trial142.stdout:2201: finishing write tid 1 to trial14245205-24 2026-02-17T11:59:55.593 INFO:tasks.rados.rados.0.trial142.stdout:2201: finishing write tid 2 to trial14245205-24 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: finishing write tid 3 to trial14245205-24 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: finishing write tid 4 to trial14245205-24 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: oid 24 updating version 0 to 1095 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: oid 24 updating version 1095 to 1096 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: oid 24 version 1096 is already newer than 1094 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1096 (ObjNum 760 snap 240 seq_num 760) dirty exists 2026-02-17T11:59:55.594 INFO:tasks.rados.rados.0.trial142.stdout:2201: left oid 24 (ObjNum 760 snap 240 seq_num 760) 2026-02-17T11:59:55.595 INFO:tasks.rados.rados.0.trial142.stdout:2200: finishing copy_from to trial14245205-26 2026-02-17T11:59:55.595 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1608 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T11:59:55.597 INFO:tasks.rados.rados.0.trial142.stdout:2203: expect (ObjNum 731 snap 230 seq_num 731) 2026-02-17T11:59:56.584 INFO:tasks.rados.rados.0.trial142.stdout:2200: done (4 left) 2026-02-17T11:59:56.585 INFO:tasks.rados.rados.0.trial142.stdout:2201: done (3 left) 2026-02-17T11:59:56.585 INFO:tasks.rados.rados.0.trial142.stdout:2202: done (2 left) 2026-02-17T11:59:56.585 INFO:tasks.rados.rados.0.trial142.stdout:2203: done (1 left) 2026-02-17T11:59:56.585 INFO:tasks.rados.rados.0.trial142.stdout:2204: done (0 left) 2026-02-17T11:59:56.585 INFO:tasks.rados.rados.0.trial142.stdout:2205: snap_remove snap 240 2026-02-17T11:59:57.584 INFO:tasks.rados.rados.0.trial142.stdout:2205: done (0 left) 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2206: copy_from oid 33 from oid 9 current snap is 241 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2207: rollback oid 2 current snap is 241 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 239 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2208: rollback oid 36 current snap is 241 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 236 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2209: copy_from oid 7 from oid 42 current snap is 241 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2210: read oid 31 snap -1 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2210: expect (ObjNum 754 snap 238 seq_num 754) 2026-02-17T11:59:57.585 INFO:tasks.rados.rados.0.trial142.stdout:2211: snap_remove snap 237 2026-02-17T11:59:58.589 INFO:tasks.rados.rados.0.trial142.stdout:2211: done (5 left) 2026-02-17T11:59:58.589 INFO:tasks.rados.rados.0.trial142.stdout:2212: copy_from oid 24 from oid 23 current snap is 241 2026-02-17T11:59:58.589 INFO:tasks.rados.rados.0.trial142.stdout:2207: finishing rollback tid 0 to trial14245205-2 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2207: finishing rollback tid 1 to trial14245205-2 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2207: finishing rollback tid 2 to trial14245205-2 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1236 (ObjNum 733 snap 232 seq_num 733) dirty exists 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2208: finishing rollback tid 0 to trial14245205-36 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2208: finishing rollback tid 1 to trial14245205-36 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2208: finishing rollback tid 2 to trial14245205-36 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1089 (ObjNum 698 snap 217 seq_num 698) dirty exists 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2209: finishing copy_from to trial14245205-7 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2209: got expected ENOENT (src dne) 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2209: finishing copy_from racing read to trial14245205-7 2026-02-17T11:59:58.590 INFO:tasks.rados.rados.0.trial142.stdout:2210: expect (ObjNum 754 snap 238 seq_num 754) 2026-02-17T11:59:58.679 INFO:tasks.rados.rados.0.trial142.stdout:2206: finishing copy_from racing read to trial14245205-33 2026-02-17T11:59:58.679 INFO:tasks.rados.rados.0.trial142.stdout:2206: finishing copy_from to trial14245205-33 2026-02-17T11:59:58.679 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1942 (ObjNum 735 snap 234 seq_num 735) dirty exists 2026-02-17T11:59:58.679 INFO:tasks.rados.rados.0.trial142.stdout:2212: finishing copy_from racing read to trial14245205-24 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2212: finishing copy_from to trial14245205-24 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 1607 (ObjNum 748 snap 236 seq_num 748) dirty exists 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2206: done (5 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2207: done (4 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2208: done (3 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2209: done (2 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2210: done (1 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2212: done (0 left) 2026-02-17T11:59:58.680 INFO:tasks.rados.rados.0.trial142.stdout:2213: snap_remove snap 239 2026-02-17T11:59:59.591 INFO:tasks.rados.rados.0.trial142.stdout:2213: done (0 left) 2026-02-17T11:59:59.592 INFO:tasks.rados.rados.0.trial142.stdout:2214: snap_remove snap 236 2026-02-17T12:00:00.582 INFO:tasks.rados.rados.0.trial142.stdout:2214: done (0 left) 2026-02-17T12:00:00.582 INFO:tasks.rados.rados.0.trial142.stdout:2215: write (excl) oid 40 current snap is 241 2026-02-17T12:00:00.582 INFO:tasks.rados.rados.0.trial142.stdout:2215: seq_num 761 ranges {790127=499789,1698444=730935} 2026-02-17T12:00:00.587 INFO:tasks.rados.rados.0.trial142.stdout:2215: writing trial14245205-40 from 790127 to 1289916 tid 1 2026-02-17T12:00:00.591 INFO:tasks.rados.rados.0.trial142.stdout:2215: writing trial14245205-40 from 1698444 to 2429379 tid 2 2026-02-17T12:00:00.592 INFO:tasks.rados.rados.0.trial142.stdout:2216: write (excl) oid 15 current snap is 241 2026-02-17T12:00:00.592 INFO:tasks.rados.rados.0.trial142.stdout:2216: seq_num 762 ranges {406934=575038,1640573=474593,2642791=164143} 2026-02-17T12:00:00.595 INFO:tasks.rados.rados.0.trial142.stdout:2216: writing trial14245205-15 from 406934 to 981972 tid 1 2026-02-17T12:00:00.599 INFO:tasks.rados.rados.0.trial142.stdout:2216: writing trial14245205-15 from 1640573 to 2115166 tid 2 2026-02-17T12:00:00.602 INFO:tasks.rados.rados.0.trial142.stdout:2216: writing trial14245205-15 from 2642791 to 2806934 tid 3 2026-02-17T12:00:00.602 INFO:tasks.rados.rados.0.trial142.stdout:2217: read oid 25 snap -1 2026-02-17T12:00:00.602 INFO:tasks.rados.rados.0.trial142.stdout:2217: expect (ObjNum 695 snap 216 seq_num 695) 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2218: read oid 19 snap -1 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2218: expect deleted 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2219: snap_create 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: finishing write tid 1 to trial14245205-40 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: finishing write tid 2 to trial14245205-40 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: finishing write tid 3 to trial14245205-40 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: finishing write tid 4 to trial14245205-40 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: oid 40 updating version 0 to 1040 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: oid 40 updating version 1040 to 1041 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: oid 40 version 1041 is already newer than 1039 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1041 (ObjNum 761 snap 241 seq_num 761) dirty exists 2026-02-17T12:00:00.603 INFO:tasks.rados.rados.0.trial142.stdout:2215: left oid 40 (ObjNum 761 snap 241 seq_num 761) 2026-02-17T12:00:00.604 INFO:tasks.rados.rados.0.trial142.stdout:2216: finishing write tid 1 to trial14245205-15 2026-02-17T12:00:00.604 INFO:tasks.rados.rados.0.trial142.stdout:2216: finishing write tid 2 to trial14245205-15 2026-02-17T12:00:00.604 INFO:tasks.rados.rados.0.trial142.stdout:2216: finishing write tid 3 to trial14245205-15 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: finishing write tid 4 to trial14245205-15 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: finishing write tid 5 to trial14245205-15 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: oid 15 updating version 0 to 1945 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: oid 15 updating version 1945 to 1946 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: oid 15 version 1946 is already newer than 1944 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: oid 15 version 1946 is already newer than 1943 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 1946 (ObjNum 762 snap 241 seq_num 762) dirty exists 2026-02-17T12:00:00.605 INFO:tasks.rados.rados.0.trial142.stdout:2216: left oid 15 (ObjNum 762 snap 241 seq_num 762) 2026-02-17T12:00:00.608 INFO:tasks.rados.rados.0.trial142.stdout:2217: expect (ObjNum 695 snap 216 seq_num 695) 2026-02-17T12:00:01.598 INFO:tasks.rados.rados.0.trial142.stdout:2215: done (4 left) 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2216: done (3 left) 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2217: done (2 left) 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2218: done (1 left) 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2219: done (0 left) 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2220: read oid 19 snap 241 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2220: expect deleted 2026-02-17T12:00:01.599 INFO:tasks.rados.rados.0.trial142.stdout:2221: snap_create 2026-02-17T12:00:02.599 INFO:tasks.rados.rados.0.trial142.stdout:2220: done (1 left) 2026-02-17T12:00:02.599 INFO:tasks.rados.rados.0.trial142.stdout:2221: done (0 left) 2026-02-17T12:00:02.600 INFO:tasks.rados.rados.0.trial142.stdout:2222: read oid 25 snap -1 2026-02-17T12:00:02.600 INFO:tasks.rados.rados.0.trial142.stdout:2222: expect (ObjNum 695 snap 216 seq_num 695) 2026-02-17T12:00:02.600 INFO:tasks.rados.rados.0.trial142.stdout:2223: copy_from oid 3 from oid 39 current snap is 243 2026-02-17T12:00:02.600 INFO:tasks.rados.rados.0.trial142.stdout:2224: write (excl) oid 12 current snap is 243 2026-02-17T12:00:02.600 INFO:tasks.rados.rados.0.trial142.stdout:2224: seq_num 763 ranges {423741=650287,1699055=618251} 2026-02-17T12:00:02.603 INFO:tasks.rados.rados.0.trial142.stdout:2224: writing trial14245205-12 from 423741 to 1074028 tid 1 2026-02-17T12:00:02.608 INFO:tasks.rados.rados.0.trial142.stdout:2224: writing trial14245205-12 from 1699055 to 2317306 tid 2 2026-02-17T12:00:02.608 INFO:tasks.rados.rados.0.trial142.stdout:2225: rollback oid 14 current snap is 243 2026-02-17T12:00:02.608 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 241 2026-02-17T12:00:02.608 INFO:tasks.rados.rados.0.trial142.stdout:2223: finishing copy_from to trial14245205-3 2026-02-17T12:00:02.609 INFO:tasks.rados.rados.0.trial142.stdout:2223: got expected ENOENT (src dne) 2026-02-17T12:00:02.609 INFO:tasks.rados.rados.0.trial142.stdout:2223: finishing copy_from racing read to trial14245205-3 2026-02-17T12:00:02.609 INFO:tasks.rados.rados.0.trial142.stdout:2222: expect (ObjNum 695 snap 216 seq_num 695) 2026-02-17T12:00:02.696 INFO:tasks.rados.rados.0.trial142.stdout:2224: finishing write tid 1 to trial14245205-12 2026-02-17T12:00:02.697 INFO:tasks.rados.rados.0.trial142.stdout:2222: done (3 left) 2026-02-17T12:00:02.697 INFO:tasks.rados.rados.0.trial142.stdout:2223: done (2 left) 2026-02-17T12:00:02.697 INFO:tasks.rados.rados.0.trial142.stdout:2226: snap_remove snap 242 2026-02-17T12:00:03.604 INFO:tasks.rados.rados.0.trial142.stdout:2226: done (2 left) 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2227: snap_create 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: finishing write tid 2 to trial14245205-12 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: finishing write tid 3 to trial14245205-12 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: finishing write tid 4 to trial14245205-12 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: oid 12 updating version 0 to 2057 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: oid 12 version 2057 is already newer than 2056 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:2224: oid 12 updating version 2057 to 2058 2026-02-17T12:00:03.605 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2058 (ObjNum 763 snap 243 seq_num 763) dirty exists 2026-02-17T12:00:03.606 INFO:tasks.rados.rados.0.trial142.stdout:2224: left oid 12 (ObjNum 763 snap 243 seq_num 763) 2026-02-17T12:00:03.606 INFO:tasks.rados.rados.0.trial142.stdout:2225: finishing rollback tid 0 to trial14245205-14 2026-02-17T12:00:03.606 INFO:tasks.rados.rados.0.trial142.stdout:2225: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:00:03.606 INFO:tasks.rados.rados.0.trial142.stdout:2225: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:00:03.606 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2062 (ObjNum 752 snap 238 seq_num 752) dirty exists 2026-02-17T12:00:04.606 INFO:tasks.rados.rados.0.trial142.stdout:2224: done (2 left) 2026-02-17T12:00:04.606 INFO:tasks.rados.rados.0.trial142.stdout:2225: done (1 left) 2026-02-17T12:00:04.606 INFO:tasks.rados.rados.0.trial142.stdout:2227: done (0 left) 2026-02-17T12:00:04.606 INFO:tasks.rados.rados.0.trial142.stdout:2228: write oid 47 current snap is 244 2026-02-17T12:00:04.606 INFO:tasks.rados.rados.0.trial142.stdout:2228: seq_num 764 ranges {440548=725536,1757537=478262,2813990=26558} 2026-02-17T12:00:04.610 INFO:tasks.rados.rados.0.trial142.stdout:2228: writing trial14245205-47 from 440548 to 1166084 tid 1 2026-02-17T12:00:04.614 INFO:tasks.rados.rados.0.trial142.stdout:2228: writing trial14245205-47 from 1757537 to 2235799 tid 2 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2228: writing trial14245205-47 from 2813990 to 2840548 tid 3 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2229: read oid 9 snap -1 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2229: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2230: write (excl) oid 21 current snap is 244 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2228: finishing write tid 1 to trial14245205-47 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2228: finishing write tid 2 to trial14245205-47 2026-02-17T12:00:04.617 INFO:tasks.rados.rados.0.trial142.stdout:2230: seq_num 765 ranges {457355=400785,1416019=621920,2725060=132295} 2026-02-17T12:00:04.620 INFO:tasks.rados.rados.0.trial142.stdout:2230: writing trial14245205-21 from 457355 to 858140 tid 1 2026-02-17T12:00:04.624 INFO:tasks.rados.rados.0.trial142.stdout:2230: writing trial14245205-21 from 1416019 to 2037939 tid 2 2026-02-17T12:00:04.628 INFO:tasks.rados.rados.0.trial142.stdout:2230: writing trial14245205-21 from 2725060 to 2857355 tid 3 2026-02-17T12:00:04.628 INFO:tasks.rados.rados.0.trial142.stdout:2231: write oid 50 current snap is 244 2026-02-17T12:00:04.628 INFO:tasks.rados.rados.0.trial142.stdout:2231: seq_num 766 ranges {474162=476034,1358148=481931,2352483=465303} 2026-02-17T12:00:04.631 INFO:tasks.rados.rados.0.trial142.stdout:2231: writing trial14245205-50 from 474162 to 950196 tid 1 2026-02-17T12:00:04.634 INFO:tasks.rados.rados.0.trial142.stdout:2231: writing trial14245205-50 from 1358148 to 1840079 tid 2 2026-02-17T12:00:04.638 INFO:tasks.rados.rados.0.trial142.stdout:2231: writing trial14245205-50 from 2352483 to 2817786 tid 3 2026-02-17T12:00:04.638 INFO:tasks.rados.rados.0.trial142.stdout:2232: snap_create 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: finishing write tid 3 to trial14245205-47 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: finishing write tid 4 to trial14245205-47 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: finishing write tid 5 to trial14245205-47 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: oid 47 updating version 0 to 1611 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: oid 47 version 1611 is already newer than 1610 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: oid 47 version 1611 is already newer than 1609 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: oid 47 version 1611 is already newer than 1608 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 1611 (ObjNum 764 snap 244 seq_num 764) dirty exists 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2228: left oid 47 (ObjNum 764 snap 244 seq_num 764) 2026-02-17T12:00:04.639 INFO:tasks.rados.rados.0.trial142.stdout:2229: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: finishing write tid 1 to trial14245205-21 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: finishing write tid 2 to trial14245205-21 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: finishing write tid 3 to trial14245205-21 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: finishing write tid 4 to trial14245205-21 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: finishing write tid 5 to trial14245205-21 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: oid 21 updating version 0 to 1904 2026-02-17T12:00:04.728 INFO:tasks.rados.rados.0.trial142.stdout:2230: oid 21 version 1904 is already newer than 1903 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2230: oid 21 version 1904 is already newer than 1902 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2230: oid 21 updating version 1904 to 1905 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1905 (ObjNum 765 snap 244 seq_num 765) dirty exists 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2230: left oid 21 (ObjNum 765 snap 244 seq_num 765) 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: finishing write tid 1 to trial14245205-50 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: finishing write tid 2 to trial14245205-50 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: finishing write tid 3 to trial14245205-50 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: finishing write tid 4 to trial14245205-50 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: finishing write tid 5 to trial14245205-50 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: oid 50 updating version 0 to 1609 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: oid 50 updating version 1609 to 1612 2026-02-17T12:00:04.729 INFO:tasks.rados.rados.0.trial142.stdout:2231: oid 50 version 1612 is already newer than 1610 2026-02-17T12:00:04.730 INFO:tasks.rados.rados.0.trial142.stdout:2231: oid 50 version 1612 is already newer than 1611 2026-02-17T12:00:04.730 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1612 (ObjNum 766 snap 244 seq_num 766) dirty exists 2026-02-17T12:00:04.730 INFO:tasks.rados.rados.0.trial142.stdout:2231: left oid 50 (ObjNum 766 snap 244 seq_num 766) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2228: done (4 left) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2229: done (3 left) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2230: done (2 left) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2231: done (1 left) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2232: done (0 left) 2026-02-17T12:00:05.584 INFO:tasks.rados.rados.0.trial142.stdout:2233: delete oid 17 current snap is 245 2026-02-17T12:00:05.589 INFO:tasks.rados.rados.0.trial142.stdout:2233: done (0 left) 2026-02-17T12:00:05.589 INFO:tasks.rados.rados.0.trial142.stdout:2234: rollback oid 20 current snap is 245 2026-02-17T12:00:05.589 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 243 2026-02-17T12:00:05.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: write (excl) oid 12 current snap is 245 2026-02-17T12:00:05.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: seq_num 768 ranges {507776=742885,1991465=485600} 2026-02-17T12:00:05.594 INFO:tasks.rados.rados.0.trial142.stdout:2235: writing trial14245205-12 from 507776 to 1250661 tid 1 2026-02-17T12:00:05.599 INFO:tasks.rados.rados.0.trial142.stdout:2235: writing trial14245205-12 from 1991465 to 2477065 tid 2 2026-02-17T12:00:05.599 INFO:tasks.rados.rados.0.trial142.stdout:2236: read oid 31 snap -1 2026-02-17T12:00:05.599 INFO:tasks.rados.rados.0.trial142.stdout:2236: expect (ObjNum 754 snap 238 seq_num 754) 2026-02-17T12:00:05.599 INFO:tasks.rados.rados.0.trial142.stdout:2237: snap_remove snap 241 2026-02-17T12:00:06.587 INFO:tasks.rados.rados.0.trial142.stdout:2237: done (3 left) 2026-02-17T12:00:06.587 INFO:tasks.rados.rados.0.trial142.stdout:2238: snap_remove snap 244 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:2238: done (3 left) 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:2239: delete oid 29 current snap is 245 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:2234: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:2234: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:2234: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:00:07.588 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1092 (ObjNum 736 snap 234 seq_num 736) dirty exists 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: finishing write tid 1 to trial14245205-12 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: finishing write tid 2 to trial14245205-12 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: finishing write tid 3 to trial14245205-12 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: finishing write tid 4 to trial14245205-12 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: oid 12 updating version 0 to 2068 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: oid 12 updating version 2068 to 2069 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: oid 12 updating version 2069 to 2070 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2070 (ObjNum 768 snap 245 seq_num 768) dirty exists 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2235: left oid 12 (ObjNum 768 snap 245 seq_num 768) 2026-02-17T12:00:07.589 INFO:tasks.rados.rados.0.trial142.stdout:2236: expect (ObjNum 754 snap 238 seq_num 754) 2026-02-17T12:00:07.676 INFO:tasks.rados.rados.0.trial142.stdout:2234: done (3 left) 2026-02-17T12:00:07.677 INFO:tasks.rados.rados.0.trial142.stdout:2235: done (2 left) 2026-02-17T12:00:07.677 INFO:tasks.rados.rados.0.trial142.stdout:2236: done (1 left) 2026-02-17T12:00:07.677 INFO:tasks.rados.rados.0.trial142.stdout:2239: done (0 left) 2026-02-17T12:00:07.677 INFO:tasks.rados.rados.0.trial142.stdout:2240: write oid 30 current snap is 245 2026-02-17T12:00:07.677 INFO:tasks.rados.rados.0.trial142.stdout:2240: seq_num 770 ranges {541390=493383,1592076=489269,2862175=79215} 2026-02-17T12:00:07.680 INFO:tasks.rados.rados.0.trial142.stdout:2240: writing trial14245205-30 from 541390 to 1034773 tid 1 2026-02-17T12:00:07.684 INFO:tasks.rados.rados.0.trial142.stdout:2240: writing trial14245205-30 from 1592076 to 2081345 tid 2 2026-02-17T12:00:07.688 INFO:tasks.rados.rados.0.trial142.stdout:2240: writing trial14245205-30 from 2862175 to 2941390 tid 3 2026-02-17T12:00:07.688 INFO:tasks.rados.rados.0.trial142.stdout:2241: read oid 45 snap -1 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2241: expect (ObjNum 686 snap 213 seq_num 686) 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2242: read oid 22 snap 243 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2242: expect (ObjNum 744 snap 234 seq_num 744) 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2243: read oid 14 snap -1 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2243: expect (ObjNum 752 snap 238 seq_num 752) 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2244: rollback oid 21 current snap is 245 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 243 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2240: finishing write tid 1 to trial14245205-30 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2240: finishing write tid 2 to trial14245205-30 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2245: write (excl) oid 44 current snap is 245 2026-02-17T12:00:07.689 INFO:tasks.rados.rados.0.trial142.stdout:2245: seq_num 771 ranges {558197=568632,1650558=632927,2773245=184952} 2026-02-17T12:00:07.691 INFO:tasks.rados.rados.0.trial142.stdout:2245: writing trial14245205-44 from 558197 to 1126829 tid 1 2026-02-17T12:00:07.696 INFO:tasks.rados.rados.0.trial142.stdout:2245: writing trial14245205-44 from 1650558 to 2283485 tid 2 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2245: writing trial14245205-44 from 2773245 to 2958197 tid 3 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2246: rollback oid 33 current snap is 245 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 243 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: finishing write tid 3 to trial14245205-30 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: finishing write tid 4 to trial14245205-30 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: finishing write tid 5 to trial14245205-30 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: oid 30 updating version 0 to 1612 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: oid 30 version 1612 is already newer than 1611 2026-02-17T12:00:07.699 INFO:tasks.rados.rados.0.trial142.stdout:2240: oid 30 version 1612 is already newer than 1609 2026-02-17T12:00:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2240: oid 30 version 1612 is already newer than 1610 2026-02-17T12:00:07.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 1612 (ObjNum 770 snap 245 seq_num 770) dirty exists 2026-02-17T12:00:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2240: left oid 30 (ObjNum 770 snap 245 seq_num 770) 2026-02-17T12:00:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2243: expect (ObjNum 752 snap 238 seq_num 752) 2026-02-17T12:00:07.760 INFO:tasks.rados.rados.0.trial142.stdout:2242: expect (ObjNum 744 snap 234 seq_num 744) 2026-02-17T12:00:07.819 INFO:tasks.rados.rados.0.trial142.stdout:2241: expect (ObjNum 686 snap 213 seq_num 686) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2245: finishing write tid 1 to trial14245205-44 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2244: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2244: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2245: finishing write tid 2 to trial14245205-44 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2244: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1908 (ObjNum 666 snap 210 seq_num 666) dirty exists 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2245: finishing write tid 3 to trial14245205-44 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2240: done (6 left) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2241: done (5 left) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2242: done (4 left) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2243: done (3 left) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2244: done (2 left) 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2247: write oid 36 current snap is 245 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2245: finishing write tid 4 to trial14245205-44 2026-02-17T12:00:07.905 INFO:tasks.rados.rados.0.trial142.stdout:2247: seq_num 772 ranges {575004=643881,1709040=492938,2917021=57983} 2026-02-17T12:00:07.909 INFO:tasks.rados.rados.0.trial142.stdout:2247: writing trial14245205-36 from 575004 to 1218885 tid 1 2026-02-17T12:00:07.913 INFO:tasks.rados.rados.0.trial142.stdout:2247: writing trial14245205-36 from 1709040 to 2201978 tid 2 2026-02-17T12:00:07.916 INFO:tasks.rados.rados.0.trial142.stdout:2247: writing trial14245205-36 from 2917021 to 2975004 tid 3 2026-02-17T12:00:07.916 INFO:tasks.rados.rados.0.trial142.stdout:2248: delete oid 50 current snap is 245 2026-02-17T12:00:07.916 INFO:tasks.rados.rados.0.trial142.stdout:2245: finishing write tid 5 to trial14245205-44 2026-02-17T12:00:07.916 INFO:tasks.rados.rados.0.trial142.stdout:2245: oid 44 updating version 0 to 1503 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2245: oid 44 version 1503 is already newer than 1501 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2245: oid 44 version 1503 is already newer than 1502 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2245: oid 44 updating version 1503 to 1504 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1504 (ObjNum 771 snap 245 seq_num 771) dirty exists 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2245: left oid 44 (ObjNum 771 snap 245 seq_num 771) 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2246: finishing rollback tid 0 to trial14245205-33 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2246: finishing rollback tid 1 to trial14245205-33 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2246: finishing rollback tid 2 to trial14245205-33 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1949 (ObjNum 735 snap 234 seq_num 735) dirty exists 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2247: finishing write tid 1 to trial14245205-36 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2247: finishing write tid 2 to trial14245205-36 2026-02-17T12:00:07.917 INFO:tasks.rados.rados.0.trial142.stdout:2247: finishing write tid 3 to trial14245205-36 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2245: done (3 left) 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2246: done (2 left) 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2248: done (1 left) 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2249: snap_create 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: finishing write tid 4 to trial14245205-36 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: finishing write tid 5 to trial14245205-36 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: oid 36 updating version 0 to 1096 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: oid 36 version 1096 is already newer than 1095 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: oid 36 version 1096 is already newer than 1094 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: oid 36 version 1096 is already newer than 1093 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1096 (ObjNum 772 snap 245 seq_num 772) dirty exists 2026-02-17T12:00:07.918 INFO:tasks.rados.rados.0.trial142.stdout:2247: left oid 36 (ObjNum 772 snap 245 seq_num 772) 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2247: done (1 left) 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2249: done (0 left) 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2250: read oid 7 snap -1 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2250: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2251: write oid 8 current snap is 246 2026-02-17T12:00:08.593 INFO:tasks.rados.rados.0.trial142.stdout:2251: seq_num 774 ranges {608618=794379,2109651=780254} 2026-02-17T12:00:08.598 INFO:tasks.rados.rados.0.trial142.stdout:2251: writing trial14245205-8 from 608618 to 1402997 tid 1 2026-02-17T12:00:08.604 INFO:tasks.rados.rados.0.trial142.stdout:2251: writing trial14245205-8 from 2109651 to 2889905 tid 2 2026-02-17T12:00:08.604 INFO:tasks.rados.rados.0.trial142.stdout:2252: read oid 2 snap -1 2026-02-17T12:00:08.604 INFO:tasks.rados.rados.0.trial142.stdout:2252: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:08.604 INFO:tasks.rados.rados.0.trial142.stdout:2253: snap_remove snap 243 2026-02-17T12:00:09.594 INFO:tasks.rados.rados.0.trial142.stdout:2253: done (3 left) 2026-02-17T12:00:09.595 INFO:tasks.rados.rados.0.trial142.stdout:2254: delete oid 13 current snap is 246 2026-02-17T12:00:09.595 INFO:tasks.rados.rados.0.trial142.stdout:2250: expect (ObjNum 641 snap 199 seq_num 641) 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: finishing write tid 1 to trial14245205-8 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: finishing write tid 2 to trial14245205-8 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2250: done (3 left) 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2254: done (2 left) 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2255: delete oid 43 current snap is 246 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: finishing write tid 3 to trial14245205-8 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: finishing write tid 4 to trial14245205-8 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: oid 8 updating version 0 to 1952 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: oid 8 version 1952 is already newer than 1950 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:2251: oid 8 version 1952 is already newer than 1951 2026-02-17T12:00:09.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1952 (ObjNum 774 snap 246 seq_num 774) dirty exists 2026-02-17T12:00:09.665 INFO:tasks.rados.rados.0.trial142.stdout:2251: left oid 8 (ObjNum 774 snap 246 seq_num 774) 2026-02-17T12:00:09.665 INFO:tasks.rados.rados.0.trial142.stdout:2252: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:09.717 INFO:tasks.rados.rados.0.trial142.stdout:2251: done (2 left) 2026-02-17T12:00:09.717 INFO:tasks.rados.rados.0.trial142.stdout:2252: done (1 left) 2026-02-17T12:00:09.717 INFO:tasks.rados.rados.0.trial142.stdout:2255: done (0 left) 2026-02-17T12:00:09.717 INFO:tasks.rados.rados.0.trial142.stdout:2256: write oid 13 current snap is 246 2026-02-17T12:00:09.718 INFO:tasks.rados.rados.0.trial142.stdout:2256: seq_num 777 ranges {659039=736479,2001450=643934} 2026-02-17T12:00:09.723 INFO:tasks.rados.rados.0.trial142.stdout:2256: writing trial14245205-13 from 659039 to 1395518 tid 1 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2256: writing trial14245205-13 from 2001450 to 2645384 tid 2 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2256: finishing write tid 1 to trial14245205-13 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2257: read oid 5 snap -1 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2257: expect deleted 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2258: read oid 9 snap 245 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2258: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:09.728 INFO:tasks.rados.rados.0.trial142.stdout:2259: delete oid 22 current snap is 246 2026-02-17T12:00:09.729 INFO:tasks.rados.rados.0.trial142.stdout:2257: done (3 left) 2026-02-17T12:00:09.729 INFO:tasks.rados.rados.0.trial142.stdout:2259: done (2 left) 2026-02-17T12:00:09.729 INFO:tasks.rados.rados.0.trial142.stdout:2260: write (excl) oid 16 current snap is 246 2026-02-17T12:00:09.729 INFO:tasks.rados.rados.0.trial142.stdout:2260: seq_num 779 ranges {692653=486977,1602061=647603,2992629=100024} 2026-02-17T12:00:09.733 INFO:tasks.rados.rados.0.trial142.stdout:2260: writing trial14245205-16 from 692653 to 1179630 tid 1 2026-02-17T12:00:09.737 INFO:tasks.rados.rados.0.trial142.stdout:2260: writing trial14245205-16 from 1602061 to 2249664 tid 2 2026-02-17T12:00:09.741 INFO:tasks.rados.rados.0.trial142.stdout:2260: writing trial14245205-16 from 2992629 to 3092653 tid 3 2026-02-17T12:00:09.741 INFO:tasks.rados.rados.0.trial142.stdout:2261: read oid 29 snap -1 2026-02-17T12:00:09.741 INFO:tasks.rados.rados.0.trial142.stdout:2261: expect deleted 2026-02-17T12:00:09.741 INFO:tasks.rados.rados.0.trial142.stdout:2262: snap_create 2026-02-17T12:00:09.741 INFO:tasks.rados.rados.0.trial142.stdout:2258: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:09.829 INFO:tasks.rados.rados.0.trial142.stdout:2256: finishing write tid 2 to trial14245205-13 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: finishing write tid 3 to trial14245205-13 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: finishing write tid 4 to trial14245205-13 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: oid 13 updating version 0 to 1955 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: oid 13 version 1955 is already newer than 1954 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: oid 13 updating version 1955 to 1956 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 1956 (ObjNum 777 snap 246 seq_num 777) dirty exists 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2256: left oid 13 (ObjNum 777 snap 246 seq_num 777) 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2260: finishing write tid 1 to trial14245205-16 2026-02-17T12:00:09.830 INFO:tasks.rados.rados.0.trial142.stdout:2260: finishing write tid 2 to trial14245205-16 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: finishing write tid 3 to trial14245205-16 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: finishing write tid 4 to trial14245205-16 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: finishing write tid 5 to trial14245205-16 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: oid 16 updating version 0 to 1141 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: oid 16 version 1141 is already newer than 1139 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: oid 16 version 1141 is already newer than 1140 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: oid 16 updating version 1141 to 1142 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1142 (ObjNum 779 snap 246 seq_num 779) dirty exists 2026-02-17T12:00:09.831 INFO:tasks.rados.rados.0.trial142.stdout:2260: left oid 16 (ObjNum 779 snap 246 seq_num 779) 2026-02-17T12:00:10.585 INFO:tasks.rados.rados.0.trial142.stdout:2256: done (4 left) 2026-02-17T12:00:10.585 INFO:tasks.rados.rados.0.trial142.stdout:2258: done (3 left) 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2260: done (2 left) 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2261: done (1 left) 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2262: done (0 left) 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2263: copy_from oid 33 from oid 11 current snap is 247 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2264: read oid 43 snap -1 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2264: expect deleted 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2265: read oid 32 snap -1 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2265: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2266: copy_from oid 25 from oid 46 current snap is 247 2026-02-17T12:00:10.586 INFO:tasks.rados.rados.0.trial142.stdout:2267: copy_from oid 6 from oid 9 current snap is 247 2026-02-17T12:00:10.587 INFO:tasks.rados.rados.0.trial142.stdout:2268: write (excl) oid 4 current snap is 247 2026-02-17T12:00:10.587 INFO:tasks.rados.rados.0.trial142.stdout:2268: seq_num 780 ranges {709460=562226,2060543=791261} 2026-02-17T12:00:10.589 INFO:tasks.rados.rados.0.trial142.stdout:2268: writing trial14245205-4 from 709460 to 1271686 tid 1 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2268: writing trial14245205-4 from 2060543 to 2851804 tid 2 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2269: snap_create 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2266: finishing copy_from to trial14245205-25 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2266: got expected ENOENT (src dne) 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2266: finishing copy_from racing read to trial14245205-25 2026-02-17T12:00:10.596 INFO:tasks.rados.rados.0.trial142.stdout:2265: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:10.709 INFO:tasks.rados.rados.0.trial142.stdout:2267: finishing copy_from racing read to trial14245205-6 2026-02-17T12:00:10.709 INFO:tasks.rados.rados.0.trial142.stdout:2268: finishing write tid 1 to trial14245205-4 2026-02-17T12:00:10.709 INFO:tasks.rados.rados.0.trial142.stdout:2263: finishing copy_from racing read to trial14245205-33 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2267: finishing copy_from to trial14245205-6 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 1942 (ObjNum 735 snap 234 seq_num 735) dirty exists 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2263: finishing copy_from to trial14245205-33 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 1123 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: finishing write tid 2 to trial14245205-4 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: finishing write tid 3 to trial14245205-4 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: finishing write tid 4 to trial14245205-4 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: oid 4 updating version 0 to 2084 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: oid 4 version 2084 is already newer than 2083 2026-02-17T12:00:10.710 INFO:tasks.rados.rados.0.trial142.stdout:2268: oid 4 version 2084 is already newer than 2082 2026-02-17T12:00:10.711 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2084 (ObjNum 780 snap 247 seq_num 780) dirty exists 2026-02-17T12:00:10.711 INFO:tasks.rados.rados.0.trial142.stdout:2268: left oid 4 (ObjNum 780 snap 247 seq_num 780) 2026-02-17T12:00:10.999 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:00:10.999 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:00:10.999 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:00:11.000 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:00:11.002 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:00:11.002 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:00:11.002 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:11.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: get_monmap_and_config 2026-02-17T12:00:11.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: build_initial_monmap 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: monmap: 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:11.090112+0000 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:11.090112+0000 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:11.101 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 Processor -- start 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 -- start start 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: init 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-a con 0x7f4cfc06c8d0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:11.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-b con 0x7f4cfc0a0570 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4cfc13c350 0x7f4cfc13e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-c con 0x7f4cfc13c350 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc0a09f0 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc0a25a0 con 0x7f4cfc13c350 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc06d730 con 0x7f4cfc0a0570 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4d0218f640 10 monclient(hunting): authenticate will time out at 1498.708886s 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49070/0 (socket says 10.20.193.51:49070) 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfaffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/404438632 learned_addr learned my addr 10.20.193.51:0/404438632 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 10 monclient(hunting): get_auth_request con 0x7f4cfc06c8d0 auth_method 0 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:11.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfaffd640 10 monclient(hunting): get_auth_request con 0x7f4cfc0a0570 auth_method 0 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.089+0000 7f4cfaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfaffd640 1 -- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 msgr2=0x7f4cfc06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfaffd640 1 -- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 msgr2=0x7f4cfc06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfaffd640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfaffd640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfbfff640 1 --2- 10.20.193.51:0/404438632 >> v2:10.20.193.142:3300/0 conn(0x7f4cfc13c350 0x7f4cfc13e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfbfff640 10 monclient(hunting): get_auth_request con 0x7f4cfc13c350 auth_method 0 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient(hunting): handle_auth_done global_id 164415 payload 274 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 msgr2=0x7f4cfc06d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/404438632 >> v2:10.20.193.142:3300/0 conn(0x7f4cfc13c350 msgr2=0x7f4cfc13e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/404438632 >> v2:10.20.193.142:3300/0 conn(0x7f4cfc13c350 0x7f4cfc13e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:11.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.090+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/404438632 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc0a19f0 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc06c8d0 msgr2=0x7f4cfc06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc06d9e0 tx=0x7f4ce802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55058998693f6a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 1 -- 10.20.193.51:0/404438632 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce803c070 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: dump: 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.107 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4d0218f640 5 monclient: authenticate success, global_id 164415 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 1 -- 10.20.193.51:0/404438632 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce802fca0 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 1 -- 10.20.193.51:0/404438632 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8037660 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4cfa7fc640 10 monclient: dump: 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:11.109 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4d0218f640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.092+0000 7f4d0218f640 4 set_mon_vals no callback set 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 10 monclient: shutdown 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc06c8d0 msgr2=0x7f4cfc06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc06d9e0 tx=0x7f4ce802ee60 comp rx=0 tx=0).stop 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- 10.20.193.51:0/404438632 shutdown_connections 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 --2- 10.20.193.51:0/404438632 >> v2:10.20.193.142:3300/0 conn(0x7f4cfc13c350 0x7f4cfc13e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc0a0570 0x7f4cfc06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 --2- 10.20.193.51:0/404438632 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc06c8d0 0x7f4cfc06ccb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- 10.20.193.51:0/404438632 >> 10.20.193.51:0/404438632 conn(0x7f4cfc0aab70 msgr2=0x7f4cfc0aaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- 10.20.193.51:0/404438632 shutdown_connections 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- 10.20.193.51:0/404438632 wait complete. 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 10 monclient: build_initial_monmap 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 10 monclient: monmap: 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.111 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 Processor -- start 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 1 -- start start 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.093+0000 7f4d0218f640 10 monclient: init 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-c con 0x7f4cfc06c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4cfc0a0570 0x7f4cfc13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-b con 0x7f4cfc0a0570 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 0x7f4cfc122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): picked mon.noname-a con 0x7f4cfc13c350 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc0a10e0 con 0x7f4cfc13c350 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc0a0f60 con 0x7f4cfc0a0570 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc13ec80 con 0x7f4cfc06c8d0 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4d0218f640 10 monclient(hunting): authenticate will time out at 1498.713137s 2026-02-17T12:00:11.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:56678/0 (socket says 10.20.193.51:56678) 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 0x7f4cfc122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/2233448664 learned_addr learned my addr 10.20.193.51:0/2233448664 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 10 monclient(hunting): get_auth_request con 0x7f4cfc06c8d0 auth_method 0 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): get_auth_request con 0x7f4cfc13c350 auth_method 0 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:11.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 msgr2=0x7f4cfc1cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 msgr2=0x7f4cfc1cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfaffd640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4cfc0a0570 0x7f4cfc13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient(hunting): handle_auth_done global_id 164418 payload 824 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 msgr2=0x7f4cfc1cecc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4cfc0a0570 msgr2=0x7f4cfc13b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4cfc0a0570 0x7f4cfc13b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:11.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 monclient: found mon.noname-a 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.094+0000 7f4cfbfff640 1 -- 10.20.193.51:0/2233448664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc124c50 con 0x7f4cfc13c350 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cfbfff640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 msgr2=0x7f4cfc122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cfbfff640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 0x7f4cfc122fb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0007d90 tx=0x7f4cf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0003a90 con 0x7f4cfc13c350 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: dump: 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.116 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 5 monclient: authenticate success, global_id 164418 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0003c50 con 0x7f4cfc13c350 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 10 monclient: _renew_subs 2026-02-17T12:00:11.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc13e910 con 0x7f4cfc13c350 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0004020 con 0x7f4cfc13c350 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cf9ffb640 4 set_mon_vals no callback set 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4cd7fff640 10 monclient: dump: 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:11.118 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 10 monclient: _renew_subs 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.096+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc1cf200 con 0x7f4cfc13c350 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4d0218f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4d0218f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4d0218f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc06ccb0 con 0x7f4cfc13c350 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4cf0004450 con 0x7f4cfc13c350 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4cd7fff640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 0x7f4ccc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(527..527 src has 323..527) ==== 4795+0+0 (secure 0 0 0) 0x7f4cf0052cd0 con 0x7f4cfc13c350 2026-02-17T12:00:11.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 0x7f4ccc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:11.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.097+0000 7f4cfb7fe640 10 monclient: get_auth_request con 0x7f4ccc03dd10 auth_method 0 2026-02-17T12:00:11.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.100+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4cf001c370 con 0x7f4cfc13c350 2026-02-17T12:00:11.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.100+0000 7f4cd7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:11.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.100+0000 7f4cd7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:11.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.100+0000 7f4cfb7fe640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 0x7f4ccc0401d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80090b0 tx=0x7f4ce8039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:11.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4d0218f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4d0218f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4d0218f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4cfc0a1d60 con 0x7f4cfc13c350 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4cd7fff640 1 -- 10.20.193.51:0/2233448664 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f4cf0014420 con 0x7f4cfc13c350 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4cd7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:11.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.213+0000 7f4cd7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:11.217 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":138,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 msgr2=0x7f4ccc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 0x7f4ccc0401d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80090b0 tx=0x7f4ce8039040 comp rx=0 tx=0).stop 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 10 monclient: shutdown 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 msgr2=0x7f4cfc122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 0x7f4cfc122fb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0007d90 tx=0x7f4cf000e4b0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 shutdown_connections 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4ccc03dd10 0x7f4ccc0401d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4cfc13c350 0x7f4cfc122fb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4cfc0a0570 0x7f4cfc13b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 --2- 10.20.193.51:0/2233448664 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4cfc06c8d0 0x7f4cfc1cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 >> 10.20.193.51:0/2233448664 conn(0x7f4cfc0aab70 msgr2=0x7f4cfc13d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 shutdown_connections 2026-02-17T12:00:11.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:11.214+0000 7f4d0218f640 1 -- 10.20.193.51:0/2233448664 wait complete. 2026-02-17T12:00:11.599 INFO:tasks.rados.rados.0.trial142.stdout:2263: done (6 left) 2026-02-17T12:00:11.599 INFO:tasks.rados.rados.0.trial142.stdout:2264: done (5 left) 2026-02-17T12:00:11.599 INFO:tasks.rados.rados.0.trial142.stdout:2265: done (4 left) 2026-02-17T12:00:11.599 INFO:tasks.rados.rados.0.trial142.stdout:2266: done (3 left) 2026-02-17T12:00:11.599 INFO:tasks.rados.rados.0.trial142.stdout:2267: done (2 left) 2026-02-17T12:00:11.600 INFO:tasks.rados.rados.0.trial142.stdout:2268: done (1 left) 2026-02-17T12:00:11.600 INFO:tasks.rados.rados.0.trial142.stdout:2269: done (0 left) 2026-02-17T12:00:11.600 INFO:tasks.rados.rados.0.trial142.stdout:2270: delete oid 40 current snap is 248 2026-02-17T12:00:11.602 INFO:tasks.rados.rados.0.trial142.stdout:2270: done (0 left) 2026-02-17T12:00:11.602 INFO:tasks.rados.rados.0.trial142.stdout:2271: snap_create 2026-02-17T12:00:12.603 INFO:tasks.rados.rados.0.trial142.stdout:2271: done (0 left) 2026-02-17T12:00:12.604 INFO:tasks.rados.rados.0.trial142.stdout:2272: read oid 2 snap -1 2026-02-17T12:00:12.604 INFO:tasks.rados.rados.0.trial142.stdout:2272: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:12.604 INFO:tasks.rados.rados.0.trial142.stdout:2273: read oid 24 snap -1 2026-02-17T12:00:12.604 INFO:tasks.rados.rados.0.trial142.stdout:2273: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:12.604 INFO:tasks.rados.rados.0.trial142.stdout:2274: delete oid 16 current snap is 249 2026-02-17T12:00:12.607 INFO:tasks.rados.rados.0.trial142.stdout:2274: done (2 left) 2026-02-17T12:00:12.607 INFO:tasks.rados.rados.0.trial142.stdout:2275: write (excl) oid 5 current snap is 249 2026-02-17T12:00:12.607 INFO:tasks.rados.rados.0.trial142.stdout:2275: seq_num 783 ranges {759881=787973,2119636=654941} 2026-02-17T12:00:12.613 INFO:tasks.rados.rados.0.trial142.stdout:2275: writing trial14245205-5 from 759881 to 1547854 tid 1 2026-02-17T12:00:12.618 INFO:tasks.rados.rados.0.trial142.stdout:2275: writing trial14245205-5 from 2119636 to 2774577 tid 2 2026-02-17T12:00:12.618 INFO:tasks.rados.rados.0.trial142.stdout:2276: rollback oid 17 current snap is 249 2026-02-17T12:00:12.618 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 247 2026-02-17T12:00:12.618 INFO:tasks.rados.rados.0.trial142.stdout:2272: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:12.672 INFO:tasks.rados.rados.0.trial142.stdout:2273: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:12.773 INFO:tasks.rados.rados.0.trial142.stdout:2275: finishing write tid 1 to trial14245205-5 2026-02-17T12:00:12.774 INFO:tasks.rados.rados.0.trial142.stdout:2272: done (3 left) 2026-02-17T12:00:12.774 INFO:tasks.rados.rados.0.trial142.stdout:2273: done (2 left) 2026-02-17T12:00:12.774 INFO:tasks.rados.rados.0.trial142.stdout:2277: write (excl) oid 31 current snap is 249 2026-02-17T12:00:12.774 INFO:tasks.rados.rados.0.trial142.stdout:2277: seq_num 784 ranges {776688=579575,1894471=798599} 2026-02-17T12:00:12.779 INFO:tasks.rados.rados.0.trial142.stdout:2277: writing trial14245205-31 from 776688 to 1356263 tid 1 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:2277: writing trial14245205-31 from 1894471 to 2693070 tid 2 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:2278: write oid 34 current snap is 249 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:2276: finishing rollback tid 1 to trial14245205-17 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 0 (ObjNum 129 snap 0 seq_num 1213916904) dirty dne 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:2275: finishing write tid 2 to trial14245205-5 2026-02-17T12:00:12.785 INFO:tasks.rados.rados.0.trial142.stdout:2278: seq_num 785 ranges {793495=654824,1952953=658610,3157167=36328} 2026-02-17T12:00:12.790 INFO:tasks.rados.rados.0.trial142.stdout:2278: writing trial14245205-34 from 793495 to 1448319 tid 1 2026-02-17T12:00:12.795 INFO:tasks.rados.rados.0.trial142.stdout:2278: writing trial14245205-34 from 1952953 to 2611563 tid 2 2026-02-17T12:00:12.797 INFO:tasks.rados.rados.0.trial142.stdout:2278: writing trial14245205-34 from 3157167 to 3193495 tid 3 2026-02-17T12:00:12.798 INFO:tasks.rados.rados.0.trial142.stdout:2276: done (3 left) 2026-02-17T12:00:12.798 INFO:tasks.rados.rados.0.trial142.stdout:2279: write oid 42 current snap is 249 2026-02-17T12:00:12.798 INFO:tasks.rados.rados.0.trial142.stdout:2279: seq_num 786 ranges {410302=730073,1895082=402268,2951884=258418} 2026-02-17T12:00:12.802 INFO:tasks.rados.rados.0.trial142.stdout:2279: writing trial14245205-42 from 410302 to 1140375 tid 1 2026-02-17T12:00:12.806 INFO:tasks.rados.rados.0.trial142.stdout:2279: writing trial14245205-42 from 1895082 to 2297350 tid 2 2026-02-17T12:00:12.810 INFO:tasks.rados.rados.0.trial142.stdout:2279: writing trial14245205-42 from 2951884 to 3210302 tid 3 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2280: read oid 12 snap -1 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2280: expect (ObjNum 768 snap 245 seq_num 768) 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2281: rollback oid 25 current snap is 249 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 25 to 245 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2275: finishing write tid 3 to trial14245205-5 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2275: finishing write tid 4 to trial14245205-5 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2275: oid 5 updating version 0 to 1144 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2275: oid 5 updating version 1144 to 1145 2026-02-17T12:00:12.811 INFO:tasks.rados.rados.0.trial142.stdout:2275: oid 5 updating version 1145 to 1146 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1146 (ObjNum 783 snap 249 seq_num 783) dirty exists 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2275: left oid 5 (ObjNum 783 snap 249 seq_num 783) 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: finishing write tid 1 to trial14245205-31 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: finishing write tid 2 to trial14245205-31 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: finishing write tid 3 to trial14245205-31 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2275: done (5 left) 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2282: read oid 41 snap 247 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2282: expect deleted 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2283: write (excl) oid 3 current snap is 249 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: finishing write tid 4 to trial14245205-31 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: oid 31 updating version 0 to 1959 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: oid 31 version 1959 is already newer than 1957 2026-02-17T12:00:12.812 INFO:tasks.rados.rados.0.trial142.stdout:2277: oid 31 version 1959 is already newer than 1958 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1959 (ObjNum 784 snap 249 seq_num 784) dirty exists 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2277: left oid 31 (ObjNum 784 snap 249 seq_num 784) 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2278: finishing write tid 1 to trial14245205-34 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2278: finishing write tid 2 to trial14245205-34 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2278: finishing write tid 3 to trial14245205-34 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2283: seq_num 787 ranges {427109=405322,1553564=545926,2579307=647802} 2026-02-17T12:00:12.813 INFO:tasks.rados.rados.0.trial142.stdout:2283: writing trial14245205-3 from 427109 to 832431 tid 1 2026-02-17T12:00:12.818 INFO:tasks.rados.rados.0.trial142.stdout:2283: writing trial14245205-3 from 1553564 to 2099490 tid 2 2026-02-17T12:00:12.822 INFO:tasks.rados.rados.0.trial142.stdout:2283: writing trial14245205-3 from 2579307 to 3227109 tid 3 2026-02-17T12:00:12.822 INFO:tasks.rados.rados.0.trial142.stdout:2277: done (6 left) 2026-02-17T12:00:12.822 INFO:tasks.rados.rados.0.trial142.stdout:2284: snap_remove snap 248 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2284: done (6 left) 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2285: rollback oid 40 current snap is 249 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 245 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2278: finishing write tid 4 to trial14245205-34 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2278: finishing write tid 5 to trial14245205-34 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2278: oid 34 updating version 0 to 1909 2026-02-17T12:00:13.610 INFO:tasks.rados.rados.0.trial142.stdout:2278: oid 34 updating version 1909 to 1912 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2278: oid 34 version 1912 is already newer than 1910 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2278: oid 34 version 1912 is already newer than 1911 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1912 (ObjNum 785 snap 249 seq_num 785) dirty exists 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2278: left oid 34 (ObjNum 785 snap 249 seq_num 785) 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2279: finishing write tid 1 to trial14245205-42 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2279: finishing write tid 2 to trial14245205-42 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2278: done (6 left) 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2286: write (excl) oid 35 current snap is 249 2026-02-17T12:00:13.611 INFO:tasks.rados.rados.0.trial142.stdout:2286: seq_num 788 ranges {443916=480571,1612046=405937,2606730=495052} 2026-02-17T12:00:13.613 INFO:tasks.rados.rados.0.trial142.stdout:2286: writing trial14245205-35 from 443916 to 924487 tid 1 2026-02-17T12:00:13.617 INFO:tasks.rados.rados.0.trial142.stdout:2286: writing trial14245205-35 from 1612046 to 2017983 tid 2 2026-02-17T12:00:13.621 INFO:tasks.rados.rados.0.trial142.stdout:2286: writing trial14245205-35 from 2606730 to 3101782 tid 3 2026-02-17T12:00:13.621 INFO:tasks.rados.rados.0.trial142.stdout:2287: write oid 5 current snap is 249 2026-02-17T12:00:13.621 INFO:tasks.rados.rados.0.trial142.stdout:2287: seq_num 789 ranges {460723=555820,1670528=549595,2634153=626570} 2026-02-17T12:00:13.624 INFO:tasks.rados.rados.0.trial142.stdout:2287: writing trial14245205-5 from 460723 to 1016543 tid 1 2026-02-17T12:00:13.629 INFO:tasks.rados.rados.0.trial142.stdout:2287: writing trial14245205-5 from 1670528 to 2220123 tid 2 2026-02-17T12:00:13.634 INFO:tasks.rados.rados.0.trial142.stdout:2287: writing trial14245205-5 from 2634153 to 3260723 tid 3 2026-02-17T12:00:13.634 INFO:tasks.rados.rados.0.trial142.stdout:2288: write oid 19 current snap is 249 2026-02-17T12:00:13.634 INFO:tasks.rados.rados.0.trial142.stdout:2288: seq_num 790 ranges {477530=631069,1612657=409606,2545223=517596} 2026-02-17T12:00:13.637 INFO:tasks.rados.rados.0.trial142.stdout:2288: writing trial14245205-19 from 477530 to 1108599 tid 1 2026-02-17T12:00:13.641 INFO:tasks.rados.rados.0.trial142.stdout:2288: writing trial14245205-19 from 1612657 to 2022263 tid 2 2026-02-17T12:00:13.645 INFO:tasks.rados.rados.0.trial142.stdout:2288: writing trial14245205-19 from 2545223 to 3062819 tid 3 2026-02-17T12:00:13.645 INFO:tasks.rados.rados.0.trial142.stdout:2289: delete oid 18 current snap is 249 2026-02-17T12:00:13.645 INFO:tasks.rados.rados.0.trial142.stdout:2279: finishing write tid 3 to trial14245205-42 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2281: finishing rollback tid 0 to trial14245205-25 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: finishing write tid 4 to trial14245205-42 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: finishing write tid 5 to trial14245205-42 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: oid 42 updating version 0 to 1097 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: oid 42 updating version 1097 to 1100 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: oid 42 version 1100 is already newer than 1098 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: oid 42 version 1100 is already newer than 1099 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1100 (ObjNum 786 snap 249 seq_num 786) dirty exists 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2279: left oid 42 (ObjNum 786 snap 249 seq_num 786) 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2281: finishing rollback tid 1 to trial14245205-25 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:2281: finishing rollback tid 2 to trial14245205-25 2026-02-17T12:00:13.646 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 1616 (ObjNum 695 snap 216 seq_num 695) dirty exists 2026-02-17T12:00:13.647 INFO:tasks.rados.rados.0.trial142.stdout:2280: expect (ObjNum 768 snap 245 seq_num 768) 2026-02-17T12:00:13.798 INFO:tasks.rados.rados.0.trial142.stdout:2283: finishing write tid 1 to trial14245205-3 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: finishing write tid 2 to trial14245205-3 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: finishing write tid 3 to trial14245205-3 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: finishing write tid 4 to trial14245205-3 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: finishing write tid 5 to trial14245205-3 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: oid 3 updating version 0 to 1041 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: oid 3 updating version 1041 to 1042 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: oid 3 version 1042 is already newer than 1039 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: oid 3 version 1042 is already newer than 1040 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1042 (ObjNum 787 snap 249 seq_num 787) dirty exists 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2283: left oid 3 (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2285: finishing rollback tid 1 to trial14245205-40 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2279: done (9 left) 2026-02-17T12:00:13.799 INFO:tasks.rados.rados.0.trial142.stdout:2280: done (8 left) 2026-02-17T12:00:13.800 INFO:tasks.rados.rados.0.trial142.stdout:2281: done (7 left) 2026-02-17T12:00:13.800 INFO:tasks.rados.rados.0.trial142.stdout:2282: done (6 left) 2026-02-17T12:00:13.800 INFO:tasks.rados.rados.0.trial142.stdout:2283: done (5 left) 2026-02-17T12:00:13.800 INFO:tasks.rados.rados.0.trial142.stdout:2289: done (4 left) 2026-02-17T12:00:13.800 INFO:tasks.rados.rados.0.trial142.stdout:2290: snap_remove snap 246 2026-02-17T12:00:14.224 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: get_monmap_and_config 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: build_initial_monmap 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: monmap: 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:14.291199+0000 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:14.291199+0000 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:14.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 Processor -- start 2026-02-17T12:00:14.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 -- start start 2026-02-17T12:00:14.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: init 2026-02-17T12:00:14.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:14.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cf80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7cf80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7cf813b760 0x7f7cf813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cf813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf806e140 con 0x7f7cf80a0750 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf809f910 con 0x7f7cf813b760 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf809ccd0 con 0x7f7cf80a3bb0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.290+0000 7f7d006bf640 10 monclient(hunting): authenticate will time out at 1501.909961s 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7cf813b760 0x7f7cf813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfdc33640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7cf80a0750 0x7f7cf809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:47258/0 (socket says 10.20.193.51:47258) 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7cf813b760 0x7f7cf813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49122/0 (socket says 10.20.193.51:49122) 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfdc33640 1 -- 10.20.193.51:0/224174180 learned_addr learned my addr 10.20.193.51:0/224174180 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): get_auth_request con 0x7f7cf813b760 auth_method 0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfe434640 1 --2- 10.20.193.51:0/224174180 >> v2:10.20.193.142:3300/0 conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfe434640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfe434640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfe434640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfe434640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient(hunting): handle_auth_done global_id 164421 payload 274 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 -- 10.20.193.51:0/224174180 >> v2:10.20.193.142:3300/0 conn(0x7f7cf80a3bb0 msgr2=0x7f7cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 --2- 10.20.193.51:0/224174180 >> v2:10.20.193.142:3300/0 conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 -- 10.20.193.51:0/224174180 >> v1:10.20.193.51:6789/0 conn(0x7f7cf80a0750 legacy=0x7f7cf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient: _finish_hunting 0 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 monclient: found mon.noname-a 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.291+0000 7f7cfec35640 1 -- 10.20.193.51:0/224174180 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf809eec0 con 0x7f7cf813b760 2026-02-17T12:00:14.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfec35640 1 -- 10.20.193.51:0/224174180 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf813b760 msgr2=0x7f7cf813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfec35640 1 --2- 10.20.193.51:0/224174180 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf813b760 0x7f7cf813db50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7cf806c1c0 tx=0x7f7cf402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742e80b6615057ac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 1 -- 10.20.193.51:0/224174180 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf403c070 con 0x7f7cf813b760 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: dump: 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: _finish_auth 0 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: _check_auth_tickets 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 1 -- 10.20.193.51:0/224174180 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf4037440 con 0x7f7cf813b760 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7d006bf640 5 monclient: authenticate success, global_id 164421 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 1 -- 10.20.193.51:0/224174180 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4037810 con 0x7f7cf813b760 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7d006bf640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7d006bf640 4 set_mon_vals no callback set 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:14.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.293+0000 7f7cfd432640 10 monclient: dump: 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 10 monclient: shutdown 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- 10.20.193.51:0/224174180 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf813b760 msgr2=0x7f7cf813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 --2- 10.20.193.51:0/224174180 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf813b760 0x7f7cf813db50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7cf806c1c0 tx=0x7f7cf402f130 comp rx=0 tx=0).stop 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- 10.20.193.51:0/224174180 shutdown_connections 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 --2- 10.20.193.51:0/224174180 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf813b760 0x7f7cf813db50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 --2- 10.20.193.51:0/224174180 >> v2:10.20.193.142:3300/0 conn(0x7f7cf80a3bb0 0x7f7cf809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- 10.20.193.51:0/224174180 >> 10.20.193.51:0/224174180 conn(0x7f7cf80a30c0 msgr2=0x7f7cf80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- 10.20.193.51:0/224174180 shutdown_connections 2026-02-17T12:00:14.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- 10.20.193.51:0/224174180 wait complete. 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 10 monclient: build_initial_monmap 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 10 monclient: monmap: 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:14.298 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 Processor -- start 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 1 -- start start 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.294+0000 7f7d006bf640 10 monclient: init 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cf80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cf80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cf813b760 0x7f7cf80968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): picked mon.noname-b con 0x7f7cf813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80a04b0 con 0x7f7cf80a0750 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf809c850 con 0x7f7cf813b760 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf809e710 con 0x7f7cf80a3bb0 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7d006bf640 10 monclient(hunting): authenticate will time out at 1501.914158s 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49126/0 (socket says 10.20.193.51:49126) 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 -- 10.20.193.51:0/2041514247 learned_addr learned my addr 10.20.193.51:0/2041514247 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:14.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): get_auth_request con 0x7f7cf80a0750 auth_method 0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 10 monclient(hunting): get_auth_request con 0x7f7cf80a3bb0 auth_method 0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf8096390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf8096390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfec35640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cf813b760 0x7f7cf80968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfdc33640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfec35640 10 monclient(hunting): get_auth_request con 0x7f7cf813b760 auth_method 0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfec35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfec35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfec35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient(hunting): handle_auth_done global_id 164424 payload 824 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 msgr2=0x7f7cf8096390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cf813b760 msgr2=0x7f7cf80968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cf813b760 0x7f7cf80968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient: _finish_hunting 0 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 monclient: found mon.noname-a 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:14.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.295+0000 7f7cfe434640 1 -- 10.20.193.51:0/2041514247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf80a24e0 con 0x7f7cf80a0750 2026-02-17T12:00:14.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cfe434640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 msgr2=0x7f7cf8095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cfe434640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e7c0 tx=0x7f7ce800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cf80a0750 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: dump: 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce800cae0 con 0x7f7cf80a0750 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800f040 con 0x7f7cf80a0750 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 5 monclient: authenticate success, global_id 164424 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 10 monclient: _renew_subs 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cfcc31640 4 set_mon_vals no callback set 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf8099ab0 con 0x7f7cf80a0750 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:14.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7cdeffd640 10 monclient: dump: 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 10 monclient: _renew_subs 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.297+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf80997d0 con 0x7f7cf80a0750 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7d006bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7d006bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7d006bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf809dac0 con 0x7f7cf80a0750 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7ce8012050 con 0x7f7cf80a0750 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7cdeffd640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 0x7f7cc8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(530..530 src has 323..530) ==== 4779+0+0 (secure 0 0 0) 0x7f7ce8052400 con 0x7f7cf80a0750 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7cfdc33640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 0x7f7cc8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.298+0000 7f7cfdc33640 10 monclient: get_auth_request con 0x7f7cc803dd60 auth_method 0 2026-02-17T12:00:14.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.300+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7cf80a24e0 con 0x7f7cf80a0750 2026-02-17T12:00:14.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.300+0000 7f7cdeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.300+0000 7f7cdeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:14.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.301+0000 7f7cfdc33640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 0x7f7cc8040220 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007fd0 tx=0x7f7cec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7d006bf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:14.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7d006bf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:14.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7d006bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:14.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7cf8097f00 con 0x7f7cf80a0750 2026-02-17T12:00:14.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7cdeffd640 1 -- 10.20.193.51:0/2041514247 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f7ce8023d80 con 0x7f7cf80a0750 2026-02-17T12:00:14.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7cdeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:14.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.414+0000 7f7cdeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:14.417 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":138,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:14.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 msgr2=0x7f7cc8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 0x7f7cc8040220 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007fd0 tx=0x7f7cec009040 comp rx=0 tx=0).stop 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 10 monclient: shutdown 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 msgr2=0x7f7cf8095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e7c0 tx=0x7f7ce800ec90 comp rx=0 tx=0).stop 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 shutdown_connections 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7cc803dd60 0x7f7cc8040220 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7cf813b760 0x7f7cf80968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7cf80a3bb0 0x7f7cf8096390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 --2- 10.20.193.51:0/2041514247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7cf80a0750 0x7f7cf8095e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 >> 10.20.193.51:0/2041514247 conn(0x7f7cf80a30c0 msgr2=0x7f7cf813ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:14.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 shutdown_connections 2026-02-17T12:00:14.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:14.415+0000 7f7d006bf640 1 -- 10.20.193.51:0/2041514247 wait complete. 2026-02-17T12:00:14.613 INFO:tasks.rados.rados.0.trial142.stdout:2290: done (4 left) 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2291: delete oid 10 current snap is 249 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2285: finishing rollback tid 2 to trial14245205-40 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1945 (ObjNum 761 snap 241 seq_num 761) dirty exists 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: finishing write tid 1 to trial14245205-35 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: finishing write tid 2 to trial14245205-35 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: finishing write tid 3 to trial14245205-35 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: finishing write tid 4 to trial14245205-35 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: finishing write tid 5 to trial14245205-35 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: oid 35 updating version 0 to 1961 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: oid 35 updating version 1961 to 1962 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: oid 35 version 1962 is already newer than 1960 2026-02-17T12:00:14.614 INFO:tasks.rados.rados.0.trial142.stdout:2286: oid 35 updating version 1962 to 1963 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1963 (ObjNum 788 snap 249 seq_num 788) dirty exists 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2286: left oid 35 (ObjNum 788 snap 249 seq_num 788) 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: finishing write tid 1 to trial14245205-5 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: finishing write tid 2 to trial14245205-5 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: finishing write tid 3 to trial14245205-5 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: finishing write tid 4 to trial14245205-5 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: finishing write tid 5 to trial14245205-5 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: oid 5 updating version 0 to 1148 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: oid 5 updating version 1148 to 1150 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: oid 5 version 1150 is already newer than 1147 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: oid 5 version 1150 is already newer than 1149 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1150 (ObjNum 789 snap 249 seq_num 789) dirty exists 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2287: left oid 5 (ObjNum 789 snap 249 seq_num 789) 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2288: finishing write tid 1 to trial14245205-19 2026-02-17T12:00:14.615 INFO:tasks.rados.rados.0.trial142.stdout:2288: finishing write tid 2 to trial14245205-19 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: finishing write tid 3 to trial14245205-19 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: finishing write tid 4 to trial14245205-19 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: finishing write tid 5 to trial14245205-19 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: oid 19 updating version 0 to 1614 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: oid 19 version 1614 is already newer than 1613 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: oid 19 updating version 1614 to 1615 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: oid 19 version 1615 is already newer than 1612 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 1615 (ObjNum 790 snap 249 seq_num 790) dirty exists 2026-02-17T12:00:14.616 INFO:tasks.rados.rados.0.trial142.stdout:2288: left oid 19 (ObjNum 790 snap 249 seq_num 790) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2285: done (4 left) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2286: done (3 left) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2287: done (2 left) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2288: done (1 left) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2291: done (0 left) 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2292: delete oid 34 current snap is 249 2026-02-17T12:00:14.617 INFO:tasks.rados.rados.0.trial142.stdout:2292: done (0 left) 2026-02-17T12:00:14.618 INFO:tasks.rados.rados.0.trial142.stdout:2293: write oid 20 current snap is 249 2026-02-17T12:00:14.618 INFO:tasks.rados.rados.0.trial142.stdout:2293: seq_num 794 ranges {544758=648418,1846585=416944,2771268=573490} 2026-02-17T12:00:14.622 INFO:tasks.rados.rados.0.trial142.stdout:2293: writing trial14245205-20 from 544758 to 1193176 tid 1 2026-02-17T12:00:14.626 INFO:tasks.rados.rados.0.trial142.stdout:2293: writing trial14245205-20 from 1846585 to 2263529 tid 2 2026-02-17T12:00:14.630 INFO:tasks.rados.rados.0.trial142.stdout:2293: writing trial14245205-20 from 2771268 to 3344758 tid 3 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2294: copy_from oid 23 from oid 8 current snap is 249 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2293: finishing write tid 1 to trial14245205-20 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2293: finishing write tid 2 to trial14245205-20 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2295: read oid 2 snap -1 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2295: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:14.631 INFO:tasks.rados.rados.0.trial142.stdout:2296: delete oid 17 current snap is 249 2026-02-17T12:00:14.632 INFO:tasks.rados.rados.0.trial142.stdout:2296: done (3 left) 2026-02-17T12:00:14.632 INFO:tasks.rados.rados.0.trial142.stdout:2297: write oid 7 current snap is 249 2026-02-17T12:00:14.632 INFO:tasks.rados.rados.0.trial142.stdout:2297: seq_num 796 ranges {578372=798916,1963549=420613,2826114=417934} 2026-02-17T12:00:14.637 INFO:tasks.rados.rados.0.trial142.stdout:2297: writing trial14245205-7 from 578372 to 1377288 tid 1 2026-02-17T12:00:14.641 INFO:tasks.rados.rados.0.trial142.stdout:2297: writing trial14245205-7 from 1963549 to 2384162 tid 2 2026-02-17T12:00:14.644 INFO:tasks.rados.rados.0.trial142.stdout:2297: writing trial14245205-7 from 2826114 to 3244048 tid 3 2026-02-17T12:00:14.644 INFO:tasks.rados.rados.0.trial142.stdout:2298: delete oid 33 current snap is 249 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: finishing write tid 3 to trial14245205-20 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: finishing write tid 4 to trial14245205-20 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: finishing write tid 5 to trial14245205-20 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: oid 20 updating version 0 to 1101 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: oid 20 updating version 1101 to 1103 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: oid 20 updating version 1103 to 1104 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: oid 20 version 1104 is already newer than 1102 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1104 (ObjNum 794 snap 249 seq_num 794) dirty exists 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2293: left oid 20 (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:00:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2295: expect (ObjNum 733 snap 232 seq_num 733) 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2294: finishing copy_from racing read to trial14245205-23 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2294: finishing copy_from to trial14245205-23 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1952 (ObjNum 774 snap 246 seq_num 774) dirty exists 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2297: finishing write tid 1 to trial14245205-7 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2297: finishing write tid 2 to trial14245205-7 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2297: finishing write tid 3 to trial14245205-7 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2293: done (4 left) 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2294: done (3 left) 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2295: done (2 left) 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2298: done (1 left) 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:2299: rollback oid 48 current snap is 249 2026-02-17T12:00:14.698 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 247 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: finishing write tid 4 to trial14245205-7 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: finishing write tid 5 to trial14245205-7 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: oid 7 updating version 0 to 2090 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: oid 7 updating version 2090 to 2091 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: oid 7 version 2091 is already newer than 2087 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: oid 7 updating version 2091 to 2092 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2092 (ObjNum 796 snap 249 seq_num 796) dirty exists 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: left oid 7 (ObjNum 796 snap 249 seq_num 796) 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2297: done (1 left) 2026-02-17T12:00:14.699 INFO:tasks.rados.rados.0.trial142.stdout:2300: snap_create 2026-02-17T12:00:14.700 INFO:tasks.rados.rados.0.trial142.stdout:2299: finishing rollback tid 0 to trial14245205-48 2026-02-17T12:00:14.700 INFO:tasks.rados.rados.0.trial142.stdout:2299: finishing rollback tid 1 to trial14245205-48 2026-02-17T12:00:14.700 INFO:tasks.rados.rados.0.trial142.stdout:2299: finishing rollback tid 2 to trial14245205-48 2026-02-17T12:00:14.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1615 (ObjNum 704 snap 220 seq_num 704) dirty exists 2026-02-17T12:00:15.586 INFO:tasks.rados.rados.0.trial142.stdout:2299: done (1 left) 2026-02-17T12:00:15.586 INFO:tasks.rados.rados.0.trial142.stdout:2300: done (0 left) 2026-02-17T12:00:15.586 INFO:tasks.rados.rados.0.trial142.stdout:2301: snap_remove snap 247 2026-02-17T12:00:16.589 INFO:tasks.rados.rados.0.trial142.stdout:2301: done (0 left) 2026-02-17T12:00:16.589 INFO:tasks.rados.rados.0.trial142.stdout:2302: rollback oid 8 current snap is 250 2026-02-17T12:00:16.589 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 249 2026-02-17T12:00:16.589 INFO:tasks.rados.rados.0.trial142.stdout:2303: write oid 25 current snap is 250 2026-02-17T12:00:16.590 INFO:tasks.rados.rados.0.trial142.stdout:2303: seq_num 798 ranges {611986=549414,1564160=424282,2764607=440478} 2026-02-17T12:00:16.593 INFO:tasks.rados.rados.0.trial142.stdout:2303: writing trial14245205-25 from 611986 to 1161400 tid 1 2026-02-17T12:00:16.597 INFO:tasks.rados.rados.0.trial142.stdout:2303: writing trial14245205-25 from 1564160 to 1988442 tid 2 2026-02-17T12:00:16.602 INFO:tasks.rados.rados.0.trial142.stdout:2303: writing trial14245205-25 from 2764607 to 3205085 tid 3 2026-02-17T12:00:16.602 INFO:tasks.rados.rados.0.trial142.stdout:2304: rollback oid 47 current snap is 250 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 249 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2302: finishing rollback tid 0 to trial14245205-8 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2302: finishing rollback tid 1 to trial14245205-8 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2302: finishing rollback tid 2 to trial14245205-8 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1967 (ObjNum 774 snap 246 seq_num 774) dirty exists 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2303: finishing write tid 1 to trial14245205-25 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2303: finishing write tid 2 to trial14245205-25 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2302: done (2 left) 2026-02-17T12:00:16.603 INFO:tasks.rados.rados.0.trial142.stdout:2305: delete oid 21 current snap is 250 2026-02-17T12:00:16.604 INFO:tasks.rados.rados.0.trial142.stdout:2305: done (2 left) 2026-02-17T12:00:16.604 INFO:tasks.rados.rados.0.trial142.stdout:2306: snap_create 2026-02-17T12:00:16.604 INFO:tasks.rados.rados.0.trial142.stdout:2304: finishing rollback tid 0 to trial14245205-47 2026-02-17T12:00:16.606 INFO:tasks.rados.rados.0.trial142.stdout:2303: finishing write tid 3 to trial14245205-25 2026-02-17T12:00:16.606 INFO:tasks.rados.rados.0.trial142.stdout:2304: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:00:16.606 INFO:tasks.rados.rados.0.trial142.stdout:2303: finishing write tid 4 to trial14245205-25 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2304: finishing rollback tid 2 to trial14245205-47 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 1955 (ObjNum 764 snap 244 seq_num 764) dirty exists 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2303: finishing write tid 5 to trial14245205-25 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2303: oid 25 updating version 0 to 1617 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2303: oid 25 updating version 1617 to 1618 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2303: oid 25 updating version 1618 to 1620 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:2303: oid 25 version 1620 is already newer than 1619 2026-02-17T12:00:16.607 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 1620 (ObjNum 798 snap 250 seq_num 798) dirty exists 2026-02-17T12:00:16.608 INFO:tasks.rados.rados.0.trial142.stdout:2303: left oid 25 (ObjNum 798 snap 250 seq_num 798) 2026-02-17T12:00:17.425 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.492+0000 7fbd19dde640 10 monclient: get_monmap_and_config 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.492+0000 7fbd19dde640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.492+0000 7fbd19dde640 10 monclient: monmap: 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:17.493576+0000 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:17.493576+0000 2026-02-17T12:00:17.497 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 Processor -- start 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 -- start start 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient: init 2026-02-17T12:00:17.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-b con 0x7fbd140a01f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbd140a05d0 0x7fbd140a1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-a con 0x7fbd140a05d0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd140a09d0 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd140a2cd0 con 0x7fbd140a09d0 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fbd140a2920 con 0x7fbd140a05d0 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1409ecc0 con 0x7fbd140a01f0 2026-02-17T12:00:17.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd19dde640 10 monclient(hunting): authenticate will time out at 1505.112399s 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38924/0 (socket says 10.20.193.51:38924) 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 -- 10.20.193.51:0/1635393069 learned_addr learned my addr 10.20.193.51:0/1635393069 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 10 monclient(hunting): get_auth_request con 0x7fbd140a01f0 auth_method 0 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/1635393069 >> v2:10.20.193.51:3300/0 conn(0x7fbd140a05d0 0x7fbd140a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): get_auth_request con 0x7fbd140a05d0 auth_method 0 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 -- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 msgr2=0x7fbd141383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 -- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 msgr2=0x7fbd141383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd137fe640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient(hunting): handle_auth_done global_id 164427 payload 274 2026-02-17T12:00:17.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 -- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 msgr2=0x7fbd141383c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 -- 10.20.193.51:0/1635393069 >> v1:10.20.193.51:6789/0 conn(0x7fbd140a09d0 legacy=0x7fbd140a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.493+0000 7fbd12ffd640 1 -- 10.20.193.51:0/1635393069 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1409e420 con 0x7fbd140a05d0 2026-02-17T12:00:17.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd12ffd640 1 -- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a05d0 msgr2=0x7fbd140a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a05d0 0x7fbd140a1400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd040098a0 tx=0x7fbd0402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4d53d06040a9b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 1 -- 10.20.193.51:0/1635393069 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0403c070 con 0x7fbd140a05d0 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: dump: 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.510 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 1 -- 10.20.193.51:0/1635393069 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0402fc90 con 0x7fbd140a05d0 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 1 -- 10.20.193.51:0/1635393069 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04037660 con 0x7fbd140a05d0 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd127fc640 10 monclient: dump: 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 5 monclient: authenticate success, global_id 164427 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 4 set_mon_vals no callback set 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 10 monclient: shutdown 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 -- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a05d0 msgr2=0x7fbd140a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a05d0 0x7fbd140a1400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd040098a0 tx=0x7fbd0402ee10 comp rx=0 tx=0).stop 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 -- 10.20.193.51:0/1635393069 shutdown_connections 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a05d0 0x7fbd140a1400 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 --2- 10.20.193.51:0/1635393069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a01f0 0x7fbd141383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 -- 10.20.193.51:0/1635393069 >> 10.20.193.51:0/1635393069 conn(0x7fbd140a6be0 msgr2=0x7fbd140a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 -- 10.20.193.51:0/1635393069 shutdown_connections 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.496+0000 7fbd19dde640 1 -- 10.20.193.51:0/1635393069 wait complete. 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient: monmap: 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.514 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 Processor -- start 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 -- start start 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient: init 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-a con 0x7fbd140a01f0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-c con 0x7fbd140a05d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 0x7fbd141cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): picked mon.noname-b con 0x7fbd140a09d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbd14074990 con 0x7fbd140a01f0 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbd14074810 con 0x7fbd140a09d0 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbd140a2050 con 0x7fbd140a05d0 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd19dde640 10 monclient(hunting): authenticate will time out at 1505.116562s 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48684/0 (socket says 10.20.193.51:48684) 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 -- 10.20.193.51:0/609106419 learned_addr learned my addr 10.20.193.51:0/609106419 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): get_auth_request con 0x7fbd140a01f0 auth_method 0 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 10 monclient(hunting): get_auth_request con 0x7fbd140a05d0 auth_method 0 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 msgr2=0x7fbd1413da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 msgr2=0x7fbd1413da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd13fff640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 0x7fbd141cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient(hunting): handle_auth_done global_id 164430 payload 824 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 msgr2=0x7fbd1413da80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 msgr2=0x7fbd141cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 0x7fbd141cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd137fe640 1 -- 10.20.193.51:0/609106419 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd140a4c50 con 0x7fbd140a01f0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd13fff640 10 monclient: get_auth_request con 0x7fbd140a09d0 auth_method 0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.497+0000 7fbd13fff640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 0x7fbd141cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.499+0000 7fbd137fe640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 msgr2=0x7fbd1413d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.499+0000 7fbd137fe640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000d800 tx=0x7fbd0000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00018030 con 0x7fbd140a01f0 2026-02-17T12:00:17.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: dump: 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.520 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0000ba80 con 0x7fbd140a01f0 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000bc70 con 0x7fbd140a01f0 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 5 monclient: authenticate success, global_id 164430 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _renew_subs 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd11ffb640 4 set_mon_vals no callback set 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1413ec50 con 0x7fbd140a01f0 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 10 monclient: dump: 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.522 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _renew_subs 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1412c7b0 con 0x7fbd140a01f0 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd141383c0 con 0x7fbd140a01f0 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbd00013050 con 0x7fbd140a01f0 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.500+0000 7fbceffff640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 0x7fbce4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.501+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(533..533 src has 323..533) ==== 4779+0+0 (secure 0 0 0) 0x7fbd00052640 con 0x7fbd140a01f0 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.501+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 0x7fbce4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.501+0000 7fbd12ffd640 10 monclient: get_auth_request con 0x7fbce403dd40 auth_method 0 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.503+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbd00022070 con 0x7fbd140a01f0 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.503+0000 7fbceffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.503+0000 7fbceffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:17.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.504+0000 7fbd12ffd640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 0x7fbce4040200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd14138f80 tx=0x7fbd04033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbd19dde640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbd19dde640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbd19dde640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd1412c590 con 0x7fbd140a01f0 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbceffff640 1 -- 10.20.193.51:0/609106419 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fbd140a4c50 con 0x7fbd140a01f0 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbceffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:17.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.622+0000 7fbceffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 msgr2=0x7fbce4040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 0x7fbce4040200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd14138f80 tx=0x7fbd04033000 comp rx=0 tx=0).stop 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 10 monclient: shutdown 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 msgr2=0x7fbd1413d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000d800 tx=0x7fbd0000dcd0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 shutdown_connections 2026-02-17T12:00:17.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbce403dd40 0x7fbce4040200 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbd140a09d0 0x7fbd141cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbd140a05d0 0x7fbd1413da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 --2- 10.20.193.51:0/609106419 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbd140a01f0 0x7fbd1413d540 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 >> 10.20.193.51:0/609106419 conn(0x7fbd140a6be0 msgr2=0x7fbd1409c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 shutdown_connections 2026-02-17T12:00:17.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.623+0000 7fbd19dde640 1 -- 10.20.193.51:0/609106419 wait complete. 2026-02-17T12:00:17.633 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:00:17.633 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:00:17.634 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:00:17.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: get_monmap_and_config 2026-02-17T12:00:17.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: monmap: 2026-02-17T12:00:17.705 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.705 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:17.701252+0000 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:17.701252+0000 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:17.706 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 1 Processor -- start 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 1 -- start start 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: init 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.700+0000 7f6b47a87640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6b400a3bb0 0x7f6b4009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-c con 0x7f6b400a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-b con 0x7f6b400a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6b4009e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:17.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4006e140 con 0x7f6b4009e540 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400a3f90 con 0x7f6b400a3bb0 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4009f910 con 0x7f6b400a0750 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b47a87640 10 monclient(hunting): authenticate will time out at 1505.320038s 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b45ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f6b4009e540 0x7f6b4013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39298/0 (socket says 10.20.193.51:39298) 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b45ffd640 1 -- 10.20.193.51:0/1292804622 learned_addr learned my addr 10.20.193.51:0/1292804622 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 10 monclient(hunting): get_auth_request con 0x7f6b400a0750 auth_method 0 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 --2- 10.20.193.51:0/1292804622 >> v2:10.20.193.142:3300/0 conn(0x7f6b400a3bb0 0x7f6b4009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 1 -- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 msgr2=0x7f6b4009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 1 -- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 msgr2=0x7f6b4009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): get_auth_request con 0x7f6b400a3bb0 auth_method 0 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b44ffb640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient(hunting): handle_auth_done global_id 184168 payload 274 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 -- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 msgr2=0x7f6b4009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 -- 10.20.193.51:0/1292804622 >> v1:10.20.193.51:6789/0 conn(0x7f6b4009e540 legacy=0x7f6b4013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 monclient: found mon.noname-c 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:00:17.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.701+0000 7f6b457fc640 1 -- 10.20.193.51:0/1292804622 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4009ccd0 con 0x7f6b400a3bb0 2026-02-17T12:00:17.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b457fc640 1 -- 10.20.193.51:0/1292804622 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a3bb0 msgr2=0x7f6b4009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b457fc640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a3bb0 0x7f6b4009dac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006c1c0 tx=0x7f6b3002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a0ef98232262a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 1 -- 10.20.193.51:0/1292804622 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3003c070 con 0x7f6b400a3bb0 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: dump: 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 5 monclient: authenticate success, global_id 184168 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 1 -- 10.20.193.51:0/1292804622 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3002fbd0 con 0x7f6b400a3bb0 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 1 -- 10.20.193.51:0/1292804622 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30037440 con 0x7f6b400a3bb0 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 4 set_mon_vals no callback set 2026-02-17T12:00:17.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b2ffff640 10 monclient: dump: 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.724 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 10 monclient: shutdown 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 -- 10.20.193.51:0/1292804622 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a3bb0 msgr2=0x7f6b4009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a3bb0 0x7f6b4009dac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006c1c0 tx=0x7f6b3002ed50 comp rx=0 tx=0).stop 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 -- 10.20.193.51:0/1292804622 shutdown_connections 2026-02-17T12:00:17.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b400a0750 0x7f6b4009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 --2- 10.20.193.51:0/1292804622 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a3bb0 0x7f6b4009dac0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 -- 10.20.193.51:0/1292804622 >> 10.20.193.51:0/1292804622 conn(0x7f6b400a30c0 msgr2=0x7f6b400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 -- 10.20.193.51:0/1292804622 shutdown_connections 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.704+0000 7f6b47a87640 1 -- 10.20.193.51:0/1292804622 wait complete. 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient: monmap: 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.726 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 Processor -- start 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 -- start start 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient: init 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-c con 0x7f6b4009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a0750 0x7f6b40137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-b con 0x7f6b400a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 0x7f6b40137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): picked mon.noname-a con 0x7f6b400a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400a04b0 con 0x7f6b400a3bb0 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4009c850 con 0x7f6b400a0750 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4013de80 con 0x7f6b4009e540 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b47a87640 10 monclient(hunting): authenticate will time out at 1505.324611s 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38946/0 (socket says 10.20.193.51:38946) 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 learned_addr learned my addr 10.20.193.51:0/2927156868 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 10 monclient(hunting): get_auth_request con 0x7f6b4009e540 auth_method 0 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 0x7f6b40137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): get_auth_request con 0x7f6b400a3bb0 auth_method 0 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 msgr2=0x7f6b401cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:00:17.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 msgr2=0x7f6b401cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b44ffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a0750 0x7f6b40137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b44ffb640 10 monclient(hunting): get_auth_request con 0x7f6b400a0750 auth_method 0 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b44ffb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b44ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b44ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient(hunting): handle_auth_done global_id 164433 payload 824 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 msgr2=0x7f6b401cefe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6b4009e540 0x7f6b401cefe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a0750 msgr2=0x7f6b40137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6b400a0750 0x7f6b40137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.705+0000 7f6b45ffd640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b400a2660 con 0x7f6b400a3bb0 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b45ffd640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 msgr2=0x7f6b40137ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b45ffd640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 0x7f6b40137ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00caf0 tx=0x7f6b3c005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00ad50 con 0x7f6b400a3bb0 2026-02-17T12:00:17.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: dump: 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c012400 con 0x7f6b400a3bb0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0127f0 con 0x7f6b400a3bb0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 5 monclient: authenticate success, global_id 164433 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 monclient: _renew_subs 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2f7fe640 4 set_mon_vals no callback set 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b40130290 con 0x7f6b400a3bb0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b2dffb640 10 monclient: dump: 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.734 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 monclient: _renew_subs 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40132540 con 0x7f6b400a3bb0 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 0x7f6b4012e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4009dac0 con 0x7f6b40131ca0 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 0x7f6b4012e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient: get_auth_request con 0x7f6b40131ca0 auth_method 0 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.708+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b457fc640 10 monclient(hunting): handle_auth_done global_id 164436 payload 824 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6b3c0129d0 con 0x7f6b400a3bb0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b40138720 con 0x7f6b40131ca0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b2dffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b1003dd10 0x7f6b100401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(533..533 src has 323..533) ==== 4779+0+0 (secure 0 0 0) 0x7f6b3c052b80 con 0x7f6b400a3bb0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b44ffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b1003dd10 0x7f6b100401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.709+0000 7f6b44ffb640 10 monclient: get_auth_request con 0x7f6b1003dd10 auth_method 0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 msgr2=0x7f6b4012e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 0x7f6b4012e740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b3002ed90 tx=0x7f6b300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30048070 con 0x7f6b40131ca0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 10 monclient: dump: 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6b30037d80 con 0x7f6b40131ca0 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 msgr2=0x7f6b4012e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 0x7f6b4012e740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b3002ed90 tx=0x7f6b300047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 msgr2=0x7f6b4012e740 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.711+0000 7f6b2dffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b40131ca0 0x7f6b4012e740 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b3002ed90 tx=0x7f6b300047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.712+0000 7f6b44ffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b1003dd10 0x7f6b100401d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6b4012ff10 tx=0x7f6b34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b47a87640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b47a87640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 0x7f6b401da350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b47a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400008d0 con 0x7f6b4012ec80 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 0x7f6b401da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient: get_auth_request con 0x7f6b4012ec80 auth_method 0 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 10 monclient(hunting): handle_auth_done global_id 164439 payload 824 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.714+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6b40050ac0 con 0x7f6b4012ec80 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b457fc640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 msgr2=0x7f6b401da350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b457fc640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 0x7f6b401da350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b30047000 tx=0x7f6b30008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3003c040 con 0x7f6b4012ec80 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.716+0000 7f6b2dffb640 10 monclient: dump: 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.739 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f6b30003dc0 con 0x7f6b4012ec80 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 msgr2=0x7f6b401da350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 0x7f6b401da350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b30047000 tx=0x7f6b30008030 comp rx=0 tx=0).stop 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 msgr2=0x7f6b401da350 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:17.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b2dffb640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b4012ec80 0x7f6b401da350 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b30047000 tx=0x7f6b30008030 comp rx=0 tx=0).stop 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 162155, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:17.741 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:17.742 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.743 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:17.744 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.745 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.746 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.747 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.748 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:17.749 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:17.750 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:17.751 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:17.751 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:17.751 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b1003dd10 msgr2=0x7f6b100401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6b1003dd10 0x7f6b100401d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6b4012ff10 tx=0x7f6b34008040 comp rx=0 tx=0).stop 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 10 monclient: shutdown 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b45ffd640 1 -- 10.20.193.51:0/2927156868 reap_dead start 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 msgr2=0x7f6b40137ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 0x7f6b40137ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00caf0 tx=0x7f6b3c005bc0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 shutdown_connections 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 --2- 10.20.193.51:0/2927156868 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6b400a3bb0 0x7f6b40137ff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 >> 10.20.193.51:0/2927156868 conn(0x7f6b400a30c0 msgr2=0x7f6b400a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 shutdown_connections 2026-02-17T12:00:17.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.717+0000 7f6b47a87640 1 -- 10.20.193.51:0/2927156868 wait complete. 2026-02-17T12:00:17.753 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:17.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:00:17.753 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:00:17.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.818+0000 7f9d5703b640 10 monclient: get_monmap_and_config 2026-02-17T12:00:17.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.818+0000 7f9d5703b640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.818+0000 7f9d5703b640 10 monclient: monmap: 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:17.819763+0000 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:17.819763+0000 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:17.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 Processor -- start 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 -- start start 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient: init 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9d500a3bb0 0x7f9d5009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-a con 0x7f9d500a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9d5009dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 0x7f9d5013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-c con 0x7f9d500a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5006e140 con 0x7f9d5009dac0 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5009aed0 con 0x7f9d500a3bb0 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5009caa0 con 0x7f9d500a0110 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d5703b640 10 monclient(hunting): authenticate will time out at 1505.438557s 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9d500a3bb0 0x7f9d5009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9d500a3bb0 0x7f9d5009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48710/0 (socket says 10.20.193.51:48710) 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 -- 10.20.193.51:0/2194486648 learned_addr learned my addr 10.20.193.51:0/2194486648 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): get_auth_request con 0x7f9d500a3bb0 auth_method 0 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d555b1640 1 --2- 10.20.193.51:0/2194486648 >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 0x7f9d5013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient(hunting): handle_auth_done global_id 164442 payload 274 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 -- 10.20.193.51:0/2194486648 >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 msgr2=0x7f9d5013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 --2- 10.20.193.51:0/2194486648 >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 0x7f9d5013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 -- 10.20.193.51:0/2194486648 >> v1:10.20.193.142:6789/0 conn(0x7f9d5009dac0 legacy=0x7f9d5009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d54db0640 1 -- 10.20.193.51:0/2194486648 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5009ce60 con 0x7f9d500a3bb0 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d555b1640 10 monclient: get_auth_request con 0x7f9d500a0110 auth_method 0 2026-02-17T12:00:17.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.819+0000 7f9d555b1640 1 --2- 10.20.193.51:0/2194486648 >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 0x7f9d5013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d54db0640 1 -- 10.20.193.51:0/2194486648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d500a3bb0 msgr2=0x7f9d5009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d54db0640 1 --2- 10.20.193.51:0/2194486648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d500a3bb0 0x7f9d5009f4c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d5009cc20 tx=0x7f9d4002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3746710906350399 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 1 -- 10.20.193.51:0/2194486648 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4003c070 con 0x7f9d500a3bb0 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: dump: 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.830 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 5 monclient: authenticate success, global_id 164442 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 1 -- 10.20.193.51:0/2194486648 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4002fd70 con 0x7f9d500a3bb0 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 1 -- 10.20.193.51:0/2194486648 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40037660 con 0x7f9d500a3bb0 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 4 set_mon_vals no callback set 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d477fe640 10 monclient: dump: 2026-02-17T12:00:17.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 10 monclient: shutdown 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 -- 10.20.193.51:0/2194486648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d500a3bb0 msgr2=0x7f9d5009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2194486648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d500a3bb0 0x7f9d5009f4c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d5009cc20 tx=0x7f9d4002ee10 comp rx=0 tx=0).stop 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 -- 10.20.193.51:0/2194486648 shutdown_connections 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2194486648 >> v2:10.20.193.142:3300/0 conn(0x7f9d500a0110 0x7f9d5013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2194486648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d500a3bb0 0x7f9d5009f4c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 -- 10.20.193.51:0/2194486648 >> 10.20.193.51:0/2194486648 conn(0x7f9d500a30c0 msgr2=0x7f9d500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 -- 10.20.193.51:0/2194486648 shutdown_connections 2026-02-17T12:00:17.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.822+0000 7f9d5703b640 1 -- 10.20.193.51:0/2194486648 wait complete. 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient: monmap: 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 Processor -- start 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 -- start start 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient: init 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-a con 0x7f9d5009dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:17.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 0x7f9d5013dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-c con 0x7f9d500a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9d500a3bb0 0x7f9d5013e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): picked mon.noname-b con 0x7f9d500a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9d500a0540 con 0x7f9d5009dac0 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5009a880 con 0x7f9d500a3bb0 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5013cca0 con 0x7f9d500a0110 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d5703b640 10 monclient(hunting): authenticate will time out at 1505.442798s 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48724/0 (socket says 10.20.193.51:48724) 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 1 -- 10.20.193.51:0/2584556325 learned_addr learned my addr 10.20.193.51:0/2584556325 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): get_auth_request con 0x7f9d5009dac0 auth_method 0 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 0x7f9d5013dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 10 monclient(hunting): get_auth_request con 0x7f9d500a0110 auth_method 0 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 msgr2=0x7f9d5013dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 msgr2=0x7f9d5013dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 0x7f9d5013dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 0x7f9d5013dce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 10 monclient(hunting): handle_auth_done global_id 164445 payload 824 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d555b1640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9d500a3bb0 0x7f9d5013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.823+0000 7f9d54db0640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 msgr2=0x7f9d5013dce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d500a0110 0x7f9d5013dce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9d500a3bb0 msgr2=0x7f9d5013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9d500a3bb0 0x7f9d5013e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.824+0000 7f9d54db0640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5013a1c0 con 0x7f9d5009dac0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d54db0640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 msgr2=0x7f9d501360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d54db0640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9d40002410 tx=0x7f9d40004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4003c040 con 0x7f9d5009dac0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: dump: 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40047070 con 0x7f9d5009dac0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 5 monclient: authenticate success, global_id 164445 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 monclient: _renew_subs 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5013fcd0 con 0x7f9d5009dac0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40042890 con 0x7f9d5009dac0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d46ffd640 4 set_mon_vals no callback set 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d457fa640 10 monclient: dump: 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.837 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 monclient: _renew_subs 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5009f2a0 con 0x7f9d5009dac0 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5013eb40 con 0x7f9d5013e760 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d5013e760 auth_method 0 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.826+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.827+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9d40042a30 con 0x7f9d5009dac0 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.827+0000 7f9d457fa640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 0x7f9d20040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.827+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(533..533 src has 323..533) ==== 4779+0+0 (secure 0 0 0) 0x7f9d40077410 con 0x7f9d5009dac0 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.827+0000 7f9d555b1640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 0x7f9d20040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.827+0000 7f9d555b1640 10 monclient: get_auth_request con 0x7f9d2003dd60 auth_method 0 2026-02-17T12:00:17.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:17.829+0000 7f9d555b1640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 0x7f9d20040220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9d5013f5a0 tx=0x7f9d4c007460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.942 INFO:tasks.rados.rados.0.trial142.stdout:2303: done (2 left) 2026-02-17T12:00:17.942 INFO:tasks.rados.rados.0.trial142.stdout:2304: done (1 left) 2026-02-17T12:00:17.942 INFO:tasks.rados.rados.0.trial142.stdout:2306: done (0 left) 2026-02-17T12:00:17.942 INFO:tasks.rados.rados.0.trial142.stdout:2307: snap_remove snap 249 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d5013e760 auth_method 0 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.027+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d5013e760 auth_method 0 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:18.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:18.428+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:00:18.947 INFO:tasks.rados.rados.0.trial142.stdout:2307: done (0 left) 2026-02-17T12:00:18.947 INFO:tasks.rados.rados.0.trial142.stdout:2308: snap_remove snap 250 2026-02-17T12:00:19.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d5013e760 auth_method 0 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:19.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:19.229+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:00:19.947 INFO:tasks.rados.rados.0.trial142.stdout:2308: done (0 left) 2026-02-17T12:00:19.948 INFO:tasks.rados.rados.0.trial142.stdout:2309: snap_remove snap 245 2026-02-17T12:00:20.585 INFO:tasks.rados.rados.0.trial142.stdout:2309: done (0 left) 2026-02-17T12:00:20.586 INFO:tasks.rados.rados.0.trial142.stdout:2310: write oid 19 current snap is 251 2026-02-17T12:00:20.586 INFO:tasks.rados.rados.0.trial142.stdout:2310: seq_num 800 ranges {645600=416265,1797477=711598,3219453=226147} 2026-02-17T12:00:20.589 INFO:tasks.rados.rados.0.trial142.stdout:2310: writing trial14245205-19 from 645600 to 1061865 tid 1 2026-02-17T12:00:20.595 INFO:tasks.rados.rados.0.trial142.stdout:2310: writing trial14245205-19 from 1797477 to 2509075 tid 2 2026-02-17T12:00:20.598 INFO:tasks.rados.rados.0.trial142.stdout:2310: writing trial14245205-19 from 3219453 to 3445600 tid 3 2026-02-17T12:00:20.598 INFO:tasks.rados.rados.0.trial142.stdout:2311: delete oid 50 current snap is 251 2026-02-17T12:00:20.602 INFO:tasks.rados.rados.0.trial142.stdout:2310: finishing write tid 1 to trial14245205-19 2026-02-17T12:00:20.602 INFO:tasks.rados.rados.0.trial142.stdout:2311: done (1 left) 2026-02-17T12:00:20.602 INFO:tasks.rados.rados.0.trial142.stdout:2312: delete oid 35 current snap is 251 2026-02-17T12:00:20.602 INFO:tasks.rados.rados.0.trial142.stdout:2310: finishing write tid 2 to trial14245205-19 2026-02-17T12:00:20.603 INFO:tasks.rados.rados.0.trial142.stdout:2312: done (1 left) 2026-02-17T12:00:20.603 INFO:tasks.rados.rados.0.trial142.stdout:2313: snap_create 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: finishing write tid 3 to trial14245205-19 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: finishing write tid 4 to trial14245205-19 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: finishing write tid 5 to trial14245205-19 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: oid 19 updating version 0 to 1959 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: oid 19 version 1959 is already newer than 1957 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: oid 19 version 1959 is already newer than 1958 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: oid 19 version 1959 is already newer than 1956 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 1959 (ObjNum 800 snap 251 seq_num 800) dirty exists 2026-02-17T12:00:20.604 INFO:tasks.rados.rados.0.trial142.stdout:2310: left oid 19 (ObjNum 800 snap 251 seq_num 800) 2026-02-17T12:00:20.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.823+0000 7f9d1ffff640 10 monclient: tick 2026-02-17T12:00:20.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.823+0000 7f9d1ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:20.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.823+0000 7f9d1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:20.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.823+0000 7f9d1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.830+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.830+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d5013e760 auth_method 0 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.830+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.830+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.830+0000 7f9d47fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.831+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.831+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.831+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:20.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:20.831+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T12:00:21.588 INFO:tasks.rados.rados.0.trial142.stdout:2310: done (1 left) 2026-02-17T12:00:21.588 INFO:tasks.rados.rados.0.trial142.stdout:2313: done (0 left) 2026-02-17T12:00:21.588 INFO:tasks.rados.rados.0.trial142.stdout:2314: write oid 4 current snap is 252 2026-02-17T12:00:21.588 INFO:tasks.rados.rados.0.trial142.stdout:2314: seq_num 803 ranges {696021=642012,1856570=575278,3185369=310652} 2026-02-17T12:00:21.593 INFO:tasks.rados.rados.0.trial142.stdout:2314: writing trial14245205-4 from 696021 to 1338033 tid 1 2026-02-17T12:00:21.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: writing trial14245205-4 from 1856570 to 2431848 tid 2 2026-02-17T12:00:21.602 INFO:tasks.rados.rados.0.trial142.stdout:2314: writing trial14245205-4 from 3185369 to 3496021 tid 3 2026-02-17T12:00:21.602 INFO:tasks.rados.rados.0.trial142.stdout:2315: snap_remove snap 251 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 10 monclient: tick 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 0x7f9d18005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 msgr2=0x7f9d50072430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d5013e760 0x7f9d50072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.823+0000 7f9d1ffff640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5013eb40 con 0x7f9d18003640 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 0x7f9d18005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d18003640 auth_method 0 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 10 monclient(hunting): handle_auth_done global_id 194099 payload 824 2026-02-17T12:00:21.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.824+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d180061b0 con 0x7f9d18003640 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 msgr2=0x7f9d18005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 0x7f9d18005ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d38017970 tx=0x7f9d38017e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38003d80 con 0x7f9d18003640 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 10 monclient: dump: 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9d3801c070 con 0x7f9d18003640 2026-02-17T12:00:21.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:21.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:21.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 msgr2=0x7f9d18005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 0x7f9d18005ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d38017970 tx=0x7f9d38017e40 comp rx=0 tx=0).stop 2026-02-17T12:00:21.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 msgr2=0x7f9d18005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:21.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.826+0000 7f9d457fa640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d18003640 0x7f9d18005ad0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d38017970 tx=0x7f9d38017e40 comp rx=0 tx=0).stop 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d5703b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 0x7f9d50072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d5703b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5009d7b0 con 0x7f9d50072970 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 0x7f9d50072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient: get_auth_request con 0x7f9d50072970 auth_method 0 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.830+0000 7f9d47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.831+0000 7f9d47fff640 10 monclient(hunting): handle_auth_done global_id 194102 payload 824 2026-02-17T12:00:21.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.831+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d5013d0b0 con 0x7f9d50072970 2026-02-17T12:00:21.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d47fff640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 msgr2=0x7f9d50072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d47fff640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 0x7f9d50072d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d38020000 tx=0x7f9d380037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38006ce0 con 0x7f9d50072970 2026-02-17T12:00:21.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 10 monclient: dump: 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f9d3802a070 con 0x7f9d50072970 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 msgr2=0x7f9d50072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 0x7f9d50072d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d38020000 tx=0x7f9d380037f0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 msgr2=0x7f9d50072d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:21.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d457fa640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9d50072970 0x7f9d50072d50 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d38020000 tx=0x7f9d380037f0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d555b1640 1 -- 10.20.193.51:0/2584556325 reap_dead start 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10771, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.836 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:21.837 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.838 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:21.839 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:21.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 msgr2=0x7f9d20040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 0x7f9d20040220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9d5013f5a0 tx=0x7f9d4c007460 comp rx=0 tx=0).stop 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 10 monclient: shutdown 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:21.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 msgr2=0x7f9d501360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9d40002410 tx=0x7f9d40004830 comp rx=0 tx=0).stop 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 shutdown_connections 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9d2003dd60 0x7f9d20040220 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 --2- 10.20.193.51:0/2584556325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9d5009dac0 0x7f9d501360b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 >> 10.20.193.51:0/2584556325 conn(0x7f9d500a30c0 msgr2=0x7f9d5006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 shutdown_connections 2026-02-17T12:00:21.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.833+0000 7f9d5703b640 1 -- 10.20.193.51:0/2584556325 wait complete. 2026-02-17T12:00:21.843 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:21.843 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:00:21.843 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:00:21.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 10 monclient: get_monmap_and_config 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 10 monclient: build_initial_monmap 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 10 monclient: monmap: 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:21.911153+0000 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:21.911153+0000 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:21.912 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 1 Processor -- start 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 1 -- start start 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.910+0000 7f2eb91f5640 10 monclient: init 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2eb40a3bb0 0x7f2eb409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-b con 0x7f2eb409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2eb409ff40 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb406e140 con 0x7f2eb409ff40 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb409aed0 con 0x7f2eb40a3bb0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb409caa0 con 0x7f2eb409dac0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb91f5640 10 monclient(hunting): authenticate will time out at 1509.530183s 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2eb40a3bb0 0x7f2eb409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39004/0 (socket says 10.20.193.51:39004) 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 -- 10.20.193.51:0/1166036140 learned_addr learned my addr 10.20.193.51:0/1166036140 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): get_auth_request con 0x7f2eb409dac0 auth_method 0 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request con 0x7f2eb40a3bb0 auth_method 0 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient(hunting): handle_auth_done global_id 194105 payload 274 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 -- 10.20.193.51:0/1166036140 >> v2:10.20.193.51:3300/0 conn(0x7f2eb40a3bb0 msgr2=0x7f2eb409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1166036140 >> v2:10.20.193.51:3300/0 conn(0x7f2eb40a3bb0 0x7f2eb409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 -- 10.20.193.51:0/1166036140 >> v1:10.20.193.142:6789/0 conn(0x7f2eb409ff40 legacy=0x7f2eb413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient: _finish_hunting 0 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 monclient: found mon.noname-b 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:21.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.911+0000 7f2eb2575640 1 -- 10.20.193.51:0/1166036140 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb409ce60 con 0x7f2eb409dac0 2026-02-17T12:00:21.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb2575640 1 -- 10.20.193.51:0/1166036140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 msgr2=0x7f2eb409fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1166036140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009970 tx=0x7f2e9c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12ab5b51157eed5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 1 -- 10.20.193.51:0/1166036140 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c03c070 con 0x7f2eb409dac0 2026-02-17T12:00:21.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: dump: 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: _finish_auth 0 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: _check_auth_tickets 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 1 -- 10.20.193.51:0/1166036140 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c02fcd0 con 0x7f2eb409dac0 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 1 -- 10.20.193.51:0/1166036140 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c037660 con 0x7f2eb409dac0 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb1d74640 10 monclient: dump: 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb91f5640 5 monclient: authenticate success, global_id 194105 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb91f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.913+0000 7f2eb91f5640 4 set_mon_vals no callback set 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 10 monclient: shutdown 2026-02-17T12:00:21.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1166036140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 msgr2=0x7f2eb409fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1166036140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009970 tx=0x7f2e9c02ee90 comp rx=0 tx=0).stop 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1166036140 shutdown_connections 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1166036140 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409dac0 0x7f2eb409fa00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1166036140 >> v2:10.20.193.51:3300/0 conn(0x7f2eb40a3bb0 0x7f2eb409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1166036140 >> 10.20.193.51:0/1166036140 conn(0x7f2eb40a30c0 msgr2=0x7f2eb40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1166036140 shutdown_connections 2026-02-17T12:00:21.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1166036140 wait complete. 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 10 monclient: build_initial_monmap 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 10 monclient: monmap: 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 Processor -- start 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 1 -- start start 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.914+0000 7f2eb91f5640 10 monclient: init 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 0x7f2eb406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-c con 0x7f2eb409ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb40a3bb0 0x7f2eb4070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): picked mon.noname-b con 0x7f2eb40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40a0370 con 0x7f2eb409dac0 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb409a880 con 0x7f2eb40a3bb0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb40a04f0 con 0x7f2eb409ff40 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb91f5640 10 monclient(hunting): authenticate will time out at 1509.534096s 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 0x7f2eb406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 0x7f2eb406f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48744/0 (socket says 10.20.193.51:48744) 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 1 -- 10.20.193.51:0/1509416892 learned_addr learned my addr 10.20.193.51:0/1509416892 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request con 0x7f2eb409dac0 auth_method 0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39014/0 (socket says 10.20.193.51:39014) 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): get_auth_request con 0x7f2eb409ff40 auth_method 0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient(hunting): handle_auth_done global_id 194108 payload 824 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb40a3bb0 msgr2=0x7f2eb4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb40a3bb0 0x7f2eb4070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 msgr2=0x7f2eb406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 0x7f2eb406f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient: _finish_hunting 0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 monclient: found mon.noname-c 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2575640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb41b99d0 con 0x7f2eb409ff40 2026-02-17T12:00:21.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.915+0000 7f2eb2d76640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2eb409dac0 0x7f2eb406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb2575640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 msgr2=0x7f2eb406fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb2575640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406dd50 tx=0x7f2e9c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c03c040 con 0x7f2eb409ff40 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: dump: 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c042450 con 0x7f2eb409ff40 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c042840 con 0x7f2eb409ff40 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2e937fe640 10 monclient: dump: 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb1573640 4 set_mon_vals no callback set 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 5 monclient: authenticate success, global_id 194108 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 10 monclient: _renew_subs 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb41ba980 con 0x7f2eb409ff40 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 10 monclient: _renew_subs 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.917+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb409d7b0 con 0x7f2eb409ff40 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb91f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 0x7f2eb41be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40a2430 con 0x7f2eb41ba320 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2e9c0429e0 con 0x7f2eb409ff40 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 0x7f2eb41be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient: get_auth_request con 0x7f2eb41ba320 auth_method 0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2e937fe640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2e8003dd40 0x7f2e80040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(538..538 src has 323..538) ==== 4751+0+0 (secure 0 0 0) 0x7f2e9c076a60 con 0x7f2eb409ff40 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb3577640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2e8003dd40 0x7f2e80040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb3577640 10 monclient: get_auth_request con 0x7f2e8003dd40 auth_method 0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_done global_id 184174 payload 824 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.918+0000 7f2eb2d76640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2eb406a290 con 0x7f2eb41ba320 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2eb2d76640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 msgr2=0x7f2eb41be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2eb2d76640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 0x7f2eb41be5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009fa0 tx=0x7f2ea800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2eb3577640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2e8003dd40 0x7f2e80040200 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb41b9670 tx=0x7f2ea4003fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8004030 con 0x7f2eb41ba320 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 10 monclient: dump: 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f2ea8004030 con 0x7f2eb41ba320 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 msgr2=0x7f2eb41be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 0x7f2eb41be5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009fa0 tx=0x7f2ea800f610 comp rx=0 tx=0).stop 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 msgr2=0x7f2eb41be5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:21.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.921+0000 7f2e937fe640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41ba320 0x7f2eb41be5a0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009fa0 tx=0x7f2ea800f610 comp rx=0 tx=0).stop 2026-02-17T12:00:21.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.924+0000 7f2eb91f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:21.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 0x7f2eb41beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:21.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb91f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:21.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb409f4c0 con 0x7f2eb41beae0 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 0x7f2eb41beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient: get_auth_request con 0x7f2eb41beae0 auth_method 0 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 10 monclient(hunting): handle_auth_done global_id 184177 payload 824 2026-02-17T12:00:21.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.925+0000 7f2eb2d76640 1 -- 10.20.193.51:0/1509416892 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2eb41ba700 con 0x7f2eb41beae0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2eb2d76640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 msgr2=0x7f2eb41beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2eb2d76640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 0x7f2eb41beec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009f70 tx=0x7f2ea80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8003d30 con 0x7f2eb41beae0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 10 monclient: dump: 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f2ea8003d30 con 0x7f2eb41beae0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 msgr2=0x7f2eb41beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 0x7f2eb41beec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009f70 tx=0x7f2ea80047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 msgr2=0x7f2eb41beec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.927+0000 7f2e937fe640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2eb41beae0 0x7f2eb41beec0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009f70 tx=0x7f2ea80047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 54314, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.930 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:21.931 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:21.932 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:21.933 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:21.934 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2e8003dd40 msgr2=0x7f2e80040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2e8003dd40 0x7f2e80040200 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb41b9670 tx=0x7f2ea4003fc0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 10 monclient: shutdown 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 msgr2=0x7f2eb406fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb3577640 1 -- 10.20.193.51:0/1509416892 reap_dead start 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406dd50 tx=0x7f2e9c004830 comp rx=0 tx=0).stop 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 shutdown_connections 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 --2- 10.20.193.51:0/1509416892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2eb409ff40 0x7f2eb406fbf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 >> 10.20.193.51:0/1509416892 conn(0x7f2eb40a30c0 msgr2=0x7f2eb406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 shutdown_connections 2026-02-17T12:00:21.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:21.928+0000 7f2eb91f5640 1 -- 10.20.193.51:0/1509416892 wait complete. 2026-02-17T12:00:21.935 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:21.935 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:00:21.936 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.000+0000 7fb06b1ce640 10 monclient: get_monmap_and_config 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.000+0000 7fb06b1ce640 10 monclient: build_initial_monmap 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.000+0000 7fb06b1ce640 10 monclient: monmap: 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:22.001893+0000 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:22.001893+0000 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 Processor -- start 2026-02-17T12:00:22.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 -- start start 2026-02-17T12:00:22.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient: init 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient: _add_conns ranks=[4,3,2,0,1] 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb0640a3bb0 0x7fb06409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-c con 0x7fb0640a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0640a0750 0x7fb06409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-a con 0x7fb0640a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:22.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb06413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-b con 0x7fb06409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb0640a3f90 con 0x7fb0640a0750 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb06406e140 con 0x7fb0640a3bb0 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb06409f910 con 0x7fb06409e540 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb06b1ce640 10 monclient(hunting): authenticate will time out at 1509.620650s 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0640a0750 0x7fb06409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0640a0750 0x7fb06409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48758/0 (socket says 10.20.193.51:48758) 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 -- 10.20.193.51:0/3946509149 learned_addr learned my addr 10.20.193.51:0/3946509149 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): get_auth_request con 0x7fb0640a0750 auth_method 0 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb06413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): get_auth_request con 0x7fb06409e540 auth_method 0 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:22.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb068f43640 1 --2- 10.20.193.51:0/3946509149 >> v2:10.20.193.142:3300/0 conn(0x7fb0640a3bb0 0x7fb06409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb069744640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb068f43640 10 monclient(hunting): get_auth_request con 0x7fb0640a3bb0 auth_method 0 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb068f43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb068f43640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb068f43640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient(hunting): handle_auth_done global_id 164454 payload 274 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 -- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 msgr2=0x7fb06413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb06413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 -- 10.20.193.51:0/3946509149 >> v2:10.20.193.142:3300/0 conn(0x7fb0640a3bb0 msgr2=0x7fb06409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3946509149 >> v2:10.20.193.142:3300/0 conn(0x7fb0640a3bb0 0x7fb06409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 monclient: found mon.noname-a 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.001+0000 7fb05bfff640 1 -- 10.20.193.51:0/3946509149 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06409ccd0 con 0x7fb0640a0750 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05bfff640 1 -- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 msgr2=0x7fb06409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb06409e000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb06406c1c0 tx=0x7fb04c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817b6197109ccb02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 1 -- 10.20.193.51:0/3946509149 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c03c070 con 0x7fb0640a0750 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: dump: 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 5 monclient: authenticate success, global_id 164454 2026-02-17T12:00:22.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 1 -- 10.20.193.51:0/3946509149 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c02fca0 con 0x7fb0640a0750 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 1 -- 10.20.193.51:0/3946509149 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c037660 con 0x7fb0640a0750 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 4 set_mon_vals no callback set 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb05b7fe640 10 monclient: dump: 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 10 monclient: shutdown 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 msgr2=0x7fb06409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:22.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb06409e000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb06406c1c0 tx=0x7fb04c02ee60 comp rx=0 tx=0).stop 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3946509149 shutdown_connections 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb06413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3946509149 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb06409e000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3946509149 >> v2:10.20.193.142:3300/0 conn(0x7fb0640a3bb0 0x7fb06409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3946509149 >> 10.20.193.51:0/3946509149 conn(0x7fb0640a30c0 msgr2=0x7fb0640a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3946509149 shutdown_connections 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.004+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3946509149 wait complete. 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient: build_initial_monmap 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient: monmap: 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:22.011 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 Processor -- start 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 -- start start 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient: init 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb064131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-c con 0x7fb06409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:22.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-a con 0x7fb0640a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0640a3bb0 0x7fb064132a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): picked mon.noname-b con 0x7fb0640a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640a04b0 con 0x7fb0640a0750 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb06409c850 con 0x7fb0640a3bb0 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb06413cca0 con 0x7fb06409e540 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb06b1ce640 10 monclient(hunting): authenticate will time out at 1509.624483s 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb064131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48766/0 (socket says 10.20.193.51:48766) 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 -- 10.20.193.51:0/3730453658 learned_addr learned my addr 10.20.193.51:0/3730453658 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): get_auth_request con 0x7fb06409e540 auth_method 0 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): get_auth_request con 0x7fb0640a0750 auth_method 0 2026-02-17T12:00:22.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb068f43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient(hunting): handle_auth_done global_id 164457 payload 824 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 -- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 msgr2=0x7fb064131f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb064131f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 -- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0640a3bb0 msgr2=0x7fb064132a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0640a3bb0 0x7fb064132a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 monclient: found mon.noname-a 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.005+0000 7fb05bfff640 1 -- 10.20.193.51:0/3730453658 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640a2350 con 0x7fb0640a0750 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb05bfff640 1 -- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 msgr2=0x7fb0641324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb05bfff640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb04c002410 tx=0x7fb04c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:22.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c047070 con 0x7fb0640a0750 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: dump: 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: _finish_auth 0 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: _check_auth_tickets 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c02fe50 con 0x7fb0640a0750 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c03c040 con 0x7fb0640a0750 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:22.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb0597fa640 10 monclient: dump: 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb05affd640 4 set_mon_vals no callback set 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 5 monclient: authenticate success, global_id 164457 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 10 monclient: _renew_subs 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06409d7b0 con 0x7fb0640a0750 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 10 monclient: _renew_subs 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.007+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb064135da0 con 0x7fb0640a0750 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb04c03f9f0 con 0x7fb0640a0750 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb06b1ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb06b1ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:22.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb06b1ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06406a290 con 0x7fb0640a0750 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb0597fa640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 0x7fb034040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(538..538 src has 323..538) ==== 4751+0+0 (secure 0 0 0) 0x7fb04c0772c0 con 0x7fb0640a0750 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.008+0000 7fb068f43640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 0x7fb034040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.009+0000 7fb068f43640 10 monclient: get_auth_request con 0x7fb03403dd60 auth_method 0 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.011+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb06406a290 con 0x7fb0640a0750 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.011+0000 7fb0597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.011+0000 7fb0597fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:22.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.011+0000 7fb068f43640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 0x7fb034040220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0540044b0 tx=0x7fb054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:22.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb06b1ce640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:00:22.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb06b1ce640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:00:22.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb06b1ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:22.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb06406e4a0 con 0x7fb0640a0750 2026-02-17T12:00:22.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=11,logm=46} crc {auth=2458071960,config=692619927,health=3859181704,kv=1728028228,logm=2676783565}) 2026-02-17T12:00:22.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb0597fa640 1 -- 10.20.193.51:0/3730453658 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb06406e4a0 con 0x7fb0640a0750 2026-02-17T12:00:22.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb0597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:00:22.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.127+0000 7fb0597fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=1,health=10,kv=12,logm=50} crc {auth=1710115496,config=3678701417,health=1337625172,kv=643764953,logm=3390966495}) 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=11,logm=46} crc {auth=2458071960,config=692619927,health=3859181704,kv=1728028228,logm=2676783565}) 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.127+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1723774796,config=692619927,health=1014261093,kv=643764953,logm=1668757716}) 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=125462499}) 2026-02-17T12:00:22.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=281839731}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=125462499}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.128+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=538742366}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1303451817}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=365558269}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1303451817}) 2026-02-17T12:00:22.133 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919468887}) 2026-02-17T12:00:22.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 msgr2=0x7fb034040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:22.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 0x7fb034040220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0540044b0 tx=0x7fb054008040 comp rx=0 tx=0).stop 2026-02-17T12:00:22.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 10 monclient: shutdown 2026-02-17T12:00:22.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 msgr2=0x7fb0641324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb04c002410 tx=0x7fb04c004830 comp rx=0 tx=0).stop 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 shutdown_connections 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb03403dd60 0x7fb034040220 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0640a3bb0 0x7fb064132a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0640a0750 0x7fb0641324d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 --2- 10.20.193.51:0/3730453658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb06409e540 0x7fb064131f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 >> 10.20.193.51:0/3730453658 conn(0x7fb0640a30c0 msgr2=0x7fb064072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 shutdown_connections 2026-02-17T12:00:22.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:22.129+0000 7fb06b1ce640 1 -- 10.20.193.51:0/3730453658 wait complete. 2026-02-17T12:00:22.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.137 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=282081271}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4286549894}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=282081271}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.129+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2885351199}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507262352}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2204969728}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507262352}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2155757061}) 2026-02-17T12:00:22.138 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3871679413}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=600149101}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3871679413}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=681853460}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730266861}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2535391648}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730266861}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.130+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1433213153}) 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.139 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928106945}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2342960039}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928106945}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3319770137}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3250324029}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1637184244}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3250324029}) 2026-02-17T12:00:22.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.131+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457837133}) 2026-02-17T12:00:22.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:00:22.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566655072}) 2026-02-17T12:00:22.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=994495530}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566655072}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2132962787}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=407457590}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2837027248}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=407457590}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3375037226}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3812059864}) 2026-02-17T12:00:22.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=712390544}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3812059864}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.139+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2448326073}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043726164}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4223459283}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043726164}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3039201610}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201439583}) 2026-02-17T12:00:22.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2008551903}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201439583}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2282892478}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=537631265}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1377765984}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=537631265}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=44510906}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003805465}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=271042248}) 2026-02-17T12:00:22.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.140+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003805465}) 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1361621515}) 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845970067}) 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3582695876}) 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845970067}) 2026-02-17T12:00:22.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.141+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1676028157}) 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=948021793}) 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=696473327}) 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=948021793}) 2026-02-17T12:00:22.588 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.585+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3494810766}) 2026-02-17T12:00:22.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=582678012}) 2026-02-17T12:00:22.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1020222964}) 2026-02-17T12:00:22.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=582678012}) 2026-02-17T12:00:22.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.588+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1315911370}) 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3198144375}) 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1512417999}) 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3198144375}) 2026-02-17T12:00:22.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.593+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1614265848}) 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2315: done (1 left) 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2316: read oid 3 snap -1 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2316: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2317: read oid 44 snap -1 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2317: expect (ObjNum 771 snap 245 seq_num 771) 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2318: snap_create 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2314: finishing write tid 1 to trial14245205-4 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2314: finishing write tid 2 to trial14245205-4 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2314: finishing write tid 3 to trial14245205-4 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2314: finishing write tid 4 to trial14245205-4 2026-02-17T12:00:22.597 INFO:tasks.rados.rados.0.trial142.stdout:2314: finishing write tid 5 to trial14245205-4 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: oid 4 updating version 0 to 2103 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: oid 4 updating version 2103 to 2104 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: oid 4 version 2104 is already newer than 2102 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: oid 4 updating version 2104 to 2105 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2105 (ObjNum 803 snap 252 seq_num 803) dirty exists 2026-02-17T12:00:22.598 INFO:tasks.rados.rados.0.trial142.stdout:2314: left oid 4 (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:22.601 INFO:tasks.rados.rados.0.trial142.stdout:2317: expect (ObjNum 771 snap 245 seq_num 771) 2026-02-17T12:00:22.651 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.651 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1725485750}) 2026-02-17T12:00:22.651 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3531673164}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1725485750}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2315896867}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54468349}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1503094005}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54468349}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.645+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3625282261}) 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.652 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060969850}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=75903159}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060969850}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2789894649}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3651525923}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1867464541}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3651525923}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.646+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3428096745}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2504339894}) 2026-02-17T12:00:22.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=566737025}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2504339894}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1317404752}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1445047486}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1316476621}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1445047486}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1444893888}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737589580}) 2026-02-17T12:00:22.654 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1629362468}) 2026-02-17T12:00:22.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737589580}) 2026-02-17T12:00:22.655 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.647+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=767903380}) 2026-02-17T12:00:22.670 INFO:tasks.rados.rados.0.trial142.stdout:2316: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:22.799 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.800 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1628233951}) 2026-02-17T12:00:22.800 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2579717189}) 2026-02-17T12:00:22.800 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.800 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1628233951}) 2026-02-17T12:00:22.800 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.797+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4094924847}) 2026-02-17T12:00:22.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=578328253}) 2026-02-17T12:00:22.913 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3017067413}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=578328253}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=70759508}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316787177}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1628372150}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316787177}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.909+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=851482094}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447588142}) 2026-02-17T12:00:22.914 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1376346481}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447588142}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233699990}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102872300}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3237099132}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102872300}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3833069215}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1336644072}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2853336192}) 2026-02-17T12:00:22.915 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1336644072}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.910+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3776723902}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1561752459}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1684578054}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1561752459}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2187980767}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1767592734}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=599131568}) 2026-02-17T12:00:22.916 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1767592734}) 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3367190659}) 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=438966767}) 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2729931562}) 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=438966767}) 2026-02-17T12:00:22.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.911+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3896008381}) 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3485014618}) 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2290137584}) 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3485014618}) 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2124133003}) 2026-02-17T12:00:22.926 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700942329}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2682501919}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700942329}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3573714764}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57391940}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4143560445}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57391940}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=613205192}) 2026-02-17T12:00:22.927 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1969769566}) 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3947227194}) 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1969769566}) 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.912+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3258484180}) 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696854621}) 2026-02-17T12:00:22.928 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=513407005}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696854621}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1680270100}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3419619031}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3919056624}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3419619031}) 2026-02-17T12:00:22.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.913+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2392163836}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726134898}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1322238607}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726134898}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=47847255}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2499721978}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1550039649}) 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2499721978}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=874406031}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=845664049}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=834655158}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=845664049}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3212329425}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4219390598}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2079735024}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4219390598}) 2026-02-17T12:00:22.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.914+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1611141523}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190719499}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3354799466}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190719499}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1603779120}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59895040}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3333834025}) 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59895040}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=148226742}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=854402235}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=632159189}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=854402235}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.915+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1139068553}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1366322646}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1335112311}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1366322646}) 2026-02-17T12:00:22.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2856466082}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109314157}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1341771663}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109314157}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=871772127}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4010887622}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2892018680}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4010887622}) 2026-02-17T12:00:22.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1915357648}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624920772}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1719784084}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624920772}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.916+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2911359997}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038366558}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2535795956}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038366558}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3282436934}) 2026-02-17T12:00:22.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872184983}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=994180917}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872184983}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3807257042}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703581838}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4057304941}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703581838}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.917+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3876510961}) 2026-02-17T12:00:22.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3180710860}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=300326196}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3180710860}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2461991477}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3102791807}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=504510124}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3102791807}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1058548674}) 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2345654933}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=135142260}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2345654933}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.918+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=349387278}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=47} crc {logm=3293882781,mdsmap=3207544932,mgr=2271820824,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=4140924357,mon_config_key=3390328712,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=2781231023,osd_snap=4266985056}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=49} crc {logm=3293882781,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3220048893,mon_config_key=1577268959,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=2781231023,osd_snap=983665111}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=47} crc {logm=3293882781,mdsmap=3207544932,mgr=2271820824,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=4140924357,mon_config_key=3390328712,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=2781231023,osd_snap=4266985056}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=6,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=49} crc {logm=3293882781,mdsmap=3207544932,mgr=3142006587,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2797465898,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=2781231023,osd_snap=4190617892}) 2026-02-17T12:00:22.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=1398869891,osdmap=1061767978}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=39,osdmap=61} crc {osd_snap=3471740201,osdmap=211114526}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=1398869891,osdmap=1061767978}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=145568823,osdmap=1081628056}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1955452738}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1720914010}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1955452738}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.919+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=541716500}) 2026-02-17T12:00:22.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=128502414}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3085038469}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=128502414}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.920+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2415237962}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=64} crc {osdmap=2622162870}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=66} crc {osdmap=349197933}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=64} crc {osdmap=2622162870}) 2026-02-17T12:00:22.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:00:22.922+0000 7f00b81d3640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=68} crc {osdmap=3628321943}) 2026-02-17T12:00:23.142 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:00:23.143 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:23.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: get_monmap_and_config 2026-02-17T12:00:23.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: monmap: 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:23.210104+0000 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:23.210104+0000 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:23.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 Processor -- start 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 -- start start 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: init 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd2540a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-b con 0x7fd25409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd2540a0110 0x7fd25413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-c con 0x7fd2540a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25406e140 con 0x7fd2540a3bb0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd25409aed0 con 0x7fd2540a0110 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd25409caa0 con 0x7fd25409dac0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd258f51640 10 monclient(hunting): authenticate will time out at 1510.828842s 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39026/0 (socket says 10.20.193.51:39026) 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 1 -- 10.20.193.51:0/2656418816 learned_addr learned my addr 10.20.193.51:0/2656418816 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 10 monclient(hunting): get_auth_request con 0x7fd25409dac0 auth_method 0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.209+0000 7fd251d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd252d76640 1 --2- 10.20.193.51:0/2656418816 >> v2:10.20.193.142:3300/0 conn(0x7fd2540a0110 0x7fd25413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd252d76640 10 monclient(hunting): get_auth_request con 0x7fd2540a0110 auth_method 0 2026-02-17T12:00:23.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd252d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd252d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd252d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient(hunting): handle_auth_done global_id 194117 payload 274 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 1 -- 10.20.193.51:0/2656418816 >> v2:10.20.193.142:3300/0 conn(0x7fd2540a0110 msgr2=0x7fd25413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 1 --2- 10.20.193.51:0/2656418816 >> v2:10.20.193.142:3300/0 conn(0x7fd2540a0110 0x7fd25413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 1 -- 10.20.193.51:0/2656418816 >> v1:10.20.193.142:6789/0 conn(0x7fd2540a3bb0 legacy=0x7fd25409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 1 monclient: found mon.noname-b 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.210+0000 7fd251d74640 1 -- 10.20.193.51:0/2656418816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25409ce60 con 0x7fd25409dac0 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251d74640 1 -- 10.20.193.51:0/2656418816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 msgr2=0x7fd25409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251d74640 1 --2- 10.20.193.51:0/2656418816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009970 tx=0x7fd23c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af43aac7c9f676c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 1 -- 10.20.193.51:0/2656418816 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c03c070 con 0x7fd25409dac0 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: dump: 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 1 -- 10.20.193.51:0/2656418816 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c02fcd0 con 0x7fd25409dac0 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 1 -- 10.20.193.51:0/2656418816 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c037660 con 0x7fd25409dac0 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd251573640 10 monclient: dump: 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd258f51640 5 monclient: authenticate success, global_id 194117 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd258f51640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.212+0000 7fd258f51640 4 set_mon_vals no callback set 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 10 monclient: shutdown 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- 10.20.193.51:0/2656418816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 msgr2=0x7fd25409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 --2- 10.20.193.51:0/2656418816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009970 tx=0x7fd23c02ee90 comp rx=0 tx=0).stop 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- 10.20.193.51:0/2656418816 shutdown_connections 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 --2- 10.20.193.51:0/2656418816 >> v2:10.20.193.142:3300/0 conn(0x7fd2540a0110 0x7fd25413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 --2- 10.20.193.51:0/2656418816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd25409dac0 0x7fd25409fbd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- 10.20.193.51:0/2656418816 >> 10.20.193.51:0/2656418816 conn(0x7fd2540a30c0 msgr2=0x7fd2540a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- 10.20.193.51:0/2656418816 shutdown_connections 2026-02-17T12:00:23.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- 10.20.193.51:0/2656418816 wait complete. 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 10 monclient: monmap: 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 Processor -- start 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 1 -- start start 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.213+0000 7fd258f51640 10 monclient: init 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd25409dac0 0x7fd254099fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-b con 0x7fd25409dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 0x7fd254094830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-a con 0x7fd2540a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): picked mon.noname-c con 0x7fd2540a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd2540a0540 con 0x7fd2540a0110 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd25409a880 con 0x7fd25409dac0 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd25413cca0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd258f51640 10 monclient(hunting): authenticate will time out at 1510.833068s 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 0x7fd254094830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39040/0 (socket says 10.20.193.51:39040) 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 0x7fd254094830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48772/0 (socket says 10.20.193.51:48772) 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 -- 10.20.193.51:0/2323175127 learned_addr learned my addr 10.20.193.51:0/2323175127 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): get_auth_request con 0x7fd2540a3bb0 auth_method 0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): get_auth_request con 0x7fd2540a0110 auth_method 0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd251d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252575640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd25409dac0 0x7fd254099fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252575640 10 monclient(hunting): get_auth_request con 0x7fd25409dac0 auth_method 0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient(hunting): handle_auth_done global_id 194120 payload 824 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 -- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd25409dac0 msgr2=0x7fd254099fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd25409dac0 0x7fd254099fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 -- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 msgr2=0x7fd254094830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 0x7fd254094830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 monclient: found mon.noname-c 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.214+0000 7fd252d76640 1 -- 10.20.193.51:0/2323175127 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2540984e0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd252d76640 1 -- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 msgr2=0x7fd254094d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd252d76640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd244007d90 tx=0x7fd24400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244014620 con 0x7fd2540a3bb0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: dump: 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd244019070 con 0x7fd2540a3bb0 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 5 monclient: authenticate success, global_id 194120 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 10 monclient: _renew_subs 2026-02-17T12:00:23.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2540987c0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244014a20 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd250d72640 4 set_mon_vals no callback set 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd23affd640 10 monclient: dump: 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 10 monclient: _renew_subs 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.216+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25409d7b0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd258f51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd258f51640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd258f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd254096db0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd24401e460 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd23affd640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 0x7fd220040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(539..539 src has 323..539) ==== 4779+0+0 (secure 0 0 0) 0x7fd244053010 con 0x7fd2540a3bb0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd252575640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 0x7fd220040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.217+0000 7fd252575640 10 monclient: get_auth_request con 0x7fd22003dd60 auth_method 0 2026-02-17T12:00:23.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.220+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd24401cc60 con 0x7fd2540a3bb0 2026-02-17T12:00:23.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.220+0000 7fd23affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.220+0000 7fd23affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:23.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.220+0000 7fd252575640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 0x7fd220040220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd2540986f0 tx=0x7fd248009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd258f51640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd258f51640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd258f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd2540008d0 con 0x7fd2540a3bb0 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd23affd640 1 -- 10.20.193.51:0/2323175127 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fd24401b310 con 0x7fd2540a3bb0 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd23affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:23.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.339+0000 7fd23affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:23.343 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 msgr2=0x7fd220040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 0x7fd220040220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd2540986f0 tx=0x7fd248009040 comp rx=0 tx=0).stop 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 10 monclient: shutdown 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 msgr2=0x7fd254094d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.340+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd244007d90 tx=0x7fd24400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 shutdown_connections 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd22003dd60 0x7fd220040220 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd2540a3bb0 0x7fd254094d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd2540a0110 0x7fd254094830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 --2- 10.20.193.51:0/2323175127 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd25409dac0 0x7fd254099fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 >> 10.20.193.51:0/2323175127 conn(0x7fd2540a30c0 msgr2=0x7fd25406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 shutdown_connections 2026-02-17T12:00:23.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.341+0000 7fd258f51640 1 -- 10.20.193.51:0/2323175127 wait complete. 2026-02-17T12:00:23.350 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:00:23.350 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:00:23.351 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:00:23.351 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:00:23.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 10 monclient: get_monmap_and_config 2026-02-17T12:00:23.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 10 monclient: monmap: 2026-02-17T12:00:23.422 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:23.419268+0000 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:23.419268+0000 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:23.423 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 1 Processor -- start 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 1 -- start start 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.418+0000 7fc5d21fb640 10 monclient: init 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-b con 0x7fc5cc06c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc5cc0a0570 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5cc13d360 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc0a25a0 con 0x7fc5cc13d360 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc0a19f0 con 0x7fc5cc0a0570 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc5cc0a09f0 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5d21fb640 10 monclient(hunting): authenticate will time out at 1511.038109s 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39042/0 (socket says 10.20.193.51:39042) 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2075474798 learned_addr learned my addr 10.20.193.51:0/2075474798 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): get_auth_request con 0x7fc5cc06c8d0 auth_method 0 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_done global_id 194123 payload 274 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2075474798 >> v1:10.20.193.142:6789/0 conn(0x7fc5cc0a0570 legacy=0x7fc5cc06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2075474798 >> v1:10.20.193.51:6789/0 conn(0x7fc5cc13d360 legacy=0x7fc5cc13f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 monclient: found mon.noname-b 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.419+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2075474798 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc0a0c30 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.421+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2075474798 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 msgr2=0x7fc5cc06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.421+0000 7fc5cb7fe640 1 --2- 10.20.193.51:0/2075474798 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80099a0 tx=0x7fc5b802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1667bedf92204b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 1 -- 10.20.193.51:0/2075474798 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b803c070 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: dump: 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.439 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 1 -- 10.20.193.51:0/2075474798 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b802fdf0 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 5 monclient: authenticate success, global_id 194123 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 1 -- 10.20.193.51:0/2075474798 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8037660 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5ca7fc640 10 monclient: dump: 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.441 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 4 set_mon_vals no callback set 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 10 monclient: shutdown 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2075474798 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 msgr2=0x7fc5cc06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2075474798 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80099a0 tx=0x7fc5b802ee90 comp rx=0 tx=0).stop 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2075474798 shutdown_connections 2026-02-17T12:00:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2075474798 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc06ccb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2075474798 >> 10.20.193.51:0/2075474798 conn(0x7fc5cc0aab70 msgr2=0x7fc5cc0aaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2075474798 shutdown_connections 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2075474798 wait complete. 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 10 monclient: monmap: 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 Processor -- start 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 1 -- start start 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.422+0000 7fc5d21fb640 10 monclient: init 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-c con 0x7fc5cc06c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc0a0570 0x7fc5cc13c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-a con 0x7fc5cc0a0570 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5cc13d360 0x7fc5cc13cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): picked mon.noname-b con 0x7fc5cc13d360 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc0a1120 con 0x7fc5cc0a0570 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc0a0fa0 con 0x7fc5cc13d360 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc5cc140e70 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5d21fb640 10 monclient(hunting): authenticate will time out at 1511.042166s 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc0a0570 0x7fc5cc13c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39046/0 (socket says 10.20.193.51:39046) 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2445560735 learned_addr learned my addr 10.20.193.51:0/2445560735 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): get_auth_request con 0x7fc5cc06c8d0 auth_method 0 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): get_auth_request con 0x7fc5cc0a0570 auth_method 0 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cbfff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5cc13d360 0x7fc5cc13cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cbfff640 10 monclient(hunting): get_auth_request con 0x7fc5cc13d360 auth_method 0 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient(hunting): handle_auth_done global_id 194126 payload 824 2026-02-17T12:00:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5cc13d360 msgr2=0x7fc5cc13cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc5cc13d360 0x7fc5cc13cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc0a0570 msgr2=0x7fc5cc13c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc0a0570 0x7fc5cc13c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 monclient: found mon.noname-c 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.423+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc0a1d60 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5cb7fe640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 msgr2=0x7fc5cc1cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5cb7fe640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80099a0 tx=0x7fc5b80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8046070 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: dump: 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b8041660 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 5 monclient: authenticate success, global_id 194126 2026-02-17T12:00:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 10 monclient: _renew_subs 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc123c60 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b803c040 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5c9ffb640 4 set_mon_vals no callback set 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5a7fff640 10 monclient: dump: 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.451 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 10 monclient: _renew_subs 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.425+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5cc125f50 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc5b8041a50 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5d21fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 0x7fc5cc1223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1258f0 con 0x7fc5cc122010 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 0x7fc5cc1223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient: get_auth_request con 0x7fc5cc122010 auth_method 0 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5a7fff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc59c03dd60 0x7fc59c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(539..539 src has 323..539) ==== 4779+0+0 (secure 0 0 0) 0x7fc5b8077de0 con 0x7fc5cc06c8d0 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 10 monclient(hunting): handle_auth_done global_id 164466 payload 824 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5caffd640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5cc0a1390 con 0x7fc5cc122010 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5cbfff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc59c03dd60 0x7fc59c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.426+0000 7fc5cbfff640 10 monclient: get_auth_request con 0x7fc59c03dd60 auth_method 0 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5caffd640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 msgr2=0x7fc5cc1223f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5caffd640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 0x7fc5cc1223f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00f7a0 tx=0x7fc5bc00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc018030 con 0x7fc5cc122010 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.428+0000 7fc5a7fff640 10 monclient: dump: 2026-02-17T12:00:23.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc5bc00dbc0 con 0x7fc5cc122010 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 msgr2=0x7fc5cc1223f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 0x7fc5cc1223f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00f7a0 tx=0x7fc5bc00fc70 comp rx=0 tx=0).stop 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 msgr2=0x7fc5cc1223f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5a7fff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122010 0x7fc5cc1223f0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00f7a0 tx=0x7fc5bc00fc70 comp rx=0 tx=0).stop 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.429+0000 7fc5cbfff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc59c03dd60 0x7fc59c040220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc124220 tx=0x7fc5c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5d21fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 0x7fc5cc1da4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5d21fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc06ccb0 con 0x7fc5cc122930 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 0x7fc5cc1da4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient: get_auth_request con 0x7fc5cc122930 auth_method 0 2026-02-17T12:00:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 10 monclient(hunting): handle_auth_done global_id 164469 payload 824 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.432+0000 7fc5caffd640 1 -- 10.20.193.51:0/2445560735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5cc140a80 con 0x7fc5cc122930 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5caffd640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 msgr2=0x7fc5cc1da4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5caffd640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 0x7fc5cc1da4d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc018000 tx=0x7fc5bc003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc004230 con 0x7fc5cc122930 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 10 monclient: dump: 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7fc5bc004230 con 0x7fc5cc122930 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 msgr2=0x7fc5cc1da4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 0x7fc5cc1da4d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc018000 tx=0x7fc5bc003860 comp rx=0 tx=0).stop 2026-02-17T12:00:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 msgr2=0x7fc5cc1da4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.434+0000 7fc5a7fff640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc5cc122930 0x7fc5cc1da4d0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc018000 tx=0x7fc5bc003860 comp rx=0 tx=0).stop 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:23.459 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 167872, 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.460 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.461 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:23.462 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.463 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.464 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.468 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.469 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:23.470 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc59c03dd60 msgr2=0x7fc59c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc59c03dd60 0x7fc59c040220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc124220 tx=0x7fc5c0009040 comp rx=0 tx=0).stop 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 10 monclient: shutdown 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 msgr2=0x7fc5cc1cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80099a0 tx=0x7fc5b80047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5cbfff640 1 -- 10.20.193.51:0/2445560735 reap_dead start 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 shutdown_connections 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 --2- 10.20.193.51:0/2445560735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc5cc06c8d0 0x7fc5cc1cf140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 >> 10.20.193.51:0/2445560735 conn(0x7fc5cc0aab70 msgr2=0x7fc5cc0a75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 shutdown_connections 2026-02-17T12:00:23.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.435+0000 7fc5d21fb640 1 -- 10.20.193.51:0/2445560735 wait complete. 2026-02-17T12:00:23.472 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:23.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:00:23.472 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:00:23.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.538+0000 7fe3f04e8640 10 monclient: get_monmap_and_config 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.538+0000 7fe3f04e8640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.538+0000 7fe3f04e8640 10 monclient: monmap: 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:23.539947+0000 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:23.539947+0000 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:23.541 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:23.542 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:23.542 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:23.542 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.539+0000 7fe3f04e8640 1 Processor -- start 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.539+0000 7fe3f04e8640 1 -- start start 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.539+0000 7fe3f04e8640 10 monclient: init 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.539+0000 7fe3f04e8640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.539+0000 7fe3f04e8640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe3e8138600 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 0x7fe3e813d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-b con 0x7fe3e80a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe3e813d8a0 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e80a1df0 con 0x7fe3e813d8a0 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e80a65b0 con 0x7fe3e8138600 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80a6830 con 0x7fe3e80a35a0 2026-02-17T12:00:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3f04e8640 10 monclient(hunting): authenticate will time out at 1511.159065s 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 0x7fe3e813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eea5e640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe3e813d8a0 0x7fe3e813fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39322/0 (socket says 10.20.193.51:39322) 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eea5e640 1 -- 10.20.193.51:0/2292565252 learned_addr learned my addr 10.20.193.51:0/2292565252 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): get_auth_request con 0x7fe3e80a35a0 auth_method 0 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_done global_id 194129 payload 274 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 1 -- 10.20.193.51:0/2292565252 >> v1:10.20.193.142:6789/0 conn(0x7fe3e8138600 legacy=0x7fe3e81389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 1 -- 10.20.193.51:0/2292565252 >> v1:10.20.193.51:6789/0 conn(0x7fe3e813d8a0 legacy=0x7fe3e813fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 1 monclient: found mon.noname-b 2026-02-17T12:00:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.540+0000 7fe3eda5c640 1 -- 10.20.193.51:0/2292565252 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e80a22d0 con 0x7fe3e80a35a0 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3eda5c640 1 -- 10.20.193.51:0/2292565252 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 msgr2=0x7fe3e813d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3eda5c640 1 --2- 10.20.193.51:0/2292565252 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 0x7fe3e813d360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0098d0 tx=0x7fe3dc02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7565f24d9a777391 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 1 -- 10.20.193.51:0/2292565252 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc03c070 con 0x7fe3e80a35a0 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: dump: 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.551 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 1 -- 10.20.193.51:0/2292565252 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc02fd20 con 0x7fe3e80a35a0 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 1 -- 10.20.193.51:0/2292565252 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc037660 con 0x7fe3e80a35a0 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3ed25b640 10 monclient: dump: 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.552 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3f04e8640 5 monclient: authenticate success, global_id 194129 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3f04e8640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.542+0000 7fe3f04e8640 4 set_mon_vals no callback set 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 10 monclient: shutdown 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 -- 10.20.193.51:0/2292565252 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 msgr2=0x7fe3e813d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/2292565252 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 0x7fe3e813d360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0098d0 tx=0x7fe3dc02edc0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 -- 10.20.193.51:0/2292565252 shutdown_connections 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/2292565252 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80a35a0 0x7fe3e813d360 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 -- 10.20.193.51:0/2292565252 >> 10.20.193.51:0/2292565252 conn(0x7fe3e80a7460 msgr2=0x7fe3e80a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 -- 10.20.193.51:0/2292565252 shutdown_connections 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 1 -- 10.20.193.51:0/2292565252 wait complete. 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.543+0000 7fe3f04e8640 10 monclient: monmap: 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 Processor -- start 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 -- start start 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient: init 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3e80a35a0 0x7fe3e81cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-b con 0x7fe3e80a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-a con 0x7fe3e8138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e813d8a0 0x7fe3e8137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): picked mon.noname-c con 0x7fe3e813d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80a15f0 con 0x7fe3e8138600 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80a2c00 con 0x7fe3e80a35a0 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80a1770 con 0x7fe3e813d8a0 2026-02-17T12:00:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3f04e8640 10 monclient(hunting): authenticate will time out at 1511.163353s 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e813d8a0 0x7fe3e8137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48812/0 (socket says 10.20.193.51:48812) 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 -- 10.20.193.51:0/814727168 learned_addr learned my addr 10.20.193.51:0/814727168 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): get_auth_request con 0x7fe3e8138600 auth_method 0 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): get_auth_request con 0x7fe3e813d8a0 auth_method 0 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient(hunting): handle_auth_done global_id 164472 payload 824 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e813d8a0 msgr2=0x7fe3e8137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e813d8a0 0x7fe3e8137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3e80a35a0 msgr2=0x7fe3e81cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe3e80a35a0 0x7fe3e81cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 monclient: found mon.noname-a 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eda5c640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8121050 con 0x7fe3e8138600 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.544+0000 7fe3eea5e640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e813d8a0 0x7fe3e8137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:00:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3eda5c640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 msgr2=0x7fe3e81376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3eda5c640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009820 tx=0x7fe3dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc046070 con 0x7fe3e8138600 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: dump: 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 5 monclient: authenticate success, global_id 164472 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc041870 con 0x7fe3e8138600 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc03c040 con 0x7fe3e8138600 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 10 monclient: _renew_subs 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3eca5a640 4 set_mon_vals no callback set 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e8074b30 con 0x7fe3e8138600 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3ceffd640 10 monclient: dump: 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.559 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 10 monclient: _renew_subs 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.546+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e8072b20 con 0x7fe3e8138600 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3f04e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 0x7fe3e8071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80a70a0 con 0x7fe3e8070e80 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 0x7fe3e8071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient: get_auth_request con 0x7fe3e8070e80 auth_method 0 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe3dc041c60 con 0x7fe3e8138600 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_done global_id 194135 payload 824 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ee25d640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3e81389e0 con 0x7fe3e8070e80 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ceffd640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3b803dd10 0x7fe3b80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(539..539 src has 323..539) ==== 4779+0+0 (secure 0 0 0) 0x7fe3dc077ec0 con 0x7fe3e8138600 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3eea5e640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3b803dd10 0x7fe3b80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.547+0000 7fe3eea5e640 10 monclient: get_auth_request con 0x7fe3b803dd10 auth_method 0 2026-02-17T12:00:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ee25d640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 msgr2=0x7fe3e8071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ee25d640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 0x7fe3e8071260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c390 tx=0x7fe3d800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8011a80 con 0x7fe3e8070e80 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 10 monclient: dump: 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fe3d8017070 con 0x7fe3e8070e80 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 msgr2=0x7fe3e8071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 0x7fe3e8071260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c390 tx=0x7fe3d800c860 comp rx=0 tx=0).stop 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 msgr2=0x7fe3e8071260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.549+0000 7fe3ceffd640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e8070e80 0x7fe3e8071260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.550+0000 7fe3eea5e640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3b803dd10 0x7fe3b80401d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4005d00 tx=0x7fe3e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.552+0000 7fe3f04e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.552+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 0x7fe3e81daa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.552+0000 7fe3f04e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.552+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e8069780 con 0x7fe3e80717a0 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 0x7fe3e81daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient: get_auth_request con 0x7fe3e80717a0 auth_method 0 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 10 monclient(hunting): handle_auth_done global_id 194138 payload 824 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.553+0000 7fe3ee25d640 1 -- 10.20.193.51:0/814727168 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3e8071bb0 con 0x7fe3e80717a0 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ee25d640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 msgr2=0x7fe3e81daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ee25d640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 0x7fe3e81daa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c390 tx=0x7fe3d8003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d801caf0 con 0x7fe3e80717a0 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 10 monclient: dump: 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.566 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fe3d801caf0 con 0x7fe3e80717a0 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 msgr2=0x7fe3e81daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 0x7fe3e81daa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c390 tx=0x7fe3d8003860 comp rx=0 tx=0).stop 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 msgr2=0x7fe3e81daa80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3ceffd640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3e80717a0 0x7fe3e81daa80 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c390 tx=0x7fe3d8003860 comp rx=0 tx=0).stop 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:23.567 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12493, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:23.568 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:23.569 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:23.570 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.571 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:23.572 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.573 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.574 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:23.575 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.576 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:23.577 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3b803dd10 msgr2=0x7fe3b80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe3b803dd10 0x7fe3b80401d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4005d00 tx=0x7fe3e4009040 comp rx=0 tx=0).stop 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 10 monclient: shutdown 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 msgr2=0x7fe3e81376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009820 tx=0x7fe3dc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3eea5e640 1 -- 10.20.193.51:0/814727168 reap_dead start 2026-02-17T12:00:23.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 shutdown_connections 2026-02-17T12:00:23.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 --2- 10.20.193.51:0/814727168 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3e8138600 0x7fe3e81376d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 >> 10.20.193.51:0/814727168 conn(0x7fe3e80a7460 msgr2=0x7fe3e80aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 shutdown_connections 2026-02-17T12:00:23.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.555+0000 7fe3f04e8640 1 -- 10.20.193.51:0/814727168 wait complete. 2026-02-17T12:00:23.579 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:23.579 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:00:23.579 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2314: done (3 left) 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2316: done (2 left) 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2317: done (1 left) 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2318: done (0 left) 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2319: write oid 10 current snap is 253 2026-02-17T12:00:23.602 INFO:tasks.rados.rados.0.trial142.stdout:2319: seq_num 804 ranges {712828=717261,1915052=718936,3212792=300036} 2026-02-17T12:00:23.607 INFO:tasks.rados.rados.0.trial142.stdout:2319: writing trial14245205-10 from 712828 to 1430089 tid 1 2026-02-17T12:00:23.611 INFO:tasks.rados.rados.0.trial142.stdout:2319: writing trial14245205-10 from 1915052 to 2633988 tid 2 2026-02-17T12:00:23.614 INFO:tasks.rados.rados.0.trial142.stdout:2319: writing trial14245205-10 from 3212792 to 3512828 tid 3 2026-02-17T12:00:23.615 INFO:tasks.rados.rados.0.trial142.stdout:2320: read oid 13 snap -1 2026-02-17T12:00:23.615 INFO:tasks.rados.rados.0.trial142.stdout:2320: expect (ObjNum 777 snap 246 seq_num 777) 2026-02-17T12:00:23.615 INFO:tasks.rados.rados.0.trial142.stdout:2321: write oid 23 current snap is 253 2026-02-17T12:00:23.615 INFO:tasks.rados.rados.0.trial142.stdout:2321: seq_num 805 ranges {729635=792510,1973534=578947,3240215=289420} 2026-02-17T12:00:23.620 INFO:tasks.rados.rados.0.trial142.stdout:2321: writing trial14245205-23 from 729635 to 1522145 tid 1 2026-02-17T12:00:23.624 INFO:tasks.rados.rados.0.trial142.stdout:2321: writing trial14245205-23 from 1973534 to 2552481 tid 2 2026-02-17T12:00:23.628 INFO:tasks.rados.rados.0.trial142.stdout:2321: writing trial14245205-23 from 3240215 to 3529635 tid 3 2026-02-17T12:00:23.628 INFO:tasks.rados.rados.0.trial142.stdout:2322: rollback oid 35 current snap is 253 2026-02-17T12:00:23.628 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 252 2026-02-17T12:00:23.628 INFO:tasks.rados.rados.0.trial142.stdout:2319: finishing write tid 1 to trial14245205-10 2026-02-17T12:00:23.628 INFO:tasks.rados.rados.0.trial142.stdout:2319: finishing write tid 2 to trial14245205-10 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: finishing write tid 3 to trial14245205-10 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: finishing write tid 4 to trial14245205-10 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: finishing write tid 5 to trial14245205-10 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: oid 10 updating version 0 to 1960 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: oid 10 updating version 1960 to 1961 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: oid 10 updating version 1961 to 1963 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: oid 10 version 1963 is already newer than 1962 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 1963 (ObjNum 804 snap 253 seq_num 804) dirty exists 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2319: left oid 10 (ObjNum 804 snap 253 seq_num 804) 2026-02-17T12:00:23.629 INFO:tasks.rados.rados.0.trial142.stdout:2320: expect (ObjNum 777 snap 246 seq_num 777) 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 10 monclient: get_monmap_and_config 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 10 monclient: monmap: 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:23.651258+0000 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:23.651258+0000 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:23.652 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:23.653 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:23.653 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 1 Processor -- start 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 1 -- start start 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.650+0000 7ffa1791b640 10 monclient: init 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffa100a3bb0 0x7ffa1009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-a con 0x7ffa100a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:23.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffa1009dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ffa100a0110 0x7ffa1013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-c con 0x7ffa100a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1006e140 con 0x7ffa1009dac0 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1009aed0 con 0x7ffa100a3bb0 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1009caa0 con 0x7ffa100a0110 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa1791b640 10 monclient(hunting): authenticate will time out at 1511.270281s 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffa100a3bb0 0x7ffa1009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffa100a3bb0 0x7ffa1009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48828/0 (socket says 10.20.193.51:48828) 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 -- 10.20.193.51:0/2212698691 learned_addr learned my addr 10.20.193.51:0/2212698691 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): get_auth_request con 0x7ffa100a3bb0 auth_method 0 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15e91640 1 --2- 10.20.193.51:0/2212698691 >> v2:10.20.193.142:3300/0 conn(0x7ffa100a0110 0x7ffa1013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15e91640 10 monclient(hunting): get_auth_request con 0x7ffa100a0110 auth_method 0 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15e91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15e91640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15e91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient(hunting): handle_auth_done global_id 164475 payload 274 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 -- 10.20.193.51:0/2212698691 >> v2:10.20.193.142:3300/0 conn(0x7ffa100a0110 msgr2=0x7ffa1013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 --2- 10.20.193.51:0/2212698691 >> v2:10.20.193.142:3300/0 conn(0x7ffa100a0110 0x7ffa1013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 -- 10.20.193.51:0/2212698691 >> v1:10.20.193.142:6789/0 conn(0x7ffa1009dac0 legacy=0x7ffa1009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 monclient: found mon.noname-a 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.651+0000 7ffa15690640 1 -- 10.20.193.51:0/2212698691 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1009ce60 con 0x7ffa100a3bb0 2026-02-17T12:00:23.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.653+0000 7ffa15690640 1 -- 10.20.193.51:0/2212698691 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 msgr2=0x7ffa1009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.653+0000 7ffa15690640 1 --2- 10.20.193.51:0/2212698691 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa1009f4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa1009cc20 tx=0x7ffa0002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17739c98f0c3818 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 1 -- 10.20.193.51:0/2212698691 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0003c070 con 0x7ffa100a3bb0 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: dump: 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.669 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 5 monclient: authenticate success, global_id 164475 2026-02-17T12:00:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 1 -- 10.20.193.51:0/2212698691 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0002fc90 con 0x7ffa100a3bb0 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 1 -- 10.20.193.51:0/2212698691 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00037660 con 0x7ffa100a3bb0 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 4 set_mon_vals no callback set 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ff9fffff640 10 monclient: dump: 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.671 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 10 monclient: shutdown 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 -- 10.20.193.51:0/2212698691 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 msgr2=0x7ffa1009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 --2- 10.20.193.51:0/2212698691 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa1009f4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa1009cc20 tx=0x7ffa0002ee10 comp rx=0 tx=0).stop 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 -- 10.20.193.51:0/2212698691 shutdown_connections 2026-02-17T12:00:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 --2- 10.20.193.51:0/2212698691 >> v2:10.20.193.142:3300/0 conn(0x7ffa100a0110 0x7ffa1013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 --2- 10.20.193.51:0/2212698691 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa1009f4c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 -- 10.20.193.51:0/2212698691 >> 10.20.193.51:0/2212698691 conn(0x7ffa100a30c0 msgr2=0x7ffa100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 -- 10.20.193.51:0/2212698691 shutdown_connections 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 1 -- 10.20.193.51:0/2212698691 wait complete. 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.654+0000 7ffa1791b640 10 monclient: monmap: 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:23.673 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:23.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 Processor -- start 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 -- start start 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient: init 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa1009dac0 0x7ffa10090d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-c con 0x7ffa1009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa100a0110 0x7ffa100998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-b con 0x7ffa100a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa10099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): picked mon.noname-a con 0x7ffa100a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100a0540 con 0x7ffa100a3bb0 2026-02-17T12:00:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1009a880 con 0x7ffa100a0110 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1009e370 con 0x7ffa1009dac0 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa1791b640 10 monclient(hunting): authenticate will time out at 1511.274528s 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa10099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa1009dac0 0x7ffa10090d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa10099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48832/0 (socket says 10.20.193.51:48832) 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 learned_addr learned my addr 10.20.193.51:0/95232343 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): get_auth_request con 0x7ffa100a3bb0 auth_method 0 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): get_auth_request con 0x7ffa1009dac0 auth_method 0 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa14e8f640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa100a0110 0x7ffa100998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient(hunting): handle_auth_done global_id 164478 payload 824 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa1009dac0 msgr2=0x7ffa10090d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa1009dac0 0x7ffa10090d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa100a0110 msgr2=0x7ffa100998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa100a0110 0x7ffa100998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 monclient: found mon.noname-a 2026-02-17T12:00:23.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1009a360 con 0x7ffa100a3bb0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa14e8f640 10 monclient: get_auth_request con 0x7ffa100a0110 auth_method 0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa14e8f640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa100a0110 0x7ffa100998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.655+0000 7ffa15690640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffa1009dac0 0x7ffa10090d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 msgr2=0x7ffa10099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ffa15e91640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa10099e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c007dc0 tx=0x7ffa0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c014620 con 0x7ffa100a3bb0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ff9fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ff9fdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.657+0000 7ff9fdffb640 10 monclient: dump: 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.681 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 5 monclient: authenticate success, global_id 164478 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c019070 con 0x7ffa100a3bb0 2026-02-17T12:00:23.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 monclient: _renew_subs 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa10092be0 con 0x7ffa100a3bb0 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c014a00 con 0x7ffa100a3bb0 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 10 monclient: dump: 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.683 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9ff7fe640 4 set_mon_vals no callback set 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 monclient: _renew_subs 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa100923f0 con 0x7ffa100a3bb0 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ffa0c014ba0 con 0x7ffa100a3bb0 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 0x7ffa101cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1009e780 con 0x7ffa101caa30 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 0x7ffa101cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff9e003dd10 0x7ff9e00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient: get_auth_request con 0x7ffa101caa30 auth_method 0 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7ffa0c052d50 con 0x7ffa100a3bb0 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.658+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.659+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.659+0000 7ffa14e8f640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff9e003dd10 0x7ff9e00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.659+0000 7ffa14e8f640 10 monclient: get_auth_request con 0x7ff9e003dd10 auth_method 0 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.659+0000 7ffa15690640 10 monclient(hunting): handle_auth_done global_id 184195 payload 824 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.659+0000 7ffa15690640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa10069830 con 0x7ffa101caa30 2026-02-17T12:00:23.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ffa15690640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 msgr2=0x7ffa101cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ffa15690640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 0x7ffa101cae10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa1006dc20 tx=0x7ffa000047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0003c050 con 0x7ffa101caa30 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 10 monclient: dump: 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ffa14e8f640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff9e003dd10 0x7ff9e00401d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa10091ef0 tx=0x7ffa04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ffa00037e50 con 0x7ffa101caa30 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 msgr2=0x7ffa101cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 0x7ffa101cae10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa1006dc20 tx=0x7ffa000047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 msgr2=0x7ffa101cae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.661+0000 7ff9fdffb640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101caa30 0x7ffa101cae10 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa1006dc20 tx=0x7ffa000047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa1791b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa1791b640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 0x7ffa101d5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa1791b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10050ac0 con 0x7ffa101cb350 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 0x7ffa101d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient: get_auth_request con 0x7ffa101cb350 auth_method 0 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 10 monclient(hunting): handle_auth_done global_id 184198 payload 824 2026-02-17T12:00:23.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.665+0000 7ffa15690640 1 -- 10.20.193.51:0/95232343 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffa101cb760 con 0x7ffa101cb350 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.667+0000 7ffa15690640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 msgr2=0x7ffa101d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.667+0000 7ffa15690640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 0x7ffa101d5d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa0002ee50 tx=0x7ffa00009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0004ab40 con 0x7ffa101cb350 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 10 monclient: dump: 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.689 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7ffa0003d040 con 0x7ffa101cb350 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 msgr2=0x7ffa101d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 0x7ffa101d5d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa0002ee50 tx=0x7ffa00009340 comp rx=0 tx=0).stop 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 msgr2=0x7ffa101d5d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ff9fdffb640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffa101cb350 0x7ffa101d5d80 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa0002ee50 tx=0x7ffa00009340 comp rx=0 tx=0).stop 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:23.690 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 140, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 56054, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.691 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.692 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:23.693 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.694 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.695 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:23.696 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.697 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.698 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:23.699 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff9e003dd10 msgr2=0x7ff9e00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff9e003dd10 0x7ff9e00401d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa10091ef0 tx=0x7ffa04009040 comp rx=0 tx=0).stop 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 10 monclient: shutdown 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 msgr2=0x7ffa10099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 --2- 10.20.193.51:0/95232343 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffa100a3bb0 0x7ffa10099e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c007dc0 tx=0x7ffa0c00e4b0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 reap_dead start 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa15e91640 1 -- 10.20.193.51:0/95232343 reap_dead start 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 shutdown_connections 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 >> 10.20.193.51:0/95232343 conn(0x7ffa100a30c0 msgr2=0x7ffa10071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 shutdown_connections 2026-02-17T12:00:23.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.668+0000 7ffa1791b640 1 -- 10.20.193.51:0/95232343 wait complete. 2026-02-17T12:00:23.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:00:23.701 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T12:00:23.701 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:00:23.701 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T12:00:23.701 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:00:23.701 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:00:23.701 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: finishing write tid 1 to trial14245205-23 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: finishing write tid 2 to trial14245205-23 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: finishing write tid 3 to trial14245205-23 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: finishing write tid 4 to trial14245205-23 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: finishing write tid 5 to trial14245205-23 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: oid 23 updating version 0 to 1967 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: oid 23 version 1967 is already newer than 1966 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: oid 23 version 1967 is already newer than 1965 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: oid 23 version 1967 is already newer than 1964 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1967 (ObjNum 805 snap 253 seq_num 805) dirty exists 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: left oid 23 (ObjNum 805 snap 253 seq_num 805) 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2322: finishing rollback tid 1 to trial14245205-35 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 0 (ObjNum 289 snap 0 seq_num 321784728) dirty dne 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2319: done (3 left) 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2320: done (2 left) 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2321: done (1 left) 2026-02-17T12:00:23.702 INFO:tasks.rados.rados.0.trial142.stdout:2322: done (0 left) 2026-02-17T12:00:23.703 INFO:tasks.rados.rados.0.trial142.stdout:2323: delete oid 37 current snap is 253 2026-02-17T12:00:23.703 INFO:tasks.rados.rados.0.trial142.stdout:2323: done (0 left) 2026-02-17T12:00:23.703 INFO:tasks.rados.rados.0.trial142.stdout:2324: write oid 2 current snap is 253 2026-02-17T12:00:23.703 INFO:tasks.rados.rados.0.trial142.stdout:2324: seq_num 807 ranges {763249=659361,2090498=582616,3295061=268188} 2026-02-17T12:00:23.707 INFO:tasks.rados.rados.0.trial142.stdout:2324: writing trial14245205-2 from 763249 to 1422610 tid 1 2026-02-17T12:00:23.711 INFO:tasks.rados.rados.0.trial142.stdout:2324: writing trial14245205-2 from 2090498 to 2673114 tid 2 2026-02-17T12:00:23.712 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:00:23.712 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:00:23.712 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2324: writing trial14245205-2 from 3295061 to 3563249 tid 3 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2325: copy_from oid 1 from oid 23 current snap is 253 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2324: finishing write tid 1 to trial14245205-2 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2324: finishing write tid 2 to trial14245205-2 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2326: write (excl) oid 48 current snap is 253 2026-02-17T12:00:23.715 INFO:tasks.rados.rados.0.trial142.stdout:2326: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2026-02-17T12:00:23.721 INFO:tasks.rados.rados.0.trial142.stdout:2326: writing trial14245205-48 from 780056 to 1514666 tid 1 2026-02-17T12:00:23.726 INFO:tasks.rados.rados.0.trial142.stdout:2326: writing trial14245205-48 from 2148980 to 2875254 tid 2 2026-02-17T12:00:23.728 INFO:tasks.rados.rados.0.trial142.stdout:2326: writing trial14245205-48 from 3322484 to 3580056 tid 3 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2327: snap_create 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: finishing write tid 3 to trial14245205-2 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: finishing write tid 4 to trial14245205-2 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: finishing write tid 5 to trial14245205-2 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: oid 2 updating version 0 to 1240 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: oid 2 version 1240 is already newer than 1237 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: oid 2 version 1240 is already newer than 1238 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: oid 2 version 1240 is already newer than 1239 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1240 (ObjNum 807 snap 253 seq_num 807) dirty exists 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2324: left oid 2 (ObjNum 807 snap 253 seq_num 807) 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2325: finishing copy_from racing read to trial14245205-1 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2326: finishing write tid 1 to trial14245205-48 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2325: finishing copy_from to trial14245205-1 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1967 (ObjNum 805 snap 253 seq_num 805) dirty exists 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2326: finishing write tid 2 to trial14245205-48 2026-02-17T12:00:23.729 INFO:tasks.rados.rados.0.trial142.stdout:2326: finishing write tid 3 to trial14245205-48 2026-02-17T12:00:23.730 INFO:tasks.rados.rados.0.trial142.stdout:2326: finishing write tid 4 to trial14245205-48 2026-02-17T12:00:23.730 INFO:tasks.rados.rados.0.trial142.stdout:2326: finishing write tid 5 to trial14245205-48 2026-02-17T12:00:23.730 INFO:tasks.rados.rados.0.trial142.stdout:2326: oid 48 updating version 0 to 1618 2026-02-17T12:00:23.730 INFO:tasks.rados.rados.0.trial142.stdout:2326: oid 48 version 1618 is already newer than 1617 2026-02-17T12:00:23.730 INFO:tasks.rados.rados.0.trial142.stdout:2326: oid 48 version 1618 is already newer than 1616 2026-02-17T12:00:23.731 INFO:tasks.rados.rados.0.trial142.stdout:2326: oid 48 updating version 1618 to 1619 2026-02-17T12:00:23.731 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1619 (ObjNum 808 snap 253 seq_num 808) dirty exists 2026-02-17T12:00:23.731 INFO:tasks.rados.rados.0.trial142.stdout:2326: left oid 48 (ObjNum 808 snap 253 seq_num 808) 2026-02-17T12:00:23.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: get_monmap_and_config 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: monmap: 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:23.820289+0000 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:23.820289+0000 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:23.824 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 1 Processor -- start 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 1 -- start start 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: init 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.819+0000 7f4089379640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 0x7f408409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): picked mon.noname-a con 0x7f40840a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:23.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f40840a0750 0x7f408409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): picked mon.noname-c con 0x7f40840a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f408409e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f408406e140 con 0x7f408409e540 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f40840a3f90 con 0x7f40840a3bb0 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f408409f910 con 0x7f40840a0750 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4089379640 10 monclient(hunting): authenticate will time out at 1511.439049s 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4082ffd640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 msgr2=0x7f408409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f4082ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 0x7f408409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:23.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f40840a0750 0x7f408409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f40840a0750 0x7f408409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:51120/0 (socket says 10.20.193.51:51120) 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 -- 10.20.193.51:0/1037751869 learned_addr learned my addr 10.20.193.51:0/1037751869 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): get_auth_request con 0x7f40840a0750 auth_method 0 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient(hunting): handle_auth_done global_id 184201 payload 274 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 -- 10.20.193.51:0/1037751869 >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 msgr2=0x7f408409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:23.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 --2- 10.20.193.51:0/1037751869 >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 0x7f408409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 -- 10.20.193.51:0/1037751869 >> v1:10.20.193.142:6789/0 conn(0x7f408409e540 legacy=0x7f408413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 monclient: found mon.noname-c 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:00:23.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.820+0000 7f40827fc640 1 -- 10.20.193.51:0/1037751869 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408409ccd0 con 0x7f40840a0750 2026-02-17T12:00:23.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f40827fc640 1 -- 10.20.193.51:0/1037751869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a0750 msgr2=0x7f408409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f40827fc640 1 --2- 10.20.193.51:0/1037751869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a0750 0x7f408409e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f408406c1c0 tx=0x7f406c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446263bc1d7b5516 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 1 -- 10.20.193.51:0/1037751869 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c03c070 con 0x7f40840a0750 2026-02-17T12:00:23.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: dump: 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.836 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 5 monclient: authenticate success, global_id 184201 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 1 -- 10.20.193.51:0/1037751869 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406c02fd70 con 0x7f40840a0750 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 1 -- 10.20.193.51:0/1037751869 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c037660 con 0x7f40840a0750 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4081ffb640 10 monclient: dump: 2026-02-17T12:00:23.837 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 4 set_mon_vals no callback set 2026-02-17T12:00:23.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 10 monclient: shutdown 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 -- 10.20.193.51:0/1037751869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a0750 msgr2=0x7f408409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 --2- 10.20.193.51:0/1037751869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a0750 0x7f408409e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f408406c1c0 tx=0x7f406c02ee10 comp rx=0 tx=0).stop 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 -- 10.20.193.51:0/1037751869 shutdown_connections 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 --2- 10.20.193.51:0/1037751869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a0750 0x7f408409e000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 --2- 10.20.193.51:0/1037751869 >> v2:10.20.193.51:3300/0 conn(0x7f40840a3bb0 0x7f408409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 -- 10.20.193.51:0/1037751869 >> 10.20.193.51:0/1037751869 conn(0x7f40840a30c0 msgr2=0x7f40840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 -- 10.20.193.51:0/1037751869 shutdown_connections 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.823+0000 7f4089379640 1 -- 10.20.193.51:0/1037751869 wait complete. 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient: build_initial_monmap 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient: monmap: 2026-02-17T12:00:23.839 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 Processor -- start 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 -- start start 2026-02-17T12:00:23.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient: init 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 0x7f4084099be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): picked mon.noname-a con 0x7f408409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): picked mon.noname-c con 0x7f40840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a3bb0 0x7f408412bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): picked mon.noname-b con 0x7f40840a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f40840a04b0 con 0x7f408409e540 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f408409c850 con 0x7f40840a3bb0 2026-02-17T12:00:23.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f408413de80 con 0x7f40840a0750 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4082ffd640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 msgr2=0x7f4084099be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4089379640 10 monclient(hunting): authenticate will time out at 1511.443756s 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f4082ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 0x7f4084099be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39116/0 (socket says 10.20.193.51:39116) 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 1 -- 10.20.193.51:0/1497443447 learned_addr learned my addr 10.20.193.51:0/1497443447 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): get_auth_request con 0x7f40840a0750 auth_method 0 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40837fe640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a3bb0 0x7f408412bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40837fe640 10 monclient(hunting): get_auth_request con 0x7f40840a3bb0 auth_method 0 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.824+0000 7f40827fc640 10 monclient(hunting): handle_auth_done global_id 194144 payload 824 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 -- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a3bb0 msgr2=0x7f408412bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a3bb0 0x7f408412bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 -- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 msgr2=0x7f4084099be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:23.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 0x7f4084099be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 monclient: found mon.noname-c 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.825+0000 7f40827fc640 1 -- 10.20.193.51:0/1497443447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408412f0e0 con 0x7f40840a0750 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40827fc640 1 -- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 msgr2=0x7f408412b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40827fc640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f406c009a40 tx=0x7f406c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c046020 con 0x7f40840a0750 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: dump: 2026-02-17T12:00:23.844 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:23.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406c042640 con 0x7f40840a0750 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c03c040 con 0x7f40840a0750 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40817fa640 4 set_mon_vals no callback set 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f40637fe640 10 monclient: dump: 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:23.846 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 5 monclient: authenticate success, global_id 194144 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _renew_subs 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408412f3c0 con 0x7f40840a0750 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _renew_subs 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f408406f7d0 con 0x7f40840a0750 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.827+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408409dac0 con 0x7f40840a0750 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.828+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f406c03f030 con 0x7f40840a0750 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.828+0000 7f40637fe640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 0x7f4050040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.828+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7f406c0776b0 con 0x7f40840a0750 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.828+0000 7f4082ffd640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 0x7f4050040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.828+0000 7f4082ffd640 10 monclient: get_auth_request con 0x7f405003dcc0 auth_method 0 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.830+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f406c050070 con 0x7f40840a0750 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.830+0000 7f40637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.830+0000 7f40637fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:23.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.831+0000 7f4082ffd640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 0x7f4050040180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4078003a80 tx=0x7f4078009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f4089379640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f4089379640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f4089379640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f408412fd80 con 0x7f40840a0750 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f40637fe640 1 -- 10.20.193.51:0/1497443447 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f406c040cc0 con 0x7f40840a0750 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f40637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:23.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.942+0000 7f40637fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:23.946 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:23.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 msgr2=0x7f4050040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 0x7f4050040180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4078003a80 tx=0x7f4078009270 comp rx=0 tx=0).stop 2026-02-17T12:00:23.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 10 monclient: shutdown 2026-02-17T12:00:23.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:23.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 msgr2=0x7f408412b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f406c009a40 tx=0x7f406c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 shutdown_connections 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f405003dcc0 0x7f4050040180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40840a3bb0 0x7f408412bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f40840a0750 0x7f408412b680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 --2- 10.20.193.51:0/1497443447 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f408409e540 0x7f4084099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 >> 10.20.193.51:0/1497443447 conn(0x7f40840a30c0 msgr2=0x7f4084072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 shutdown_connections 2026-02-17T12:00:23.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:23.943+0000 7f4089379640 1 -- 10.20.193.51:0/1497443447 wait complete. 2026-02-17T12:00:26.955 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:27.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.020+0000 7faf772fa640 10 monclient: get_monmap_and_config 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.020+0000 7faf772fa640 10 monclient: build_initial_monmap 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.020+0000 7faf772fa640 10 monclient: monmap: 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:27.021655+0000 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:27.021655+0000 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:27.026 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 Processor -- start 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 -- start start 2026-02-17T12:00:27.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient: init 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faf700a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7faf700a0750 0x7faf7009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-c con 0x7faf700a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faf7013b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7006e140 con 0x7faf7013b760 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7009f910 con 0x7faf700a3bb0 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf7009ccd0 con 0x7faf700a0750 2026-02-17T12:00:27.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf772fa640 10 monclient(hunting): authenticate will time out at 1514.640406s 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf75870640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7faf7013b760 legacy=0x7faf7013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7506f640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7faf700a3bb0 0x7faf7009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:46316/0 (socket says 10.20.193.51:46316) 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7506f640 1 -- 10.20.193.51:0/1004331845 learned_addr learned my addr 10.20.193.51:0/1004331845 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 1 --2- 10.20.193.51:0/1004331845 >> v2:10.20.193.142:3300/0 conn(0x7faf700a0750 0x7faf7009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): get_auth_request con 0x7faf700a0750 auth_method 0 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.021+0000 7faf7486e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 10 monclient(hunting): handle_auth_done global_id 184207 payload 274 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 1 -- 10.20.193.51:0/1004331845 >> v1:10.20.193.142:6789/0 conn(0x7faf700a3bb0 legacy=0x7faf7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 1 -- 10.20.193.51:0/1004331845 >> v1:10.20.193.51:6789/0 conn(0x7faf7013b760 legacy=0x7faf7013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 10 monclient: _finish_hunting 0 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 1 monclient: found mon.noname-c 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:00:27.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.022+0000 7faf7486e640 1 -- 10.20.193.51:0/1004331845 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7009eec0 con 0x7faf700a0750 2026-02-17T12:00:27.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf7486e640 1 -- 10.20.193.51:0/1004331845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 msgr2=0x7faf7009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf7486e640 1 --2- 10.20.193.51:0/1004331845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf7009e1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf640098a0 tx=0x7faf6402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c83ad8c5fdfd17c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 1 -- 10.20.193.51:0/1004331845 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6403c070 con 0x7faf700a0750 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: dump: 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.038 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: _finish_auth 0 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf772fa640 5 monclient: authenticate success, global_id 184207 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf772fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:27.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 1 -- 10.20.193.51:0/1004331845 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6402fce0 con 0x7faf700a0750 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 1 -- 10.20.193.51:0/1004331845 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64037660 con 0x7faf700a0750 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf5ffff640 10 monclient: dump: 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf772fa640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.024+0000 7faf772fa640 4 set_mon_vals no callback set 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 10 monclient: shutdown 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- 10.20.193.51:0/1004331845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 msgr2=0x7faf7009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 --2- 10.20.193.51:0/1004331845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf7009e1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf640098a0 tx=0x7faf6402ed80 comp rx=0 tx=0).stop 2026-02-17T12:00:27.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- 10.20.193.51:0/1004331845 shutdown_connections 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 --2- 10.20.193.51:0/1004331845 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf7009e1d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- 10.20.193.51:0/1004331845 >> 10.20.193.51:0/1004331845 conn(0x7faf700a30c0 msgr2=0x7faf700a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- 10.20.193.51:0/1004331845 shutdown_connections 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- 10.20.193.51:0/1004331845 wait complete. 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 10 monclient: build_initial_monmap 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 10 monclient: monmap: 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:27.042 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 Processor -- start 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 1 -- start start 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.025+0000 7faf772fa640 10 monclient: init 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf70138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-b con 0x7faf700a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:27.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 0x7faf700954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-a con 0x7faf700a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): picked mon.noname-c con 0x7faf7013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faf700a04b0 con 0x7faf700a3bb0 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf7009c850 con 0x7faf700a0750 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faf7009e710 con 0x7faf7013b760 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf772fa640 10 monclient(hunting): authenticate will time out at 1514.645222s 2026-02-17T12:00:27.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7486e640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 msgr2=0x7faf700954e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7486e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 0x7faf700954e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42940/0 (socket says 10.20.193.51:42940) 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 -- 10.20.193.51:0/1189556834 learned_addr learned my addr 10.20.193.51:0/1189556834 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): get_auth_request con 0x7faf7013b760 auth_method 0 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7506f640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf70138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7506f640 10 monclient(hunting): get_auth_request con 0x7faf700a0750 auth_method 0 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7506f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7506f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf7506f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient(hunting): handle_auth_done global_id 194147 payload 824 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 -- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 msgr2=0x7faf70138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf70138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 -- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 msgr2=0x7faf700954e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 0x7faf700954e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient: _finish_hunting 0 2026-02-17T12:00:27.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 monclient: found mon.noname-c 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.026+0000 7faf75870640 1 -- 10.20.193.51:0/1189556834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf700975d0 con 0x7faf7013b760 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf75870640 1 -- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 msgr2=0x7faf70095a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf75870640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00be60 tx=0x7faf6c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c006e60 con 0x7faf7013b760 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: dump: 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:27.047 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 5 monclient: authenticate success, global_id 194147 2026-02-17T12:00:27.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 10 monclient: _renew_subs 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c010030 con 0x7faf7013b760 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf70097e40 con 0x7faf7013b760 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c016430 con 0x7faf7013b760 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5dffb640 10 monclient: dump: 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.049 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf5f7fe640 4 set_mon_vals no callback set 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 10 monclient: _renew_subs 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.028+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf700a2dd0 con 0x7faf7013b760 2026-02-17T12:00:27.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faf6c0153e0 con 0x7faf7013b760 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf772fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf772fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf772fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7009dac0 con 0x7faf7013b760 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf5dffb640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 0x7faf40040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7faf6c052360 con 0x7faf7013b760 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf7506f640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 0x7faf40040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.029+0000 7faf7506f640 10 monclient: get_auth_request con 0x7faf4003dcc0 auth_method 0 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.032+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faf6c050d80 con 0x7faf7013b760 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.032+0000 7faf5dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.032+0000 7faf5dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:27.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.032+0000 7faf7506f640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 0x7faf40040180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf60007340 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf772fa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:27.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf772fa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf772fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf700008d0 con 0x7faf7013b760 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf5dffb640 1 -- 10.20.193.51:0/1189556834 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7faf6c013c00 con 0x7faf7013b760 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf5dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.146+0000 7faf5dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:27.149 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:27.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 msgr2=0x7faf40040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 0x7faf40040180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf60007340 tx=0x7faf60009040 comp rx=0 tx=0).stop 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 10 monclient: shutdown 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 msgr2=0x7faf70095a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00be60 tx=0x7faf6c00bf60 comp rx=0 tx=0).stop 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 shutdown_connections 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faf4003dcc0 0x7faf40040180 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faf7013b760 0x7faf70095a20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faf700a3bb0 0x7faf700954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 --2- 10.20.193.51:0/1189556834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faf700a0750 0x7faf70138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 >> 10.20.193.51:0/1189556834 conn(0x7faf700a30c0 msgr2=0x7faf7013acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:27.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 shutdown_connections 2026-02-17T12:00:27.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:27.147+0000 7faf772fa640 1 -- 10.20.193.51:0/1189556834 wait complete. 2026-02-17T12:00:30.159 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:30.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: get_monmap_and_config 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: build_initial_monmap 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: monmap: 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:30.227176+0000 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:30.227176+0000 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.231 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 Processor -- start 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 -- start start 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: init 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f71880a3bb0 0x7f718809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-c con 0x7f71880a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-b con 0x7f71880a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f718809e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f718806e140 con 0x7f718809e540 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f71880a3f90 con 0x7f71880a3bb0 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f718809f910 con 0x7f71880a0750 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.226+0000 7f718ccc7640 10 monclient(hunting): authenticate will time out at 1517.845939s 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42952/0 (socket says 10.20.193.51:42952) 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 -- 10.20.193.51:0/2755203918 learned_addr learned my addr 10.20.193.51:0/2755203918 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): get_auth_request con 0x7f71880a0750 auth_method 0 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7186575640 1 --2- 10.20.193.51:0/2755203918 >> v2:10.20.193.142:3300/0 conn(0x7f71880a3bb0 0x7f718809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7186575640 10 monclient(hunting): get_auth_request con 0x7f71880a3bb0 auth_method 0 2026-02-17T12:00:30.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7186575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7186575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7186575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient(hunting): handle_auth_done global_id 194150 payload 274 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 -- 10.20.193.51:0/2755203918 >> v2:10.20.193.142:3300/0 conn(0x7f71880a3bb0 msgr2=0x7f718809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 --2- 10.20.193.51:0/2755203918 >> v2:10.20.193.142:3300/0 conn(0x7f71880a3bb0 0x7f718809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 -- 10.20.193.51:0/2755203918 >> v1:10.20.193.142:6789/0 conn(0x7f718809e540 legacy=0x7f718813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient: _finish_hunting 0 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 monclient: found mon.noname-b 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.227+0000 7f7185d74640 1 -- 10.20.193.51:0/2755203918 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718809ccd0 con 0x7f71880a0750 2026-02-17T12:00:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185d74640 1 -- 10.20.193.51:0/2755203918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 msgr2=0x7f718809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185d74640 1 --2- 10.20.193.51:0/2755203918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f718806c1c0 tx=0x7f717002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f474237317b9e520 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 1 -- 10.20.193.51:0/2755203918 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717003c070 con 0x7f71880a0750 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: dump: 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: _finish_auth 0 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: _check_auth_tickets 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 1 -- 10.20.193.51:0/2755203918 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717002fca0 con 0x7f71880a0750 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f718ccc7640 5 monclient: authenticate success, global_id 194150 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 1 -- 10.20.193.51:0/2755203918 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170037660 con 0x7f71880a0750 2026-02-17T12:00:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f718ccc7640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f718ccc7640 4 set_mon_vals no callback set 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.229+0000 7f7185573640 10 monclient: dump: 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:30.245 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 10 monclient: shutdown 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- 10.20.193.51:0/2755203918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 msgr2=0x7f718809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 --2- 10.20.193.51:0/2755203918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f718806c1c0 tx=0x7f717002ee60 comp rx=0 tx=0).stop 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- 10.20.193.51:0/2755203918 shutdown_connections 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 --2- 10.20.193.51:0/2755203918 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a0750 0x7f718809e000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 --2- 10.20.193.51:0/2755203918 >> v2:10.20.193.142:3300/0 conn(0x7f71880a3bb0 0x7f718809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- 10.20.193.51:0/2755203918 >> 10.20.193.51:0/2755203918 conn(0x7f71880a30c0 msgr2=0x7f71880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- 10.20.193.51:0/2755203918 shutdown_connections 2026-02-17T12:00:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- 10.20.193.51:0/2755203918 wait complete. 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 10 monclient: build_initial_monmap 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 10 monclient: monmap: 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:30.247 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 Processor -- start 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 1 -- start start 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.230+0000 7f718ccc7640 10 monclient: init 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 0x7f718812bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-a con 0x7f718809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71880a0750 0x7f718812c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-b con 0x7f71880a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): picked mon.noname-c con 0x7f71880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71880a04b0 con 0x7f718809e540 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f718809c850 con 0x7f71880a0750 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f718813de80 con 0x7f71880a3bb0 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f718ccc7640 10 monclient(hunting): authenticate will time out at 1517.850118s 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186575640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 msgr2=0x7f718812bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 0x7f718812bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42954/0 (socket says 10.20.193.51:42954) 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 -- 10.20.193.51:0/3190643427 learned_addr learned my addr 10.20.193.51:0/3190643427 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): get_auth_request con 0x7f71880a3bb0 auth_method 0 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7185d74640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71880a0750 0x7f718812c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7185d74640 10 monclient(hunting): get_auth_request con 0x7f71880a0750 auth_method 0 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7185d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7185d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7185d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient(hunting): handle_auth_done global_id 194153 payload 824 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 -- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71880a0750 msgr2=0x7f718812c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71880a0750 0x7f718812c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 -- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 msgr2=0x7f718812bb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 0x7f718812bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient: _finish_hunting 0 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 monclient: found mon.noname-c 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.231+0000 7f7186d76640 1 -- 10.20.193.51:0/3190643427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718812d560 con 0x7f71880a3bb0 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f7186d76640 1 -- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 msgr2=0x7f718812c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f7186d76640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f717800cb60 tx=0x7f717800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178016020 con 0x7f71880a3bb0 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: dump: 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: _finish_auth 0 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178012420 con 0x7f71880a3bb0 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178012810 con 0x7f71880a3bb0 2026-02-17T12:00:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f716effd640 10 monclient: dump: 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f7184d72640 4 set_mon_vals no callback set 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 5 monclient: authenticate success, global_id 194153 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 10 monclient: _renew_subs 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718812efb0 con 0x7f71880a3bb0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 10 monclient: _renew_subs 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.233+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f718806f8d0 con 0x7f71880a3bb0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f718ccc7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f718ccc7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f718ccc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f718806f410 con 0x7f71880a3bb0 2026-02-17T12:00:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f71780129b0 con 0x7f71880a3bb0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f716effd640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 0x7f71540401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7f7178052d40 con 0x7f71880a3bb0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f7186575640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 0x7f71540401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.234+0000 7f7186575640 10 monclient: get_auth_request con 0x7f715403dd10 auth_method 0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.236+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7178020030 con 0x7f71880a3bb0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.236+0000 7f716effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.236+0000 7f716effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:30.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.237+0000 7f7186575640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 0x7f71540401d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f717c009180 tx=0x7f717c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f718ccc7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f718ccc7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f718ccc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f718809dac0 con 0x7f71880a3bb0 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f716effd640 1 -- 10.20.193.51:0/3190643427 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f7178019310 con 0x7f71880a3bb0 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f716effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:30.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.355+0000 7f716effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:30.359 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 msgr2=0x7f71540401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 0x7f71540401d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f717c009180 tx=0x7f717c008040 comp rx=0 tx=0).stop 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 10 monclient: shutdown 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 msgr2=0x7f718812c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f717800cb60 tx=0x7f717800a430 comp rx=0 tx=0).stop 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 shutdown_connections 2026-02-17T12:00:30.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f715403dd10 0x7f71540401d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.356+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71880a3bb0 0x7f718812c590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.357+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71880a0750 0x7f718812c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.357+0000 7f718ccc7640 1 --2- 10.20.193.51:0/3190643427 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f718809e540 0x7f718812bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.357+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 >> 10.20.193.51:0/3190643427 conn(0x7f71880a30c0 msgr2=0x7f71880a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.357+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 shutdown_connections 2026-02-17T12:00:30.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:30.357+0000 7f718ccc7640 1 -- 10.20.193.51:0/3190643427 wait complete. 2026-02-17T12:00:33.368 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:33.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 10 monclient: get_monmap_and_config 2026-02-17T12:00:33.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 10 monclient: build_initial_monmap 2026-02-17T12:00:33.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 10 monclient: monmap: 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:33.437301+0000 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:33.437301+0000 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:33.441 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 1 Processor -- start 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 1 -- start start 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.436+0000 7fe20efa7640 10 monclient: init 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 0x7fe20809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-a con 0x7fe2080a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe20809dac0 0x7fe20809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-c con 0x7fe20809dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe20809ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:33.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20806e140 con 0x7fe20809ff40 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe20809aed0 con 0x7fe2080a3bb0 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe20809caa0 con 0x7fe20809dac0 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20cd1c640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 msgr2=0x7fe20809f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20efa7640 10 monclient(hunting): authenticate will time out at 1521.056131s 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20cd1c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 0x7fe20809f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe20d51d640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fe20809ff40 legacy=0x7fe20813b750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe20809dac0 0x7fe20809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe20809dac0 0x7fe20809fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:46918/0 (socket says 10.20.193.51:46918) 2026-02-17T12:00:33.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 -- 10.20.193.51:0/3467983931 learned_addr learned my addr 10.20.193.51:0/3467983931 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): get_auth_request con 0x7fe20809dac0 auth_method 0 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient(hunting): handle_auth_done global_id 184219 payload 274 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 -- 10.20.193.51:0/3467983931 >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 msgr2=0x7fe20809f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 --2- 10.20.193.51:0/3467983931 >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 0x7fe20809f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 -- 10.20.193.51:0/3467983931 >> v1:10.20.193.51:6789/0 conn(0x7fe20809ff40 legacy=0x7fe20813b750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:33.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:33.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 monclient: found mon.noname-c 2026-02-17T12:00:33.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:33.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:00:33.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.437+0000 7fe1fffff640 1 -- 10.20.193.51:0/3467983931 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20809ce60 con 0x7fe20809dac0 2026-02-17T12:00:33.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1fffff640 1 -- 10.20.193.51:0/3467983931 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe20809dac0 msgr2=0x7fe20809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1fffff640 1 --2- 10.20.193.51:0/3467983931 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe20809dac0 0x7fe20809fa00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe20809cc20 tx=0x7fe1f002ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fa9aee39b92990 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 1 -- 10.20.193.51:0/3467983931 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f003c070 con 0x7fe20809dac0 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: dump: 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:33.452 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 1 -- 10.20.193.51:0/3467983931 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f002fd90 con 0x7fe20809dac0 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 5 monclient: authenticate success, global_id 184219 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 1 -- 10.20.193.51:0/3467983931 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0037660 con 0x7fe20809dac0 2026-02-17T12:00:33.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe1ff7fe640 10 monclient: dump: 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:33.454 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 4 set_mon_vals no callback set 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 10 monclient: shutdown 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 1 -- 10.20.193.51:0/3467983931 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe20809dac0 msgr2=0x7fe20809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.440+0000 7fe20efa7640 1 --2- 10.20.193.51:0/3467983931 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe20809dac0 0x7fe20809fa00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe20809cc20 tx=0x7fe1f002ee30 comp rx=0 tx=0).stop 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 -- 10.20.193.51:0/3467983931 shutdown_connections 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 --2- 10.20.193.51:0/3467983931 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe20809dac0 0x7fe20809fa00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 --2- 10.20.193.51:0/3467983931 >> v2:10.20.193.51:3300/0 conn(0x7fe2080a3bb0 0x7fe20809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 -- 10.20.193.51:0/3467983931 >> 10.20.193.51:0/3467983931 conn(0x7fe2080a30c0 msgr2=0x7fe2080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:33.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 -- 10.20.193.51:0/3467983931 shutdown_connections 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 -- 10.20.193.51:0/3467983931 wait complete. 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 10 monclient: build_initial_monmap 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 10 monclient: monmap: 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:33.456 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 Processor -- start 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 1 -- start start 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.441+0000 7fe20efa7640 10 monclient: init 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 0x7fe20813cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-a con 0x7fe20809dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-c con 0x7fe20809ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2080a3bb0 0x7fe20813e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): picked mon.noname-b con 0x7fe2080a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:33.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20cd1c640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 msgr2=0x7fe20813cdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe2080a0370 con 0x7fe20809dac0 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe20809a880 con 0x7fe2080a3bb0 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080a04f0 con 0x7fe20809ff40 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20efa7640 10 monclient(hunting): authenticate will time out at 1521.061083s 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20cd1c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 0x7fe20813cdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42966/0 (socket says 10.20.193.51:42966) 2026-02-17T12:00:33.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 -- 10.20.193.51:0/2135457014 learned_addr learned my addr 10.20.193.51:0/2135457014 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): get_auth_request con 0x7fe20809ff40 auth_method 0 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20d51d640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2080a3bb0 0x7fe20813e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20d51d640 10 monclient(hunting): get_auth_request con 0x7fe2080a3bb0 auth_method 0 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20d51d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20d51d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:33.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe20d51d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient(hunting): handle_auth_done global_id 194156 payload 824 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 -- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2080a3bb0 msgr2=0x7fe20813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2080a3bb0 0x7fe20813e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 -- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 msgr2=0x7fe20813cdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 0x7fe20813cdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 monclient: found mon.noname-c 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.442+0000 7fe1fffff640 1 -- 10.20.193.51:0/2135457014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20813ab30 con 0x7fe20809ff40 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fffff640 1 -- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 msgr2=0x7fe20813de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:33.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fffff640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0002410 tx=0x7fe1f00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0046020 con 0x7fe20809ff40 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: dump: 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.461 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: _finish_auth 0 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:00:33.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 5 monclient: authenticate success, global_id 194156 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f0042640 con 0x7fe20809ff40 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f003c040 con 0x7fe20809ff40 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 10 monclient: _renew_subs 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20813b670 con 0x7fe20809ff40 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1feffd640 4 set_mon_vals no callback set 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe1fd7fa640 10 monclient: dump: 2026-02-17T12:00:33.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 10 monclient: _renew_subs 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:33.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.444+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20809d7b0 con 0x7fe20809ff40 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20efa7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20efa7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20efa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20809e370 con 0x7fe20809ff40 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe1f003f030 con 0x7fe20809ff40 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe1fd7fa640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 0x7fe1d8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7fe1f0077870 con 0x7fe20809ff40 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20cd1c640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 0x7fe1d8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.445+0000 7fe20cd1c640 10 monclient: get_auth_request con 0x7fe1d803dcc0 auth_method 0 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.448+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1f0050030 con 0x7fe20809ff40 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.448+0000 7fe1fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:33.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.448+0000 7fe1fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:33.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.448+0000 7fe20cd1c640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 0x7fe1d8040180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8003a80 tx=0x7fe1f8009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:33.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe20efa7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe20efa7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe20efa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe20813d310 con 0x7fe20809ff40 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe1fd7fa640 1 -- 10.20.193.51:0/2135457014 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fe1f002fd30 con 0x7fe20809ff40 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe1fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.562+0000 7fe1fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:33.565 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 msgr2=0x7fe1d8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 0x7fe1d8040180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8003a80 tx=0x7fe1f8009270 comp rx=0 tx=0).stop 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 10 monclient: shutdown 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 msgr2=0x7fe20813de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0002410 tx=0x7fe1f00047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 shutdown_connections 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe1d803dcc0 0x7fe1d8040180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2080a3bb0 0x7fe20813e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe20809ff40 0x7fe20813de80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 --2- 10.20.193.51:0/2135457014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe20809dac0 0x7fe20813cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:33.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 >> 10.20.193.51:0/2135457014 conn(0x7fe2080a30c0 msgr2=0x7fe20809e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:33.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 shutdown_connections 2026-02-17T12:00:33.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:33.563+0000 7fe20efa7640 1 -- 10.20.193.51:0/2135457014 wait complete. 2026-02-17T12:00:36.573 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: get_monmap_and_config 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: build_initial_monmap 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: monmap: 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:36.643144+0000 2026-02-17T12:00:36.646 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:36.643144+0000 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 Processor -- start 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 -- start start 2026-02-17T12:00:36.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: init 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f24940a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-c con 0x7f249409dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f24940a0110 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249406e140 con 0x7f24940a0110 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249409ce60 con 0x7f24940a3bb0 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f249409aed0 con 0x7f249409dac0 2026-02-17T12:00:36.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f249b70a640 10 monclient(hunting): authenticate will time out at 1524.261926s 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.642+0000 7f2499c80640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f24940a0110 legacy=0x7f249413c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f249947f640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f24940a3bb0 0x7f249409f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:42696/0 (socket says 10.20.193.51:42696) 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 learned_addr learned my addr 10.20.193.51:0/1213684438 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f249409dac0 auth_method 0 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:36.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:36.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.643+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:36.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.645+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.142:6789/0 conn(0x7f24940a3bb0 legacy=0x7f249409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:36.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.843+0000 7f2499c80640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.51:6789/0 conn(0x7f24940a0110 legacy=0x7f249413c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f249409dac0 auth_method 0 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:36.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:36.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:36.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:36.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:36.844+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:00:37.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.244+0000 7f2499c80640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.51:6789/0 conn(0x7f24940a0110 legacy=0x7f249413c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:37.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f249409dac0 auth_method 0 2026-02-17T12:00:37.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:37.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:37.245+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:00:38.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.045+0000 7f2499c80640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.51:6789/0 conn(0x7f24940a0110 legacy=0x7f249413c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f249409dac0 auth_method 0 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:38.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:38.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:38.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.046+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:00:38.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492575506 0 0) 0x7f249409ce60 con 0x7f24940a3bb0 2026-02-17T12:00:38.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 10 monclient(hunting): _negotiate 2026-02-17T12:00:38.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 10 monclient(hunting): my global_id is 184225 2026-02-17T12:00:38.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.605+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f247c003620 con 0x7f24940a3bb0 2026-02-17T12:00:38.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372010605 0 0) 0x7f247c003620 con 0x7f24940a3bb0 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 msgr2=0x7f249409fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 --2- 10.20.193.51:0/1213684438 >> v2:10.20.193.142:3300/0 conn(0x7f249409dac0 0x7f249409fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.51:6789/0 conn(0x7f24940a0110 legacy=0x7f249413c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249409a5c0 con 0x7f24940a3bb0 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f2484003190 con 0x7f24940a3bb0 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: dump: 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.620 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 >> v1:10.20.193.142:6789/0 conn(0x7f24940a3bb0 legacy=0x7f249409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 0x7f247c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): picked mon.c con 0x7f247c003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c004900 0x7f247c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): picked mon.b con 0x7f247c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0053e0 0x7f247c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): picked mon.a con 0x7f247c0053e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f249409aed0 con 0x7f247c0053e0 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f247c00c290 con 0x7f247c004900 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f247c00c490 con 0x7f247c003ab0 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2483fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2499c80640 1 -- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0053e0 msgr2=0x7f247c00bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f2499c80640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0053e0 0x7f247c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.606+0000 7f249947f640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 0x7f247c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c004900 0x7f247c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): get_auth_request con 0x7f247c003ab0 auth_method 0 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f247c004900 auth_method 0 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient(hunting): handle_auth_done global_id 184225 payload 293 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c004900 msgr2=0x7f247c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c004900 0x7f247c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0053e0 msgr2=0x7f247c00bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0053e0 0x7f247c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 monclient: found mon.c 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c003620 con 0x7f247c003ab0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f2499c80640 1 -- 10.20.193.51:0/1213684438 reap_dead start 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249947f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249b70a640 5 monclient: authenticate success, global_id 184225 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.607+0000 7f249b70a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f249947f640 1 -- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 msgr2=0x7f247c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f249947f640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 0x7f247c003eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f24840033b0 tx=0x7f248402f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8194542c5bf56ae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248400c0e0 con 0x7f247c003ab0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f2483fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f2483fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f2483fff640 10 monclient: dump: 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.626 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2484005bf0 con 0x7f247c003ab0 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.609+0000 7f249b70a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f2483fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f2483fff640 1 -- 10.20.193.51:0/1213684438 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484007070 con 0x7f247c003ab0 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f2483fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f2483fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f2483fff640 10 monclient: dump: 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.627 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 4 set_mon_vals no callback set 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 10 monclient: shutdown 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 -- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 msgr2=0x7f247c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 0x7f247c003eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f24840033b0 tx=0x7f248402f690 comp rx=0 tx=0).stop 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 -- 10.20.193.51:0/1213684438 shutdown_connections 2026-02-17T12:00:38.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 --2- 10.20.193.51:0/1213684438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c003ab0 0x7f247c003eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 -- 10.20.193.51:0/1213684438 >> 10.20.193.51:0/1213684438 conn(0x7f24940a30c0 msgr2=0x7f24940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 -- 10.20.193.51:0/1213684438 shutdown_connections 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 1 -- 10.20.193.51:0/1213684438 wait complete. 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 10 monclient: build_initial_monmap 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.610+0000 7f249b70a640 10 monclient: monmap: 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.629 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 Processor -- start 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 -- start start 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient: init 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c003ab0 0x7f24941bd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-b con 0x7f247c003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-c con 0x7f24941cd040 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 0x7f24941b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): picked mon.noname-a con 0x7f24941b4380 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f24940a3f90 con 0x7f24941b4380 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f249409caa0 con 0x7f247c003ab0 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f24940a0540 con 0x7f24941cd040 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f249b70a640 10 monclient(hunting): authenticate will time out at 1526.230326s 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2499c80640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 msgr2=0x7f24941b4830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2499c80640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 0x7f24941b4830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44134/0 (socket says 10.20.193.51:44134) 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 -- 10.20.193.51:0/2281663811 learned_addr learned my addr 10.20.193.51:0/2281663811 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): get_auth_request con 0x7f24941cd040 auth_method 0 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient(hunting): handle_auth_done global_id 194159 payload 824 2026-02-17T12:00:38.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 -- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c003ab0 msgr2=0x7f24941bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c003ab0 0x7f24941bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 -- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 msgr2=0x7f24941b4830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 0x7f24941b4830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 monclient: found mon.noname-c 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.611+0000 7f2498c7e640 1 -- 10.20.193.51:0/2281663811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24941b7d50 con 0x7f24941cd040 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2498c7e640 1 -- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 msgr2=0x7f24941bddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2498c7e640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2488012660 tx=0x7f2488012b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800f040 con 0x7f24941cd040 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: dump: 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248801c070 con 0x7f24941cd040 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 5 monclient: authenticate success, global_id 194159 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 10 monclient: _renew_subs 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24941b7140 con 0x7f24941cd040 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488021470 con 0x7f24941cd040 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f24837fe640 4 set_mon_vals no callback set 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f2481ffb640 10 monclient: dump: 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.635 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 10 monclient: _renew_subs 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.613+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24941b8030 con 0x7f24941cd040 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2488015040 con 0x7f24941cd040 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249b70a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249b70a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249b70a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249409f670 con 0x7f24941cd040 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f2481ffb640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 0x7f2464040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(540..540 src has 323..540) ==== 4751+0+0 (secure 0 0 0) 0x7f2488053250 con 0x7f24941cd040 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249947f640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 0x7f2464040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.614+0000 7f249947f640 10 monclient: get_auth_request con 0x7f246403dd40 auth_method 0 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.616+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2488051c70 con 0x7f24941cd040 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.616+0000 7f2481ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.616+0000 7f2481ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:38.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.617+0000 7f249947f640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 0x7f2464040200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2484033000 tx=0x7f2484007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.672 INFO:tasks.rados.rados.0.trial142.stdout:2324: done (3 left) 2026-02-17T12:00:38.672 INFO:tasks.rados.rados.0.trial142.stdout:2325: done (2 left) 2026-02-17T12:00:38.673 INFO:tasks.rados.rados.0.trial142.stdout:2326: done (1 left) 2026-02-17T12:00:38.673 INFO:tasks.rados.rados.0.trial142.stdout:2327: done (0 left) 2026-02-17T12:00:38.673 INFO:tasks.rados.rados.0.trial142.stdout:2328: read oid 49 snap -1 2026-02-17T12:00:38.673 INFO:tasks.rados.rados.0.trial142.stdout:2328: expect deleted 2026-02-17T12:00:38.673 INFO:tasks.rados.rados.0.trial142.stdout:2329: delete oid 13 current snap is 254 2026-02-17T12:00:38.674 INFO:tasks.rados.rados.0.trial142.stdout:2328: done (1 left) 2026-02-17T12:00:38.674 INFO:tasks.rados.rados.0.trial142.stdout:2329: done (0 left) 2026-02-17T12:00:38.674 INFO:tasks.rados.rados.0.trial142.stdout:2330: snap_remove snap 253 2026-02-17T12:00:38.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f249b70a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f249b70a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f249b70a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f249409d7b0 con 0x7f24941cd040 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f2481ffb640 1 -- 10.20.193.51:0/2281663811 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f2488014df0 con 0x7f24941cd040 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f2481ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:38.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.730+0000 7f2481ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:38.734 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 msgr2=0x7f2464040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 0x7f2464040200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2484033000 tx=0x7f2484007000 comp rx=0 tx=0).stop 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 10 monclient: shutdown 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 msgr2=0x7f24941bddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2488012660 tx=0x7f2488012b30 comp rx=0 tx=0).stop 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 shutdown_connections 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f246403dd40 0x7f2464040200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f24941b4380 0x7f24941b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f24941cd040 0x7f24941bddc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 --2- 10.20.193.51:0/2281663811 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c003ab0 0x7f24941bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 >> 10.20.193.51:0/2281663811 conn(0x7f24940a30c0 msgr2=0x7f249406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 shutdown_connections 2026-02-17T12:00:38.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.731+0000 7f249b70a640 1 -- 10.20.193.51:0/2281663811 wait complete. 2026-02-17T12:00:38.743 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:00:38.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:00:38.743 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 10 monclient: get_monmap_and_config 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 10 monclient: build_initial_monmap 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 10 monclient: monmap: 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:38.810309+0000 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:38.810309+0000 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:38.811 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 1 Processor -- start 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 1 -- start start 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.809+0000 7fd0553f5640 10 monclient: init 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd0500a3bb0 0x7fd05009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-a con 0x7fd0500a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd05009dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:00:38.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd0500a0110 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05006e140 con 0x7fd05009dac0 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05009ce60 con 0x7fd0500a0110 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd05009aed0 con 0x7fd0500a3bb0 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd0553f5640 10 monclient(hunting): authenticate will time out at 1526.429083s 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd04effd640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fd0500a3bb0 msgr2=0x7fd05009f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd04effd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd0500a3bb0 0x7fd05009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd04e7fc640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fd05009dac0 legacy=0x7fd05009fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd04f7fe640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fd0500a0110 0x7fd05013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:42702/0 (socket says 10.20.193.51:42702) 2026-02-17T12:00:38.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.810+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 learned_addr learned my addr 10.20.193.51:0/765650517 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:38.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 >> v1:10.20.193.142:6789/0 conn(0x7fd0500a0110 legacy=0x7fd05013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082864867 0 0) 0x7fd05009ce60 con 0x7fd0500a0110 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 10 monclient(hunting): _negotiate 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 10 monclient(hunting): my global_id is 184228 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.812+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03c003620 con 0x7fd0500a0110 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 261321104 0 0) 0x7fd03c003620 con 0x7fd0500a0110 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 >> v2:10.20.193.51:3300/0 conn(0x7fd0500a3bb0 msgr2=0x7fd05009f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 --2- 10.20.193.51:0/765650517 >> v2:10.20.193.51:3300/0 conn(0x7fd0500a3bb0 0x7fd05009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 >> v1:10.20.193.51:6789/0 conn(0x7fd05009dac0 legacy=0x7fd05009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05009a5c0 con 0x7fd0500a0110 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fd0400035f0 con 0x7fd0500a0110 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:00:38.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: dump: 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 >> v1:10.20.193.142:6789/0 conn(0x7fd0500a0110 legacy=0x7fd05013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd03c003ab0 0x7fd03c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): picked mon.a con 0x7fd03c003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c004900 0x7fd03c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): picked mon.b con 0x7fd03c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 0x7fd03c00bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): picked mon.c con 0x7fd03c005470 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd05009aed0 con 0x7fd03c003ab0 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00c3c0 con 0x7fd03c004900 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd03c00c5c0 con 0x7fd03c005470 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04effd640 1 -- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd03c003ab0 msgr2=0x7fd03c003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04dffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04effd640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd03c003ab0 0x7fd03c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 0x7fd03c00bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): get_auth_request con 0x7fd03c005470 auth_method 0 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c004900 0x7fd03c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): get_auth_request con 0x7fd03c004900 auth_method 0 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient(hunting): handle_auth_done global_id 184228 payload 293 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c004900 msgr2=0x7fd03c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c004900 0x7fd03c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd03c003ab0 msgr2=0x7fd03c003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd03c003ab0 0x7fd03c003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 monclient: found mon.c 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c003620 con 0x7fd03c005470 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd0553f5640 5 monclient: authenticate success, global_id 184228 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd0553f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.813+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 reap_dead start 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.815+0000 7fd04f7fe640 1 -- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 msgr2=0x7fd03c00bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.815+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 0x7fd03c00bae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd040003060 tx=0x7fd04002ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece21b782d6e1dce server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04000a800 con 0x7fd03c005470 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: dump: 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd040034070 con 0x7fd03c005470 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 1 -- 10.20.193.51:0/765650517 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040030bf0 con 0x7fd03c005470 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 4 set_mon_vals no callback set 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd04dffb640 10 monclient: dump: 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 10 monclient: shutdown 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 -- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 msgr2=0x7fd03c00bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 0x7fd03c00bae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd040003060 tx=0x7fd04002ff70 comp rx=0 tx=0).stop 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 -- 10.20.193.51:0/765650517 shutdown_connections 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 --2- 10.20.193.51:0/765650517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd03c005470 0x7fd03c00bae0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 -- 10.20.193.51:0/765650517 >> 10.20.193.51:0/765650517 conn(0x7fd0500a30c0 msgr2=0x7fd0500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 -- 10.20.193.51:0/765650517 shutdown_connections 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 1 -- 10.20.193.51:0/765650517 wait complete. 2026-02-17T12:00:38.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 10 monclient: build_initial_monmap 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.816+0000 7fd0553f5640 10 monclient: monmap: 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 Processor -- start 2026-02-17T12:00:38.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 -- start start 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient: init 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c005470 0x7fd0501cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-b con 0x7fd03c005470 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-c con 0x7fd0501bda60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd0501ceea0 0x7fd0501cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): picked mon.noname-a con 0x7fd0501ceea0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500a3f90 con 0x7fd0501ceea0 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd05009caa0 con 0x7fd03c005470 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500a0540 con 0x7fd0501bda60 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd0553f5640 10 monclient(hunting): authenticate will time out at 1526.436461s 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04f7fe640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd0501ceea0 msgr2=0x7fd0501cf320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd0501ceea0 0x7fd0501cf320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44162/0 (socket says 10.20.193.51:44162) 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 -- 10.20.193.51:0/2261186109 learned_addr learned my addr 10.20.193.51:0/2261186109 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:38.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): get_auth_request con 0x7fd0501bda60 auth_method 0 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient(hunting): handle_auth_done global_id 194162 payload 824 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c005470 msgr2=0x7fd0501cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd03c005470 0x7fd0501cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd0501ceea0 msgr2=0x7fd0501cf320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:38.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd0501ceea0 0x7fd0501cf320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 monclient: found mon.noname-c 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.817+0000 7fd04e7fc640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0501b9f50 con 0x7fd0501bda60 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd04e7fc640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 msgr2=0x7fd0501bdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd04e7fc640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0380094f0 tx=0x7fd03800ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038003cb0 con 0x7fd0501bda60 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:38.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: dump: 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0380050d0 con 0x7fd0501bda60 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 5 monclient: authenticate success, global_id 194162 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 10 monclient: _renew_subs 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0501ba230 con 0x7fd0501bda60 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0380054c0 con 0x7fd0501bda60 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd02f7fe640 10 monclient: dump: 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.841 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd04d7fa640 4 set_mon_vals no callback set 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 10 monclient: _renew_subs 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.819+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05009ee50 con 0x7fd0501bda60 2026-02-17T12:00:38.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd0553f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd0553f5640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 0x7fd0500716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500a2b30 con 0x7fd0501cf860 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 0x7fd0500716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient: get_auth_request con 0x7fd0501cf860 auth_method 0 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd038015070 con 0x7fd0501bda60 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 10 monclient(hunting): handle_auth_done global_id 194165 payload 824 2026-02-17T12:00:38.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd04effd640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd05009f670 con 0x7fd0501cf860 2026-02-17T12:00:38.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd02f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd01c03dcf0 0x7fd01c0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.820+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(541..541 src has 323..541) ==== 4751+0+0 (secure 0 0 0) 0x7fd038053020 con 0x7fd0501bda60 2026-02-17T12:00:38.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.821+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd01c03dcf0 0x7fd01c0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.821+0000 7fd04f7fe640 10 monclient: get_auth_request con 0x7fd01c03dcf0 auth_method 0 2026-02-17T12:00:38.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd04effd640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 msgr2=0x7fd0500716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd04effd640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 0x7fd0500716a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b450 tx=0x7fd04400b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044005270 con 0x7fd0501cf860 2026-02-17T12:00:38.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd02f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd02f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.822+0000 7fd02f7fe640 10 monclient: dump: 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd044015070 con 0x7fd0501cf860 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 msgr2=0x7fd0500716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 0x7fd0500716a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b450 tx=0x7fd04400b920 comp rx=0 tx=0).stop 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 msgr2=0x7fd0500716a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd02f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501cf860 0x7fd0500716a0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b450 tx=0x7fd04400b920 comp rx=0 tx=0).stop 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.823+0000 7fd04f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd01c03dcf0 0x7fd01c0401b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0500a3020 tx=0x7fd04003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd0553f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd0553f5640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 0x7fd050071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd0553f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd0501cc420 con 0x7fd050071be0 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 0x7fd050071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient: get_auth_request con 0x7fd050071be0 auth_method 0 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 10 monclient(hunting): handle_auth_done global_id 194168 payload 824 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.826+0000 7fd04effd640 1 -- 10.20.193.51:0/2261186109 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd0501cfc40 con 0x7fd050071be0 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd04effd640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 msgr2=0x7fd050071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd04effd640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 0x7fd050071ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd044003fd0 tx=0x7fd044005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044010480 con 0x7fd050071be0 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 10 monclient: dump: 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.849 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7fd044010480 con 0x7fd050071be0 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 msgr2=0x7fd050071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 0x7fd050071ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd044003fd0 tx=0x7fd044005ad0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 msgr2=0x7fd050071ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:38.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.828+0000 7fd02f7fe640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd050071be0 0x7fd050071ff0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd044003fd0 tx=0x7fd044005ad0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 142, 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 27766, 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:00:38.851 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:38.852 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:38.853 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:38.854 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:38.855 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.856 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:38.857 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.858 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.859 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:38.860 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd01c03dcf0 msgr2=0x7fd01c0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd01c03dcf0 0x7fd01c0401b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0500a3020 tx=0x7fd04003d040 comp rx=0 tx=0).stop 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 10 monclient: shutdown 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 msgr2=0x7fd0501bdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0380094f0 tx=0x7fd03800ef80 comp rx=0 tx=0).stop 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd04f7fe640 1 -- 10.20.193.51:0/2261186109 reap_dead start 2026-02-17T12:00:38.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 shutdown_connections 2026-02-17T12:00:38.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 --2- 10.20.193.51:0/2261186109 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd0501bda60 0x7fd0501bdec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 >> 10.20.193.51:0/2261186109 conn(0x7fd0500a30c0 msgr2=0x7fd05006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:38.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 shutdown_connections 2026-02-17T12:00:38.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.829+0000 7fd0553f5640 1 -- 10.20.193.51:0/2261186109 wait complete. 2026-02-17T12:00:38.862 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:00:38.862 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:00:38.862 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.929+0000 7fc698590640 10 monclient: get_monmap_and_config 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.929+0000 7fc698590640 10 monclient: build_initial_monmap 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.929+0000 7fc698590640 10 monclient: monmap: 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:38.930703+0000 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:38.930703+0000 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:38.931 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 Processor -- start 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 -- start start 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient: init 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc6900a3bb0 0x7fc69009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): picked mon.noname-c con 0x7fc6900a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 0x7fc69009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): picked mon.noname-a con 0x7fc6900a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc69009e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69006e140 con 0x7fc69009e540 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900a3f90 con 0x7fc6900a0750 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc69009f910 con 0x7fc6900a3bb0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc698590640 10 monclient(hunting): authenticate will time out at 1526.549610s 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc695b04640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 msgr2=0x7fc69009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc695b04640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 0x7fc69009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc6900a3bb0 0x7fc69009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696b06640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fc69009e540 0x7fc69013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:42716/0 (socket says 10.20.193.51:42716) 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696b06640 1 -- 10.20.193.51:0/786467451 learned_addr learned my addr 10.20.193.51:0/786467451 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): get_auth_request con 0x7fc6900a3bb0 auth_method 0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.930+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 10 monclient(hunting): handle_auth_done global_id 184231 payload 274 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 1 -- 10.20.193.51:0/786467451 >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 msgr2=0x7fc69009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 1 --2- 10.20.193.51:0/786467451 >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 0x7fc69009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 1 -- 10.20.193.51:0/786467451 >> v1:10.20.193.142:6789/0 conn(0x7fc69009e540 legacy=0x7fc69013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 1 monclient: found mon.noname-c 2026-02-17T12:00:38.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:00:38.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.931+0000 7fc696305640 1 -- 10.20.193.51:0/786467451 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69009ccd0 con 0x7fc6900a3bb0 2026-02-17T12:00:38.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc696305640 1 -- 10.20.193.51:0/786467451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 msgr2=0x7fc69009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc696305640 1 --2- 10.20.193.51:0/786467451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 0x7fc69009dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc69006f3c0 tx=0x7fc68002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140fb07ed3da57f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 1 -- 10.20.193.51:0/786467451 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68003c070 con 0x7fc6900a3bb0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 10 monclient: dump: 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc695303640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc698590640 5 monclient: authenticate success, global_id 184231 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.933+0000 7fc698590640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 1 -- 10.20.193.51:0/786467451 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68002fcb0 con 0x7fc6900a3bb0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 1 -- 10.20.193.51:0/786467451 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68002fe60 con 0x7fc6900a3bb0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc695303640 10 monclient: dump: 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 4 set_mon_vals no callback set 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 10 monclient: shutdown 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 -- 10.20.193.51:0/786467451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 msgr2=0x7fc69009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 --2- 10.20.193.51:0/786467451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 0x7fc69009dac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc69006f3c0 tx=0x7fc68002ed50 comp rx=0 tx=0).stop 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 -- 10.20.193.51:0/786467451 shutdown_connections 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 --2- 10.20.193.51:0/786467451 >> v2:10.20.193.51:3300/0 conn(0x7fc6900a0750 0x7fc69009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 --2- 10.20.193.51:0/786467451 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 0x7fc69009dac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 -- 10.20.193.51:0/786467451 >> 10.20.193.51:0/786467451 conn(0x7fc6900a30c0 msgr2=0x7fc6900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 -- 10.20.193.51:0/786467451 shutdown_connections 2026-02-17T12:00:38.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 1 -- 10.20.193.51:0/786467451 wait complete. 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 10 monclient: build_initial_monmap 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.934+0000 7fc698590640 10 monclient: monmap: 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 Processor -- start 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 -- start start 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient: init 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): picked mon.noname-c con 0x7fc69009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc6900a0750 0x7fc69008e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): picked mon.noname-a con 0x7fc6900a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 0x7fc69008eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): picked mon.noname-b con 0x7fc6900a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900a04b0 con 0x7fc6900a0750 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc69009c850 con 0x7fc6900a3bb0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc69013de80 con 0x7fc69009e540 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc698590640 10 monclient(hunting): authenticate will time out at 1526.554429s 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc695b04640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc6900a0750 msgr2=0x7fc69008e9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc695b04640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc6900a0750 0x7fc69008e9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44206/0 (socket says 10.20.193.51:44206) 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 -- 10.20.193.51:0/2952106422 learned_addr learned my addr 10.20.193.51:0/2952106422 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): get_auth_request con 0x7fc69009e540 auth_method 0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient(hunting): handle_auth_done global_id 194171 payload 824 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 msgr2=0x7fc69008eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900a3bb0 0x7fc69008eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc6900a0750 msgr2=0x7fc69008e9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc6900a0750 0x7fc69008e9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient: _finish_hunting 0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 monclient: found mon.noname-c 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.935+0000 7fc696305640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc690091460 con 0x7fc69009e540 2026-02-17T12:00:38.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc696305640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 msgr2=0x7fc69008e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc696305640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc680002410 tx=0x7fc6800047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680046070 con 0x7fc69009e540 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: dump: 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680041890 con 0x7fc69009e540 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc698590640 5 monclient: authenticate success, global_id 194171 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc698590640 10 monclient: _renew_subs 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc698590640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6900917a0 con 0x7fc69009e540 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68003c040 con 0x7fc69009e540 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc694b02640 4 set_mon_vals no callback set 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.937+0000 7fc676ffd640 10 monclient: dump: 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.941 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 10 monclient: _renew_subs 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69008f940 con 0x7fc69009e540 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 0x7fc69013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc690098320 con 0x7fc6900903b0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc680041cc0 con 0x7fc69009e540 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 0x7fc69013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient: get_auth_request con 0x7fc6900903b0 auth_method 0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc676ffd640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc66003dcc0 0x7fc660040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(541..541 src has 323..541) ==== 4751+0+0 (secure 0 0 0) 0x7fc680077b30 con 0x7fc69009e540 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc696b06640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc66003dcc0 0x7fc660040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc696b06640 10 monclient: get_auth_request con 0x7fc66003dcc0 auth_method 0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.938+0000 7fc695b04640 10 monclient(hunting): handle_auth_done global_id 184234 payload 824 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.939+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6900a2b30 con 0x7fc6900903b0 2026-02-17T12:00:38.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc696b06640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc66003dcc0 0x7fc660040180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6900a1c70 tx=0x7fc68c005150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 msgr2=0x7fc69013cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 0x7fc69013cd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc68400bcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684005070 con 0x7fc6900903b0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 10 monclient: dump: 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc684005070 con 0x7fc6900903b0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 msgr2=0x7fc69013cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 0x7fc69013cd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc68400bcc0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 msgr2=0x7fc69013cd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:38.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.941+0000 7fc676ffd640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900903b0 0x7fc69013cd50 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc68400bcc0 comp rx=0 tx=0).stop 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.944+0000 7fc698590640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.944+0000 7fc698590640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.944+0000 7fc698590640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.944+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc690074200 con 0x7fc6900638c0 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 10 monclient: get_auth_request con 0x7fc6900638c0 auth_method 0 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:38.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 msgr2=0x7fc690063cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:00:38.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 msgr2=0x7fc690063cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:38.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:38.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:38.945+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:39.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient: get_auth_request con 0x7fc6900638c0 auth_method 0 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 10 monclient(hunting): handle_auth_done global_id 184237 payload 824 2026-02-17T12:00:39.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.146+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc69009dac0 con 0x7fc6900638c0 2026-02-17T12:00:39.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc695b04640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 msgr2=0x7fc690063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:39.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc695b04640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc684005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:39.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68401a940 con 0x7fc6900638c0 2026-02-17T12:00:39.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 10 monclient: dump: 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:39.152 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4866 (secure 0 0 0) 0x7fc68401a940 con 0x7fc6900638c0 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 msgr2=0x7fc690063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc684005ad0 comp rx=0 tx=0).stop 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 msgr2=0x7fc690063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc676ffd640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6900638c0 0x7fc690063cd0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc684003a80 tx=0x7fc684005ad0 comp rx=0 tx=0).stop 2026-02-17T12:00:39.153 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 142, 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 71535, 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.154 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:39.155 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:39.156 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:00:39.157 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:00:39.158 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:00:39.159 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:39.161 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.162 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.163 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:00:39.164 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.165 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:39.166 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:00:39.167 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:00:39.168 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:00:39.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc66003dcc0 msgr2=0x7fc660040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc66003dcc0 0x7fc660040180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6900a1c70 tx=0x7fc68c005150 comp rx=0 tx=0).stop 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 10 monclient: shutdown 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 msgr2=0x7fc69008e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc680002410 tx=0x7fc6800047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc696b06640 1 -- 10.20.193.51:0/2952106422 reap_dead start 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 shutdown_connections 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 --2- 10.20.193.51:0/2952106422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc69009e540 0x7fc69008e460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.149+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 >> 10.20.193.51:0/2952106422 conn(0x7fc6900a30c0 msgr2=0x7fc69009bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.150+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 shutdown_connections 2026-02-17T12:00:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:39.150+0000 7fc698590640 1 -- 10.20.193.51:0/2952106422 wait complete. 2026-02-17T12:00:39.171 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:00:39.171 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:00:39.674 INFO:tasks.rados.rados.0.trial142.stdout:2330: done (0 left) 2026-02-17T12:00:39.674 INFO:tasks.rados.rados.0.trial142.stdout:2331: snap_remove snap 252 2026-02-17T12:00:40.676 INFO:tasks.rados.rados.0.trial142.stdout:2331: done (0 left) 2026-02-17T12:00:40.677 INFO:tasks.rados.rados.0.trial142.stdout:2332: write oid 26 current snap is 254 2026-02-17T12:00:40.677 INFO:tasks.rados.rados.0.trial142.stdout:2332: seq_num 810 ranges {413670=485108,1465944=729943,2977330=524801} 2026-02-17T12:00:40.680 INFO:tasks.rados.rados.0.trial142.stdout:2332: writing trial14245205-26 from 413670 to 898778 tid 1 2026-02-17T12:00:40.685 INFO:tasks.rados.rados.0.trial142.stdout:2332: writing trial14245205-26 from 1465944 to 2195887 tid 2 2026-02-17T12:00:40.691 INFO:tasks.rados.rados.0.trial142.stdout:2332: writing trial14245205-26 from 2977330 to 3502131 tid 3 2026-02-17T12:00:40.691 INFO:tasks.rados.rados.0.trial142.stdout:2333: copy_from oid 6 from oid 29 current snap is 254 2026-02-17T12:00:40.691 INFO:tasks.rados.rados.0.trial142.stdout:2332: finishing write tid 1 to trial14245205-26 2026-02-17T12:00:40.692 INFO:tasks.rados.rados.0.trial142.stdout:2332: finishing write tid 2 to trial14245205-26 2026-02-17T12:00:40.692 INFO:tasks.rados.rados.0.trial142.stdout:2334: copy_from oid 49 from oid 16 current snap is 254 2026-02-17T12:00:40.692 INFO:tasks.rados.rados.0.trial142.stdout:2335: read oid 27 snap -1 2026-02-17T12:00:40.692 INFO:tasks.rados.rados.0.trial142.stdout:2335: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:00:40.692 INFO:tasks.rados.rados.0.trial142.stdout:2336: delete oid 9 current snap is 254 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2333: finishing copy_from to trial14245205-6 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2333: got expected ENOENT (src dne) 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2333: finishing copy_from racing read to trial14245205-6 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2332: finishing write tid 3 to trial14245205-26 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2334: finishing copy_from to trial14245205-49 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2334: got expected ENOENT (src dne) 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2332: finishing write tid 4 to trial14245205-26 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2334: finishing copy_from racing read to trial14245205-49 2026-02-17T12:00:40.694 INFO:tasks.rados.rados.0.trial142.stdout:2333: done (4 left) 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2334: done (3 left) 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2336: done (2 left) 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2337: copy_from oid 28 from oid 21 current snap is 254 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: finishing write tid 5 to trial14245205-26 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: oid 26 updating version 0 to 1624 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: oid 26 version 1624 is already newer than 1623 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: oid 26 version 1624 is already newer than 1622 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: oid 26 version 1624 is already newer than 1621 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1624 (ObjNum 810 snap 254 seq_num 810) dirty exists 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: left oid 26 (ObjNum 810 snap 254 seq_num 810) 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2332: done (2 left) 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2338: rollback oid 46 current snap is 254 2026-02-17T12:00:40.695 INFO:tasks.rados.rados.0.trial142.stdout:2338: done (2 left) 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2339: read oid 25 snap -1 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2339: expect (ObjNum 798 snap 250 seq_num 798) 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2340: read oid 45 snap -1 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2340: expect (ObjNum 686 snap 213 seq_num 686) 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2341: rollback oid 50 current snap is 254 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2341: done (4 left) 2026-02-17T12:00:40.696 INFO:tasks.rados.rados.0.trial142.stdout:2342: delete oid 35 current snap is 254 2026-02-17T12:00:40.697 INFO:tasks.rados.rados.0.trial142.stdout:2337: finishing copy_from to trial14245205-28 2026-02-17T12:00:40.697 INFO:tasks.rados.rados.0.trial142.stdout:2337: got expected ENOENT (src dne) 2026-02-17T12:00:40.697 INFO:tasks.rados.rados.0.trial142.stdout:2337: finishing copy_from racing read to trial14245205-28 2026-02-17T12:00:40.697 INFO:tasks.rados.rados.0.trial142.stdout:2340: expect (ObjNum 686 snap 213 seq_num 686) 2026-02-17T12:00:40.782 INFO:tasks.rados.rados.0.trial142.stdout:2335: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:00:40.912 INFO:tasks.rados.rados.0.trial142.stdout:2339: expect (ObjNum 798 snap 250 seq_num 798) 2026-02-17T12:00:41.023 INFO:tasks.rados.rados.0.trial142.stdout:2335: done (4 left) 2026-02-17T12:00:41.023 INFO:tasks.rados.rados.0.trial142.stdout:2337: done (3 left) 2026-02-17T12:00:41.023 INFO:tasks.rados.rados.0.trial142.stdout:2339: done (2 left) 2026-02-17T12:00:41.023 INFO:tasks.rados.rados.0.trial142.stdout:2340: done (1 left) 2026-02-17T12:00:41.023 INFO:tasks.rados.rados.0.trial142.stdout:2342: done (0 left) 2026-02-17T12:00:41.024 INFO:tasks.rados.rados.0.trial142.stdout:2343: copy_from oid 28 from oid 2 current snap is 254 2026-02-17T12:00:41.024 INFO:tasks.rados.rados.0.trial142.stdout:2344: rollback oid 13 current snap is 254 2026-02-17T12:00:41.024 INFO:tasks.rados.rados.0.trial142.stdout:2344: done (1 left) 2026-02-17T12:00:41.024 INFO:tasks.rados.rados.0.trial142.stdout:2345: write oid 17 current snap is 254 2026-02-17T12:00:41.024 INFO:tasks.rados.rados.0.trial142.stdout:2345: seq_num 813 ranges {464091=710855,1925037=477270,2943246=474970} 2026-02-17T12:00:41.027 INFO:tasks.rados.rados.0.trial142.stdout:2345: writing trial14245205-17 from 464091 to 1174946 tid 1 2026-02-17T12:00:41.032 INFO:tasks.rados.rados.0.trial142.stdout:2345: writing trial14245205-17 from 1925037 to 2402307 tid 2 2026-02-17T12:00:41.036 INFO:tasks.rados.rados.0.trial142.stdout:2345: writing trial14245205-17 from 2943246 to 3418216 tid 3 2026-02-17T12:00:41.036 INFO:tasks.rados.rados.0.trial142.stdout:2346: rollback oid 10 current snap is 254 2026-02-17T12:00:41.036 INFO:tasks.rados.rados.0.trial142.stdout:2346: done (2 left) 2026-02-17T12:00:41.036 INFO:tasks.rados.rados.0.trial142.stdout:2347: read oid 42 snap -1 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2347: expect (ObjNum 786 snap 249 seq_num 786) 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2348: copy_from oid 48 from oid 21 current snap is 254 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2345: finishing write tid 1 to trial14245205-17 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2343: finishing copy_from racing read to trial14245205-28 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2345: finishing write tid 2 to trial14245205-17 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2343: finishing copy_from to trial14245205-28 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 1240 (ObjNum 807 snap 253 seq_num 807) dirty exists 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2343: done (3 left) 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2349: write oid 31 current snap is 254 2026-02-17T12:00:41.037 INFO:tasks.rados.rados.0.trial142.stdout:2349: seq_num 814 ranges {480898=502457,1699872=737281,3087022=593876} 2026-02-17T12:00:41.039 INFO:tasks.rados.rados.0.trial142.stdout:2349: writing trial14245205-31 from 480898 to 983355 tid 1 2026-02-17T12:00:41.045 INFO:tasks.rados.rados.0.trial142.stdout:2349: writing trial14245205-31 from 1699872 to 2437153 tid 2 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2349: writing trial14245205-31 from 3087022 to 3680898 tid 3 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2350: read oid 11 snap -1 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2350: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2351: read oid 3 snap -1 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2351: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2352: read oid 6 snap -1 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2352: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:41.049 INFO:tasks.rados.rados.0.trial142.stdout:2353: rollback oid 18 current snap is 254 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2353: done (7 left) 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2354: write oid 44 current snap is 254 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2348: finishing copy_from to trial14245205-48 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2348: got expected ENOENT (src dne) 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2348: finishing copy_from racing read to trial14245205-48 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: finishing write tid 3 to trial14245205-17 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: finishing write tid 4 to trial14245205-17 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: finishing write tid 5 to trial14245205-17 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: oid 17 updating version 0 to 1153 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: oid 17 updating version 1153 to 1154 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: oid 17 version 1154 is already newer than 1151 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: oid 17 version 1154 is already newer than 1152 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1154 (ObjNum 813 snap 254 seq_num 813) dirty exists 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2345: left oid 17 (ObjNum 813 snap 254 seq_num 813) 2026-02-17T12:00:41.050 INFO:tasks.rados.rados.0.trial142.stdout:2347: expect (ObjNum 786 snap 249 seq_num 786) 2026-02-17T12:00:41.125 INFO:tasks.rados.rados.0.trial142.stdout:2349: finishing write tid 1 to trial14245205-31 2026-02-17T12:00:41.125 INFO:tasks.rados.rados.0.trial142.stdout:2349: finishing write tid 2 to trial14245205-31 2026-02-17T12:00:41.126 INFO:tasks.rados.rados.0.trial142.stdout:2354: seq_num 815 ranges {497705=577706,1642001=480939,2598092=497514} 2026-02-17T12:00:41.130 INFO:tasks.rados.rados.0.trial142.stdout:2354: writing trial14245205-44 from 497705 to 1075411 tid 1 2026-02-17T12:00:41.134 INFO:tasks.rados.rados.0.trial142.stdout:2354: writing trial14245205-44 from 1642001 to 2122940 tid 2 2026-02-17T12:00:41.138 INFO:tasks.rados.rados.0.trial142.stdout:2354: writing trial14245205-44 from 2598092 to 3095606 tid 3 2026-02-17T12:00:41.139 INFO:tasks.rados.rados.0.trial142.stdout:2345: done (7 left) 2026-02-17T12:00:41.139 INFO:tasks.rados.rados.0.trial142.stdout:2347: done (6 left) 2026-02-17T12:00:41.139 INFO:tasks.rados.rados.0.trial142.stdout:2348: done (5 left) 2026-02-17T12:00:41.139 INFO:tasks.rados.rados.0.trial142.stdout:2355: delete oid 39 current snap is 254 2026-02-17T12:00:41.139 INFO:tasks.rados.rados.0.trial142.stdout:2351: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:41.233 INFO:tasks.rados.rados.0.trial142.stdout:2350: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2349: finishing write tid 3 to trial14245205-31 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2350: done (5 left) 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2351: done (4 left) 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2355: done (3 left) 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2356: write (excl) oid 7 current snap is 254 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2349: finishing write tid 4 to trial14245205-31 2026-02-17T12:00:41.366 INFO:tasks.rados.rados.0.trial142.stdout:2356: seq_num 817 ranges {531319=728204,1758965=484608,2652938=520058} 2026-02-17T12:00:41.371 INFO:tasks.rados.rados.0.trial142.stdout:2356: writing trial14245205-7 from 531319 to 1259523 tid 1 2026-02-17T12:00:41.375 INFO:tasks.rados.rados.0.trial142.stdout:2356: writing trial14245205-7 from 1758965 to 2243573 tid 2 2026-02-17T12:00:41.378 INFO:tasks.rados.rados.0.trial142.stdout:2356: writing trial14245205-7 from 2652938 to 3172996 tid 3 2026-02-17T12:00:41.378 INFO:tasks.rados.rados.0.trial142.stdout:2357: copy_from oid 2 from oid 23 current snap is 254 2026-02-17T12:00:41.378 INFO:tasks.rados.rados.0.trial142.stdout:2349: finishing write tid 5 to trial14245205-31 2026-02-17T12:00:41.378 INFO:tasks.rados.rados.0.trial142.stdout:2349: oid 31 updating version 0 to 1971 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:2349: oid 31 updating version 1971 to 1972 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:2349: oid 31 version 1972 is already newer than 1970 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:2349: oid 31 updating version 1972 to 1973 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1973 (ObjNum 814 snap 254 seq_num 814) dirty exists 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:2349: left oid 31 (ObjNum 814 snap 254 seq_num 814) 2026-02-17T12:00:41.379 INFO:tasks.rados.rados.0.trial142.stdout:2352: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2354: finishing write tid 1 to trial14245205-44 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2354: finishing write tid 2 to trial14245205-44 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2354: finishing write tid 3 to trial14245205-44 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2349: done (4 left) 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2352: done (3 left) 2026-02-17T12:00:41.468 INFO:tasks.rados.rados.0.trial142.stdout:2358: write oid 9 current snap is 254 2026-02-17T12:00:41.469 INFO:tasks.rados.rados.0.trial142.stdout:2354: finishing write tid 4 to trial14245205-44 2026-02-17T12:00:41.469 INFO:tasks.rados.rados.0.trial142.stdout:2358: seq_num 818 ranges {548126=403453,1417447=744619,2680361=447683,3680450=67676} 2026-02-17T12:00:41.471 INFO:tasks.rados.rados.0.trial142.stdout:2358: writing trial14245205-9 from 548126 to 951579 tid 1 2026-02-17T12:00:41.476 INFO:tasks.rados.rados.0.trial142.stdout:2358: writing trial14245205-9 from 1417447 to 2162066 tid 2 2026-02-17T12:00:41.480 INFO:tasks.rados.rados.0.trial142.stdout:2358: writing trial14245205-9 from 2680361 to 3128044 tid 3 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2358: writing trial14245205-9 from 3680450 to 3748126 tid 4 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2359: rollback oid 16 current snap is 254 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2359: done (4 left) 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2360: copy_from oid 39 from oid 25 current snap is 254 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: finishing write tid 5 to trial14245205-44 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: oid 44 updating version 0 to 1969 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: oid 44 updating version 1969 to 1971 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: oid 44 version 1971 is already newer than 1968 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: oid 44 version 1971 is already newer than 1970 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1971 (ObjNum 815 snap 254 seq_num 815) dirty exists 2026-02-17T12:00:41.482 INFO:tasks.rados.rados.0.trial142.stdout:2354: left oid 44 (ObjNum 815 snap 254 seq_num 815) 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: finishing write tid 1 to trial14245205-7 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: finishing write tid 2 to trial14245205-7 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: finishing write tid 3 to trial14245205-7 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: finishing write tid 4 to trial14245205-7 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: finishing write tid 5 to trial14245205-7 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: oid 7 updating version 0 to 2110 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: oid 7 updating version 2110 to 2112 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: oid 7 version 2112 is already newer than 2111 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: oid 7 version 2112 is already newer than 2109 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2112 (ObjNum 817 snap 254 seq_num 817) dirty exists 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: left oid 7 (ObjNum 817 snap 254 seq_num 817) 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2357: finishing copy_from racing read to trial14245205-2 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2357: finishing copy_from to trial14245205-2 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1967 (ObjNum 805 snap 253 seq_num 805) dirty exists 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 1 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2354: done (4 left) 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2356: done (3 left) 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2357: done (2 left) 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2361: delete oid 43 current snap is 254 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 2 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 3 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 4 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 5 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: finishing write tid 6 to trial14245205-9 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: oid 9 updating version 0 to 2117 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: oid 9 version 2117 is already newer than 2115 2026-02-17T12:00:41.483 INFO:tasks.rados.rados.0.trial142.stdout:2358: oid 9 version 2117 is already newer than 2114 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2358: oid 9 version 2117 is already newer than 2116 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2358: oid 9 version 2117 is already newer than 2113 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2117 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2358: left oid 9 (ObjNum 818 snap 254 seq_num 818) 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2358: done (2 left) 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2361: done (1 left) 2026-02-17T12:00:41.484 INFO:tasks.rados.rados.0.trial142.stdout:2362: delete oid 31 current snap is 254 2026-02-17T12:00:41.485 INFO:tasks.rados.rados.0.trial142.stdout:2362: done (1 left) 2026-02-17T12:00:41.485 INFO:tasks.rados.rados.0.trial142.stdout:2363: snap_create 2026-02-17T12:00:41.486 INFO:tasks.rados.rados.0.trial142.stdout:2360: finishing copy_from racing read to trial14245205-39 2026-02-17T12:00:41.489 INFO:tasks.rados.rados.0.trial142.stdout:2360: finishing copy_from to trial14245205-39 2026-02-17T12:00:41.489 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 1620 (ObjNum 798 snap 250 seq_num 798) dirty exists 2026-02-17T12:00:41.682 INFO:tasks.rados.rados.0.trial142.stdout:2360: done (1 left) 2026-02-17T12:00:41.682 INFO:tasks.rados.rados.0.trial142.stdout:2363: done (0 left) 2026-02-17T12:00:41.682 INFO:tasks.rados.rados.0.trial142.stdout:2364: copy_from oid 23 from oid 48 current snap is 255 2026-02-17T12:00:41.682 INFO:tasks.rados.rados.0.trial142.stdout:2365: read oid 44 snap -1 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2365: expect (ObjNum 815 snap 254 seq_num 815) 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2366: copy_from oid 29 from oid 15 current snap is 255 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2367: read oid 34 snap 254 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2367: expect deleted 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2368: copy_from oid 39 from oid 9 current snap is 255 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2369: read oid 35 snap -1 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2369: expect deleted 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2370: write (excl) oid 46 current snap is 255 2026-02-17T12:00:41.683 INFO:tasks.rados.rados.0.trial142.stdout:2370: seq_num 821 ranges {598547=629200,1876540=491946,3046277=681499} 2026-02-17T12:00:41.686 INFO:tasks.rados.rados.0.trial142.stdout:2370: writing trial14245205-46 from 598547 to 1227747 tid 1 2026-02-17T12:00:41.690 INFO:tasks.rados.rados.0.trial142.stdout:2370: writing trial14245205-46 from 1876540 to 2368486 tid 2 2026-02-17T12:00:41.695 INFO:tasks.rados.rados.0.trial142.stdout:2370: writing trial14245205-46 from 3046277 to 3727776 tid 3 2026-02-17T12:00:41.695 INFO:tasks.rados.rados.0.trial142.stdout:2371: write (excl) oid 40 current snap is 255 2026-02-17T12:00:41.696 INFO:tasks.rados.rados.0.trial142.stdout:2371: seq_num 822 ranges {615354=420802,1651375=751957,3190053=492771} 2026-02-17T12:00:41.699 INFO:tasks.rados.rados.0.trial142.stdout:2371: writing trial14245205-40 from 615354 to 1036156 tid 1 2026-02-17T12:00:41.704 INFO:tasks.rados.rados.0.trial142.stdout:2371: writing trial14245205-40 from 1651375 to 2403332 tid 2 2026-02-17T12:00:41.709 INFO:tasks.rados.rados.0.trial142.stdout:2371: writing trial14245205-40 from 3190053 to 3682824 tid 3 2026-02-17T12:00:41.709 INFO:tasks.rados.rados.0.trial142.stdout:2372: read oid 47 snap -1 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2372: expect (ObjNum 764 snap 244 seq_num 764) 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2373: read oid 49 snap -1 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2373: expect deleted 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2374: read oid 20 snap 254 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2374: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2375: read oid 3 snap -1 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2375: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2376: read oid 19 snap 254 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2376: expect (ObjNum 800 snap 251 seq_num 800) 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2377: write oid 43 current snap is 255 2026-02-17T12:00:41.710 INFO:tasks.rados.rados.0.trial142.stdout:2377: seq_num 823 ranges {632161=496051,1593504=495615,2701123=420396,3611645=220516} 2026-02-17T12:00:41.713 INFO:tasks.rados.rados.0.trial142.stdout:2377: writing trial14245205-43 from 632161 to 1128212 tid 1 2026-02-17T12:00:41.717 INFO:tasks.rados.rados.0.trial142.stdout:2377: writing trial14245205-43 from 1593504 to 2089119 tid 2 2026-02-17T12:00:41.721 INFO:tasks.rados.rados.0.trial142.stdout:2377: writing trial14245205-43 from 2701123 to 3121519 tid 3 2026-02-17T12:00:41.724 INFO:tasks.rados.rados.0.trial142.stdout:2377: writing trial14245205-43 from 3611645 to 3832161 tid 4 2026-02-17T12:00:41.724 INFO:tasks.rados.rados.0.trial142.stdout:2378: read oid 24 snap -1 2026-02-17T12:00:41.724 INFO:tasks.rados.rados.0.trial142.stdout:2378: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:41.724 INFO:tasks.rados.rados.0.trial142.stdout:2379: read oid 50 snap -1 2026-02-17T12:00:41.724 INFO:tasks.rados.rados.0.trial142.stdout:2379: expect deleted 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2367: done (15 left) 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2369: done (14 left) 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2380: read oid 22 snap -1 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2380: expect deleted 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2381: read oid 26 snap -1 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2381: expect (ObjNum 810 snap 254 seq_num 810) 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 16 2026-02-17T12:00:41.725 INFO:tasks.rados.rados.0.trial142.stdout:2365: expect (ObjNum 815 snap 254 seq_num 815) 2026-02-17T12:00:41.844 INFO:tasks.rados.rados.0.trial142.stdout:2370: finishing write tid 1 to trial14245205-46 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2368: finishing copy_from racing read to trial14245205-39 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2368: finishing copy_from to trial14245205-39 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2117 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2366: finishing copy_from racing read to trial14245205-29 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2370: finishing write tid 2 to trial14245205-46 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2365: done (15 left) 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2368: done (14 left) 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2382: write (excl) oid 5 current snap is 255 2026-02-17T12:00:41.845 INFO:tasks.rados.rados.0.trial142.stdout:2382: seq_num 824 ranges {648968=571300,1651986=639273,2728546=631668} 2026-02-17T12:00:41.848 INFO:tasks.rados.rados.0.trial142.stdout:2382: writing trial14245205-5 from 648968 to 1220268 tid 1 2026-02-17T12:00:41.852 INFO:tasks.rados.rados.0.trial142.stdout:2382: writing trial14245205-5 from 1651986 to 2291259 tid 2 2026-02-17T12:00:41.857 INFO:tasks.rados.rados.0.trial142.stdout:2382: writing trial14245205-5 from 2728546 to 3360214 tid 3 2026-02-17T12:00:41.857 INFO:tasks.rados.rados.0.trial142.stdout:2383: snap_create 2026-02-17T12:00:41.857 INFO:tasks.rados.rados.0.trial142.stdout:2366: finishing copy_from to trial14245205-29 2026-02-17T12:00:41.857 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1946 (ObjNum 762 snap 241 seq_num 762) dirty exists 2026-02-17T12:00:41.857 INFO:tasks.rados.rados.0.trial142.stdout:2364: finishing copy_from racing read to trial14245205-23 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2364: finishing copy_from to trial14245205-23 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1619 (ObjNum 808 snap 253 seq_num 808) dirty exists 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: finishing write tid 3 to trial14245205-46 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: finishing write tid 4 to trial14245205-46 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: finishing write tid 5 to trial14245205-46 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: oid 46 updating version 0 to 2121 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: oid 46 version 2121 is already newer than 2120 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: oid 46 updating version 2121 to 2122 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: oid 46 version 2122 is already newer than 2119 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2122 (ObjNum 821 snap 255 seq_num 821) dirty exists 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2370: left oid 46 (ObjNum 821 snap 255 seq_num 821) 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2371: finishing write tid 1 to trial14245205-40 2026-02-17T12:00:41.858 INFO:tasks.rados.rados.0.trial142.stdout:2371: finishing write tid 2 to trial14245205-40 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: finishing write tid 3 to trial14245205-40 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: finishing write tid 4 to trial14245205-40 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: finishing write tid 5 to trial14245205-40 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: oid 40 updating version 0 to 1949 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: oid 40 version 1949 is already newer than 1947 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: oid 40 version 1949 is already newer than 1946 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: oid 40 version 1949 is already newer than 1948 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1949 (ObjNum 822 snap 255 seq_num 822) dirty exists 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2371: left oid 40 (ObjNum 822 snap 255 seq_num 822) 2026-02-17T12:00:41.859 INFO:tasks.rados.rados.0.trial142.stdout:2375: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:41.950 INFO:tasks.rados.rados.0.trial142.stdout:2372: expect (ObjNum 764 snap 244 seq_num 764) 2026-02-17T12:00:42.017 INFO:tasks.rados.rados.0.trial142.stdout:2374: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:00:42.158 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 1 to trial14245205-43 2026-02-17T12:00:42.159 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 2 to trial14245205-43 2026-02-17T12:00:42.159 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 3 to trial14245205-43 2026-02-17T12:00:42.159 INFO:tasks.rados.rados.0.trial142.stdout:2376: expect (ObjNum 800 snap 251 seq_num 800) 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 4 to trial14245205-43 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 5 to trial14245205-43 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: finishing write tid 6 to trial14245205-43 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: oid 43 updating version 0 to 2127 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: oid 43 version 2127 is already newer than 2125 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: oid 43 version 2127 is already newer than 2123 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: oid 43 version 2127 is already newer than 2124 2026-02-17T12:00:42.266 INFO:tasks.rados.rados.0.trial142.stdout:2377: oid 43 version 2127 is already newer than 2126 2026-02-17T12:00:42.267 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2127 (ObjNum 823 snap 255 seq_num 823) dirty exists 2026-02-17T12:00:42.267 INFO:tasks.rados.rados.0.trial142.stdout:2377: left oid 43 (ObjNum 823 snap 255 seq_num 823) 2026-02-17T12:00:42.267 INFO:tasks.rados.rados.0.trial142.stdout:2378: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:42.366 INFO:tasks.rados.rados.0.trial142.stdout:2381: expect (ObjNum 810 snap 254 seq_num 810) 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: finishing write tid 1 to trial14245205-5 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: finishing write tid 2 to trial14245205-5 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: finishing write tid 3 to trial14245205-5 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: finishing write tid 4 to trial14245205-5 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: finishing write tid 5 to trial14245205-5 2026-02-17T12:00:42.543 INFO:tasks.rados.rados.0.trial142.stdout:2382: oid 5 updating version 0 to 1156 2026-02-17T12:00:42.544 INFO:tasks.rados.rados.0.trial142.stdout:2382: oid 5 version 1156 is already newer than 1155 2026-02-17T12:00:42.544 INFO:tasks.rados.rados.0.trial142.stdout:2382: oid 5 updating version 1156 to 1158 2026-02-17T12:00:42.544 INFO:tasks.rados.rados.0.trial142.stdout:2382: oid 5 version 1158 is already newer than 1157 2026-02-17T12:00:42.544 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1158 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-17T12:00:42.544 INFO:tasks.rados.rados.0.trial142.stdout:2382: left oid 5 (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2364: done (15 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2366: done (14 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2370: done (13 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2371: done (12 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2372: done (11 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2373: done (10 left) 2026-02-17T12:00:42.627 INFO:tasks.rados.rados.0.trial142.stdout:2374: done (9 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2375: done (8 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2376: done (7 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2377: done (6 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2378: done (5 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2379: done (4 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2380: done (3 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2381: done (2 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2382: done (1 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2383: done (0 left) 2026-02-17T12:00:42.628 INFO:tasks.rados.rados.0.trial142.stdout:2384: snap_create 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2384: done (0 left) 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2385: read oid 12 snap 255 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2385: expect (ObjNum 768 snap 245 seq_num 768) 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2386: copy_from oid 40 from oid 5 current snap is 257 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2387: write (excl) oid 19 current snap is 257 2026-02-17T12:00:43.626 INFO:tasks.rados.rados.0.trial142.stdout:2387: seq_num 825 ranges {665775=646549,2110468=499284,3155969=442940} 2026-02-17T12:00:43.631 INFO:tasks.rados.rados.0.trial142.stdout:2387: writing trial14245205-19 from 665775 to 1312324 tid 1 2026-02-17T12:00:43.636 INFO:tasks.rados.rados.0.trial142.stdout:2387: writing trial14245205-19 from 2110468 to 2609752 tid 2 2026-02-17T12:00:43.640 INFO:tasks.rados.rados.0.trial142.stdout:2387: writing trial14245205-19 from 3155969 to 3598909 tid 3 2026-02-17T12:00:43.640 INFO:tasks.rados.rados.0.trial142.stdout:2388: delete oid 44 current snap is 257 2026-02-17T12:00:43.640 INFO:tasks.rados.rados.0.trial142.stdout:2385: expect (ObjNum 768 snap 245 seq_num 768) 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2387: finishing write tid 1 to trial14245205-19 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2386: finishing copy_from racing read to trial14245205-40 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2386: finishing copy_from to trial14245205-40 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1158 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2387: finishing write tid 2 to trial14245205-19 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2387: finishing write tid 3 to trial14245205-19 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2387: finishing write tid 4 to trial14245205-19 2026-02-17T12:00:43.794 INFO:tasks.rados.rados.0.trial142.stdout:2387: finishing write tid 5 to trial14245205-19 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: oid 19 updating version 0 to 1969 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: oid 19 updating version 1969 to 1971 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: oid 19 version 1971 is already newer than 1970 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: oid 19 version 1971 is already newer than 1968 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 1971 (ObjNum 825 snap 257 seq_num 825) dirty exists 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: left oid 19 (ObjNum 825 snap 257 seq_num 825) 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2385: done (3 left) 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2386: done (2 left) 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2387: done (1 left) 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2388: done (0 left) 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2389: copy_from oid 40 from oid 6 current snap is 257 2026-02-17T12:00:43.795 INFO:tasks.rados.rados.0.trial142.stdout:2390: write (excl) oid 29 current snap is 257 2026-02-17T12:00:43.796 INFO:tasks.rados.rados.0.trial142.stdout:2390: seq_num 827 ranges {699389=797047,2111079=502953,3094462=581837} 2026-02-17T12:00:43.799 INFO:tasks.rados.rados.0.trial142.stdout:2390: writing trial14245205-29 from 699389 to 1496436 tid 1 2026-02-17T12:00:43.803 INFO:tasks.rados.rados.0.trial142.stdout:2390: writing trial14245205-29 from 2111079 to 2614032 tid 2 2026-02-17T12:00:43.808 INFO:tasks.rados.rados.0.trial142.stdout:2390: writing trial14245205-29 from 3094462 to 3676299 tid 3 2026-02-17T12:00:43.808 INFO:tasks.rados.rados.0.trial142.stdout:2391: read oid 3 snap -1 2026-02-17T12:00:43.808 INFO:tasks.rados.rados.0.trial142.stdout:2391: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:43.808 INFO:tasks.rados.rados.0.trial142.stdout:2392: copy_from oid 2 from oid 32 current snap is 257 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2389: finishing copy_from racing read to trial14245205-40 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2389: finishing copy_from to trial14245205-40 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1942 (ObjNum 735 snap 234 seq_num 735) dirty exists 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2390: finishing write tid 1 to trial14245205-29 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2390: finishing write tid 2 to trial14245205-29 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2389: done (3 left) 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2393: read oid 24 snap -1 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2393: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:43.809 INFO:tasks.rados.rados.0.trial142.stdout:2394: snap_create 2026-02-17T12:00:43.811 INFO:tasks.rados.rados.0.trial142.stdout:2390: finishing write tid 3 to trial14245205-29 2026-02-17T12:00:43.811 INFO:tasks.rados.rados.0.trial142.stdout:2390: finishing write tid 4 to trial14245205-29 2026-02-17T12:00:43.811 INFO:tasks.rados.rados.0.trial142.stdout:2390: finishing write tid 5 to trial14245205-29 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:2390: oid 29 updating version 0 to 1947 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:2390: oid 29 updating version 1947 to 1948 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:2390: oid 29 updating version 1948 to 1950 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:2390: oid 29 version 1950 is already newer than 1949 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1950 (ObjNum 827 snap 257 seq_num 827) dirty exists 2026-02-17T12:00:43.812 INFO:tasks.rados.rados.0.trial142.stdout:2390: left oid 29 (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:00:43.813 INFO:tasks.rados.rados.0.trial142.stdout:2391: expect (ObjNum 787 snap 249 seq_num 787) 2026-02-17T12:00:43.903 INFO:tasks.rados.rados.0.trial142.stdout:2393: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:00:44.003 INFO:tasks.rados.rados.0.trial142.stdout:2392: finishing copy_from racing read to trial14245205-2 2026-02-17T12:00:44.003 INFO:tasks.rados.rados.0.trial142.stdout:2392: finishing copy_from to trial14245205-2 2026-02-17T12:00:44.003 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T12:00:44.688 INFO:tasks.rados.rados.0.trial142.stdout:2390: done (4 left) 2026-02-17T12:00:44.688 INFO:tasks.rados.rados.0.trial142.stdout:2391: done (3 left) 2026-02-17T12:00:44.688 INFO:tasks.rados.rados.0.trial142.stdout:2392: done (2 left) 2026-02-17T12:00:44.688 INFO:tasks.rados.rados.0.trial142.stdout:2393: done (1 left) 2026-02-17T12:00:44.689 INFO:tasks.rados.rados.0.trial142.stdout:2394: done (0 left) 2026-02-17T12:00:44.689 INFO:tasks.rados.rados.0.trial142.stdout:2395: copy_from oid 9 from oid 16 current snap is 258 2026-02-17T12:00:44.689 INFO:tasks.rados.rados.0.trial142.stdout:2396: write (excl) oid 40 current snap is 258 2026-02-17T12:00:44.689 INFO:tasks.rados.rados.0.trial142.stdout:2396: seq_num 828 ranges {716196=472296,1769561=646611,3121885=793109} 2026-02-17T12:00:44.692 INFO:tasks.rados.rados.0.trial142.stdout:2396: writing trial14245205-40 from 716196 to 1188492 tid 1 2026-02-17T12:00:44.697 INFO:tasks.rados.rados.0.trial142.stdout:2396: writing trial14245205-40 from 1769561 to 2416172 tid 2 2026-02-17T12:00:44.702 INFO:tasks.rados.rados.0.trial142.stdout:2396: writing trial14245205-40 from 3121885 to 3914994 tid 3 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2397: snap_create 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2395: finishing copy_from to trial14245205-9 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2395: got expected ENOENT (src dne) 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2395: finishing copy_from racing read to trial14245205-9 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2396: finishing write tid 1 to trial14245205-40 2026-02-17T12:00:44.703 INFO:tasks.rados.rados.0.trial142.stdout:2396: finishing write tid 2 to trial14245205-40 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: finishing write tid 3 to trial14245205-40 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: finishing write tid 4 to trial14245205-40 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: finishing write tid 5 to trial14245205-40 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: oid 40 updating version 0 to 1950 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: oid 40 updating version 1950 to 1952 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: oid 40 version 1952 is already newer than 1951 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: oid 40 updating version 1952 to 1953 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1953 (ObjNum 828 snap 258 seq_num 828) dirty exists 2026-02-17T12:00:44.705 INFO:tasks.rados.rados.0.trial142.stdout:2396: left oid 40 (ObjNum 828 snap 258 seq_num 828) 2026-02-17T12:00:46.270 INFO:tasks.rados.rados.0.trial142.stdout:2395: done (2 left) 2026-02-17T12:00:46.270 INFO:tasks.rados.rados.0.trial142.stdout:2396: done (1 left) 2026-02-17T12:00:46.270 INFO:tasks.rados.rados.0.trial142.stdout:2397: done (0 left) 2026-02-17T12:00:46.270 INFO:tasks.rados.rados.0.trial142.stdout:2398: delete oid 38 current snap is 259 2026-02-17T12:00:46.271 INFO:tasks.rados.rados.0.trial142.stdout:2398: done (0 left) 2026-02-17T12:00:46.272 INFO:tasks.rados.rados.0.trial142.stdout:2399: read oid 30 snap -1 2026-02-17T12:00:46.272 INFO:tasks.rados.rados.0.trial142.stdout:2399: expect (ObjNum 770 snap 245 seq_num 770) 2026-02-17T12:00:46.272 INFO:tasks.rados.rados.0.trial142.stdout:2400: snap_create 2026-02-17T12:00:46.277 INFO:tasks.rados.rados.0.trial142.stdout:2399: expect (ObjNum 770 snap 245 seq_num 770) 2026-02-17T12:00:47.271 INFO:tasks.rados.rados.0.trial142.stdout:2399: done (1 left) 2026-02-17T12:00:47.271 INFO:tasks.rados.rados.0.trial142.stdout:2400: done (0 left) 2026-02-17T12:00:47.271 INFO:tasks.rados.rados.0.trial142.stdout:2401: delete oid 40 current snap is 260 2026-02-17T12:00:47.273 INFO:tasks.rados.rados.0.trial142.stdout:2401: done (0 left) 2026-02-17T12:00:47.273 INFO:tasks.rados.rados.0.trial142.stdout:2402: read oid 31 snap 257 2026-02-17T12:00:47.273 INFO:tasks.rados.rados.0.trial142.stdout:2402: expect deleted 2026-02-17T12:00:47.273 INFO:tasks.rados.rados.0.trial142.stdout:2403: rollback oid 16 current snap is 260 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 258 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2404: read oid 4 snap -1 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2404: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2405: snap_create 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2403: finishing rollback tid 1 to trial14245205-16 2026-02-17T12:00:47.274 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 0 (ObjNum 33 snap 0 seq_num 1201977176) dirty dne 2026-02-17T12:00:47.279 INFO:tasks.rados.rados.0.trial142.stdout:2404: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2402: done (3 left) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2403: done (2 left) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2404: done (1 left) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2405: done (0 left) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2406: read oid 30 snap -1 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2406: expect (ObjNum 770 snap 245 seq_num 770) 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2407: write (excl) oid 6 current snap is 261 2026-02-17T12:00:47.626 INFO:tasks.rados.rados.0.trial142.stdout:2407: seq_num 831 ranges {766617=414396,1945007=510291,3204154=626925} 2026-02-17T12:00:47.631 INFO:tasks.rados.rados.0.trial142.stdout:2407: writing trial14245205-6 from 766617 to 1181013 tid 1 2026-02-17T12:00:47.636 INFO:tasks.rados.rados.0.trial142.stdout:2407: writing trial14245205-6 from 1945007 to 2455298 tid 2 2026-02-17T12:00:47.641 INFO:tasks.rados.rados.0.trial142.stdout:2407: writing trial14245205-6 from 3204154 to 3831079 tid 3 2026-02-17T12:00:47.641 INFO:tasks.rados.rados.0.trial142.stdout:2408: rollback oid 44 current snap is 261 2026-02-17T12:00:47.641 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 256 2026-02-17T12:00:47.641 INFO:tasks.rados.rados.0.trial142.stdout:2406: expect (ObjNum 770 snap 245 seq_num 770) 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: finishing write tid 1 to trial14245205-6 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: finishing write tid 2 to trial14245205-6 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: finishing write tid 3 to trial14245205-6 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: finishing write tid 4 to trial14245205-6 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: finishing write tid 5 to trial14245205-6 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: oid 6 updating version 0 to 1957 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: oid 6 updating version 1957 to 1958 2026-02-17T12:00:47.713 INFO:tasks.rados.rados.0.trial142.stdout:2407: oid 6 version 1958 is already newer than 1956 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2407: oid 6 version 1958 is already newer than 1955 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 1958 (ObjNum 831 snap 261 seq_num 831) dirty exists 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2407: left oid 6 (ObjNum 831 snap 261 seq_num 831) 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2408: finishing rollback tid 1 to trial14245205-44 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2408: finishing rollback tid 2 to trial14245205-44 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1974 (ObjNum 815 snap 254 seq_num 815) dirty exists 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2406: done (2 left) 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2407: done (1 left) 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2408: done (0 left) 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2409: copy_from oid 10 from oid 2 current snap is 261 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2410: write oid 31 current snap is 261 2026-02-17T12:00:47.714 INFO:tasks.rados.rados.0.trial142.stdout:2410: seq_num 832 ranges {783424=489645,2003489=653949,3231577=554550} 2026-02-17T12:00:47.718 INFO:tasks.rados.rados.0.trial142.stdout:2410: writing trial14245205-31 from 783424 to 1273069 tid 1 2026-02-17T12:00:47.723 INFO:tasks.rados.rados.0.trial142.stdout:2410: writing trial14245205-31 from 2003489 to 2657438 tid 2 2026-02-17T12:00:47.728 INFO:tasks.rados.rados.0.trial142.stdout:2410: writing trial14245205-31 from 3231577 to 3786127 tid 3 2026-02-17T12:00:47.728 INFO:tasks.rados.rados.0.trial142.stdout:2411: snap_create 2026-02-17T12:00:47.729 INFO:tasks.rados.rados.0.trial142.stdout:2409: finishing copy_from racing read to trial14245205-10 2026-02-17T12:00:47.729 INFO:tasks.rados.rados.0.trial142.stdout:2410: finishing write tid 1 to trial14245205-31 2026-02-17T12:00:47.729 INFO:tasks.rados.rados.0.trial142.stdout:2409: finishing copy_from to trial14245205-10 2026-02-17T12:00:47.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 656 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T12:00:47.729 INFO:tasks.rados.rados.0.trial142.stdout:2410: finishing write tid 2 to trial14245205-31 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: finishing write tid 3 to trial14245205-31 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: finishing write tid 4 to trial14245205-31 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: finishing write tid 5 to trial14245205-31 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: oid 31 updating version 0 to 1976 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: oid 31 updating version 1976 to 1978 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: oid 31 version 1978 is already newer than 1975 2026-02-17T12:00:47.730 INFO:tasks.rados.rados.0.trial142.stdout:2410: oid 31 version 1978 is already newer than 1977 2026-02-17T12:00:47.731 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 1978 (ObjNum 832 snap 261 seq_num 832) dirty exists 2026-02-17T12:00:47.731 INFO:tasks.rados.rados.0.trial142.stdout:2410: left oid 31 (ObjNum 832 snap 261 seq_num 832) 2026-02-17T12:00:48.628 INFO:tasks.rados.rados.0.trial142.stdout:2409: done (2 left) 2026-02-17T12:00:48.628 INFO:tasks.rados.rados.0.trial142.stdout:2410: done (1 left) 2026-02-17T12:00:48.628 INFO:tasks.rados.rados.0.trial142.stdout:2411: done (0 left) 2026-02-17T12:00:48.628 INFO:tasks.rados.rados.0.trial142.stdout:2412: delete oid 19 current snap is 262 2026-02-17T12:00:48.630 INFO:tasks.rados.rados.0.trial142.stdout:2412: done (0 left) 2026-02-17T12:00:48.630 INFO:tasks.rados.rados.0.trial142.stdout:2413: copy_from oid 18 from oid 21 current snap is 262 2026-02-17T12:00:48.630 INFO:tasks.rados.rados.0.trial142.stdout:2414: rollback oid 22 current snap is 262 2026-02-17T12:00:48.631 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 260 2026-02-17T12:00:48.631 INFO:tasks.rados.rados.0.trial142.stdout:2415: read oid 1 snap 260 2026-02-17T12:00:48.631 INFO:tasks.rados.rados.0.trial142.stdout:2415: expect (ObjNum 805 snap 253 seq_num 805) 2026-02-17T12:00:48.631 INFO:tasks.rados.rados.0.trial142.stdout:2416: snap_remove snap 254 2026-02-17T12:00:49.630 INFO:tasks.rados.rados.0.trial142.stdout:2416: done (3 left) 2026-02-17T12:00:49.630 INFO:tasks.rados.rados.0.trial142.stdout:2417: copy_from oid 35 from oid 30 current snap is 262 2026-02-17T12:00:49.630 INFO:tasks.rados.rados.0.trial142.stdout:2414: finishing rollback tid 1 to trial14245205-22 2026-02-17T12:00:49.630 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 0 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T12:00:49.630 INFO:tasks.rados.rados.0.trial142.stdout:2413: finishing copy_from to trial14245205-18 2026-02-17T12:00:49.631 INFO:tasks.rados.rados.0.trial142.stdout:2413: got expected ENOENT (src dne) 2026-02-17T12:00:49.631 INFO:tasks.rados.rados.0.trial142.stdout:2413: finishing copy_from racing read to trial14245205-18 2026-02-17T12:00:49.631 INFO:tasks.rados.rados.0.trial142.stdout:2415: expect (ObjNum 805 snap 253 seq_num 805) 2026-02-17T12:00:49.822 INFO:tasks.rados.rados.0.trial142.stdout:2417: finishing copy_from racing read to trial14245205-35 2026-02-17T12:00:49.822 INFO:tasks.rados.rados.0.trial142.stdout:2417: finishing copy_from to trial14245205-35 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 1612 (ObjNum 770 snap 245 seq_num 770) dirty exists 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2413: done (3 left) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2414: done (2 left) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2415: done (1 left) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2417: done (0 left) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2418: read oid 29 snap -1 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2418: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2419: read oid 4 snap 260 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2419: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:2420: rollback oid 33 current snap is 262 2026-02-17T12:00:49.823 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 261 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:2421: read oid 40 snap -1 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:2421: expect deleted 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:2422: snap_create 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:2420: finishing rollback tid 1 to trial14245205-33 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T12:00:49.824 INFO:tasks.rados.rados.0.trial142.stdout:2419: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:49.988 INFO:tasks.rados.rados.0.trial142.stdout:2418: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2418: done (4 left) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2419: done (3 left) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2420: done (2 left) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2421: done (1 left) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2422: done (0 left) 2026-02-17T12:00:50.842 INFO:tasks.rados.rados.0.trial142.stdout:2423: snap_create 2026-02-17T12:00:51.883 INFO:tasks.rados.rados.0.trial142.stdout:2423: done (0 left) 2026-02-17T12:00:51.883 INFO:tasks.rados.rados.0.trial142.stdout:2424: write (excl) oid 23 current snap is 264 2026-02-17T12:00:51.883 INFO:tasks.rados.rados.0.trial142.stdout:2424: seq_num 834 ranges {417038=640143,1720453=296585} 2026-02-17T12:00:51.887 INFO:tasks.rados.rados.0.trial142.stdout:2424: writing trial14245205-23 from 417038 to 1057181 tid 1 2026-02-17T12:00:51.891 INFO:tasks.rados.rados.0.trial142.stdout:2424: writing trial14245205-23 from 1720453 to 2017038 tid 2 2026-02-17T12:00:51.891 INFO:tasks.rados.rados.0.trial142.stdout:2425: delete oid 47 current snap is 264 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: finishing write tid 1 to trial14245205-23 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: finishing write tid 2 to trial14245205-23 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: finishing write tid 3 to trial14245205-23 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: finishing write tid 4 to trial14245205-23 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: oid 23 updating version 0 to 1975 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: oid 23 version 1975 is already newer than 1974 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: oid 23 version 1975 is already newer than 1973 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1975 (ObjNum 834 snap 264 seq_num 834) dirty exists 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: left oid 23 (ObjNum 834 snap 264 seq_num 834) 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2424: done (1 left) 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2425: done (0 left) 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2426: rollback oid 29 current snap is 264 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 262 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2427: rollback oid 30 current snap is 264 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 30 to 263 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2428: read oid 14 snap -1 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2428: expect (ObjNum 752 snap 238 seq_num 752) 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2429: write (excl) oid 21 current snap is 264 2026-02-17T12:00:51.894 INFO:tasks.rados.rados.0.trial142.stdout:2429: seq_num 836 ranges {450652=790641,1721064=329588} 2026-02-17T12:00:51.899 INFO:tasks.rados.rados.0.trial142.stdout:2429: writing trial14245205-21 from 450652 to 1241293 tid 1 2026-02-17T12:00:51.903 INFO:tasks.rados.rados.0.trial142.stdout:2429: writing trial14245205-21 from 1721064 to 2050652 tid 2 2026-02-17T12:00:51.903 INFO:tasks.rados.rados.0.trial142.stdout:2430: read oid 35 snap 259 2026-02-17T12:00:51.903 INFO:tasks.rados.rados.0.trial142.stdout:2430: expect deleted 2026-02-17T12:00:51.903 INFO:tasks.rados.rados.0.trial142.stdout:2431: delete oid 38 current snap is 264 2026-02-17T12:00:51.903 INFO:tasks.rados.rados.0.trial142.stdout:2428: expect (ObjNum 752 snap 238 seq_num 752) 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2426: finishing rollback tid 0 to trial14245205-29 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2426: finishing rollback tid 1 to trial14245205-29 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2428: done (5 left) 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2431: done (4 left) 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2432: read oid 15 snap -1 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2432: expect (ObjNum 762 snap 241 seq_num 762) 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2433: rollback oid 16 current snap is 264 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 255 2026-02-17T12:00:51.965 INFO:tasks.rados.rados.0.trial142.stdout:2426: finishing rollback tid 2 to trial14245205-29 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1953 (ObjNum 827 snap 257 seq_num 827) dirty exists 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2427: finishing rollback tid 0 to trial14245205-30 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2427: finishing rollback tid 1 to trial14245205-30 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2427: finishing rollback tid 2 to trial14245205-30 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 1956 (ObjNum 770 snap 245 seq_num 770) dirty exists 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2429: finishing write tid 1 to trial14245205-21 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2429: finishing write tid 2 to trial14245205-21 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2426: done (5 left) 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2427: done (4 left) 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2430: done (3 left) 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2434: delete oid 37 current snap is 264 2026-02-17T12:00:51.966 INFO:tasks.rados.rados.0.trial142.stdout:2429: finishing write tid 3 to trial14245205-21 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: finishing write tid 4 to trial14245205-21 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: oid 21 updating version 0 to 1917 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: oid 21 version 1917 is already newer than 1916 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: oid 21 version 1917 is already newer than 1915 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1917 (ObjNum 836 snap 264 seq_num 836) dirty exists 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: left oid 21 (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2429: done (3 left) 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2434: done (2 left) 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2435: read oid 32 snap -1 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2435: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2436: copy_from oid 6 from oid 18 current snap is 264 2026-02-17T12:00:51.967 INFO:tasks.rados.rados.0.trial142.stdout:2437: delete oid 41 current snap is 264 2026-02-17T12:00:51.968 INFO:tasks.rados.rados.0.trial142.stdout:2436: finishing copy_from to trial14245205-6 2026-02-17T12:00:51.968 INFO:tasks.rados.rados.0.trial142.stdout:2436: got expected ENOENT (src dne) 2026-02-17T12:00:51.968 INFO:tasks.rados.rados.0.trial142.stdout:2436: finishing copy_from racing read to trial14245205-6 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2436: done (4 left) 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2437: done (3 left) 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2438: read oid 11 snap 257 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2438: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2439: read oid 4 snap -1 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2439: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:51.969 INFO:tasks.rados.rados.0.trial142.stdout:2440: snap_remove snap 263 2026-02-17T12:00:52.629 INFO:tasks.rados.rados.0.trial142.stdout:2440: done (5 left) 2026-02-17T12:00:52.629 INFO:tasks.rados.rados.0.trial142.stdout:2441: rollback oid 8 current snap is 264 2026-02-17T12:00:52.629 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 260 2026-02-17T12:00:52.629 INFO:tasks.rados.rados.0.trial142.stdout:2435: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:52.742 INFO:tasks.rados.rados.0.trial142.stdout:2439: expect (ObjNum 803 snap 252 seq_num 803) 2026-02-17T12:00:52.907 INFO:tasks.rados.rados.0.trial142.stdout:2432: expect (ObjNum 762 snap 241 seq_num 762) 2026-02-17T12:00:52.995 INFO:tasks.rados.rados.0.trial142.stdout:2433: finishing rollback tid 1 to trial14245205-16 2026-02-17T12:00:52.995 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 0 (ObjNum 177 snap 0 seq_num 1213917056) dirty dne 2026-02-17T12:00:52.995 INFO:tasks.rados.rados.0.trial142.stdout:2438: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:00:53.129 INFO:tasks.rados.rados.0.trial142.stdout:2441: finishing rollback tid 0 to trial14245205-8 2026-02-17T12:00:53.129 INFO:tasks.rados.rados.0.trial142.stdout:2441: finishing rollback tid 1 to trial14245205-8 2026-02-17T12:00:53.129 INFO:tasks.rados.rados.0.trial142.stdout:2441: finishing rollback tid 2 to trial14245205-8 2026-02-17T12:00:53.129 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1981 (ObjNum 774 snap 246 seq_num 774) dirty exists 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2432: done (5 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2433: done (4 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2435: done (3 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2438: done (2 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2439: done (1 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2441: done (0 left) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2442: read oid 20 snap -1 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2442: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2443: copy_from oid 3 from oid 31 current snap is 264 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2444: write (excl) oid 16 current snap is 264 2026-02-17T12:00:53.130 INFO:tasks.rados.rados.0.trial142.stdout:2444: seq_num 840 ranges {517880=407990,1554992=562888} 2026-02-17T12:00:53.133 INFO:tasks.rados.rados.0.trial142.stdout:2444: writing trial14245205-16 from 517880 to 925870 tid 1 2026-02-17T12:00:53.138 INFO:tasks.rados.rados.0.trial142.stdout:2444: writing trial14245205-16 from 1554992 to 2117880 tid 2 2026-02-17T12:00:53.138 INFO:tasks.rados.rados.0.trial142.stdout:2445: write (excl) oid 36 current snap is 264 2026-02-17T12:00:53.138 INFO:tasks.rados.rados.0.trial142.stdout:2445: seq_num 841 ranges {534687=483239,1613474=412283} 2026-02-17T12:00:53.141 INFO:tasks.rados.rados.0.trial142.stdout:2445: writing trial14245205-36 from 534687 to 1017926 tid 1 2026-02-17T12:00:53.145 INFO:tasks.rados.rados.0.trial142.stdout:2445: writing trial14245205-36 from 1613474 to 2025757 tid 2 2026-02-17T12:00:53.146 INFO:tasks.rados.rados.0.trial142.stdout:2446: read oid 39 snap -1 2026-02-17T12:00:53.146 INFO:tasks.rados.rados.0.trial142.stdout:2446: expect (ObjNum 818 snap 254 seq_num 818) 2026-02-17T12:00:53.146 INFO:tasks.rados.rados.0.trial142.stdout:2447: rollback oid 49 current snap is 264 2026-02-17T12:00:53.146 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 258 2026-02-17T12:00:53.146 INFO:tasks.rados.rados.0.trial142.stdout:2442: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: finishing write tid 1 to trial14245205-16 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: finishing write tid 2 to trial14245205-16 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: finishing write tid 3 to trial14245205-16 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: finishing write tid 4 to trial14245205-16 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: oid 16 updating version 0 to 1160 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: oid 16 updating version 1160 to 1161 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: oid 16 version 1161 is already newer than 1159 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1161 (ObjNum 840 snap 264 seq_num 840) dirty exists 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2444: left oid 16 (ObjNum 840 snap 264 seq_num 840) 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2443: finishing copy_from racing read to trial14245205-3 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2443: finishing copy_from to trial14245205-3 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1978 (ObjNum 832 snap 261 seq_num 832) dirty exists 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: finishing write tid 1 to trial14245205-36 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2447: finishing rollback tid 1 to trial14245205-49 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 0 (ObjNum 81 snap 0 seq_num 1214091888) dirty dne 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: finishing write tid 2 to trial14245205-36 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: finishing write tid 3 to trial14245205-36 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: finishing write tid 4 to trial14245205-36 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: oid 36 updating version 0 to 1106 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: oid 36 updating version 1106 to 1107 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: oid 36 version 1107 is already newer than 1105 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1107 (ObjNum 841 snap 264 seq_num 841) dirty exists 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2445: left oid 36 (ObjNum 841 snap 264 seq_num 841) 2026-02-17T12:00:53.287 INFO:tasks.rados.rados.0.trial142.stdout:2446: expect (ObjNum 818 snap 254 seq_num 818) 2026-02-17T12:00:53.375 INFO:tasks.rados.rados.0.trial142.stdout:2442: done (5 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2443: done (4 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2444: done (3 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2445: done (2 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2446: done (1 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2447: done (0 left) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2448: rollback oid 42 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 255 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2449: copy_from oid 37 from oid 34 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2450: read oid 15 snap -1 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2450: expect (ObjNum 762 snap 241 seq_num 762) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2451: copy_from oid 49 from oid 39 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2452: rollback oid 11 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 257 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2453: copy_from oid 46 from oid 4 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2454: delete oid 10 current snap is 264 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2449: finishing copy_from to trial14245205-37 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2449: got expected ENOENT (src dne) 2026-02-17T12:00:53.376 INFO:tasks.rados.rados.0.trial142.stdout:2449: finishing copy_from racing read to trial14245205-37 2026-02-17T12:00:53.377 INFO:tasks.rados.rados.0.trial142.stdout:2448: finishing rollback tid 0 to trial14245205-42 2026-02-17T12:00:53.378 INFO:tasks.rados.rados.0.trial142.stdout:2448: finishing rollback tid 1 to trial14245205-42 2026-02-17T12:00:53.378 INFO:tasks.rados.rados.0.trial142.stdout:2448: finishing rollback tid 2 to trial14245205-42 2026-02-17T12:00:53.378 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1110 (ObjNum 786 snap 249 seq_num 786) dirty exists 2026-02-17T12:00:53.379 INFO:tasks.rados.rados.0.trial142.stdout:2450: expect (ObjNum 762 snap 241 seq_num 762) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2452: finishing rollback tid 0 to trial14245205-11 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2452: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2452: finishing rollback tid 2 to trial14245205-11 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1126 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2453: finishing copy_from racing read to trial14245205-46 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2451: finishing copy_from racing read to trial14245205-49 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2453: finishing copy_from to trial14245205-46 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2105 (ObjNum 803 snap 252 seq_num 803) dirty exists 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2451: finishing copy_from to trial14245205-49 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2117 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2448: done (6 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2449: done (5 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2450: done (4 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2451: done (3 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2452: done (2 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2453: done (1 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2454: done (0 left) 2026-02-17T12:00:53.468 INFO:tasks.rados.rados.0.trial142.stdout:2455: snap_remove snap 256 2026-02-17T12:00:53.891 INFO:tasks.rados.rados.0.trial142.stdout:2455: done (0 left) 2026-02-17T12:00:53.891 INFO:tasks.rados.rados.0.trial142.stdout:2456: read oid 34 snap 255 2026-02-17T12:00:53.891 INFO:tasks.rados.rados.0.trial142.stdout:2456: expect deleted 2026-02-17T12:00:53.891 INFO:tasks.rados.rados.0.trial142.stdout:2457: write oid 8 current snap is 264 2026-02-17T12:00:53.891 INFO:tasks.rados.rados.0.trial142.stdout:2457: seq_num 843 ranges {568301=633737,1614085=415952} 2026-02-17T12:00:53.895 INFO:tasks.rados.rados.0.trial142.stdout:2457: writing trial14245205-8 from 568301 to 1202038 tid 1 2026-02-17T12:00:53.898 INFO:tasks.rados.rados.0.trial142.stdout:2457: writing trial14245205-8 from 1614085 to 2030037 tid 2 2026-02-17T12:00:53.899 INFO:tasks.rados.rados.0.trial142.stdout:2458: delete oid 36 current snap is 264 2026-02-17T12:00:53.899 INFO:tasks.rados.rados.0.trial142.stdout:2457: finishing write tid 1 to trial14245205-8 2026-02-17T12:00:53.900 INFO:tasks.rados.rados.0.trial142.stdout:2456: done (2 left) 2026-02-17T12:00:53.900 INFO:tasks.rados.rados.0.trial142.stdout:2458: done (1 left) 2026-02-17T12:00:53.900 INFO:tasks.rados.rados.0.trial142.stdout:2459: read oid 50 snap -1 2026-02-17T12:00:53.900 INFO:tasks.rados.rados.0.trial142.stdout:2459: expect deleted 2026-02-17T12:00:53.900 INFO:tasks.rados.rados.0.trial142.stdout:2460: delete oid 38 current snap is 264 2026-02-17T12:00:53.901 INFO:tasks.rados.rados.0.trial142.stdout:2457: finishing write tid 2 to trial14245205-8 2026-02-17T12:00:53.901 INFO:tasks.rados.rados.0.trial142.stdout:2459: done (2 left) 2026-02-17T12:00:53.901 INFO:tasks.rados.rados.0.trial142.stdout:2460: done (1 left) 2026-02-17T12:00:53.901 INFO:tasks.rados.rados.0.trial142.stdout:2461: snap_remove snap 260 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2461: done (1 left) 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2462: delete oid 35 current snap is 264 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2457: finishing write tid 3 to trial14245205-8 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2457: finishing write tid 4 to trial14245205-8 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2457: oid 8 updating version 0 to 1982 2026-02-17T12:00:54.892 INFO:tasks.rados.rados.0.trial142.stdout:2457: oid 8 updating version 1982 to 1983 2026-02-17T12:00:54.893 INFO:tasks.rados.rados.0.trial142.stdout:2457: oid 8 updating version 1983 to 1984 2026-02-17T12:00:54.893 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1984 (ObjNum 843 snap 264 seq_num 843) dirty exists 2026-02-17T12:00:54.893 INFO:tasks.rados.rados.0.trial142.stdout:2457: left oid 8 (ObjNum 843 snap 264 seq_num 843) 2026-02-17T12:00:54.896 INFO:tasks.rados.rados.0.trial142.stdout:2457: done (1 left) 2026-02-17T12:00:54.896 INFO:tasks.rados.rados.0.trial142.stdout:2462: done (0 left) 2026-02-17T12:00:54.896 INFO:tasks.rados.rados.0.trial142.stdout:2463: write (excl) oid 2 current snap is 264 2026-02-17T12:00:54.896 INFO:tasks.rados.rados.0.trial142.stdout:2463: seq_num 847 ranges {635529=651086,1848013=387516} 2026-02-17T12:00:54.901 INFO:tasks.rados.rados.0.trial142.stdout:2463: writing trial14245205-2 from 635529 to 1286615 tid 1 2026-02-17T12:00:54.905 INFO:tasks.rados.rados.0.trial142.stdout:2463: writing trial14245205-2 from 1848013 to 2235529 tid 2 2026-02-17T12:00:54.905 INFO:tasks.rados.rados.0.trial142.stdout:2464: copy_from oid 14 from oid 27 current snap is 264 2026-02-17T12:00:54.906 INFO:tasks.rados.rados.0.trial142.stdout:2463: finishing write tid 1 to trial14245205-2 2026-02-17T12:00:54.906 INFO:tasks.rados.rados.0.trial142.stdout:2465: read oid 47 snap -1 2026-02-17T12:00:54.906 INFO:tasks.rados.rados.0.trial142.stdout:2465: expect deleted 2026-02-17T12:00:54.906 INFO:tasks.rados.rados.0.trial142.stdout:2466: delete oid 36 current snap is 264 2026-02-17T12:00:54.907 INFO:tasks.rados.rados.0.trial142.stdout:2465: done (3 left) 2026-02-17T12:00:54.907 INFO:tasks.rados.rados.0.trial142.stdout:2466: done (2 left) 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2467: read oid 37 snap 259 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2467: expect deleted 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2468: snap_create 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: finishing write tid 2 to trial14245205-2 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: finishing write tid 3 to trial14245205-2 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: finishing write tid 4 to trial14245205-2 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: oid 2 updating version 0 to 1969 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: oid 2 updating version 1969 to 1970 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: oid 2 version 1970 is already newer than 1968 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1970 (ObjNum 847 snap 264 seq_num 847) dirty exists 2026-02-17T12:00:54.908 INFO:tasks.rados.rados.0.trial142.stdout:2463: left oid 2 (ObjNum 847 snap 264 seq_num 847) 2026-02-17T12:00:54.911 INFO:tasks.rados.rados.0.trial142.stdout:2464: finishing copy_from racing read to trial14245205-14 2026-02-17T12:00:54.913 INFO:tasks.rados.rados.0.trial142.stdout:2464: finishing copy_from to trial14245205-14 2026-02-17T12:00:54.913 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 1799 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T12:00:55.894 INFO:tasks.rados.rados.0.trial142.stdout:2463: done (3 left) 2026-02-17T12:00:55.894 INFO:tasks.rados.rados.0.trial142.stdout:2464: done (2 left) 2026-02-17T12:00:55.894 INFO:tasks.rados.rados.0.trial142.stdout:2467: done (1 left) 2026-02-17T12:00:55.894 INFO:tasks.rados.rados.0.trial142.stdout:2468: done (0 left) 2026-02-17T12:00:55.895 INFO:tasks.rados.rados.0.trial142.stdout:2469: read oid 32 snap -1 2026-02-17T12:00:55.895 INFO:tasks.rados.rados.0.trial142.stdout:2469: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:55.895 INFO:tasks.rados.rados.0.trial142.stdout:2470: write (excl) oid 8 current snap is 265 2026-02-17T12:00:55.895 INFO:tasks.rados.rados.0.trial142.stdout:2470: seq_num 849 ranges {669143=401584,1564977=426959} 2026-02-17T12:00:55.898 INFO:tasks.rados.rados.0.trial142.stdout:2470: writing trial14245205-8 from 669143 to 1070727 tid 1 2026-02-17T12:00:55.902 INFO:tasks.rados.rados.0.trial142.stdout:2470: writing trial14245205-8 from 1564977 to 1991936 tid 2 2026-02-17T12:00:55.902 INFO:tasks.rados.rados.0.trial142.stdout:2471: rollback oid 20 current snap is 265 2026-02-17T12:00:55.902 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 259 2026-02-17T12:00:55.902 INFO:tasks.rados.rados.0.trial142.stdout:2469: expect (ObjNum 425 snap 127 seq_num 425) 2026-02-17T12:00:56.015 INFO:tasks.rados.rados.0.trial142.stdout:2470: finishing write tid 1 to trial14245205-8 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2471: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2469: done (2 left) 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2472: read oid 48 snap -1 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2472: expect (ObjNum 808 snap 253 seq_num 808) 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2473: rollback oid 10 current snap is 265 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 10 to 259 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2471: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:00:56.016 INFO:tasks.rados.rados.0.trial142.stdout:2471: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 1114 (ObjNum 794 snap 249 seq_num 794) dirty exists 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: finishing write tid 2 to trial14245205-8 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: finishing write tid 3 to trial14245205-8 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: finishing write tid 4 to trial14245205-8 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: oid 8 updating version 0 to 1987 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: oid 8 updating version 1987 to 1988 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: oid 8 version 1988 is already newer than 1986 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1988 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: left oid 8 (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:00:56.017 INFO:tasks.rados.rados.0.trial142.stdout:2470: done (3 left) 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:2471: done (2 left) 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:2474: rollback oid 45 current snap is 265 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 258 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:2475: rollback oid 39 current snap is 265 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 258 2026-02-17T12:00:56.018 INFO:tasks.rados.rados.0.trial142.stdout:2476: snap_remove snap 257 2026-02-17T12:00:56.898 INFO:tasks.rados.rados.0.trial142.stdout:2476: done (4 left) 2026-02-17T12:00:56.899 INFO:tasks.rados.rados.0.trial142.stdout:2477: write oid 43 current snap is 265 2026-02-17T12:00:56.899 INFO:tasks.rados.rados.0.trial142.stdout:2477: seq_num 850 ranges {685950=476833,1623459=570617} 2026-02-17T12:00:56.903 INFO:tasks.rados.rados.0.trial142.stdout:2477: writing trial14245205-43 from 685950 to 1162783 tid 1 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2477: writing trial14245205-43 from 1623459 to 2194076 tid 2 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2478: read oid 14 snap -1 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2478: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2479: copy_from oid 49 from oid 29 current snap is 265 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2473: finishing rollback tid 1 to trial14245205-10 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2473: finishing rollback tid 2 to trial14245205-10 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 1979 (ObjNum 804 snap 253 seq_num 804) dirty exists 2026-02-17T12:00:56.908 INFO:tasks.rados.rados.0.trial142.stdout:2474: finishing rollback tid 0 to trial14245205-45 2026-02-17T12:00:56.909 INFO:tasks.rados.rados.0.trial142.stdout:2473: done (6 left) 2026-02-17T12:00:56.909 INFO:tasks.rados.rados.0.trial142.stdout:2480: snap_remove snap 255 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:2480: done (6 left) 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:2481: delete oid 47 current snap is 265 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:2474: finishing rollback tid 1 to trial14245205-45 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:2474: finishing rollback tid 2 to trial14245205-45 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 1920 (ObjNum 686 snap 213 seq_num 686) dirty exists 2026-02-17T12:00:57.630 INFO:tasks.rados.rados.0.trial142.stdout:2475: finishing rollback tid 0 to trial14245205-39 2026-02-17T12:00:57.631 INFO:tasks.rados.rados.0.trial142.stdout:2475: finishing rollback tid 1 to trial14245205-39 2026-02-17T12:00:57.631 INFO:tasks.rados.rados.0.trial142.stdout:2475: finishing rollback tid 2 to trial14245205-39 2026-02-17T12:00:57.631 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2120 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:00:57.631 INFO:tasks.rados.rados.0.trial142.stdout:2472: expect (ObjNum 808 snap 253 seq_num 808) 2026-02-17T12:00:57.788 INFO:tasks.rados.rados.0.trial142.stdout:2477: finishing write tid 1 to trial14245205-43 2026-02-17T12:00:57.788 INFO:tasks.rados.rados.0.trial142.stdout:2477: finishing write tid 2 to trial14245205-43 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: finishing write tid 3 to trial14245205-43 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: finishing write tid 4 to trial14245205-43 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: oid 43 updating version 0 to 2138 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: oid 43 updating version 2138 to 2143 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: oid 43 updating version 2143 to 2144 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2144 (ObjNum 850 snap 265 seq_num 850) dirty exists 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2477: left oid 43 (ObjNum 850 snap 265 seq_num 850) 2026-02-17T12:00:57.789 INFO:tasks.rados.rados.0.trial142.stdout:2478: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2479: finishing copy_from racing read to trial14245205-49 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2479: finishing copy_from to trial14245205-49 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 1953 (ObjNum 827 snap 257 seq_num 827) dirty exists 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2472: done (6 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2474: done (5 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2475: done (4 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2477: done (3 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2478: done (2 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2479: done (1 left) 2026-02-17T12:00:57.916 INFO:tasks.rados.rados.0.trial142.stdout:2481: done (0 left) 2026-02-17T12:00:57.917 INFO:tasks.rados.rados.0.trial142.stdout:2482: snap_create 2026-02-17T12:00:58.902 INFO:tasks.rados.rados.0.trial142.stdout:2482: done (0 left) 2026-02-17T12:00:58.902 INFO:tasks.rados.rados.0.trial142.stdout:2483: snap_create 2026-02-17T12:00:59.172 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:00:59.172 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T12:00:59.172 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:00:59.172 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:00:59.174 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:00:59.174 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:00:59.175 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 10 monclient: get_monmap_and_config 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 10 monclient: build_initial_monmap 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 10 monclient: monmap: 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:00:59.242432+0000 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:00:59.242432+0000 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:00:59.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 1 Processor -- start 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 1 -- start start 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.241+0000 7f402b5ba640 10 monclient: init 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f40240a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-a con 0x7f40240a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f402413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-b con 0x7f402413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402406e140 con 0x7f40240a3bb0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f402409f910 con 0x7f40240a0750 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f402409ccd0 con 0x7f402413b760 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f402b5ba640 10 monclient(hunting): authenticate will time out at 1546.861281s 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f402413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45312/0 (socket says 10.20.193.51:45312) 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 -- 10.20.193.51:0/2693050774 learned_addr learned my addr 10.20.193.51:0/2693050774 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 10 monclient(hunting): get_auth_request con 0x7f40240a0750 auth_method 0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): get_auth_request con 0x7f402413b760 auth_method 0 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:59.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 -- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 msgr2=0x7f402409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 -- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 msgr2=0x7f402409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 --2- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4028b2e640 1 --2- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient(hunting): handle_auth_done global_id 194174 payload 274 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 -- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 msgr2=0x7f402409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 --2- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 -- 10.20.193.51:0/2693050774 >> v1:10.20.193.142:6789/0 conn(0x7f40240a3bb0 legacy=0x7f402409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient: _finish_hunting 0 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 monclient: found mon.noname-b 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.242+0000 7f4029b30640 1 -- 10.20.193.51:0/2693050774 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402409eec0 con 0x7f402413b760 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4029b30640 1 -- 10.20.193.51:0/2693050774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 msgr2=0x7f402413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4029b30640 1 --2- 10.20.193.51:0/2693050774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f402413db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f402406f3c0 tx=0x7f402002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4796cc56dc2862f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 1 -- 10.20.193.51:0/2693050774 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402003c070 con 0x7f402413b760 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: dump: 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:59.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 1 -- 10.20.193.51:0/2693050774 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4020037440 con 0x7f402413b760 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 5 monclient: authenticate success, global_id 194174 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 1 -- 10.20.193.51:0/2693050774 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020037810 con 0x7f402413b760 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 4 set_mon_vals no callback set 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f4013fff640 10 monclient: dump: 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 10 monclient: shutdown 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:59.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 -- 10.20.193.51:0/2693050774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 msgr2=0x7f402413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 --2- 10.20.193.51:0/2693050774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f402413db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f402406f3c0 tx=0x7f402002f130 comp rx=0 tx=0).stop 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 -- 10.20.193.51:0/2693050774 shutdown_connections 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 --2- 10.20.193.51:0/2693050774 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f402413db50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 --2- 10.20.193.51:0/2693050774 >> v2:10.20.193.51:3300/0 conn(0x7f40240a0750 0x7f402409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 -- 10.20.193.51:0/2693050774 >> 10.20.193.51:0/2693050774 conn(0x7f40240a30c0 msgr2=0x7f40240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 -- 10.20.193.51:0/2693050774 shutdown_connections 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 1 -- 10.20.193.51:0/2693050774 wait complete. 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 10 monclient: build_initial_monmap 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.245+0000 7f402b5ba640 10 monclient: monmap: 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 Processor -- start 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 -- start start 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient: init 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:59.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-a con 0x7f40240a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40240a3bb0 0x7f4024132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-b con 0x7f40240a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): picked mon.noname-c con 0x7f402413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f40240a04b0 con 0x7f40240a0750 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f402409c850 con 0x7f40240a3bb0 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f402409e710 con 0x7f402413b760 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402b5ba640 10 monclient(hunting): authenticate will time out at 1546.865454s 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44200/0 (socket says 10.20.193.51:44200) 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 -- 10.20.193.51:0/568316453 learned_addr learned my addr 10.20.193.51:0/568316453 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): get_auth_request con 0x7f402413b760 auth_method 0 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 10 monclient(hunting): get_auth_request con 0x7f40240a0750 auth_method 0 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:59.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 msgr2=0x7f40241321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 msgr2=0x7f40241321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f402932f640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient(hunting): handle_auth_done global_id 194177 payload 824 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40240a3bb0 msgr2=0x7f4024132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40240a3bb0 0x7f4024132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 msgr2=0x7f40241321f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient: _finish_hunting 0 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 monclient: found mon.noname-c 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.246+0000 7f4029b30640 1 -- 10.20.193.51:0/568316453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4024135950 con 0x7f402413b760 2026-02-17T12:00:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.248+0000 7f4029b30640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 msgr2=0x7f4024132c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:00:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.248+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:00:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.248+0000 7f4029b30640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f402002f640 tx=0x7f4020004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020047020 con 0x7f402413b760 2026-02-17T12:00:59.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: dump: 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402003d040 con 0x7f402413b760 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 5 monclient: authenticate success, global_id 194177 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 10 monclient: _renew_subs 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4024135c30 con 0x7f402413b760 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402003c070 con 0x7f402413b760 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f40137fe640 4 set_mon_vals no callback set 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f4011ffb640 10 monclient: dump: 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:00:59.256 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 10 monclient: _renew_subs 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.250+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40240a2be0 con 0x7f402413b760 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f402b5ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f402b5ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f402b5ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402409dac0 con 0x7f402413b760 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f40200423e0 con 0x7f402413b760 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f4011ffb640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 0x7f3ff4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.251+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(561..561 src has 323..561) ==== 4767+0+0 (secure 0 0 0) 0x7f40200783a0 con 0x7f402413b760 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.252+0000 7f402932f640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 0x7f3ff4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:59.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.252+0000 7f402932f640 10 monclient: get_auth_request con 0x7f3ff403dd60 auth_method 0 2026-02-17T12:00:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.254+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4020051070 con 0x7f402413b760 2026-02-17T12:00:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.254+0000 7f4011ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.254+0000 7f4011ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:59.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.254+0000 7f402932f640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 0x7f3ff4040220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4014007d50 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f402b5ba640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f402b5ba640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f402b5ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4024135100 con 0x7f402413b760 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f4011ffb640 1 -- 10.20.193.51:0/568316453 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f4020040d60 con 0x7f402413b760 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f4011ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:00:59.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.366+0000 7f4011ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:59.370 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:00:59.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 msgr2=0x7f3ff4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 0x7f3ff4040220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4014007d50 tx=0x7f4014009040 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 10 monclient: shutdown 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 msgr2=0x7f4024132c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f402002f640 tx=0x7f4020004b40 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 shutdown_connections 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3ff403dd60 0x7f3ff4040220 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f402413b760 0x7f4024132c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f40240a3bb0 0x7f4024132730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 --2- 10.20.193.51:0/568316453 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f40240a0750 0x7f40241321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:59.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 >> 10.20.193.51:0/568316453 conn(0x7f40240a30c0 msgr2=0x7f4024138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 shutdown_connections 2026-02-17T12:00:59.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:00:59.367+0000 7f402b5ba640 1 -- 10.20.193.51:0/568316453 wait complete. 2026-02-17T12:00:59.903 INFO:tasks.rados.rados.0.trial142.stdout:2483: done (0 left) 2026-02-17T12:00:59.903 INFO:tasks.rados.rados.0.trial142.stdout:2484: read oid 18 snap 261 2026-02-17T12:00:59.903 INFO:tasks.rados.rados.0.trial142.stdout:2484: expect deleted 2026-02-17T12:00:59.903 INFO:tasks.rados.rados.0.trial142.stdout:2485: snap_create 2026-02-17T12:01:01.271 INFO:tasks.rados.rados.0.trial142.stdout:2484: done (1 left) 2026-02-17T12:01:01.271 INFO:tasks.rados.rados.0.trial142.stdout:2485: done (0 left) 2026-02-17T12:01:01.271 INFO:tasks.rados.rados.0.trial142.stdout:2486: copy_from oid 39 from oid 8 current snap is 268 2026-02-17T12:01:01.271 INFO:tasks.rados.rados.0.trial142.stdout:2487: read oid 11 snap -1 2026-02-17T12:01:01.271 INFO:tasks.rados.rados.0.trial142.stdout:2487: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:01.272 INFO:tasks.rados.rados.0.trial142.stdout:2488: write oid 18 current snap is 268 2026-02-17T12:01:01.272 INFO:tasks.rados.rados.0.trial142.stdout:2488: seq_num 852 ranges {719564=743684,2140423=179141} 2026-02-17T12:01:01.277 INFO:tasks.rados.rados.0.trial142.stdout:2488: writing trial14245205-18 from 719564 to 1463248 tid 1 2026-02-17T12:01:01.280 INFO:tasks.rados.rados.0.trial142.stdout:2488: writing trial14245205-18 from 2140423 to 2319564 tid 2 2026-02-17T12:01:01.280 INFO:tasks.rados.rados.0.trial142.stdout:2489: write oid 27 current snap is 268 2026-02-17T12:01:01.280 INFO:tasks.rados.rados.0.trial142.stdout:2489: seq_num 853 ranges {736371=418933,1798905=434297} 2026-02-17T12:01:01.284 INFO:tasks.rados.rados.0.trial142.stdout:2489: writing trial14245205-27 from 736371 to 1155304 tid 1 2026-02-17T12:01:01.289 INFO:tasks.rados.rados.0.trial142.stdout:2489: writing trial14245205-27 from 1798905 to 2233202 tid 2 2026-02-17T12:01:01.289 INFO:tasks.rados.rados.0.trial142.stdout:2490: delete oid 6 current snap is 268 2026-02-17T12:01:01.289 INFO:tasks.rados.rados.0.trial142.stdout:2486: finishing copy_from racing read to trial14245205-39 2026-02-17T12:01:01.289 INFO:tasks.rados.rados.0.trial142.stdout:2488: finishing write tid 1 to trial14245205-18 2026-02-17T12:01:01.289 INFO:tasks.rados.rados.0.trial142.stdout:2486: finishing copy_from to trial14245205-39 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 1988 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: finishing write tid 2 to trial14245205-18 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: finishing write tid 3 to trial14245205-18 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: finishing write tid 4 to trial14245205-18 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: oid 18 updating version 0 to 2153 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: oid 18 updating version 2153 to 2155 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: oid 18 version 2155 is already newer than 2154 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2155 (ObjNum 852 snap 268 seq_num 852) dirty exists 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2488: left oid 18 (ObjNum 852 snap 268 seq_num 852) 2026-02-17T12:01:01.290 INFO:tasks.rados.rados.0.trial142.stdout:2487: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:01.422 INFO:tasks.rados.rados.0.trial142.stdout:2489: finishing write tid 1 to trial14245205-27 2026-02-17T12:01:01.422 INFO:tasks.rados.rados.0.trial142.stdout:2489: finishing write tid 2 to trial14245205-27 2026-02-17T12:01:01.422 INFO:tasks.rados.rados.0.trial142.stdout:2486: done (4 left) 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2487: done (3 left) 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2488: done (2 left) 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2490: done (1 left) 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2491: read oid 36 snap -1 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2491: expect deleted 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2492: write oid 23 current snap is 268 2026-02-17T12:01:01.423 INFO:tasks.rados.rados.0.trial142.stdout:2492: seq_num 855 ranges {769985=569431,1915869=437966} 2026-02-17T12:01:01.427 INFO:tasks.rados.rados.0.trial142.stdout:2492: writing trial14245205-23 from 769985 to 1339416 tid 1 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2492: writing trial14245205-23 from 1915869 to 2353835 tid 2 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2493: snap_create 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: finishing write tid 3 to trial14245205-27 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: finishing write tid 4 to trial14245205-27 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: oid 27 updating version 0 to 1991 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: oid 27 version 1991 is already newer than 1989 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: oid 27 version 1991 is already newer than 1990 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 1991 (ObjNum 853 snap 268 seq_num 853) dirty exists 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2489: left oid 27 (ObjNum 853 snap 268 seq_num 853) 2026-02-17T12:01:01.431 INFO:tasks.rados.rados.0.trial142.stdout:2492: finishing write tid 1 to trial14245205-23 2026-02-17T12:01:01.432 INFO:tasks.rados.rados.0.trial142.stdout:2492: finishing write tid 2 to trial14245205-23 2026-02-17T12:01:01.432 INFO:tasks.rados.rados.0.trial142.stdout:2492: finishing write tid 3 to trial14245205-23 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:2492: finishing write tid 4 to trial14245205-23 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:2492: oid 23 updating version 0 to 1982 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:2492: oid 23 version 1982 is already newer than 1980 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:2492: oid 23 version 1982 is already newer than 1981 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1982 (ObjNum 855 snap 268 seq_num 855) dirty exists 2026-02-17T12:01:01.433 INFO:tasks.rados.rados.0.trial142.stdout:2492: left oid 23 (ObjNum 855 snap 268 seq_num 855) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2489: done (3 left) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2491: done (2 left) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2492: done (1 left) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2493: done (0 left) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2494: rollback oid 36 current snap is 269 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 265 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2495: rollback oid 1 current snap is 269 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 264 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2496: read oid 11 snap -1 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2496: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2497: rollback oid 32 current snap is 269 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 265 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2498: read oid 16 snap -1 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2498: expect (ObjNum 840 snap 264 seq_num 840) 2026-02-17T12:01:02.272 INFO:tasks.rados.rados.0.trial142.stdout:2499: delete oid 35 current snap is 269 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:2494: finishing rollback tid 1 to trial14245205-36 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1111 (ObjNum 1201 snap 0 seq_num 3520840920) dirty dne 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:2497: finishing rollback tid 0 to trial14245205-32 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:2497: finishing rollback tid 1 to trial14245205-32 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:2497: finishing rollback tid 2 to trial14245205-32 2026-02-17T12:01:02.276 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1117 (ObjNum 425 snap 127 seq_num 425) dirty exists 2026-02-17T12:01:02.277 INFO:tasks.rados.rados.0.trial142.stdout:2495: finishing rollback tid 0 to trial14245205-1 2026-02-17T12:01:02.277 INFO:tasks.rados.rados.0.trial142.stdout:2495: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:01:02.277 INFO:tasks.rados.rados.0.trial142.stdout:2496: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:02.378 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:02.410 INFO:tasks.rados.rados.0.trial142.stdout:2495: finishing rollback tid 2 to trial14245205-1 2026-02-17T12:01:02.410 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1977 (ObjNum 805 snap 253 seq_num 805) dirty exists 2026-02-17T12:01:02.410 INFO:tasks.rados.rados.0.trial142.stdout:2498: expect (ObjNum 840 snap 264 seq_num 840) 2026-02-17T12:01:02.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: get_monmap_and_config 2026-02-17T12:01:02.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: build_initial_monmap 2026-02-17T12:01:02.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: monmap: 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:02.445118+0000 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:02.445118+0000 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:02.457 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 1 Processor -- start 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 1 -- start start 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: init 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f635806eb80 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 0x7f63581385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient(hunting): picked mon.noname-c con 0x7f63580a4c10 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 0x7f635813f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.444+0000 7f636070a640 10 monclient(hunting): picked mon.noname-b con 0x7f635813d210 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635806f9c0 con 0x7f635806eb80 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f635806ef60 con 0x7f63580a4c10 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f635806fca0 con 0x7f635813d210 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f636070a640 10 monclient(hunting): authenticate will time out at 1550.064025s 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635e47f640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f635806eb80 0x7f6358137e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:41644/0 (socket says 10.20.193.51:41644) 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635e47f640 1 -- 10.20.193.51:0/2630456473 learned_addr learned my addr 10.20.193.51:0/2630456473 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 --2- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 0x7f635813f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): get_auth_request con 0x7f635813d210 auth_method 0 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2630456473 >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 0x7f63581385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 10 monclient(hunting): get_auth_request con 0x7f63580a4c10 auth_method 0 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:02.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient(hunting): handle_auth_done global_id 194180 payload 274 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 -- 10.20.193.51:0/2630456473 >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 msgr2=0x7f63581385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 --2- 10.20.193.51:0/2630456473 >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 0x7f63581385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 -- 10.20.193.51:0/2630456473 >> v1:10.20.193.51:6789/0 conn(0x7f635806eb80 legacy=0x7f6358137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient: _finish_hunting 0 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 monclient: found mon.noname-b 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635ec80640 1 -- 10.20.193.51:0/2630456473 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635806ff80 con 0x7f635813d210 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.445+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2630456473 >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 0x7f63581385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635ec80640 1 -- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 msgr2=0x7f635813f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635ec80640 1 --2- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 0x7f635813f600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c16e758370342ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:02.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 1 -- 10.20.193.51:0/2630456473 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635403c070 con 0x7f635813d210 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: dump: 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:02.462 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: _finish_auth 0 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: _check_auth_tickets 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f636070a640 5 monclient: authenticate success, global_id 194180 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f636070a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 1 -- 10.20.193.51:0/2630456473 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354037440 con 0x7f635813d210 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 1 -- 10.20.193.51:0/2630456473 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037810 con 0x7f635813d210 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:02.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f635d47d640 10 monclient: dump: 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f636070a640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.447+0000 7f636070a640 4 set_mon_vals no callback set 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 10 monclient: shutdown 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 msgr2=0x7f635813f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 --2- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 0x7f635813f600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635402f190 comp rx=0 tx=0).stop 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- 10.20.193.51:0/2630456473 shutdown_connections 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 --2- 10.20.193.51:0/2630456473 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635813d210 0x7f635813f600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 --2- 10.20.193.51:0/2630456473 >> v2:10.20.193.142:3300/0 conn(0x7f63580a4c10 0x7f63581385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- 10.20.193.51:0/2630456473 >> 10.20.193.51:0/2630456473 conn(0x7f63580a8c80 msgr2=0x7f63580a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- 10.20.193.51:0/2630456473 shutdown_connections 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- 10.20.193.51:0/2630456473 wait complete. 2026-02-17T12:01:02.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 10 monclient: build_initial_monmap 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 10 monclient: monmap: 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 Processor -- start 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 1 -- start start 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.448+0000 7f636070a640 10 monclient: init 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): picked mon.noname-c con 0x7f635806eb80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 0x7f63581319e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): picked mon.noname-b con 0x7f63580a4c10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): picked mon.noname-a con 0x7f635813d210 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f635813fcc0 con 0x7f635813d210 2026-02-17T12:01:02.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f635813fb40 con 0x7f63580a4c10 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f635813fe40 con 0x7f635806eb80 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f636070a640 10 monclient(hunting): authenticate will time out at 1550.068122s 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44260/0 (socket says 10.20.193.51:44260) 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 -- 10.20.193.51:0/2673880207 learned_addr learned my addr 10.20.193.51:0/2673880207 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): get_auth_request con 0x7f635806eb80 auth_method 0 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:02.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 10 monclient(hunting): get_auth_request con 0x7f635813d210 auth_method 0 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 msgr2=0x7f6358131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 msgr2=0x7f6358131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:02.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635ec80640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient(hunting): handle_auth_done global_id 194183 payload 824 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 msgr2=0x7f63581319e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 0x7f63581319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 0x7f63581319e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 msgr2=0x7f6358131f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient: _finish_hunting 0 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 monclient: found mon.noname-c 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635e47f640 1 -- 10.20.193.51:0/2673880207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63581355d0 con 0x7f635806eb80 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635dc7e640 10 monclient: get_auth_request con 0x7f63580a4c10 auth_method 0 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.449+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 0x7f63581319e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f635e47f640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 msgr2=0x7f63581314a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f635e47f640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f634800b530 tx=0x7f634800ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634800fa60 con 0x7f635806eb80 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: dump: 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.471 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: _finish_auth 0 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634800fc00 con 0x7f635806eb80 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 5 monclient: authenticate success, global_id 194183 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 10 monclient: _renew_subs 2026-02-17T12:01:02.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635809f5f0 con 0x7f635806eb80 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348017400 con 0x7f635806eb80 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f635cc7c640 4 set_mon_vals no callback set 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f633effd640 10 monclient: dump: 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:02.473 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 10 monclient: _renew_subs 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.451+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f635809e9c0 con 0x7f635806eb80 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f63480203f0 con 0x7f635806eb80 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f636070a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f636070a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:02.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f636070a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6358137e90 con 0x7f635806eb80 2026-02-17T12:01:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f633effd640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 0x7f6328040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(564..564 src has 323..564) ==== 4767+0+0 (secure 0 0 0) 0x7f6348052720 con 0x7f635806eb80 2026-02-17T12:01:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 0x7f6328040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:02.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.452+0000 7f635dc7e640 10 monclient: get_auth_request con 0x7f632803dd90 auth_method 0 2026-02-17T12:01:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.455+0000 7f635dc7e640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 0x7f6328040250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f634c006fd0 tx=0x7f634c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.455+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6348013030 con 0x7f635806eb80 2026-02-17T12:01:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.455+0000 7f633effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:02.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.455+0000 7f633effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2494: done (5 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2495: done (4 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2496: done (3 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2497: done (2 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2498: done (1 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2499: done (0 left) 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2500: read oid 33 snap -1 2026-02-17T12:01:02.477 INFO:tasks.rados.rados.0.trial142.stdout:2500: expect deleted 2026-02-17T12:01:02.478 INFO:tasks.rados.rados.0.trial142.stdout:2501: snap_create 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f636070a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f636070a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f636070a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f635813f830 con 0x7f635806eb80 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f633effd640 1 -- 10.20.193.51:0/2673880207 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f6348051130 con 0x7f635806eb80 2026-02-17T12:01:02.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f633effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:02.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.570+0000 7f633effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:02.574 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 msgr2=0x7f6328040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 0x7f6328040250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f634c006fd0 tx=0x7f634c008040 comp rx=0 tx=0).stop 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 10 monclient: shutdown 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 msgr2=0x7f63581314a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:02.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f634800b530 tx=0x7f634800ba00 comp rx=0 tx=0).stop 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 shutdown_connections 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f632803dd90 0x7f6328040250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f635813d210 0x7f6358131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63580a4c10 0x7f63581319e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 --2- 10.20.193.51:0/2673880207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f635806eb80 0x7f63581314a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 >> 10.20.193.51:0/2673880207 conn(0x7f63580a8c80 msgr2=0x7f63580a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 shutdown_connections 2026-02-17T12:01:02.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:02.571+0000 7f636070a640 1 -- 10.20.193.51:0/2673880207 wait complete. 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:2500: done (1 left) 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:2501: done (0 left) 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:2502: rollback oid 50 current snap is 270 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 269 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:2503: write oid 7 current snap is 270 2026-02-17T12:01:02.629 INFO:tasks.rados.rados.0.trial142.stdout:2503: seq_num 857 ranges {403599=719929,1916480=441635} 2026-02-17T12:01:02.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: writing trial14245205-7 from 403599 to 1123528 tid 1 2026-02-17T12:01:02.637 INFO:tasks.rados.rados.0.trial142.stdout:2503: writing trial14245205-7 from 1916480 to 2358115 tid 2 2026-02-17T12:01:02.637 INFO:tasks.rados.rados.0.trial142.stdout:2504: read oid 11 snap -1 2026-02-17T12:01:02.637 INFO:tasks.rados.rados.0.trial142.stdout:2504: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:02.637 INFO:tasks.rados.rados.0.trial142.stdout:2505: write oid 22 current snap is 270 2026-02-17T12:01:02.637 INFO:tasks.rados.rados.0.trial142.stdout:2505: seq_num 858 ranges {420406=795178,1974962=445444} 2026-02-17T12:01:02.641 INFO:tasks.rados.rados.0.trial142.stdout:2505: writing trial14245205-22 from 420406 to 1215584 tid 1 2026-02-17T12:01:02.646 INFO:tasks.rados.rados.0.trial142.stdout:2505: writing trial14245205-22 from 1974962 to 2420406 tid 2 2026-02-17T12:01:02.646 INFO:tasks.rados.rados.0.trial142.stdout:2506: snap_remove snap 266 2026-02-17T12:01:03.631 INFO:tasks.rados.rados.0.trial142.stdout:2506: done (4 left) 2026-02-17T12:01:03.631 INFO:tasks.rados.rados.0.trial142.stdout:2507: rollback oid 23 current snap is 270 2026-02-17T12:01:03.631 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 268 2026-02-17T12:01:03.631 INFO:tasks.rados.rados.0.trial142.stdout:2502: finishing rollback tid 1 to trial14245205-50 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 0 (ObjNum 1213915008 snap 21943 seq_num 304) dirty dne 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: finishing write tid 1 to trial14245205-7 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: finishing write tid 2 to trial14245205-7 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: finishing write tid 3 to trial14245205-7 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: finishing write tid 4 to trial14245205-7 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: oid 7 updating version 0 to 2157 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: oid 7 updating version 2157 to 2159 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: oid 7 version 2159 is already newer than 2158 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2159 (ObjNum 857 snap 270 seq_num 857) dirty exists 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: left oid 7 (ObjNum 857 snap 270 seq_num 857) 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2502: done (4 left) 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2503: done (3 left) 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2508: delete oid 13 current snap is 270 2026-02-17T12:01:03.632 INFO:tasks.rados.rados.0.trial142.stdout:2504: expect (ObjNum 747 snap 235 seq_num 747) 2026-02-17T12:01:03.766 INFO:tasks.rados.rados.0.trial142.stdout:2505: finishing write tid 1 to trial14245205-22 2026-02-17T12:01:03.766 INFO:tasks.rados.rados.0.trial142.stdout:2505: finishing write tid 2 to trial14245205-22 2026-02-17T12:01:03.766 INFO:tasks.rados.rados.0.trial142.stdout:2505: finishing write tid 3 to trial14245205-22 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2504: done (3 left) 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2508: done (2 left) 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2509: delete oid 15 current snap is 270 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2505: finishing write tid 4 to trial14245205-22 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2505: oid 22 updating version 0 to 1979 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2505: oid 22 updating version 1979 to 1980 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2505: oid 22 version 1980 is already newer than 1978 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 1980 (ObjNum 858 snap 270 seq_num 858) dirty exists 2026-02-17T12:01:03.767 INFO:tasks.rados.rados.0.trial142.stdout:2505: left oid 22 (ObjNum 858 snap 270 seq_num 858) 2026-02-17T12:01:03.768 INFO:tasks.rados.rados.0.trial142.stdout:2507: finishing rollback tid 0 to trial14245205-23 2026-02-17T12:01:03.768 INFO:tasks.rados.rados.0.trial142.stdout:2507: finishing rollback tid 1 to trial14245205-23 2026-02-17T12:01:03.768 INFO:tasks.rados.rados.0.trial142.stdout:2507: finishing rollback tid 2 to trial14245205-23 2026-02-17T12:01:03.768 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1985 (ObjNum 855 snap 268 seq_num 855) dirty exists 2026-02-17T12:01:03.769 INFO:tasks.rados.rados.0.trial142.stdout:2505: done (2 left) 2026-02-17T12:01:03.769 INFO:tasks.rados.rados.0.trial142.stdout:2507: done (1 left) 2026-02-17T12:01:03.769 INFO:tasks.rados.rados.0.trial142.stdout:2509: done (0 left) 2026-02-17T12:01:03.769 INFO:tasks.rados.rados.0.trial142.stdout:2510: write oid 30 current snap is 270 2026-02-17T12:01:03.769 INFO:tasks.rados.rados.0.trial142.stdout:2510: seq_num 861 ranges {470827=737278,1750408=720419} 2026-02-17T12:01:03.772 INFO:tasks.rados.rados.0.trial142.stdout:2510: writing trial14245205-30 from 470827 to 1208105 tid 1 2026-02-17T12:01:03.777 INFO:tasks.rados.rados.0.trial142.stdout:2510: writing trial14245205-30 from 1750408 to 2470827 tid 2 2026-02-17T12:01:03.777 INFO:tasks.rados.rados.0.trial142.stdout:2511: read oid 39 snap -1 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2511: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2512: read oid 13 snap -1 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2512: expect deleted 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2513: read oid 42 snap 261 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2513: expect (ObjNum 786 snap 249 seq_num 786) 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2514: snap_create 2026-02-17T12:01:03.778 INFO:tasks.rados.rados.0.trial142.stdout:2510: finishing write tid 1 to trial14245205-30 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: finishing write tid 2 to trial14245205-30 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: finishing write tid 3 to trial14245205-30 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: finishing write tid 4 to trial14245205-30 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: oid 30 updating version 0 to 1958 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: oid 30 updating version 1958 to 1959 2026-02-17T12:01:03.779 INFO:tasks.rados.rados.0.trial142.stdout:2510: oid 30 version 1959 is already newer than 1957 2026-02-17T12:01:03.780 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 1959 (ObjNum 861 snap 270 seq_num 861) dirty exists 2026-02-17T12:01:03.780 INFO:tasks.rados.rados.0.trial142.stdout:2510: left oid 30 (ObjNum 861 snap 270 seq_num 861) 2026-02-17T12:01:03.781 INFO:tasks.rados.rados.0.trial142.stdout:2513: expect (ObjNum 786 snap 249 seq_num 786) 2026-02-17T12:01:03.857 INFO:tasks.rados.rados.0.trial142.stdout:2511: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2510: done (4 left) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2511: done (3 left) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2512: done (2 left) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2513: done (1 left) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2514: done (0 left) 2026-02-17T12:01:04.702 INFO:tasks.rados.rados.0.trial142.stdout:2515: delete oid 1 current snap is 271 2026-02-17T12:01:04.706 INFO:tasks.rados.rados.0.trial142.stdout:2515: done (0 left) 2026-02-17T12:01:04.706 INFO:tasks.rados.rados.0.trial142.stdout:2516: write oid 41 current snap is 271 2026-02-17T12:01:04.706 INFO:tasks.rados.rados.0.trial142.stdout:2516: seq_num 863 ranges {504441=487776,1467372=736289} 2026-02-17T12:01:04.710 INFO:tasks.rados.rados.0.trial142.stdout:2516: writing trial14245205-41 from 504441 to 992217 tid 1 2026-02-17T12:01:04.714 INFO:tasks.rados.rados.0.trial142.stdout:2516: writing trial14245205-41 from 1467372 to 2203661 tid 2 2026-02-17T12:01:04.715 INFO:tasks.rados.rados.0.trial142.stdout:2517: write (excl) oid 30 current snap is 271 2026-02-17T12:01:04.715 INFO:tasks.rados.rados.0.trial142.stdout:2516: finishing write tid 1 to trial14245205-41 2026-02-17T12:01:04.715 INFO:tasks.rados.rados.0.trial142.stdout:2517: seq_num 864 ranges {521248=563025,1809501=596300} 2026-02-17T12:01:04.718 INFO:tasks.rados.rados.0.trial142.stdout:2517: writing trial14245205-30 from 521248 to 1084273 tid 1 2026-02-17T12:01:04.723 INFO:tasks.rados.rados.0.trial142.stdout:2517: writing trial14245205-30 from 1809501 to 2405801 tid 2 2026-02-17T12:01:04.723 INFO:tasks.rados.rados.0.trial142.stdout:2518: delete oid 43 current snap is 271 2026-02-17T12:01:04.723 INFO:tasks.rados.rados.0.trial142.stdout:2516: finishing write tid 2 to trial14245205-41 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: finishing write tid 3 to trial14245205-41 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: finishing write tid 4 to trial14245205-41 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: oid 41 updating version 0 to 1973 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: oid 41 version 1973 is already newer than 1972 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: oid 41 version 1973 is already newer than 1971 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1973 (ObjNum 863 snap 271 seq_num 863) dirty exists 2026-02-17T12:01:04.724 INFO:tasks.rados.rados.0.trial142.stdout:2516: left oid 41 (ObjNum 863 snap 271 seq_num 863) 2026-02-17T12:01:04.726 INFO:tasks.rados.rados.0.trial142.stdout:2516: done (2 left) 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2518: done (1 left) 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2519: copy_from oid 3 from oid 9 current snap is 271 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2520: read oid 6 snap 259 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2520: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2521: write (excl) oid 23 current snap is 271 2026-02-17T12:01:04.727 INFO:tasks.rados.rados.0.trial142.stdout:2521: seq_num 866 ranges {554862=713523,1926465=599969} 2026-02-17T12:01:04.731 INFO:tasks.rados.rados.0.trial142.stdout:2521: writing trial14245205-23 from 554862 to 1268385 tid 1 2026-02-17T12:01:04.736 INFO:tasks.rados.rados.0.trial142.stdout:2521: writing trial14245205-23 from 1926465 to 2526434 tid 2 2026-02-17T12:01:04.737 INFO:tasks.rados.rados.0.trial142.stdout:2522: write oid 50 current snap is 271 2026-02-17T12:01:04.737 INFO:tasks.rados.rados.0.trial142.stdout:2522: seq_num 867 ranges {571669=505125,1701300=743627} 2026-02-17T12:01:04.740 INFO:tasks.rados.rados.0.trial142.stdout:2522: writing trial14245205-50 from 571669 to 1076794 tid 1 2026-02-17T12:01:04.746 INFO:tasks.rados.rados.0.trial142.stdout:2522: writing trial14245205-50 from 1701300 to 2444927 tid 2 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2523: snap_create 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: finishing write tid 1 to trial14245205-30 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: finishing write tid 2 to trial14245205-30 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: finishing write tid 3 to trial14245205-30 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: finishing write tid 4 to trial14245205-30 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: oid 30 updating version 0 to 1960 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: oid 30 updating version 1960 to 1961 2026-02-17T12:01:04.747 INFO:tasks.rados.rados.0.trial142.stdout:2517: oid 30 updating version 1961 to 1962 2026-02-17T12:01:04.748 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 1962 (ObjNum 864 snap 271 seq_num 864) dirty exists 2026-02-17T12:01:04.748 INFO:tasks.rados.rados.0.trial142.stdout:2517: left oid 30 (ObjNum 864 snap 271 seq_num 864) 2026-02-17T12:01:04.748 INFO:tasks.rados.rados.0.trial142.stdout:2520: expect (ObjNum 735 snap 234 seq_num 735) 2026-02-17T12:01:04.836 INFO:tasks.rados.rados.0.trial142.stdout:2519: finishing copy_from racing read to trial14245205-3 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2519: finishing copy_from to trial14245205-3 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2117 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: finishing write tid 1 to trial14245205-23 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: finishing write tid 2 to trial14245205-23 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: finishing write tid 3 to trial14245205-23 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: finishing write tid 4 to trial14245205-23 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: oid 23 updating version 0 to 1987 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: oid 23 updating version 1987 to 1988 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: oid 23 version 1988 is already newer than 1986 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1988 (ObjNum 866 snap 271 seq_num 866) dirty exists 2026-02-17T12:01:04.837 INFO:tasks.rados.rados.0.trial142.stdout:2521: left oid 23 (ObjNum 866 snap 271 seq_num 866) 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: finishing write tid 1 to trial14245205-50 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: finishing write tid 2 to trial14245205-50 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: finishing write tid 3 to trial14245205-50 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: finishing write tid 4 to trial14245205-50 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: oid 50 updating version 0 to 1627 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: oid 50 version 1627 is already newer than 1625 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: oid 50 version 1627 is already newer than 1626 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1627 (ObjNum 867 snap 271 seq_num 867) dirty exists 2026-02-17T12:01:04.838 INFO:tasks.rados.rados.0.trial142.stdout:2522: left oid 50 (ObjNum 867 snap 271 seq_num 867) 2026-02-17T12:01:05.583 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:05.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 10 monclient: get_monmap_and_config 2026-02-17T12:01:05.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 10 monclient: build_initial_monmap 2026-02-17T12:01:05.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 10 monclient: monmap: 2026-02-17T12:01:05.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:05.653 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:05.652384+0000 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:05.652384+0000 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:05.654 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 1 Processor -- start 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 1 -- start start 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.650+0000 7ffb6dfbe640 10 monclient: init 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-a con 0x7ffb680a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 0x7ffb6809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-b con 0x7ffb680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffb6809e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6806e140 con 0x7ffb6809e540 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ffb680a3f90 con 0x7ffb680a3bb0 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6809f910 con 0x7ffb680a0750 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb6dfbe640 10 monclient(hunting): authenticate will time out at 1553.271203s 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37550/0 (socket says 10.20.193.51:37550) 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 -- 10.20.193.51:0/2242275209 learned_addr learned my addr 10.20.193.51:0/2242275209 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 10 monclient(hunting): get_auth_request con 0x7ffb680a3bb0 auth_method 0 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 --2- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 0x7ffb6809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): get_auth_request con 0x7ffb680a0750 auth_method 0 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 -- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 msgr2=0x7ffb6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:05.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 -- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 msgr2=0x7ffb6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 --2- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb677fe640 1 --2- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient(hunting): handle_auth_done global_id 194186 payload 274 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 -- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 msgr2=0x7ffb6809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 --2- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 -- 10.20.193.51:0/2242275209 >> v1:10.20.193.51:6789/0 conn(0x7ffb6809e540 legacy=0x7ffb6813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:05.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 monclient: found mon.noname-b 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.651+0000 7ffb66ffd640 1 -- 10.20.193.51:0/2242275209 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6809ccd0 con 0x7ffb680a0750 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb66ffd640 1 -- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 msgr2=0x7ffb6809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb66ffd640 1 --2- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 0x7ffb6809e000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806c1c0 tx=0x7ffb5802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c0bbeb75e39054 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 1 -- 10.20.193.51:0/2242275209 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5803c070 con 0x7ffb680a0750 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: dump: 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.667 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 5 monclient: authenticate success, global_id 194186 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 1 -- 10.20.193.51:0/2242275209 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5802fbd0 con 0x7ffb680a0750 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 1 -- 10.20.193.51:0/2242275209 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58037440 con 0x7ffb680a0750 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 4 set_mon_vals no callback set 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb667fc640 10 monclient: dump: 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:05.668 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 10 monclient: shutdown 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 msgr2=0x7ffb6809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 0x7ffb6809e000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806c1c0 tx=0x7ffb5802ed50 comp rx=0 tx=0).stop 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/2242275209 shutdown_connections 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/2242275209 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a0750 0x7ffb6809e000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/2242275209 >> v2:10.20.193.51:3300/0 conn(0x7ffb680a3bb0 0x7ffb6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/2242275209 >> 10.20.193.51:0/2242275209 conn(0x7ffb680a30c0 msgr2=0x7ffb680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/2242275209 shutdown_connections 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/2242275209 wait complete. 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 10 monclient: build_initial_monmap 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.654+0000 7ffb6dfbe640 10 monclient: monmap: 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 Processor -- start 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 -- start start 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient: init 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-a con 0x7ffb6809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffb680a0750 0x7ffb6809a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-b con 0x7ffb680a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 0x7ffb6809ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): picked mon.noname-c con 0x7ffb680a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680a04b0 con 0x7ffb6809e540 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6809c850 con 0x7ffb680a0750 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6813de80 con 0x7ffb680a3bb0 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb6dfbe640 10 monclient(hunting): authenticate will time out at 1553.275359s 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37564/0 (socket says 10.20.193.51:37564) 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 -- 10.20.193.51:0/1905577559 learned_addr learned my addr 10.20.193.51:0/1905577559 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 10 monclient(hunting): get_auth_request con 0x7ffb6809e540 auth_method 0 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 0x7ffb6809ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): get_auth_request con 0x7ffb680a3bb0 auth_method 0 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 msgr2=0x7ffb6813cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 msgr2=0x7ffb6813cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb677fe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb66ffd640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffb680a0750 0x7ffb6809a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb66ffd640 10 monclient(hunting): get_auth_request con 0x7ffb680a0750 auth_method 0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient(hunting): handle_auth_done global_id 194189 payload 824 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffb680a0750 msgr2=0x7ffb6809a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffb680a0750 0x7ffb6809a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 msgr2=0x7ffb6813cec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 monclient: found mon.noname-c 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.655+0000 7ffb67fff640 1 -- 10.20.193.51:0/1905577559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6813c7c0 con 0x7ffb680a3bb0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb67fff640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 msgr2=0x7ffb6809ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb67fff640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 0x7ffb6809ab30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00caf0 tx=0x7ffb5c004a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c016030 con 0x7ffb680a3bb0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: dump: 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:05.671 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00ac50 con 0x7ffb680a3bb0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 5 monclient: authenticate success, global_id 194189 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 10 monclient: _renew_subs 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6806f750 con 0x7ffb680a3bb0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004a80 con 0x7ffb680a3bb0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb43fff640 10 monclient: dump: 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb65ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 10 monclient: _renew_subs 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.657+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68074460 con 0x7ffb680a3bb0 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb6dfbe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb6dfbe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb6dfbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6806a290 con 0x7ffb680a3bb0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ffb5c023060 con 0x7ffb680a3bb0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb43fff640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 0x7ffb38040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.658+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(567..567 src has 323..567) ==== 4751+0+0 (secure 0 0 0) 0x7ffb5c0528c0 con 0x7ffb680a3bb0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.659+0000 7ffb677fe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 0x7ffb38040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.659+0000 7ffb677fe640 10 monclient: get_auth_request con 0x7ffb3803dd40 auth_method 0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.661+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffb6806a290 con 0x7ffb680a3bb0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.661+0000 7ffb43fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.661+0000 7ffb43fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:05.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.661+0000 7ffb677fe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 0x7ffb38040200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009320 tx=0x7ffb54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.706 INFO:tasks.rados.rados.0.trial142.stdout:2517: done (5 left) 2026-02-17T12:01:05.706 INFO:tasks.rados.rados.0.trial142.stdout:2519: done (4 left) 2026-02-17T12:01:05.706 INFO:tasks.rados.rados.0.trial142.stdout:2520: done (3 left) 2026-02-17T12:01:05.706 INFO:tasks.rados.rados.0.trial142.stdout:2521: done (2 left) 2026-02-17T12:01:05.707 INFO:tasks.rados.rados.0.trial142.stdout:2522: done (1 left) 2026-02-17T12:01:05.707 INFO:tasks.rados.rados.0.trial142.stdout:2523: done (0 left) 2026-02-17T12:01:05.707 INFO:tasks.rados.rados.0.trial142.stdout:2524: rollback oid 9 current snap is 272 2026-02-17T12:01:05.707 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 264 2026-02-17T12:01:05.707 INFO:tasks.rados.rados.0.trial142.stdout:2525: write oid 17 current snap is 272 2026-02-17T12:01:05.708 INFO:tasks.rados.rados.0.trial142.stdout:2525: seq_num 868 ranges {588476=580374,1643429=603638} 2026-02-17T12:01:05.709 INFO:tasks.rados.rados.0.trial142.stdout:2525: writing trial14245205-17 from 588476 to 1168850 tid 1 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2525: writing trial14245205-17 from 1643429 to 2247067 tid 2 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2526: rollback oid 44 current snap is 272 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 271 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2524: finishing rollback tid 0 to trial14245205-9 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2524: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2524: finishing rollback tid 2 to trial14245205-9 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2167 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2525: finishing write tid 1 to trial14245205-17 2026-02-17T12:01:05.714 INFO:tasks.rados.rados.0.trial142.stdout:2524: done (2 left) 2026-02-17T12:01:05.715 INFO:tasks.rados.rados.0.trial142.stdout:2527: write oid 25 current snap is 272 2026-02-17T12:01:05.715 INFO:tasks.rados.rados.0.trial142.stdout:2527: seq_num 869 ranges {605283=655623,1701911=747296} 2026-02-17T12:01:05.718 INFO:tasks.rados.rados.0.trial142.stdout:2527: writing trial14245205-25 from 605283 to 1260906 tid 1 2026-02-17T12:01:05.722 INFO:tasks.rados.rados.0.trial142.stdout:2527: writing trial14245205-25 from 1701911 to 2449207 tid 2 2026-02-17T12:01:05.722 INFO:tasks.rados.rados.0.trial142.stdout:2528: snap_remove snap 259 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb6dfbe640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb6dfbe640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb6dfbe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ffb6809dac0 con 0x7ffb680a3bb0 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb43fff640 1 -- 10.20.193.51:0/1905577559 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7ffb5c010d70 con 0x7ffb680a3bb0 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb43fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:05.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.775+0000 7ffb43fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:05.780 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":27,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 msgr2=0x7ffb38040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 0x7ffb38040200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009320 tx=0x7ffb54008040 comp rx=0 tx=0).stop 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 10 monclient: shutdown 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 msgr2=0x7ffb6809ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 0x7ffb6809ab30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00caf0 tx=0x7ffb5c004a10 comp rx=0 tx=0).stop 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 shutdown_connections 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffb3803dd40 0x7ffb38040200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffb680a3bb0 0x7ffb6809ab30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffb680a0750 0x7ffb6809a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 --2- 10.20.193.51:0/1905577559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffb6809e540 0x7ffb6813cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 >> 10.20.193.51:0/1905577559 conn(0x7ffb680a30c0 msgr2=0x7ffb680996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 shutdown_connections 2026-02-17T12:01:05.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:05.777+0000 7ffb6dfbe640 1 -- 10.20.193.51:0/1905577559 wait complete. 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2528: done (3 left) 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2529: copy_from oid 21 from oid 41 current snap is 272 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2526: finishing rollback tid 0 to trial14245205-44 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2526: finishing rollback tid 1 to trial14245205-44 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2525: finishing write tid 2 to trial14245205-17 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:2526: finishing rollback tid 2 to trial14245205-44 2026-02-17T12:01:06.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1984 (ObjNum 815 snap 254 seq_num 815) dirty exists 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: finishing write tid 3 to trial14245205-17 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: finishing write tid 4 to trial14245205-17 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: oid 17 updating version 0 to 1164 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: oid 17 version 1164 is already newer than 1162 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: oid 17 version 1164 is already newer than 1163 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1164 (ObjNum 868 snap 272 seq_num 868) dirty exists 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: left oid 17 (ObjNum 868 snap 272 seq_num 868) 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2527: finishing write tid 1 to trial14245205-25 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2527: finishing write tid 2 to trial14245205-25 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2527: finishing write tid 3 to trial14245205-25 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2525: done (3 left) 2026-02-17T12:01:06.711 INFO:tasks.rados.rados.0.trial142.stdout:2526: done (2 left) 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2530: snap_create 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2527: finishing write tid 4 to trial14245205-25 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2527: oid 25 updating version 0 to 1629 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2527: oid 25 updating version 1629 to 1630 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2527: oid 25 version 1630 is already newer than 1628 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 1630 (ObjNum 869 snap 272 seq_num 869) dirty exists 2026-02-17T12:01:06.712 INFO:tasks.rados.rados.0.trial142.stdout:2527: left oid 25 (ObjNum 869 snap 272 seq_num 869) 2026-02-17T12:01:06.718 INFO:tasks.rados.rados.0.trial142.stdout:2529: finishing copy_from racing read to trial14245205-21 2026-02-17T12:01:06.719 INFO:tasks.rados.rados.0.trial142.stdout:2529: finishing copy_from to trial14245205-21 2026-02-17T12:01:06.719 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1973 (ObjNum 863 snap 271 seq_num 863) dirty exists 2026-02-17T12:01:07.630 INFO:tasks.rados.rados.0.trial142.stdout:2527: done (2 left) 2026-02-17T12:01:07.630 INFO:tasks.rados.rados.0.trial142.stdout:2529: done (1 left) 2026-02-17T12:01:07.630 INFO:tasks.rados.rados.0.trial142.stdout:2530: done (0 left) 2026-02-17T12:01:07.630 INFO:tasks.rados.rados.0.trial142.stdout:2531: snap_remove snap 265 2026-02-17T12:01:08.631 INFO:tasks.rados.rados.0.trial142.stdout:2531: done (0 left) 2026-02-17T12:01:08.631 INFO:tasks.rados.rados.0.trial142.stdout:2532: snap_remove snap 268 2026-02-17T12:01:08.790 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:08.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 10 monclient: monmap: 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:08.857459+0000 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:08.857459+0000 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.861 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 1 Processor -- start 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 1 -- start start 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.856+0000 7f501eda9640 10 monclient: init 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T12:01:08.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-b con 0x7f50180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f50180a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f501813b760 0x7f501813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-c con 0x7f501813b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501806e140 con 0x7f50180a0750 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f501809f910 con 0x7f501813b760 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f501809ccd0 con 0x7f50180a3bb0 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501eda9640 10 monclient(hunting): authenticate will time out at 1556.476294s 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58842/0 (socket says 10.20.193.51:58842) 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 -- 10.20.193.51:0/1515872776 learned_addr learned my addr 10.20.193.51:0/1515872776 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): get_auth_request con 0x7f50180a3bb0 auth_method 0 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501d31f640 1 --2- 10.20.193.51:0/1515872776 >> v2:10.20.193.142:3300/0 conn(0x7f501813b760 0x7f501813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501d31f640 10 monclient(hunting): get_auth_request con 0x7f501813b760 auth_method 0 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501d31f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501d31f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501d31f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient(hunting): handle_auth_done global_id 194192 payload 274 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 -- 10.20.193.51:0/1515872776 >> v2:10.20.193.142:3300/0 conn(0x7f501813b760 msgr2=0x7f501813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 --2- 10.20.193.51:0/1515872776 >> v2:10.20.193.142:3300/0 conn(0x7f501813b760 0x7f501813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 -- 10.20.193.51:0/1515872776 >> v1:10.20.193.142:6789/0 conn(0x7f50180a0750 legacy=0x7f501809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.857+0000 7f501cb1e640 1 -- 10.20.193.51:0/1515872776 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501809eec0 con 0x7f50180a3bb0 2026-02-17T12:01:08.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501cb1e640 1 -- 10.20.193.51:0/1515872776 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 msgr2=0x7f501809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:08.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501cb1e640 1 --2- 10.20.193.51:0/1515872776 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f501809f230 tx=0x7f500802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad7cbde0fb3d4f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 1 -- 10.20.193.51:0/1515872776 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500803c070 con 0x7f50180a3bb0 2026-02-17T12:01:08.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: dump: 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:08.874 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 1 -- 10.20.193.51:0/1515872776 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500802fcc0 con 0x7f50180a3bb0 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 5 monclient: authenticate success, global_id 194192 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 1 -- 10.20.193.51:0/1515872776 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008037660 con 0x7f50180a3bb0 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f500f7fe640 10 monclient: dump: 2026-02-17T12:01:08.875 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 4 set_mon_vals no callback set 2026-02-17T12:01:08.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 10 monclient: shutdown 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 -- 10.20.193.51:0/1515872776 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 msgr2=0x7f501809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 --2- 10.20.193.51:0/1515872776 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f501809f230 tx=0x7f500802ee80 comp rx=0 tx=0).stop 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 -- 10.20.193.51:0/1515872776 shutdown_connections 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 --2- 10.20.193.51:0/1515872776 >> v2:10.20.193.142:3300/0 conn(0x7f501813b760 0x7f501813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 --2- 10.20.193.51:0/1515872776 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f50180a3bb0 0x7f501809dac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 -- 10.20.193.51:0/1515872776 >> 10.20.193.51:0/1515872776 conn(0x7f50180a30c0 msgr2=0x7f50180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 -- 10.20.193.51:0/1515872776 shutdown_connections 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.860+0000 7f501eda9640 1 -- 10.20.193.51:0/1515872776 wait complete. 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient: monmap: 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:08.878 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 Processor -- start 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 -- start start 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient: init 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f50180a0750 0x7f50181cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-b con 0x7f50180a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-a con 0x7f50180a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): picked mon.noname-c con 0x7f501813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f50180a04b0 con 0x7f50180a3bb0 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f501809c850 con 0x7f50180a0750 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f501809e710 con 0x7f501813b760 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501eda9640 10 monclient(hunting): authenticate will time out at 1556.480587s 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58858/0 (socket says 10.20.193.51:58858) 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 -- 10.20.193.51:0/3254965740 learned_addr learned my addr 10.20.193.51:0/3254965740 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:08.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): get_auth_request con 0x7f501813b760 auth_method 0 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 10 monclient(hunting): get_auth_request con 0x7f50180a3bb0 auth_method 0 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501cb1e640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f50180a0750 0x7f50181cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501cb1e640 10 monclient(hunting): get_auth_request con 0x7f50180a0750 auth_method 0 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501cb1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501cb1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501cb1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 msgr2=0x7f50181cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 msgr2=0x7f50181cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f500ffff640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient(hunting): handle_auth_done global_id 194195 payload 824 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f50180a0750 msgr2=0x7f50181cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f50180a0750 0x7f50181cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 msgr2=0x7f50181cfda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:08.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 monclient: found mon.noname-c 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.861+0000 7f501d31f640 1 -- 10.20.193.51:0/3254965740 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5018098620 con 0x7f501813b760 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.863+0000 7f501d31f640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 msgr2=0x7f50181d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.863+0000 7f501d31f640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5014007d90 tx=0x7f501400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014014620 con 0x7f501813b760 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: dump: 2026-02-17T12:01:08.883 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5014019070 con 0x7f501813b760 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 5 monclient: authenticate success, global_id 194195 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _renew_subs 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5018098900 con 0x7f501813b760 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014014a20 con 0x7f501813b760 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 10 monclient: dump: 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:08.885 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500effd640 4 set_mon_vals no callback set 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _renew_subs 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f501806f6a0 con 0x7f501813b760 2026-02-17T12:01:08.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501809dac0 con 0x7f501813b760 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.864+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f501401e460 con 0x7f501813b760 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.865+0000 7f500d7fa640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 0x7f4fe80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.865+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(571..571 src has 323..571) ==== 4779+0+0 (secure 0 0 0) 0x7f5014053080 con 0x7f501813b760 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.865+0000 7f501cb1e640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 0x7f4fe80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.865+0000 7f501cb1e640 10 monclient: get_auth_request con 0x7f4fe803dd10 auth_method 0 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.867+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5014014dd0 con 0x7f501813b760 2026-02-17T12:01:08.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.867+0000 7f500d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.867+0000 7f500d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:08.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.867+0000 7f501cb1e640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 0x7f4fe80401d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5008036000 tx=0x7f5008039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f501eda9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f501eda9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f501eda9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f50180008d0 con 0x7f501813b760 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f500d7fa640 1 -- 10.20.193.51:0/3254965740 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f5014011d20 con 0x7f501813b760 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f500d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.984+0000 7f500d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":30,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 msgr2=0x7f4fe80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 0x7f4fe80401d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5008036000 tx=0x7f5008039040 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 10 monclient: shutdown 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 msgr2=0x7f50181d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5014007d90 tx=0x7f501400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 shutdown_connections 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fe803dd10 0x7f4fe80401d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f501813b760 0x7f50181d02e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f50180a3bb0 0x7f50181cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 --2- 10.20.193.51:0/3254965740 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f50180a0750 0x7f50181cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 >> 10.20.193.51:0/3254965740 conn(0x7f50180a30c0 msgr2=0x7f501813ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 shutdown_connections 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:08.985+0000 7f501eda9640 1 -- 10.20.193.51:0/3254965740 wait complete. 2026-02-17T12:01:09.632 INFO:tasks.rados.rados.0.trial142.stdout:2532: done (0 left) 2026-02-17T12:01:09.632 INFO:tasks.rados.rados.0.trial142.stdout:2533: write (excl) oid 37 current snap is 273 2026-02-17T12:01:09.633 INFO:tasks.rados.rados.0.trial142.stdout:2533: seq_num 870 ranges {622090=730872,1760393=607307} 2026-02-17T12:01:09.638 INFO:tasks.rados.rados.0.trial142.stdout:2533: writing trial14245205-37 from 622090 to 1352962 tid 1 2026-02-17T12:01:09.642 INFO:tasks.rados.rados.0.trial142.stdout:2533: writing trial14245205-37 from 1760393 to 2367700 tid 2 2026-02-17T12:01:09.643 INFO:tasks.rados.rados.0.trial142.stdout:2534: read oid 20 snap -1 2026-02-17T12:01:09.643 INFO:tasks.rados.rados.0.trial142.stdout:2534: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:01:09.643 INFO:tasks.rados.rados.0.trial142.stdout:2535: snap_remove snap 261 2026-02-17T12:01:10.639 INFO:tasks.rados.rados.0.trial142.stdout:2535: done (2 left) 2026-02-17T12:01:10.639 INFO:tasks.rados.rados.0.trial142.stdout:2536: write oid 46 current snap is 273 2026-02-17T12:01:10.639 INFO:tasks.rados.rados.0.trial142.stdout:2536: seq_num 871 ranges {638897=406121,1818875=750965} 2026-02-17T12:01:10.643 INFO:tasks.rados.rados.0.trial142.stdout:2536: writing trial14245205-46 from 638897 to 1045018 tid 1 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2536: writing trial14245205-46 from 1818875 to 2569840 tid 2 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2537: snap_create 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: finishing write tid 1 to trial14245205-37 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: finishing write tid 2 to trial14245205-37 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: finishing write tid 3 to trial14245205-37 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: finishing write tid 4 to trial14245205-37 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: oid 37 updating version 0 to 2120 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: oid 37 version 2120 is already newer than 2118 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:2533: oid 37 version 2120 is already newer than 2119 2026-02-17T12:01:10.649 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2120 (ObjNum 870 snap 273 seq_num 870) dirty exists 2026-02-17T12:01:10.650 INFO:tasks.rados.rados.0.trial142.stdout:2533: left oid 37 (ObjNum 870 snap 273 seq_num 870) 2026-02-17T12:01:10.650 INFO:tasks.rados.rados.0.trial142.stdout:2534: expect (ObjNum 794 snap 249 seq_num 794) 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: finishing write tid 1 to trial14245205-46 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: finishing write tid 2 to trial14245205-46 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: finishing write tid 3 to trial14245205-46 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: finishing write tid 4 to trial14245205-46 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: oid 46 updating version 0 to 2203 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: oid 46 version 2203 is already newer than 2202 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: oid 46 version 2203 is already newer than 2201 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2203 (ObjNum 871 snap 273 seq_num 871) dirty exists 2026-02-17T12:01:10.789 INFO:tasks.rados.rados.0.trial142.stdout:2536: left oid 46 (ObjNum 871 snap 273 seq_num 871) 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2533: done (3 left) 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2534: done (2 left) 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2536: done (1 left) 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2537: done (0 left) 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2538: rollback oid 49 current snap is 274 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 267 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2539: write oid 43 current snap is 274 2026-02-17T12:01:11.641 INFO:tasks.rados.rados.0.trial142.stdout:2539: seq_num 872 ranges {655704=481370,1761004=494623} 2026-02-17T12:01:11.645 INFO:tasks.rados.rados.0.trial142.stdout:2539: writing trial14245205-43 from 655704 to 1137074 tid 1 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2539: writing trial14245205-43 from 1761004 to 2255627 tid 2 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2540: delete oid 10 current snap is 274 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2538: finishing rollback tid 0 to trial14245205-49 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2538: finishing rollback tid 1 to trial14245205-49 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2538: finishing rollback tid 2 to trial14245205-49 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2207 (ObjNum 827 snap 257 seq_num 827) dirty exists 2026-02-17T12:01:11.650 INFO:tasks.rados.rados.0.trial142.stdout:2539: finishing write tid 1 to trial14245205-43 2026-02-17T12:01:11.651 INFO:tasks.rados.rados.0.trial142.stdout:2538: done (2 left) 2026-02-17T12:01:11.651 INFO:tasks.rados.rados.0.trial142.stdout:2540: done (1 left) 2026-02-17T12:01:11.651 INFO:tasks.rados.rados.0.trial142.stdout:2541: write (excl) oid 44 current snap is 274 2026-02-17T12:01:11.651 INFO:tasks.rados.rados.0.trial142.stdout:2541: seq_num 874 ranges {689318=631868,1877968=498292} 2026-02-17T12:01:11.656 INFO:tasks.rados.rados.0.trial142.stdout:2541: writing trial14245205-44 from 689318 to 1321186 tid 1 2026-02-17T12:01:11.661 INFO:tasks.rados.rados.0.trial142.stdout:2541: writing trial14245205-44 from 1877968 to 2376260 tid 2 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2542: snap_create 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: finishing write tid 2 to trial14245205-43 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: finishing write tid 3 to trial14245205-43 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: finishing write tid 4 to trial14245205-43 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: oid 43 updating version 0 to 2209 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: oid 43 version 2209 is already newer than 2208 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: oid 43 updating version 2209 to 2210 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2210 (ObjNum 872 snap 274 seq_num 872) dirty exists 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2539: left oid 43 (ObjNum 872 snap 274 seq_num 872) 2026-02-17T12:01:11.662 INFO:tasks.rados.rados.0.trial142.stdout:2541: finishing write tid 1 to trial14245205-44 2026-02-17T12:01:11.663 INFO:tasks.rados.rados.0.trial142.stdout:2541: finishing write tid 2 to trial14245205-44 2026-02-17T12:01:11.663 INFO:tasks.rados.rados.0.trial142.stdout:2541: finishing write tid 3 to trial14245205-44 2026-02-17T12:01:11.663 INFO:tasks.rados.rados.0.trial142.stdout:2541: finishing write tid 4 to trial14245205-44 2026-02-17T12:01:11.664 INFO:tasks.rados.rados.0.trial142.stdout:2541: oid 44 updating version 0 to 1987 2026-02-17T12:01:11.664 INFO:tasks.rados.rados.0.trial142.stdout:2541: oid 44 version 1987 is already newer than 1986 2026-02-17T12:01:11.664 INFO:tasks.rados.rados.0.trial142.stdout:2541: oid 44 version 1987 is already newer than 1985 2026-02-17T12:01:11.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1987 (ObjNum 874 snap 274 seq_num 874) dirty exists 2026-02-17T12:01:11.664 INFO:tasks.rados.rados.0.trial142.stdout:2541: left oid 44 (ObjNum 874 snap 274 seq_num 874) 2026-02-17T12:01:11.996 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.062+0000 7fea0b60c640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.062+0000 7fea0b60c640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.062+0000 7fea0b60c640 10 monclient: monmap: 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:12.063876+0000 2026-02-17T12:01:12.064 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:12.063876+0000 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:12.065 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 Processor -- start 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 -- start start 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient: init 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea040a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-b con 0x7fea040a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fea0413b760 0x7fea0413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-c con 0x7fea0413b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0406e140 con 0x7fea040a3bb0 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fea0409f910 con 0x7fea0413b760 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fea0409ccd0 con 0x7fea040a0750 2026-02-17T12:01:12.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea0b60c640 10 monclient(hunting): authenticate will time out at 1559.682648s 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09381640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fea040a3bb0 0x7fea0409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:47796/0 (socket says 10.20.193.51:47796) 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09381640 1 -- 10.20.193.51:0/2356827016 learned_addr learned my addr 10.20.193.51:0/2356827016 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 10 monclient(hunting): get_auth_request con 0x7fea040a0750 auth_method 0 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09b82640 1 --2- 10.20.193.51:0/2356827016 >> v2:10.20.193.142:3300/0 conn(0x7fea0413b760 0x7fea0413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 1 -- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 msgr2=0x7fea0409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:01:12.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 1 -- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 msgr2=0x7fea0409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09b82640 10 monclient(hunting): get_auth_request con 0x7fea0413b760 auth_method 0 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09b82640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea09b82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.063+0000 7fea08b80640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient(hunting): handle_auth_done global_id 184252 payload 274 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 1 -- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 msgr2=0x7fea0409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 1 -- 10.20.193.51:0/2356827016 >> v1:10.20.193.51:6789/0 conn(0x7fea040a3bb0 legacy=0x7fea0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 1 monclient: found mon.noname-c 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:01:12.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.064+0000 7fea09b82640 1 -- 10.20.193.51:0/2356827016 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0409eec0 con 0x7fea0413b760 2026-02-17T12:01:12.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea09b82640 1 -- 10.20.193.51:0/2356827016 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea0413b760 msgr2=0x7fea0413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea09b82640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea0413b760 0x7fea0413db50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea0409f230 tx=0x7fea0002f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=196e47acc88e9abf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 1 -- 10.20.193.51:0/2356827016 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0003c070 con 0x7fea0413b760 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: dump: 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 1 -- 10.20.193.51:0/2356827016 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea00037440 con 0x7fea0413b760 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea0b60c640 5 monclient: authenticate success, global_id 184252 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea0b60c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 1 -- 10.20.193.51:0/2356827016 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00037810 con 0x7fea0413b760 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fe9f3fff640 10 monclient: dump: 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.080 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea0b60c640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.066+0000 7fea0b60c640 4 set_mon_vals no callback set 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 10 monclient: shutdown 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 -- 10.20.193.51:0/2356827016 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea0413b760 msgr2=0x7fea0413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea0413b760 0x7fea0413db50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea0409f230 tx=0x7fea0002f130 comp rx=0 tx=0).stop 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 -- 10.20.193.51:0/2356827016 shutdown_connections 2026-02-17T12:01:12.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea0413b760 0x7fea0413db50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 --2- 10.20.193.51:0/2356827016 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a0750 0x7fea0409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 -- 10.20.193.51:0/2356827016 >> 10.20.193.51:0/2356827016 conn(0x7fea040a30c0 msgr2=0x7fea040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 -- 10.20.193.51:0/2356827016 shutdown_connections 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 1 -- 10.20.193.51:0/2356827016 wait complete. 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.067+0000 7fea0b60c640 10 monclient: monmap: 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.082 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 Processor -- start 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 -- start start 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient: init 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea040a0750 0x7fea0413a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-b con 0x7fea040a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-c con 0x7fea040a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): picked mon.noname-a con 0x7fea0413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fea040a04b0 con 0x7fea0413b760 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea0409c850 con 0x7fea040a0750 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fea0409e710 con 0x7fea040a3bb0 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea0b60c640 10 monclient(hunting): authenticate will time out at 1559.687340s 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58910/0 (socket says 10.20.193.51:58910) 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 -- 10.20.193.51:0/3255204608 learned_addr learned my addr 10.20.193.51:0/3255204608 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): get_auth_request con 0x7fea040a3bb0 auth_method 0 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 10 monclient(hunting): get_auth_request con 0x7fea0413b760 auth_method 0 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 msgr2=0x7fea0413b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 msgr2=0x7fea0413b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09b82640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09381640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea040a0750 0x7fea0413a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09381640 10 monclient(hunting): get_auth_request con 0x7fea040a0750 auth_method 0 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09381640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea09381640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient(hunting): handle_auth_done global_id 194201 payload 824 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea040a0750 msgr2=0x7fea0413a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea040a0750 0x7fea0413a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 msgr2=0x7fea0413b1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 monclient: found mon.noname-c 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.068+0000 7fea08b80640 1 -- 10.20.193.51:0/3255204608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0409ac50 con 0x7fea040a3bb0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea08b80640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 msgr2=0x7fea0413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea08b80640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800e7a0 tx=0x7fe9f800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8017070 con 0x7fea040a3bb0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: dump: 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f800cb00 con 0x7fea040a3bb0 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 5 monclient: authenticate success, global_id 194201 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 10 monclient: _renew_subs 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea040a2400 con 0x7fea040a3bb0 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800f040 con 0x7fea040a3bb0 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f37fe640 4 set_mon_vals no callback set 2026-02-17T12:01:12.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fe9f1ffb640 10 monclient: dump: 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 10 monclient: _renew_subs 2026-02-17T12:01:12.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.070+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0409a3b0 con 0x7fea040a3bb0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fea0b60c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fea0b60c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fea0b60c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0409dac0 con 0x7fea040a3bb0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe9f8012050 con 0x7fea040a3bb0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fe9f1ffb640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 0x7fe9d40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.071+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(574..574 src has 323..574) ==== 4783+0+0 (secure 0 0 0) 0x7fe9f80524c0 con 0x7fea040a3bb0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.072+0000 7fea09381640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 0x7fe9d40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.072+0000 7fea09381640 10 monclient: get_auth_request con 0x7fe9d403dd10 auth_method 0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.074+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe9f8023d80 con 0x7fea040a3bb0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.074+0000 7fe9f1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.074+0000 7fe9f1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.074+0000 7fea09381640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 0x7fe9d40401d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4007340 tx=0x7fe9f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fea0b60c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fea0b60c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fea0b60c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fea04099240 con 0x7fea040a3bb0 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fe9f1ffb640 1 -- 10.20.193.51:0/3255204608 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fe9f8013c60 con 0x7fea040a3bb0 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fe9f1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:12.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.187+0000 7fe9f1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:12.191 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":33,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 msgr2=0x7fe9d40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 0x7fe9d40401d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4007340 tx=0x7fe9f4009040 comp rx=0 tx=0).stop 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 10 monclient: shutdown 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 msgr2=0x7fea0413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800e7a0 tx=0x7fe9f800ec70 comp rx=0 tx=0).stop 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 shutdown_connections 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe9d403dd10 0x7fe9d40401d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fea0413b760 0x7fea0413b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fea040a3bb0 0x7fea0413acb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 --2- 10.20.193.51:0/3255204608 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fea040a0750 0x7fea0413a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 >> 10.20.193.51:0/3255204608 conn(0x7fea040a30c0 msgr2=0x7fea040a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 shutdown_connections 2026-02-17T12:01:12.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:12.188+0000 7fea0b60c640 1 -- 10.20.193.51:0/3255204608 wait complete. 2026-02-17T12:01:12.630 INFO:tasks.rados.rados.0.trial142.stdout:2539: done (2 left) 2026-02-17T12:01:12.630 INFO:tasks.rados.rados.0.trial142.stdout:2541: done (1 left) 2026-02-17T12:01:12.630 INFO:tasks.rados.rados.0.trial142.stdout:2542: done (0 left) 2026-02-17T12:01:12.630 INFO:tasks.rados.rados.0.trial142.stdout:2543: rollback oid 21 current snap is 275 2026-02-17T12:01:12.630 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 264 2026-02-17T12:01:12.631 INFO:tasks.rados.rados.0.trial142.stdout:2544: copy_from oid 34 from oid 50 current snap is 275 2026-02-17T12:01:12.631 INFO:tasks.rados.rados.0.trial142.stdout:2545: snap_create 2026-02-17T12:01:12.634 INFO:tasks.rados.rados.0.trial142.stdout:2543: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:01:12.635 INFO:tasks.rados.rados.0.trial142.stdout:2543: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:01:12.635 INFO:tasks.rados.rados.0.trial142.stdout:2543: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:01:12.635 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1976 (ObjNum 836 snap 264 seq_num 836) dirty exists 2026-02-17T12:01:12.642 INFO:tasks.rados.rados.0.trial142.stdout:2544: finishing copy_from racing read to trial14245205-34 2026-02-17T12:01:12.643 INFO:tasks.rados.rados.0.trial142.stdout:2544: finishing copy_from to trial14245205-34 2026-02-17T12:01:12.643 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1627 (ObjNum 867 snap 271 seq_num 867) dirty exists 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2543: done (2 left) 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2544: done (1 left) 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2545: done (0 left) 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2546: copy_from oid 38 from oid 23 current snap is 276 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2547: read oid 29 snap -1 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2547: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:01:13.631 INFO:tasks.rados.rados.0.trial142.stdout:2548: snap_create 2026-02-17T12:01:13.632 INFO:tasks.rados.rados.0.trial142.stdout:2547: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:01:13.752 INFO:tasks.rados.rados.0.trial142.stdout:2546: finishing copy_from racing read to trial14245205-38 2026-02-17T12:01:13.753 INFO:tasks.rados.rados.0.trial142.stdout:2546: finishing copy_from to trial14245205-38 2026-02-17T12:01:13.753 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1988 (ObjNum 866 snap 271 seq_num 866) dirty exists 2026-02-17T12:01:14.633 INFO:tasks.rados.rados.0.trial142.stdout:2546: done (2 left) 2026-02-17T12:01:14.633 INFO:tasks.rados.rados.0.trial142.stdout:2547: done (1 left) 2026-02-17T12:01:14.633 INFO:tasks.rados.rados.0.trial142.stdout:2548: done (0 left) 2026-02-17T12:01:14.633 INFO:tasks.rados.rados.0.trial142.stdout:2549: write (excl) oid 9 current snap is 277 2026-02-17T12:01:14.633 INFO:tasks.rados.rados.0.trial142.stdout:2549: seq_num 875 ranges {706125=423470,1652803=758303} 2026-02-17T12:01:14.637 INFO:tasks.rados.rados.0.trial142.stdout:2549: writing trial14245205-9 from 706125 to 1129595 tid 1 2026-02-17T12:01:14.642 INFO:tasks.rados.rados.0.trial142.stdout:2549: writing trial14245205-9 from 1652803 to 2411106 tid 2 2026-02-17T12:01:14.642 INFO:tasks.rados.rados.0.trial142.stdout:2550: rollback oid 14 current snap is 277 2026-02-17T12:01:14.642 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 267 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2549: finishing write tid 1 to trial14245205-9 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2551: read oid 41 snap -1 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2551: expect (ObjNum 863 snap 271 seq_num 863) 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2552: copy_from oid 26 from oid 39 current snap is 277 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2553: read oid 21 snap -1 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2553: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2554: copy_from oid 8 from oid 4 current snap is 277 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2555: rollback oid 34 current snap is 277 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 34 to 273 2026-02-17T12:01:14.643 INFO:tasks.rados.rados.0.trial142.stdout:2556: delete oid 35 current snap is 277 2026-02-17T12:01:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2556: done (7 left) 2026-02-17T12:01:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2557: copy_from oid 36 from oid 11 current snap is 277 2026-02-17T12:01:14.645 INFO:tasks.rados.rados.0.trial142.stdout:2558: read oid 30 snap -1 2026-02-17T12:01:14.646 INFO:tasks.rados.rados.0.trial142.stdout:2558: expect (ObjNum 864 snap 271 seq_num 864) 2026-02-17T12:01:14.646 INFO:tasks.rados.rados.0.trial142.stdout:2559: delete oid 2 current snap is 277 2026-02-17T12:01:14.646 INFO:tasks.rados.rados.0.trial142.stdout:2549: finishing write tid 2 to trial14245205-9 2026-02-17T12:01:14.646 INFO:tasks.rados.rados.0.trial142.stdout:2553: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:01:14.693 INFO:tasks.rados.rados.0.trial142.stdout:2551: expect (ObjNum 863 snap 271 seq_num 863) 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2555: finishing rollback tid 0 to trial14245205-34 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: finishing write tid 3 to trial14245205-9 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: finishing write tid 4 to trial14245205-9 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: oid 9 updating version 0 to 2213 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: oid 9 updating version 2213 to 2214 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: oid 9 version 2214 is already newer than 2212 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2214 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2549: left oid 9 (ObjNum 875 snap 277 seq_num 875) 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2555: finishing rollback tid 1 to trial14245205-34 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1978 (ObjNum 65 snap 0 seq_num 321162693) dirty dne 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2552: finishing copy_from racing read to trial14245205-26 2026-02-17T12:01:14.751 INFO:tasks.rados.rados.0.trial142.stdout:2558: expect (ObjNum 864 snap 271 seq_num 864) 2026-02-17T12:01:14.853 INFO:tasks.rados.rados.0.trial142.stdout:2550: finishing rollback tid 0 to trial14245205-14 2026-02-17T12:01:14.853 INFO:tasks.rados.rados.0.trial142.stdout:2550: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:01:14.853 INFO:tasks.rados.rados.0.trial142.stdout:2550: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2218 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2552: finishing copy_from to trial14245205-26 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 1988 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2557: finishing copy_from racing read to trial14245205-36 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2554: finishing copy_from racing read to trial14245205-8 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2554: finishing copy_from to trial14245205-8 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2105 (ObjNum 803 snap 252 seq_num 803) dirty exists 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2557: finishing copy_from to trial14245205-36 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1126 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2549: done (9 left) 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2550: done (8 left) 2026-02-17T12:01:14.854 INFO:tasks.rados.rados.0.trial142.stdout:2551: done (7 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2552: done (6 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2553: done (5 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2554: done (4 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2555: done (3 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2557: done (2 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2558: done (1 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2559: done (0 left) 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2560: write (excl) oid 8 current snap is 277 2026-02-17T12:01:14.855 INFO:tasks.rados.rados.0.trial142.stdout:2560: seq_num 878 ranges {756546=649217,2111896=505630} 2026-02-17T12:01:14.857 INFO:tasks.rados.rados.0.trial142.stdout:2560: writing trial14245205-8 from 756546 to 1405763 tid 1 2026-02-17T12:01:14.862 INFO:tasks.rados.rados.0.trial142.stdout:2560: writing trial14245205-8 from 2111896 to 2617526 tid 2 2026-02-17T12:01:14.862 INFO:tasks.rados.rados.0.trial142.stdout:2561: read oid 39 snap -1 2026-02-17T12:01:14.862 INFO:tasks.rados.rados.0.trial142.stdout:2561: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:14.862 INFO:tasks.rados.rados.0.trial142.stdout:2562: snap_remove snap 275 2026-02-17T12:01:15.199 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:15.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: get_monmap_and_config 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: build_initial_monmap 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: monmap: 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:15.269041+0000 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:15.269041+0000 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:15.270 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 Processor -- start 2026-02-17T12:01:15.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 -- start start 2026-02-17T12:01:15.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: init 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-a con 0x7ff1280a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 0x7ff12809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-b con 0x7ff1280a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff12809e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12806e140 con 0x7ff12809e540 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff1280a3f90 con 0x7ff1280a3bb0 2026-02-17T12:01:15.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff12809f910 con 0x7ff1280a0750 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff13061a640 10 monclient(hunting): authenticate will time out at 1562.887830s 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37312/0 (socket says 10.20.193.51:37312) 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 1 -- 10.20.193.51:0/465203067 learned_addr learned my addr 10.20.193.51:0/465203067 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12db8e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 0x7ff12809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 10 monclient(hunting): get_auth_request con 0x7ff1280a3bb0 auth_method 0 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12e38f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12db8e640 10 monclient(hunting): get_auth_request con 0x7ff1280a0750 auth_method 0 2026-02-17T12:01:15.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12db8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12db8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.268+0000 7ff12db8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12e38f640 1 -- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 msgr2=0x7ff12809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12e38f640 1 -- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 msgr2=0x7ff12809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12e38f640 1 --2- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12e38f640 1 --2- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient(hunting): handle_auth_done global_id 194204 payload 274 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 1 -- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 msgr2=0x7ff12809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 1 --2- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 1 -- 10.20.193.51:0/465203067 >> v1:10.20.193.142:6789/0 conn(0x7ff12809e540 legacy=0x7ff12813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:15.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 1 monclient: found mon.noname-b 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.269+0000 7ff12db8e640 1 -- 10.20.193.51:0/465203067 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12809ccd0 con 0x7ff1280a0750 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12db8e640 1 -- 10.20.193.51:0/465203067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 msgr2=0x7ff12809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12db8e640 1 --2- 10.20.193.51:0/465203067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 0x7ff12809e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff12806c1c0 tx=0x7ff11c02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2ab6ac53d3d66e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 1 -- 10.20.193.51:0/465203067 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c03c070 con 0x7ff1280a0750 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: dump: 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:15.284 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: _finish_auth 0 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: _check_auth_tickets 2026-02-17T12:01:15.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 1 -- 10.20.193.51:0/465203067 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c02fbd0 con 0x7ff1280a0750 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff13061a640 5 monclient: authenticate success, global_id 194204 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff13061a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff13061a640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 1 -- 10.20.193.51:0/465203067 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c037440 con 0x7ff1280a0750 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff13061a640 4 set_mon_vals no callback set 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.271+0000 7ff12d38d640 10 monclient: dump: 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.286 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 10 monclient: shutdown 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- 10.20.193.51:0/465203067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 msgr2=0x7ff12809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 --2- 10.20.193.51:0/465203067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 0x7ff12809e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff12806c1c0 tx=0x7ff11c02ed50 comp rx=0 tx=0).stop 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- 10.20.193.51:0/465203067 shutdown_connections 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 --2- 10.20.193.51:0/465203067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1280a0750 0x7ff12809e000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 --2- 10.20.193.51:0/465203067 >> v2:10.20.193.51:3300/0 conn(0x7ff1280a3bb0 0x7ff12809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- 10.20.193.51:0/465203067 >> 10.20.193.51:0/465203067 conn(0x7ff1280a30c0 msgr2=0x7ff1280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- 10.20.193.51:0/465203067 shutdown_connections 2026-02-17T12:01:15.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- 10.20.193.51:0/465203067 wait complete. 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 10 monclient: build_initial_monmap 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 10 monclient: monmap: 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 Processor -- start 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 1 -- start start 2026-02-17T12:01:15.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.272+0000 7ff13061a640 10 monclient: init 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-c con 0x7ff12809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-a con 0x7ff1280a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1280a3bb0 0x7ff128130cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): picked mon.noname-b con 0x7ff1280a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff1280a04b0 con 0x7ff1280a0750 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff12809c850 con 0x7ff1280a3bb0 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff12813de80 con 0x7ff12809e540 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff13061a640 10 monclient(hunting): authenticate will time out at 1562.892052s 2026-02-17T12:01:15.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38006/0 (socket says 10.20.193.51:38006) 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37322/0 (socket says 10.20.193.51:37322) 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 -- 10.20.193.51:0/3754183937 learned_addr learned my addr 10.20.193.51:0/3754183937 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): get_auth_request con 0x7ff12809e540 auth_method 0 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 10 monclient(hunting): get_auth_request con 0x7ff1280a0750 auth_method 0 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 msgr2=0x7ff128130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 msgr2=0x7ff128130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:15.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12db8e640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient(hunting): handle_auth_done global_id 194207 payload 824 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1280a3bb0 msgr2=0x7ff128130cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1280a3bb0 0x7ff128130cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 msgr2=0x7ff128130780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient: _finish_hunting 0 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 monclient: found mon.noname-c 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.273+0000 7ff12e38f640 1 -- 10.20.193.51:0/3754183937 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff128133990 con 0x7ff12809e540 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff12e38f640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 msgr2=0x7ff128130240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff12e38f640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d830 tx=0x7ff11800dd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118018030 con 0x7ff12809e540 2026-02-17T12:01:15.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: dump: 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: _finish_auth 0 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11800bae0 con 0x7ff12809e540 2026-02-17T12:01:15.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 5 monclient: authenticate success, global_id 194207 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 10 monclient: _renew_subs 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff128133c70 con 0x7ff12809e540 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11800bcd0 con 0x7ff12809e540 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff12cb8c640 4 set_mon_vals no callback set 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff10effd640 10 monclient: dump: 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:15.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 10 monclient: _renew_subs 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.275+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12809d7b0 con 0x7ff12809e540 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff13061a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff13061a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff13061a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12809dac0 con 0x7ff12809e540 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff118013050 con 0x7ff12809e540 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff10effd640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 0x7ff0f8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(577..577 src has 323..577) ==== 4767+0+0 (secure 0 0 0) 0x7ff118052610 con 0x7ff12809e540 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff12db8e640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 0x7ff0f8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.276+0000 7ff12db8e640 10 monclient: get_auth_request con 0x7ff0f803dd60 auth_method 0 2026-02-17T12:01:15.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.278+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff118022070 con 0x7ff12809e540 2026-02-17T12:01:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.278+0000 7ff10effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.278+0000 7ff10effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:15.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.279+0000 7ff12db8e640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 0x7ff0f8040220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff12809f230 tx=0x7ff11c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff13061a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff13061a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff13061a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff12806e530 con 0x7ff12809e540 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff10effd640 1 -- 10.20.193.51:0/3754183937 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7ff118013c90 con 0x7ff12809e540 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff10effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.392+0000 7ff10effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:15.395 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 msgr2=0x7ff0f8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 0x7ff0f8040220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff12809f230 tx=0x7ff11c033000 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 10 monclient: shutdown 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 msgr2=0x7ff128130240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d830 tx=0x7ff11800dd00 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 shutdown_connections 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff0f803dd60 0x7ff0f8040220 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1280a3bb0 0x7ff128130cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1280a0750 0x7ff128130780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 --2- 10.20.193.51:0/3754183937 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff12809e540 0x7ff128130240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 >> 10.20.193.51:0/3754183937 conn(0x7ff1280a30c0 msgr2=0x7ff128072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 shutdown_connections 2026-02-17T12:01:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:15.393+0000 7ff13061a640 1 -- 10.20.193.51:0/3754183937 wait complete. 2026-02-17T12:01:15.647 INFO:tasks.rados.rados.0.trial142.stdout:2562: done (2 left) 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2563: read oid 33 snap -1 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2563: expect deleted 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: finishing write tid 1 to trial14245205-8 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: finishing write tid 2 to trial14245205-8 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: finishing write tid 3 to trial14245205-8 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: finishing write tid 4 to trial14245205-8 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: oid 8 updating version 0 to 2107 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: oid 8 updating version 2107 to 2108 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: oid 8 version 2108 is already newer than 2106 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2108 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2560: left oid 8 (ObjNum 878 snap 277 seq_num 878) 2026-02-17T12:01:15.648 INFO:tasks.rados.rados.0.trial142.stdout:2561: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2564: read oid 47 snap 271 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2564: expect deleted 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2560: done (3 left) 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2561: done (2 left) 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2563: done (1 left) 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2565: read oid 5 snap -1 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2565: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:01:15.833 INFO:tasks.rados.rados.0.trial142.stdout:2566: rollback oid 27 current snap is 277 2026-02-17T12:01:15.834 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 274 2026-02-17T12:01:15.834 INFO:tasks.rados.rados.0.trial142.stdout:2567: read oid 15 snap -1 2026-02-17T12:01:15.834 INFO:tasks.rados.rados.0.trial142.stdout:2567: expect deleted 2026-02-17T12:01:15.834 INFO:tasks.rados.rados.0.trial142.stdout:2568: write oid 43 current snap is 277 2026-02-17T12:01:15.834 INFO:tasks.rados.rados.0.trial142.stdout:2568: seq_num 879 ranges {773353=724466,2170378=602975} 2026-02-17T12:01:15.838 INFO:tasks.rados.rados.0.trial142.stdout:2568: writing trial14245205-43 from 773353 to 1497819 tid 1 2026-02-17T12:01:15.843 INFO:tasks.rados.rados.0.trial142.stdout:2568: writing trial14245205-43 from 2170378 to 2773353 tid 2 2026-02-17T12:01:15.843 INFO:tasks.rados.rados.0.trial142.stdout:2569: snap_remove snap 269 2026-02-17T12:01:16.652 INFO:tasks.rados.rados.0.trial142.stdout:2569: done (5 left) 2026-02-17T12:01:16.652 INFO:tasks.rados.rados.0.trial142.stdout:2570: snap_remove snap 276 2026-02-17T12:01:17.630 INFO:tasks.rados.rados.0.trial142.stdout:2570: done (5 left) 2026-02-17T12:01:17.631 INFO:tasks.rados.rados.0.trial142.stdout:2571: snap_remove snap 262 2026-02-17T12:01:18.403 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 10 monclient: get_monmap_and_config 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 10 monclient: build_initial_monmap 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 10 monclient: monmap: 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:18.471999+0000 2026-02-17T12:01:18.473 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:18.471999+0000 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:18.474 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 1 Processor -- start 2026-02-17T12:01:18.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 1 -- start start 2026-02-17T12:01:18.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 10 monclient: init 2026-02-17T12:01:18.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.471+0000 7feaea179640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:18.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-17T12:01:18.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): picked mon.noname-a con 0x7feae4138600 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feae40a35a0 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 0x7feae4140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): picked mon.noname-b con 0x7feae40a5a70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae40a1df0 con 0x7feae40a35a0 2026-02-17T12:01:18.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7feae40a6830 con 0x7feae4138600 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7feae40a2c00 con 0x7feae40a5a70 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feaea179640 10 monclient(hunting): authenticate will time out at 1566.091091s 2026-02-17T12:01:18.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 0x7feae4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae2ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7feae40a35a0 0x7feae40a5360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35464/0 (socket says 10.20.193.51:35464) 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae2ffd640 1 -- 10.20.193.51:0/3835508239 learned_addr learned my addr 10.20.193.51:0/3835508239 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 10 monclient(hunting): get_auth_request con 0x7feae4138600 auth_method 0 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:18.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): get_auth_request con 0x7feae40a5a70 auth_method 0 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 1 -- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 msgr2=0x7feae41389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:18.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 1 -- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 msgr2=0x7feae41389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 1 --2- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae37fe640 1 --2- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:18.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient(hunting): handle_auth_done global_id 194210 payload 274 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 -- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 msgr2=0x7feae41389e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 --2- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 -- 10.20.193.51:0/3835508239 >> v1:10.20.193.51:6789/0 conn(0x7feae40a35a0 legacy=0x7feae40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 monclient: found mon.noname-b 2026-02-17T12:01:18.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.472+0000 7feae3fff640 1 -- 10.20.193.51:0/3835508239 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae4138f20 con 0x7feae40a5a70 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae3fff640 1 -- 10.20.193.51:0/3835508239 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 msgr2=0x7feae4140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae3fff640 1 --2- 10.20.193.51:0/3835508239 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 0x7feae4140380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a9d7f0c49b8218 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 1 -- 10.20.193.51:0/3835508239 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead803c070 con 0x7feae40a5a70 2026-02-17T12:01:18.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: dump: 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.495 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feaea179640 5 monclient: authenticate success, global_id 194210 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feaea179640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 1 -- 10.20.193.51:0/3835508239 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead8037440 con 0x7feae40a5a70 2026-02-17T12:01:18.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 1 -- 10.20.193.51:0/3835508239 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8037810 con 0x7feae40a5a70 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feae27fc640 10 monclient: dump: 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:18.498 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:18.499 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feaea179640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.474+0000 7feaea179640 4 set_mon_vals no callback set 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 10 monclient: shutdown 2026-02-17T12:01:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- 10.20.193.51:0/3835508239 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 msgr2=0x7feae4140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 --2- 10.20.193.51:0/3835508239 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 0x7feae4140380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802f190 comp rx=0 tx=0).stop 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- 10.20.193.51:0/3835508239 shutdown_connections 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 --2- 10.20.193.51:0/3835508239 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a5a70 0x7feae4140380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 --2- 10.20.193.51:0/3835508239 >> v2:10.20.193.51:3300/0 conn(0x7feae4138600 0x7feae41389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- 10.20.193.51:0/3835508239 >> 10.20.193.51:0/3835508239 conn(0x7feae40a7460 msgr2=0x7feae40a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:18.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- 10.20.193.51:0/3835508239 shutdown_connections 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- 10.20.193.51:0/3835508239 wait complete. 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 10 monclient: build_initial_monmap 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 10 monclient: monmap: 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:18.502 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:18.503 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 Processor -- start 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 1 -- start start 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.475+0000 7feaea179640 10 monclient: init 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:18.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 0x7feae41cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): picked mon.noname-c con 0x7feae40a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): picked mon.noname-a con 0x7feae40a5a70 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feae4138600 0x7feae41cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): picked mon.noname-b con 0x7feae4138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7feae40a25b0 con 0x7feae40a5a70 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7feae40a22d0 con 0x7feae4138600 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7feae40a15f0 con 0x7feae40a35a0 2026-02-17T12:01:18.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feaea179640 10 monclient(hunting): authenticate will time out at 1566.095061s 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 0x7feae41cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37350/0 (socket says 10.20.193.51:37350) 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 -- 10.20.193.51:0/429687563 learned_addr learned my addr 10.20.193.51:0/429687563 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 10 monclient(hunting): get_auth_request con 0x7feae40a5a70 auth_method 0 2026-02-17T12:01:18.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): get_auth_request con 0x7feae40a35a0 auth_method 0 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:18.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 msgr2=0x7feae41366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 msgr2=0x7feae41366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:18.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae2ffd640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae3fff640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feae4138600 0x7feae41cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient(hunting): handle_auth_done global_id 194213 payload 824 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feae4138600 msgr2=0x7feae41cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feae4138600 0x7feae41cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 msgr2=0x7feae41366d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:18.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.476+0000 7feae37fe640 1 -- 10.20.193.51:0/429687563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae41280d0 con 0x7feae40a35a0 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feae37fe640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 msgr2=0x7feae41cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feae37fe640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 0x7feae41cf370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead000e840 tx=0x7fead000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0017070 con 0x7feae40a35a0 2026-02-17T12:01:18.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: dump: 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:18.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead0004220 con 0x7feae40a35a0 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 5 monclient: authenticate success, global_id 194213 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 10 monclient: _renew_subs 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae4137ae0 con 0x7feae40a35a0 2026-02-17T12:01:18.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead000f040 con 0x7feae40a35a0 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feabffff640 10 monclient: dump: 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.515 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feae1ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:18.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 10 monclient: _renew_subs 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.478+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feae4125de0 con 0x7feae40a35a0 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feaea179640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feaea179640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feaea179640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fead0012050 con 0x7feae40a35a0 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae40a4500 con 0x7feae40a35a0 2026-02-17T12:01:18.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feabffff640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 0x7feab40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(580..580 src has 323..580) ==== 4839+0+0 (secure 0 0 0) 0x7fead0052080 con 0x7feae40a35a0 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feae2ffd640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 0x7feab40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.479+0000 7feae2ffd640 10 monclient: get_auth_request con 0x7feab403dd10 auth_method 0 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.482+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feae40a4500 con 0x7feae40a35a0 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.482+0000 7feabffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.482+0000 7feabffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:18.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.482+0000 7feae2ffd640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 0x7feab40401d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feae41d0430 tx=0x7fead4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:18.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feaea179640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:18.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feaea179640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:18.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feaea179640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:18.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feae4069780 con 0x7feae40a35a0 2026-02-17T12:01:18.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feabffff640 1 -- 10.20.193.51:0/429687563 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fead0050a40 con 0x7feae40a35a0 2026-02-17T12:01:18.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feabffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:18.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.596+0000 7feabffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:18.599 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":39,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:18.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 msgr2=0x7feab40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:18.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 0x7feab40401d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feae41d0430 tx=0x7fead4009040 comp rx=0 tx=0).stop 2026-02-17T12:01:18.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 10 monclient: shutdown 2026-02-17T12:01:18.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:18.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 msgr2=0x7feae41cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 0x7feae41cf370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead000e840 tx=0x7fead000ed10 comp rx=0 tx=0).stop 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 shutdown_connections 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feab403dd10 0x7feab40401d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feae4138600 0x7feae41cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feae40a5a70 0x7feae41366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 --2- 10.20.193.51:0/429687563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feae40a35a0 0x7feae41cf370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 >> 10.20.193.51:0/429687563 conn(0x7feae40a7460 msgr2=0x7feae406fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 shutdown_connections 2026-02-17T12:01:18.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:18.597+0000 7feaea179640 1 -- 10.20.193.51:0/429687563 wait complete. 2026-02-17T12:01:18.632 INFO:tasks.rados.rados.0.trial142.stdout:2571: done (5 left) 2026-02-17T12:01:18.632 INFO:tasks.rados.rados.0.trial142.stdout:2572: write oid 6 current snap is 277 2026-02-17T12:01:18.632 INFO:tasks.rados.rados.0.trial142.stdout:2572: seq_num 880 ranges {790160=799715,2112507=509299} 2026-02-17T12:01:18.639 INFO:tasks.rados.rados.0.trial142.stdout:2572: writing trial14245205-6 from 790160 to 1589875 tid 1 2026-02-17T12:01:18.643 INFO:tasks.rados.rados.0.trial142.stdout:2572: writing trial14245205-6 from 2112507 to 2621806 tid 2 2026-02-17T12:01:18.643 INFO:tasks.rados.rados.0.trial142.stdout:2573: snap_create 2026-02-17T12:01:18.643 INFO:tasks.rados.rados.0.trial142.stdout:2565: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:01:18.789 INFO:tasks.rados.rados.0.trial142.stdout:2566: finishing rollback tid 0 to trial14245205-27 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:2566: finishing rollback tid 1 to trial14245205-27 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:2566: finishing rollback tid 2 to trial14245205-27 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2111 (ObjNum 853 snap 268 seq_num 853) dirty exists 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:2568: finishing write tid 1 to trial14245205-43 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:2568: finishing write tid 2 to trial14245205-43 2026-02-17T12:01:18.790 INFO:tasks.rados.rados.0.trial142.stdout:2568: finishing write tid 3 to trial14245205-43 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2568: finishing write tid 4 to trial14245205-43 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2568: oid 43 updating version 0 to 2220 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2568: oid 43 updating version 2220 to 2225 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2568: oid 43 updating version 2225 to 2226 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2226 (ObjNum 879 snap 277 seq_num 879) dirty exists 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2568: left oid 43 (ObjNum 879 snap 277 seq_num 879) 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2572: finishing write tid 1 to trial14245205-6 2026-02-17T12:01:18.791 INFO:tasks.rados.rados.0.trial142.stdout:2572: finishing write tid 2 to trial14245205-6 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: finishing write tid 3 to trial14245205-6 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: finishing write tid 4 to trial14245205-6 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: oid 6 updating version 0 to 1960 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: oid 6 updating version 1960 to 1961 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: oid 6 updating version 1961 to 1962 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 1962 (ObjNum 880 snap 277 seq_num 880) dirty exists 2026-02-17T12:01:18.792 INFO:tasks.rados.rados.0.trial142.stdout:2572: left oid 6 (ObjNum 880 snap 277 seq_num 880) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2564: done (6 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2565: done (5 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2566: done (4 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2567: done (3 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2568: done (2 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2572: done (1 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2573: done (0 left) 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:2574: rollback oid 3 current snap is 278 2026-02-17T12:01:19.632 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 277 2026-02-17T12:01:19.633 INFO:tasks.rados.rados.0.trial142.stdout:2575: snap_create 2026-02-17T12:01:19.636 INFO:tasks.rados.rados.0.trial142.stdout:2574: finishing rollback tid 0 to trial14245205-3 2026-02-17T12:01:19.636 INFO:tasks.rados.rados.0.trial142.stdout:2574: finishing rollback tid 1 to trial14245205-3 2026-02-17T12:01:19.636 INFO:tasks.rados.rados.0.trial142.stdout:2574: finishing rollback tid 2 to trial14245205-3 2026-02-17T12:01:19.636 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2123 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:01:20.634 INFO:tasks.rados.rados.0.trial142.stdout:2574: done (1 left) 2026-02-17T12:01:20.635 INFO:tasks.rados.rados.0.trial142.stdout:2575: done (0 left) 2026-02-17T12:01:20.635 INFO:tasks.rados.rados.0.trial142.stdout:2576: snap_remove snap 258 2026-02-17T12:01:21.607 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:21.636 INFO:tasks.rados.rados.0.trial142.stdout:2576: done (0 left) 2026-02-17T12:01:21.637 INFO:tasks.rados.rados.0.trial142.stdout:2577: write (excl) oid 42 current snap is 279 2026-02-17T12:01:21.637 INFO:tasks.rados.rados.0.trial142.stdout:2577: seq_num 881 ranges {406967=474964,1370989=769310,2677186=129781} 2026-02-17T12:01:21.640 INFO:tasks.rados.rados.0.trial142.stdout:2577: writing trial14245205-42 from 406967 to 881931 tid 1 2026-02-17T12:01:21.645 INFO:tasks.rados.rados.0.trial142.stdout:2577: writing trial14245205-42 from 1370989 to 2140299 tid 2 2026-02-17T12:01:21.647 INFO:tasks.rados.rados.0.trial142.stdout:2577: writing trial14245205-42 from 2677186 to 2806967 tid 3 2026-02-17T12:01:21.647 INFO:tasks.rados.rados.0.trial142.stdout:2578: snap_create 2026-02-17T12:01:21.647 INFO:tasks.rados.rados.0.trial142.stdout:2577: finishing write tid 1 to trial14245205-42 2026-02-17T12:01:21.647 INFO:tasks.rados.rados.0.trial142.stdout:2577: finishing write tid 2 to trial14245205-42 2026-02-17T12:01:21.648 INFO:tasks.rados.rados.0.trial142.stdout:2577: finishing write tid 3 to trial14245205-42 2026-02-17T12:01:21.648 INFO:tasks.rados.rados.0.trial142.stdout:2577: finishing write tid 4 to trial14245205-42 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: finishing write tid 5 to trial14245205-42 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: oid 42 updating version 0 to 1128 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: oid 42 version 1128 is already newer than 1127 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: oid 42 updating version 1128 to 1129 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: oid 42 updating version 1129 to 1130 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1130 (ObjNum 881 snap 279 seq_num 881) dirty exists 2026-02-17T12:01:21.649 INFO:tasks.rados.rados.0.trial142.stdout:2577: left oid 42 (ObjNum 881 snap 279 seq_num 881) 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 10 monclient: get_monmap_and_config 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 10 monclient: build_initial_monmap 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 10 monclient: monmap: 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:21.676281+0000 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:21.676281+0000 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:21.677 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 1 Processor -- start 2026-02-17T12:01:21.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 1 -- start start 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.675+0000 7f691f600640 10 monclient: init 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): picked mon.noname-a con 0x7f69180a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f69180a0750 0x7f691809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): picked mon.noname-c con 0x7f69180a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f691813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): picked mon.noname-b con 0x7f691809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f69180a3f90 con 0x7f69180a3bb0 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f691806e140 con 0x7f69180a0750 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f691809f910 con 0x7f691809e540 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691f600640 10 monclient(hunting): authenticate will time out at 1569.295063s 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f691813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37358/0 (socket says 10.20.193.51:37358) 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 -- 10.20.193.51:0/1481553786 learned_addr learned my addr 10.20.193.51:0/1481553786 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 10 monclient(hunting): get_auth_request con 0x7f69180a3bb0 auth_method 0 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): get_auth_request con 0x7f691809e540 auth_method 0 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 -- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 msgr2=0x7f691809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 -- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 msgr2=0x7f691809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691d375640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691cb74640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.142:3300/0 conn(0x7f69180a0750 0x7f691809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691cb74640 10 monclient(hunting): get_auth_request con 0x7f69180a0750 auth_method 0 2026-02-17T12:01:21.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691cb74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691cb74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691cb74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient(hunting): handle_auth_done global_id 194216 payload 274 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 -- 10.20.193.51:0/1481553786 >> v2:10.20.193.142:3300/0 conn(0x7f69180a0750 msgr2=0x7f691809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.142:3300/0 conn(0x7f69180a0750 0x7f691809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 -- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 msgr2=0x7f691809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient: _finish_hunting 0 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 monclient: found mon.noname-b 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.676+0000 7f691db76640 1 -- 10.20.193.51:0/1481553786 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691809ccd0 con 0x7f691809e540 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.678+0000 7f691db76640 1 -- 10.20.193.51:0/1481553786 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 msgr2=0x7f691813c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.678+0000 7f691db76640 1 --2- 10.20.193.51:0/1481553786 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f691813c760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f691806f3c0 tx=0x7f691402f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c86b6a12e9a1e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.678+0000 7f6907fff640 1 -- 10.20.193.51:0/1481553786 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691403c070 con 0x7f691809e540 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.678+0000 7f6907fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.678+0000 7f6907fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: dump: 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:21.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 1 -- 10.20.193.51:0/1481553786 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6914037440 con 0x7f691809e540 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 5 monclient: authenticate success, global_id 194216 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 1 -- 10.20.193.51:0/1481553786 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6914037810 con 0x7f691809e540 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 4 set_mon_vals no callback set 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f6907fff640 10 monclient: dump: 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:21.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 10 monclient: shutdown 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 -- 10.20.193.51:0/1481553786 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 msgr2=0x7f691813c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 --2- 10.20.193.51:0/1481553786 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f691813c760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f691806f3c0 tx=0x7f691402f130 comp rx=0 tx=0).stop 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 -- 10.20.193.51:0/1481553786 shutdown_connections 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 --2- 10.20.193.51:0/1481553786 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f691813c760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.142:3300/0 conn(0x7f69180a0750 0x7f691809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 --2- 10.20.193.51:0/1481553786 >> v2:10.20.193.51:3300/0 conn(0x7f69180a3bb0 0x7f691809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 -- 10.20.193.51:0/1481553786 >> 10.20.193.51:0/1481553786 conn(0x7f69180a30c0 msgr2=0x7f69180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 -- 10.20.193.51:0/1481553786 shutdown_connections 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 1 -- 10.20.193.51:0/1481553786 wait complete. 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 10 monclient: build_initial_monmap 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.679+0000 7f691f600640 10 monclient: monmap: 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:21.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 Processor -- start 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 -- start start 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient: init 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): picked mon.noname-c con 0x7f691809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69180a0750 0x7f6918099be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): picked mon.noname-b con 0x7f69180a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): picked mon.noname-a con 0x7f69180a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f69180a04b0 con 0x7f69180a3bb0 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f691809c850 con 0x7f69180a0750 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f691813cca0 con 0x7f691809e540 2026-02-17T12:01:21.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691f600640 10 monclient(hunting): authenticate will time out at 1569.299481s 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38028/0 (socket says 10.20.193.51:38028) 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 -- 10.20.193.51:0/3550330758 learned_addr learned my addr 10.20.193.51:0/3550330758 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): get_auth_request con 0x7f691809e540 auth_method 0 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 10 monclient(hunting): get_auth_request con 0x7f69180a3bb0 auth_method 0 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 msgr2=0x7f69181cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 msgr2=0x7f69181cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691db76640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient(hunting): handle_auth_done global_id 194219 payload 824 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69180a0750 msgr2=0x7f6918099be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69180a0750 0x7f6918099be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 msgr2=0x7f69181cf0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient: _finish_hunting 0 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 monclient: found mon.noname-c 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.680+0000 7f691d375640 1 -- 10.20.193.51:0/3550330758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691809baa0 con 0x7f691809e540 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691d375640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 msgr2=0x7f69181cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691d375640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f690800d800 tx=0x7f690800dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908018030 con 0x7f691809e540 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: dump: 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690800bae0 con 0x7f691809e540 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690800bcd0 con 0x7f691809e540 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f6905ffb640 10 monclient: dump: 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f69077fe640 4 set_mon_vals no callback set 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 5 monclient: authenticate success, global_id 194219 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 10 monclient: _renew_subs 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691806f7c0 con 0x7f691809e540 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 10 monclient: _renew_subs 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.682+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69180953a0 con 0x7f691809e540 2026-02-17T12:01:21.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6908013050 con 0x7f691809e540 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691f600640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691f600640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691f600640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691809c290 con 0x7f691809e540 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f6905ffb640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 0x7f68e80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(584..584 src has 323..584) ==== 4811+0+0 (secure 0 0 0) 0x7f69080523f0 con 0x7f691809e540 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691cb74640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 0x7f68e80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.683+0000 7f691cb74640 10 monclient: get_auth_request con 0x7f68e803dd10 auth_method 0 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.686+0000 7f691cb74640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 0x7f68e80401d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f690c006fd0 tx=0x7f690c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.686+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6908022070 con 0x7f691809e540 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.686+0000 7f6905ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.686+0000 7f6905ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:21.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f691f600640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:21.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f691f600640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:21.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f691f600640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:21.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6918068450 con 0x7f691809e540 2026-02-17T12:01:21.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f6905ffb640 1 -- 10.20.193.51:0/3550330758 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f6918068450 con 0x7f691809e540 2026-02-17T12:01:21.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f6905ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:21.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.801+0000 7f6905ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:21.805 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":142,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":43,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 msgr2=0x7f68e80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 0x7f68e80401d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f690c006fd0 tx=0x7f690c008040 comp rx=0 tx=0).stop 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 10 monclient: shutdown 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 msgr2=0x7f69181cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:21.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f690800d800 tx=0x7f690800dcd0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 shutdown_connections 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f68e803dd10 0x7f68e80401d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f69180a3bb0 0x7f69181cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f69180a0750 0x7f6918099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 --2- 10.20.193.51:0/3550330758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f691809e540 0x7f69181cbbd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 >> 10.20.193.51:0/3550330758 conn(0x7f69180a30c0 msgr2=0x7f6918072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 shutdown_connections 2026-02-17T12:01:21.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:21.802+0000 7f691f600640 1 -- 10.20.193.51:0/3550330758 wait complete. 2026-02-17T12:01:22.632 INFO:tasks.rados.rados.0.trial142.stdout:2577: done (1 left) 2026-02-17T12:01:22.632 INFO:tasks.rados.rados.0.trial142.stdout:2578: done (0 left) 2026-02-17T12:01:22.632 INFO:tasks.rados.rados.0.trial142.stdout:2579: write (excl) oid 5 current snap is 280 2026-02-17T12:01:22.632 INFO:tasks.rados.rados.0.trial142.stdout:2579: seq_num 882 ranges {423774=666566,1545824=512968,2704609=119165} 2026-02-17T12:01:22.636 INFO:tasks.rados.rados.0.trial142.stdout:2579: writing trial14245205-5 from 423774 to 1090340 tid 1 2026-02-17T12:01:22.640 INFO:tasks.rados.rados.0.trial142.stdout:2579: writing trial14245205-5 from 1545824 to 2058792 tid 2 2026-02-17T12:01:22.643 INFO:tasks.rados.rados.0.trial142.stdout:2579: writing trial14245205-5 from 2704609 to 2823774 tid 3 2026-02-17T12:01:22.643 INFO:tasks.rados.rados.0.trial142.stdout:2580: write (excl) oid 32 current snap is 280 2026-02-17T12:01:22.643 INFO:tasks.rados.rados.0.trial142.stdout:2579: finishing write tid 1 to trial14245205-5 2026-02-17T12:01:22.643 INFO:tasks.rados.rados.0.trial142.stdout:2579: finishing write tid 2 to trial14245205-5 2026-02-17T12:01:22.643 INFO:tasks.rados.rados.0.trial142.stdout:2580: seq_num 883 ranges {440581=741815,1604306=656626,2732032=108549} 2026-02-17T12:01:22.648 INFO:tasks.rados.rados.0.trial142.stdout:2580: writing trial14245205-32 from 440581 to 1182396 tid 1 2026-02-17T12:01:22.652 INFO:tasks.rados.rados.0.trial142.stdout:2580: writing trial14245205-32 from 1604306 to 2260932 tid 2 2026-02-17T12:01:22.654 INFO:tasks.rados.rados.0.trial142.stdout:2580: writing trial14245205-32 from 2732032 to 2840581 tid 3 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2581: write (excl) oid 28 current snap is 280 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: finishing write tid 3 to trial14245205-5 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: finishing write tid 4 to trial14245205-5 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: finishing write tid 5 to trial14245205-5 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: oid 5 updating version 0 to 1166 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: oid 5 version 1166 is already newer than 1165 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: oid 5 updating version 1166 to 1167 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: oid 5 updating version 1167 to 1168 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1168 (ObjNum 882 snap 280 seq_num 882) dirty exists 2026-02-17T12:01:22.655 INFO:tasks.rados.rados.0.trial142.stdout:2579: left oid 5 (ObjNum 882 snap 280 seq_num 882) 2026-02-17T12:01:22.656 INFO:tasks.rados.rados.0.trial142.stdout:2580: finishing write tid 1 to trial14245205-32 2026-02-17T12:01:22.656 INFO:tasks.rados.rados.0.trial142.stdout:2581: seq_num 884 ranges {457388=417064,1546435=516637,2643102=214286} 2026-02-17T12:01:22.657 INFO:tasks.rados.rados.0.trial142.stdout:2581: writing trial14245205-28 from 457388 to 874452 tid 1 2026-02-17T12:01:22.662 INFO:tasks.rados.rados.0.trial142.stdout:2581: writing trial14245205-28 from 1546435 to 2063072 tid 2 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2581: writing trial14245205-28 from 2643102 to 2857388 tid 3 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2579: done (2 left) 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2582: read oid 15 snap -1 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2582: expect deleted 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2580: finishing write tid 2 to trial14245205-32 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2583: read oid 5 snap -1 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2583: expect (ObjNum 882 snap 280 seq_num 882) 2026-02-17T12:01:22.666 INFO:tasks.rados.rados.0.trial142.stdout:2584: copy_from oid 43 from oid 39 current snap is 280 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: finishing write tid 3 to trial14245205-32 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: finishing write tid 4 to trial14245205-32 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: finishing write tid 5 to trial14245205-32 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: oid 32 updating version 0 to 1132 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: oid 32 version 1132 is already newer than 1131 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: oid 32 updating version 1132 to 1133 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: oid 32 updating version 1133 to 1134 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1134 (ObjNum 883 snap 280 seq_num 883) dirty exists 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: left oid 32 (ObjNum 883 snap 280 seq_num 883) 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2581: finishing write tid 1 to trial14245205-28 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2580: done (4 left) 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:2585: rollback oid 1 current snap is 280 2026-02-17T12:01:22.667 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 274 2026-02-17T12:01:22.668 INFO:tasks.rados.rados.0.trial142.stdout:2581: finishing write tid 2 to trial14245205-28 2026-02-17T12:01:22.668 INFO:tasks.rados.rados.0.trial142.stdout:2586: snap_remove snap 272 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:2586: done (5 left) 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:2587: copy_from oid 38 from oid 41 current snap is 280 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:2585: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 1981 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:2581: finishing write tid 3 to trial14245205-28 2026-02-17T12:01:23.641 INFO:tasks.rados.rados.0.trial142.stdout:2581: finishing write tid 4 to trial14245205-28 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: finishing write tid 5 to trial14245205-28 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: oid 28 updating version 0 to 2124 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: oid 28 updating version 2124 to 2125 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: oid 28 updating version 2125 to 2126 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: oid 28 updating version 2126 to 2127 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2127 (ObjNum 884 snap 280 seq_num 884) dirty exists 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2581: left oid 28 (ObjNum 884 snap 280 seq_num 884) 2026-02-17T12:01:23.642 INFO:tasks.rados.rados.0.trial142.stdout:2583: expect (ObjNum 882 snap 280 seq_num 882) 2026-02-17T12:01:23.783 INFO:tasks.rados.rados.0.trial142.stdout:2584: finishing copy_from racing read to trial14245205-43 2026-02-17T12:01:23.783 INFO:tasks.rados.rados.0.trial142.stdout:2584: finishing copy_from to trial14245205-43 2026-02-17T12:01:23.783 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 1988 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:01:23.783 INFO:tasks.rados.rados.0.trial142.stdout:2587: finishing copy_from racing read to trial14245205-38 2026-02-17T12:01:23.783 INFO:tasks.rados.rados.0.trial142.stdout:2587: finishing copy_from to trial14245205-38 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1973 (ObjNum 863 snap 271 seq_num 863) dirty exists 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2581: done (5 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2582: done (4 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2583: done (3 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2584: done (2 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2585: done (1 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2587: done (0 left) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2588: read oid 26 snap -1 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2588: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:23.784 INFO:tasks.rados.rados.0.trial142.stdout:2589: snap_remove snap 277 2026-02-17T12:01:24.647 INFO:tasks.rados.rados.0.trial142.stdout:2589: done (1 left) 2026-02-17T12:01:24.647 INFO:tasks.rados.rados.0.trial142.stdout:2590: read oid 22 snap -1 2026-02-17T12:01:24.647 INFO:tasks.rados.rados.0.trial142.stdout:2590: expect (ObjNum 858 snap 270 seq_num 858) 2026-02-17T12:01:24.647 INFO:tasks.rados.rados.0.trial142.stdout:2591: snap_remove snap 279 2026-02-17T12:01:24.812 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.879+0000 7f4debaa0640 10 monclient: get_monmap_and_config 2026-02-17T12:01:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient: build_initial_monmap 2026-02-17T12:01:24.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient: monmap: 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:24.880973+0000 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:24.880973+0000 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:24.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 Processor -- start 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 -- start start 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient: init 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-b con 0x7f4de40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4de40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4de413b760 0x7f4de413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-a con 0x7f4de413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de406e140 con 0x7f4de40a0750 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4de409f910 con 0x7f4de413b760 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4de409ccd0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4debaa0640 10 monclient(hunting): authenticate will time out at 1572.499726s 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4de413b760 0x7f4de413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38044/0 (socket says 10.20.193.51:38044) 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 1 -- 10.20.193.51:0/171016447 learned_addr learned my addr 10.20.193.51:0/171016447 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): get_auth_request con 0x7f4de40a3bb0 auth_method 0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): get_auth_request con 0x7f4de413b760 auth_method 0 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.880+0000 7f4dea016640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 10 monclient(hunting): handle_auth_done global_id 194222 payload 274 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 1 -- 10.20.193.51:0/171016447 >> v2:10.20.193.51:3300/0 conn(0x7f4de413b760 msgr2=0x7f4de413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:24.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 1 --2- 10.20.193.51:0/171016447 >> v2:10.20.193.51:3300/0 conn(0x7f4de413b760 0x7f4de413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 1 -- 10.20.193.51:0/171016447 >> v1:10.20.193.51:6789/0 conn(0x7f4de40a0750 legacy=0x7f4de409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 10 monclient: _finish_hunting 0 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 1 monclient: found mon.noname-b 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:24.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.881+0000 7f4de9815640 1 -- 10.20.193.51:0/171016447 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de409eec0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de9815640 1 -- 10.20.193.51:0/171016447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 msgr2=0x7f4de409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de9815640 1 --2- 10.20.193.51:0/171016447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4de409f230 tx=0x7f4dd402ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbbbd925a46ea8de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 1 -- 10.20.193.51:0/171016447 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd403c070 con 0x7f4de40a3bb0 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: dump: 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:24.891 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: _finish_auth 0 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: _check_auth_tickets 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:24.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 1 -- 10.20.193.51:0/171016447 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd402fcc0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 1 -- 10.20.193.51:0/171016447 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4037660 con 0x7f4de40a3bb0 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4de8813640 10 monclient: dump: 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.893 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4debaa0640 5 monclient: authenticate success, global_id 194222 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4debaa0640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.883+0000 7f4debaa0640 4 set_mon_vals no callback set 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: shutdown 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- 10.20.193.51:0/171016447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 msgr2=0x7f4de409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- 10.20.193.51:0/171016447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4de409f230 tx=0x7f4dd402ee80 comp rx=0 tx=0).stop 2026-02-17T12:01:24.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- 10.20.193.51:0/171016447 shutdown_connections 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- 10.20.193.51:0/171016447 >> v2:10.20.193.51:3300/0 conn(0x7f4de413b760 0x7f4de413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- 10.20.193.51:0/171016447 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de409dac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- 10.20.193.51:0/171016447 >> 10.20.193.51:0/171016447 conn(0x7f4de40a30c0 msgr2=0x7f4de40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- 10.20.193.51:0/171016447 shutdown_connections 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- 10.20.193.51:0/171016447 wait complete. 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: build_initial_monmap 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: monmap: 2026-02-17T12:01:24.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 Processor -- start 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- start start 2026-02-17T12:01:24.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: init 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4de40a0750 0x7f4de4099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-a con 0x7f4de40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-c con 0x7f4de40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4de413b760 0x7f4de4091070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): picked mon.noname-b con 0x7f4de413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40a04b0 con 0x7f4de40a0750 2026-02-17T12:01:24.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4de409c850 con 0x7f4de413b760 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4de409e710 con 0x7f4de40a3bb0 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.884+0000 7f4debaa0640 10 monclient(hunting): authenticate will time out at 1572.504008s 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4de40a0750 0x7f4de4099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:38052/0 (socket says 10.20.193.51:38052) 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 -- 10.20.193.51:0/5267543 learned_addr learned my addr 10.20.193.51:0/5267543 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): get_auth_request con 0x7f4de40a0750 auth_method 0 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:24.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): get_auth_request con 0x7f4de40a3bb0 auth_method 0 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9815640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient(hunting): handle_auth_done global_id 194225 payload 824 2026-02-17T12:01:24.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 -- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4de413b760 msgr2=0x7f4de4091070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4de413b760 0x7f4de4091070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 -- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4de40a0750 msgr2=0x7f4de4099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4de40a0750 0x7f4de4099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient: _finish_hunting 0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 monclient: found mon.noname-c 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.885+0000 7f4de9014640 1 -- 10.20.193.51:0/5267543 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de4093260 con 0x7f4de40a3bb0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4de9014640 1 -- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 msgr2=0x7f4de4090b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4de9014640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c500 tx=0x7f4dd800c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8012a40 con 0x7f4de40a3bb0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:24.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: dump: 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd8017070 con 0x7f4de40a3bb0 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8012e40 con 0x7f4de40a3bb0 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd3fff640 4 set_mon_vals no callback set 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4dd27fc640 10 monclient: dump: 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:24.902 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 5 monclient: authenticate success, global_id 194225 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 10 monclient: _renew_subs 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de409d7b0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 10 monclient: _renew_subs 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.887+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de4094860 con 0x7f4de40a3bb0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4dd801c460 con 0x7f4de40a3bb0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4debaa0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4debaa0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4debaa0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de4139ab0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4dd27fc640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 0x7f4db4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(587..587 src has 323..587) ==== 4811+0+0 (secure 0 0 0) 0x7f4dd80523c0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4de9815640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 0x7f4db4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:24.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.888+0000 7f4de9815640 10 monclient: get_auth_request con 0x7f4db403dd60 auth_method 0 2026-02-17T12:01:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.890+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4de4139ab0 con 0x7f4de40a3bb0 2026-02-17T12:01:24.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.890+0000 7f4dd27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:24.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.890+0000 7f4dd27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:24.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:24.891+0000 7f4de9815640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 0x7f4db4040220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4036000 tx=0x7f4dd4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4debaa0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:25.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4debaa0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4debaa0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4de409dac0 con 0x7f4de40a3bb0 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4dd27fc640 1 -- 10.20.193.51:0/5267543 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f4dd8050da0 con 0x7f4de40a3bb0 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4dd27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.007+0000 7f4dd27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:25.010 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 msgr2=0x7f4db4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 0x7f4db4040220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4036000 tx=0x7f4dd4033000 comp rx=0 tx=0).stop 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 10 monclient: shutdown 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 msgr2=0x7f4de4090b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c500 tx=0x7f4dd800c9d0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 shutdown_connections 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4db403dd60 0x7f4db4040220 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4de413b760 0x7f4de4091070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4de40a3bb0 0x7f4de4090b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 --2- 10.20.193.51:0/5267543 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4de40a0750 0x7f4de4099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 >> 10.20.193.51:0/5267543 conn(0x7f4de40a30c0 msgr2=0x7f4de413a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 shutdown_connections 2026-02-17T12:01:25.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.008+0000 7f4debaa0640 1 -- 10.20.193.51:0/5267543 wait complete. 2026-02-17T12:01:25.018 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:01:25.018 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:01:25.018 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:01:25.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 10 monclient: get_monmap_and_config 2026-02-17T12:01:25.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 10 monclient: monmap: 2026-02-17T12:01:25.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:25.084408+0000 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:25.084408+0000 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:25.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 1 Processor -- start 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 1 -- start start 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.083+0000 7f010ce2c640 10 monclient: init 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f01080a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f01080a0750 0x7f010809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-c con 0x7f01080a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f010813b760 0x7f010813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-a con 0x7f010813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010806e140 con 0x7f01080a3bb0 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f010809f910 con 0x7f010813b760 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f010809ccd0 con 0x7f01080a0750 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f010ce2c640 10 monclient(hunting): authenticate will time out at 1572.703252s 2026-02-17T12:01:25.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f010813b760 0x7f010813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f010813b760 0x7f010813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37400/0 (socket says 10.20.193.51:37400) 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 -- 10.20.193.51:0/2940301351 learned_addr learned my addr 10.20.193.51:0/2940301351 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): get_auth_request con 0x7f010813b760 auth_method 0 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0105d74640 1 --2- 10.20.193.51:0/2940301351 >> v2:10.20.193.142:3300/0 conn(0x7f01080a0750 0x7f010809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0105d74640 10 monclient(hunting): get_auth_request con 0x7f01080a0750 auth_method 0 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0105d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0105d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0105d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient(hunting): handle_auth_done global_id 204105 payload 274 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 -- 10.20.193.51:0/2940301351 >> v2:10.20.193.142:3300/0 conn(0x7f01080a0750 msgr2=0x7f010809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 --2- 10.20.193.51:0/2940301351 >> v2:10.20.193.142:3300/0 conn(0x7f01080a0750 0x7f010809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 -- 10.20.193.51:0/2940301351 >> v1:10.20.193.142:6789/0 conn(0x7f01080a3bb0 legacy=0x7f010809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 monclient: found mon.noname-a 2026-02-17T12:01:25.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.084+0000 7f0106d76640 1 -- 10.20.193.51:0/2940301351 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010809eec0 con 0x7f010813b760 2026-02-17T12:01:25.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.086+0000 7f0106d76640 1 -- 10.20.193.51:0/2940301351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b760 msgr2=0x7f010813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.086+0000 7f0106d76640 1 --2- 10.20.193.51:0/2940301351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b760 0x7f010813db50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f010806f3c0 tx=0x7f00f802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75906750609dcf9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 1 -- 10.20.193.51:0/2940301351 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f802fe60 con 0x7f010813b760 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: dump: 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 5 monclient: authenticate success, global_id 204105 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 1 -- 10.20.193.51:0/2940301351 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f80373f0 con 0x7f010813b760 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 1 -- 10.20.193.51:0/2940301351 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f80377c0 con 0x7f010813b760 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 4 set_mon_vals no callback set 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f0105573640 10 monclient: dump: 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.108 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 10 monclient: shutdown 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 -- 10.20.193.51:0/2940301351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b760 msgr2=0x7f010813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 --2- 10.20.193.51:0/2940301351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b760 0x7f010813db50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f010806f3c0 tx=0x7f00f802f230 comp rx=0 tx=0).stop 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 -- 10.20.193.51:0/2940301351 shutdown_connections 2026-02-17T12:01:25.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 --2- 10.20.193.51:0/2940301351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b760 0x7f010813db50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 --2- 10.20.193.51:0/2940301351 >> v2:10.20.193.142:3300/0 conn(0x7f01080a0750 0x7f010809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 -- 10.20.193.51:0/2940301351 >> 10.20.193.51:0/2940301351 conn(0x7f01080a30c0 msgr2=0x7f01080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 -- 10.20.193.51:0/2940301351 shutdown_connections 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 -- 10.20.193.51:0/2940301351 wait complete. 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 10 monclient: monmap: 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.110 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.087+0000 7f010ce2c640 1 Processor -- start 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 -- start start 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient: init 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01080a0750 0x7f010809a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-b con 0x7f01080a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:25.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 0x7f010813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-a con 0x7f01080a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f010813b760 0x7f010813acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): picked mon.noname-c con 0x7f010813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f01080a04b0 con 0x7f01080a3bb0 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f010809c850 con 0x7f01080a0750 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f010809e710 con 0x7f010813b760 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f010ce2c640 10 monclient(hunting): authenticate will time out at 1572.707334s 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 0x7f010813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 0x7f010813a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37410/0 (socket says 10.20.193.51:37410) 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 -- 10.20.193.51:0/775645194 learned_addr learned my addr 10.20.193.51:0/775645194 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): get_auth_request con 0x7f01080a3bb0 auth_method 0 2026-02-17T12:01:25.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f010813b760 0x7f010813acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): get_auth_request con 0x7f010813b760 auth_method 0 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106575640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01080a0750 0x7f010809a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106575640 10 monclient(hunting): get_auth_request con 0x7f01080a0750 auth_method 0 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0106575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient(hunting): handle_auth_done global_id 204108 payload 824 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f010813b760 msgr2=0x7f010813acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f010813b760 0x7f010813acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01080a0750 msgr2=0x7f010809a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01080a0750 0x7f010809a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 monclient: found mon.noname-a 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.088+0000 7f0105d74640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0108094de0 con 0x7f01080a3bb0 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f0105d74640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 msgr2=0x7f010813a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f0105d74640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 0x7f010813a770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00f000e7c0 tx=0x7f00f000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0017070 con 0x7f01080a3bb0 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: dump: 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.118 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f000cae0 con 0x7f01080a3bb0 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f000f040 con 0x7f01080a3bb0 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f0104d72640 4 set_mon_vals no callback set 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f00eeffd640 10 monclient: dump: 2026-02-17T12:01:25.120 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 5 monclient: authenticate success, global_id 204108 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 10 monclient: _renew_subs 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01080a2470 con 0x7f01080a3bb0 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 10 monclient: _renew_subs 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.090+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0108096230 con 0x7f01080a3bb0 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f010ce2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f010ce2c640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 0x7f01080930c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0108095280 con 0x7f010813b1f0 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 0x7f01080930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient: get_auth_request con 0x7f010813b1f0 auth_method 0 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f00f0012050 con 0x7f01080a3bb0 2026-02-17T12:01:25.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 10 monclient(hunting): handle_auth_done global_id 204111 payload 824 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106575640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f010809dac0 con 0x7f010813b1f0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f00eeffd640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dd10 0x7f00d40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(587..587 src has 323..587) ==== 4811+0+0 (secure 0 0 0) 0x7f00f00524a0 con 0x7f01080a3bb0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106d76640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dd10 0x7f00d40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.091+0000 7f0106d76640 10 monclient: get_auth_request con 0x7f00d403dd10 auth_method 0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f0106575640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 msgr2=0x7f01080930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f0106575640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 0x7f01080930c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc006ae0 con 0x7f010813b1f0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f00eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f00eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.093+0000 7f00eeffd640 10 monclient: dump: 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.125 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f00fc006ae0 con 0x7f010813b1f0 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 msgr2=0x7f01080930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 0x7f01080930c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc00ec00 comp rx=0 tx=0).stop 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 msgr2=0x7f01080930c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f00eeffd640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010813b1f0 0x7f01080930c0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc00ec00 comp rx=0 tx=0).stop 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.094+0000 7f0106d76640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dd10 0x7f00d40401d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f010806c1c0 tx=0x7f00f8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f010ce2c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:25.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f010ce2c640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 0x7f01081d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f010ce2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f010813b5d0 con 0x7f010808d3f0 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 0x7f01081d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient: get_auth_request con 0x7f010808d3f0 auth_method 0 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 10 monclient(hunting): handle_auth_done global_id 204114 payload 824 2026-02-17T12:01:25.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.097+0000 7f0106575640 1 -- 10.20.193.51:0/775645194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f01080008d0 con 0x7f010808d3f0 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f0106575640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 msgr2=0x7f01081d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f0106575640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 0x7f01081d88a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00c930 con 0x7f010808d3f0 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 10 monclient: dump: 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.128 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7f00fc00c930 con 0x7f010808d3f0 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 msgr2=0x7f01081d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 0x7f01081d88a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc003860 comp rx=0 tx=0).stop 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 msgr2=0x7f01081d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f00eeffd640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f010808d3f0 0x7f01081d88a0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e730 tx=0x7f00fc003860 comp rx=0 tx=0).stop 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 25865, 2026-02-17T12:01:25.130 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.131 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:25.132 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.133 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.134 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.135 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.136 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.137 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:25.138 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dd10 msgr2=0x7f00d40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f00d403dd10 0x7f00d40401d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f010806c1c0 tx=0x7f00f8033000 comp rx=0 tx=0).stop 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 10 monclient: shutdown 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 msgr2=0x7f010813a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f010ce2c640 1 --2- 10.20.193.51:0/775645194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01080a3bb0 0x7f010813a770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00f000e7c0 tx=0x7f00f000ec90 comp rx=0 tx=0).stop 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f0106d76640 1 -- 10.20.193.51:0/775645194 reap_dead start 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.099+0000 7f0106d76640 1 -- 10.20.193.51:0/775645194 reap_dead start 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.100+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 shutdown_connections 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.100+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 >> 10.20.193.51:0/775645194 conn(0x7f01080a30c0 msgr2=0x7f01080a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.100+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 shutdown_connections 2026-02-17T12:01:25.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.100+0000 7f010ce2c640 1 -- 10.20.193.51:0/775645194 wait complete. 2026-02-17T12:01:25.140 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:25.140 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:01:25.140 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 10 monclient: get_monmap_and_config 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 10 monclient: monmap: 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:25.206348+0000 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:25.206348+0000 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:25.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 1 Processor -- start 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 1 -- start start 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.205+0000 7f907e4da640 10 monclient: init 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f90780a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f90780a0750 0x7f907809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-c con 0x7f90780a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f907813b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f907806e140 con 0x7f90780a3bb0 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f907809f910 con 0x7f907813b760 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f907809ccd0 con 0x7f90780a0750 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f907e4da640 10 monclient(hunting): authenticate will time out at 1572.825112s 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f9077fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f90780a3bb0 0x7f907809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46252/0 (socket says 10.20.193.51:46252) 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f9077fff640 1 -- 10.20.193.51:0/184395863 learned_addr learned my addr 10.20.193.51:0/184395863 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 1 --2- 10.20.193.51:0/184395863 >> v2:10.20.193.142:3300/0 conn(0x7f90780a0750 0x7f907809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): get_auth_request con 0x7f90780a0750 auth_method 0 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient(hunting): handle_auth_done global_id 184267 payload 274 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 1 -- 10.20.193.51:0/184395863 >> v1:10.20.193.142:6789/0 conn(0x7f907813b760 legacy=0x7f907813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 1 -- 10.20.193.51:0/184395863 >> v1:10.20.193.51:6789/0 conn(0x7f90780a3bb0 legacy=0x7f907809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:01:25.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.206+0000 7f90777fe640 1 -- 10.20.193.51:0/184395863 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907809eec0 con 0x7f90780a0750 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f90777fe640 1 -- 10.20.193.51:0/184395863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a0750 msgr2=0x7f907809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f90777fe640 1 --2- 10.20.193.51:0/184395863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a0750 0x7f907809e1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90680098a0 tx=0x7f906802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c7327c9a6b9ba9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 1 -- 10.20.193.51:0/184395863 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906803c070 con 0x7f90780a0750 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: dump: 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.216 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 1 -- 10.20.193.51:0/184395863 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906802fce0 con 0x7f90780a0750 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 5 monclient: authenticate success, global_id 184267 2026-02-17T12:01:25.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 1 -- 10.20.193.51:0/184395863 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068037660 con 0x7f90780a0750 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 4 set_mon_vals no callback set 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f9076ffd640 10 monclient: dump: 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.218 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 10 monclient: shutdown 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 -- 10.20.193.51:0/184395863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a0750 msgr2=0x7f907809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 --2- 10.20.193.51:0/184395863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a0750 0x7f907809e1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90680098a0 tx=0x7f906802ed80 comp rx=0 tx=0).stop 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 -- 10.20.193.51:0/184395863 shutdown_connections 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 --2- 10.20.193.51:0/184395863 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a0750 0x7f907809e1d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 -- 10.20.193.51:0/184395863 >> 10.20.193.51:0/184395863 conn(0x7f90780a30c0 msgr2=0x7f90780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 -- 10.20.193.51:0/184395863 shutdown_connections 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 1 -- 10.20.193.51:0/184395863 wait complete. 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.209+0000 7f907e4da640 10 monclient: monmap: 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 Processor -- start 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 -- start start 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient: init 2026-02-17T12:01:25.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-a con 0x7f90780a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a3bb0 0x7f907809bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-b con 0x7f90780a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f907813b760 0x7f9078132290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): picked mon.noname-c con 0x7f907813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f90780a04b0 con 0x7f90780a0750 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f907809c850 con 0x7f90780a3bb0 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f907809e710 con 0x7f907813b760 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907e4da640 10 monclient(hunting): authenticate will time out at 1572.829435s 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44468/0 (socket says 10.20.193.51:44468) 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 -- 10.20.193.51:0/1277256162 learned_addr learned my addr 10.20.193.51:0/1277256162 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): get_auth_request con 0x7f90780a0750 auth_method 0 2026-02-17T12:01:25.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f907813b760 0x7f9078132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): get_auth_request con 0x7f907813b760 auth_method 0 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f90777fe640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a3bb0 0x7f907809bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f907ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f90777fe640 10 monclient(hunting): get_auth_request con 0x7f90780a3bb0 auth_method 0 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f90777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f90777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f90777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient(hunting): handle_auth_done global_id 204117 payload 824 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f907813b760 msgr2=0x7f9078132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f907813b760 0x7f9078132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a3bb0 msgr2=0x7f907809bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90780a3bb0 0x7f907809bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 monclient: found mon.noname-a 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.210+0000 7f9077fff640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90781349d0 con 0x7f90780a0750 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9077fff640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 msgr2=0x7f907809b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9077fff640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f906400c780 tx=0x7f906400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064005de0 con 0x7f90780a0750 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: dump: 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.224 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9064007070 con 0x7f90780a0750 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f907e4da640 5 monclient: authenticate success, global_id 204117 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f907e4da640 10 monclient: _renew_subs 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f907e4da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9078135ba0 con 0x7f90780a0750 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064007440 con 0x7f90780a0750 2026-02-17T12:01:25.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f9074ff9640 10 monclient: dump: 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.212+0000 7f90767fc640 4 set_mon_vals no callback set 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 10 monclient: _renew_subs 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9078136160 con 0x7f90780a0750 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 0x7f9078132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f907809cac0 con 0x7f90781327d0 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 0x7f9078132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient: get_auth_request con 0x7f90781327d0 auth_method 0 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f90640075e0 con 0x7f90780a0750 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 10 monclient(hunting): handle_auth_done global_id 194234 payload 824 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f90777fe640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9078073d20 con 0x7f90781327d0 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f9074ff9640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f904803dd10 0x7f90480401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.213+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(587..587 src has 323..587) ==== 4811+0+0 (secure 0 0 0) 0x7f90640523a0 con 0x7f90780a0750 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.214+0000 7f907ca50640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f904803dd10 0x7f90480401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.214+0000 7f907ca50640 10 monclient: get_auth_request con 0x7f904803dd10 auth_method 0 2026-02-17T12:01:25.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f90777fe640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 msgr2=0x7f9078132bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f90777fe640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 0x7f9078132bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9068039000 tx=0x7f90680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906803c040 con 0x7f90781327d0 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f9074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f9074ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.215+0000 7f9074ff9640 10 monclient: dump: 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9068037de0 con 0x7f90781327d0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 msgr2=0x7f9078132bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 0x7f9078132bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9068039000 tx=0x7f90680047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 msgr2=0x7f9078132bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.216+0000 7f9074ff9640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781327d0 0x7f9078132bb0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9068039000 tx=0x7f90680047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.217+0000 7f907ca50640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f904803dd10 0x7f90480401d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f90781357b0 tx=0x7f906c004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.218+0000 7f907e4da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f907e4da640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 0x7f90781dad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f907e4da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f907809dac0 con 0x7f90781330f0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 0x7f90781dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient: get_auth_request con 0x7f90781330f0 auth_method 0 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 10 monclient(hunting): handle_auth_done global_id 194237 payload 824 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.219+0000 7f90777fe640 1 -- 10.20.193.51:0/1277256162 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90781342b0 con 0x7f90781330f0 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f90777fe640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 msgr2=0x7f90781dad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f90777fe640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 0x7f90781dad50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9068002410 tx=0x7f9068008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068052070 con 0x7f90781330f0 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 10 monclient: dump: 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f906804e3f0 con 0x7f90781330f0 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 msgr2=0x7f90781dad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 0x7f90781dad50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9068002410 tx=0x7f9068008030 comp rx=0 tx=0).stop 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 msgr2=0x7f90781dad50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f9074ff9640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90781330f0 0x7f90781dad50 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9068002410 tx=0x7f9068008030 comp rx=0 tx=0).stop 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 74159, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.234 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.235 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:25.236 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.237 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:25.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f904803dd10 msgr2=0x7f90480401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f904803dd10 0x7f90480401d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f90781357b0 tx=0x7f906c004200 comp rx=0 tx=0).stop 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 10 monclient: shutdown 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 msgr2=0x7f907809b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f906400c780 tx=0x7f906400cc50 comp rx=0 tx=0).stop 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907ca50640 1 -- 10.20.193.51:0/1277256162 reap_dead start 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 shutdown_connections 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 --2- 10.20.193.51:0/1277256162 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90780a0750 0x7f907809b740 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 >> 10.20.193.51:0/1277256162 conn(0x7f90780a30c0 msgr2=0x7f9078072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 shutdown_connections 2026-02-17T12:01:25.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.221+0000 7f907e4da640 1 -- 10.20.193.51:0/1277256162 wait complete. 2026-02-17T12:01:25.239 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:25.239 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:01:25.239 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: get_monmap_and_config 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: monmap: 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:25.305013+0000 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:25.305013+0000 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:25.306 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:25.307 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 Processor -- start 2026-02-17T12:01:25.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 -- start start 2026-02-17T12:01:25.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: init 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f49c40a3bb0 0x7f49c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-a con 0x7f49c40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f49c40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49c413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c406e140 con 0x7f49c413b760 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c409f910 con 0x7f49c40a0750 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f49c409ccd0 con 0x7f49c40a3bb0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c983f640 10 monclient(hunting): authenticate will time out at 1572.923783s 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f49c40a3bb0 0x7f49c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f49c40a3bb0 0x7f49c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44472/0 (socket says 10.20.193.51:44472) 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 1 -- 10.20.193.51:0/3407411466 learned_addr learned my addr 10.20.193.51:0/3407411466 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 10 monclient(hunting): get_auth_request con 0x7f49c40a3bb0 auth_method 0 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.304+0000 7f49c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.306+0000 7f49c37fe640 1 -- 10.20.193.51:0/3407411466 >> v1:10.20.193.51:6789/0 conn(0x7f49c413b760 legacy=0x7f49c413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_done global_id 204120 payload 274 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 1 -- 10.20.193.51:0/3407411466 >> v1:10.20.193.142:6789/0 conn(0x7f49c40a0750 legacy=0x7f49c409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 1 -- 10.20.193.51:0/3407411466 >> v1:10.20.193.51:6789/0 conn(0x7f49c413b760 legacy=0x7f49c413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:25.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.307+0000 7f49c2ffd640 1 -- 10.20.193.51:0/3407411466 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c409eec0 con 0x7f49c40a3bb0 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c2ffd640 1 -- 10.20.193.51:0/3407411466 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a3bb0 msgr2=0x7f49c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c2ffd640 1 --2- 10.20.193.51:0/3407411466 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a3bb0 0x7f49c409dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49b80099f0 tx=0x7f49b802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3f2e5c130030b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 1 -- 10.20.193.51:0/3407411466 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b803c070 con 0x7f49c40a3bb0 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: dump: 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.312 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 1 -- 10.20.193.51:0/3407411466 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b8037440 con 0x7f49c40a3bb0 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c983f640 5 monclient: authenticate success, global_id 204120 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c983f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 1 -- 10.20.193.51:0/3407411466 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8037810 con 0x7f49c40a3bb0 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c983f640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c983f640 4 set_mon_vals no callback set 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.309+0000 7f49c1ffb640 10 monclient: dump: 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.313 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: shutdown 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- 10.20.193.51:0/3407411466 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a3bb0 msgr2=0x7f49c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 --2- 10.20.193.51:0/3407411466 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a3bb0 0x7f49c409dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49b80099f0 tx=0x7f49b802eed0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- 10.20.193.51:0/3407411466 shutdown_connections 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 --2- 10.20.193.51:0/3407411466 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a3bb0 0x7f49c409dac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- 10.20.193.51:0/3407411466 >> 10.20.193.51:0/3407411466 conn(0x7f49c40a30c0 msgr2=0x7f49c40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- 10.20.193.51:0/3407411466 shutdown_connections 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- 10.20.193.51:0/3407411466 wait complete. 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: monmap: 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:25.314 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 Processor -- start 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 -- start start 2026-02-17T12:01:25.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: init 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-a con 0x7f49c40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c40a3bb0 0x7f49c4099c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.310+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-b con 0x7f49c40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49c413b760 0x7f49c41c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): picked mon.noname-c con 0x7f49c413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40a04b0 con 0x7f49c40a0750 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49c409c850 con 0x7f49c40a3bb0 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f49c409e710 con 0x7f49c413b760 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c983f640 10 monclient(hunting): authenticate will time out at 1572.930015s 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44488/0 (socket says 10.20.193.51:44488) 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 -- 10.20.193.51:0/2328620844 learned_addr learned my addr 10.20.193.51:0/2328620844 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): get_auth_request con 0x7f49c40a0750 auth_method 0 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49c413b760 0x7f49c41c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): get_auth_request con 0x7f49c413b760 auth_method 0 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient(hunting): handle_auth_done global_id 204126 payload 824 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49c413b760 msgr2=0x7f49c41c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f49c413b760 0x7f49c41c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c40a3bb0 msgr2=0x7f49c4099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c40a3bb0 0x7f49c4099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.311+0000 7f49c2ffd640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4094430 con 0x7f49c40a0750 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c2ffd640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 msgr2=0x7f49c41ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c2ffd640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49b80099f0 tx=0x7f49b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8046020 con 0x7f49c40a0750 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: dump: 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80428f0 con 0x7f49c40a0750 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 5 monclient: authenticate success, global_id 204126 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b803c040 con 0x7f49c40a0750 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c17fa640 4 set_mon_vals no callback set 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f499bfff640 10 monclient: dump: 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 10 monclient: _renew_subs 2026-02-17T12:01:25.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c4094710 con 0x7f49c40a0750 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 10 monclient: _renew_subs 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.313+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c409d7b0 con 0x7f49c40a0750 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c983f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c983f640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 0x7f49c41c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40a2590 con 0x7f49c409a1c0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f49b803f030 con 0x7f49c40a0750 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f499bfff640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f499403dd60 0x7f4994040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 0x7f49c41c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient: get_auth_request con 0x7f49c409a1c0 auth_method 0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(587..587 src has 323..587) ==== 4811+0+0 (secure 0 0 0) 0x7f49b8077c50 con 0x7f49c40a0750 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c37fe640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f499403dd60 0x7f4994040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c37fe640 10 monclient: get_auth_request con 0x7f499403dd60 auth_method 0 2026-02-17T12:01:25.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 10 monclient(hunting): handle_auth_done global_id 184273 payload 824 2026-02-17T12:01:25.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.314+0000 7f49c27fc640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49c409dac0 con 0x7f49c409a1c0 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.316+0000 7f49c37fe640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f499403dd60 0x7f4994040220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f49b4003a40 tx=0x7f49b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.316+0000 7f49c27fc640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 msgr2=0x7f49c41c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.316+0000 7f49c27fc640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 0x7f49c41c9db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac011a80 con 0x7f49c409a1c0 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 10 monclient: dump: 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.324 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f49ac017070 con 0x7f49c409a1c0 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 msgr2=0x7f49c41c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 0x7f49c41c9db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac00c800 comp rx=0 tx=0).stop 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 msgr2=0x7f49c41c9db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.317+0000 7f499bfff640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c409a1c0 0x7f49c41c9db0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac00c800 comp rx=0 tx=0).stop 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c983f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c983f640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 0x7f49c41d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c983f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49c41ca6d0 con 0x7f49c41ca2f0 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c27fc640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 0x7f49c41d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c27fc640 10 monclient: get_auth_request con 0x7f49c41ca2f0 auth_method 0 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.320+0000 7f49c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.321+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.321+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.321+0000 7f49c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.321+0000 7f49c27fc640 10 monclient(hunting): handle_auth_done global_id 184276 payload 824 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.321+0000 7f49c27fc640 1 -- 10.20.193.51:0/2328620844 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49c4092420 con 0x7f49c41ca2f0 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c27fc640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 msgr2=0x7f49c41d80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c27fc640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 0x7f49c41d80e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac01caf0 con 0x7f49c41ca2f0 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 10 monclient: dump: 2026-02-17T12:01:25.326 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f49ac01caf0 con 0x7f49c41ca2f0 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 msgr2=0x7f49c41d80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 0x7f49c41d80e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac003860 comp rx=0 tx=0).stop 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 msgr2=0x7f49c41d80e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f499bfff640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f49c41ca2f0 0x7f49c41d80e0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f49c406f590 tx=0x7f49ac003860 comp rx=0 tx=0).stop 2026-02-17T12:01:25.327 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 117710, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.328 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.329 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:25.330 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.331 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:25.332 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:25.333 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.334 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:25.335 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:25.336 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:25.336 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:25.336 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:25.336 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f499403dd60 msgr2=0x7f4994040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f499403dd60 0x7f4994040220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f49b4003a40 tx=0x7f49b4009040 comp rx=0 tx=0).stop 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 10 monclient: shutdown 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 msgr2=0x7f49c41ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49b80099f0 tx=0x7f49b80047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c37fe640 1 -- 10.20.193.51:0/2328620844 reap_dead start 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 shutdown_connections 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 --2- 10.20.193.51:0/2328620844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f49c40a0750 0x7f49c41ccd70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 >> 10.20.193.51:0/2328620844 conn(0x7f49c40a30c0 msgr2=0x7f49c413acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 shutdown_connections 2026-02-17T12:01:25.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.323+0000 7f49c983f640 1 -- 10.20.193.51:0/2328620844 wait complete. 2026-02-17T12:01:25.337 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:25.337 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:01:25.338 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 10 monclient: get_monmap_and_config 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 10 monclient: monmap: 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:25.404168+0000 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:25.404168+0000 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.405 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:25.406 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:25.406 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:25.406 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:25.406 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:25.406 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 1 Processor -- start 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 1 -- start start 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.403+0000 7f83580da640 10 monclient: init 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8350138600 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 0x7f835013d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): picked mon.noname-b con 0x7f83500a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 0x7f835013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): picked mon.noname-c con 0x7f835013d8a0 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83500a1df0 con 0x7f8350138600 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f83500a6830 con 0x7f835013d8a0 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f83500a2c00 con 0x7f83500a35a0 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f83580da640 10 monclient(hunting): authenticate will time out at 1573.023145s 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f8355e4f640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8350138600 0x7f83501389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46274/0 (socket says 10.20.193.51:46274) 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f8355e4f640 1 -- 10.20.193.51:0/661368060 learned_addr learned my addr 10.20.193.51:0/661368060 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 --2- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 0x7f835013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): get_auth_request con 0x7f83500a35a0 auth_method 0 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient(hunting): handle_auth_done global_id 194243 payload 274 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 -- 10.20.193.51:0/661368060 >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 msgr2=0x7f835013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f8356650640 1 --2- 10.20.193.51:0/661368060 >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 0x7f835013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 --2- 10.20.193.51:0/661368060 >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 0x7f835013fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 -- 10.20.193.51:0/661368060 >> v1:10.20.193.51:6789/0 conn(0x7f8350138600 legacy=0x7f83501389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 monclient: found mon.noname-b 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f835564e640 1 -- 10.20.193.51:0/661368060 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83500a65b0 con 0x7f83500a35a0 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f8356650640 10 monclient: get_auth_request con 0x7f835013d8a0 auth_method 0 2026-02-17T12:01:25.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.404+0000 7f8356650640 1 --2- 10.20.193.51:0/661368060 >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 0x7f835013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.406+0000 7f835564e640 1 -- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 msgr2=0x7f835013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.406+0000 7f835564e640 1 --2- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 0x7f835013d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83440098a0 tx=0x7f834402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a94800a04724c914 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 1 -- 10.20.193.51:0/661368060 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834403c070 con 0x7f83500a35a0 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: dump: 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.414 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 1 -- 10.20.193.51:0/661368060 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834402fce0 con 0x7f83500a35a0 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 1 -- 10.20.193.51:0/661368060 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344037660 con 0x7f83500a35a0 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 5 monclient: authenticate success, global_id 194243 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 4 set_mon_vals no callback set 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f8354e4d640 10 monclient: dump: 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.415 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 10 monclient: shutdown 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 -- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 msgr2=0x7f835013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 --2- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 0x7f835013d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83440098a0 tx=0x7f834402ed80 comp rx=0 tx=0).stop 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 -- 10.20.193.51:0/661368060 shutdown_connections 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 --2- 10.20.193.51:0/661368060 >> v2:10.20.193.142:3300/0 conn(0x7f835013d8a0 0x7f835013fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 --2- 10.20.193.51:0/661368060 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f83500a35a0 0x7f835013d360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 -- 10.20.193.51:0/661368060 >> 10.20.193.51:0/661368060 conn(0x7f83500a7460 msgr2=0x7f83500a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 -- 10.20.193.51:0/661368060 shutdown_connections 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 1 -- 10.20.193.51:0/661368060 wait complete. 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 10 monclient: build_initial_monmap 2026-02-17T12:01:25.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.407+0000 7f83580da640 10 monclient: monmap: 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 Processor -- start 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 -- start start 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient: init 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83500a35a0 0x7f83501cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): picked mon.noname-b con 0x7f83500a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 0x7f8350137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): picked mon.noname-a con 0x7f8350138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 0x7f8350071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): picked mon.noname-c con 0x7f835013d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f83500a15f0 con 0x7f8350138600 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f83500a25b0 con 0x7f83500a35a0 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f83500a1770 con 0x7f835013d8a0 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f83580da640 10 monclient(hunting): authenticate will time out at 1573.027539s 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 0x7f8350137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 0x7f8350071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 0x7f8350137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44500/0 (socket says 10.20.193.51:44500) 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): get_auth_request con 0x7f835013d8a0 auth_method 0 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 1 -- 10.20.193.51:0/3863297538 learned_addr learned my addr 10.20.193.51:0/3863297538 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): get_auth_request con 0x7f8350138600 auth_method 0 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f835564e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient(hunting): handle_auth_done global_id 194246 payload 824 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 -- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83500a35a0 msgr2=0x7f83501cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83500a35a0 0x7f83501cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 -- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 msgr2=0x7f8350137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 0x7f8350137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient: _finish_hunting 0 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 monclient: found mon.noname-c 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:25.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.408+0000 7f8356650640 1 -- 10.20.193.51:0/3863297538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83501d0180 con 0x7f835013d8a0 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.410+0000 7f8356650640 1 -- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 msgr2=0x7f8350071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.410+0000 7f8356650640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 0x7f8350071d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f834c007fd0 tx=0x7f834c00a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.410+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c003c90 con 0x7f835013d8a0 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.410+0000 7f833e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: dump: 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c003e50 con 0x7f835013d8a0 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 5 monclient: authenticate success, global_id 194246 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00da90 con 0x7f835013d8a0 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833ffff640 4 set_mon_vals no callback set 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 10 monclient: dump: 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:25.421 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _renew_subs 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83500741c0 con 0x7f835013d8a0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _renew_subs 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83500a88d0 con 0x7f835013d8a0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f834c00dcb0 con 0x7f835013d8a0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835013d250 con 0x7f835013d8a0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 0x7f83200401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.411+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(587..587 src has 323..587) ==== 4811+0+0 (secure 0 0 0) 0x7f834c052f50 con 0x7f835013d8a0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.412+0000 7f8355e4f640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 0x7f83200401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:25.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.412+0000 7f8355e4f640 10 monclient: get_auth_request con 0x7f832003dd10 auth_method 0 2026-02-17T12:01:25.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.414+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f834c013340 con 0x7f835013d8a0 2026-02-17T12:01:25.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.414+0000 7f833e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:25.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.414+0000 7f833e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:25.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.414+0000 7f8355e4f640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 0x7f83200401d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8340007fd0 tx=0x7f8340007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:25.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.533+0000 7f83580da640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:01:25.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.533+0000 7f83580da640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:01:25.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.533+0000 7f83580da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:25.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.533+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f83501389e0 con 0x7f835013d8a0 2026-02-17T12:01:25.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.534+0000 7f833e7fc640 1 -- 10.20.193.51:0/3863297538 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f834c051930 con 0x7f835013d8a0 2026-02-17T12:01:25.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.534+0000 7f833e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:01:25.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.534+0000 7f833e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=11,logm=44} crc {auth=1760257932,config=692619927,health=2114909644,kv=393982321,logm=894770733}) 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=29,config=2,health=11,kv=10,logm=48} crc {auth=4083409098,config=692619927,health=2485907539,kv=2264027724,logm=3947082754}) 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=11,logm=44} crc {auth=1760257932,config=692619927,health=2114909644,kv=393982321,logm=894770733}) 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=11,kv=12,logm=48} crc {auth=2569692897,config=692619927,health=935866140,kv=643764953,logm=3994510520}) 2026-02-17T12:01:25.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570381327}) 2026-02-17T12:01:25.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3969805802}) 2026-02-17T12:01:25.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570381327}) 2026-02-17T12:01:25.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.534+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3381200397}) 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 msgr2=0x7f83200401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 0x7f83200401d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8340007fd0 tx=0x7f8340007ba0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 10 monclient: shutdown 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 msgr2=0x7f8350071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:25.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 0x7f8350071d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f834c007fd0 tx=0x7f834c00a710 comp rx=0 tx=0).stop 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 shutdown_connections 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f832003dd10 0x7f83200401d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f835013d8a0 0x7f8350071d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8350138600 0x7f8350137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 --2- 10.20.193.51:0/3863297538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f83500a35a0 0x7f83501cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 >> 10.20.193.51:0/3863297538 conn(0x7f83500a7460 msgr2=0x7f835013dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 shutdown_connections 2026-02-17T12:01:25.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:25.535+0000 7f83580da640 1 -- 10.20.193.51:0/3863297538 wait complete. 2026-02-17T12:01:25.546 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.546 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801592806}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=754410574}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801592806}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=138513740}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028957223}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4051389558}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028957223}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=247288506}) 2026-02-17T12:01:25.547 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275236227}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1652779253}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275236227}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.536+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272536346}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=667043297}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2463957418}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=667043297}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=342596582}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4064804556}) 2026-02-17T12:01:25.548 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2230810454}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4064804556}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457938285}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151489626}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1405705976}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151489626}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.537+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=249468646}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830710364}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2155914695}) 2026-02-17T12:01:25.549 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830710364}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=382699745}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1077298104}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=662692633}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1077298104}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.538+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1059007060}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=374449730}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=546447579}) 2026-02-17T12:01:25.550 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=374449730}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517206121}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2438124839}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=978869230}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2438124839}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3217931672}) 2026-02-17T12:01:25.551 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371081132}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=130824062}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371081132}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.539+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1024472033}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432841676}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3025644896}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432841676}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=719159779}) 2026-02-17T12:01:25.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3149861255}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2436672486}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3149861255}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.540+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2596483078}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357892316}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2384034274}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357892316}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=792209057}) 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3696973605}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2704813562}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3696973605}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1942375751}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2909324359}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4230739179}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2909324359}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.541+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2257083790}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=795669329}) 2026-02-17T12:01:25.554 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1537283368}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=795669329}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=856390076}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881635311}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2376037437}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881635311}) 2026-02-17T12:01:25.555 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.542+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3749551809}) 2026-02-17T12:01:25.556 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3520085637}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268904128}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3520085637}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2657497363}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3317349448}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3375197383}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3317349448}) 2026-02-17T12:01:25.566 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2731700819}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506348550}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1144927150}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506348550}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.543+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2399814587}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1819168978}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1892042343}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1819168978}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=355729412}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3803338611}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1940469849}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3803338611}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2687716854}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641812004}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.544+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=756329845}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641812004}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2876807113}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359864364}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3231119877}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359864364}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2932015094}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163000844}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1080631887}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163000844}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.545+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2366485111}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=101208536}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613572002}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=101208536}) 2026-02-17T12:01:25.567 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3090704952}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857814815}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2452725322}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857814815}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=153644086}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195029813}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=948321681}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195029813}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.546+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=238917171}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=916602624}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088555742}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=916602624}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2527866173}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883586348}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3638277882}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883586348}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1859418573}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2148029208}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=978775066}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2148029208}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.547+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3938624497}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2237845663}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=335566678}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2237845663}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3769846282}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=854062840}) 2026-02-17T12:01:25.568 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3078281997}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=854062840}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1972614039}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1267100399}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1905071748}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1267100399}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.548+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739792180}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2701684459}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2279040091}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2701684459}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1413640071}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789717677}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3226077075}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789717677}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2170973945}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117266072}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3308949175}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117266072}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.549+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3266152692}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=104974371}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3349986966}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=104974371}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2967097962}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1643781397}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2010488567}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1643781397}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2819485853}) 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.569 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244583434}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1928886470}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244583434}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1864463954}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3406983833}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2285377232}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3406983833}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=800278939}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280816764}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4157822288}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280816764}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2525597461}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1992918842}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1902822971}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1992918842}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.551+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2537927290}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349594693}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4262045632}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349594693}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=435757885}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371541029}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=525180578}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371541029}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1161940732}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1842316189}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1669913201}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1842316189}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.552+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2191554322}) 2026-02-17T12:01:25.570 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1037531687}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=442146251}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1037531687}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2877005736}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=626914091}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3408430209}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=626914091}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4058024843}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2024034407}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2460416228}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2024034407}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2048258026}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105985816}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1533911194}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105985816}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.553+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=936472325}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1124504043}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3017788683}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1124504043}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3768085052}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057955740}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=806215353}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057955740}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1625567602}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1883246935}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=328314200}) 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.571 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1883246935}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=162195395}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1956573715}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1189901211}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1956573715}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2264413177}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251283966}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1468770660}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251283966}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3750078063}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294223384}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4151231606}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294223384}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.555+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=19927212}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4202399176}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1389088847}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4202399176}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3986825213}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1121531547}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2673786688}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1121531547}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=935219969}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=941131075}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2100162726}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=941131075}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.556+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4131692373}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3503112833}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2822563799}) 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.572 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3503112833}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2091210273}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=19} crc {logm=1159344535,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1355206549,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3459302533,osd_snap=4256600049}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18} crc {logm=4237895846,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=754767822,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3459302533,osd_snap=1388337451}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=19} crc {logm=1159344535,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1355206549,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3459302533,osd_snap=4256600049}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.557+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18} crc {logm=1751915901,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=754767822,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3459302533,osd_snap=1388337451}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=79,osdmap=21} crc {osd_snap=1103105305,osdmap=2331059265}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=80,osdmap=20} crc {osd_snap=2030891515,osdmap=220202427}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=79,osdmap=21} crc {osd_snap=1103105305,osdmap=2331059265}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=84,osdmap=16} crc {osd_snap=1727875604,osdmap=3510070725}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1345295063}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4148803923}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1345295063}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3524849394}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1212714606}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2752878759}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1212714606}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.558+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=260326909}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=262242983}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2222029787}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=262242983}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.559+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3994134034}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=74} crc {osdmap=2746515566}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=72} crc {osdmap=2047023478}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=74} crc {osdmap=2746515566}) 2026-02-17T12:01:25.573 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:01:25.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=71} crc {osdmap=2194592804}) 2026-02-17T12:01:25.707 INFO:tasks.rados.rados.0.trial142.stdout:2591: done (2 left) 2026-02-17T12:01:25.707 INFO:tasks.rados.rados.0.trial142.stdout:2592: delete oid 18 current snap is 280 2026-02-17T12:01:25.708 INFO:tasks.rados.rados.0.trial142.stdout:2588: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:25.891 INFO:tasks.rados.rados.0.trial142.stdout:2590: expect (ObjNum 858 snap 270 seq_num 858) 2026-02-17T12:01:25.948 INFO:tasks.rados.rados.0.trial142.stdout:2588: done (2 left) 2026-02-17T12:01:25.948 INFO:tasks.rados.rados.0.trial142.stdout:2590: done (1 left) 2026-02-17T12:01:25.948 INFO:tasks.rados.rados.0.trial142.stdout:2592: done (0 left) 2026-02-17T12:01:25.948 INFO:tasks.rados.rados.0.trial142.stdout:2593: snap_create 2026-02-17T12:01:26.557 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:01:26.557 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.625+0000 7f938d3e6640 10 monclient: get_monmap_and_config 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.625+0000 7f938d3e6640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.625+0000 7f938d3e6640 10 monclient: monmap: 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:26.626828+0000 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:26.626828+0000 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:26.628 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:26.629 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 Processor -- start 2026-02-17T12:01:26.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 -- start start 2026-02-17T12:01:26.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient: init 2026-02-17T12:01:26.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 0x7f938809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-a con 0x7f93880a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f938809dac0 0x7f938809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-c con 0x7f938809dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f938809ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938806e140 con 0x7f938809ff40 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f938809aed0 con 0x7f93880a3bb0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f938809caa0 con 0x7f938809dac0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f938d3e6640 10 monclient(hunting): authenticate will time out at 1574.245618s 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 0x7f938809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 0x7f938809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44512/0 (socket says 10.20.193.51:44512) 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 1 -- 10.20.193.51:0/1975572714 learned_addr learned my addr 10.20.193.51:0/1975572714 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): get_auth_request con 0x7f93880a3bb0 auth_method 0 2026-02-17T12:01:26.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f9386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 1 --2- 10.20.193.51:0/1975572714 >> v2:10.20.193.142:3300/0 conn(0x7f938809dac0 0x7f938809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): get_auth_request con 0x7f938809dac0 auth_method 0 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.626+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 10 monclient(hunting): handle_auth_done global_id 184279 payload 274 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 1 -- 10.20.193.51:0/1975572714 >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 msgr2=0x7f938809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 1 --2- 10.20.193.51:0/1975572714 >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 0x7f938809f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 1 -- 10.20.193.51:0/1975572714 >> v1:10.20.193.51:6789/0 conn(0x7f938809ff40 legacy=0x7f938813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 1 monclient: found mon.noname-c 2026-02-17T12:01:26.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:01:26.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.627+0000 7f93867fc640 1 -- 10.20.193.51:0/1975572714 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938809ce60 con 0x7f938809dac0 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f93867fc640 1 -- 10.20.193.51:0/1975572714 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 msgr2=0x7f938809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f93867fc640 1 --2- 10.20.193.51:0/1975572714 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f938809fa00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f938809cc20 tx=0x7f937002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7478273a26cfc47a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 1 -- 10.20.193.51:0/1975572714 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937003c070 con 0x7f938809dac0 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: dump: 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.637 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 1 -- 10.20.193.51:0/1975572714 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937002fbd0 con 0x7f938809dac0 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f938d3e6640 5 monclient: authenticate success, global_id 184279 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 1 -- 10.20.193.51:0/1975572714 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370037440 con 0x7f938809dac0 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f938d3e6640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f938d3e6640 4 set_mon_vals no callback set 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.629+0000 7f9385ffb640 10 monclient: dump: 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 10 monclient: shutdown 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- 10.20.193.51:0/1975572714 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 msgr2=0x7f938809fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 --2- 10.20.193.51:0/1975572714 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f938809fa00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f938809cc20 tx=0x7f937002ed50 comp rx=0 tx=0).stop 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- 10.20.193.51:0/1975572714 shutdown_connections 2026-02-17T12:01:26.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 --2- 10.20.193.51:0/1975572714 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f938809fa00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 --2- 10.20.193.51:0/1975572714 >> v2:10.20.193.51:3300/0 conn(0x7f93880a3bb0 0x7f938809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- 10.20.193.51:0/1975572714 >> 10.20.193.51:0/1975572714 conn(0x7f93880a30c0 msgr2=0x7f93880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- 10.20.193.51:0/1975572714 shutdown_connections 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- 10.20.193.51:0/1975572714 wait complete. 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 10 monclient: monmap: 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 Processor -- start 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 1 -- start start 2026-02-17T12:01:26.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.630+0000 7f938d3e6640 10 monclient: init 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f9388094ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-b con 0x7f938809dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f938809ff40 0x7f93880950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-c con 0x7f938809ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): picked mon.noname-a con 0x7f93880a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f93880a0370 con 0x7f93880a3bb0 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f938809a880 con 0x7f938809dac0 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93880a04f0 con 0x7f938809ff40 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f938d3e6640 10 monclient(hunting): authenticate will time out at 1574.250198s 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f938809ff40 0x7f93880950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44516/0 (socket says 10.20.193.51:44516) 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 -- 10.20.193.51:0/3849254864 learned_addr learned my addr 10.20.193.51:0/3849254864 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): get_auth_request con 0x7f93880a3bb0 auth_method 0 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): get_auth_request con 0x7f938809ff40 auth_method 0 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f9386ffd640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f9388094ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f9386ffd640 10 monclient(hunting): get_auth_request con 0x7f938809dac0 auth_method 0 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f9386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f9386ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f9386ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient(hunting): handle_auth_done global_id 204135 payload 824 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 -- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f938809ff40 msgr2=0x7f93880950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f938809ff40 0x7f93880950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 -- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 msgr2=0x7f9388094ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f9388094ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.631+0000 7f93877fe640 1 -- 10.20.193.51:0/3849254864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388098850 con 0x7f93880a3bb0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93877fe640 1 -- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 msgr2=0x7f9388095620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93877fe640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f937800cb60 tx=0x7f937800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378016020 con 0x7f93880a3bb0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:26.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: dump: 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 5 monclient: authenticate success, global_id 204135 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 10 monclient: _renew_subs 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9388097120 con 0x7f93880a3bb0 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378012420 con 0x7f93880a3bb0 2026-02-17T12:01:26.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378012810 con 0x7f93880a3bb0 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93677fe640 10 monclient: dump: 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f93857fa640 4 set_mon_vals no callback set 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 10 monclient: _renew_subs 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.633+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93880a1230 con 0x7f93880a3bb0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f93780129f0 con 0x7f93880a3bb0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f938d3e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f938d3e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f938d3e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938809fc60 con 0x7f93880a3bb0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f93677fe640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 0x7f93540401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(588..588 src has 323..588) ==== 4827+0+0 (secure 0 0 0) 0x7f9378052ff0 con 0x7f93880a3bb0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f9386ffd640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 0x7f93540401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.634+0000 7f9386ffd640 10 monclient: get_auth_request con 0x7f935403dd10 auth_method 0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.637+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9378020020 con 0x7f93880a3bb0 2026-02-17T12:01:26.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.637+0000 7f93677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.637+0000 7f93677fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:26.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.637+0000 7f9386ffd640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 0x7f93540401d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f938d3e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f938d3e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f938d3e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f938809e340 con 0x7f93880a3bb0 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f93677fe640 1 -- 10.20.193.51:0/3849254864 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f9378012d10 con 0x7f93880a3bb0 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f93677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.751+0000 7f93677fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 msgr2=0x7f93540401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 0x7f93540401d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).stop 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 10 monclient: shutdown 2026-02-17T12:01:26.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 msgr2=0x7f9388095620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f937800cb60 tx=0x7f937800a430 comp rx=0 tx=0).stop 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 shutdown_connections 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f935403dd10 0x7f93540401d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93880a3bb0 0x7f9388095620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f938809ff40 0x7f93880950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 --2- 10.20.193.51:0/3849254864 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f938809dac0 0x7f9388094ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 >> 10.20.193.51:0/3849254864 conn(0x7f93880a30c0 msgr2=0x7f9388073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 shutdown_connections 2026-02-17T12:01:26.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.752+0000 7f938d3e6640 1 -- 10.20.193.51:0/3849254864 wait complete. 2026-02-17T12:01:26.761 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:01:26.762 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:01:26.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:01:26.762 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:01:26.763 INFO:tasks.rados.rados.0.trial142.stdout:2593: done (0 left) 2026-02-17T12:01:26.763 INFO:tasks.rados.rados.0.trial142.stdout:2594: write (excl) oid 5 current snap is 281 2026-02-17T12:01:26.763 INFO:tasks.rados.rados.0.trial142.stdout:2594: seq_num 886 ranges {491002=567562,1663399=520306,2814301=76701} 2026-02-17T12:01:26.766 INFO:tasks.rados.rados.0.trial142.stdout:2594: writing trial14245205-5 from 491002 to 1058564 tid 1 2026-02-17T12:01:26.770 INFO:tasks.rados.rados.0.trial142.stdout:2594: writing trial14245205-5 from 1663399 to 2183705 tid 2 2026-02-17T12:01:26.773 INFO:tasks.rados.rados.0.trial142.stdout:2594: writing trial14245205-5 from 2814301 to 2891002 tid 3 2026-02-17T12:01:26.773 INFO:tasks.rados.rados.0.trial142.stdout:2595: write oid 12 current snap is 281 2026-02-17T12:01:26.773 INFO:tasks.rados.rados.0.trial142.stdout:2594: finishing write tid 1 to trial14245205-5 2026-02-17T12:01:26.773 INFO:tasks.rados.rados.0.trial142.stdout:2594: finishing write tid 2 to trial14245205-5 2026-02-17T12:01:26.773 INFO:tasks.rados.rados.0.trial142.stdout:2595: seq_num 887 ranges {507809=642811,1721881=663964} 2026-02-17T12:01:26.777 INFO:tasks.rados.rados.0.trial142.stdout:2595: writing trial14245205-12 from 507809 to 1150620 tid 1 2026-02-17T12:01:26.782 INFO:tasks.rados.rados.0.trial142.stdout:2595: writing trial14245205-12 from 1721881 to 2385845 tid 2 2026-02-17T12:01:26.782 INFO:tasks.rados.rados.0.trial142.stdout:2596: write oid 45 current snap is 281 2026-02-17T12:01:26.782 INFO:tasks.rados.rados.0.trial142.stdout:2594: finishing write tid 3 to trial14245205-5 2026-02-17T12:01:26.782 INFO:tasks.rados.rados.0.trial142.stdout:2594: finishing write tid 4 to trial14245205-5 2026-02-17T12:01:26.782 INFO:tasks.rados.rados.0.trial142.stdout:2594: finishing write tid 5 to trial14245205-5 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2594: oid 5 updating version 0 to 1172 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2594: oid 5 version 1172 is already newer than 1169 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2594: oid 5 version 1172 is already newer than 1170 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2594: oid 5 version 1172 is already newer than 1171 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1172 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2594: left oid 5 (ObjNum 886 snap 281 seq_num 886) 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2595: finishing write tid 1 to trial14245205-12 2026-02-17T12:01:26.783 INFO:tasks.rados.rados.0.trial142.stdout:2596: seq_num 888 ranges {524616=718060,1664010=523975,2752794=171822} 2026-02-17T12:01:26.786 INFO:tasks.rados.rados.0.trial142.stdout:2596: writing trial14245205-45 from 524616 to 1242676 tid 1 2026-02-17T12:01:26.790 INFO:tasks.rados.rados.0.trial142.stdout:2596: writing trial14245205-45 from 1664010 to 2187985 tid 2 2026-02-17T12:01:26.793 INFO:tasks.rados.rados.0.trial142.stdout:2596: writing trial14245205-45 from 2752794 to 2924616 tid 3 2026-02-17T12:01:26.793 INFO:tasks.rados.rados.0.trial142.stdout:2594: done (2 left) 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2597: rollback oid 18 current snap is 281 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 273 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: finishing write tid 2 to trial14245205-12 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: finishing write tid 3 to trial14245205-12 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: finishing write tid 4 to trial14245205-12 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: oid 12 updating version 0 to 2284 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: oid 12 version 2284 is already newer than 2282 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: oid 12 version 2284 is already newer than 2283 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2284 (ObjNum 887 snap 281 seq_num 887) dirty exists 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: left oid 12 (ObjNum 887 snap 281 seq_num 887) 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2596: finishing write tid 1 to trial14245205-45 2026-02-17T12:01:26.794 INFO:tasks.rados.rados.0.trial142.stdout:2595: done (2 left) 2026-02-17T12:01:26.795 INFO:tasks.rados.rados.0.trial142.stdout:2598: snap_create 2026-02-17T12:01:26.795 INFO:tasks.rados.rados.0.trial142.stdout:2596: finishing write tid 2 to trial14245205-45 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2597: finishing rollback tid 1 to trial14245205-18 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: finishing write tid 3 to trial14245205-45 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2597: finishing rollback tid 2 to trial14245205-18 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2286 (ObjNum 852 snap 268 seq_num 852) dirty exists 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: finishing write tid 4 to trial14245205-45 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: finishing write tid 5 to trial14245205-45 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: oid 45 updating version 0 to 1980 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: oid 45 updating version 1980 to 1981 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: oid 45 updating version 1981 to 1982 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:2596: oid 45 version 1982 is already newer than 1979 2026-02-17T12:01:26.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 1982 (ObjNum 888 snap 281 seq_num 888) dirty exists 2026-02-17T12:01:26.797 INFO:tasks.rados.rados.0.trial142.stdout:2596: left oid 45 (ObjNum 888 snap 281 seq_num 888) 2026-02-17T12:01:26.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.829+0000 7fc63d632640 10 monclient: get_monmap_and_config 2026-02-17T12:01:26.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.829+0000 7fc63d632640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.829+0000 7fc63d632640 10 monclient: monmap: 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:26.830639+0000 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:26.830639+0000 2026-02-17T12:01:26.834 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 Processor -- start 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 -- start start 2026-02-17T12:01:26.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient: init 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc6380a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-b con 0x7fc6380a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc63813b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63806e140 con 0x7fc63813b760 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63809f910 con 0x7fc6380a3bb0 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc63809ccd0 con 0x7fc6380a0750 2026-02-17T12:01:26.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc63d632640 10 monclient(hunting): authenticate will time out at 1574.449455s 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6377fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc63813b760 0x7fc63813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46294/0 (socket says 10.20.193.51:46294) 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6377fe640 1 -- 10.20.193.51:0/19809408 learned_addr learned my addr 10.20.193.51:0/19809408 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): get_auth_request con 0x7fc6380a0750 auth_method 0 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient(hunting): handle_auth_done global_id 194252 payload 274 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 1 -- 10.20.193.51:0/19809408 >> v1:10.20.193.142:6789/0 conn(0x7fc6380a3bb0 legacy=0x7fc63809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 1 -- 10.20.193.51:0/19809408 >> v1:10.20.193.51:6789/0 conn(0x7fc63813b760 legacy=0x7fc63813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 1 monclient: found mon.noname-b 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:26.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.830+0000 7fc6367fc640 1 -- 10.20.193.51:0/19809408 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63809eec0 con 0x7fc6380a0750 2026-02-17T12:01:26.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc6367fc640 1 -- 10.20.193.51:0/19809408 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 msgr2=0x7fc63809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc6367fc640 1 --2- 10.20.193.51:0/19809408 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809e1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc63806c1c0 tx=0x7fc62002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d7a8ad69a8dbf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 1 -- 10.20.193.51:0/19809408 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62003c070 con 0x7fc6380a0750 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: dump: 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 1 -- 10.20.193.51:0/19809408 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62002fce0 con 0x7fc6380a0750 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 5 monclient: authenticate success, global_id 194252 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 1 -- 10.20.193.51:0/19809408 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620037660 con 0x7fc6380a0750 2026-02-17T12:01:26.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 4 set_mon_vals no callback set 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc635ffb640 10 monclient: dump: 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.849 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 10 monclient: shutdown 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 -- 10.20.193.51:0/19809408 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 msgr2=0x7fc63809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 --2- 10.20.193.51:0/19809408 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809e1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc63806c1c0 tx=0x7fc62002ed80 comp rx=0 tx=0).stop 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 -- 10.20.193.51:0/19809408 shutdown_connections 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 --2- 10.20.193.51:0/19809408 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809e1d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 -- 10.20.193.51:0/19809408 >> 10.20.193.51:0/19809408 conn(0x7fc6380a30c0 msgr2=0x7fc6380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 -- 10.20.193.51:0/19809408 shutdown_connections 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.833+0000 7fc63d632640 1 -- 10.20.193.51:0/19809408 wait complete. 2026-02-17T12:01:26.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient: monmap: 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 Processor -- start 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 -- start start 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient: init 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-c con 0x7fc6380a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6380a3bb0 0x7fc63809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-b con 0x7fc6380a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63813b760 0x7fc63809b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): picked mon.noname-a con 0x7fc63813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:26.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc6380a04b0 con 0x7fc63813b760 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc63809c850 con 0x7fc6380a3bb0 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc63809e710 con 0x7fc6380a0750 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc63d632640 10 monclient(hunting): authenticate will time out at 1574.453601s 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63813b760 0x7fc63809b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51610/0 (socket says 10.20.193.51:51610) 2026-02-17T12:01:26.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 -- 10.20.193.51:0/625913501 learned_addr learned my addr 10.20.193.51:0/625913501 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): get_auth_request con 0x7fc63813b760 auth_method 0 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): get_auth_request con 0x7fc6380a0750 auth_method 0 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6367fc640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6380a3bb0 0x7fc63809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6367fc640 10 monclient(hunting): get_auth_request con 0x7fc6380a3bb0 auth_method 0 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6367fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc6367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient(hunting): handle_auth_done global_id 194255 payload 824 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6380a3bb0 msgr2=0x7fc63809ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc6380a3bb0 0x7fc63809ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63813b760 msgr2=0x7fc63809b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63813b760 0x7fc63809b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 monclient: found mon.noname-c 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.834+0000 7fc636ffd640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63809d7b0 con 0x7fc6380a0750 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.836+0000 7fc636ffd640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 msgr2=0x7fc63809a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.836+0000 7fc636ffd640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c5d0 tx=0x7fc62c00caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c016020 con 0x7fc6380a0750 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: dump: 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.856 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c012a60 con 0x7fc6380a0750 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c012e50 con 0x7fc6380a0750 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6357fa640 4 set_mon_vals no callback set 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 10 monclient: dump: 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.858 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 5 monclient: authenticate success, global_id 194255 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 monclient: _renew_subs 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6380963e0 con 0x7fc6380a0750 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 monclient: _renew_subs 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc638095480 con 0x7fc6380a0750 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 0x7fc63808d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc638096b30 con 0x7fc63808d3f0 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 0x7fc63808d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient: get_auth_request con 0x7fc63808d3f0 auth_method 0 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 10 monclient(hunting): handle_auth_done global_id 204141 payload 824 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6367fc640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc63809dac0 con 0x7fc63808d3f0 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.837+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc62c01b400 con 0x7fc6380a0750 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.838+0000 7fc6177fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc60403deb0 0x7fc604040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.838+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7fc62c052a10 con 0x7fc6380a0750 2026-02-17T12:01:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.838+0000 7fc6377fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc60403deb0 0x7fc604040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.838+0000 7fc6377fe640 10 monclient: get_auth_request con 0x7fc60403deb0 auth_method 0 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6367fc640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 msgr2=0x7fc63808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6367fc640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 0x7fc63808d7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc620039000 tx=0x7fc6200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62003c040 con 0x7fc63808d3f0 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.839+0000 7fc6177fe640 10 monclient: dump: 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.861 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc620041440 con 0x7fc63808d3f0 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 msgr2=0x7fc63808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 0x7fc63808d7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc620039000 tx=0x7fc6200047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 msgr2=0x7fc63808d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6177fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808d3f0 0x7fc63808d7d0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc620039000 tx=0x7fc6200047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.840+0000 7fc6377fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc60403deb0 0x7fc604040370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6280055f0 tx=0x7fc628005580 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc63d632640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc63d632640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 0x7fc6381d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc63d632640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc63806f410 con 0x7fc63808dd10 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 0x7fc6381d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient: get_auth_request con 0x7fc63808dd10 auth_method 0 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 10 monclient(hunting): handle_auth_done global_id 204144 payload 824 2026-02-17T12:01:26.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.843+0000 7fc6367fc640 1 -- 10.20.193.51:0/625913501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6380008d0 con 0x7fc63808dd10 2026-02-17T12:01:26.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6367fc640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 msgr2=0x7fc6381d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6367fc640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 0x7fc6381d98b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc620002410 tx=0x7fc620008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62003c050 con 0x7fc63808dd10 2026-02-17T12:01:26.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 10 monclient: dump: 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7fc620055430 con 0x7fc63808dd10 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:26.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 msgr2=0x7fc6381d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 0x7fc6381d98b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc620002410 tx=0x7fc620008030 comp rx=0 tx=0).stop 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 msgr2=0x7fc6381d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.845+0000 7fc6177fe640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc63808dd10 0x7fc6381d98b0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc620002410 tx=0x7fc620008030 comp rx=0 tx=0).stop 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:01:26.866 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 27611, 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.867 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.868 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:26.869 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.870 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.871 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.872 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.873 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.874 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:26.875 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:26.876 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.876 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.876 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.876 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:26.876 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc60403deb0 msgr2=0x7fc604040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc60403deb0 0x7fc604040370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6280055f0 tx=0x7fc628005580 comp rx=0 tx=0).stop 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 10 monclient: shutdown 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 msgr2=0x7fc63809a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc6377fe640 1 -- 10.20.193.51:0/625913501 reap_dead start 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c5d0 tx=0x7fc62c00caa0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 shutdown_connections 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 --2- 10.20.193.51:0/625913501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc6380a0750 0x7fc63809a830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 >> 10.20.193.51:0/625913501 conn(0x7fc6380a30c0 msgr2=0x7fc638072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 shutdown_connections 2026-02-17T12:01:26.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.846+0000 7fc63d632640 1 -- 10.20.193.51:0/625913501 wait complete. 2026-02-17T12:01:26.878 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:26.878 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:01:26.878 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:01:26.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.943+0000 7f9bcbc1a640 10 monclient: get_monmap_and_config 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.943+0000 7f9bcbc1a640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.943+0000 7f9bcbc1a640 10 monclient: monmap: 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:26.944790+0000 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:26.944790+0000 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:26.946 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:26.947 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:26.947 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 Processor -- start 2026-02-17T12:01:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 -- start start 2026-02-17T12:01:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient: init 2026-02-17T12:01:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T12:01:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 0x7f9bc409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-a con 0x7f9bc40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-b con 0x7f9bc409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9bc409ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc406e140 con 0x7f9bc409ff40 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc409aed0 con 0x7f9bc40a3bb0 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc409caa0 con 0x7f9bc409dac0 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bcbc1a640 10 monclient(hunting): authenticate will time out at 1574.563607s 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 0x7f9bc409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 0x7f9bc409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44552/0 (socket says 10.20.193.51:44552) 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 1 -- 10.20.193.51:0/1854503861 learned_addr learned my addr 10.20.193.51:0/1854503861 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 10 monclient(hunting): get_auth_request con 0x7f9bc40a3bb0 auth_method 0 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc998f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): get_auth_request con 0x7f9bc409dac0 auth_method 0 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient(hunting): handle_auth_done global_id 194258 payload 274 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 -- 10.20.193.51:0/1854503861 >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 msgr2=0x7f9bc409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 --2- 10.20.193.51:0/1854503861 >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 0x7f9bc409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 -- 10.20.193.51:0/1854503861 >> v1:10.20.193.51:6789/0 conn(0x7f9bc409ff40 legacy=0x7f9bc413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 monclient: found mon.noname-b 2026-02-17T12:01:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.944+0000 7f9bc918e640 1 -- 10.20.193.51:0/1854503861 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc409ce60 con 0x7f9bc409dac0 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc918e640 1 -- 10.20.193.51:0/1854503861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 msgr2=0x7f9bc409fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc918e640 1 --2- 10.20.193.51:0/1854503861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc409fa00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80098a0 tx=0x7f9bb802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b015bab684d61e10 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 1 -- 10.20.193.51:0/1854503861 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb803c070 con 0x7f9bc409dac0 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: dump: 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.972 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 1 -- 10.20.193.51:0/1854503861 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb802fc00 con 0x7f9bc409dac0 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 5 monclient: authenticate success, global_id 194258 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 1 -- 10.20.193.51:0/1854503861 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8037440 con 0x7f9bc409dac0 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bc898d640 10 monclient: dump: 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.975 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 4 set_mon_vals no callback set 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 10 monclient: shutdown 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/1854503861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 msgr2=0x7f9bc409fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/1854503861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc409fa00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80098a0 tx=0x7f9bb802ed80 comp rx=0 tx=0).stop 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/1854503861 shutdown_connections 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/1854503861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc409fa00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/1854503861 >> v2:10.20.193.51:3300/0 conn(0x7f9bc40a3bb0 0x7f9bc409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/1854503861 >> 10.20.193.51:0/1854503861 conn(0x7f9bc40a30c0 msgr2=0x7f9bc40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/1854503861 shutdown_connections 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.947+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/1854503861 wait complete. 2026-02-17T12:01:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient: build_initial_monmap 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient: monmap: 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:26.978 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 Processor -- start 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 -- start start 2026-02-17T12:01:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient: init 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc406f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-c con 0x7f9bc409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 0x7f9bc406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-a con 0x7f9bc409ff40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bc40a3bb0 0x7f9bc4070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): picked mon.noname-b con 0x7f9bc40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:26.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc40a0370 con 0x7f9bc409ff40 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc409a880 con 0x7f9bc40a3bb0 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc40a04f0 con 0x7f9bc409dac0 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bcbc1a640 10 monclient(hunting): authenticate will time out at 1574.567794s 2026-02-17T12:01:26.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 0x7f9bc406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc406f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51634/0 (socket says 10.20.193.51:51634) 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 1 -- 10.20.193.51:0/292105352 learned_addr learned my addr 10.20.193.51:0/292105352 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): get_auth_request con 0x7f9bc409dac0 auth_method 0 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): get_auth_request con 0x7f9bc409ff40 auth_method 0 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bca190640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bc40a3bb0 0x7f9bc4070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 10 monclient(hunting): handle_auth_done global_id 204150 payload 824 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 msgr2=0x7f9bc406f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.948+0000 7f9bc918e640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc409dac0 0x7f9bc406f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bc40a3bb0 msgr2=0x7f9bc4070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bc40a3bb0 0x7f9bc4070100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 1 monclient: found mon.noname-a 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.949+0000 7f9bc918e640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc41b9910 con 0x7f9bc409ff40 2026-02-17T12:01:26.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc918e640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 msgr2=0x7f9bc406fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc918e640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 0x7f9bc406fbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406dd50 tx=0x7f9bb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb803c040 con 0x7f9bc409ff40 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: dump: 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 5 monclient: authenticate success, global_id 204150 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 monclient: _renew_subs 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc41ba090 con 0x7f9bc409ff40 2026-02-17T12:01:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8047070 con 0x7f9bc409ff40 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8040a40 con 0x7f9bc409ff40 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb3fff640 4 set_mon_vals no callback set 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 10 monclient: dump: 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 monclient: _renew_subs 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc41b8da0 con 0x7f9bc409ff40 2026-02-17T12:01:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 0x7f9bc40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc41b8fd0 con 0x7f9bc41b91a0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9bb803f030 con 0x7f9bc409ff40 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc998f640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 0x7f9bc40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc998f640 10 monclient: get_auth_request con 0x7f9bc41b91a0 auth_method 0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc998f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc998f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.951+0000 7f9bc998f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bc998f640 10 monclient(hunting): handle_auth_done global_id 194264 payload 824 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bc998f640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bc409f4c0 con 0x7f9bc41b91a0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bb27fc640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b9403dd10 0x7f9b940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f9bb80776a0 con 0x7f9bc409ff40 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bca190640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b9403dd10 0x7f9b940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.952+0000 7f9bca190640 10 monclient: get_auth_request con 0x7f9b9403dd10 auth_method 0 2026-02-17T12:01:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bc998f640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 msgr2=0x7f9bc40716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bc998f640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 0x7f9bc40716a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003970 tx=0x7f9bb4003e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4018070 con 0x7f9bc41b91a0 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 10 monclient: dump: 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9bb4010cc0 con 0x7f9bc41b91a0 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 msgr2=0x7f9bc40716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 0x7f9bc40716a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003970 tx=0x7f9bb4003e40 comp rx=0 tx=0).stop 2026-02-17T12:01:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 msgr2=0x7f9bc40716a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.954+0000 7f9bb27fc640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc41b91a0 0x7f9bc40716a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.955+0000 7f9bca190640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b9403dd10 0x7f9b940401d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4070fa0 tx=0x7f9bc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bcbc1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 0x7f9bc4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bcbc1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc4070820 con 0x7f9bc4071be0 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bc998f640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 0x7f9bc4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bc998f640 10 monclient: get_auth_request con 0x7f9bc4071be0 auth_method 0 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bc998f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bc998f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.957+0000 7f9bc998f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.958+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.958+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.958+0000 7f9bc998f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.958+0000 7f9bc998f640 10 monclient(hunting): handle_auth_done global_id 194267 payload 824 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.958+0000 7f9bc998f640 1 -- 10.20.193.51:0/292105352 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9bc409f090 con 0x7f9bc4071be0 2026-02-17T12:01:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bc998f640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 msgr2=0x7f9bc4071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bc998f640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 0x7f9bc4071ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003970 tx=0x7f9bb4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4014a50 con 0x7f9bc4071be0 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 10 monclient: dump: 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f9bb4014a50 con 0x7f9bc4071be0 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 msgr2=0x7f9bc4071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 0x7f9bc4071ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003970 tx=0x7f9bb4004830 comp rx=0 tx=0).stop 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 msgr2=0x7f9bc4071ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bb27fc640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bc4071be0 0x7f9bc4071ff0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003970 tx=0x7f9bb4004830 comp rx=0 tx=0).stop 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 75898, 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:26.992 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:26.993 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:26.994 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:26.995 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:26.996 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:26.997 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.998 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:26.999 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b9403dd10 msgr2=0x7f9b940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b9403dd10 0x7f9b940401d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4070fa0 tx=0x7f9bc0009040 comp rx=0 tx=0).stop 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 10 monclient: shutdown 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 msgr2=0x7f9bc406fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 --2- 10.20.193.51:0/292105352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bc409ff40 0x7f9bc406fbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406dd50 tx=0x7f9bb80047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bca190640 1 -- 10.20.193.51:0/292105352 reap_dead start 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bca190640 1 -- 10.20.193.51:0/292105352 reap_dead start 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 shutdown_connections 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 >> 10.20.193.51:0/292105352 conn(0x7f9bc40a30c0 msgr2=0x7f9bc406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 shutdown_connections 2026-02-17T12:01:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:26.960+0000 7f9bcbc1a640 1 -- 10.20.193.51:0/292105352 wait complete. 2026-02-17T12:01:27.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:27.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:01:27.001 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:01:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: get_monmap_and_config 2026-02-17T12:01:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: build_initial_monmap 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: monmap: 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:27.067134+0000 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:27.067134+0000 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:27.068 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 Processor -- start 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 -- start start 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: init 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 0x7f9ae409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-a con 0x7f9ae409dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9ae409ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae406e140 con 0x7f9ae409ff40 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae409aed0 con 0x7f9ae409dac0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae409caa0 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae9e4d640 10 monclient(hunting): authenticate will time out at 1574.685897s 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 0x7f9ae409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 0x7f9ae409fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44560/0 (socket says 10.20.193.51:44560) 2026-02-17T12:01:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 1 -- 10.20.193.51:0/2715682879 learned_addr learned my addr 10.20.193.51:0/2715682879 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51660/0 (socket says 10.20.193.51:51660) 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ae409dac0 auth_method 0 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 10 monclient(hunting): get_auth_request con 0x7f9ae40a3bb0 auth_method 0 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.066+0000 7f9ae37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_done global_id 194270 payload 274 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 1 -- 10.20.193.51:0/2715682879 >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 msgr2=0x7f9ae409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 1 --2- 10.20.193.51:0/2715682879 >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 0x7f9ae409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 1 -- 10.20.193.51:0/2715682879 >> v1:10.20.193.51:6789/0 conn(0x7f9ae409ff40 legacy=0x7f9ae413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:01:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.067+0000 7f9ae37fe640 1 -- 10.20.193.51:0/2715682879 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae409ce60 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae37fe640 1 -- 10.20.193.51:0/2715682879 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 msgr2=0x7f9ae409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae37fe640 1 --2- 10.20.193.51:0/2715682879 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4069d60 tx=0x7f9ad002ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c93db738c0a3ae9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 1 -- 10.20.193.51:0/2715682879 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad003c070 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: dump: 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 1 -- 10.20.193.51:0/2715682879 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad002fc60 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae9e4d640 5 monclient: authenticate success, global_id 194270 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 1 -- 10.20.193.51:0/2715682879 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0037660 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae27fc640 10 monclient: dump: 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae9e4d640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.069+0000 7f9ae9e4d640 4 set_mon_vals no callback set 2026-02-17T12:01:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 10 monclient: shutdown 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/2715682879 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 msgr2=0x7f9ae409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/2715682879 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4069d60 tx=0x7f9ad002ede0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/2715682879 shutdown_connections 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/2715682879 >> v2:10.20.193.51:3300/0 conn(0x7f9ae409dac0 0x7f9ae409fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/2715682879 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae40a3bb0 0x7f9ae409f4c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/2715682879 >> 10.20.193.51:0/2715682879 conn(0x7f9ae40a30c0 msgr2=0x7f9ae40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/2715682879 shutdown_connections 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/2715682879 wait complete. 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 10 monclient: build_initial_monmap 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 10 monclient: monmap: 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.070+0000 7f9ae9e4d640 1 Processor -- start 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 -- start start 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient: init 2026-02-17T12:01:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-a con 0x7f9ae409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae409ff40 0x7f9ae41b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-c con 0x7f9ae409ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae40a3bb0 0x7f9ae41b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae409a880 con 0x7f9ae409dac0 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40a0350 con 0x7f9ae40a3bb0 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae40a04d0 con 0x7f9ae409ff40 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae9e4d640 10 monclient(hunting): authenticate will time out at 1574.690301s 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae409ff40 0x7f9ae41b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44570/0 (socket says 10.20.193.51:44570) 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 -- 10.20.193.51:0/3164303091 learned_addr learned my addr 10.20.193.51:0/3164303091 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae409ff40 0x7f9ae41b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51676/0 (socket says 10.20.193.51:51676) 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): get_auth_request con 0x7f9ae409dac0 auth_method 0 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ae409ff40 auth_method 0 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae3fff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae40a3bb0 0x7f9ae41b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae3fff640 10 monclient(hunting): get_auth_request con 0x7f9ae40a3bb0 auth_method 0 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient(hunting): handle_auth_done global_id 204156 payload 824 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae409ff40 msgr2=0x7f9ae41b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9ae409ff40 0x7f9ae41b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae40a3bb0 msgr2=0x7f9ae41b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae40a3bb0 0x7f9ae41b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.071+0000 7f9ae37fe640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae409d7b0 con 0x7f9ae409dac0 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae37fe640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 msgr2=0x7f9ae41b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae37fe640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0002410 tx=0x7f9ad00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad003c040 con 0x7f9ae409dac0 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: dump: 2026-02-17T12:01:27.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 5 monclient: authenticate success, global_id 204156 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad0047070 con 0x7f9ae409dac0 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0040a60 con 0x7f9ae409dac0 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9abffff640 10 monclient: dump: 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.081 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae1ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 10 monclient: _renew_subs 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae40a0fc0 con 0x7f9ae409dac0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 10 monclient: _renew_subs 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.073+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae41b7cf0 con 0x7f9ae409dac0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae9e4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 0x7f9ae41cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40a3fc0 con 0x7f9ae41cad20 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9ad003f030 con 0x7f9ae409dac0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 0x7f9ae41cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9abffff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ab403dd10 0x7f9ab40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient: get_auth_request con 0x7f9ae41cad20 auth_method 0 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f9ad00778a0 con 0x7f9ae409dac0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae3fff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ab403dd10 0x7f9ab40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.074+0000 7f9ae3fff640 10 monclient: get_auth_request con 0x7f9ab403dd10 auth_method 0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.075+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_done global_id 184291 payload 824 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.075+0000 7f9ae2ffd640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ae409e490 con 0x7f9ae41cad20 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9ae2ffd640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 msgr2=0x7f9ae41cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9ae2ffd640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 0x7f9ae41cb100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4009d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4018070 con 0x7f9ae41cad20 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9ae3fff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ab403dd10 0x7f9ab40401d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ae41b6580 tx=0x7f9ad8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 10 monclient: dump: 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.083 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9ad4010c30 con 0x7f9ae41cad20 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 msgr2=0x7f9ae41cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 0x7f9ae41cb100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4009d70 comp rx=0 tx=0).stop 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 msgr2=0x7f9ae41cb100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.077+0000 7f9abffff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cad20 0x7f9ae41cb100 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4009d70 comp rx=0 tx=0).stop 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.080+0000 7f9ae9e4d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.080+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 0x7f9ae41d6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.080+0000 7f9ae9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.080+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae41be120 con 0x7f9ae41cb640 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 0x7f9ae41d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient: get_auth_request con 0x7f9ae41cb640 auth_method 0 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 10 monclient(hunting): handle_auth_done global_id 184294 payload 824 2026-02-17T12:01:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.081+0000 7f9ae2ffd640 1 -- 10.20.193.51:0/3164303091 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ae40008d0 con 0x7f9ae41cb640 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae2ffd640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 msgr2=0x7f9ae41d6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae2ffd640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 0x7f9ae41d6070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4014840 con 0x7f9ae41cb640 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 10 monclient: dump: 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f9ad4014840 con 0x7f9ae41cb640 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 msgr2=0x7f9ae41d6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 0x7f9ae41d6070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4004830 comp rx=0 tx=0).stop 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 msgr2=0x7f9ae41d6070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9abffff640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9ae41cb640 0x7f9ae41d6070 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ae409fcb0 tx=0x7f9ad4004830 comp rx=0 tx=0).stop 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 146, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 119470, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.088 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:27.094 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ab403dd10 msgr2=0x7f9ab40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9ab403dd10 0x7f9ab40401d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ae41b6580 tx=0x7f9ad8009040 comp rx=0 tx=0).stop 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 10 monclient: shutdown 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 msgr2=0x7f9ae41b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae3fff640 1 -- 10.20.193.51:0/3164303091 reap_dead start 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0002410 tx=0x7f9ad00047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 shutdown_connections 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 --2- 10.20.193.51:0/3164303091 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9ae409dac0 0x7f9ae41b4370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 >> 10.20.193.51:0/3164303091 conn(0x7f9ae40a30c0 msgr2=0x7f9ae41be520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 shutdown_connections 2026-02-17T12:01:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.084+0000 7f9ae9e4d640 1 -- 10.20.193.51:0/3164303091 wait complete. 2026-02-17T12:01:27.096 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:01:27.096 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T12:01:27.096 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:01:27.096 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T12:01:27.096 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:01:27.096 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:01:27.096 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:01:27.106 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:01:27.106 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:01:27.106 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:27.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 10 monclient: get_monmap_and_config 2026-02-17T12:01:27.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 10 monclient: build_initial_monmap 2026-02-17T12:01:27.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 10 monclient: monmap: 2026-02-17T12:01:27.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:27.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:27.212343+0000 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:27.212343+0000 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 1 Processor -- start 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 1 -- start start 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.211+0000 7fd44587d640 10 monclient: init 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd4400a3bb0 0x7fd44009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-c con 0x7fd4400a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 0x7fd44009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-b con 0x7fd44009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd44009ff40 0x7fd44013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-a con 0x7fd44009ff40 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:27.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd44009aed0 con 0x7fd44009ff40 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd44009caa0 con 0x7fd4400a3bb0 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd4400a3f90 con 0x7fd44009dac0 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd44587d640 10 monclient(hunting): authenticate will time out at 1574.831136s 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43e7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 msgr2=0x7fd44009fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 0x7fd44009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd44009ff40 0x7fd44013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd44009ff40 0x7fd44013b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44606/0 (socket says 10.20.193.51:44606) 2026-02-17T12:01:27.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 -- 10.20.193.51:0/3450596584 learned_addr learned my addr 10.20.193.51:0/3450596584 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): get_auth_request con 0x7fd44009ff40 auth_method 0 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43effd640 1 --2- 10.20.193.51:0/3450596584 >> v2:10.20.193.142:3300/0 conn(0x7fd4400a3bb0 0x7fd44009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43effd640 10 monclient(hunting): get_auth_request con 0x7fd4400a3bb0 auth_method 0 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_done global_id 204159 payload 274 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 -- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 msgr2=0x7fd44009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 0x7fd44009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 -- 10.20.193.51:0/3450596584 >> v2:10.20.193.142:3300/0 conn(0x7fd4400a3bb0 msgr2=0x7fd44009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/3450596584 >> v2:10.20.193.142:3300/0 conn(0x7fd4400a3bb0 0x7fd44009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.212+0000 7fd43f7fe640 1 -- 10.20.193.51:0/3450596584 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44006e140 con 0x7fd44009ff40 2026-02-17T12:01:27.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.214+0000 7fd43f7fe640 1 -- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd44009ff40 msgr2=0x7fd44013b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.214+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd44009ff40 0x7fd44013b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd44006c1c0 tx=0x7fd43002f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36b2817728106a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 1 -- 10.20.193.51:0/3450596584 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4300373f0 con 0x7fd44009ff40 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: dump: 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.228 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 1 -- 10.20.193.51:0/3450596584 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd430037590 con 0x7fd44009ff40 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 5 monclient: authenticate success, global_id 204159 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 1 -- 10.20.193.51:0/3450596584 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430037960 con 0x7fd44009ff40 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd43dffb640 10 monclient: dump: 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 4 set_mon_vals no callback set 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 10 monclient: shutdown 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 -- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd44009ff40 msgr2=0x7fd44013b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 --2- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd44009ff40 0x7fd44013b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd44006c1c0 tx=0x7fd43002f200 comp rx=0 tx=0).stop 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 -- 10.20.193.51:0/3450596584 shutdown_connections 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 --2- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd44009ff40 0x7fd44013b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 --2- 10.20.193.51:0/3450596584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009dac0 0x7fd44009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 --2- 10.20.193.51:0/3450596584 >> v2:10.20.193.142:3300/0 conn(0x7fd4400a3bb0 0x7fd44009f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 -- 10.20.193.51:0/3450596584 >> 10.20.193.51:0/3450596584 conn(0x7fd4400a30c0 msgr2=0x7fd4400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 -- 10.20.193.51:0/3450596584 shutdown_connections 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 1 -- 10.20.193.51:0/3450596584 wait complete. 2026-02-17T12:01:27.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 10 monclient: build_initial_monmap 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.215+0000 7fd44587d640 10 monclient: monmap: 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:27.232 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 Processor -- start 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 -- start start 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient: init 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 0x7fd44013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-b con 0x7fd44009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 0x7fd44013c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-c con 0x7fd44009ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): picked mon.noname-a con 0x7fd4400a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd44009a880 con 0x7fd4400a3bb0 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd44009ce90 con 0x7fd44009dac0 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd4400a0370 con 0x7fd44009ff40 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd44587d640 10 monclient(hunting): authenticate will time out at 1574.835428s 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43e7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 msgr2=0x7fd44013c690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 0x7fd44013c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44612/0 (socket says 10.20.193.51:44612) 2026-02-17T12:01:27.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 -- 10.20.193.51:0/2233225221 learned_addr learned my addr 10.20.193.51:0/2233225221 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): get_auth_request con 0x7fd4400a3bb0 auth_method 0 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient(hunting): handle_auth_done global_id 204162 payload 824 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 -- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 msgr2=0x7fd44013c690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 0x7fd44013c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 -- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 msgr2=0x7fd44013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43effd640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 0x7fd44013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 0x7fd44013c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43f7fe640 1 -- 10.20.193.51:0/2233225221 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd440130a70 con 0x7fd4400a3bb0 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43effd640 10 monclient: get_auth_request con 0x7fd44009dac0 auth_method 0 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.216+0000 7fd43effd640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 0x7fd44013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd43f7fe640 1 -- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 msgr2=0x7fd4401cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:27.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd43f7fe640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd430039040 tx=0x7fd430004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430046020 con 0x7fd4400a3bb0 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: dump: 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.237 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd430041870 con 0x7fd4400a3bb0 2026-02-17T12:01:27.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430041c60 con 0x7fd4400a3bb0 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd44587d640 5 monclient: authenticate success, global_id 204162 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd43d7fa640 4 set_mon_vals no callback set 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd44587d640 10 monclient: _renew_subs 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd44587d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44013d150 con 0x7fd4400a3bb0 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.218+0000 7fd417fff640 10 monclient: dump: 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:27.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 10 monclient: _renew_subs 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4401304b0 con 0x7fd4400a3bb0 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44009e370 con 0x7fd4400a3bb0 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd430042400 con 0x7fd4400a3bb0 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd417fff640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 0x7fd4100401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.219+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7fd430078600 con 0x7fd4400a3bb0 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.220+0000 7fd43effd640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 0x7fd4100401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.220+0000 7fd43effd640 10 monclient: get_auth_request con 0x7fd41003dd10 auth_method 0 2026-02-17T12:01:27.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.222+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd430050030 con 0x7fd4400a3bb0 2026-02-17T12:01:27.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.222+0000 7fd417fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:27.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.222+0000 7fd417fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:27.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.222+0000 7fd43effd640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 0x7fd4100401d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd434006fd0 tx=0x7fd434008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:27.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd44587d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:27.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd44587d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd44587d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd440074260 con 0x7fd4400a3bb0 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd417fff640 1 -- 10.20.193.51:0/2233225221 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fd430041e00 con 0x7fd4400a3bb0 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd417fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.335+0000 7fd417fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:27.338 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:27.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 msgr2=0x7fd4100401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 0x7fd4100401d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd434006fd0 tx=0x7fd434008040 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 10 monclient: shutdown 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 msgr2=0x7fd4401cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd430039040 tx=0x7fd430004b40 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 shutdown_connections 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd41003dd10 0x7fd4100401d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd4400a3bb0 0x7fd4401cf0e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd44009ff40 0x7fd44013c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 --2- 10.20.193.51:0/2233225221 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd44009dac0 0x7fd44013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 >> 10.20.193.51:0/2233225221 conn(0x7fd4400a30c0 msgr2=0x7fd44009e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:27.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 shutdown_connections 2026-02-17T12:01:27.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:27.336+0000 7fd44587d640 1 -- 10.20.193.51:0/2233225221 wait complete. 2026-02-17T12:01:30.346 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: get_monmap_and_config 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: build_initial_monmap 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: monmap: 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:30.415190+0000 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:30.415190+0000 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:30.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 Processor -- start 2026-02-17T12:01:30.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 -- start start 2026-02-17T12:01:30.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: init 2026-02-17T12:01:30.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:30.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 0x7f28cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f28cc0a0750 0x7f28cc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f28cc09e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc06e140 con 0x7f28cc09e540 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f28cc0a3f90 con 0x7f28cc0a0750 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f28cc09f910 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d3032640 10 monclient(hunting): authenticate will time out at 1578.033927s 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d0da7640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 msgr2=0x7f28cc09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.414+0000 7f28d0da7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 0x7f28cc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f28cc0a0750 0x7f28cc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f28cc0a0750 0x7f28cc09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44616/0 (socket says 10.20.193.51:44616) 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 -- 10.20.193.51:0/1859175655 learned_addr learned my addr 10.20.193.51:0/1859175655 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28d15a8640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f28cc09e540 0x7f28cc13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46324/0 (socket says 10.20.193.51:46324) 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): get_auth_request con 0x7f28cc0a0750 auth_method 0 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient(hunting): handle_auth_done global_id 204165 payload 274 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 -- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 msgr2=0x7f28cc09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 --2- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 0x7f28cc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 -- 10.20.193.51:0/1859175655 >> v1:10.20.193.51:6789/0 conn(0x7f28cc09e540 legacy=0x7f28cc13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:30.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 monclient: found mon.noname-a 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.415+0000 7f28c3fff640 1 -- 10.20.193.51:0/1859175655 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28cc09ccd0 con 0x7f28cc0a0750 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c3fff640 1 -- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a0750 msgr2=0x7f28cc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c3fff640 1 --2- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a0750 0x7f28cc09e000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28cc069d60 tx=0x7f28b402ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e5a003ed440a3b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:30.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 1 -- 10.20.193.51:0/1859175655 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b403c070 con 0x7f28cc0a0750 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: dump: 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 1 -- 10.20.193.51:0/1859175655 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b402fda0 con 0x7f28cc0a0750 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 1 -- 10.20.193.51:0/1859175655 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4037660 con 0x7f28cc0a0750 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28c37fe640 10 monclient: dump: 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28d3032640 5 monclient: authenticate success, global_id 204165 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28d3032640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.417+0000 7f28d3032640 4 set_mon_vals no callback set 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 10 monclient: shutdown 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a0750 msgr2=0x7f28cc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 --2- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a0750 0x7f28cc09e000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28cc069d60 tx=0x7f28b402ee80 comp rx=0 tx=0).stop 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- 10.20.193.51:0/1859175655 shutdown_connections 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 --2- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a0750 0x7f28cc09e000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 --2- 10.20.193.51:0/1859175655 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a3bb0 0x7f28cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- 10.20.193.51:0/1859175655 >> 10.20.193.51:0/1859175655 conn(0x7f28cc0a30c0 msgr2=0x7f28cc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- 10.20.193.51:0/1859175655 shutdown_connections 2026-02-17T12:01:30.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- 10.20.193.51:0/1859175655 wait complete. 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 10 monclient: build_initial_monmap 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 10 monclient: monmap: 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:30.422 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 Processor -- start 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 1 -- start start 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.418+0000 7f28d3032640 10 monclient: init 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f28cc09e540 0x7f28cc13d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 0x7f28cc12fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-c con 0x7f28cc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f28cc0a04b0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f28cc09c850 con 0x7f28cc09e540 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f28cc13de80 con 0x7f28cc0a0750 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d3032640 10 monclient(hunting): authenticate will time out at 1578.038106s 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28c3fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 msgr2=0x7f28cc12fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28c3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 0x7f28cc12fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44626/0 (socket says 10.20.193.51:44626) 2026-02-17T12:01:30.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 -- 10.20.193.51:0/1077560901 learned_addr learned my addr 10.20.193.51:0/1077560901 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): get_auth_request con 0x7f28cc0a3bb0 auth_method 0 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient(hunting): handle_auth_done global_id 204168 payload 824 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 -- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 msgr2=0x7f28cc12fb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 0x7f28cc12fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 -- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f28cc09e540 msgr2=0x7f28cc13d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f28cc09e540 0x7f28cc13d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient: _finish_hunting 0 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 monclient: found mon.noname-a 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.419+0000 7f28d15a8640 1 -- 10.20.193.51:0/1077560901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28cc0a23c0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d15a8640 1 -- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 msgr2=0x7f28cc1300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d15a8640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28c800caf0 tx=0x7f28c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8017070 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: dump: 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: _finish_auth 0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: _check_auth_tickets 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c8012400 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80127f0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 5 monclient: authenticate success, global_id 204168 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 10 monclient: _renew_subs 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28cc130da0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c2ffd640 4 set_mon_vals no callback set 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28c17fa640 10 monclient: dump: 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 10 monclient: _renew_subs 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.421+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28cc13dc20 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d3032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d3032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d3032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28cc09dac0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f28c8007070 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28c17fa640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 0x7f289c040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f28c80527a0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d0da7640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 0x7f289c040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.422+0000 7f28d0da7640 10 monclient: get_auth_request con 0x7f289c03dd40 auth_method 0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.424+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f28cc0a23c0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.424+0000 7f28c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.424+0000 7f28c17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:30.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.425+0000 7f28d0da7640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 0x7f289c040200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f28bc003a80 tx=0x7f28bc006d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:30.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28d3032640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:30.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28d3032640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:30.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28d3032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:30.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28cc0008d0 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28c17fa640 1 -- 10.20.193.51:0/1077560901 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f28c801ac60 con 0x7f28cc0a3bb0 2026-02-17T12:01:30.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:30.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.543+0000 7f28c17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:30.546 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:30.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 msgr2=0x7f289c040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 0x7f289c040200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f28bc003a80 tx=0x7f28bc006d90 comp rx=0 tx=0).stop 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 10 monclient: shutdown 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 msgr2=0x7f28cc1300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28c800caf0 tx=0x7f28c800a060 comp rx=0 tx=0).stop 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 shutdown_connections 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f289c03dd40 0x7f289c040200 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f28cc0a3bb0 0x7f28cc1300d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f28cc0a0750 0x7f28cc12fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 --2- 10.20.193.51:0/1077560901 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f28cc09e540 0x7f28cc13d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:30.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 >> 10.20.193.51:0/1077560901 conn(0x7f28cc0a30c0 msgr2=0x7f28cc072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:30.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 shutdown_connections 2026-02-17T12:01:30.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:30.544+0000 7f28d3032640 1 -- 10.20.193.51:0/1077560901 wait complete. 2026-02-17T12:01:33.555 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:33.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.621+0000 7ff982a87640 10 monclient: get_monmap_and_config 2026-02-17T12:01:33.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.621+0000 7ff982a87640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.621+0000 7ff982a87640 10 monclient: monmap: 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:33.622708+0000 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:33.622708+0000 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 Processor -- start 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 -- start start 2026-02-17T12:01:33.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient: init 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff97c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff97c0a0750 0x7ff97c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-c con 0x7ff97c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff97c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97c06e140 con 0x7ff97c13b760 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97c09f910 con 0x7ff97c0a3bb0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff97c09ccd0 con 0x7ff97c0a0750 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff982a87640 10 monclient(hunting): authenticate will time out at 1581.241492s 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff980ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff97c13b760 0x7ff97c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46328/0 (socket says 10.20.193.51:46328) 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff980ffd640 1 -- 10.20.193.51:0/2679191968 learned_addr learned my addr 10.20.193.51:0/2679191968 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 1 --2- 10.20.193.51:0/2679191968 >> v2:10.20.193.142:3300/0 conn(0x7ff97c0a0750 0x7ff97c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): get_auth_request con 0x7ff97c0a0750 auth_method 0 2026-02-17T12:01:33.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.622+0000 7ff97b7fe640 10 monclient(hunting): handle_auth_done global_id 184300 payload 274 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 1 -- 10.20.193.51:0/2679191968 >> v1:10.20.193.142:6789/0 conn(0x7ff97c0a3bb0 legacy=0x7ff97c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 1 -- 10.20.193.51:0/2679191968 >> v1:10.20.193.51:6789/0 conn(0x7ff97c13b760 legacy=0x7ff97c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:01:33.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.623+0000 7ff97b7fe640 1 -- 10.20.193.51:0/2679191968 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c09eec0 con 0x7ff97c0a0750 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97b7fe640 1 -- 10.20.193.51:0/2679191968 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a0750 msgr2=0x7ff97c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97b7fe640 1 --2- 10.20.193.51:0/2679191968 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a0750 0x7ff97c09e1d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0098a0 tx=0x7ff96c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6bc98331469847f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 1 -- 10.20.193.51:0/2679191968 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c03c070 con 0x7ff97c0a0750 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: dump: 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.636 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff982a87640 5 monclient: authenticate success, global_id 184300 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff982a87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 1 -- 10.20.193.51:0/2679191968 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff96c02fce0 con 0x7ff97c0a0750 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 1 -- 10.20.193.51:0/2679191968 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c037660 con 0x7ff97c0a0750 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff97affd640 10 monclient: dump: 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff982a87640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:33.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.625+0000 7ff982a87640 4 set_mon_vals no callback set 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: shutdown 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- 10.20.193.51:0/2679191968 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a0750 msgr2=0x7ff97c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 --2- 10.20.193.51:0/2679191968 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a0750 0x7ff97c09e1d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0098a0 tx=0x7ff96c02ed80 comp rx=0 tx=0).stop 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- 10.20.193.51:0/2679191968 shutdown_connections 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 --2- 10.20.193.51:0/2679191968 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a0750 0x7ff97c09e1d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- 10.20.193.51:0/2679191968 >> 10.20.193.51:0/2679191968 conn(0x7ff97c0a30c0 msgr2=0x7ff97c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- 10.20.193.51:0/2679191968 shutdown_connections 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- 10.20.193.51:0/2679191968 wait complete. 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: monmap: 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:33.639 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 Processor -- start 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- start start 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: init 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 0x7ff97c1cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-c con 0x7ff97c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:33.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a3bb0 0x7ff97c09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-b con 0x7ff97c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): picked mon.noname-a con 0x7ff97c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0a04b0 con 0x7ff97c13b760 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c09c850 con 0x7ff97c0a3bb0 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c09e710 con 0x7ff97c0a0750 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.626+0000 7ff982a87640 10 monclient(hunting): authenticate will time out at 1581.245996s 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff97bfff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 msgr2=0x7ff97c1cfe20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff97bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 0x7ff97c1cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:44636/0 (socket says 10.20.193.51:44636) 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 -- 10.20.193.51:0/243309904 learned_addr learned my addr 10.20.193.51:0/243309904 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): get_auth_request con 0x7ff97c13b760 auth_method 0 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient(hunting): handle_auth_done global_id 204171 payload 824 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 -- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 msgr2=0x7ff97c1cfe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 0x7ff97c1cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 -- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a3bb0 msgr2=0x7ff97c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a3bb0 0x7ff97c09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.627+0000 7ff980ffd640 1 -- 10.20.193.51:0/243309904 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c06f6c0 con 0x7ff97c13b760 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff980ffd640 1 -- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 msgr2=0x7ff97c09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff980ffd640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff97000caf0 tx=0x7ff970005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970017070 con 0x7ff97c13b760 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: dump: 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.643 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97000adf0 con 0x7ff97c13b760 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970012640 con 0x7ff97c13b760 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff978ff9640 10 monclient: dump: 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:33.644 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 5 monclient: authenticate success, global_id 204171 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff97a7fc640 4 set_mon_vals no callback set 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 10 monclient: _renew_subs 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c0a28c0 con 0x7ff97c13b760 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 10 monclient: _renew_subs 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:33.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.629+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c133e60 con 0x7ff97c13b760 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff982a87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff982a87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff982a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c09dac0 con 0x7ff97c13b760 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff97001b3b0 con 0x7ff97c13b760 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff978ff9640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 0x7ff94c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7ff9700525e0 con 0x7ff97c13b760 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff97bfff640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 0x7ff94c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.630+0000 7ff97bfff640 10 monclient: get_auth_request con 0x7ff94c03dcc0 auth_method 0 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.632+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff97001bbe0 con 0x7ff97c13b760 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.632+0000 7ff978ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.632+0000 7ff978ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:33.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.633+0000 7ff97bfff640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 0x7ff94c040180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff968003870 tx=0x7ff968007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff982a87640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:33.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff982a87640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff982a87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff97c1335c0 con 0x7ff97c13b760 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff978ff9640 1 -- 10.20.193.51:0/243309904 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7ff970010c00 con 0x7ff97c13b760 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff978ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.746+0000 7ff978ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:33.749 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 msgr2=0x7ff94c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 0x7ff94c040180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff968003870 tx=0x7ff968007b10 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 10 monclient: shutdown 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 msgr2=0x7ff97c09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff97000caf0 tx=0x7ff970005c50 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 shutdown_connections 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff94c03dcc0 0x7ff94c040180 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff97c13b760 0x7ff97c09ab00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff97c0a3bb0 0x7ff97c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 --2- 10.20.193.51:0/243309904 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff97c0a0750 0x7ff97c1cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 >> 10.20.193.51:0/243309904 conn(0x7ff97c0a30c0 msgr2=0x7ff97c072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:33.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 shutdown_connections 2026-02-17T12:01:33.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:33.747+0000 7ff982a87640 1 -- 10.20.193.51:0/243309904 wait complete. 2026-02-17T12:01:36.758 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 10 monclient: get_monmap_and_config 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 10 monclient: build_initial_monmap 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 10 monclient: monmap: 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:36.824332+0000 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:36.824332+0000 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:36.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 1 Processor -- start 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 1 -- start start 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.823+0000 7f6581f96640 10 monclient: init 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-b con 0x7f657c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-a con 0x7f657c09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-c con 0x7f657c09ff40 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f657c09aed0 con 0x7f657c09dac0 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f657c09caa0 con 0x7f657c09ff40 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f657c0a3f90 con 0x7f657c0a3bb0 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f6581f96640 10 monclient(hunting): authenticate will time out at 1584.443098s 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c09f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:36.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49548/0 (socket says 10.20.193.51:49548) 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 learned_addr learned my addr 10.20.193.51:0/1927074818 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f657c09dac0 auth_method 0 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 10 monclient(hunting): get_auth_request con 0x7f657c09ff40 auth_method 0 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:36.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:36.824+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c09f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f657c09dac0 auth_method 0 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:37.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 10 monclient(hunting): get_auth_request con 0x7f657c09ff40 auth_method 0 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:37.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.025+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c09f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f657c09dac0 auth_method 0 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:37.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 10 monclient(hunting): get_auth_request con 0x7f657c09ff40 auth_method 0 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:37.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:37.426+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c09f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f657c09dac0 auth_method 0 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 10 monclient(hunting): get_auth_request con 0x7f657c09ff40 auth_method 0 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:01:38.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:38.227+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): tick 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 monclient(hunting): continuing hunt 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c09f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f657c09f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 msgr2=0x7f657c13b750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.142:3300/0 conn(0x7f657c09ff40 0x7f657c13b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 -- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 msgr2=0x7f657c09fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 --2- 10.20.193.51:0/1927074818 >> v2:10.20.193.51:3300/0 conn(0x7f657c09dac0 0x7f657c09fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient: _add_conns ranks=[1,0] 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f65580037a0 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6558007450 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:39.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 -- 10.20.193.51:0/1927074818 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657c06e140 con 0x7f6558007450 2026-02-17T12:01:39.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 1 -- 10.20.193.51:0/1927074818 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655800c1b0 con 0x7f65580037a0 2026-02-17T12:01:39.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.824+0000 7f65797fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:39.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.826+0000 7f657affd640 1 -- 10.20.193.51:0/1927074818 >> v1:10.20.193.51:6789/0 conn(0x7f6558007450 legacy=0x7f6558009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:39.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:39.826+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> v1:10.20.193.142:6789/0 conn(0x7f65580037a0 legacy=0x7f6558005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:41.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724329282 0 0) 0x7f655800c1b0 con 0x7f65580037a0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): my global_id is 184303 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65600058b0 con 0x7f65580037a0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3576851744 0 0) 0x7f65600058b0 con 0x7f65580037a0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 >> v1:10.20.193.51:6789/0 conn(0x7f6558007450 legacy=0x7f6558009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655800d410 con 0x7f65580037a0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f6568004700 con 0x7f65580037a0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f6581f96640 5 monclient: authenticate success, global_id 184303 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f6581f96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: dump: 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:01:41.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 >> v1:10.20.193.142:6789/0 conn(0x7f65580037a0 legacy=0x7f6558005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 0x7f6560006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): picked mon.a con 0x7f6560005d40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f6560007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): picked mon.b con 0x7f6560006b90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f656000dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): picked mon.c con 0x7f657c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f65600079a0 con 0x7f6560005d40 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f656000e290 con 0x7f6560006b90 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f656000e440 con 0x7f657c0a3bb0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f6581f96640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 0x7f6560006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): get_auth_request con 0x7f6560005d40 auth_method 0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f6560007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f6560006b90 auth_method 0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 reap_dead start 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657bfff640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f656000dd50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657bfff640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f656000dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient(hunting): handle_auth_done global_id 184303 payload 293 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 msgr2=0x7f656000dd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f656000dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 msgr2=0x7f6560007010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f6560007010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.767+0000 7f657b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 1 monclient: found mon.a 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600058b0 con 0x7f6560005d40 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.768+0000 7f657b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657b7fe640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 msgr2=0x7f6560006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657b7fe640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 0x7f6560006140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6568003a80 tx=0x7f656802f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b94577a21be994 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656800a2d0 con 0x7f6560005d40 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: dump: 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.772 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568004c90 con 0x7f6560005d40 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 1 -- 10.20.193.51:0/1927074818 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65680062b0 con 0x7f6560005d40 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 4 set_mon_vals no callback set 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f657a7fc640 10 monclient: dump: 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 10 monclient: shutdown 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 1 -- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 msgr2=0x7f6560006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.770+0000 7f6581f96640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 0x7f6560006140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6568003a80 tx=0x7f656802f940 comp rx=0 tx=0).stop 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 -- 10.20.193.51:0/1927074818 shutdown_connections 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f657c0a3bb0 0x7f656000dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f6560007010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 --2- 10.20.193.51:0/1927074818 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6560005d40 0x7f6560006140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 -- 10.20.193.51:0/1927074818 >> 10.20.193.51:0/1927074818 conn(0x7f657c0a30c0 msgr2=0x7f657c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 -- 10.20.193.51:0/1927074818 shutdown_connections 2026-02-17T12:01:41.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 -- 10.20.193.51:0/1927074818 wait complete. 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 10 monclient: build_initial_monmap 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 10 monclient: monmap: 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:41.774 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 Processor -- start 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 1 -- start start 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.771+0000 7f6581f96640 10 monclient: init 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 0x7f657c094b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-c con 0x7f6560005d40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f657c095060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-b con 0x7f6560006b90 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): picked mon.noname-a con 0x7f657c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f657c09a880 con 0x7f657c0a3bb0 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f657c09a5c0 con 0x7f6560006b90 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f657c0a0350 con 0x7f6560005d40 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f6581f96640 10 monclient(hunting): authenticate will time out at 1589.391244s 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 msgr2=0x7f657c094b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 0x7f657c094b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49590/0 (socket says 10.20.193.51:49590) 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 -- 10.20.193.51:0/3978598916 learned_addr learned my addr 10.20.193.51:0/3978598916 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): get_auth_request con 0x7f657c0a3bb0 auth_method 0 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:41.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657affd640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f657c095060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657affd640 10 monclient(hunting): get_auth_request con 0x7f6560006b90 auth_method 0 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient(hunting): handle_auth_done global_id 204177 payload 824 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 -- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 msgr2=0x7f657c094b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 0x7f657c094b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 -- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 msgr2=0x7f657c095060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f657c095060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 monclient: found mon.noname-a 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.772+0000 7f657bfff640 1 -- 10.20.193.51:0/3978598916 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c0a2a30 con 0x7f657c0a3bb0 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f657bfff640 1 -- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c0955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f657bfff640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65580073c0 tx=0x7f6570011600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657001b020 con 0x7f657c0a3bb0 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: dump: 2026-02-17T12:01:41.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:41.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6570017460 con 0x7f657c0a3bb0 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 5 monclient: authenticate success, global_id 204177 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 10 monclient: _renew_subs 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c09d7b0 con 0x7f657c0a3bb0 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570017850 con 0x7f657c0a3bb0 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6579ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:41.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6557fff640 10 monclient: dump: 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 10 monclient: _renew_subs 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.774+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c098960 con 0x7f657c0a3bb0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6581f96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6581f96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6581f96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657c068450 con 0x7f657c0a3bb0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f65700179f0 con 0x7f657c0a3bb0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6557fff640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 0x7f654c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f6570053870 con 0x7f657c0a3bb0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f657b7fe640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 0x7f654c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.775+0000 7f657b7fe640 10 monclient: get_auth_request con 0x7f654c03dcc0 auth_method 0 2026-02-17T12:01:41.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.777+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f657c068450 con 0x7f657c0a3bb0 2026-02-17T12:01:41.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.778+0000 7f6557fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:41.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.778+0000 7f6557fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:41.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.778+0000 7f657b7fe640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 0x7f654c040180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6568004920 tx=0x7f6568009070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6581f96640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6581f96640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6581f96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f657c096f50 con 0x7f657c0a3bb0 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6557fff640 1 -- 10.20.193.51:0/3978598916 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f6570025020 con 0x7f657c0a3bb0 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6557fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.898+0000 7f6557fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:41.900 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 msgr2=0x7f654c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 0x7f654c040180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6568004920 tx=0x7f6568009070 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 10 monclient: shutdown 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 msgr2=0x7f657c0955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65580073c0 tx=0x7f6570011600 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 shutdown_connections 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f654c03dcc0 0x7f654c040180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f657c0a3bb0 0x7f657c0955a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6560006b90 0x7f657c095060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 --2- 10.20.193.51:0/3978598916 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6560005d40 0x7f657c094b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 >> 10.20.193.51:0/3978598916 conn(0x7f657c0a30c0 msgr2=0x7f657c071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 shutdown_connections 2026-02-17T12:01:41.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.899+0000 7f6581f96640 1 -- 10.20.193.51:0/3978598916 wait complete. 2026-02-17T12:01:41.909 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:01:41.909 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:01:41.909 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: get_monmap_and_config 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: build_initial_monmap 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: monmap: 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:41.978121+0000 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:41.978121+0000 2026-02-17T12:01:41.980 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 Processor -- start 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 -- start start 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: init 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f16900a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f169013b380 addr v1:10.20.193.142:6789/0 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1690141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): picked mon.noname-b con 0x7f169013ee90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1690135430 con 0x7f16900a3bb0 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169009af60 con 0x7f169013b380 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f169009a5c0 con 0x7f169013ee90 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.977+0000 7f169786f640 10 monclient(hunting): authenticate will time out at 1589.596903s 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.978+0000 7f1695de5640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 msgr2=0x7f1690141280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.978+0000 7f1695de5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1690141280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.978+0000 7f16955e4640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f16900a3bb0 0x7f169009cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58300/0 (socket says 10.20.193.51:58300) 2026-02-17T12:01:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.978+0000 7f16955e4640 1 -- 10.20.193.51:0/3615931429 learned_addr learned my addr 10.20.193.51:0/3615931429 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 1 -- 10.20.193.51:0/3615931429 >> v1:10.20.193.51:6789/0 conn(0x7f16900a3bb0 legacy=0x7f169009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987818537 0 0) 0x7f1690135430 con 0x7f16900a3bb0 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): _negotiate 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): my global_id is 204180 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1678003620 con 0x7f16900a3bb0 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638196580 0 0) 0x7f1678003620 con 0x7f16900a3bb0 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 msgr2=0x7f1690141280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1690141280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 >> v1:10.20.193.142:6789/0 conn(0x7f169013b380 legacy=0x7f169013d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169009b240 con 0x7f16900a3bb0 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f16800031b0 con 0x7f16900a3bb0 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f169786f640 5 monclient: authenticate success, global_id 204180 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f169786f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: dump: 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 >> v1:10.20.193.51:6789/0 conn(0x7f16900a3bb0 legacy=0x7f169009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1678003ae0 0x7f1678003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): picked mon.b con 0x7f1678003ae0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1678004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): picked mon.c con 0x7f169013ee90 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 0x7f167800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): picked mon.a con 0x7f1678005040 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:41.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f169009a5c0 con 0x7f1678005040 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f167800c000 con 0x7f1678003ae0 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f167800c180 con 0x7f169013ee90 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f167ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f169786f640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1694de3640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 msgr2=0x7f1678004900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1694de3640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1678004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 0x7f167800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): get_auth_request con 0x7f1678005040 auth_method 0 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:41.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1678003ae0 0x7f1678003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 10 monclient(hunting): get_auth_request con 0x7f1678003ae0 auth_method 0 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f16955e4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient(hunting): handle_auth_done global_id 204180 payload 293 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 msgr2=0x7f1678004900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:41.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013ee90 0x7f1678004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1678003ae0 msgr2=0x7f1678003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1678003ae0 0x7f1678003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient: _finish_hunting 0 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 monclient: found mon.a 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:41.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 1 -- 10.20.193.51:0/3615931429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1678003620 con 0x7f1678005040 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient: _finish_auth 0 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 10 monclient: _check_auth_tickets 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.980+0000 7f1695de5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f1695de5640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 msgr2=0x7f167800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f1695de5640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 0x7f167800bac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e30 tx=0x7f168c02f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f5b34773c6c4b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c009a30 con 0x7f1678005040 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:41.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: dump: 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:41.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c037630 con 0x7f1678005040 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 1 -- 10.20.193.51:0/3615931429 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c037a00 con 0x7f1678005040 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 4 set_mon_vals no callback set 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f167ffff640 10 monclient: dump: 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:41.998 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 10 monclient: shutdown 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 -- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 msgr2=0x7f167800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 --2- 10.20.193.51:0/3615931429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1678005040 0x7f167800bac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e30 tx=0x7f168c02f660 comp rx=0 tx=0).stop 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f1695de5640 1 -- 10.20.193.51:0/3615931429 reap_dead start 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 -- 10.20.193.51:0/3615931429 shutdown_connections 2026-02-17T12:01:41.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 -- 10.20.193.51:0/3615931429 >> 10.20.193.51:0/3615931429 conn(0x7f16900a30c0 msgr2=0x7f16900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 -- 10.20.193.51:0/3615931429 shutdown_connections 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.983+0000 7f169786f640 1 -- 10.20.193.51:0/3615931429 wait complete. 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient: build_initial_monmap 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient: monmap: 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:42.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 Processor -- start 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 -- start start 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient: init 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): picked mon.noname-a con 0x7f16901cf240 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013a630 0x7f169009ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): picked mon.noname-c con 0x7f169013a630 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:42.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f169009f1b0 0x7f169009f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): picked mon.noname-b con 0x7f169009f1b0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1690135040 con 0x7f16901cf240 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16900a3f90 con 0x7f169009f1b0 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f16901351c0 con 0x7f169013a630 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f169786f640 10 monclient(hunting): authenticate will time out at 1589.603750s 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1694de3640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013a630 msgr2=0x7f169009ec70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1694de3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013a630 0x7f169009ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49606/0 (socket says 10.20.193.51:49606) 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 -- 10.20.193.51:0/2385021297 learned_addr learned my addr 10.20.193.51:0/2385021297 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): get_auth_request con 0x7f16901cf240 auth_method 0 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1695de5640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f169009f1b0 0x7f169009f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1695de5640 10 monclient(hunting): get_auth_request con 0x7f169009f1b0 auth_method 0 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1695de5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1695de5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f1695de5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient(hunting): handle_auth_done global_id 204183 payload 824 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013a630 msgr2=0x7f169009ec70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f169013a630 0x7f169009ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f169009f1b0 msgr2=0x7f169009f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f169009f1b0 0x7f169009f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient: _finish_hunting 0 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 monclient: found mon.noname-a 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.984+0000 7f16955e4640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16901378d0 con 0x7f16901cf240 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f16955e4640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 msgr2=0x7f169013a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f16955e4640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16800028f0 tx=0x7f1680007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680005e60 con 0x7f16901cf240 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:42.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: dump: 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 5 monclient: authenticate success, global_id 204183 2026-02-17T12:01:42.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680018070 con 0x7f16901cf240 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 monclient: _renew_subs 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16900a1390 con 0x7f16901cf240 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168000ed70 con 0x7f16901cf240 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 10 monclient: dump: 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.012 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167f7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 monclient: _renew_subs 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169009d7b0 con 0x7f16901cf240 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 0x7f1690133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f169009d560 con 0x7f16901337d0 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 0x7f1690133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient: get_auth_request con 0x7f16901337d0 auth_method 0 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f168001d460 con 0x7f16901cf240 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.987+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f1694de3640 10 monclient(hunting): handle_auth_done global_id 204186 payload 824 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f1694de3640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1690074db0 con 0x7f16901337d0 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f167dffb640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f166003dcc0 0x7f1660040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f1680052640 con 0x7f16901cf240 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f1695de5640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f166003dcc0 0x7f1660040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.988+0000 7f1695de5640 10 monclient: get_auth_request con 0x7f166003dcc0 auth_method 0 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f1694de3640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 msgr2=0x7f1690133bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f1694de3640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 0x7f1690133bb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f168400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684017070 con 0x7f16901337d0 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 10 monclient: dump: 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.015 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1684007070 con 0x7f16901337d0 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:42.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 msgr2=0x7f1690133bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 0x7f1690133bb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f168400c900 comp rx=0 tx=0).stop 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 msgr2=0x7f1690133bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.990+0000 7f167dffb640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901337d0 0x7f1690133bb0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f168400c900 comp rx=0 tx=0).stop 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.991+0000 7f1695de5640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f166003dcc0 0x7f1660040180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f168c003e00 tx=0x7f168c005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f169786f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f169786f640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 0x7f16901da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f169786f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f16901363b0 con 0x7f16901340f0 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 0x7f16901da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient: get_auth_request con 0x7f16901340f0 auth_method 0 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 10 monclient(hunting): handle_auth_done global_id 204189 payload 824 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.993+0000 7f1694de3640 1 -- 10.20.193.51:0/2385021297 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16900008d0 con 0x7f16901340f0 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f1694de3640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 msgr2=0x7f16901da5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f1694de3640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 0x7f16901da5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f16840038e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684017030 con 0x7f16901340f0 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f167dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f167dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:42.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.995+0000 7f167dffb640 10 monclient: dump: 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f168401abd0 con 0x7f16901340f0 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 msgr2=0x7f16901da5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 0x7f16901da5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f16840038e0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 msgr2=0x7f16901da5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f167dffb640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901340f0 0x7f16901da5b0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f16840038e0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 150, 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 42761, 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:42.020 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:42.021 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:42.022 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.023 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:42.024 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.025 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:42.026 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.027 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:42.028 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:42.029 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f166003dcc0 msgr2=0x7f1660040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f166003dcc0 0x7f1660040180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f168c003e00 tx=0x7f168c005000 comp rx=0 tx=0).stop 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 10 monclient: shutdown 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 msgr2=0x7f169013a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16800028f0 tx=0x7f1680007720 comp rx=0 tx=0).stop 2026-02-17T12:01:42.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f1695de5640 1 -- 10.20.193.51:0/2385021297 reap_dead start 2026-02-17T12:01:42.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 shutdown_connections 2026-02-17T12:01:42.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 --2- 10.20.193.51:0/2385021297 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16901cf240 0x7f169013a0f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 >> 10.20.193.51:0/2385021297 conn(0x7f16900a30c0 msgr2=0x7f169009bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:42.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 shutdown_connections 2026-02-17T12:01:42.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:41.996+0000 7f169786f640 1 -- 10.20.193.51:0/2385021297 wait complete. 2026-02-17T12:01:42.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:01:42.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:01:42.031 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:01:42.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.097+0000 7f90667b6640 10 monclient: get_monmap_and_config 2026-02-17T12:01:42.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.097+0000 7f90667b6640 10 monclient: build_initial_monmap 2026-02-17T12:01:42.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.097+0000 7f90667b6640 10 monclient: monmap: 2026-02-17T12:01:42.099 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:01:42.098786+0000 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:01:42.098786+0000 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:01:42.100 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 Processor -- start 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 -- start start 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient: init 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f906009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-b con 0x7f90600a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f90600a0750 0x7f906009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-c con 0x7f90600a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:01:42.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f906009e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906006e140 con 0x7f906009e540 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f90600a3f90 con 0x7f90600a0750 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f906009f910 con 0x7f90600a3bb0 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f90667b6640 10 monclient(hunting): authenticate will time out at 1589.717546s 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905ffff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 msgr2=0x7f906009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f906009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f9064d2c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f906009e540 0x7f906013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58314/0 (socket says 10.20.193.51:58314) 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f9064d2c640 1 -- 10.20.193.51:0/1469567094 learned_addr learned my addr 10.20.193.51:0/1469567094 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 1 --2- 10.20.193.51:0/1469567094 >> v2:10.20.193.142:3300/0 conn(0x7f90600a0750 0x7f906009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): get_auth_request con 0x7f90600a0750 auth_method 0 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 10 monclient(hunting): handle_auth_done global_id 184312 payload 274 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.098+0000 7f905f7fe640 1 -- 10.20.193.51:0/1469567094 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 msgr2=0x7f906009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 1 --2- 10.20.193.51:0/1469567094 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f906009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 1 -- 10.20.193.51:0/1469567094 >> v1:10.20.193.51:6789/0 conn(0x7f906009e540 legacy=0x7f906013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:01:42.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.099+0000 7f905f7fe640 1 -- 10.20.193.51:0/1469567094 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906009ccd0 con 0x7f90600a0750 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905f7fe640 1 -- 10.20.193.51:0/1469567094 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90600a0750 msgr2=0x7f906009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905f7fe640 1 --2- 10.20.193.51:0/1469567094 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90600a0750 0x7f906009e000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9060069d60 tx=0x7f905002ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92d527c5852277 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 1 -- 10.20.193.51:0/1469567094 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905003c070 con 0x7f90600a0750 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: dump: 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.108 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: _finish_auth 0 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 1 -- 10.20.193.51:0/1469567094 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f905002fcd0 con 0x7f90600a0750 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 1 -- 10.20.193.51:0/1469567094 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050037660 con 0x7f90600a0750 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f90667b6640 5 monclient: authenticate success, global_id 184312 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f90667b6640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f90667b6640 4 set_mon_vals no callback set 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.101+0000 7f905effd640 10 monclient: dump: 2026-02-17T12:01:42.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: shutdown 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- 10.20.193.51:0/1469567094 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90600a0750 msgr2=0x7f906009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- 10.20.193.51:0/1469567094 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90600a0750 0x7f906009e000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9060069d60 tx=0x7f905002ed70 comp rx=0 tx=0).stop 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- 10.20.193.51:0/1469567094 shutdown_connections 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- 10.20.193.51:0/1469567094 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90600a0750 0x7f906009e000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- 10.20.193.51:0/1469567094 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f906009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- 10.20.193.51:0/1469567094 >> 10.20.193.51:0/1469567094 conn(0x7f90600a30c0 msgr2=0x7f90600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- 10.20.193.51:0/1469567094 shutdown_connections 2026-02-17T12:01:42.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- 10.20.193.51:0/1469567094 wait complete. 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: build_initial_monmap 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: monmap: 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 Processor -- start 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- start start 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: init 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f906009e540 0x7f906013d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-b con 0x7f906009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-a con 0x7f90600a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f90601300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): picked mon.noname-c con 0x7f90600a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f90600a04b0 con 0x7f90600a0750 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f906009c850 con 0x7f906009e540 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f906013de80 con 0x7f90600a3bb0 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f90667b6640 10 monclient(hunting): authenticate will time out at 1589.721951s 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f9064d2c640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 msgr2=0x7f90601300d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.102+0000 7f9064d2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f90601300d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:49626/0 (socket says 10.20.193.51:49626) 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 -- 10.20.193.51:0/33193122 learned_addr learned my addr 10.20.193.51:0/33193122 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): get_auth_request con 0x7f90600a0750 auth_method 0 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.112 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905ffff640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f906009e540 0x7f906013d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient(hunting): handle_auth_done global_id 204192 payload 824 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 msgr2=0x7f90601300d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90600a3bb0 0x7f90601300d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f906009e540 msgr2=0x7f906013d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f906009e540 0x7f906013d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.103+0000 7f905f7fe640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90600a23c0 con 0x7f90600a0750 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905f7fe640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 msgr2=0x7f906012fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905f7fe640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90500099a0 tx=0x7f90500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050047020 con 0x7f90600a0750 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: dump: 2026-02-17T12:01:42.113 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9050042690 con 0x7f90600a0750 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905003c040 con 0x7f90600a0750 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905cff9640 10 monclient: dump: 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f905e7fc640 4 set_mon_vals no callback set 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 5 monclient: authenticate success, global_id 204192 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 monclient: _renew_subs 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9060130da0 con 0x7f90600a0750 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 monclient: _renew_subs 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906013dc20 con 0x7f90600a0750 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 0x7f9060130610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.105+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90601314d0 con 0x7f9060132590 2026-02-17T12:01:42.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9050042a80 con 0x7f90600a0750 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 0x7f9060130610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient: get_auth_request con 0x7f9060132590 auth_method 0 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905cff9640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f903003dcf0 0x7f90300401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(589..589 src has 323..589) ==== 4799+0+0 (secure 0 0 0) 0x7f9050077eb0 con 0x7f90600a0750 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 10 monclient(hunting): handle_auth_done global_id 184315 payload 824 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f905ffff640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f906009dac0 con 0x7f9060132590 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f9064d2c640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f903003dcf0 0x7f90300401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.106+0000 7f9064d2c640 10 monclient: get_auth_request con 0x7f903003dcf0 auth_method 0 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905ffff640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 msgr2=0x7f9060130610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905ffff640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 0x7f9060130610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c007690 con 0x7f9060132590 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f905cff9640 10 monclient: dump: 2026-02-17T12:01:42.118 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.108+0000 7f9064d2c640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f903003dcf0 0x7f90300401b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9054004c90 tx=0x7f9054005220 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f904c016070 con 0x7f9060132590 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 msgr2=0x7f9060130610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 0x7f9060130610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c00cbc0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 msgr2=0x7f9060130610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.109+0000 7f905cff9640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9060132590 0x7f9060130610 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c00cbc0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.111+0000 7f90667b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f90667b6640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 0x7f90601d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f90667b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90600008d0 con 0x7f90601386e0 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 0x7f90601d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient: get_auth_request con 0x7f90601386e0 auth_method 0 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:42.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 10 monclient(hunting): handle_auth_done global_id 184318 payload 824 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.112+0000 7f905ffff640 1 -- 10.20.193.51:0/33193122 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9060050aa0 con 0x7f90601386e0 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905ffff640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 msgr2=0x7f90601d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905ffff640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 0x7f90601d9de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c007d80 con 0x7f90601386e0 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 10 monclient: dump: 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:01:42.121 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7f904c007d80 con 0x7f90601386e0 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 msgr2=0x7f90601d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 0x7f90601d9de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 msgr2=0x7f90601d9de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:01:42.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f905cff9640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90601386e0 0x7f90601d9de0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c6f0 tx=0x7f904c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 150, 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 134501, 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.123 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.124 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:01:42.125 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.126 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.127 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.128 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:01:42.129 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.130 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:01:42.131 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f903003dcf0 msgr2=0x7f90300401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f903003dcf0 0x7f90300401b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9054004c90 tx=0x7f9054005220 comp rx=0 tx=0).stop 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 10 monclient: shutdown 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 msgr2=0x7f906012fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90500099a0 tx=0x7f90500047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f9064d2c640 1 -- 10.20.193.51:0/33193122 reap_dead start 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 shutdown_connections 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 --2- 10.20.193.51:0/33193122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90600a0750 0x7f906012fb90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:42.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 >> 10.20.193.51:0/33193122 conn(0x7f90600a30c0 msgr2=0x7f9060072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:42.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 shutdown_connections 2026-02-17T12:01:42.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:01:42.115+0000 7f90667b6640 1 -- 10.20.193.51:0/33193122 wait complete. 2026-02-17T12:01:42.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:01:42.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2596: done (2 left) 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2597: done (1 left) 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2598: done (0 left) 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2599: read oid 43 snap -1 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2599: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2600: rollback oid 40 current snap is 282 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 280 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2601: rollback oid 9 current snap is 282 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 274 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2602: delete oid 6 current snap is 282 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:2600: finishing rollback tid 1 to trial14245205-40 2026-02-17T12:01:42.768 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:01:42.771 INFO:tasks.rados.rados.0.trial142.stdout:2600: done (3 left) 2026-02-17T12:01:42.771 INFO:tasks.rados.rados.0.trial142.stdout:2602: done (2 left) 2026-02-17T12:01:42.771 INFO:tasks.rados.rados.0.trial142.stdout:2603: delete oid 38 current snap is 282 2026-02-17T12:01:42.771 INFO:tasks.rados.rados.0.trial142.stdout:2599: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:01:42.956 INFO:tasks.rados.rados.0.trial142.stdout:2601: finishing rollback tid 0 to trial14245205-9 2026-02-17T12:01:42.956 INFO:tasks.rados.rados.0.trial142.stdout:2601: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:01:42.956 INFO:tasks.rados.rados.0.trial142.stdout:2601: finishing rollback tid 2 to trial14245205-9 2026-02-17T12:01:42.956 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2290 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2599: done (2 left) 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2601: done (1 left) 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2603: done (0 left) 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2604: copy_from oid 39 from oid 45 current snap is 282 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2605: copy_from oid 10 from oid 23 current snap is 282 2026-02-17T12:01:42.957 INFO:tasks.rados.rados.0.trial142.stdout:2606: rollback oid 5 current snap is 282 2026-02-17T12:01:42.958 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 5 to 264 2026-02-17T12:01:42.958 INFO:tasks.rados.rados.0.trial142.stdout:2607: snap_create 2026-02-17T12:01:42.958 INFO:tasks.rados.rados.0.trial142.stdout:2606: finishing rollback tid 0 to trial14245205-5 2026-02-17T12:01:42.959 INFO:tasks.rados.rados.0.trial142.stdout:2606: finishing rollback tid 1 to trial14245205-5 2026-02-17T12:01:42.959 INFO:tasks.rados.rados.0.trial142.stdout:2606: finishing rollback tid 2 to trial14245205-5 2026-02-17T12:01:42.959 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1175 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-17T12:01:42.960 INFO:tasks.rados.rados.0.trial142.stdout:2605: finishing copy_from racing read to trial14245205-10 2026-02-17T12:01:42.963 INFO:tasks.rados.rados.0.trial142.stdout:2604: finishing copy_from racing read to trial14245205-39 2026-02-17T12:01:42.963 INFO:tasks.rados.rados.0.trial142.stdout:2605: finishing copy_from to trial14245205-10 2026-02-17T12:01:42.963 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 1988 (ObjNum 866 snap 271 seq_num 866) dirty exists 2026-02-17T12:01:42.963 INFO:tasks.rados.rados.0.trial142.stdout:2604: finishing copy_from to trial14245205-39 2026-02-17T12:01:42.963 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 1982 (ObjNum 888 snap 281 seq_num 888) dirty exists 2026-02-17T12:01:43.772 INFO:tasks.rados.rados.0.trial142.stdout:2604: done (3 left) 2026-02-17T12:01:43.773 INFO:tasks.rados.rados.0.trial142.stdout:2605: done (2 left) 2026-02-17T12:01:43.773 INFO:tasks.rados.rados.0.trial142.stdout:2606: done (1 left) 2026-02-17T12:01:43.773 INFO:tasks.rados.rados.0.trial142.stdout:2607: done (0 left) 2026-02-17T12:01:43.773 INFO:tasks.rados.rados.0.trial142.stdout:2608: snap_create 2026-02-17T12:01:44.244 INFO:tasks.rados.rados.0.trial142.stdout:2608: done (0 left) 2026-02-17T12:01:44.244 INFO:tasks.rados.rados.0.trial142.stdout:2609: rollback oid 38 current snap is 284 2026-02-17T12:01:44.244 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 264 2026-02-17T12:01:44.244 INFO:tasks.rados.rados.0.trial142.stdout:2610: delete oid 13 current snap is 284 2026-02-17T12:01:44.247 INFO:tasks.rados.rados.0.trial142.stdout:2610: done (1 left) 2026-02-17T12:01:44.247 INFO:tasks.rados.rados.0.trial142.stdout:2611: write oid 27 current snap is 284 2026-02-17T12:01:44.247 INFO:tasks.rados.rados.0.trial142.stdout:2611: seq_num 892 ranges {591844=735409,1897938=531313,2862486=129358} 2026-02-17T12:01:44.252 INFO:tasks.rados.rados.0.trial142.stdout:2611: writing trial14245205-27 from 591844 to 1327253 tid 1 2026-02-17T12:01:44.256 INFO:tasks.rados.rados.0.trial142.stdout:2611: writing trial14245205-27 from 1897938 to 2429251 tid 2 2026-02-17T12:01:44.258 INFO:tasks.rados.rados.0.trial142.stdout:2611: writing trial14245205-27 from 2862486 to 2991844 tid 3 2026-02-17T12:01:44.258 INFO:tasks.rados.rados.0.trial142.stdout:2612: copy_from oid 43 from oid 14 current snap is 284 2026-02-17T12:01:44.258 INFO:tasks.rados.rados.0.trial142.stdout:2609: finishing rollback tid 1 to trial14245205-38 2026-02-17T12:01:44.258 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1989 (ObjNum 145 snap 0 seq_num 1213897472) dirty dne 2026-02-17T12:01:44.258 INFO:tasks.rados.rados.0.trial142.stdout:2611: finishing write tid 1 to trial14245205-27 2026-02-17T12:01:44.259 INFO:tasks.rados.rados.0.trial142.stdout:2609: done (2 left) 2026-02-17T12:01:44.259 INFO:tasks.rados.rados.0.trial142.stdout:2613: write oid 42 current snap is 284 2026-02-17T12:01:44.259 INFO:tasks.rados.rados.0.trial142.stdout:2613: seq_num 893 ranges {608651=410658,1556420=674971,2773556=235095} 2026-02-17T12:01:44.262 INFO:tasks.rados.rados.0.trial142.stdout:2613: writing trial14245205-42 from 608651 to 1019309 tid 1 2026-02-17T12:01:44.266 INFO:tasks.rados.rados.0.trial142.stdout:2613: writing trial14245205-42 from 1556420 to 2231391 tid 2 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2613: writing trial14245205-42 from 2773556 to 3008651 tid 3 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2614: delete oid 35 current snap is 284 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2611: finishing write tid 2 to trial14245205-27 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2611: finishing write tid 3 to trial14245205-27 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2611: finishing write tid 4 to trial14245205-27 2026-02-17T12:01:44.270 INFO:tasks.rados.rados.0.trial142.stdout:2611: finishing write tid 5 to trial14245205-27 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2611: oid 27 updating version 0 to 2112 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2611: oid 27 updating version 2112 to 2115 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2611: oid 27 version 2115 is already newer than 2114 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2611: oid 27 version 2115 is already newer than 2113 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2115 (ObjNum 892 snap 284 seq_num 892) dirty exists 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2611: left oid 27 (ObjNum 892 snap 284 seq_num 892) 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2613: finishing write tid 1 to trial14245205-42 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2612: finishing copy_from racing read to trial14245205-43 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2612: finishing copy_from to trial14245205-43 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2218 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T12:01:44.271 INFO:tasks.rados.rados.0.trial142.stdout:2613: finishing write tid 2 to trial14245205-42 2026-02-17T12:01:44.272 INFO:tasks.rados.rados.0.trial142.stdout:2611: done (3 left) 2026-02-17T12:01:44.272 INFO:tasks.rados.rados.0.trial142.stdout:2612: done (2 left) 2026-02-17T12:01:44.272 INFO:tasks.rados.rados.0.trial142.stdout:2614: done (1 left) 2026-02-17T12:01:44.272 INFO:tasks.rados.rados.0.trial142.stdout:2615: read oid 31 snap -1 2026-02-17T12:01:44.272 INFO:tasks.rados.rados.0.trial142.stdout:2615: expect (ObjNum 832 snap 261 seq_num 832) 2026-02-17T12:01:44.273 INFO:tasks.rados.rados.0.trial142.stdout:2616: snap_create 2026-02-17T12:01:44.274 INFO:tasks.rados.rados.0.trial142.stdout:2615: expect (ObjNum 832 snap 261 seq_num 832) 2026-02-17T12:01:44.368 INFO:tasks.rados.rados.0.trial142.stdout:2613: finishing write tid 3 to trial14245205-42 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: finishing write tid 4 to trial14245205-42 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: finishing write tid 5 to trial14245205-42 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: oid 42 updating version 0 to 1138 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: oid 42 version 1138 is already newer than 1137 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: oid 42 version 1138 is already newer than 1135 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: oid 42 version 1138 is already newer than 1136 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1138 (ObjNum 893 snap 284 seq_num 893) dirty exists 2026-02-17T12:01:44.369 INFO:tasks.rados.rados.0.trial142.stdout:2613: left oid 42 (ObjNum 893 snap 284 seq_num 893) 2026-02-17T12:01:45.246 INFO:tasks.rados.rados.0.trial142.stdout:2613: done (2 left) 2026-02-17T12:01:45.246 INFO:tasks.rados.rados.0.trial142.stdout:2615: done (1 left) 2026-02-17T12:01:45.246 INFO:tasks.rados.rados.0.trial142.stdout:2616: done (0 left) 2026-02-17T12:01:45.246 INFO:tasks.rados.rados.0.trial142.stdout:2617: delete oid 2 current snap is 285 2026-02-17T12:01:45.248 INFO:tasks.rados.rados.0.trial142.stdout:2617: done (0 left) 2026-02-17T12:01:45.248 INFO:tasks.rados.rados.0.trial142.stdout:2618: write oid 41 current snap is 285 2026-02-17T12:01:45.248 INFO:tasks.rados.rados.0.trial142.stdout:2618: seq_num 896 ranges {659072=636405,1731866=422298,2855825=203247} 2026-02-17T12:01:45.252 INFO:tasks.rados.rados.0.trial142.stdout:2618: writing trial14245205-41 from 659072 to 1295477 tid 1 2026-02-17T12:01:45.256 INFO:tasks.rados.rados.0.trial142.stdout:2618: writing trial14245205-41 from 1731866 to 2154164 tid 2 2026-02-17T12:01:45.259 INFO:tasks.rados.rados.0.trial142.stdout:2618: writing trial14245205-41 from 2855825 to 3059072 tid 3 2026-02-17T12:01:45.259 INFO:tasks.rados.rados.0.trial142.stdout:2619: read oid 5 snap 264 2026-02-17T12:01:45.259 INFO:tasks.rados.rados.0.trial142.stdout:2619: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:01:45.259 INFO:tasks.rados.rados.0.trial142.stdout:2620: write (excl) oid 33 current snap is 285 2026-02-17T12:01:45.259 INFO:tasks.rados.rados.0.trial142.stdout:2620: seq_num 897 ranges {675879=711654,2073995=682309} 2026-02-17T12:01:45.264 INFO:tasks.rados.rados.0.trial142.stdout:2620: writing trial14245205-33 from 675879 to 1387533 tid 1 2026-02-17T12:01:45.269 INFO:tasks.rados.rados.0.trial142.stdout:2620: writing trial14245205-33 from 2073995 to 2756304 tid 2 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2621: snap_create 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: finishing write tid 1 to trial14245205-41 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: finishing write tid 2 to trial14245205-41 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: finishing write tid 3 to trial14245205-41 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: finishing write tid 4 to trial14245205-41 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: finishing write tid 5 to trial14245205-41 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: oid 41 updating version 0 to 1977 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: oid 41 version 1977 is already newer than 1976 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: oid 41 updating version 1977 to 1978 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: oid 41 version 1978 is already newer than 1975 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1978 (ObjNum 896 snap 285 seq_num 896) dirty exists 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2618: left oid 41 (ObjNum 896 snap 285 seq_num 896) 2026-02-17T12:01:45.270 INFO:tasks.rados.rados.0.trial142.stdout:2619: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:01:45.415 INFO:tasks.rados.rados.0.trial142.stdout:2620: finishing write tid 1 to trial14245205-33 2026-02-17T12:01:45.415 INFO:tasks.rados.rados.0.trial142.stdout:2620: finishing write tid 2 to trial14245205-33 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: finishing write tid 3 to trial14245205-33 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: finishing write tid 4 to trial14245205-33 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: oid 33 updating version 0 to 2118 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: oid 33 version 2118 is already newer than 2116 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: oid 33 version 2118 is already newer than 2117 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 2118 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:01:45.416 INFO:tasks.rados.rados.0.trial142.stdout:2620: left oid 33 (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2618: done (3 left) 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2619: done (2 left) 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2620: done (1 left) 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2621: done (0 left) 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2622: rollback oid 40 current snap is 286 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 278 2026-02-17T12:01:46.247 INFO:tasks.rados.rados.0.trial142.stdout:2623: snap_create 2026-02-17T12:01:46.249 INFO:tasks.rados.rados.0.trial142.stdout:2622: finishing rollback tid 1 to trial14245205-40 2026-02-17T12:01:46.249 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 0 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T12:01:47.249 INFO:tasks.rados.rados.0.trial142.stdout:2622: done (1 left) 2026-02-17T12:01:47.249 INFO:tasks.rados.rados.0.trial142.stdout:2623: done (0 left) 2026-02-17T12:01:47.249 INFO:tasks.rados.rados.0.trial142.stdout:2624: delete oid 22 current snap is 287 2026-02-17T12:01:47.252 INFO:tasks.rados.rados.0.trial142.stdout:2624: done (0 left) 2026-02-17T12:01:47.252 INFO:tasks.rados.rados.0.trial142.stdout:2625: write oid 27 current snap is 287 2026-02-17T12:01:47.252 INFO:tasks.rados.rados.0.trial142.stdout:2625: seq_num 899 ranges {709493=578505,1907312=685978} 2026-02-17T12:01:47.257 INFO:tasks.rados.rados.0.trial142.stdout:2625: writing trial14245205-27 from 709493 to 1287998 tid 1 2026-02-17T12:01:47.262 INFO:tasks.rados.rados.0.trial142.stdout:2625: writing trial14245205-27 from 1907312 to 2593290 tid 2 2026-02-17T12:01:47.262 INFO:tasks.rados.rados.0.trial142.stdout:2626: rollback oid 39 current snap is 287 2026-02-17T12:01:47.263 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 274 2026-02-17T12:01:47.263 INFO:tasks.rados.rados.0.trial142.stdout:2627: write (excl) oid 4 current snap is 287 2026-02-17T12:01:47.263 INFO:tasks.rados.rados.0.trial142.stdout:2627: seq_num 900 ranges {726300=653754,1965794=429636,2965517=160783} 2026-02-17T12:01:47.267 INFO:tasks.rados.rados.0.trial142.stdout:2627: writing trial14245205-4 from 726300 to 1380054 tid 1 2026-02-17T12:01:47.271 INFO:tasks.rados.rados.0.trial142.stdout:2627: writing trial14245205-4 from 1965794 to 2395430 tid 2 2026-02-17T12:01:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2627: writing trial14245205-4 from 2965517 to 3126300 tid 3 2026-02-17T12:01:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2628: delete oid 13 current snap is 287 2026-02-17T12:01:47.274 INFO:tasks.rados.rados.0.trial142.stdout:2625: finishing write tid 1 to trial14245205-27 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: finishing write tid 2 to trial14245205-27 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2626: finishing rollback tid 0 to trial14245205-39 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: finishing write tid 3 to trial14245205-27 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: finishing write tid 4 to trial14245205-27 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: oid 27 updating version 0 to 2120 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: oid 27 updating version 2120 to 2121 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: oid 27 version 2121 is already newer than 2119 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2121 (ObjNum 899 snap 287 seq_num 899) dirty exists 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2625: left oid 27 (ObjNum 899 snap 287 seq_num 899) 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2626: finishing rollback tid 1 to trial14245205-39 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2626: finishing rollback tid 2 to trial14245205-39 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2123 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2627: finishing write tid 1 to trial14245205-4 2026-02-17T12:01:47.275 INFO:tasks.rados.rados.0.trial142.stdout:2627: finishing write tid 2 to trial14245205-4 2026-02-17T12:01:47.276 INFO:tasks.rados.rados.0.trial142.stdout:2625: done (3 left) 2026-02-17T12:01:47.276 INFO:tasks.rados.rados.0.trial142.stdout:2626: done (2 left) 2026-02-17T12:01:47.276 INFO:tasks.rados.rados.0.trial142.stdout:2628: done (1 left) 2026-02-17T12:01:47.276 INFO:tasks.rados.rados.0.trial142.stdout:2629: write (excl) oid 42 current snap is 287 2026-02-17T12:01:47.276 INFO:tasks.rados.rados.0.trial142.stdout:2629: seq_num 902 ranges {759914=404252,1566405=433305,2504010=655904} 2026-02-17T12:01:47.280 INFO:tasks.rados.rados.0.trial142.stdout:2629: writing trial14245205-42 from 759914 to 1164166 tid 1 2026-02-17T12:01:47.283 INFO:tasks.rados.rados.0.trial142.stdout:2629: writing trial14245205-42 from 1566405 to 1999710 tid 2 2026-02-17T12:01:47.288 INFO:tasks.rados.rados.0.trial142.stdout:2629: writing trial14245205-42 from 2504010 to 3159914 tid 3 2026-02-17T12:01:47.288 INFO:tasks.rados.rados.0.trial142.stdout:2630: copy_from oid 8 from oid 21 current snap is 287 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: finishing write tid 3 to trial14245205-4 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: finishing write tid 4 to trial14245205-4 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: finishing write tid 5 to trial14245205-4 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: oid 4 updating version 0 to 2295 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: oid 4 version 2295 is already newer than 2294 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: oid 4 updating version 2295 to 2296 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: oid 4 updating version 2296 to 2297 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2297 (ObjNum 900 snap 287 seq_num 900) dirty exists 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: left oid 4 (ObjNum 900 snap 287 seq_num 900) 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2629: finishing write tid 1 to trial14245205-42 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2629: finishing write tid 2 to trial14245205-42 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2627: done (2 left) 2026-02-17T12:01:47.289 INFO:tasks.rados.rados.0.trial142.stdout:2631: rollback oid 47 current snap is 287 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 278 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:2632: read oid 40 snap -1 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:2632: expect deleted 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:2633: snap_create 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:2631: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:01:47.290 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 0 (ObjNum 257 snap 0 seq_num 1213156096) dirty dne 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: finishing write tid 3 to trial14245205-42 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: finishing write tid 4 to trial14245205-42 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: finishing write tid 5 to trial14245205-42 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: oid 42 updating version 0 to 1141 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: oid 42 version 1141 is already newer than 1140 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: oid 42 version 1141 is already newer than 1139 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: oid 42 updating version 1141 to 1142 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1142 (ObjNum 902 snap 287 seq_num 902) dirty exists 2026-02-17T12:01:47.291 INFO:tasks.rados.rados.0.trial142.stdout:2629: left oid 42 (ObjNum 902 snap 287 seq_num 902) 2026-02-17T12:01:47.292 INFO:tasks.rados.rados.0.trial142.stdout:2630: finishing copy_from racing read to trial14245205-8 2026-02-17T12:01:47.293 INFO:tasks.rados.rados.0.trial142.stdout:2630: finishing copy_from to trial14245205-8 2026-02-17T12:01:47.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1976 (ObjNum 836 snap 264 seq_num 836) dirty exists 2026-02-17T12:01:48.255 INFO:tasks.rados.rados.0.trial142.stdout:2629: done (4 left) 2026-02-17T12:01:48.256 INFO:tasks.rados.rados.0.trial142.stdout:2630: done (3 left) 2026-02-17T12:01:48.256 INFO:tasks.rados.rados.0.trial142.stdout:2631: done (2 left) 2026-02-17T12:01:48.256 INFO:tasks.rados.rados.0.trial142.stdout:2632: done (1 left) 2026-02-17T12:01:48.256 INFO:tasks.rados.rados.0.trial142.stdout:2633: done (0 left) 2026-02-17T12:01:48.256 INFO:tasks.rados.rados.0.trial142.stdout:2634: rollback oid 7 current snap is 288 2026-02-17T12:01:48.257 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 270 2026-02-17T12:01:48.257 INFO:tasks.rados.rados.0.trial142.stdout:2635: snap_create 2026-02-17T12:01:48.259 INFO:tasks.rados.rados.0.trial142.stdout:2634: finishing rollback tid 0 to trial14245205-7 2026-02-17T12:01:48.259 INFO:tasks.rados.rados.0.trial142.stdout:2634: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:01:48.259 INFO:tasks.rados.rados.0.trial142.stdout:2634: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:01:48.259 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2301 (ObjNum 857 snap 270 seq_num 857) dirty exists 2026-02-17T12:01:49.244 INFO:tasks.rados.rados.0.trial142.stdout:2634: done (1 left) 2026-02-17T12:01:49.244 INFO:tasks.rados.rados.0.trial142.stdout:2635: done (0 left) 2026-02-17T12:01:49.244 INFO:tasks.rados.rados.0.trial142.stdout:2636: snap_remove snap 273 2026-02-17T12:01:50.247 INFO:tasks.rados.rados.0.trial142.stdout:2636: done (0 left) 2026-02-17T12:01:50.247 INFO:tasks.rados.rados.0.trial142.stdout:2637: snap_remove snap 281 2026-02-17T12:01:51.248 INFO:tasks.rados.rados.0.trial142.stdout:2637: done (0 left) 2026-02-17T12:01:51.248 INFO:tasks.rados.rados.0.trial142.stdout:2638: snap_create 2026-02-17T12:01:52.252 INFO:tasks.rados.rados.0.trial142.stdout:2638: done (0 left) 2026-02-17T12:01:52.252 INFO:tasks.rados.rados.0.trial142.stdout:2639: read oid 1 snap -1 2026-02-17T12:01:52.252 INFO:tasks.rados.rados.0.trial142.stdout:2639: expect deleted 2026-02-17T12:01:52.252 INFO:tasks.rados.rados.0.trial142.stdout:2640: snap_create 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2639: done (1 left) 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2640: done (0 left) 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2641: copy_from oid 42 from oid 30 current snap is 291 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2642: copy_from oid 1 from oid 37 current snap is 291 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2643: rollback oid 48 current snap is 291 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 270 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2644: write oid 2 current snap is 291 2026-02-17T12:01:53.253 INFO:tasks.rados.rados.0.trial142.stdout:2644: seq_num 903 ranges {776721=479501,2024887=693316} 2026-02-17T12:01:53.258 INFO:tasks.rados.rados.0.trial142.stdout:2644: writing trial14245205-2 from 776721 to 1256222 tid 1 2026-02-17T12:01:53.264 INFO:tasks.rados.rados.0.trial142.stdout:2644: writing trial14245205-2 from 2024887 to 2718203 tid 2 2026-02-17T12:01:53.264 INFO:tasks.rados.rados.0.trial142.stdout:2645: snap_remove snap 267 2026-02-17T12:01:54.266 INFO:tasks.rados.rados.0.trial142.stdout:2645: done (4 left) 2026-02-17T12:01:54.266 INFO:tasks.rados.rados.0.trial142.stdout:2646: delete oid 26 current snap is 291 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2643: finishing rollback tid 0 to trial14245205-48 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2643: finishing rollback tid 1 to trial14245205-48 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2644: finishing write tid 1 to trial14245205-2 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2641: finishing copy_from racing read to trial14245205-42 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2643: finishing rollback tid 2 to trial14245205-48 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 1965 (ObjNum 808 snap 253 seq_num 808) dirty exists 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2641: finishing copy_from to trial14245205-42 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 1962 (ObjNum 864 snap 271 seq_num 864) dirty exists 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2642: finishing copy_from racing read to trial14245205-1 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2642: finishing copy_from to trial14245205-1 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2120 (ObjNum 870 snap 273 seq_num 870) dirty exists 2026-02-17T12:01:54.267 INFO:tasks.rados.rados.0.trial142.stdout:2644: finishing write tid 2 to trial14245205-2 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: finishing write tid 3 to trial14245205-2 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: finishing write tid 4 to trial14245205-2 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: oid 2 updating version 0 to 1979 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: oid 2 updating version 1979 to 1981 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: oid 2 version 1981 is already newer than 1980 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 1981 (ObjNum 903 snap 291 seq_num 903) dirty exists 2026-02-17T12:01:54.268 INFO:tasks.rados.rados.0.trial142.stdout:2644: left oid 2 (ObjNum 903 snap 291 seq_num 903) 2026-02-17T12:01:54.275 INFO:tasks.rados.rados.0.trial142.stdout:2641: done (4 left) 2026-02-17T12:01:54.275 INFO:tasks.rados.rados.0.trial142.stdout:2642: done (3 left) 2026-02-17T12:01:54.275 INFO:tasks.rados.rados.0.trial142.stdout:2643: done (2 left) 2026-02-17T12:01:54.276 INFO:tasks.rados.rados.0.trial142.stdout:2644: done (1 left) 2026-02-17T12:01:54.276 INFO:tasks.rados.rados.0.trial142.stdout:2646: done (0 left) 2026-02-17T12:01:54.276 INFO:tasks.rados.rados.0.trial142.stdout:2647: write (excl) oid 36 current snap is 291 2026-02-17T12:01:54.276 INFO:tasks.rados.rados.0.trial142.stdout:2647: seq_num 905 ranges {410335=746352,1741851=696985,3102632=107703} 2026-02-17T12:01:54.280 INFO:tasks.rados.rados.0.trial142.stdout:2647: writing trial14245205-36 from 410335 to 1156687 tid 1 2026-02-17T12:01:54.284 INFO:tasks.rados.rados.0.trial142.stdout:2647: writing trial14245205-36 from 1741851 to 2438836 tid 2 2026-02-17T12:01:54.287 INFO:tasks.rados.rados.0.trial142.stdout:2647: writing trial14245205-36 from 3102632 to 3210335 tid 3 2026-02-17T12:01:54.287 INFO:tasks.rados.rados.0.trial142.stdout:2648: snap_remove snap 285 2026-02-17T12:01:54.287 INFO:tasks.rados.rados.0.trial142.stdout:2647: finishing write tid 1 to trial14245205-36 2026-02-17T12:01:54.287 INFO:tasks.rados.rados.0.trial142.stdout:2647: finishing write tid 2 to trial14245205-36 2026-02-17T12:01:55.276 INFO:tasks.rados.rados.0.trial142.stdout:2648: done (1 left) 2026-02-17T12:01:55.276 INFO:tasks.rados.rados.0.trial142.stdout:2649: delete oid 43 current snap is 291 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: finishing write tid 3 to trial14245205-36 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: finishing write tid 4 to trial14245205-36 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: finishing write tid 5 to trial14245205-36 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: oid 36 updating version 0 to 1964 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: oid 36 version 1964 is already newer than 1963 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: oid 36 updating version 1964 to 1965 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: oid 36 updating version 1965 to 1966 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 1966 (ObjNum 905 snap 291 seq_num 905) dirty exists 2026-02-17T12:01:55.277 INFO:tasks.rados.rados.0.trial142.stdout:2647: left oid 36 (ObjNum 905 snap 291 seq_num 905) 2026-02-17T12:01:55.285 INFO:tasks.rados.rados.0.trial142.stdout:2647: done (1 left) 2026-02-17T12:01:55.285 INFO:tasks.rados.rados.0.trial142.stdout:2649: done (0 left) 2026-02-17T12:01:55.285 INFO:tasks.rados.rados.0.trial142.stdout:2650: snap_create 2026-02-17T12:01:56.278 INFO:tasks.rados.rados.0.trial142.stdout:2650: done (0 left) 2026-02-17T12:01:56.278 INFO:tasks.rados.rados.0.trial142.stdout:2651: write oid 22 current snap is 292 2026-02-17T12:01:56.278 INFO:tasks.rados.rados.0.trial142.stdout:2651: seq_num 907 ranges {443949=496850,1458815=584301,2641125=602824} 2026-02-17T12:01:56.282 INFO:tasks.rados.rados.0.trial142.stdout:2651: writing trial14245205-22 from 443949 to 940799 tid 1 2026-02-17T12:01:56.285 INFO:tasks.rados.rados.0.trial142.stdout:2651: writing trial14245205-22 from 1458815 to 2043116 tid 2 2026-02-17T12:01:56.290 INFO:tasks.rados.rados.0.trial142.stdout:2651: writing trial14245205-22 from 2641125 to 3243949 tid 3 2026-02-17T12:01:56.290 INFO:tasks.rados.rados.0.trial142.stdout:2652: snap_remove snap 280 2026-02-17T12:01:57.281 INFO:tasks.rados.rados.0.trial142.stdout:2652: done (1 left) 2026-02-17T12:01:57.281 INFO:tasks.rados.rados.0.trial142.stdout:2653: write (excl) oid 25 current snap is 292 2026-02-17T12:01:57.281 INFO:tasks.rados.rados.0.trial142.stdout:2653: seq_num 908 ranges {460756=572099,1517297=444312,2668548=472870} 2026-02-17T12:01:57.284 INFO:tasks.rados.rados.0.trial142.stdout:2653: writing trial14245205-25 from 460756 to 1032855 tid 1 2026-02-17T12:01:57.288 INFO:tasks.rados.rados.0.trial142.stdout:2653: writing trial14245205-25 from 1517297 to 1961609 tid 2 2026-02-17T12:01:57.293 INFO:tasks.rados.rados.0.trial142.stdout:2653: writing trial14245205-25 from 2668548 to 3141418 tid 3 2026-02-17T12:01:57.293 INFO:tasks.rados.rados.0.trial142.stdout:2654: read oid 34 snap -1 2026-02-17T12:01:57.293 INFO:tasks.rados.rados.0.trial142.stdout:2654: expect deleted 2026-02-17T12:01:57.293 INFO:tasks.rados.rados.0.trial142.stdout:2655: snap_remove snap 289 2026-02-17T12:01:58.283 INFO:tasks.rados.rados.0.trial142.stdout:2655: done (3 left) 2026-02-17T12:01:58.283 INFO:tasks.rados.rados.0.trial142.stdout:2656: write oid 16 current snap is 292 2026-02-17T12:01:58.283 INFO:tasks.rados.rados.0.trial142.stdout:2656: seq_num 909 ranges {477563=647348,1859426=587970,2979618=297945} 2026-02-17T12:01:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2656: writing trial14245205-16 from 477563 to 1124911 tid 1 2026-02-17T12:01:58.293 INFO:tasks.rados.rados.0.trial142.stdout:2656: writing trial14245205-16 from 1859426 to 2447396 tid 2 2026-02-17T12:01:58.296 INFO:tasks.rados.rados.0.trial142.stdout:2656: writing trial14245205-16 from 2979618 to 3277563 tid 3 2026-02-17T12:01:58.296 INFO:tasks.rados.rados.0.trial142.stdout:2657: snap_remove snap 270 2026-02-17T12:01:59.246 INFO:tasks.rados.rados.0.trial142.stdout:2657: done (4 left) 2026-02-17T12:01:59.246 INFO:tasks.rados.rados.0.trial142.stdout:2658: snap_remove snap 264 2026-02-17T12:02:00.249 INFO:tasks.rados.rados.0.trial142.stdout:2658: done (4 left) 2026-02-17T12:02:00.249 INFO:tasks.rados.rados.0.trial142.stdout:2659: snap_create 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: finishing write tid 1 to trial14245205-22 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: finishing write tid 2 to trial14245205-22 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: finishing write tid 3 to trial14245205-22 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: finishing write tid 4 to trial14245205-22 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: finishing write tid 5 to trial14245205-22 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: oid 22 updating version 0 to 2122 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: oid 22 updating version 2122 to 2124 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: oid 22 version 2124 is already newer than 2123 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: oid 22 version 2124 is already newer than 2121 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2124 (ObjNum 907 snap 292 seq_num 907) dirty exists 2026-02-17T12:02:00.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: left oid 22 (ObjNum 907 snap 292 seq_num 907) 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: finishing write tid 1 to trial14245205-25 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: finishing write tid 2 to trial14245205-25 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: finishing write tid 3 to trial14245205-25 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: finishing write tid 4 to trial14245205-25 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: finishing write tid 5 to trial14245205-25 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: oid 25 updating version 0 to 1991 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: oid 25 updating version 1991 to 1993 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: oid 25 version 1993 is already newer than 1990 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: oid 25 version 1993 is already newer than 1992 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 1993 (ObjNum 908 snap 292 seq_num 908) dirty exists 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: left oid 25 (ObjNum 908 snap 292 seq_num 908) 2026-02-17T12:02:00.251 INFO:tasks.rados.rados.0.trial142.stdout:2656: finishing write tid 1 to trial14245205-16 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: finishing write tid 2 to trial14245205-16 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: finishing write tid 3 to trial14245205-16 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: finishing write tid 4 to trial14245205-16 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: finishing write tid 5 to trial14245205-16 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: oid 16 updating version 0 to 1178 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: oid 16 updating version 1178 to 1179 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: oid 16 version 1179 is already newer than 1177 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: oid 16 version 1179 is already newer than 1176 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1179 (ObjNum 909 snap 292 seq_num 909) dirty exists 2026-02-17T12:02:00.252 INFO:tasks.rados.rados.0.trial142.stdout:2656: left oid 16 (ObjNum 909 snap 292 seq_num 909) 2026-02-17T12:02:01.250 INFO:tasks.rados.rados.0.trial142.stdout:2651: done (4 left) 2026-02-17T12:02:01.251 INFO:tasks.rados.rados.0.trial142.stdout:2653: done (3 left) 2026-02-17T12:02:01.251 INFO:tasks.rados.rados.0.trial142.stdout:2654: done (2 left) 2026-02-17T12:02:01.251 INFO:tasks.rados.rados.0.trial142.stdout:2656: done (1 left) 2026-02-17T12:02:01.251 INFO:tasks.rados.rados.0.trial142.stdout:2659: done (0 left) 2026-02-17T12:02:01.251 INFO:tasks.rados.rados.0.trial142.stdout:2660: snap_remove snap 282 2026-02-17T12:02:02.135 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:02:02.135 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:02:02.135 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:02:02.136 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:02:02.139 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:02:02.139 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:02:02.140 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 10 monclient: get_monmap_and_config 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 10 monclient: build_initial_monmap 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 10 monclient: monmap: 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:02.206392+0000 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:02.206392+0000 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:02.207 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:02.208 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:02.208 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:02.208 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 1 Processor -- start 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 1 -- start start 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.205+0000 7f6e9aee2640 10 monclient: init 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6e94138600 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:02.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-b con 0x7f6e940a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6e9413d8a0 0x7f6e9413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-c con 0x7f6e9413d8a0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e940a1df0 con 0x7f6e94138600 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6e940a6830 con 0x7f6e9413d8a0 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6e940a2c00 con 0x7f6e940a35a0 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e9aee2640 10 monclient(hunting): authenticate will time out at 1609.825259s 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:35558/0 (socket says 10.20.193.51:35558) 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 -- 10.20.193.51:0/4244990673 learned_addr learned my addr 10.20.193.51:0/4244990673 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request con 0x7f6e940a35a0 auth_method 0 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:02.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 -- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 msgr2=0x7f6e9413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 -- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 msgr2=0x7f6e9413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 --2- 10.20.193.51:0/4244990673 >> v2:10.20.193.142:3300/0 conn(0x7f6e9413d8a0 0x7f6e9413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): get_auth_request con 0x7f6e9413d8a0 auth_method 0 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient(hunting): handle_auth_done global_id 184321 payload 274 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 -- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 msgr2=0x7f6e9413d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:02.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 -- 10.20.193.51:0/4244990673 >> v1:10.20.193.142:6789/0 conn(0x7f6e94138600 legacy=0x7f6e941389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient: _finish_hunting 0 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 monclient: found mon.noname-c 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:02.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.206+0000 7f6e99458640 1 -- 10.20.193.51:0/4244990673 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940a65b0 con 0x7f6e9413d8a0 2026-02-17T12:02:02.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e99458640 1 -- 10.20.193.51:0/4244990673 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 msgr2=0x7f6e9413fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:02.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e99458640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e9413fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009d90 tx=0x7f6e9002f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f63ea4293eca1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:02.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 1 -- 10.20.193.51:0/4244990673 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9003c070 con 0x7f6e9413d8a0 2026-02-17T12:02:02.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:02.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: dump: 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:02.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 1 -- 10.20.193.51:0/4244990673 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90037440 con 0x7f6e9413d8a0 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 1 -- 10.20.193.51:0/4244990673 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90037810 con 0x7f6e9413d8a0 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e8b7fe640 10 monclient: dump: 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:02.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e9aee2640 5 monclient: authenticate success, global_id 184321 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e9aee2640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.209+0000 7f6e9aee2640 4 set_mon_vals no callback set 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: shutdown 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- 10.20.193.51:0/4244990673 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 msgr2=0x7f6e9413fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e9413fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009d90 tx=0x7f6e9002f190 comp rx=0 tx=0).stop 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- 10.20.193.51:0/4244990673 shutdown_connections 2026-02-17T12:02:02.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e9413fc90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/4244990673 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e940a35a0 0x7f6e9413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- 10.20.193.51:0/4244990673 >> 10.20.193.51:0/4244990673 conn(0x7f6e940a7460 msgr2=0x7f6e940a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- 10.20.193.51:0/4244990673 shutdown_connections 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- 10.20.193.51:0/4244990673 wait complete. 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: build_initial_monmap 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: monmap: 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:02.222 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 Processor -- start 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 -- start start 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: init 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 0x7f6e94135440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.210+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-a con 0x7f6e940a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-c con 0x7f6e94138600 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e94135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): picked mon.noname-b con 0x7f6e9413d8a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940a15f0 con 0x7f6e940a35a0 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940a25b0 con 0x7f6e9413d8a0 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6e940a1770 con 0x7f6e94138600 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e9aee2640 10 monclient(hunting): authenticate will time out at 1609.830032s 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:35574/0 (socket says 10.20.193.51:35574) 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 -- 10.20.193.51:0/1976243246 learned_addr learned my addr 10.20.193.51:0/1976243246 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request con 0x7f6e94138600 auth_method 0 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:02.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 0x7f6e94135440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 msgr2=0x7f6e94135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 msgr2=0x7f6e94135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): get_auth_request con 0x7f6e940a35a0 auth_method 0 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:02.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e94135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): get_auth_request con 0x7f6e9413d8a0 auth_method 0 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e99458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient(hunting): handle_auth_done global_id 204195 payload 824 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 msgr2=0x7f6e94135980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 msgr2=0x7f6e94135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e94135ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient: _finish_hunting 0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 monclient: found mon.noname-a 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.211+0000 7f6e98c57640 1 -- 10.20.193.51:0/1976243246 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e94072020 con 0x7f6e940a35a0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e98c57640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 msgr2=0x7f6e94135440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e98c57640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 0x7f6e94135440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c450 tx=0x7f6e8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84016020 con 0x7f6e940a35a0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: dump: 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:02.227 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: _finish_auth 0 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: _check_auth_tickets 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e84012a40 con 0x7f6e940a35a0 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 5 monclient: authenticate success, global_id 204195 2026-02-17T12:02:02.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 10 monclient: _renew_subs 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9413d200 con 0x7f6e940a35a0 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84012e30 con 0x7f6e940a35a0 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e897fa640 10 monclient: dump: 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.229 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e8affd640 4 set_mon_vals no callback set 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 10 monclient: _renew_subs 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.213+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e940734d0 con 0x7f6e940a35a0 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e9aee2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:02.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e9aee2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e9aee2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e94073870 con 0x7f6e940a35a0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6e8401b400 con 0x7f6e940a35a0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e897fa640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 0x7f6e640401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(609..609 src has 323..609) ==== 4815+0+0 (secure 0 0 0) 0x7f6e840526a0 con 0x7f6e940a35a0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 0x7f6e640401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.214+0000 7f6e8bfff640 10 monclient: get_auth_request con 0x7f6e6403dd10 auth_method 0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.216+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6e84020030 con 0x7f6e940a35a0 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.216+0000 7f6e897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:02.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.216+0000 7f6e897fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:02.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.217+0000 7f6e8bfff640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 0x7f6e640401d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e9413cbc0 tx=0x7f6e7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:02.251 INFO:tasks.rados.rados.0.trial142.stdout:2660: done (0 left) 2026-02-17T12:02:02.251 INFO:tasks.rados.rados.0.trial142.stdout:2661: read oid 16 snap -1 2026-02-17T12:02:02.252 INFO:tasks.rados.rados.0.trial142.stdout:2661: expect (ObjNum 909 snap 292 seq_num 909) 2026-02-17T12:02:02.252 INFO:tasks.rados.rados.0.trial142.stdout:2662: snap_create 2026-02-17T12:02:02.260 INFO:tasks.rados.rados.0.trial142.stdout:2661: expect (ObjNum 909 snap 292 seq_num 909) 2026-02-17T12:02:02.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e9aee2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:02.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e9aee2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:02.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e9aee2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:02.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6e94071da0 con 0x7f6e940a35a0 2026-02-17T12:02:02.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e897fa640 1 -- 10.20.193.51:0/1976243246 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f6e9413d200 con 0x7f6e940a35a0 2026-02-17T12:02:02.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:02.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.333+0000 7f6e897fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:02.335 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 msgr2=0x7f6e640401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 0x7f6e640401d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e9413cbc0 tx=0x7f6e7c008040 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 10 monclient: shutdown 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 msgr2=0x7f6e94135440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 0x7f6e94135440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c450 tx=0x7f6e8400c920 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 shutdown_connections 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6e6403dd10 0x7f6e640401d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6e9413d8a0 0x7f6e94135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6e94138600 0x7f6e94135980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 --2- 10.20.193.51:0/1976243246 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6e940a35a0 0x7f6e94135440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 >> 10.20.193.51:0/1976243246 conn(0x7f6e940a7460 msgr2=0x7f6e940a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 shutdown_connections 2026-02-17T12:02:02.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:02.334+0000 7f6e9aee2640 1 -- 10.20.193.51:0/1976243246 wait complete. 2026-02-17T12:02:03.257 INFO:tasks.rados.rados.0.trial142.stdout:2661: done (1 left) 2026-02-17T12:02:03.258 INFO:tasks.rados.rados.0.trial142.stdout:2662: done (0 left) 2026-02-17T12:02:03.258 INFO:tasks.rados.rados.0.trial142.stdout:2663: read oid 43 snap 293 2026-02-17T12:02:03.258 INFO:tasks.rados.rados.0.trial142.stdout:2663: expect deleted 2026-02-17T12:02:03.258 INFO:tasks.rados.rados.0.trial142.stdout:2664: write oid 8 current snap is 294 2026-02-17T12:02:03.258 INFO:tasks.rados.rados.0.trial142.stdout:2664: seq_num 910 ranges {494370=722597,1917908=447981,3007041=287329} 2026-02-17T12:02:03.261 INFO:tasks.rados.rados.0.trial142.stdout:2664: writing trial14245205-8 from 494370 to 1216967 tid 1 2026-02-17T12:02:03.265 INFO:tasks.rados.rados.0.trial142.stdout:2664: writing trial14245205-8 from 1917908 to 2365889 tid 2 2026-02-17T12:02:03.269 INFO:tasks.rados.rados.0.trial142.stdout:2664: writing trial14245205-8 from 3007041 to 3294370 tid 3 2026-02-17T12:02:03.269 INFO:tasks.rados.rados.0.trial142.stdout:2665: delete oid 35 current snap is 294 2026-02-17T12:02:03.269 INFO:tasks.rados.rados.0.trial142.stdout:2664: finishing write tid 1 to trial14245205-8 2026-02-17T12:02:03.270 INFO:tasks.rados.rados.0.trial142.stdout:2664: finishing write tid 2 to trial14245205-8 2026-02-17T12:02:03.271 INFO:tasks.rados.rados.0.trial142.stdout:2664: finishing write tid 3 to trial14245205-8 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: finishing write tid 4 to trial14245205-8 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: finishing write tid 5 to trial14245205-8 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: oid 8 updating version 0 to 2125 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: oid 8 version 2125 is already newer than 2124 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: oid 8 version 2125 is already newer than 2123 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: oid 8 version 2125 is already newer than 2122 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2125 (ObjNum 910 snap 294 seq_num 910) dirty exists 2026-02-17T12:02:03.272 INFO:tasks.rados.rados.0.trial142.stdout:2664: left oid 8 (ObjNum 910 snap 294 seq_num 910) 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2663: done (2 left) 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2664: done (1 left) 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2665: done (0 left) 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2666: read oid 34 snap -1 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2666: expect deleted 2026-02-17T12:02:03.273 INFO:tasks.rados.rados.0.trial142.stdout:2667: snap_remove snap 292 2026-02-17T12:02:04.246 INFO:tasks.rados.rados.0.trial142.stdout:2667: done (1 left) 2026-02-17T12:02:04.246 INFO:tasks.rados.rados.0.trial142.stdout:2668: snap_remove snap 288 2026-02-17T12:02:05.246 INFO:tasks.rados.rados.0.trial142.stdout:2668: done (1 left) 2026-02-17T12:02:05.246 INFO:tasks.rados.rados.0.trial142.stdout:2669: read oid 19 snap 283 2026-02-17T12:02:05.246 INFO:tasks.rados.rados.0.trial142.stdout:2669: expect deleted 2026-02-17T12:02:05.246 INFO:tasks.rados.rados.0.trial142.stdout:2670: snap_create 2026-02-17T12:02:05.346 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: get_monmap_and_config 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: build_initial_monmap 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: monmap: 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:05.415241+0000 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:05.415241+0000 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:05.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 Processor -- start 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 -- start start 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: init 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient: _add_conns ranks=[4,0,1,2,3] 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8bc00a3bb0 0x7f8bc009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-c con 0x7f8bc00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8bc009dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8bc00a0110 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc006e140 con 0x7f8bc009dac0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc009ce60 con 0x7f8bc00a0110 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc009aed0 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.414+0000 7f8bc4d96640 10 monclient(hunting): authenticate will time out at 1613.033993s 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbdd74640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8bc009dac0 0x7f8bc009fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58460/0 (socket says 10.20.193.51:58460) 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbdd74640 1 -- 10.20.193.51:0/2338742563 learned_addr learned my addr 10.20.193.51:0/2338742563 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 1 --2- 10.20.193.51:0/2338742563 >> v2:10.20.193.142:3300/0 conn(0x7f8bc00a3bb0 0x7f8bc009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): get_auth_request con 0x7f8bc00a3bb0 auth_method 0 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient(hunting): handle_auth_done global_id 184327 payload 274 2026-02-17T12:02:05.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 1 -- 10.20.193.51:0/2338742563 >> v1:10.20.193.142:6789/0 conn(0x7f8bc00a0110 legacy=0x7f8bc013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 1 -- 10.20.193.51:0/2338742563 >> v1:10.20.193.51:6789/0 conn(0x7f8bc009dac0 legacy=0x7f8bc009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient: _finish_hunting 0 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 1 monclient: found mon.noname-c 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:05.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.415+0000 7f8bbe575640 1 -- 10.20.193.51:0/2338742563 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc009a5c0 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbe575640 1 -- 10.20.193.51:0/2338742563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 msgr2=0x7f8bc009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:05.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbe575640 1 --2- 10.20.193.51:0/2338742563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc009f4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098a0 tx=0x7f8bb402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7add4b84419e6813 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 1 -- 10.20.193.51:0/2338742563 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb403c070 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: dump: 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: _finish_auth 0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: _check_auth_tickets 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 1 -- 10.20.193.51:0/2338742563 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb402fce0 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 5 monclient: authenticate success, global_id 184327 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 1 -- 10.20.193.51:0/2338742563 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4037660 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 4 set_mon_vals no callback set 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:05.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bbd573640 10 monclient: dump: 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 10 monclient: shutdown 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 -- 10.20.193.51:0/2338742563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 msgr2=0x7f8bc009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/2338742563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc009f4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098a0 tx=0x7f8bb402ed80 comp rx=0 tx=0).stop 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 -- 10.20.193.51:0/2338742563 shutdown_connections 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/2338742563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc009f4c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 -- 10.20.193.51:0/2338742563 >> 10.20.193.51:0/2338742563 conn(0x7f8bc00a30c0 msgr2=0x7f8bc00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 -- 10.20.193.51:0/2338742563 shutdown_connections 2026-02-17T12:02:05.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.418+0000 7f8bc4d96640 1 -- 10.20.193.51:0/2338742563 wait complete. 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient: build_initial_monmap 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient: monmap: 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 Processor -- start 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 -- start start 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient: init 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:05.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-a con 0x7f8bc009dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-c con 0x7f8bc00a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): picked mon.noname-b con 0x7f8bc00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc00a3f90 con 0x7f8bc009dac0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc009caa0 con 0x7f8bc00a3bb0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc00a0540 con 0x7f8bc00a0110 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bc4d96640 10 monclient(hunting): authenticate will time out at 1613.038612s 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:46200/0 (socket says 10.20.193.51:46200) 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 -- 10.20.193.51:0/1101171565 learned_addr learned my addr 10.20.193.51:0/1101171565 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): get_auth_request con 0x7f8bc009dac0 auth_method 0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 10 monclient(hunting): get_auth_request con 0x7f8bc00a0110 auth_method 0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 msgr2=0x7f8bc006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 msgr2=0x7f8bc006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbdd74640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 10 monclient(hunting): get_auth_request con 0x7f8bc00a3bb0 auth_method 0 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient(hunting): handle_auth_done global_id 204198 payload 824 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 msgr2=0x7f8bc006fdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 msgr2=0x7f8bc00702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc00702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient: _finish_hunting 0 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 monclient: found mon.noname-a 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbe575640 1 -- 10.20.193.51:0/1101171565 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc01314b0 con 0x7f8bc009dac0 2026-02-17T12:02:05.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.419+0000 7f8bbed76640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bbe575640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 msgr2=0x7f8bc0138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bbe575640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098a0 tx=0x7f8bb40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4046070 con 0x7f8bc009dac0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: dump: 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb4041870 con 0x7f8bc009dac0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 5 monclient: authenticate success, global_id 204198 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _renew_subs 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc01302e0 con 0x7f8bc009dac0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb403c040 con 0x7f8bc009dac0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bbcd72640 4 set_mon_vals no callback set 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 10 monclient: dump: 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:05.425 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _renew_subs 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc00a1b80 con 0x7f8bc009dac0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc009f4c0 con 0x7f8bc009dac0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.422+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8bb4041c60 con 0x7f8bc009dac0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.423+0000 7f8ba6ffd640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 0x7f8b8c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.423+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(613..613 src has 323..613) ==== 4859+0+0 (secure 0 0 0) 0x7f8bb4077f20 con 0x7f8bc009dac0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.423+0000 7f8bbdd74640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 0x7f8b8c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:05.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.423+0000 7f8bbdd74640 10 monclient: get_auth_request con 0x7f8b8c03dd10 auth_method 0 2026-02-17T12:02:05.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.425+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8bb4037e10 con 0x7f8bc009dac0 2026-02-17T12:02:05.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.425+0000 7f8ba6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:05.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.425+0000 7f8ba6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:05.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.425+0000 7f8bbdd74640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 0x7f8b8c0401d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8007fd0 tx=0x7f8ba8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8bc4d96640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8bc4d96640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8bc4d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8bc0130500 con 0x7f8bc009dac0 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8ba6ffd640 1 -- 10.20.193.51:0/1101171565 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f8bb40768d0 con 0x7f8bc009dac0 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8ba6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.542+0000 7f8ba6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:05.544 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 msgr2=0x7f8b8c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 0x7f8b8c0401d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8007fd0 tx=0x7f8ba8009040 comp rx=0 tx=0).stop 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 10 monclient: shutdown 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 msgr2=0x7f8bc0138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098a0 tx=0x7f8bb40047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 shutdown_connections 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8b8c03dd10 0x7f8b8c0401d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8bc00a3bb0 0x7f8bc00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8bc00a0110 0x7f8bc006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 --2- 10.20.193.51:0/1101171565 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8bc009dac0 0x7f8bc0138190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 >> 10.20.193.51:0/1101171565 conn(0x7f8bc00a30c0 msgr2=0x7f8bc009e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 shutdown_connections 2026-02-17T12:02:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:05.544+0000 7f8bc4d96640 1 -- 10.20.193.51:0/1101171565 wait complete. 2026-02-17T12:02:06.249 INFO:tasks.rados.rados.0.trial142.stdout:2666: done (2 left) 2026-02-17T12:02:06.250 INFO:tasks.rados.rados.0.trial142.stdout:2669: done (1 left) 2026-02-17T12:02:06.250 INFO:tasks.rados.rados.0.trial142.stdout:2670: done (0 left) 2026-02-17T12:02:06.250 INFO:tasks.rados.rados.0.trial142.stdout:2671: write (excl) oid 31 current snap is 295 2026-02-17T12:02:06.250 INFO:tasks.rados.rados.0.trial142.stdout:2671: seq_num 912 ranges {527984=473095,1634872=451650,2661887=634311} 2026-02-17T12:02:06.253 INFO:tasks.rados.rados.0.trial142.stdout:2671: writing trial14245205-31 from 527984 to 1001079 tid 1 2026-02-17T12:02:06.258 INFO:tasks.rados.rados.0.trial142.stdout:2671: writing trial14245205-31 from 1634872 to 2086522 tid 2 2026-02-17T12:02:06.263 INFO:tasks.rados.rados.0.trial142.stdout:2671: writing trial14245205-31 from 2661887 to 3296198 tid 3 2026-02-17T12:02:06.263 INFO:tasks.rados.rados.0.trial142.stdout:2672: snap_create 2026-02-17T12:02:06.263 INFO:tasks.rados.rados.0.trial142.stdout:2671: finishing write tid 1 to trial14245205-31 2026-02-17T12:02:06.263 INFO:tasks.rados.rados.0.trial142.stdout:2671: finishing write tid 2 to trial14245205-31 2026-02-17T12:02:06.265 INFO:tasks.rados.rados.0.trial142.stdout:2671: finishing write tid 3 to trial14245205-31 2026-02-17T12:02:06.265 INFO:tasks.rados.rados.0.trial142.stdout:2671: finishing write tid 4 to trial14245205-31 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: finishing write tid 5 to trial14245205-31 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: oid 31 updating version 0 to 2129 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: oid 31 version 2129 is already newer than 2126 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: oid 31 version 2129 is already newer than 2128 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: oid 31 version 2129 is already newer than 2127 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 2129 (ObjNum 912 snap 295 seq_num 912) dirty exists 2026-02-17T12:02:06.266 INFO:tasks.rados.rados.0.trial142.stdout:2671: left oid 31 (ObjNum 912 snap 295 seq_num 912) 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2671: done (1 left) 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2672: done (0 left) 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2673: read oid 49 snap -1 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2673: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2674: copy_from oid 25 from oid 26 current snap is 296 2026-02-17T12:02:07.262 INFO:tasks.rados.rados.0.trial142.stdout:2675: snap_remove snap 278 2026-02-17T12:02:08.554 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.621+0000 7fd98ad5e640 10 monclient: get_monmap_and_config 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.621+0000 7fd98ad5e640 10 monclient: build_initial_monmap 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.621+0000 7fd98ad5e640 10 monclient: monmap: 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:08.622664+0000 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:08.622664+0000 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:08.623 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 Processor -- start 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 -- start start 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient: init 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd98406c8d0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-a con 0x7fd984074d60 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd98406d3c0 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9840a0210 con 0x7fd98406d3c0 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9840a04f0 con 0x7fd98406c8d0 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd9840a07d0 con 0x7fd984074d60 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd98ad5e640 10 monclient(hunting): authenticate will time out at 1616.241630s 2026-02-17T12:02:08.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:46214/0 (socket says 10.20.193.51:46214) 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 learned_addr learned my addr 10.20.193.51:0/3984944538 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd984074d60 auth_method 0 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd9892d4640 1 --1- 10.20.193.51:0/3984944538 >> v1:10.20.193.51:6789/0 conn(0x7fd98406d3c0 0x7fd98413f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:58470/0 (socket says 10.20.193.51:58470) 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:08.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.622+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:08.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.624+0000 7fd9892d4640 1 -- 10.20.193.51:0/3984944538 >> v1:10.20.193.51:6789/0 conn(0x7fd98406d3c0 legacy=0x7fd98413f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:08.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.624+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> v1:10.20.193.142:6789/0 conn(0x7fd98406c8d0 legacy=0x7fd98406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:08.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd984074d60 auth_method 0 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:08.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:08.823+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd984074d60 auth_method 0 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:09.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:09.224+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd984074d60 auth_method 0 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:10.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:10.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:10.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:10.025+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:02:11.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): tick 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 msgr2=0x7fd9840a13b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.51:3300/0 conn(0x7fd984074d60 0x7fd9840a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:11.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 -- 10.20.193.51:0/3984944538 >> v1:10.20.193.142:6789/0 conn(0x7fd98406c8d0 legacy=0x7fd98406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 -- 10.20.193.51:0/3984944538 >> v1:10.20.193.51:6789/0 conn(0x7fd98406d3c0 legacy=0x7fd98413f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient: _add_conns ranks=[2,4] 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fd968003910 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fd968006450 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 -- 10.20.193.51:0/3984944538 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd9840a07d0 con 0x7fd968006450 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 1 -- 10.20.193.51:0/3984944538 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd968008fa0 con 0x7fd968003910 2026-02-17T12:02:11.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd97a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 10 monclient(hunting): get_auth_request con 0x7fd968003910 auth_method 0 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.622+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd968006450 auth_method 0 2026-02-17T12:02:11.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:11.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.623+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 10 monclient(hunting): get_auth_request con 0x7fd968003910 auth_method 0 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.823+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:11.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd968006450 auth_method 0 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:11.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:11.824+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 10 monclient(hunting): get_auth_request con 0x7fd968003910 auth_method 0 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.224+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd968006450 auth_method 0 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:12.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:12.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:12.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 msgr2=0x7fd968008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:12.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:12.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:12.225+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2675: done (2 left) 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2676: rollback oid 28 current snap is 296 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 294 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2674: finishing copy_from to trial14245205-25 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2674: got expected ENOENT (src dne) 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2674: finishing copy_from racing read to trial14245205-25 2026-02-17T12:02:12.758 INFO:tasks.rados.rados.0.trial142.stdout:2673: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2676: finishing rollback tid 0 to trial14245205-28 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2676: finishing rollback tid 1 to trial14245205-28 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2676: finishing rollback tid 2 to trial14245205-28 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2130 (ObjNum 884 snap 280 seq_num 884) dirty exists 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2673: done (2 left) 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2674: done (1 left) 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2676: done (0 left) 2026-02-17T12:02:12.878 INFO:tasks.rados.rados.0.trial142.stdout:2677: delete oid 8 current snap is 296 2026-02-17T12:02:12.879 INFO:tasks.rados.rados.0.trial142.stdout:2677: done (0 left) 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:2678: rollback oid 40 current snap is 296 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 295 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:2679: read oid 24 snap 286 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:2679: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:2680: write (excl) oid 35 current snap is 296 2026-02-17T12:02:12.880 INFO:tasks.rados.rados.0.trial142.stdout:2680: seq_num 914 ranges {561598=739946,1751836=455319,2716733=644865} 2026-02-17T12:02:12.884 INFO:tasks.rados.rados.0.trial142.stdout:2680: writing trial14245205-35 from 561598 to 1301544 tid 1 2026-02-17T12:02:12.888 INFO:tasks.rados.rados.0.trial142.stdout:2680: writing trial14245205-35 from 1751836 to 2207155 tid 2 2026-02-17T12:02:12.893 INFO:tasks.rados.rados.0.trial142.stdout:2680: writing trial14245205-35 from 2716733 to 3361598 tid 3 2026-02-17T12:02:12.894 INFO:tasks.rados.rados.0.trial142.stdout:2681: snap_create 2026-02-17T12:02:12.894 INFO:tasks.rados.rados.0.trial142.stdout:2678: finishing rollback tid 1 to trial14245205-40 2026-02-17T12:02:12.894 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 0 (ObjNum 129 snap 0 seq_num 1213852256) dirty dne 2026-02-17T12:02:12.894 INFO:tasks.rados.rados.0.trial142.stdout:2679: expect (ObjNum 748 snap 236 seq_num 748) 2026-02-17T12:02:12.993 INFO:tasks.rados.rados.0.trial142.stdout:2680: finishing write tid 1 to trial14245205-35 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: finishing write tid 2 to trial14245205-35 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: finishing write tid 3 to trial14245205-35 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: finishing write tid 4 to trial14245205-35 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: finishing write tid 5 to trial14245205-35 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: oid 35 updating version 0 to 2134 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: oid 35 version 2134 is already newer than 2132 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: oid 35 version 2134 is already newer than 2133 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: oid 35 version 2134 is already newer than 2131 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 2134 (ObjNum 914 snap 296 seq_num 914) dirty exists 2026-02-17T12:02:12.994 INFO:tasks.rados.rados.0.trial142.stdout:2680: left oid 35 (ObjNum 914 snap 296 seq_num 914) 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 10 monclient(hunting): get_auth_request con 0x7fd968003910 auth_method 0 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:13.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.025+0000 7fd988ad3640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> v2:10.20.193.142:3300/0 conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd968006450 auth_method 0 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient(hunting): handle_auth_done global_id 184333 payload 274 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 msgr2=0x7fd968005d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd968003910 0x7fd968005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 1 monclient: found mon.noname-c 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:13.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.026+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98409ecd0 con 0x7fd968006450 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97bfff640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 msgr2=0x7fd968008910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97bfff640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd968008910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006fd0 tx=0x7fd96c030c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5f873c1fd2d5d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 1 -- 10.20.193.51:0/3984944538 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c032920 con 0x7fd968006450 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: dump: 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd98ad5e640 5 monclient: authenticate success, global_id 184333 2026-02-17T12:02:13.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd98ad5e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 1 -- 10.20.193.51:0/3984944538 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c032ac0 con 0x7fd968006450 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 1 -- 10.20.193.51:0/3984944538 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c031440 con 0x7fd968006450 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd97b7fe640 10 monclient: dump: 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd98ad5e640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:13.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.029+0000 7fd98ad5e640 4 set_mon_vals no callback set 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 10 monclient: shutdown 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 -- 10.20.193.51:0/3984944538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 msgr2=0x7fd968008910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd968008910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006fd0 tx=0x7fd96c030c90 comp rx=0 tx=0).stop 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd9892d4640 1 -- 10.20.193.51:0/3984944538 reap_dead start 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 -- 10.20.193.51:0/3984944538 shutdown_connections 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/3984944538 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd968008910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 -- 10.20.193.51:0/3984944538 >> 10.20.193.51:0/3984944538 conn(0x7fd9840aaa60 msgr2=0x7fd9840aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 -- 10.20.193.51:0/3984944538 shutdown_connections 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 1 -- 10.20.193.51:0/3984944538 wait complete. 2026-02-17T12:02:13.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 10 monclient: build_initial_monmap 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.030+0000 7fd98ad5e640 10 monclient: monmap: 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 Processor -- start 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 -- start start 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient: init 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd984070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-b con 0x7fd968006450 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-c con 0x7fd9841cedc0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): picked mon.noname-a con 0x7fd9841cf760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd984140c00 con 0x7fd9841cf760 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd984140a80 con 0x7fd968006450 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd984140d80 con 0x7fd9841cedc0 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd98ad5e640 10 monclient(hunting): authenticate will time out at 1620.650339s 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:46242/0 (socket says 10.20.193.51:46242) 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:49758/0 (socket says 10.20.193.51:49758) 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 -- 10.20.193.51:0/2759707356 learned_addr learned my addr 10.20.193.51:0/2759707356 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 10 monclient(hunting): get_auth_request con 0x7fd9841cedc0 auth_method 0 2026-02-17T12:02:13.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): get_auth_request con 0x7fd9841cf760 auth_method 0 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd984070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): get_auth_request con 0x7fd968006450 auth_method 0 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 msgr2=0x7fd9841cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 msgr2=0x7fd9841cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd97bfff640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd988ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient(hunting): handle_auth_done global_id 204201 payload 824 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 msgr2=0x7fd9841cf220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 msgr2=0x7fd984070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd984070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient: _finish_hunting 0 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 monclient: found mon.noname-a 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:13.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.031+0000 7fd9892d4640 1 -- 10.20.193.51:0/2759707356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98409e960 con 0x7fd9841cf760 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9892d4640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 msgr2=0x7fd984099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9892d4640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd984075140 tx=0x7fd98000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980017070 con 0x7fd9841cf760 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: dump: 2026-02-17T12:02:13.036 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: _finish_auth 0 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: _check_auth_tickets 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98000ac70 con 0x7fd9841cf760 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 5 monclient: authenticate success, global_id 204201 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 10 monclient: _renew_subs 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9841cfbf0 con 0x7fd9841cf760 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800070d0 con 0x7fd9841cf760 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd9797fa640 10 monclient: dump: 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd97affd640 4 set_mon_vals no callback set 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 10 monclient: _renew_subs 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.033+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd984073c30 con 0x7fd9841cf760 2026-02-17T12:02:13.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd9800072f0 con 0x7fd9841cf760 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd98ad5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd98ad5e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd98ad5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9840a13b0 con 0x7fd9841cf760 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd9797fa640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 0x7fd9540401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.034+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(616..616 src has 323..616) ==== 4875+0+0 (secure 0 0 0) 0x7fd980052180 con 0x7fd9841cf760 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.035+0000 7fd988ad3640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 0x7fd9540401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:13.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.035+0000 7fd988ad3640 10 monclient: get_auth_request con 0x7fd95403dd10 auth_method 0 2026-02-17T12:02:13.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.037+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd9841cfbf0 con 0x7fd9841cf760 2026-02-17T12:02:13.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.037+0000 7fd9797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:13.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.037+0000 7fd9797fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:13.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.037+0000 7fd988ad3640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 0x7fd9540401d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd974007fd0 tx=0x7fd974009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd98ad5e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd98ad5e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd98ad5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd984069830 con 0x7fd9841cf760 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd9797fa640 1 -- 10.20.193.51:0/2759707356 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fd98409e960 con 0x7fd9841cf760 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd9797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:13.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.152+0000 7fd9797fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":154,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 msgr2=0x7fd9540401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 0x7fd9540401d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd974007fd0 tx=0x7fd974009040 comp rx=0 tx=0).stop 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 10 monclient: shutdown 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:13.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 msgr2=0x7fd984099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd984075140 tx=0x7fd98000ce40 comp rx=0 tx=0).stop 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 shutdown_connections 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd95403dd10 0x7fd9540401d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd9841cf760 0x7fd984099a80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd9841cedc0 0x7fd9841cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 --2- 10.20.193.51:0/2759707356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd968006450 0x7fd984070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 >> 10.20.193.51:0/2759707356 conn(0x7fd9840aaa60 msgr2=0x7fd9840a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 shutdown_connections 2026-02-17T12:02:13.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:13.153+0000 7fd98ad5e640 1 -- 10.20.193.51:0/2759707356 wait complete. 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2678: done (3 left) 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2679: done (2 left) 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2680: done (1 left) 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2681: done (0 left) 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2682: copy_from oid 42 from oid 33 current snap is 297 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2683: write (excl) oid 18 current snap is 297 2026-02-17T12:02:13.759 INFO:tasks.rados.rados.0.trial142.stdout:2683: seq_num 915 ranges {578405=415195,1410318=598977,2744156=584480} 2026-02-17T12:02:13.763 INFO:tasks.rados.rados.0.trial142.stdout:2683: writing trial14245205-18 from 578405 to 993600 tid 1 2026-02-17T12:02:13.767 INFO:tasks.rados.rados.0.trial142.stdout:2683: writing trial14245205-18 from 1410318 to 2009295 tid 2 2026-02-17T12:02:13.772 INFO:tasks.rados.rados.0.trial142.stdout:2683: writing trial14245205-18 from 2744156 to 3328636 tid 3 2026-02-17T12:02:13.772 INFO:tasks.rados.rados.0.trial142.stdout:2684: write oid 29 current snap is 297 2026-02-17T12:02:13.772 INFO:tasks.rados.rados.0.trial142.stdout:2683: finishing write tid 1 to trial14245205-18 2026-02-17T12:02:13.772 INFO:tasks.rados.rados.0.trial142.stdout:2684: seq_num 916 ranges {595212=490444,1868800=458988,2887932=507280} 2026-02-17T12:02:13.776 INFO:tasks.rados.rados.0.trial142.stdout:2684: writing trial14245205-29 from 595212 to 1085656 tid 1 2026-02-17T12:02:13.781 INFO:tasks.rados.rados.0.trial142.stdout:2684: writing trial14245205-29 from 1868800 to 2327788 tid 2 2026-02-17T12:02:13.785 INFO:tasks.rados.rados.0.trial142.stdout:2684: writing trial14245205-29 from 2887932 to 3395212 tid 3 2026-02-17T12:02:13.785 INFO:tasks.rados.rados.0.trial142.stdout:2685: snap_remove snap 274 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2685: done (3 left) 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2686: snap_create 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2682: finishing copy_from racing read to trial14245205-42 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2682: finishing copy_from to trial14245205-42 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2118 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2683: finishing write tid 2 to trial14245205-18 2026-02-17T12:02:14.709 INFO:tasks.rados.rados.0.trial142.stdout:2683: finishing write tid 3 to trial14245205-18 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: finishing write tid 4 to trial14245205-18 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: finishing write tid 5 to trial14245205-18 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: oid 18 updating version 0 to 2416 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: oid 18 version 2416 is already newer than 2413 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: oid 18 version 2416 is already newer than 2414 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: oid 18 version 2416 is already newer than 2415 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2416 (ObjNum 915 snap 297 seq_num 915) dirty exists 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2683: left oid 18 (ObjNum 915 snap 297 seq_num 915) 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2684: finishing write tid 1 to trial14245205-29 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2684: finishing write tid 2 to trial14245205-29 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2684: finishing write tid 3 to trial14245205-29 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2684: finishing write tid 4 to trial14245205-29 2026-02-17T12:02:14.710 INFO:tasks.rados.rados.0.trial142.stdout:2684: finishing write tid 5 to trial14245205-29 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:2684: oid 29 updating version 0 to 1969 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:2684: oid 29 version 1969 is already newer than 1968 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:2684: oid 29 version 1969 is already newer than 1966 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:2684: oid 29 version 1969 is already newer than 1967 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1969 (ObjNum 916 snap 297 seq_num 916) dirty exists 2026-02-17T12:02:14.711 INFO:tasks.rados.rados.0.trial142.stdout:2684: left oid 29 (ObjNum 916 snap 297 seq_num 916) 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2682: done (3 left) 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2683: done (2 left) 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2684: done (1 left) 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2686: done (0 left) 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2687: copy_from oid 41 from oid 33 current snap is 298 2026-02-17T12:02:15.758 INFO:tasks.rados.rados.0.trial142.stdout:2688: delete oid 34 current snap is 298 2026-02-17T12:02:15.760 INFO:tasks.rados.rados.0.trial142.stdout:2688: done (1 left) 2026-02-17T12:02:15.760 INFO:tasks.rados.rados.0.trial142.stdout:2689: snap_create 2026-02-17T12:02:15.765 INFO:tasks.rados.rados.0.trial142.stdout:2687: finishing copy_from racing read to trial14245205-41 2026-02-17T12:02:15.773 INFO:tasks.rados.rados.0.trial142.stdout:2687: finishing copy_from to trial14245205-41 2026-02-17T12:02:15.773 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2118 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:02:16.164 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.232+0000 7f918aeda640 10 monclient: get_monmap_and_config 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.232+0000 7f918aeda640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient: monmap: 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:16.233956+0000 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:16.233956+0000 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 Processor -- start 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 -- start start 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient: init 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-b con 0x7f91840a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f91840a0750 0x7f918409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-c con 0x7f91840a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:16.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f918409e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f918406e140 con 0x7f918409e540 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f91840a3f90 con 0x7f91840a0750 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f918409f910 con 0x7f91840a3bb0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f918aeda640 10 monclient(hunting): authenticate will time out at 1623.852799s 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9189450640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f918409e540 0x7f918413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35344/0 (socket says 10.20.193.51:35344) 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 10 monclient(hunting): get_auth_request con 0x7f91840a3bb0 auth_method 0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9189450640 1 -- 10.20.193.51:0/925847986 learned_addr learned my addr 10.20.193.51:0/925847986 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 1 -- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f918409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 1 -- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f918409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f9188c4f640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.233+0000 7f917bfff640 1 --2- 10.20.193.51:0/925847986 >> v2:10.20.193.142:3300/0 conn(0x7f91840a0750 0x7f918409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): get_auth_request con 0x7f91840a0750 auth_method 0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient(hunting): handle_auth_done global_id 184339 payload 274 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 1 -- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f918409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 1 -- 10.20.193.51:0/925847986 >> v1:10.20.193.51:6789/0 conn(0x7f918409e540 legacy=0x7f918413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 1 monclient: found mon.noname-c 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.234+0000 7f917bfff640 1 -- 10.20.193.51:0/925847986 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918409ccd0 con 0x7f91840a0750 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.236+0000 7f917bfff640 1 -- 10.20.193.51:0/925847986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 msgr2=0x7f918409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.236+0000 7f917bfff640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f918409e000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9184069d60 tx=0x7f916c02ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38170c5301f8c5d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.236+0000 7f917b7fe640 1 -- 10.20.193.51:0/925847986 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c03c070 con 0x7f91840a0750 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: dump: 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 1 -- 10.20.193.51:0/925847986 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c02fbd0 con 0x7f91840a0750 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 1 -- 10.20.193.51:0/925847986 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c037440 con 0x7f91840a0750 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 5 monclient: authenticate success, global_id 184339 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 4 set_mon_vals no callback set 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f917b7fe640 10 monclient: dump: 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 10 monclient: shutdown 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 -- 10.20.193.51:0/925847986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 msgr2=0x7f918409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f918409e000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9184069d60 tx=0x7f916c02ed50 comp rx=0 tx=0).stop 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 -- 10.20.193.51:0/925847986 shutdown_connections 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f918409e000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 --2- 10.20.193.51:0/925847986 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f918409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 -- 10.20.193.51:0/925847986 >> 10.20.193.51:0/925847986 conn(0x7f91840a30c0 msgr2=0x7f91840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 -- 10.20.193.51:0/925847986 shutdown_connections 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 1 -- 10.20.193.51:0/925847986 wait complete. 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.237+0000 7f918aeda640 10 monclient: monmap: 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 Processor -- start 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 -- start start 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient: init 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-a con 0x7f918409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f9184092ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-b con 0x7f91840a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): picked mon.noname-c con 0x7f91840a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f91840a04b0 con 0x7f918409e540 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f918409c850 con 0x7f91840a0750 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f918413de80 con 0x7f91840a3bb0 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f918aeda640 10 monclient(hunting): authenticate will time out at 1623.857455s 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40888/0 (socket says 10.20.193.51:40888) 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 -- 10.20.193.51:0/2548371829 learned_addr learned my addr 10.20.193.51:0/2548371829 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): get_auth_request con 0x7f918409e540 auth_method 0 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 10 monclient(hunting): get_auth_request con 0x7f91840a3bb0 auth_method 0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f917bfff640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f9184092ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f9184093400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f9184093400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f917bfff640 10 monclient(hunting): get_auth_request con 0x7f91840a0750 auth_method 0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f917bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f917bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f917bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9189450640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient(hunting): handle_auth_done global_id 204204 payload 824 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 msgr2=0x7f9184093400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 msgr2=0x7f9184092ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f9184092ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 monclient: found mon.noname-a 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.238+0000 7f9188c4f640 1 -- 10.20.193.51:0/2548371829 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918406f8d0 con 0x7f918409e540 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f9188c4f640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 msgr2=0x7f918409c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f9188c4f640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f917400e790 tx=0x7f917400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174017070 con 0x7f918409e540 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: dump: 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 5 monclient: authenticate success, global_id 204204 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917400cae0 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917400f040 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f91797fa640 10 monclient: dump: 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f917affd640 4 set_mon_vals no callback set 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 10 monclient: _renew_subs 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918406f410 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 10 monclient: _renew_subs 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.240+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9184095af0 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f918aeda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f918aeda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f918aeda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91840a24a0 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9174012050 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f91797fa640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 0x7f9154040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.241+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(619..619 src has 323..619) ==== 4751+0+0 (secure 0 0 0) 0x7f9174052440 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.242+0000 7f917bfff640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 0x7f9154040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.242+0000 7f917bfff640 10 monclient: get_auth_request con 0x7f915403dd40 auth_method 0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.244+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9174023d80 con 0x7f918409e540 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.244+0000 7f91797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.244+0000 7f91797fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:16.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.244+0000 7f917bfff640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 0x7f9154040200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f918409f230 tx=0x7f916c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.357+0000 7f918aeda640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.357+0000 7f918aeda640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.357+0000 7f918aeda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.357+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f918409dac0 con 0x7f918409e540 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f91797fa640 1 -- 10.20.193.51:0/2548371829 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f91740520d0 con 0x7f918409e540 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f91797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:16.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f91797fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:16.361 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 msgr2=0x7f9154040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 0x7f9154040200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f918409f230 tx=0x7f916c033000 comp rx=0 tx=0).stop 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 10 monclient: shutdown 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 msgr2=0x7f918409c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f917400e790 tx=0x7f917400ec60 comp rx=0 tx=0).stop 2026-02-17T12:02:16.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 shutdown_connections 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f915403dd40 0x7f9154040200 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f91840a3bb0 0x7f9184093400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f91840a0750 0x7f9184092ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 --2- 10.20.193.51:0/2548371829 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f918409e540 0x7f918409c240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 >> 10.20.193.51:0/2548371829 conn(0x7f91840a30c0 msgr2=0x7f9184072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 shutdown_connections 2026-02-17T12:02:16.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.358+0000 7f918aeda640 1 -- 10.20.193.51:0/2548371829 wait complete. 2026-02-17T12:02:16.368 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:02:16.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:02:16.369 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 10 monclient: get_monmap_and_config 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 10 monclient: monmap: 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:16.437368+0000 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:16.437368+0000 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:16.438 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 1 Processor -- start 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 1 -- start start 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.436+0000 7fe5100a0640 10 monclient: init 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5080a3bb0 0x7fe50809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-a con 0x7fe5080a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe5080a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe50813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-b con 0x7fe50813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50806e140 con 0x7fe5080a0750 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe50809f910 con 0x7fe5080a3bb0 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe50809ccd0 con 0x7fe50813b760 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe5100a0640 10 monclient(hunting): authenticate will time out at 1624.056117s 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5080a3bb0 0x7fe50809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe5080a3bb0 0x7fe50809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40900/0 (socket says 10.20.193.51:40900) 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 -- 10.20.193.51:0/706899671 learned_addr learned my addr 10.20.193.51:0/706899671 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): get_auth_request con 0x7fe5080a3bb0 auth_method 0 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50e616640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe50813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50e616640 10 monclient(hunting): get_auth_request con 0x7fe50813b760 auth_method 0 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50e616640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50e616640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50e616640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient(hunting): handle_auth_done global_id 204207 payload 274 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 -- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 msgr2=0x7fe50813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe50813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 -- 10.20.193.51:0/706899671 >> v1:10.20.193.142:6789/0 conn(0x7fe5080a0750 legacy=0x7fe50809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 monclient: found mon.noname-a 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.437+0000 7fe50de15640 1 -- 10.20.193.51:0/706899671 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50809eec0 con 0x7fe5080a3bb0 2026-02-17T12:02:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.439+0000 7fe50de15640 1 -- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a3bb0 msgr2=0x7fe50809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.439+0000 7fe50de15640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a3bb0 0x7fe50809dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe50806c1c0 tx=0x7fe4f802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdc46916dca437c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.439+0000 7fe50ce13640 1 -- 10.20.193.51:0/706899671 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f803c070 con 0x7fe5080a3bb0 2026-02-17T12:02:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: dump: 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 5 monclient: authenticate success, global_id 204207 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 1 -- 10.20.193.51:0/706899671 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f802fca0 con 0x7fe5080a3bb0 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 1 -- 10.20.193.51:0/706899671 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8037660 con 0x7fe5080a3bb0 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 4 set_mon_vals no callback set 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe50ce13640 10 monclient: dump: 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 10 monclient: shutdown 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 -- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a3bb0 msgr2=0x7fe50809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a3bb0 0x7fe50809dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe50806c1c0 tx=0x7fe4f802ee60 comp rx=0 tx=0).stop 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 -- 10.20.193.51:0/706899671 shutdown_connections 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe50813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 --2- 10.20.193.51:0/706899671 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a3bb0 0x7fe50809dac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 -- 10.20.193.51:0/706899671 >> 10.20.193.51:0/706899671 conn(0x7fe5080a30c0 msgr2=0x7fe5080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 -- 10.20.193.51:0/706899671 shutdown_connections 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 1 -- 10.20.193.51:0/706899671 wait complete. 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.440+0000 7fe5100a0640 10 monclient: monmap: 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.444 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 Processor -- start 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 -- start start 2026-02-17T12:02:16.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient: init 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-a con 0x7fe5080a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5080a3bb0 0x7fe5080910f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-b con 0x7fe5080a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe508091630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): picked mon.noname-c con 0x7fe50813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe5080a04b0 con 0x7fe5080a0750 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe50809c850 con 0x7fe5080a3bb0 2026-02-17T12:02:16.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe50809e710 con 0x7fe50813b760 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe5100a0640 10 monclient(hunting): authenticate will time out at 1624.060394s 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe508091630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40916/0 (socket says 10.20.193.51:40916) 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 -- 10.20.193.51:0/2382557449 learned_addr learned my addr 10.20.193.51:0/2382557449 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): get_auth_request con 0x7fe5080a0750 auth_method 0 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 10 monclient(hunting): get_auth_request con 0x7fe50813b760 auth_method 0 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 msgr2=0x7fe508091630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 msgr2=0x7fe508091630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe508091630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50e616640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe508091630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50d614640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5080a3bb0 0x7fe5080910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient(hunting): handle_auth_done global_id 204210 payload 824 2026-02-17T12:02:16.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 msgr2=0x7fe508091630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe50813b760 0x7fe508091630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5080a3bb0 msgr2=0x7fe5080910f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe5080a3bb0 0x7fe5080910f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 monclient: found mon.noname-a 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.441+0000 7fe50de15640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe508099590 con 0x7fe5080a0750 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe50de15640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 msgr2=0x7fe508090bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe50de15640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8002410 tx=0x7fe4f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8046020 con 0x7fe5080a0750 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: dump: 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f802fe50 con 0x7fe5080a0750 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 5 monclient: authenticate success, global_id 204210 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 10 monclient: _renew_subs 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5080945b0 con 0x7fe5080a0750 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f803c040 con 0x7fe5080a0750 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f7fff640 4 set_mon_vals no callback set 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe4f67fc640 10 monclient: dump: 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 10 monclient: _renew_subs 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.443+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5080a2400 con 0x7fe5080a0750 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe5100a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe4f803f030 con 0x7fe5080a0750 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe5100a0640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 0x7fe50808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe508093320 con 0x7fe508091b70 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 0x7fe50808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient: get_auth_request con 0x7fe508091b70 auth_method 0 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe4f67fc640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4d803dd60 0x7fe4d8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(619..619 src has 323..619) ==== 4751+0+0 (secure 0 0 0) 0x7fe4f8077780 con 0x7fe5080a0750 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 10 monclient(hunting): handle_auth_done global_id 204213 payload 824 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50d614640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe50806f530 con 0x7fe508091b70 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50e616640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4d803dd60 0x7fe4d8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.444+0000 7fe50e616640 10 monclient: get_auth_request con 0x7fe4d803dd60 auth_method 0 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe50d614640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 msgr2=0x7fe50808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe50d614640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 0x7fe50808d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5080921a0 tx=0x7fe4fc00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc016070 con 0x7fe508091b70 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe4f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe4f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.446+0000 7fe4f67fc640 10 monclient: dump: 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.452 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fe4fc012a10 con 0x7fe508091b70 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 msgr2=0x7fe50808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 0x7fe50808d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5080921a0 tx=0x7fe4fc00d8f0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 msgr2=0x7fe50808d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe4f67fc640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508091b70 0x7fe50808d3f0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5080921a0 tx=0x7fe4fc00d8f0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.447+0000 7fe50e616640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4d803dd60 0x7fe4d8040220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe508099df0 tx=0x7fe50400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe5100a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe5100a0640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 0x7fe50808d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe5100a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe50809dac0 con 0x7fe508094170 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 0x7fe50808d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient: get_auth_request con 0x7fe508094170 auth_method 0 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 10 monclient(hunting): handle_auth_done global_id 204216 payload 824 2026-02-17T12:02:16.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.450+0000 7fe50d614640 1 -- 10.20.193.51:0/2382557449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe508092a00 con 0x7fe508094170 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe50d614640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 msgr2=0x7fe50808d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe50d614640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 0x7fe50808d930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc018000 tx=0x7fe4fc0037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc019770 con 0x7fe508094170 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe4f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe4f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.452+0000 7fe4f67fc640 10 monclient: dump: 2026-02-17T12:02:16.454 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fe4fc012e20 con 0x7fe508094170 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 msgr2=0x7fe50808d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 0x7fe50808d930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc018000 tx=0x7fe4fc0037f0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 msgr2=0x7fe50808d930 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe4f67fc640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe508094170 0x7fe50808d930 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc018000 tx=0x7fe4fc0037f0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 77218, 2026-02-17T12:02:16.455 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:16.456 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:16.457 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:16.458 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.459 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:16.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:16.461 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4d803dd60 msgr2=0x7fe4d8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe4d803dd60 0x7fe4d8040220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe508099df0 tx=0x7fe50400b040 comp rx=0 tx=0).stop 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 10 monclient: shutdown 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 msgr2=0x7fe508090bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8002410 tx=0x7fe4f80047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe50e616640 1 -- 10.20.193.51:0/2382557449 reap_dead start 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 shutdown_connections 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 --2- 10.20.193.51:0/2382557449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe5080a0750 0x7fe508090bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 >> 10.20.193.51:0/2382557449 conn(0x7fe5080a30c0 msgr2=0x7fe50813acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 shutdown_connections 2026-02-17T12:02:16.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.453+0000 7fe5100a0640 1 -- 10.20.193.51:0/2382557449 wait complete. 2026-02-17T12:02:16.463 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:16.463 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:02:16.463 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 10 monclient: get_monmap_and_config 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 10 monclient: monmap: 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:16.531496+0000 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:16.531496+0000 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:16.532 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:16.533 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:16.533 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:16.533 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:16.533 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 1 Processor -- start 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 1 -- start start 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.530+0000 7f93d5be6640 10 monclient: init 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f93d00a3bb0 0x7f93d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-c con 0x7f93d00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93d00a0750 0x7f93d009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-a con 0x7f93d00a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93d009e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:16.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d006e140 con 0x7f93d009e540 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f93d00a3f90 con 0x7f93d00a0750 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93d009f910 con 0x7f93d00a3bb0 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93d5be6640 10 monclient(hunting): authenticate will time out at 1624.150327s 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93d00a0750 0x7f93d009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f93d00a0750 0x7f93d009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40946/0 (socket says 10.20.193.51:40946) 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 -- 10.20.193.51:0/1781776474 learned_addr learned my addr 10.20.193.51:0/1781776474 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): get_auth_request con 0x7f93d00a0750 auth_method 0 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/1781776474 >> v2:10.20.193.142:3300/0 conn(0x7f93d00a3bb0 0x7f93d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request con 0x7f93d00a3bb0 auth_method 0 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient(hunting): handle_auth_done global_id 204219 payload 274 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 -- 10.20.193.51:0/1781776474 >> v2:10.20.193.142:3300/0 conn(0x7f93d00a3bb0 msgr2=0x7f93d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 --2- 10.20.193.51:0/1781776474 >> v2:10.20.193.142:3300/0 conn(0x7f93d00a3bb0 0x7f93d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 -- 10.20.193.51:0/1781776474 >> v1:10.20.193.142:6789/0 conn(0x7f93d009e540 legacy=0x7f93d013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 monclient: found mon.noname-a 2026-02-17T12:02:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.531+0000 7f93ceffd640 1 -- 10.20.193.51:0/1781776474 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d009ccd0 con 0x7f93d00a0750 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ceffd640 1 -- 10.20.193.51:0/1781776474 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 msgr2=0x7f93d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ceffd640 1 --2- 10.20.193.51:0/1781776474 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d009e000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93d006f3c0 tx=0x7f93c002edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757cf9a7e9e2e352 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 1 -- 10.20.193.51:0/1781776474 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c003c070 con 0x7f93d00a0750 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: dump: 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.538 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 5 monclient: authenticate success, global_id 204219 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 1 -- 10.20.193.51:0/1781776474 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c002fc70 con 0x7f93d00a0750 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 1 -- 10.20.193.51:0/1781776474 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0037660 con 0x7f93d00a0750 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 4 set_mon_vals no callback set 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93ce7fc640 10 monclient: dump: 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.539 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 10 monclient: shutdown 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 -- 10.20.193.51:0/1781776474 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 msgr2=0x7f93d009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 --2- 10.20.193.51:0/1781776474 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d009e000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93d006f3c0 tx=0x7f93c002edf0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 -- 10.20.193.51:0/1781776474 shutdown_connections 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 --2- 10.20.193.51:0/1781776474 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d009e000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 --2- 10.20.193.51:0/1781776474 >> v2:10.20.193.142:3300/0 conn(0x7f93d00a3bb0 0x7f93d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 -- 10.20.193.51:0/1781776474 >> 10.20.193.51:0/1781776474 conn(0x7f93d00a30c0 msgr2=0x7f93d00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 -- 10.20.193.51:0/1781776474 shutdown_connections 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 1 -- 10.20.193.51:0/1781776474 wait complete. 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 10 monclient: build_initial_monmap 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.534+0000 7f93d5be6640 10 monclient: monmap: 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:16.540 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 Processor -- start 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 -- start start 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient: init 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d009e540 0x7f93d0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-b con 0x7f93d009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d0099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-a con 0x7f93d00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 0x7f93d008e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): picked mon.noname-c con 0x7f93d00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00a04b0 con 0x7f93d00a0750 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93d009c850 con 0x7f93d009e540 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93d013de80 con 0x7f93d00a3bb0 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93d5be6640 10 monclient(hunting): authenticate will time out at 1624.154508s 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d0099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d0099fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40948/0 (socket says 10.20.193.51:40948) 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 -- 10.20.193.51:0/2014927298 learned_addr learned my addr 10.20.193.51:0/2014927298 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): get_auth_request con 0x7f93d00a0750 auth_method 0 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 0x7f93d008e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 10 monclient(hunting): get_auth_request con 0x7f93d00a3bb0 auth_method 0 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 msgr2=0x7f93d008e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:02:16.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 msgr2=0x7f93d008e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 0x7f93d008e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cffff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 0x7f93d008e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d009e540 0x7f93d0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request con 0x7f93d009e540 auth_method 0 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient(hunting): handle_auth_done global_id 204222 payload 824 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 msgr2=0x7f93d008e850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d00a3bb0 0x7f93d008e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d009e540 msgr2=0x7f93d0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f93d009e540 0x7f93d0099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient: _finish_hunting 0 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 monclient: found mon.noname-a 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.535+0000 7f93ceffd640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d0091f40 con 0x7f93d00a0750 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.537+0000 7f93ceffd640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 msgr2=0x7f93d0099fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.537+0000 7f93ceffd640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d0099fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93c0002410 tx=0x7f93c0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c003c040 con 0x7f93d00a0750 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:16.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: dump: 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: _finish_auth 0 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0047070 con 0x7f93d00a0750 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 5 monclient: authenticate success, global_id 204222 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 monclient: _renew_subs 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d00a2760 con 0x7f93d00a0750 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0042890 con 0x7f93d00a0750 2026-02-17T12:02:16.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cdffb640 4 set_mon_vals no callback set 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 10 monclient: dump: 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 monclient: _renew_subs 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d009d7b0 con 0x7f93d00a0750 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93d0090920 con 0x7f93d0092180 2026-02-17T12:02:16.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 10 monclient: get_auth_request con 0x7f93d0092180 auth_method 0 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f93c0042a70 con 0x7f93d00a0750 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a003dd40 0x7f93a0040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.538+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(619..619 src has 323..619) ==== 4751+0+0 (secure 0 0 0) 0x7f93c00773a0 con 0x7f93d00a0750 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.539+0000 7f93cffff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a003dd40 0x7f93a0040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.539+0000 7f93cffff640 10 monclient: get_auth_request con 0x7f93a003dd40 auth_method 0 2026-02-17T12:02:16.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.541+0000 7f93cffff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a003dd40 0x7f93a0040200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f93d0073fa0 tx=0x7f93c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:16.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:16.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 10 monclient: get_auth_request con 0x7f93d0092180 auth_method 0 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:16.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:16.739+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:16.760 INFO:tasks.rados.rados.0.trial142.stdout:2687: done (1 left) 2026-02-17T12:02:16.760 INFO:tasks.rados.rados.0.trial142.stdout:2689: done (0 left) 2026-02-17T12:02:16.760 INFO:tasks.rados.rados.0.trial142.stdout:2690: write oid 11 current snap is 299 2026-02-17T12:02:16.760 INFO:tasks.rados.rados.0.trial142.stdout:2690: seq_num 918 ranges {628826=640942,1869411=462657,2826425=534649} 2026-02-17T12:02:16.765 INFO:tasks.rados.rados.0.trial142.stdout:2690: writing trial14245205-11 from 628826 to 1269768 tid 1 2026-02-17T12:02:16.769 INFO:tasks.rados.rados.0.trial142.stdout:2690: writing trial14245205-11 from 1869411 to 2332068 tid 2 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2690: writing trial14245205-11 from 2826425 to 3361074 tid 3 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2691: copy_from oid 22 from oid 40 current snap is 299 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2690: finishing write tid 1 to trial14245205-11 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2690: finishing write tid 2 to trial14245205-11 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2692: write oid 50 current snap is 299 2026-02-17T12:02:16.773 INFO:tasks.rados.rados.0.trial142.stdout:2692: seq_num 919 ranges {645633=716191,1927893=606315,3137495=308138} 2026-02-17T12:02:16.778 INFO:tasks.rados.rados.0.trial142.stdout:2692: writing trial14245205-50 from 645633 to 1361824 tid 1 2026-02-17T12:02:16.782 INFO:tasks.rados.rados.0.trial142.stdout:2692: writing trial14245205-50 from 1927893 to 2534208 tid 2 2026-02-17T12:02:16.786 INFO:tasks.rados.rados.0.trial142.stdout:2692: writing trial14245205-50 from 3137495 to 3445633 tid 3 2026-02-17T12:02:16.786 INFO:tasks.rados.rados.0.trial142.stdout:2693: read oid 31 snap -1 2026-02-17T12:02:16.786 INFO:tasks.rados.rados.0.trial142.stdout:2693: expect (ObjNum 912 snap 295 seq_num 912) 2026-02-17T12:02:16.786 INFO:tasks.rados.rados.0.trial142.stdout:2694: snap_remove snap 287 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 10 monclient: get_auth_request con 0x7f93d0092180 auth_method 0 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:17.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.140+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:17.761 INFO:tasks.rados.rados.0.trial142.stdout:2694: done (4 left) 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2695: delete oid 1 current snap is 299 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2691: finishing copy_from to trial14245205-22 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2691: got expected ENOENT (src dne) 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2691: finishing copy_from racing read to trial14245205-22 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2690: finishing write tid 3 to trial14245205-11 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2690: finishing write tid 4 to trial14245205-11 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2690: finishing write tid 5 to trial14245205-11 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2690: oid 11 updating version 0 to 1127 2026-02-17T12:02:17.762 INFO:tasks.rados.rados.0.trial142.stdout:2690: oid 11 updating version 1127 to 1129 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2690: oid 11 version 1129 is already newer than 1128 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2690: oid 11 updating version 1129 to 1130 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1130 (ObjNum 918 snap 299 seq_num 918) dirty exists 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2690: left oid 11 (ObjNum 918 snap 299 seq_num 918) 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: finishing write tid 1 to trial14245205-50 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: finishing write tid 2 to trial14245205-50 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: finishing write tid 3 to trial14245205-50 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: finishing write tid 4 to trial14245205-50 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: finishing write tid 5 to trial14245205-50 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: oid 50 updating version 0 to 1995 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: oid 50 version 1995 is already newer than 1994 2026-02-17T12:02:17.763 INFO:tasks.rados.rados.0.trial142.stdout:2692: oid 50 updating version 1995 to 1996 2026-02-17T12:02:17.764 INFO:tasks.rados.rados.0.trial142.stdout:2692: oid 50 updating version 1996 to 1997 2026-02-17T12:02:17.764 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 1997 (ObjNum 919 snap 299 seq_num 919) dirty exists 2026-02-17T12:02:17.764 INFO:tasks.rados.rados.0.trial142.stdout:2692: left oid 50 (ObjNum 919 snap 299 seq_num 919) 2026-02-17T12:02:17.764 INFO:tasks.rados.rados.0.trial142.stdout:2693: expect (ObjNum 912 snap 295 seq_num 912) 2026-02-17T12:02:17.866 INFO:tasks.rados.rados.0.trial142.stdout:2690: done (4 left) 2026-02-17T12:02:17.866 INFO:tasks.rados.rados.0.trial142.stdout:2691: done (3 left) 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:2692: done (2 left) 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:2693: done (1 left) 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:2695: done (0 left) 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:2696: copy_from oid 3 from oid 21 current snap is 299 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:2697: rollback oid 32 current snap is 299 2026-02-17T12:02:17.867 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 284 2026-02-17T12:02:17.868 INFO:tasks.rados.rados.0.trial142.stdout:2698: write (excl) oid 26 current snap is 299 2026-02-17T12:02:17.868 INFO:tasks.rados.rados.0.trial142.stdout:2698: seq_num 921 ranges {679247=583042,2044857=609984,3192341=286906} 2026-02-17T12:02:17.871 INFO:tasks.rados.rados.0.trial142.stdout:2698: writing trial14245205-26 from 679247 to 1262289 tid 1 2026-02-17T12:02:17.876 INFO:tasks.rados.rados.0.trial142.stdout:2698: writing trial14245205-26 from 2044857 to 2654841 tid 2 2026-02-17T12:02:17.879 INFO:tasks.rados.rados.0.trial142.stdout:2698: writing trial14245205-26 from 3192341 to 3479247 tid 3 2026-02-17T12:02:17.879 INFO:tasks.rados.rados.0.trial142.stdout:2699: snap_remove snap 295 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient: get_auth_request con 0x7f93d0092180 auth_method 0 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_done global_id 214100 payload 824 2026-02-17T12:02:17.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.941+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93d00a2cc0 con 0x7f93d0092180 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc016de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00f040 con 0x7f93d0092180 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 10 monclient: dump: 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f93bc004020 con 0x7f93d0092180 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:17.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.943+0000 7f93abfff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc016de0 comp rx=0 tx=0).stop 2026-02-17T12:02:17.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.944+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 msgr2=0x7f93d008ed90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:17.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.944+0000 7f93abfff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d0092180 0x7f93d008ed90 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc016de0 comp rx=0 tx=0).stop 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93d5be6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93d5be6640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 0x7f93d01d8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93d5be6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f93d009dac0 con 0x7f93d01cd250 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 0x7f93d01d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient: get_auth_request con 0x7f93d01cd250 auth_method 0 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 10 monclient(hunting): handle_auth_done global_id 214103 payload 824 2026-02-17T12:02:17.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.947+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f93d00901a0 con 0x7f93d01cd250 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93cf7fe640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 msgr2=0x7f93d01d8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93cf7fe640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 0x7f93d01d8390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc003b40 con 0x7f93d01cd250 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.949+0000 7f93abfff640 10 monclient: dump: 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:17.951 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f93bc003b40 con 0x7f93d01cd250 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 msgr2=0x7f93d01d8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 0x7f93d01d8390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc004830 comp rx=0 tx=0).stop 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 msgr2=0x7f93d01d8390 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93abfff640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f93d01cd250 0x7f93d01d8390 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93bc016910 tx=0x7f93bc004830 comp rx=0 tx=0).stop 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 15748, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:17.952 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:17.953 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:17.954 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:17.955 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a003dd40 msgr2=0x7f93a0040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f93a003dd40 0x7f93a0040200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f93d0073fa0 tx=0x7f93c4009040 comp rx=0 tx=0).stop 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 10 monclient: shutdown 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 msgr2=0x7f93d0099fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 --2- 10.20.193.51:0/2014927298 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f93d00a0750 0x7f93d0099fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93c0002410 tx=0x7f93c0004830 comp rx=0 tx=0).stop 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93cffff640 1 -- 10.20.193.51:0/2014927298 reap_dead start 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93cffff640 1 -- 10.20.193.51:0/2014927298 reap_dead start 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 shutdown_connections 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 >> 10.20.193.51:0/2014927298 conn(0x7f93d00a30c0 msgr2=0x7f93d0072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 shutdown_connections 2026-02-17T12:02:17.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:17.950+0000 7f93d5be6640 1 -- 10.20.193.51:0/2014927298 wait complete. 2026-02-17T12:02:17.959 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:17.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:02:17.959 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:02:18.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: get_monmap_and_config 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: build_initial_monmap 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: monmap: 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:18.029061+0000 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:18.029061+0000 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:18.030 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 Processor -- start 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 -- start start 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: init 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-b con 0x7f191c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f191c09dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f191c0a0110 0x7f191c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-a con 0x7f191c0a0110 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c06e140 con 0x7f191c09dac0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f191c09aed0 con 0x7f191c0a0110 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f191c09caa0 con 0x7f191c0a3bb0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f19227ca640 10 monclient(hunting): authenticate will time out at 1625.647872s 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f1920d40640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f191c0a0110 0x7f191c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41246/0 (socket says 10.20.193.51:41246) 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 1 -- 10.20.193.51:0/1335188422 learned_addr learned my addr 10.20.193.51:0/1335188422 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 10 monclient(hunting): get_auth_request con 0x7f191c0a3bb0 auth_method 0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f191bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f1920d40640 10 monclient(hunting): get_auth_request con 0x7f191c0a0110 auth_method 0 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f1920d40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f1920d40640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.028+0000 7f1920d40640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient(hunting): handle_auth_done global_id 204225 payload 274 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 1 -- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 msgr2=0x7f191c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 1 -- 10.20.193.51:0/1335188422 >> v1:10.20.193.142:6789/0 conn(0x7f191c09dac0 legacy=0x7f191c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient: _finish_hunting 0 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 1 monclient: found mon.noname-a 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f1920d40640 1 -- 10.20.193.51:0/1335188422 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c09ce60 con 0x7f191c0a0110 2026-02-17T12:02:18.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.029+0000 7f191bfff640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f1920d40640 1 -- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a0110 msgr2=0x7f191c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f1920d40640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a0110 0x7f191c13c760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f191c06dc20 tx=0x7f191002f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677f0faf6fc309a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 1 -- 10.20.193.51:0/1335188422 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191003c070 con 0x7f191c0a0110 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: dump: 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: _finish_auth 0 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: _check_auth_tickets 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 1 -- 10.20.193.51:0/1335188422 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1910037640 con 0x7f191c0a0110 2026-02-17T12:02:18.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f19227ca640 5 monclient: authenticate success, global_id 204225 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 1 -- 10.20.193.51:0/1335188422 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910037a10 con 0x7f191c0a0110 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f191affd640 10 monclient: dump: 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f19227ca640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:18.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.031+0000 7f19227ca640 4 set_mon_vals no callback set 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 10 monclient: shutdown 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 -- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a0110 msgr2=0x7f191c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a0110 0x7f191c13c760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f191c06dc20 tx=0x7f191002f1c0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 -- 10.20.193.51:0/1335188422 shutdown_connections 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a0110 0x7f191c13c760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 --2- 10.20.193.51:0/1335188422 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c0a3bb0 0x7f191c09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 -- 10.20.193.51:0/1335188422 >> 10.20.193.51:0/1335188422 conn(0x7f191c0a30c0 msgr2=0x7f191c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 -- 10.20.193.51:0/1335188422 shutdown_connections 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 -- 10.20.193.51:0/1335188422 wait complete. 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 10 monclient: build_initial_monmap 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 10 monclient: monmap: 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.032+0000 7f19227ca640 1 Processor -- start 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 -- start start 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient: init 2026-02-17T12:02:18.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 0x7f191c073e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-c con 0x7f191c09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c0a0110 0x7f191c13ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-b con 0x7f191c0a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a3bb0 0x7f191c13b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): picked mon.noname-a con 0x7f191c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f191c09a880 con 0x7f191c0a3bb0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0a0520 con 0x7f191c0a0110 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f191c13cca0 con 0x7f191c09dac0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f19227ca640 10 monclient(hunting): authenticate will time out at 1625.652323s 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 0x7f191c073e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a3bb0 0x7f191c13b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 0x7f191c073e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41262/0 (socket says 10.20.193.51:41262) 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 -- 10.20.193.51:0/3339148657 learned_addr learned my addr 10.20.193.51:0/3339148657 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): get_auth_request con 0x7f191c09dac0 auth_method 0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): get_auth_request con 0x7f191c0a3bb0 auth_method 0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f1920d40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c0a0110 0x7f191c13ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient(hunting): handle_auth_done global_id 214109 payload 824 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c0a0110 msgr2=0x7f191c13ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c0a0110 0x7f191c13ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a3bb0 msgr2=0x7f191c13b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f191c0a3bb0 0x7f191c13b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 monclient: found mon.noname-c 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:18.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191bfff640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c13f720 con 0x7f191c09dac0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191b7fe640 10 monclient: get_auth_request con 0x7f191c0a0110 auth_method 0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.033+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c0a0110 0x7f191c13ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f191bfff640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 msgr2=0x7f191c073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f191bfff640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 0x7f191c073e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f190800ec10 tx=0x7f190800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908017070 con 0x7f191c09dac0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: dump: 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: _finish_auth 0 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:18.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 5 monclient: authenticate success, global_id 214109 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190800ce50 con 0x7f191c09dac0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 10 monclient: _renew_subs 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c13e4e0 con 0x7f191c09dac0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908013690 con 0x7f191c09dac0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f191a7fc640 4 set_mon_vals no callback set 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f1918ff9640 10 monclient: dump: 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 10 monclient: _renew_subs 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.035+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c13f440 con 0x7f191c09dac0 2026-02-17T12:02:18.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f19227ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f19227ca640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 0x7f191c0986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0a3fc0 con 0x7f191c13b880 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1908024060 con 0x7f191c09dac0 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 0x7f191c0986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient: get_auth_request con 0x7f191c13b880 auth_method 0 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f1918ff9640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18ec03dd10 0x7f18ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(621..621 src has 323..621) ==== 4795+0+0 (secure 0 0 0) 0x7f19080526f0 con 0x7f191c09dac0 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 10 monclient(hunting): handle_auth_done global_id 184351 payload 824 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.036+0000 7f191b7fe640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f191c13bc60 con 0x7f191c13b880 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.037+0000 7f1920d40640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18ec03dd10 0x7f18ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.037+0000 7f1920d40640 10 monclient: get_auth_request con 0x7f18ec03dd10 auth_method 0 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f191b7fe640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 msgr2=0x7f191c0986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 0x7f191c0986a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c00dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c00bb30 con 0x7f191c13b880 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:18.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 10 monclient: dump: 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f190c00bb30 con 0x7f191c13b880 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 msgr2=0x7f191c0986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 0x7f191c0986a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c00dbc0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 msgr2=0x7f191c0986a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1918ff9640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c13b880 0x7f191c0986a0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c00dbc0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.039+0000 7f1920d40640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18ec03dd10 0x7f18ec0401d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f191c069d60 tx=0x7f1910033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f19227ca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f19227ca640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 0x7f191c098ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f19227ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f191c13d0b0 con 0x7f191c098be0 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 0x7f191c098ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient: get_auth_request con 0x7f191c098be0 auth_method 0 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 10 monclient(hunting): handle_auth_done global_id 184354 payload 824 2026-02-17T12:02:18.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.042+0000 7f191b7fe640 1 -- 10.20.193.51:0/3339148657 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f191c09ef70 con 0x7f191c098be0 2026-02-17T12:02:18.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f191b7fe640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 msgr2=0x7f191c098ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f191b7fe640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 0x7f191c098ff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c005070 con 0x7f191c098be0 2026-02-17T12:02:18.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 10 monclient: dump: 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f190c005070 con 0x7f191c098be0 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 msgr2=0x7f191c098ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 0x7f191c098ff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c003860 comp rx=0 tx=0).stop 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 msgr2=0x7f191c098ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:18.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1918ff9640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f191c098be0 0x7f191c098ff0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d6f0 tx=0x7f190c003860 comp rx=0 tx=0).stop 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 170432, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:18.049 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:18.051 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:18.052 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.053 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.054 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.055 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:18.056 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18ec03dd10 msgr2=0x7f18ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f18ec03dd10 0x7f18ec0401d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f191c069d60 tx=0x7f1910033000 comp rx=0 tx=0).stop 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 10 monclient: shutdown 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 msgr2=0x7f191c073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 --2- 10.20.193.51:0/3339148657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f191c09dac0 0x7f191c073e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f190800ec10 tx=0x7f190800c520 comp rx=0 tx=0).stop 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1920d40640 1 -- 10.20.193.51:0/3339148657 reap_dead start 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f1920d40640 1 -- 10.20.193.51:0/3339148657 reap_dead start 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 shutdown_connections 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 >> 10.20.193.51:0/3339148657 conn(0x7f191c0a30c0 msgr2=0x7f191c0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 shutdown_connections 2026-02-17T12:02:18.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.045+0000 7f19227ca640 1 -- 10.20.193.51:0/3339148657 wait complete. 2026-02-17T12:02:18.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:18.058 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:02:18.058 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 10 monclient: get_monmap_and_config 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 10 monclient: build_initial_monmap 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 10 monclient: monmap: 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:18.125262+0000 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:18.125262+0000 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:18.126 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:18.127 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 1 Processor -- start 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 1 -- start start 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 10 monclient: init 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.124+0000 7fa4ac088640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T12:02:18.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa4a40a3bb0 0x7fa4a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-a con 0x7fa4a40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa4a40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a413b760 0x7fa4a413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-b con 0x7fa4a413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a406e140 con 0x7fa4a40a0750 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a409f910 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a409ccd0 con 0x7fa4a413b760 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4ac088640 10 monclient(hunting): authenticate will time out at 1625.744140s 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa4a40a3bb0 0x7fa4a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa4a40a3bb0 0x7fa4a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:40986/0 (socket says 10.20.193.51:40986) 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/2231370955 learned_addr learned my addr 10.20.193.51:0/2231370955 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): get_auth_request con 0x7fa4a40a3bb0 auth_method 0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a413b760 0x7fa4a413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): get_auth_request con 0x7fa4a413b760 auth_method 0 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4aa5fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_done global_id 204231 payload 274 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a413b760 msgr2=0x7fa4a413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a413b760 0x7fa4a413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/2231370955 >> v1:10.20.193.142:6789/0 conn(0x7fa4a40a0750 legacy=0x7fa4a409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient: _finish_hunting 0 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 monclient: found mon.noname-a 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:18.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.125+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/2231370955 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a409eec0 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 msgr2=0x7fa4a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a9dfd640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a409dac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4a406c1c0 tx=0x7fa49402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f542ad0604859a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 1 -- 10.20.193.51:0/2231370955 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49403c070 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: dump: 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: _finish_auth 0 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: _check_auth_tickets 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4ac088640 5 monclient: authenticate success, global_id 204231 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4ac088640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:18.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 1 -- 10.20.193.51:0/2231370955 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49402fca0 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4ac088640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 1 -- 10.20.193.51:0/2231370955 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494037660 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4ac088640 4 set_mon_vals no callback set 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.127+0000 7fa4a8dfb640 10 monclient: dump: 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 10 monclient: shutdown 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 msgr2=0x7fa4a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a409dac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4a406c1c0 tx=0x7fa49402ee60 comp rx=0 tx=0).stop 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- 10.20.193.51:0/2231370955 shutdown_connections 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a413b760 0x7fa4a413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 --2- 10.20.193.51:0/2231370955 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a409dac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- 10.20.193.51:0/2231370955 >> 10.20.193.51:0/2231370955 conn(0x7fa4a40a30c0 msgr2=0x7fa4a40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:18.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- 10.20.193.51:0/2231370955 shutdown_connections 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- 10.20.193.51:0/2231370955 wait complete. 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 10 monclient: build_initial_monmap 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 10 monclient: monmap: 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 Processor -- start 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 1 -- start start 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.128+0000 7fa4ac088640 10 monclient: init 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-c con 0x7fa4a40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a41d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-a con 0x7fa4a40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4a413b760 0x7fa4a4094e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): picked mon.noname-b con 0x7fa4a413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a40a04b0 con 0x7fa4a40a3bb0 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a409c850 con 0x7fa4a413b760 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a409e710 con 0x7fa4a40a0750 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4ac088640 10 monclient(hunting): authenticate will time out at 1625.748093s 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41268/0 (socket says 10.20.193.51:41268) 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/1305096908 learned_addr learned my addr 10.20.193.51:0/1305096908 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a41d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): get_auth_request con 0x7fa4a40a0750 auth_method 0 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): get_auth_request con 0x7fa4a40a3bb0 auth_method 0 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a95fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:18.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4aa5fe640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4a413b760 0x7fa4a4094e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4aa5fe640 10 monclient(hunting): get_auth_request con 0x7fa4a413b760 auth_method 0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4aa5fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4aa5fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4aa5fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient(hunting): handle_auth_done global_id 214115 payload 824 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4a413b760 msgr2=0x7fa4a4094e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4a413b760 0x7fa4a4094e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 msgr2=0x7fa4a41d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a41d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient: _finish_hunting 0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 monclient: found mon.noname-c 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.129+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/1305096908 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a4098da0 con 0x7fa4a40a0750 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4a9dfd640 1 -- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 msgr2=0x7fa4a41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4a9dfd640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa494002410 tx=0x7fa4940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494046020 con 0x7fa4a40a0750 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: dump: 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.138 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49402fe50 con 0x7fa4a40a0750 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 5 monclient: authenticate success, global_id 214115 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 10 monclient: _renew_subs 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a40a2400 con 0x7fa4a40a0750 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49403c040 con 0x7fa4a40a0750 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa493fff640 4 set_mon_vals no callback set 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4927fc640 10 monclient: dump: 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:18.139 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 10 monclient: _renew_subs 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.131+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a409d7b0 con 0x7fa4a40a0750 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4ac088640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4ac088640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4ac088640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a409dac0 con 0x7fa4a40a0750 2026-02-17T12:02:18.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa49403f030 con 0x7fa4a40a0750 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4927fc640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 0x7fa474040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(621..621 src has 323..621) ==== 4795+0+0 (secure 0 0 0) 0x7fa4940775c0 con 0x7fa4a40a0750 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4a95fc640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 0x7fa474040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.132+0000 7fa4a95fc640 10 monclient: get_auth_request con 0x7fa47403dd90 auth_method 0 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.135+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa494050030 con 0x7fa4a40a0750 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.135+0000 7fa4927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.135+0000 7fa4927fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:18.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.135+0000 7fa4a95fc640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 0x7fa474040250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40966f0 tx=0x7fa498007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:18.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.247+0000 7fa4ac088640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:02:18.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.247+0000 7fa4ac088640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:02:18.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.247+0000 7fa4ac088640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:18.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.247+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa4a4097610 con 0x7fa4a40a0750 2026-02-17T12:02:18.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.248+0000 7fa4927fc640 1 -- 10.20.193.51:0/1305096908 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa494042880 con 0x7fa4a40a0750 2026-02-17T12:02:18.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.248+0000 7fa4927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:02:18.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.248+0000 7fa4927fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=11,kv=12,logm=44} crc {auth=1928676350,config=692619927,health=942515312,kv=643764954,logm=1015640719}) 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=30,config=2,health=11,kv=12,logm=45} crc {auth=1899938265,config=692619927,health=1103070843,kv=1542691753,logm=3196004009}) 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=11,kv=12,logm=44} crc {auth=1928676350,config=692619927,health=942515312,kv=643764954,logm=1015640719}) 2026-02-17T12:02:18.251 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=32,config=2,health=12,kv=12,logm=42} crc {auth=1166007341,config=692619927,health=2770241980,kv=643764953,logm=3195049855}) 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 msgr2=0x7fa474040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 0x7fa474040250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40966f0 tx=0x7fa498007f30 comp rx=0 tx=0).stop 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 10 monclient: shutdown 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 msgr2=0x7fa4a41cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa494002410 tx=0x7fa4940047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 shutdown_connections 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa47403dd90 0x7fa474040250 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa4a413b760 0x7fa4a4094e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa4a40a3bb0 0x7fa4a41d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 --2- 10.20.193.51:0/1305096908 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa4a40a0750 0x7fa4a41cfad0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:18.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 >> 10.20.193.51:0/1305096908 conn(0x7fa4a40a30c0 msgr2=0x7fa4a413acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:18.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 shutdown_connections 2026-02-17T12:02:18.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:18.249+0000 7fa4ac088640 1 -- 10.20.193.51:0/1305096908 wait complete. 2026-02-17T12:02:18.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451682538}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=244670897}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451682538}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1681966263}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560835885}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=21604}) 2026-02-17T12:02:18.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560835885}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3742060518}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044749965}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2633290904}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044749965}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3697967047}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132198424}) 2026-02-17T12:02:18.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1224060460}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132198424}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3899673976}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2845266423}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3824948922}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2845266423}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2669501968}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3131861986}) 2026-02-17T12:02:18.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1106799123}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3131861986}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=557821817}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612460032}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3704406049}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612460032}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2902265666}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799675030}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2681293558}) 2026-02-17T12:02:18.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799675030}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3209701371}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4081084155}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3020907339}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4081084155}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.253+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2815546391}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3471306080}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1066091103}) 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3471306080}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2543990828}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686347515}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2722594689}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686347515}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2272433828}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2853582563}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2150135412}) 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2853582563}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.254+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2425836395}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003060338}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1750240011}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003060338}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3227131333}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3215372105}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=431704388}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3215372105}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=32190190}) 2026-02-17T12:02:18.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1782617537}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4105461624}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1782617537}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2969144335}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3992605404}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2840793780}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3992605404}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.255+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2710366541}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357849226}) 2026-02-17T12:02:18.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2298878278}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357849226}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4276213549}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285623357}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3869167990}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285623357}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3824670553}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1482030066}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1960658847}) 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1482030066}) 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=366523458}) 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1146005996}) 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2522485199}) 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1146005996}) 2026-02-17T12:02:18.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2028338152}) 2026-02-17T12:02:18.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1615476084}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=764824103}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1615476084}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2988668021}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2102100374}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=469696059}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2102100374}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.257+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2502078893}) 2026-02-17T12:02:18.287 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3281855982}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1598597694}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3281855982}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2977059041}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423123056}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=861029161}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423123056}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=553943726}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298062002}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4008882494}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298062002}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3235108775}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=560594928}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3955189964}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=560594928}) 2026-02-17T12:02:18.288 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.258+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3473664715}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2293736254}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4179156919}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2293736254}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3816824976}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1918106578}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2464357119}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1918106578}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3142937059}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1491183227}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=28560854}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1491183227}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3296175218}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3668759683}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1527142957}) 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.289 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3668759683}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2726939769}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263070829}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1121008676}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263070829}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1023013440}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3399900841}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=614566945}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3399900841}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.260+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4254740854}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3690612647}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3347358825}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3690612647}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2935533739}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1865969804}) 2026-02-17T12:02:18.290 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3974607063}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1865969804}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1875419609}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1456086055}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3681939235}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1456086055}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.261+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2164913581}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465496921}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=793799474}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465496921}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2763636493}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1889455489}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2518685047}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1889455489}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=723519725}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3563890094}) 2026-02-17T12:02:18.291 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3379825199}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3563890094}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=272528413}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255850572}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=910884721}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255850572}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.262+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4191340403}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=726686736}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3978259009}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=726686736}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1617254474}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132770049}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1672390157}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132770049}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=696164310}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757637302}) 2026-02-17T12:02:18.292 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3444108229}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757637302}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.263+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2037284712}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1748753321}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3357094819}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1748753321}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=910623023}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2259635686}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2751344758}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2259635686}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=386381962}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881158775}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3756709283}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881158775}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.264+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1426895179}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059250733}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3915227050}) 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.293 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059250733}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=756833226}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4286744512}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1377337302}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4286744512}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3264412472}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1485372181}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3868752148}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1485372181}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3582595813}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4260322050}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1076476512}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4260322050}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.265+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=728446106}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223160312}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1731833650}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223160312}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=321116476}) 2026-02-17T12:02:18.294 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=228780865}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2764046595}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=228780865}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2869835644}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=835775325}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1590735725}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=835775325}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.266+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=669668907}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1532555759}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3493703901}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1532555759}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=960369592}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3003994079}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1009698805}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3003994079}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.267+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642340296}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179455252}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1465294070}) 2026-02-17T12:02:18.295 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179455252}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.278+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1663097688}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546829108}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1491849565}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546829108}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=437966239}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=121907183}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2335508481}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=121907183}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2721499986}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3099077857}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3974793049}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3099077857}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.279+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3480139622}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175469379}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2493668534}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175469379}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2230039858}) 2026-02-17T12:02:18.296 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652295965}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1168592798}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652295965}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.280+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193561986}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3547252402}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1157296550}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3547252402}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=988147387}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531993982}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=337431066}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531993982}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218124211}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1694306446}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=538536488}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1694306446}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.281+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4147101759}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958893783}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3383961446}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958893783}) 2026-02-17T12:02:18.297 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=422312372}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585262039}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3676872630}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585262039}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=769680644}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523221727}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3581745353}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523221727}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.282+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2036884122}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379953664}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=496971410}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379953664}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=245644829}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=11} crc {logm=2368386540,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2187135967,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3472535926,osd_snap=2493294070}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=39,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18} crc {logm=2532834928,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgrstat=1119035781,mon_config_key=3229068709,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3472535926,osd_snap=480034528}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=11} crc {logm=2368386540,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2187135967,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3472535926,osd_snap=2493294070}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.283+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=40,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=18} crc {logm=2419442828,mdsmap=1949618592,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=876968411,mon_config_key=1590488355,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=3472535926,osd_snap=1388337451}) 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.298 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=91,osdmap=9} crc {osd_snap=286512785,osdmap=1042814388}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=87,osdmap=13} crc {osd_snap=2718939820,osdmap=3401947315}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=91,osdmap=9} crc {osd_snap=286512785,osdmap=1042814388}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=92,osdmap=8} crc {osd_snap=11089055,osdmap=19265092}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2390270268}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2564733704}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2390270268}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=174378298}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3468056691}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2953794803}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3468056691}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.284+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3657465792}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=178284920}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3647224727}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=178284920}) 2026-02-17T12:02:18.299 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.285+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1729357769}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2638595086}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2062525019}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2638595086}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.286+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3211474267}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=2326153879}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=29} crc {osdmap=3849894968}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=2326153879}) 2026-02-17T12:02:18.300 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:02:18.289+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=32} crc {osdmap=218344441}) 2026-02-17T12:02:18.772 INFO:tasks.rados.rados.0.trial142.stdout:2699: done (3 left) 2026-02-17T12:02:18.772 INFO:tasks.rados.rados.0.trial142.stdout:2700: write (excl) oid 22 current snap is 299 2026-02-17T12:02:18.772 INFO:tasks.rados.rados.0.trial142.stdout:2700: seq_num 922 ranges {696054=658291,2103339=753642} 2026-02-17T12:02:18.777 INFO:tasks.rados.rados.0.trial142.stdout:2700: writing trial14245205-22 from 696054 to 1354345 tid 1 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2700: writing trial14245205-22 from 2103339 to 2856981 tid 2 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2701: read oid 49 snap -1 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2701: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2702: snap_remove snap 290 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2697: finishing rollback tid 0 to trial14245205-32 2026-02-17T12:02:18.783 INFO:tasks.rados.rados.0.trial142.stdout:2697: finishing rollback tid 1 to trial14245205-32 2026-02-17T12:02:19.248 INFO:tasks.rados.rados.0.trial142.stdout:2702: done (5 left) 2026-02-17T12:02:19.248 INFO:tasks.rados.rados.0.trial142.stdout:2703: write oid 46 current snap is 299 2026-02-17T12:02:19.248 INFO:tasks.rados.rados.0.trial142.stdout:2703: seq_num 923 ranges {712861=733540,2161821=613653,3247187=265674} 2026-02-17T12:02:19.253 INFO:tasks.rados.rados.0.trial142.stdout:2703: writing trial14245205-46 from 712861 to 1446401 tid 1 2026-02-17T12:02:19.258 INFO:tasks.rados.rados.0.trial142.stdout:2703: writing trial14245205-46 from 2161821 to 2775474 tid 2 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2703: writing trial14245205-46 from 3247187 to 3512861 tid 3 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2704: read oid 2 snap -1 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2704: expect (ObjNum 903 snap 291 seq_num 903) 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2705: delete oid 45 current snap is 299 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2697: finishing rollback tid 2 to trial14245205-32 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2121 (ObjNum 883 snap 280 seq_num 883) dirty exists 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2696: finishing copy_from racing read to trial14245205-3 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2696: finishing copy_from to trial14245205-3 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 1976 (ObjNum 836 snap 264 seq_num 836) dirty exists 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: finishing write tid 1 to trial14245205-26 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: finishing write tid 2 to trial14245205-26 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: finishing write tid 3 to trial14245205-26 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: finishing write tid 4 to trial14245205-26 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: finishing write tid 5 to trial14245205-26 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: oid 26 updating version 0 to 1999 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: oid 26 updating version 1999 to 2001 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: oid 26 version 2001 is already newer than 1998 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: oid 26 version 2001 is already newer than 2000 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2001 (ObjNum 921 snap 299 seq_num 921) dirty exists 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2698: left oid 26 (ObjNum 921 snap 299 seq_num 921) 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2700: finishing write tid 1 to trial14245205-22 2026-02-17T12:02:19.262 INFO:tasks.rados.rados.0.trial142.stdout:2701: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:19.273 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:02:19.273 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.337+0000 7fda5d0fa640 10 monclient: get_monmap_and_config 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.337+0000 7fda5d0fa640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.337+0000 7fda5d0fa640 10 monclient: monmap: 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:19.338607+0000 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:19.338607+0000 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:19.339 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:19.340 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:19.340 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:19.340 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:19.340 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 Processor -- start 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 -- start start 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient: init 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T12:02:19.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-b con 0x7fda580a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fda5809d270 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fda58138780 0x7fda581403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-a con 0x7fda58138780 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda58135430 con 0x7fda5809d270 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fda5809a5c0 con 0x7fda58138780 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fda5809b520 con 0x7fda580a3bb0 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda5d0fa640 10 monclient(hunting): authenticate will time out at 1626.957385s 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fda58138780 0x7fda581403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41274/0 (socket says 10.20.193.51:41274) 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 -- 10.20.193.51:0/2891836294 learned_addr learned my addr 10.20.193.51:0/2891836294 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): get_auth_request con 0x7fda580a3bb0 auth_method 0 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): get_auth_request con 0x7fda58138780 auth_method 0 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient(hunting): handle_auth_done global_id 214118 payload 274 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 -- 10.20.193.51:0/2891836294 >> v2:10.20.193.51:3300/0 conn(0x7fda58138780 msgr2=0x7fda581403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 --2- 10.20.193.51:0/2891836294 >> v2:10.20.193.51:3300/0 conn(0x7fda58138780 0x7fda581403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 -- 10.20.193.51:0/2891836294 >> v1:10.20.193.142:6789/0 conn(0x7fda5809d270 legacy=0x7fda58138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 monclient: found mon.noname-b 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.338+0000 7fda56d76640 1 -- 10.20.193.51:0/2891836294 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5809af60 con 0x7fda580a3bb0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda56d76640 1 -- 10.20.193.51:0/2891836294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 msgr2=0x7fda5809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda56d76640 1 --2- 10.20.193.51:0/2891836294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009970 tx=0x7fda4c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302e9aa5c69cde1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 1 -- 10.20.193.51:0/2891836294 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c03c070 con 0x7fda580a3bb0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: dump: 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 5 monclient: authenticate success, global_id 214118 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 1 -- 10.20.193.51:0/2891836294 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c02fcd0 con 0x7fda580a3bb0 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 1 -- 10.20.193.51:0/2891836294 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c037660 con 0x7fda580a3bb0 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 4 set_mon_vals no callback set 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda55d74640 10 monclient: dump: 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 10 monclient: shutdown 2026-02-17T12:02:19.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2891836294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 msgr2=0x7fda5809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2891836294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009970 tx=0x7fda4c02ee90 comp rx=0 tx=0).stop 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2891836294 shutdown_connections 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2891836294 >> v2:10.20.193.51:3300/0 conn(0x7fda58138780 0x7fda581403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2891836294 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda580a3bb0 0x7fda5809cd30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2891836294 >> 10.20.193.51:0/2891836294 conn(0x7fda580a30c0 msgr2=0x7fda580a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2891836294 shutdown_connections 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2891836294 wait complete. 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.341+0000 7fda5d0fa640 10 monclient: monmap: 2026-02-17T12:02:19.357 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 Processor -- start 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 -- start start 2026-02-17T12:02:19.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient: init 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-a con 0x7fda5809d270 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda580a3bb0 0x7fda5812cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-b con 0x7fda580a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 0x7fda5812d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): picked mon.noname-c con 0x7fda58138780 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fda58074ac0 con 0x7fda5809d270 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fda580a3f90 con 0x7fda580a3bb0 2026-02-17T12:02:19.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fda58135040 con 0x7fda58138780 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda5d0fa640 10 monclient(hunting): authenticate will time out at 1626.961444s 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 0x7fda5812d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41000/0 (socket says 10.20.193.51:41000) 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 -- 10.20.193.51:0/2950478417 learned_addr learned my addr 10.20.193.51:0/2950478417 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): get_auth_request con 0x7fda5809d270 auth_method 0 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): get_auth_request con 0x7fda58138780 auth_method 0 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56575640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda580a3bb0 0x7fda5812cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56575640 10 monclient(hunting): get_auth_request con 0x7fda580a3bb0 auth_method 0 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient(hunting): handle_auth_done global_id 204240 payload 824 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 -- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 msgr2=0x7fda5812d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 0x7fda5812d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 -- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda580a3bb0 msgr2=0x7fda5812cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda580a3bb0 0x7fda5812cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda56d76640 1 -- 10.20.193.51:0/2950478417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda580a2730 con 0x7fda5809d270 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.342+0000 7fda57577640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 0x7fda5812d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda56d76640 1 -- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 msgr2=0x7fda58132100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda56d76640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009aa0 tx=0x7fda4c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c047070 con 0x7fda5809d270 2026-02-17T12:02:19.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: dump: 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda5d0fa640 5 monclient: authenticate success, global_id 204240 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c03f790 con 0x7fda5809d270 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c03c040 con 0x7fda5809d270 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda55573640 4 set_mon_vals no callback set 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda377fe640 10 monclient: dump: 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.364 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda5d0fa640 10 monclient: _renew_subs 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda5d0fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.344+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda581303c0 con 0x7fda5809d270 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 10 monclient: _renew_subs 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda581315f0 con 0x7fda5809d270 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda58138c10 con 0x7fda5809d270 2026-02-17T12:02:19.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fda4c03fb80 con 0x7fda5809d270 2026-02-17T12:02:19.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.345+0000 7fda377fe640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 0x7fda240401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.346+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7fda4c0770b0 con 0x7fda5809d270 2026-02-17T12:02:19.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.346+0000 7fda56575640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 0x7fda240401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.366 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.346+0000 7fda56575640 10 monclient: get_auth_request con 0x7fda2403dd10 auth_method 0 2026-02-17T12:02:19.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.348+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fda580a2730 con 0x7fda5809d270 2026-02-17T12:02:19.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.348+0000 7fda377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.348+0000 7fda377fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:19.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.349+0000 7fda56575640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 0x7fda240401d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fda40006fd0 tx=0x7fda40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: finishing write tid 2 to trial14245205-22 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: finishing write tid 3 to trial14245205-22 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: finishing write tid 4 to trial14245205-22 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: oid 22 updating version 0 to 2128 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: oid 22 version 2128 is already newer than 2126 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:2700: oid 22 version 2128 is already newer than 2127 2026-02-17T12:02:19.383 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2128 (ObjNum 922 snap 299 seq_num 922) dirty exists 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2700: left oid 22 (ObjNum 922 snap 299 seq_num 922) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: finishing write tid 1 to trial14245205-46 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: finishing write tid 2 to trial14245205-46 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2696: done (7 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2697: done (6 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2698: done (5 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2700: done (4 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2701: done (3 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2705: done (2 left) 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2706: delete oid 22 current snap is 299 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: finishing write tid 3 to trial14245205-46 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: finishing write tid 4 to trial14245205-46 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: finishing write tid 5 to trial14245205-46 2026-02-17T12:02:19.384 INFO:tasks.rados.rados.0.trial142.stdout:2703: oid 46 updating version 0 to 2447 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:2703: oid 46 version 2447 is already newer than 2444 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:2703: oid 46 version 2447 is already newer than 2445 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:2703: oid 46 version 2447 is already newer than 2446 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2447 (ObjNum 923 snap 299 seq_num 923) dirty exists 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:2703: left oid 46 (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:02:19.385 INFO:tasks.rados.rados.0.trial142.stdout:2704: expect (ObjNum 903 snap 291 seq_num 903) 2026-02-17T12:02:19.459 INFO:tasks.rados.rados.0.trial142.stdout:2703: done (2 left) 2026-02-17T12:02:19.459 INFO:tasks.rados.rados.0.trial142.stdout:2704: done (1 left) 2026-02-17T12:02:19.460 INFO:tasks.rados.rados.0.trial142.stdout:2706: done (0 left) 2026-02-17T12:02:19.460 INFO:tasks.rados.rados.0.trial142.stdout:2707: write oid 12 current snap is 299 2026-02-17T12:02:19.460 INFO:tasks.rados.rados.0.trial142.stdout:2707: seq_num 926 ranges {763282=559287,1820914=760980,3213103=350179} 2026-02-17T12:02:19.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda5d0fa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda5d0fa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda5d0fa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fda58074d80 con 0x7fda5809d270 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda377fe640 1 -- 10.20.193.51:0/2950478417 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fda4c049d90 con 0x7fda5809d270 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:19.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.462+0000 7fda377fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:19.466 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:19.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 msgr2=0x7fda240401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 0x7fda240401d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fda40006fd0 tx=0x7fda40008040 comp rx=0 tx=0).stop 2026-02-17T12:02:19.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 10 monclient: shutdown 2026-02-17T12:02:19.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 msgr2=0x7fda58132100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009aa0 tx=0x7fda4c004830 comp rx=0 tx=0).stop 2026-02-17T12:02:19.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 shutdown_connections 2026-02-17T12:02:19.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fda2403dd10 0x7fda240401d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fda58138780 0x7fda5812d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fda580a3bb0 0x7fda5812cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 --2- 10.20.193.51:0/2950478417 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fda5809d270 0x7fda58132100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 >> 10.20.193.51:0/2950478417 conn(0x7fda580a30c0 msgr2=0x7fda5809c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 shutdown_connections 2026-02-17T12:02:19.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.463+0000 7fda5d0fa640 1 -- 10.20.193.51:0/2950478417 wait complete. 2026-02-17T12:02:19.472 INFO:tasks.rados.rados.0.trial142.stdout:2707: writing trial14245205-12 from 763282 to 1322569 tid 1 2026-02-17T12:02:19.472 INFO:tasks.rados.rados.0.trial142.stdout:2707: writing trial14245205-12 from 1820914 to 2581894 tid 2 2026-02-17T12:02:19.474 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:02:19.474 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:02:19.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:02:19.474 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:02:19.476 INFO:tasks.rados.rados.0.trial142.stdout:2707: writing trial14245205-12 from 3213103 to 3563282 tid 3 2026-02-17T12:02:19.476 INFO:tasks.rados.rados.0.trial142.stdout:2708: snap_remove snap 298 2026-02-17T12:02:19.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 10 monclient: get_monmap_and_config 2026-02-17T12:02:19.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 10 monclient: monmap: 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:19.542469+0000 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:19.542469+0000 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:19.547 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 1 Processor -- start 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 1 -- start start 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.541+0000 7f27fb72c640 10 monclient: init 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f27f40a01f0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-b con 0x7f27f41383c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 0x7f27f413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-a con 0x7f27f413d760 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f41387c0 con 0x7f27f40a01f0 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f27f40a0ce0 con 0x7f27f413d760 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f27f40a2920 con 0x7f27f41383c0 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27fb72c640 10 monclient(hunting): authenticate will time out at 1627.161258s 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 0x7f27f413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41294/0 (socket says 10.20.193.51:41294) 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 0x7f27f413fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41002/0 (socket says 10.20.193.51:41002) 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 -- 10.20.193.51:0/4055664281 learned_addr learned my addr 10.20.193.51:0/4055664281 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request con 0x7f27f41383c0 auth_method 0 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): get_auth_request con 0x7f27f413d760 auth_method 0 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_done global_id 214124 payload 274 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 -- 10.20.193.51:0/4055664281 >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 msgr2=0x7f27f413fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/4055664281 >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 0x7f27f413fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 -- 10.20.193.51:0/4055664281 >> v1:10.20.193.142:6789/0 conn(0x7f27f40a01f0 legacy=0x7f27f40a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 monclient: found mon.noname-b 2026-02-17T12:02:19.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:02:19.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.542+0000 7f27f8ca0640 1 -- 10.20.193.51:0/4055664281 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f40a2cd0 con 0x7f27f41383c0 2026-02-17T12:02:19.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.544+0000 7f27f8ca0640 1 -- 10.20.193.51:0/4055664281 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 msgr2=0x7f27f413d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.544+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/4055664281 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009970 tx=0x7f27e802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a309789c7977a72a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 1 -- 10.20.193.51:0/4055664281 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e803c070 con 0x7f27f41383c0 2026-02-17T12:02:19.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: dump: 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.563 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 1 -- 10.20.193.51:0/4055664281 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e802fcd0 con 0x7f27f41383c0 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 1 -- 10.20.193.51:0/4055664281 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8037660 con 0x7f27f41383c0 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 5 monclient: authenticate success, global_id 214124 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:19.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 4 set_mon_vals no callback set 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27e3fff640 10 monclient: dump: 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.565 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 10 monclient: shutdown 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 -- 10.20.193.51:0/4055664281 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 msgr2=0x7f27f413d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 --2- 10.20.193.51:0/4055664281 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009970 tx=0x7f27e802ee90 comp rx=0 tx=0).stop 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 -- 10.20.193.51:0/4055664281 shutdown_connections 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 --2- 10.20.193.51:0/4055664281 >> v2:10.20.193.51:3300/0 conn(0x7f27f413d760 0x7f27f413fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 --2- 10.20.193.51:0/4055664281 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f41383c0 0x7f27f413d220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 -- 10.20.193.51:0/4055664281 >> 10.20.193.51:0/4055664281 conn(0x7f27f40a6be0 msgr2=0x7f27f40a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 -- 10.20.193.51:0/4055664281 shutdown_connections 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.545+0000 7f27fb72c640 1 -- 10.20.193.51:0/4055664281 wait complete. 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient: monmap: 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:19.567 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 Processor -- start 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 -- start start 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient: init 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:19.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-a con 0x7f27f40a01f0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f27f41383c0 0x7f27f413c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-b con 0x7f27f41383c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f413d760 0x7f27f413c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): picked mon.noname-c con 0x7f27f413d760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f27f409df00 con 0x7f27f40a01f0 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f27f409ed80 con 0x7f27f41383c0 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f27f4074810 con 0x7f27f413d760 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27fb72c640 10 monclient(hunting): authenticate will time out at 1627.165507s 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41008/0 (socket says 10.20.193.51:41008) 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 -- 10.20.193.51:0/1583707967 learned_addr learned my addr 10.20.193.51:0/1583707967 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): get_auth_request con 0x7f27f40a01f0 auth_method 0 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f413d760 0x7f27f413c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): get_auth_request con 0x7f27f413d760 auth_method 0 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f27f41383c0 0x7f27f413c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f9ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request con 0x7f27f41383c0 auth_method 0 2026-02-17T12:02:19.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f8ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f8ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient(hunting): handle_auth_done global_id 204246 payload 824 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f413d760 msgr2=0x7f27f413c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f27f413d760 0x7f27f413c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f27f41383c0 msgr2=0x7f27f413c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f27f41383c0 0x7f27f413c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.546+0000 7f27f94a1640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f413abf0 con 0x7f27f40a01f0 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27f94a1640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 msgr2=0x7f27f41cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27f94a1640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c5d0 tx=0x7f27e400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4016020 con 0x7f27f40a01f0 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: dump: 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.573 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e4012a60 con 0x7f27f40a01f0 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 5 monclient: authenticate success, global_id 204246 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 10 monclient: _renew_subs 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f4139740 con 0x7f27f40a01f0 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4012e50 con 0x7f27f40a01f0 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e1ffb640 10 monclient: dump: 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.575 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27e37fe640 4 set_mon_vals no callback set 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 10 monclient: _renew_subs 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.548+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f413a910 con 0x7f27f40a01f0 2026-02-17T12:02:19.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27fb72c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27fb72c640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 0x7f27f409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f27f40a05d0 con 0x7f27f409bb00 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 0x7f27f409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient: get_auth_request con 0x7f27f409bb00 auth_method 0 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f27e401b400 con 0x7f27f40a01f0 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_done global_id 204249 payload 824 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27f8ca0640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27f41394c0 con 0x7f27f409bb00 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27e1ffb640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f27c403deb0 0x7f27c4040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.549+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7f27e40526c0 con 0x7f27f40a01f0 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.550+0000 7f27f9ca2640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f27c403deb0 0x7f27c4040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.550+0000 7f27f9ca2640 10 monclient: get_auth_request con 0x7f27c403deb0 auth_method 0 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.551+0000 7f27f8ca0640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 msgr2=0x7f27f409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.551+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 0x7f27f409bee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27f4076fd0 tx=0x7f27e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e803c040 con 0x7f27f409bb00 2026-02-17T12:02:19.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 10 monclient: dump: 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f27e8037d30 con 0x7f27f409bb00 2026-02-17T12:02:19.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 msgr2=0x7f27f409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 0x7f27f409bee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27f4076fd0 tx=0x7f27e80047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 msgr2=0x7f27f409bee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27e1ffb640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409bb00 0x7f27f409bee0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27f4076fd0 tx=0x7f27e80047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.552+0000 7f27f9ca2640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f27c403deb0 0x7f27c4040370 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f27f4074d20 tx=0x7f27f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27fb72c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27fb72c640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 0x7f27f41da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27fb72c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f27f4076490 con 0x7f27f409c420 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 0x7f27f41da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient: get_auth_request con 0x7f27f409c420 auth_method 0 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 10 monclient(hunting): handle_auth_done global_id 204252 payload 824 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.555+0000 7f27f8ca0640 1 -- 10.20.193.51:0/1583707967 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27f409c830 con 0x7f27f409c420 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27f8ca0640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 msgr2=0x7f27f41da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27f8ca0640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 0x7f27f41da4c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27e8002410 tx=0x7f27e8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e803c040 con 0x7f27f409c420 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 10 monclient: dump: 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f27e804db70 con 0x7f27f409c420 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:19.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 msgr2=0x7f27f41da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 0x7f27f41da4c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27e8002410 tx=0x7f27e8008030 comp rx=0 tx=0).stop 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 msgr2=0x7f27f41da4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.557+0000 7f27e1ffb640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f409c420 0x7f27f41da4c0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27e8002410 tx=0x7f27e8008030 comp rx=0 tx=0).stop 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:19.583 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 80323, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:19.584 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:19.585 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:19.586 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.587 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:19.588 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.589 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.590 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.591 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:19.592 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.593 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.594 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:19.595 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f27c403deb0 msgr2=0x7f27c4040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f27c403deb0 0x7f27c4040370 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f27f4074d20 tx=0x7f27f000b040 comp rx=0 tx=0).stop 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 10 monclient: shutdown 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 msgr2=0x7f27f41cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27f9ca2640 1 -- 10.20.193.51:0/1583707967 reap_dead start 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c5d0 tx=0x7f27e400caa0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 shutdown_connections 2026-02-17T12:02:19.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 --2- 10.20.193.51:0/1583707967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f27f40a01f0 0x7f27f41cf3e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 >> 10.20.193.51:0/1583707967 conn(0x7f27f40a6be0 msgr2=0x7f27f40a1300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 shutdown_connections 2026-02-17T12:02:19.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.558+0000 7f27fb72c640 1 -- 10.20.193.51:0/1583707967 wait complete. 2026-02-17T12:02:19.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:19.598 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:02:19.599 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.665+0000 7f4c18a1a640 10 monclient: get_monmap_and_config 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.665+0000 7f4c18a1a640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.665+0000 7f4c18a1a640 10 monclient: monmap: 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:19.666759+0000 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:19.666759+0000 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:19.668 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 Processor -- start 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 -- start start 2026-02-17T12:02:19.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient: init 2026-02-17T12:02:19.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T12:02:19.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c1406eb80 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:19.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4c140a4c10 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:19.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4c1413e220 0x7f4c14140610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-a con 0x7f4c1413e220 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c14138cb0 con 0x7f4c140a4c10 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1406f9c0 con 0x7f4c1406eb80 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1406ef60 con 0x7f4c1413e220 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c18a1a640 10 monclient(hunting): authenticate will time out at 1627.285609s 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4c1413e220 0x7f4c14140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c11d74640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f4c140a4c10 0x7f4c141385a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35350/0 (socket says 10.20.193.51:35350) 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c11d74640 1 -- 10.20.193.51:0/3657148508 learned_addr learned my addr 10.20.193.51:0/3657148508 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): get_auth_request con 0x7f4c1413e220 auth_method 0 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient(hunting): handle_auth_done global_id 204255 payload 274 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 1 -- 10.20.193.51:0/3657148508 >> v1:10.20.193.142:6789/0 conn(0x7f4c1406eb80 legacy=0x7f4c14137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 1 -- 10.20.193.51:0/3657148508 >> v1:10.20.193.51:6789/0 conn(0x7f4c140a4c10 legacy=0x7f4c141385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.666+0000 7f4c12d76640 1 -- 10.20.193.51:0/3657148508 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1406fca0 con 0x7f4c1413e220 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c12d76640 1 -- 10.20.193.51:0/3657148508 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1413e220 msgr2=0x7f4c14140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c12d76640 1 --2- 10.20.193.51:0/3657148508 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1413e220 0x7f4c14140610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c0402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be0f5450c8a8960 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 1 -- 10.20.193.51:0/3657148508 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0403c070 con 0x7f4c1413e220 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: dump: 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 1 -- 10.20.193.51:0/3657148508 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c04037640 con 0x7f4c1413e220 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 1 -- 10.20.193.51:0/3657148508 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04037a10 con 0x7f4c1413e220 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c11573640 10 monclient: dump: 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 5 monclient: authenticate success, global_id 204255 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 4 set_mon_vals no callback set 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 10 monclient: shutdown 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 -- 10.20.193.51:0/3657148508 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1413e220 msgr2=0x7f4c14140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/3657148508 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1413e220 0x7f4c14140610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c0402f190 comp rx=0 tx=0).stop 2026-02-17T12:02:19.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 -- 10.20.193.51:0/3657148508 shutdown_connections 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/3657148508 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1413e220 0x7f4c14140610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 -- 10.20.193.51:0/3657148508 >> 10.20.193.51:0/3657148508 conn(0x7f4c140a8c80 msgr2=0x7f4c140a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 -- 10.20.193.51:0/3657148508 shutdown_connections 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.669+0000 7f4c18a1a640 1 -- 10.20.193.51:0/3657148508 wait complete. 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient: monmap: 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 Processor -- start 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 -- start start 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient: init 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-a con 0x7f4c1406eb80 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c140a4c10 0x7f4c141cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-b con 0x7f4c140a4c10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:19.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1413e220 0x7f4c141cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): picked mon.noname-c con 0x7f4c1413e220 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14140cd0 con 0x7f4c1406eb80 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14140b50 con 0x7f4c140a4c10 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4c14140e50 con 0x7f4c1413e220 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c18a1a640 10 monclient(hunting): authenticate will time out at 1627.289826s 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41034/0 (socket says 10.20.193.51:41034) 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 1 -- 10.20.193.51:0/935463389 learned_addr learned my addr 10.20.193.51:0/935463389 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): get_auth_request con 0x7f4c1406eb80 auth_method 0 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1413e220 0x7f4c141cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): get_auth_request con 0x7f4c1413e220 auth_method 0 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c11d74640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c140a4c10 0x7f4c141cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.670+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c11d74640 10 monclient(hunting): get_auth_request con 0x7f4c140a4c10 auth_method 0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c11d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c11d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c11d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 10 monclient(hunting): handle_auth_done global_id 204258 payload 824 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1413e220 msgr2=0x7f4c141cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1413e220 0x7f4c141cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c140a4c10 msgr2=0x7f4c141cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4c140a4c10 0x7f4c141cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.671+0000 7f4c12575640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c141407b0 con 0x7f4c1406eb80 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c12575640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 msgr2=0x7f4c141cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c12575640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c5d0 tx=0x7f4c0800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08016020 con 0x7f4c1406eb80 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: dump: 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c08012a60 con 0x7f4c1406eb80 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08012e50 con 0x7f4c1406eb80 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c10d72640 4 set_mon_vals no callback set 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4bfaffd640 10 monclient: dump: 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 5 monclient: authenticate success, global_id 204258 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 monclient: _renew_subs 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c140a2820 con 0x7f4c1406eb80 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 monclient: _renew_subs 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c14074a20 con 0x7f4c1406eb80 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 0x7f4c1409d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1409f5a0 con 0x7f4c1409d560 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c11d74640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 0x7f4c1409d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c11d74640 10 monclient: get_auth_request con 0x7f4c1409d560 auth_method 0 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c11d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c11d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.673+0000 7f4c11d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4c0801b400 con 0x7f4c1406eb80 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c11d74640 10 monclient(hunting): handle_auth_done global_id 214133 payload 824 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c11d74640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c14137e90 con 0x7f4c1409d560 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4bfaffd640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4be003deb0 0x7f4be0040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7f4c08052690 con 0x7f4c1406eb80 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c12d76640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4be003deb0 0x7f4be0040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.674+0000 7f4c12d76640 10 monclient: get_auth_request con 0x7f4be003deb0 auth_method 0 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4c11d74640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 msgr2=0x7f4c1409d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4c11d74640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 0x7f4c1409d940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a93d0 tx=0x7f4bfc00eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc005be0 con 0x7f4c1409d560 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 10 monclient: dump: 2026-02-17T12:02:19.684 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f4bfc018070 con 0x7f4c1409d560 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 msgr2=0x7f4c1409d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 0x7f4c1409d940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a93d0 tx=0x7f4bfc00eba0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 msgr2=0x7f4c1409d940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4bfaffd640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409d560 0x7f4c1409d940 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a93d0 tx=0x7f4bfc00eba0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.676+0000 7f4c12d76640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4be003deb0 0x7f4be0040370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a5070 tx=0x7f4c04033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c18a1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 0x7f4c141da370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c18a1a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4c140a23e0 con 0x7f4c1409de80 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 0x7f4c141da370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient: get_auth_request con 0x7f4c1409de80 auth_method 0 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 10 monclient(hunting): handle_auth_done global_id 214136 payload 824 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.679+0000 7f4c11d74640 1 -- 10.20.193.51:0/935463389 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4c14069830 con 0x7f4c1409de80 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c11d74640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 msgr2=0x7f4c141da370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c11d74640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 0x7f4c141da370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc017000 tx=0x7f4bfc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00c730 con 0x7f4c1409de80 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 10 monclient: dump: 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f4bfc00c730 con 0x7f4c1409de80 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 msgr2=0x7f4c141da370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 0x7f4c141da370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc017000 tx=0x7f4bfc004a40 comp rx=0 tx=0).stop 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 msgr2=0x7f4c141da370 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4bfaffd640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4c1409de80 0x7f4c141da370 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc017000 tx=0x7f4bfc004a40 comp rx=0 tx=0).stop 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 17481, 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.687 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.688 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.689 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.690 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.691 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:19.692 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.693 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.694 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.694 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:19.694 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:19.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4be003deb0 msgr2=0x7f4be0040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4be003deb0 0x7f4be0040370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a5070 tx=0x7f4c04033000 comp rx=0 tx=0).stop 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 10 monclient: shutdown 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 msgr2=0x7f4c141cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c5d0 tx=0x7f4c0800caa0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c12d76640 1 -- 10.20.193.51:0/935463389 reap_dead start 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 shutdown_connections 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 --2- 10.20.193.51:0/935463389 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4c1406eb80 0x7f4c141cf020 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 >> 10.20.193.51:0/935463389 conn(0x7f4c140a8c80 msgr2=0x7f4c140a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 shutdown_connections 2026-02-17T12:02:19.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.682+0000 7f4c18a1a640 1 -- 10.20.193.51:0/935463389 wait complete. 2026-02-17T12:02:19.695 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:19.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:02:19.696 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:02:19.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.764+0000 7efda9ff5640 10 monclient: get_monmap_and_config 2026-02-17T12:02:19.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.764+0000 7efda9ff5640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.764+0000 7efda9ff5640 10 monclient: monmap: 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:19.765647+0000 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:19.765647+0000 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:19.767 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:19.768 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:19.768 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 Processor -- start 2026-02-17T12:02:19.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 -- start start 2026-02-17T12:02:19.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient: init 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7efda40a3bb0 0x7efda409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-a con 0x7efda40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 0x7efda409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-b con 0x7efda40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7efda409e540 0x7efda413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-c con 0x7efda409e540 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:19.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7efda40a3f90 con 0x7efda40a3bb0 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7efda406e140 con 0x7efda409e540 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7efda409f910 con 0x7efda40a0750 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda9ff5640 10 monclient(hunting): authenticate will time out at 1627.384426s 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7efda40a3bb0 0x7efda409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 0x7efda409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7efda40a3bb0 0x7efda409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41044/0 (socket says 10.20.193.51:41044) 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 -- 10.20.193.51:0/363485687 learned_addr learned my addr 10.20.193.51:0/363485687 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): get_auth_request con 0x7efda40a3bb0 auth_method 0 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): get_auth_request con 0x7efda40a0750 auth_method 0 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda3fff640 1 --2- 10.20.193.51:0/363485687 >> v2:10.20.193.142:3300/0 conn(0x7efda409e540 0x7efda413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda3fff640 10 monclient(hunting): get_auth_request con 0x7efda409e540 auth_method 0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient(hunting): handle_auth_done global_id 204261 payload 274 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 -- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 msgr2=0x7efda409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 0x7efda409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 -- 10.20.193.51:0/363485687 >> v2:10.20.193.142:3300/0 conn(0x7efda409e540 msgr2=0x7efda413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 --2- 10.20.193.51:0/363485687 >> v2:10.20.193.142:3300/0 conn(0x7efda409e540 0x7efda413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda37fe640 1 -- 10.20.193.51:0/363485687 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda409ccd0 con 0x7efda40a3bb0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.765+0000 7efda2ffd640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 0x7efda409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda37fe640 1 -- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a3bb0 msgr2=0x7efda409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda37fe640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a3bb0 0x7efda409dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efda409f230 tx=0x7efd9002ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c66849d2b85b61 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 1 -- 10.20.193.51:0/363485687 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9003c070 con 0x7efda40a3bb0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: dump: 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 1 -- 10.20.193.51:0/363485687 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9002fcb0 con 0x7efda40a3bb0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 5 monclient: authenticate success, global_id 204261 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 1 -- 10.20.193.51:0/363485687 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9002fe60 con 0x7efda40a3bb0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda27fc640 10 monclient: dump: 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:19.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 4 set_mon_vals no callback set 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 10 monclient: shutdown 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 -- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a3bb0 msgr2=0x7efda409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a3bb0 0x7efda409dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efda409f230 tx=0x7efd9002ee70 comp rx=0 tx=0).stop 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 -- 10.20.193.51:0/363485687 shutdown_connections 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 --2- 10.20.193.51:0/363485687 >> v2:10.20.193.142:3300/0 conn(0x7efda409e540 0x7efda413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a0750 0x7efda409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 --2- 10.20.193.51:0/363485687 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a3bb0 0x7efda409dac0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.768+0000 7efda9ff5640 1 -- 10.20.193.51:0/363485687 >> 10.20.193.51:0/363485687 conn(0x7efda40a30c0 msgr2=0x7efda40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 1 -- 10.20.193.51:0/363485687 shutdown_connections 2026-02-17T12:02:19.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 1 -- 10.20.193.51:0/363485687 wait complete. 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 10 monclient: monmap: 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 1 Processor -- start 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 1 -- start start 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.769+0000 7efda9ff5640 10 monclient: init 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda409e540 0x7efda41380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-b con 0x7efda409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a0750 0x7efda4130e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-a con 0x7efda40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 0x7efda4131380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): picked mon.noname-c con 0x7efda40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7efda40a04b0 con 0x7efda40a0750 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efda409c850 con 0x7efda409e540 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7efda413cca0 con 0x7efda40a3bb0 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda9ff5640 10 monclient(hunting): authenticate will time out at 1627.389191s 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a0750 0x7efda4130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 0x7efda4131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a0750 0x7efda4130e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41048/0 (socket says 10.20.193.51:41048) 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 1 -- 10.20.193.51:0/2325434418 learned_addr learned my addr 10.20.193.51:0/2325434418 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): get_auth_request con 0x7efda40a0750 auth_method 0 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): get_auth_request con 0x7efda40a3bb0 auth_method 0 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda37fe640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda409e540 0x7efda41380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda37fe640 10 monclient(hunting): get_auth_request con 0x7efda409e540 auth_method 0 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient(hunting): handle_auth_done global_id 214142 payload 824 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda409e540 msgr2=0x7efda41380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda409e540 0x7efda41380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a0750 msgr2=0x7efda4130e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efda40a0750 0x7efda4130e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 monclient: found mon.noname-c 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.770+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41330c0 con 0x7efda40a3bb0 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 msgr2=0x7efda4131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda3fff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 0x7efda4131380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd98007d40 tx=0x7efd9800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003a90 con 0x7efda40a3bb0 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: dump: 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.784 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98003c50 con 0x7efda40a3bb0 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 5 monclient: authenticate success, global_id 214142 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 10 monclient: _renew_subs 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:19.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda406f6c0 con 0x7efda40a3bb0 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98004020 con 0x7efda40a3bb0 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda1ffb640 4 set_mon_vals no callback set 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efd7ffff640 10 monclient: dump: 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 10 monclient: _renew_subs 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.772+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efda4134430 con 0x7efda40a3bb0 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda9ff5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda9ff5640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 0x7efda4134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efda4131ca0 con 0x7efda41318c0 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7efd98004240 con 0x7efda40a3bb0 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 0x7efda4134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient: get_auth_request con 0x7efda41318c0 auth_method 0 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efd7ffff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efd7403dd10 0x7efd740401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7efd980529f0 con 0x7efda40a3bb0 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 10 monclient(hunting): handle_auth_done global_id 184375 payload 824 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda37fe640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efda406e4a0 con 0x7efda41318c0 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda2ffd640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efd7403dd10 0x7efd740401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.773+0000 7efda2ffd640 10 monclient: get_auth_request con 0x7efd7403dd10 auth_method 0 2026-02-17T12:02:19.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.775+0000 7efda37fe640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 msgr2=0x7efda4134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.775+0000 7efda37fe640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 0x7efda4134670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efda406c1c0 tx=0x7efd90004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.775+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90046070 con 0x7efda41318c0 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.775+0000 7efd7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 10 monclient: dump: 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.789 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7efd90037de0 con 0x7efda41318c0 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 msgr2=0x7efda4134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 0x7efda4134670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efda406c1c0 tx=0x7efd90004830 comp rx=0 tx=0).stop 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efda2ffd640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efd7403dd10 0x7efd740401d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd94009660 tx=0x7efd94009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 msgr2=0x7efda4134670 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.776+0000 7efd7ffff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41318c0 0x7efda4134670 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efda406c1c0 tx=0x7efd90004830 comp rx=0 tx=0).stop 2026-02-17T12:02:19.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda9ff5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:19.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda9ff5640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 0x7efda41d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda9ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efda409dac0 con 0x7efda41398f0 2026-02-17T12:02:19.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 0x7efda41d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient: get_auth_request con 0x7efda41398f0 auth_method 0 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 10 monclient(hunting): handle_auth_done global_id 184378 payload 824 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.779+0000 7efda37fe640 1 -- 10.20.193.51:0/2325434418 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efda4069830 con 0x7efda41398f0 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efda37fe640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 msgr2=0x7efda41d9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efda37fe640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 0x7efda41d9b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd90002410 tx=0x7efd900047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90046040 con 0x7efda41398f0 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efd7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efd7ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.781+0000 7efd7ffff640 10 monclient: dump: 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7efd9004b450 con 0x7efda41398f0 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 msgr2=0x7efda41d9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 0x7efda41d9b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd90002410 tx=0x7efd900047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 msgr2=0x7efda41d9b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efd7ffff640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efda41398f0 0x7efda41d9b80 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd90002410 tx=0x7efd900047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.795 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 156, 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 172168, 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.796 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.797 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:19.798 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:19.799 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.801 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.803 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.804 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:19.805 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efd7403dd10 msgr2=0x7efd740401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efd7403dd10 0x7efd740401d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd94009660 tx=0x7efd94009290 comp rx=0 tx=0).stop 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 10 monclient: shutdown 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 msgr2=0x7efda4131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 --2- 10.20.193.51:0/2325434418 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efda40a3bb0 0x7efda4131380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd98007d40 tx=0x7efd9800e4b0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 reap_dead start 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda3fff640 1 -- 10.20.193.51:0/2325434418 reap_dead start 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 shutdown_connections 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 >> 10.20.193.51:0/2325434418 conn(0x7efda40a30c0 msgr2=0x7efda4072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 shutdown_connections 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.782+0000 7efda9ff5640 1 -- 10.20.193.51:0/2325434418 wait complete. 2026-02-17T12:02:19.807 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:02:19.807 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T12:02:19.807 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:02:19.807 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T12:02:19.807 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:02:19.807 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:02:19.807 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:02:19.816 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:02:19.816 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:02:19.816 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:19.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.919+0000 7f59cacb7640 10 monclient: get_monmap_and_config 2026-02-17T12:02:19.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.919+0000 7f59cacb7640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.919+0000 7f59cacb7640 10 monclient: monmap: 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:19.920736+0000 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:19.920736+0000 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:19.922 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 Processor -- start 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 -- start start 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient: init 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f59c40a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f59c413b380 0x7f59c413d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-a con 0x7f59c413b380 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 0x7f59c41400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-b con 0x7f59c413dcb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c4135430 con 0x7f59c40a3bb0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f59c409a5c0 con 0x7f59c413b380 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f59c409b520 con 0x7f59c413dcb0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59cacb7640 10 monclient(hunting): authenticate will time out at 1627.539562s 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59c922d640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 msgr2=0x7f59c41400a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59c922d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 0x7f59c41400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f59c413b380 0x7f59c413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f59c413b380 0x7f59c413d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41060/0 (socket says 10.20.193.51:41060) 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 -- 10.20.193.51:0/3864754540 learned_addr learned my addr 10.20.193.51:0/3864754540 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): get_auth_request con 0x7f59c413b380 auth_method 0 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient(hunting): handle_auth_done global_id 204267 payload 274 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 -- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 msgr2=0x7f59c41400a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 --2- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 0x7f59c41400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 -- 10.20.193.51:0/3864754540 >> v1:10.20.193.142:6789/0 conn(0x7f59c40a3bb0 legacy=0x7f59c409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.920+0000 7f59bbfff640 1 -- 10.20.193.51:0/3864754540 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c409af60 con 0x7f59c413b380 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bbfff640 1 -- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c413b380 msgr2=0x7f59c413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bbfff640 1 --2- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c413b380 0x7f59c413d770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59c409a740 tx=0x7f59ac02ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9704124dbc8d9aff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 1 -- 10.20.193.51:0/3864754540 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03c070 con 0x7f59c413b380 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: dump: 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 1 -- 10.20.193.51:0/3864754540 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac02fd70 con 0x7f59c413b380 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 5 monclient: authenticate success, global_id 204267 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:19.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 1 -- 10.20.193.51:0/3864754540 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac037660 con 0x7f59c413b380 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 4 set_mon_vals no callback set 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59bb7fe640 10 monclient: dump: 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 10 monclient: shutdown 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 -- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c413b380 msgr2=0x7f59c413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 --2- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c413b380 0x7f59c413d770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59c409a740 tx=0x7f59ac02ee50 comp rx=0 tx=0).stop 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 -- 10.20.193.51:0/3864754540 shutdown_connections 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 --2- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413dcb0 0x7f59c41400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 --2- 10.20.193.51:0/3864754540 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c413b380 0x7f59c413d770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 -- 10.20.193.51:0/3864754540 >> 10.20.193.51:0/3864754540 conn(0x7f59c40a30c0 msgr2=0x7f59c40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 -- 10.20.193.51:0/3864754540 shutdown_connections 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.923+0000 7f59cacb7640 1 -- 10.20.193.51:0/3864754540 wait complete. 2026-02-17T12:02:19.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient: build_initial_monmap 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient: monmap: 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 Processor -- start 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 -- start start 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient: init 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-a con 0x7f59c40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 0x7f59c41372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-c con 0x7f59c413b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59c413dcb0 0x7f59c41377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): picked mon.noname-b con 0x7f59c413dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4135040 con 0x7f59c40a3bb0 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4074ac0 con 0x7f59c413dcb0 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f59c41351c0 con 0x7f59c413b380 2026-02-17T12:02:19.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59cacb7640 10 monclient(hunting): authenticate will time out at 1627.543639s 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59bbfff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 msgr2=0x7f59c41372b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59bbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 0x7f59c41372b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41066/0 (socket says 10.20.193.51:41066) 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 -- 10.20.193.51:0/2913222319 learned_addr learned my addr 10.20.193.51:0/2913222319 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): get_auth_request con 0x7f59c40a3bb0 auth_method 0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c922d640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59c413dcb0 0x7f59c41377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c922d640 10 monclient(hunting): get_auth_request con 0x7f59c413dcb0 auth_method 0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c922d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c922d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c922d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient(hunting): handle_auth_done global_id 204270 payload 824 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 -- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 msgr2=0x7f59c41372b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 0x7f59c41372b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 -- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59c413dcb0 msgr2=0x7f59c41377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59c413dcb0 0x7f59c41377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient: _finish_hunting 0 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 monclient: found mon.noname-a 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:19.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.924+0000 7f59c8a2c640 1 -- 10.20.193.51:0/2913222319 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c413abb0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.926+0000 7f59c8a2c640 1 -- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 msgr2=0x7f59c4132060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.926+0000 7f59c8a2c640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b580 tx=0x7f59b400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40026e0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: dump: 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: _finish_auth 0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: _check_auth_tickets 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b4014070 con 0x7f59c40a3bb0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 5 monclient: authenticate success, global_id 204270 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _renew_subs 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4131550 con 0x7f59c40a3bb0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4002ac0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59baffd640 4 set_mon_vals no callback set 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 10 monclient: dump: 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _renew_subs 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c4139270 con 0x7f59c40a3bb0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c409cd30 con 0x7f59c40a3bb0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.927+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f59b4002ce0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.928+0000 7f59b97fa640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 0x7f59940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.928+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7f59b40521f0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.928+0000 7f59bbfff640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 0x7f59940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:19.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.928+0000 7f59bbfff640 10 monclient: get_auth_request con 0x7f599403dd10 auth_method 0 2026-02-17T12:02:19.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.930+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f59b4018cc0 con 0x7f59c40a3bb0 2026-02-17T12:02:19.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.930+0000 7f59b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:19.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.930+0000 7f59b97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:19.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.930+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:02:19.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:19.930+0000 7f59bbfff640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 0x7f59940401d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f59ac036000 tx=0x7f59ac033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59cacb7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59cacb7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59cacb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f59c41394f0 con 0x7f59c40a3bb0 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59b97fa640 1 -- 10.20.193.51:0/2913222319 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f59b4019460 con 0x7f59c40a3bb0 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.043+0000 7f59b97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:20.046 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 msgr2=0x7f59940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 0x7f59940401d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f59ac036000 tx=0x7f59ac033000 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 10 monclient: shutdown 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 msgr2=0x7f59c4132060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b580 tx=0x7f59b400ba50 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 shutdown_connections 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f599403dd10 0x7f59940401d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f59c413dcb0 0x7f59c41377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f59c413b380 0x7f59c41372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 --2- 10.20.193.51:0/2913222319 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f59c40a3bb0 0x7f59c4132060 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 >> 10.20.193.51:0/2913222319 conn(0x7f59c40a30c0 msgr2=0x7f59c40a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 shutdown_connections 2026-02-17T12:02:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:20.044+0000 7f59cacb7640 1 -- 10.20.193.51:0/2913222319 wait complete. 2026-02-17T12:02:23.054 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: get_monmap_and_config 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: build_initial_monmap 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: monmap: 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:23.123239+0000 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:23.123239+0000 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:23.124 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:23.125 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:23.125 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:23.125 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 Processor -- start 2026-02-17T12:02:23.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 -- start start 2026-02-17T12:02:23.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: init 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4e240a3bb0 0x7f4e2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-c con 0x7f4e240a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4e240a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4e2413b760 0x7f4e2413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-a con 0x7f4e2413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2406e140 con 0x7f4e240a0750 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2409f910 con 0x7f4e2413b760 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.122+0000 7f4e2941a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e2941a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2409ccd0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e2941a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:23.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e2941a640 10 monclient(hunting): authenticate will time out at 1630.742004s 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4e2413b760 0x7f4e2413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e227fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f4e240a0750 0x7f4e2409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35366/0 (socket says 10.20.193.51:35366) 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e227fc640 1 -- 10.20.193.51:0/3230769250 learned_addr learned my addr 10.20.193.51:0/3230769250 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): get_auth_request con 0x7f4e2413b760 auth_method 0 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e22ffd640 1 --2- 10.20.193.51:0/3230769250 >> v2:10.20.193.142:3300/0 conn(0x7f4e240a3bb0 0x7f4e2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e22ffd640 10 monclient(hunting): get_auth_request con 0x7f4e240a3bb0 auth_method 0 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:23.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient(hunting): handle_auth_done global_id 204273 payload 274 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 -- 10.20.193.51:0/3230769250 >> v2:10.20.193.142:3300/0 conn(0x7f4e240a3bb0 msgr2=0x7f4e2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 --2- 10.20.193.51:0/3230769250 >> v2:10.20.193.142:3300/0 conn(0x7f4e240a3bb0 0x7f4e2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 -- 10.20.193.51:0/3230769250 >> v1:10.20.193.51:6789/0 conn(0x7f4e240a0750 legacy=0x7f4e2409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient: _finish_hunting 0 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 monclient: found mon.noname-a 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.123+0000 7f4e237fe640 1 -- 10.20.193.51:0/3230769250 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2409eec0 con 0x7f4e2413b760 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e237fe640 1 -- 10.20.193.51:0/3230769250 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e2413b760 msgr2=0x7f4e2413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e237fe640 1 --2- 10.20.193.51:0/3230769250 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e2413b760 0x7f4e2413db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e2406c1c0 tx=0x7f4e1402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a6d80bf6c953da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 1 -- 10.20.193.51:0/3230769250 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1403c070 con 0x7f4e2413b760 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: dump: 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:23.133 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: _finish_auth 0 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e2941a640 5 monclient: authenticate success, global_id 204273 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 1 -- 10.20.193.51:0/3230769250 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e14037440 con 0x7f4e2413b760 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 1 -- 10.20.193.51:0/3230769250 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14037810 con 0x7f4e2413b760 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:23.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e21ffb640 10 monclient: dump: 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e2941a640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.125+0000 7f4e2941a640 4 set_mon_vals no callback set 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 10 monclient: shutdown 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:23.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- 10.20.193.51:0/3230769250 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e2413b760 msgr2=0x7f4e2413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 --2- 10.20.193.51:0/3230769250 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e2413b760 0x7f4e2413db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e2406c1c0 tx=0x7f4e1402f130 comp rx=0 tx=0).stop 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- 10.20.193.51:0/3230769250 shutdown_connections 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 --2- 10.20.193.51:0/3230769250 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e2413b760 0x7f4e2413db50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 --2- 10.20.193.51:0/3230769250 >> v2:10.20.193.142:3300/0 conn(0x7f4e240a3bb0 0x7f4e2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- 10.20.193.51:0/3230769250 >> 10.20.193.51:0/3230769250 conn(0x7f4e240a30c0 msgr2=0x7f4e240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- 10.20.193.51:0/3230769250 shutdown_connections 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- 10.20.193.51:0/3230769250 wait complete. 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 10 monclient: build_initial_monmap 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 10 monclient: monmap: 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:23.136 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 Processor -- start 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 1 -- start start 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.126+0000 7f4e2941a640 10 monclient: init 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4e240a0750 0x7f4e2413a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-b con 0x7f4e240a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-a con 0x7f4e240a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 0x7f4e2413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): picked mon.noname-c con 0x7f4e2413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240a04b0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2409c850 con 0x7f4e240a0750 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2409e710 con 0x7f4e2413b760 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e2941a640 10 monclient(hunting): authenticate will time out at 1630.746147s 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e237fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 msgr2=0x7f4e2413b1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e237fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 0x7f4e2413b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41074/0 (socket says 10.20.193.51:41074) 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 -- 10.20.193.51:0/2183544167 learned_addr learned my addr 10.20.193.51:0/2183544167 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): get_auth_request con 0x7f4e240a3bb0 auth_method 0 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e22ffd640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4e240a0750 0x7f4e2413a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e22ffd640 10 monclient(hunting): get_auth_request con 0x7f4e240a0750 auth_method 0 2026-02-17T12:02:23.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient(hunting): handle_auth_done global_id 204276 payload 824 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 -- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 msgr2=0x7f4e2413b1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 0x7f4e2413b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 -- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4e240a0750 msgr2=0x7f4e2413a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4e240a0750 0x7f4e2413a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient: _finish_hunting 0 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 monclient: found mon.noname-a 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.127+0000 7f4e227fc640 1 -- 10.20.193.51:0/2183544167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e24094e40 con 0x7f4e240a3bb0 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e227fc640 1 -- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 msgr2=0x7f4e2413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e227fc640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c750 tx=0x7f4e0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c005de0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: dump: 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.141 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c007070 con 0x7f4e240a3bb0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 5 monclient: authenticate success, global_id 204276 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 10 monclient: _renew_subs 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e240a2400 con 0x7f4e240a3bb0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c007440 con 0x7f4e240a3bb0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e037fe640 10 monclient: dump: 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:23.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e217fa640 4 set_mon_vals no callback set 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 10 monclient: _renew_subs 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.129+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2409d7b0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e2941a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e2941a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e2941a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4e0c0075e0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2409dac0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e037fe640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 0x7f4df00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7f4e0c052500 con 0x7f4e240a3bb0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e22ffd640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 0x7f4df00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.130+0000 7f4e22ffd640 10 monclient: get_auth_request con 0x7f4df003dd10 auth_method 0 2026-02-17T12:02:23.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.132+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4e0c050ec0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.132+0000 7f4e037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:23.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.132+0000 7f4e037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:23.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.133+0000 7f4e22ffd640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 0x7f4df00401d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4e180099b0 tx=0x7f4e18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.244+0000 7f4e2941a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.244+0000 7f4e2941a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.244+0000 7f4e2941a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.244+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4e240008d0 con 0x7f4e240a3bb0 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.245+0000 7f4e037fe640 1 -- 10.20.193.51:0/2183544167 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f4e0c011a00 con 0x7f4e240a3bb0 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.245+0000 7f4e037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.245+0000 7f4e037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.245+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 msgr2=0x7f4df00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 0x7f4df00401d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4e180099b0 tx=0x7f4e18008040 comp rx=0 tx=0).stop 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 10 monclient: shutdown 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 msgr2=0x7f4e2413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c750 tx=0x7f4e0c00cc20 comp rx=0 tx=0).stop 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 shutdown_connections 2026-02-17T12:02:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4df003dd10 0x7f4df00401d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4e2413b760 0x7f4e2413b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4e240a3bb0 0x7f4e2413acb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 --2- 10.20.193.51:0/2183544167 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4e240a0750 0x7f4e2413a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 >> 10.20.193.51:0/2183544167 conn(0x7f4e240a30c0 msgr2=0x7f4e240a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 shutdown_connections 2026-02-17T12:02:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:23.246+0000 7f4e2941a640 1 -- 10.20.193.51:0/2183544167 wait complete. 2026-02-17T12:02:26.256 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:26.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.324+0000 7f55a200c640 10 monclient: get_monmap_and_config 2026-02-17T12:02:26.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.324+0000 7f55a200c640 10 monclient: build_initial_monmap 2026-02-17T12:02:26.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.324+0000 7f55a200c640 10 monclient: monmap: 2026-02-17T12:02:26.326 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:26.325767+0000 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:26.325767+0000 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:26.327 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 Processor -- start 2026-02-17T12:02:26.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 -- start start 2026-02-17T12:02:26.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient: init 2026-02-17T12:02:26.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:26.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 0x7f559c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-b con 0x7f559c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f559c0a0750 0x7f559c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-a con 0x7f559c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f559c09e540 0x7f559c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-c con 0x7f559c09e540 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f559c0a3f90 con 0x7f559c0a0750 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f559c06e140 con 0x7f559c09e540 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f559c09f910 con 0x7f559c0a3bb0 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f55a200c640 10 monclient(hunting): authenticate will time out at 1633.944509s 2026-02-17T12:02:26.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559b7fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 msgr2=0x7f559c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 0x7f559c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f559c0a0750 0x7f559c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f559c0a0750 0x7f559c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53098/0 (socket says 10.20.193.51:53098) 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 -- 10.20.193.51:0/3655807652 learned_addr learned my addr 10.20.193.51:0/3655807652 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): get_auth_request con 0x7f559c0a0750 auth_method 0 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559bfff640 1 --2- 10.20.193.51:0/3655807652 >> v2:10.20.193.142:3300/0 conn(0x7f559c09e540 0x7f559c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559bfff640 10 monclient(hunting): get_auth_request con 0x7f559c09e540 auth_method 0 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient(hunting): handle_auth_done global_id 204279 payload 274 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 -- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 msgr2=0x7f559c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 --2- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 0x7f559c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 -- 10.20.193.51:0/3655807652 >> v2:10.20.193.142:3300/0 conn(0x7f559c09e540 msgr2=0x7f559c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 --2- 10.20.193.51:0/3655807652 >> v2:10.20.193.142:3300/0 conn(0x7f559c09e540 0x7f559c13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient: _finish_hunting 0 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 monclient: found mon.noname-a 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.325+0000 7f559affd640 1 -- 10.20.193.51:0/3655807652 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c09ccd0 con 0x7f559c0a0750 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559affd640 1 -- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c0a0750 msgr2=0x7f559c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559affd640 1 --2- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c0a0750 0x7f559c09e000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f559c09f230 tx=0x7f558c02ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb4208218b7b083 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 1 -- 10.20.193.51:0/3655807652 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c03c070 con 0x7f559c0a0750 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:26.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: dump: 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 5 monclient: authenticate success, global_id 204279 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 1 -- 10.20.193.51:0/3655807652 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c02fcc0 con 0x7f559c0a0750 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 1 -- 10.20.193.51:0/3655807652 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c037660 con 0x7f559c0a0750 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 4 set_mon_vals no callback set 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f559a7fc640 10 monclient: dump: 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:26.342 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 10 monclient: shutdown 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 -- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c0a0750 msgr2=0x7f559c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 --2- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c0a0750 0x7f559c09e000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f559c09f230 tx=0x7f558c02ee80 comp rx=0 tx=0).stop 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 -- 10.20.193.51:0/3655807652 shutdown_connections 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 --2- 10.20.193.51:0/3655807652 >> v2:10.20.193.142:3300/0 conn(0x7f559c09e540 0x7f559c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 --2- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c0a0750 0x7f559c09e000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 --2- 10.20.193.51:0/3655807652 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a3bb0 0x7f559c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 -- 10.20.193.51:0/3655807652 >> 10.20.193.51:0/3655807652 conn(0x7f559c0a30c0 msgr2=0x7f559c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 -- 10.20.193.51:0/3655807652 shutdown_connections 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.328+0000 7f55a200c640 1 -- 10.20.193.51:0/3655807652 wait complete. 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient: build_initial_monmap 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient: monmap: 2026-02-17T12:02:26.343 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 Processor -- start 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 -- start start 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient: init 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-a con 0x7f559c09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:26.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 0x7f559c097f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-c con 0x7f559c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 0x7f559c08d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): picked mon.noname-b con 0x7f559c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0a04b0 con 0x7f559c09e540 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f559c09c850 con 0x7f559c0a3bb0 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f559c13cca0 con 0x7f559c0a0750 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f55a200c640 10 monclient(hunting): authenticate will time out at 1633.948604s 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559affd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 msgr2=0x7f559c097f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:26.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 0x7f559c097f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53108/0 (socket says 10.20.193.51:53108) 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 -- 10.20.193.51:0/3019081352 learned_addr learned my addr 10.20.193.51:0/3019081352 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): get_auth_request con 0x7f559c09e540 auth_method 0 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient(hunting): handle_auth_done global_id 204282 payload 824 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 -- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 msgr2=0x7f559c097f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 0x7f559c097f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.346 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 -- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 msgr2=0x7f559c08d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559bfff640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 0x7f559c08d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 0x7f559c08d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559b7fe640 1 -- 10.20.193.51:0/3019081352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c1cd240 con 0x7f559c09e540 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559bfff640 10 monclient: get_auth_request con 0x7f559c0a3bb0 auth_method 0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.329+0000 7f559bfff640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 0x7f559c08d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.331+0000 7f559b7fe640 1 -- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 msgr2=0x7f559c097a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.331+0000 7f559b7fe640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f558800b780 tx=0x7f558800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588005270 con 0x7f559c09e540 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: dump: 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:26.347 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: _finish_auth 0 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588010070 con 0x7f559c09e540 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 5 monclient: authenticate success, global_id 204282 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _renew_subs 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c08ed20 con 0x7f559c09e540 2026-02-17T12:02:26.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588005650 con 0x7f559c09e540 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5599ffb640 4 set_mon_vals no callback set 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 10 monclient: dump: 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _renew_subs 2026-02-17T12:02:26.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c06f920 con 0x7f559c09e540 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c09dac0 con 0x7f559c09e540 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.332+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f558801d030 con 0x7f559c09e540 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.333+0000 7f5577fff640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 0x7f556c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.333+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7f5588051d00 con 0x7f559c09e540 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.333+0000 7f559affd640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 0x7f556c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.333+0000 7f559affd640 10 monclient: get_auth_request con 0x7f556c03dcc0 auth_method 0 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.335+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f559c1cd240 con 0x7f559c09e540 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.335+0000 7f5577fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.335+0000 7f5577fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:26.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.335+0000 7f559affd640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 0x7f556c040180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f558c036000 tx=0x7f558c039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f55a200c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f55a200c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f55a200c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:26.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f559c0008d0 con 0x7f559c09e540 2026-02-17T12:02:26.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f5577fff640 1 -- 10.20.193.51:0/3019081352 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f5588005870 con 0x7f559c09e540 2026-02-17T12:02:26.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f5577fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:26.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.449+0000 7f5577fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:26.452 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 msgr2=0x7f556c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 0x7f556c040180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f558c036000 tx=0x7f558c039040 comp rx=0 tx=0).stop 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 10 monclient: shutdown 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 msgr2=0x7f559c097a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f558800b780 tx=0x7f558800bc50 comp rx=0 tx=0).stop 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 shutdown_connections 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f556c03dcc0 0x7f556c040180 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f559c0a3bb0 0x7f559c08d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f559c0a0750 0x7f559c097f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 --2- 10.20.193.51:0/3019081352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f559c09e540 0x7f559c097a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:26.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 >> 10.20.193.51:0/3019081352 conn(0x7f559c0a30c0 msgr2=0x7f559c072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:26.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 shutdown_connections 2026-02-17T12:02:26.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:26.450+0000 7f55a200c640 1 -- 10.20.193.51:0/3019081352 wait complete. 2026-02-17T12:02:29.460 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: get_monmap_and_config 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: build_initial_monmap 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: monmap: 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:29.533 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:29.530055+0000 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:29.530055+0000 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 Processor -- start 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 -- start start 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: init 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb2340a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb23409dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb2340a02e0 0x7fb23413d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-c con 0x7fb2340a02e0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:29.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23406e140 con 0x7fb23409dac0 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23409ce60 con 0x7fb2340a3bb0 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb23409aed0 con 0x7fb2340a02e0 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb239b0a640 10 monclient(hunting): authenticate will time out at 1637.148798s 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb232ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb23409dac0 0x7fb23409fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:59348/0 (socket says 10.20.193.51:59348) 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb232ffd640 1 -- 10.20.193.51:0/3954526251 learned_addr learned my addr 10.20.193.51:0/3954526251 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.529+0000 7fb233fff640 1 --2- 10.20.193.51:0/3954526251 >> v2:10.20.193.142:3300/0 conn(0x7fb2340a02e0 0x7fb23413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): get_auth_request con 0x7fb2340a02e0 auth_method 0 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:29.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient(hunting): handle_auth_done global_id 184393 payload 274 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 1 -- 10.20.193.51:0/3954526251 >> v1:10.20.193.142:6789/0 conn(0x7fb2340a3bb0 legacy=0x7fb23409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 1 -- 10.20.193.51:0/3954526251 >> v1:10.20.193.51:6789/0 conn(0x7fb23409dac0 legacy=0x7fb23409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 1 monclient: found mon.noname-c 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:29.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.530+0000 7fb233fff640 1 -- 10.20.193.51:0/3954526251 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23409a5c0 con 0x7fb2340a02e0 2026-02-17T12:02:29.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb233fff640 1 -- 10.20.193.51:0/3954526251 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 msgr2=0x7fb23413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:29.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb233fff640 1 --2- 10.20.193.51:0/3954526251 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb23413d770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb228009d90 tx=0x7fb22802f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c9ef95b1f8e45f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:29.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 1 -- 10.20.193.51:0/3954526251 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22803c070 con 0x7fb2340a02e0 2026-02-17T12:02:29.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: dump: 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:29.545 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 5 monclient: authenticate success, global_id 184393 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 1 -- 10.20.193.51:0/3954526251 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb228037640 con 0x7fb2340a02e0 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 1 -- 10.20.193.51:0/3954526251 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228037a10 con 0x7fb2340a02e0 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:29.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb2327fc640 10 monclient: dump: 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 4 set_mon_vals no callback set 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 10 monclient: shutdown 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 -- 10.20.193.51:0/3954526251 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 msgr2=0x7fb23413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 --2- 10.20.193.51:0/3954526251 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb23413d770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb228009d90 tx=0x7fb22802f190 comp rx=0 tx=0).stop 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 -- 10.20.193.51:0/3954526251 shutdown_connections 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 --2- 10.20.193.51:0/3954526251 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb23413d770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 -- 10.20.193.51:0/3954526251 >> 10.20.193.51:0/3954526251 conn(0x7fb2340a30c0 msgr2=0x7fb2340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 -- 10.20.193.51:0/3954526251 shutdown_connections 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.533+0000 7fb239b0a640 1 -- 10.20.193.51:0/3954526251 wait complete. 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient: build_initial_monmap 2026-02-17T12:02:29.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient: monmap: 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 Processor -- start 2026-02-17T12:02:29.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 -- start start 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient: init 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 0x7fb2340927c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-c con 0x7fb23409dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb234092d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-b con 0x7fb2340a02e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): picked mon.noname-a con 0x7fb2340a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb2340a3f90 con 0x7fb2340a3bb0 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:29.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb23409caa0 con 0x7fb2340a02e0 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb23413dcb0 con 0x7fb23409dac0 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb239b0a640 10 monclient(hunting): authenticate will time out at 1637.153523s 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb2337fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 msgr2=0x7fb2340927c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb2337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 0x7fb2340927c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53118/0 (socket says 10.20.193.51:53118) 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 -- 10.20.193.51:0/1607940993 learned_addr learned my addr 10.20.193.51:0/1607940993 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): get_auth_request con 0x7fb2340a3bb0 auth_method 0 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:29.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb232ffd640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb234092d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient(hunting): handle_auth_done global_id 204285 payload 824 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 -- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 msgr2=0x7fb2340927c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 0x7fb2340927c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 -- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 msgr2=0x7fb234092d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb234092d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient: _finish_hunting 0 2026-02-17T12:02:29.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 monclient: found mon.noname-a 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.534+0000 7fb233fff640 1 -- 10.20.193.51:0/1607940993 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23409d7b0 con 0x7fb2340a3bb0 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb233fff640 1 -- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 msgr2=0x7fb234093240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb233fff640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb228009d90 tx=0x7fb228004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228047020 con 0x7fb2340a3bb0 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: dump: 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:29.553 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: _finish_auth 0 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 5 monclient: authenticate success, global_id 204285 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _renew_subs 2026-02-17T12:02:29.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb234094360 con 0x7fb2340a3bb0 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2280428a0 con 0x7fb2340a3bb0 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22803c040 con 0x7fb2340a3bb0 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 10 monclient: dump: 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:29.555 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb231ffb640 4 set_mon_vals no callback set 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _renew_subs 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23409a2d0 con 0x7fb2340a3bb0 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:29.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb228043420 con 0x7fb2340a3bb0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23406a290 con 0x7fb2340a3bb0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.537+0000 7fb20ffff640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 0x7fb204040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.538+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(623..623 src has 323..623) ==== 4839+0+0 (secure 0 0 0) 0x7fb2280784c0 con 0x7fb2340a3bb0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.538+0000 7fb2337fe640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 0x7fb204040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.538+0000 7fb2337fe640 10 monclient: get_auth_request con 0x7fb20403dcc0 auth_method 0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.540+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb23406a290 con 0x7fb2340a3bb0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.540+0000 7fb20ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.540+0000 7fb20ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:29.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.540+0000 7fb2337fe640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 0x7fb204040180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb220003870 tx=0x7fb220007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb239b0a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb239b0a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb239b0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb23409f4c0 con 0x7fb2340a3bb0 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb20ffff640 1 -- 10.20.193.51:0/1607940993 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fb228051070 con 0x7fb2340a3bb0 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb20ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.655+0000 7fb20ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:29.659 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 msgr2=0x7fb204040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 0x7fb204040180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb220003870 tx=0x7fb220007b10 comp rx=0 tx=0).stop 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 10 monclient: shutdown 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 msgr2=0x7fb234093240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:29.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb228009d90 tx=0x7fb228004b40 comp rx=0 tx=0).stop 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 shutdown_connections 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb20403dcc0 0x7fb204040180 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb2340a3bb0 0x7fb234093240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb2340a02e0 0x7fb234092d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 --2- 10.20.193.51:0/1607940993 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb23409dac0 0x7fb2340927c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 >> 10.20.193.51:0/1607940993 conn(0x7fb2340a30c0 msgr2=0x7fb2340a2440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 shutdown_connections 2026-02-17T12:02:29.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:29.656+0000 7fb239b0a640 1 -- 10.20.193.51:0/1607940993 wait complete. 2026-02-17T12:02:32.667 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:32.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.733+0000 7f3068866640 10 monclient: get_monmap_and_config 2026-02-17T12:02:32.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.733+0000 7f3068866640 10 monclient: build_initial_monmap 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.733+0000 7f3068866640 10 monclient: monmap: 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:32.734752+0000 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:32.734752+0000 2026-02-17T12:02:32.740 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:32.741 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 Processor -- start 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 -- start start 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient: init 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:32.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): picked mon.noname-a con 0x7f30600a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): picked mon.noname-b con 0x7f30600a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f306009e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:32.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306006e140 con 0x7f306009e540 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f30600a3f90 con 0x7f30600a3bb0 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f306009f910 con 0x7f30600a0750 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:32.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3068866640 10 monclient(hunting): authenticate will time out at 1640.353510s 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3065dda640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f306009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3065dda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3066ddc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f306009e540 0x7f306013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:59354/0 (socket says 10.20.193.51:59354) 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 learned_addr learned my addr 10.20.193.51:0/3818004370 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53134/0 (socket says 10.20.193.51:53134) 2026-02-17T12:02:32.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f30600a3bb0 auth_method 0 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:32.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:32.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.734+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:32.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.736+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 >> v1:10.20.193.51:6789/0 conn(0x7f306009e540 legacy=0x7f306013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:32.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f3065dda640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f306009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:32.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f3065dda640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f30600a3bb0 auth_method 0 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:32.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:32.935+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:02:33.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f3065dda640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f306009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:33.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f3065dda640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f30600a3bb0 auth_method 0 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:33.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:33.336+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:02:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f3065dda640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f306009e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f3065dda640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:02:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f30600a3bb0 auth_method 0 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.137+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:02:34.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76053591 0 0) 0x7f306006e140 con 0x7f306009e540 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): _negotiate 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): my global_id is 204288 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3050003620 con 0x7f306009e540 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1858926244 0 0) 0x7f3050003620 con 0x7f306009e540 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f306009e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f306009e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 msgr2=0x7f306009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 --2- 10.20.193.51:0/3818004370 >> v2:10.20.193.51:3300/0 conn(0x7f30600a3bb0 0x7f306009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _finish_hunting 0 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306009ccd0 con 0x7f306009e540 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _finish_auth 0 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _check_auth_tickets 2026-02-17T12:02:34.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f30540034e0 con 0x7f306009e540 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: dump: 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 >> v1:10.20.193.51:6789/0 conn(0x7f306009e540 legacy=0x7f306013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050003ab0 0x7f3050003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): picked mon.a con 0x7f3050003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f3050004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): picked mon.c con 0x7f30600a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:34.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 0x7f30500052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): picked mon.b con 0x7f3050004e40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f30600a3f90 con 0x7f3050003ab0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f306009f910 con 0x7f3050004e40 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f305000bd50 con 0x7f30600a0750 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f30655d9640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f3065dda640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f3050004900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.777+0000 7f3065dda640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f3050004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 0x7f30500052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): get_auth_request con 0x7f3050004e40 auth_method 0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050003ab0 0x7f3050003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f3050003ab0 auth_method 0 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient(hunting): handle_auth_done global_id 204288 payload 293 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 msgr2=0x7f3050004900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30600a0750 0x7f3050004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050003ab0 msgr2=0x7f3050003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050003ab0 0x7f3050003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient: _finish_hunting 0 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 monclient: found mon.b 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.142:3300/0 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3050003620 con 0x7f3050004e40 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient: _finish_auth 0 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3066ddc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3068866640 5 monclient: authenticate success, global_id 204288 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f3068866640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:34.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.778+0000 7f30665db640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050003ab0 0x7f3050003ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2708: done (1 left) 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2709: snap_create 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: finishing write tid 1 to trial14245205-12 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: finishing write tid 2 to trial14245205-12 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: finishing write tid 3 to trial14245205-12 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: finishing write tid 4 to trial14245205-12 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: finishing write tid 5 to trial14245205-12 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: oid 12 updating version 0 to 2451 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: oid 12 updating version 2451 to 2452 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: oid 12 version 2452 is already newer than 2450 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: oid 12 version 2452 is already newer than 2449 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2452 (ObjNum 926 snap 299 seq_num 926) dirty exists 2026-02-17T12:02:34.785 INFO:tasks.rados.rados.0.trial142.stdout:2707: left oid 12 (ObjNum 926 snap 299 seq_num 926) 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 msgr2=0x7f30500052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3066ddc640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 0x7f30500052a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f306006e310 tx=0x7f305402fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c525e17961aa64 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305400a670 con 0x7f3050004e40 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: dump: 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3054031730 con 0x7f3050004e40 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:34.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 1 -- 10.20.193.51:0/3818004370 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054031b20 con 0x7f3050004e40 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 4 set_mon_vals no callback set 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f30655d9640 10 monclient: dump: 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 10 monclient: shutdown 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 -- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 msgr2=0x7f30500052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 --2- 10.20.193.51:0/3818004370 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3050004e40 0x7f30500052a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f306006e310 tx=0x7f305402fca0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3066ddc640 1 -- 10.20.193.51:0/3818004370 reap_dead start 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 -- 10.20.193.51:0/3818004370 shutdown_connections 2026-02-17T12:02:34.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 -- 10.20.193.51:0/3818004370 >> 10.20.193.51:0/3818004370 conn(0x7f30600a30c0 msgr2=0x7f30600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 -- 10.20.193.51:0/3818004370 shutdown_connections 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.781+0000 7f3068866640 1 -- 10.20.193.51:0/3818004370 wait complete. 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient: build_initial_monmap 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient: monmap: 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 Processor -- start 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 -- start start 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient: init 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): picked mon.noname-a con 0x7f3050004e40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f306009ab00 0x7f306009af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): picked mon.noname-b con 0x7f306009ab00 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 0x7f30601d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): picked mon.noname-c con 0x7f30601d3890 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f306009c850 con 0x7f3050004e40 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f30600a04b0 con 0x7f306009ab00 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f306009e000 con 0x7f30601d3890 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3068866640 10 monclient(hunting): authenticate will time out at 1642.401674s 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3066ddc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 msgr2=0x7f30601d5c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f3066ddc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 0x7f30601d5c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53178/0 (socket says 10.20.193.51:53178) 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 -- 10.20.193.51:0/4013816356 learned_addr learned my addr 10.20.193.51:0/4013816356 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): get_auth_request con 0x7f3050004e40 auth_method 0 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient(hunting): handle_auth_done global_id 204291 payload 824 2026-02-17T12:02:34.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 -- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 msgr2=0x7f30601d5c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 0x7f30601d5c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 -- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f306009ab00 msgr2=0x7f306009af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f306009ab00 0x7f306009af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient: _finish_hunting 0 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 monclient: found mon.noname-a 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.782+0000 7f30665db640 1 -- 10.20.193.51:0/4013816356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30601ba970 con 0x7f3050004e40 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f30665db640 1 -- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 msgr2=0x7f306009a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f30665db640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3058004720 tx=0x7f3058012ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058017af0 con 0x7f3050004e40 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: dump: 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.793 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: _finish_auth 0 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: _check_auth_tickets 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3058017c90 con 0x7f3050004e40 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 5 monclient: authenticate success, global_id 204291 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058018450 con 0x7f3050004e40 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3064dd8640 4 set_mon_vals no callback set 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 10 monclient: dump: 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _renew_subs 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306009c590 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _renew_subs 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306006f850 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306009dac0 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.785+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3058015040 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.786+0000 7f304affd640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 0x7f3030040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.786+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(624..624 src has 323..624) ==== 4827+0+0 (secure 0 0 0) 0x7f3058053680 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.786+0000 7f3065dda640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 0x7f3030040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.786+0000 7f3065dda640 10 monclient: get_auth_request con 0x7f303003dcc0 auth_method 0 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.788+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3058015e40 con 0x7f3050004e40 2026-02-17T12:02:34.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.788+0000 7f304affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.788+0000 7f304affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:34.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.788+0000 7f3065dda640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 0x7f3030040180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f30600a2e30 tx=0x7f304c0091d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f3068866640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f3068866640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f3068866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f306009c0e0 con 0x7f3050004e40 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f304affd640 1 -- 10.20.193.51:0/4013816356 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f3058018b90 con 0x7f3050004e40 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f304affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:34.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.903+0000 7f304affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 msgr2=0x7f3030040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 0x7f3030040180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f30600a2e30 tx=0x7f304c0091d0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 10 monclient: shutdown 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 msgr2=0x7f306009a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3058004720 tx=0x7f3058012ae0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 shutdown_connections 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f303003dcc0 0x7f3030040180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f30601d3890 0x7f30601d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f306009ab00 0x7f306009af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 --2- 10.20.193.51:0/4013816356 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3050004e40 0x7f306009a5c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 >> 10.20.193.51:0/4013816356 conn(0x7f30600a30c0 msgr2=0x7f30600a1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 shutdown_connections 2026-02-17T12:02:34.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.904+0000 7f3068866640 1 -- 10.20.193.51:0/4013816356 wait complete. 2026-02-17T12:02:34.915 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:02:34.915 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:02:34.915 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.981+0000 7f7cd3c2c640 10 monclient: get_monmap_and_config 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.981+0000 7f7cd3c2c640 10 monclient: build_initial_monmap 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.981+0000 7f7cd3c2c640 10 monclient: monmap: 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:34.982602+0000 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:34.982602+0000 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:34.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.981+0000 7f7cd3c2c640 1 Processor -- start 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 1 -- start start 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient: init 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-17T12:02:34.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7ccc0a3bb0 0x7f7ccc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-a con 0x7f7ccc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7ccc0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7ccc13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ccc06e140 con 0x7f7ccc13b760 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ccc09f910 con 0x7f7ccc0a0750 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7ccc09ccd0 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd3c2c640 10 monclient(hunting): authenticate will time out at 1642.601345s 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7ccc0a3bb0 0x7f7ccc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd21a2640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7ccc13b760 0x7f7ccc13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:59362/0 (socket says 10.20.193.51:59362) 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd21a2640 1 -- 10.20.193.51:0/3671159767 learned_addr learned my addr 10.20.193.51:0/3671159767 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): get_auth_request con 0x7f7ccc0a3bb0 auth_method 0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_done global_id 204294 payload 274 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 1 -- 10.20.193.51:0/3671159767 >> v1:10.20.193.142:6789/0 conn(0x7f7ccc0a0750 legacy=0x7f7ccc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 1 -- 10.20.193.51:0/3671159767 >> v1:10.20.193.51:6789/0 conn(0x7f7ccc13b760 legacy=0x7f7ccc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient: _finish_hunting 0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 1 monclient: found mon.noname-a 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.982+0000 7f7cd19a1640 1 -- 10.20.193.51:0/3671159767 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc09eec0 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd19a1640 1 -- 10.20.193.51:0/3671159767 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a3bb0 msgr2=0x7f7ccc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd19a1640 1 --2- 10.20.193.51:0/3671159767 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a3bb0 0x7f7ccc09dac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0098a0 tx=0x7f7cbc02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df737e88b147fdf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 1 -- 10.20.193.51:0/3671159767 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03c070 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: dump: 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: _finish_auth 0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: _check_auth_tickets 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 1 -- 10.20.193.51:0/3671159767 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc02fce0 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 5 monclient: authenticate success, global_id 204294 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 1 -- 10.20.193.51:0/3671159767 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc037660 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd099f640 10 monclient: dump: 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:34.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 4 set_mon_vals no callback set 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 10 monclient: shutdown 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/3671159767 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a3bb0 msgr2=0x7f7ccc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/3671159767 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a3bb0 0x7f7ccc09dac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0098a0 tx=0x7f7cbc02ed80 comp rx=0 tx=0).stop 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/3671159767 shutdown_connections 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/3671159767 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a3bb0 0x7f7ccc09dac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/3671159767 >> 10.20.193.51:0/3671159767 conn(0x7f7ccc0a30c0 msgr2=0x7f7ccc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/3671159767 shutdown_connections 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.985+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/3671159767 wait complete. 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient: build_initial_monmap 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient: monmap: 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 Processor -- start 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 -- start start 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient: init 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 0x7f7ccc1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-a con 0x7f7ccc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ccc0a3bb0 0x7f7ccc1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-c con 0x7f7ccc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ccc13b760 0x7f7ccc0952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): picked mon.noname-b con 0x7f7ccc13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0a04b0 con 0x7f7ccc0a0750 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc09c850 con 0x7f7ccc13b760 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc09e710 con 0x7f7ccc0a3bb0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd3c2c640 10 monclient(hunting): authenticate will time out at 1642.605667s 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd11a0640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ccc0a3bb0 msgr2=0x7f7ccc1d0010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 0x7f7ccc1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd11a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ccc0a3bb0 0x7f7ccc1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 0x7f7ccc1cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53194/0 (socket says 10.20.193.51:53194) 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 -- 10.20.193.51:0/4082699158 learned_addr learned my addr 10.20.193.51:0/4082699158 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): get_auth_request con 0x7f7ccc0a0750 auth_method 0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient(hunting): handle_auth_done global_id 204297 payload 824 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd21a2640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ccc13b760 0x7f7ccc0952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ccc0a3bb0 msgr2=0x7f7ccc1d0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7ccc0a3bb0 0x7f7ccc1d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ccc13b760 msgr2=0x7f7ccc0952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7ccc13b760 0x7f7ccc0952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient: _finish_hunting 0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 monclient: found mon.noname-a 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.986+0000 7f7cd19a1640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc098b10 con 0x7f7ccc0a0750 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.988+0000 7f7cd19a1640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 msgr2=0x7f7ccc1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.988+0000 7f7cd19a1640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 0x7f7ccc1cfad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0098a0 tx=0x7f7cbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc046070 con 0x7f7ccc0a0750 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: dump: 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: _finish_auth 0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc041870 con 0x7f7ccc0a0750 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 5 monclient: authenticate success, global_id 204297 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 monclient: _renew_subs 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc09c3d0 con 0x7f7ccc0a0750 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03c040 con 0x7f7ccc0a0750 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cbbfff640 4 set_mon_vals no callback set 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 10 monclient: dump: 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 monclient: _renew_subs 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc0a2490 con 0x7f7ccc0a0750 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7cbc041c60 con 0x7f7ccc0a0750 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 0x7f7ccc095bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc096de0 con 0x7f7ccc0957f0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 0x7f7ccc095bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient: get_auth_request con 0x7f7ccc0957f0 auth_method 0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.989+0000 7f7cba7fc640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7c9c03dcc0 0x7f7c9c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.990+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_done global_id 204300 payload 824 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.990+0000 7f7cd11a0640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ccc09dac0 con 0x7f7ccc0957f0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.990+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(624..624 src has 323..624) ==== 4827+0+0 (secure 0 0 0) 0x7f7cbc077d30 con 0x7f7ccc0a0750 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.990+0000 7f7cd21a2640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7c9c03dcc0 0x7f7c9c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.990+0000 7f7cd21a2640 10 monclient: get_auth_request con 0x7f7c9c03dcc0 auth_method 0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cd11a0640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 msgr2=0x7f7ccc095bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cd11a0640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 0x7f7ccc095bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc096a60 tx=0x7f7cc000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0017070 con 0x7f7ccc0957f0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:34.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 10 monclient: dump: 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7cc0007070 con 0x7f7ccc0957f0 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 msgr2=0x7f7ccc095bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 0x7f7ccc095bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc096a60 tx=0x7f7cc000c8d0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 msgr2=0x7f7ccc095bd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cba7fc640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0957f0 0x7f7ccc095bd0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc096a60 tx=0x7f7cc000c8d0 comp rx=0 tx=0).stop 2026-02-17T12:02:34.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.992+0000 7f7cd21a2640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7c9c03dcc0 0x7f7c9c040180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc098410 tx=0x7f7cc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd3c2c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 0x7f7ccc1dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd3c2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc097220 con 0x7f7ccc096110 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 0x7f7ccc1dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient: get_auth_request con 0x7f7ccc096110 auth_method 0 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 10 monclient(hunting): handle_auth_done global_id 204303 payload 824 2026-02-17T12:02:34.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.995+0000 7f7cd11a0640 1 -- 10.20.193.51:0/4082699158 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ccc0008d0 con 0x7f7ccc096110 2026-02-17T12:02:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd11a0640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 msgr2=0x7f7ccc1dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd11a0640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 0x7f7ccc1dab40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0014000 tx=0x7f7cc00038e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0017070 con 0x7f7ccc096110 2026-02-17T12:02:34.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 10 monclient: dump: 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f7cc0022400 con 0x7f7ccc096110 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 msgr2=0x7f7ccc1dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 0x7f7ccc1dab40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0014000 tx=0x7f7cc00038e0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 msgr2=0x7f7ccc1dab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cba7fc640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc096110 0x7f7ccc1dab40 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0014000 tx=0x7f7cc00038e0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 160, 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 95764, 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:35.000 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:35.001 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:35.002 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.003 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:35.004 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7c9c03dcc0 msgr2=0x7f7c9c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7c9c03dcc0 0x7f7c9c040180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc098410 tx=0x7f7cc8009040 comp rx=0 tx=0).stop 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 10 monclient: shutdown 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 msgr2=0x7f7ccc1cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 --2- 10.20.193.51:0/4082699158 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7ccc0a0750 0x7f7ccc1cfad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0098a0 tx=0x7f7cbc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd21a2640 1 -- 10.20.193.51:0/4082699158 reap_dead start 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd21a2640 1 -- 10.20.193.51:0/4082699158 reap_dead start 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 shutdown_connections 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 >> 10.20.193.51:0/4082699158 conn(0x7f7ccc0a30c0 msgr2=0x7f7ccc13ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 shutdown_connections 2026-02-17T12:02:35.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:34.998+0000 7f7cd3c2c640 1 -- 10.20.193.51:0/4082699158 wait complete. 2026-02-17T12:02:35.006 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:02:35.006 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:02:35.006 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.072+0000 7f51e5200640 10 monclient: get_monmap_and_config 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.072+0000 7f51e5200640 10 monclient: build_initial_monmap 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.072+0000 7f51e5200640 10 monclient: monmap: 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:35.073636+0000 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:35.073636+0000 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:35.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 Processor -- start 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 -- start start 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient: init 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f51e00a3bb0 0x7f51e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-a con 0x7f51e00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f51e00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-b con 0x7f51e013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:35.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e006e140 con 0x7f51e00a0750 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f51e009f910 con 0x7f51e00a3bb0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f51e009ccd0 con 0x7f51e013b760 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51e5200640 10 monclient(hunting): authenticate will time out at 1642.692446s 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51df577640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 msgr2=0x7f51e013db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51df577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f51e00a3bb0 0x7f51e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f51e00a3bb0 0x7f51e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53230/0 (socket says 10.20.193.51:53230) 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 -- 10.20.193.51:0/1957324410 learned_addr learned my addr 10.20.193.51:0/1957324410 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): get_auth_request con 0x7f51e00a3bb0 auth_method 0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient(hunting): handle_auth_done global_id 204306 payload 274 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 -- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 msgr2=0x7f51e013db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 --2- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 -- 10.20.193.51:0/1957324410 >> v1:10.20.193.142:6789/0 conn(0x7f51e00a0750 legacy=0x7f51e009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient: _finish_hunting 0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 monclient: found mon.noname-a 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:35.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.073+0000 7f51ded76640 1 -- 10.20.193.51:0/1957324410 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e009eec0 con 0x7f51e00a3bb0 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ded76640 1 -- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a3bb0 msgr2=0x7f51e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ded76640 1 --2- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a3bb0 0x7f51e009dac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f51e006c1c0 tx=0x7f51d402ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229cd4f1424d8777 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 1 -- 10.20.193.51:0/1957324410 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d403c070 con 0x7f51e00a3bb0 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: dump: 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: _finish_auth 0 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: _check_auth_tickets 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:35.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 1 -- 10.20.193.51:0/1957324410 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d402fda0 con 0x7f51e00a3bb0 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 5 monclient: authenticate success, global_id 204306 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 1 -- 10.20.193.51:0/1957324410 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4037660 con 0x7f51e00a3bb0 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51ddd74640 10 monclient: dump: 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 4 set_mon_vals no callback set 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 10 monclient: shutdown 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 -- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a3bb0 msgr2=0x7f51e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 --2- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a3bb0 0x7f51e009dac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f51e006c1c0 tx=0x7f51d402ee80 comp rx=0 tx=0).stop 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 -- 10.20.193.51:0/1957324410 shutdown_connections 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 --2- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 --2- 10.20.193.51:0/1957324410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a3bb0 0x7f51e009dac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 -- 10.20.193.51:0/1957324410 >> 10.20.193.51:0/1957324410 conn(0x7f51e00a30c0 msgr2=0x7f51e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 -- 10.20.193.51:0/1957324410 shutdown_connections 2026-02-17T12:02:35.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.076+0000 7f51e5200640 1 -- 10.20.193.51:0/1957324410 wait complete. 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient: build_initial_monmap 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient: monmap: 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 Processor -- start 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 -- start start 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient: init 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 0x7f51e01cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-a con 0x7f51e00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e00a3bb0 0x7f51e01cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-b con 0x7f51e00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e012e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): picked mon.noname-c con 0x7f51e013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00a04b0 con 0x7f51e00a0750 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f51e009c850 con 0x7f51e00a3bb0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f51e009e710 con 0x7f51e013b760 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51e5200640 10 monclient(hunting): authenticate will time out at 1642.696626s 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51df577640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 msgr2=0x7f51e012e120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51df577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e012e120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 0x7f51e01cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 0x7f51e01cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53236/0 (socket says 10.20.193.51:53236) 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 -- 10.20.193.51:0/4036794247 learned_addr learned my addr 10.20.193.51:0/4036794247 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): get_auth_request con 0x7f51e00a0750 auth_method 0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51de575640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e00a3bb0 0x7f51e01cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51de575640 10 monclient(hunting): get_auth_request con 0x7f51e00a3bb0 auth_method 0 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:35.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient(hunting): handle_auth_done global_id 204309 payload 824 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 msgr2=0x7f51e012e120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f51e013b760 0x7f51e012e120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e00a3bb0 msgr2=0x7f51e01cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e00a3bb0 0x7f51e01cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient: _finish_hunting 0 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 monclient: found mon.noname-a 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:35.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.077+0000 7f51ded76640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e0131d10 con 0x7f51e00a0750 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.079+0000 7f51ded76640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 msgr2=0x7f51e01cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.079+0000 7f51ded76640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 0x7f51e01cdab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009a70 tx=0x7f51d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4046020 con 0x7f51e00a0750 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: dump: 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: _finish_auth 0 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 5 monclient: authenticate success, global_id 204309 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d4042620 con 0x7f51e00a0750 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 monclient: _renew_subs 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e009d7b0 con 0x7f51e00a0750 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d403c040 con 0x7f51e00a0750 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51dd573640 4 set_mon_vals no callback set 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 10 monclient: dump: 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 monclient: _renew_subs 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e0131750 con 0x7f51e00a0750 2026-02-17T12:02:35.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 0x7f51e012ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00743f0 con 0x7f51e012e660 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f51d403f030 con 0x7f51e00a0750 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51de575640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 0x7f51e012ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51de575640 10 monclient: get_auth_request con 0x7f51e012e660 auth_method 0 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f51ac03dcc0 0x7f51ac040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.080+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(624..624 src has 323..624) ==== 4827+0+0 (secure 0 0 0) 0x7f51d4077540 con 0x7f51e00a0750 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51df577640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f51ac03dcc0 0x7f51ac040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51df577640 10 monclient: get_auth_request con 0x7f51ac03dcc0 auth_method 0 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51de575640 10 monclient(hunting): handle_auth_done global_id 184399 payload 824 2026-02-17T12:02:35.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.081+0000 7f51de575640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51e006f9f0 con 0x7f51e012e660 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51df577640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f51ac03dcc0 0x7f51ac040180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f51e01384b0 tx=0x7f51d00091f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51de575640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 msgr2=0x7f51e012ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51de575640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 0x7f51e012ea40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8006ae0 con 0x7f51e012e660 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 10 monclient: dump: 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f51c8006ae0 con 0x7f51e012e660 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 msgr2=0x7f51e012ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 0x7f51e012ea40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c800ebd0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 msgr2=0x7f51e012ea40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:35.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.083+0000 7f51bf7fe640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012e660 0x7f51e012ea40 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c800ebd0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.086+0000 7f51e5200640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:02:35.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.086+0000 7f51e5200640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 0x7f51e01d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:35.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.086+0000 7f51e5200640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:35.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.086+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0132080 con 0x7f51e012ef80 2026-02-17T12:02:35.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 0x7f51e01d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient: get_auth_request con 0x7f51e012ef80 auth_method 0 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 10 monclient(hunting): handle_auth_done global_id 184402 payload 824 2026-02-17T12:02:35.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.087+0000 7f51de575640 1 -- 10.20.193.51:0/4036794247 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51e009dac0 con 0x7f51e012ef80 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51de575640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 msgr2=0x7f51e01d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51de575640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 0x7f51e01d8ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c8003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c800c930 con 0x7f51e012ef80 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 10 monclient: dump: 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:35.091 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7f51c800c930 con 0x7f51e012ef80 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 msgr2=0x7f51e01d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 0x7f51e01d8ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c8003860 comp rx=0 tx=0).stop 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 msgr2=0x7f51e01d8ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51bf7fe640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f51e012ef80 0x7f51e01d8ab0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e700 tx=0x7f51c8003860 comp rx=0 tx=0).stop 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 160, 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 187476, 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:02:35.092 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:02:35.093 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.094 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.095 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:02:35.096 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.097 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:02:35.098 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f51ac03dcc0 msgr2=0x7f51ac040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f51ac03dcc0 0x7f51ac040180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f51e01384b0 tx=0x7f51d00091f0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 10 monclient: shutdown 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 msgr2=0x7f51e01cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.089+0000 7f51e5200640 1 --2- 10.20.193.51:0/4036794247 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f51e00a0750 0x7f51e01cdab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009a70 tx=0x7f51d40047c0 comp rx=0 tx=0).stop 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51df577640 1 -- 10.20.193.51:0/4036794247 reap_dead start 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51df577640 1 -- 10.20.193.51:0/4036794247 reap_dead start 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 shutdown_connections 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 >> 10.20.193.51:0/4036794247 conn(0x7f51e00a30c0 msgr2=0x7f51e013ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 shutdown_connections 2026-02-17T12:02:35.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:35.090+0000 7f51e5200640 1 -- 10.20.193.51:0/4036794247 wait complete. 2026-02-17T12:02:35.099 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:02:35.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:02:35.790 INFO:tasks.rados.rados.0.trial142.stdout:2707: done (1 left) 2026-02-17T12:02:35.790 INFO:tasks.rados.rados.0.trial142.stdout:2709: done (0 left) 2026-02-17T12:02:35.790 INFO:tasks.rados.rados.0.trial142.stdout:2710: delete oid 30 current snap is 300 2026-02-17T12:02:35.799 INFO:tasks.rados.rados.0.trial142.stdout:2710: done (0 left) 2026-02-17T12:02:35.799 INFO:tasks.rados.rados.0.trial142.stdout:2711: snap_remove snap 296 2026-02-17T12:02:36.793 INFO:tasks.rados.rados.0.trial142.stdout:2711: done (0 left) 2026-02-17T12:02:36.793 INFO:tasks.rados.rados.0.trial142.stdout:2712: snap_remove snap 291 2026-02-17T12:02:37.794 INFO:tasks.rados.rados.0.trial142.stdout:2712: done (0 left) 2026-02-17T12:02:37.794 INFO:tasks.rados.rados.0.trial142.stdout:2713: read oid 14 snap -1 2026-02-17T12:02:37.794 INFO:tasks.rados.rados.0.trial142.stdout:2713: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:37.794 INFO:tasks.rados.rados.0.trial142.stdout:2714: read oid 27 snap -1 2026-02-17T12:02:37.795 INFO:tasks.rados.rados.0.trial142.stdout:2714: expect (ObjNum 899 snap 287 seq_num 899) 2026-02-17T12:02:37.795 INFO:tasks.rados.rados.0.trial142.stdout:2715: snap_remove snap 283 2026-02-17T12:02:38.798 INFO:tasks.rados.rados.0.trial142.stdout:2715: done (2 left) 2026-02-17T12:02:38.799 INFO:tasks.rados.rados.0.trial142.stdout:2716: copy_from oid 43 from oid 32 current snap is 300 2026-02-17T12:02:38.799 INFO:tasks.rados.rados.0.trial142.stdout:2713: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:38.928 INFO:tasks.rados.rados.0.trial142.stdout:2714: expect (ObjNum 899 snap 287 seq_num 899) 2026-02-17T12:02:39.107 INFO:tasks.rados.rados.0.trial142.stdout:2716: finishing copy_from racing read to trial14245205-43 2026-02-17T12:02:39.107 INFO:tasks.rados.rados.0.trial142.stdout:2716: finishing copy_from to trial14245205-43 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2121 (ObjNum 883 snap 280 seq_num 883) dirty exists 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:2713: done (2 left) 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:2714: done (1 left) 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:2716: done (0 left) 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:2717: write (excl) oid 2 current snap is 300 2026-02-17T12:02:39.108 INFO:tasks.rados.rados.0.trial142.stdout:2717: seq_num 928 ranges {796896=426138,1654231=764649,2984302=480075} 2026-02-17T12:02:39.112 INFO:tasks.rados.rados.0.trial142.stdout:2717: writing trial14245205-2 from 796896 to 1223034 tid 1 2026-02-17T12:02:39.117 INFO:tasks.rados.rados.0.trial142.stdout:2717: writing trial14245205-2 from 1654231 to 2418880 tid 2 2026-02-17T12:02:39.120 INFO:tasks.rados.rados.0.trial142.stdout:2717: writing trial14245205-2 from 2984302 to 3464377 tid 3 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2718: rollback oid 21 current snap is 300 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 284 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2717: finishing write tid 1 to trial14245205-2 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2717: finishing write tid 2 to trial14245205-2 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2719: read oid 39 snap -1 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2719: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2720: write (excl) oid 16 current snap is 300 2026-02-17T12:02:39.121 INFO:tasks.rados.rados.0.trial142.stdout:2720: seq_num 929 ranges {413703=501387,1596360=624660,2895372=691347} 2026-02-17T12:02:39.124 INFO:tasks.rados.rados.0.trial142.stdout:2720: writing trial14245205-16 from 413703 to 915090 tid 1 2026-02-17T12:02:39.129 INFO:tasks.rados.rados.0.trial142.stdout:2720: writing trial14245205-16 from 1596360 to 2221020 tid 2 2026-02-17T12:02:39.135 INFO:tasks.rados.rados.0.trial142.stdout:2720: writing trial14245205-16 from 2895372 to 3586719 tid 3 2026-02-17T12:02:39.135 INFO:tasks.rados.rados.0.trial142.stdout:2721: read oid 5 snap -1 2026-02-17T12:02:39.135 INFO:tasks.rados.rados.0.trial142.stdout:2721: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:02:39.135 INFO:tasks.rados.rados.0.trial142.stdout:2722: write oid 36 current snap is 300 2026-02-17T12:02:39.135 INFO:tasks.rados.rados.0.trial142.stdout:2722: seq_num 930 ranges {430510=576636,1654842=768318,2922795=502619} 2026-02-17T12:02:39.138 INFO:tasks.rados.rados.0.trial142.stdout:2722: writing trial14245205-36 from 430510 to 1007146 tid 1 2026-02-17T12:02:39.143 INFO:tasks.rados.rados.0.trial142.stdout:2722: writing trial14245205-36 from 1654842 to 2423160 tid 2 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2722: writing trial14245205-36 from 2922795 to 3425414 tid 3 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2723: snap_create 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: finishing write tid 3 to trial14245205-2 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: finishing write tid 4 to trial14245205-2 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: finishing write tid 5 to trial14245205-2 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: oid 2 updating version 0 to 2121 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: oid 2 updating version 2121 to 2122 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: oid 2 version 2122 is already newer than 2120 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: oid 2 version 2122 is already newer than 2119 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2122 (ObjNum 928 snap 300 seq_num 928) dirty exists 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2717: left oid 2 (ObjNum 928 snap 300 seq_num 928) 2026-02-17T12:02:39.147 INFO:tasks.rados.rados.0.trial142.stdout:2718: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:02:39.148 INFO:tasks.rados.rados.0.trial142.stdout:2718: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:02:39.148 INFO:tasks.rados.rados.0.trial142.stdout:2718: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:02:39.148 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1986 (ObjNum 836 snap 264 seq_num 836) dirty exists 2026-02-17T12:02:39.148 INFO:tasks.rados.rados.0.trial142.stdout:2719: expect (ObjNum 849 snap 265 seq_num 849) 2026-02-17T12:02:39.332 INFO:tasks.rados.rados.0.trial142.stdout:2720: finishing write tid 1 to trial14245205-16 2026-02-17T12:02:39.332 INFO:tasks.rados.rados.0.trial142.stdout:2720: finishing write tid 2 to trial14245205-16 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2717: done (6 left) 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2718: done (5 left) 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2719: done (4 left) 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2723: done (3 left) 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2724: read oid 19 snap -1 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2724: expect deleted 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2725: read oid 49 snap -1 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2725: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:39.333 INFO:tasks.rados.rados.0.trial142.stdout:2726: snap_remove snap 299 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2726: done (5 left) 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2727: snap_create 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: finishing write tid 3 to trial14245205-16 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: finishing write tid 4 to trial14245205-16 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: finishing write tid 5 to trial14245205-16 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: oid 16 updating version 0 to 1181 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: oid 16 updating version 1181 to 1182 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: oid 16 updating version 1182 to 1183 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:2720: oid 16 version 1183 is already newer than 1180 2026-02-17T12:02:40.252 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1183 (ObjNum 929 snap 300 seq_num 929) dirty exists 2026-02-17T12:02:40.253 INFO:tasks.rados.rados.0.trial142.stdout:2720: left oid 16 (ObjNum 929 snap 300 seq_num 929) 2026-02-17T12:02:40.253 INFO:tasks.rados.rados.0.trial142.stdout:2721: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:02:40.398 INFO:tasks.rados.rados.0.trial142.stdout:2722: finishing write tid 1 to trial14245205-36 2026-02-17T12:02:40.398 INFO:tasks.rados.rados.0.trial142.stdout:2722: finishing write tid 2 to trial14245205-36 2026-02-17T12:02:40.398 INFO:tasks.rados.rados.0.trial142.stdout:2722: finishing write tid 3 to trial14245205-36 2026-02-17T12:02:40.398 INFO:tasks.rados.rados.0.trial142.stdout:2722: finishing write tid 4 to trial14245205-36 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: finishing write tid 5 to trial14245205-36 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: oid 36 updating version 0 to 2124 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: oid 36 version 2124 is already newer than 2122 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: oid 36 version 2124 is already newer than 2123 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: oid 36 updating version 2124 to 2125 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 2125 (ObjNum 930 snap 300 seq_num 930) dirty exists 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2722: left oid 36 (ObjNum 930 snap 300 seq_num 930) 2026-02-17T12:02:40.399 INFO:tasks.rados.rados.0.trial142.stdout:2725: expect (ObjNum 827 snap 257 seq_num 827) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2720: done (5 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2721: done (4 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2722: done (3 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2724: done (2 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2725: done (1 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2727: done (0 left) 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2728: read oid 14 snap 301 2026-02-17T12:02:41.254 INFO:tasks.rados.rados.0.trial142.stdout:2728: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:41.255 INFO:tasks.rados.rados.0.trial142.stdout:2729: read oid 21 snap 294 2026-02-17T12:02:41.255 INFO:tasks.rados.rados.0.trial142.stdout:2729: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:02:41.255 INFO:tasks.rados.rados.0.trial142.stdout:2730: write (excl) oid 10 current snap is 302 2026-02-17T12:02:41.255 INFO:tasks.rados.rados.0.trial142.stdout:2730: seq_num 931 ranges {447317=651885,1713324=628329,3066571=580746} 2026-02-17T12:02:41.257 INFO:tasks.rados.rados.0.trial142.stdout:2730: writing trial14245205-10 from 447317 to 1099202 tid 1 2026-02-17T12:02:41.262 INFO:tasks.rados.rados.0.trial142.stdout:2730: writing trial14245205-10 from 1713324 to 2341653 tid 2 2026-02-17T12:02:41.267 INFO:tasks.rados.rados.0.trial142.stdout:2730: writing trial14245205-10 from 3066571 to 3647317 tid 3 2026-02-17T12:02:41.267 INFO:tasks.rados.rados.0.trial142.stdout:2731: write oid 29 current snap is 302 2026-02-17T12:02:41.267 INFO:tasks.rados.rados.0.trial142.stdout:2731: seq_num 932 ranges {464124=727134,1771806=771987,2977641=641516} 2026-02-17T12:02:41.271 INFO:tasks.rados.rados.0.trial142.stdout:2731: writing trial14245205-29 from 464124 to 1191258 tid 1 2026-02-17T12:02:41.276 INFO:tasks.rados.rados.0.trial142.stdout:2731: writing trial14245205-29 from 1771806 to 2543793 tid 2 2026-02-17T12:02:41.280 INFO:tasks.rados.rados.0.trial142.stdout:2731: writing trial14245205-29 from 2977641 to 3619157 tid 3 2026-02-17T12:02:41.280 INFO:tasks.rados.rados.0.trial142.stdout:2732: delete oid 3 current snap is 302 2026-02-17T12:02:41.280 INFO:tasks.rados.rados.0.trial142.stdout:2728: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:41.410 INFO:tasks.rados.rados.0.trial142.stdout:2729: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:02:41.456 INFO:tasks.rados.rados.0.trial142.stdout:2730: finishing write tid 1 to trial14245205-10 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2730: finishing write tid 2 to trial14245205-10 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2730: finishing write tid 3 to trial14245205-10 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2728: done (4 left) 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2729: done (3 left) 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2732: done (2 left) 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2733: copy_from oid 32 from oid 23 current snap is 302 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2730: finishing write tid 4 to trial14245205-10 2026-02-17T12:02:41.457 INFO:tasks.rados.rados.0.trial142.stdout:2730: finishing write tid 5 to trial14245205-10 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2730: oid 10 updating version 0 to 1992 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2730: oid 10 version 1992 is already newer than 1990 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2730: oid 10 updating version 1992 to 1993 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2730: oid 10 version 1993 is already newer than 1991 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 1993 (ObjNum 931 snap 302 seq_num 931) dirty exists 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2730: left oid 10 (ObjNum 931 snap 302 seq_num 931) 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2731: finishing write tid 1 to trial14245205-29 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2731: finishing write tid 2 to trial14245205-29 2026-02-17T12:02:41.458 INFO:tasks.rados.rados.0.trial142.stdout:2731: finishing write tid 3 to trial14245205-29 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: finishing write tid 4 to trial14245205-29 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: finishing write tid 5 to trial14245205-29 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: oid 29 updating version 0 to 1972 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: oid 29 updating version 1972 to 1973 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: oid 29 updating version 1973 to 1974 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: oid 29 version 1974 is already newer than 1971 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 1974 (ObjNum 932 snap 302 seq_num 932) dirty exists 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: left oid 29 (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2730: done (2 left) 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2731: done (1 left) 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:2734: rollback oid 8 current snap is 302 2026-02-17T12:02:41.459 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 300 2026-02-17T12:02:41.460 INFO:tasks.rados.rados.0.trial142.stdout:2735: snap_create 2026-02-17T12:02:41.460 INFO:tasks.rados.rados.0.trial142.stdout:2734: finishing rollback tid 1 to trial14245205-8 2026-02-17T12:02:41.460 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2130 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T12:02:41.462 INFO:tasks.rados.rados.0.trial142.stdout:2733: finishing copy_from racing read to trial14245205-32 2026-02-17T12:02:41.462 INFO:tasks.rados.rados.0.trial142.stdout:2733: finishing copy_from to trial14245205-32 2026-02-17T12:02:41.462 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 1988 (ObjNum 866 snap 271 seq_num 866) dirty exists 2026-02-17T12:02:42.259 INFO:tasks.rados.rados.0.trial142.stdout:2733: done (2 left) 2026-02-17T12:02:42.259 INFO:tasks.rados.rados.0.trial142.stdout:2734: done (1 left) 2026-02-17T12:02:42.260 INFO:tasks.rados.rados.0.trial142.stdout:2735: done (0 left) 2026-02-17T12:02:42.260 INFO:tasks.rados.rados.0.trial142.stdout:2736: copy_from oid 22 from oid 14 current snap is 303 2026-02-17T12:02:42.260 INFO:tasks.rados.rados.0.trial142.stdout:2737: write oid 40 current snap is 303 2026-02-17T12:02:42.260 INFO:tasks.rados.rados.0.trial142.stdout:2737: seq_num 934 ranges {497738=477632,1772417=775656,3316134=381604} 2026-02-17T12:02:42.263 INFO:tasks.rados.rados.0.trial142.stdout:2737: writing trial14245205-40 from 497738 to 975370 tid 1 2026-02-17T12:02:42.269 INFO:tasks.rados.rados.0.trial142.stdout:2737: writing trial14245205-40 from 1772417 to 2548073 tid 2 2026-02-17T12:02:42.274 INFO:tasks.rados.rados.0.trial142.stdout:2737: writing trial14245205-40 from 3316134 to 3697738 tid 3 2026-02-17T12:02:42.274 INFO:tasks.rados.rados.0.trial142.stdout:2738: write oid 32 current snap is 303 2026-02-17T12:02:42.274 INFO:tasks.rados.rados.0.trial142.stdout:2738: seq_num 935 ranges {514545=552881,1830899=519314,2943557=475332} 2026-02-17T12:02:42.277 INFO:tasks.rados.rados.0.trial142.stdout:2738: writing trial14245205-32 from 514545 to 1067426 tid 1 2026-02-17T12:02:42.282 INFO:tasks.rados.rados.0.trial142.stdout:2738: writing trial14245205-32 from 1830899 to 2350213 tid 2 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2738: writing trial14245205-32 from 2943557 to 3418889 tid 3 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2739: copy_from oid 12 from oid 39 current snap is 303 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2737: finishing write tid 1 to trial14245205-40 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2736: finishing copy_from racing read to trial14245205-22 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2736: finishing copy_from to trial14245205-22 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2218 (ObjNum 675 snap 211 seq_num 675) dirty exists 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2737: finishing write tid 2 to trial14245205-40 2026-02-17T12:02:42.288 INFO:tasks.rados.rados.0.trial142.stdout:2736: done (3 left) 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2740: read oid 34 snap -1 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2740: expect deleted 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2741: rollback oid 2 current snap is 303 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 297 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: finishing write tid 3 to trial14245205-40 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: finishing write tid 4 to trial14245205-40 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: finishing write tid 5 to trial14245205-40 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: oid 40 updating version 0 to 1966 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: oid 40 updating version 1966 to 1967 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: oid 40 version 1967 is already newer than 1965 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:2737: oid 40 version 1967 is already newer than 1964 2026-02-17T12:02:42.289 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 1967 (ObjNum 934 snap 303 seq_num 934) dirty exists 2026-02-17T12:02:42.290 INFO:tasks.rados.rados.0.trial142.stdout:2737: left oid 40 (ObjNum 934 snap 303 seq_num 934) 2026-02-17T12:02:42.290 INFO:tasks.rados.rados.0.trial142.stdout:2738: finishing write tid 1 to trial14245205-32 2026-02-17T12:02:42.290 INFO:tasks.rados.rados.0.trial142.stdout:2738: finishing write tid 2 to trial14245205-32 2026-02-17T12:02:42.290 INFO:tasks.rados.rados.0.trial142.stdout:2737: done (4 left) 2026-02-17T12:02:42.290 INFO:tasks.rados.rados.0.trial142.stdout:2742: delete oid 13 current snap is 303 2026-02-17T12:02:42.291 INFO:tasks.rados.rados.0.trial142.stdout:2738: finishing write tid 3 to trial14245205-32 2026-02-17T12:02:42.291 INFO:tasks.rados.rados.0.trial142.stdout:2740: done (4 left) 2026-02-17T12:02:42.291 INFO:tasks.rados.rados.0.trial142.stdout:2742: done (3 left) 2026-02-17T12:02:42.291 INFO:tasks.rados.rados.0.trial142.stdout:2743: write (excl) oid 36 current snap is 303 2026-02-17T12:02:42.291 INFO:tasks.rados.rados.0.trial142.stdout:2743: seq_num 937 ranges {548159=419732,1664216=522983,2714756=614229} 2026-02-17T12:02:42.292 INFO:tasks.rados.rados.0.trial142.stdout:2743: writing trial14245205-36 from 548159 to 967891 tid 1 2026-02-17T12:02:42.297 INFO:tasks.rados.rados.0.trial142.stdout:2743: writing trial14245205-36 from 1664216 to 2187199 tid 2 2026-02-17T12:02:42.302 INFO:tasks.rados.rados.0.trial142.stdout:2743: writing trial14245205-36 from 2714756 to 3328985 tid 3 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2744: copy_from oid 6 from oid 11 current snap is 303 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: finishing write tid 4 to trial14245205-32 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: finishing write tid 5 to trial14245205-32 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: oid 32 updating version 0 to 2129 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: oid 32 version 2129 is already newer than 2128 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: oid 32 version 2129 is already newer than 2126 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: oid 32 version 2129 is already newer than 2127 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2129 (ObjNum 935 snap 303 seq_num 935) dirty exists 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2738: left oid 32 (ObjNum 935 snap 303 seq_num 935) 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2741: finishing rollback tid 0 to trial14245205-2 2026-02-17T12:02:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2741: finishing rollback tid 1 to trial14245205-2 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2741: finishing rollback tid 2 to trial14245205-2 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2125 (ObjNum 903 snap 291 seq_num 903) dirty exists 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2739: finishing copy_from racing read to trial14245205-12 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2738: done (4 left) 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2741: done (3 left) 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2745: read oid 31 snap -1 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2745: expect (ObjNum 912 snap 295 seq_num 912) 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2746: write oid 14 current snap is 303 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2743: finishing write tid 1 to trial14245205-36 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2739: finishing copy_from to trial14245205-12 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2123 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:02:42.304 INFO:tasks.rados.rados.0.trial142.stdout:2743: finishing write tid 2 to trial14245205-36 2026-02-17T12:02:42.305 INFO:tasks.rados.rados.0.trial142.stdout:2746: seq_num 938 ranges {564966=494981,1606345=782994,3025826=425501} 2026-02-17T12:02:42.305 INFO:tasks.rados.rados.0.trial142.stdout:2746: writing trial14245205-14 from 564966 to 1059947 tid 1 2026-02-17T12:02:42.310 INFO:tasks.rados.rados.0.trial142.stdout:2746: writing trial14245205-14 from 1606345 to 2389339 tid 2 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2746: writing trial14245205-14 from 3025826 to 3451327 tid 3 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2739: done (4 left) 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2747: snap_create 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: finishing write tid 3 to trial14245205-36 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: finishing write tid 4 to trial14245205-36 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: finishing write tid 5 to trial14245205-36 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: oid 36 updating version 0 to 2133 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: oid 36 version 2133 is already newer than 2132 2026-02-17T12:02:42.315 INFO:tasks.rados.rados.0.trial142.stdout:2743: oid 36 version 2133 is already newer than 2130 2026-02-17T12:02:42.316 INFO:tasks.rados.rados.0.trial142.stdout:2743: oid 36 version 2133 is already newer than 2131 2026-02-17T12:02:42.316 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 2133 (ObjNum 937 snap 303 seq_num 937) dirty exists 2026-02-17T12:02:42.316 INFO:tasks.rados.rados.0.trial142.stdout:2743: left oid 36 (ObjNum 937 snap 303 seq_num 937) 2026-02-17T12:02:42.316 INFO:tasks.rados.rados.0.trial142.stdout:2745: expect (ObjNum 912 snap 295 seq_num 912) 2026-02-17T12:02:42.419 INFO:tasks.rados.rados.0.trial142.stdout:2746: finishing write tid 1 to trial14245205-14 2026-02-17T12:02:42.419 INFO:tasks.rados.rados.0.trial142.stdout:2744: finishing copy_from racing read to trial14245205-6 2026-02-17T12:02:42.419 INFO:tasks.rados.rados.0.trial142.stdout:2744: finishing copy_from to trial14245205-6 2026-02-17T12:02:42.419 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 1130 (ObjNum 918 snap 299 seq_num 918) dirty exists 2026-02-17T12:02:42.419 INFO:tasks.rados.rados.0.trial142.stdout:2746: finishing write tid 2 to trial14245205-14 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: finishing write tid 3 to trial14245205-14 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: finishing write tid 4 to trial14245205-14 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: finishing write tid 5 to trial14245205-14 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: oid 14 updating version 0 to 2486 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: oid 14 updating version 2486 to 2488 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: oid 14 version 2488 is already newer than 2487 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: oid 14 version 2488 is already newer than 2485 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2488 (ObjNum 938 snap 303 seq_num 938) dirty exists 2026-02-17T12:02:42.420 INFO:tasks.rados.rados.0.trial142.stdout:2746: left oid 14 (ObjNum 938 snap 303 seq_num 938) 2026-02-17T12:02:43.261 INFO:tasks.rados.rados.0.trial142.stdout:2743: done (4 left) 2026-02-17T12:02:43.262 INFO:tasks.rados.rados.0.trial142.stdout:2744: done (3 left) 2026-02-17T12:02:43.262 INFO:tasks.rados.rados.0.trial142.stdout:2745: done (2 left) 2026-02-17T12:02:43.262 INFO:tasks.rados.rados.0.trial142.stdout:2746: done (1 left) 2026-02-17T12:02:43.262 INFO:tasks.rados.rados.0.trial142.stdout:2747: done (0 left) 2026-02-17T12:02:43.262 INFO:tasks.rados.rados.0.trial142.stdout:2748: delete oid 41 current snap is 304 2026-02-17T12:02:43.263 INFO:tasks.rados.rados.0.trial142.stdout:2748: done (0 left) 2026-02-17T12:02:43.263 INFO:tasks.rados.rados.0.trial142.stdout:2749: rollback oid 23 current snap is 304 2026-02-17T12:02:43.263 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 300 2026-02-17T12:02:43.263 INFO:tasks.rados.rados.0.trial142.stdout:2750: delete oid 11 current snap is 304 2026-02-17T12:02:43.266 INFO:tasks.rados.rados.0.trial142.stdout:2750: done (1 left) 2026-02-17T12:02:43.266 INFO:tasks.rados.rados.0.trial142.stdout:2751: write (excl) oid 28 current snap is 304 2026-02-17T12:02:43.266 INFO:tasks.rados.rados.0.trial142.stdout:2751: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2026-02-17T12:02:43.271 INFO:tasks.rados.rados.0.trial142.stdout:2751: writing trial14245205-28 from 615387 to 1336115 tid 1 2026-02-17T12:02:43.275 INFO:tasks.rados.rados.0.trial142.stdout:2751: writing trial14245205-28 from 1781791 to 2312112 tid 2 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2751: writing trial14245205-28 from 3108095 to 3815387 tid 3 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2752: delete oid 18 current snap is 304 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2749: finishing rollback tid 0 to trial14245205-23 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2749: finishing rollback tid 1 to trial14245205-23 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2749: finishing rollback tid 2 to trial14245205-23 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 1996 (ObjNum 866 snap 271 seq_num 866) dirty exists 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2751: finishing write tid 1 to trial14245205-28 2026-02-17T12:02:43.281 INFO:tasks.rados.rados.0.trial142.stdout:2751: finishing write tid 2 to trial14245205-28 2026-02-17T12:02:43.284 INFO:tasks.rados.rados.0.trial142.stdout:2751: finishing write tid 3 to trial14245205-28 2026-02-17T12:02:43.284 INFO:tasks.rados.rados.0.trial142.stdout:2751: finishing write tid 4 to trial14245205-28 2026-02-17T12:02:43.284 INFO:tasks.rados.rados.0.trial142.stdout:2751: finishing write tid 5 to trial14245205-28 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:2751: oid 28 updating version 0 to 2134 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:2751: oid 28 version 2134 is already newer than 2132 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:2751: oid 28 version 2134 is already newer than 2133 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:2751: oid 28 updating version 2134 to 2135 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2135 (ObjNum 941 snap 304 seq_num 941) dirty exists 2026-02-17T12:02:43.285 INFO:tasks.rados.rados.0.trial142.stdout:2751: left oid 28 (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:02:43.286 INFO:tasks.rados.rados.0.trial142.stdout:2749: done (2 left) 2026-02-17T12:02:43.286 INFO:tasks.rados.rados.0.trial142.stdout:2751: done (1 left) 2026-02-17T12:02:43.286 INFO:tasks.rados.rados.0.trial142.stdout:2752: done (0 left) 2026-02-17T12:02:43.286 INFO:tasks.rados.rados.0.trial142.stdout:2753: snap_remove snap 297 2026-02-17T12:02:44.266 INFO:tasks.rados.rados.0.trial142.stdout:2753: done (0 left) 2026-02-17T12:02:44.266 INFO:tasks.rados.rados.0.trial142.stdout:2754: rollback oid 19 current snap is 304 2026-02-17T12:02:44.266 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 302 2026-02-17T12:02:44.266 INFO:tasks.rados.rados.0.trial142.stdout:2755: rollback oid 1 current snap is 304 2026-02-17T12:02:44.267 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 271 2026-02-17T12:02:44.267 INFO:tasks.rados.rados.0.trial142.stdout:2756: snap_create 2026-02-17T12:02:44.267 INFO:tasks.rados.rados.0.trial142.stdout:2754: finishing rollback tid 1 to trial14245205-19 2026-02-17T12:02:44.267 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:02:44.268 INFO:tasks.rados.rados.0.trial142.stdout:2755: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:02:44.269 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2125 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T12:02:45.267 INFO:tasks.rados.rados.0.trial142.stdout:2754: done (2 left) 2026-02-17T12:02:45.267 INFO:tasks.rados.rados.0.trial142.stdout:2755: done (1 left) 2026-02-17T12:02:45.268 INFO:tasks.rados.rados.0.trial142.stdout:2756: done (0 left) 2026-02-17T12:02:45.268 INFO:tasks.rados.rados.0.trial142.stdout:2757: read oid 21 snap 303 2026-02-17T12:02:45.268 INFO:tasks.rados.rados.0.trial142.stdout:2757: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:02:45.268 INFO:tasks.rados.rados.0.trial142.stdout:2758: snap_create 2026-02-17T12:02:45.271 INFO:tasks.rados.rados.0.trial142.stdout:2757: expect (ObjNum 836 snap 264 seq_num 836) 2026-02-17T12:02:46.697 INFO:tasks.rados.rados.0.trial142.stdout:2757: done (1 left) 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2758: done (0 left) 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2759: rollback oid 9 current snap is 306 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 300 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2760: read oid 10 snap -1 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2760: expect (ObjNum 931 snap 302 seq_num 931) 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2761: copy_from oid 47 from oid 46 current snap is 306 2026-02-17T12:02:46.698 INFO:tasks.rados.rados.0.trial142.stdout:2762: snap_create 2026-02-17T12:02:46.700 INFO:tasks.rados.rados.0.trial142.stdout:2759: finishing rollback tid 0 to trial14245205-9 2026-02-17T12:02:46.700 INFO:tasks.rados.rados.0.trial142.stdout:2759: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:02:46.701 INFO:tasks.rados.rados.0.trial142.stdout:2759: finishing rollback tid 2 to trial14245205-9 2026-02-17T12:02:46.701 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2502 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:02:46.704 INFO:tasks.rados.rados.0.trial142.stdout:2760: expect (ObjNum 931 snap 302 seq_num 931) 2026-02-17T12:02:46.876 INFO:tasks.rados.rados.0.trial142.stdout:2761: finishing copy_from racing read to trial14245205-47 2026-02-17T12:02:46.876 INFO:tasks.rados.rados.0.trial142.stdout:2761: finishing copy_from to trial14245205-47 2026-02-17T12:02:46.876 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2447 (ObjNum 923 snap 299 seq_num 923) dirty exists 2026-02-17T12:02:47.698 INFO:tasks.rados.rados.0.trial142.stdout:2759: done (3 left) 2026-02-17T12:02:47.698 INFO:tasks.rados.rados.0.trial142.stdout:2760: done (2 left) 2026-02-17T12:02:47.698 INFO:tasks.rados.rados.0.trial142.stdout:2761: done (1 left) 2026-02-17T12:02:47.698 INFO:tasks.rados.rados.0.trial142.stdout:2762: done (0 left) 2026-02-17T12:02:47.698 INFO:tasks.rados.rados.0.trial142.stdout:2763: snap_create 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2763: done (0 left) 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2764: read oid 26 snap 293 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2764: expect deleted 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2765: read oid 28 snap -1 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2765: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2766: write oid 12 current snap is 308 2026-02-17T12:02:48.699 INFO:tasks.rados.rados.0.trial142.stdout:2766: seq_num 943 ranges {649001=587579,1898755=533990,3162941=686060} 2026-02-17T12:02:48.703 INFO:tasks.rados.rados.0.trial142.stdout:2766: writing trial14245205-12 from 649001 to 1236580 tid 1 2026-02-17T12:02:48.708 INFO:tasks.rados.rados.0.trial142.stdout:2766: writing trial14245205-12 from 1898755 to 2432745 tid 2 2026-02-17T12:02:48.713 INFO:tasks.rados.rados.0.trial142.stdout:2766: writing trial14245205-12 from 3162941 to 3849001 tid 3 2026-02-17T12:02:48.714 INFO:tasks.rados.rados.0.trial142.stdout:2767: snap_remove snap 284 2026-02-17T12:02:49.251 INFO:tasks.rados.rados.0.trial142.stdout:2767: done (3 left) 2026-02-17T12:02:49.252 INFO:tasks.rados.rados.0.trial142.stdout:2768: write (excl) oid 23 current snap is 308 2026-02-17T12:02:49.252 INFO:tasks.rados.rados.0.trial142.stdout:2768: seq_num 944 ranges {665808=662828,1957237=677648,3074011=609486} 2026-02-17T12:02:49.258 INFO:tasks.rados.rados.0.trial142.stdout:2768: writing trial14245205-23 from 665808 to 1328636 tid 1 2026-02-17T12:02:49.263 INFO:tasks.rados.rados.0.trial142.stdout:2768: writing trial14245205-23 from 1957237 to 2634885 tid 2 2026-02-17T12:02:49.269 INFO:tasks.rados.rados.0.trial142.stdout:2768: writing trial14245205-23 from 3074011 to 3683497 tid 3 2026-02-17T12:02:49.269 INFO:tasks.rados.rados.0.trial142.stdout:2769: read oid 22 snap -1 2026-02-17T12:02:49.269 INFO:tasks.rados.rados.0.trial142.stdout:2769: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:49.269 INFO:tasks.rados.rados.0.trial142.stdout:2770: write (excl) oid 14 current snap is 308 2026-02-17T12:02:49.269 INFO:tasks.rados.rados.0.trial142.stdout:2770: seq_num 945 ranges {682615=738077,2015719=537659,3217787=420758} 2026-02-17T12:02:49.273 INFO:tasks.rados.rados.0.trial142.stdout:2770: writing trial14245205-14 from 682615 to 1420692 tid 1 2026-02-17T12:02:49.278 INFO:tasks.rados.rados.0.trial142.stdout:2770: writing trial14245205-14 from 2015719 to 2553378 tid 2 2026-02-17T12:02:49.282 INFO:tasks.rados.rados.0.trial142.stdout:2770: writing trial14245205-14 from 3217787 to 3638545 tid 3 2026-02-17T12:02:49.283 INFO:tasks.rados.rados.0.trial142.stdout:2771: rollback oid 3 current snap is 308 2026-02-17T12:02:49.283 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 303 2026-02-17T12:02:49.283 INFO:tasks.rados.rados.0.trial142.stdout:2764: done (6 left) 2026-02-17T12:02:49.283 INFO:tasks.rados.rados.0.trial142.stdout:2772: copy_from oid 48 from oid 32 current snap is 308 2026-02-17T12:02:49.283 INFO:tasks.rados.rados.0.trial142.stdout:2765: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: finishing write tid 1 to trial14245205-12 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: finishing write tid 2 to trial14245205-12 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: finishing write tid 3 to trial14245205-12 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: finishing write tid 4 to trial14245205-12 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: finishing write tid 5 to trial14245205-12 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: oid 12 updating version 0 to 2506 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: oid 12 version 2506 is already newer than 2504 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: oid 12 updating version 2506 to 2507 2026-02-17T12:02:49.434 INFO:tasks.rados.rados.0.trial142.stdout:2766: oid 12 version 2507 is already newer than 2505 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2507 (ObjNum 943 snap 308 seq_num 943) dirty exists 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2766: left oid 12 (ObjNum 943 snap 308 seq_num 943) 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: finishing write tid 1 to trial14245205-23 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2765: done (6 left) 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2766: done (5 left) 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2773: read oid 36 snap -1 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2773: expect (ObjNum 937 snap 303 seq_num 937) 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2774: snap_create 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: finishing write tid 2 to trial14245205-23 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: finishing write tid 3 to trial14245205-23 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: finishing write tid 4 to trial14245205-23 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: finishing write tid 5 to trial14245205-23 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: oid 23 updating version 0 to 2451 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: oid 23 version 2451 is already newer than 2450 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: oid 23 version 2451 is already newer than 2449 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: oid 23 version 2451 is already newer than 2448 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2451 (ObjNum 944 snap 308 seq_num 944) dirty exists 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2768: left oid 23 (ObjNum 944 snap 308 seq_num 944) 2026-02-17T12:02:49.435 INFO:tasks.rados.rados.0.trial142.stdout:2769: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:49.564 INFO:tasks.rados.rados.0.trial142.stdout:2770: finishing write tid 1 to trial14245205-14 2026-02-17T12:02:49.564 INFO:tasks.rados.rados.0.trial142.stdout:2770: finishing write tid 2 to trial14245205-14 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2771: finishing rollback tid 1 to trial14245205-3 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2131 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: finishing write tid 3 to trial14245205-14 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: finishing write tid 4 to trial14245205-14 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: finishing write tid 5 to trial14245205-14 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: oid 14 updating version 0 to 2524 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: oid 14 version 2524 is already newer than 2509 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: oid 14 version 2524 is already newer than 2523 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: oid 14 version 2524 is already newer than 2514 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2524 (ObjNum 945 snap 308 seq_num 945) dirty exists 2026-02-17T12:02:49.565 INFO:tasks.rados.rados.0.trial142.stdout:2770: left oid 14 (ObjNum 945 snap 308 seq_num 945) 2026-02-17T12:02:49.566 INFO:tasks.rados.rados.0.trial142.stdout:2772: finishing copy_from racing read to trial14245205-48 2026-02-17T12:02:49.566 INFO:tasks.rados.rados.0.trial142.stdout:2772: finishing copy_from to trial14245205-48 2026-02-17T12:02:49.566 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2129 (ObjNum 935 snap 303 seq_num 935) dirty exists 2026-02-17T12:02:49.566 INFO:tasks.rados.rados.0.trial142.stdout:2773: expect (ObjNum 937 snap 303 seq_num 937) 2026-02-17T12:02:50.254 INFO:tasks.rados.rados.0.trial142.stdout:2768: done (6 left) 2026-02-17T12:02:50.254 INFO:tasks.rados.rados.0.trial142.stdout:2769: done (5 left) 2026-02-17T12:02:50.254 INFO:tasks.rados.rados.0.trial142.stdout:2770: done (4 left) 2026-02-17T12:02:50.255 INFO:tasks.rados.rados.0.trial142.stdout:2771: done (3 left) 2026-02-17T12:02:50.255 INFO:tasks.rados.rados.0.trial142.stdout:2772: done (2 left) 2026-02-17T12:02:50.255 INFO:tasks.rados.rados.0.trial142.stdout:2773: done (1 left) 2026-02-17T12:02:50.255 INFO:tasks.rados.rados.0.trial142.stdout:2774: done (0 left) 2026-02-17T12:02:50.255 INFO:tasks.rados.rados.0.trial142.stdout:2775: snap_remove snap 308 2026-02-17T12:02:51.255 INFO:tasks.rados.rados.0.trial142.stdout:2775: done (0 left) 2026-02-17T12:02:51.255 INFO:tasks.rados.rados.0.trial142.stdout:2776: read oid 45 snap -1 2026-02-17T12:02:51.255 INFO:tasks.rados.rados.0.trial142.stdout:2776: expect deleted 2026-02-17T12:02:51.256 INFO:tasks.rados.rados.0.trial142.stdout:2777: delete oid 38 current snap is 309 2026-02-17T12:02:51.257 INFO:tasks.rados.rados.0.trial142.stdout:2776: done (1 left) 2026-02-17T12:02:51.258 INFO:tasks.rados.rados.0.trial142.stdout:2777: done (0 left) 2026-02-17T12:02:51.258 INFO:tasks.rados.rados.0.trial142.stdout:2778: copy_from oid 41 from oid 17 current snap is 309 2026-02-17T12:02:51.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: write (excl) oid 5 current snap is 309 2026-02-17T12:02:51.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: seq_num 947 ranges {716229=488575,1616330=541328,2756280=559655} 2026-02-17T12:02:51.263 INFO:tasks.rados.rados.0.trial142.stdout:2779: writing trial14245205-5 from 716229 to 1204804 tid 1 2026-02-17T12:02:51.266 INFO:tasks.rados.rados.0.trial142.stdout:2779: writing trial14245205-5 from 1616330 to 2157658 tid 2 2026-02-17T12:02:51.271 INFO:tasks.rados.rados.0.trial142.stdout:2779: writing trial14245205-5 from 2756280 to 3315935 tid 3 2026-02-17T12:02:51.271 INFO:tasks.rados.rados.0.trial142.stdout:2780: snap_remove snap 300 2026-02-17T12:02:52.257 INFO:tasks.rados.rados.0.trial142.stdout:2780: done (2 left) 2026-02-17T12:02:52.257 INFO:tasks.rados.rados.0.trial142.stdout:2781: snap_create 2026-02-17T12:02:52.257 INFO:tasks.rados.rados.0.trial142.stdout:2779: finishing write tid 1 to trial14245205-5 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2778: finishing copy_from racing read to trial14245205-41 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2778: finishing copy_from to trial14245205-41 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 1164 (ObjNum 868 snap 272 seq_num 868) dirty exists 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: finishing write tid 2 to trial14245205-5 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: finishing write tid 3 to trial14245205-5 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: finishing write tid 4 to trial14245205-5 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: finishing write tid 5 to trial14245205-5 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: oid 5 updating version 0 to 1184 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: oid 5 updating version 1184 to 1186 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: oid 5 updating version 1186 to 1187 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: oid 5 version 1187 is already newer than 1185 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1187 (ObjNum 947 snap 309 seq_num 947) dirty exists 2026-02-17T12:02:52.258 INFO:tasks.rados.rados.0.trial142.stdout:2779: left oid 5 (ObjNum 947 snap 309 seq_num 947) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2778: done (2 left) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2779: done (1 left) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2781: done (0 left) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2782: copy_from oid 19 from oid 12 current snap is 310 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2783: read oid 25 snap 304 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2783: expect (ObjNum 908 snap 292 seq_num 908) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2784: read oid 44 snap -1 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2784: expect (ObjNum 874 snap 274 seq_num 874) 2026-02-17T12:02:53.259 INFO:tasks.rados.rados.0.trial142.stdout:2785: delete oid 37 current snap is 310 2026-02-17T12:02:53.262 INFO:tasks.rados.rados.0.trial142.stdout:2785: done (3 left) 2026-02-17T12:02:53.263 INFO:tasks.rados.rados.0.trial142.stdout:2786: snap_remove snap 302 2026-02-17T12:02:54.265 INFO:tasks.rados.rados.0.trial142.stdout:2786: done (3 left) 2026-02-17T12:02:54.265 INFO:tasks.rados.rados.0.trial142.stdout:2787: read oid 43 snap 286 2026-02-17T12:02:54.265 INFO:tasks.rados.rados.0.trial142.stdout:2787: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:54.265 INFO:tasks.rados.rados.0.trial142.stdout:2788: write (excl) oid 8 current snap is 310 2026-02-17T12:02:54.265 INFO:tasks.rados.rados.0.trial142.stdout:2788: seq_num 949 ranges {749843=639073,2133294=544997,3211126=582199} 2026-02-17T12:02:54.270 INFO:tasks.rados.rados.0.trial142.stdout:2788: writing trial14245205-8 from 749843 to 1388916 tid 1 2026-02-17T12:02:54.275 INFO:tasks.rados.rados.0.trial142.stdout:2788: writing trial14245205-8 from 2133294 to 2678291 tid 2 2026-02-17T12:02:54.280 INFO:tasks.rados.rados.0.trial142.stdout:2788: writing trial14245205-8 from 3211126 to 3793325 tid 3 2026-02-17T12:02:54.280 INFO:tasks.rados.rados.0.trial142.stdout:2789: write (excl) oid 3 current snap is 310 2026-02-17T12:02:54.280 INFO:tasks.rados.rados.0.trial142.stdout:2789: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2026-02-17T12:02:54.286 INFO:tasks.rados.rados.0.trial142.stdout:2789: writing trial14245205-3 from 766650 to 1480972 tid 1 2026-02-17T12:02:54.290 INFO:tasks.rados.rados.0.trial142.stdout:2789: writing trial14245205-3 from 2075423 to 2764078 tid 2 2026-02-17T12:02:54.295 INFO:tasks.rados.rados.0.trial142.stdout:2789: writing trial14245205-3 from 3522196 to 3966650 tid 3 2026-02-17T12:02:54.295 INFO:tasks.rados.rados.0.trial142.stdout:2790: delete oid 21 current snap is 310 2026-02-17T12:02:54.295 INFO:tasks.rados.rados.0.trial142.stdout:2784: expect (ObjNum 874 snap 274 seq_num 874) 2026-02-17T12:02:54.384 INFO:tasks.rados.rados.0.trial142.stdout:2783: expect (ObjNum 908 snap 292 seq_num 908) 2026-02-17T12:02:54.504 INFO:tasks.rados.rados.0.trial142.stdout:2782: finishing copy_from racing read to trial14245205-19 2026-02-17T12:02:54.504 INFO:tasks.rados.rados.0.trial142.stdout:2782: finishing copy_from to trial14245205-19 2026-02-17T12:02:54.504 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2507 (ObjNum 943 snap 308 seq_num 943) dirty exists 2026-02-17T12:02:54.505 INFO:tasks.rados.rados.0.trial142.stdout:2787: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:54.632 INFO:tasks.rados.rados.0.trial142.stdout:2788: finishing write tid 1 to trial14245205-8 2026-02-17T12:02:54.632 INFO:tasks.rados.rados.0.trial142.stdout:2788: finishing write tid 2 to trial14245205-8 2026-02-17T12:02:54.632 INFO:tasks.rados.rados.0.trial142.stdout:2788: finishing write tid 3 to trial14245205-8 2026-02-17T12:02:54.632 INFO:tasks.rados.rados.0.trial142.stdout:2788: finishing write tid 4 to trial14245205-8 2026-02-17T12:02:54.632 INFO:tasks.rados.rados.0.trial142.stdout:2788: finishing write tid 5 to trial14245205-8 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: oid 8 updating version 0 to 2136 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: oid 8 updating version 2136 to 2137 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: oid 8 updating version 2137 to 2138 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: oid 8 version 2138 is already newer than 2135 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2138 (ObjNum 949 snap 310 seq_num 949) dirty exists 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: left oid 8 (ObjNum 949 snap 310 seq_num 949) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: finishing write tid 1 to trial14245205-3 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: finishing write tid 2 to trial14245205-3 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: finishing write tid 3 to trial14245205-3 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: finishing write tid 4 to trial14245205-3 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: finishing write tid 5 to trial14245205-3 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: oid 3 updating version 0 to 2139 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: oid 3 version 2139 is already newer than 2137 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: oid 3 version 2139 is already newer than 2138 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: oid 3 updating version 2139 to 2140 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2140 (ObjNum 950 snap 310 seq_num 950) dirty exists 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: left oid 3 (ObjNum 950 snap 310 seq_num 950) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2782: done (6 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2783: done (5 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2784: done (4 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2787: done (3 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2788: done (2 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2789: done (1 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2790: done (0 left) 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2791: write (excl) oid 21 current snap is 310 2026-02-17T12:02:54.633 INFO:tasks.rados.rados.0.trial142.stdout:2791: seq_num 952 ranges {400264=581173,1508740=491524} 2026-02-17T12:02:54.636 INFO:tasks.rados.rados.0.trial142.stdout:2791: writing trial14245205-21 from 400264 to 981437 tid 1 2026-02-17T12:02:54.640 INFO:tasks.rados.rados.0.trial142.stdout:2791: writing trial14245205-21 from 1508740 to 2000264 tid 2 2026-02-17T12:02:54.640 INFO:tasks.rados.rados.0.trial142.stdout:2792: write (excl) oid 14 current snap is 310 2026-02-17T12:02:54.640 INFO:tasks.rados.rados.0.trial142.stdout:2792: seq_num 953 ranges {417071=656422,1567222=449849} 2026-02-17T12:02:54.644 INFO:tasks.rados.rados.0.trial142.stdout:2792: writing trial14245205-14 from 417071 to 1073493 tid 1 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2792: writing trial14245205-14 from 1567222 to 2017071 tid 2 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2793: delete oid 8 current snap is 310 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2791: finishing write tid 1 to trial14245205-21 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2791: finishing write tid 2 to trial14245205-21 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2791: finishing write tid 3 to trial14245205-21 2026-02-17T12:02:54.649 INFO:tasks.rados.rados.0.trial142.stdout:2791: finishing write tid 4 to trial14245205-21 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2791: oid 21 updating version 0 to 1989 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2791: oid 21 version 1989 is already newer than 1988 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2791: oid 21 updating version 1989 to 1990 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1990 (ObjNum 952 snap 310 seq_num 952) dirty exists 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2791: left oid 21 (ObjNum 952 snap 310 seq_num 952) 2026-02-17T12:02:54.650 INFO:tasks.rados.rados.0.trial142.stdout:2792: finishing write tid 1 to trial14245205-14 2026-02-17T12:02:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2791: done (2 left) 2026-02-17T12:02:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2793: done (1 left) 2026-02-17T12:02:54.651 INFO:tasks.rados.rados.0.trial142.stdout:2794: write (excl) oid 7 current snap is 310 2026-02-17T12:02:54.652 INFO:tasks.rados.rados.0.trial142.stdout:2794: seq_num 955 ranges {450685=406920,1567833=482852} 2026-02-17T12:02:54.652 INFO:tasks.rados.rados.0.trial142.stdout:2794: writing trial14245205-7 from 450685 to 857605 tid 1 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2794: writing trial14245205-7 from 1567833 to 2050685 tid 2 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2795: delete oid 10 current snap is 310 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2792: finishing write tid 2 to trial14245205-14 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2792: finishing write tid 3 to trial14245205-14 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2792: finishing write tid 4 to trial14245205-14 2026-02-17T12:02:54.658 INFO:tasks.rados.rados.0.trial142.stdout:2792: oid 14 updating version 0 to 2546 2026-02-17T12:02:54.659 INFO:tasks.rados.rados.0.trial142.stdout:2792: oid 14 updating version 2546 to 2547 2026-02-17T12:02:54.659 INFO:tasks.rados.rados.0.trial142.stdout:2792: oid 14 updating version 2547 to 2548 2026-02-17T12:02:54.659 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2548 (ObjNum 953 snap 310 seq_num 953) dirty exists 2026-02-17T12:02:54.659 INFO:tasks.rados.rados.0.trial142.stdout:2792: left oid 14 (ObjNum 953 snap 310 seq_num 953) 2026-02-17T12:02:54.659 INFO:tasks.rados.rados.0.trial142.stdout:2794: finishing write tid 1 to trial14245205-7 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2792: done (2 left) 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2795: done (1 left) 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2796: rollback oid 26 current snap is 310 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 271 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2797: delete oid 49 current snap is 310 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2794: finishing write tid 2 to trial14245205-7 2026-02-17T12:02:54.661 INFO:tasks.rados.rados.0.trial142.stdout:2794: finishing write tid 3 to trial14245205-7 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: finishing write tid 4 to trial14245205-7 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: oid 7 updating version 0 to 2550 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: oid 7 updating version 2550 to 2552 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: oid 7 version 2552 is already newer than 2551 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2552 (ObjNum 955 snap 310 seq_num 955) dirty exists 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: left oid 7 (ObjNum 955 snap 310 seq_num 955) 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2794: done (2 left) 2026-02-17T12:02:54.662 INFO:tasks.rados.rados.0.trial142.stdout:2797: done (1 left) 2026-02-17T12:02:54.663 INFO:tasks.rados.rados.0.trial142.stdout:2798: snap_remove snap 304 2026-02-17T12:02:55.100 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:02:55.109 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:02:55.110 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:02:55.110 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:02:55.113 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:02:55.113 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:02:55.113 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:55.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 10 monclient: get_monmap_and_config 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 10 monclient: build_initial_monmap 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 10 monclient: monmap: 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:55.180481+0000 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:55.180481+0000 2026-02-17T12:02:55.184 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 1 Processor -- start 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 1 -- start start 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.179+0000 7fde5b58f640 10 monclient: init 2026-02-17T12:02:55.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fde5406eb80 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-b con 0x7fde540a4c10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fde5413d210 0x7fde5413f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-c con 0x7fde5413d210 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5406f9c0 con 0x7fde5406eb80 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fde5406ef60 con 0x7fde5413d210 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde5406fca0 con 0x7fde540a4c10 2026-02-17T12:02:55.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde5b58f640 10 monclient(hunting): authenticate will time out at 1662.799357s 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48454/0 (socket says 10.20.193.51:48454) 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 -- 10.20.193.51:0/3062897080 learned_addr learned my addr 10.20.193.51:0/3062897080 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 10 monclient(hunting): get_auth_request con 0x7fde540a4c10 auth_method 0 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 -- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde541385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 -- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde541385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:02:55.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 --2- 10.20.193.51:0/3062897080 >> v2:10.20.193.142:3300/0 conn(0x7fde5413d210 0x7fde5413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde58b03640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): get_auth_request con 0x7fde5413d210 auth_method 0 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient(hunting): handle_auth_done global_id 184405 payload 274 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 -- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde541385a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 -- 10.20.193.51:0/3062897080 >> v1:10.20.193.142:6789/0 conn(0x7fde5406eb80 legacy=0x7fde54137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:55.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient: _finish_hunting 0 2026-02-17T12:02:55.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 monclient: found mon.noname-c 2026-02-17T12:02:55.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:55.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:02:55.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.180+0000 7fde59b05640 1 -- 10.20.193.51:0/3062897080 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5406ff80 con 0x7fde5413d210 2026-02-17T12:02:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde59b05640 1 -- 10.20.193.51:0/3062897080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5413d210 msgr2=0x7fde5413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:55.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde59b05640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5413d210 0x7fde5413f600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde54070ed0 tx=0x7fde5002f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eafa841d1e08ca8c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 1 -- 10.20.193.51:0/3062897080 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5003c070 con 0x7fde5413d210 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: dump: 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.197 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: _finish_auth 0 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: _check_auth_tickets 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 1 -- 10.20.193.51:0/3062897080 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50037440 con 0x7fde5413d210 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 1 -- 10.20.193.51:0/3062897080 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50037810 con 0x7fde5413d210 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde5b58f640 5 monclient: authenticate success, global_id 184405 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde5b58f640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:55.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde5b58f640 4 set_mon_vals no callback set 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.183+0000 7fde43fff640 10 monclient: dump: 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:55.199 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: shutdown 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- 10.20.193.51:0/3062897080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5413d210 msgr2=0x7fde5413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5413d210 0x7fde5413f600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde54070ed0 tx=0x7fde5002f130 comp rx=0 tx=0).stop 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- 10.20.193.51:0/3062897080 shutdown_connections 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5413d210 0x7fde5413f600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- 10.20.193.51:0/3062897080 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde541385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- 10.20.193.51:0/3062897080 >> 10.20.193.51:0/3062897080 conn(0x7fde540a8c80 msgr2=0x7fde540a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- 10.20.193.51:0/3062897080 shutdown_connections 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- 10.20.193.51:0/3062897080 wait complete. 2026-02-17T12:02:55.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: build_initial_monmap 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: monmap: 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 Processor -- start 2026-02-17T12:02:55.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- start start 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: init 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5406eb80 0x7fde54071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-b con 0x7fde5406eb80 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-c con 0x7fde540a4c10 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 0x7fde54072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): picked mon.noname-a con 0x7fde5413d210 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:55.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fde5413fb40 con 0x7fde5413d210 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fde54138cf0 con 0x7fde5406eb80 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde5413fcc0 con 0x7fde540a4c10 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:55.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.184+0000 7fde5b58f640 10 monclient(hunting): authenticate will time out at 1662.803992s 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48468/0 (socket says 10.20.193.51:48468) 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 -- 10.20.193.51:0/870057200 learned_addr learned my addr 10.20.193.51:0/870057200 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 10 monclient(hunting): get_auth_request con 0x7fde540a4c10 auth_method 0 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:55.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 0x7fde54072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): get_auth_request con 0x7fde5413d210 auth_method 0 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:55.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde540723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde540723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde58b03640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:02:55.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59304640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5406eb80 0x7fde54071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59304640 10 monclient(hunting): get_auth_request con 0x7fde5406eb80 auth_method 0 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59304640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59304640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59304640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient(hunting): handle_auth_done global_id 204312 payload 824 2026-02-17T12:02:55.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 msgr2=0x7fde540723e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5406eb80 msgr2=0x7fde54071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5406eb80 0x7fde54071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient: _finish_hunting 0 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 monclient: found mon.noname-a 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:55.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.185+0000 7fde59b05640 1 -- 10.20.193.51:0/870057200 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde54074a60 con 0x7fde5413d210 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde59b05640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 msgr2=0x7fde54072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde59b05640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 0x7fde54072920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde50036000 tx=0x7fde50004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50047030 con 0x7fde5413d210 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:55.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: dump: 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:55.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.211 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:55.211 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:55.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: _finish_auth 0 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50042680 con 0x7fde5413d210 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 5 monclient: authenticate success, global_id 204312 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 10 monclient: _renew_subs 2026-02-17T12:02:55.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5409fa50 con 0x7fde5413d210 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5003c040 con 0x7fde5413d210 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde437fe640 4 set_mon_vals no callback set 2026-02-17T12:02:55.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde41ffb640 10 monclient: dump: 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:55.214 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 10 monclient: _renew_subs 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.187+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde540a28a0 con 0x7fde5413d210 2026-02-17T12:02:55.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde5b58f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde5b58f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde5b58f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fde50054060 con 0x7fde5413d210 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde54137e90 con 0x7fde5413d210 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde41ffb640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 0x7fde240401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(644..644 src has 323..644) ==== 4827+0+0 (secure 0 0 0) 0x7fde500782d0 con 0x7fde5413d210 2026-02-17T12:02:55.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde59304640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 0x7fde240401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.188+0000 7fde59304640 10 monclient: get_auth_request con 0x7fde2403dd10 auth_method 0 2026-02-17T12:02:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.190+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde50035340 con 0x7fde5413d210 2026-02-17T12:02:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.190+0000 7fde41ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.190+0000 7fde41ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:55.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.191+0000 7fde59304640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 0x7fde240401d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde44005020 tx=0x7fde44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:55.268 INFO:tasks.rados.rados.0.trial142.stdout:2798: done (1 left) 2026-02-17T12:02:55.268 INFO:tasks.rados.rados.0.trial142.stdout:2799: read oid 41 snap -1 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2799: expect (ObjNum 868 snap 272 seq_num 868) 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2800: copy_from oid 44 from oid 17 current snap is 310 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2796: finishing rollback tid 0 to trial14245205-26 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2796: finishing rollback tid 1 to trial14245205-26 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2796: finishing rollback tid 2 to trial14245205-26 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2004 (ObjNum 810 snap 254 seq_num 810) dirty exists 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2796: done (2 left) 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2801: read oid 2 snap -1 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2801: expect (ObjNum 903 snap 291 seq_num 903) 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2802: read oid 22 snap -1 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2802: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:55.269 INFO:tasks.rados.rados.0.trial142.stdout:2803: snap_remove snap 309 2026-02-17T12:02:55.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde5b58f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde5b58f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde5b58f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fde54069830 con 0x7fde5413d210 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde41ffb640 1 -- 10.20.193.51:0/870057200 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fde50076ca0 con 0x7fde5413d210 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde41ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:55.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.305+0000 7fde41ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:55.309 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 msgr2=0x7fde240401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 0x7fde240401d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde44005020 tx=0x7fde44009040 comp rx=0 tx=0).stop 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 10 monclient: shutdown 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 msgr2=0x7fde54072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 0x7fde54072920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde50036000 tx=0x7fde50004b40 comp rx=0 tx=0).stop 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 shutdown_connections 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde2403dd10 0x7fde240401d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde5413d210 0x7fde54072920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde540a4c10 0x7fde540723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 --2- 10.20.193.51:0/870057200 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde5406eb80 0x7fde54071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 >> 10.20.193.51:0/870057200 conn(0x7fde540a8c80 msgr2=0x7fde540a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 shutdown_connections 2026-02-17T12:02:55.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:55.307+0000 7fde5b58f640 1 -- 10.20.193.51:0/870057200 wait complete. 2026-02-17T12:02:56.273 INFO:tasks.rados.rados.0.trial142.stdout:2803: done (4 left) 2026-02-17T12:02:56.273 INFO:tasks.rados.rados.0.trial142.stdout:2804: read oid 28 snap -1 2026-02-17T12:02:56.273 INFO:tasks.rados.rados.0.trial142.stdout:2804: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:02:56.273 INFO:tasks.rados.rados.0.trial142.stdout:2805: snap_remove snap 306 2026-02-17T12:02:57.276 INFO:tasks.rados.rados.0.trial142.stdout:2805: done (5 left) 2026-02-17T12:02:57.276 INFO:tasks.rados.rados.0.trial142.stdout:2806: rollback oid 38 current snap is 310 2026-02-17T12:02:57.276 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 301 2026-02-17T12:02:57.276 INFO:tasks.rados.rados.0.trial142.stdout:2802: expect (ObjNum 675 snap 211 seq_num 675) 2026-02-17T12:02:57.405 INFO:tasks.rados.rados.0.trial142.stdout:2799: expect (ObjNum 868 snap 272 seq_num 868) 2026-02-17T12:02:57.489 INFO:tasks.rados.rados.0.trial142.stdout:2800: finishing copy_from racing read to trial14245205-44 2026-02-17T12:02:57.490 INFO:tasks.rados.rados.0.trial142.stdout:2801: expect (ObjNum 903 snap 291 seq_num 903) 2026-02-17T12:02:57.566 INFO:tasks.rados.rados.0.trial142.stdout:2800: finishing copy_from to trial14245205-44 2026-02-17T12:02:57.567 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 1164 (ObjNum 868 snap 272 seq_num 868) dirty exists 2026-02-17T12:02:57.567 INFO:tasks.rados.rados.0.trial142.stdout:2804: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:02:57.720 INFO:tasks.rados.rados.0.trial142.stdout:2806: finishing rollback tid 1 to trial14245205-38 2026-02-17T12:02:57.720 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:02:57.720 INFO:tasks.rados.rados.0.trial142.stdout:2799: done (5 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2800: done (4 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2801: done (3 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2802: done (2 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2804: done (1 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2806: done (0 left) 2026-02-17T12:02:57.721 INFO:tasks.rados.rados.0.trial142.stdout:2807: snap_remove snap 301 2026-02-17T12:02:58.279 INFO:tasks.rados.rados.0.trial142.stdout:2807: done (0 left) 2026-02-17T12:02:58.279 INFO:tasks.rados.rados.0.trial142.stdout:2808: write oid 8 current snap is 310 2026-02-17T12:02:58.279 INFO:tasks.rados.rados.0.trial142.stdout:2808: seq_num 958 ranges {501106=749020,1743279=357827} 2026-02-17T12:02:58.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: writing trial14245205-8 from 501106 to 1250126 tid 1 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2808: writing trial14245205-8 from 1743279 to 2101106 tid 2 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2808: finishing write tid 1 to trial14245205-8 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2809: read oid 28 snap 271 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2809: expect (ObjNum 807 snap 253 seq_num 807) 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2810: copy_from oid 34 from oid 24 current snap is 310 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2811: read oid 11 snap -1 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2811: expect deleted 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2812: write (excl) oid 49 current snap is 310 2026-02-17T12:02:58.288 INFO:tasks.rados.rados.0.trial142.stdout:2812: seq_num 959 ranges {517913=424269,1401761=446989} 2026-02-17T12:02:58.291 INFO:tasks.rados.rados.0.trial142.stdout:2812: writing trial14245205-49 from 517913 to 942182 tid 1 2026-02-17T12:02:58.296 INFO:tasks.rados.rados.0.trial142.stdout:2812: writing trial14245205-49 from 1401761 to 1848750 tid 2 2026-02-17T12:02:58.296 INFO:tasks.rados.rados.0.trial142.stdout:2813: snap_remove snap 294 2026-02-17T12:02:58.318 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 10 monclient: get_monmap_and_config 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 10 monclient: build_initial_monmap 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 10 monclient: monmap: 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:02:58.384371+0000 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:02:58.384371+0000 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:02:58.385 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:02:58.386 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:02:58.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 1 Processor -- start 2026-02-17T12:02:58.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 1 -- start start 2026-02-17T12:02:58.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.383+0000 7fde52546640 10 monclient: init 2026-02-17T12:02:58.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:58.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fde4c0a3bb0 0x7fde4c09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): picked mon.noname-c con 0x7fde4c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fde4c09d270 0x7fde4c138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): picked mon.noname-a con 0x7fde4c09d270 addr v2:10.20.193.51:3300/0 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fde4c1385b0 addr v1:10.20.193.142:6789/0 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4c135430 con 0x7fde4c1385b0 2026-02-17T12:02:58.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fde4c09a5c0 con 0x7fde4c09d270 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fde4c09b520 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde52546640 10 monclient(hunting): authenticate will time out at 1666.003136s 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fde4c09d270 0x7fde4c138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fde4c09d270 0x7fde4c138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41970/0 (socket says 10.20.193.51:41970) 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4226104652 learned_addr learned my addr 10.20.193.51:0/4226104652 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): get_auth_request con 0x7fde4c09d270 auth_method 0 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:58.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4bfff640 1 --2- 10.20.193.51:0/4226104652 >> v2:10.20.193.142:3300/0 conn(0x7fde4c0a3bb0 0x7fde4c09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4bfff640 10 monclient(hunting): get_auth_request con 0x7fde4c0a3bb0 auth_method 0 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_done global_id 204315 payload 274 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4226104652 >> v2:10.20.193.142:3300/0 conn(0x7fde4c0a3bb0 msgr2=0x7fde4c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:58.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 --2- 10.20.193.51:0/4226104652 >> v2:10.20.193.142:3300/0 conn(0x7fde4c0a3bb0 0x7fde4c09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4226104652 >> v1:10.20.193.142:6789/0 conn(0x7fde4c1385b0 legacy=0x7fde4c13f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.384+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4226104652 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c09af60 con 0x7fde4c09d270 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4226104652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c09d270 msgr2=0x7fde4c138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4b7fe640 1 --2- 10.20.193.51:0/4226104652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c09d270 0x7fde4c138070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0694e0 tx=0x7fde3c02edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de8cec8871e28da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 1 -- 10.20.193.51:0/4226104652 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03c070 con 0x7fde4c09d270 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:58.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: dump: 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: _finish_auth 0 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: _check_auth_tickets 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde52546640 5 monclient: authenticate success, global_id 204315 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 1 -- 10.20.193.51:0/4226104652 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c02fc70 con 0x7fde4c09d270 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 1 -- 10.20.193.51:0/4226104652 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c037660 con 0x7fde4c09d270 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde4affd640 10 monclient: dump: 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:58.404 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.386+0000 7fde52546640 10 monclient: get_monmap_and_config success 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 4 set_mon_vals no callback set 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 10 monclient: shutdown 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:58.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 -- 10.20.193.51:0/4226104652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c09d270 msgr2=0x7fde4c138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 --2- 10.20.193.51:0/4226104652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c09d270 0x7fde4c138070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0694e0 tx=0x7fde3c02edf0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 -- 10.20.193.51:0/4226104652 shutdown_connections 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 --2- 10.20.193.51:0/4226104652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c09d270 0x7fde4c138070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 --2- 10.20.193.51:0/4226104652 >> v2:10.20.193.142:3300/0 conn(0x7fde4c0a3bb0 0x7fde4c09cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 -- 10.20.193.51:0/4226104652 >> 10.20.193.51:0/4226104652 conn(0x7fde4c0a30c0 msgr2=0x7fde4c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 -- 10.20.193.51:0/4226104652 shutdown_connections 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 -- 10.20.193.51:0/4226104652 wait complete. 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 10 monclient: build_initial_monmap 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 10 monclient: monmap: 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:02:58.406 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.387+0000 7fde52546640 1 Processor -- start 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 -- start start 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient: init 2026-02-17T12:02:58.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient: _reopen_session rank -1 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4c09d270 0x7fde4c1cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): picked mon.noname-b con 0x7fde4c09d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): picked mon.noname-a con 0x7fde4c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde4c1385b0 0x7fde4c1cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): picked mon.noname-c con 0x7fde4c1385b0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c074ac0 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c0a3f90 con 0x7fde4c09d270 2026-02-17T12:02:58.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): start opening mon connection 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde4c135040 con 0x7fde4c1385b0 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): _renew_subs 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde52546640 10 monclient(hunting): authenticate will time out at 1666.007262s 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41980/0 (socket says 10.20.193.51:41980) 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4112756569 learned_addr learned my addr 10.20.193.51:0/4112756569 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): get_auth_request con 0x7fde4c0a3bb0 auth_method 0 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:02:58.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde50abc640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde4c1385b0 0x7fde4c1cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde50abc640 10 monclient(hunting): get_auth_request con 0x7fde4c1385b0 auth_method 0 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde50abc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde50abc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde50abc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4bfff640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4c09d270 0x7fde4c1cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4bfff640 10 monclient(hunting): get_auth_request con 0x7fde4c09d270 auth_method 0 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:02:58.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient(hunting): handle_auth_done global_id 204318 payload 824 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde4c1385b0 msgr2=0x7fde4c1cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde4c1385b0 0x7fde4c1cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4c09d270 msgr2=0x7fde4c1cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4c09d270 0x7fde4c1cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.388+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4112756569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c131350 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde4b7fe640 1 -- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 msgr2=0x7fde4c1cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:02:58.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde4b7fe640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009a40 tx=0x7fde3c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c047070 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: dump: 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:58.412 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: _finish_auth 0 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c03f590 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 5 monclient: authenticate success, global_id 204318 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 10 monclient: _renew_subs 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c09d7b0 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:02:58.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03c040 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde4a7fc640 4 set_mon_vals no callback set 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde48ff9640 10 monclient: dump: 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:02:58.414 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 10 monclient: _renew_subs 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.390+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c131070 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde52546640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde52546640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde52546640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fde3c03f9c0 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4c0a3800 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde48ff9640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 0x7fde1c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:02:58.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(648..648 src has 323..648) ==== 4843+0+0 (secure 0 0 0) 0x7fde3c077410 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde4bfff640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 0x7fde1c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.391+0000 7fde4bfff640 10 monclient: get_auth_request con 0x7fde1c03dd10 auth_method 0 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.393+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde4c0a3800 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.393+0000 7fde48ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.393+0000 7fde48ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:02:58.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.394+0000 7fde4bfff640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 0x7fde1c0401d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fde380099b0 tx=0x7fde38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.507+0000 7fde52546640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.507+0000 7fde52546640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.507+0000 7fde52546640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.507+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fde4c133e00 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde48ff9640 1 -- 10.20.193.51:0/4112756569 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fde4c133e00 con 0x7fde4c0a3bb0 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde48ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:02:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde48ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:02:58.511 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:02:58.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 msgr2=0x7fde1c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:58.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 0x7fde1c0401d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fde380099b0 tx=0x7fde38008040 comp rx=0 tx=0).stop 2026-02-17T12:02:58.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 10 monclient: shutdown 2026-02-17T12:02:58.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:02:58.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 msgr2=0x7fde4c1cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009a40 tx=0x7fde3c004830 comp rx=0 tx=0).stop 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 shutdown_connections 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde1c03dd10 0x7fde1c0401d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde4c1385b0 0x7fde4c1cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde4c0a3bb0 0x7fde4c1cef90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 --2- 10.20.193.51:0/4112756569 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde4c09d270 0x7fde4c1cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 >> 10.20.193.51:0/4112756569 conn(0x7fde4c0a30c0 msgr2=0x7fde4c132cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 shutdown_connections 2026-02-17T12:02:58.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:02:58.508+0000 7fde52546640 1 -- 10.20.193.51:0/4112756569 wait complete. 2026-02-17T12:02:59.253 INFO:tasks.rados.rados.0.trial142.stdout:2813: done (5 left) 2026-02-17T12:02:59.254 INFO:tasks.rados.rados.0.trial142.stdout:2814: read oid 5 snap 305 2026-02-17T12:02:59.254 INFO:tasks.rados.rados.0.trial142.stdout:2814: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:02:59.254 INFO:tasks.rados.rados.0.trial142.stdout:2815: snap_remove snap 293 2026-02-17T12:03:00.257 INFO:tasks.rados.rados.0.trial142.stdout:2815: done (6 left) 2026-02-17T12:03:00.257 INFO:tasks.rados.rados.0.trial142.stdout:2816: write oid 20 current snap is 310 2026-02-17T12:03:00.257 INFO:tasks.rados.rados.0.trial142.stdout:2816: seq_num 960 ranges {534720=499518,1460243=674477} 2026-02-17T12:03:00.261 INFO:tasks.rados.rados.0.trial142.stdout:2816: writing trial14245205-20 from 534720 to 1034238 tid 1 2026-02-17T12:03:00.266 INFO:tasks.rados.rados.0.trial142.stdout:2816: writing trial14245205-20 from 1460243 to 2134720 tid 2 2026-02-17T12:03:00.266 INFO:tasks.rados.rados.0.trial142.stdout:2817: write (excl) oid 42 current snap is 310 2026-02-17T12:03:00.266 INFO:tasks.rados.rados.0.trial142.stdout:2817: seq_num 961 ranges {551527=574767,1918725=232802} 2026-02-17T12:03:00.270 INFO:tasks.rados.rados.0.trial142.stdout:2817: writing trial14245205-42 from 551527 to 1126294 tid 1 2026-02-17T12:03:00.275 INFO:tasks.rados.rados.0.trial142.stdout:2817: writing trial14245205-42 from 1918725 to 2151527 tid 2 2026-02-17T12:03:00.275 INFO:tasks.rados.rados.0.trial142.stdout:2818: write oid 15 current snap is 310 2026-02-17T12:03:00.275 INFO:tasks.rados.rados.0.trial142.stdout:2808: finishing write tid 2 to trial14245205-8 2026-02-17T12:03:00.275 INFO:tasks.rados.rados.0.trial142.stdout:2808: finishing write tid 3 to trial14245205-8 2026-02-17T12:03:00.275 INFO:tasks.rados.rados.0.trial142.stdout:2818: seq_num 962 ranges {568334=650016,1860854=307480} 2026-02-17T12:03:00.279 INFO:tasks.rados.rados.0.trial142.stdout:2818: writing trial14245205-15 from 568334 to 1218350 tid 1 2026-02-17T12:03:00.283 INFO:tasks.rados.rados.0.trial142.stdout:2818: writing trial14245205-15 from 1860854 to 2168334 tid 2 2026-02-17T12:03:00.283 INFO:tasks.rados.rados.0.trial142.stdout:2811: done (8 left) 2026-02-17T12:03:00.283 INFO:tasks.rados.rados.0.trial142.stdout:2819: copy_from oid 19 from oid 25 current snap is 310 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: finishing write tid 4 to trial14245205-8 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: oid 8 updating version 0 to 2140 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: oid 8 updating version 2140 to 2141 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: oid 8 updating version 2141 to 2142 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2142 (ObjNum 958 snap 310 seq_num 958) dirty exists 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2808: left oid 8 (ObjNum 958 snap 310 seq_num 958) 2026-02-17T12:03:00.284 INFO:tasks.rados.rados.0.trial142.stdout:2809: expect (ObjNum 807 snap 253 seq_num 807) 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2810: finishing copy_from racing read to trial14245205-34 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2812: finishing write tid 1 to trial14245205-49 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2808: done (8 left) 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2809: done (7 left) 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2820: read oid 29 snap -1 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2820: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:03:00.397 INFO:tasks.rados.rados.0.trial142.stdout:2821: read oid 32 snap -1 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2821: expect (ObjNum 935 snap 303 seq_num 935) 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2822: rollback oid 41 current snap is 310 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 41 to 303 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2810: finishing copy_from to trial14245205-34 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 1607 (ObjNum 748 snap 236 seq_num 748) dirty exists 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: finishing write tid 2 to trial14245205-49 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: finishing write tid 3 to trial14245205-49 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: finishing write tid 4 to trial14245205-49 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: oid 49 updating version 0 to 2591 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: oid 49 updating version 2591 to 2592 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:2812: oid 49 updating version 2592 to 2593 2026-02-17T12:03:00.398 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2593 (ObjNum 959 snap 310 seq_num 959) dirty exists 2026-02-17T12:03:00.399 INFO:tasks.rados.rados.0.trial142.stdout:2812: left oid 49 (ObjNum 959 snap 310 seq_num 959) 2026-02-17T12:03:00.399 INFO:tasks.rados.rados.0.trial142.stdout:2814: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: finishing write tid 1 to trial14245205-20 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: finishing write tid 2 to trial14245205-20 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: finishing write tid 3 to trial14245205-20 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: finishing write tid 4 to trial14245205-20 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: oid 20 updating version 0 to 2134 2026-02-17T12:03:00.543 INFO:tasks.rados.rados.0.trial142.stdout:2816: oid 20 updating version 2134 to 2136 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2816: oid 20 version 2136 is already newer than 2135 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2136 (ObjNum 960 snap 310 seq_num 960) dirty exists 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2816: left oid 20 (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2817: finishing write tid 1 to trial14245205-42 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2817: finishing write tid 2 to trial14245205-42 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2810: done (9 left) 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2812: done (8 left) 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2814: done (7 left) 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2816: done (6 left) 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2823: rollback oid 26 current snap is 310 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 26 to 305 2026-02-17T12:03:00.544 INFO:tasks.rados.rados.0.trial142.stdout:2817: finishing write tid 3 to trial14245205-42 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2817: finishing write tid 4 to trial14245205-42 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2817: oid 42 updating version 0 to 2137 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2817: oid 42 updating version 2137 to 2139 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2817: oid 42 version 2139 is already newer than 2138 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2817: left oid 42 (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: finishing write tid 1 to trial14245205-15 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: finishing write tid 2 to trial14245205-15 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: finishing write tid 3 to trial14245205-15 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: finishing write tid 4 to trial14245205-15 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: oid 15 updating version 0 to 2143 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: oid 15 updating version 2143 to 2144 2026-02-17T12:03:00.545 INFO:tasks.rados.rados.0.trial142.stdout:2818: oid 15 updating version 2144 to 2145 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2145 (ObjNum 962 snap 310 seq_num 962) dirty exists 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2818: left oid 15 (ObjNum 962 snap 310 seq_num 962) 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2819: finishing copy_from racing read to trial14245205-19 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2819: finishing copy_from to trial14245205-19 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 1993 (ObjNum 908 snap 292 seq_num 908) dirty exists 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2822: finishing rollback tid 0 to trial14245205-41 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2822: finishing rollback tid 1 to trial14245205-41 2026-02-17T12:03:00.546 INFO:tasks.rados.rados.0.trial142.stdout:2821: expect (ObjNum 935 snap 303 seq_num 935) 2026-02-17T12:03:00.743 INFO:tasks.rados.rados.0.trial142.stdout:2820: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:03:00.916 INFO:tasks.rados.rados.0.trial142.stdout:2822: finishing rollback tid 2 to trial14245205-41 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2823: finishing rollback tid 0 to trial14245205-26 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2823: finishing rollback tid 1 to trial14245205-26 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2817: done (6 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2818: done (5 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2819: done (4 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2820: done (3 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2821: done (2 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2822: done (1 left) 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2824: write oid 18 current snap is 310 2026-02-17T12:03:00.917 INFO:tasks.rados.rados.0.trial142.stdout:2823: finishing rollback tid 2 to trial14245205-26 2026-02-17T12:03:00.918 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2007 (ObjNum 921 snap 299 seq_num 921) dirty exists 2026-02-17T12:03:00.918 INFO:tasks.rados.rados.0.trial142.stdout:2824: seq_num 963 ranges {585141=725265,1919336=265805} 2026-02-17T12:03:00.921 INFO:tasks.rados.rados.0.trial142.stdout:2824: writing trial14245205-18 from 585141 to 1310406 tid 1 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2824: writing trial14245205-18 from 1919336 to 2185141 tid 2 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2823: done (1 left) 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2825: read oid 42 snap -1 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2825: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2826: write oid 38 current snap is 310 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2824: finishing write tid 1 to trial14245205-18 2026-02-17T12:03:00.925 INFO:tasks.rados.rados.0.trial142.stdout:2826: seq_num 964 ranges {601948=400514,1577818=624130} 2026-02-17T12:03:00.928 INFO:tasks.rados.rados.0.trial142.stdout:2826: writing trial14245205-38 from 601948 to 1002462 tid 1 2026-02-17T12:03:00.933 INFO:tasks.rados.rados.0.trial142.stdout:2826: writing trial14245205-38 from 1577818 to 2201948 tid 2 2026-02-17T12:03:00.933 INFO:tasks.rados.rados.0.trial142.stdout:2827: rollback oid 11 current snap is 310 2026-02-17T12:03:00.933 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 271 2026-02-17T12:03:00.933 INFO:tasks.rados.rados.0.trial142.stdout:2824: finishing write tid 2 to trial14245205-18 2026-02-17T12:03:00.933 INFO:tasks.rados.rados.0.trial142.stdout:2824: finishing write tid 3 to trial14245205-18 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2824: finishing write tid 4 to trial14245205-18 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2824: oid 18 updating version 0 to 2623 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2824: oid 18 updating version 2623 to 2624 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2824: oid 18 version 2624 is already newer than 2622 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2624 (ObjNum 963 snap 310 seq_num 963) dirty exists 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2824: left oid 18 (ObjNum 963 snap 310 seq_num 963) 2026-02-17T12:03:00.934 INFO:tasks.rados.rados.0.trial142.stdout:2825: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:2826: finishing write tid 1 to trial14245205-38 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:2827: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:2827: finishing rollback tid 2 to trial14245205-11 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1133 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:2826: finishing write tid 2 to trial14245205-38 2026-02-17T12:03:00.998 INFO:tasks.rados.rados.0.trial142.stdout:2826: finishing write tid 3 to trial14245205-38 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2824: done (3 left) 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2825: done (2 left) 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2827: done (1 left) 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2828: snap_create 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2826: finishing write tid 4 to trial14245205-38 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2826: oid 38 updating version 0 to 1991 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2826: oid 38 version 1991 is already newer than 1990 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2826: oid 38 updating version 1991 to 1992 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1992 (ObjNum 964 snap 310 seq_num 964) dirty exists 2026-02-17T12:03:00.999 INFO:tasks.rados.rados.0.trial142.stdout:2826: left oid 38 (ObjNum 964 snap 310 seq_num 964) 2026-02-17T12:03:01.518 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:01.553 INFO:tasks.rados.rados.0.trial142.stdout:2826: done (1 left) 2026-02-17T12:03:01.553 INFO:tasks.rados.rados.0.trial142.stdout:2828: done (0 left) 2026-02-17T12:03:01.553 INFO:tasks.rados.rados.0.trial142.stdout:2829: read oid 19 snap -1 2026-02-17T12:03:01.554 INFO:tasks.rados.rados.0.trial142.stdout:2829: expect (ObjNum 908 snap 292 seq_num 908) 2026-02-17T12:03:01.554 INFO:tasks.rados.rados.0.trial142.stdout:2830: read oid 30 snap -1 2026-02-17T12:03:01.554 INFO:tasks.rados.rados.0.trial142.stdout:2830: expect deleted 2026-02-17T12:03:01.554 INFO:tasks.rados.rados.0.trial142.stdout:2831: snap_remove snap 303 2026-02-17T12:03:01.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 10 monclient: get_monmap_and_config 2026-02-17T12:03:01.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 10 monclient: monmap: 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:01.587415+0000 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:01.587415+0000 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:01.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 1 Processor -- start 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 1 -- start start 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.586+0000 7fb330e00640 10 monclient: init 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb32c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb32c0a0750 0x7fb32c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-c con 0x7fb32c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb32c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c06e140 con 0x7fb32c13b760 2026-02-17T12:03:01.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c09f910 con 0x7fb32c0a3bb0 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb32c09ccd0 con 0x7fb32c0a0750 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb330e00640 10 monclient(hunting): authenticate will time out at 1669.206182s 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb32ad76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb32c13b760 0x7fb32c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39892/0 (socket says 10.20.193.51:39892) 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb32ad76640 1 -- 10.20.193.51:0/1930232450 learned_addr learned my addr 10.20.193.51:0/1930232450 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 1 --2- 10.20.193.51:0/1930232450 >> v2:10.20.193.142:3300/0 conn(0x7fb32c0a0750 0x7fb32c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): get_auth_request con 0x7fb32c0a0750 auth_method 0 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient(hunting): handle_auth_done global_id 184417 payload 274 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 1 -- 10.20.193.51:0/1930232450 >> v1:10.20.193.142:6789/0 conn(0x7fb32c0a3bb0 legacy=0x7fb32c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 1 -- 10.20.193.51:0/1930232450 >> v1:10.20.193.51:6789/0 conn(0x7fb32c13b760 legacy=0x7fb32c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 1 monclient: found mon.noname-c 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:03:01.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.587+0000 7fb329d74640 1 -- 10.20.193.51:0/1930232450 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c09eec0 con 0x7fb32c0a0750 2026-02-17T12:03:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329d74640 1 -- 10.20.193.51:0/1930232450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 msgr2=0x7fb32c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329d74640 1 --2- 10.20.193.51:0/1930232450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c09e1d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb3140098a0 tx=0x7fb31402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44527b9af519587c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 1 -- 10.20.193.51:0/1930232450 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31403c070 con 0x7fb32c0a0750 2026-02-17T12:03:01.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: dump: 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 1 -- 10.20.193.51:0/1930232450 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31402fce0 con 0x7fb32c0a0750 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 1 -- 10.20.193.51:0/1930232450 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037660 con 0x7fb32c0a0750 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb329573640 10 monclient: dump: 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.603 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 5 monclient: authenticate success, global_id 184417 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 4 set_mon_vals no callback set 2026-02-17T12:03:01.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 10 monclient: shutdown 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 -- 10.20.193.51:0/1930232450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 msgr2=0x7fb32c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 --2- 10.20.193.51:0/1930232450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c09e1d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb3140098a0 tx=0x7fb31402ed80 comp rx=0 tx=0).stop 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 -- 10.20.193.51:0/1930232450 shutdown_connections 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 --2- 10.20.193.51:0/1930232450 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c09e1d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 -- 10.20.193.51:0/1930232450 >> 10.20.193.51:0/1930232450 conn(0x7fb32c0a30c0 msgr2=0x7fb32c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 -- 10.20.193.51:0/1930232450 shutdown_connections 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.590+0000 7fb330e00640 1 -- 10.20.193.51:0/1930232450 wait complete. 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient: monmap: 2026-02-17T12:03:01.605 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 Processor -- start 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 -- start start 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient: init 2026-02-17T12:03:01.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c1cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-b con 0x7fb32c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-c con 0x7fb32c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): picked mon.noname-a con 0x7fb32c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c0a04b0 con 0x7fb32c13b760 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c09c850 con 0x7fb32c0a0750 2026-02-17T12:03:01.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c09e710 con 0x7fb32c0a3bb0 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb330e00640 10 monclient(hunting): authenticate will time out at 1669.210570s 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41990/0 (socket says 10.20.193.51:41990) 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 -- 10.20.193.51:0/473417910 learned_addr learned my addr 10.20.193.51:0/473417910 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): get_auth_request con 0x7fb32c13b760 auth_method 0 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 10 monclient(hunting): get_auth_request con 0x7fb32c0a3bb0 auth_method 0 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 msgr2=0x7fb32c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 msgr2=0x7fb32c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb329d74640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:01.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient(hunting): handle_auth_done global_id 204321 payload 824 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 msgr2=0x7fb32c09a5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32a575640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c1cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 msgr2=0x7fb32c1cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c1cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 monclient: found mon.noname-a 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32ad76640 1 -- 10.20.193.51:0/473417910 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c06f6c0 con 0x7fb32c13b760 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32a575640 10 monclient: get_auth_request con 0x7fb32c0a0750 auth_method 0 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.591+0000 7fb32a575640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c1cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:01.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.593+0000 7fb32ad76640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 msgr2=0x7fb32c09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.593+0000 7fb32ad76640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00caf0 tx=0x7fb31c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c017070 con 0x7fb32c13b760 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: dump: 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.611 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 5 monclient: authenticate success, global_id 204321 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _renew_subs 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c00adf0 con 0x7fb32c13b760 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c0a28c0 con 0x7fb32c13b760 2026-02-17T12:03:01.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c012640 con 0x7fb32c13b760 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb328d72640 4 set_mon_vals no callback set 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 10 monclient: dump: 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _renew_subs 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c133e60 con 0x7fb32c13b760 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb31c01b3b0 con 0x7fb32c13b760 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c09dac0 con 0x7fb32c13b760 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.594+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(651..651 src has 323..651) ==== 4799+0+0 (secure 0 0 0) 0x7fb31c052560 con 0x7fb32c13b760 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.595+0000 7fb32a575640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.595+0000 7fb32a575640 10 monclient: get_auth_request con 0x7fb2f803dd10 auth_method 0 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.597+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb31c050f50 con 0x7fb32c13b760 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.597+0000 7fb312ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.597+0000 7fb312ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:01.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.597+0000 7fb32a575640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb320004020 tx=0x7fb320009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb330e00640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb330e00640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb330e00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb32c1335c0 con 0x7fb32c13b760 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb312ffd640 1 -- 10.20.193.51:0/473417910 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fb31c0546e0 con 0x7fb32c13b760 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb312ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.712+0000 7fb312ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:01.714 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 msgr2=0x7fb2f80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb320004020 tx=0x7fb320009040 comp rx=0 tx=0).stop 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 10 monclient: shutdown 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 msgr2=0x7fb32c09ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.713+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00caf0 tx=0x7fb31c005c50 comp rx=0 tx=0).stop 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 shutdown_connections 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32c13b760 0x7fb32c09ab00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb32c0a3bb0 0x7fb32c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 --2- 10.20.193.51:0/473417910 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32c0a0750 0x7fb32c1cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 >> 10.20.193.51:0/473417910 conn(0x7fb32c0a30c0 msgr2=0x7fb32c072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:01.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 shutdown_connections 2026-02-17T12:03:01.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.714+0000 7fb330e00640 1 -- 10.20.193.51:0/473417910 wait complete. 2026-02-17T12:03:01.723 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:03:01.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:03:01.723 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.790+0000 7f7b312ca640 10 monclient: get_monmap_and_config 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.790+0000 7f7b312ca640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.790+0000 7f7b312ca640 10 monclient: monmap: 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:01.791558+0000 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:01.791558+0000 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:01.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 Processor -- start 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 -- start start 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient: init 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7b2c09e370 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-b con 0x7f7b2c09aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b2c139950 0x7f7b2c13bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-a con 0x7f7b2c139950 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0a0980 con 0x7f7b2c09e370 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c09d600 con 0x7f7b2c139950 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c06d8e0 con 0x7f7b2c09aa50 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b312ca640 10 monclient(hunting): authenticate will time out at 1669.410516s 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b2c139950 0x7f7b2c13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:48506/0 (socket says 10.20.193.51:48506) 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7b2c139950 0x7f7b2c13bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42004/0 (socket says 10.20.193.51:42004) 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/136303743 learned_addr learned my addr 10.20.193.51:0/136303743 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b2c09aa50 auth_method 0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b2c139950 auth_method 0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c09ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c09ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2a7fc640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient(hunting): handle_auth_done global_id 204324 payload 274 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c09ee60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/136303743 >> v1:10.20.193.142:6789/0 conn(0x7f7b2c09e370 legacy=0x7f7b2c09e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.791+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/136303743 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c09ff30 con 0x7f7b2c139950 2026-02-17T12:03:01.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c139950 msgr2=0x7f7b2c13bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b2b7fe640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c139950 0x7f7b2c13bd40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009d90 tx=0x7f7b1c02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4dab82cb3ad0d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 1 -- 10.20.193.51:0/136303743 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c03c070 con 0x7f7b2c139950 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: dump: 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 1 -- 10.20.193.51:0/136303743 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c037440 con 0x7f7b2c139950 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 5 monclient: authenticate success, global_id 204324 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 1 -- 10.20.193.51:0/136303743 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c037810 con 0x7f7b2c139950 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 4 set_mon_vals no callback set 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b29ffb640 10 monclient: dump: 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 10 monclient: shutdown 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 -- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c139950 msgr2=0x7f7b2c13bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c139950 0x7f7b2c13bd40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009d90 tx=0x7f7b1c02f190 comp rx=0 tx=0).stop 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 -- 10.20.193.51:0/136303743 shutdown_connections 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c139950 0x7f7b2c13bd40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 --2- 10.20.193.51:0/136303743 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c09ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 -- 10.20.193.51:0/136303743 >> 10.20.193.51:0/136303743 conn(0x7f7b2c0a30c0 msgr2=0x7f7b2c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 -- 10.20.193.51:0/136303743 shutdown_connections 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.794+0000 7f7b312ca640 1 -- 10.20.193.51:0/136303743 wait complete. 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient: monmap: 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 Processor -- start 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 -- start start 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient: init 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c1cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-c con 0x7f7b2c09aa50 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 0x7f7b2c1cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-a con 0x7f7b2c09e370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b2c139950 0x7f7b2c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): picked mon.noname-b con 0x7f7b2c139950 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0a3e20 con 0x7f7b2c09e370 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c06e140 con 0x7f7b2c139950 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0a3fa0 con 0x7f7b2c09aa50 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b312ca640 10 monclient(hunting): authenticate will time out at 1669.414780s 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 0x7f7b2c1cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c1cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 0x7f7b2c1cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42012/0 (socket says 10.20.193.51:42012) 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/144803742 learned_addr learned my addr 10.20.193.51:0/144803742 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b2c09e370 auth_method 0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 10 monclient(hunting): get_auth_request con 0x7f7b2c09aa50 auth_method 0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b2c139950 0x7f7b2c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c1cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c1cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c1cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.795+0000 7f7b2b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b2c139950 auth_method 0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c1cd590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 10 monclient(hunting): handle_auth_done global_id 204327 payload 824 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 msgr2=0x7f7b2c1cd590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7b2c09aa50 0x7f7b2c1cd590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b2c139950 msgr2=0x7f7b2c072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7b2c139950 0x7f7b2c072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 monclient: found mon.noname-a 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.796+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c099ab0 con 0x7f7b2c09e370 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b2a7fc640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 msgr2=0x7f7b2c1cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b2a7fc640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 0x7f7b2c1cdad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d830 tx=0x7f7b1400dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14018030 con 0x7f7b2c09e370 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:01.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: dump: 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1400bae0 con 0x7f7b2c09e370 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 5 monclient: authenticate success, global_id 204327 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 monclient: _renew_subs 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c08fb60 con 0x7f7b2c09e370 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400bcd0 con 0x7f7b2c09e370 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b0b7fe640 10 monclient: dump: 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b297fa640 4 set_mon_vals no callback set 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 monclient: _renew_subs 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c09d7b0 con 0x7f7b2c09e370 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 0x7f7b2c073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.798+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c09dcc0 con 0x7f7b2c0733b0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 0x7f7b2c073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient: get_auth_request con 0x7f7b2c0733b0 auth_method 0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7b14013050 con 0x7f7b2c09e370 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 10 monclient(hunting): handle_auth_done global_id 204330 payload 824 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b2c069830 con 0x7f7b2c0733b0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b0b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7af803dd10 0x7f7af80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(651..651 src has 323..651) ==== 4799+0+0 (secure 0 0 0) 0x7f7b14052710 con 0x7f7b2c09e370 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7af803dd10 0x7f7af80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.799+0000 7f7b2b7fe640 10 monclient: get_auth_request con 0x7f7af803dd10 auth_method 0 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 msgr2=0x7f7b2c073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 0x7f7b2c073790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007d50 tx=0x7f7b2000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20006ae0 con 0x7f7b2c0733b0 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 10 monclient: dump: 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7b20006ae0 con 0x7f7b2c0733b0 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 msgr2=0x7f7b2c073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 0x7f7b2c073790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007d50 tx=0x7f7b2000eba0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 msgr2=0x7f7b2c073790 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.801+0000 7f7b0b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c0733b0 0x7f7b2c073790 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007d50 tx=0x7f7b2000eba0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.802+0000 7f7b2b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7af803dd10 0x7f7af80401d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c06c1c0 tx=0x7f7b1c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b312ca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b312ca640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 0x7f7b2c1d8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b312ca640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c08f380 con 0x7f7b2c073cd0 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 0x7f7b2c1d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient: get_auth_request con 0x7f7b2c073cd0 auth_method 0 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 10 monclient(hunting): handle_auth_done global_id 204333 payload 824 2026-02-17T12:03:01.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.804+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b2c050ac0 con 0x7f7b2c073cd0 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.806+0000 7f7b2affd640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 msgr2=0x7f7b2c1d8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.806+0000 7f7b2affd640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 0x7f7b2c1d8590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b20018000 tx=0x7f7b20003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20003230 con 0x7f7b2c073cd0 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 10 monclient: dump: 2026-02-17T12:03:01.808 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f7b20003230 con 0x7f7b2c073cd0 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 msgr2=0x7f7b2c1d8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 0x7f7b2c1d8590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b20018000 tx=0x7f7b20003860 comp rx=0 tx=0).stop 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 msgr2=0x7f7b2c1d8590 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b0b7fe640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c073cd0 0x7f7b2c1d8590 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b20018000 tx=0x7f7b20003860 comp rx=0 tx=0).stop 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 122573, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:01.809 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:01.810 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:01.811 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:01.812 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:01.813 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7af803dd10 msgr2=0x7f7af80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7af803dd10 0x7f7af80401d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c06c1c0 tx=0x7f7b1c033000 comp rx=0 tx=0).stop 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 10 monclient: shutdown 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 msgr2=0x7f7b2c1cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 --2- 10.20.193.51:0/144803742 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7b2c09e370 0x7f7b2c1cdad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d830 tx=0x7f7b1400dd00 comp rx=0 tx=0).stop 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/144803742 reap_dead start 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b2b7fe640 1 -- 10.20.193.51:0/144803742 reap_dead start 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 shutdown_connections 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 >> 10.20.193.51:0/144803742 conn(0x7f7b2c0a30c0 msgr2=0x7f7b2c13c230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 shutdown_connections 2026-02-17T12:03:01.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.807+0000 7f7b312ca640 1 -- 10.20.193.51:0/144803742 wait complete. 2026-02-17T12:03:01.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:01.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:03:01.815 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 10 monclient: get_monmap_and_config 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 10 monclient: monmap: 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:01.880445+0000 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:01.880445+0000 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:01.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 1 Processor -- start 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 1 -- start start 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.879+0000 7f740c4bf640 10 monclient: init 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74040a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:01.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74040a0750 0x7f740409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-a con 0x7f74040a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f740413b760 0x7f740413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-c con 0x7f740413b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f740406e140 con 0x7f74040a3bb0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f740409f910 con 0x7f74040a0750 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f740409ccd0 con 0x7f740413b760 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f740c4bf640 10 monclient(hunting): authenticate will time out at 1669.499211s 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74040a0750 0x7f740409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f74040a0750 0x7f740409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42032/0 (socket says 10.20.193.51:42032) 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 -- 10.20.193.51:0/2200909256 learned_addr learned my addr 10.20.193.51:0/2200909256 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): get_auth_request con 0x7f74040a0750 auth_method 0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient(hunting): handle_auth_done global_id 204336 payload 274 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 -- 10.20.193.51:0/2200909256 >> v2:10.20.193.142:3300/0 conn(0x7f740413b760 msgr2=0x7f740413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 --2- 10.20.193.51:0/2200909256 >> v2:10.20.193.142:3300/0 conn(0x7f740413b760 0x7f740413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 -- 10.20.193.51:0/2200909256 >> v1:10.20.193.142:6789/0 conn(0x7f74040a3bb0 legacy=0x7f740409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 monclient: found mon.noname-a 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.880+0000 7f7409a33640 1 -- 10.20.193.51:0/2200909256 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740409eec0 con 0x7f74040a0750 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409a33640 1 -- 10.20.193.51:0/2200909256 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74040a0750 msgr2=0x7f740409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409a33640 1 --2- 10.20.193.51:0/2200909256 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74040a0750 0x7f740409e1d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f740409f5f0 tx=0x7f73f802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57f8b001b02eb8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409232640 1 -- 10.20.193.51:0/2200909256 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f803c070 con 0x7f74040a0750 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409232640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409232640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.882+0000 7f7409232640 10 monclient: dump: 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.884 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 1 -- 10.20.193.51:0/2200909256 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f802fd80 con 0x7f74040a0750 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 5 monclient: authenticate success, global_id 204336 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 1 -- 10.20.193.51:0/2200909256 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8037660 con 0x7f74040a0750 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f7409232640 10 monclient: dump: 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:01.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 4 set_mon_vals no callback set 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 10 monclient: shutdown 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 -- 10.20.193.51:0/2200909256 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74040a0750 msgr2=0x7f740409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 --2- 10.20.193.51:0/2200909256 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74040a0750 0x7f740409e1d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f740409f5f0 tx=0x7f73f802ee60 comp rx=0 tx=0).stop 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 -- 10.20.193.51:0/2200909256 shutdown_connections 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 --2- 10.20.193.51:0/2200909256 >> v2:10.20.193.142:3300/0 conn(0x7f740413b760 0x7f740413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 --2- 10.20.193.51:0/2200909256 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f74040a0750 0x7f740409e1d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 -- 10.20.193.51:0/2200909256 >> 10.20.193.51:0/2200909256 conn(0x7f74040a30c0 msgr2=0x7f74040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 -- 10.20.193.51:0/2200909256 shutdown_connections 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 1 -- 10.20.193.51:0/2200909256 wait complete. 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 10 monclient: build_initial_monmap 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.883+0000 7f740c4bf640 10 monclient: monmap: 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 Processor -- start 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 -- start start 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient: init 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74040a0750 0x7f740413a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-b con 0x7f74040a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 0x7f740413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-c con 0x7f74040a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): picked mon.noname-a con 0x7f740413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f74040a04b0 con 0x7f740413b760 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f740409c850 con 0x7f74040a0750 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f740409e710 con 0x7f74040a3bb0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740c4bf640 10 monclient(hunting): authenticate will time out at 1669.503364s 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 0x7f740413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42048/0 (socket says 10.20.193.51:42048) 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 learned_addr learned my addr 10.20.193.51:0/4274996190 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): get_auth_request con 0x7f740413b760 auth_method 0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 10 monclient(hunting): get_auth_request con 0x7f74040a3bb0 auth_method 0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 msgr2=0x7f740413acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 msgr2=0x7f740413acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 0x7f740413acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f7409a33640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 0x7f740413acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient(hunting): handle_auth_done global_id 204339 payload 824 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 msgr2=0x7f740413acb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040a3bb0 0x7f740413acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74040a0750 msgr2=0x7f740413a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f74040a0750 0x7f740413a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient: _finish_hunting 0 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 monclient: found mon.noname-a 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:01.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.884+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740409aa40 con 0x7f740413b760 2026-02-17T12:03:01.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 msgr2=0x7f740413b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740aa35640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f740000b9e0 tx=0x7f740000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740000c830 con 0x7f740413b760 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: dump: 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: _finish_auth 0 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7400010070 con 0x7f740413b760 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 5 monclient: authenticate success, global_id 204339 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 10 monclient: _renew_subs 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7404099310 con 0x7f740413b760 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740000cc30 con 0x7f740413b760 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f7408a31640 4 set_mon_vals no callback set 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f73eaffd640 10 monclient: dump: 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:01.890 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 10 monclient: _renew_subs 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.886+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74040a26c0 con 0x7f740413b760 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740c4bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f740406f7e0 con 0x7f7404096d90 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 10 monclient: get_auth_request con 0x7f7404096d90 auth_method 0 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f740001d030 con 0x7f740413b760 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f73eaffd640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 0x7f73d40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(651..651 src has 323..651) ==== 4799+0+0 (secure 0 0 0) 0x7f74000521b0 con 0x7f740413b760 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f7409a33640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 0x7f73d40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.887+0000 7f7409a33640 10 monclient: get_auth_request con 0x7f73d403dd10 auth_method 0 2026-02-17T12:03:01.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:01.890+0000 7f7409a33640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 0x7f73d40401d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73f8036000 tx=0x7f73f8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:02.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 10 monclient: get_auth_request con 0x7f7404096d90 auth_method 0 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:02.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.088+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:02.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:02.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 10 monclient: get_auth_request con 0x7f7404096d90 auth_method 0 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:02.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:02.489+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:02.911 INFO:tasks.rados.rados.0.trial142.stdout:2831: done (2 left) 2026-02-17T12:03:02.911 INFO:tasks.rados.rados.0.trial142.stdout:2832: read oid 18 snap 271 2026-02-17T12:03:02.912 INFO:tasks.rados.rados.0.trial142.stdout:2832: expect (ObjNum 852 snap 268 seq_num 852) 2026-02-17T12:03:02.912 INFO:tasks.rados.rados.0.trial142.stdout:2833: read oid 8 snap -1 2026-02-17T12:03:02.912 INFO:tasks.rados.rados.0.trial142.stdout:2833: expect (ObjNum 958 snap 310 seq_num 958) 2026-02-17T12:03:02.912 INFO:tasks.rados.rados.0.trial142.stdout:2834: copy_from oid 33 from oid 47 current snap is 311 2026-02-17T12:03:02.912 INFO:tasks.rados.rados.0.trial142.stdout:2829: expect (ObjNum 908 snap 292 seq_num 908) 2026-02-17T12:03:03.032 INFO:tasks.rados.rados.0.trial142.stdout:2833: expect (ObjNum 958 snap 310 seq_num 958) 2026-02-17T12:03:03.079 INFO:tasks.rados.rados.0.trial142.stdout:2832: expect (ObjNum 852 snap 268 seq_num 852) 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2834: finishing copy_from racing read to trial14245205-33 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2834: finishing copy_from to trial14245205-33 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 2447 (ObjNum 923 snap 299 seq_num 923) dirty exists 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2829: done (4 left) 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2830: done (3 left) 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2832: done (2 left) 2026-02-17T12:03:03.136 INFO:tasks.rados.rados.0.trial142.stdout:2833: done (1 left) 2026-02-17T12:03:03.137 INFO:tasks.rados.rados.0.trial142.stdout:2834: done (0 left) 2026-02-17T12:03:03.137 INFO:tasks.rados.rados.0.trial142.stdout:2835: delete oid 14 current snap is 311 2026-02-17T12:03:03.137 INFO:tasks.rados.rados.0.trial142.stdout:2835: done (0 left) 2026-02-17T12:03:03.137 INFO:tasks.rados.rados.0.trial142.stdout:2836: snap_remove snap 271 2026-02-17T12:03:03.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:03.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 10 monclient: get_auth_request con 0x7f7404096d90 auth_method 0 2026-02-17T12:03:03.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:03.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:03.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:03.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:03.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:03.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:03.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:03.290+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:2836: done (0 left) 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:2837: rollback oid 49 current snap is 311 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 49 to 286 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:2838: rollback oid 3 current snap is 311 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 310 2026-02-17T12:03:04.253 INFO:tasks.rados.rados.0.trial142.stdout:2839: read oid 36 snap -1 2026-02-17T12:03:04.254 INFO:tasks.rados.rados.0.trial142.stdout:2839: expect (ObjNum 937 snap 303 seq_num 937) 2026-02-17T12:03:04.254 INFO:tasks.rados.rados.0.trial142.stdout:2840: snap_create 2026-02-17T12:03:04.256 INFO:tasks.rados.rados.0.trial142.stdout:2837: finishing rollback tid 0 to trial14245205-49 2026-02-17T12:03:04.257 INFO:tasks.rados.rados.0.trial142.stdout:2839: expect (ObjNum 937 snap 303 seq_num 937) 2026-02-17T12:03:04.471 INFO:tasks.rados.rados.0.trial142.stdout:2838: finishing rollback tid 0 to trial14245205-3 2026-02-17T12:03:04.471 INFO:tasks.rados.rados.0.trial142.stdout:2838: finishing rollback tid 1 to trial14245205-3 2026-02-17T12:03:04.471 INFO:tasks.rados.rados.0.trial142.stdout:2837: finishing rollback tid 1 to trial14245205-49 2026-02-17T12:03:04.472 INFO:tasks.rados.rados.0.trial142.stdout:2837: finishing rollback tid 2 to trial14245205-49 2026-02-17T12:03:04.472 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2646 (ObjNum 827 snap 257 seq_num 827) dirty exists 2026-02-17T12:03:04.472 INFO:tasks.rados.rados.0.trial142.stdout:2838: finishing rollback tid 2 to trial14245205-3 2026-02-17T12:03:04.472 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2143 (ObjNum 950 snap 310 seq_num 950) dirty exists 2026-02-17T12:03:04.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.884+0000 7f73e9ffb640 10 monclient: tick 2026-02-17T12:03:04.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.884+0000 7f73e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:04.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.884+0000 7f73e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:04.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.884+0000 7f73e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 10 monclient: get_auth_request con 0x7f7404096d90 auth_method 0 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:04.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:04.892+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T12:03:05.552 INFO:tasks.rados.rados.0.trial142.stdout:2837: done (3 left) 2026-02-17T12:03:05.552 INFO:tasks.rados.rados.0.trial142.stdout:2838: done (2 left) 2026-02-17T12:03:05.552 INFO:tasks.rados.rados.0.trial142.stdout:2839: done (1 left) 2026-02-17T12:03:05.552 INFO:tasks.rados.rados.0.trial142.stdout:2840: done (0 left) 2026-02-17T12:03:05.552 INFO:tasks.rados.rados.0.trial142.stdout:2841: delete oid 44 current snap is 312 2026-02-17T12:03:05.553 INFO:tasks.rados.rados.0.trial142.stdout:2841: done (0 left) 2026-02-17T12:03:05.553 INFO:tasks.rados.rados.0.trial142.stdout:2842: snap_remove snap 311 2026-02-17T12:03:05.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 10 monclient: tick 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 0x7f73cc005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 msgr2=0x7f7404097170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7404096d90 0x7f7404097170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f73e9ffb640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f740406f7e0 con 0x7f73cc003640 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 0x7f73cc005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient: get_auth_request con 0x7f73cc003640 auth_method 0 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 10 monclient(hunting): handle_auth_done global_id 224099 payload 824 2026-02-17T12:03:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.884+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73cc0061b0 con 0x7f73cc003640 2026-02-17T12:03:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 msgr2=0x7f73cc005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 0x7f73cc005ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73f4016590 tx=0x7f73f4016a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4018970 con 0x7f73cc003640 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 10 monclient: dump: 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.891 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f73f4018970 con 0x7f73cc003640 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 msgr2=0x7f73cc005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 0x7f73cc005ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73f4016590 tx=0x7f73f4016a60 comp rx=0 tx=0).stop 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 msgr2=0x7f73cc005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:05.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.887+0000 7f73eaffd640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f73cc003640 0x7f73cc005ad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740c4bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 0x7f74041da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740c4bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f74040008d0 con 0x7f74040976b0 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 0x7f74041da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient: get_auth_request con 0x7f74040976b0 auth_method 0 2026-02-17T12:03:05.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 10 monclient(hunting): handle_auth_done global_id 224102 payload 824 2026-02-17T12:03:05.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.891+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7404050ac0 con 0x7f74040976b0 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f740a234640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 msgr2=0x7f74041da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f740a234640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 0x7f74041da8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73f4021000 tx=0x7f73f40038d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4005590 con 0x7f74040976b0 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 10 monclient: dump: 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f73f4005590 con 0x7f74040976b0 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.893+0000 7f73eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:05.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 msgr2=0x7f74041da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f73eaffd640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 0x7f74041da8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73f4021000 tx=0x7f73f40038d0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f73eaffd640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 msgr2=0x7f74041da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f73eaffd640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f74040976b0 0x7f74041da8c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740aa35640 1 -- 10.20.193.51:0/4274996190 reap_dead start 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:05.899 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10722, 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:05.900 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:05.901 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:05.902 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:05.903 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:05.904 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.905 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.906 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:05.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:05.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.910 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:05.911 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:05.912 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:05.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 msgr2=0x7f73d40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 0x7f73d40401d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73f8036000 tx=0x7f73f8033000 comp rx=0 tx=0).stop 2026-02-17T12:03:05.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 10 monclient: shutdown 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 msgr2=0x7f740413b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f740000b9e0 tx=0x7f740000beb0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 shutdown_connections 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f73d403dd10 0x7f73d40401d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 --2- 10.20.193.51:0/4274996190 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f740413b760 0x7f740413b1f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 >> 10.20.193.51:0/4274996190 conn(0x7f74040a30c0 msgr2=0x7f7404072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 shutdown_connections 2026-02-17T12:03:05.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.894+0000 7f740c4bf640 1 -- 10.20.193.51:0/4274996190 wait complete. 2026-02-17T12:03:05.916 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:05.916 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:03:05.916 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 10 monclient: get_monmap_and_config 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 10 monclient: build_initial_monmap 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 10 monclient: monmap: 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:05.985342+0000 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:05.985342+0000 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:05.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 1 Processor -- start 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 1 -- start start 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.984+0000 7f38c9cd3640 10 monclient: init 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f38c40a3bb0 0x7f38c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-a con 0x7f38c40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f38c40a0750 0x7f38c409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-c con 0x7f38c40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38c409e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c406e140 con 0x7f38c409e540 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f38c40a3f90 con 0x7f38c40a3bb0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f38c409f910 con 0x7f38c40a0750 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c9cd3640 10 monclient(hunting): authenticate will time out at 1673.604118s 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f38c40a3bb0 0x7f38c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f38c40a3bb0 0x7f38c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50238/0 (socket says 10.20.193.51:50238) 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c3fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f38c409e540 0x7f38c413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37658/0 (socket says 10.20.193.51:37658) 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 -- 10.20.193.51:0/3207230891 learned_addr learned my addr 10.20.193.51:0/3207230891 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): get_auth_request con 0x7f38c40a3bb0 auth_method 0 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/3207230891 >> v2:10.20.193.142:3300/0 conn(0x7f38c40a0750 0x7f38c409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request con 0x7f38c40a0750 auth_method 0 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient(hunting): handle_auth_done global_id 204342 payload 274 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 -- 10.20.193.51:0/3207230891 >> v2:10.20.193.142:3300/0 conn(0x7f38c40a0750 msgr2=0x7f38c409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 --2- 10.20.193.51:0/3207230891 >> v2:10.20.193.142:3300/0 conn(0x7f38c40a0750 0x7f38c409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 -- 10.20.193.51:0/3207230891 >> v1:10.20.193.51:6789/0 conn(0x7f38c409e540 legacy=0x7f38c413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:05.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.985+0000 7f38c37fe640 1 -- 10.20.193.51:0/3207230891 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c409ccd0 con 0x7f38c40a3bb0 2026-02-17T12:03:05.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c37fe640 1 -- 10.20.193.51:0/3207230891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c40a3bb0 msgr2=0x7f38c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:05.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c37fe640 1 --2- 10.20.193.51:0/3207230891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c40a3bb0 0x7f38c409dac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38c406c1c0 tx=0x7f38b002edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d6ef40a291e06b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 1 -- 10.20.193.51:0/3207230891 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b003c070 con 0x7f38c40a3bb0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: dump: 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 5 monclient: authenticate success, global_id 204342 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 1 -- 10.20.193.51:0/3207230891 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b002fc70 con 0x7f38c40a3bb0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 1 -- 10.20.193.51:0/3207230891 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0037660 con 0x7f38c40a3bb0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 4 set_mon_vals no callback set 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c27fc640 10 monclient: dump: 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 10 monclient: shutdown 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 -- 10.20.193.51:0/3207230891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c40a3bb0 msgr2=0x7f38c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/3207230891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c40a3bb0 0x7f38c409dac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38c406c1c0 tx=0x7f38b002edf0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 -- 10.20.193.51:0/3207230891 shutdown_connections 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/3207230891 >> v2:10.20.193.142:3300/0 conn(0x7f38c40a0750 0x7f38c409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/3207230891 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c40a3bb0 0x7f38c409dac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 -- 10.20.193.51:0/3207230891 >> 10.20.193.51:0/3207230891 conn(0x7f38c40a30c0 msgr2=0x7f38c40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 -- 10.20.193.51:0/3207230891 shutdown_connections 2026-02-17T12:03:05.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 -- 10.20.193.51:0/3207230891 wait complete. 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 10 monclient: build_initial_monmap 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 10 monclient: monmap: 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.988+0000 7f38c9cd3640 1 Processor -- start 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 -- start start 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient: init 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-a con 0x7f38c409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38c40a0750 0x7f38c4099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-c con 0x7f38c40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c40a3bb0 0x7f38c408e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): picked mon.noname-b con 0x7f38c40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40a04b0 con 0x7f38c409e540 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f38c409c850 con 0x7f38c40a3bb0 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f38c413de80 con 0x7f38c40a0750 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c9cd3640 10 monclient(hunting): authenticate will time out at 1673.608288s 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50240/0 (socket says 10.20.193.51:50240) 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 -- 10.20.193.51:0/888711758 learned_addr learned my addr 10.20.193.51:0/888711758 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): get_auth_request con 0x7f38c409e540 auth_method 0 2026-02-17T12:03:05.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38c40a0750 0x7f38c4099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request con 0x7f38c40a0750 auth_method 0 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient(hunting): handle_auth_done global_id 204345 payload 824 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38c40a0750 msgr2=0x7f38c4099f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f38c40a0750 0x7f38c4099f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c40a3bb0 msgr2=0x7f38c408e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c40a3bb0 0x7f38c408e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:05.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.989+0000 7f38c37fe640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c40921a0 con 0x7f38c409e540 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c37fe640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 msgr2=0x7f38c4099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c37fe640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009a40 tx=0x7f38b0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0047070 con 0x7f38c409e540 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: dump: 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: _finish_auth 0 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 5 monclient: authenticate success, global_id 204345 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b003f870 con 0x7f38c409e540 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 10 monclient: _renew_subs 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c406f730 con 0x7f38c409e540 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b003c040 con 0x7f38c409e540 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c1ffb640 4 set_mon_vals no callback set 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f389ffff640 10 monclient: dump: 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 10 monclient: _renew_subs 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.991+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c4091ec0 con 0x7f38c409e540 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c9cd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 0x7f38c408ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40a2c70 con 0x7f38c41cd1b0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f38b003fca0 con 0x7f38c409e540 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 0x7f38c408ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient: get_auth_request con 0x7f38c41cd1b0 auth_method 0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f389ffff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f389403dd10 0x7f38940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(654..654 src has 323..654) ==== 4799+0+0 (secure 0 0 0) 0x7f38b00776c0 con 0x7f38c409e540 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c3fff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f389403dd10 0x7f38940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_done global_id 184426 payload 824 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c2ffd640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38c409dac0 con 0x7f38c41cd1b0 2026-02-17T12:03:05.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.992+0000 7f38c3fff640 10 monclient: get_auth_request con 0x7f389403dd10 auth_method 0 2026-02-17T12:03:05.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f38c2ffd640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 msgr2=0x7f38c408ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:05.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 0x7f38c408ebe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38c4091df0 tx=0x7f38b4011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f38c3fff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f389403dd10 0x7f38940401d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f38b8005b20 tx=0x7f38b8005140 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4019070 con 0x7f38c41cd1b0 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 10 monclient: dump: 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f38b400fe20 con 0x7f38c41cd1b0 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 msgr2=0x7f38c408ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 0x7f38c408ebe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38c4091df0 tx=0x7f38b4011ca0 comp rx=0 tx=0).stop 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 msgr2=0x7f38c408ebe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:05.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.995+0000 7f389ffff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c41cd1b0 0x7f38c408ebe0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38c4091df0 tx=0x7f38b4011ca0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.998+0000 7f38c9cd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.998+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 0x7f38c41d82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.998+0000 7f38c9cd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.998+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f38c408f530 con 0x7f38c408f120 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.998+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 0x7f38c41d82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient: get_auth_request con 0x7f38c408f120 auth_method 0 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:06.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:06.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:06.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:06.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:06.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 10 monclient(hunting): handle_auth_done global_id 184429 payload 824 2026-02-17T12:03:06.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:05.999+0000 7f38c2ffd640 1 -- 10.20.193.51:0/888711758 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38c4090800 con 0x7f38c408f120 2026-02-17T12:03:06.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c2ffd640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 msgr2=0x7f38c41d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:06.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c2ffd640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 0x7f38c41d82b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38b401b000 tx=0x7f38b4004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b400f040 con 0x7f38c408f120 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 10 monclient: dump: 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f38b40143e0 con 0x7f38c408f120 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 msgr2=0x7f38c41d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 0x7f38c41d82b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38b401b000 tx=0x7f38b4004830 comp rx=0 tx=0).stop 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 msgr2=0x7f38c41d82b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:06.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f389ffff640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f38c408f120 0x7f38c41d82b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 218388, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:06.004 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.005 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:06.006 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:06.007 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f389403dd10 msgr2=0x7f38940401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f389403dd10 0x7f38940401d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f38b8005b20 tx=0x7f38b8005140 comp rx=0 tx=0).stop 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 10 monclient: shutdown 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 msgr2=0x7f38c4099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009a40 tx=0x7f38b0004830 comp rx=0 tx=0).stop 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.001+0000 7f38c3fff640 1 -- 10.20.193.51:0/888711758 reap_dead start 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.002+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 shutdown_connections 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.002+0000 7f38c9cd3640 1 --2- 10.20.193.51:0/888711758 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f38c409e540 0x7f38c4099a10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.002+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 >> 10.20.193.51:0/888711758 conn(0x7f38c40a30c0 msgr2=0x7f38c4072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.002+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 shutdown_connections 2026-02-17T12:03:06.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.002+0000 7f38c9cd3640 1 -- 10.20.193.51:0/888711758 wait complete. 2026-02-17T12:03:06.009 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:06.009 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:03:06.009 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 10 monclient: get_monmap_and_config 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 10 monclient: build_initial_monmap 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 10 monclient: monmap: 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:06.073452+0000 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:06.073452+0000 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.074 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:06.075 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:06.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:06.075 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:06.075 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:06.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 1 Processor -- start 2026-02-17T12:03:06.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 1 -- start start 2026-02-17T12:03:06.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.072+0000 7fdf6021a640 10 monclient: init 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdf580a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdf580a0750 0x7fdf5809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-c con 0x7fdf580a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-b con 0x7fdf5813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5806e140 con 0x7fdf580a3bb0 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5809f910 con 0x7fdf580a0750 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5809ccd0 con 0x7fdf5813b760 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf6021a640 10 monclient(hunting): authenticate will time out at 1673.692261s 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39460/0 (socket says 10.20.193.51:39460) 2026-02-17T12:03:06.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 -- 10.20.193.51:0/1732341950 learned_addr learned my addr 10.20.193.51:0/1732341950 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): get_auth_request con 0x7fdf5813b760 auth_method 0 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5d78e640 1 --2- 10.20.193.51:0/1732341950 >> v2:10.20.193.142:3300/0 conn(0x7fdf580a0750 0x7fdf5809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient(hunting): handle_auth_done global_id 224108 payload 274 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 -- 10.20.193.51:0/1732341950 >> v2:10.20.193.142:3300/0 conn(0x7fdf580a0750 msgr2=0x7fdf5809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 --2- 10.20.193.51:0/1732341950 >> v2:10.20.193.142:3300/0 conn(0x7fdf580a0750 0x7fdf5809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 -- 10.20.193.51:0/1732341950 >> v1:10.20.193.142:6789/0 conn(0x7fdf580a3bb0 legacy=0x7fdf5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient: _finish_hunting 0 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 monclient: found mon.noname-b 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.073+0000 7fdf5e790640 1 -- 10.20.193.51:0/1732341950 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5809eec0 con 0x7fdf5813b760 2026-02-17T12:03:06.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.076+0000 7fdf5e790640 1 -- 10.20.193.51:0/1732341950 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 msgr2=0x7fdf5813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:06.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.076+0000 7fdf5e790640 1 --2- 10.20.193.51:0/1732341950 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806f3c0 tx=0x7fdf5402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0397bf8db120986 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:06.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 1 -- 10.20.193.51:0/1732341950 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5402fe60 con 0x7fdf5813b760 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: dump: 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: _finish_auth 0 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: _check_auth_tickets 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 1 -- 10.20.193.51:0/1732341950 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf540373f0 con 0x7fdf5813b760 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 5 monclient: authenticate success, global_id 224108 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 1 -- 10.20.193.51:0/1732341950 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf540377c0 con 0x7fdf5813b760 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 4 set_mon_vals no callback set 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf5cf8d640 10 monclient: dump: 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:06.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 10 monclient: shutdown 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 -- 10.20.193.51:0/1732341950 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 msgr2=0x7fdf5813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 --2- 10.20.193.51:0/1732341950 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806f3c0 tx=0x7fdf5402f230 comp rx=0 tx=0).stop 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 -- 10.20.193.51:0/1732341950 shutdown_connections 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 --2- 10.20.193.51:0/1732341950 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf5813b760 0x7fdf5813db50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 --2- 10.20.193.51:0/1732341950 >> v2:10.20.193.142:3300/0 conn(0x7fdf580a0750 0x7fdf5809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 -- 10.20.193.51:0/1732341950 >> 10.20.193.51:0/1732341950 conn(0x7fdf580a30c0 msgr2=0x7fdf580a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 -- 10.20.193.51:0/1732341950 shutdown_connections 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.078+0000 7fdf6021a640 1 -- 10.20.193.51:0/1732341950 wait complete. 2026-02-17T12:03:06.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient: build_initial_monmap 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient: monmap: 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 Processor -- start 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 -- start start 2026-02-17T12:03:06.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient: init 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf580a0750 0x7fdf580950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-b con 0x7fdf580a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-c con 0x7fdf580a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:06.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf5813b760 0x7fdf58095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): picked mon.noname-a con 0x7fdf5813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580a04b0 con 0x7fdf5813b760 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5809c850 con 0x7fdf580a0750 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5809e710 con 0x7fdf580a3bb0 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf6021a640 10 monclient(hunting): authenticate will time out at 1673.698590s 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39468/0 (socket says 10.20.193.51:39468) 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 -- 10.20.193.51:0/4278828713 learned_addr learned my addr 10.20.193.51:0/4278828713 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): get_auth_request con 0x7fdf580a3bb0 auth_method 0 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:06.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf5813b760 0x7fdf58095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): get_auth_request con 0x7fdf5813b760 auth_method 0 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5df8f640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf580a0750 0x7fdf580950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5df8f640 10 monclient(hunting): get_auth_request con 0x7fdf580a0750 auth_method 0 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5df8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5df8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5df8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5e790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:06.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient(hunting): handle_auth_done global_id 224111 payload 824 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 -- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf580a0750 msgr2=0x7fdf580950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf580a0750 0x7fdf580950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 -- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf5813b760 msgr2=0x7fdf58095b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf5813b760 0x7fdf58095b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient: _finish_hunting 0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 monclient: found mon.noname-c 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.079+0000 7fdf5d78e640 1 -- 10.20.193.51:0/4278828713 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf58098b20 con 0x7fdf580a3bb0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.081+0000 7fdf5d78e640 1 -- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 msgr2=0x7fdf58095620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.081+0000 7fdf5d78e640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00c7c0 tx=0x7fdf4c00cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c007ca0 con 0x7fdf580a3bb0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: dump: 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:06.091 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4c004020 con 0x7fdf580a3bb0 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c007e60 con 0x7fdf580a3bb0 2026-02-17T12:03:06.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 10 monclient: dump: 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf47fff640 4 set_mon_vals no callback set 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 5 monclient: authenticate success, global_id 224111 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _renew_subs 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf58098e00 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _renew_subs 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5809d7b0 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5809dac0 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.082+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdf4c004410 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.083+0000 7fdf467fc640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 0x7fdf28040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.083+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(654..654 src has 323..654) ==== 4799+0+0 (secure 0 0 0) 0x7fdf4c052c80 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.083+0000 7fdf5df8f640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 0x7fdf28040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.083+0000 7fdf5df8f640 10 monclient: get_auth_request con 0x7fdf2803dd60 auth_method 0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.085+0000 7fdf5df8f640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 0x7fdf28040220 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005020 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.085+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdf4c01e020 con 0x7fdf580a3bb0 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.085+0000 7fdf467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:06.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.085+0000 7fdf467fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:06.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.202+0000 7fdf6021a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:03:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.202+0000 7fdf6021a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:03:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.202+0000 7fdf6021a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.202+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdf58097670 con 0x7fdf580a3bb0 2026-02-17T12:03:06.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.203+0000 7fdf467fc640 1 -- 10.20.193.51:0/4278828713 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fdf4c015030 con 0x7fdf580a3bb0 2026-02-17T12:03:06.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.203+0000 7fdf467fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:03:06.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.203+0000 7fdf467fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:06.207 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.207 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=12,logm=48} crc {auth=4219626277,config=692619927,health=832381332,kv=643764953,logm=2145114435}) 2026-02-17T12:03:06.207 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=1077686836,config=692619927,health=949105977,kv=643764953,logm=3233380635}) 2026-02-17T12:03:06.207 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.207 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=12,logm=48} crc {auth=4219626277,config=692619927,health=832381332,kv=643764953,logm=2145114435}) 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.203+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=11,kv=12,logm=48} crc {auth=4219626277,config=692619927,health=101084904,kv=643764953,logm=3461596255}) 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861472209}) 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3102079296}) 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861472209}) 2026-02-17T12:03:06.208 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1901115261}) 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 msgr2=0x7fdf28040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 0x7fdf28040220 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005020 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 10 monclient: shutdown 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 msgr2=0x7fdf58095620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00c7c0 tx=0x7fdf4c00cc90 comp rx=0 tx=0).stop 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 shutdown_connections 2026-02-17T12:03:06.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdf2803dd60 0x7fdf28040220 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.210 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdf5813b760 0x7fdf58095b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdf580a3bb0 0x7fdf58095620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 --2- 10.20.193.51:0/4278828713 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdf580a0750 0x7fdf580950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:06.211 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3942198041}) 2026-02-17T12:03:06.211 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3404480405}) 2026-02-17T12:03:06.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 >> 10.20.193.51:0/4278828713 conn(0x7fdf580a30c0 msgr2=0x7fdf5813ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:06.212 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.212 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3942198041}) 2026-02-17T12:03:06.212 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.204+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2856923189}) 2026-02-17T12:03:06.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 shutdown_connections 2026-02-17T12:03:06.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:06.204+0000 7fdf6021a640 1 -- 10.20.193.51:0/4278828713 wait complete. 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=104880408}) 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3023213070}) 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=104880408}) 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=766818514}) 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.220 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914900534}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3068412678}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914900534}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.205+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=277075755}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3923296670}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2405449192}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3923296670}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2925445176}) 2026-02-17T12:03:06.221 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1574790227}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1504274694}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1574790227}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1757530662}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277202010}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2530166093}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277202010}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.206+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1608064449}) 2026-02-17T12:03:06.222 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2070995273}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3183730644}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2070995273}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2659265303}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4185804192}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2133204042}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4185804192}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.207+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4056411394}) 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.223 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2951133560}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3183279439}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2951133560}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3854442974}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238595873}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4225552156}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238595873}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1632443115}) 2026-02-17T12:03:06.224 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4140802204}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1078613228}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4140802204}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.208+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2343086757}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2741571115}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3489155332}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2741571115}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3231439823}) 2026-02-17T12:03:06.225 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1178549379}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484495152}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1178549379}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3516351336}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2105266680}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=132845753}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2105266680}) 2026-02-17T12:03:06.226 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.209+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=140961054}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3307569351}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3087622612}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3307569351}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2695480136}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000719827}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3462095216}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000719827}) 2026-02-17T12:03:06.227 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.210+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=665313635}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1476807722}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=491673609}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1476807722}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=509125277}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201101140}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3233173103}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201101140}) 2026-02-17T12:03:06.228 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3766524835}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480526692}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4044851041}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480526692}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.211+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3581056597}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967086167}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3768235836}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967086167}) 2026-02-17T12:03:06.229 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=829665574}) 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3023324288}) 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=204818507}) 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3023324288}) 2026-02-17T12:03:06.230 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1328653376}) 2026-02-17T12:03:06.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3436748914}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2405938411}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3436748914}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.212+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=289397437}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3086747746}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=418290824}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3086747746}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=902216981}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838194995}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=244005632}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838194995}) 2026-02-17T12:03:06.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2576907768}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272512935}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=186509203}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272512935}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.213+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2330131543}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2899217230}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1532637966}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2899217230}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2067143161}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620698025}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=985470673}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620698025}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.214+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1149180783}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3799159615}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3399474365}) 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.260 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3799159615}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=998423056}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953394873}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2910546261}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953394873}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1779808742}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120483986}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2703398753}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120483986}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.215+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2173112508}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=249626653}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2407242211}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=249626653}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1858412730}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301456974}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1414818883}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301456974}) 2026-02-17T12:03:06.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=13527350}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799079116}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2939153752}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799079116}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.216+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1894950630}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1138090382}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853079013}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1138090382}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2333393100}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127473882}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=960650443}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127473882}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.217+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1204226473}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=410743189}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=481148954}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=410743189}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2916867452}) 2026-02-17T12:03:06.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484953924}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1805641978}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484953924}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4109402520}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035692967}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3561555895}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035692967}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.218+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=536122097}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4118489187}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=151699806}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4118489187}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2377497531}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458744196}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3202110773}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458744196}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2046695824}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3922785722}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=745419569}) 2026-02-17T12:03:06.263 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3922785722}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.219+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=905961034}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4123432516}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2072752858}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4123432516}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.229+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=664597292}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=116809295}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2817522552}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=116809295}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4210806656}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1423039838}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3986648112}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1423039838}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1831936370}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3193387223}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4170547424}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3193387223}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.230+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1817475701}) 2026-02-17T12:03:06.264 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163484585}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3773355620}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163484585}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3234369258}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220547989}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1074942463}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220547989}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1035357968}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941647076}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2322285841}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941647076}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.231+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=770201072}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=929233435}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2877380413}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=929233435}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=380750042}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2532681489}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=995088365}) 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.265 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2532681489}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=265115241}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574290102}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1235293760}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574290102}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.232+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=548788696}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=511369229}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2336721428}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=511369229}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3790604852}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4127560328}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3431122284}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4127560328}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3341586347}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2166856591}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1865161584}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2166856591}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.233+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2497567339}) 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.266 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884750159}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2543532839}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884750159}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=253656379}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594869595}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3056565656}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594869595}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2103812587}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022564825}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268094436}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022564825}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.234+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2976229012}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1382841151}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2331488608}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1382841151}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3415263627}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230245842}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1834160143}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230245842}) 2026-02-17T12:03:06.267 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2677333645}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2938463796}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3012100212}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2938463796}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.235+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3067802688}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031572775}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2759621791}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031572775}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1866825449}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3895060302}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1516805524}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3895060302}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.236+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3638183280}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3414680920}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=597420179}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3414680920}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=428695472}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2399114532}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3161375593}) 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.268 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2399114532}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1193279885}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542620137}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1497015288}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542620137}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.237+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=932409134}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084257513}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2126602173}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084257513}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1325029159}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2318941597}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1670458840}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2318941597}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.238+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2236461531}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645051449}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3621340804}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645051449}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357563439}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766588658}) 2026-02-17T12:03:06.269 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1001348693}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766588658}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=305068345}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956138846}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=565576822}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956138846}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.239+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=115614107}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3593891725}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1423565725}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3593891725}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2247636291}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=902921774,mdsmap=3207544932,mgr=386329862,mgr_command_descs=1238205435}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=96,mdsmap=2,mgr=2} crc {logm=3473003546,mdsmap=3140514009,mgr=2479357392}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=902921774,mdsmap=3207544932,mgr=386329862,mgr_command_descs=1238205435}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2921259491}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=4205813884,config=692619927,health=1817011749,kv=643764953,logm=2501653219}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2235279556,config=692619927,health=949105977,kv=643764953,logm=3324078497}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=4205813884,config=692619927,health=1817011749,kv=643764953,logm=2501653219}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.240+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=1862414361,config=692619927,health=949105977,kv=643764953,logm=3791590375}) 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.270 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985202913}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1870837160}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985202913}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3167233888}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070307844}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1277272274}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070307844}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.241+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1976521904}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2819813976}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=914386165}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2819813976}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3247887663}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3836786650}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3316000857}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3836786650}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2638674786}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696547577}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2167704171}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696547577}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.242+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2252385945}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704028705}) 2026-02-17T12:03:06.271 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2364644041}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704028705}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1498282838}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1808325096}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2812410293}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1808325096}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.243+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=553906286}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3582743559}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2161230060}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3582743559}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4278246474}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186491621}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3590412515}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186491621}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3205832979}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3935613616}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1188328150}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3935613616}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.244+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=611908446}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2187587386}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2976787009}) 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.272 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2187587386}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1455479907}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529076689}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2303207578}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529076689}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.245+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=468198281}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=630427719}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=533609223}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=630427719}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=106507004}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3278019356}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942911957}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3278019356}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=245575015}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926286079}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3609891599}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926286079}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.246+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4254682281}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=242396996}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3896293985}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=242396996}) 2026-02-17T12:03:06.273 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2282751703}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2967934954}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2421330528}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2967934954}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2475147313}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1184831723}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2902112082}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1184831723}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.247+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=341605968}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2056785017}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2494240114}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2056785017}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=581984049}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4280779591}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=562932556}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4280779591}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.248+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2044889294}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2602591362}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3165512789}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2602591362}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3033871012}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587599473}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2065870453}) 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587599473}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3257769388}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2944046452}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=289555864}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2944046452}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.249+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1177201518}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570987280}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1828856991}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570987280}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2729197091}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778672439}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=352433086}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778672439}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1520951464}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3863398128}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1810654711}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3863398128}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.250+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1683264623}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=595529395}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=491402597}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=595529395}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2250661968}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=836613966}) 2026-02-17T12:03:06.275 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3020172475}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=836613966}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1220127625}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1814640497}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.251+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2327685202}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1814640497}) 2026-02-17T12:03:06.276 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.252+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3320565232}) 2026-02-17T12:03:06.552 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2770407829}) 2026-02-17T12:03:06.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=89119809}) 2026-02-17T12:03:06.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2770407829}) 2026-02-17T12:03:06.553 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.550+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2608845025}) 2026-02-17T12:03:06.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052723753}) 2026-02-17T12:03:06.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1292355816}) 2026-02-17T12:03:06.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.556 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052723753}) 2026-02-17T12:03:06.557 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.554+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2110304099}) 2026-02-17T12:03:06.564 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.564 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1378517037}) 2026-02-17T12:03:06.564 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4198235933}) 2026-02-17T12:03:06.565 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.565 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1378517037}) 2026-02-17T12:03:06.565 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.562+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2089993334}) 2026-02-17T12:03:06.565 INFO:tasks.rados.rados.0.trial142.stdout:2842: done (0 left) 2026-02-17T12:03:06.565 INFO:tasks.rados.rados.0.trial142.stdout:2843: write oid 25 current snap is 312 2026-02-17T12:03:06.566 INFO:tasks.rados.rados.0.trial142.stdout:2843: seq_num 967 ranges {652369=742614,2153264=99105} 2026-02-17T12:03:06.569 INFO:tasks.rados.rados.0.trial142.stdout:2843: writing trial14245205-25 from 652369 to 1394983 tid 1 2026-02-17T12:03:06.573 INFO:tasks.rados.rados.0.trial142.stdout:2843: writing trial14245205-25 from 2153264 to 2252369 tid 2 2026-02-17T12:03:06.573 INFO:tasks.rados.rados.0.trial142.stdout:2844: copy_from oid 27 from oid 7 current snap is 312 2026-02-17T12:03:06.573 INFO:tasks.rados.rados.0.trial142.stdout:2845: read oid 47 snap -1 2026-02-17T12:03:06.573 INFO:tasks.rados.rados.0.trial142.stdout:2845: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:03:06.573 INFO:tasks.rados.rados.0.trial142.stdout:2846: snap_remove snap 307 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220603700}) 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1522192394}) 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220603700}) 2026-02-17T12:03:06.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.685+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1872033298}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4146381823}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2033980251}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4146381823}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.693+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=658185846}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737986432}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2433324292}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737986432}) 2026-02-17T12:03:06.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4016883136}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548650792}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=314635990}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548650792}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3820225023}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699017600}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1098758771}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699017600}) 2026-02-17T12:03:06.696 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.694+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739849560}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2814001802}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=373537557}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2814001802}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2234790022}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344772887}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=100571493}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344772887}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.695+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=404570870}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846521442}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=208955266}) 2026-02-17T12:03:06.697 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846521442}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=77920815}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3887455161}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2310568995}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3887455161}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=541305208}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106518981}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1174268897}) 2026-02-17T12:03:06.698 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106518981}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.696+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1080893731}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=690903877}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2513485741}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=690903877}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3100483745}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692916160}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3575165926}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692916160}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=124658022}) 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.699 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124612379}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3546497765}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124612379}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.697+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1025026559}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613156058}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=523108751}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613156058}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1372324859}) 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.700 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211388843}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=584062770}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211388843}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2577858310}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2228354655}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2705733974}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2228354655}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.698+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2635268940}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3854571002}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=351844266}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3854571002}) 2026-02-17T12:03:06.701 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2518683637}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689597012}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=679366254}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689597012}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3317640213}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2497742701}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2402439729}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.699+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2497742701}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3754982538}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=29433989}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=662027467}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=29433989}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2392440072}) 2026-02-17T12:03:06.702 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205523992}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1150532009}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205523992}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.700+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=435838816}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382544332}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1462072841}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382544332}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1433622968}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576842503}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=221556064}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576842503}) 2026-02-17T12:03:06.703 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.701+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2279132234}) 2026-02-17T12:03:06.811 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.811 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781200605}) 2026-02-17T12:03:06.811 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3000433639}) 2026-02-17T12:03:06.811 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:06.812 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781200605}) 2026-02-17T12:03:06.812 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:06.809+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1869470166}) 2026-02-17T12:03:07.163 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.163 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1308018851}) 2026-02-17T12:03:07.163 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2666211821}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1308018851}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=813175728}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1457903819}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811169173}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1457903819}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1785327949}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.161+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2139067026}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=543639476}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2139067026}) 2026-02-17T12:03:07.164 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=595767796}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4123722535}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=381911438}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4123722535}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2420696777}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1900555125}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=330260209}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1900555125}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.162+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1479795518}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2182124505}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1008944669}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2182124505}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1743002879}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=919307483}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1001203216}) 2026-02-17T12:03:07.166 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=919307483}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2817298220}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471287749}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3850459264}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471287749}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.163+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=76576408}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2914445356}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3456674591}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2914445356}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1210922831}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1242469816}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3778097032}) 2026-02-17T12:03:07.167 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1242469816}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=165175767}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=623249018}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1046691598}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=623249018}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.164+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=392065938}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=333610551}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1136945315}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=333610551}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2164831974}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101422351}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=546979438}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101422351}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=229583704}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3829947133}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2561954850}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3829947133}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.165+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3950710321}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675304543}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3022421293}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675304543}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1149616961}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1234753338}) 2026-02-17T12:03:07.169 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1878202819}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1234753338}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2342648310}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1332943226}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1891871872}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1332943226}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.166+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=178165220}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356782179}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2439324775}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356782179}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=116153561}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=720166631}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=241617958}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=720166631}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2011603975}) 2026-02-17T12:03:07.170 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36206599}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3404949524}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36206599}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1162009138}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2788460456}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1082670361}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2788460456}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.167+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1230835641}) 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.171 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312732661}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=576273812}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312732661}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3383593331}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1427763478}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1295897988}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1427763478}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1219394166}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=15} crc {logm=482970600,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=987902419,mon_config_key=804177604,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=766685346,osd_snap=1027989564}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=4,osd_snap=19} crc {logm=3266610364,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=2593126149,mon_config_key=3390328712,monmap=263989209,osd_metadata=648801625,osd_snap=4256600049}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=15} crc {logm=482970600,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=987902419,mon_config_key=804177604,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=766685346,osd_snap=1027989564}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.168+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=39,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=15} crc {logm=889707164,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=987902419,mon_config_key=3639895655,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=766685346,osd_snap=3495527663}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=92,osdmap=8} crc {osd_snap=2775174567,osdmap=19265092}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=91,osdmap=9} crc {osd_snap=1809035026,osdmap=785827081}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=92,osdmap=8} crc {osd_snap=2775174567,osdmap=19265092}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=90,osdmap=10} crc {osd_snap=4058423263,osdmap=1901856419}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1477732197}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2143934886}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1477732197}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3828170508}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2486555062}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=281071975}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2486555062}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.169+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=121515228}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1422189532}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1173753275}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1422189532}) 2026-02-17T12:03:07.172 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2693256106}) 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=896511123}) 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2973778946}) 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=896511123}) 2026-02-17T12:03:07.173 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.170+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2343208573}) 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=512475135}) 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=86} crc {osdmap=71386071}) 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=512475135}) 2026-02-17T12:03:07.174 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:07.172+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=83} crc {osdmap=101784675}) 2026-02-17T12:03:07.232 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:03:07.233 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: get_monmap_and_config 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: monmap: 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:07.299192+0000 2026-02-17T12:03:07.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:07.299192+0000 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 Processor -- start 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 -- start start 2026-02-17T12:03:07.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: init 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb3280a3bb0 0x7fb32809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-c con 0x7fb3280a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb3280a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb32813b760 0x7fb32813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-a con 0x7fb32813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32806e140 con 0x7fb3280a0750 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb32809f910 con 0x7fb32813b760 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb32809ccd0 con 0x7fb3280a3bb0 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.298+0000 7fb32f7a7640 10 monclient(hunting): authenticate will time out at 1674.917926s 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb32813b760 0x7fb32813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb32813b760 0x7fb32813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50248/0 (socket says 10.20.193.51:50248) 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 -- 10.20.193.51:0/780018652 learned_addr learned my addr 10.20.193.51:0/780018652 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): get_auth_request con 0x7fb32813b760 auth_method 0 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32d51c640 1 --2- 10.20.193.51:0/780018652 >> v2:10.20.193.142:3300/0 conn(0x7fb3280a3bb0 0x7fb32809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32d51c640 10 monclient(hunting): get_auth_request con 0x7fb3280a3bb0 auth_method 0 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32d51c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32d51c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32d51c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient(hunting): handle_auth_done global_id 204351 payload 274 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 -- 10.20.193.51:0/780018652 >> v2:10.20.193.142:3300/0 conn(0x7fb3280a3bb0 msgr2=0x7fb32809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 --2- 10.20.193.51:0/780018652 >> v2:10.20.193.142:3300/0 conn(0x7fb3280a3bb0 0x7fb32809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 -- 10.20.193.51:0/780018652 >> v1:10.20.193.142:6789/0 conn(0x7fb3280a0750 legacy=0x7fb32809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.299+0000 7fb32dd1d640 1 -- 10.20.193.51:0/780018652 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32809eec0 con 0x7fb32813b760 2026-02-17T12:03:07.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb32dd1d640 1 -- 10.20.193.51:0/780018652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32813b760 msgr2=0x7fb32813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb32dd1d640 1 --2- 10.20.193.51:0/780018652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32813b760 0x7fb32813db50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb32806c1c0 tx=0x7fb32402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f541f3f5a4f4b1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 1 -- 10.20.193.51:0/780018652 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32402fe60 con 0x7fb32813b760 2026-02-17T12:03:07.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: dump: 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 1 -- 10.20.193.51:0/780018652 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3240373f0 con 0x7fb32813b760 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 1 -- 10.20.193.51:0/780018652 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240377c0 con 0x7fb32813b760 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb317fff640 10 monclient: dump: 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.318 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb32f7a7640 5 monclient: authenticate success, global_id 204351 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb32f7a7640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.301+0000 7fb32f7a7640 4 set_mon_vals no callback set 2026-02-17T12:03:07.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: shutdown 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- 10.20.193.51:0/780018652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32813b760 msgr2=0x7fb32813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/780018652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32813b760 0x7fb32813db50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb32806c1c0 tx=0x7fb32402f230 comp rx=0 tx=0).stop 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- 10.20.193.51:0/780018652 shutdown_connections 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/780018652 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb32813b760 0x7fb32813db50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/780018652 >> v2:10.20.193.142:3300/0 conn(0x7fb3280a3bb0 0x7fb32809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- 10.20.193.51:0/780018652 >> 10.20.193.51:0/780018652 conn(0x7fb3280a30c0 msgr2=0x7fb3280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- 10.20.193.51:0/780018652 shutdown_connections 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- 10.20.193.51:0/780018652 wait complete. 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: monmap: 2026-02-17T12:03:07.320 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 Processor -- start 2026-02-17T12:03:07.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 -- start start 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: init 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.302+0000 7fb32f7a7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-a con 0x7fb3280a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb3280a3bb0 0x7fb32812dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-c con 0x7fb3280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32813b760 0x7fb32812e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): picked mon.noname-b con 0x7fb32813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280a04b0 con 0x7fb3280a0750 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb32809c850 con 0x7fb32813b760 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb32809e710 con 0x7fb3280a3bb0 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32f7a7640 10 monclient(hunting): authenticate will time out at 1674.922027s 2026-02-17T12:03:07.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50264/0 (socket says 10.20.193.51:50264) 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 -- 10.20.193.51:0/706443892 learned_addr learned my addr 10.20.193.51:0/706443892 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): get_auth_request con 0x7fb3280a0750 auth_method 0 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb3280a3bb0 0x7fb32812dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): get_auth_request con 0x7fb3280a3bb0 auth_method 0 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32cd1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient(hunting): handle_auth_done global_id 204354 payload 824 2026-02-17T12:03:07.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 -- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb3280a3bb0 msgr2=0x7fb32812dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb3280a3bb0 0x7fb32812dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 -- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32813b760 msgr2=0x7fb32812e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32813b760 0x7fb32812e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.303+0000 7fb32d51c640 1 -- 10.20.193.51:0/706443892 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3281317d0 con 0x7fb3280a0750 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32d51c640 1 -- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 msgr2=0x7fb32812dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32d51c640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e7f0 tx=0x7fb31800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017070 con 0x7fb3280a0750 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: dump: 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.329 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31800ca60 con 0x7fb3280a0750 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 5 monclient: authenticate success, global_id 204354 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 10 monclient: _renew_subs 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32812ffd0 con 0x7fb3280a0750 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800f040 con 0x7fb3280a0750 2026-02-17T12:03:07.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb3177fe640 4 set_mon_vals no callback set 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb315ffb640 10 monclient: dump: 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.332 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 10 monclient: _renew_subs 2026-02-17T12:03:07.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.305+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32812f470 con 0x7fb3280a0750 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32f7a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32f7a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32f7a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32809dac0 con 0x7fb3280a0750 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb318012050 con 0x7fb3280a0750 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb315ffb640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(655..655 src has 323..655) ==== 4843+0+0 (secure 0 0 0) 0x7fb318052440 con 0x7fb3280a0750 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32cd1b640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.306+0000 7fb32cd1b640 10 monclient: get_auth_request con 0x7fb2f803dd10 auth_method 0 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.309+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb318023d80 con 0x7fb3280a0750 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.309+0000 7fb315ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.309+0000 7fb315ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:07.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.309+0000 7fb32cd1b640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb32812f0f0 tx=0x7fb31c007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb32f7a7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:07.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb32f7a7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb32f7a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb3280008d0 con 0x7fb3280a0750 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb315ffb640 1 -- 10.20.193.51:0/706443892 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fb3180520d0 con 0x7fb3280a0750 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb315ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.430+0000 7fb315ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:07.433 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:07.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 msgr2=0x7fb2f80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb32812f0f0 tx=0x7fb31c007f30 comp rx=0 tx=0).stop 2026-02-17T12:03:07.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 10 monclient: shutdown 2026-02-17T12:03:07.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 msgr2=0x7fb32812dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e7f0 tx=0x7fb31800ecc0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 shutdown_connections 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb2f803dd10 0x7fb2f80401d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb32813b760 0x7fb32812e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb3280a3bb0 0x7fb32812dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 --2- 10.20.193.51:0/706443892 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb3280a0750 0x7fb32812dab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 >> 10.20.193.51:0/706443892 conn(0x7fb3280a30c0 msgr2=0x7fb328138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 shutdown_connections 2026-02-17T12:03:07.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.431+0000 7fb32f7a7640 1 -- 10.20.193.51:0/706443892 wait complete. 2026-02-17T12:03:07.441 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:03:07.441 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:03:07.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:03:07.441 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:03:07.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.505+0000 7fa610f51640 10 monclient: get_monmap_and_config 2026-02-17T12:03:07.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.505+0000 7fa610f51640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.505+0000 7fa610f51640 10 monclient: monmap: 2026-02-17T12:03:07.507 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.507 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:07.506672+0000 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:07.506672+0000 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:07.508 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 Processor -- start 2026-02-17T12:03:07.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 -- start start 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient: init 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa60c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa60c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa60c13c770 0x7fa60c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-a con 0x7fa60c13c770 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c09e8e0 con 0x7fa60c0a0750 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c06e140 con 0x7fa60c0a3bb0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c09f910 con 0x7fa60c13c770 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa610f51640 10 monclient(hunting): authenticate will time out at 1675.125640s 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa609d74640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa60c0a0750 0x7fa60c09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37668/0 (socket says 10.20.193.51:37668) 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa60c13c770 0x7fa60c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa609d74640 1 -- 10.20.193.51:0/1127620559 learned_addr learned my addr 10.20.193.51:0/1127620559 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): get_auth_request con 0x7fa60c13c770 auth_method 0 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient(hunting): handle_auth_done global_id 204357 payload 274 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 1 -- 10.20.193.51:0/1127620559 >> v1:10.20.193.142:6789/0 conn(0x7fa60c0a3bb0 legacy=0x7fa60c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 1 -- 10.20.193.51:0/1127620559 >> v1:10.20.193.51:6789/0 conn(0x7fa60c0a0750 legacy=0x7fa60c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.506+0000 7fa60ad76640 1 -- 10.20.193.51:0/1127620559 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c09ccd0 con 0x7fa60c13c770 2026-02-17T12:03:07.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa60ad76640 1 -- 10.20.193.51:0/1127620559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c13c770 msgr2=0x7fa60c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa60ad76640 1 --2- 10.20.193.51:0/1127620559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c13c770 0x7fa60c13eb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009d90 tx=0x7fa5fc02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7f8aadacd5df9a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 1 -- 10.20.193.51:0/1127620559 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc03c070 con 0x7fa60c13c770 2026-02-17T12:03:07.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: dump: 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 1 -- 10.20.193.51:0/1127620559 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc037640 con 0x7fa60c13c770 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 5 monclient: authenticate success, global_id 204357 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 1 -- 10.20.193.51:0/1127620559 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc037a10 con 0x7fa60c13c770 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 4 set_mon_vals no callback set 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa609573640 10 monclient: dump: 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.516 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 10 monclient: shutdown 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 -- 10.20.193.51:0/1127620559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c13c770 msgr2=0x7fa60c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 --2- 10.20.193.51:0/1127620559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c13c770 0x7fa60c13eb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009d90 tx=0x7fa5fc02f190 comp rx=0 tx=0).stop 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 -- 10.20.193.51:0/1127620559 shutdown_connections 2026-02-17T12:03:07.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 --2- 10.20.193.51:0/1127620559 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c13c770 0x7fa60c13eb60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 -- 10.20.193.51:0/1127620559 >> 10.20.193.51:0/1127620559 conn(0x7fa60c0a30c0 msgr2=0x7fa60c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 -- 10.20.193.51:0/1127620559 shutdown_connections 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.509+0000 7fa610f51640 1 -- 10.20.193.51:0/1127620559 wait complete. 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.510+0000 7fa610f51640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.510+0000 7fa610f51640 10 monclient: monmap: 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:07.518 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.510+0000 7fa610f51640 1 Processor -- start 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.510+0000 7fa610f51640 1 -- start start 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.510+0000 7fa610f51640 10 monclient: init 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa60c0a0750 0x7fa60c099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-b con 0x7fa60c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0a3bb0 0x7fa60c09a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-a con 0x7fa60c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 0x7fa60c09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): picked mon.noname-c con 0x7fa60c13c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c09c850 con 0x7fa60c0a3bb0 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c09ebe0 con 0x7fa60c0a0750 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c0a04b0 con 0x7fa60c13c770 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa610f51640 10 monclient(hunting): authenticate will time out at 1675.130063s 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0a3bb0 0x7fa60c09a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 0x7fa60c09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0a3bb0 0x7fa60c09a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50274/0 (socket says 10.20.193.51:50274) 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 1 -- 10.20.193.51:0/565446501 learned_addr learned my addr 10.20.193.51:0/565446501 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): get_auth_request con 0x7fa60c0a3bb0 auth_method 0 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): get_auth_request con 0x7fa60c13c770 auth_method 0 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa609d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa60c0a0750 0x7fa60c099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient(hunting): handle_auth_done global_id 224117 payload 824 2026-02-17T12:03:07.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa60c0a0750 msgr2=0x7fa60c099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa60c0a0750 0x7fa60c099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0a3bb0 msgr2=0x7fa60c09a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0a3bb0 0x7fa60c09a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 monclient: found mon.noname-c 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60ad76640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c095f20 con 0x7fa60c13c770 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60a575640 10 monclient: get_auth_request con 0x7fa60c0a0750 auth_method 0 2026-02-17T12:03:07.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.511+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa60c0a0750 0x7fa60c099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:07.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa60ad76640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 msgr2=0x7fa60c09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa60ad76640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 0x7fa60c09ab30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc036000 tx=0x7fa5fc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc047020 con 0x7fa60c13c770 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: dump: 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.527 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 5 monclient: authenticate success, global_id 224117 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc042880 con 0x7fa60c13c770 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 10 monclient: _renew_subs 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c13e690 con 0x7fa60c13c770 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc03c040 con 0x7fa60c13c770 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa608d72640 4 set_mon_vals no callback set 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa5f2ffd640 10 monclient: dump: 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.528 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 10 monclient: _renew_subs 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.513+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c0964e0 con 0x7fa60c13c770 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa610f51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa610f51640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 0x7fa60c0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c09b450 con 0x7fa60c09b070 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa5fc0374c0 con 0x7fa60c13c770 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 0x7fa60c0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient: get_auth_request con 0x7fa60c09b070 auth_method 0 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa5f2ffd640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5d803dd10 0x7fa5d80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(655..655 src has 323..655) ==== 4843+0+0 (secure 0 0 0) 0x7fa5fc078580 con 0x7fa60c13c770 2026-02-17T12:03:07.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 10 monclient(hunting): handle_auth_done global_id 204363 payload 824 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa60a575640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa60c06e4a0 con 0x7fa60c09b070 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa609d74640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5d803dd10 0x7fa5d80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.514+0000 7fa609d74640 10 monclient: get_auth_request con 0x7fa5d803dd10 auth_method 0 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa60a575640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 msgr2=0x7fa60c0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 0x7fa60c0728e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d720 tx=0x7fa60000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60000bb30 con 0x7fa60c09b070 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 10 monclient: dump: 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fa60000bb30 con 0x7fa60c09b070 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 msgr2=0x7fa60c0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 0x7fa60c0728e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d720 tx=0x7fa60000dbf0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 msgr2=0x7fa60c0728e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.516+0000 7fa5f2ffd640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c09b070 0x7fa60c0728e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.517+0000 7fa609d74640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5d803dd10 0x7fa5d80401d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009470 tx=0x7fa5f4009400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa610f51640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa610f51640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 0x7fa60c063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa610f51640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c09dac0 con 0x7fa60c0638c0 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 0x7fa60c063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient: get_auth_request con 0x7fa60c0638c0 auth_method 0 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 10 monclient(hunting): handle_auth_done global_id 204366 payload 824 2026-02-17T12:03:07.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.519+0000 7fa60a575640 1 -- 10.20.193.51:0/565446501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa60c072e20 con 0x7fa60c0638c0 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa60a575640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 msgr2=0x7fa60c063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa60a575640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 0x7fa60c063ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d720 tx=0x7fa600003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001c070 con 0x7fa60c0638c0 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 10 monclient: dump: 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7fa60001c070 con 0x7fa60c0638c0 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:07.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 msgr2=0x7fa60c063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 0x7fa60c063ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d720 tx=0x7fa600003860 comp rx=0 tx=0).stop 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 msgr2=0x7fa60c063ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa5f2ffd640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa60c0638c0 0x7fa60c063ca0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d720 tx=0x7fa600003860 comp rx=0 tx=0).stop 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 128288, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.533 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:07.534 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.535 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.536 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.537 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:07.538 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5d803dd10 msgr2=0x7fa5d80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa5d803dd10 0x7fa5d80401d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009470 tx=0x7fa5f4009400 comp rx=0 tx=0).stop 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 10 monclient: shutdown 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 msgr2=0x7fa60c09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 0x7fa60c09ab30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc036000 tx=0x7fa5fc004b40 comp rx=0 tx=0).stop 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa60ad76640 1 -- 10.20.193.51:0/565446501 reap_dead start 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 shutdown_connections 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 --2- 10.20.193.51:0/565446501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa60c13c770 0x7fa60c09ab30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 >> 10.20.193.51:0/565446501 conn(0x7fa60c0a30c0 msgr2=0x7fa60c13ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 shutdown_connections 2026-02-17T12:03:07.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.522+0000 7fa610f51640 1 -- 10.20.193.51:0/565446501 wait complete. 2026-02-17T12:03:07.540 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:07.540 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:03:07.540 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2846: done (3 left) 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2847: copy_from oid 21 from oid 1 current snap is 312 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: finishing write tid 1 to trial14245205-25 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: finishing write tid 2 to trial14245205-25 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: finishing write tid 3 to trial14245205-25 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: finishing write tid 4 to trial14245205-25 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: oid 25 updating version 0 to 2009 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: oid 25 version 2009 is already newer than 2008 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: oid 25 updating version 2009 to 2010 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2010 (ObjNum 967 snap 312 seq_num 967) dirty exists 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2843: left oid 25 (ObjNum 967 snap 312 seq_num 967) 2026-02-17T12:03:07.568 INFO:tasks.rados.rados.0.trial142.stdout:2845: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 10 monclient: get_monmap_and_config 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 10 monclient: monmap: 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:07.606301+0000 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:07.606301+0000 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:07.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 1 Processor -- start 2026-02-17T12:03:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 1 -- start start 2026-02-17T12:03:07.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 10 monclient: init 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.605+0000 7fbdaece8640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbda80a3bb0 0x7fbda809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-a con 0x7fbda80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbda80a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-b con 0x7fbda813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda806e140 con 0x7fbda80a0750 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fbda809f910 con 0x7fbda80a3bb0 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbda809ccd0 con 0x7fbda813b760 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaece8640 10 monclient(hunting): authenticate will time out at 1675.225085s 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbda80a3bb0 0x7fbda809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbda80a3bb0 0x7fbda809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50298/0 (socket says 10.20.193.51:50298) 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 -- 10.20.193.51:0/1228499661 learned_addr learned my addr 10.20.193.51:0/1228499661 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): get_auth_request con 0x7fbda80a3bb0 auth_method 0 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): get_auth_request con 0x7fbda813b760 auth_method 0 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_done global_id 204369 payload 274 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 -- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 msgr2=0x7fbda813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 -- 10.20.193.51:0/1228499661 >> v1:10.20.193.142:6789/0 conn(0x7fbda80a0750 legacy=0x7fbda809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdaca5d640 1 -- 10.20.193.51:0/1228499661 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda809eec0 con 0x7fbda80a3bb0 2026-02-17T12:03:07.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.606+0000 7fbdad25e640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.608+0000 7fbdaca5d640 1 -- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a3bb0 msgr2=0x7fbda809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.608+0000 7fbdaca5d640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a3bb0 0x7fbda809dac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbda806c1c0 tx=0x7fbd9802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e643f2415885dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 1 -- 10.20.193.51:0/1228499661 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9803c070 con 0x7fbda80a3bb0 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: dump: 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.618 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 1 -- 10.20.193.51:0/1228499661 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9802fca0 con 0x7fbda80a3bb0 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 5 monclient: authenticate success, global_id 204369 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 1 -- 10.20.193.51:0/1228499661 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98037660 con 0x7fbda80a3bb0 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbd9f7fe640 10 monclient: dump: 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.619 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 4 set_mon_vals no callback set 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 10 monclient: shutdown 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a3bb0 msgr2=0x7fbda809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a3bb0 0x7fbda809dac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbda806c1c0 tx=0x7fbd9802ee60 comp rx=0 tx=0).stop 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- 10.20.193.51:0/1228499661 shutdown_connections 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 --2- 10.20.193.51:0/1228499661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a3bb0 0x7fbda809dac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- 10.20.193.51:0/1228499661 >> 10.20.193.51:0/1228499661 conn(0x7fbda80a30c0 msgr2=0x7fbda80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- 10.20.193.51:0/1228499661 shutdown_connections 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- 10.20.193.51:0/1228499661 wait complete. 2026-02-17T12:03:07.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 10 monclient: monmap: 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 Processor -- start 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 1 -- start start 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.609+0000 7fbdaece8640 10 monclient: init 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-a con 0x7fbda80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbda80a3bb0 0x7fbda80955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-b con 0x7fbda80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda8095b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): picked mon.noname-c con 0x7fbda813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80a04b0 con 0x7fbda80a0750 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbda809c850 con 0x7fbda80a3bb0 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbda809e710 con 0x7fbda813b760 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaece8640 10 monclient(hunting): authenticate will time out at 1675.229166s 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda8095b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50314/0 (socket says 10.20.193.51:50314) 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 -- 10.20.193.51:0/3934864930 learned_addr learned my addr 10.20.193.51:0/3934864930 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): get_auth_request con 0x7fbda80a0750 auth_method 0 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): get_auth_request con 0x7fbda813b760 auth_method 0 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbd9ffff640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbda80a3bb0 0x7fbda80955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbd9ffff640 10 monclient(hunting): get_auth_request con 0x7fbda80a3bb0 auth_method 0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbd9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbd9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbd9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient(hunting): handle_auth_done global_id 204372 payload 824 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 msgr2=0x7fbda8095b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda8095b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbda80a3bb0 msgr2=0x7fbda80955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbda80a3bb0 0x7fbda80955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdaca5d640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda8098960 con 0x7fbda80a0750 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.610+0000 7fbdad25e640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda813b760 0x7fbda8095b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaca5d640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 msgr2=0x7fbda8095080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaca5d640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd98002410 tx=0x7fbd980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98046020 con 0x7fbda80a0750 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: dump: 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9802fe50 con 0x7fbda80a0750 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 5 monclient: authenticate success, global_id 204372 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 10 monclient: _renew_subs 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda8098c40 con 0x7fbda80a0750 2026-02-17T12:03:07.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9803c040 con 0x7fbda80a0750 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9d7fa640 10 monclient: dump: 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbd9effd640 4 set_mon_vals no callback set 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 10 monclient: _renew_subs 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.612+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda809d7b0 con 0x7fbda80a0750 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdaece8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdaece8640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 0x7fbda808d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbda80a2400 con 0x7fbda808d3f0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 0x7fbda808d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient: get_auth_request con 0x7fbda808d3f0 auth_method 0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbd9803f030 con 0x7fbda80a0750 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_done global_id 224126 payload 824 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9ffff640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbda809dac0 con 0x7fbda808d3f0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9d7fa640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbd7803dd10 0x7fbd780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7fbd98077370 con 0x7fbda80a0750 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdad25e640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbd7803dd10 0x7fbd780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.613+0000 7fbdad25e640 10 monclient: get_auth_request con 0x7fbd7803dd10 auth_method 0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9ffff640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 msgr2=0x7fbda808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9ffff640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 0x7fbda808d7d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd9000eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90006ae0 con 0x7fbda808d3f0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 10 monclient: dump: 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.626 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fbd90006ae0 con 0x7fbda808d3f0 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 msgr2=0x7fbda808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 0x7fbda808d7d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd9000eba0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 msgr2=0x7fbda808d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbd9d7fa640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808d3f0 0x7fbda808d7d0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd9000eba0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.615+0000 7fbdad25e640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbd7803dd10 0x7fbd780401d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbda806dab0 tx=0x7fbda400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbdaece8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbdaece8640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 0x7fbda81d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbdaece8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbda80974b0 con 0x7fbda808dd10 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 0x7fbda81d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient: get_auth_request con 0x7fbda808dd10 auth_method 0 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.618+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.619+0000 7fbd9ffff640 10 monclient(hunting): handle_auth_done global_id 224129 payload 824 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.619+0000 7fbd9ffff640 1 -- 10.20.193.51:0/3934864930 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbda80008d0 con 0x7fbda808dd10 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9ffff640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 msgr2=0x7fbda81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9ffff640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 0x7fbda81d98b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd90003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9000c900 con 0x7fbda808dd10 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 10 monclient: dump: 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.628 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fbd9000c900 con 0x7fbda808dd10 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 msgr2=0x7fbda81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 0x7fbda81d98b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd90003860 comp rx=0 tx=0).stop 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 msgr2=0x7fbda81d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbd9d7fa640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbda808dd10 0x7fbda81d98b0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbda8096590 tx=0x7fbd90003860 comp rx=0 tx=0).stop 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12450, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 7, 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.629 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:07.630 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.631 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.632 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:07.633 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:07.634 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbd7803dd10 msgr2=0x7fbd780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbd7803dd10 0x7fbd780401d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbda806dab0 tx=0x7fbda400b040 comp rx=0 tx=0).stop 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 10 monclient: shutdown 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 msgr2=0x7fbda8095080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd98002410 tx=0x7fbd980047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdad25e640 1 -- 10.20.193.51:0/3934864930 reap_dead start 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 shutdown_connections 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 --2- 10.20.193.51:0/3934864930 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbda80a0750 0x7fbda8095080 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 >> 10.20.193.51:0/3934864930 conn(0x7fbda80a30c0 msgr2=0x7fbda8072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 shutdown_connections 2026-02-17T12:03:07.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.621+0000 7fbdaece8640 1 -- 10.20.193.51:0/3934864930 wait complete. 2026-02-17T12:03:07.635 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:07.635 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:03:07.635 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2844: finishing copy_from racing read to trial14245205-27 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2844: finishing copy_from to trial14245205-27 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2552 (ObjNum 955 snap 310 seq_num 955) dirty exists 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2847: finishing copy_from to trial14245205-21 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2847: got expected ENOENT (src dne) 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2847: finishing copy_from racing read to trial14245205-21 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2843: done (3 left) 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2844: done (2 left) 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2845: done (1 left) 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2847: done (0 left) 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2848: write (excl) oid 6 current snap is 312 2026-02-17T12:03:07.700 INFO:tasks.rados.rados.0.trial142.stdout:2848: seq_num 968 ranges {669176=417863,1811746=457430} 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.701+0000 7f1439153640 10 monclient: get_monmap_and_config 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.701+0000 7f1439153640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.701+0000 7f1439153640 10 monclient: monmap: 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:07.702761+0000 2026-02-17T12:03:07.703 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:07.702761+0000 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:07.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.704 INFO:tasks.rados.rados.0.trial142.stdout:2848: writing trial14245205-6 from 669176 to 1087039 tid 1 2026-02-17T12:03:07.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 Processor -- start 2026-02-17T12:03:07.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 -- start start 2026-02-17T12:03:07.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient: init 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): picked mon.noname-b con 0x7f14340a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f14340a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 0x7f143413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): picked mon.noname-a con 0x7f143413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143406e140 con 0x7f14340a0750 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f143409f910 con 0x7f143413b760 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f143409ccd0 con 0x7f14340a3bb0 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1439153640 10 monclient(hunting): authenticate will time out at 1675.321549s 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 0x7f143413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39534/0 (socket says 10.20.193.51:39534) 2026-02-17T12:03:07.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 -- 10.20.193.51:0/335930901 learned_addr learned my addr 10.20.193.51:0/335930901 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): get_auth_request con 0x7f14340a3bb0 auth_method 0 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 1 --2- 10.20.193.51:0/335930901 >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 0x7f143413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50320/0 (socket says 10.20.193.51:50320) 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): get_auth_request con 0x7f143413b760 auth_method 0 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1433577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient(hunting): handle_auth_done global_id 224132 payload 274 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 -- 10.20.193.51:0/335930901 >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 msgr2=0x7f143413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 --2- 10.20.193.51:0/335930901 >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 0x7f143413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 -- 10.20.193.51:0/335930901 >> v1:10.20.193.142:6789/0 conn(0x7f14340a0750 legacy=0x7f143409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 monclient: found mon.noname-b 2026-02-17T12:03:07.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.702+0000 7f1432d76640 1 -- 10.20.193.51:0/335930901 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143409eec0 con 0x7f14340a3bb0 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2848: writing trial14245205-6 from 1811746 to 2269176 tid 2 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2849: copy_from oid 1 from oid 8 current snap is 312 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2848: finishing write tid 1 to trial14245205-6 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2850: read oid 10 snap 310 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2850: expect deleted 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2851: copy_from oid 40 from oid 28 current snap is 312 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2852: read oid 48 snap -1 2026-02-17T12:03:07.709 INFO:tasks.rados.rados.0.trial142.stdout:2852: expect (ObjNum 935 snap 303 seq_num 935) 2026-02-17T12:03:07.710 INFO:tasks.rados.rados.0.trial142.stdout:2853: snap_create 2026-02-17T12:03:07.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1432d76640 1 -- 10.20.193.51:0/335930901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 msgr2=0x7f143409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1432d76640 1 --2- 10.20.193.51:0/335930901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f143409f230 tx=0x7f142802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36cd2e38d632c17 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 1 -- 10.20.193.51:0/335930901 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142803c070 con 0x7f14340a3bb0 2026-02-17T12:03:07.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: dump: 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 1 -- 10.20.193.51:0/335930901 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142802fcc0 con 0x7f14340a3bb0 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 5 monclient: authenticate success, global_id 224132 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 1 -- 10.20.193.51:0/335930901 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428037660 con 0x7f14340a3bb0 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 4 set_mon_vals no callback set 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:07.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1431d74640 10 monclient: dump: 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 10 monclient: shutdown 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 -- 10.20.193.51:0/335930901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 msgr2=0x7f143409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 --2- 10.20.193.51:0/335930901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f143409f230 tx=0x7f142802ee80 comp rx=0 tx=0).stop 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 -- 10.20.193.51:0/335930901 shutdown_connections 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 --2- 10.20.193.51:0/335930901 >> v2:10.20.193.51:3300/0 conn(0x7f143413b760 0x7f143413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 --2- 10.20.193.51:0/335930901 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f143409dac0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 -- 10.20.193.51:0/335930901 >> 10.20.193.51:0/335930901 conn(0x7f14340a30c0 msgr2=0x7f14340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 -- 10.20.193.51:0/335930901 shutdown_connections 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.705+0000 7f1439153640 1 -- 10.20.193.51:0/335930901 wait complete. 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient: monmap: 2026-02-17T12:03:07.715 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 Processor -- start 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 -- start start 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient: init 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 0x7f1434095280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): picked mon.noname-a con 0x7f14340a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f14340957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): picked mon.noname-c con 0x7f14340a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f143413b760 0x7f1434095d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): picked mon.noname-b con 0x7f143413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:07.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f14340a04b0 con 0x7f14340a0750 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f143409c850 con 0x7f143413b760 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f143409e710 con 0x7f14340a3bb0 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1439153640 10 monclient(hunting): authenticate will time out at 1675.325647s 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 0x7f1434095280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f14340957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 0x7f1434095280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50322/0 (socket says 10.20.193.51:50322) 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 1 -- 10.20.193.51:0/374010404 learned_addr learned my addr 10.20.193.51:0/374010404 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): get_auth_request con 0x7f14340a0750 auth_method 0 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): get_auth_request con 0x7f14340a3bb0 auth_method 0 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1433577640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f143413b760 0x7f1434095d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1433577640 10 monclient(hunting): get_auth_request con 0x7f143413b760 auth_method 0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1433577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1433577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1433577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient(hunting): handle_auth_done global_id 224135 payload 824 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f143413b760 msgr2=0x7f1434095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f143413b760 0x7f1434095d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 msgr2=0x7f1434095280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 0x7f1434095280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 monclient: found mon.noname-c 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432575640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143409b9c0 con 0x7f14340a3bb0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.706+0000 7f1432d76640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f14340a0750 0x7f1434095280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432575640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 msgr2=0x7f14340957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432575640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f14340957c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1434074fa0 tx=0x7f141c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c016020 con 0x7f14340a3bb0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: dump: 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c012a60 con 0x7f14340a3bb0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 5 monclient: authenticate success, global_id 224135 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c012e50 con 0x7f14340a3bb0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1431573640 4 set_mon_vals no callback set 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 10 monclient: dump: 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 monclient: _renew_subs 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1434098d70 con 0x7f14340a3bb0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 monclient: _renew_subs 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14340984d0 con 0x7f14340a3bb0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 0x7f14340a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1434096a10 con 0x7f1434098710 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432d76640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 0x7f14340a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f141c01b400 con 0x7f14340a3bb0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432d76640 10 monclient: get_auth_request con 0x7f1434098710 auth_method 0 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.709+0000 7f1432d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f14137fe640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f140003df00 0x7f14000403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1432d76640 10 monclient(hunting): handle_auth_done global_id 184444 payload 824 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1432d76640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f143406f6a0 con 0x7f1434098710 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f141c052670 con 0x7f14340a3bb0 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1433577640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f140003df00 0x7f14000403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.710+0000 7f1433577640 10 monclient: get_auth_request con 0x7f140003df00 auth_method 0 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: finishing write tid 2 to trial14245205-6 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: finishing write tid 3 to trial14245205-6 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: finishing write tid 4 to trial14245205-6 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: oid 6 updating version 0 to 1970 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: oid 6 version 1970 is already newer than 1968 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: oid 6 version 1970 is already newer than 1969 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 1970 (ObjNum 968 snap 312 seq_num 968) dirty exists 2026-02-17T12:03:07.720 INFO:tasks.rados.rados.0.trial142.stdout:2848: left oid 6 (ObjNum 968 snap 312 seq_num 968) 2026-02-17T12:03:07.721 INFO:tasks.rados.rados.0.trial142.stdout:2849: finishing copy_from racing read to trial14245205-1 2026-02-17T12:03:07.721 INFO:tasks.rados.rados.0.trial142.stdout:2849: finishing copy_from to trial14245205-1 2026-02-17T12:03:07.721 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2142 (ObjNum 958 snap 310 seq_num 958) dirty exists 2026-02-17T12:03:07.721 INFO:tasks.rados.rados.0.trial142.stdout:2852: expect (ObjNum 935 snap 303 seq_num 935) 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f1432d76640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 msgr2=0x7f14340a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f1432d76640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 0x7f14340a0ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f14280090b0 tx=0x7f14280047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428045070 con 0x7f1434098710 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f1433577640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f140003df00 0x7f14000403c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fd0 tx=0x7f142400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 10 monclient: dump: 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1428041680 con 0x7f1434098710 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 msgr2=0x7f14340a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 0x7f14340a0ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f14280090b0 tx=0x7f14280047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 msgr2=0x7f14340a0ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.712+0000 7f14137fe640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1434098710 0x7f14340a0ec0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f14280090b0 tx=0x7f14280047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1439153640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1439153640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 0x7f14340a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1439153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1434139ab0 con 0x7f14340a1400 2026-02-17T12:03:07.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 0x7f14340a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient: get_auth_request con 0x7f14340a1400 auth_method 0 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 10 monclient(hunting): handle_auth_done global_id 184447 payload 824 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.716+0000 7f1432d76640 1 -- 10.20.193.51:0/374010404 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f143409dac0 con 0x7f14340a1400 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1432d76640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 msgr2=0x7f14340a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1432d76640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 0x7f14340a1810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1434096b90 tx=0x7f1428009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428045050 con 0x7f14340a1400 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 10 monclient: dump: 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f1428003920 con 0x7f14340a1400 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 msgr2=0x7f14340a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 0x7f14340a1810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1434096b90 tx=0x7f1428009340 comp rx=0 tx=0).stop 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 msgr2=0x7f14340a1810 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:07.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f14137fe640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f14340a1400 0x7f14340a1810 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1434096b90 tx=0x7f1428009340 comp rx=0 tx=0).stop 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 162, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 220105, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 7, 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:07.724 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:07.725 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:07.726 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.727 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.728 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:07.729 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:07.730 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f140003df00 msgr2=0x7f14000403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f140003df00 0x7f14000403c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fd0 tx=0x7f142400b040 comp rx=0 tx=0).stop 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 10 monclient: shutdown 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 msgr2=0x7f14340957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 --2- 10.20.193.51:0/374010404 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f14340a3bb0 0x7f14340957c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1434074fa0 tx=0x7f141c00c8f0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1433577640 1 -- 10.20.193.51:0/374010404 reap_dead start 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1433577640 1 -- 10.20.193.51:0/374010404 reap_dead start 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 shutdown_connections 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 >> 10.20.193.51:0/374010404 conn(0x7f14340a30c0 msgr2=0x7f143413a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 shutdown_connections 2026-02-17T12:03:07.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.719+0000 7f1439153640 1 -- 10.20.193.51:0/374010404 wait complete. 2026-02-17T12:03:07.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:07.732 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T12:03:07.732 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:03:07.732 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T12:03:07.732 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:03:07.732 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:03:07.732 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:03:07.740 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:03:07.741 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:03:07.741 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 10 monclient: get_monmap_and_config 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 10 monclient: monmap: 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:07.846392+0000 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:07.846392+0000 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:07.847 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 1 Processor -- start 2026-02-17T12:03:07.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 1 -- start start 2026-02-17T12:03:07.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.845+0000 7f1311691640 10 monclient: init 2026-02-17T12:03:07.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f130c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f130c0a0750 0x7f130c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): picked mon.noname-c con 0x7f130c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f130c13b760 0x7f130c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): picked mon.noname-a con 0x7f130c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c06e140 con 0x7f130c0a3bb0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f130c09f910 con 0x7f130c13b760 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f130c09ccd0 con 0x7f130c0a0750 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f1311691640 10 monclient(hunting): authenticate will time out at 1675.465159s 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f130c13b760 0x7f130c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f130c13b760 0x7f130c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50334/0 (socket says 10.20.193.51:50334) 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 -- 10.20.193.51:0/3470313442 learned_addr learned my addr 10.20.193.51:0/3470313442 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): get_auth_request con 0x7f130c13b760 auth_method 0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130a7fc640 1 --2- 10.20.193.51:0/3470313442 >> v2:10.20.193.142:3300/0 conn(0x7f130c0a0750 0x7f130c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130a7fc640 10 monclient(hunting): get_auth_request con 0x7f130c0a0750 auth_method 0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient(hunting): handle_auth_done global_id 204381 payload 274 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 -- 10.20.193.51:0/3470313442 >> v2:10.20.193.142:3300/0 conn(0x7f130c0a0750 msgr2=0x7f130c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 --2- 10.20.193.51:0/3470313442 >> v2:10.20.193.142:3300/0 conn(0x7f130c0a0750 0x7f130c09e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 -- 10.20.193.51:0/3470313442 >> v1:10.20.193.142:6789/0 conn(0x7f130c0a3bb0 legacy=0x7f130c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.846+0000 7f130b7fe640 1 -- 10.20.193.51:0/3470313442 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c09eec0 con 0x7f130c13b760 2026-02-17T12:03:07.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.848+0000 7f130b7fe640 1 -- 10.20.193.51:0/3470313442 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c13b760 msgr2=0x7f130c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.848+0000 7f130b7fe640 1 --2- 10.20.193.51:0/3470313442 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c13b760 0x7f130c13db50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f130c06f3c0 tx=0x7f12fc02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd104146985707a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 1 -- 10.20.193.51:0/3470313442 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc02fe60 con 0x7f130c13b760 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: dump: 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 5 monclient: authenticate success, global_id 204381 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 1 -- 10.20.193.51:0/3470313442 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12fc0373f0 con 0x7f130c13b760 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 1 -- 10.20.193.51:0/3470313442 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0377c0 con 0x7f130c13b760 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:07.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 4 set_mon_vals no callback set 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1309ffb640 10 monclient: dump: 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 10 monclient: shutdown 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- 10.20.193.51:0/3470313442 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c13b760 msgr2=0x7f130c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 --2- 10.20.193.51:0/3470313442 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c13b760 0x7f130c13db50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f130c06f3c0 tx=0x7f12fc02f230 comp rx=0 tx=0).stop 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- 10.20.193.51:0/3470313442 shutdown_connections 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 --2- 10.20.193.51:0/3470313442 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c13b760 0x7f130c13db50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 --2- 10.20.193.51:0/3470313442 >> v2:10.20.193.142:3300/0 conn(0x7f130c0a0750 0x7f130c09e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- 10.20.193.51:0/3470313442 >> 10.20.193.51:0/3470313442 conn(0x7f130c0a30c0 msgr2=0x7f130c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- 10.20.193.51:0/3470313442 shutdown_connections 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- 10.20.193.51:0/3470313442 wait complete. 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 10 monclient: build_initial_monmap 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 10 monclient: monmap: 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:07.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 Processor -- start 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 1 -- start start 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.849+0000 7f1311691640 10 monclient: init 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): picked mon.noname-a con 0x7f130c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 0x7f130c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): picked mon.noname-c con 0x7f130c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 0x7f130c13b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): picked mon.noname-b con 0x7f130c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f130c0a04b0 con 0x7f130c0a0750 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f130c09c850 con 0x7f130c13b760 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f130c09e710 con 0x7f130c0a3bb0 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f1311691640 10 monclient(hunting): authenticate will time out at 1675.469221s 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130a7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 msgr2=0x7f130c13acb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 0x7f130c13acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50346/0 (socket says 10.20.193.51:50346) 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 -- 10.20.193.51:0/2991231889 learned_addr learned my addr 10.20.193.51:0/2991231889 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): get_auth_request con 0x7f130c0a0750 auth_method 0 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:07.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130b7fe640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 0x7f130c13b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient(hunting): handle_auth_done global_id 204384 payload 824 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 -- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 msgr2=0x7f130c13acb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 0x7f130c13acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 -- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 msgr2=0x7f130c13b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 0x7f130c13b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient: _finish_hunting 0 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 monclient: found mon.noname-a 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130affd640 1 -- 10.20.193.51:0/2991231889 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c0998b0 con 0x7f130c0a0750 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130b7fe640 10 monclient: get_auth_request con 0x7f130c13b760 auth_method 0 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.850+0000 7f130b7fe640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 0x7f130c13b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f130affd640 1 -- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 msgr2=0x7f130c13a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:07.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f130affd640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f130000c5d0 tx=0x7f130000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300016020 con 0x7f130c0a0750 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: dump: 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.856 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1300012a60 con 0x7f130c0a0750 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 5 monclient: authenticate success, global_id 204384 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300012e50 con 0x7f130c0a0750 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f13097fa640 4 set_mon_vals no callback set 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f12eb7fe640 10 monclient: dump: 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.857 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 10 monclient: _renew_subs 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c09ad00 con 0x7f130c0a0750 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 10 monclient: _renew_subs 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.852+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c0a2470 con 0x7f130c0a0750 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f1311691640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f130001b400 con 0x7f130c0a0750 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f1311691640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f1311691640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130c0a2cb0 con 0x7f130c0a0750 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f12eb7fe640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 0x7f12d8040320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f1300052860 con 0x7f130c0a0750 2026-02-17T12:03:07.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f130a7fc640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 0x7f12d8040320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:07.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.853+0000 7f130a7fc640 10 monclient: get_auth_request con 0x7f12d803de60 auth_method 0 2026-02-17T12:03:07.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.856+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1300020030 con 0x7f130c0a0750 2026-02-17T12:03:07.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.856+0000 7f12eb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:07.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.856+0000 7f12eb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:07.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.856+0000 7f130a7fc640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 0x7f12d8040320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f130c098610 tx=0x7f12f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:07.914 INFO:tasks.rados.rados.0.trial142.stdout:2851: finishing copy_from racing read to trial14245205-40 2026-02-17T12:03:07.914 INFO:tasks.rados.rados.0.trial142.stdout:2851: finishing copy_from to trial14245205-40 2026-02-17T12:03:07.915 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 2135 (ObjNum 941 snap 304 seq_num 941) dirty exists 2026-02-17T12:03:07.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.969+0000 7f1311691640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.969+0000 7f1311691640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.969+0000 7f1311691640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.969+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f130c09dac0 con 0x7f130c0a0750 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.970+0000 7f12eb7fe640 1 -- 10.20.193.51:0/2991231889 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f130001b720 con 0x7f130c0a0750 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.970+0000 7f12eb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.970+0000 7f12eb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:07.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 msgr2=0x7f12d8040320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 0x7f12d8040320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f130c098610 tx=0x7f12f4008040 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 10 monclient: shutdown 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 msgr2=0x7f130c13a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f130000c5d0 tx=0x7f130000caa0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 shutdown_connections 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f12d803de60 0x7f12d8040320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f130c13b760 0x7f130c13b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f130c0a3bb0 0x7f130c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 --2- 10.20.193.51:0/2991231889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f130c0a0750 0x7f130c13a770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 >> 10.20.193.51:0/2991231889 conn(0x7f130c0a30c0 msgr2=0x7f130c0a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 shutdown_connections 2026-02-17T12:03:07.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:07.971+0000 7f1311691640 1 -- 10.20.193.51:0/2991231889 wait complete. 2026-02-17T12:03:10.981 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: get_monmap_and_config 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: build_initial_monmap 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: monmap: 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:11.050220+0000 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:11.050220+0000 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:11.051 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 Processor -- start 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 -- start start 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: init 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 0x7ff1a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff1a00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff1a013b760 0x7ff1a013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a006e140 con 0x7ff1a00a0750 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a009f910 con 0x7ff1a013b760 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a009ccd0 con 0x7ff1a00a3bb0 2026-02-17T12:03:11.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a71f8640 10 monclient(hunting): authenticate will time out at 1678.668976s 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.049+0000 7ff1a4f6d640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 msgr2=0x7ff1a009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a4f6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 0x7ff1a009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff1a013b760 0x7ff1a013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff197fff640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7ff1a00a0750 0x7ff1a009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:46322/0 (socket says 10.20.193.51:46322) 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff197fff640 1 -- 10.20.193.51:0/1038803989 learned_addr learned my addr 10.20.193.51:0/1038803989 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): get_auth_request con 0x7ff1a013b760 auth_method 0 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient(hunting): handle_auth_done global_id 184453 payload 274 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 -- 10.20.193.51:0/1038803989 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 msgr2=0x7ff1a009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 --2- 10.20.193.51:0/1038803989 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 0x7ff1a009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 -- 10.20.193.51:0/1038803989 >> v1:10.20.193.142:6789/0 conn(0x7ff1a00a0750 legacy=0x7ff1a009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient: _finish_hunting 0 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 monclient: found mon.noname-c 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:03:11.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.050+0000 7ff1a576e640 1 -- 10.20.193.51:0/1038803989 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a009eec0 con 0x7ff1a013b760 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a576e640 1 -- 10.20.193.51:0/1038803989 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a013b760 msgr2=0x7ff1a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a576e640 1 --2- 10.20.193.51:0/1038803989 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a013b760 0x7ff1a013db50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1a009f230 tx=0x7ff19c02f170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2542b91fea4087f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 1 -- 10.20.193.51:0/1038803989 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c03c070 con 0x7ff1a013b760 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: dump: 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 1 -- 10.20.193.51:0/1038803989 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19c037640 con 0x7ff1a013b760 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 5 monclient: authenticate success, global_id 184453 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:11.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 1 -- 10.20.193.51:0/1038803989 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c037a10 con 0x7ff1a013b760 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1977fe640 10 monclient: dump: 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 4 set_mon_vals no callback set 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 10 monclient: shutdown 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1038803989 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a013b760 msgr2=0x7ff1a013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1038803989 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a013b760 0x7ff1a013db50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1a009f230 tx=0x7ff19c02f170 comp rx=0 tx=0).stop 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1038803989 shutdown_connections 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1038803989 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a013b760 0x7ff1a013db50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1038803989 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a00a3bb0 0x7ff1a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1038803989 >> 10.20.193.51:0/1038803989 conn(0x7ff1a00a30c0 msgr2=0x7ff1a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1038803989 shutdown_connections 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1038803989 wait complete. 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 10 monclient: build_initial_monmap 2026-02-17T12:03:11.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.053+0000 7ff1a71f8640 10 monclient: monmap: 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 Processor -- start 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 -- start start 2026-02-17T12:03:11.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient: init 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-a con 0x7ff1a00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 0x7ff1a0094ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:11.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 0x7ff1a00950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a00a04b0 con 0x7ff1a00a0750 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a009c850 con 0x7ff1a00a3bb0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a009e710 con 0x7ff1a013b760 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a71f8640 10 monclient(hunting): authenticate will time out at 1678.673665s 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a576e640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 msgr2=0x7ff1a00950e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a576e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 0x7ff1a00950e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50356/0 (socket says 10.20.193.51:50356) 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 -- 10.20.193.51:0/1790936324 learned_addr learned my addr 10.20.193.51:0/1790936324 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): get_auth_request con 0x7ff1a00a0750 auth_method 0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 0x7ff1a0094ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 10 monclient(hunting): get_auth_request con 0x7ff1a00a3bb0 auth_method 0 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:11.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient(hunting): handle_auth_done global_id 204387 payload 824 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 -- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 msgr2=0x7ff1a00950e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 0x7ff1a00950e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 -- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 msgr2=0x7ff1a0094ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 0x7ff1a0094ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 monclient: found mon.noname-a 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff1a4f6d640 1 -- 10.20.193.51:0/1790936324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a0096c60 con 0x7ff1a00a0750 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.054+0000 7ff197fff640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 0x7ff1a0094ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a4f6d640 1 -- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 msgr2=0x7ff1a009c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a4f6d640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff19000b7b0 tx=0x7ff19000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190005270 con 0x7ff1a00a0750 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: dump: 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:11.062 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: _finish_auth 0 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: _check_auth_tickets 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 5 monclient: authenticate success, global_id 204387 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff190010070 con 0x7ff1a00a0750 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _renew_subs 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a009d7b0 con 0x7ff1a00a0750 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190005650 con 0x7ff1a00a0750 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff196ffd640 4 set_mon_vals no callback set 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 10 monclient: dump: 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _renew_subs 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a0098a90 con 0x7ff1a00a0750 2026-02-17T12:03:11.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff19001d030 con 0x7ff1a00a0750 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.057+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a009dac0 con 0x7ff1a00a0750 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.058+0000 7ff1957fa640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 0x7ff1700401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.058+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7ff190051c30 con 0x7ff1a00a0750 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.058+0000 7ff197fff640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 0x7ff1700401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.058+0000 7ff197fff640 10 monclient: get_auth_request con 0x7ff17003dcf0 auth_method 0 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.060+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff1a009d7b0 con 0x7ff1a00a0750 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.060+0000 7ff1957fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.060+0000 7ff1957fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:11.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.060+0000 7ff197fff640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 0x7ff1700401b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00963e0 tx=0x7ff188009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:11.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1a71f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:11.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1a71f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1a71f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1a006f6a0 con 0x7ff1a00a0750 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1957fa640 1 -- 10.20.193.51:0/1790936324 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7ff1a0096c60 con 0x7ff1a00a0750 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1957fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.182+0000 7ff1957fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:11.185 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:11.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 msgr2=0x7ff1700401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 0x7ff1700401b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00963e0 tx=0x7ff188009040 comp rx=0 tx=0).stop 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 10 monclient: shutdown 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 msgr2=0x7ff1a009c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff19000b7b0 tx=0x7ff19000bc80 comp rx=0 tx=0).stop 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 shutdown_connections 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff17003dcf0 0x7ff1700401b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff1a013b760 0x7ff1a00950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff1a00a3bb0 0x7ff1a0094ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 --2- 10.20.193.51:0/1790936324 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff1a00a0750 0x7ff1a009c230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:11.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 >> 10.20.193.51:0/1790936324 conn(0x7ff1a00a30c0 msgr2=0x7ff1a0072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:11.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 shutdown_connections 2026-02-17T12:03:11.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:11.183+0000 7ff1a71f8640 1 -- 10.20.193.51:0/1790936324 wait complete. 2026-02-17T12:03:14.193 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:14.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.259+0000 7f7a3a2b0640 10 monclient: get_monmap_and_config 2026-02-17T12:03:14.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.259+0000 7f7a3a2b0640 10 monclient: build_initial_monmap 2026-02-17T12:03:14.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.259+0000 7f7a3a2b0640 10 monclient: monmap: 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:14.260919+0000 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:14.260919+0000 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:14.265 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 Processor -- start 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 -- start start 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient: init 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 0x7f7a3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-b con 0x7f7a340a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7a340a0750 0x7f7a3409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-c con 0x7f7a340a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:14.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7a3409e540 0x7f7a3413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-a con 0x7f7a3409e540 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340a3f90 con 0x7f7a3409e540 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3406e140 con 0x7f7a340a0750 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3409f910 con 0x7f7a340a3bb0 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a3a2b0640 10 monclient(hunting): authenticate will time out at 1681.879669s 2026-02-17T12:03:14.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a33fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 msgr2=0x7f7a3409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a33fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 0x7f7a3409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7a3409e540 0x7f7a3413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7a3409e540 0x7f7a3413c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50358/0 (socket says 10.20.193.51:50358) 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 -- 10.20.193.51:0/4263717477 learned_addr learned my addr 10.20.193.51:0/4263717477 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): get_auth_request con 0x7f7a3409e540 auth_method 0 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:14.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a337fe640 1 --2- 10.20.193.51:0/4263717477 >> v2:10.20.193.142:3300/0 conn(0x7f7a340a0750 0x7f7a3409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a337fe640 10 monclient(hunting): get_auth_request con 0x7f7a340a0750 auth_method 0 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient(hunting): handle_auth_done global_id 204390 payload 274 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 -- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 msgr2=0x7f7a3409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 --2- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 0x7f7a3409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 -- 10.20.193.51:0/4263717477 >> v2:10.20.193.142:3300/0 conn(0x7f7a340a0750 msgr2=0x7f7a3409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 --2- 10.20.193.51:0/4263717477 >> v2:10.20.193.142:3300/0 conn(0x7f7a340a0750 0x7f7a3409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 10 monclient: _finish_hunting 0 2026-02-17T12:03:14.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 1 monclient: found mon.noname-a 2026-02-17T12:03:14.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.260+0000 7f7a38826640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:14.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.261+0000 7f7a38826640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:14.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.261+0000 7f7a38826640 1 -- 10.20.193.51:0/4263717477 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3409ccd0 con 0x7f7a3409e540 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a38826640 1 -- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a3409e540 msgr2=0x7f7a3413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a38826640 1 --2- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a3409e540 0x7f7a3413c760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a34069d60 tx=0x7f7a2802f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eaf8f74b54ad34 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 1 -- 10.20.193.51:0/4263717477 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280373f0 con 0x7f7a3409e540 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: dump: 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:14.277 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: _finish_auth 0 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 5 monclient: authenticate success, global_id 204390 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 1 -- 10.20.193.51:0/4263717477 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a28037590 con 0x7f7a3409e540 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 1 -- 10.20.193.51:0/4263717477 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a28037960 con 0x7f7a3409e540 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 4 set_mon_vals no callback set 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:14.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a32ffd640 10 monclient: dump: 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 10 monclient: shutdown 2026-02-17T12:03:14.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a3409e540 msgr2=0x7f7a3413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.263+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a3409e540 0x7f7a3413c760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a34069d60 tx=0x7f7a2802f200 comp rx=0 tx=0).stop 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/4263717477 shutdown_connections 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a3409e540 0x7f7a3413c760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/4263717477 >> v2:10.20.193.142:3300/0 conn(0x7f7a340a0750 0x7f7a3409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/4263717477 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a340a3bb0 0x7f7a3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/4263717477 >> 10.20.193.51:0/4263717477 conn(0x7f7a340a30c0 msgr2=0x7f7a340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/4263717477 shutdown_connections 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/4263717477 wait complete. 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 10 monclient: build_initial_monmap 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 10 monclient: monmap: 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:14.281 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 Processor -- start 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 1 -- start start 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.264+0000 7f7a3a2b0640 10 monclient: init 2026-02-17T12:03:14.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 0x7f7a34137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-c con 0x7f7a3409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-a con 0x7f7a340a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a340a3bb0 0x7f7a34131350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): picked mon.noname-b con 0x7f7a340a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340a04b0 con 0x7f7a340a0750 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3409c850 con 0x7f7a340a3bb0 2026-02-17T12:03:14.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3413cca0 con 0x7f7a3409e540 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a33fff640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 msgr2=0x7f7a34137190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a3a2b0640 10 monclient(hunting): authenticate will time out at 1681.884068s 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a33fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 0x7f7a34137190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:50372/0 (socket says 10.20.193.51:50372) 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 -- 10.20.193.51:0/3485579302 learned_addr learned my addr 10.20.193.51:0/3485579302 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): get_auth_request con 0x7f7a340a0750 auth_method 0 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:14.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a38826640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a340a3bb0 0x7f7a34131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a38826640 10 monclient(hunting): get_auth_request con 0x7f7a340a3bb0 auth_method 0 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a38826640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a38826640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a38826640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient(hunting): handle_auth_done global_id 204393 payload 824 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 -- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 msgr2=0x7f7a34137190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 0x7f7a34137190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 -- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a340a3bb0 msgr2=0x7f7a34131350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:14.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a340a3bb0 0x7f7a34131350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.265+0000 7f7a337fe640 1 -- 10.20.193.51:0/3485579302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3406f410 con 0x7f7a340a0750 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a337fe640 1 -- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 msgr2=0x7f7a34130e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a337fe640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400e7d0 tx=0x7f7a2400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a337fe640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400e7d0 tx=0x7f7a2400eca0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f7a24017020 mon_map magic: 0 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24017020 con 0x7f7a340a0750 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:14.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: dump: 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: _finish_auth 0 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:03:14.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24004440 con 0x7f7a340a0750 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 5 monclient: authenticate success, global_id 204393 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 10 monclient: _renew_subs 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3409d7b0 con 0x7f7a340a0750 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a30ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a327fc640 4 set_mon_vals no callback set 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 10 monclient: _renew_subs 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.267+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a34134110 con 0x7f7a340a0750 2026-02-17T12:03:14.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400f040 con 0x7f7a340a0750 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 10 monclient: dump: 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:14.289 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7a24012050 con 0x7f7a340a0750 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a3a2b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a3a2b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a3a2b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3409dac0 con 0x7f7a340a0750 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a30ff9640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 0x7f7a040401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a33fff640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 0x7f7a040401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.268+0000 7f7a33fff640 10 monclient: get_auth_request con 0x7f7a0403dcf0 auth_method 0 2026-02-17T12:03:14.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.270+0000 7f7a337fe640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400e7d0 tx=0x7f7a2400eca0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f7a24021020 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-17T12:03:14.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.271+0000 7f7a33fff640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 0x7f7a040401b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7a20003a80 tx=0x7f7a20009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:14.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:14.890+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f7a240525d0 con 0x7f7a340a0750 2026-02-17T12:03:15.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.098+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7a24021020 con 0x7f7a340a0750 2026-02-17T12:03:15.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.098+0000 7f7a30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:15.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.098+0000 7f7a30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:15.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a3a2b0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:15.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a3a2b0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:15.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a3a2b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:15.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7a340008d0 con 0x7f7a340a0750 2026-02-17T12:03:15.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a30ff9640 1 -- 10.20.193.51:0/3485579302 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f7a24050f90 con 0x7f7a340a0750 2026-02-17T12:03:15.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:15.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.213+0000 7f7a30ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:15.217 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:15.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 msgr2=0x7f7a040401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:15.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 0x7f7a040401b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7a20003a80 tx=0x7f7a20009270 comp rx=0 tx=0).stop 2026-02-17T12:03:15.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 10 monclient: shutdown 2026-02-17T12:03:15.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:15.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 msgr2=0x7f7a34130e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400e7d0 tx=0x7f7a2400eca0 comp rx=0 tx=0).stop 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 shutdown_connections 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a0403dcf0 0x7f7a040401b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a340a3bb0 0x7f7a34131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a340a0750 0x7f7a34130e10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:15.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 --2- 10.20.193.51:0/3485579302 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a3409e540 0x7f7a34137190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:15.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 >> 10.20.193.51:0/3485579302 conn(0x7f7a340a30c0 msgr2=0x7f7a34072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:15.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 shutdown_connections 2026-02-17T12:03:15.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:15.214+0000 7f7a3a2b0640 1 -- 10.20.193.51:0/3485579302 wait complete. 2026-02-17T12:03:18.226 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:18.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: get_monmap_and_config 2026-02-17T12:03:18.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: build_initial_monmap 2026-02-17T12:03:18.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: monmap: 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:18.295248+0000 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:18.295248+0000 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:18.301 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:18.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 Processor -- start 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 -- start start 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: init 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:18.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-c con 0x7f17e40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-a con 0x7f17e409dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f17e409ff40 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e406e140 con 0x7f17e409ff40 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f17e409aed0 con 0x7f17e409dac0 2026-02-17T12:03:18.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f17e409caa0 con 0x7f17e40a3bb0 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.294+0000 7f17ebd6a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17ebd6a640 10 monclient(hunting): authenticate will time out at 1685.914016s 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34394/0 (socket says 10.20.193.51:34394) 2026-02-17T12:03:18.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 learned_addr learned my addr 10.20.193.51:0/1750287683 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17e409dac0 auth_method 0 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:18.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 10 monclient(hunting): get_auth_request con 0x7f17e40a3bb0 auth_method 0 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:18.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:18.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.295+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:18.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.297+0000 7f17ea2e0640 1 -- 10.20.193.51:0/1750287683 >> v1:10.20.193.142:6789/0 conn(0x7f17e409ff40 legacy=0x7f17e413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:18.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17e409dac0 auth_method 0 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 10 monclient(hunting): get_auth_request con 0x7f17e40a3bb0 auth_method 0 2026-02-17T12:03:18.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.496+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17e409dac0 auth_method 0 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:18.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 10 monclient(hunting): get_auth_request con 0x7f17e40a3bb0 auth_method 0 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:18.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:18.897+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:19.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:19.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17e409dac0 auth_method 0 2026-02-17T12:03:19.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:19.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:19.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 10 monclient(hunting): get_auth_request con 0x7f17e40a3bb0 auth_method 0 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:19.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:19.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:19.698+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): tick 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 monclient(hunting): continuing hunt 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 msgr2=0x7f17e409f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.142:3300/0 conn(0x7f17e40a3bb0 0x7f17e409f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 -- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 msgr2=0x7f17e409fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 --2- 10.20.193.51:0/1750287683 >> v2:10.20.193.51:3300/0 conn(0x7f17e409dac0 0x7f17e409fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 -- 10.20.193.51:0/1750287683 >> v1:10.20.193.142:6789/0 conn(0x7f17e409ff40 legacy=0x7f17e413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient: _add_conns ranks=[2,0] 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 0x7f17c8005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): picked mon.noname-b con 0x7f17c80037f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f17c8006350 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 -- 10.20.193.51:0/1750287683 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e409ce60 con 0x7f17c8006350 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 1 -- 10.20.193.51:0/1750287683 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17e409aed0 con 0x7f17c80037f0 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17d37fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 msgr2=0x7f17c8005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:21.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.295+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 0x7f17c8005c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:21.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.297+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> v1:10.20.193.51:6789/0 conn(0x7f17c8006350 legacy=0x7f17c8008810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:21.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.496+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 msgr2=0x7f17c8005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:21.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.496+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 0x7f17c8005c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:21.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.897+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 msgr2=0x7f17c8005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:21.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:21.897+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 0x7f17c8005c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130995614 0 0) 0x7f17e409ce60 con 0x7f17c8006350 2026-02-17T12:03:22.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): _negotiate 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): my global_id is 204396 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17cc003620 con 0x7f17c8006350 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1894434953 0 0) 0x7f17cc003620 con 0x7f17c8006350 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 msgr2=0x7f17c8005c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17c80037f0 0x7f17c8005c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c800b210 con 0x7f17c8006350 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f17d80096c0 con 0x7f17c8006350 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:03:22.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: dump: 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 >> v1:10.20.193.51:6789/0 conn(0x7f17c8006350 legacy=0x7f17c8008810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ea2e0640 1 -- 10.20.193.51:0/1750287683 reap_dead start 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17cc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): picked mon.c con 0x7f17cc003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 0x7f17cc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): picked mon.a con 0x7f17cc004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 0x7f17cc00bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): picked mon.b con 0x7f17cc005470 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f17e409aed0 con 0x7f17cc004900 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc00c3c0 con 0x7f17cc005470 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17cc00c5c0 con 0x7f17cc003ab0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e8add640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e9adf640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 msgr2=0x7f17cc003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e9adf640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17cc003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 0x7f17cc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17cc004900 auth_method 0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ea2e0640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 0x7f17cc00bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient(hunting): handle_auth_done global_id 204396 payload 293 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 msgr2=0x7f17cc003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:22.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17cc003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 msgr2=0x7f17cc00bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 0x7f17cc00bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 monclient: found mon.a 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc003620 con 0x7f17cc004900 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17e92de640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ebd6a640 5 monclient: authenticate success, global_id 204396 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ebd6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ea2e0640 10 monclient: get_auth_request con 0x7f17cc005470 auth_method 0 2026-02-17T12:03:22.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.574+0000 7f17ea2e0640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 0x7f17cc00bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e92de640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 msgr2=0x7f17cc004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e92de640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 0x7f17cc004d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006fd0 tx=0x7f17d8030080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f8a510f458cbc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8036070 con 0x7f17cc004900 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: dump: 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.585 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d8030aa0 con 0x7f17cc004900 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 1 -- 10.20.193.51:0/1750287683 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8004040 con 0x7f17cc004900 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 4 set_mon_vals no callback set 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17e8add640 10 monclient: dump: 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 10 monclient: shutdown 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 -- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 msgr2=0x7f17cc004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 0x7f17cc004d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006fd0 tx=0x7f17d8030080 comp rx=0 tx=0).stop 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 -- 10.20.193.51:0/1750287683 shutdown_connections 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc005470 0x7f17cc00bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc004900 0x7f17cc004d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/1750287683 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17cc003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 -- 10.20.193.51:0/1750287683 >> 10.20.193.51:0/1750287683 conn(0x7f17e40a30c0 msgr2=0x7f17e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 -- 10.20.193.51:0/1750287683 shutdown_connections 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.577+0000 7f17ebd6a640 1 -- 10.20.193.51:0/1750287683 wait complete. 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient: build_initial_monmap 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient: monmap: 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:22.587 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 Processor -- start 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 -- start start 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient: init 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17e4099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-c con 0x7f17cc003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 0x7f17e4094c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-b con 0x7f17cc004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): picked mon.noname-a con 0x7f17cc005470 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f17e409a880 con 0x7f17cc005470 2026-02-17T12:03:22.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17e40a3f90 con 0x7f17cc004900 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f17e40a0370 con 0x7f17cc003ab0 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ebd6a640 10 monclient(hunting): authenticate will time out at 1690.197929s 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17e9adf640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 msgr2=0x7f17e4099de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17e9adf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17e4099de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.578+0000 7f17ea2e0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34430/0 (socket says 10.20.193.51:34430) 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 -- 10.20.193.51:0/195764531 learned_addr learned my addr 10.20.193.51:0/195764531 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): get_auth_request con 0x7f17cc005470 auth_method 0 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 0x7f17e4094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 10 monclient(hunting): get_auth_request con 0x7f17cc004900 auth_method 0 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient(hunting): handle_auth_done global_id 204399 payload 824 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 -- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 msgr2=0x7f17e4099de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17e4099de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 -- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 msgr2=0x7f17e4094c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 0x7f17e4094c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 monclient: found mon.noname-a 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17ea2e0640 1 -- 10.20.193.51:0/195764531 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e4097190 con 0x7f17cc005470 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.579+0000 7f17e92de640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 0x7f17e4094c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ea2e0640 1 -- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 msgr2=0x7f17e40951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ea2e0640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17e40a0be0 tx=0x7f17e000df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e000be30 con 0x7f17cc005470 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: dump: 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 5 monclient: authenticate success, global_id 204399 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e0017070 con 0x7f17cc005470 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 10 monclient: _renew_subs 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e40988c0 con 0x7f17cc005470 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0012650 con 0x7f17cc005470 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d3fff640 4 set_mon_vals no callback set 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17d27fc640 10 monclient: dump: 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.592 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 10 monclient: _renew_subs 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.581+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e40a2b00 con 0x7f17cc005470 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f17e00127f0 con 0x7f17cc005470 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17ebd6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17ebd6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17ebd6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e406a290 con 0x7f17cc005470 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17d27fc640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 0x7f17b4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f17e0052c80 con 0x7f17cc005470 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17e9adf640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 0x7f17b4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.582+0000 7f17e9adf640 10 monclient: get_auth_request con 0x7f17b403dcc0 auth_method 0 2026-02-17T12:03:22.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.584+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f17e406a290 con 0x7f17cc005470 2026-02-17T12:03:22.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.584+0000 7f17d27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.584+0000 7f17d27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:22.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.585+0000 7f17e9adf640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 0x7f17b4040180 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f17d4006fb0 tx=0x7f17d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17ebd6a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:22.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17ebd6a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:22.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17ebd6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f17e409c170 con 0x7f17cc005470 2026-02-17T12:03:22.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17d27fc640 1 -- 10.20.193.51:0/195764531 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f17e409c170 con 0x7f17cc005470 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17d27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.702+0000 7f17d27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":166,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 msgr2=0x7f17b4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 0x7f17b4040180 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f17d4006fb0 tx=0x7f17d4008040 comp rx=0 tx=0).stop 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 10 monclient: shutdown 2026-02-17T12:03:22.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 msgr2=0x7f17e40951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17e40a0be0 tx=0x7f17e000df20 comp rx=0 tx=0).stop 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 shutdown_connections 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f17b403dcc0 0x7f17b4040180 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f17cc005470 0x7f17e40951a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f17cc004900 0x7f17e4094c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 --2- 10.20.193.51:0/195764531 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f17cc003ab0 0x7f17e4099de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 >> 10.20.193.51:0/195764531 conn(0x7f17e40a30c0 msgr2=0x7f17e409e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 shutdown_connections 2026-02-17T12:03:22.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.703+0000 7f17ebd6a640 1 -- 10.20.193.51:0/195764531 wait complete. 2026-02-17T12:03:22.714 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:03:22.715 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:03:22.715 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:03:22.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.779+0000 7f768359e640 10 monclient: get_monmap_and_config 2026-02-17T12:03:22.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.779+0000 7f768359e640 10 monclient: build_initial_monmap 2026-02-17T12:03:22.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.779+0000 7f768359e640 10 monclient: monmap: 2026-02-17T12:03:22.784 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:22.780882+0000 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:22.780882+0000 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:22.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 Processor -- start 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 -- start start 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient: init 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f767c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f767c0a0750 0x7f767c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): picked mon.noname-c con 0x7f767c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 0x7f767c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): picked mon.noname-b con 0x7f767c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c06e140 con 0x7f767c0a3bb0 2026-02-17T12:03:22.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f767c09f910 con 0x7f767c0a0750 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f767c09ccd0 con 0x7f767c13b760 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f768359e640 10 monclient(hunting): authenticate will time out at 1690.399636s 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7681b14640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 msgr2=0x7f767c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7681b14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 0x7f767c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7681313640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f767c0a3bb0 0x7f767c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:51314/0 (socket says 10.20.193.51:51314) 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7681313640 1 -- 10.20.193.51:0/3107672823 learned_addr learned my addr 10.20.193.51:0/3107672823 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 1 --2- 10.20.193.51:0/3107672823 >> v2:10.20.193.142:3300/0 conn(0x7f767c0a0750 0x7f767c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): get_auth_request con 0x7f767c0a0750 auth_method 0 2026-02-17T12:03:22.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.780+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 10 monclient(hunting): handle_auth_done global_id 184468 payload 274 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 1 -- 10.20.193.51:0/3107672823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 msgr2=0x7f767c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 1 --2- 10.20.193.51:0/3107672823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 0x7f767c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 1 -- 10.20.193.51:0/3107672823 >> v1:10.20.193.142:6789/0 conn(0x7f767c0a3bb0 legacy=0x7f767c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 1 monclient: found mon.noname-c 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:03:22.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.781+0000 7f7680b12640 1 -- 10.20.193.51:0/3107672823 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c09eec0 con 0x7f767c0a0750 2026-02-17T12:03:22.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f7680b12640 1 -- 10.20.193.51:0/3107672823 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c0a0750 msgr2=0x7f767c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f7680b12640 1 --2- 10.20.193.51:0/3107672823 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c0a0750 0x7f767c09e1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f767c06f3c0 tx=0x7f767002ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7454c83703dbbe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 1 -- 10.20.193.51:0/3107672823 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767003c070 con 0x7f767c0a0750 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: dump: 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.801 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f768359e640 5 monclient: authenticate success, global_id 184468 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 1 -- 10.20.193.51:0/3107672823 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767002fcd0 con 0x7f767c0a0750 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f768359e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 1 -- 10.20.193.51:0/3107672823 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037660 con 0x7f767c0a0750 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f768359e640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f768359e640 4 set_mon_vals no callback set 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.783+0000 7f766bfff640 10 monclient: dump: 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: shutdown 2026-02-17T12:03:22.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- 10.20.193.51:0/3107672823 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c0a0750 msgr2=0x7f767c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- 10.20.193.51:0/3107672823 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c0a0750 0x7f767c09e1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f767c06f3c0 tx=0x7f767002ed70 comp rx=0 tx=0).stop 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- 10.20.193.51:0/3107672823 shutdown_connections 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- 10.20.193.51:0/3107672823 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c13b760 0x7f767c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- 10.20.193.51:0/3107672823 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c0a0750 0x7f767c09e1d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- 10.20.193.51:0/3107672823 >> 10.20.193.51:0/3107672823 conn(0x7f767c0a30c0 msgr2=0x7f767c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- 10.20.193.51:0/3107672823 shutdown_connections 2026-02-17T12:03:22.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- 10.20.193.51:0/3107672823 wait complete. 2026-02-17T12:03:22.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: build_initial_monmap 2026-02-17T12:03:22.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: monmap: 2026-02-17T12:03:22.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.807 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 Processor -- start 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- start start 2026-02-17T12:03:22.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: init 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c0a0750 0x7f767c09bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): picked mon.noname-c con 0x7f767c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 0x7f767c09c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): picked mon.noname-a con 0x7f767c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c13b760 0x7f767c095810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): picked mon.noname-b con 0x7f767c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0a04b0 con 0x7f767c0a3bb0 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f767c09c850 con 0x7f767c13b760 2026-02-17T12:03:22.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f767c09e710 con 0x7f767c0a0750 2026-02-17T12:03:22.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f768359e640 10 monclient(hunting): authenticate will time out at 1690.403923s 2026-02-17T12:03:22.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f7681313640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c0a0750 msgr2=0x7f767c09bbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f7681313640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c0a0750 0x7f767c09bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.784+0000 7f7680b12640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 0x7f767c09c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 0x7f767c09c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34440/0 (socket says 10.20.193.51:34440) 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 -- 10.20.193.51:0/2932568523 learned_addr learned my addr 10.20.193.51:0/2932568523 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): get_auth_request con 0x7f767c0a3bb0 auth_method 0 2026-02-17T12:03:22.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7681b14640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c13b760 0x7f767c095810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7681b14640 10 monclient(hunting): get_auth_request con 0x7f767c13b760 auth_method 0 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7681b14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7681b14640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7681b14640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient(hunting): handle_auth_done global_id 204402 payload 824 2026-02-17T12:03:22.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c0a0750 msgr2=0x7f767c09bbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f767c0a0750 0x7f767c09bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c13b760 msgr2=0x7f767c095810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f767c13b760 0x7f767c095810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 monclient: found mon.noname-a 2026-02-17T12:03:22.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.785+0000 7f7680b12640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0993a0 con 0x7f767c0a3bb0 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7680b12640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 msgr2=0x7f767c09c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7680b12640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 0x7f767c09c100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76700099a0 tx=0x7f76700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670046070 con 0x7f767c0a3bb0 2026-02-17T12:03:22.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: dump: 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.817 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670041870 con 0x7f767c0a3bb0 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 5 monclient: authenticate success, global_id 204402 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 monclient: _renew_subs 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c099680 con 0x7f767c0a3bb0 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767003c040 con 0x7f767c0a3bb0 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f7669ffb640 10 monclient: dump: 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.820 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f766b7fe640 4 set_mon_vals no callback set 2026-02-17T12:03:22.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 monclient: _renew_subs 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c09d7b0 con 0x7f767c0a3bb0 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 0x7f767c095d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.787+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06ff30 con 0x7f767c1cfcb0 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 0x7f767c095d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7670041c60 con 0x7f767c0a3bb0 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient: get_auth_request con 0x7f767c1cfcb0 auth_method 0 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7669ffb640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f764c03dcc0 0x7f764c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 10 monclient(hunting): handle_auth_done global_id 204405 payload 824 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681313640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f767c09dac0 con 0x7f767c1cfcb0 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f7670077ee0 con 0x7f767c0a3bb0 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681b14640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f764c03dcc0 0x7f764c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.788+0000 7f7681b14640 10 monclient: get_auth_request con 0x7f764c03dcc0 auth_method 0 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7681313640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 msgr2=0x7f767c095d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7681313640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 0x7f767c095d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c007270 con 0x7f767c1cfcb0 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 10 monclient: dump: 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.825 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f766c007270 con 0x7f767c1cfcb0 2026-02-17T12:03:22.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 msgr2=0x7f767c095d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 0x7f767c095d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c00c900 comp rx=0 tx=0).stop 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 msgr2=0x7f767c095d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7669ffb640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c1cfcb0 0x7f767c095d50 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c00c900 comp rx=0 tx=0).stop 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.790+0000 7f7681b14640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f764c03dcc0 0x7f764c040180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f767c099b70 tx=0x7f76780094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f768359e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f768359e640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 0x7f767c1dadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f768359e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f767c096670 con 0x7f767c096290 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 0x7f767c1dadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient: get_auth_request con 0x7f767c096290 auth_method 0 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 10 monclient(hunting): handle_auth_done global_id 204408 payload 824 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.793+0000 7f7681313640 1 -- 10.20.193.51:0/2932568523 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f767c0977f0 con 0x7f767c096290 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.795+0000 7f7681313640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 msgr2=0x7f767c1dadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.795+0000 7f7681313640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 0x7f767c1dadb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c024450 con 0x7f767c096290 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 10 monclient: dump: 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.830 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4700 (secure 0 0 0) 0x7f766c012400 con 0x7f767c096290 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 msgr2=0x7f767c1dadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 0x7f767c1dadb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c004ad0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 msgr2=0x7f767c1dadb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:22.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7669ffb640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c096290 0x7f767c1dadb0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c430 tx=0x7f766c004ad0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.832 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:22.832 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:22.832 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:22.832 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 166, 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 143562, 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:22.833 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.834 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.835 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:22.836 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:22.837 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.838 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:22.839 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.840 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:22.841 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.842 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.843 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.844 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.845 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.846 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:22.847 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f764c03dcc0 msgr2=0x7f764c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f764c03dcc0 0x7f764c040180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f767c099b70 tx=0x7f76780094f0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 10 monclient: shutdown 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 msgr2=0x7f767c09c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 --2- 10.20.193.51:0/2932568523 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f767c0a3bb0 0x7f767c09c100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76700099a0 tx=0x7f76700047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7681b14640 1 -- 10.20.193.51:0/2932568523 reap_dead start 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f7681b14640 1 -- 10.20.193.51:0/2932568523 reap_dead start 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 shutdown_connections 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 >> 10.20.193.51:0/2932568523 conn(0x7f767c0a30c0 msgr2=0x7f767c0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 shutdown_connections 2026-02-17T12:03:22.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.796+0000 7f768359e640 1 -- 10.20.193.51:0/2932568523 wait complete. 2026-02-17T12:03:22.849 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:03:22.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:03:22.850 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.916+0000 7f6c85854640 10 monclient: get_monmap_and_config 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.916+0000 7f6c85854640 10 monclient: build_initial_monmap 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.916+0000 7f6c85854640 10 monclient: monmap: 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:22.917662+0000 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:22.917662+0000 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:22.918 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 Processor -- start 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 -- start start 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient: init 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6c800a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c800a0750 0x7f6c8009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-a con 0x7f6c800a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6c8013b760 0x7f6c8013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-c con 0x7f6c8013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8006e140 con 0x7f6c800a3bb0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8009f910 con 0x7f6c800a0750 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8009ccd0 con 0x7f6c8013b760 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c85854640 10 monclient(hunting): authenticate will time out at 1690.536449s 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c800a0750 0x7f6c8009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6c800a0750 0x7f6c8009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34460/0 (socket says 10.20.193.51:34460) 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 -- 10.20.193.51:0/1864085072 learned_addr learned my addr 10.20.193.51:0/1864085072 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): get_auth_request con 0x7f6c800a0750 auth_method 0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 1 --2- 10.20.193.51:0/1864085072 >> v2:10.20.193.142:3300/0 conn(0x7f6c8013b760 0x7f6c8013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): get_auth_request con 0x7f6c8013b760 auth_method 0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient(hunting): handle_auth_done global_id 204411 payload 274 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 -- 10.20.193.51:0/1864085072 >> v2:10.20.193.142:3300/0 conn(0x7f6c8013b760 msgr2=0x7f6c8013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 --2- 10.20.193.51:0/1864085072 >> v2:10.20.193.142:3300/0 conn(0x7f6c8013b760 0x7f6c8013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 -- 10.20.193.51:0/1864085072 >> v1:10.20.193.142:6789/0 conn(0x7f6c800a3bb0 legacy=0x7f6c8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 monclient: found mon.noname-a 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.917+0000 7f6c7e7fc640 1 -- 10.20.193.51:0/1864085072 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8009eec0 con 0x7f6c800a0750 2026-02-17T12:03:22.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7e7fc640 1 -- 10.20.193.51:0/1864085072 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c800a0750 msgr2=0x7f6c8009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7e7fc640 1 --2- 10.20.193.51:0/1864085072 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c800a0750 0x7f6c8009e1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c8009f5f0 tx=0x7f6c6802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a49780631a861ff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 1 -- 10.20.193.51:0/1864085072 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6803c070 con 0x7f6c800a0750 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: dump: 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 1 -- 10.20.193.51:0/1864085072 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6802fca0 con 0x7f6c800a0750 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 1 -- 10.20.193.51:0/1864085072 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037660 con 0x7f6c800a0750 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 5 monclient: authenticate success, global_id 204411 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 4 set_mon_vals no callback set 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c7dffb640 10 monclient: dump: 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.922 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.923 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.923 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 10 monclient: shutdown 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 -- 10.20.193.51:0/1864085072 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c800a0750 msgr2=0x7f6c8009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 --2- 10.20.193.51:0/1864085072 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c800a0750 0x7f6c8009e1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c8009f5f0 tx=0x7f6c6802ee60 comp rx=0 tx=0).stop 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 -- 10.20.193.51:0/1864085072 shutdown_connections 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 --2- 10.20.193.51:0/1864085072 >> v2:10.20.193.142:3300/0 conn(0x7f6c8013b760 0x7f6c8013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 --2- 10.20.193.51:0/1864085072 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c800a0750 0x7f6c8009e1d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 -- 10.20.193.51:0/1864085072 >> 10.20.193.51:0/1864085072 conn(0x7f6c800a30c0 msgr2=0x7f6c800a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 -- 10.20.193.51:0/1864085072 shutdown_connections 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.920+0000 7f6c85854640 1 -- 10.20.193.51:0/1864085072 wait complete. 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient: build_initial_monmap 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient: monmap: 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 Processor -- start 2026-02-17T12:03:22.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 -- start start 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient: init 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c800a0750 0x7f6c801cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-b con 0x7f6c800a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c800a3bb0 0x7f6c801d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-c con 0x7f6c800a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 0x7f6c80131340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): picked mon.noname-a con 0x7f6c8013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6c800a04b0 con 0x7f6c8013b760 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8009c850 con 0x7f6c800a0750 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8009e710 con 0x7f6c800a3bb0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c85854640 10 monclient(hunting): authenticate will time out at 1690.540762s 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7e7fc640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c800a3bb0 msgr2=0x7f6c801d0010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c800a3bb0 0x7f6c801d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 0x7f6c80131340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 0x7f6c80131340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34474/0 (socket says 10.20.193.51:34474) 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 learned_addr learned my addr 10.20.193.51:0/1823293517 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): get_auth_request con 0x7f6c8013b760 auth_method 0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c800a0750 0x7f6c801cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient(hunting): handle_auth_done global_id 204414 payload 824 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c800a3bb0 msgr2=0x7f6c801d0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6c800a3bb0 0x7f6c801d0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c800a0750 msgr2=0x7f6c801cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c800a0750 0x7f6c801cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:22.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c80132bc0 con 0x7f6c8013b760 2026-02-17T12:03:22.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7effd640 10 monclient: get_auth_request con 0x7f6c800a0750 auth_method 0 2026-02-17T12:03:22.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.921+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c800a0750 0x7f6c801cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 msgr2=0x7f6c80131340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7f7fe640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 0x7f6c80131340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000efc0 tx=0x7f6c7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70018020 con 0x7f6c8013b760 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: dump: 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70014480 con 0x7f6c8013b760 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 5 monclient: authenticate success, global_id 204414 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70014870 con 0x7f6c8013b760 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 10 monclient: dump: 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7d7fa640 4 set_mon_vals no callback set 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 monclient: _renew_subs 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c800a27b0 con 0x7f6c8013b760 2026-02-17T12:03:22.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 monclient: _renew_subs 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8009d7b0 con 0x7f6c8013b760 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 0x7f6c80131880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80135060 con 0x7f6c80134c80 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6c70014a10 con 0x7f6c8013b760 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 0x7f6c80131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7effd640 10 monclient: get_auth_request con 0x7f6c80134c80 auth_method 0 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.924+0000 7f6c7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c57fff640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c5003dcc0 0x7f6c50040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(656..656 src has 323..656) ==== 4843+0+0 (secure 0 0 0) 0x7f6c700536f0 con 0x7f6c8013b760 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7effd640 10 monclient(hunting): handle_auth_done global_id 184477 payload 824 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7effd640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c80077c20 con 0x7f6c80134c80 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7e7fc640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c5003dcc0 0x7f6c50040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.925+0000 7f6c7e7fc640 10 monclient: get_auth_request con 0x7f6c5003dcc0 auth_method 0 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c7effd640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 msgr2=0x7f6c80131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 0x7f6c80131880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c7400dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c7e7fc640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c5003dcc0 0x7f6c50040180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6c68036000 tx=0x7f6c68039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400bb30 con 0x7f6c80134c80 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c57fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.927+0000 7f6c57fff640 10 monclient: dump: 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.929 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6c7400bb30 con 0x7f6c80134c80 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 msgr2=0x7f6c80131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 0x7f6c80131880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c7400dbf0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 msgr2=0x7f6c80131880 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:22.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.928+0000 7f6c57fff640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80134c80 0x7f6c80131880 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c7400dbf0 comp rx=0 tx=0).stop 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c85854640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c85854640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 0x7f6c801daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c85854640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8009dac0 con 0x7f6c80131dc0 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 0x7f6c801daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient: get_auth_request con 0x7f6c80131dc0 auth_method 0 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 10 monclient(hunting): handle_auth_done global_id 184480 payload 824 2026-02-17T12:03:22.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.931+0000 7f6c7effd640 1 -- 10.20.193.51:0/1823293517 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c800008d0 con 0x7f6c80131dc0 2026-02-17T12:03:22.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c7effd640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 msgr2=0x7f6c801daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:22.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c7effd640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 0x7f6c801daad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c74003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74005490 con 0x7f6c80131dc0 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 10 monclient: dump: 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7f6c74005490 con 0x7f6c80131dc0 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 msgr2=0x7f6c801daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 0x7f6c801daad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c74003860 comp rx=0 tx=0).stop 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 msgr2=0x7f6c801daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c57fff640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6c80131dc0 0x7f6c801daad0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d720 tx=0x7f6c74003860 comp rx=0 tx=0).stop 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 166, 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 235320, 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:22.936 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:22.937 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.939 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:22.940 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c5003dcc0 msgr2=0x7f6c50040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6c5003dcc0 0x7f6c50040180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6c68036000 tx=0x7f6c68039040 comp rx=0 tx=0).stop 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 10 monclient: shutdown 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 msgr2=0x7f6c80131340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 --2- 10.20.193.51:0/1823293517 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6c8013b760 0x7f6c80131340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000efc0 tx=0x7f6c7000c490 comp rx=0 tx=0).stop 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 reap_dead start 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c7f7fe640 1 -- 10.20.193.51:0/1823293517 reap_dead start 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 shutdown_connections 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 >> 10.20.193.51:0/1823293517 conn(0x7f6c800a30c0 msgr2=0x7f6c8013a190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 shutdown_connections 2026-02-17T12:03:22.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:22.934+0000 7f6c85854640 1 -- 10.20.193.51:0/1823293517 wait complete. 2026-02-17T12:03:22.941 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:03:22.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2848: done (5 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2849: done (4 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2850: done (3 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2851: done (2 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2852: done (1 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2853: done (0 left) 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2854: read oid 1 snap 305 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2854: expect deleted 2026-02-17T12:03:23.575 INFO:tasks.rados.rados.0.trial142.stdout:2855: delete oid 50 current snap is 313 2026-02-17T12:03:23.577 INFO:tasks.rados.rados.0.trial142.stdout:2854: done (1 left) 2026-02-17T12:03:23.578 INFO:tasks.rados.rados.0.trial142.stdout:2855: done (0 left) 2026-02-17T12:03:23.578 INFO:tasks.rados.rados.0.trial142.stdout:2856: rollback oid 14 current snap is 313 2026-02-17T12:03:23.578 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 305 2026-02-17T12:03:23.578 INFO:tasks.rados.rados.0.trial142.stdout:2857: delete oid 34 current snap is 313 2026-02-17T12:03:23.579 INFO:tasks.rados.rados.0.trial142.stdout:2857: done (1 left) 2026-02-17T12:03:23.580 INFO:tasks.rados.rados.0.trial142.stdout:2858: write oid 50 current snap is 313 2026-02-17T12:03:23.580 INFO:tasks.rados.rados.0.trial142.stdout:2858: seq_num 971 ranges {719597=643610,1870839=448758} 2026-02-17T12:03:23.585 INFO:tasks.rados.rados.0.trial142.stdout:2858: writing trial14245205-50 from 719597 to 1363207 tid 1 2026-02-17T12:03:23.589 INFO:tasks.rados.rados.0.trial142.stdout:2858: writing trial14245205-50 from 1870839 to 2319597 tid 2 2026-02-17T12:03:23.590 INFO:tasks.rados.rados.0.trial142.stdout:2859: snap_create 2026-02-17T12:03:23.590 INFO:tasks.rados.rados.0.trial142.stdout:2856: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:03:23.590 INFO:tasks.rados.rados.0.trial142.stdout:2856: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:03:23.590 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2668 (ObjNum 938 snap 303 seq_num 938) dirty exists 2026-02-17T12:03:23.590 INFO:tasks.rados.rados.0.trial142.stdout:2858: finishing write tid 1 to trial14245205-50 2026-02-17T12:03:23.592 INFO:tasks.rados.rados.0.trial142.stdout:2858: finishing write tid 2 to trial14245205-50 2026-02-17T12:03:23.592 INFO:tasks.rados.rados.0.trial142.stdout:2858: finishing write tid 3 to trial14245205-50 2026-02-17T12:03:23.592 INFO:tasks.rados.rados.0.trial142.stdout:2858: finishing write tid 4 to trial14245205-50 2026-02-17T12:03:23.592 INFO:tasks.rados.rados.0.trial142.stdout:2858: oid 50 updating version 0 to 2012 2026-02-17T12:03:23.592 INFO:tasks.rados.rados.0.trial142.stdout:2858: oid 50 updating version 2012 to 2014 2026-02-17T12:03:23.593 INFO:tasks.rados.rados.0.trial142.stdout:2858: oid 50 version 2014 is already newer than 2013 2026-02-17T12:03:23.593 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2014 (ObjNum 971 snap 313 seq_num 971) dirty exists 2026-02-17T12:03:23.593 INFO:tasks.rados.rados.0.trial142.stdout:2858: left oid 50 (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:03:24.449 INFO:tasks.rados.rados.0.trial142.stdout:2856: done (2 left) 2026-02-17T12:03:24.450 INFO:tasks.rados.rados.0.trial142.stdout:2858: done (1 left) 2026-02-17T12:03:24.450 INFO:tasks.rados.rados.0.trial142.stdout:2859: done (0 left) 2026-02-17T12:03:24.450 INFO:tasks.rados.rados.0.trial142.stdout:2860: delete oid 10 current snap is 314 2026-02-17T12:03:24.454 INFO:tasks.rados.rados.0.trial142.stdout:2860: done (0 left) 2026-02-17T12:03:24.455 INFO:tasks.rados.rados.0.trial142.stdout:2861: copy_from oid 48 from oid 42 current snap is 314 2026-02-17T12:03:24.455 INFO:tasks.rados.rados.0.trial142.stdout:2862: delete oid 3 current snap is 314 2026-02-17T12:03:24.457 INFO:tasks.rados.rados.0.trial142.stdout:2862: done (1 left) 2026-02-17T12:03:24.457 INFO:tasks.rados.rados.0.trial142.stdout:2863: snap_create 2026-02-17T12:03:24.460 INFO:tasks.rados.rados.0.trial142.stdout:2861: finishing copy_from racing read to trial14245205-48 2026-02-17T12:03:24.461 INFO:tasks.rados.rados.0.trial142.stdout:2861: finishing copy_from to trial14245205-48 2026-02-17T12:03:24.461 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:03:25.452 INFO:tasks.rados.rados.0.trial142.stdout:2861: done (1 left) 2026-02-17T12:03:25.452 INFO:tasks.rados.rados.0.trial142.stdout:2863: done (0 left) 2026-02-17T12:03:25.452 INFO:tasks.rados.rados.0.trial142.stdout:2864: delete oid 23 current snap is 315 2026-02-17T12:03:25.456 INFO:tasks.rados.rados.0.trial142.stdout:2864: done (0 left) 2026-02-17T12:03:25.456 INFO:tasks.rados.rados.0.trial142.stdout:2865: write (excl) oid 35 current snap is 315 2026-02-17T12:03:25.456 INFO:tasks.rados.rados.0.trial142.stdout:2865: seq_num 975 ranges {786825=660959,2104767=282058} 2026-02-17T12:03:25.462 INFO:tasks.rados.rados.0.trial142.stdout:2865: writing trial14245205-35 from 786825 to 1447784 tid 1 2026-02-17T12:03:25.466 INFO:tasks.rados.rados.0.trial142.stdout:2865: writing trial14245205-35 from 2104767 to 2386825 tid 2 2026-02-17T12:03:25.466 INFO:tasks.rados.rados.0.trial142.stdout:2866: delete oid 17 current snap is 315 2026-02-17T12:03:25.466 INFO:tasks.rados.rados.0.trial142.stdout:2865: finishing write tid 1 to trial14245205-35 2026-02-17T12:03:25.467 INFO:tasks.rados.rados.0.trial142.stdout:2865: finishing write tid 2 to trial14245205-35 2026-02-17T12:03:25.468 INFO:tasks.rados.rados.0.trial142.stdout:2866: done (1 left) 2026-02-17T12:03:25.468 INFO:tasks.rados.rados.0.trial142.stdout:2867: snap_remove snap 312 2026-02-17T12:03:26.453 INFO:tasks.rados.rados.0.trial142.stdout:2867: done (1 left) 2026-02-17T12:03:26.454 INFO:tasks.rados.rados.0.trial142.stdout:2868: read oid 15 snap -1 2026-02-17T12:03:26.454 INFO:tasks.rados.rados.0.trial142.stdout:2868: expect (ObjNum 962 snap 310 seq_num 962) 2026-02-17T12:03:26.454 INFO:tasks.rados.rados.0.trial142.stdout:2869: read oid 18 snap -1 2026-02-17T12:03:26.454 INFO:tasks.rados.rados.0.trial142.stdout:2869: expect (ObjNum 963 snap 310 seq_num 963) 2026-02-17T12:03:26.454 INFO:tasks.rados.rados.0.trial142.stdout:2870: snap_remove snap 313 2026-02-17T12:03:27.455 INFO:tasks.rados.rados.0.trial142.stdout:2870: done (3 left) 2026-02-17T12:03:27.455 INFO:tasks.rados.rados.0.trial142.stdout:2871: write (excl) oid 21 current snap is 315 2026-02-17T12:03:27.455 INFO:tasks.rados.rados.0.trial142.stdout:2871: seq_num 977 ranges {420439=411457,1421731=480010} 2026-02-17T12:03:27.459 INFO:tasks.rados.rados.0.trial142.stdout:2871: writing trial14245205-21 from 420439 to 831896 tid 1 2026-02-17T12:03:27.463 INFO:tasks.rados.rados.0.trial142.stdout:2871: writing trial14245205-21 from 1421731 to 1901741 tid 2 2026-02-17T12:03:27.464 INFO:tasks.rados.rados.0.trial142.stdout:2872: rollback oid 45 current snap is 315 2026-02-17T12:03:27.464 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 305 2026-02-17T12:03:27.464 INFO:tasks.rados.rados.0.trial142.stdout:2865: finishing write tid 3 to trial14245205-35 2026-02-17T12:03:27.464 INFO:tasks.rados.rados.0.trial142.stdout:2873: snap_remove snap 314 2026-02-17T12:03:28.457 INFO:tasks.rados.rados.0.trial142.stdout:2873: done (5 left) 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2874: rollback oid 22 current snap is 315 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 286 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2865: finishing write tid 4 to trial14245205-35 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2865: oid 35 updating version 0 to 2555 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2865: oid 35 version 2555 is already newer than 2553 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2865: oid 35 version 2555 is already newer than 2554 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 2555 (ObjNum 975 snap 315 seq_num 975) dirty exists 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2865: left oid 35 (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:03:28.458 INFO:tasks.rados.rados.0.trial142.stdout:2869: expect (ObjNum 963 snap 310 seq_num 963) 2026-02-17T12:03:28.510 INFO:tasks.rados.rados.0.trial142.stdout:2868: expect (ObjNum 962 snap 310 seq_num 962) 2026-02-17T12:03:28.561 INFO:tasks.rados.rados.0.trial142.stdout:2871: finishing write tid 1 to trial14245205-21 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: finishing write tid 2 to trial14245205-21 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: finishing write tid 3 to trial14245205-21 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: finishing write tid 4 to trial14245205-21 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: oid 21 updating version 0 to 1994 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: oid 21 version 1994 is already newer than 1992 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: oid 21 version 1994 is already newer than 1993 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 1994 (ObjNum 977 snap 315 seq_num 977) dirty exists 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2871: left oid 21 (ObjNum 977 snap 315 seq_num 977) 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2872: finishing rollback tid 1 to trial14245205-45 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 1983 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2874: finishing rollback tid 0 to trial14245205-22 2026-02-17T12:03:28.562 INFO:tasks.rados.rados.0.trial142.stdout:2874: finishing rollback tid 1 to trial14245205-22 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2874: finishing rollback tid 2 to trial14245205-22 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2222 (ObjNum 858 snap 270 seq_num 858) dirty exists 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2865: done (5 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2868: done (4 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2869: done (3 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2871: done (2 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2872: done (1 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2874: done (0 left) 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2875: write oid 16 current snap is 315 2026-02-17T12:03:28.563 INFO:tasks.rados.rados.0.trial142.stdout:2875: seq_num 978 ranges {437246=486706,1363860=623668} 2026-02-17T12:03:28.564 INFO:tasks.rados.rados.0.trial142.stdout:2875: writing trial14245205-16 from 437246 to 923952 tid 1 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2875: writing trial14245205-16 from 1363860 to 1987528 tid 2 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2876: read oid 50 snap -1 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2876: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2877: write (excl) oid 7 current snap is 315 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2875: finishing write tid 1 to trial14245205-16 2026-02-17T12:03:28.569 INFO:tasks.rados.rados.0.trial142.stdout:2877: seq_num 979 ranges {454053=561955,1422342=483679,2368404=85649} 2026-02-17T12:03:28.572 INFO:tasks.rados.rados.0.trial142.stdout:2877: writing trial14245205-7 from 454053 to 1016008 tid 1 2026-02-17T12:03:28.576 INFO:tasks.rados.rados.0.trial142.stdout:2877: writing trial14245205-7 from 1422342 to 1906021 tid 2 2026-02-17T12:03:28.578 INFO:tasks.rados.rados.0.trial142.stdout:2877: writing trial14245205-7 from 2368404 to 2454053 tid 3 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2878: rollback oid 14 current snap is 315 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 310 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: finishing write tid 2 to trial14245205-16 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: finishing write tid 3 to trial14245205-16 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: finishing write tid 4 to trial14245205-16 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: oid 16 updating version 0 to 1190 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: oid 16 updating version 1190 to 1191 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: oid 16 version 1191 is already newer than 1189 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1191 (ObjNum 978 snap 315 seq_num 978) dirty exists 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2875: left oid 16 (ObjNum 978 snap 315 seq_num 978) 2026-02-17T12:03:28.579 INFO:tasks.rados.rados.0.trial142.stdout:2876: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:03:28.632 INFO:tasks.rados.rados.0.trial142.stdout:2877: finishing write tid 1 to trial14245205-7 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2875: done (3 left) 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2876: done (2 left) 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2879: delete oid 2 current snap is 315 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: finishing write tid 2 to trial14245205-7 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: finishing write tid 3 to trial14245205-7 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: finishing write tid 4 to trial14245205-7 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: finishing write tid 5 to trial14245205-7 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: oid 7 updating version 0 to 2670 2026-02-17T12:03:28.633 INFO:tasks.rados.rados.0.trial142.stdout:2877: oid 7 updating version 2670 to 2673 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2877: oid 7 version 2673 is already newer than 2671 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2877: oid 7 version 2673 is already newer than 2672 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2673 (ObjNum 979 snap 315 seq_num 979) dirty exists 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2877: left oid 7 (ObjNum 979 snap 315 seq_num 979) 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2878: finishing rollback tid 0 to trial14245205-14 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2878: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:2878: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:03:28.634 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2676 (ObjNum 953 snap 310 seq_num 953) dirty exists 2026-02-17T12:03:28.635 INFO:tasks.rados.rados.0.trial142.stdout:2877: done (2 left) 2026-02-17T12:03:28.635 INFO:tasks.rados.rados.0.trial142.stdout:2878: done (1 left) 2026-02-17T12:03:28.635 INFO:tasks.rados.rados.0.trial142.stdout:2879: done (0 left) 2026-02-17T12:03:28.635 INFO:tasks.rados.rados.0.trial142.stdout:2880: snap_create 2026-02-17T12:03:29.256 INFO:tasks.rados.rados.0.trial142.stdout:2880: done (0 left) 2026-02-17T12:03:29.256 INFO:tasks.rados.rados.0.trial142.stdout:2881: delete oid 37 current snap is 316 2026-02-17T12:03:29.259 INFO:tasks.rados.rados.0.trial142.stdout:2881: done (0 left) 2026-02-17T12:03:29.259 INFO:tasks.rados.rados.0.trial142.stdout:2882: delete oid 6 current snap is 316 2026-02-17T12:03:29.266 INFO:tasks.rados.rados.0.trial142.stdout:2882: done (0 left) 2026-02-17T12:03:29.266 INFO:tasks.rados.rados.0.trial142.stdout:2883: delete oid 46 current snap is 316 2026-02-17T12:03:29.268 INFO:tasks.rados.rados.0.trial142.stdout:2883: done (0 left) 2026-02-17T12:03:29.268 INFO:tasks.rados.rados.0.trial142.stdout:2884: copy_from oid 25 from oid 37 current snap is 316 2026-02-17T12:03:29.268 INFO:tasks.rados.rados.0.trial142.stdout:2885: rollback oid 17 current snap is 316 2026-02-17T12:03:29.268 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 310 2026-02-17T12:03:29.268 INFO:tasks.rados.rados.0.trial142.stdout:2886: read oid 47 snap -1 2026-02-17T12:03:29.269 INFO:tasks.rados.rados.0.trial142.stdout:2886: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:03:29.269 INFO:tasks.rados.rados.0.trial142.stdout:2887: copy_from oid 22 from oid 7 current snap is 316 2026-02-17T12:03:29.269 INFO:tasks.rados.rados.0.trial142.stdout:2888: write oid 5 current snap is 316 2026-02-17T12:03:29.269 INFO:tasks.rados.rados.0.trial142.stdout:2888: seq_num 984 ranges {538088=654553,1714752=634675} 2026-02-17T12:03:29.272 INFO:tasks.rados.rados.0.trial142.stdout:2888: writing trial14245205-5 from 538088 to 1192641 tid 1 2026-02-17T12:03:29.277 INFO:tasks.rados.rados.0.trial142.stdout:2888: writing trial14245205-5 from 1714752 to 2349427 tid 2 2026-02-17T12:03:29.277 INFO:tasks.rados.rados.0.trial142.stdout:2889: rollback oid 39 current snap is 316 2026-02-17T12:03:29.277 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 305 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2884: finishing copy_from to trial14245205-25 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2884: got expected ENOENT (src dne) 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2884: finishing copy_from racing read to trial14245205-25 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2885: finishing rollback tid 1 to trial14245205-17 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2885: finishing rollback tid 2 to trial14245205-17 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1193 (ObjNum 868 snap 272 seq_num 868) dirty exists 2026-02-17T12:03:29.278 INFO:tasks.rados.rados.0.trial142.stdout:2886: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:2887: finishing copy_from racing read to trial14245205-22 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:2887: finishing copy_from to trial14245205-22 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2673 (ObjNum 979 snap 315 seq_num 979) dirty exists 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:2888: finishing write tid 1 to trial14245205-5 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:2884: done (5 left) 2026-02-17T12:03:29.409 INFO:tasks.rados.rados.0.trial142.stdout:2885: done (4 left) 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2886: done (3 left) 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2887: done (2 left) 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2890: delete oid 37 current snap is 316 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2889: finishing rollback tid 0 to trial14245205-39 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2889: finishing rollback tid 1 to trial14245205-39 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2888: finishing write tid 2 to trial14245205-5 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2889: finishing rollback tid 2 to trial14245205-39 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2126 (ObjNum 849 snap 265 seq_num 849) dirty exists 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2888: finishing write tid 3 to trial14245205-5 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2888: finishing write tid 4 to trial14245205-5 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2888: oid 5 updating version 0 to 1194 2026-02-17T12:03:29.410 INFO:tasks.rados.rados.0.trial142.stdout:2888: oid 5 updating version 1194 to 1195 2026-02-17T12:03:29.411 INFO:tasks.rados.rados.0.trial142.stdout:2888: oid 5 updating version 1195 to 1196 2026-02-17T12:03:29.411 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 1196 (ObjNum 984 snap 316 seq_num 984) dirty exists 2026-02-17T12:03:29.411 INFO:tasks.rados.rados.0.trial142.stdout:2888: left oid 5 (ObjNum 984 snap 316 seq_num 984) 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2888: done (2 left) 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2889: done (1 left) 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2890: done (0 left) 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2891: rollback oid 32 current snap is 316 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 310 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2892: copy_from oid 48 from oid 25 current snap is 316 2026-02-17T12:03:29.412 INFO:tasks.rados.rados.0.trial142.stdout:2893: snap_remove snap 305 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2891: finishing rollback tid 0 to trial14245205-32 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2891: finishing rollback tid 1 to trial14245205-32 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2891: finishing rollback tid 2 to trial14245205-32 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2142 (ObjNum 935 snap 303 seq_num 935) dirty exists 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2892: finishing copy_from racing read to trial14245205-48 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2892: finishing copy_from to trial14245205-48 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2010 (ObjNum 967 snap 312 seq_num 967) dirty exists 2026-02-17T12:03:30.692 INFO:tasks.rados.rados.0.trial142.stdout:2891: done (2 left) 2026-02-17T12:03:30.693 INFO:tasks.rados.rados.0.trial142.stdout:2892: done (1 left) 2026-02-17T12:03:30.693 INFO:tasks.rados.rados.0.trial142.stdout:2893: done (0 left) 2026-02-17T12:03:30.693 INFO:tasks.rados.rados.0.trial142.stdout:2894: snap_create 2026-02-17T12:03:31.706 INFO:tasks.rados.rados.0.trial142.stdout:2894: done (0 left) 2026-02-17T12:03:31.706 INFO:tasks.rados.rados.0.trial142.stdout:2895: write (excl) oid 16 current snap is 317 2026-02-17T12:03:31.706 INFO:tasks.rados.rados.0.trial142.stdout:2895: seq_num 986 ranges {571702=405051,1431716=638344,2560365=11337} 2026-02-17T12:03:31.710 INFO:tasks.rados.rados.0.trial142.stdout:2895: writing trial14245205-16 from 571702 to 976753 tid 1 2026-02-17T12:03:31.714 INFO:tasks.rados.rados.0.trial142.stdout:2895: writing trial14245205-16 from 1431716 to 2070060 tid 2 2026-02-17T12:03:31.716 INFO:tasks.rados.rados.0.trial142.stdout:2895: writing trial14245205-16 from 2560365 to 2571702 tid 3 2026-02-17T12:03:31.716 INFO:tasks.rados.rados.0.trial142.stdout:2896: read oid 2 snap -1 2026-02-17T12:03:31.716 INFO:tasks.rados.rados.0.trial142.stdout:2896: expect deleted 2026-02-17T12:03:31.716 INFO:tasks.rados.rados.0.trial142.stdout:2897: snap_create 2026-02-17T12:03:31.716 INFO:tasks.rados.rados.0.trial142.stdout:2895: finishing write tid 1 to trial14245205-16 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: finishing write tid 2 to trial14245205-16 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: finishing write tid 3 to trial14245205-16 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: finishing write tid 4 to trial14245205-16 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: finishing write tid 5 to trial14245205-16 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: oid 16 updating version 0 to 1199 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: oid 16 version 1199 is already newer than 1198 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: oid 16 version 1199 is already newer than 1197 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: oid 16 updating version 1199 to 1200 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 1200 (ObjNum 986 snap 317 seq_num 986) dirty exists 2026-02-17T12:03:31.717 INFO:tasks.rados.rados.0.trial142.stdout:2895: left oid 16 (ObjNum 986 snap 317 seq_num 986) 2026-02-17T12:03:32.707 INFO:tasks.rados.rados.0.trial142.stdout:2895: done (2 left) 2026-02-17T12:03:32.707 INFO:tasks.rados.rados.0.trial142.stdout:2896: done (1 left) 2026-02-17T12:03:32.708 INFO:tasks.rados.rados.0.trial142.stdout:2897: done (0 left) 2026-02-17T12:03:32.708 INFO:tasks.rados.rados.0.trial142.stdout:2898: write (excl) oid 32 current snap is 318 2026-02-17T12:03:32.708 INFO:tasks.rados.rados.0.trial142.stdout:2898: seq_num 987 ranges {588509=480300,1773845=782002} 2026-02-17T12:03:32.711 INFO:tasks.rados.rados.0.trial142.stdout:2898: writing trial14245205-32 from 588509 to 1068809 tid 1 2026-02-17T12:03:32.717 INFO:tasks.rados.rados.0.trial142.stdout:2898: writing trial14245205-32 from 1773845 to 2555847 tid 2 2026-02-17T12:03:32.717 INFO:tasks.rados.rados.0.trial142.stdout:2899: copy_from oid 24 from oid 42 current snap is 318 2026-02-17T12:03:32.717 INFO:tasks.rados.rados.0.trial142.stdout:2898: finishing write tid 1 to trial14245205-32 2026-02-17T12:03:32.717 INFO:tasks.rados.rados.0.trial142.stdout:2900: write (excl) oid 49 current snap is 318 2026-02-17T12:03:32.718 INFO:tasks.rados.rados.0.trial142.stdout:2900: seq_num 988 ranges {605316=555549,1832327=642013} 2026-02-17T12:03:32.722 INFO:tasks.rados.rados.0.trial142.stdout:2900: writing trial14245205-49 from 605316 to 1160865 tid 1 2026-02-17T12:03:32.728 INFO:tasks.rados.rados.0.trial142.stdout:2900: writing trial14245205-49 from 1832327 to 2474340 tid 2 2026-02-17T12:03:32.728 INFO:tasks.rados.rados.0.trial142.stdout:2901: snap_create 2026-02-17T12:03:32.728 INFO:tasks.rados.rados.0.trial142.stdout:2898: finishing write tid 2 to trial14245205-32 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: finishing write tid 3 to trial14245205-32 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: finishing write tid 4 to trial14245205-32 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: oid 32 updating version 0 to 2144 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: oid 32 updating version 2144 to 2145 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: oid 32 version 2145 is already newer than 2143 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2145 (ObjNum 987 snap 318 seq_num 987) dirty exists 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2898: left oid 32 (ObjNum 987 snap 318 seq_num 987) 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2899: finishing copy_from racing read to trial14245205-24 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2900: finishing write tid 1 to trial14245205-49 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:2899: finishing copy_from to trial14245205-24 2026-02-17T12:03:32.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:03:32.731 INFO:tasks.rados.rados.0.trial142.stdout:2900: finishing write tid 2 to trial14245205-49 2026-02-17T12:03:32.731 INFO:tasks.rados.rados.0.trial142.stdout:2900: finishing write tid 3 to trial14245205-49 2026-02-17T12:03:32.731 INFO:tasks.rados.rados.0.trial142.stdout:2900: finishing write tid 4 to trial14245205-49 2026-02-17T12:03:32.731 INFO:tasks.rados.rados.0.trial142.stdout:2900: oid 49 updating version 0 to 2692 2026-02-17T12:03:32.731 INFO:tasks.rados.rados.0.trial142.stdout:2900: oid 49 updating version 2692 to 2693 2026-02-17T12:03:32.732 INFO:tasks.rados.rados.0.trial142.stdout:2900: oid 49 updating version 2693 to 2694 2026-02-17T12:03:32.732 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2694 (ObjNum 988 snap 318 seq_num 988) dirty exists 2026-02-17T12:03:32.732 INFO:tasks.rados.rados.0.trial142.stdout:2900: left oid 49 (ObjNum 988 snap 318 seq_num 988) 2026-02-17T12:03:33.710 INFO:tasks.rados.rados.0.trial142.stdout:2898: done (3 left) 2026-02-17T12:03:33.711 INFO:tasks.rados.rados.0.trial142.stdout:2899: done (2 left) 2026-02-17T12:03:33.711 INFO:tasks.rados.rados.0.trial142.stdout:2900: done (1 left) 2026-02-17T12:03:33.711 INFO:tasks.rados.rados.0.trial142.stdout:2901: done (0 left) 2026-02-17T12:03:33.711 INFO:tasks.rados.rados.0.trial142.stdout:2902: snap_create 2026-02-17T12:03:34.255 INFO:tasks.rados.rados.0.trial142.stdout:2902: done (0 left) 2026-02-17T12:03:34.255 INFO:tasks.rados.rados.0.trial142.stdout:2903: rollback oid 11 current snap is 320 2026-02-17T12:03:34.255 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 310 2026-02-17T12:03:34.255 INFO:tasks.rados.rados.0.trial142.stdout:2904: snap_create 2026-02-17T12:03:34.261 INFO:tasks.rados.rados.0.trial142.stdout:2903: finishing rollback tid 0 to trial14245205-11 2026-02-17T12:03:34.261 INFO:tasks.rados.rados.0.trial142.stdout:2903: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:03:34.261 INFO:tasks.rados.rados.0.trial142.stdout:2903: finishing rollback tid 2 to trial14245205-11 2026-02-17T12:03:34.261 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1136 (ObjNum 747 snap 235 seq_num 747) dirty exists 2026-02-17T12:03:35.258 INFO:tasks.rados.rados.0.trial142.stdout:2903: done (1 left) 2026-02-17T12:03:35.258 INFO:tasks.rados.rados.0.trial142.stdout:2904: done (0 left) 2026-02-17T12:03:35.258 INFO:tasks.rados.rados.0.trial142.stdout:2905: copy_from oid 48 from oid 41 current snap is 321 2026-02-17T12:03:35.259 INFO:tasks.rados.rados.0.trial142.stdout:2906: rollback oid 27 current snap is 321 2026-02-17T12:03:35.259 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 319 2026-02-17T12:03:35.259 INFO:tasks.rados.rados.0.trial142.stdout:2907: delete oid 17 current snap is 321 2026-02-17T12:03:35.262 INFO:tasks.rados.rados.0.trial142.stdout:2907: done (2 left) 2026-02-17T12:03:35.262 INFO:tasks.rados.rados.0.trial142.stdout:2908: delete oid 7 current snap is 321 2026-02-17T12:03:35.263 INFO:tasks.rados.rados.0.trial142.stdout:2906: finishing rollback tid 0 to trial14245205-27 2026-02-17T12:03:35.263 INFO:tasks.rados.rados.0.trial142.stdout:2906: finishing rollback tid 1 to trial14245205-27 2026-02-17T12:03:35.263 INFO:tasks.rados.rados.0.trial142.stdout:2906: finishing rollback tid 2 to trial14245205-27 2026-02-17T12:03:35.263 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2558 (ObjNum 955 snap 310 seq_num 955) dirty exists 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2906: done (2 left) 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2908: done (1 left) 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2909: copy_from oid 8 from oid 49 current snap is 321 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2910: copy_from oid 45 from oid 28 current snap is 321 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2911: copy_from oid 2 from oid 34 current snap is 321 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2912: write oid 17 current snap is 321 2026-02-17T12:03:35.265 INFO:tasks.rados.rados.0.trial142.stdout:2912: seq_num 991 ranges {655737=497649,1607773=789340} 2026-02-17T12:03:35.270 INFO:tasks.rados.rados.0.trial142.stdout:2912: writing trial14245205-17 from 655737 to 1153386 tid 1 2026-02-17T12:03:35.275 INFO:tasks.rados.rados.0.trial142.stdout:2912: writing trial14245205-17 from 1607773 to 2397113 tid 2 2026-02-17T12:03:35.275 INFO:tasks.rados.rados.0.trial142.stdout:2913: snap_remove snap 318 2026-02-17T12:03:36.260 INFO:tasks.rados.rados.0.trial142.stdout:2913: done (5 left) 2026-02-17T12:03:36.260 INFO:tasks.rados.rados.0.trial142.stdout:2914: read oid 43 snap -1 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2914: expect (ObjNum 883 snap 280 seq_num 883) 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2915: rollback oid 21 current snap is 321 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 320 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2911: finishing copy_from to trial14245205-2 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2911: got expected ENOENT (src dne) 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2911: finishing copy_from racing read to trial14245205-2 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2905: finishing copy_from racing read to trial14245205-48 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2910: finishing copy_from racing read to trial14245205-45 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2912: finishing write tid 1 to trial14245205-17 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2909: finishing copy_from racing read to trial14245205-8 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:2905: finishing copy_from to trial14245205-48 2026-02-17T12:03:36.261 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2910: finishing copy_from to trial14245205-45 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2135 (ObjNum 941 snap 304 seq_num 941) dirty exists 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2909: finishing copy_from to trial14245205-8 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2694 (ObjNum 988 snap 318 seq_num 988) dirty exists 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: finishing write tid 2 to trial14245205-17 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: finishing write tid 3 to trial14245205-17 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: finishing write tid 4 to trial14245205-17 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: oid 17 updating version 0 to 1204 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: oid 17 version 1204 is already newer than 1202 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:2912: oid 17 version 1204 is already newer than 1203 2026-02-17T12:03:36.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 1204 (ObjNum 991 snap 321 seq_num 991) dirty exists 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2912: left oid 17 (ObjNum 991 snap 321 seq_num 991) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2905: done (6 left) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2909: done (5 left) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2910: done (4 left) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2911: done (3 left) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2912: done (2 left) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2916: read oid 4 snap -1 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2916: expect (ObjNum 900 snap 287 seq_num 900) 2026-02-17T12:03:36.263 INFO:tasks.rados.rados.0.trial142.stdout:2917: snap_remove snap 310 2026-02-17T12:03:37.263 INFO:tasks.rados.rados.0.trial142.stdout:2917: done (3 left) 2026-02-17T12:03:37.263 INFO:tasks.rados.rados.0.trial142.stdout:2918: read oid 29 snap -1 2026-02-17T12:03:37.263 INFO:tasks.rados.rados.0.trial142.stdout:2918: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:03:37.263 INFO:tasks.rados.rados.0.trial142.stdout:2919: read oid 46 snap -1 2026-02-17T12:03:37.263 INFO:tasks.rados.rados.0.trial142.stdout:2919: expect deleted 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:2920: snap_create 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:2915: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:2915: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:2915: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2138 (ObjNum 977 snap 315 seq_num 977) dirty exists 2026-02-17T12:03:37.264 INFO:tasks.rados.rados.0.trial142.stdout:2914: expect (ObjNum 883 snap 280 seq_num 883) 2026-02-17T12:03:37.375 INFO:tasks.rados.rados.0.trial142.stdout:2916: expect (ObjNum 900 snap 287 seq_num 900) 2026-02-17T12:03:37.555 INFO:tasks.rados.rados.0.trial142.stdout:2918: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2914: done (5 left) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2915: done (4 left) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2916: done (3 left) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2918: done (2 left) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2919: done (1 left) 2026-02-17T12:03:38.266 INFO:tasks.rados.rados.0.trial142.stdout:2920: done (0 left) 2026-02-17T12:03:38.267 INFO:tasks.rados.rados.0.trial142.stdout:2921: rollback oid 15 current snap is 322 2026-02-17T12:03:38.267 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 286 2026-02-17T12:03:38.267 INFO:tasks.rados.rados.0.trial142.stdout:2922: delete oid 24 current snap is 322 2026-02-17T12:03:38.268 INFO:tasks.rados.rados.0.trial142.stdout:2921: finishing rollback tid 0 to trial14245205-15 2026-02-17T12:03:38.268 INFO:tasks.rados.rados.0.trial142.stdout:2922: done (1 left) 2026-02-17T12:03:38.268 INFO:tasks.rados.rados.0.trial142.stdout:2923: rollback oid 43 current snap is 322 2026-02-17T12:03:38.268 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 320 2026-02-17T12:03:38.268 INFO:tasks.rados.rados.0.trial142.stdout:2924: write oid 25 current snap is 322 2026-02-17T12:03:38.269 INFO:tasks.rados.rados.0.trial142.stdout:2924: seq_num 993 ranges {689351=648147,2124737=564614} 2026-02-17T12:03:38.274 INFO:tasks.rados.rados.0.trial142.stdout:2924: writing trial14245205-25 from 689351 to 1337498 tid 1 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2924: writing trial14245205-25 from 2124737 to 2689351 tid 2 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2925: copy_from oid 8 from oid 34 current snap is 322 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2921: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2696 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2923: finishing rollback tid 0 to trial14245205-43 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2923: finishing rollback tid 1 to trial14245205-43 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2923: finishing rollback tid 2 to trial14245205-43 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2710 (ObjNum 883 snap 280 seq_num 883) dirty exists 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2924: finishing write tid 1 to trial14245205-25 2026-02-17T12:03:38.280 INFO:tasks.rados.rados.0.trial142.stdout:2921: done (3 left) 2026-02-17T12:03:38.281 INFO:tasks.rados.rados.0.trial142.stdout:2923: done (2 left) 2026-02-17T12:03:38.281 INFO:tasks.rados.rados.0.trial142.stdout:2926: delete oid 16 current snap is 322 2026-02-17T12:03:38.281 INFO:tasks.rados.rados.0.trial142.stdout:2925: finishing copy_from to trial14245205-8 2026-02-17T12:03:38.281 INFO:tasks.rados.rados.0.trial142.stdout:2925: got expected ENOENT (src dne) 2026-02-17T12:03:38.281 INFO:tasks.rados.rados.0.trial142.stdout:2925: finishing copy_from racing read to trial14245205-8 2026-02-17T12:03:38.282 INFO:tasks.rados.rados.0.trial142.stdout:2925: done (2 left) 2026-02-17T12:03:38.282 INFO:tasks.rados.rados.0.trial142.stdout:2926: done (1 left) 2026-02-17T12:03:38.282 INFO:tasks.rados.rados.0.trial142.stdout:2927: snap_create 2026-02-17T12:03:38.282 INFO:tasks.rados.rados.0.trial142.stdout:2924: finishing write tid 2 to trial14245205-25 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: finishing write tid 3 to trial14245205-25 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: finishing write tid 4 to trial14245205-25 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: oid 25 updating version 0 to 2017 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: oid 25 version 2017 is already newer than 2016 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: oid 25 version 2017 is already newer than 2015 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2017 (ObjNum 993 snap 322 seq_num 993) dirty exists 2026-02-17T12:03:38.283 INFO:tasks.rados.rados.0.trial142.stdout:2924: left oid 25 (ObjNum 993 snap 322 seq_num 993) 2026-02-17T12:03:39.257 INFO:tasks.rados.rados.0.trial142.stdout:2924: done (1 left) 2026-02-17T12:03:39.257 INFO:tasks.rados.rados.0.trial142.stdout:2927: done (0 left) 2026-02-17T12:03:39.257 INFO:tasks.rados.rados.0.trial142.stdout:2928: snap_create 2026-02-17T12:03:40.257 INFO:tasks.rados.rados.0.trial142.stdout:2928: done (0 left) 2026-02-17T12:03:40.257 INFO:tasks.rados.rados.0.trial142.stdout:2929: delete oid 23 current snap is 324 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2929: done (0 left) 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2930: rollback oid 40 current snap is 324 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 40 to 317 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2931: read oid 35 snap -1 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2931: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2932: write (excl) oid 46 current snap is 324 2026-02-17T12:03:40.261 INFO:tasks.rados.rados.0.trial142.stdout:2932: seq_num 996 ranges {739772=590247,1900183=540336} 2026-02-17T12:03:40.266 INFO:tasks.rados.rados.0.trial142.stdout:2932: writing trial14245205-46 from 739772 to 1330019 tid 1 2026-02-17T12:03:40.271 INFO:tasks.rados.rados.0.trial142.stdout:2932: writing trial14245205-46 from 1900183 to 2440519 tid 2 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2933: read oid 28 snap -1 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2933: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2934: read oid 37 snap 286 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2934: expect (ObjNum 870 snap 273 seq_num 870) 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2935: snap_create 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2930: finishing rollback tid 0 to trial14245205-40 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2930: finishing rollback tid 1 to trial14245205-40 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2930: finishing rollback tid 2 to trial14245205-40 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 2139 (ObjNum 941 snap 304 seq_num 941) dirty exists 2026-02-17T12:03:40.272 INFO:tasks.rados.rados.0.trial142.stdout:2931: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:03:40.346 INFO:tasks.rados.rados.0.trial142.stdout:2932: finishing write tid 1 to trial14245205-46 2026-02-17T12:03:40.346 INFO:tasks.rados.rados.0.trial142.stdout:2933: expect (ObjNum 941 snap 304 seq_num 941) 2026-02-17T12:03:40.498 INFO:tasks.rados.rados.0.trial142.stdout:2932: finishing write tid 2 to trial14245205-46 2026-02-17T12:03:40.498 INFO:tasks.rados.rados.0.trial142.stdout:2932: finishing write tid 3 to trial14245205-46 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2932: finishing write tid 4 to trial14245205-46 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2932: oid 46 updating version 0 to 2713 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2932: oid 46 version 2713 is already newer than 2712 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2932: oid 46 version 2713 is already newer than 2711 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2713 (ObjNum 996 snap 324 seq_num 996) dirty exists 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2932: left oid 46 (ObjNum 996 snap 324 seq_num 996) 2026-02-17T12:03:40.499 INFO:tasks.rados.rados.0.trial142.stdout:2934: expect (ObjNum 870 snap 273 seq_num 870) 2026-02-17T12:03:41.260 INFO:tasks.rados.rados.0.trial142.stdout:2930: done (5 left) 2026-02-17T12:03:41.260 INFO:tasks.rados.rados.0.trial142.stdout:2931: done (4 left) 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2932: done (3 left) 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2933: done (2 left) 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2934: done (1 left) 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2935: done (0 left) 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2936: write (excl) oid 13 current snap is 325 2026-02-17T12:03:41.261 INFO:tasks.rados.rados.0.trial142.stdout:2936: seq_num 997 ranges {756579=665496,1958665=400347} 2026-02-17T12:03:41.265 INFO:tasks.rados.rados.0.trial142.stdout:2936: writing trial14245205-13 from 756579 to 1422075 tid 1 2026-02-17T12:03:41.269 INFO:tasks.rados.rados.0.trial142.stdout:2936: writing trial14245205-13 from 1958665 to 2359012 tid 2 2026-02-17T12:03:41.269 INFO:tasks.rados.rados.0.trial142.stdout:2937: write oid 21 current snap is 325 2026-02-17T12:03:41.269 INFO:tasks.rados.rados.0.trial142.stdout:2937: seq_num 998 ranges {773386=740745,2017147=544005} 2026-02-17T12:03:41.274 INFO:tasks.rados.rados.0.trial142.stdout:2937: writing trial14245205-21 from 773386 to 1514131 tid 1 2026-02-17T12:03:41.279 INFO:tasks.rados.rados.0.trial142.stdout:2937: writing trial14245205-21 from 2017147 to 2561152 tid 2 2026-02-17T12:03:41.279 INFO:tasks.rados.rados.0.trial142.stdout:2938: write (excl) oid 12 current snap is 325 2026-02-17T12:03:41.279 INFO:tasks.rados.rados.0.trial142.stdout:2938: seq_num 999 ranges {790193=415994,1959276=404016} 2026-02-17T12:03:41.283 INFO:tasks.rados.rados.0.trial142.stdout:2938: writing trial14245205-12 from 790193 to 1206187 tid 1 2026-02-17T12:03:41.288 INFO:tasks.rados.rados.0.trial142.stdout:2938: writing trial14245205-12 from 1959276 to 2363292 tid 2 2026-02-17T12:03:41.288 INFO:tasks.rados.rados.0.trial142.stdout:2939: snap_remove snap 320 2026-02-17T12:03:41.289 INFO:tasks.rados.rados.0.trial142.stdout:2936: finishing write tid 1 to trial14245205-13 2026-02-17T12:03:41.289 INFO:tasks.rados.rados.0.trial142.stdout:2936: finishing write tid 2 to trial14245205-13 2026-02-17T12:03:41.289 INFO:tasks.rados.rados.0.trial142.stdout:2936: finishing write tid 3 to trial14245205-13 2026-02-17T12:03:42.295 INFO:tasks.rados.rados.0.trial142.stdout:2939: done (3 left) 2026-02-17T12:03:42.295 INFO:tasks.rados.rados.0.trial142.stdout:2940: read oid 18 snap -1 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2940: expect (ObjNum 963 snap 310 seq_num 963) 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2941: write (excl) oid 34 current snap is 325 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2936: finishing write tid 4 to trial14245205-13 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2936: oid 13 updating version 0 to 2698 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2936: oid 13 version 2698 is already newer than 2697 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2936: oid 13 updating version 2698 to 2699 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 2699 (ObjNum 997 snap 325 seq_num 997) dirty exists 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2936: left oid 13 (ObjNum 997 snap 325 seq_num 997) 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2937: finishing write tid 1 to trial14245205-21 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2937: finishing write tid 2 to trial14245205-21 2026-02-17T12:03:42.296 INFO:tasks.rados.rados.0.trial142.stdout:2937: finishing write tid 3 to trial14245205-21 2026-02-17T12:03:42.297 INFO:tasks.rados.rados.0.trial142.stdout:2941: seq_num 1000 ranges {407000=491243,1617758=547674,2595228=211772} 2026-02-17T12:03:42.298 INFO:tasks.rados.rados.0.trial142.stdout:2941: writing trial14245205-34 from 407000 to 898243 tid 1 2026-02-17T12:03:42.303 INFO:tasks.rados.rados.0.trial142.stdout:2941: writing trial14245205-34 from 1617758 to 2165432 tid 2 2026-02-17T12:03:42.306 INFO:tasks.rados.rados.0.trial142.stdout:2941: writing trial14245205-34 from 2595228 to 2807000 tid 3 2026-02-17T12:03:42.306 INFO:tasks.rados.rados.0.trial142.stdout:2936: done (4 left) 2026-02-17T12:03:42.307 INFO:tasks.rados.rados.0.trial142.stdout:2942: write (excl) oid 22 current snap is 325 2026-02-17T12:03:42.307 INFO:tasks.rados.rados.0.trial142.stdout:2942: seq_num 1001 ranges {423807=566492,1676240=407685,2739004=84803} 2026-02-17T12:03:42.310 INFO:tasks.rados.rados.0.trial142.stdout:2942: writing trial14245205-22 from 423807 to 990299 tid 1 2026-02-17T12:03:42.314 INFO:tasks.rados.rados.0.trial142.stdout:2942: writing trial14245205-22 from 1676240 to 2083925 tid 2 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2942: writing trial14245205-22 from 2739004 to 2823807 tid 3 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2943: delete oid 9 current snap is 325 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2937: finishing write tid 4 to trial14245205-21 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2937: oid 21 updating version 0 to 2139 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2937: oid 21 updating version 2139 to 2140 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2937: oid 21 updating version 2140 to 2141 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2141 (ObjNum 998 snap 325 seq_num 998) dirty exists 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2937: left oid 21 (ObjNum 998 snap 325 seq_num 998) 2026-02-17T12:03:42.318 INFO:tasks.rados.rados.0.trial142.stdout:2938: finishing write tid 1 to trial14245205-12 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: finishing write tid 2 to trial14245205-12 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: finishing write tid 3 to trial14245205-12 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: finishing write tid 4 to trial14245205-12 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: oid 12 updating version 0 to 2717 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: oid 12 version 2717 is already newer than 2715 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: oid 12 version 2717 is already newer than 2716 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 12 v 2717 (ObjNum 999 snap 325 seq_num 999) dirty exists 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2938: left oid 12 (ObjNum 999 snap 325 seq_num 999) 2026-02-17T12:03:42.319 INFO:tasks.rados.rados.0.trial142.stdout:2940: expect (ObjNum 963 snap 310 seq_num 963) 2026-02-17T12:03:42.369 INFO:tasks.rados.rados.0.trial142.stdout:2941: finishing write tid 1 to trial14245205-34 2026-02-17T12:03:42.369 INFO:tasks.rados.rados.0.trial142.stdout:2941: finishing write tid 2 to trial14245205-34 2026-02-17T12:03:42.369 INFO:tasks.rados.rados.0.trial142.stdout:2941: finishing write tid 3 to trial14245205-34 2026-02-17T12:03:42.369 INFO:tasks.rados.rados.0.trial142.stdout:2941: finishing write tid 4 to trial14245205-34 2026-02-17T12:03:42.369 INFO:tasks.rados.rados.0.trial142.stdout:2941: finishing write tid 5 to trial14245205-34 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: oid 34 updating version 0 to 2143 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: oid 34 updating version 2143 to 2144 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: oid 34 version 2144 is already newer than 2142 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: oid 34 updating version 2144 to 2145 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 2145 (ObjNum 1000 snap 325 seq_num 1000) dirty exists 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: left oid 34 (ObjNum 1000 snap 325 seq_num 1000) 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2942: finishing write tid 1 to trial14245205-22 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2942: finishing write tid 2 to trial14245205-22 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2937: done (5 left) 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2938: done (4 left) 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2940: done (3 left) 2026-02-17T12:03:42.370 INFO:tasks.rados.rados.0.trial142.stdout:2941: done (2 left) 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2943: done (1 left) 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2944: write oid 23 current snap is 325 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: finishing write tid 3 to trial14245205-22 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: finishing write tid 4 to trial14245205-22 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: finishing write tid 5 to trial14245205-22 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: oid 22 updating version 0 to 2674 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: oid 22 updating version 2674 to 2675 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: oid 22 updating version 2675 to 2676 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: oid 22 updating version 2676 to 2677 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2677 (ObjNum 1001 snap 325 seq_num 1001) dirty exists 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2942: left oid 22 (ObjNum 1001 snap 325 seq_num 1001) 2026-02-17T12:03:42.371 INFO:tasks.rados.rados.0.trial142.stdout:2944: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2026-02-17T12:03:42.373 INFO:tasks.rados.rados.0.trial142.stdout:2944: writing trial14245205-23 from 457421 to 1174411 tid 1 2026-02-17T12:03:42.377 INFO:tasks.rados.rados.0.trial142.stdout:2944: writing trial14245205-23 from 1676851 to 2088205 tid 2 2026-02-17T12:03:42.380 INFO:tasks.rados.rados.0.trial142.stdout:2944: writing trial14245205-23 from 2677497 to 2857421 tid 3 2026-02-17T12:03:42.380 INFO:tasks.rados.rados.0.trial142.stdout:2942: done (1 left) 2026-02-17T12:03:42.380 INFO:tasks.rados.rados.0.trial142.stdout:2945: copy_from oid 35 from oid 15 current snap is 325 2026-02-17T12:03:42.380 INFO:tasks.rados.rados.0.trial142.stdout:2944: finishing write tid 1 to trial14245205-23 2026-02-17T12:03:42.380 INFO:tasks.rados.rados.0.trial142.stdout:2944: finishing write tid 2 to trial14245205-23 2026-02-17T12:03:42.381 INFO:tasks.rados.rados.0.trial142.stdout:2946: write (excl) oid 22 current snap is 325 2026-02-17T12:03:42.381 INFO:tasks.rados.rados.0.trial142.stdout:2946: seq_num 1004 ranges {474228=508592,1451686=555012,2704920=169308} 2026-02-17T12:03:42.383 INFO:tasks.rados.rados.0.trial142.stdout:2946: writing trial14245205-22 from 474228 to 982820 tid 1 2026-02-17T12:03:42.387 INFO:tasks.rados.rados.0.trial142.stdout:2946: writing trial14245205-22 from 1451686 to 2006698 tid 2 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2946: writing trial14245205-22 from 2704920 to 2874228 tid 3 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2947: rollback oid 37 current snap is 325 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 324 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2945: finishing copy_from to trial14245205-35 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2945: got expected ENOENT (src dne) 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2945: finishing copy_from racing read to trial14245205-35 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2944: finishing write tid 3 to trial14245205-23 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2945: done (3 left) 2026-02-17T12:03:42.391 INFO:tasks.rados.rados.0.trial142.stdout:2948: write oid 48 current snap is 325 2026-02-17T12:03:42.392 INFO:tasks.rados.rados.0.trial142.stdout:2948: seq_num 1005 ranges {491035=583841,1510168=698670,2732343=158692} 2026-02-17T12:03:42.395 INFO:tasks.rados.rados.0.trial142.stdout:2948: writing trial14245205-48 from 491035 to 1074876 tid 1 2026-02-17T12:03:42.399 INFO:tasks.rados.rados.0.trial142.stdout:2948: writing trial14245205-48 from 1510168 to 2208838 tid 2 2026-02-17T12:03:42.403 INFO:tasks.rados.rados.0.trial142.stdout:2948: writing trial14245205-48 from 2732343 to 2891035 tid 3 2026-02-17T12:03:42.403 INFO:tasks.rados.rados.0.trial142.stdout:2949: snap_create 2026-02-17T12:03:42.403 INFO:tasks.rados.rados.0.trial142.stdout:2944: finishing write tid 4 to trial14245205-23 2026-02-17T12:03:42.403 INFO:tasks.rados.rados.0.trial142.stdout:2944: finishing write tid 5 to trial14245205-23 2026-02-17T12:03:42.403 INFO:tasks.rados.rados.0.trial142.stdout:2944: oid 23 updating version 0 to 2512 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2944: oid 23 version 2512 is already newer than 2511 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2944: oid 23 updating version 2512 to 2513 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2944: oid 23 version 2513 is already newer than 2510 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2513 (ObjNum 1003 snap 325 seq_num 1003) dirty exists 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2944: left oid 23 (ObjNum 1003 snap 325 seq_num 1003) 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2946: finishing write tid 1 to trial14245205-22 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2946: finishing write tid 2 to trial14245205-22 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2946: finishing write tid 3 to trial14245205-22 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2946: finishing write tid 4 to trial14245205-22 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2947: finishing rollback tid 1 to trial14245205-37 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2136 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:03:42.404 INFO:tasks.rados.rados.0.trial142.stdout:2946: finishing write tid 5 to trial14245205-22 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2946: oid 22 updating version 0 to 2681 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2946: oid 22 version 2681 is already newer than 2678 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2946: oid 22 version 2681 is already newer than 2679 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2946: oid 22 version 2681 is already newer than 2680 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2681 (ObjNum 1004 snap 325 seq_num 1004) dirty exists 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2946: left oid 22 (ObjNum 1004 snap 325 seq_num 1004) 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2948: finishing write tid 1 to trial14245205-48 2026-02-17T12:03:42.405 INFO:tasks.rados.rados.0.trial142.stdout:2948: finishing write tid 2 to trial14245205-48 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: finishing write tid 3 to trial14245205-48 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: finishing write tid 4 to trial14245205-48 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: finishing write tid 5 to trial14245205-48 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: oid 48 updating version 0 to 2142 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: oid 48 updating version 2142 to 2143 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: oid 48 version 2143 is already newer than 2141 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:2948: oid 48 version 2143 is already newer than 2140 2026-02-17T12:03:42.406 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2143 (ObjNum 1005 snap 325 seq_num 1005) dirty exists 2026-02-17T12:03:42.407 INFO:tasks.rados.rados.0.trial142.stdout:2948: left oid 48 (ObjNum 1005 snap 325 seq_num 1005) 2026-02-17T12:03:42.942 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:03:42.943 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:03:42.943 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:03:42.943 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:03:42.946 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:03:42.946 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:03:42.946 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: get_monmap_and_config 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: build_initial_monmap 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: monmap: 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:43.018 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:43.014223+0000 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:43.014223+0000 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 Processor -- start 2026-02-17T12:03:43.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 -- start start 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: init 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-b con 0x7f7e980a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7e9809d270 0x7f7e98138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-c con 0x7f7e9809d270 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e981385b0 0x7f7e98138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-a con 0x7f7e981385b0 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.013+0000 7f7e9fe64640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9809a5c0 con 0x7f7e981385b0 2026-02-17T12:03:43.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9809b520 con 0x7f7e9809d270 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7e980a3f90 con 0x7f7e980a3bb0 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9fe64640 10 monclient(hunting): authenticate will time out at 1710.633013s 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e981385b0 0x7f7e98138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e981385b0 0x7f7e98138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34248/0 (socket says 10.20.193.51:34248) 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43066/0 (socket says 10.20.193.51:43066) 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 -- 10.20.193.51:0/1429563533 learned_addr learned my addr 10.20.193.51:0/1429563533 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:43.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): get_auth_request con 0x7f7e981385b0 auth_method 0 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 10 monclient(hunting): get_auth_request con 0x7f7e980a3bb0 auth_method 0 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 -- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 msgr2=0x7f7e9809cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 -- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 msgr2=0x7f7e9809cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:43.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9d3d8640 1 --2- 10.20.193.51:0/1429563533 >> v2:10.20.193.142:3300/0 conn(0x7f7e9809d270 0x7f7e98138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9d3d8640 10 monclient(hunting): get_auth_request con 0x7f7e9809d270 auth_method 0 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9d3d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9d3d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9d3d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_done global_id 204417 payload 274 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 -- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 msgr2=0x7f7e9809cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 -- 10.20.193.51:0/1429563533 >> v2:10.20.193.142:3300/0 conn(0x7f7e9809d270 msgr2=0x7f7e98138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:43.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/1429563533 >> v2:10.20.193.142:3300/0 conn(0x7f7e9809d270 0x7f7e98138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient: _finish_hunting 0 2026-02-17T12:03:43.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 monclient: found mon.noname-a 2026-02-17T12:03:43.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:43.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.014+0000 7f7e9e3da640 1 -- 10.20.193.51:0/1429563533 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e98135430 con 0x7f7e981385b0 2026-02-17T12:03:43.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9e3da640 1 -- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 msgr2=0x7f7e98138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e98138a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e9806c0d0 tx=0x7f7e9402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467ed068c54f069d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 1 -- 10.20.193.51:0/1429563533 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9402fe60 con 0x7f7e981385b0 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: dump: 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: _finish_auth 0 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: _check_auth_tickets 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 1 -- 10.20.193.51:0/1429563533 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e940373f0 con 0x7f7e981385b0 2026-02-17T12:03:43.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9fe64640 5 monclient: authenticate success, global_id 204417 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 1 -- 10.20.193.51:0/1429563533 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e940377c0 con 0x7f7e981385b0 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9fe64640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9fe64640 4 set_mon_vals no callback set 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.016+0000 7f7e9cbd7640 10 monclient: dump: 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.033 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 10 monclient: shutdown 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 -- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 msgr2=0x7f7e98138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:43.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e98138a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e9806c0d0 tx=0x7f7e9402f230 comp rx=0 tx=0).stop 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 -- 10.20.193.51:0/1429563533 shutdown_connections 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e98138a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/1429563533 >> v2:10.20.193.142:3300/0 conn(0x7f7e9809d270 0x7f7e98138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/1429563533 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e980a3bb0 0x7f7e9809cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 -- 10.20.193.51:0/1429563533 >> 10.20.193.51:0/1429563533 conn(0x7f7e980a30c0 msgr2=0x7f7e980a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 -- 10.20.193.51:0/1429563533 shutdown_connections 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 1 -- 10.20.193.51:0/1429563533 wait complete. 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 10 monclient: build_initial_monmap 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.017+0000 7f7e9fe64640 10 monclient: monmap: 2026-02-17T12:03:43.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 Processor -- start 2026-02-17T12:03:43.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 -- start start 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient: init 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-c con 0x7f7e9809d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e980a3bb0 0x7f7e98131c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-b con 0x7f7e980a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e981321a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): picked mon.noname-a con 0x7f7e981385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:43.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98074ac0 con 0x7f7e981385b0 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9809b240 con 0x7f7e980a3bb0 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98135040 con 0x7f7e9809d270 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9fe64640 10 monclient(hunting): authenticate will time out at 1710.637425s 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e981321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43080/0 (socket says 10.20.193.51:43080) 2026-02-17T12:03:43.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 -- 10.20.193.51:0/2995056351 learned_addr learned my addr 10.20.193.51:0/2995056351 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 10 monclient(hunting): get_auth_request con 0x7f7e9809d270 auth_method 0 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): get_auth_request con 0x7f7e981385b0 auth_method 0 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:43.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 msgr2=0x7f7e981cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 msgr2=0x7f7e981cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient(hunting): handle_auth_done global_id 204420 payload 824 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 msgr2=0x7f7e981cf390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e980a3bb0 msgr2=0x7f7e98131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e980a3bb0 0x7f7e98131c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient: _finish_hunting 0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 monclient: found mon.noname-a 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.018+0000 7f7e9e3da640 1 -- 10.20.193.51:0/2995056351 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e981c2a40 con 0x7f7e981385b0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9e3da640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 msgr2=0x7f7e981321a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9e3da640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e981321a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e94035000 tx=0x7f7e94004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94046030 con 0x7f7e981385b0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: dump: 2026-02-17T12:03:43.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:43.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e94041870 con 0x7f7e981385b0 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94037e60 con 0x7f7e981385b0 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e87fff640 4 set_mon_vals no callback set 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e867fc640 10 monclient: dump: 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 5 monclient: authenticate success, global_id 204420 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 10 monclient: _renew_subs 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9812c710 con 0x7f7e981385b0 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 10 monclient: _renew_subs 2026-02-17T12:03:43.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.020+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e980a1350 con 0x7f7e981385b0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9fe64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9fe64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9fe64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9809cd30 con 0x7f7e981385b0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7e94041aa0 con 0x7f7e981385b0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e867fc640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 0x7f7e680401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(676..676 src has 323..676) ==== 4795+0+0 (secure 0 0 0) 0x7f7e94077f10 con 0x7f7e981385b0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 0x7f7e680401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.021+0000 7f7e9dbd9640 10 monclient: get_auth_request con 0x7f7e6803dd10 auth_method 0 2026-02-17T12:03:43.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.024+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7e94049360 con 0x7f7e981385b0 2026-02-17T12:03:43.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.024+0000 7f7e867fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:43.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.024+0000 7f7e867fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:43.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.024+0000 7f7e9dbd9640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 0x7f7e680401d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7e88006f80 tx=0x7f7e88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.137+0000 7f7e9fe64640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.137+0000 7f7e9fe64640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.137+0000 7f7e9fe64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.137+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7e981c2ea0 con 0x7f7e981385b0 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e867fc640 1 -- 10.20.193.51:0/2995056351 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f7e9404b460 con 0x7f7e981385b0 2026-02-17T12:03:43.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e867fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:43.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e867fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:43.141 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":166,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:43.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 msgr2=0x7f7e680401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:43.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 0x7f7e680401d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7e88006f80 tx=0x7f7e88008040 comp rx=0 tx=0).stop 2026-02-17T12:03:43.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 10 monclient: shutdown 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 msgr2=0x7f7e981321a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e981321a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e94035000 tx=0x7f7e94004b40 comp rx=0 tx=0).stop 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 shutdown_connections 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e6803dd10 0x7f7e680401d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e981385b0 0x7f7e981321a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e980a3bb0 0x7f7e98131c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 --2- 10.20.193.51:0/2995056351 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e9809d270 0x7f7e981cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:43.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 >> 10.20.193.51:0/2995056351 conn(0x7f7e980a30c0 msgr2=0x7f7e9806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:43.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 shutdown_connections 2026-02-17T12:03:43.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:43.138+0000 7f7e9fe64640 1 -- 10.20.193.51:0/2995056351 wait complete. 2026-02-17T12:03:43.295 INFO:tasks.rados.rados.0.trial142.stdout:2944: done (4 left) 2026-02-17T12:03:43.295 INFO:tasks.rados.rados.0.trial142.stdout:2946: done (3 left) 2026-02-17T12:03:43.295 INFO:tasks.rados.rados.0.trial142.stdout:2947: done (2 left) 2026-02-17T12:03:43.295 INFO:tasks.rados.rados.0.trial142.stdout:2948: done (1 left) 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:2949: done (0 left) 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:2950: rollback oid 7 current snap is 326 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 317 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:2951: read oid 35 snap -1 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:2951: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:03:43.296 INFO:tasks.rados.rados.0.trial142.stdout:2952: snap_create 2026-02-17T12:03:43.297 INFO:tasks.rados.rados.0.trial142.stdout:2950: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:03:43.297 INFO:tasks.rados.rados.0.trial142.stdout:2950: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:03:43.297 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2727 (ObjNum 979 snap 315 seq_num 979) dirty exists 2026-02-17T12:03:43.300 INFO:tasks.rados.rados.0.trial142.stdout:2951: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:03:44.257 INFO:tasks.rados.rados.0.trial142.stdout:2950: done (2 left) 2026-02-17T12:03:44.257 INFO:tasks.rados.rados.0.trial142.stdout:2951: done (1 left) 2026-02-17T12:03:44.257 INFO:tasks.rados.rados.0.trial142.stdout:2952: done (0 left) 2026-02-17T12:03:44.257 INFO:tasks.rados.rados.0.trial142.stdout:2953: snap_remove snap 326 2026-02-17T12:03:45.260 INFO:tasks.rados.rados.0.trial142.stdout:2953: done (0 left) 2026-02-17T12:03:45.260 INFO:tasks.rados.rados.0.trial142.stdout:2954: write (excl) oid 24 current snap is 327 2026-02-17T12:03:45.260 INFO:tasks.rados.rados.0.trial142.stdout:2954: seq_num 1006 ranges {507842=659090,1568650=558681,2759766=148076} 2026-02-17T12:03:45.265 INFO:tasks.rados.rados.0.trial142.stdout:2954: writing trial14245205-24 from 507842 to 1166932 tid 1 2026-02-17T12:03:45.269 INFO:tasks.rados.rados.0.trial142.stdout:2954: writing trial14245205-24 from 1568650 to 2127331 tid 2 2026-02-17T12:03:45.272 INFO:tasks.rados.rados.0.trial142.stdout:2954: writing trial14245205-24 from 2759766 to 2907842 tid 3 2026-02-17T12:03:45.272 INFO:tasks.rados.rados.0.trial142.stdout:2955: write oid 18 current snap is 327 2026-02-17T12:03:45.272 INFO:tasks.rados.rados.0.trial142.stdout:2954: finishing write tid 1 to trial14245205-24 2026-02-17T12:03:45.272 INFO:tasks.rados.rados.0.trial142.stdout:2954: finishing write tid 2 to trial14245205-24 2026-02-17T12:03:45.272 INFO:tasks.rados.rados.0.trial142.stdout:2955: seq_num 1007 ranges {524649=734339,1910779=702339} 2026-02-17T12:03:45.276 INFO:tasks.rados.rados.0.trial142.stdout:2955: writing trial14245205-18 from 524649 to 1258988 tid 1 2026-02-17T12:03:45.282 INFO:tasks.rados.rados.0.trial142.stdout:2955: writing trial14245205-18 from 1910779 to 2613118 tid 2 2026-02-17T12:03:45.282 INFO:tasks.rados.rados.0.trial142.stdout:2956: write (excl) oid 22 current snap is 327 2026-02-17T12:03:45.282 INFO:tasks.rados.rados.0.trial142.stdout:2954: finishing write tid 3 to trial14245205-24 2026-02-17T12:03:45.282 INFO:tasks.rados.rados.0.trial142.stdout:2954: finishing write tid 4 to trial14245205-24 2026-02-17T12:03:45.282 INFO:tasks.rados.rados.0.trial142.stdout:2954: finishing write tid 5 to trial14245205-24 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2954: oid 24 updating version 0 to 2144 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2954: oid 24 version 2144 is already newer than 2143 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2954: oid 24 version 2144 is already newer than 2142 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2954: oid 24 version 2144 is already newer than 2141 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2144 (ObjNum 1006 snap 327 seq_num 1006) dirty exists 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2954: left oid 24 (ObjNum 1006 snap 327 seq_num 1006) 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2955: finishing write tid 1 to trial14245205-18 2026-02-17T12:03:45.283 INFO:tasks.rados.rados.0.trial142.stdout:2956: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2026-02-17T12:03:45.285 INFO:tasks.rados.rados.0.trial142.stdout:2956: writing trial14245205-22 from 541456 to 951044 tid 1 2026-02-17T12:03:45.290 INFO:tasks.rados.rados.0.trial142.stdout:2956: writing trial14245205-22 from 1569261 to 2131611 tid 2 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:2956: writing trial14245205-22 from 2814612 to 2941456 tid 3 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:2954: done (2 left) 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:2957: rollback oid 24 current snap is 327 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 319 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:2955: finishing write tid 2 to trial14245205-18 2026-02-17T12:03:45.294 INFO:tasks.rados.rados.0.trial142.stdout:2955: finishing write tid 3 to trial14245205-18 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: finishing write tid 4 to trial14245205-18 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: oid 18 updating version 0 to 2730 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: oid 18 updating version 2730 to 2731 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: oid 18 version 2731 is already newer than 2729 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2731 (ObjNum 1007 snap 327 seq_num 1007) dirty exists 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: left oid 18 (ObjNum 1007 snap 327 seq_num 1007) 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2956: finishing write tid 1 to trial14245205-22 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2956: finishing write tid 2 to trial14245205-22 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2955: done (2 left) 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2958: read oid 37 snap -1 2026-02-17T12:03:45.295 INFO:tasks.rados.rados.0.trial142.stdout:2958: expect deleted 2026-02-17T12:03:45.296 INFO:tasks.rados.rados.0.trial142.stdout:2959: copy_from oid 4 from oid 8 current snap is 327 2026-02-17T12:03:45.296 INFO:tasks.rados.rados.0.trial142.stdout:2960: read oid 3 snap -1 2026-02-17T12:03:45.296 INFO:tasks.rados.rados.0.trial142.stdout:2960: expect deleted 2026-02-17T12:03:45.296 INFO:tasks.rados.rados.0.trial142.stdout:2961: write oid 21 current snap is 327 2026-02-17T12:03:45.296 INFO:tasks.rados.rados.0.trial142.stdout:2961: seq_num 1009 ranges {558263=484837,1627743=706008} 2026-02-17T12:03:45.297 INFO:tasks.rados.rados.0.trial142.stdout:2961: writing trial14245205-21 from 558263 to 1043100 tid 1 2026-02-17T12:03:45.302 INFO:tasks.rados.rados.0.trial142.stdout:2961: writing trial14245205-21 from 1627743 to 2333751 tid 2 2026-02-17T12:03:45.302 INFO:tasks.rados.rados.0.trial142.stdout:2962: snap_create 2026-02-17T12:03:45.302 INFO:tasks.rados.rados.0.trial142.stdout:2956: finishing write tid 3 to trial14245205-22 2026-02-17T12:03:45.302 INFO:tasks.rados.rados.0.trial142.stdout:2956: finishing write tid 4 to trial14245205-22 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: finishing write tid 5 to trial14245205-22 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: oid 22 updating version 0 to 2683 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: oid 22 updating version 2683 to 2685 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: oid 22 version 2685 is already newer than 2682 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: oid 22 version 2685 is already newer than 2684 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2685 (ObjNum 1008 snap 327 seq_num 1008) dirty exists 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: left oid 22 (ObjNum 1008 snap 327 seq_num 1008) 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2957: finishing rollback tid 0 to trial14245205-24 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2957: finishing rollback tid 1 to trial14245205-24 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2957: finishing rollback tid 2 to trial14245205-24 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2147 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:03:45.303 INFO:tasks.rados.rados.0.trial142.stdout:2961: finishing write tid 1 to trial14245205-21 2026-02-17T12:03:45.304 INFO:tasks.rados.rados.0.trial142.stdout:2959: finishing copy_from racing read to trial14245205-4 2026-02-17T12:03:45.304 INFO:tasks.rados.rados.0.trial142.stdout:2959: finishing copy_from to trial14245205-4 2026-02-17T12:03:45.304 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2694 (ObjNum 988 snap 318 seq_num 988) dirty exists 2026-02-17T12:03:45.304 INFO:tasks.rados.rados.0.trial142.stdout:2961: finishing write tid 2 to trial14245205-21 2026-02-17T12:03:45.304 INFO:tasks.rados.rados.0.trial142.stdout:2961: finishing write tid 3 to trial14245205-21 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:2961: finishing write tid 4 to trial14245205-21 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:2961: oid 21 updating version 0 to 2148 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:2961: oid 21 version 2148 is already newer than 2147 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:2961: oid 21 version 2148 is already newer than 2146 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2148 (ObjNum 1009 snap 327 seq_num 1009) dirty exists 2026-02-17T12:03:45.305 INFO:tasks.rados.rados.0.trial142.stdout:2961: left oid 21 (ObjNum 1009 snap 327 seq_num 1009) 2026-02-17T12:03:46.150 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.216+0000 7f7fcda98640 10 monclient: get_monmap_and_config 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.216+0000 7f7fcda98640 10 monclient: build_initial_monmap 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.216+0000 7f7fcda98640 10 monclient: monmap: 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:46.219 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:46.217874+0000 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:46.217874+0000 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:46.220 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:46.221 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:46.221 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 Processor -- start 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 -- start start 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient: init 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-b con 0x7f7fc806c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7fc8074d60 0x7f7fc806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-a con 0x7f7fc8074d60 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7fc806d1f0 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:46.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc80a0210 con 0x7f7fc806d1f0 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc80a07d0 con 0x7f7fc8074d60 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80a04f0 con 0x7f7fc806c8d0 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fcda98640 10 monclient(hunting): authenticate will time out at 1713.836801s 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7fc8074d60 0x7f7fc806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7fc8074d60 0x7f7fc806ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45140/0 (socket says 10.20.193.51:45140) 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc7fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7fc806d1f0 0x7f7fc809d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35098/0 (socket says 10.20.193.51:35098) 2026-02-17T12:03:46.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57316/0 (socket says 10.20.193.51:57316) 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 1 -- 10.20.193.51:0/3124438801 learned_addr learned my addr 10.20.193.51:0/3124438801 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): get_auth_request con 0x7f7fc8074d60 auth_method 0 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 10 monclient(hunting): get_auth_request con 0x7f7fc806c8d0 auth_method 0 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:46.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 1 -- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc80a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 1 -- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc80a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.217+0000 7f7fc6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 10 monclient(hunting): handle_auth_done global_id 204423 payload 274 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 1 -- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc80a13b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 1 -- 10.20.193.51:0/3124438801 >> v1:10.20.193.51:6789/0 conn(0x7f7fc806d1f0 legacy=0x7f7fc809d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 1 monclient: found mon.noname-a 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:46.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.218+0000 7f7fc6ffd640 1 -- 10.20.193.51:0/3124438801 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc809ecd0 con 0x7f7fc8074d60 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc6ffd640 1 -- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 msgr2=0x7f7fc806ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc6ffd640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc806ccb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009970 tx=0x7f7fb802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc4d7dd4b5f8d59 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 1 -- 10.20.193.51:0/3124438801 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb803c070 con 0x7f7fc8074d60 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: dump: 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.235 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 1 -- 10.20.193.51:0/3124438801 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb802fcd0 con 0x7f7fc8074d60 2026-02-17T12:03:46.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 5 monclient: authenticate success, global_id 204423 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 1 -- 10.20.193.51:0/3124438801 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8037660 con 0x7f7fc8074d60 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 4 set_mon_vals no callback set 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fc67fc640 10 monclient: dump: 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 10 monclient: shutdown 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 1 -- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 msgr2=0x7f7fc806ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.220+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc806ccb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009970 tx=0x7f7fb802ee90 comp rx=0 tx=0).stop 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- 10.20.193.51:0/3124438801 shutdown_connections 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc806ccb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3124438801 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc80a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- 10.20.193.51:0/3124438801 >> 10.20.193.51:0/3124438801 conn(0x7f7fc80aaa60 msgr2=0x7f7fc80aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- 10.20.193.51:0/3124438801 shutdown_connections 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- 10.20.193.51:0/3124438801 wait complete. 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient: build_initial_monmap 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient: monmap: 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:46.239 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 Processor -- start 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- start start 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient: init 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:03:46.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-c con 0x7f7fc806c8d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 0x7f7fc81cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-b con 0x7f7fc806d1f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc812fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): picked mon.noname-a con 0x7f7fc8074d60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80ab970 con 0x7f7fc8074d60 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80ab7f0 con 0x7f7fc806d1f0 2026-02-17T12:03:46.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc809e0d0 con 0x7f7fc806c8d0 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.221+0000 7f7fcda98640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fcda98640 10 monclient(hunting): authenticate will time out at 1713.841003s 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57318/0 (socket says 10.20.193.51:57318) 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc812fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 -- 10.20.193.51:0/3905377586 learned_addr learned my addr 10.20.193.51:0/3905377586 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 10 monclient(hunting): get_auth_request con 0x7f7fc806c8d0 auth_method 0 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:46.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): get_auth_request con 0x7f7fc8074d60 auth_method 0 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc81cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc81cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:46.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc6ffd640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 0x7f7fc81cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient(hunting): handle_auth_done global_id 204426 payload 824 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 msgr2=0x7f7fc81cf430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 msgr2=0x7f7fc81cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 0x7f7fc81cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient: _finish_hunting 0 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 monclient: found mon.noname-a 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:46.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc7fff640 1 -- 10.20.193.51:0/3905377586 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81323b0 con 0x7f7fc8074d60 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc6ffd640 10 monclient: get_auth_request con 0x7f7fc806d1f0 auth_method 0 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.222+0000 7f7fc6ffd640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 0x7f7fc81cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fc7fff640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 msgr2=0x7f7fc812fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fc7fff640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc812fb20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00caf0 tx=0x7f7fbc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc017070 con 0x7f7fc8074d60 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: dump: 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:46.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:46.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc012400 con 0x7f7fc8074d60 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 5 monclient: authenticate success, global_id 204426 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 10 monclient: _renew_subs 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80a7cb0 con 0x7f7fc8074d60 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0127f0 con 0x7f7fc8074d60 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:46.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fa3fff640 10 monclient: dump: 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:46.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fc5ffb640 4 set_mon_vals no callback set 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 10 monclient: _renew_subs 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.224+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc80745c0 con 0x7f7fc8074d60 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fcda98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fcda98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fcda98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc809e500 con 0x7f7fc8074d60 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7fbc007070 con 0x7f7fc8074d60 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fa3fff640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 0x7f7f98040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(679..679 src has 323..679) ==== 4779+0+0 (secure 0 0 0) 0x7f7fbc0526f0 con 0x7f7fc8074d60 2026-02-17T12:03:46.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 0x7f7f98040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:46.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.225+0000 7f7fc77fe640 10 monclient: get_auth_request con 0x7f7f9803dd60 auth_method 0 2026-02-17T12:03:46.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.227+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7fbc007620 con 0x7f7fc8074d60 2026-02-17T12:03:46.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.227+0000 7f7fa3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:46.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.227+0000 7f7fa3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:46.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.228+0000 7f7fc77fe640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 0x7f7f98040220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006f80 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:46.303 INFO:tasks.rados.rados.0.trial142.stdout:2956: done (6 left) 2026-02-17T12:03:46.303 INFO:tasks.rados.rados.0.trial142.stdout:2957: done (5 left) 2026-02-17T12:03:46.303 INFO:tasks.rados.rados.0.trial142.stdout:2958: done (4 left) 2026-02-17T12:03:46.304 INFO:tasks.rados.rados.0.trial142.stdout:2959: done (3 left) 2026-02-17T12:03:46.304 INFO:tasks.rados.rados.0.trial142.stdout:2960: done (2 left) 2026-02-17T12:03:46.304 INFO:tasks.rados.rados.0.trial142.stdout:2961: done (1 left) 2026-02-17T12:03:46.304 INFO:tasks.rados.rados.0.trial142.stdout:2962: done (0 left) 2026-02-17T12:03:46.304 INFO:tasks.rados.rados.0.trial142.stdout:2963: snap_remove snap 327 2026-02-17T12:03:46.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fcda98640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:46.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fcda98640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fcda98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7fc81cfeb0 con 0x7f7fc8074d60 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fa3fff640 1 -- 10.20.193.51:0/3905377586 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f7fbc007850 con 0x7f7fc8074d60 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fa3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.339+0000 7f7fa3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:46.342 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":166,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 msgr2=0x7f7f98040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 0x7f7f98040220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006f80 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 10 monclient: shutdown 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 msgr2=0x7f7fc812fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc812fb20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00caf0 tx=0x7f7fbc00a060 comp rx=0 tx=0).stop 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 shutdown_connections 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f9803dd60 0x7f7f98040220 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7fc8074d60 0x7f7fc812fb20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7fc806d1f0 0x7f7fc81cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 --2- 10.20.193.51:0/3905377586 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7fc806c8d0 0x7f7fc81cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:46.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 >> 10.20.193.51:0/3905377586 conn(0x7f7fc80aaa60 msgr2=0x7f7fc80a0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:46.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 shutdown_connections 2026-02-17T12:03:46.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:46.340+0000 7f7fcda98640 1 -- 10.20.193.51:0/3905377586 wait complete. 2026-02-17T12:03:47.305 INFO:tasks.rados.rados.0.trial142.stdout:2963: done (0 left) 2026-02-17T12:03:47.305 INFO:tasks.rados.rados.0.trial142.stdout:2964: rollback oid 44 current snap is 328 2026-02-17T12:03:47.305 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 322 2026-02-17T12:03:47.305 INFO:tasks.rados.rados.0.trial142.stdout:2965: snap_create 2026-02-17T12:03:47.306 INFO:tasks.rados.rados.0.trial142.stdout:2964: finishing rollback tid 1 to trial14245205-44 2026-02-17T12:03:47.306 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 2219 (ObjNum 225 snap 0 seq_num 1213125120) dirty dne 2026-02-17T12:03:48.309 INFO:tasks.rados.rados.0.trial142.stdout:2964: done (1 left) 2026-02-17T12:03:48.309 INFO:tasks.rados.rados.0.trial142.stdout:2965: done (0 left) 2026-02-17T12:03:48.309 INFO:tasks.rados.rados.0.trial142.stdout:2966: write (excl) oid 8 current snap is 329 2026-02-17T12:03:48.309 INFO:tasks.rados.rados.0.trial142.stdout:2966: seq_num 1010 ranges {575070=560086,1686225=566019,2869458=105612} 2026-02-17T12:03:48.312 INFO:tasks.rados.rados.0.trial142.stdout:2966: writing trial14245205-8 from 575070 to 1135156 tid 1 2026-02-17T12:03:48.317 INFO:tasks.rados.rados.0.trial142.stdout:2966: writing trial14245205-8 from 1686225 to 2252244 tid 2 2026-02-17T12:03:48.320 INFO:tasks.rados.rados.0.trial142.stdout:2966: writing trial14245205-8 from 2869458 to 2975070 tid 3 2026-02-17T12:03:48.320 INFO:tasks.rados.rados.0.trial142.stdout:2967: write oid 23 current snap is 329 2026-02-17T12:03:48.320 INFO:tasks.rados.rados.0.trial142.stdout:2967: seq_num 1011 ranges {591877=635335,1628354=709677} 2026-02-17T12:03:48.324 INFO:tasks.rados.rados.0.trial142.stdout:2967: writing trial14245205-23 from 591877 to 1227212 tid 1 2026-02-17T12:03:48.328 INFO:tasks.rados.rados.0.trial142.stdout:2967: writing trial14245205-23 from 1628354 to 2338031 tid 2 2026-02-17T12:03:48.328 INFO:tasks.rados.rados.0.trial142.stdout:2968: snap_remove snap 315 2026-02-17T12:03:49.351 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 10 monclient: get_monmap_and_config 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 10 monclient: build_initial_monmap 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 10 monclient: monmap: 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:49.418469+0000 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:49.418469+0000 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:49.419 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:49.420 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:49.420 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:49.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 1 Processor -- start 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 1 -- start start 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.417+0000 7fd552b96640 10 monclient: init 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-c con 0x7fd54c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-b con 0x7fd54c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd54c09e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:49.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c06e140 con 0x7fd54c09e540 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c0a3f90 con 0x7fd54c0a3bb0 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c09f910 con 0x7fd54c0a0750 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd552b96640 10 monclient(hunting): authenticate will time out at 1717.037286s 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57338/0 (socket says 10.20.193.51:57338) 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 learned_addr learned my addr 10.20.193.51:0/356489733 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 10 monclient(hunting): get_auth_request con 0x7fd54c0a0750 auth_method 0 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55110c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd54c09e540 0x7fd54c13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35104/0 (socket says 10.20.193.51:35104) 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd54c0a3bb0 auth_method 0 2026-02-17T12:03:49.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:49.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.420+0000 7fd55110c640 1 -- 10.20.193.51:0/356489733 >> v1:10.20.193.51:6789/0 conn(0x7fd54c09e540 legacy=0x7fd54c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 10 monclient(hunting): get_auth_request con 0x7fd54c0a0750 auth_method 0 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:49.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd54c0a3bb0 auth_method 0 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:49.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:49.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:49.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:49.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:50.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:50.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 10 monclient(hunting): get_auth_request con 0x7fd54c0a0750 auth_method 0 2026-02-17T12:03:50.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:50.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:50.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd54c0a3bb0 auth_method 0 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:50.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 10 monclient(hunting): get_auth_request con 0x7fd54c0a0750 auth_method 0 2026-02-17T12:03:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd54c0a3bb0 auth_method 0 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:50.821+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:03:52.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): tick 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 msgr2=0x7fd54c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd54c0a0750 0x7fd54c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 msgr2=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.142:3300/0 conn(0x7fd54c0a3bb0 0x7fd54c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 -- 10.20.193.51:0/356489733 >> v1:10.20.193.51:6789/0 conn(0x7fd54c09e540 legacy=0x7fd54c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:52.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient: _add_conns ranks=[3,1] 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): picked mon.noname-a con 0x7fd530003820 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd530006370 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 -- 10.20.193.51:0/356489733 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c09ccd0 con 0x7fd530006370 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 1 -- 10.20.193.51:0/356489733 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c0a3f90 con 0x7fd530003820 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd5427fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd530003820 auth_method 0 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:52.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:52.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:52.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:52.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:52.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.418+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:52.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.420+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> v1:10.20.193.142:6789/0 conn(0x7fd530006370 legacy=0x7fd530008830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd530003820 auth_method 0 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:52.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:52.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:52.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:52.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:52.619+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd530003820 auth_method 0 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:53.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.020+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605965782 0 0) 0x7fd54c09ccd0 con 0x7fd530006370 2026-02-17T12:03:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 10 monclient(hunting): _negotiate 2026-02-17T12:03:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 10 monclient(hunting): my global_id is 184486 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd538003620 con 0x7fd530006370 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.534+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1126775651 0 0) 0x7fd538003620 con 0x7fd530006370 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 msgr2=0x7fd530005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 --2- 10.20.193.51:0/356489733 >> v2:10.20.193.51:3300/0 conn(0x7fd530003820 0x7fd530005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _finish_hunting 0 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:03:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53000b1a0 con 0x7fd530006370 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fd534009700 con 0x7fd530006370 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: dump: 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.548 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 >> v1:10.20.193.142:6789/0 conn(0x7fd530006370 legacy=0x7fd530008830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 1 -- 10.20.193.51:0/356489733 reap_dead start 2026-02-17T12:03:53.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538003ba0 0x7fd538003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): picked mon.b con 0x7fd538003ba0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 0x7fd538004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): picked mon.c con 0x7fd538004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538005510 0x7fd53800bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): picked mon.a con 0x7fd538005510 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0a3f90 con 0x7fd538005510 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd53800c420 con 0x7fd538003ba0 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd53800c620 con 0x7fd538004900 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd5437fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:03:53.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 0x7fd538004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): get_auth_request con 0x7fd538004900 auth_method 0 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538005510 0x7fd53800bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): get_auth_request con 0x7fd538005510 auth_method 0 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55090b640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538003ba0 0x7fd538003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd538003ba0 auth_method 0 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55090b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:53.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd55110c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient(hunting): handle_auth_done global_id 184486 payload 293 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538003ba0 msgr2=0x7fd538003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538003ba0 0x7fd538003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538005510 msgr2=0x7fd53800bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538005510 0x7fd53800bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient: _finish_hunting 0 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 monclient: found mon.c 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd538003620 con 0x7fd538004900 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd543fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd552b96640 5 monclient: authenticate success, global_id 184486 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.535+0000 7fd552b96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd543fff640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 msgr2=0x7fd538004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd543fff640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 0x7fd538004d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd534006fd0 tx=0x7fd5340301d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a5b13299923195d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:53.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534036070 con 0x7fd538004900 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: dump: 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:53.556 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd534030c50 con 0x7fd538004900 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 1 -- 10.20.193.51:0/356489733 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534004040 con 0x7fd538004900 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 4 set_mon_vals no callback set 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd5437fe640 10 monclient: dump: 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:53.557 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 10 monclient: shutdown 2026-02-17T12:03:53.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 -- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 msgr2=0x7fd538004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 0x7fd538004d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd534006fd0 tx=0x7fd5340301d0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 -- 10.20.193.51:0/356489733 shutdown_connections 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538005510 0x7fd53800bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538004900 0x7fd538004d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 --2- 10.20.193.51:0/356489733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538003ba0 0x7fd538003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 -- 10.20.193.51:0/356489733 >> 10.20.193.51:0/356489733 conn(0x7fd54c0a30c0 msgr2=0x7fd54c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 -- 10.20.193.51:0/356489733 shutdown_connections 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.538+0000 7fd552b96640 1 -- 10.20.193.51:0/356489733 wait complete. 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.539+0000 7fd552b96640 10 monclient: build_initial_monmap 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.539+0000 7fd552b96640 10 monclient: monmap: 2026-02-17T12:03:53.560 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:53.561 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.539+0000 7fd552b96640 1 Processor -- start 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.539+0000 7fd552b96640 1 -- start start 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.539+0000 7fd552b96640 10 monclient: init 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:53.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-a con 0x7fd538003ba0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 0x7fd54c09b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-b con 0x7fd538004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): picked mon.noname-c con 0x7fd538005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:53.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c09c850 con 0x7fd538003ba0 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c09ef20 con 0x7fd538004900 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0a04b0 con 0x7fd538005510 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd552b96640 10 monclient(hunting): authenticate will time out at 1721.159114s 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45188/0 (socket says 10.20.193.51:45188) 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 -- 10.20.193.51:0/1685044014 learned_addr learned my addr 10.20.193.51:0/1685044014 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): get_auth_request con 0x7fd538003ba0 auth_method 0 2026-02-17T12:03:53.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 10 monclient(hunting): get_auth_request con 0x7fd538005510 auth_method 0 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 msgr2=0x7fd54c1ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:03:53.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 msgr2=0x7fd54c1ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55110c640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd543fff640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 0x7fd54c09b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient(hunting): handle_auth_done global_id 204429 payload 824 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 msgr2=0x7fd54c1ceb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 msgr2=0x7fd54c09b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 0x7fd54c09b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient: _finish_hunting 0 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 monclient: found mon.noname-a 2026-02-17T12:03:53.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd55090b640 1 -- 10.20.193.51:0/1685044014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c06f530 con 0x7fd538003ba0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd543fff640 10 monclient: get_auth_request con 0x7fd538004900 auth_method 0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.540+0000 7fd543fff640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 0x7fd54c09b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd55090b640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 msgr2=0x7fd54c1cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd55090b640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd53c018780 tx=0x7fd53c018c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c027070 con 0x7fd538003ba0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: dump: 2026-02-17T12:03:53.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: _finish_auth 0 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: _check_auth_tickets 2026-02-17T12:03:53.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c017dd0 con 0x7fd538003ba0 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 5 monclient: authenticate success, global_id 204429 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 10 monclient: _renew_subs 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c0a2b80 con 0x7fd538003ba0 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00f040 con 0x7fd538003ba0 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd5417fa640 10 monclient: dump: 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:53.569 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd542ffd640 4 set_mon_vals no callback set 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 10 monclient: _renew_subs 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:53.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.542+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c0979a0 con 0x7fd538003ba0 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd53c015040 con 0x7fd538003ba0 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd552b96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd552b96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd552b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd5417fa640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 0x7fd51c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c099560 con 0x7fd538003ba0 2026-02-17T12:03:53.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(682..682 src has 323..682) ==== 4751+0+0 (secure 0 0 0) 0x7fd53c0535f0 con 0x7fd538003ba0 2026-02-17T12:03:53.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd543fff640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 0x7fd51c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:53.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.543+0000 7fd543fff640 10 monclient: get_auth_request con 0x7fd51c03dd10 auth_method 0 2026-02-17T12:03:53.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.545+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd54c099560 con 0x7fd538003ba0 2026-02-17T12:03:53.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.545+0000 7fd5417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:53.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.545+0000 7fd5417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:53.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.546+0000 7fd543fff640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 0x7fd51c0401d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0a0b70 tx=0x7fd534036000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:53.593 INFO:tasks.rados.rados.0.trial142.stdout:2968: done (2 left) 2026-02-17T12:03:53.593 INFO:tasks.rados.rados.0.trial142.stdout:2969: delete oid 10 current snap is 329 2026-02-17T12:03:53.593 INFO:tasks.rados.rados.0.trial142.stdout:2966: finishing write tid 1 to trial14245205-8 2026-02-17T12:03:53.593 INFO:tasks.rados.rados.0.trial142.stdout:2966: finishing write tid 2 to trial14245205-8 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: finishing write tid 3 to trial14245205-8 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: finishing write tid 4 to trial14245205-8 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: finishing write tid 5 to trial14245205-8 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: oid 8 updating version 0 to 2703 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: oid 8 version 2703 is already newer than 2701 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: oid 8 version 2703 is already newer than 2700 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: oid 8 version 2703 is already newer than 2702 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2703 (ObjNum 1010 snap 329 seq_num 1010) dirty exists 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2966: left oid 8 (ObjNum 1010 snap 329 seq_num 1010) 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2967: finishing write tid 1 to trial14245205-23 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2967: finishing write tid 2 to trial14245205-23 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2967: finishing write tid 3 to trial14245205-23 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2967: finishing write tid 4 to trial14245205-23 2026-02-17T12:03:53.594 INFO:tasks.rados.rados.0.trial142.stdout:2967: oid 23 updating version 0 to 2516 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2967: oid 23 version 2516 is already newer than 2515 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2967: oid 23 version 2516 is already newer than 2514 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2516 (ObjNum 1011 snap 329 seq_num 1011) dirty exists 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2967: left oid 23 (ObjNum 1011 snap 329 seq_num 1011) 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2966: done (2 left) 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2967: done (1 left) 2026-02-17T12:03:53.595 INFO:tasks.rados.rados.0.trial142.stdout:2969: done (0 left) 2026-02-17T12:03:53.596 INFO:tasks.rados.rados.0.trial142.stdout:2970: write oid 21 current snap is 329 2026-02-17T12:03:53.596 INFO:tasks.rados.rados.0.trial142.stdout:2970: seq_num 1013 ranges {625491=502186,1861671=713346} 2026-02-17T12:03:53.600 INFO:tasks.rados.rados.0.trial142.stdout:2970: writing trial14245205-21 from 625491 to 1127677 tid 1 2026-02-17T12:03:53.606 INFO:tasks.rados.rados.0.trial142.stdout:2970: writing trial14245205-21 from 1861671 to 2575017 tid 2 2026-02-17T12:03:53.606 INFO:tasks.rados.rados.0.trial142.stdout:2971: delete oid 2 current snap is 329 2026-02-17T12:03:53.606 INFO:tasks.rados.rados.0.trial142.stdout:2970: finishing write tid 1 to trial14245205-21 2026-02-17T12:03:53.607 INFO:tasks.rados.rados.0.trial142.stdout:2971: done (1 left) 2026-02-17T12:03:53.607 INFO:tasks.rados.rados.0.trial142.stdout:2972: copy_from oid 8 from oid 38 current snap is 329 2026-02-17T12:03:53.608 INFO:tasks.rados.rados.0.trial142.stdout:2973: write (excl) oid 13 current snap is 329 2026-02-17T12:03:53.608 INFO:tasks.rados.rados.0.trial142.stdout:2973: seq_num 1015 ranges {659105=652684,1862282=717015} 2026-02-17T12:03:53.612 INFO:tasks.rados.rados.0.trial142.stdout:2973: writing trial14245205-13 from 659105 to 1311789 tid 1 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2973: writing trial14245205-13 from 1862282 to 2579297 tid 2 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2974: rollback oid 46 current snap is 329 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 324 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: finishing write tid 2 to trial14245205-21 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: finishing write tid 3 to trial14245205-21 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: finishing write tid 4 to trial14245205-21 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: oid 21 updating version 0 to 2149 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: oid 21 updating version 2149 to 2151 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:2970: oid 21 version 2151 is already newer than 2150 2026-02-17T12:03:53.618 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2151 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2970: left oid 21 (ObjNum 1013 snap 329 seq_num 1013) 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2970: done (3 left) 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2975: delete oid 28 current snap is 329 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2972: finishing copy_from racing read to trial14245205-8 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2972: finishing copy_from to trial14245205-8 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 1992 (ObjNum 964 snap 310 seq_num 964) dirty exists 2026-02-17T12:03:53.619 INFO:tasks.rados.rados.0.trial142.stdout:2973: finishing write tid 1 to trial14245205-13 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2973: finishing write tid 2 to trial14245205-13 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2972: done (3 left) 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2975: done (2 left) 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2976: copy_from oid 34 from oid 30 current snap is 329 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2973: finishing write tid 3 to trial14245205-13 2026-02-17T12:03:53.620 INFO:tasks.rados.rados.0.trial142.stdout:2977: write oid 19 current snap is 329 2026-02-17T12:03:53.621 INFO:tasks.rados.rados.0.trial142.stdout:2977: seq_num 1017 ranges {692719=403182,1579246=720684,2828713=264006} 2026-02-17T12:03:53.624 INFO:tasks.rados.rados.0.trial142.stdout:2977: writing trial14245205-19 from 692719 to 1095901 tid 1 2026-02-17T12:03:53.628 INFO:tasks.rados.rados.0.trial142.stdout:2977: writing trial14245205-19 from 1579246 to 2299930 tid 2 2026-02-17T12:03:53.631 INFO:tasks.rados.rados.0.trial142.stdout:2977: writing trial14245205-19 from 2828713 to 3092719 tid 3 2026-02-17T12:03:53.631 INFO:tasks.rados.rados.0.trial142.stdout:2978: write (excl) oid 24 current snap is 329 2026-02-17T12:03:53.631 INFO:tasks.rados.rados.0.trial142.stdout:2978: seq_num 1018 ranges {709526=478431,1637728=464342,2856136=253390} 2026-02-17T12:03:53.636 INFO:tasks.rados.rados.0.trial142.stdout:2978: writing trial14245205-24 from 709526 to 1187957 tid 1 2026-02-17T12:03:53.639 INFO:tasks.rados.rados.0.trial142.stdout:2978: writing trial14245205-24 from 1637728 to 2102070 tid 2 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2978: writing trial14245205-24 from 2856136 to 3109526 tid 3 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2979: delete oid 31 current snap is 329 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2974: finishing rollback tid 0 to trial14245205-46 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2973: finishing write tid 4 to trial14245205-13 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2973: oid 13 updating version 0 to 2705 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2973: oid 13 updating version 2705 to 2706 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2973: oid 13 version 2706 is already newer than 2704 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 2706 (ObjNum 1015 snap 329 seq_num 1015) dirty exists 2026-02-17T12:03:53.644 INFO:tasks.rados.rados.0.trial142.stdout:2973: left oid 13 (ObjNum 1015 snap 329 seq_num 1015) 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2974: finishing rollback tid 1 to trial14245205-46 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2976: finishing copy_from to trial14245205-34 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2976: got expected ENOENT (src dne) 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2974: finishing rollback tid 2 to trial14245205-46 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2753 (ObjNum 996 snap 324 seq_num 996) dirty exists 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2976: finishing copy_from racing read to trial14245205-34 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: finishing write tid 1 to trial14245205-19 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: finishing write tid 2 to trial14245205-19 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: finishing write tid 3 to trial14245205-19 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: finishing write tid 4 to trial14245205-19 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: finishing write tid 5 to trial14245205-19 2026-02-17T12:03:53.645 INFO:tasks.rados.rados.0.trial142.stdout:2977: oid 19 updating version 0 to 2520 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2977: oid 19 version 2520 is already newer than 2518 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2977: oid 19 version 2520 is already newer than 2519 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2977: oid 19 version 2520 is already newer than 2517 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2520 (ObjNum 1017 snap 329 seq_num 1017) dirty exists 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2977: left oid 19 (ObjNum 1017 snap 329 seq_num 1017) 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2978: finishing write tid 1 to trial14245205-24 2026-02-17T12:03:53.646 INFO:tasks.rados.rados.0.trial142.stdout:2978: finishing write tid 2 to trial14245205-24 2026-02-17T12:03:53.647 INFO:tasks.rados.rados.0.trial142.stdout:2978: finishing write tid 3 to trial14245205-24 2026-02-17T12:03:53.647 INFO:tasks.rados.rados.0.trial142.stdout:2978: finishing write tid 4 to trial14245205-24 2026-02-17T12:03:53.647 INFO:tasks.rados.rados.0.trial142.stdout:2978: finishing write tid 5 to trial14245205-24 2026-02-17T12:03:53.647 INFO:tasks.rados.rados.0.trial142.stdout:2978: oid 24 updating version 0 to 2150 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2978: oid 24 version 2150 is already newer than 2148 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2978: oid 24 version 2150 is already newer than 2149 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2978: oid 24 updating version 2150 to 2151 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2151 (ObjNum 1018 snap 329 seq_num 1018) dirty exists 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2978: left oid 24 (ObjNum 1018 snap 329 seq_num 1018) 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2973: done (5 left) 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2974: done (4 left) 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2976: done (3 left) 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2977: done (2 left) 2026-02-17T12:03:53.648 INFO:tasks.rados.rados.0.trial142.stdout:2978: done (1 left) 2026-02-17T12:03:53.649 INFO:tasks.rados.rados.0.trial142.stdout:2979: done (0 left) 2026-02-17T12:03:53.649 INFO:tasks.rados.rados.0.trial142.stdout:2980: delete oid 47 current snap is 329 2026-02-17T12:03:53.649 INFO:tasks.rados.rados.0.trial142.stdout:2980: done (0 left) 2026-02-17T12:03:53.649 INFO:tasks.rados.rados.0.trial142.stdout:2981: delete oid 18 current snap is 329 2026-02-17T12:03:53.650 INFO:tasks.rados.rados.0.trial142.stdout:2981: done (0 left) 2026-02-17T12:03:53.650 INFO:tasks.rados.rados.0.trial142.stdout:2982: delete oid 45 current snap is 329 2026-02-17T12:03:53.650 INFO:tasks.rados.rados.0.trial142.stdout:2982: done (0 left) 2026-02-17T12:03:53.650 INFO:tasks.rados.rados.0.trial142.stdout:2983: snap_remove snap 324 2026-02-17T12:03:53.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd552b96640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:53.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd552b96640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd552b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd54c0008d0 con 0x7fd538003ba0 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd5417fa640 1 -- 10.20.193.51:0/1685044014 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fd54c06f530 con 0x7fd538003ba0 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd5417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.666+0000 7fd5417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:53.669 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":170,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 msgr2=0x7fd51c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 0x7fd51c0401d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0a0b70 tx=0x7fd534036000 comp rx=0 tx=0).stop 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 10 monclient: shutdown 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 msgr2=0x7fd54c1cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd53c018780 tx=0x7fd53c018c50 comp rx=0 tx=0).stop 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 shutdown_connections 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd51c03dd10 0x7fd51c0401d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd538005510 0x7fd54c1ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd538004900 0x7fd54c09b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 --2- 10.20.193.51:0/1685044014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd538003ba0 0x7fd54c1cb640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:53.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 >> 10.20.193.51:0/1685044014 conn(0x7fd54c0a30c0 msgr2=0x7fd54c09bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:53.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 shutdown_connections 2026-02-17T12:03:53.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:53.668+0000 7fd552b96640 1 -- 10.20.193.51:0/1685044014 wait complete. 2026-02-17T12:03:54.260 INFO:tasks.rados.rados.0.trial142.stdout:2983: done (0 left) 2026-02-17T12:03:54.260 INFO:tasks.rados.rados.0.trial142.stdout:2984: read oid 44 snap -1 2026-02-17T12:03:54.261 INFO:tasks.rados.rados.0.trial142.stdout:2984: expect deleted 2026-02-17T12:03:54.261 INFO:tasks.rados.rados.0.trial142.stdout:2985: delete oid 25 current snap is 329 2026-02-17T12:03:54.264 INFO:tasks.rados.rados.0.trial142.stdout:2985: done (1 left) 2026-02-17T12:03:54.264 INFO:tasks.rados.rados.0.trial142.stdout:2986: copy_from oid 13 from oid 42 current snap is 329 2026-02-17T12:03:54.264 INFO:tasks.rados.rados.0.trial142.stdout:2987: snap_create 2026-02-17T12:03:54.269 INFO:tasks.rados.rados.0.trial142.stdout:2986: finishing copy_from racing read to trial14245205-13 2026-02-17T12:03:54.271 INFO:tasks.rados.rados.0.trial142.stdout:2986: finishing copy_from to trial14245205-13 2026-02-17T12:03:54.271 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:03:55.263 INFO:tasks.rados.rados.0.trial142.stdout:2984: done (2 left) 2026-02-17T12:03:55.263 INFO:tasks.rados.rados.0.trial142.stdout:2986: done (1 left) 2026-02-17T12:03:55.263 INFO:tasks.rados.rados.0.trial142.stdout:2987: done (0 left) 2026-02-17T12:03:55.263 INFO:tasks.rados.rados.0.trial142.stdout:2988: snap_create 2026-02-17T12:03:56.267 INFO:tasks.rados.rados.0.trial142.stdout:2988: done (0 left) 2026-02-17T12:03:56.267 INFO:tasks.rados.rados.0.trial142.stdout:2989: snap_remove snap 325 2026-02-17T12:03:56.680 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:56.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.747+0000 7f6be6511640 10 monclient: get_monmap_and_config 2026-02-17T12:03:56.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.747+0000 7f6be6511640 10 monclient: build_initial_monmap 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.747+0000 7f6be6511640 10 monclient: monmap: 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:56.748771+0000 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:56.748771+0000 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:56.752 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 Processor -- start 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 -- start start 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient: init 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6be00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-b con 0x7f6be00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:56.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6be013b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be006e140 con 0x7f6be013b760 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be009f910 con 0x7f6be00a3bb0 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6be009ccd0 con 0x7f6be00a0750 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be6511640 10 monclient(hunting): authenticate will time out at 1724.367606s 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57322/0 (socket says 10.20.193.51:57322) 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 -- 10.20.193.51:0/2823200207 learned_addr learned my addr 10.20.193.51:0/2823200207 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 10 monclient(hunting): get_auth_request con 0x7f6be00a0750 auth_method 0 2026-02-17T12:03:56.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6be4a87640 1 --1- 10.20.193.51:0/2823200207 >> v1:10.20.193.51:6789/0 conn(0x7f6be013b760 0x7f6be013db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53794/0 (socket says 10.20.193.51:53794) 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6be009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6be009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:56.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.748+0000 7f6bdf7fe640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6be4a87640 1 -- 10.20.193.51:0/2823200207 >> v1:10.20.193.51:6789/0 conn(0x7f6be013b760 legacy=0x7f6be013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648464873 0 0) 0x7f6be006e140 con 0x7f6be013b760 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 10 monclient(hunting): _negotiate 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 10 monclient(hunting): my global_id is 204432 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.750+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc4003620 con 0x7f6be013b760 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3821795510 0 0) 0x7f6bc4003620 con 0x7f6be013b760 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6be009e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6be009e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 >> v1:10.20.193.142:6789/0 conn(0x7f6be00a3bb0 legacy=0x7f6be009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 -- 10.20.193.51:0/2823200207 >> v1:10.20.193.142:6789/0 conn(0x7f6be00a3bb0 legacy=0x7f6be009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _finish_hunting 0 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be009eec0 con 0x7f6be013b760 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _finish_auth 0 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f6bd4003520 con 0x7f6be013b760 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be6511640 5 monclient: authenticate success, global_id 204432 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: dump: 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 >> v1:10.20.193.51:6789/0 conn(0x7f6be013b760 legacy=0x7f6be013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 0x7f6bc4004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): picked mon.a con 0x7f6bc4003c00 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6bc4004900 0x7f6bc4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): picked mon.b con 0x7f6bc4004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6bc400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): picked mon.c con 0x7f6be00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6be009ccd0 con 0x7f6bc4003c00 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400c000 con 0x7f6bc4004900 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc400c180 con 0x7f6be00a0750 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdeffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be6511640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 0x7f6bc4004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): get_auth_request con 0x7f6bc4003c00 auth_method 0 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6bc400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 10 monclient(hunting): get_auth_request con 0x7f6be00a0750 auth_method 0 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6bc400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6bc400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6bc400bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6be4a87640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6bc400bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient(hunting): handle_auth_done global_id 204432 payload 293 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdf7fe640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6bc4004900 0x7f6bc4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 msgr2=0x7f6bc400bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6be00a0750 0x7f6bc400bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6bc4004900 msgr2=0x7f6bc4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6bc4004900 0x7f6bc4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient: _finish_hunting 0 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 monclient: found mon.a 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 1 -- 10.20.193.51:0/2823200207 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc4003620 con 0x7f6bc4003c00 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient: _finish_auth 0 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdf7fe640 10 monclient: get_auth_request con 0x7f6bc4004900 auth_method 0 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.751+0000 7f6bdf7fe640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6bc4004900 0x7f6bc4004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.753+0000 7f6bdffff640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 msgr2=0x7f6bc4004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.753+0000 7f6bdffff640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 0x7f6bc4004020 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0032a0 tx=0x7f6bcc02efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476507725604ccc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc002fa0 con 0x7f6bc4003c00 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: dump: 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.775 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc033030 con 0x7f6bc4003c00 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 1 -- 10.20.193.51:0/2823200207 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc005d20 con 0x7f6bc4003c00 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 4 set_mon_vals no callback set 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6bdeffd640 10 monclient: dump: 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 10 monclient: shutdown 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 -- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 msgr2=0x7f6bc4004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 --2- 10.20.193.51:0/2823200207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6bc4003c00 0x7f6bc4004020 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0032a0 tx=0x7f6bcc02efe0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be4a87640 1 -- 10.20.193.51:0/2823200207 reap_dead start 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 -- 10.20.193.51:0/2823200207 shutdown_connections 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 -- 10.20.193.51:0/2823200207 >> 10.20.193.51:0/2823200207 conn(0x7f6be00a30c0 msgr2=0x7f6be00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 -- 10.20.193.51:0/2823200207 shutdown_connections 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.754+0000 7f6be6511640 1 -- 10.20.193.51:0/2823200207 wait complete. 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient: build_initial_monmap 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient: monmap: 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:56.778 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 Processor -- start 2026-02-17T12:03:56.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 -- start start 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient: init 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-c con 0x7f6bc4003c00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6be00907f0 0x7f6be0090c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-b con 0x7f6be00907f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 0x7f6be01d3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): picked mon.noname-a con 0x7f6be00911b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6be00a04b0 con 0x7f6be00911b0 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6be009c850 con 0x7f6be00907f0 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6be009e1d0 con 0x7f6bc4003c00 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be6511640 10 monclient(hunting): authenticate will time out at 1724.374640s 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 0x7f6be01d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57334/0 (socket says 10.20.193.51:57334) 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 -- 10.20.193.51:0/3741093147 learned_addr learned my addr 10.20.193.51:0/3741093147 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 10 monclient(hunting): get_auth_request con 0x7f6bc4003c00 auth_method 0 2026-02-17T12:03:56.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): get_auth_request con 0x7f6be00911b0 auth_method 0 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 msgr2=0x7f6be0099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 msgr2=0x7f6be0099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:56.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6bdffff640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient(hunting): handle_auth_done global_id 204435 payload 824 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 msgr2=0x7f6be0099f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6be00907f0 msgr2=0x7f6be0090c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6be00907f0 0x7f6be0090c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient: _finish_hunting 0 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 monclient: found mon.noname-a 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.755+0000 7f6be4a87640 1 -- 10.20.193.51:0/3741093147 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00937d0 con 0x7f6be00911b0 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.757+0000 7f6be4a87640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 msgr2=0x7f6be01d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.757+0000 7f6be4a87640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 0x7f6be01d3870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6be009d3f0 tx=0x7f6bd400e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4017030 con 0x7f6be00911b0 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: dump: 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.784 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: _finish_auth 0 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: _check_auth_tickets 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd4013480 con 0x7f6be00911b0 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 5 monclient: authenticate success, global_id 204435 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _renew_subs 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be0091630 con 0x7f6be00911b0 2026-02-17T12:03:56.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4013850 con 0x7f6be00911b0 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bde7fc640 4 set_mon_vals no callback set 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 10 monclient: dump: 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _renew_subs 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be0094780 con 0x7f6be00911b0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be009e5a0 con 0x7f6be00911b0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6bd40139f0 con 0x7f6be00911b0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 0x7f6bb00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.758+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(686..686 src has 323..686) ==== 4751+0+0 (secure 0 0 0) 0x7f6bd4052fd0 con 0x7f6be00911b0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.759+0000 7f6bdffff640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 0x7f6bb00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.759+0000 7f6bdffff640 10 monclient: get_auth_request con 0x7f6bb003dd10 auth_method 0 2026-02-17T12:03:56.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.761+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6bd4021070 con 0x7f6be00911b0 2026-02-17T12:03:56.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.761+0000 7f6bdcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:56.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.761+0000 7f6bdcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:56.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.761+0000 7f6bdffff640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 0x7f6bb00401d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02f020 tx=0x7f6bcc007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6be6511640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:03:56.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6be6511640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6be6511640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6be00a2240 con 0x7f6be00911b0 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6bdcff9640 1 -- 10.20.193.51:0/3741093147 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f6bd4022d20 con 0x7f6be00911b0 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6bdcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.875+0000 7f6bdcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:56.878 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 msgr2=0x7f6bb00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 0x7f6bb00401d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02f020 tx=0x7f6bcc007000 comp rx=0 tx=0).stop 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 10 monclient: shutdown 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 msgr2=0x7f6be01d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 0x7f6be01d3870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6be009d3f0 tx=0x7f6bd400e590 comp rx=0 tx=0).stop 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 shutdown_connections 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6bb003dd10 0x7f6bb00401d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6be00911b0 0x7f6be01d3870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6be00907f0 0x7f6be0090c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 --2- 10.20.193.51:0/3741093147 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6bc4003c00 0x7f6be0099f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 >> 10.20.193.51:0/3741093147 conn(0x7f6be00a30c0 msgr2=0x7f6be013abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 shutdown_connections 2026-02-17T12:03:56.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.876+0000 7f6be6511640 1 -- 10.20.193.51:0/3741093147 wait complete. 2026-02-17T12:03:56.886 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:03:56.886 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:03:56.886 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:03:56.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: get_monmap_and_config 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: build_initial_monmap 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: monmap: 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:56.953063+0000 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:56.953063+0000 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:56.957 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 Processor -- start 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 -- start start 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: init 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T12:03:56.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f338c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f338c13b380 0x7f338c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f338c13b380 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f338c13dcb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338c135430 con 0x7f338c0a3bb0 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f338c09a5c0 con 0x7f338c13b380 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f338c09b520 con 0x7f338c13dcb0 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3392f0a640 10 monclient(hunting): authenticate will time out at 1724.571844s 2026-02-17T12:03:56.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3390c7f640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f338c0a3bb0 0x7f338c09cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53796/0 (socket says 10.20.193.51:53796) 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3390c7f640 1 -- 10.20.193.51:0/1986920242 learned_addr learned my addr 10.20.193.51:0/1986920242 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 1 --2- 10.20.193.51:0/1986920242 >> v2:10.20.193.51:3300/0 conn(0x7f338c13b380 0x7f338c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): get_auth_request con 0x7f338c13b380 auth_method 0 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3391480640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3391480640 10 monclient(hunting): get_auth_request con 0x7f338c13dcb0 auth_method 0 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3391480640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3391480640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3391480640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.952+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3391480640 1 -- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 msgr2=0x7f338c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3391480640 1 -- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 msgr2=0x7f338c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3391480640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3391480640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 10 monclient(hunting): handle_auth_done global_id 204438 payload 274 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 1 -- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 msgr2=0x7f338c1400a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 1 -- 10.20.193.51:0/1986920242 >> v1:10.20.193.51:6789/0 conn(0x7f338c0a3bb0 legacy=0x7f338c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:56.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 10 monclient: _finish_hunting 0 2026-02-17T12:03:56.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 1 monclient: found mon.noname-a 2026-02-17T12:03:56.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:56.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.953+0000 7f3383fff640 1 -- 10.20.193.51:0/1986920242 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c09af60 con 0x7f338c13b380 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3383fff640 1 -- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c13b380 msgr2=0x7f338c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3383fff640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c13b380 0x7f338c13d770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f338c09a740 tx=0x7f337402ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655509844e74fc57 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 1 -- 10.20.193.51:0/1986920242 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337403c070 con 0x7f338c13b380 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: dump: 2026-02-17T12:03:56.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: _finish_auth 0 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: _check_auth_tickets 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 1 -- 10.20.193.51:0/1986920242 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337402fb90 con 0x7f338c13b380 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 1 -- 10.20.193.51:0/1986920242 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374037440 con 0x7f338c13b380 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 5 monclient: authenticate success, global_id 204438 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 4 set_mon_vals no callback set 2026-02-17T12:03:56.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f33837fe640 10 monclient: dump: 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.975 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 10 monclient: shutdown 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 -- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c13b380 msgr2=0x7f338c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c13b380 0x7f338c13d770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f338c09a740 tx=0x7f337402ed10 comp rx=0 tx=0).stop 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 -- 10.20.193.51:0/1986920242 shutdown_connections 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13dcb0 0x7f338c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1986920242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c13b380 0x7f338c13d770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 -- 10.20.193.51:0/1986920242 >> 10.20.193.51:0/1986920242 conn(0x7f338c0a30c0 msgr2=0x7f338c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 -- 10.20.193.51:0/1986920242 shutdown_connections 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.955+0000 7f3392f0a640 1 -- 10.20.193.51:0/1986920242 wait complete. 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient: build_initial_monmap 2026-02-17T12:03:56.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient: monmap: 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 Processor -- start 2026-02-17T12:03:56.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 -- start start 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient: init 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f338c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-c con 0x7f338c13b380 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f338c13dcb0 0x7f338c1377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f338c13dcb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f338c135040 con 0x7f338c0a3bb0 2026-02-17T12:03:56.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f338c074ac0 con 0x7f338c13dcb0 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f338c1351c0 con 0x7f338c13b380 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3392f0a640 10 monclient(hunting): authenticate will time out at 1724.575752s 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35434/0 (socket says 10.20.193.51:35434) 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57354/0 (socket says 10.20.193.51:57354) 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 1 -- 10.20.193.51:0/1782234051 learned_addr learned my addr 10.20.193.51:0/1782234051 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:56.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): get_auth_request con 0x7f338c0a3bb0 auth_method 0 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 10 monclient(hunting): get_auth_request con 0x7f338c13b380 auth_method 0 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 msgr2=0x7f338c137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:03:56.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 msgr2=0x7f338c137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 10 monclient(hunting): handle_auth_done global_id 204441 payload 824 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 msgr2=0x7f338c137270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.956+0000 7f3390c7f640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f338c13b380 0x7f338c137270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3391480640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f338c13dcb0 0x7f338c1377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f338c13dcb0 msgr2=0x7f338c1377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f338c13dcb0 0x7f338c1377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 10 monclient: _finish_hunting 0 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 1 monclient: found mon.noname-a 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3390c7f640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c09d7b0 con 0x7f338c0a3bb0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3391480640 10 monclient: get_auth_request con 0x7f338c13dcb0 auth_method 0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.957+0000 7f3391480640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f338c13dcb0 0x7f338c1377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3390c7f640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 msgr2=0x7f338c132130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3390c7f640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b530 tx=0x7f337c00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c00fa60 con 0x7f338c0a3bb0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: dump: 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: _finish_auth 0 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: _check_auth_tickets 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:56.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c00fc00 con 0x7f338c0a3bb0 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 5 monclient: authenticate success, global_id 204441 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 monclient: _renew_subs 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338c131620 con 0x7f338c0a3bb0 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c017400 con 0x7f338c0a3bb0 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 10 monclient: dump: 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3382ffd640 4 set_mon_vals no callback set 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 monclient: _renew_subs 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:56.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338c13a9a0 con 0x7f338c0a3bb0 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 0x7f338c09dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f338c09d5a0 con 0x7f338c09d980 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 0x7f338c09dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient: get_auth_request con 0x7f338c09d980 auth_method 0 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f337c0203f0 con 0x7f338c0a3bb0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.959+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f3383fff640 10 monclient(hunting): handle_auth_done global_id 204444 payload 824 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f338c074db0 con 0x7f338c09d980 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f33817fa640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f335c03dd10 0x7f335c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(686..686 src has 323..686) ==== 4751+0+0 (secure 0 0 0) 0x7f337c052710 con 0x7f338c0a3bb0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f3391480640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f335c03dd10 0x7f335c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.960+0000 7f3391480640 10 monclient: get_auth_request con 0x7f335c03dd10 auth_method 0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 msgr2=0x7f338c09dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 0x7f338c09dd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3374039000 tx=0x7f33740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337403c040 con 0x7f338c09d980 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 10 monclient: dump: 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3374037cd0 con 0x7f338c09d980 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:56.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 msgr2=0x7f338c09dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 0x7f338c09dd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3374039000 tx=0x7f33740047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 msgr2=0x7f338c09dd60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f33817fa640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09d980 0x7f338c09dd60 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3374039000 tx=0x7f33740047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.962+0000 7f3391480640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f335c03dd10 0x7f335c0401d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f338c069d30 tx=0x7f338800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3392f0a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 0x7f338c09e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3392f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f338c12b9f0 con 0x7f338c09e2a0 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 0x7f338c09e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient: get_auth_request con 0x7f338c09e2a0 auth_method 0 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:56.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.965+0000 7f3383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.966+0000 7f3383fff640 10 monclient(hunting): handle_auth_done global_id 204447 payload 824 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.966+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f338c0008d0 con 0x7f338c09e2a0 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3383fff640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 msgr2=0x7f338c09e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3383fff640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 0x7f338c09e6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3374002410 tx=0x7f3374008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374050040 con 0x7f338c09e2a0 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 10 monclient: dump: 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:56.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f3374041e50 con 0x7f338c09e2a0 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 msgr2=0x7f338c09e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 0x7f338c09e6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3374002410 tx=0x7f3374008030 comp rx=0 tx=0).stop 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 msgr2=0x7f338c09e6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:56.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f33817fa640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c09e2a0 0x7f338c09e6b0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3374002410 tx=0x7f3374008030 comp rx=0 tx=0).stop 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 177734, 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:56.992 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:56.993 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:56.994 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:56.995 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.996 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:56.997 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:56.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:56.999 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:57.000 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:57.001 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:57.002 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f335c03dd10 msgr2=0x7f335c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f335c03dd10 0x7f335c0401d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f338c069d30 tx=0x7f338800b040 comp rx=0 tx=0).stop 2026-02-17T12:03:57.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 10 monclient: shutdown 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 msgr2=0x7f338c132130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b530 tx=0x7f337c00ba00 comp rx=0 tx=0).stop 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3391480640 1 -- 10.20.193.51:0/1782234051 reap_dead start 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 shutdown_connections 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 --2- 10.20.193.51:0/1782234051 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f338c0a3bb0 0x7f338c132130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 >> 10.20.193.51:0/1782234051 conn(0x7f338c0a30c0 msgr2=0x7f338c09c800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 shutdown_connections 2026-02-17T12:03:57.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:56.968+0000 7f3392f0a640 1 -- 10.20.193.51:0/1782234051 wait complete. 2026-02-17T12:03:57.004 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:57.004 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:03:57.005 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: get_monmap_and_config 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: build_initial_monmap 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: monmap: 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:57.070034+0000 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:57.070034+0000 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 Processor -- start 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 -- start start 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: init 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): picked mon.noname-b con 0x7faddc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7faddc0a0750 0x7faddc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): picked mon.noname-c con 0x7faddc0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faddc09e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faddc06e140 con 0x7faddc09e540 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7faddc0a3f90 con 0x7faddc0a0750 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faddc09f910 con 0x7faddc0a3bb0 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade407e640 10 monclient(hunting): authenticate will time out at 1724.688762s 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade25f4640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7faddc09e540 0x7faddc13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53804/0 (socket says 10.20.193.51:53804) 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade25f4640 1 -- 10.20.193.51:0/1381602552 learned_addr learned my addr 10.20.193.51:0/1381602552 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 10 monclient(hunting): get_auth_request con 0x7faddc0a3bb0 auth_method 0 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 1 -- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 1 -- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade1df3640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:57.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade15f2640 1 --2- 10.20.193.51:0/1381602552 >> v2:10.20.193.142:3300/0 conn(0x7faddc0a0750 0x7faddc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.069+0000 7fade15f2640 10 monclient(hunting): get_auth_request con 0x7faddc0a0750 auth_method 0 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient(hunting): handle_auth_done global_id 184489 payload 274 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 1 -- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 1 -- 10.20.193.51:0/1381602552 >> v1:10.20.193.51:6789/0 conn(0x7faddc09e540 legacy=0x7faddc13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient: _finish_hunting 0 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 1 monclient: found mon.noname-c 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:57.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:03:57.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.070+0000 7fade15f2640 1 -- 10.20.193.51:0/1381602552 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc09ccd0 con 0x7faddc0a0750 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.072+0000 7fade15f2640 1 -- 10.20.193.51:0/1381602552 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc0a0750 msgr2=0x7faddc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.072+0000 7fade15f2640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc0a0750 0x7faddc09e000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faddc069d60 tx=0x7fadd002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133c4f93ec28122a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 1 -- 10.20.193.51:0/1381602552 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd003c070 con 0x7faddc0a0750 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: dump: 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: _finish_auth 0 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: _check_auth_tickets 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 5 monclient: authenticate success, global_id 184489 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 1 -- 10.20.193.51:0/1381602552 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd002fbd0 con 0x7faddc0a0750 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:57.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 1 -- 10.20.193.51:0/1381602552 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0037440 con 0x7faddc0a0750 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 4 set_mon_vals no callback set 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade0df1640 10 monclient: dump: 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:57.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 10 monclient: shutdown 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 -- 10.20.193.51:0/1381602552 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc0a0750 msgr2=0x7faddc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc0a0750 0x7faddc09e000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faddc069d60 tx=0x7fadd002ed50 comp rx=0 tx=0).stop 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 -- 10.20.193.51:0/1381602552 shutdown_connections 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc0a0750 0x7faddc09e000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 --2- 10.20.193.51:0/1381602552 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 -- 10.20.193.51:0/1381602552 >> 10.20.193.51:0/1381602552 conn(0x7faddc0a30c0 msgr2=0x7faddc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 -- 10.20.193.51:0/1381602552 shutdown_connections 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 1 -- 10.20.193.51:0/1381602552 wait complete. 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 10 monclient: build_initial_monmap 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.073+0000 7fade407e640 10 monclient: monmap: 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:57.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 Processor -- start 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 -- start start 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient: init 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc09e540 0x7faddc139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): picked mon.noname-b con 0x7faddc09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 0x7faddc131020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): picked mon.noname-a con 0x7faddc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): picked mon.noname-c con 0x7faddc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faddc0a04b0 con 0x7faddc0a0750 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faddc09c850 con 0x7faddc09e540 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faddc13de80 con 0x7faddc0a3bb0 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade407e640 10 monclient(hunting): authenticate will time out at 1724.693354s 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 0x7faddc131020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57380/0 (socket says 10.20.193.51:57380) 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 0x7faddc131020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35450/0 (socket says 10.20.193.51:35450) 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 -- 10.20.193.51:0/1802027214 learned_addr learned my addr 10.20.193.51:0/1802027214 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 10 monclient(hunting): get_auth_request con 0x7faddc0a3bb0 auth_method 0 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): get_auth_request con 0x7faddc0a0750 auth_method 0 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc131560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc131560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:57.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade25f4640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc09e540 0x7faddc139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade1df3640 10 monclient(hunting): get_auth_request con 0x7faddc09e540 auth_method 0 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade1df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient(hunting): handle_auth_done global_id 204450 payload 824 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 msgr2=0x7faddc131560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc0a3bb0 0x7faddc131560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc09e540 msgr2=0x7faddc139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faddc09e540 0x7faddc139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient: _finish_hunting 0 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 monclient: found mon.noname-a 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:57.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.074+0000 7fade15f2640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc134390 con 0x7faddc0a0750 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade15f2640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 msgr2=0x7faddc131020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade15f2640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 0x7faddc131020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadd0036000 tx=0x7fadd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0046070 con 0x7faddc0a0750 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: dump: 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:57.092 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: _finish_auth 0 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd0037e50 con 0x7faddc0a0750 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 5 monclient: authenticate success, global_id 204450 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 10 monclient: _renew_subs 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faddc134950 con 0x7faddc0a0750 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd003c040 con 0x7faddc0a0750 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:57.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadca7fc640 10 monclient: dump: 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fadcbfff640 4 set_mon_vals no callback set 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 10 monclient: _renew_subs 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.076+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faddc133650 con 0x7faddc0a0750 2026-02-17T12:03:57.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade407e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade407e640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faddc1328d0 con 0x7faddc131aa0 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 10 monclient: get_auth_request con 0x7faddc131aa0 auth_method 0 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fadd0041b30 con 0x7faddc0a0750 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fadca7fc640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadac03dd10 0x7fadac0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:57.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(686..686 src has 323..686) ==== 4751+0+0 (secure 0 0 0) 0x7fadd00776e0 con 0x7faddc0a0750 2026-02-17T12:03:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade25f4640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadac03dd10 0x7fadac0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.077+0000 7fade25f4640 10 monclient: get_auth_request con 0x7fadac03dd10 auth_method 0 2026-02-17T12:03:57.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.080+0000 7fade25f4640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadac03dd10 0x7fadac0401d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7faddc135100 tx=0x7fadd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:57.269 INFO:tasks.rados.rados.0.trial142.stdout:2989: done (0 left) 2026-02-17T12:03:57.269 INFO:tasks.rados.rados.0.trial142.stdout:2990: delete oid 26 current snap is 331 2026-02-17T12:03:57.274 INFO:tasks.rados.rados.0.trial142.stdout:2990: done (0 left) 2026-02-17T12:03:57.275 INFO:tasks.rados.rados.0.trial142.stdout:2991: read oid 9 snap -1 2026-02-17T12:03:57.275 INFO:tasks.rados.rados.0.trial142.stdout:2991: expect deleted 2026-02-17T12:03:57.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: write oid 11 current snap is 331 2026-02-17T12:03:57.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: seq_num 1025 ranges {427175=721527,1930749=735360} 2026-02-17T12:03:57.278 INFO:tasks.rados.rados.0.trial142.stdout:2992: writing trial14245205-11 from 427175 to 1148702 tid 1 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 10 monclient: get_auth_request con 0x7faddc131aa0 auth_method 0 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:03:57.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:57.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:57.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.278+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:03:57.284 INFO:tasks.rados.rados.0.trial142.stdout:2992: writing trial14245205-11 from 1930749 to 2666109 tid 2 2026-02-17T12:03:57.284 INFO:tasks.rados.rados.0.trial142.stdout:2993: snap_remove snap 319 2026-02-17T12:03:57.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:57.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 10 monclient: get_auth_request con 0x7faddc131aa0 auth_method 0 2026-02-17T12:03:57.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:57.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:03:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:03:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:03:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:57.679+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:03:58.274 INFO:tasks.rados.rados.0.trial142.stdout:2993: done (2 left) 2026-02-17T12:03:58.274 INFO:tasks.rados.rados.0.trial142.stdout:2994: delete oid 12 current snap is 331 2026-02-17T12:03:58.274 INFO:tasks.rados.rados.0.trial142.stdout:2992: finishing write tid 1 to trial14245205-11 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: finishing write tid 2 to trial14245205-11 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: finishing write tid 3 to trial14245205-11 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: finishing write tid 4 to trial14245205-11 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: oid 11 updating version 0 to 1138 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: oid 11 updating version 1138 to 1139 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: oid 11 version 1139 is already newer than 1137 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1139 (ObjNum 1025 snap 331 seq_num 1025) dirty exists 2026-02-17T12:03:58.275 INFO:tasks.rados.rados.0.trial142.stdout:2992: left oid 11 (ObjNum 1025 snap 331 seq_num 1025) 2026-02-17T12:03:58.278 INFO:tasks.rados.rados.0.trial142.stdout:2991: done (2 left) 2026-02-17T12:03:58.278 INFO:tasks.rados.rados.0.trial142.stdout:2992: done (1 left) 2026-02-17T12:03:58.278 INFO:tasks.rados.rados.0.trial142.stdout:2994: done (0 left) 2026-02-17T12:03:58.278 INFO:tasks.rados.rados.0.trial142.stdout:2995: snap_create 2026-02-17T12:03:58.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.482 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient: get_auth_request con 0x7faddc131aa0 auth_method 0 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 10 monclient(hunting): handle_auth_done global_id 234101 payload 824 2026-02-17T12:03:58.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.480+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faddc131e80 con 0x7faddc131aa0 2026-02-17T12:03:58.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc016de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00f040 con 0x7faddc131aa0 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 10 monclient: dump: 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.485 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fadcc018450 con 0x7faddc131aa0 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc016de0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 msgr2=0x7faddc13aa00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:58.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.482+0000 7fadca7fc640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc131aa0 0x7faddc13aa00 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc016de0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade407e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:58.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade407e640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 0x7faddc13b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade407e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faddc0a24c0 con 0x7faddc13af40 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 0x7faddc13b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient: get_auth_request con 0x7faddc13af40 auth_method 0 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 10 monclient(hunting): handle_auth_done global_id 234104 payload 824 2026-02-17T12:03:58.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.486+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faddc09dac0 con 0x7faddc13af40 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade1df3640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 msgr2=0x7faddc13b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade1df3640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 0x7faddc13b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc027070 con 0x7faddc13af40 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 10 monclient: dump: 2026-02-17T12:03:58.491 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fadcc027890 con 0x7faddc13af40 2026-02-17T12:03:58.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 msgr2=0x7faddc13b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 0x7faddc13b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc004830 comp rx=0 tx=0).stop 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 msgr2=0x7faddc13b350 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fadca7fc640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faddc13af40 0x7faddc13b350 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadcc016910 tx=0x7fadcc004830 comp rx=0 tx=0).stop 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:58.493 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 15483, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T12:03:58.494 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.495 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.496 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:58.497 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:58.498 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.499 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:58.500 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.501 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.502 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.503 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.504 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.505 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:58.506 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.507 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.508 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.508 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:58.508 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadac03dd10 msgr2=0x7fadac0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadac03dd10 0x7fadac0401d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7faddc135100 tx=0x7fadd8009040 comp rx=0 tx=0).stop 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 10 monclient: shutdown 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 msgr2=0x7faddc131020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade407e640 1 --2- 10.20.193.51:0/1802027214 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faddc0a0750 0x7faddc131020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadd0036000 tx=0x7fadd00047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade25f4640 1 -- 10.20.193.51:0/1802027214 reap_dead start 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.488+0000 7fade25f4640 1 -- 10.20.193.51:0/1802027214 reap_dead start 2026-02-17T12:03:58.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.489+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 shutdown_connections 2026-02-17T12:03:58.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.489+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 >> 10.20.193.51:0/1802027214 conn(0x7faddc0a30c0 msgr2=0x7faddc072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:58.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.489+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 shutdown_connections 2026-02-17T12:03:58.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.489+0000 7fade407e640 1 -- 10.20.193.51:0/1802027214 wait complete. 2026-02-17T12:03:58.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:58.512 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:03:58.512 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:03:58.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.576+0000 7f439f351640 10 monclient: get_monmap_and_config 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.576+0000 7f439f351640 10 monclient: build_initial_monmap 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.576+0000 7f439f351640 10 monclient: monmap: 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:58.577826+0000 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:58.577826+0000 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.589 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 Processor -- start 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 -- start start 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient: init 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T12:03:58.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f43980a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43980a0750 0x7f439809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): picked mon.noname-b con 0x7f43980a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f439813b760 0x7f439813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): picked mon.noname-a con 0x7f439813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439806e140 con 0x7f43980a3bb0 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f439809f910 con 0x7f439813b760 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f439809ccd0 con 0x7f43980a0750 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:58.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439f351640 10 monclient(hunting): authenticate will time out at 1726.196584s 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f439813b760 0x7f439813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d0c6640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f43980a3bb0 0x7f439809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53820/0 (socket says 10.20.193.51:53820) 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d0c6640 1 -- 10.20.193.51:0/2550636221 learned_addr learned my addr 10.20.193.51:0/2550636221 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43980a0750 0x7f439809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): get_auth_request con 0x7f439813b760 auth_method 0 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): get_auth_request con 0x7f43980a0750 auth_method 0 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439c8c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient(hunting): handle_auth_done global_id 204453 payload 274 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 -- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43980a0750 msgr2=0x7f439809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 --2- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43980a0750 0x7f439809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 -- 10.20.193.51:0/2550636221 >> v1:10.20.193.51:6789/0 conn(0x7f43980a3bb0 legacy=0x7f439809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:58.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient: _finish_hunting 0 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 monclient: found mon.noname-a 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.577+0000 7f439d8c7640 1 -- 10.20.193.51:0/2550636221 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439809eec0 con 0x7f439813b760 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439d8c7640 1 -- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f439813b760 msgr2=0x7f439813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439d8c7640 1 --2- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f439813b760 0x7f439813db50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f439809f230 tx=0x7f439402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8597fd9864b66a83 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 1 -- 10.20.193.51:0/2550636221 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439403c070 con 0x7f439813b760 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: dump: 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.594 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:58.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 1 -- 10.20.193.51:0/2550636221 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4394037440 con 0x7f439813b760 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 5 monclient: authenticate success, global_id 204453 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 1 -- 10.20.193.51:0/2550636221 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394037810 con 0x7f439813b760 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 4 set_mon_vals no callback set 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f4387fff640 10 monclient: dump: 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.596 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 10 monclient: shutdown 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 -- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f439813b760 msgr2=0x7f439813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 --2- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f439813b760 0x7f439813db50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f439809f230 tx=0x7f439402f130 comp rx=0 tx=0).stop 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 -- 10.20.193.51:0/2550636221 shutdown_connections 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 --2- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f439813b760 0x7f439813db50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 --2- 10.20.193.51:0/2550636221 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43980a0750 0x7f439809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 -- 10.20.193.51:0/2550636221 >> 10.20.193.51:0/2550636221 conn(0x7f43980a30c0 msgr2=0x7f43980a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 -- 10.20.193.51:0/2550636221 shutdown_connections 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.580+0000 7f439f351640 1 -- 10.20.193.51:0/2550636221 wait complete. 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient: build_initial_monmap 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient: monmap: 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:58.598 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 Processor -- start 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 -- start start 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient: init 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:03:58.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43980a0750 0x7f43981312d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): picked mon.noname-a con 0x7f43980a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43980a3bb0 0x7f4398131810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): picked mon.noname-b con 0x7f43980a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 0x7f4398131d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): picked mon.noname-c con 0x7f439813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f43980a04b0 con 0x7f43980a0750 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f439809c850 con 0x7f43980a3bb0 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f439809e710 con 0x7f439813b760 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:58.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439f351640 10 monclient(hunting): authenticate will time out at 1726.200653s 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 0x7f4398131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43980a0750 0x7f43981312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 0x7f4398131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57432/0 (socket says 10.20.193.51:57432) 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 learned_addr learned my addr 10.20.193.51:0/2704473115 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): get_auth_request con 0x7f439813b760 auth_method 0 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): get_auth_request con 0x7f43980a0750 auth_method 0 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient(hunting): handle_auth_done global_id 234110 payload 824 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439c8c5640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43980a3bb0 0x7f4398131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43980a3bb0 msgr2=0x7f4398131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43980a3bb0 0x7f4398131810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43980a0750 msgr2=0x7f43981312d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43980a0750 0x7f43981312d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient: _finish_hunting 0 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 monclient: found mon.noname-c 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980a26d0 con 0x7f439813b760 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439c8c5640 10 monclient: get_auth_request con 0x7f43980a3bb0 auth_method 0 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.581+0000 7f439c8c5640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43980a3bb0 0x7f4398131810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.583+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 msgr2=0x7f4398131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.583+0000 7f439d8c7640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 0x7f4398131d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4394009e90 tx=0x7f4394004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439403c050 con 0x7f439813b760 2026-02-17T12:03:58.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: dump: 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.604 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4394048070 con 0x7f439813b760 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394041a50 con 0x7f439813b760 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 10 monclient: dump: 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.606 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 5 monclient: authenticate success, global_id 234110 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f43877fe640 4 set_mon_vals no callback set 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 monclient: _renew_subs 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4398134870 con 0x7f439813b760 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 monclient: _renew_subs 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43980a2160 con 0x7f439813b760 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 0x7f439812d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4398134e90 con 0x7f4398132290 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4394041bf0 con 0x7f439813b760 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439d0c6640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 0x7f439812d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439d0c6640 10 monclient: get_auth_request con 0x7f4398132290 auth_method 0 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439d0c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439d0c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f439d0c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f436803dd10 0x7f43680401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.584+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(688..688 src has 323..688) ==== 4795+0+0 (secure 0 0 0) 0x7f43940783f0 con 0x7f439813b760 2026-02-17T12:03:58.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439c8c5640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f436803dd10 0x7f43680401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439c8c5640 10 monclient: get_auth_request con 0x7f436803dd10 auth_method 0 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439d0c6640 10 monclient(hunting): handle_auth_done global_id 184495 payload 824 2026-02-17T12:03:58.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.585+0000 7f439d0c6640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f439809dac0 con 0x7f4398132290 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f439c8c5640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f436803dd10 0x7f43680401d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43981327c0 tx=0x7f438c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f439d0c6640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 msgr2=0x7f439812d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f439d0c6640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 0x7f439812d690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f438800eaa0 tx=0x7f438800ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438800cbf0 con 0x7f4398132290 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:58.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 10 monclient: dump: 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f4388019070 con 0x7f4398132290 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 msgr2=0x7f439812d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 0x7f439812d690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f438800eaa0 tx=0x7f438800ef70 comp rx=0 tx=0).stop 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 msgr2=0x7f439812d690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.587+0000 7f4385ffb640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4398132290 0x7f439812d690 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f438800eaa0 tx=0x7f438800ef70 comp rx=0 tx=0).stop 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439f351640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439f351640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 0x7f439812dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439f351640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f43980008d0 con 0x7f439812dbd0 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 0x7f439812dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient: get_auth_request con 0x7f439812dbd0 auth_method 0 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 10 monclient(hunting): handle_auth_done global_id 184498 payload 824 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.591+0000 7f439d0c6640 1 -- 10.20.193.51:0/2704473115 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4398050ac0 con 0x7f439812dbd0 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f439d0c6640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 msgr2=0x7f439812dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f439d0c6640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 0x7f439812dfe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4388016040 tx=0x7f4388004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438801edb0 con 0x7f439812dbd0 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f4385ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f4385ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.593+0000 7f4385ffb640 10 monclient: dump: 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.615 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f438801ed90 con 0x7f439812dbd0 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 msgr2=0x7f439812dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 0x7f439812dfe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4388016040 tx=0x7f4388004a40 comp rx=0 tx=0).stop 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 msgr2=0x7f439812dfe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:03:58.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f4385ffb640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f439812dbd0 0x7f439812dfe0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4388016040 tx=0x7f4388004a40 comp rx=0 tx=0).stop 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 270980, 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:03:58.617 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.618 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.619 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:03:58.620 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.621 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:03:58.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.624 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.625 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:03:58.626 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:03:58.627 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:03:58.627 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f436803dd10 msgr2=0x7f43680401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f436803dd10 0x7f43680401d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43981327c0 tx=0x7f438c008040 comp rx=0 tx=0).stop 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 10 monclient: shutdown 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 msgr2=0x7f4398131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 --2- 10.20.193.51:0/2704473115 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f439813b760 0x7f4398131d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4394009e90 tx=0x7f4394004b40 comp rx=0 tx=0).stop 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 reap_dead start 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439d8c7640 1 -- 10.20.193.51:0/2704473115 reap_dead start 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 shutdown_connections 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 >> 10.20.193.51:0/2704473115 conn(0x7f43980a30c0 msgr2=0x7f4398139f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 shutdown_connections 2026-02-17T12:03:58.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.594+0000 7f439f351640 1 -- 10.20.193.51:0/2704473115 wait complete. 2026-02-17T12:03:58.628 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:03:58.629 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:03:58.629 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:03:58.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 10 monclient: get_monmap_and_config 2026-02-17T12:03:58.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 10 monclient: build_initial_monmap 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 10 monclient: monmap: 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:58.695492+0000 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:58.695492+0000 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:58.697 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:58.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 1 Processor -- start 2026-02-17T12:03:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 1 -- start start 2026-02-17T12:03:58.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.694+0000 7f43907a9640 10 monclient: init 2026-02-17T12:03:58.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:58.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f43880a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43880a0750 0x7f438809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-a con 0x7f43880a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 0x7f438813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-b con 0x7f438813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f438806e140 con 0x7f43880a3bb0 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f438809f910 con 0x7f43880a0750 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f438809ccd0 con 0x7f438813b760 2026-02-17T12:03:58.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f43907a9640 10 monclient(hunting): authenticate will time out at 1726.314228s 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43880a0750 0x7f438809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43880a0750 0x7f438809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35470/0 (socket says 10.20.193.51:35470) 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 0x7f438813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 -- 10.20.193.51:0/1539931271 learned_addr learned my addr 10.20.193.51:0/1539931271 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): get_auth_request con 0x7f43880a0750 auth_method 0 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): get_auth_request con 0x7f438813b760 auth_method 0 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient(hunting): handle_auth_done global_id 204459 payload 274 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 -- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 msgr2=0x7f438813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 0x7f438813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 -- 10.20.193.51:0/1539931271 >> v1:10.20.193.142:6789/0 conn(0x7f43880a3bb0 legacy=0x7f438809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 monclient: found mon.noname-a 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:58.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438dd1d640 1 -- 10.20.193.51:0/1539931271 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438809eec0 con 0x7f43880a0750 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.695+0000 7f438ed1f640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 0x7f438813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.697+0000 7f438dd1d640 1 -- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 msgr2=0x7f438809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.697+0000 7f438dd1d640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f438809e1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f438806f3c0 tx=0x7f437c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15650b706410379e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.697+0000 7f438d51c640 1 -- 10.20.193.51:0/1539931271 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c03c070 con 0x7f43880a0750 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.697+0000 7f438d51c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: dump: 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.709 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: _finish_auth 0 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: _check_auth_tickets 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 1 -- 10.20.193.51:0/1539931271 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f437c02fca0 con 0x7f43880a0750 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 1 -- 10.20.193.51:0/1539931271 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c037660 con 0x7f43880a0750 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f438d51c640 10 monclient: dump: 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 5 monclient: authenticate success, global_id 204459 2026-02-17T12:03:58.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 4 set_mon_vals no callback set 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 10 monclient: shutdown 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 -- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 msgr2=0x7f438809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f438809e1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f438806f3c0 tx=0x7f437c02ee60 comp rx=0 tx=0).stop 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 -- 10.20.193.51:0/1539931271 shutdown_connections 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f438813b760 0x7f438813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 --2- 10.20.193.51:0/1539931271 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f438809e1d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 -- 10.20.193.51:0/1539931271 >> 10.20.193.51:0/1539931271 conn(0x7f43880a30c0 msgr2=0x7f43880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 -- 10.20.193.51:0/1539931271 shutdown_connections 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 1 -- 10.20.193.51:0/1539931271 wait complete. 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 10 monclient: build_initial_monmap 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.698+0000 7f43907a9640 10 monclient: monmap: 2026-02-17T12:03:58.712 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 Processor -- start 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 -- start start 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient: init 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:58.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-a con 0x7f43880a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-c con 0x7f43880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f438813b760 0x7f4388094f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): picked mon.noname-b con 0x7f438813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f43880a04b0 con 0x7f43880a0750 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f438809c850 con 0x7f438813b760 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f438809e710 con 0x7f43880a3bb0 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:58.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f43907a9640 10 monclient(hunting): authenticate will time out at 1726.318366s 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35476/0 (socket says 10.20.193.51:35476) 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57444/0 (socket says 10.20.193.51:57444) 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 1 -- 10.20.193.51:0/3540191435 learned_addr learned my addr 10.20.193.51:0/3540191435 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): get_auth_request con 0x7f43880a0750 auth_method 0 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): get_auth_request con 0x7f43880a3bb0 auth_method 0 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:58.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient(hunting): handle_auth_done global_id 234116 payload 824 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 -- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f438813b760 msgr2=0x7f4388094f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f438813b760 0x7f4388094f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 -- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 msgr2=0x7f43881cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient: _finish_hunting 0 2026-02-17T12:03:58.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 monclient: found mon.noname-c 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438dd1d640 1 -- 10.20.193.51:0/3540191435 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4388098e20 con 0x7f43880a3bb0 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.699+0000 7f438e51e640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f438dd1d640 1 -- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 msgr2=0x7f43881d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f438dd1d640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c046020 con 0x7f43880a3bb0 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: dump: 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.717 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: _finish_auth 0 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: _check_auth_tickets 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f437c02fe50 con 0x7f43880a3bb0 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c03c040 con 0x7f43880a3bb0 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:58.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f438cd1b640 4 set_mon_vals no callback set 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f436effd640 10 monclient: dump: 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 5 monclient: authenticate success, global_id 234116 2026-02-17T12:03:58.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 10 monclient: _renew_subs 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438806f510 con 0x7f43880a3bb0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 10 monclient: _renew_subs 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.701+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f438809d7b0 con 0x7f43880a3bb0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f43907a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f43907a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f43907a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438809dac0 con 0x7f43880a3bb0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f437c03f030 con 0x7f43880a3bb0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.702+0000 7f436effd640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 0x7f43580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.703+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(688..688 src has 323..688) ==== 4795+0+0 (secure 0 0 0) 0x7f437c077200 con 0x7f43880a3bb0 2026-02-17T12:03:58.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.703+0000 7f438e51e640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 0x7f43580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.703+0000 7f438e51e640 10 monclient: get_auth_request con 0x7f435803dd10 auth_method 0 2026-02-17T12:03:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.705+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f437c050070 con 0x7f43880a3bb0 2026-02-17T12:03:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.705+0000 7f436effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.705+0000 7f436effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:58.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.705+0000 7f438e51e640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 0x7f43580401d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4378004670 tx=0x7f4378003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f43907a9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:03:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f43907a9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:03:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f43907a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:03:58.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f43880008d0 con 0x7f43880a3bb0 2026-02-17T12:03:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f436effd640 1 -- 10.20.193.51:0/3540191435 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f437c037e20 con 0x7f43880a3bb0 2026-02-17T12:03:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f436effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:03:58.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.818+0000 7f436effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:03:58.822 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=485838563,config=692619927,health=2186438481,kv=643764953,logm=1464594088}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=28,config=2,health=12,kv=10,logm=48} crc {auth=3635925725,config=692619927,health=3816966473,kv=3190169816,logm=4131855195}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=485838563,config=692619927,health=2186438481,kv=643764953,logm=1464594088}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.818+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=2420680705,config=692619927,health=3816966473,kv=643764953,logm=286964369}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138200831}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2201186232}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138200831}) 2026-02-17T12:03:58.823 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.819+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4204865158}) 2026-02-17T12:03:58.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 msgr2=0x7f43580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 0x7f43580401d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4378004670 tx=0x7f4378003960 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 10 monclient: shutdown 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 msgr2=0x7f43881d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.819+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 shutdown_connections 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f435803dd10 0x7f43580401d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f438813b760 0x7f4388094f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43880a3bb0 0x7f43881d0010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 --2- 10.20.193.51:0/3540191435 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43880a0750 0x7f43881cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 >> 10.20.193.51:0/3540191435 conn(0x7f43880a30c0 msgr2=0x7f43880a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:58.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 shutdown_connections 2026-02-17T12:03:58.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:58.820+0000 7f43907a9640 1 -- 10.20.193.51:0/3540191435 wait complete. 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=79725741}) 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1810254314}) 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=79725741}) 2026-02-17T12:03:58.832 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=696843293}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3320173879}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4034933595}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3320173879}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.820+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=194728382}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2767846793}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3540671263}) 2026-02-17T12:03:58.833 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2767846793}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2191490903}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950651510}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1806447165}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950651510}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.821+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1872465899}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3816416783}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=913763092}) 2026-02-17T12:03:58.834 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3816416783}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=787844627}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=434740358}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3622724011}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=434740358}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.822+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3999304050}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3590409688}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=811653403}) 2026-02-17T12:03:58.835 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3590409688}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2693674706}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=852321358}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3514035780}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=852321358}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1320553291}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=829438629}) 2026-02-17T12:03:58.836 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3580381595}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=829438629}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.823+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4016703835}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896277925}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2006404293}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896277925}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2969106602}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3578868041}) 2026-02-17T12:03:58.837 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4228392430}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3578868041}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.824+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1676662469}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692672138}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2827847460}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692672138}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1620803145}) 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.838 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1139040494}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2722087793}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1139040494}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1304359992}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1124647428}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=697988803}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1124647428}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.825+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=876031623}) 2026-02-17T12:03:58.839 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3380810106}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=304584730}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3380810106}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1470047742}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1393484436}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1039708795}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1393484436}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=563902529}) 2026-02-17T12:03:58.840 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1377154402}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=292583931}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1377154402}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.826+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2428499184}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426623065}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1223533}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426623065}) 2026-02-17T12:03:58.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=690511539}) 2026-02-17T12:03:58.843 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:03:58.846 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=591054078}) 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3498184829}) 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=591054078}) 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.827+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3068570039}) 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.847 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2170746124}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2359494229}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2170746124}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3860270665}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3996460163}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=639363911}) 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.848 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3996460163}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2818405241}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203077575}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1693941490}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203077575}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.828+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=198005891}) 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2047300013}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1307174757}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2047300013}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3403492430}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1348169739}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1790414882}) 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.850 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1348169739}) 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1874089220}) 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2718731212}) 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2155766019}) 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2718731212}) 2026-02-17T12:03:58.851 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:58.829+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=908026076}) 2026-02-17T12:03:59.258 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.258 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776462671}) 2026-02-17T12:03:59.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2956867370}) 2026-02-17T12:03:59.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776462671}) 2026-02-17T12:03:59.259 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.256+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2391618264}) 2026-02-17T12:03:59.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.261 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1533429339}) 2026-02-17T12:03:59.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3770482173}) 2026-02-17T12:03:59.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1533429339}) 2026-02-17T12:03:59.262 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.259+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3730136147}) 2026-02-17T12:03:59.262 INFO:tasks.rados.rados.0.trial142.stdout:2995: done (0 left) 2026-02-17T12:03:59.263 INFO:tasks.rados.rados.0.trial142.stdout:2996: snap_create 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2603200636}) 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2636159838}) 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2603200636}) 2026-02-17T12:03:59.274 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.272+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2797098881}) 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518217408}) 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3407496958}) 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518217408}) 2026-02-17T12:03:59.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.275+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=5684411}) 2026-02-17T12:03:59.474 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.474 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1895108719}) 2026-02-17T12:03:59.474 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=411782467}) 2026-02-17T12:03:59.474 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1895108719}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3427008843}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3216915019}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1641815155}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3216915019}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4225105503}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=908155612}) 2026-02-17T12:03:59.475 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=982855288}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=908155612}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.469+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3310954065}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128768053}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2040679119}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128768053}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3243065714}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615343815}) 2026-02-17T12:03:59.476 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3205577601}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615343815}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=370806480}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2311298509}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3059520128}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2311298509}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.470+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=498046557}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105365744}) 2026-02-17T12:03:59.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=480453773}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105365744}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2297512032}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766505710}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1311749414}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766505710}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1257285116}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626848128}) 2026-02-17T12:03:59.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=107102981}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626848128}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.471+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2521024678}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048399744}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1288690650}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048399744}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1328644727}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2729943474}) 2026-02-17T12:03:59.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1430847906}) 2026-02-17T12:03:59.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2729943474}) 2026-02-17T12:03:59.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=470398800}) 2026-02-17T12:03:59.487 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927683255}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2957799351}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927683255}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.472+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=619565367}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=692123040}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2764303404}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=692123040}) 2026-02-17T12:03:59.488 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1995347583}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079124331}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3073197569}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079124331}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1222048460}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3487778991}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1172577045}) 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.489 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3487778991}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.473+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=436358578}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134546871}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4150147831}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134546871}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3539681075}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1808568346}) 2026-02-17T12:03:59.490 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3508564554}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1808568346}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=473695182}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587220764}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3297642677}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587220764}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.474+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2554049083}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3467059200}) 2026-02-17T12:03:59.491 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3416600630}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3467059200}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3232884608}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=446998565}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3397920298}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=446998565}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.475+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1330590666}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2922749895}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2451002026}) 2026-02-17T12:03:59.492 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2922749895}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1265066198}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1208256891}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2072541760}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1208256891}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3831994433}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2741620717}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1409356265}) 2026-02-17T12:03:59.493 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2741620717}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.476+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3909635021}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1369829410}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3820117535}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1369829410}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1315377572}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3683014168}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2869541570}) 2026-02-17T12:03:59.494 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3683014168}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3743774255}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591286483}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2041506407}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591286483}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1283250679}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=668744518}) 2026-02-17T12:03:59.495 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3408473566}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=668744518}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.477+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1427823927}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169812420}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3212725121}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169812420}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=845770462}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347541223}) 2026-02-17T12:03:59.496 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1814724024}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347541223}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2327967173}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871023523}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3270317852}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871023523}) 2026-02-17T12:03:59.497 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.478+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2107070603}) 2026-02-17T12:03:59.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290327323}) 2026-02-17T12:03:59.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1332222783}) 2026-02-17T12:03:59.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290327323}) 2026-02-17T12:03:59.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.535+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3144318915}) 2026-02-17T12:03:59.759 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582054329}) 2026-02-17T12:03:59.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3128713228}) 2026-02-17T12:03:59.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582054329}) 2026-02-17T12:03:59.760 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.757+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2963976314}) 2026-02-17T12:03:59.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470590251}) 2026-02-17T12:03:59.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1295887973}) 2026-02-17T12:03:59.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.841 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470590251}) 2026-02-17T12:03:59.842 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.839+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3760530339}) 2026-02-17T12:03:59.844 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:03:59.844 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.911+0000 7f7a6f61a640 10 monclient: get_monmap_and_config 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.911+0000 7f7a6f61a640 10 monclient: build_initial_monmap 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.911+0000 7f7a6f61a640 10 monclient: monmap: 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:59.916 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:03:59.912743+0000 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:03:59.912743+0000 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 Processor -- start 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 -- start start 2026-02-17T12:03:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient: init 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7a680a3bb0 0x7f7a6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-c con 0x7f7a680a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7a680a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-b con 0x7f7a6813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6806e140 con 0x7f7a680a0750 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7a6809f910 con 0x7f7a680a3bb0 2026-02-17T12:03:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6809ccd0 con 0x7f7a6813b760 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6f61a640 10 monclient(hunting): authenticate will time out at 1727.531485s 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57464/0 (socket says 10.20.193.51:57464) 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 -- 10.20.193.51:0/1418439111 learned_addr learned my addr 10.20.193.51:0/1418439111 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): get_auth_request con 0x7f7a6813b760 auth_method 0 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6d38f640 1 --2- 10.20.193.51:0/1418439111 >> v2:10.20.193.142:3300/0 conn(0x7f7a680a3bb0 0x7f7a6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6d38f640 10 monclient(hunting): get_auth_request con 0x7f7a680a3bb0 auth_method 0 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6d38f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6d38f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6d38f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient(hunting): handle_auth_done global_id 234119 payload 274 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 -- 10.20.193.51:0/1418439111 >> v2:10.20.193.142:3300/0 conn(0x7f7a680a3bb0 msgr2=0x7f7a6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 --2- 10.20.193.51:0/1418439111 >> v2:10.20.193.142:3300/0 conn(0x7f7a680a3bb0 0x7f7a6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 -- 10.20.193.51:0/1418439111 >> v1:10.20.193.142:6789/0 conn(0x7f7a680a0750 legacy=0x7f7a6809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient: _finish_hunting 0 2026-02-17T12:03:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 monclient: found mon.noname-b 2026-02-17T12:03:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:03:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.912+0000 7f7a6db90640 1 -- 10.20.193.51:0/1418439111 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6809eec0 con 0x7f7a6813b760 2026-02-17T12:03:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6db90640 1 -- 10.20.193.51:0/1418439111 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 msgr2=0x7f7a6813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6db90640 1 --2- 10.20.193.51:0/1418439111 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6806c1c0 tx=0x7f7a6402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219c14e615d06242 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 1 -- 10.20.193.51:0/1418439111 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6402fe60 con 0x7f7a6813b760 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: dump: 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:59.928 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: _finish_auth 0 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: _check_auth_tickets 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 1 -- 10.20.193.51:0/1418439111 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a640373f0 con 0x7f7a6813b760 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 5 monclient: authenticate success, global_id 234119 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 1 -- 10.20.193.51:0/1418439111 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a640377c0 con 0x7f7a6813b760 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:03:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a57fff640 10 monclient: dump: 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 10 monclient: get_monmap_and_config success 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 4 set_mon_vals no callback set 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 10 monclient: shutdown 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 -- 10.20.193.51:0/1418439111 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 msgr2=0x7f7a6813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/1418439111 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6806c1c0 tx=0x7f7a6402f230 comp rx=0 tx=0).stop 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 -- 10.20.193.51:0/1418439111 shutdown_connections 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/1418439111 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a6813b760 0x7f7a6813db50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/1418439111 >> v2:10.20.193.142:3300/0 conn(0x7f7a680a3bb0 0x7f7a6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 -- 10.20.193.51:0/1418439111 >> 10.20.193.51:0/1418439111 conn(0x7f7a680a30c0 msgr2=0x7f7a680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 -- 10.20.193.51:0/1418439111 shutdown_connections 2026-02-17T12:03:59.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.915+0000 7f7a6f61a640 1 -- 10.20.193.51:0/1418439111 wait complete. 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient: build_initial_monmap 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient: monmap: 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:03:59.932 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 Processor -- start 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 -- start start 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient: init 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient: _reopen_session rank -1 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 0x7f7a6813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-c con 0x7f7a680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-a con 0x7f7a680a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a6813b760 0x7f7a6813b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): picked mon.noname-b con 0x7f7a6813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:03:59.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680a04b0 con 0x7f7a680a3bb0 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6809c850 con 0x7f7a6813b760 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6809e710 con 0x7f7a680a0750 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): _renew_subs 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6f61a640 10 monclient(hunting): authenticate will time out at 1727.535693s 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 0x7f7a6813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35484/0 (socket says 10.20.193.51:35484) 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 0x7f7a6813a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57474/0 (socket says 10.20.193.51:57474) 2026-02-17T12:03:59.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 -- 10.20.193.51:0/2034868676 learned_addr learned my addr 10.20.193.51:0/2034868676 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): get_auth_request con 0x7f7a680a3bb0 auth_method 0 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): get_auth_request con 0x7f7a680a0750 auth_method 0 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:59.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6d38f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6db90640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a6813b760 0x7f7a6813b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6db90640 10 monclient(hunting): get_auth_request con 0x7f7a6813b760 auth_method 0 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6db90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6db90640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6db90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient(hunting): handle_auth_done global_id 204465 payload 824 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 -- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 msgr2=0x7f7a6813a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 0x7f7a6813a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:59.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 -- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a6813b760 msgr2=0x7f7a6813b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a6813b760 0x7f7a6813b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient: _finish_hunting 0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 monclient: found mon.noname-a 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.916+0000 7f7a6cb8e640 1 -- 10.20.193.51:0/2034868676 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68097440 con 0x7f7a680a3bb0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6cb8e640 1 -- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 msgr2=0x7f7a6813acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6cb8e640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c5d0 tx=0x7f7a5c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c016020 con 0x7f7a680a3bb0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:03:59.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: dump: 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: _finish_auth 0 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:03:59.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c012a60 con 0x7f7a680a3bb0 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c012e50 con 0x7f7a680a3bb0 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a577fe640 4 set_mon_vals no callback set 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a55ffb640 10 monclient: dump: 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:03:59.939 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 5 monclient: authenticate success, global_id 204465 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _renew_subs 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a68098890 con 0x7f7a680a3bb0 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _renew_subs 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:59.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6809d7b0 con 0x7f7a680a3bb0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.919+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a680a2cc0 con 0x7f7a680a3bb0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.920+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7a5c01b400 con 0x7f7a680a3bb0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.920+0000 7f7a55ffb640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 0x7f7a38040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.920+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(689..689 src has 323..689) ==== 4779+0+0 (secure 0 0 0) 0x7f7a5c052680 con 0x7f7a680a3bb0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.920+0000 7f7a6d38f640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 0x7f7a38040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.920+0000 7f7a6d38f640 10 monclient: get_auth_request con 0x7f7a3803deb0 auth_method 0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.922+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7a5c020030 con 0x7f7a680a3bb0 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.922+0000 7f7a55ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:03:59.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.922+0000 7f7a55ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:03:59.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:03:59.923+0000 7f7a6d38f640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 0x7f7a38040370 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009a50 tx=0x7f7a58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:03:59.995 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1938146645}) 2026-02-17T12:03:59.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=460745386}) 2026-02-17T12:03:59.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:03:59.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1938146645}) 2026-02-17T12:03:59.996 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:03:59.993+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2777804952}) 2026-02-17T12:04:00.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1654230322}) 2026-02-17T12:04:00.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=222854628}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1654230322}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2578369815}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1754097830}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1007266147}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1754097830}) 2026-02-17T12:04:00.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1586841918}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3437393212}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3474085753}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3437393212}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.001+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1548759291}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=21488668}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=608371132}) 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=21488668}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1718615387}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=193230266}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=116641989}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=193230266}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.002+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1324923153}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3526260327}) 2026-02-17T12:04:00.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2210288803}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3526260327}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3799618153}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3496319787}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2060141451}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3496319787}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=183992374}) 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3204289476}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3215840254}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3204289476}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.003+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2395054788}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2302202695}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811188328}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2302202695}) 2026-02-17T12:04:00.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3862370453}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435224999}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3392410218}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435224999}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3212822925}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3732902231}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=864369952}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.004+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3732902231}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3974947245}) 2026-02-17T12:04:00.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230524946}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1625249076}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230524946}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1210058660}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383084380}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=577234606}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383084380}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.005+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2292695208}) 2026-02-17T12:04:00.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866470919}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=311837056}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866470919}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=444933157}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3337104768}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2682477359}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3337104768}) 2026-02-17T12:04:00.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3286712959}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1877041295}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=199899965}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1877041295}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.006+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3493760764}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3054292696}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2718442813}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3054292696}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1301060822}) 2026-02-17T12:04:00.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=437541126}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=636634144}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=437541126}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=215157704}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1569254336}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1772437159}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1569254336}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.007+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=256784699}) 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187223861}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3995358142}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187223861}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2637778312}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3830227826}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=275229412}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3830227826}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.008+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=368098524}) 2026-02-17T12:04:00.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=79,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=3717648219,mdsmap=3207544932,mgr=2242172100,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=187869042,mon_config_key=2292436301}) 2026-02-17T12:04:00.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=76,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=5} crc {logm=2295748769,mdsmap=3207544932,mgr=2242172100,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=26787248,mon_config_key=4159340129}) 2026-02-17T12:04:00.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=79,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=3717648219,mdsmap=3207544932,mgr=2242172100,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=187869042,mon_config_key=2292436301}) 2026-02-17T12:04:00.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.009+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=73,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7} crc {logm=1964178742,mdsmap=3207544932,mgr=1312948032,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=187869042,mon_config_key=70915502}) 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.036+0000 7f7a6f61a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.036+0000 7f7a6f61a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.036+0000 7f7a6f61a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.036+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7a6809dac0 con 0x7f7a680a3bb0 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.037+0000 7f7a55ffb640 1 -- 10.20.193.51:0/2034868676 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f7a5c01b9b0 con 0x7f7a680a3bb0 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.037+0000 7f7a55ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:00.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.037+0000 7f7a55ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:00.040 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:00.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 msgr2=0x7f7a38040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 0x7f7a38040370 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009a50 tx=0x7f7a58008040 comp rx=0 tx=0).stop 2026-02-17T12:04:00.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 10 monclient: shutdown 2026-02-17T12:04:00.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 msgr2=0x7f7a6813acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c5d0 tx=0x7f7a5c00caa0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 shutdown_connections 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7a3803deb0 0x7f7a38040370 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7a6813b760 0x7f7a6813b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7a680a3bb0 0x7f7a6813acb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 --2- 10.20.193.51:0/2034868676 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7a680a0750 0x7f7a6813a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 >> 10.20.193.51:0/2034868676 conn(0x7f7a680a30c0 msgr2=0x7f7a68072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 shutdown_connections 2026-02-17T12:04:00.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.038+0000 7f7a6f61a640 1 -- 10.20.193.51:0/2034868676 wait complete. 2026-02-17T12:04:00.048 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:04:00.048 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:04:00.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:04:00.048 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.113+0000 7ff610cb0640 10 monclient: get_monmap_and_config 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.113+0000 7ff610cb0640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.113+0000 7ff610cb0640 10 monclient: monmap: 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:00.114652+0000 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:00.114652+0000 2026-02-17T12:04:00.116 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 Processor -- start 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 -- start start 2026-02-17T12:04:00.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient: init 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff60c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff60c09dac0 0x7ff60c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff60c09dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff60c0a0110 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60c06e140 con 0x7ff60c0a3bb0 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60c09ce60 con 0x7ff60c0a0110 2026-02-17T12:04:00.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff60c09aed0 con 0x7ff60c09dac0 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff610cb0640 10 monclient(hunting): authenticate will time out at 1727.733606s 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff60a575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff60c0a3bb0 0x7ff60c09f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53836/0 (socket says 10.20.193.51:53836) 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff60a575640 1 -- 10.20.193.51:0/2193500620 learned_addr learned my addr 10.20.193.51:0/2193500620 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 1 --2- 10.20.193.51:0/2193500620 >> v2:10.20.193.51:3300/0 conn(0x7ff60c09dac0 0x7ff60c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): get_auth_request con 0x7ff60c09dac0 auth_method 0 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient(hunting): handle_auth_done global_id 204468 payload 274 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 1 -- 10.20.193.51:0/2193500620 >> v1:10.20.193.142:6789/0 conn(0x7ff60c0a0110 legacy=0x7ff60c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 1 -- 10.20.193.51:0/2193500620 >> v1:10.20.193.51:6789/0 conn(0x7ff60c0a3bb0 legacy=0x7ff60c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 1 monclient: found mon.noname-a 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.114+0000 7ff609d74640 1 -- 10.20.193.51:0/2193500620 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60c09a5c0 con 0x7ff60c09dac0 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609d74640 1 -- 10.20.193.51:0/2193500620 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c09dac0 msgr2=0x7ff60c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609d74640 1 --2- 10.20.193.51:0/2193500620 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c09dac0 0x7ff60c09fbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c096616c9f65a98 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 1 -- 10.20.193.51:0/2193500620 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f403c070 con 0x7ff60c09dac0 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: dump: 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.131 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 1 -- 10.20.193.51:0/2193500620 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f402fce0 con 0x7ff60c09dac0 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 5 monclient: authenticate success, global_id 204468 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 1 -- 10.20.193.51:0/2193500620 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4037660 con 0x7ff60c09dac0 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 4 set_mon_vals no callback set 2026-02-17T12:04:00.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff609573640 10 monclient: dump: 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.133 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 10 monclient: shutdown 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 -- 10.20.193.51:0/2193500620 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c09dac0 msgr2=0x7ff60c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 --2- 10.20.193.51:0/2193500620 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c09dac0 0x7ff60c09fbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f402ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 -- 10.20.193.51:0/2193500620 shutdown_connections 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 --2- 10.20.193.51:0/2193500620 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c09dac0 0x7ff60c09fbd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 -- 10.20.193.51:0/2193500620 >> 10.20.193.51:0/2193500620 conn(0x7ff60c0a30c0 msgr2=0x7ff60c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 -- 10.20.193.51:0/2193500620 shutdown_connections 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.117+0000 7ff610cb0640 1 -- 10.20.193.51:0/2193500620 wait complete. 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient: monmap: 2026-02-17T12:04:00.134 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 Processor -- start 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 -- start start 2026-02-17T12:04:00.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient: init 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff60c09dac0 0x7ff60c1cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff60c09dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff60c0a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff60c0a3bb0 0x7ff60c099050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): picked mon.noname-c con 0x7ff60c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c0a3f90 con 0x7ff60c0a0110 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c09caa0 con 0x7ff60c09dac0 2026-02-17T12:04:00.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff60c0a0540 con 0x7ff60c0a3bb0 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff610cb0640 10 monclient(hunting): authenticate will time out at 1727.737877s 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35500/0 (socket says 10.20.193.51:35500) 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 1 -- 10.20.193.51:0/427122697 learned_addr learned my addr 10.20.193.51:0/427122697 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 10 monclient(hunting): get_auth_request con 0x7ff60c0a0110 auth_method 0 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff609d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff60ad76640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff60c0a3bb0 0x7ff60c099050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff60ad76640 10 monclient(hunting): get_auth_request con 0x7ff60c0a3bb0 auth_method 0 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff60ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff60ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.118+0000 7ff60ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff60c09dac0 0x7ff60c1cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): get_auth_request con 0x7ff60c09dac0 auth_method 0 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient(hunting): handle_auth_done global_id 204471 payload 824 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff60c0a3bb0 msgr2=0x7ff60c099050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff60c0a3bb0 0x7ff60c099050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff60c09dac0 msgr2=0x7ff60c1cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff60c09dac0 0x7ff60c1cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 monclient: found mon.noname-a 2026-02-17T12:04:00.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.119+0000 7ff609d74640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60c0a2040 con 0x7ff60c0a0110 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff609d74640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 msgr2=0x7ff60c098b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff609d74640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4046070 con 0x7ff60c0a0110 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: dump: 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f4041870 con 0x7ff60c0a0110 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 5 monclient: authenticate success, global_id 204471 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 monclient: _renew_subs 2026-02-17T12:04:00.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60c0a1af0 con 0x7ff60c0a0110 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f403c040 con 0x7ff60c0a0110 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff608d72640 4 set_mon_vals no callback set 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 10 monclient: dump: 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.142 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 monclient: _renew_subs 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60c0922b0 con 0x7ff60c0a0110 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 0x7ff60c08ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c0914e0 con 0x7ff60c08e6a0 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 0x7ff60c08ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient: get_auth_request con 0x7ff60c08e6a0 auth_method 0 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff5f4041c60 con 0x7ff60c0a0110 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.121+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff60a575640 10 monclient(hunting): handle_auth_done global_id 204474 payload 824 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff60a575640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff60c09f4c0 con 0x7ff60c08e6a0 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff5f2ffd640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff5d803dd10 0x7ff5d80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(689..689 src has 323..689) ==== 4779+0+0 (secure 0 0 0) 0x7ff5f4077ec0 con 0x7ff60c0a0110 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff60ad76640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff5d803dd10 0x7ff5d80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.122+0000 7ff60ad76640 10 monclient: get_auth_request con 0x7ff5d803dd10 auth_method 0 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff60a575640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 msgr2=0x7ff60c08ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff60a575640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 0x7ff60c08ea80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff60000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60000cbf0 con 0x7ff60c08e6a0 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 10 monclient: dump: 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.145 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff600019070 con 0x7ff60c08e6a0 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 msgr2=0x7ff60c08ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 0x7ff60c08ea80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff60000ef70 comp rx=0 tx=0).stop 2026-02-17T12:04:00.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 msgr2=0x7ff60c08ea80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.124+0000 7ff5f2ffd640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08e6a0 0x7ff60c08ea80 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff60000ef70 comp rx=0 tx=0).stop 2026-02-17T12:04:00.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.125+0000 7ff60ad76640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff5d803dd10 0x7ff5d80401d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00f2e0 tx=0x7ff5fc004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff610cb0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff610cb0640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 0x7ff60c1da560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff610cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c09d790 con 0x7ff60c08efc0 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 0x7ff60c1da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient: get_auth_request con 0x7ff60c08efc0 auth_method 0 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 10 monclient(hunting): handle_auth_done global_id 204477 payload 824 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.127+0000 7ff60a575640 1 -- 10.20.193.51:0/427122697 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff60c0008d0 con 0x7ff60c08efc0 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff60a575640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 msgr2=0x7ff60c1da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff60a575640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 0x7ff60c1da560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60001e250 con 0x7ff60c08efc0 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff5f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff5f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.129+0000 7ff5f2ffd640 10 monclient: dump: 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.150 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7ff60001e250 con 0x7ff60c08efc0 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 msgr2=0x7ff60c1da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 0x7ff60c1da560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff600004a40 comp rx=0 tx=0).stop 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 msgr2=0x7ff60c1da560 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff5f2ffd640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c08efc0 0x7ff60c1da560 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff60000eaa0 tx=0x7ff600004a40 comp rx=0 tx=0).stop 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 180895, 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:00.152 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.153 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.154 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.155 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.156 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.157 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:00.158 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.159 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:00.160 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:04:00.161 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.162 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.162 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.162 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:00.162 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff5d803dd10 msgr2=0x7ff5d80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff5d803dd10 0x7ff5d80401d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00f2e0 tx=0x7ff5fc004200 comp rx=0 tx=0).stop 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 10 monclient: shutdown 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 msgr2=0x7ff60c098b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff60ad76640 1 -- 10.20.193.51:0/427122697 reap_dead start 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f40047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 shutdown_connections 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 --2- 10.20.193.51:0/427122697 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff60c0a0110 0x7ff60c098b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 >> 10.20.193.51:0/427122697 conn(0x7ff60c0a30c0 msgr2=0x7ff60c0997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 shutdown_connections 2026-02-17T12:04:00.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.130+0000 7ff610cb0640 1 -- 10.20.193.51:0/427122697 wait complete. 2026-02-17T12:04:00.164 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:00.164 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:04:00.164 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.230+0000 7ff050eda640 10 monclient: get_monmap_and_config 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.230+0000 7ff050eda640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.230+0000 7ff050eda640 10 monclient: monmap: 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:00.231585+0000 2026-02-17T12:04:00.234 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:00.231585+0000 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 Processor -- start 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 -- start start 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient: init 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff04c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:00.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 0x7ff04c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-b con 0x7ff04c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff04c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c06e140 con 0x7ff04c13b760 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c09f910 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c09ccd0 con 0x7ff04c0a0750 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff050eda640 10 monclient(hunting): authenticate will time out at 1727.850362s 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 0x7ff04c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff04ad76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff04c13b760 0x7ff04c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53844/0 (socket says 10.20.193.51:53844) 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff04ad76640 1 -- 10.20.193.51:0/1844408753 learned_addr learned my addr 10.20.193.51:0/1844408753 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): get_auth_request con 0x7ff04c0a0750 auth_method 0 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient(hunting): handle_auth_done global_id 234128 payload 274 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 1 -- 10.20.193.51:0/1844408753 >> v1:10.20.193.142:6789/0 conn(0x7ff04c0a3bb0 legacy=0x7ff04c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 1 -- 10.20.193.51:0/1844408753 >> v1:10.20.193.51:6789/0 conn(0x7ff04c13b760 legacy=0x7ff04c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 1 monclient: found mon.noname-b 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.231+0000 7ff049d74640 1 -- 10.20.193.51:0/1844408753 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c09eec0 con 0x7ff04c0a0750 2026-02-17T12:04:00.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049d74640 1 -- 10.20.193.51:0/1844408753 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 msgr2=0x7ff04c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049d74640 1 --2- 10.20.193.51:0/1844408753 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 0x7ff04c09e1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff04c06c1c0 tx=0x7ff03402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4470ed8d92356034 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 1 -- 10.20.193.51:0/1844408753 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03403c070 con 0x7ff04c0a0750 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: dump: 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 1 -- 10.20.193.51:0/1844408753 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03402fce0 con 0x7ff04c0a0750 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 5 monclient: authenticate success, global_id 234128 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 1 -- 10.20.193.51:0/1844408753 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034037660 con 0x7ff04c0a0750 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 4 set_mon_vals no callback set 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff049573640 10 monclient: dump: 2026-02-17T12:04:00.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 10 monclient: shutdown 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 -- 10.20.193.51:0/1844408753 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 msgr2=0x7ff04c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 --2- 10.20.193.51:0/1844408753 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 0x7ff04c09e1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff04c06c1c0 tx=0x7ff03402ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 -- 10.20.193.51:0/1844408753 shutdown_connections 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 --2- 10.20.193.51:0/1844408753 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a0750 0x7ff04c09e1d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 -- 10.20.193.51:0/1844408753 >> 10.20.193.51:0/1844408753 conn(0x7ff04c0a30c0 msgr2=0x7ff04c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 -- 10.20.193.51:0/1844408753 shutdown_connections 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.234+0000 7ff050eda640 1 -- 10.20.193.51:0/1844408753 wait complete. 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient: monmap: 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:00.247 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 Processor -- start 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 -- start start 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient: init 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff04c0a0750 0x7ff04c131130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-b con 0x7ff04c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-c con 0x7ff04c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff04c13b760 0x7ff04c131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): picked mon.noname-a con 0x7ff04c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:00.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0a04b0 con 0x7ff04c13b760 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c09c850 con 0x7ff04c0a0750 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c09e710 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff050eda640 10 monclient(hunting): authenticate will time out at 1727.854483s 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff04c13b760 0x7ff04c131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57508/0 (socket says 10.20.193.51:57508) 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 -- 10.20.193.51:0/3347269481 learned_addr learned my addr 10.20.193.51:0/3347269481 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): get_auth_request con 0x7ff04c0a3bb0 auth_method 0 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): get_auth_request con 0x7ff04c13b760 auth_method 0 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff04ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient(hunting): handle_auth_done global_id 234131 payload 824 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff04c0a0750 msgr2=0x7ff04c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff04c0a0750 0x7ff04c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff04c13b760 msgr2=0x7ff04c131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff04c13b760 0x7ff04c131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 monclient: found mon.noname-c 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.235+0000 7ff049d74640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c133190 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff049d74640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 msgr2=0x7ff04c131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff049d74640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff034009820 tx=0x7ff0340047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034046070 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: dump: 2026-02-17T12:04:00.251 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff034041870 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff050eda640 5 monclient: authenticate success, global_id 234131 2026-02-17T12:04:00.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03403c040 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff050eda640 10 monclient: _renew_subs 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff048d72640 4 set_mon_vals no callback set 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff050eda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c09d7b0 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.237+0000 7ff032ffd640 10 monclient: dump: 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.253 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 10 monclient: _renew_subs 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c134a50 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 0x7ff04c12da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c09dac0 con 0x7ff04c12d690 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 0x7ff04c12da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient: get_auth_request con 0x7ff04c12d690 auth_method 0 2026-02-17T12:04:00.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff034041c60 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 10 monclient(hunting): handle_auth_done global_id 234134 payload 824 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff04a575640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff04c134590 con 0x7ff04c12d690 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.238+0000 7ff032ffd640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff01803dd90 0x7ff018040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.239+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(689..689 src has 323..689) ==== 4779+0+0 (secure 0 0 0) 0x7ff034077e20 con 0x7ff04c0a3bb0 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.239+0000 7ff04ad76640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff01803dd90 0x7ff018040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.239+0000 7ff04ad76640 10 monclient: get_auth_request con 0x7ff01803dd90 auth_method 0 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff04a575640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 msgr2=0x7ff04c12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff04a575640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 0x7ff04c12da70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff04000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040011a80 con 0x7ff04c12d690 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 10 monclient: dump: 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff040017070 con 0x7ff04c12d690 2026-02-17T12:04:00.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 msgr2=0x7ff04c12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 0x7ff04c12da70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff04000c860 comp rx=0 tx=0).stop 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 msgr2=0x7ff04c12da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff032ffd640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12d690 0x7ff04c12da70 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff04000c860 comp rx=0 tx=0).stop 2026-02-17T12:04:00.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.241+0000 7ff04ad76640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff01803dd90 0x7ff018040250 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0055f0 tx=0x7ff03c005580 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff050eda640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff050eda640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 0x7ff04c1d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff050eda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c133770 con 0x7ff04c12dfb0 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 0x7ff04c1d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient: get_auth_request con 0x7ff04c12dfb0 auth_method 0 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 10 monclient(hunting): handle_auth_done global_id 234137 payload 824 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.244+0000 7ff04a575640 1 -- 10.20.193.51:0/3347269481 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff04c0008d0 con 0x7ff04c12dfb0 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff04a575640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 msgr2=0x7ff04c1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff04a575640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 0x7ff04c1d98b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff040003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04001caf0 con 0x7ff04c12dfb0 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 10 monclient: dump: 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7ff04001caf0 con 0x7ff04c12dfb0 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 msgr2=0x7ff04c1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 0x7ff04c1d98b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff040003860 comp rx=0 tx=0).stop 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 msgr2=0x7ff04c1d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.246+0000 7ff032ffd640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c12dfb0 0x7ff04c1d98b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c390 tx=0x7ff040003860 comp rx=0 tx=0).stop 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 17241, 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:00.262 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.263 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.264 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:00.265 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:00.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.267 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.268 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.269 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.271 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.272 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:00.273 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:00.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff01803dd90 msgr2=0x7ff018040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff01803dd90 0x7ff018040250 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0055f0 tx=0x7ff03c005580 comp rx=0 tx=0).stop 2026-02-17T12:04:00.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 10 monclient: shutdown 2026-02-17T12:04:00.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 msgr2=0x7ff04c131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff034009820 tx=0x7ff0340047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff04ad76640 1 -- 10.20.193.51:0/3347269481 reap_dead start 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 shutdown_connections 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 --2- 10.20.193.51:0/3347269481 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff04c0a3bb0 0x7ff04c131670 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 >> 10.20.193.51:0/3347269481 conn(0x7ff04c0a30c0 msgr2=0x7ff04c13a520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 shutdown_connections 2026-02-17T12:04:00.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.247+0000 7ff050eda640 1 -- 10.20.193.51:0/3347269481 wait complete. 2026-02-17T12:04:00.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:00.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:04:00.277 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:04:00.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=9,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3492980404,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=1043206690,osd_snap=2123263683}) 2026-02-17T12:04:00.277 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=79} crc {mon_config_key=4019974976,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1043206690,osd_snap=3824357456}) 2026-02-17T12:04:00.278 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.278 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=9,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3492980404,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=1043206690,osd_snap=2123263683}) 2026-02-17T12:04:00.278 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.271+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=80} crc {mon_config_key=4019974976,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=1043206690,osd_snap=433816416}) 2026-02-17T12:04:00.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.342+0000 7f717c8bf640 10 monclient: get_monmap_and_config 2026-02-17T12:04:00.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.342+0000 7f717c8bf640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.342+0000 7f717c8bf640 10 monclient: monmap: 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:00.343894+0000 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:00.343894+0000 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:00.345 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 Processor -- start 2026-02-17T12:04:00.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 -- start start 2026-02-17T12:04:00.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient: init 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71740a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f71740a0750 0x7f717409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-c con 0x7f71740a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f717413b760 0x7f717413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-a con 0x7f717413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717406e140 con 0x7f71740a3bb0 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f717409f910 con 0x7f717413b760 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f717409ccd0 con 0x7f71740a0750 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.343+0000 7f717c8bf640 10 monclient(hunting): authenticate will time out at 1727.962980s 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717a634640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f71740a3bb0 0x7f717409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53852/0 (socket says 10.20.193.51:53852) 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717a634640 1 -- 10.20.193.51:0/2954562502 learned_addr learned my addr 10.20.193.51:0/2954562502 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 --2- 10.20.193.51:0/2954562502 >> v2:10.20.193.51:3300/0 conn(0x7f717413b760 0x7f717413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): get_auth_request con 0x7f717413b760 auth_method 0 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 1 --2- 10.20.193.51:0/2954562502 >> v2:10.20.193.142:3300/0 conn(0x7f71740a0750 0x7f717409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): get_auth_request con 0x7f71740a0750 auth_method 0 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient(hunting): handle_auth_done global_id 204483 payload 274 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 -- 10.20.193.51:0/2954562502 >> v2:10.20.193.142:3300/0 conn(0x7f71740a0750 msgr2=0x7f717409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 --2- 10.20.193.51:0/2954562502 >> v2:10.20.193.142:3300/0 conn(0x7f71740a0750 0x7f717409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 -- 10.20.193.51:0/2954562502 >> v1:10.20.193.51:6789/0 conn(0x7f71740a3bb0 legacy=0x7f717409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 monclient: found mon.noname-a 2026-02-17T12:04:00.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.344+0000 7f717ae35640 1 -- 10.20.193.51:0/2954562502 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717409eec0 con 0x7f717413b760 2026-02-17T12:04:00.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717ae35640 1 -- 10.20.193.51:0/2954562502 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 msgr2=0x7f717413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717ae35640 1 --2- 10.20.193.51:0/2954562502 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413db50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f717406f3c0 tx=0x7f716802f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7f1fe84017cbd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 1 -- 10.20.193.51:0/2954562502 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716803c070 con 0x7f717413b760 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: dump: 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.355 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 1 -- 10.20.193.51:0/2954562502 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7168037440 con 0x7f717413b760 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717c8bf640 5 monclient: authenticate success, global_id 204483 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717c8bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 1 -- 10.20.193.51:0/2954562502 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168037810 con 0x7f717413b760 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717c8bf640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f717c8bf640 4 set_mon_vals no callback set 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.346+0000 7f7179632640 10 monclient: dump: 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.356 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 10 monclient: shutdown 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- 10.20.193.51:0/2954562502 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 msgr2=0x7f717413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 --2- 10.20.193.51:0/2954562502 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413db50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f717406f3c0 tx=0x7f716802f130 comp rx=0 tx=0).stop 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- 10.20.193.51:0/2954562502 shutdown_connections 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 --2- 10.20.193.51:0/2954562502 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413db50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 --2- 10.20.193.51:0/2954562502 >> v2:10.20.193.142:3300/0 conn(0x7f71740a0750 0x7f717409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- 10.20.193.51:0/2954562502 >> 10.20.193.51:0/2954562502 conn(0x7f71740a30c0 msgr2=0x7f71740a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- 10.20.193.51:0/2954562502 shutdown_connections 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- 10.20.193.51:0/2954562502 wait complete. 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 10 monclient: monmap: 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.357 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 Processor -- start 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 1 -- start start 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.347+0000 7f717c8bf640 10 monclient: init 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a0750 0x7f717409b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-b con 0x7f71740a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71740a3bb0 0x7f717413abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-c con 0x7f71740a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): picked mon.noname-a con 0x7f717413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71740a04b0 con 0x7f717413b760 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f717409c850 con 0x7f71740a0750 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f717409e710 con 0x7f71740a3bb0 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717c8bf640 10 monclient(hunting): authenticate will time out at 1727.967136s 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71740a3bb0 0x7f717413abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35546/0 (socket says 10.20.193.51:35546) 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 learned_addr learned my addr 10.20.193.51:0/3678683049 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): get_auth_request con 0x7f717413b760 auth_method 0 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): get_auth_request con 0x7f71740a3bb0 auth_method 0 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a0750 0x7f717409b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 10 monclient(hunting): get_auth_request con 0x7f71740a0750 auth_method 0 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f7179e33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient(hunting): handle_auth_done global_id 204486 payload 824 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71740a3bb0 msgr2=0x7f717413abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71740a3bb0 0x7f717413abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a0750 msgr2=0x7f717409b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a0750 0x7f717409b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 monclient: found mon.noname-a 2026-02-17T12:04:00.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717409ae20 con 0x7f717413b760 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.348+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a0750 0x7f717409b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 msgr2=0x7f717413b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717ae35640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413b0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716803a040 tx=0x7f7168004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716803c050 con 0x7f717413b760 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: dump: 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.361 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 5 monclient: authenticate success, global_id 204486 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7168048070 con 0x7f717413b760 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168041a50 con 0x7f717413b760 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 10 monclient: _renew_subs 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717409b100 con 0x7f717413b760 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f7178e31640 4 set_mon_vals no callback set 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f715effd640 10 monclient: dump: 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.362 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 10 monclient: _renew_subs 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.350+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71740a2450 con 0x7f717413b760 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717c8bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717c8bf640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 0x7f71740972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f717409d7b0 con 0x7f71740a2b20 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7168041bf0 con 0x7f717413b760 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 0x7f71740972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient: get_auth_request con 0x7f71740a2b20 auth_method 0 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f715effd640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f714403dd60 0x7f7144040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(689..689 src has 323..689) ==== 4779+0+0 (secure 0 0 0) 0x7f7168077ee0 con 0x7f717413b760 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f7179e33640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f714403dd60 0x7f7144040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f7179e33640 10 monclient: get_auth_request con 0x7f714403dd60 auth_method 0 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 10 monclient(hunting): handle_auth_done global_id 184516 payload 824 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.351+0000 7f717a634640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f717409dac0 con 0x7f71740a2b20 2026-02-17T12:04:00.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f717a634640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 msgr2=0x7f71740972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.365 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 0x7f71740972c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f716c00e730 tx=0x7f716c00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.365 INFO:tasks.rados.rados.0.trial142.stdout:2996: done (0 left) 2026-02-17T12:04:00.365 INFO:tasks.rados.rados.0.trial142.stdout:2997: write oid 25 current snap is 333 2026-02-17T12:04:00.365 INFO:tasks.rados.rados.0.trial142.stdout:2997: seq_num 1027 ranges {460789=588378,1764066=739029,3219296=41493} 2026-02-17T12:04:00.365 INFO:tasks.rados.rados.0.trial142.stdout:2997: writing trial14245205-25 from 460789 to 1049167 tid 1 2026-02-17T12:04:00.365 INFO:tasks.rados.rados.0.trial142.stdout:2997: writing trial14245205-25 from 1764066 to 2503095 tid 2 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=1601801054,osdmap=508260090}) 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=469811755,osdmap=2052426845}) 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=1601801054,osdmap=508260090}) 2026-02-17T12:04:00.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.354+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=2826502813,osdmap=231726998}) 2026-02-17T12:04:00.367 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c005df0 con 0x7f71740a2b20 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 10 monclient: dump: 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f7179e33640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f714403dd60 0x7f7144040220 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7160009c40 tx=0x7f7160009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f716c018070 con 0x7f71740a2b20 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:00.368 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 msgr2=0x7f71740972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 0x7f71740972c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f716c00e730 tx=0x7f716c00ec00 comp rx=0 tx=0).stop 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 msgr2=0x7f71740972c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.354+0000 7f715effd640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71740a2b20 0x7f71740972c0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f716c00e730 tx=0x7f716c00ec00 comp rx=0 tx=0).stop 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717c8bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717c8bf640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 0x7f71741da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f717406fe50 con 0x7f7174097800 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 0x7f71741da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient: get_auth_request con 0x7f7174097800 auth_method 0 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.357+0000 7f717a634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.358+0000 7f717a634640 10 monclient(hunting): handle_auth_done global_id 184519 payload 824 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.358+0000 7f717a634640 1 -- 10.20.193.51:0/3678683049 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71740008d0 con 0x7f7174097800 2026-02-17T12:04:00.369 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f717a634640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 msgr2=0x7f71741da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f717a634640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 0x7f71741da8c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f716c017000 tx=0x7f716c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c00cb40 con 0x7f7174097800 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 10 monclient: dump: 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f716c01ee50 con 0x7f7174097800 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:00.370 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 msgr2=0x7f71741da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 0x7f71741da8c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f716c017000 tx=0x7f716c004a40 comp rx=0 tx=0).stop 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 msgr2=0x7f71741da8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.360+0000 7f715effd640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7174097800 0x7f71741da8c0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f716c017000 tx=0x7f716c004a40 comp rx=0 tx=0).stop 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 172, 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 272747, 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:00.371 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.372 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:00.373 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:00.374 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:00.375 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:00.376 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.377 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:00.378 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.379 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:00.380 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f714403dd60 msgr2=0x7f7144040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f714403dd60 0x7f7144040220 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7160009c40 tx=0x7f7160009290 comp rx=0 tx=0).stop 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 10 monclient: shutdown 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 msgr2=0x7f717413b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 --2- 10.20.193.51:0/3678683049 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f717413b760 0x7f717413b0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716803a040 tx=0x7f7168004b40 comp rx=0 tx=0).stop 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 reap_dead start 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717ae35640 1 -- 10.20.193.51:0/3678683049 reap_dead start 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 shutdown_connections 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 >> 10.20.193.51:0/3678683049 conn(0x7f71740a30c0 msgr2=0x7f7174072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 shutdown_connections 2026-02-17T12:04:00.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.361+0000 7f717c8bf640 1 -- 10.20.193.51:0/3678683049 wait complete. 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3829972929}) 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4244906039}) 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3829972929}) 2026-02-17T12:04:00.382 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:00.366+0000 7fc5b6794640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3842544004}) 2026-02-17T12:04:00.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:00.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T12:04:00.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:04:00.383 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T12:04:00.383 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:04:00.384 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:04:00.384 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:04:00.384 INFO:tasks.rados.rados.0.trial142.stdout:2997: writing trial14245205-25 from 3219296 to 3260789 tid 3 2026-02-17T12:04:00.384 INFO:tasks.rados.rados.0.trial142.stdout:2998: snap_remove snap 316 2026-02-17T12:04:00.394 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:04:00.394 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:04:00.395 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.499+0000 7f222393e640 10 monclient: get_monmap_and_config 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.499+0000 7f222393e640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.499+0000 7f222393e640 10 monclient: monmap: 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:00.500806+0000 2026-02-17T12:04:00.501 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:00.500806+0000 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:00.502 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 Processor -- start 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 -- start start 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient: init 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f221c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): picked mon.noname-b con 0x7f221c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f221c13b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221c06e140 con 0x7f221c0a3bb0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221c09f910 con 0x7f221c13b760 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f221c09ccd0 con 0x7f221c0a0750 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f22216b3640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f221c0a3bb0 legacy=0x7f221c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f222393e640 10 monclient(hunting): authenticate will time out at 1728.119579s 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57556/0 (socket says 10.20.193.51:57556) 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 -- 10.20.193.51:0/1279160737 learned_addr learned my addr 10.20.193.51:0/1279160737 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): get_auth_request con 0x7f221c0a0750 auth_method 0 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient(hunting): handle_auth_done global_id 234143 payload 274 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 -- 10.20.193.51:0/1279160737 >> v1:10.20.193.142:6789/0 conn(0x7f221c13b760 legacy=0x7f221c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 -- 10.20.193.51:0/1279160737 >> v1:10.20.193.51:6789/0 conn(0x7f221c0a3bb0 legacy=0x7f221c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 monclient: found mon.noname-b 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.500+0000 7f2220eb2640 1 -- 10.20.193.51:0/1279160737 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c09eec0 con 0x7f221c0a0750 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f2220eb2640 1 -- 10.20.193.51:0/1279160737 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 msgr2=0x7f221c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f2220eb2640 1 --2- 10.20.193.51:0/1279160737 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f221c09f230 tx=0x7f221002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25da8069c0e2975 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 1 -- 10.20.193.51:0/1279160737 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221003c070 con 0x7f221c0a0750 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: dump: 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 1 -- 10.20.193.51:0/1279160737 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221002fdd0 con 0x7f221c0a0750 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 5 monclient: authenticate success, global_id 234143 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 1 -- 10.20.193.51:0/1279160737 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210037660 con 0x7f221c0a0750 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 4 set_mon_vals no callback set 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f220bfff640 10 monclient: dump: 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 10 monclient: shutdown 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 -- 10.20.193.51:0/1279160737 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 msgr2=0x7f221c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 --2- 10.20.193.51:0/1279160737 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f221c09f230 tx=0x7f221002eeb0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 -- 10.20.193.51:0/1279160737 shutdown_connections 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 --2- 10.20.193.51:0/1279160737 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c09e1d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 -- 10.20.193.51:0/1279160737 >> 10.20.193.51:0/1279160737 conn(0x7f221c0a30c0 msgr2=0x7f221c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 -- 10.20.193.51:0/1279160737 shutdown_connections 2026-02-17T12:04:00.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.503+0000 7f222393e640 1 -- 10.20.193.51:0/1279160737 wait complete. 2026-02-17T12:04:00.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient: build_initial_monmap 2026-02-17T12:04:00.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient: monmap: 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 Processor -- start 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 -- start start 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient: init 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): picked mon.noname-c con 0x7f221c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 0x7f221c0919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): picked mon.noname-a con 0x7f221c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f221c13b760 0x7f221c091ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): picked mon.noname-b con 0x7f221c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f221c0a04b0 con 0x7f221c0a3bb0 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f221c09c850 con 0x7f221c13b760 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f221c09e710 con 0x7f221c0a0750 2026-02-17T12:04:00.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f222393e640 10 monclient(hunting): authenticate will time out at 1728.123781s 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2220eb2640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 msgr2=0x7f221c0919b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2220eb2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 0x7f221c0919b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57564/0 (socket says 10.20.193.51:57564) 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 -- 10.20.193.51:0/1043765809 learned_addr learned my addr 10.20.193.51:0/1043765809 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): get_auth_request con 0x7f221c0a0750 auth_method 0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2221eb4640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f221c13b760 0x7f221c091ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2221eb4640 10 monclient(hunting): get_auth_request con 0x7f221c13b760 auth_method 0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2221eb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2221eb4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f2221eb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient(hunting): handle_auth_done global_id 234146 payload 824 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 -- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f221c13b760 msgr2=0x7f221c091ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f221c13b760 0x7f221c091ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 -- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 msgr2=0x7f221c0919b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 0x7f221c0919b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient: _finish_hunting 0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 monclient: found mon.noname-c 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.504+0000 7f22216b3640 1 -- 10.20.193.51:0/1043765809 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c0940f0 con 0x7f221c0a0750 2026-02-17T12:04:00.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f22216b3640 1 -- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 msgr2=0x7f221c099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f22216b3640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f220c00b780 tx=0x7f220c00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c005270 con 0x7f221c0a0750 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: dump: 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c010070 con 0x7f221c0a0750 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c005650 con 0x7f221c0a0750 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 10 monclient: dump: 2026-02-17T12:04:00.511 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f220b7fe640 4 set_mon_vals no callback set 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 5 monclient: authenticate success, global_id 234146 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _renew_subs 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221c0955a0 con 0x7f221c0a0750 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _renew_subs 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f221c0952c0 con 0x7f221c0a0750 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f220c01d070 con 0x7f221c0a0750 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.507+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221c09dac0 con 0x7f221c0a0750 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.508+0000 7f2209ffb640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 0x7f21ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.508+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(690..690 src has 323..690) ==== 4751+0+0 (secure 0 0 0) 0x7f220c051fd0 con 0x7f221c0a0750 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.508+0000 7f2220eb2640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 0x7f21ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:00.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.508+0000 7f2220eb2640 10 monclient: get_auth_request con 0x7f21ec03dd10 auth_method 0 2026-02-17T12:04:00.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.510+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f220c01a060 con 0x7f221c0a0750 2026-02-17T12:04:00.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.510+0000 7f2209ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:00.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.510+0000 7f2209ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:00.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.510+0000 7f2220eb2640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 0x7f21ec0401d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.625+0000 7f222393e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.625+0000 7f222393e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.625+0000 7f222393e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.625+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f221c0939d0 con 0x7f221c0a0750 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f2209ffb640 1 -- 10.20.193.51:0/1043765809 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f220c0509f0 con 0x7f221c0a0750 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f2209ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:00.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f2209ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:00.629 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:00.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 msgr2=0x7f21ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 0x7f21ec0401d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210033000 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 10 monclient: shutdown 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 msgr2=0x7f221c099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f220c00b780 tx=0x7f220c00bc50 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 shutdown_connections 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21ec03dd10 0x7f21ec0401d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f221c13b760 0x7f221c091ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f221c0a3bb0 0x7f221c0919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 --2- 10.20.193.51:0/1043765809 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f221c0a0750 0x7f221c099ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 >> 10.20.193.51:0/1043765809 conn(0x7f221c0a30c0 msgr2=0x7f221c13ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 shutdown_connections 2026-02-17T12:04:00.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:00.626+0000 7f222393e640 1 -- 10.20.193.51:0/1043765809 wait complete. 2026-02-17T12:04:03.637 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:03.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: get_monmap_and_config 2026-02-17T12:04:03.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: build_initial_monmap 2026-02-17T12:04:03.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: monmap: 2026-02-17T12:04:03.709 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:03.709 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:03.706098+0000 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:03.706098+0000 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 Processor -- start 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 -- start start 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: init 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8c400a3bb0 0x7f8c4009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-c con 0x7f8c400a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8c4009dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 0x7f8c4013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-a con 0x7f8c400a0110 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4006e140 con 0x7f8c4009dac0 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4009aed0 con 0x7f8c400a0110 2026-02-17T12:04:03.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4009caa0 con 0x7f8c400a3bb0 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c463cc640 10 monclient(hunting): authenticate will time out at 1731.324851s 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c44942640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 msgr2=0x7f8c4013c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c3f7fe640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f8c4009dac0 legacy=0x7f8c4009fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.705+0000 7f8c44942640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 0x7f8c4013c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8c400a3bb0 0x7f8c4009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8c400a3bb0 0x7f8c4009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:33140/0 (socket says 10.20.193.51:33140) 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 -- 10.20.193.51:0/1853837409 learned_addr learned my addr 10.20.193.51:0/1853837409 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): get_auth_request con 0x7f8c400a3bb0 auth_method 0 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:03.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient(hunting): handle_auth_done global_id 184525 payload 274 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 -- 10.20.193.51:0/1853837409 >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 msgr2=0x7f8c4013c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 --2- 10.20.193.51:0/1853837409 >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 0x7f8c4013c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 -- 10.20.193.51:0/1853837409 >> v1:10.20.193.51:6789/0 conn(0x7f8c4009dac0 legacy=0x7f8c4009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 monclient: found mon.noname-c 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:04:03.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.706+0000 7f8c3ffff640 1 -- 10.20.193.51:0/1853837409 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4009ce60 con 0x7f8c400a3bb0 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3ffff640 1 -- 10.20.193.51:0/1853837409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 msgr2=0x7f8c4009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3ffff640 1 --2- 10.20.193.51:0/1853837409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4009f4c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c4009cc20 tx=0x7f8c2c02ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73337c42a5a7569 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 1 -- 10.20.193.51:0/1853837409 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c03c070 con 0x7f8c400a3bb0 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: dump: 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:03.720 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: _finish_auth 0 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:03.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 5 monclient: authenticate success, global_id 184525 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 1 -- 10.20.193.51:0/1853837409 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c02fd90 con 0x7f8c400a3bb0 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 1 -- 10.20.193.51:0/1853837409 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c037660 con 0x7f8c400a3bb0 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 4 set_mon_vals no callback set 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c3effd640 10 monclient: dump: 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:03.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 10 monclient: shutdown 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 -- 10.20.193.51:0/1853837409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 msgr2=0x7f8c4009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:03.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 --2- 10.20.193.51:0/1853837409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4009f4c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c4009cc20 tx=0x7f8c2c02ee30 comp rx=0 tx=0).stop 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 -- 10.20.193.51:0/1853837409 shutdown_connections 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 --2- 10.20.193.51:0/1853837409 >> v2:10.20.193.51:3300/0 conn(0x7f8c400a0110 0x7f8c4013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 --2- 10.20.193.51:0/1853837409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4009f4c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 -- 10.20.193.51:0/1853837409 >> 10.20.193.51:0/1853837409 conn(0x7f8c400a30c0 msgr2=0x7f8c400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 -- 10.20.193.51:0/1853837409 shutdown_connections 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.709+0000 7f8c463cc640 1 -- 10.20.193.51:0/1853837409 wait complete. 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient: build_initial_monmap 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient: monmap: 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 Processor -- start 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 -- start start 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient: init 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:03.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 0x7f8c4013acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-a con 0x7f8c4009dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-c con 0x7f8c400a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4013b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): picked mon.noname-b con 0x7f8c400a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400a0540 con 0x7f8c4009dac0 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4009a880 con 0x7f8c400a3bb0 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4013cca0 con 0x7f8c400a0110 2026-02-17T12:04:03.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c463cc640 10 monclient(hunting): authenticate will time out at 1731.329828s 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3ffff640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 msgr2=0x7f8c4013acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 0x7f8c4013acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57566/0 (socket says 10.20.193.51:57566) 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 1 -- 10.20.193.51:0/2986227970 learned_addr learned my addr 10.20.193.51:0/2986227970 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): get_auth_request con 0x7f8c400a0110 auth_method 0 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:03.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.710+0000 7f8c44942640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c44942640 10 monclient(hunting): get_auth_request con 0x7f8c400a3bb0 auth_method 0 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c44942640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c44942640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c44942640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 10 monclient(hunting): handle_auth_done global_id 234149 payload 824 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 -- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 msgr2=0x7f8c4013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 -- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 msgr2=0x7f8c4013acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 0x7f8c4013acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 monclient: found mon.noname-c 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.711+0000 7f8c3f7fe640 1 -- 10.20.193.51:0/2986227970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4013dd60 con 0x7f8c400a0110 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3f7fe640 1 -- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 msgr2=0x7f8c4013b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3f7fe640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b7b0 tx=0x7f8c3000bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30005270 con 0x7f8c400a0110 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: dump: 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:03.729 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: _finish_auth 0 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:03.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c30010070 con 0x7f8c400a0110 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 5 monclient: authenticate success, global_id 234149 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _renew_subs 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4013f830 con 0x7f8c400a0110 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30005650 con 0x7f8c400a0110 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3cff9640 10 monclient: dump: 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:03.731 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:03.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c3e7fc640 4 set_mon_vals no callback set 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _renew_subs 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4013f550 con 0x7f8c400a0110 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.713+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4013d0f0 con 0x7f8c400a0110 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.714+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8c3001d030 con 0x7f8c400a0110 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.714+0000 7f8c3cff9640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 0x7f8c10040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.714+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(690..690 src has 323..690) ==== 4751+0+0 (secure 0 0 0) 0x7f8c30051c30 con 0x7f8c400a0110 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.714+0000 7f8c3ffff640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 0x7f8c10040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:03.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.714+0000 7f8c3ffff640 10 monclient: get_auth_request con 0x7f8c1003dcc0 auth_method 0 2026-02-17T12:04:03.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.716+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8c3000cd80 con 0x7f8c400a0110 2026-02-17T12:04:03.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.716+0000 7f8c3cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:03.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.716+0000 7f8c3cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:03.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.717+0000 7f8c3ffff640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 0x7f8c10040180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036000 tx=0x7f8c2c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c463cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c463cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c463cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8c4013e1e0 con 0x7f8c400a0110 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c3cff9640 1 -- 10.20.193.51:0/2986227970 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f8c30005830 con 0x7f8c400a0110 2026-02-17T12:04:03.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c3cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:03.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.829+0000 7f8c3cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:03.833 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:03.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 msgr2=0x7f8c10040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:03.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 0x7f8c10040180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036000 tx=0x7f8c2c033000 comp rx=0 tx=0).stop 2026-02-17T12:04:03.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 10 monclient: shutdown 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 msgr2=0x7f8c4013b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b7b0 tx=0x7f8c3000bc80 comp rx=0 tx=0).stop 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 shutdown_connections 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8c1003dcc0 0x7f8c10040180 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8c400a3bb0 0x7f8c4013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8c400a0110 0x7f8c4013b210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 --2- 10.20.193.51:0/2986227970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8c4009dac0 0x7f8c4013acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 >> 10.20.193.51:0/2986227970 conn(0x7f8c400a30c0 msgr2=0x7f8c400a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 shutdown_connections 2026-02-17T12:04:03.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:03.830+0000 7f8c463cc640 1 -- 10.20.193.51:0/2986227970 wait complete. 2026-02-17T12:04:06.842 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: get_monmap_and_config 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: build_initial_monmap 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: monmap: 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:06.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:06.912091+0000 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:06.912091+0000 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:06.914 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 Processor -- start 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 -- start start 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: init 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4fdc0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-b con 0x7f4fdc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:06.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4fdc13b760 0x7f4fdc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-c con 0x7f4fdc13b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fdc06e140 con 0x7f4fdc0a3bb0 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc09f910 con 0x7f4fdc13b760 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc09ccd0 con 0x7f4fdc0a0750 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fe1643640 10 monclient(hunting): authenticate will time out at 1734.530908s 2026-02-17T12:04:06.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fdaffd640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f4fdc0a3bb0 legacy=0x7f4fdc09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.911+0000 7f4fda7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33670/0 (socket says 10.20.193.51:33670) 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 -- 10.20.193.51:0/1276608034 learned_addr learned my addr 10.20.193.51:0/1276608034 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): get_auth_request con 0x7f4fdc0a0750 auth_method 0 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fdb7fe640 1 --2- 10.20.193.51:0/1276608034 >> v2:10.20.193.142:3300/0 conn(0x7f4fdc13b760 0x7f4fdc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:06.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fdb7fe640 10 monclient(hunting): get_auth_request con 0x7f4fdc13b760 auth_method 0 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fdb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient(hunting): handle_auth_done global_id 234152 payload 274 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 -- 10.20.193.51:0/1276608034 >> v2:10.20.193.142:3300/0 conn(0x7f4fdc13b760 msgr2=0x7f4fdc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 --2- 10.20.193.51:0/1276608034 >> v2:10.20.193.142:3300/0 conn(0x7f4fdc13b760 0x7f4fdc13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 -- 10.20.193.51:0/1276608034 >> v1:10.20.193.51:6789/0 conn(0x7f4fdc0a3bb0 legacy=0x7f4fdc09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 monclient: found mon.noname-b 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:06.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.912+0000 7f4fda7fc640 1 -- 10.20.193.51:0/1276608034 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc09eec0 con 0x7f4fdc0a0750 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fda7fc640 1 -- 10.20.193.51:0/1276608034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 msgr2=0x7f4fdc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fda7fc640 1 --2- 10.20.193.51:0/1276608034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc09f230 tx=0x7f4fc402ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39088e125d2d46a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 1 -- 10.20.193.51:0/1276608034 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc403c070 con 0x7f4fdc0a0750 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: dump: 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:06.929 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 1 -- 10.20.193.51:0/1276608034 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc402fcc0 con 0x7f4fdc0a0750 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fe1643640 5 monclient: authenticate success, global_id 234152 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fe1643640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:06.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 1 -- 10.20.193.51:0/1276608034 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4037660 con 0x7f4fdc0a0750 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fd9ffb640 10 monclient: dump: 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:06.931 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fe1643640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.914+0000 7f4fe1643640 4 set_mon_vals no callback set 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 10 monclient: shutdown 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- 10.20.193.51:0/1276608034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 msgr2=0x7f4fdc09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:06.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1276608034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc09f230 tx=0x7f4fc402ee80 comp rx=0 tx=0).stop 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- 10.20.193.51:0/1276608034 shutdown_connections 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1276608034 >> v2:10.20.193.142:3300/0 conn(0x7f4fdc13b760 0x7f4fdc13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1276608034 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc0a0750 0x7f4fdc09e1d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- 10.20.193.51:0/1276608034 >> 10.20.193.51:0/1276608034 conn(0x7f4fdc0a30c0 msgr2=0x7f4fdc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- 10.20.193.51:0/1276608034 shutdown_connections 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- 10.20.193.51:0/1276608034 wait complete. 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 10 monclient: build_initial_monmap 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 10 monclient: monmap: 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:06.933 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 Processor -- start 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 1 -- start start 2026-02-17T12:04:06.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.915+0000 7f4fe1643640 10 monclient: init 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 0x7f4fdc1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-a con 0x7f4fdc0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fdc0a3bb0 0x7f4fdc1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-b con 0x7f4fdc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): picked mon.noname-c con 0x7f4fdc13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0a04b0 con 0x7f4fdc0a0750 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc09c850 con 0x7f4fdc0a3bb0 2026-02-17T12:04:06.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc09e710 con 0x7f4fdc13b760 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdaffd640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 msgr2=0x7f4fdc1cfad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fe1643640 10 monclient(hunting): authenticate will time out at 1734.535108s 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 0x7f4fdc1cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33682/0 (socket says 10.20.193.51:33682) 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 -- 10.20.193.51:0/1198512085 learned_addr learned my addr 10.20.193.51:0/1198512085 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): get_auth_request con 0x7f4fdc13b760 auth_method 0 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:06.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fda7fc640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fdc0a3bb0 0x7f4fdc1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fda7fc640 10 monclient(hunting): get_auth_request con 0x7f4fdc0a3bb0 auth_method 0 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fda7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient(hunting): handle_auth_done global_id 234155 payload 824 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 -- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fdc0a3bb0 msgr2=0x7f4fdc1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fdc0a3bb0 0x7f4fdc1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:06.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 -- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 msgr2=0x7f4fdc1cfad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 0x7f4fdc1cfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 monclient: found mon.noname-c 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.916+0000 7f4fdb7fe640 1 -- 10.20.193.51:0/1198512085 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc09d7b0 con 0x7f4fdc13b760 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fdb7fe640 1 -- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 msgr2=0x7f4fdc096200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fdb7fe640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007dc0 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:06.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014620 con 0x7f4fdc13b760 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: dump: 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:06.939 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc019070 con 0x7f4fdc13b760 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014a00 con 0x7f4fdc13b760 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 5 monclient: authenticate success, global_id 234155 2026-02-17T12:04:06.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fd97fa640 4 set_mon_vals no callback set 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 10 monclient: _renew_subs 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc0a2ab0 con 0x7f4fdc13b760 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fbb7fe640 10 monclient: dump: 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:06.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 10 monclient: _renew_subs 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.918+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc0996b0 con 0x7f4fdc13b760 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fe1643640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:06.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fe1643640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fe1643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc09dac0 con 0x7f4fdc13b760 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4fcc014ba0 con 0x7f4fdc13b760 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fbb7fe640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 0x7f4fa8040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(690..690 src has 323..690) ==== 4751+0+0 (secure 0 0 0) 0x7f4fcc052d90 con 0x7f4fdc13b760 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fdaffd640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 0x7f4fa8040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.919+0000 7f4fdaffd640 10 monclient: get_auth_request con 0x7f4fa803dd40 auth_method 0 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.921+0000 7f4fdb7fe640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007dc0 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f4fcc057070 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-17T12:04:06.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:06.922+0000 7f4fdaffd640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 0x7f4fa8040200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0003a80 tx=0x7f4fd0009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:07.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.750+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4fcc057070 con 0x7f4fdc13b760 2026-02-17T12:04:07.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.750+0000 7f4fbb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:07.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.750+0000 7f4fbb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fe1643640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:07.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fe1643640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fe1643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4fdc099af0 con 0x7f4fdc13b760 2026-02-17T12:04:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fbb7fe640 1 -- 10.20.193.51:0/1198512085 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f4fdc09d7b0 con 0x7f4fdc13b760 2026-02-17T12:04:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fbb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:07.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.865+0000 7f4fbb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:07.870 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 msgr2=0x7f4fa8040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 0x7f4fa8040200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0003a80 tx=0x7f4fd0009270 comp rx=0 tx=0).stop 2026-02-17T12:04:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 10 monclient: shutdown 2026-02-17T12:04:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:07.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 msgr2=0x7f4fdc096200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007dc0 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 shutdown_connections 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fa803dd40 0x7f4fa8040200 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fdc13b760 0x7f4fdc096200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fdc0a3bb0 0x7f4fdc1d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 --2- 10.20.193.51:0/1198512085 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fdc0a0750 0x7f4fdc1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:07.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 >> 10.20.193.51:0/1198512085 conn(0x7f4fdc0a30c0 msgr2=0x7f4fdc13ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 shutdown_connections 2026-02-17T12:04:07.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:07.866+0000 7f4fe1643640 1 -- 10.20.193.51:0/1198512085 wait complete. 2026-02-17T12:04:10.878 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:10.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.944+0000 7f2d60fa9640 10 monclient: get_monmap_and_config 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.944+0000 7f2d60fa9640 10 monclient: build_initial_monmap 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.944+0000 7f2d60fa9640 10 monclient: monmap: 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:10.945798+0000 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:10.945798+0000 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:10.947 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:10.948 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:10.948 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:10.948 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:10.948 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:10.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 Processor -- start 2026-02-17T12:04:10.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 -- start start 2026-02-17T12:04:10.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient: init 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-a con 0x7f2d5c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d5c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-c con 0x7f2d5c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c06e140 con 0x7f2d5c0a0750 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c09f910 con 0x7f2d5c0a3bb0 2026-02-17T12:04:10.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c09ccd0 con 0x7f2d5c13b760 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d60fa9640 10 monclient(hunting): authenticate will time out at 1738.564607s 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5a575640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5a575640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d59d74640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f2d5c0a0750 legacy=0x7f2d5c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:35452/0 (socket says 10.20.193.51:35452) 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 learned_addr learned my addr 10.20.193.51:0/1313482735 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d5c13b760 auth_method 0 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:10.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:10.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.945+0000 7f2d5ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:10.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.946+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:04:10.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.946+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:10.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.946+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:10.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:10.946+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:11.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.146+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.51:6789/0 conn(0x7f2d5c0a0750 legacy=0x7f2d5c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:11.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.146+0000 7f2d5a575640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:11.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.146+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:11.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:11.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d5c13b760 auth_method 0 2026-02-17T12:04:11.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:11.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:11.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:11.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:11.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:11.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:11.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.147+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:11.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.547+0000 7f2d5a575640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:11.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.547+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.51:6789/0 conn(0x7f2d5c0a0750 legacy=0x7f2d5c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:11.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.547+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:11.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:11.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d5c13b760 auth_method 0 2026-02-17T12:04:11.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:11.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:11.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:11.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:11.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:11.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:11.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:11.548+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.348+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.51:6789/0 conn(0x7f2d5c0a0750 legacy=0x7f2d5c09e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.348+0000 7f2d5a575640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:12.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.348+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d5c13b760 auth_method 0 2026-02-17T12:04:12.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:12.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:12.349+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): tick 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 monclient(hunting): continuing hunt 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 msgr2=0x7f2d5c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.142:3300/0 conn(0x7f2d5c13b760 0x7f2d5c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 -- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:13.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 --2- 10.20.193.51:0/1313482735 >> v2:10.20.193.51:3300/0 conn(0x7f2d5c0a3bb0 0x7f2d5c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.51:6789/0 conn(0x7f2d5c0a0750 legacy=0x7f2d5c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient: _add_conns ranks=[1,2] 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2d38003770 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): picked mon.noname-b con 0x7f2d38007460 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 -- 10.20.193.51:0/1313482735 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c09eec0 con 0x7f2d38003770 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 1 -- 10.20.193.51:0/1313482735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5c09f910 con 0x7f2d38007460 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d43fff640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:13.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d38007460 auth_method 0 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.945+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:13.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:13.948+0000 7f2d5a575640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.142:6789/0 conn(0x7f2d38003770 legacy=0x7f2d38005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:14.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d38007460 auth_method 0 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:14.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.146+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:14.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:14.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d38007460 auth_method 0 2026-02-17T12:04:14.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:14.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:14.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:14.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:14.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:14.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:14.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:14.547+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:15.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d38007460 auth_method 0 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:15.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.348+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300294769 0 0) 0x7f2d5c09eec0 con 0x7f2d38003770 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 10 monclient(hunting): _negotiate 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 10 monclient(hunting): my global_id is 184537 2026-02-17T12:04:15.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.372+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d48003620 con 0x7f2d38003770 2026-02-17T12:04:15.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 720161727 0 0) 0x7f2d48003620 con 0x7f2d38003770 2026-02-17T12:04:15.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 msgr2=0x7f2d38009920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:15.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d38007460 0x7f2d38009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c06e140 con 0x7f2d38003770 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d60fa9640 5 monclient: authenticate success, global_id 184537 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d60fa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:15.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f2d500043a0 con 0x7f2d38003770 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: dump: 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.387 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 >> v1:10.20.193.142:6789/0 conn(0x7f2d38003770 legacy=0x7f2d38005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1313482735 reap_dead start 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d48003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient(hunting): picked mon.a con 0x7f2d48003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 0x7f2d48004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient(hunting): picked mon.c con 0x7f2d48004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48005310 0x7f2d4800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient(hunting): picked mon.b con 0x7f2d48005310 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.373+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c09f910 con 0x7f2d48003ab0 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4800c240 con 0x7f2d48005310 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4800c440 con 0x7f2d48004900 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59573640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d60fa9640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:15.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5a575640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 msgr2=0x7f2d48003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d48003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 0x7f2d48004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d48004900 auth_method 0 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48005310 0x7f2d4800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d48005310 auth_method 0 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d5ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient(hunting): handle_auth_done global_id 184537 payload 293 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48005310 msgr2=0x7f2d4800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48005310 0x7f2d4800bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 msgr2=0x7f2d48003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d48003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 monclient: found mon.c 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d48003620 con 0x7f2d48004900 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.374+0000 7f2d59d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59d74640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 msgr2=0x7f2d48004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 0x7f2d48004d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d44003a80 tx=0x7f2d440340a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d96149eda04ba3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4403a070 con 0x7f2d48004900 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: dump: 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44038070 con 0x7f2d48004900 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d60fa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 1 -- 10.20.193.51:0/1313482735 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44015bc0 con 0x7f2d48004900 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d60fa9640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d60fa9640 4 set_mon_vals no callback set 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.376+0000 7f2d59573640 10 monclient: dump: 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.394 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 10 monclient: shutdown 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 msgr2=0x7f2d48004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 0x7f2d48004d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d44003a80 tx=0x7f2d440340a0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1313482735 shutdown_connections 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48005310 0x7f2d4800bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48004900 0x7f2d48004d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1313482735 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d48003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1313482735 >> 10.20.193.51:0/1313482735 conn(0x7f2d5c0a30c0 msgr2=0x7f2d5c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1313482735 shutdown_connections 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1313482735 wait complete. 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 10 monclient: build_initial_monmap 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.377+0000 7f2d60fa9640 10 monclient: monmap: 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:15.396 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 Processor -- start 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 -- start start 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient: init 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d5c09b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-a con 0x7f2d48003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:15.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48004900 0x7f2d5c0920c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-b con 0x7f2d48004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): picked mon.noname-c con 0x7f2d48005310 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c09dac0 con 0x7f2d48003ab0 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0a04b0 con 0x7f2d48004900 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5c09dc40 con 0x7f2d48005310 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d60fa9640 10 monclient(hunting): authenticate will time out at 1742.997347s 2026-02-17T12:04:15.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5a575640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 msgr2=0x7f2d5c09b7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d5c09b7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42652/0 (socket says 10.20.193.51:42652) 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1108592560 learned_addr learned my addr 10.20.193.51:0/1108592560 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request con 0x7f2d48005310 auth_method 0 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d59d74640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48004900 0x7f2d5c0920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d59d74640 10 monclient(hunting): get_auth_request con 0x7f2d48004900 auth_method 0 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d59d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d59d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d59d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient(hunting): handle_auth_done global_id 234158 payload 824 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48004900 msgr2=0x7f2d5c0920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48004900 0x7f2d5c0920c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 msgr2=0x7f2d5c09b7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d5c09b7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 monclient: found mon.noname-c 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.378+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1108592560 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c0941c0 con 0x7f2d48005310 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d5ad76640 1 -- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 msgr2=0x7f2d5c092600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d5ad76640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c06dab0 tx=0x7f2d4c014d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c01b030 con 0x7f2d48005310 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: dump: 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c012c10 con 0x7f2d48005310 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 5 monclient: authenticate success, global_id 234158 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 10 monclient: _renew_subs 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c096010 con 0x7f2d48005310 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c012dc0 con 0x7f2d48005310 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d58d72640 4 set_mon_vals no callback set 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d42ffd640 10 monclient: dump: 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 10 monclient: _renew_subs 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.380+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c0a2a70 con 0x7f2d48005310 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2d4c017440 con 0x7f2d48005310 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d60fa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d60fa9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d60fa9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c09eec0 con 0x7f2d48005310 2026-02-17T12:04:15.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d42ffd640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 0x7f2d280401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(690..690 src has 323..690) ==== 4751+0+0 (secure 0 0 0) 0x7f2d4c052f90 con 0x7f2d48005310 2026-02-17T12:04:15.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 0x7f2d280401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.381+0000 7f2d5a575640 10 monclient: get_auth_request con 0x7f2d2803dd10 auth_method 0 2026-02-17T12:04:15.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.384+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2d4c0519b0 con 0x7f2d48005310 2026-02-17T12:04:15.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.384+0000 7f2d42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.384+0000 7f2d42ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:15.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.384+0000 7f2d5a575640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 0x7f2d280401d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2d50004550 tx=0x7f2d500041a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.436 INFO:tasks.rados.rados.0.trial142.stdout:2998: done (1 left) 2026-02-17T12:04:15.436 INFO:tasks.rados.rados.0.trial142.stdout:2999: write (excl) oid 43 current snap is 333 2026-02-17T12:04:15.436 INFO:tasks.rados.rados.0.trial142.stdout:2997: finishing write tid 1 to trial14245205-25 2026-02-17T12:04:15.436 INFO:tasks.rados.rados.0.trial142.stdout:2997: finishing write tid 2 to trial14245205-25 2026-02-17T12:04:15.436 INFO:tasks.rados.rados.0.trial142.stdout:2997: finishing write tid 3 to trial14245205-25 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: finishing write tid 4 to trial14245205-25 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: finishing write tid 5 to trial14245205-25 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: oid 25 updating version 0 to 2022 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: oid 25 updating version 2022 to 2023 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: oid 25 version 2023 is already newer than 2021 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: oid 25 version 2023 is already newer than 2020 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2023 (ObjNum 1027 snap 333 seq_num 1027) dirty exists 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2997: left oid 25 (ObjNum 1027 snap 333 seq_num 1027) 2026-02-17T12:04:15.437 INFO:tasks.rados.rados.0.trial142.stdout:2999: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2026-02-17T12:04:15.440 INFO:tasks.rados.rados.0.trial142.stdout:2999: writing trial14245205-43 from 477596 to 1141223 tid 1 2026-02-17T12:04:15.444 INFO:tasks.rados.rados.0.trial142.stdout:2999: writing trial14245205-43 from 1706195 to 2188882 tid 2 2026-02-17T12:04:15.448 INFO:tasks.rados.rados.0.trial142.stdout:2999: writing trial14245205-43 from 2614013 to 3181054 tid 3 2026-02-17T12:04:15.448 INFO:tasks.rados.rados.0.trial142.stdout:2997: done (1 left) 2026-02-17T12:04:15.448 INFO:tasks.rados.rados.0.trial142.stdout:3000: snap_create 2026-02-17T12:04:15.448 INFO:tasks.rados.rados.0.trial142.stdout:2999: finishing write tid 1 to trial14245205-43 2026-02-17T12:04:15.449 INFO:tasks.rados.rados.0.trial142.stdout:2999: finishing write tid 2 to trial14245205-43 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: finishing write tid 3 to trial14245205-43 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: finishing write tid 4 to trial14245205-43 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: finishing write tid 5 to trial14245205-43 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: oid 43 updating version 0 to 2804 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: oid 43 version 2804 is already newer than 2803 2026-02-17T12:04:15.450 INFO:tasks.rados.rados.0.trial142.stdout:2999: oid 43 version 2804 is already newer than 2799 2026-02-17T12:04:15.451 INFO:tasks.rados.rados.0.trial142.stdout:2999: oid 43 version 2804 is already newer than 2802 2026-02-17T12:04:15.451 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2804 (ObjNum 1028 snap 333 seq_num 1028) dirty exists 2026-02-17T12:04:15.451 INFO:tasks.rados.rados.0.trial142.stdout:2999: left oid 43 (ObjNum 1028 snap 333 seq_num 1028) 2026-02-17T12:04:15.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d60fa9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d60fa9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d60fa9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2d5c09d790 con 0x7f2d48005310 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d42ffd640 1 -- 10.20.193.51:0/1108592560 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f2d4c015330 con 0x7f2d48005310 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d42ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.499+0000 7f2d42ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:15.502 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":174,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 msgr2=0x7f2d280401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 0x7f2d280401d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2d50004550 tx=0x7f2d500041a0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 10 monclient: shutdown 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 msgr2=0x7f2d5c092600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c06dab0 tx=0x7f2d4c014d00 comp rx=0 tx=0).stop 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 shutdown_connections 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d2803dd10 0x7f2d280401d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2d48005310 0x7f2d5c092600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2d48004900 0x7f2d5c0920c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 --2- 10.20.193.51:0/1108592560 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2d48003ab0 0x7f2d5c09b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 >> 10.20.193.51:0/1108592560 conn(0x7f2d5c0a30c0 msgr2=0x7f2d5c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 shutdown_connections 2026-02-17T12:04:15.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.500+0000 7f2d60fa9640 1 -- 10.20.193.51:0/1108592560 wait complete. 2026-02-17T12:04:15.511 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:04:15.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:04:15.511 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:04:15.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: get_monmap_and_config 2026-02-17T12:04:15.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: build_initial_monmap 2026-02-17T12:04:15.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: monmap: 2026-02-17T12:04:15.582 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:15.578979+0000 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:15.578979+0000 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:15.583 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 Processor -- start 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 -- start start 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: init 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 0x7f71f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-a con 0x7f71f40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71f40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-b con 0x7f71f413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f406e140 con 0x7f71f40a0750 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f71f409f910 con 0x7f71f40a3bb0 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f409ccd0 con 0x7f71f413b760 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fc785640 10 monclient(hunting): authenticate will time out at 1743.197749s 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fa4fa640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 msgr2=0x7f71f409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71fa4fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 0x7f71f409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71f9cf9640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f71f40a0750 legacy=0x7f71f409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42658/0 (socket says 10.20.193.51:42658) 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 1 -- 10.20.193.51:0/1487411191 learned_addr learned my addr 10.20.193.51:0/1487411191 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): get_auth_request con 0x7f71f413b760 auth_method 0 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.578+0000 7f71facfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 10 monclient(hunting): handle_auth_done global_id 234161 payload 274 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 1 -- 10.20.193.51:0/1487411191 >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 msgr2=0x7f71f409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 1 --2- 10.20.193.51:0/1487411191 >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 0x7f71f409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 1 -- 10.20.193.51:0/1487411191 >> v1:10.20.193.51:6789/0 conn(0x7f71f40a0750 legacy=0x7f71f409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:15.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 1 monclient: found mon.noname-b 2026-02-17T12:04:15.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.579+0000 7f71facfb640 1 -- 10.20.193.51:0/1487411191 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f409eec0 con 0x7f71f413b760 2026-02-17T12:04:15.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71facfb640 1 -- 10.20.193.51:0/1487411191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 msgr2=0x7f71f413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71facfb640 1 --2- 10.20.193.51:0/1487411191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71f406c1c0 tx=0x7f71f002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b30588e194ae23c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 1 -- 10.20.193.51:0/1487411191 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f00373f0 con 0x7f71f413b760 2026-02-17T12:04:15.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: dump: 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.598 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 1 -- 10.20.193.51:0/1487411191 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f0037590 con 0x7f71f413b760 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 1 -- 10.20.193.51:0/1487411191 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0037960 con 0x7f71f413b760 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 5 monclient: authenticate success, global_id 234161 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 4 set_mon_vals no callback set 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71f94f8640 10 monclient: dump: 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 10 monclient: shutdown 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 -- 10.20.193.51:0/1487411191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 msgr2=0x7f71f413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 --2- 10.20.193.51:0/1487411191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71f406c1c0 tx=0x7f71f002f230 comp rx=0 tx=0).stop 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 -- 10.20.193.51:0/1487411191 shutdown_connections 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 --2- 10.20.193.51:0/1487411191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f413b760 0x7f71f413db50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 --2- 10.20.193.51:0/1487411191 >> v2:10.20.193.51:3300/0 conn(0x7f71f40a3bb0 0x7f71f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.581+0000 7f71fc785640 1 -- 10.20.193.51:0/1487411191 >> 10.20.193.51:0/1487411191 conn(0x7f71f40a30c0 msgr2=0x7f71f40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- 10.20.193.51:0/1487411191 shutdown_connections 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- 10.20.193.51:0/1487411191 wait complete. 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient: build_initial_monmap 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient: monmap: 2026-02-17T12:04:15.601 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 Processor -- start 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- start start 2026-02-17T12:04:15.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient: init 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-c con 0x7f71f40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f40a3bb0 0x7f71f4095700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-b con 0x7f71f40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f413b760 0x7f71f4095c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): picked mon.noname-a con 0x7f71f413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40a04b0 con 0x7f71f413b760 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71f409c850 con 0x7f71f40a3bb0 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f409e710 con 0x7f71f40a0750 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fc785640 10 monclient(hunting): authenticate will time out at 1743.201826s 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71facfb640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f413b760 msgr2=0x7f71f4095c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71facfb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f413b760 0x7f71f4095c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42668/0 (socket says 10.20.193.51:42668) 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 1 -- 10.20.193.51:0/3604382031 learned_addr learned my addr 10.20.193.51:0/3604382031 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): get_auth_request con 0x7f71f40a0750 auth_method 0 2026-02-17T12:04:15.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.582+0000 7f71fa4fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 10 monclient(hunting): handle_auth_done global_id 234164 payload 824 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f40a3bb0 msgr2=0x7f71f4095700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71f9cf9640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f40a3bb0 0x7f71f4095700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f71f40a3bb0 0x7f71f4095700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f413b760 msgr2=0x7f71f4095c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71f413b760 0x7f71f4095c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 monclient: found mon.noname-c 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.583+0000 7f71fa4fa640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f4096f80 con 0x7f71f40a0750 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fa4fa640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 msgr2=0x7f71f40951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fa4fa640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b780 tx=0x7f71e400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40052d0 con 0x7f71f40a0750 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: dump: 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e4010070 con 0x7f71f40a0750 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 5 monclient: authenticate success, global_id 234164 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 monclient: _renew_subs 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f40a2c00 con 0x7f71f40a0750 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40056d0 con 0x7f71f40a0750 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f8cf7640 4 set_mon_vals no callback set 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71daffd640 10 monclient: dump: 2026-02-17T12:04:15.608 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 monclient: _renew_subs 2026-02-17T12:04:15.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f4098ac0 con 0x7f71f40a0750 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 0x7f71f408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f409dac0 con 0x7f71f408d3f0 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f9cf9640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 0x7f71f408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f9cf9640 10 monclient: get_auth_request con 0x7f71f408d3f0 auth_method 0 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f9cf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f9cf9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.585+0000 7f71f9cf9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f71e4015470 con 0x7f71f40a0750 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_done global_id 234167 payload 824 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71f9cf9640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71f4069830 con 0x7f71f408d3f0 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71daffd640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c403dcc0 0x7f71c4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(691..691 src has 323..691) ==== 4795+0+0 (secure 0 0 0) 0x7f71e4052080 con 0x7f71f40a0750 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71facfb640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c403dcc0 0x7f71c4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.586+0000 7f71facfb640 10 monclient: get_auth_request con 0x7f71c403dcc0 auth_method 0 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71f9cf9640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 msgr2=0x7f71f408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71f9cf9640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 0x7f71f408d7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c6f0 tx=0x7f71e800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007690 con 0x7f71f408d3f0 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 10 monclient: dump: 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.612 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f71e8016070 con 0x7f71f408d3f0 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 msgr2=0x7f71f408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 0x7f71f408d7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c6f0 tx=0x7f71e800cbc0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 msgr2=0x7f71f408d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.588+0000 7f71daffd640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408d3f0 0x7f71f408d7d0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c6f0 tx=0x7f71e800cbc0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.589+0000 7f71facfb640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c403dcc0 0x7f71c4040180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71f406f3c0 tx=0x7f71f0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71fc785640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71fc785640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 0x7f71f41d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71fc785640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71f4050ac0 con 0x7f71f408dd10 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 0x7f71f41d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient: get_auth_request con 0x7f71f408dd10 auth_method 0 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 10 monclient(hunting): handle_auth_done global_id 234170 payload 824 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.591+0000 7f71f9cf9640 1 -- 10.20.193.51:0/3604382031 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71f4096af0 con 0x7f71f408dd10 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71f9cf9640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 msgr2=0x7f71f41d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71f9cf9640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 0x7f71f41d98b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71e8015000 tx=0x7f71e8005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007d80 con 0x7f71f408dd10 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 10 monclient: dump: 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.615 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7f71e8007d80 con 0x7f71f408dd10 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 msgr2=0x7f71f41d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 0x7f71f41d98b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71e8015000 tx=0x7f71e8005ad0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 msgr2=0x7f71f41d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:15.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71daffd640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f408dd10 0x7f71f41d98b0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71e8015000 tx=0x7f71e8005ad0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 174, 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 32589, 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.617 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.618 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.619 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:15.620 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.621 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.622 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:15.623 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.624 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:15.625 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.626 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.627 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:15.628 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c403dcc0 msgr2=0x7f71c4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f71c403dcc0 0x7f71c4040180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71f406f3c0 tx=0x7f71f0033000 comp rx=0 tx=0).stop 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 10 monclient: shutdown 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 msgr2=0x7f71f40951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b780 tx=0x7f71e400bc50 comp rx=0 tx=0).stop 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71facfb640 1 -- 10.20.193.51:0/3604382031 reap_dead start 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 shutdown_connections 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 --2- 10.20.193.51:0/3604382031 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71f40a0750 0x7f71f40951c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 >> 10.20.193.51:0/3604382031 conn(0x7f71f40a30c0 msgr2=0x7f71f413aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 shutdown_connections 2026-02-17T12:04:15.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.594+0000 7f71fc785640 1 -- 10.20.193.51:0/3604382031 wait complete. 2026-02-17T12:04:15.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:04:15.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:04:15.630 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:04:15.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.697+0000 7f8146d2c640 10 monclient: get_monmap_and_config 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.697+0000 7f8146d2c640 10 monclient: build_initial_monmap 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient: monmap: 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:15.698956+0000 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:15.698956+0000 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:15.700 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 Processor -- start 2026-02-17T12:04:15.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 -- start start 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient: init 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f81400a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 0x7f8140138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f814009d270 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 0x7f8140138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f81401385b0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f814009a5c0 con 0x7f81401385b0 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f814009b520 con 0x7f814009d270 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f81400a3f90 con 0x7f81400a3bb0 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8146d2c640 10 monclient(hunting): authenticate will time out at 1743.317776s 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f81452a2640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 msgr2=0x7f8140138a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f81452a2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 0x7f8140138a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42700/0 (socket says 10.20.193.51:42700) 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 1 -- 10.20.193.51:0/2452283545 learned_addr learned my addr 10.20.193.51:0/2452283545 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): get_auth_request con 0x7f81400a3bb0 auth_method 0 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.698+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8137fff640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 0x7f8140138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 10 monclient(hunting): handle_auth_done global_id 234173 payload 274 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 -- 10.20.193.51:0/2452283545 >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 msgr2=0x7f8140138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 0x7f8140138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 -- 10.20.193.51:0/2452283545 >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 msgr2=0x7f8140138a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 0x7f8140138a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 monclient: found mon.noname-b 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8144aa1640 1 -- 10.20.193.51:0/2452283545 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8140135430 con 0x7f81400a3bb0 2026-02-17T12:04:15.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8137fff640 10 monclient: get_auth_request con 0x7f814009d270 auth_method 0 2026-02-17T12:04:15.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.699+0000 7f8137fff640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 0x7f8140138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f8144aa1640 1 -- 10.20.193.51:0/2452283545 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 msgr2=0x7f814009cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f8144aa1640 1 --2- 10.20.193.51:0/2452283545 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f814006c0d0 tx=0x7f813002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66dc1b5e5ddef85 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 1 -- 10.20.193.51:0/2452283545 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813003c070 con 0x7f81400a3bb0 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: dump: 2026-02-17T12:04:15.713 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 1 -- 10.20.193.51:0/2452283545 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813002fda0 con 0x7f81400a3bb0 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 1 -- 10.20.193.51:0/2452283545 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130037660 con 0x7f81400a3bb0 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f8146d2c640 5 monclient: authenticate success, global_id 234173 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f8146d2c640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f8146d2c640 4 set_mon_vals no callback set 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.701+0000 7f81377fe640 10 monclient: dump: 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.715 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 10 monclient: shutdown 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- 10.20.193.51:0/2452283545 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 msgr2=0x7f814009cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 --2- 10.20.193.51:0/2452283545 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f814006c0d0 tx=0x7f813002ee80 comp rx=0 tx=0).stop 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- 10.20.193.51:0/2452283545 shutdown_connections 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.51:3300/0 conn(0x7f81401385b0 0x7f8140138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 --2- 10.20.193.51:0/2452283545 >> v2:10.20.193.142:3300/0 conn(0x7f814009d270 0x7f8140138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 --2- 10.20.193.51:0/2452283545 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814009cd30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- 10.20.193.51:0/2452283545 >> 10.20.193.51:0/2452283545 conn(0x7f81400a30c0 msgr2=0x7f81400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- 10.20.193.51:0/2452283545 shutdown_connections 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- 10.20.193.51:0/2452283545 wait complete. 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 10 monclient: build_initial_monmap 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 10 monclient: monmap: 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:15.717 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 Processor -- start 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 1 -- start start 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 10 monclient: init 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.702+0000 7f8146d2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009d270 0x7f81401320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f814009d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f81400a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81401385b0 0x7f814012d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f81401385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8140074ac0 con 0x7f81401385b0 2026-02-17T12:04:15.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f814009b240 con 0x7f814009d270 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8140135040 con 0x7f81400a3bb0 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8146d2c640 10 monclient(hunting): authenticate will time out at 1743.322052s 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f81452a2640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81401385b0 msgr2=0x7f814012d020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f81452a2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81401385b0 0x7f814012d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:42704/0 (socket says 10.20.193.51:42704) 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 -- 10.20.193.51:0/1239635039 learned_addr learned my addr 10.20.193.51:0/1239635039 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): get_auth_request con 0x7f81400a3bb0 auth_method 0 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8144aa1640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009d270 0x7f81401320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8144aa1640 10 monclient(hunting): get_auth_request con 0x7f814009d270 auth_method 0 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8144aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8144aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8144aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient(hunting): handle_auth_done global_id 234176 payload 824 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009d270 msgr2=0x7f81401320f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009d270 0x7f81401320f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81401385b0 msgr2=0x7f814012d020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:15.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f81401385b0 0x7f814012d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 monclient: found mon.noname-c 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.703+0000 7f8137fff640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814012eae0 con 0x7f81400a3bb0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8137fff640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 msgr2=0x7f814012cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8137fff640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f812800c780 tx=0x7f812800cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128015070 con 0x7f81400a3bb0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: dump: 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.721 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: _finish_auth 0 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: _check_auth_tickets 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128007c40 con 0x7f81400a3bb0 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 5 monclient: authenticate success, global_id 234176 2026-02-17T12:04:15.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 monclient: _renew_subs 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8140133000 con 0x7f81400a3bb0 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280113f0 con 0x7f81400a3bb0 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8136ffd640 4 set_mon_vals no callback set 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f81357fa640 10 monclient: dump: 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.723 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 monclient: _renew_subs 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81401303b0 con 0x7f81400a3bb0 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 0x7f81401305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.705+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8140131650 con 0x7f814012d560 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 0x7f81401305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient: get_auth_request con 0x7f814012d560 auth_method 0 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8128022060 con 0x7f81400a3bb0 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f81357fa640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f811003dcc0 0x7f8110040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(691..691 src has 323..691) ==== 4795+0+0 (secure 0 0 0) 0x7f81280523e0 con 0x7f81400a3bb0 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 10 monclient(hunting): handle_auth_done global_id 184546 payload 824 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f8144aa1640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f814012d940 con 0x7f814012d560 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f81452a2640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f811003dcc0 0x7f8110040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.706+0000 7f81452a2640 10 monclient: get_auth_request con 0x7f811003dcc0 auth_method 0 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f8144aa1640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 msgr2=0x7f81401305f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f8144aa1640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 0x7f81401305f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f814006f3a0 tx=0x7f8130004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813003c040 con 0x7f814012d560 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 10 monclient: dump: 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.726 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81452a2640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f811003dcc0 0x7f8110040180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f813c003e00 tx=0x7f813c0091f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8130037cd0 con 0x7f814012d560 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 msgr2=0x7f81401305f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 0x7f81401305f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f814006f3a0 tx=0x7f8130004830 comp rx=0 tx=0).stop 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 msgr2=0x7f81401305f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:15.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.709+0000 7f81357fa640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814012d560 0x7f81401305f0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f814006f3a0 tx=0x7f8130004830 comp rx=0 tx=0).stop 2026-02-17T12:04:15.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8146d2c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:15.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8146d2c640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 0x7f81400638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:15.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8146d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:15.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f814009cd30 con 0x7f814009eb40 2026-02-17T12:04:15.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 0x7f81400638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient: get_auth_request con 0x7f814009eb40 auth_method 0 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.712+0000 7f8144aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.713+0000 7f8144aa1640 10 monclient(hunting): handle_auth_done global_id 184549 payload 824 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.713+0000 7f8144aa1640 1 -- 10.20.193.51:0/1239635039 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8140074db0 con 0x7f814009eb40 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8144aa1640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 msgr2=0x7f81400638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8144aa1640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 0x7f81400638c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8130002410 tx=0x7f81300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130053070 con 0x7f814009eb40 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:15.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 10 monclient: dump: 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4867 (secure 0 0 0) 0x7f813004c3d0 con 0x7f814009eb40 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:15.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 msgr2=0x7f81400638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 0x7f81400638c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8130002410 tx=0x7f81300047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 msgr2=0x7f81400638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81357fa640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f814009eb40 0x7f81400638c0 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8130002410 tx=0x7f81300047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 174, 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 288102, 2026-02-17T12:04:15.732 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.733 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.734 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:15.737 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.738 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:15.739 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.740 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:15.741 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:15.742 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f811003dcc0 msgr2=0x7f8110040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f811003dcc0 0x7f8110040180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f813c003e00 tx=0x7f813c0091f0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 10 monclient: shutdown 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 msgr2=0x7f814012cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f81452a2640 1 -- 10.20.193.51:0/1239635039 reap_dead start 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f812800c780 tx=0x7f812800cc50 comp rx=0 tx=0).stop 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 shutdown_connections 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 --2- 10.20.193.51:0/1239635039 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f81400a3bb0 0x7f814012cae0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.715+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 >> 10.20.193.51:0/1239635039 conn(0x7f81400a30c0 msgr2=0x7f81400a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:15.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.716+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 shutdown_connections 2026-02-17T12:04:15.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:15.716+0000 7f8146d2c640 1 -- 10.20.193.51:0/1239635039 wait complete. 2026-02-17T12:04:15.744 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:04:15.744 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:04:16.440 INFO:tasks.rados.rados.0.trial142.stdout:2999: done (1 left) 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3000: done (0 left) 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3001: rollback oid 44 current snap is 334 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 322 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3002: read oid 10 snap -1 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3002: expect deleted 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3003: read oid 33 snap -1 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3003: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3004: copy_from oid 39 from oid 13 current snap is 334 2026-02-17T12:04:16.441 INFO:tasks.rados.rados.0.trial142.stdout:3005: snap_remove snap 328 2026-02-17T12:04:17.441 INFO:tasks.rados.rados.0.trial142.stdout:3005: done (4 left) 2026-02-17T12:04:17.442 INFO:tasks.rados.rados.0.trial142.stdout:3006: write oid 46 current snap is 334 2026-02-17T12:04:17.442 INFO:tasks.rados.rados.0.trial142.stdout:3006: seq_num 1029 ranges {494403=738876,1764677=626345,3041436=252967} 2026-02-17T12:04:17.447 INFO:tasks.rados.rados.0.trial142.stdout:3006: writing trial14245205-46 from 494403 to 1233279 tid 1 2026-02-17T12:04:17.451 INFO:tasks.rados.rados.0.trial142.stdout:3006: writing trial14245205-46 from 1764677 to 2391022 tid 2 2026-02-17T12:04:17.455 INFO:tasks.rados.rados.0.trial142.stdout:3006: writing trial14245205-46 from 3041436 to 3294403 tid 3 2026-02-17T12:04:17.455 INFO:tasks.rados.rados.0.trial142.stdout:3007: write (excl) oid 49 current snap is 334 2026-02-17T12:04:17.455 INFO:tasks.rados.rados.0.trial142.stdout:3007: seq_num 1030 ranges {511210=414125,1423159=486356,2668859=589585} 2026-02-17T12:04:17.458 INFO:tasks.rados.rados.0.trial142.stdout:3007: writing trial14245205-49 from 511210 to 925335 tid 1 2026-02-17T12:04:17.462 INFO:tasks.rados.rados.0.trial142.stdout:3007: writing trial14245205-49 from 1423159 to 1909515 tid 2 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3007: writing trial14245205-49 from 2668859 to 3258444 tid 3 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3008: copy_from oid 48 from oid 31 current snap is 334 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3001: finishing rollback tid 1 to trial14245205-44 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 2219 (ObjNum 129 snap 0 seq_num 1213903184) dirty dne 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3001: done (6 left) 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3002: done (5 left) 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3009: write oid 24 current snap is 334 2026-02-17T12:04:17.468 INFO:tasks.rados.rados.0.trial142.stdout:3009: seq_num 1031 ranges {528017=489374,1481641=630014,2696282=400857} 2026-02-17T12:04:17.472 INFO:tasks.rados.rados.0.trial142.stdout:3009: writing trial14245205-24 from 528017 to 1017391 tid 1 2026-02-17T12:04:17.476 INFO:tasks.rados.rados.0.trial142.stdout:3009: writing trial14245205-24 from 1481641 to 2111655 tid 2 2026-02-17T12:04:17.480 INFO:tasks.rados.rados.0.trial142.stdout:3009: writing trial14245205-24 from 2696282 to 3097139 tid 3 2026-02-17T12:04:17.480 INFO:tasks.rados.rados.0.trial142.stdout:3010: copy_from oid 15 from oid 38 current snap is 334 2026-02-17T12:04:17.480 INFO:tasks.rados.rados.0.trial142.stdout:3003: expect (ObjNum 923 snap 299 seq_num 923) 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:3004: finishing copy_from racing read to trial14245205-39 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:3004: finishing copy_from to trial14245205-39 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:3006: finishing write tid 1 to trial14245205-46 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:3006: finishing write tid 2 to trial14245205-46 2026-02-17T12:04:17.613 INFO:tasks.rados.rados.0.trial142.stdout:3006: finishing write tid 3 to trial14245205-46 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: finishing write tid 4 to trial14245205-46 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: finishing write tid 5 to trial14245205-46 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: oid 46 updating version 0 to 2816 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: oid 46 version 2816 is already newer than 2814 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: oid 46 version 2816 is already newer than 2815 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: oid 46 updating version 2816 to 2817 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2817 (ObjNum 1029 snap 334 seq_num 1029) dirty exists 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3006: left oid 46 (ObjNum 1029 snap 334 seq_num 1029) 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3007: finishing write tid 1 to trial14245205-49 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3007: finishing write tid 2 to trial14245205-49 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3003: done (6 left) 2026-02-17T12:04:17.614 INFO:tasks.rados.rados.0.trial142.stdout:3004: done (5 left) 2026-02-17T12:04:17.615 INFO:tasks.rados.rados.0.trial142.stdout:3006: done (4 left) 2026-02-17T12:04:17.615 INFO:tasks.rados.rados.0.trial142.stdout:3011: write oid 29 current snap is 334 2026-02-17T12:04:17.615 INFO:tasks.rados.rados.0.trial142.stdout:3011: seq_num 1032 ranges {544824=564623,1823770=490025,3007352=337472} 2026-02-17T12:04:17.617 INFO:tasks.rados.rados.0.trial142.stdout:3011: writing trial14245205-29 from 544824 to 1109447 tid 1 2026-02-17T12:04:17.621 INFO:tasks.rados.rados.0.trial142.stdout:3011: writing trial14245205-29 from 1823770 to 2313795 tid 2 2026-02-17T12:04:17.625 INFO:tasks.rados.rados.0.trial142.stdout:3011: writing trial14245205-29 from 3007352 to 3344824 tid 3 2026-02-17T12:04:17.626 INFO:tasks.rados.rados.0.trial142.stdout:3012: read oid 9 snap -1 2026-02-17T12:04:17.626 INFO:tasks.rados.rados.0.trial142.stdout:3012: expect deleted 2026-02-17T12:04:17.626 INFO:tasks.rados.rados.0.trial142.stdout:3013: snap_remove snap 333 2026-02-17T12:04:17.643 INFO:tasks.rados.rados.0.trial142.stdout:3013: done (6 left) 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3014: snap_create 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3008: finishing copy_from to trial14245205-48 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3008: got expected ENOENT (src dne) 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3008: finishing copy_from racing read to trial14245205-48 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: finishing write tid 3 to trial14245205-49 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: finishing write tid 4 to trial14245205-49 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: finishing write tid 5 to trial14245205-49 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: oid 49 updating version 0 to 2822 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: oid 49 version 2822 is already newer than 2821 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: oid 49 version 2822 is already newer than 2820 2026-02-17T12:04:17.644 INFO:tasks.rados.rados.0.trial142.stdout:3007: oid 49 version 2822 is already newer than 2819 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2822 (ObjNum 1030 snap 334 seq_num 1030) dirty exists 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3007: left oid 49 (ObjNum 1030 snap 334 seq_num 1030) 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: finishing write tid 1 to trial14245205-24 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: finishing write tid 2 to trial14245205-24 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: finishing write tid 3 to trial14245205-24 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: finishing write tid 4 to trial14245205-24 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: finishing write tid 5 to trial14245205-24 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: oid 24 updating version 0 to 2153 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: oid 24 updating version 2153 to 2155 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: oid 24 version 2155 is already newer than 2154 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: oid 24 version 2155 is already newer than 2152 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2155 (ObjNum 1031 snap 334 seq_num 1031) dirty exists 2026-02-17T12:04:17.645 INFO:tasks.rados.rados.0.trial142.stdout:3009: left oid 24 (ObjNum 1031 snap 334 seq_num 1031) 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3010: finishing copy_from racing read to trial14245205-15 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3010: finishing copy_from to trial14245205-15 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 1992 (ObjNum 964 snap 310 seq_num 964) dirty exists 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: finishing write tid 1 to trial14245205-29 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: finishing write tid 2 to trial14245205-29 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: finishing write tid 3 to trial14245205-29 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: finishing write tid 4 to trial14245205-29 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: finishing write tid 5 to trial14245205-29 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: oid 29 updating version 0 to 2145 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: oid 29 updating version 2145 to 2147 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: oid 29 version 2147 is already newer than 2146 2026-02-17T12:04:17.646 INFO:tasks.rados.rados.0.trial142.stdout:3011: oid 29 version 2147 is already newer than 2144 2026-02-17T12:04:17.647 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2147 (ObjNum 1032 snap 334 seq_num 1032) dirty exists 2026-02-17T12:04:17.647 INFO:tasks.rados.rados.0.trial142.stdout:3011: left oid 29 (ObjNum 1032 snap 334 seq_num 1032) 2026-02-17T12:04:18.643 INFO:tasks.rados.rados.0.trial142.stdout:3007: done (6 left) 2026-02-17T12:04:18.643 INFO:tasks.rados.rados.0.trial142.stdout:3008: done (5 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3009: done (4 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3010: done (3 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3011: done (2 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3012: done (1 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3014: done (0 left) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3015: read oid 34 snap -1 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3015: expect (ObjNum 1000 snap 325 seq_num 1000) 2026-02-17T12:04:18.644 INFO:tasks.rados.rados.0.trial142.stdout:3016: snap_create 2026-02-17T12:04:18.648 INFO:tasks.rados.rados.0.trial142.stdout:3015: expect (ObjNum 1000 snap 325 seq_num 1000) 2026-02-17T12:04:19.644 INFO:tasks.rados.rados.0.trial142.stdout:3015: done (1 left) 2026-02-17T12:04:19.644 INFO:tasks.rados.rados.0.trial142.stdout:3016: done (0 left) 2026-02-17T12:04:19.644 INFO:tasks.rados.rados.0.trial142.stdout:3017: read oid 13 snap 321 2026-02-17T12:04:19.644 INFO:tasks.rados.rados.0.trial142.stdout:3017: expect deleted 2026-02-17T12:04:19.645 INFO:tasks.rados.rados.0.trial142.stdout:3018: read oid 26 snap -1 2026-02-17T12:04:19.645 INFO:tasks.rados.rados.0.trial142.stdout:3018: expect deleted 2026-02-17T12:04:19.645 INFO:tasks.rados.rados.0.trial142.stdout:3019: write oid 11 current snap is 336 2026-02-17T12:04:19.645 INFO:tasks.rados.rados.0.trial142.stdout:3019: seq_num 1033 ranges {561631=639872,1882252=633683,3034775=326856} 2026-02-17T12:04:19.648 INFO:tasks.rados.rados.0.trial142.stdout:3019: writing trial14245205-11 from 561631 to 1201503 tid 1 2026-02-17T12:04:19.654 INFO:tasks.rados.rados.0.trial142.stdout:3019: writing trial14245205-11 from 1882252 to 2515935 tid 2 2026-02-17T12:04:19.657 INFO:tasks.rados.rados.0.trial142.stdout:3019: writing trial14245205-11 from 3034775 to 3361631 tid 3 2026-02-17T12:04:19.657 INFO:tasks.rados.rados.0.trial142.stdout:3020: read oid 4 snap -1 2026-02-17T12:04:19.657 INFO:tasks.rados.rados.0.trial142.stdout:3020: expect (ObjNum 988 snap 318 seq_num 988) 2026-02-17T12:04:19.657 INFO:tasks.rados.rados.0.trial142.stdout:3021: rollback oid 9 current snap is 336 2026-02-17T12:04:19.657 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 330 2026-02-17T12:04:19.658 INFO:tasks.rados.rados.0.trial142.stdout:3017: done (4 left) 2026-02-17T12:04:19.658 INFO:tasks.rados.rados.0.trial142.stdout:3018: done (3 left) 2026-02-17T12:04:19.658 INFO:tasks.rados.rados.0.trial142.stdout:3022: write (excl) oid 19 current snap is 336 2026-02-17T12:04:19.658 INFO:tasks.rados.rados.0.trial142.stdout:3022: seq_num 1034 ranges {578438=431474,1657087=493694,2778551=599887} 2026-02-17T12:04:19.661 INFO:tasks.rados.rados.0.trial142.stdout:3022: writing trial14245205-19 from 578438 to 1009912 tid 1 2026-02-17T12:04:19.665 INFO:tasks.rados.rados.0.trial142.stdout:3022: writing trial14245205-19 from 1657087 to 2150781 tid 2 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3022: writing trial14245205-19 from 2778551 to 3378438 tid 3 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3023: delete oid 49 current snap is 336 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: finishing write tid 1 to trial14245205-11 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: finishing write tid 2 to trial14245205-11 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: finishing write tid 3 to trial14245205-11 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: finishing write tid 4 to trial14245205-11 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: finishing write tid 5 to trial14245205-11 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: oid 11 updating version 0 to 1140 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: oid 11 updating version 1140 to 1141 2026-02-17T12:04:19.671 INFO:tasks.rados.rados.0.trial142.stdout:3019: oid 11 updating version 1141 to 1142 2026-02-17T12:04:19.672 INFO:tasks.rados.rados.0.trial142.stdout:3019: oid 11 updating version 1142 to 1143 2026-02-17T12:04:19.672 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1143 (ObjNum 1033 snap 336 seq_num 1033) dirty exists 2026-02-17T12:04:19.672 INFO:tasks.rados.rados.0.trial142.stdout:3019: left oid 11 (ObjNum 1033 snap 336 seq_num 1033) 2026-02-17T12:04:19.672 INFO:tasks.rados.rados.0.trial142.stdout:3020: expect (ObjNum 988 snap 318 seq_num 988) 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3021: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2725 (ObjNum 97 snap 0 seq_num 1) dirty dne 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3022: finishing write tid 1 to trial14245205-19 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3019: done (4 left) 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3020: done (3 left) 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3021: done (2 left) 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3023: done (1 left) 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:3024: rollback oid 9 current snap is 336 2026-02-17T12:04:19.770 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 317 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: finishing write tid 2 to trial14245205-19 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: finishing write tid 3 to trial14245205-19 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: finishing write tid 4 to trial14245205-19 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: finishing write tid 5 to trial14245205-19 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: oid 19 updating version 0 to 2525 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: oid 19 version 2525 is already newer than 2524 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: oid 19 version 2525 is already newer than 2523 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: oid 19 version 2525 is already newer than 2522 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2525 (ObjNum 1034 snap 336 seq_num 1034) dirty exists 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: left oid 19 (ObjNum 1034 snap 336 seq_num 1034) 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3022: done (1 left) 2026-02-17T12:04:19.771 INFO:tasks.rados.rados.0.trial142.stdout:3025: delete oid 29 current snap is 336 2026-02-17T12:04:19.772 INFO:tasks.rados.rados.0.trial142.stdout:3024: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:04:19.773 INFO:tasks.rados.rados.0.trial142.stdout:3025: done (1 left) 2026-02-17T12:04:19.773 INFO:tasks.rados.rados.0.trial142.stdout:3026: snap_create 2026-02-17T12:04:19.773 INFO:tasks.rados.rados.0.trial142.stdout:3024: finishing rollback tid 2 to trial14245205-9 2026-02-17T12:04:19.773 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2831 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:04:20.655 INFO:tasks.rados.rados.0.trial142.stdout:3024: done (1 left) 2026-02-17T12:04:20.655 INFO:tasks.rados.rados.0.trial142.stdout:3026: done (0 left) 2026-02-17T12:04:20.656 INFO:tasks.rados.rados.0.trial142.stdout:3027: copy_from oid 32 from oid 25 current snap is 337 2026-02-17T12:04:20.656 INFO:tasks.rados.rados.0.trial142.stdout:3028: snap_create 2026-02-17T12:04:20.670 INFO:tasks.rados.rados.0.trial142.stdout:3027: finishing copy_from racing read to trial14245205-32 2026-02-17T12:04:20.672 INFO:tasks.rados.rados.0.trial142.stdout:3027: finishing copy_from to trial14245205-32 2026-02-17T12:04:20.672 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2023 (ObjNum 1027 snap 333 seq_num 1027) dirty exists 2026-02-17T12:04:21.656 INFO:tasks.rados.rados.0.trial142.stdout:3027: done (1 left) 2026-02-17T12:04:21.657 INFO:tasks.rados.rados.0.trial142.stdout:3028: done (0 left) 2026-02-17T12:04:21.657 INFO:tasks.rados.rados.0.trial142.stdout:3029: rollback oid 50 current snap is 338 2026-02-17T12:04:21.657 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 332 2026-02-17T12:04:21.657 INFO:tasks.rados.rados.0.trial142.stdout:3030: write oid 20 current snap is 338 2026-02-17T12:04:21.657 INFO:tasks.rados.rados.0.trial142.stdout:3030: seq_num 1037 ranges {628859=657221,1716180=641021,3144467=284392} 2026-02-17T12:04:21.661 INFO:tasks.rados.rados.0.trial142.stdout:3030: writing trial14245205-20 from 628859 to 1286080 tid 1 2026-02-17T12:04:21.665 INFO:tasks.rados.rados.0.trial142.stdout:3030: writing trial14245205-20 from 1716180 to 2357201 tid 2 2026-02-17T12:04:21.669 INFO:tasks.rados.rados.0.trial142.stdout:3030: writing trial14245205-20 from 3144467 to 3428859 tid 3 2026-02-17T12:04:21.669 INFO:tasks.rados.rados.0.trial142.stdout:3031: rollback oid 47 current snap is 338 2026-02-17T12:04:21.669 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 331 2026-02-17T12:04:21.670 INFO:tasks.rados.rados.0.trial142.stdout:3029: finishing rollback tid 0 to trial14245205-50 2026-02-17T12:04:21.670 INFO:tasks.rados.rados.0.trial142.stdout:3029: finishing rollback tid 1 to trial14245205-50 2026-02-17T12:04:21.670 INFO:tasks.rados.rados.0.trial142.stdout:3032: read oid 42 snap 322 2026-02-17T12:04:21.670 INFO:tasks.rados.rados.0.trial142.stdout:3032: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:04:21.670 INFO:tasks.rados.rados.0.trial142.stdout:3033: snap_remove snap 335 2026-02-17T12:04:22.644 INFO:tasks.rados.rados.0.trial142.stdout:3033: done (4 left) 2026-02-17T12:04:22.644 INFO:tasks.rados.rados.0.trial142.stdout:3034: copy_from oid 21 from oid 29 current snap is 338 2026-02-17T12:04:22.644 INFO:tasks.rados.rados.0.trial142.stdout:3029: finishing rollback tid 2 to trial14245205-50 2026-02-17T12:04:22.644 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2026 (ObjNum 971 snap 313 seq_num 971) dirty exists 2026-02-17T12:04:22.645 INFO:tasks.rados.rados.0.trial142.stdout:3030: finishing write tid 1 to trial14245205-20 2026-02-17T12:04:22.645 INFO:tasks.rados.rados.0.trial142.stdout:3030: finishing write tid 2 to trial14245205-20 2026-02-17T12:04:22.645 INFO:tasks.rados.rados.0.trial142.stdout:3031: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:04:22.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2521 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T12:04:22.645 INFO:tasks.rados.rados.0.trial142.stdout:3032: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: finishing write tid 3 to trial14245205-20 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: finishing write tid 4 to trial14245205-20 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: finishing write tid 5 to trial14245205-20 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: oid 20 updating version 0 to 2147 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: oid 20 updating version 2147 to 2148 2026-02-17T12:04:22.710 INFO:tasks.rados.rados.0.trial142.stdout:3030: oid 20 version 2148 is already newer than 2146 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3030: oid 20 updating version 2148 to 2149 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2149 (ObjNum 1037 snap 338 seq_num 1037) dirty exists 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3030: left oid 20 (ObjNum 1037 snap 338 seq_num 1037) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3034: finishing copy_from to trial14245205-21 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3034: got expected ENOENT (src dne) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3034: finishing copy_from racing read to trial14245205-21 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3029: done (4 left) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3030: done (3 left) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3031: done (2 left) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3032: done (1 left) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3034: done (0 left) 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3035: copy_from oid 17 from oid 19 current snap is 338 2026-02-17T12:04:22.711 INFO:tasks.rados.rados.0.trial142.stdout:3036: read oid 35 snap -1 2026-02-17T12:04:22.712 INFO:tasks.rados.rados.0.trial142.stdout:3036: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:04:22.712 INFO:tasks.rados.rados.0.trial142.stdout:3037: delete oid 48 current snap is 338 2026-02-17T12:04:22.712 INFO:tasks.rados.rados.0.trial142.stdout:3037: done (2 left) 2026-02-17T12:04:22.712 INFO:tasks.rados.rados.0.trial142.stdout:3038: delete oid 27 current snap is 338 2026-02-17T12:04:22.712 INFO:tasks.rados.rados.0.trial142.stdout:3036: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:04:22.786 INFO:tasks.rados.rados.0.trial142.stdout:3035: finishing copy_from racing read to trial14245205-17 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3035: finishing copy_from to trial14245205-17 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2525 (ObjNum 1034 snap 336 seq_num 1034) dirty exists 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3035: done (2 left) 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3036: done (1 left) 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3038: done (0 left) 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3039: write (excl) oid 14 current snap is 338 2026-02-17T12:04:22.787 INFO:tasks.rados.rados.0.trial142.stdout:3039: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2026-02-17T12:04:22.791 INFO:tasks.rados.rados.0.trial142.stdout:3039: writing trial14245205-14 from 679280 to 1162248 tid 1 2026-02-17T12:04:22.796 INFO:tasks.rados.rados.0.trial142.stdout:3039: writing trial14245205-14 from 1775273 to 2563621 tid 2 2026-02-17T12:04:22.800 INFO:tasks.rados.rados.0.trial142.stdout:3039: writing trial14245205-14 from 3110383 to 3479280 tid 3 2026-02-17T12:04:22.800 INFO:tasks.rados.rados.0.trial142.stdout:3040: write oid 29 current snap is 338 2026-02-17T12:04:22.800 INFO:tasks.rados.rados.0.trial142.stdout:3039: finishing write tid 1 to trial14245205-14 2026-02-17T12:04:22.800 INFO:tasks.rados.rados.0.trial142.stdout:3040: seq_num 1041 ranges {696087=558217,1833755=648359,3137806=358281} 2026-02-17T12:04:22.804 INFO:tasks.rados.rados.0.trial142.stdout:3040: writing trial14245205-29 from 696087 to 1254304 tid 1 2026-02-17T12:04:22.809 INFO:tasks.rados.rados.0.trial142.stdout:3040: writing trial14245205-29 from 1833755 to 2482114 tid 2 2026-02-17T12:04:22.813 INFO:tasks.rados.rados.0.trial142.stdout:3040: writing trial14245205-29 from 3137806 to 3496087 tid 3 2026-02-17T12:04:22.813 INFO:tasks.rados.rados.0.trial142.stdout:3041: snap_create 2026-02-17T12:04:22.813 INFO:tasks.rados.rados.0.trial142.stdout:3039: finishing write tid 2 to trial14245205-14 2026-02-17T12:04:22.813 INFO:tasks.rados.rados.0.trial142.stdout:3039: finishing write tid 3 to trial14245205-14 2026-02-17T12:04:22.813 INFO:tasks.rados.rados.0.trial142.stdout:3039: finishing write tid 4 to trial14245205-14 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: finishing write tid 5 to trial14245205-14 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: oid 14 updating version 0 to 2835 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: oid 14 updating version 2835 to 2836 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: oid 14 updating version 2836 to 2838 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: oid 14 version 2838 is already newer than 2837 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2838 (ObjNum 1040 snap 338 seq_num 1040) dirty exists 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3039: left oid 14 (ObjNum 1040 snap 338 seq_num 1040) 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3040: finishing write tid 1 to trial14245205-29 2026-02-17T12:04:22.814 INFO:tasks.rados.rados.0.trial142.stdout:3040: finishing write tid 2 to trial14245205-29 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: finishing write tid 3 to trial14245205-29 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: finishing write tid 4 to trial14245205-29 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: finishing write tid 5 to trial14245205-29 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: oid 29 updating version 0 to 2152 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: oid 29 updating version 2152 to 2153 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: oid 29 version 2153 is already newer than 2150 2026-02-17T12:04:22.815 INFO:tasks.rados.rados.0.trial142.stdout:3040: oid 29 version 2153 is already newer than 2151 2026-02-17T12:04:22.816 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2153 (ObjNum 1041 snap 338 seq_num 1041) dirty exists 2026-02-17T12:04:22.816 INFO:tasks.rados.rados.0.trial142.stdout:3040: left oid 29 (ObjNum 1041 snap 338 seq_num 1041) 2026-02-17T12:04:23.665 INFO:tasks.rados.rados.0.trial142.stdout:3039: done (2 left) 2026-02-17T12:04:23.665 INFO:tasks.rados.rados.0.trial142.stdout:3040: done (1 left) 2026-02-17T12:04:23.665 INFO:tasks.rados.rados.0.trial142.stdout:3041: done (0 left) 2026-02-17T12:04:23.665 INFO:tasks.rados.rados.0.trial142.stdout:3042: snap_remove snap 336 2026-02-17T12:04:24.667 INFO:tasks.rados.rados.0.trial142.stdout:3042: done (0 left) 2026-02-17T12:04:24.668 INFO:tasks.rados.rados.0.trial142.stdout:3043: delete oid 26 current snap is 339 2026-02-17T12:04:24.670 INFO:tasks.rados.rados.0.trial142.stdout:3043: done (0 left) 2026-02-17T12:04:24.670 INFO:tasks.rados.rados.0.trial142.stdout:3044: read oid 42 snap -1 2026-02-17T12:04:24.670 INFO:tasks.rados.rados.0.trial142.stdout:3044: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:04:24.670 INFO:tasks.rados.rados.0.trial142.stdout:3045: copy_from oid 36 from oid 41 current snap is 339 2026-02-17T12:04:24.671 INFO:tasks.rados.rados.0.trial142.stdout:3046: write oid 5 current snap is 339 2026-02-17T12:04:24.671 INFO:tasks.rados.rados.0.trial142.stdout:3046: seq_num 1043 ranges {729701=425068,1667072=652028,2909005=485180} 2026-02-17T12:04:24.674 INFO:tasks.rados.rados.0.trial142.stdout:3046: writing trial14245205-5 from 729701 to 1154769 tid 1 2026-02-17T12:04:24.678 INFO:tasks.rados.rados.0.trial142.stdout:3046: writing trial14245205-5 from 1667072 to 2319100 tid 2 2026-02-17T12:04:24.683 INFO:tasks.rados.rados.0.trial142.stdout:3046: writing trial14245205-5 from 2909005 to 3394185 tid 3 2026-02-17T12:04:24.683 INFO:tasks.rados.rados.0.trial142.stdout:3047: copy_from oid 30 from oid 35 current snap is 339 2026-02-17T12:04:24.683 INFO:tasks.rados.rados.0.trial142.stdout:3044: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:04:24.748 INFO:tasks.rados.rados.0.trial142.stdout:3046: finishing write tid 1 to trial14245205-5 2026-02-17T12:04:24.748 INFO:tasks.rados.rados.0.trial142.stdout:3045: finishing copy_from racing read to trial14245205-36 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3044: done (3 left) 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3048: read oid 45 snap -1 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3048: expect deleted 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3049: snap_create 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3045: finishing copy_from to trial14245205-36 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: finishing write tid 2 to trial14245205-5 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: finishing write tid 3 to trial14245205-5 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: finishing write tid 4 to trial14245205-5 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: finishing write tid 5 to trial14245205-5 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: oid 5 updating version 0 to 2527 2026-02-17T12:04:24.749 INFO:tasks.rados.rados.0.trial142.stdout:3046: oid 5 updating version 2527 to 2528 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:3046: oid 5 updating version 2528 to 2529 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:3046: oid 5 version 2529 is already newer than 2526 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2529 (ObjNum 1043 snap 339 seq_num 1043) dirty exists 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:3046: left oid 5 (ObjNum 1043 snap 339 seq_num 1043) 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:3047: finishing copy_from racing read to trial14245205-30 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:3047: finishing copy_from to trial14245205-30 2026-02-17T12:04:24.750 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 2555 (ObjNum 975 snap 315 seq_num 975) dirty exists 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3045: done (4 left) 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3046: done (3 left) 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3047: done (2 left) 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3048: done (1 left) 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3049: done (0 left) 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3050: write oid 18 current snap is 340 2026-02-17T12:04:25.671 INFO:tasks.rados.rados.0.trial142.stdout:3050: seq_num 1044 ranges {746508=500317,2009201=795686,3220075=326433} 2026-02-17T12:04:25.676 INFO:tasks.rados.rados.0.trial142.stdout:3050: writing trial14245205-18 from 746508 to 1246825 tid 1 2026-02-17T12:04:25.682 INFO:tasks.rados.rados.0.trial142.stdout:3050: writing trial14245205-18 from 2009201 to 2804887 tid 2 2026-02-17T12:04:25.684 INFO:tasks.rados.rados.0.trial142.stdout:3050: writing trial14245205-18 from 3220075 to 3546508 tid 3 2026-02-17T12:04:25.685 INFO:tasks.rados.rados.0.trial142.stdout:3051: delete oid 14 current snap is 340 2026-02-17T12:04:25.685 INFO:tasks.rados.rados.0.trial142.stdout:3050: finishing write tid 1 to trial14245205-18 2026-02-17T12:04:25.685 INFO:tasks.rados.rados.0.trial142.stdout:3050: finishing write tid 2 to trial14245205-18 2026-02-17T12:04:25.688 INFO:tasks.rados.rados.0.trial142.stdout:3050: finishing write tid 3 to trial14245205-18 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: finishing write tid 4 to trial14245205-18 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: finishing write tid 5 to trial14245205-18 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: oid 18 updating version 0 to 2841 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: oid 18 updating version 2841 to 2843 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: oid 18 version 2843 is already newer than 2842 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: oid 18 updating version 2843 to 2844 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 2844 (ObjNum 1044 snap 340 seq_num 1044) dirty exists 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: left oid 18 (ObjNum 1044 snap 340 seq_num 1044) 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3050: done (1 left) 2026-02-17T12:04:25.689 INFO:tasks.rados.rados.0.trial142.stdout:3051: done (0 left) 2026-02-17T12:04:25.690 INFO:tasks.rados.rados.0.trial142.stdout:3052: snap_remove snap 337 2026-02-17T12:04:26.674 INFO:tasks.rados.rados.0.trial142.stdout:3052: done (0 left) 2026-02-17T12:04:26.675 INFO:tasks.rados.rados.0.trial142.stdout:3053: write (excl) oid 33 current snap is 340 2026-02-17T12:04:26.675 INFO:tasks.rados.rados.0.trial142.stdout:3053: seq_num 1046 ranges {780122=650815,2126165=799355} 2026-02-17T12:04:26.680 INFO:tasks.rados.rados.0.trial142.stdout:3053: writing trial14245205-33 from 780122 to 1430937 tid 1 2026-02-17T12:04:26.686 INFO:tasks.rados.rados.0.trial142.stdout:3053: writing trial14245205-33 from 2126165 to 2925520 tid 2 2026-02-17T12:04:26.686 INFO:tasks.rados.rados.0.trial142.stdout:3054: read oid 14 snap -1 2026-02-17T12:04:26.686 INFO:tasks.rados.rados.0.trial142.stdout:3054: expect deleted 2026-02-17T12:04:26.686 INFO:tasks.rados.rados.0.trial142.stdout:3055: delete oid 24 current snap is 340 2026-02-17T12:04:26.687 INFO:tasks.rados.rados.0.trial142.stdout:3053: finishing write tid 1 to trial14245205-33 2026-02-17T12:04:26.688 INFO:tasks.rados.rados.0.trial142.stdout:3054: done (2 left) 2026-02-17T12:04:26.688 INFO:tasks.rados.rados.0.trial142.stdout:3055: done (1 left) 2026-02-17T12:04:26.688 INFO:tasks.rados.rados.0.trial142.stdout:3056: copy_from oid 29 from oid 41 current snap is 340 2026-02-17T12:04:26.688 INFO:tasks.rados.rados.0.trial142.stdout:3057: snap_remove snap 321 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3057: done (2 left) 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3058: read oid 50 snap 334 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3058: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3059: read oid 22 snap -1 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3059: expect (ObjNum 1008 snap 327 seq_num 1008) 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3060: write oid 45 current snap is 340 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: finishing write tid 2 to trial14245205-33 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: finishing write tid 3 to trial14245205-33 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: finishing write tid 4 to trial14245205-33 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: oid 33 updating version 0 to 2711 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: oid 33 version 2711 is already newer than 2709 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: oid 33 version 2711 is already newer than 2710 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 2711 (ObjNum 1046 snap 340 seq_num 1046) dirty exists 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3053: left oid 33 (ObjNum 1046 snap 340 seq_num 1046) 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3056: finishing copy_from racing read to trial14245205-29 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3056: finishing copy_from to trial14245205-29 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:04:27.645 INFO:tasks.rados.rados.0.trial142.stdout:3060: seq_num 1048 ranges {413736=401313,1326776=403024,2413414=457893,3438716=175020} 2026-02-17T12:04:27.648 INFO:tasks.rados.rados.0.trial142.stdout:3060: writing trial14245205-45 from 413736 to 815049 tid 1 2026-02-17T12:04:27.651 INFO:tasks.rados.rados.0.trial142.stdout:3060: writing trial14245205-45 from 1326776 to 1729800 tid 2 2026-02-17T12:04:27.655 INFO:tasks.rados.rados.0.trial142.stdout:3060: writing trial14245205-45 from 2413414 to 2871307 tid 3 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3060: writing trial14245205-45 from 3438716 to 3613736 tid 4 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3053: done (4 left) 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3056: done (3 left) 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3061: read oid 11 snap 338 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3061: expect (ObjNum 1033 snap 336 seq_num 1033) 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3062: copy_from oid 40 from oid 5 current snap is 340 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 1 to trial14245205-45 2026-02-17T12:04:27.659 INFO:tasks.rados.rados.0.trial142.stdout:3059: expect (ObjNum 1008 snap 327 seq_num 1008) 2026-02-17T12:04:27.855 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 2 to trial14245205-45 2026-02-17T12:04:27.855 INFO:tasks.rados.rados.0.trial142.stdout:3058: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 3 to trial14245205-45 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 4 to trial14245205-45 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 5 to trial14245205-45 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3058: done (4 left) 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3059: done (3 left) 2026-02-17T12:04:27.910 INFO:tasks.rados.rados.0.trial142.stdout:3063: delete oid 10 current snap is 340 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: finishing write tid 6 to trial14245205-45 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: oid 45 updating version 0 to 2156 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: oid 45 version 2156 is already newer than 2153 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: oid 45 version 2156 is already newer than 2154 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: oid 45 updating version 2156 to 2157 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: oid 45 version 2157 is already newer than 2155 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2157 (ObjNum 1048 snap 340 seq_num 1048) dirty exists 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3060: left oid 45 (ObjNum 1048 snap 340 seq_num 1048) 2026-02-17T12:04:27.911 INFO:tasks.rados.rados.0.trial142.stdout:3061: expect (ObjNum 1033 snap 336 seq_num 1033) 2026-02-17T12:04:28.043 INFO:tasks.rados.rados.0.trial142.stdout:3062: finishing copy_from racing read to trial14245205-40 2026-02-17T12:04:28.043 INFO:tasks.rados.rados.0.trial142.stdout:3060: done (3 left) 2026-02-17T12:04:28.044 INFO:tasks.rados.rados.0.trial142.stdout:3061: done (2 left) 2026-02-17T12:04:28.044 INFO:tasks.rados.rados.0.trial142.stdout:3063: done (1 left) 2026-02-17T12:04:28.044 INFO:tasks.rados.rados.0.trial142.stdout:3064: delete oid 34 current snap is 340 2026-02-17T12:04:28.044 INFO:tasks.rados.rados.0.trial142.stdout:3062: finishing copy_from to trial14245205-40 2026-02-17T12:04:28.044 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 2529 (ObjNum 1043 snap 339 seq_num 1043) dirty exists 2026-02-17T12:04:28.045 INFO:tasks.rados.rados.0.trial142.stdout:3062: done (1 left) 2026-02-17T12:04:28.046 INFO:tasks.rados.rados.0.trial142.stdout:3064: done (0 left) 2026-02-17T12:04:28.046 INFO:tasks.rados.rados.0.trial142.stdout:3065: rollback oid 32 current snap is 340 2026-02-17T12:04:28.046 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 32 to 338 2026-02-17T12:04:28.046 INFO:tasks.rados.rados.0.trial142.stdout:3066: copy_from oid 26 from oid 1 current snap is 340 2026-02-17T12:04:28.046 INFO:tasks.rados.rados.0.trial142.stdout:3067: snap_create 2026-02-17T12:04:28.047 INFO:tasks.rados.rados.0.trial142.stdout:3065: finishing rollback tid 0 to trial14245205-32 2026-02-17T12:04:28.047 INFO:tasks.rados.rados.0.trial142.stdout:3065: finishing rollback tid 1 to trial14245205-32 2026-02-17T12:04:28.047 INFO:tasks.rados.rados.0.trial142.stdout:3065: finishing rollback tid 2 to trial14245205-32 2026-02-17T12:04:28.048 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2152 (ObjNum 1027 snap 333 seq_num 1027) dirty exists 2026-02-17T12:04:28.052 INFO:tasks.rados.rados.0.trial142.stdout:3066: finishing copy_from racing read to trial14245205-26 2026-02-17T12:04:28.052 INFO:tasks.rados.rados.0.trial142.stdout:3066: finishing copy_from to trial14245205-26 2026-02-17T12:04:28.052 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2142 (ObjNum 958 snap 310 seq_num 958) dirty exists 2026-02-17T12:04:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3065: done (2 left) 2026-02-17T12:04:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3066: done (1 left) 2026-02-17T12:04:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3067: done (0 left) 2026-02-17T12:04:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3068: write (excl) oid 26 current snap is 341 2026-02-17T12:04:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3068: seq_num 1051 ranges {464157=743413,1618575=666704,3012036=408062} 2026-02-17T12:04:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3068: writing trial14245205-26 from 464157 to 1207570 tid 1 2026-02-17T12:04:28.693 INFO:tasks.rados.rados.0.trial142.stdout:3068: writing trial14245205-26 from 1618575 to 2285279 tid 2 2026-02-17T12:04:28.697 INFO:tasks.rados.rados.0.trial142.stdout:3068: writing trial14245205-26 from 3012036 to 3420098 tid 3 2026-02-17T12:04:28.697 INFO:tasks.rados.rados.0.trial142.stdout:3069: write oid 7 current snap is 341 2026-02-17T12:04:28.697 INFO:tasks.rados.rados.0.trial142.stdout:3069: seq_num 1052 ranges {480964=418662,1560704=410362,2523106=619334} 2026-02-17T12:04:28.701 INFO:tasks.rados.rados.0.trial142.stdout:3069: writing trial14245205-7 from 480964 to 899626 tid 1 2026-02-17T12:04:28.705 INFO:tasks.rados.rados.0.trial142.stdout:3069: writing trial14245205-7 from 1560704 to 1971066 tid 2 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3069: writing trial14245205-7 from 2523106 to 3142440 tid 3 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3070: copy_from oid 9 from oid 37 current snap is 341 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: finishing write tid 1 to trial14245205-26 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: finishing write tid 2 to trial14245205-26 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: finishing write tid 3 to trial14245205-26 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: finishing write tid 4 to trial14245205-26 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: finishing write tid 5 to trial14245205-26 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: oid 26 updating version 0 to 2143 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: oid 26 updating version 2143 to 2144 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: oid 26 updating version 2144 to 2145 2026-02-17T12:04:28.711 INFO:tasks.rados.rados.0.trial142.stdout:3068: oid 26 updating version 2145 to 2146 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2146 (ObjNum 1051 snap 341 seq_num 1051) dirty exists 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3068: left oid 26 (ObjNum 1051 snap 341 seq_num 1051) 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3069: finishing write tid 1 to trial14245205-7 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3068: done (2 left) 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3071: rollback oid 8 current snap is 341 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 286 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3069: finishing write tid 2 to trial14245205-7 2026-02-17T12:04:28.712 INFO:tasks.rados.rados.0.trial142.stdout:3072: delete oid 11 current snap is 341 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3072: done (3 left) 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3073: read oid 48 snap -1 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3073: expect deleted 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3074: snap_create 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3071: finishing rollback tid 0 to trial14245205-8 2026-02-17T12:04:28.714 INFO:tasks.rados.rados.0.trial142.stdout:3069: finishing write tid 3 to trial14245205-7 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: finishing write tid 4 to trial14245205-7 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: finishing write tid 5 to trial14245205-7 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: oid 7 updating version 0 to 2867 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: oid 7 version 2867 is already newer than 2864 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: oid 7 version 2867 is already newer than 2865 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: oid 7 version 2867 is already newer than 2866 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2867 (ObjNum 1052 snap 341 seq_num 1052) dirty exists 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3069: left oid 7 (ObjNum 1052 snap 341 seq_num 1052) 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3070: finishing copy_from to trial14245205-9 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3070: got expected ENOENT (src dne) 2026-02-17T12:04:28.715 INFO:tasks.rados.rados.0.trial142.stdout:3071: finishing rollback tid 1 to trial14245205-8 2026-02-17T12:04:28.716 INFO:tasks.rados.rados.0.trial142.stdout:3070: finishing copy_from racing read to trial14245205-9 2026-02-17T12:04:28.716 INFO:tasks.rados.rados.0.trial142.stdout:3071: finishing rollback tid 2 to trial14245205-8 2026-02-17T12:04:28.716 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2714 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3069: done (4 left) 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3070: done (3 left) 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3071: done (2 left) 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3073: done (1 left) 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3074: done (0 left) 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3075: rollback oid 22 current snap is 342 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 334 2026-02-17T12:04:29.686 INFO:tasks.rados.rados.0.trial142.stdout:3076: snap_create 2026-02-17T12:04:29.691 INFO:tasks.rados.rados.0.trial142.stdout:3075: finishing rollback tid 0 to trial14245205-22 2026-02-17T12:04:29.691 INFO:tasks.rados.rados.0.trial142.stdout:3075: finishing rollback tid 1 to trial14245205-22 2026-02-17T12:04:29.691 INFO:tasks.rados.rados.0.trial142.stdout:3075: finishing rollback tid 2 to trial14245205-22 2026-02-17T12:04:29.691 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2688 (ObjNum 1008 snap 327 seq_num 1008) dirty exists 2026-02-17T12:04:30.687 INFO:tasks.rados.rados.0.trial142.stdout:3075: done (1 left) 2026-02-17T12:04:30.687 INFO:tasks.rados.rados.0.trial142.stdout:3076: done (0 left) 2026-02-17T12:04:30.687 INFO:tasks.rados.rados.0.trial142.stdout:3077: rollback oid 42 current snap is 343 2026-02-17T12:04:30.687 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 334 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3078: read oid 35 snap -1 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3078: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3079: read oid 8 snap 341 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3079: expect (ObjNum 878 snap 277 seq_num 878) 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3080: copy_from oid 25 from oid 22 current snap is 343 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3081: read oid 14 snap 341 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3081: expect deleted 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3082: read oid 43 snap -1 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3082: expect (ObjNum 1028 snap 333 seq_num 1028) 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3083: write (excl) oid 17 current snap is 343 2026-02-17T12:04:30.688 INFO:tasks.rados.rados.0.trial142.stdout:3083: seq_num 1054 ranges {514578=569160,1677668=414031,2577952=641878} 2026-02-17T12:04:30.691 INFO:tasks.rados.rados.0.trial142.stdout:3083: writing trial14245205-17 from 514578 to 1083738 tid 1 2026-02-17T12:04:30.695 INFO:tasks.rados.rados.0.trial142.stdout:3083: writing trial14245205-17 from 1677668 to 2091699 tid 2 2026-02-17T12:04:30.699 INFO:tasks.rados.rados.0.trial142.stdout:3083: writing trial14245205-17 from 2577952 to 3219830 tid 3 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:3084: delete oid 26 current snap is 343 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:3077: finishing rollback tid 0 to trial14245205-42 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:3077: finishing rollback tid 1 to trial14245205-42 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:3077: finishing rollback tid 2 to trial14245205-42 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2155 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:04:30.700 INFO:tasks.rados.rados.0.trial142.stdout:3078: expect (ObjNum 975 snap 315 seq_num 975) 2026-02-17T12:04:30.774 INFO:tasks.rados.rados.0.trial142.stdout:3079: expect (ObjNum 878 snap 277 seq_num 878) 2026-02-17T12:04:30.919 INFO:tasks.rados.rados.0.trial142.stdout:3082: expect (ObjNum 1028 snap 333 seq_num 1028) 2026-02-17T12:04:31.074 INFO:tasks.rados.rados.0.trial142.stdout:3083: finishing write tid 1 to trial14245205-17 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3083: finishing write tid 2 to trial14245205-17 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3080: finishing copy_from racing read to trial14245205-25 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3077: done (7 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3078: done (6 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3079: done (5 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3081: done (4 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3082: done (3 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3084: done (2 left) 2026-02-17T12:04:31.075 INFO:tasks.rados.rados.0.trial142.stdout:3085: write oid 19 current snap is 343 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3080: finishing copy_from to trial14245205-25 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2688 (ObjNum 1008 snap 327 seq_num 1008) dirty exists 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: finishing write tid 3 to trial14245205-17 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: finishing write tid 4 to trial14245205-17 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: finishing write tid 5 to trial14245205-17 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: oid 17 updating version 0 to 2533 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: oid 17 version 2533 is already newer than 2530 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: oid 17 version 2533 is already newer than 2531 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: oid 17 version 2533 is already newer than 2532 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2533 (ObjNum 1054 snap 343 seq_num 1054) dirty exists 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3083: left oid 17 (ObjNum 1054 snap 343 seq_num 1054) 2026-02-17T12:04:31.076 INFO:tasks.rados.rados.0.trial142.stdout:3085: seq_num 1056 ranges {548192=719658,1678279=417700,2516445=780775} 2026-02-17T12:04:31.079 INFO:tasks.rados.rados.0.trial142.stdout:3085: writing trial14245205-19 from 548192 to 1267850 tid 1 2026-02-17T12:04:31.082 INFO:tasks.rados.rados.0.trial142.stdout:3085: writing trial14245205-19 from 1678279 to 2095979 tid 2 2026-02-17T12:04:31.087 INFO:tasks.rados.rados.0.trial142.stdout:3085: writing trial14245205-19 from 2516445 to 3297220 tid 3 2026-02-17T12:04:31.087 INFO:tasks.rados.rados.0.trial142.stdout:3080: done (2 left) 2026-02-17T12:04:31.087 INFO:tasks.rados.rados.0.trial142.stdout:3083: done (1 left) 2026-02-17T12:04:31.087 INFO:tasks.rados.rados.0.trial142.stdout:3086: delete oid 7 current snap is 343 2026-02-17T12:04:31.087 INFO:tasks.rados.rados.0.trial142.stdout:3085: finishing write tid 1 to trial14245205-19 2026-02-17T12:04:31.088 INFO:tasks.rados.rados.0.trial142.stdout:3085: finishing write tid 2 to trial14245205-19 2026-02-17T12:04:31.089 INFO:tasks.rados.rados.0.trial142.stdout:3086: done (1 left) 2026-02-17T12:04:31.089 INFO:tasks.rados.rados.0.trial142.stdout:3087: delete oid 2 current snap is 343 2026-02-17T12:04:31.089 INFO:tasks.rados.rados.0.trial142.stdout:3085: finishing write tid 3 to trial14245205-19 2026-02-17T12:04:31.089 INFO:tasks.rados.rados.0.trial142.stdout:3085: finishing write tid 4 to trial14245205-19 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:3085: finishing write tid 5 to trial14245205-19 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:3085: oid 19 updating version 0 to 2527 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:3085: oid 19 updating version 2527 to 2528 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:3085: oid 19 updating version 2528 to 2529 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:3085: oid 19 version 2529 is already newer than 2526 2026-02-17T12:04:31.090 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2529 (ObjNum 1056 snap 343 seq_num 1056) dirty exists 2026-02-17T12:04:31.091 INFO:tasks.rados.rados.0.trial142.stdout:3085: left oid 19 (ObjNum 1056 snap 343 seq_num 1056) 2026-02-17T12:04:31.091 INFO:tasks.rados.rados.0.trial142.stdout:3085: done (1 left) 2026-02-17T12:04:31.091 INFO:tasks.rados.rados.0.trial142.stdout:3087: done (0 left) 2026-02-17T12:04:31.091 INFO:tasks.rados.rados.0.trial142.stdout:3088: snap_remove snap 339 2026-02-17T12:04:31.692 INFO:tasks.rados.rados.0.trial142.stdout:3088: done (0 left) 2026-02-17T12:04:31.692 INFO:tasks.rados.rados.0.trial142.stdout:3089: snap_remove snap 341 2026-02-17T12:04:32.645 INFO:tasks.rados.rados.0.trial142.stdout:3089: done (0 left) 2026-02-17T12:04:32.646 INFO:tasks.rados.rados.0.trial142.stdout:3090: snap_remove snap 286 2026-02-17T12:04:33.646 INFO:tasks.rados.rados.0.trial142.stdout:3090: done (0 left) 2026-02-17T12:04:33.646 INFO:tasks.rados.rados.0.trial142.stdout:3091: write oid 33 current snap is 343 2026-02-17T12:04:33.646 INFO:tasks.rados.rados.0.trial142.stdout:3091: seq_num 1059 ranges {598613=661758,1970078=565027,3115067=614591} 2026-02-17T12:04:33.650 INFO:tasks.rados.rados.0.trial142.stdout:3091: writing trial14245205-33 from 598613 to 1260371 tid 1 2026-02-17T12:04:33.655 INFO:tasks.rados.rados.0.trial142.stdout:3091: writing trial14245205-33 from 1970078 to 2535105 tid 2 2026-02-17T12:04:33.660 INFO:tasks.rados.rados.0.trial142.stdout:3091: writing trial14245205-33 from 3115067 to 3729658 tid 3 2026-02-17T12:04:33.660 INFO:tasks.rados.rados.0.trial142.stdout:3092: read oid 45 snap -1 2026-02-17T12:04:33.661 INFO:tasks.rados.rados.0.trial142.stdout:3092: expect (ObjNum 1048 snap 340 seq_num 1048) 2026-02-17T12:04:33.661 INFO:tasks.rados.rados.0.trial142.stdout:3093: write (excl) oid 28 current snap is 343 2026-02-17T12:04:33.661 INFO:tasks.rados.rados.0.trial142.stdout:3091: finishing write tid 1 to trial14245205-33 2026-02-17T12:04:33.661 INFO:tasks.rados.rados.0.trial142.stdout:3091: finishing write tid 2 to trial14245205-33 2026-02-17T12:04:33.661 INFO:tasks.rados.rados.0.trial142.stdout:3093: seq_num 1060 ranges {615420=737007,1912207=425038,3026137=542216} 2026-02-17T12:04:33.665 INFO:tasks.rados.rados.0.trial142.stdout:3093: writing trial14245205-28 from 615420 to 1352427 tid 1 2026-02-17T12:04:33.669 INFO:tasks.rados.rados.0.trial142.stdout:3093: writing trial14245205-28 from 1912207 to 2337245 tid 2 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3093: writing trial14245205-28 from 3026137 to 3568353 tid 3 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3094: snap_create 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: finishing write tid 3 to trial14245205-33 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: finishing write tid 4 to trial14245205-33 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: finishing write tid 5 to trial14245205-33 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: oid 33 updating version 0 to 2715 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: oid 33 updating version 2715 to 2716 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: oid 33 updating version 2716 to 2717 2026-02-17T12:04:33.674 INFO:tasks.rados.rados.0.trial142.stdout:3091: oid 33 updating version 2717 to 2718 2026-02-17T12:04:33.675 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:04:33.675 INFO:tasks.rados.rados.0.trial142.stdout:3091: left oid 33 (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:04:33.675 INFO:tasks.rados.rados.0.trial142.stdout:3092: expect (ObjNum 1048 snap 340 seq_num 1048) 2026-02-17T12:04:33.760 INFO:tasks.rados.rados.0.trial142.stdout:3093: finishing write tid 1 to trial14245205-28 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: finishing write tid 2 to trial14245205-28 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: finishing write tid 3 to trial14245205-28 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: finishing write tid 4 to trial14245205-28 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: finishing write tid 5 to trial14245205-28 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: oid 28 updating version 0 to 2148 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: oid 28 version 2148 is already newer than 2146 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: oid 28 version 2148 is already newer than 2147 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: oid 28 updating version 2148 to 2149 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2149 (ObjNum 1060 snap 343 seq_num 1060) dirty exists 2026-02-17T12:04:33.761 INFO:tasks.rados.rados.0.trial142.stdout:3093: left oid 28 (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:04:34.647 INFO:tasks.rados.rados.0.trial142.stdout:3091: done (3 left) 2026-02-17T12:04:34.648 INFO:tasks.rados.rados.0.trial142.stdout:3092: done (2 left) 2026-02-17T12:04:34.648 INFO:tasks.rados.rados.0.trial142.stdout:3093: done (1 left) 2026-02-17T12:04:34.648 INFO:tasks.rados.rados.0.trial142.stdout:3094: done (0 left) 2026-02-17T12:04:34.648 INFO:tasks.rados.rados.0.trial142.stdout:3095: write (excl) oid 37 current snap is 344 2026-02-17T12:04:34.648 INFO:tasks.rados.rados.0.trial142.stdout:3095: seq_num 1061 ranges {632227=412256,1570689=568696,2653560=753488} 2026-02-17T12:04:34.651 INFO:tasks.rados.rados.0.trial142.stdout:3095: writing trial14245205-37 from 632227 to 1044483 tid 1 2026-02-17T12:04:34.655 INFO:tasks.rados.rados.0.trial142.stdout:3095: writing trial14245205-37 from 1570689 to 2139385 tid 2 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:3095: writing trial14245205-37 from 2653560 to 3407048 tid 3 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:3096: rollback oid 47 current snap is 344 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 331 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:3095: finishing write tid 1 to trial14245205-37 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:3095: finishing write tid 2 to trial14245205-37 2026-02-17T12:04:34.660 INFO:tasks.rados.rados.0.trial142.stdout:3097: snap_remove snap 343 2026-02-17T12:04:35.648 INFO:tasks.rados.rados.0.trial142.stdout:3097: done (2 left) 2026-02-17T12:04:35.648 INFO:tasks.rados.rados.0.trial142.stdout:3098: write (excl) oid 22 current snap is 344 2026-02-17T12:04:35.649 INFO:tasks.rados.rados.0.trial142.stdout:3098: seq_num 1062 ranges {649034=487505,1629171=428707,2680983=564760,3798768=50266} 2026-02-17T12:04:35.652 INFO:tasks.rados.rados.0.trial142.stdout:3098: writing trial14245205-22 from 649034 to 1136539 tid 1 2026-02-17T12:04:35.656 INFO:tasks.rados.rados.0.trial142.stdout:3098: writing trial14245205-22 from 1629171 to 2057878 tid 2 2026-02-17T12:04:35.660 INFO:tasks.rados.rados.0.trial142.stdout:3098: writing trial14245205-22 from 2680983 to 3245743 tid 3 2026-02-17T12:04:35.663 INFO:tasks.rados.rados.0.trial142.stdout:3098: writing trial14245205-22 from 3798768 to 3849034 tid 4 2026-02-17T12:04:35.663 INFO:tasks.rados.rados.0.trial142.stdout:3099: delete oid 15 current snap is 344 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: finishing write tid 3 to trial14245205-37 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: finishing write tid 4 to trial14245205-37 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3096: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2521 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: finishing write tid 5 to trial14245205-37 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: oid 37 updating version 0 to 2151 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: oid 37 updating version 2151 to 2152 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: oid 37 updating version 2152 to 2153 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:3095: oid 37 version 2153 is already newer than 2150 2026-02-17T12:04:35.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2153 (ObjNum 1061 snap 344 seq_num 1061) dirty exists 2026-02-17T12:04:35.665 INFO:tasks.rados.rados.0.trial142.stdout:3095: left oid 37 (ObjNum 1061 snap 344 seq_num 1061) 2026-02-17T12:04:35.665 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 1 to trial14245205-22 2026-02-17T12:04:35.665 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 2 to trial14245205-22 2026-02-17T12:04:35.665 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 3 to trial14245205-22 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 4 to trial14245205-22 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 5 to trial14245205-22 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: finishing write tid 6 to trial14245205-22 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: oid 22 updating version 0 to 2690 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: oid 22 updating version 2690 to 2692 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: oid 22 version 2692 is already newer than 2691 2026-02-17T12:04:35.666 INFO:tasks.rados.rados.0.trial142.stdout:3098: oid 22 updating version 2692 to 2693 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3098: oid 22 version 2693 is already newer than 2689 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 2693 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3098: left oid 22 (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3095: done (3 left) 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3096: done (2 left) 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3098: done (1 left) 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3099: done (0 left) 2026-02-17T12:04:35.667 INFO:tasks.rados.rados.0.trial142.stdout:3100: snap_create 2026-02-17T12:04:35.744 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:04:35.745 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T12:04:35.745 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:04:35.745 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:04:35.747 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:04:35.747 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:04:35.748 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: get_monmap_and_config 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: build_initial_monmap 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: monmap: 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:35.815315+0000 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:35.815315+0000 2026-02-17T12:04:35.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 1 Processor -- start 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 1 -- start start 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: init 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.814+0000 7fd5763f8640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd5700a3bb0 0x7fd57009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-c con 0x7fd5700a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-b con 0x7fd5700a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-a con 0x7fd57009e540 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd5700a3f90 con 0x7fd57009e540 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd57006e140 con 0x7fd5700a3bb0 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd57009f910 con 0x7fd5700a0750 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd5763f8640 10 monclient(hunting): authenticate will time out at 1763.434102s 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33340/0 (socket says 10.20.193.51:33340) 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53966/0 (socket says 10.20.193.51:53966) 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 -- 10.20.193.51:0/3796965658 learned_addr learned my addr 10.20.193.51:0/3796965658 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request con 0x7fd5700a0750 auth_method 0 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 10 monclient(hunting): get_auth_request con 0x7fd57009e540 auth_method 0 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.142:3300/0 conn(0x7fd5700a3bb0 0x7fd57009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): get_auth_request con 0x7fd5700a3bb0 auth_method 0 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 -- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 msgr2=0x7fd57013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 -- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 msgr2=0x7fd57013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd57496e640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_done global_id 234179 payload 274 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 -- 10.20.193.51:0/3796965658 >> v2:10.20.193.142:3300/0 conn(0x7fd5700a3bb0 msgr2=0x7fd57009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.142:3300/0 conn(0x7fd5700a3bb0 0x7fd57009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 -- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 msgr2=0x7fd57013c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 monclient: found mon.noname-b 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.815+0000 7fd56f7fe640 1 -- 10.20.193.51:0/3796965658 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57009ccd0 con 0x7fd5700a0750 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.817+0000 7fd56f7fe640 1 -- 10.20.193.51:0/3796965658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 msgr2=0x7fd57009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.817+0000 7fd56f7fe640 1 --2- 10.20.193.51:0/3796965658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd57006c1c0 tx=0x7fd56002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb0f76ccfc613a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 1 -- 10.20.193.51:0/3796965658 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56003c070 con 0x7fd5700a0750 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: dump: 2026-02-17T12:04:35.832 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: _finish_auth 0 2026-02-17T12:04:35.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 5 monclient: authenticate success, global_id 234179 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 1 -- 10.20.193.51:0/3796965658 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56002fca0 con 0x7fd5700a0750 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 4 set_mon_vals no callback set 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 1 -- 10.20.193.51:0/3796965658 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560037660 con 0x7fd5700a0750 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd56effd640 10 monclient: dump: 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:35.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 10 monclient: shutdown 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 -- 10.20.193.51:0/3796965658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 msgr2=0x7fd57009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:35.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 --2- 10.20.193.51:0/3796965658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd57006c1c0 tx=0x7fd56002ee60 comp rx=0 tx=0).stop 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 -- 10.20.193.51:0/3796965658 shutdown_connections 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.51:3300/0 conn(0x7fd57009e540 0x7fd57013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 --2- 10.20.193.51:0/3796965658 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a0750 0x7fd57009e000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 --2- 10.20.193.51:0/3796965658 >> v2:10.20.193.142:3300/0 conn(0x7fd5700a3bb0 0x7fd57009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 -- 10.20.193.51:0/3796965658 >> 10.20.193.51:0/3796965658 conn(0x7fd5700a30c0 msgr2=0x7fd5700a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 -- 10.20.193.51:0/3796965658 shutdown_connections 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 1 -- 10.20.193.51:0/3796965658 wait complete. 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 10 monclient: build_initial_monmap 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.818+0000 7fd5763f8640 10 monclient: monmap: 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:35.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 Processor -- start 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 -- start start 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient: init 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:35.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-a con 0x7fd57009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5700a0750 0x7fd57008f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-b con 0x7fd5700a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 0x7fd57008fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): picked mon.noname-c con 0x7fd5700a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd5700a04b0 con 0x7fd57009e540 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd57009c850 con 0x7fd5700a0750 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:35.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd57013cca0 con 0x7fd5700a3bb0 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd5763f8640 10 monclient(hunting): authenticate will time out at 1763.438412s 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53972/0 (socket says 10.20.193.51:53972) 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 -- 10.20.193.51:0/2383170797 learned_addr learned my addr 10.20.193.51:0/2383170797 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 10 monclient(hunting): get_auth_request con 0x7fd57009e540 auth_method 0 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 0x7fd57008fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): get_auth_request con 0x7fd5700a3bb0 auth_method 0 2026-02-17T12:04:35.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 msgr2=0x7fd570098f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 msgr2=0x7fd570098f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56ffff640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56f7fe640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5700a0750 0x7fd57008f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request con 0x7fd5700a0750 auth_method 0 2026-02-17T12:04:35.840 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd56f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient(hunting): handle_auth_done global_id 234182 payload 824 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5700a0750 msgr2=0x7fd57008f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5700a0750 0x7fd57008f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 msgr2=0x7fd570098f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient: _finish_hunting 0 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 monclient: found mon.noname-c 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.819+0000 7fd57496e640 1 -- 10.20.193.51:0/2383170797 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd570091b60 con 0x7fd5700a3bb0 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd57496e640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 msgr2=0x7fd57008fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd57496e640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 0x7fd57008fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd564007d10 tx=0x7fd56400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564007e60 con 0x7fd5700a3bb0 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: dump: 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: _finish_auth 0 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564003a90 con 0x7fd5700a3bb0 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 5 monclient: authenticate success, global_id 234182 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 10 monclient: _renew_subs 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd570093770 con 0x7fd5700a3bb0 2026-02-17T12:04:35.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564004020 con 0x7fd5700a3bb0 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56e7fc640 4 set_mon_vals no callback set 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd56cff9640 10 monclient: dump: 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 10 monclient: _renew_subs 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.821+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd570093490 con 0x7fd5700a3bb0 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd5763f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd5763f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd5763f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57009dac0 con 0x7fd5700a3bb0 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd564004490 con 0x7fd5700a3bb0 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd56cff9640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 0x7fd540040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:35.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.822+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(712..712 src has 323..712) ==== 4827+0+0 (secure 0 0 0) 0x7fd564052960 con 0x7fd5700a3bb0 2026-02-17T12:04:35.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.823+0000 7fd56ffff640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 0x7fd540040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:35.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.823+0000 7fd56ffff640 10 monclient: get_auth_request con 0x7fd54003dd90 auth_method 0 2026-02-17T12:04:35.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.825+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd564022020 con 0x7fd5700a3bb0 2026-02-17T12:04:35.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.825+0000 7fd56cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:35.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.825+0000 7fd56cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:35.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.825+0000 7fd56ffff640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 0x7fd540040250 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0096c0 tx=0x7fd55c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd5763f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd5763f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd5763f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd5700008d0 con 0x7fd5700a3bb0 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd56cff9640 1 -- 10.20.193.51:0/2383170797 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fd56401a2c0 con 0x7fd5700a3bb0 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd56cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:35.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.937+0000 7fd56cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:35.941 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":174,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 msgr2=0x7fd540040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 0x7fd540040250 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0096c0 tx=0x7fd55c008040 comp rx=0 tx=0).stop 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 10 monclient: shutdown 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 msgr2=0x7fd57008fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:35.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 0x7fd57008fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd564007d10 tx=0x7fd56400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 shutdown_connections 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd54003dd90 0x7fd540040250 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd5700a3bb0 0x7fd57008fe30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd5700a0750 0x7fd57008f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 --2- 10.20.193.51:0/2383170797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd57009e540 0x7fd570098f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 >> 10.20.193.51:0/2383170797 conn(0x7fd5700a30c0 msgr2=0x7fd57009bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 shutdown_connections 2026-02-17T12:04:35.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:35.938+0000 7fd5763f8640 1 -- 10.20.193.51:0/2383170797 wait complete. 2026-02-17T12:04:36.652 INFO:tasks.rados.rados.0.trial142.stdout:3100: done (0 left) 2026-02-17T12:04:36.652 INFO:tasks.rados.rados.0.trial142.stdout:3101: read oid 14 snap -1 2026-02-17T12:04:36.652 INFO:tasks.rados.rados.0.trial142.stdout:3101: expect deleted 2026-02-17T12:04:36.652 INFO:tasks.rados.rados.0.trial142.stdout:3102: read oid 20 snap -1 2026-02-17T12:04:36.652 INFO:tasks.rados.rados.0.trial142.stdout:3102: expect (ObjNum 1037 snap 338 seq_num 1037) 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3103: rollback oid 23 current snap is 345 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 331 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3104: read oid 6 snap -1 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3104: expect deleted 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3105: copy_from oid 26 from oid 36 current snap is 345 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3106: write (excl) oid 42 current snap is 345 2026-02-17T12:04:36.653 INFO:tasks.rados.rados.0.trial142.stdout:3106: seq_num 1064 ranges {682648=638003,2029782=432376,3019476=587304} 2026-02-17T12:04:36.657 INFO:tasks.rados.rados.0.trial142.stdout:3106: writing trial14245205-42 from 682648 to 1320651 tid 1 2026-02-17T12:04:36.661 INFO:tasks.rados.rados.0.trial142.stdout:3106: writing trial14245205-42 from 2029782 to 2462158 tid 2 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3106: writing trial14245205-42 from 3019476 to 3606780 tid 3 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3107: snap_create 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3103: finishing rollback tid 0 to trial14245205-23 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3103: finishing rollback tid 1 to trial14245205-23 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3103: finishing rollback tid 2 to trial14245205-23 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2532 (ObjNum 1011 snap 329 seq_num 1011) dirty exists 2026-02-17T12:04:36.666 INFO:tasks.rados.rados.0.trial142.stdout:3102: expect (ObjNum 1037 snap 338 seq_num 1037) 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3105: finishing copy_from racing read to trial14245205-26 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3105: finishing copy_from to trial14245205-26 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: finishing write tid 1 to trial14245205-42 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: finishing write tid 2 to trial14245205-42 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: finishing write tid 3 to trial14245205-42 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: finishing write tid 4 to trial14245205-42 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: finishing write tid 5 to trial14245205-42 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: oid 42 updating version 0 to 2159 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: oid 42 version 2159 is already newer than 2158 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: oid 42 version 2159 is already newer than 2156 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: oid 42 version 2159 is already newer than 2157 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2159 (ObjNum 1064 snap 345 seq_num 1064) dirty exists 2026-02-17T12:04:36.796 INFO:tasks.rados.rados.0.trial142.stdout:3106: left oid 42 (ObjNum 1064 snap 345 seq_num 1064) 2026-02-17T12:04:37.646 INFO:tasks.rados.rados.0.trial142.stdout:3101: done (6 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3102: done (5 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3103: done (4 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3104: done (3 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3105: done (2 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3106: done (1 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3107: done (0 left) 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3108: rollback oid 37 current snap is 346 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 344 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3109: write (excl) oid 46 current snap is 346 2026-02-17T12:04:37.647 INFO:tasks.rados.rados.0.trial142.stdout:3109: seq_num 1065 ranges {699455=429605,1804617=576034,3163252=514929} 2026-02-17T12:04:37.650 INFO:tasks.rados.rados.0.trial142.stdout:3109: writing trial14245205-46 from 699455 to 1129060 tid 1 2026-02-17T12:04:37.655 INFO:tasks.rados.rados.0.trial142.stdout:3109: writing trial14245205-46 from 1804617 to 2380651 tid 2 2026-02-17T12:04:37.660 INFO:tasks.rados.rados.0.trial142.stdout:3109: writing trial14245205-46 from 3163252 to 3678181 tid 3 2026-02-17T12:04:37.660 INFO:tasks.rados.rados.0.trial142.stdout:3110: rollback oid 9 current snap is 346 2026-02-17T12:04:37.660 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 9 to 342 2026-02-17T12:04:37.660 INFO:tasks.rados.rados.0.trial142.stdout:3108: finishing rollback tid 0 to trial14245205-37 2026-02-17T12:04:37.660 INFO:tasks.rados.rados.0.trial142.stdout:3108: finishing rollback tid 1 to trial14245205-37 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:3108: finishing rollback tid 2 to trial14245205-37 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2156 (ObjNum 1061 snap 344 seq_num 1061) dirty exists 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:3109: finishing write tid 1 to trial14245205-46 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:3109: finishing write tid 2 to trial14245205-46 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:3108: done (2 left) 2026-02-17T12:04:37.661 INFO:tasks.rados.rados.0.trial142.stdout:3111: snap_remove snap 330 2026-02-17T12:04:38.654 INFO:tasks.rados.rados.0.trial142.stdout:3111: done (2 left) 2026-02-17T12:04:38.654 INFO:tasks.rados.rados.0.trial142.stdout:3112: write oid 5 current snap is 346 2026-02-17T12:04:38.654 INFO:tasks.rados.rados.0.trial142.stdout:3112: seq_num 1066 ranges {716262=504854,1863099=719692,3074322=726201} 2026-02-17T12:04:38.658 INFO:tasks.rados.rados.0.trial142.stdout:3112: writing trial14245205-5 from 716262 to 1221116 tid 1 2026-02-17T12:04:38.664 INFO:tasks.rados.rados.0.trial142.stdout:3112: writing trial14245205-5 from 1863099 to 2582791 tid 2 2026-02-17T12:04:38.668 INFO:tasks.rados.rados.0.trial142.stdout:3112: writing trial14245205-5 from 3074322 to 3800523 tid 3 2026-02-17T12:04:38.669 INFO:tasks.rados.rados.0.trial142.stdout:3113: read oid 10 snap 323 2026-02-17T12:04:38.669 INFO:tasks.rados.rados.0.trial142.stdout:3113: expect deleted 2026-02-17T12:04:38.669 INFO:tasks.rados.rados.0.trial142.stdout:3114: write (excl) oid 48 current snap is 346 2026-02-17T12:04:38.669 INFO:tasks.rados.rados.0.trial142.stdout:3114: seq_num 1067 ranges {733069=580103,1921581=579703,3218098=537473} 2026-02-17T12:04:38.673 INFO:tasks.rados.rados.0.trial142.stdout:3114: writing trial14245205-48 from 733069 to 1313172 tid 1 2026-02-17T12:04:38.678 INFO:tasks.rados.rados.0.trial142.stdout:3114: writing trial14245205-48 from 1921581 to 2501284 tid 2 2026-02-17T12:04:38.684 INFO:tasks.rados.rados.0.trial142.stdout:3114: writing trial14245205-48 from 3218098 to 3755571 tid 3 2026-02-17T12:04:38.684 INFO:tasks.rados.rados.0.trial142.stdout:3115: read oid 12 snap -1 2026-02-17T12:04:38.684 INFO:tasks.rados.rados.0.trial142.stdout:3115: expect deleted 2026-02-17T12:04:38.684 INFO:tasks.rados.rados.0.trial142.stdout:3116: write (excl) oid 17 current snap is 346 2026-02-17T12:04:38.684 INFO:tasks.rados.rados.0.trial142.stdout:3109: finishing write tid 3 to trial14245205-46 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: finishing write tid 4 to trial14245205-46 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: finishing write tid 5 to trial14245205-46 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: oid 46 updating version 0 to 2896 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: oid 46 updating version 2896 to 2897 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: oid 46 updating version 2897 to 2898 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: oid 46 version 2898 is already newer than 2895 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2898 (ObjNum 1065 snap 346 seq_num 1065) dirty exists 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3109: left oid 46 (ObjNum 1065 snap 346 seq_num 1065) 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3110: finishing rollback tid 0 to trial14245205-9 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3110: finishing rollback tid 1 to trial14245205-9 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:3110: finishing rollback tid 2 to trial14245205-9 2026-02-17T12:04:38.685 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 2902 (ObjNum 818 snap 254 seq_num 818) dirty exists 2026-02-17T12:04:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3112: finishing write tid 1 to trial14245205-5 2026-02-17T12:04:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3112: finishing write tid 2 to trial14245205-5 2026-02-17T12:04:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3116: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2026-02-17T12:04:38.689 INFO:tasks.rados.rados.0.trial142.stdout:3116: writing trial14245205-17 from 749876 to 1405228 tid 1 2026-02-17T12:04:38.693 INFO:tasks.rados.rados.0.trial142.stdout:3116: writing trial14245205-17 from 1863710 to 2587071 tid 2 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3116: writing trial14245205-17 from 3012815 to 3761560 tid 3 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3109: done (6 left) 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3110: done (5 left) 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3117: read oid 50 snap -1 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3117: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3118: copy_from oid 16 from oid 6 current snap is 346 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3112: finishing write tid 3 to trial14245205-5 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3112: finishing write tid 4 to trial14245205-5 2026-02-17T12:04:38.700 INFO:tasks.rados.rados.0.trial142.stdout:3112: finishing write tid 5 to trial14245205-5 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: oid 5 updating version 0 to 2535 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: oid 5 updating version 2535 to 2536 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: oid 5 updating version 2536 to 2537 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: oid 5 version 2537 is already newer than 2534 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2537 (ObjNum 1066 snap 346 seq_num 1066) dirty exists 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: left oid 5 (ObjNum 1066 snap 346 seq_num 1066) 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3114: finishing write tid 1 to trial14245205-48 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3114: finishing write tid 2 to trial14245205-48 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3112: done (6 left) 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3113: done (5 left) 2026-02-17T12:04:38.701 INFO:tasks.rados.rados.0.trial142.stdout:3119: rollback oid 15 current snap is 346 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 338 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: finishing write tid 3 to trial14245205-48 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: finishing write tid 4 to trial14245205-48 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: finishing write tid 5 to trial14245205-48 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: oid 48 updating version 0 to 2557 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: oid 48 updating version 2557 to 2559 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: oid 48 version 2559 is already newer than 2558 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: oid 48 version 2559 is already newer than 2556 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2559 (ObjNum 1067 snap 346 seq_num 1067) dirty exists 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: left oid 48 (ObjNum 1067 snap 346 seq_num 1067) 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3116: finishing write tid 1 to trial14245205-17 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3116: finishing write tid 2 to trial14245205-17 2026-02-17T12:04:38.702 INFO:tasks.rados.rados.0.trial142.stdout:3114: done (5 left) 2026-02-17T12:04:38.703 INFO:tasks.rados.rados.0.trial142.stdout:3115: done (4 left) 2026-02-17T12:04:38.703 INFO:tasks.rados.rados.0.trial142.stdout:3120: copy_from oid 42 from oid 33 current snap is 346 2026-02-17T12:04:38.703 INFO:tasks.rados.rados.0.trial142.stdout:3121: copy_from oid 32 from oid 39 current snap is 346 2026-02-17T12:04:38.703 INFO:tasks.rados.rados.0.trial142.stdout:3122: snap_remove snap 340 2026-02-17T12:04:38.950 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:39.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: get_monmap_and_config 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: build_initial_monmap 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: monmap: 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:39.017225+0000 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:39.017225+0000 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:39.021 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 Processor -- start 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 -- start start 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: init 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:39.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-a con 0x7fa7b40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-b con 0x7fa7b409d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa7b41385b0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b4135430 con 0x7fa7b41385b0 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b409a5c0 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b409b520 con 0x7fa7b409d270 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:39.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.016+0000 7fa7b9579640 10 monclient(hunting): authenticate will time out at 1766.635982s 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53982/0 (socket says 10.20.193.51:53982) 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 -- 10.20.193.51:0/1380954485 learned_addr learned my addr 10.20.193.51:0/1380954485 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33396/0 (socket says 10.20.193.51:33396) 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 10 monclient(hunting): get_auth_request con 0x7fa7b40a3bb0 auth_method 0 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b37fe640 1 --1- 10.20.193.51:0/1380954485 >> v1:10.20.193.51:6789/0 conn(0x7fa7b41385b0 0x7fa7b413f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:47940/0 (socket says 10.20.193.51:47940) 2026-02-17T12:04:39.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): get_auth_request con 0x7fa7b409d270 auth_method 0 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 -- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 msgr2=0x7fa7b409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 -- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 msgr2=0x7fa7b409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 --2- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b2ffd640 1 --2- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_done global_id 234185 payload 274 2026-02-17T12:04:39.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 msgr2=0x7fa7b409cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 --2- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1380954485 >> v1:10.20.193.51:6789/0 conn(0x7fa7b41385b0 legacy=0x7fa7b413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 monclient: found mon.noname-b 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.017+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1380954485 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b409af60 con 0x7fa7b409d270 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1380954485 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 msgr2=0x7fa7b4138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b27fc640 1 --2- 10.20.193.51:0/1380954485 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098a0 tx=0x7fa79c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61bbbb4ad11cef87 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 1 -- 10.20.193.51:0/1380954485 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c03c070 con 0x7fa7b409d270 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:39.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: dump: 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:39.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 1 -- 10.20.193.51:0/1380954485 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c02fc00 con 0x7fa7b409d270 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 1 -- 10.20.193.51:0/1380954485 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c037440 con 0x7fa7b409d270 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b1ffb640 10 monclient: dump: 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.035 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b9579640 5 monclient: authenticate success, global_id 234185 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b9579640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.019+0000 7fa7b9579640 4 set_mon_vals no callback set 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 10 monclient: shutdown 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:39.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- 10.20.193.51:0/1380954485 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 msgr2=0x7fa7b4138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1380954485 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098a0 tx=0x7fa79c02ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- 10.20.193.51:0/1380954485 shutdown_connections 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1380954485 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b409d270 0x7fa7b4138070 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1380954485 >> v2:10.20.193.51:3300/0 conn(0x7fa7b40a3bb0 0x7fa7b409cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- 10.20.193.51:0/1380954485 >> 10.20.193.51:0/1380954485 conn(0x7fa7b40a30c0 msgr2=0x7fa7b40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- 10.20.193.51:0/1380954485 shutdown_connections 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- 10.20.193.51:0/1380954485 wait complete. 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 10 monclient: build_initial_monmap 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 10 monclient: monmap: 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:39.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 Processor -- start 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 1 -- start start 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.020+0000 7fa7b9579640 10 monclient: init 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:39.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7b409d270 0x7fa7b412d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-b con 0x7fa7b409d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-c con 0x7fa7b40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): picked mon.noname-a con 0x7fa7b41385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b4074ac0 con 0x7fa7b41385b0 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b40a3f90 con 0x7fa7b409d270 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b4135040 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b9579640 10 monclient(hunting): authenticate will time out at 1766.640141s 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33408/0 (socket says 10.20.193.51:33408) 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1663555258 learned_addr learned my addr 10.20.193.51:0/1663555258 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): get_auth_request con 0x7fa7b40a3bb0 auth_method 0 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 10 monclient(hunting): get_auth_request con 0x7fa7b41385b0 auth_method 0 2026-02-17T12:04:39.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 msgr2=0x7fa7b412dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 msgr2=0x7fa7b412dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b37fe640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient(hunting): handle_auth_done global_id 234188 payload 824 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7b409d270 msgr2=0x7fa7b412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7b409d270 0x7fa7b412d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 msgr2=0x7fa7b412dc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 monclient: found mon.noname-c 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.021+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1663555258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b412e620 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b27fc640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 msgr2=0x7fa7b412d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b27fc640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0099d0 tx=0x7fa79c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c03c040 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:39.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: dump: 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:39.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c047070 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 5 monclient: authenticate success, global_id 234188 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 10 monclient: _renew_subs 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b41331a0 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c040a40 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b17fa640 4 set_mon_vals no callback set 2026-02-17T12:04:39.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7937fe640 10 monclient: dump: 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 10 monclient: _renew_subs 2026-02-17T12:04:39.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.023+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b4130d90 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b9579640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b9579640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b9579640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b4138070 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa79c03f030 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7937fe640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 0x7fa7800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(715..715 src has 323..715) ==== 4811+0+0 (secure 0 0 0) 0x7fa79c0778e0 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b2ffd640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 0x7fa7800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.024+0000 7fa7b2ffd640 10 monclient: get_auth_request con 0x7fa78003dd10 auth_method 0 2026-02-17T12:04:39.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.027+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa7b412e620 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.027+0000 7fa7937fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:39.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.027+0000 7fa7937fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:39.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.027+0000 7fa7b2ffd640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 0x7fa7800401d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8006fd0 tx=0x7fa7a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:39.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7b9579640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7b9579640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7b9579640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa7b4132510 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7937fe640 1 -- 10.20.193.51:0/1663555258 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fa79c035d70 con 0x7fa7b40a3bb0 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7937fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.139+0000 7fa7937fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:39.142 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":174,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 msgr2=0x7fa7800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 0x7fa7800401d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8006fd0 tx=0x7fa7a8008040 comp rx=0 tx=0).stop 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 10 monclient: shutdown 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 msgr2=0x7fa7b412d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0099d0 tx=0x7fa79c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 shutdown_connections 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa78003dd10 0x7fa7800401d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa7b41385b0 0x7fa7b412dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa7b40a3bb0 0x7fa7b412d720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 --2- 10.20.193.51:0/1663555258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa7b409d270 0x7fa7b412d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:39.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 >> 10.20.193.51:0/1663555258 conn(0x7fa7b40a30c0 msgr2=0x7fa7b40a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:39.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 shutdown_connections 2026-02-17T12:04:39.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:39.140+0000 7fa7b9579640 1 -- 10.20.193.51:0/1663555258 wait complete. 2026-02-17T12:04:39.657 INFO:tasks.rados.rados.0.trial142.stdout:3122: done (6 left) 2026-02-17T12:04:39.657 INFO:tasks.rados.rados.0.trial142.stdout:3123: snap_remove snap 345 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3123: done (6 left) 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3124: rollback oid 21 current snap is 346 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 344 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3118: finishing copy_from to trial14245205-16 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3118: got expected ENOENT (src dne) 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3118: finishing copy_from racing read to trial14245205-16 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3116: finishing write tid 3 to trial14245205-17 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3116: finishing write tid 4 to trial14245205-17 2026-02-17T12:04:40.658 INFO:tasks.rados.rados.0.trial142.stdout:3116: finishing write tid 5 to trial14245205-17 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3116: oid 17 updating version 0 to 2540 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3116: oid 17 version 2540 is already newer than 2538 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3116: oid 17 version 2540 is already newer than 2539 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3116: oid 17 updating version 2540 to 2541 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2541 (ObjNum 1068 snap 346 seq_num 1068) dirty exists 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3116: left oid 17 (ObjNum 1068 snap 346 seq_num 1068) 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3119: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3121: finishing copy_from racing read to trial14245205-32 2026-02-17T12:04:40.659 INFO:tasks.rados.rados.0.trial142.stdout:3117: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:3120: finishing copy_from racing read to trial14245205-42 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:3121: finishing copy_from to trial14245205-32 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:3119: finishing rollback tid 2 to trial14245205-15 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2721 (ObjNum 964 snap 310 seq_num 964) dirty exists 2026-02-17T12:04:40.713 INFO:tasks.rados.rados.0.trial142.stdout:3120: finishing copy_from to trial14245205-42 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3116: done (6 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3117: done (5 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3118: done (4 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3119: done (3 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3120: done (2 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3121: done (1 left) 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3125: delete oid 40 current snap is 346 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3124: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3124: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:04:40.714 INFO:tasks.rados.rados.0.trial142.stdout:3124: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:04:40.715 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2161 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:04:40.715 INFO:tasks.rados.rados.0.trial142.stdout:3124: done (1 left) 2026-02-17T12:04:40.715 INFO:tasks.rados.rados.0.trial142.stdout:3125: done (0 left) 2026-02-17T12:04:40.715 INFO:tasks.rados.rados.0.trial142.stdout:3126: snap_create 2026-02-17T12:04:41.710 INFO:tasks.rados.rados.0.trial142.stdout:3126: done (0 left) 2026-02-17T12:04:41.711 INFO:tasks.rados.rados.0.trial142.stdout:3127: read oid 3 snap -1 2026-02-17T12:04:41.711 INFO:tasks.rados.rados.0.trial142.stdout:3127: expect deleted 2026-02-17T12:04:41.711 INFO:tasks.rados.rados.0.trial142.stdout:3128: write oid 4 current snap is 347 2026-02-17T12:04:41.711 INFO:tasks.rados.rados.0.trial142.stdout:3128: seq_num 1070 ranges {783490=405850,1980674=727030,3184014=487642} 2026-02-17T12:04:41.714 INFO:tasks.rados.rados.0.trial142.stdout:3128: writing trial14245205-4 from 783490 to 1189340 tid 1 2026-02-17T12:04:41.720 INFO:tasks.rados.rados.0.trial142.stdout:3128: writing trial14245205-4 from 1980674 to 2707704 tid 2 2026-02-17T12:04:41.724 INFO:tasks.rados.rados.0.trial142.stdout:3128: writing trial14245205-4 from 3184014 to 3671656 tid 3 2026-02-17T12:04:41.724 INFO:tasks.rados.rados.0.trial142.stdout:3129: read oid 37 snap 322 2026-02-17T12:04:41.724 INFO:tasks.rados.rados.0.trial142.stdout:3129: expect deleted 2026-02-17T12:04:41.724 INFO:tasks.rados.rados.0.trial142.stdout:3130: snap_create 2026-02-17T12:04:41.724 INFO:tasks.rados.rados.0.trial142.stdout:3128: finishing write tid 1 to trial14245205-4 2026-02-17T12:04:41.725 INFO:tasks.rados.rados.0.trial142.stdout:3128: finishing write tid 2 to trial14245205-4 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: finishing write tid 3 to trial14245205-4 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: finishing write tid 4 to trial14245205-4 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: finishing write tid 5 to trial14245205-4 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: oid 4 updating version 0 to 2929 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: oid 4 version 2929 is already newer than 2927 2026-02-17T12:04:41.726 INFO:tasks.rados.rados.0.trial142.stdout:3128: oid 4 version 2929 is already newer than 2928 2026-02-17T12:04:41.727 INFO:tasks.rados.rados.0.trial142.stdout:3128: oid 4 version 2929 is already newer than 2926 2026-02-17T12:04:41.727 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2929 (ObjNum 1070 snap 347 seq_num 1070) dirty exists 2026-02-17T12:04:41.727 INFO:tasks.rados.rados.0.trial142.stdout:3128: left oid 4 (ObjNum 1070 snap 347 seq_num 1070) 2026-02-17T12:04:42.151 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:42.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.217+0000 7fb1f3ac6640 10 monclient: get_monmap_and_config 2026-02-17T12:04:42.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.217+0000 7fb1f3ac6640 10 monclient: build_initial_monmap 2026-02-17T12:04:42.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.217+0000 7fb1f3ac6640 10 monclient: monmap: 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:42.218775+0000 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:42.218775+0000 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:42.222 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 Processor -- start 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 -- start start 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient: init 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-b con 0x7fb1ec0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb1ec09d270 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb1ec138780 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec135430 con 0x7fb1ec09d270 2026-02-17T12:04:42.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec09af60 con 0x7fb1ec138780 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec09a5c0 con 0x7fb1ec0a3bb0 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f3ac6640 10 monclient(hunting): authenticate will time out at 1769.837632s 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f103a640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb1ec09d270 0x7fb1ec138070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:47944/0 (socket says 10.20.193.51:47944) 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 learned_addr learned my addr 10.20.193.51:0/2121839253 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:42.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.218+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.220+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.51:6789/0 conn(0x7fb1ec09d270 legacy=0x7fb1ec138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:42.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.220+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec138780 legacy=0x7fb1ec1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:42.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:42.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:43.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:43.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:43.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:43.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:45.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): tick 2026-02-17T12:04:45.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:04:45.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 monclient(hunting): continuing hunt 2026-02-17T12:04:45.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec09cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1ec09cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec138780 legacy=0x7fb1ec1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.51:6789/0 conn(0x7fb1ec09d270 legacy=0x7fb1ec138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient: _add_conns ranks=[3,4] 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fb1d00038f0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fb1d0006420 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:45.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec09a5c0 con 0x7fb1d00038f0 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d0008fa0 con 0x7fb1d0006420 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1db7fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1d00038f0 auth_method 0 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1d0006420 auth_method 0 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.218+0000 7fb1f103a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.219+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.219+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.219+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.219+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:45.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1d00038f0 auth_method 0 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.419+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:45.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1d0006420 auth_method 0 2026-02-17T12:04:45.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.420+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:45.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1d00038f0 auth_method 0 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.820+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:45.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:45.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1d0006420 auth_method 0 2026-02-17T12:04:45.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:45.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:45.821+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:46.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1d00038f0 auth_method 0 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:46.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.621+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1d0006420 auth_method 0 2026-02-17T12:04:46.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:46.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:46.622+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:47.174 INFO:tasks.rados.rados.0.trial142.stdout:3127: done (3 left) 2026-02-17T12:04:47.174 INFO:tasks.rados.rados.0.trial142.stdout:3128: done (2 left) 2026-02-17T12:04:47.174 INFO:tasks.rados.rados.0.trial142.stdout:3129: done (1 left) 2026-02-17T12:04:47.174 INFO:tasks.rados.rados.0.trial142.stdout:3130: done (0 left) 2026-02-17T12:04:47.175 INFO:tasks.rados.rados.0.trial142.stdout:3131: write oid 49 current snap is 348 2026-02-17T12:04:47.175 INFO:tasks.rados.rados.0.trial142.stdout:3131: seq_num 1071 ranges {400297=481099,1639156=361141} 2026-02-17T12:04:47.177 INFO:tasks.rados.rados.0.trial142.stdout:3131: writing trial14245205-49 from 400297 to 881396 tid 1 2026-02-17T12:04:47.181 INFO:tasks.rados.rados.0.trial142.stdout:3131: writing trial14245205-49 from 1639156 to 2000297 tid 2 2026-02-17T12:04:47.182 INFO:tasks.rados.rados.0.trial142.stdout:3132: rollback oid 48 current snap is 348 2026-02-17T12:04:47.182 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 322 2026-02-17T12:04:47.182 INFO:tasks.rados.rados.0.trial142.stdout:3131: finishing write tid 1 to trial14245205-49 2026-02-17T12:04:47.182 INFO:tasks.rados.rados.0.trial142.stdout:3133: delete oid 9 current snap is 348 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3132: finishing rollback tid 0 to trial14245205-48 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3132: finishing rollback tid 1 to trial14245205-48 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3132: finishing rollback tid 2 to trial14245205-48 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2562 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3131: finishing write tid 2 to trial14245205-49 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3131: finishing write tid 3 to trial14245205-49 2026-02-17T12:04:47.185 INFO:tasks.rados.rados.0.trial142.stdout:3131: finishing write tid 4 to trial14245205-49 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3131: oid 49 updating version 0 to 2930 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3131: oid 49 updating version 2930 to 2932 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3131: oid 49 version 2932 is already newer than 2931 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2932 (ObjNum 1071 snap 348 seq_num 1071) dirty exists 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3131: left oid 49 (ObjNum 1071 snap 348 seq_num 1071) 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3131: done (2 left) 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3132: done (1 left) 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3133: done (0 left) 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3134: read oid 9 snap -1 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3134: expect deleted 2026-02-17T12:04:47.186 INFO:tasks.rados.rados.0.trial142.stdout:3135: write oid 44 current snap is 348 2026-02-17T12:04:47.187 INFO:tasks.rados.rados.0.trial142.stdout:3135: seq_num 1073 ranges {433911=747950,1756120=277791} 2026-02-17T12:04:47.189 INFO:tasks.rados.rados.0.trial142.stdout:3135: writing trial14245205-44 from 433911 to 1181861 tid 1 2026-02-17T12:04:47.192 INFO:tasks.rados.rados.0.trial142.stdout:3135: writing trial14245205-44 from 1756120 to 2033911 tid 2 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:3136: copy_from oid 37 from oid 42 current snap is 348 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:3135: finishing write tid 1 to trial14245205-44 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:3134: done (2 left) 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:3137: rollback oid 4 current snap is 348 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 329 2026-02-17T12:04:47.193 INFO:tasks.rados.rados.0.trial142.stdout:3138: snap_create 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: finishing write tid 2 to trial14245205-44 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: finishing write tid 3 to trial14245205-44 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: finishing write tid 4 to trial14245205-44 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: oid 44 updating version 0 to 2694 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: oid 44 updating version 2694 to 2696 2026-02-17T12:04:47.194 INFO:tasks.rados.rados.0.trial142.stdout:3135: oid 44 version 2696 is already newer than 2695 2026-02-17T12:04:47.195 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 2696 (ObjNum 1073 snap 348 seq_num 1073) dirty exists 2026-02-17T12:04:47.195 INFO:tasks.rados.rados.0.trial142.stdout:3135: left oid 44 (ObjNum 1073 snap 348 seq_num 1073) 2026-02-17T12:04:47.195 INFO:tasks.rados.rados.0.trial142.stdout:3137: finishing rollback tid 0 to trial14245205-4 2026-02-17T12:04:47.195 INFO:tasks.rados.rados.0.trial142.stdout:3137: finishing rollback tid 1 to trial14245205-4 2026-02-17T12:04:47.196 INFO:tasks.rados.rados.0.trial142.stdout:3137: finishing rollback tid 2 to trial14245205-4 2026-02-17T12:04:47.196 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2938 (ObjNum 988 snap 318 seq_num 988) dirty exists 2026-02-17T12:04:47.200 INFO:tasks.rados.rados.0.trial142.stdout:3136: finishing copy_from racing read to trial14245205-37 2026-02-17T12:04:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3136: finishing copy_from to trial14245205-37 2026-02-17T12:04:47.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): tick 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 monclient(hunting): continuing hunt 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 msgr2=0x7fb1d00088e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.142:3300/0 conn(0x7fb1d0006420 0x7fb1d00088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 msgr2=0x7fb1d0005d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d00038f0 0x7fb1d0005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 reap_dead start 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fb1ec0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb1ec138780 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fb1d0003d20 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec09b240 con 0x7fb1ec138780 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec09a5c0 con 0x7fb1d0003d20 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 1 -- 10.20.193.51:0/2121839253 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d0008fa0 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1db7fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 10 monclient(hunting): get_auth_request con 0x7fb1d0003d20 auth_method 0 2026-02-17T12:04:48.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 msgr2=0x7fb1d00068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 msgr2=0x7fb1d00068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d000b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d000b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:48.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.219+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:48.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.221+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec138780 legacy=0x7fb1d000d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 10 monclient(hunting): get_auth_request con 0x7fb1d0003d20 auth_method 0 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 msgr2=0x7fb1d00068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 msgr2=0x7fb1d00068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d000b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d000b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:48.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.420+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919271656 0 0) 0x7fb1ec09b240 con 0x7fb1ec138780 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): _negotiate 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): my global_id is 184558 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d4003620 con 0x7fb1ec138780 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2574367474 0 0) 0x7fb1d4003620 con 0x7fb1ec138780 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d000b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d000b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 msgr2=0x7fb1d00068d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 --2- 10.20.193.51:0/2121839253 >> v2:10.20.193.51:3300/0 conn(0x7fb1d0003d20 0x7fb1d00068d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d0007ec0 con 0x7fb1ec138780 2026-02-17T12:04:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fb1e0002fb0 con 0x7fb1ec138780 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: dump: 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 >> v1:10.20.193.142:6789/0 conn(0x7fb1ec138780 legacy=0x7fb1d000d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d4003ab0 0x7fb1d4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): picked mon.b con 0x7fb1d4003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d4004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): picked mon.c con 0x7fb1ec0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d4004e40 0x7fb1d40052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): picked mon.a con 0x7fb1d4004e40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec09a5c0 con 0x7fb1d4004e40 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d0008fa0 con 0x7fb1d4003ab0 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d400bcd0 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f0839640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d4004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d4004e40 0x7fb1d40052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): get_auth_request con 0x7fb1d4004e40 auth_method 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f183b640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d4003ab0 0x7fb1d4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1d4003ab0 auth_method 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f183b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient(hunting): handle_auth_done global_id 184558 payload 293 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d4003ab0 msgr2=0x7fb1d4003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1d4003ab0 0x7fb1d4003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d4004e40 msgr2=0x7fb1d40052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1d4004e40 0x7fb1d40052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 monclient: found mon.c 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d4003620 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.449+0000 7fb1f103a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.450+0000 7fb1f3ac6640 5 monclient: authenticate success, global_id 184558 2026-02-17T12:04:48.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.450+0000 7fb1f3ac6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f103a640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d4004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f103a640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d4004900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0694e0 tx=0x7fb1e0030460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad84f6b632b131c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0005ad0 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: dump: 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0034070 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f3ac6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 1 -- 10.20.193.51:0/2121839253 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0004be0 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f0839640 10 monclient: dump: 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f3ac6640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.452+0000 7fb1f3ac6640 4 set_mon_vals no callback set 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 10 monclient: shutdown 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1d4004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/2121839253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec0a3bb0 0x7fb1d4004900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0694e0 tx=0x7fb1e0030460 comp rx=0 tx=0).stop 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f203c640 1 -- 10.20.193.51:0/2121839253 reap_dead start 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/2121839253 shutdown_connections 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/2121839253 >> 10.20.193.51:0/2121839253 conn(0x7fb1ec0a30c0 msgr2=0x7fb1ec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/2121839253 shutdown_connections 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/2121839253 wait complete. 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 10 monclient: monmap: 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 Processor -- start 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 1 -- start start 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.453+0000 7fb1f3ac6640 10 monclient: init 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 0x7fb1ec1c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-a con 0x7fb1ec0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1ec1c1030 0x7fb1ec1c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-b con 0x7fb1ec1c1030 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): picked mon.noname-c con 0x7fb1ec1cf1d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0a3f90 con 0x7fb1ec0a3bb0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec09b520 con 0x7fb1ec1c1030 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec135040 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f3ac6640 10 monclient(hunting): authenticate will time out at 1776.073127s 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 0x7fb1ec1c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 0x7fb1ec1c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56700/0 (socket says 10.20.193.51:56700) 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44698/0 (socket says 10.20.193.51:44698) 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 1 -- 10.20.193.51:0/161176793 learned_addr learned my addr 10.20.193.51:0/161176793 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): get_auth_request con 0x7fb1ec0a3bb0 auth_method 0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): get_auth_request con 0x7fb1ec1cf1d0 auth_method 0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f103a640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1ec1c1030 0x7fb1ec1c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f183b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f103a640 10 monclient(hunting): get_auth_request con 0x7fb1ec1c1030 auth_method 0 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f103a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient(hunting): handle_auth_done global_id 234191 payload 824 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 -- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1ec1c1030 msgr2=0x7fb1ec1c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1ec1c1030 0x7fb1ec1c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 -- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 msgr2=0x7fb1ec1c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 0x7fb1ec1c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 monclient: found mon.noname-c 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.454+0000 7fb1f203c640 1 -- 10.20.193.51:0/161176793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec12c050 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f203c640 1 -- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 msgr2=0x7fb1ec1cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f203c640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0765b0 tx=0x7fb1e8011f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8018020 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: dump: 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80072d0 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80076c0 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1dbfff640 4 set_mon_vals no callback set 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1da7fc640 10 monclient: dump: 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 5 monclient: authenticate success, global_id 234191 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 10 monclient: _renew_subs 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec1c2c10 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 10 monclient: _renew_subs 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.456+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec138360 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb1e80078a0 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1da7fc640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 0x7fb1bc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(719..719 src has 323..719) ==== 4799+0+0 (secure 0 0 0) 0x7fb1e8053220 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f3ac6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f3ac6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f3ac6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec0a14e0 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f183b640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 0x7fb1bc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.457+0000 7fb1f183b640 10 monclient: get_auth_request con 0x7fb1bc03dd10 auth_method 0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.459+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb1e800e050 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.459+0000 7fb1da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.459+0000 7fb1da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:48.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.460+0000 7fb1f183b640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 0x7fb1bc0401d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc006f80 tx=0x7fb1dc01a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.513 INFO:tasks.rados.rados.0.trial142.stdout:3135: done (3 left) 2026-02-17T12:04:48.513 INFO:tasks.rados.rados.0.trial142.stdout:3136: done (2 left) 2026-02-17T12:04:48.513 INFO:tasks.rados.rados.0.trial142.stdout:3137: done (1 left) 2026-02-17T12:04:48.513 INFO:tasks.rados.rados.0.trial142.stdout:3138: done (0 left) 2026-02-17T12:04:48.513 INFO:tasks.rados.rados.0.trial142.stdout:3139: delete oid 23 current snap is 349 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:3139: done (0 left) 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:3140: rollback oid 4 current snap is 349 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 323 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:3141: copy_from oid 23 from oid 8 current snap is 349 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:3142: write (excl) oid 31 current snap is 349 2026-02-17T12:04:48.515 INFO:tasks.rados.rados.0.trial142.stdout:3142: seq_num 1075 ranges {467525=498448,1473084=594379} 2026-02-17T12:04:48.519 INFO:tasks.rados.rados.0.trial142.stdout:3142: writing trial14245205-31 from 467525 to 965973 tid 1 2026-02-17T12:04:48.523 INFO:tasks.rados.rados.0.trial142.stdout:3142: writing trial14245205-31 from 1473084 to 2067463 tid 2 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3143: copy_from oid 6 from oid 16 current snap is 349 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3140: finishing rollback tid 0 to trial14245205-4 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3140: finishing rollback tid 1 to trial14245205-4 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3140: finishing rollback tid 2 to trial14245205-4 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 2942 (ObjNum 900 snap 287 seq_num 900) dirty exists 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3141: finishing copy_from racing read to trial14245205-23 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3141: finishing copy_from to trial14245205-23 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2714 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3142: finishing write tid 1 to trial14245205-31 2026-02-17T12:04:48.524 INFO:tasks.rados.rados.0.trial142.stdout:3140: done (3 left) 2026-02-17T12:04:48.525 INFO:tasks.rados.rados.0.trial142.stdout:3141: done (2 left) 2026-02-17T12:04:48.525 INFO:tasks.rados.rados.0.trial142.stdout:3144: snap_create 2026-02-17T12:04:48.525 INFO:tasks.rados.rados.0.trial142.stdout:3143: finishing copy_from to trial14245205-6 2026-02-17T12:04:48.525 INFO:tasks.rados.rados.0.trial142.stdout:3143: got expected ENOENT (src dne) 2026-02-17T12:04:48.525 INFO:tasks.rados.rados.0.trial142.stdout:3143: finishing copy_from racing read to trial14245205-6 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: finishing write tid 2 to trial14245205-31 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: finishing write tid 3 to trial14245205-31 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: finishing write tid 4 to trial14245205-31 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: oid 31 updating version 0 to 2724 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: oid 31 version 2724 is already newer than 2723 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: oid 31 version 2724 is already newer than 2722 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 2724 (ObjNum 1075 snap 349 seq_num 1075) dirty exists 2026-02-17T12:04:48.526 INFO:tasks.rados.rados.0.trial142.stdout:3142: left oid 31 (ObjNum 1075 snap 349 seq_num 1075) 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1f3ac6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1f3ac6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1f3ac6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb1ec138c10 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1da7fc640 1 -- 10.20.193.51:0/161176793 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fb1e801ad40 con 0x7fb1ec1cf1d0 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.574+0000 7fb1da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:48.576 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 msgr2=0x7fb1bc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 0x7fb1bc0401d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc006f80 tx=0x7fb1dc01a040 comp rx=0 tx=0).stop 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 10 monclient: shutdown 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 msgr2=0x7fb1ec1cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0765b0 tx=0x7fb1e8011f90 comp rx=0 tx=0).stop 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 shutdown_connections 2026-02-17T12:04:48.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb1bc03dd10 0x7fb1bc0401d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb1ec1cf1d0 0x7fb1ec1cf650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb1ec1c1030 0x7fb1ec1c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 --2- 10.20.193.51:0/161176793 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb1ec0a3bb0 0x7fb1ec1c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 >> 10.20.193.51:0/161176793 conn(0x7fb1ec0a30c0 msgr2=0x7fb1ec09bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 shutdown_connections 2026-02-17T12:04:48.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.575+0000 7fb1f3ac6640 1 -- 10.20.193.51:0/161176793 wait complete. 2026-02-17T12:04:48.586 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:04:48.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:04:48.586 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:04:48.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.651+0000 7f22cf054640 10 monclient: get_monmap_and_config 2026-02-17T12:04:48.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.651+0000 7f22cf054640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.651+0000 7f22cf054640 10 monclient: monmap: 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:48.652506+0000 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:48.652506+0000 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:48.657 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.651+0000 7f22cf054640 1 Processor -- start 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 -- start start 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient: init 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22c80a3bb0 0x7f22c809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-a con 0x7f22c80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f22c809d270 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f22c8138780 0x7f22c81403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-c con 0x7f22c8138780 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c8135430 con 0x7f22c809d270 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f22c809a5c0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f22c809b520 con 0x7f22c8138780 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22cf054640 10 monclient(hunting): authenticate will time out at 1776.271331s 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22c80a3bb0 0x7f22c809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f22c80a3bb0 0x7f22c809cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56706/0 (socket says 10.20.193.51:56706) 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 -- 10.20.193.51:0/187245852 learned_addr learned my addr 10.20.193.51:0/187245852 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request con 0x7f22c80a3bb0 auth_method 0 2026-02-17T12:04:48.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_done global_id 244101 payload 274 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 -- 10.20.193.51:0/187245852 >> v2:10.20.193.142:3300/0 conn(0x7f22c8138780 msgr2=0x7f22c81403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/187245852 >> v2:10.20.193.142:3300/0 conn(0x7f22c8138780 0x7f22c81403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 -- 10.20.193.51:0/187245852 >> v1:10.20.193.142:6789/0 conn(0x7f22c809d270 legacy=0x7f22c8138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.652+0000 7f22ccdc9640 1 -- 10.20.193.51:0/187245852 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c809af60 con 0x7f22c80a3bb0 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22ccdc9640 1 -- 10.20.193.51:0/187245852 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 msgr2=0x7f22c809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/187245852 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c809cd30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f22c80a3020 tx=0x7f22b802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a4e5d9cb4c6ec1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 1 -- 10.20.193.51:0/187245852 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b803c070 con 0x7f22c80a3bb0 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: dump: 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 1 -- 10.20.193.51:0/187245852 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b802fd50 con 0x7f22c80a3bb0 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 1 -- 10.20.193.51:0/187245852 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8037660 con 0x7f22c80a3bb0 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22bf7fe640 10 monclient: dump: 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.671 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 5 monclient: authenticate success, global_id 244101 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:48.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 4 set_mon_vals no callback set 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 10 monclient: shutdown 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 -- 10.20.193.51:0/187245852 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 msgr2=0x7f22c809cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 --2- 10.20.193.51:0/187245852 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c809cd30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f22c80a3020 tx=0x7f22b802edf0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 -- 10.20.193.51:0/187245852 shutdown_connections 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 --2- 10.20.193.51:0/187245852 >> v2:10.20.193.142:3300/0 conn(0x7f22c8138780 0x7f22c81403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 --2- 10.20.193.51:0/187245852 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c809cd30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 -- 10.20.193.51:0/187245852 >> 10.20.193.51:0/187245852 conn(0x7f22c80a30c0 msgr2=0x7f22c80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 -- 10.20.193.51:0/187245852 shutdown_connections 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.655+0000 7f22cf054640 1 -- 10.20.193.51:0/187245852 wait complete. 2026-02-17T12:04:48.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient: monmap: 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 Processor -- start 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 -- start start 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient: init 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22c809d270 0x7f22c812cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-b con 0x7f22c809d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-a con 0x7f22c80a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22c8138780 0x7f22c812d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): picked mon.noname-c con 0x7f22c8138780 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8074ac0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80a3f90 con 0x7f22c809d270 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f22c8135040 con 0x7f22c8138780 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cf054640 10 monclient(hunting): authenticate will time out at 1776.275560s 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56718/0 (socket says 10.20.193.51:56718) 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 -- 10.20.193.51:0/2235329163 learned_addr learned my addr 10.20.193.51:0/2235329163 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): get_auth_request con 0x7f22c80a3bb0 auth_method 0 2026-02-17T12:04:48.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22c809d270 0x7f22c812cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request con 0x7f22c809d270 auth_method 0 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22ccdc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22ccdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22c8138780 0x7f22c812d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): get_auth_request con 0x7f22c8138780 auth_method 0 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22cd5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient(hunting): handle_auth_done global_id 244104 payload 824 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22c8138780 msgr2=0x7f22c812d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22c8138780 0x7f22c812d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22c809d270 msgr2=0x7f22c812cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f22c809d270 0x7f22c812cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.656+0000 7f22bffff640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c812ee80 con 0x7f22c80a3bb0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.658+0000 7f22bffff640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 msgr2=0x7f22c812d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.658+0000 7f22bffff640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22b000b550 tx=0x7f22b000ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0013020 con 0x7f22c80a3bb0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: dump: 2026-02-17T12:04:48.679 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b00026e0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0002ad0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 10 monclient: dump: 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.681 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22beffd640 4 set_mon_vals no callback set 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 5 monclient: authenticate success, global_id 244104 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 monclient: _renew_subs 2026-02-17T12:04:48.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c80a2ca0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 monclient: _renew_subs 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c809d7b0 con 0x7f22c80a3bb0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 0x7f22c809eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8138bb0 con 0x7f22c8130950 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 0x7f22c809eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient: get_auth_request con 0x7f22c8130950 auth_method 0 2026-02-17T12:04:48.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f22b0018400 con 0x7f22c80a3bb0 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_done global_id 244107 payload 824 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22ccdc9640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22c8074db0 con 0x7f22c8130950 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f229803dd90 0x7f2298040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.659+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(720..720 src has 323..720) ==== 4799+0+0 (secure 0 0 0) 0x7f22b0052490 con 0x7f22c80a3bb0 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.660+0000 7f22cd5ca640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f229803dd90 0x7f2298040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.660+0000 7f22cd5ca640 10 monclient: get_auth_request con 0x7f229803dd90 auth_method 0 2026-02-17T12:04:48.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22ccdc9640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 msgr2=0x7f22c809eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 0x7f22c809eb00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c80694e0 tx=0x7f22b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8047070 con 0x7f22c8130950 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 10 monclient: dump: 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.685 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f22b8043460 con 0x7f22c8130950 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 msgr2=0x7f22c809eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 0x7f22c809eb00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c80694e0 tx=0x7f22b80047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 msgr2=0x7f22c809eb00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22bd7fa640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c8130950 0x7f22c809eb00 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c80694e0 tx=0x7f22b80047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.662+0000 7f22cd5ca640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f229803dd90 0x7f2298040250 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009fb0 tx=0x7f22c400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22cf054640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22cf054640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 0x7f22c8063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22cf054640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f22c812f760 con 0x7f22c80638c0 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 0x7f22c8063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient: get_auth_request con 0x7f22c80638c0 auth_method 0 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 10 monclient(hunting): handle_auth_done global_id 244110 payload 824 2026-02-17T12:04:48.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.665+0000 7f22ccdc9640 1 -- 10.20.193.51:0/2235329163 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22c8130d30 con 0x7f22c80638c0 2026-02-17T12:04:48.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.667+0000 7f22ccdc9640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 msgr2=0x7f22c8063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.667+0000 7f22ccdc9640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 0x7f22c8063cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22b802ee30 tx=0x7f22b8009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b803c040 con 0x7f22c80638c0 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 10 monclient: dump: 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.689 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7f22b8003e70 con 0x7f22c80638c0 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 msgr2=0x7f22c8063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 0x7f22c8063cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22b802ee30 tx=0x7f22b8009340 comp rx=0 tx=0).stop 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 msgr2=0x7f22c8063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22bd7fa640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80638c0 0x7f22c8063cd0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22b802ee30 tx=0x7f22b8009340 comp rx=0 tx=0).stop 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:48.690 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12864, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.691 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.692 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:48.693 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.696 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.697 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.698 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:04:48.699 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.700 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.700 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.700 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:48.700 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f229803dd90 msgr2=0x7f2298040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f229803dd90 0x7f2298040250 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009fb0 tx=0x7f22c400d040 comp rx=0 tx=0).stop 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 10 monclient: shutdown 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 msgr2=0x7f22c812d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22b000b550 tx=0x7f22b000ba20 comp rx=0 tx=0).stop 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cd5ca640 1 -- 10.20.193.51:0/2235329163 reap_dead start 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 shutdown_connections 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 --2- 10.20.193.51:0/2235329163 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f22c80a3bb0 0x7f22c812d400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 >> 10.20.193.51:0/2235329163 conn(0x7f22c80a30c0 msgr2=0x7f22c8133ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 shutdown_connections 2026-02-17T12:04:48.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.668+0000 7f22cf054640 1 -- 10.20.193.51:0/2235329163 wait complete. 2026-02-17T12:04:48.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:48.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:04:48.702 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.765+0000 7f461b379640 10 monclient: get_monmap_and_config 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.765+0000 7f461b379640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.765+0000 7f461b379640 10 monclient: monmap: 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:48.766824+0000 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:48.766824+0000 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.770 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 Processor -- start 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 -- start start 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient: init 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f46140a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f46140a0750 0x7f461409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): picked mon.noname-a con 0x7f46140a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f461413b760 0x7f461413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): picked mon.noname-c con 0x7f461413b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461406e140 con 0x7f46140a3bb0 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f461409f910 con 0x7f46140a0750 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f461409ccd0 con 0x7f461413b760 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f461b379640 10 monclient(hunting): authenticate will time out at 1776.385629s 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f46140a0750 0x7f461409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f46140a0750 0x7f461409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56742/0 (socket says 10.20.193.51:56742) 2026-02-17T12:04:48.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 -- 10.20.193.51:0/2615386999 learned_addr learned my addr 10.20.193.51:0/2615386999 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): get_auth_request con 0x7f46140a0750 auth_method 0 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46198ef640 1 --2- 10.20.193.51:0/2615386999 >> v2:10.20.193.142:3300/0 conn(0x7f461413b760 0x7f461413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46198ef640 10 monclient(hunting): get_auth_request con 0x7f461413b760 auth_method 0 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46198ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46198ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46198ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient(hunting): handle_auth_done global_id 244113 payload 274 2026-02-17T12:04:48.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 -- 10.20.193.51:0/2615386999 >> v2:10.20.193.142:3300/0 conn(0x7f461413b760 msgr2=0x7f461413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 --2- 10.20.193.51:0/2615386999 >> v2:10.20.193.142:3300/0 conn(0x7f461413b760 0x7f461413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 -- 10.20.193.51:0/2615386999 >> v1:10.20.193.142:6789/0 conn(0x7f46140a3bb0 legacy=0x7f461409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.766+0000 7f46188ed640 1 -- 10.20.193.51:0/2615386999 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461409eec0 con 0x7f46140a0750 2026-02-17T12:04:48.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f46188ed640 1 -- 10.20.193.51:0/2615386999 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f46140a0750 msgr2=0x7f461409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f46188ed640 1 --2- 10.20.193.51:0/2615386999 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f46140a0750 0x7f461409e1d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f461409f5f0 tx=0x7f460802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c83b74f05185e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 1 -- 10.20.193.51:0/2615386999 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460803c070 con 0x7f46140a0750 2026-02-17T12:04:48.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: dump: 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 1 -- 10.20.193.51:0/2615386999 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460802fca0 con 0x7f46140a0750 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 5 monclient: authenticate success, global_id 244113 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 1 -- 10.20.193.51:0/2615386999 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608037660 con 0x7f46140a0750 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 4 set_mon_vals no callback set 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f4603fff640 10 monclient: dump: 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.784 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 10 monclient: shutdown 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 -- 10.20.193.51:0/2615386999 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f46140a0750 msgr2=0x7f461409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 --2- 10.20.193.51:0/2615386999 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f46140a0750 0x7f461409e1d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f461409f5f0 tx=0x7f460802ee60 comp rx=0 tx=0).stop 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 -- 10.20.193.51:0/2615386999 shutdown_connections 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 --2- 10.20.193.51:0/2615386999 >> v2:10.20.193.142:3300/0 conn(0x7f461413b760 0x7f461413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 --2- 10.20.193.51:0/2615386999 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f46140a0750 0x7f461409e1d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 -- 10.20.193.51:0/2615386999 >> 10.20.193.51:0/2615386999 conn(0x7f46140a30c0 msgr2=0x7f46140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 -- 10.20.193.51:0/2615386999 shutdown_connections 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.769+0000 7f461b379640 1 -- 10.20.193.51:0/2615386999 wait complete. 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient: monmap: 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:48.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 Processor -- start 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 -- start start 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient: init 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f46140a0750 0x7f46141cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): picked mon.noname-b con 0x7f46140a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140a3bb0 0x7f46141cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): picked mon.noname-c con 0x7f46140a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 0x7f4614090ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): picked mon.noname-a con 0x7f461413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f46140a04b0 con 0x7f461413b760 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f461409c850 con 0x7f46140a0750 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f461409e710 con 0x7f46140a3bb0 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f461b379640 10 monclient(hunting): authenticate will time out at 1776.389789s 2026-02-17T12:04:48.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 0x7f4614090ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 0x7f4614090ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56744/0 (socket says 10.20.193.51:56744) 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 learned_addr learned my addr 10.20.193.51:0/4293364130 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): get_auth_request con 0x7f461413b760 auth_method 0 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140a3bb0 0x7f46141cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): get_auth_request con 0x7f46140a3bb0 auth_method 0 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46188ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46190ee640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f46140a0750 0x7f46141cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46190ee640 10 monclient(hunting): get_auth_request con 0x7f46140a0750 auth_method 0 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46190ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46190ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46190ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient(hunting): handle_auth_done global_id 244116 payload 824 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140a3bb0 msgr2=0x7f46141cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140a3bb0 0x7f46141cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f46140a0750 msgr2=0x7f46141cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f46140a0750 0x7f46141cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.770+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4614092fb0 con 0x7f461413b760 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 msgr2=0x7f4614090ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46198ef640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 0x7f4614090ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4610007d80 tx=0x7f461000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610014620 con 0x7f461413b760 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: dump: 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 5 monclient: authenticate success, global_id 244116 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4610019070 con 0x7f461413b760 2026-02-17T12:04:48.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 monclient: _renew_subs 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4614094b20 con 0x7f461413b760 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610014a00 con 0x7f461413b760 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46037fe640 4 set_mon_vals no callback set 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 10 monclient: dump: 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 monclient: _renew_subs 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46140a2290 con 0x7f461413b760 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 0x7f4614091400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4614092b70 con 0x7f46140946e0 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 0x7f4614091400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient: get_auth_request con 0x7f46140946e0 auth_method 0 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f461001e460 con 0x7f461413b760 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.773+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f46190ee640 10 monclient(hunting): handle_auth_done global_id 234200 payload 824 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f46190ee640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4614077c20 con 0x7f46140946e0 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f4601ffb640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f45e403dd10 0x7f45e40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(720..720 src has 323..720) ==== 4799+0+0 (secure 0 0 0) 0x7f4610052ff0 con 0x7f461413b760 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f46188ed640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f45e403dd10 0x7f45e40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.774+0000 7f46188ed640 10 monclient: get_auth_request con 0x7f45e403dd10 auth_method 0 2026-02-17T12:04:48.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f46190ee640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 msgr2=0x7f4614091400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f46190ee640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 0x7f4614091400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f460400ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604006ae0 con 0x7f46140946e0 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 10 monclient: dump: 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.796 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f4604006ae0 con 0x7f46140946e0 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 msgr2=0x7f4614091400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 0x7f4614091400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f460400ec00 comp rx=0 tx=0).stop 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 msgr2=0x7f4614091400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f4601ffb640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f46140946e0 0x7f4614091400 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f460400ec00 comp rx=0 tx=0).stop 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.776+0000 7f46188ed640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f45e403dd10 0x7f45e40401d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4608036000 tx=0x7f4608033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f461b379640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f461b379640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 0x7f46141d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f461b379640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f46140a2c00 con 0x7f4614091940 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 0x7f46141d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient: get_auth_request con 0x7f4614091940 auth_method 0 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 10 monclient(hunting): handle_auth_done global_id 234203 payload 824 2026-02-17T12:04:48.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.779+0000 7f46190ee640 1 -- 10.20.193.51:0/4293364130 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f461409d7b0 con 0x7f4614091940 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.781+0000 7f46190ee640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 msgr2=0x7f46141d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.781+0000 7f46190ee640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 0x7f46141d8ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f4604003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460400c930 con 0x7f4614091940 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 10 monclient: dump: 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.800 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f460400c930 con 0x7f4614091940 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 msgr2=0x7f46141d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 0x7f46141d8ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f4604003860 comp rx=0 tx=0).stop 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 msgr2=0x7f46141d8ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f4601ffb640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4614091940 0x7f46141d8ab0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f460400e730 tx=0x7f4604003860 comp rx=0 tx=0).stop 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 65777, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:04:48.802 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:48.803 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:48.804 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.805 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.806 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.807 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.808 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.809 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.810 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:48.811 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f45e403dd10 msgr2=0x7f45e40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f45e403dd10 0x7f45e40401d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4608036000 tx=0x7f4608033000 comp rx=0 tx=0).stop 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 10 monclient: shutdown 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 msgr2=0x7f4614090ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 --2- 10.20.193.51:0/4293364130 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f461413b760 0x7f4614090ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4610007d80 tx=0x7f461000e4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 reap_dead start 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f46198ef640 1 -- 10.20.193.51:0/4293364130 reap_dead start 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 shutdown_connections 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 >> 10.20.193.51:0/4293364130 conn(0x7f46140a30c0 msgr2=0x7f461413abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 shutdown_connections 2026-02-17T12:04:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.782+0000 7f461b379640 1 -- 10.20.193.51:0/4293364130 wait complete. 2026-02-17T12:04:48.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:48.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:04:48.814 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:04:48.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: get_monmap_and_config 2026-02-17T12:04:48.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: monmap: 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:48.876995+0000 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:48.876995+0000 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:48.880 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 Processor -- start 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 -- start start 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: init 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f05ac0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f05ac0a0750 0x7f05ac09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-c con 0x7f05ac0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f05ac13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:48.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac06e140 con 0x7f05ac13b760 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac09f910 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac09ccd0 con 0x7f05ac0a0750 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b38fc640 10 monclient(hunting): authenticate will time out at 1776.495779s 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b1e72640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f05ac13b760 0x7f05ac13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60008/0 (socket says 10.20.193.51:60008) 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.876+0000 7f05b1e72640 1 -- 10.20.193.51:0/1324287536 learned_addr learned my addr 10.20.193.51:0/1324287536 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 1 --2- 10.20.193.51:0/1324287536 >> v2:10.20.193.142:3300/0 conn(0x7f05ac0a0750 0x7f05ac09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): get_auth_request con 0x7f05ac0a0750 auth_method 0 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient(hunting): handle_auth_done global_id 184573 payload 274 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 1 -- 10.20.193.51:0/1324287536 >> v1:10.20.193.142:6789/0 conn(0x7f05ac0a3bb0 legacy=0x7f05ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 1 -- 10.20.193.51:0/1324287536 >> v1:10.20.193.51:6789/0 conn(0x7f05ac13b760 legacy=0x7f05ac13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 1 monclient: found mon.noname-c 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:04:48.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.877+0000 7f05b0e70640 1 -- 10.20.193.51:0/1324287536 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac09eec0 con 0x7f05ac0a0750 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b0e70640 1 -- 10.20.193.51:0/1324287536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac0a0750 msgr2=0x7f05ac09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b0e70640 1 --2- 10.20.193.51:0/1324287536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac0a0750 0x7f05ac09e1d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f05a00098a0 tx=0x7f05a002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a08aa01d5b5cd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 1 -- 10.20.193.51:0/1324287536 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a003c070 con 0x7f05ac0a0750 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: dump: 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 1 -- 10.20.193.51:0/1324287536 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a002fce0 con 0x7f05ac0a0750 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 1 -- 10.20.193.51:0/1324287536 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0037660 con 0x7f05ac0a0750 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 5 monclient: authenticate success, global_id 184573 2026-02-17T12:04:48.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 4 set_mon_vals no callback set 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f059bfff640 10 monclient: dump: 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.891 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 10 monclient: shutdown 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 -- 10.20.193.51:0/1324287536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac0a0750 msgr2=0x7f05ac09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 --2- 10.20.193.51:0/1324287536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac0a0750 0x7f05ac09e1d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f05a00098a0 tx=0x7f05a002ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 -- 10.20.193.51:0/1324287536 shutdown_connections 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 --2- 10.20.193.51:0/1324287536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac0a0750 0x7f05ac09e1d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 -- 10.20.193.51:0/1324287536 >> 10.20.193.51:0/1324287536 conn(0x7f05ac0a30c0 msgr2=0x7f05ac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 -- 10.20.193.51:0/1324287536 shutdown_connections 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.880+0000 7f05b38fc640 1 -- 10.20.193.51:0/1324287536 wait complete. 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient: monmap: 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 Processor -- start 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 -- start start 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient: init 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05ac0a0750 0x7f05ac09ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-c con 0x7f05ac0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 0x7f05ac1324a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-a con 0x7f05ac0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac13b760 0x7f05ac1329e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): picked mon.noname-b con 0x7f05ac13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0a04b0 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac09c850 con 0x7f05ac13b760 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac09e710 con 0x7f05ac0a0750 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b38fc640 10 monclient(hunting): authenticate will time out at 1776.500589s 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 0x7f05ac1324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 0x7f05ac1324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56760/0 (socket says 10.20.193.51:56760) 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 -- 10.20.193.51:0/2930709456 learned_addr learned my addr 10.20.193.51:0/2930709456 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05ac0a0750 0x7f05ac09ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): get_auth_request con 0x7f05ac0a3bb0 auth_method 0 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): get_auth_request con 0x7f05ac0a0750 auth_method 0 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient(hunting): handle_auth_done global_id 244119 payload 824 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1e72640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac13b760 0x7f05ac1329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05ac0a0750 msgr2=0x7f05ac09ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f05ac0a0750 0x7f05ac09ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac13b760 msgr2=0x7f05ac1329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac13b760 0x7f05ac1329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b0e70640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac134590 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1e72640 10 monclient: get_auth_request con 0x7f05ac13b760 auth_method 0 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.881+0000 7f05b1e72640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac13b760 0x7f05ac1329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.883+0000 7f05b0e70640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 msgr2=0x7f05ac1324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.883+0000 7f05b0e70640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 0x7f05ac1324a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05a00099d0 tx=0x7f05a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0047020 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: dump: 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0042670 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a003c040 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f059b7fe640 4 set_mon_vals no callback set 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 10 monclient: dump: 2026-02-17T12:04:48.898 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 5 monclient: authenticate success, global_id 244119 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 monclient: _renew_subs 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1355b0 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 monclient: _renew_subs 2026-02-17T12:04:48.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac135b70 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 0x7f05ac135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac09dac0 con 0x7f05ac09bfd0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f05a0042a60 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b1671640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 0x7f05ac135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b1671640 10 monclient: get_auth_request con 0x7f05ac09bfd0 auth_method 0 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b1671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b1671640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.884+0000 7f05b1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f0599ffb640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057c03dd40 0x7f057c040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(720..720 src has 323..720) ==== 4799+0+0 (secure 0 0 0) 0x7f05a0077cc0 con 0x7f05ac0a3bb0 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1671640 10 monclient(hunting): handle_auth_done global_id 184576 payload 824 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1671640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05ac09d7b0 con 0x7f05ac09bfd0 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1e72640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057c03dd40 0x7f057c040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.885+0000 7f05b1e72640 10 monclient: get_auth_request con 0x7f057c03dd40 auth_method 0 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f05b1671640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 msgr2=0x7f05ac135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f05b1671640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 0x7f05ac135db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f059c00f7a0 tx=0x7f059c00fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f05b1e72640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057c03dd40 0x7f057c040200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0a2690 tx=0x7f05a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c018030 con 0x7f05ac09bfd0 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 10 monclient: dump: 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f059c00dbc0 con 0x7f05ac09bfd0 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 msgr2=0x7f05ac135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 0x7f05ac135db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f059c00f7a0 tx=0x7f059c00fc70 comp rx=0 tx=0).stop 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 msgr2=0x7f05ac135db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.887+0000 7f0599ffb640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac09bfd0 0x7f05ac135db0 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f059c00f7a0 tx=0x7f059c00fc70 comp rx=0 tx=0).stop 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b38fc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b38fc640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 0x7f05ac1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b38fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0008d0 con 0x7f05ac132f20 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 0x7f05ac1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient: get_auth_request con 0x7f05ac132f20 auth_method 0 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 10 monclient(hunting): handle_auth_done global_id 184579 payload 824 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.891+0000 7f05b1671640 1 -- 10.20.193.51:0/2930709456 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f05ac050ac0 con 0x7f05ac132f20 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f05b1671640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 msgr2=0x7f05ac1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f05b1671640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 0x7f05ac1daad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f059c018000 tx=0x7f059c003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c004230 con 0x7f05ac132f20 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 10 monclient: dump: 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.907 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f059c004230 con 0x7f05ac132f20 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 msgr2=0x7f05ac1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 0x7f05ac1daad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f059c018000 tx=0x7f059c003860 comp rx=0 tx=0).stop 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 msgr2=0x7f05ac1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:48.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.893+0000 7f0599ffb640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f05ac132f20 0x7f05ac1daad0 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f059c018000 tx=0x7f059c003860 comp rx=0 tx=0).stop 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 321280, 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:48.909 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.910 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.911 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:48.912 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:48.913 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.914 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.915 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:48.916 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.917 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:04:48.918 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:48.919 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057c03dd40 msgr2=0x7f057c040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f057c03dd40 0x7f057c040200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0a2690 tx=0x7f05a8009040 comp rx=0 tx=0).stop 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 10 monclient: shutdown 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 msgr2=0x7f05ac1324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 --2- 10.20.193.51:0/2930709456 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f05ac0a3bb0 0x7f05ac1324a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05a00099d0 tx=0x7f05a00047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b1e72640 1 -- 10.20.193.51:0/2930709456 reap_dead start 2026-02-17T12:04:48.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b1e72640 1 -- 10.20.193.51:0/2930709456 reap_dead start 2026-02-17T12:04:48.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 shutdown_connections 2026-02-17T12:04:48.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 >> 10.20.193.51:0/2930709456 conn(0x7f05ac0a30c0 msgr2=0x7f05ac072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:48.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 shutdown_connections 2026-02-17T12:04:48.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.894+0000 7f05b38fc640 1 -- 10.20.193.51:0/2930709456 wait complete. 2026-02-17T12:04:48.921 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:48.921 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:04:48.921 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.985+0000 7feafb796640 10 monclient: get_monmap_and_config 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.985+0000 7feafb796640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.985+0000 7feafb796640 10 monclient: monmap: 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:48.986590+0000 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:48.986590+0000 2026-02-17T12:04:48.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.985+0000 7feafb796640 1 Processor -- start 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 -- start start 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient: init 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7feaf40a3bb0 0x7feaf409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): picked mon.noname-a con 0x7feaf40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf409d270 0x7feaf4138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): picked mon.noname-b con 0x7feaf409d270 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feaf41385b0 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf4135430 con 0x7feaf41385b0 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7feaf409a5c0 con 0x7feaf40a3bb0 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7feaf409b520 con 0x7feaf409d270 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feafb796640 10 monclient(hunting): authenticate will time out at 1776.605335s 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7feaf40a3bb0 0x7feaf409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf9d0c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7feaf41385b0 0x7feaf413f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60012/0 (socket says 10.20.193.51:60012) 2026-02-17T12:04:48.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): get_auth_request con 0x7feaf40a3bb0 auth_method 0 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf9d0c640 1 -- 10.20.193.51:0/2951039342 learned_addr learned my addr 10.20.193.51:0/2951039342 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf409d270 0x7feaf4138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): get_auth_request con 0x7feaf409d270 auth_method 0 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:48.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient(hunting): handle_auth_done global_id 244122 payload 274 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 -- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf409d270 msgr2=0x7feaf4138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf409d270 0x7feaf4138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 -- 10.20.193.51:0/2951039342 >> v1:10.20.193.51:6789/0 conn(0x7feaf41385b0 legacy=0x7feaf413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient: _finish_hunting 0 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 monclient: found mon.noname-a 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.986+0000 7feaf950b640 1 -- 10.20.193.51:0/2951039342 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf409af60 con 0x7feaf40a3bb0 2026-02-17T12:04:48.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feaf950b640 1 -- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf40a3bb0 msgr2=0x7feaf409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feaf950b640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf40a3bb0 0x7feaf409cd30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feae40098a0 tx=0x7feae402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e76b598cd72dcf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:48.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 1 -- 10.20.193.51:0/2951039342 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae403c070 con 0x7feaf40a3bb0 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: dump: 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: _finish_auth 0 2026-02-17T12:04:48.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 1 -- 10.20.193.51:0/2951039342 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae402fc00 con 0x7feaf40a3bb0 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 5 monclient: authenticate success, global_id 244122 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 1 -- 10.20.193.51:0/2951039342 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4037440 con 0x7feaf40a3bb0 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feae3fff640 10 monclient: dump: 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:49.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 4 set_mon_vals no callback set 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 10 monclient: shutdown 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 -- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf40a3bb0 msgr2=0x7feaf409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf40a3bb0 0x7feaf409cd30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feae40098a0 tx=0x7feae402ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 -- 10.20.193.51:0/2951039342 shutdown_connections 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf409d270 0x7feaf4138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 --2- 10.20.193.51:0/2951039342 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf40a3bb0 0x7feaf409cd30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 -- 10.20.193.51:0/2951039342 >> 10.20.193.51:0/2951039342 conn(0x7feaf40a30c0 msgr2=0x7feaf40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 -- 10.20.193.51:0/2951039342 shutdown_connections 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.989+0000 7feafb796640 1 -- 10.20.193.51:0/2951039342 wait complete. 2026-02-17T12:04:49.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient: build_initial_monmap 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient: monmap: 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 Processor -- start 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 -- start start 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient: init 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:49.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feaf409d270 0x7feaf412cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): picked mon.noname-b con 0x7feaf409d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): picked mon.noname-c con 0x7feaf40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 0x7feaf412d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): picked mon.noname-a con 0x7feaf41385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4074ac0 con 0x7feaf41385b0 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40a3f90 con 0x7feaf409d270 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7feaf4135040 con 0x7feaf40a3bb0 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feafb796640 10 monclient(hunting): authenticate will time out at 1776.609601s 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 0x7feaf412d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:49.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44766/0 (socket says 10.20.193.51:44766) 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 -- 10.20.193.51:0/586744751 learned_addr learned my addr 10.20.193.51:0/586744751 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): get_auth_request con 0x7feaf40a3bb0 auth_method 0 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): get_auth_request con 0x7feaf41385b0 auth_method 0 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:49.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf950b640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feaf409d270 0x7feaf412cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf950b640 10 monclient(hunting): get_auth_request con 0x7feaf409d270 auth_method 0 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf950b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf950b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf950b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient(hunting): handle_auth_done global_id 234212 payload 824 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 -- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feaf409d270 msgr2=0x7feaf412cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feaf409d270 0x7feaf412cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 -- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 msgr2=0x7feaf412d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 0x7feaf412d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient: _finish_hunting 0 2026-02-17T12:04:49.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 monclient: found mon.noname-c 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf8d0a640 1 -- 10.20.193.51:0/586744751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4130b50 con 0x7feaf40a3bb0 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.990+0000 7feaf9d0c640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 0x7feaf412d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.992+0000 7feaf8d0a640 1 -- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 msgr2=0x7feaf412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.992+0000 7feaf8d0a640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feae800e860 tx=0x7feae800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8017070 con 0x7feaf40a3bb0 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: dump: 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:49.006 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae800cb50 con 0x7feaf40a3bb0 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8013470 con 0x7feaf40a3bb0 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 10 monclient: dump: 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:49.007 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 5 monclient: authenticate success, global_id 234212 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _renew_subs 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae37fe640 4 set_mon_vals no callback set 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf4133630 con 0x7feaf40a3bb0 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _renew_subs 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf412f420 con 0x7feaf40a3bb0 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7feae8024060 con 0x7feaf40a3bb0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4138070 con 0x7feaf40a3bb0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 0x7feac40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.993+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(720..720 src has 323..720) ==== 4799+0+0 (secure 0 0 0) 0x7feae80525e0 con 0x7feaf40a3bb0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.994+0000 7feaf950b640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 0x7feac40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.994+0000 7feaf950b640 10 monclient: get_auth_request con 0x7feac403dd10 auth_method 0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.996+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feae8050fd0 con 0x7feaf40a3bb0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.996+0000 7feae1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.996+0000 7feae1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:49.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:48.996+0000 7feaf950b640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 0x7feac40401d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feaf406f3a0 tx=0x7feae4033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feafb796640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feafb796640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feafb796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7feaf412efa0 con 0x7feaf40a3bb0 2026-02-17T12:04:49.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=10,kv=12,logm=49} crc {auth=1419607018,config=692619927,health=981976669,kv=124369429,logm=3304265011}) 2026-02-17T12:04:49.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=28,config=2,health=12,kv=12,logm=46} crc {auth=3567655644,config=692619927,health=3911963131,kv=643764953,logm=622051102}) 2026-02-17T12:04:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feae1ffb640 1 -- 10.20.193.51:0/586744751 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7feae80522c0 con 0x7feaf40a3bb0 2026-02-17T12:04:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feae1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:04:49.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.113+0000 7feae1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:49.117 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.117 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=10,kv=12,logm=49} crc {auth=1419607018,config=692619927,health=981976669,kv=124369429,logm=3304265011}) 2026-02-17T12:04:49.117 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.113+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=26,config=2,health=12,kv=10,logm=50} crc {auth=2653374254,config=692619927,health=3911963131,kv=261752509,logm=3588489907}) 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3740830254}) 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4253486521}) 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3740830254}) 2026-02-17T12:04:49.118 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.114+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2222255093}) 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 msgr2=0x7feac40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 0x7feac40401d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feaf406f3a0 tx=0x7feae4033000 comp rx=0 tx=0).stop 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 10 monclient: shutdown 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 msgr2=0x7feaf412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feae800e860 tx=0x7feae800ed30 comp rx=0 tx=0).stop 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 shutdown_connections 2026-02-17T12:04:49.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7feac403dd10 0x7feac40401d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7feaf41385b0 0x7feaf412d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7feaf40a3bb0 0x7feaf412d480 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 --2- 10.20.193.51:0/586744751 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7feaf409d270 0x7feaf412cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.114+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 >> 10.20.193.51:0/586744751 conn(0x7feaf40a30c0 msgr2=0x7feaf40a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.115+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 shutdown_connections 2026-02-17T12:04:49.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:49.115+0000 7feafb796640 1 -- 10.20.193.51:0/586744751 wait complete. 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702068925}) 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2890076897}) 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702068925}) 2026-02-17T12:04:49.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.115+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4190447251}) 2026-02-17T12:04:49.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:04:49.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456237011}) 2026-02-17T12:04:49.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2816501077}) 2026-02-17T12:04:49.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456237011}) 2026-02-17T12:04:49.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.439+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3800892167}) 2026-02-17T12:04:49.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3240202577}) 2026-02-17T12:04:49.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=152328203}) 2026-02-17T12:04:49.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3240202577}) 2026-02-17T12:04:49.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.503+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2467813544}) 2026-02-17T12:04:49.508 INFO:tasks.rados.rados.0.trial142.stdout:3142: done (2 left) 2026-02-17T12:04:49.508 INFO:tasks.rados.rados.0.trial142.stdout:3143: done (1 left) 2026-02-17T12:04:49.508 INFO:tasks.rados.rados.0.trial142.stdout:3144: done (0 left) 2026-02-17T12:04:49.508 INFO:tasks.rados.rados.0.trial142.stdout:3145: copy_from oid 13 from oid 21 current snap is 350 2026-02-17T12:04:49.509 INFO:tasks.rados.rados.0.trial142.stdout:3146: delete oid 5 current snap is 350 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1674502786}) 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1393713814}) 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1674502786}) 2026-02-17T12:04:49.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.507+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1222403663}) 2026-02-17T12:04:49.512 INFO:tasks.rados.rados.0.trial142.stdout:3146: done (1 left) 2026-02-17T12:04:49.512 INFO:tasks.rados.rados.0.trial142.stdout:3147: delete oid 47 current snap is 350 2026-02-17T12:04:49.514 INFO:tasks.rados.rados.0.trial142.stdout:3147: done (1 left) 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:3148: rollback oid 25 current snap is 350 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 25 to 317 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:3149: copy_from oid 29 from oid 8 current snap is 350 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:3150: read oid 36 snap -1 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:3150: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:04:49.515 INFO:tasks.rados.rados.0.trial142.stdout:3151: snap_remove snap 329 2026-02-17T12:04:49.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1737015301}) 2026-02-17T12:04:49.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4170660868}) 2026-02-17T12:04:49.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1737015301}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257189107}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3938367380}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=923636862}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3938367380}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=678453789}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167422543}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=135221076}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167422543}) 2026-02-17T12:04:49.518 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.516+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1126771604}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689212404}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3374240766}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689212404}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1499338679}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284291361}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=984700343}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284291361}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2344671107}) 2026-02-17T12:04:49.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078261008}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=808399024}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078261008}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2194791346}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049974592}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=936953391}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049974592}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2019214525}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359733361}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4223659007}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359733361}) 2026-02-17T12:04:49.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.518+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1947232799}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3545010156}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4126595429}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3545010156}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3181635050}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186608167}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1744424672}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186608167}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.519+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3606943763}) 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.521 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1204623068}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=722269883}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1204623068}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1302072754}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3373092340}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3070585919}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3373092340}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1946116221}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1538495652}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3099894426}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1538495652}) 2026-02-17T12:04:49.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.520+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2259812358}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615173359}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3940911819}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615173359}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4097962329}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3697643000}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2465412144}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3697643000}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.521+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3961121795}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=396341576}) 2026-02-17T12:04:49.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1229732831}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=396341576}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3837148646}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942554087}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4046362461}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942554087}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3849802272}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3653936756}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2966663232}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3653936756}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.522+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=778427222}) 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1108808027}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1796723414}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1108808027}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2426709487}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=63820667}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1917890935}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=63820667}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3817281923}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199357428}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3352098397}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199357428}) 2026-02-17T12:04:49.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=527987621}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3683788083}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2521984826}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3683788083}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=271941023}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738757787}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1225290580}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738757787}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=687303960}) 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3308946080}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1987916616}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3308946080}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.524+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2871475178}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2044084471}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1403386423}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2044084471}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3706459868}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838803370}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2601285956}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838803370}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1906667779}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622558088}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=250817690}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622558088}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.525+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=540885652}) 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4128439327}) 2026-02-17T12:04:49.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2406069592}) 2026-02-17T12:04:49.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4128439327}) 2026-02-17T12:04:49.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.526+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=195949214}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349002824}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1035014028}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349002824}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.532+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2078608967}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021469711}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3803396900}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021469711}) 2026-02-17T12:04:49.534 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=865248175}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140072803}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3391143679}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140072803}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3158303540}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4278828534}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=865238041}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4278828534}) 2026-02-17T12:04:49.535 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.533+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4036784349}) 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2773468435}) 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3259960623}) 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2773468435}) 2026-02-17T12:04:49.536 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2856705661}) 2026-02-17T12:04:49.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1318680968}) 2026-02-17T12:04:49.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2419088788}) 2026-02-17T12:04:49.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1318680968}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=853913021}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.534+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1201288490}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1622900175}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1201288490}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3182731675}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1280679181}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1744895607}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1280679181}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=193241000}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202393674}) 2026-02-17T12:04:49.538 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1114201305}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202393674}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1126538339}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277793295}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1401097068}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277793295}) 2026-02-17T12:04:49.539 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.535+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2447517712}) 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838667901}) 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3631106684}) 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838667901}) 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=927020368}) 2026-02-17T12:04:49.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813989920}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2385406602}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813989920}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.673+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3001674721}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223805917}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3075449545}) 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:49.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223805917}) 2026-02-17T12:04:49.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.674+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1088920449}) 2026-02-17T12:04:50.001 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.001 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=87743515}) 2026-02-17T12:04:50.002 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=72432749}) 2026-02-17T12:04:50.002 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.002 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=87743515}) 2026-02-17T12:04:50.002 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:49.999+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1097039506}) 2026-02-17T12:04:50.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.036 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4053013289}) 2026-02-17T12:04:50.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1564354971}) 2026-02-17T12:04:50.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4053013289}) 2026-02-17T12:04:50.037 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.034+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3145579533}) 2026-02-17T12:04:50.044 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304671446}) 2026-02-17T12:04:50.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3760816693}) 2026-02-17T12:04:50.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304671446}) 2026-02-17T12:04:50.045 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.042+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=699390395}) 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1071819147}) 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1271940243}) 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1071819147}) 2026-02-17T12:04:50.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3201806972}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753515821}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3317460753}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753515821}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2875350152}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.106+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1388449120}) 2026-02-17T12:04:50.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3413282206}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1388449120}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2138825055}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914906896}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3547281810}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914906896}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=320270957}) 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1752573653}) 2026-02-17T12:04:50.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3781489543}) 2026-02-17T12:04:50.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1752573653}) 2026-02-17T12:04:50.113 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.107+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2312400143}) 2026-02-17T12:04:50.119 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.120 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223955747}) 2026-02-17T12:04:50.120 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2014151906}) 2026-02-17T12:04:50.120 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.120 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223955747}) 2026-02-17T12:04:50.120 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.117+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=519622450}) 2026-02-17T12:04:50.125 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:04:50.126 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:50.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 10 monclient: get_monmap_and_config 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 10 monclient: monmap: 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:50.193332+0000 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:50.193332+0000 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 1 Processor -- start 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 1 -- start start 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.192+0000 7f8aa10fa640 10 monclient: init 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8a9c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c0a0750 0x7f8a9c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8a9c09e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c06e140 con 0x7f8a9c09e540 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c0a3f90 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c09f910 con 0x7f8a9c0a0750 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8aa10fa640 10 monclient(hunting): authenticate will time out at 1777.812148s 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56798/0 (socket says 10.20.193.51:56798) 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 -- 10.20.193.51:0/4036856618 learned_addr learned my addr 10.20.193.51:0/4036856618 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9b577640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8a9c09e540 0x7f8a9c13c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60014/0 (socket says 10.20.193.51:60014) 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c0a0750 0x7f8a9c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): get_auth_request con 0x7f8a9c0a3bb0 auth_method 0 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): get_auth_request con 0x7f8a9c0a0750 auth_method 0 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_done global_id 244128 payload 274 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 -- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c0a0750 msgr2=0x7f8a9c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 --2- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c0a0750 0x7f8a9c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 -- 10.20.193.51:0/4036856618 >> v1:10.20.193.51:6789/0 conn(0x7f8a9c09e540 legacy=0x7f8a9c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.193+0000 7f8a9ad76640 1 -- 10.20.193.51:0/4036856618 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c09ccd0 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.195+0000 7f8a9ad76640 1 -- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a3bb0 msgr2=0x7f8a9c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.195+0000 7f8a9ad76640 1 --2- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06c1c0 tx=0x7f8a9002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828a516c83ad815 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 1 -- 10.20.193.51:0/4036856618 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9003c070 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: dump: 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 5 monclient: authenticate success, global_id 244128 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 1 -- 10.20.193.51:0/4036856618 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9002fca0 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 1 -- 10.20.193.51:0/4036856618 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90037660 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8a99d74640 10 monclient: dump: 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.212 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 4 set_mon_vals no callback set 2026-02-17T12:04:50.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 10 monclient: shutdown 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 -- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a3bb0 msgr2=0x7f8a9c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06c1c0 tx=0x7f8a9002ee60 comp rx=0 tx=0).stop 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 -- 10.20.193.51:0/4036856618 shutdown_connections 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c0a0750 0x7f8a9c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/4036856618 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09dac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 -- 10.20.193.51:0/4036856618 >> 10.20.193.51:0/4036856618 conn(0x7f8a9c0a30c0 msgr2=0x7f8a9c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 -- 10.20.193.51:0/4036856618 shutdown_connections 2026-02-17T12:04:50.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 1 -- 10.20.193.51:0/4036856618 wait complete. 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.196+0000 7f8aa10fa640 10 monclient: monmap: 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:50.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 Processor -- start 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 -- start start 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient: init 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-c con 0x7f8a9c09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a0750 0x7f8a9c09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8a9c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0a04b0 con 0x7f8a9c0a0750 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c09c850 con 0x7f8a9c0a3bb0 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c13de80 con 0x7f8a9c09e540 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8aa10fa640 10 monclient(hunting): authenticate will time out at 1777.816488s 2026-02-17T12:04:50.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44790/0 (socket says 10.20.193.51:44790) 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 -- 10.20.193.51:0/450552628 learned_addr learned my addr 10.20.193.51:0/450552628 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): get_auth_request con 0x7f8a9c09e540 auth_method 0 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a0750 0x7f8a9c09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): get_auth_request con 0x7f8a9c0a0750 auth_method 0 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient(hunting): handle_auth_done global_id 234218 payload 824 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 -- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a9c0a3bb0 msgr2=0x7f8a9c09ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 -- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a0750 msgr2=0x7f8a9c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a0750 0x7f8a9c09a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 monclient: found mon.noname-c 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.197+0000 7f8a9ad76640 1 -- 10.20.193.51:0/450552628 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c09c490 con 0x7f8a9c09e540 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a9ad76640 1 -- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 msgr2=0x7f8a9c13ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a9ad76640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a90002410 tx=0x7f8a90004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9003c040 con 0x7f8a9c09e540 2026-02-17T12:04:50.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: dump: 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.221 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a90047070 con 0x7f8a9c09e540 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a900428b0 con 0x7f8a9c09e540 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a99573640 4 set_mon_vals no callback set 2026-02-17T12:04:50.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8a7b7fe640 10 monclient: dump: 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.223 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8aa10fa640 5 monclient: authenticate success, global_id 234218 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8aa10fa640 10 monclient: _renew_subs 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8aa10fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.199+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c13bda0 con 0x7f8a9c09e540 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 10 monclient: _renew_subs 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c06f410 con 0x7f8a9c09e540 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8a90042a50 con 0x7f8a9c09e540 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c09d7b0 con 0x7f8a9c09e540 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8a7b7fe640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 0x7f8a680401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(721..721 src has 323..721) ==== 4799+0+0 (secure 0 0 0) 0x7f8a900778d0 con 0x7f8a9c09e540 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8a9a575640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 0x7f8a680401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.200+0000 7f8a9a575640 10 monclient: get_auth_request con 0x7f8a6803dd10 auth_method 0 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.203+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8a90035340 con 0x7f8a9c09e540 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.203+0000 7f8a7b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.203+0000 7f8a7b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:50.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.203+0000 7f8a9a575640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 0x7f8a680401d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c13bfb0 tx=0x7f8a84009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8aa10fa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8aa10fa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8aa10fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8a9c09dac0 con 0x7f8a9c09e540 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8a7b7fe640 1 -- 10.20.193.51:0/450552628 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f8a90042e20 con 0x7f8a9c09e540 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8a7b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:50.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.316+0000 7f8a7b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:50.320 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:50.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 msgr2=0x7f8a680401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 0x7f8a680401d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c13bfb0 tx=0x7f8a84009290 comp rx=0 tx=0).stop 2026-02-17T12:04:50.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 10 monclient: shutdown 2026-02-17T12:04:50.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 msgr2=0x7f8a9c13ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a90002410 tx=0x7f8a90004830 comp rx=0 tx=0).stop 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 shutdown_connections 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a6803dd10 0x7f8a680401d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a9c0a3bb0 0x7f8a9c09ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a9c0a0750 0x7f8a9c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 --2- 10.20.193.51:0/450552628 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a9c09e540 0x7f8a9c13ceb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 >> 10.20.193.51:0/450552628 conn(0x7f8a9c0a30c0 msgr2=0x7f8a9c0996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 shutdown_connections 2026-02-17T12:04:50.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.317+0000 7f8aa10fa640 1 -- 10.20.193.51:0/450552628 wait complete. 2026-02-17T12:04:50.327 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:04:50.327 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:04:50.327 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:04:50.327 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: get_monmap_and_config 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: monmap: 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.399 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:50.395112+0000 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:50.395112+0000 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:50.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 Processor -- start 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 -- start start 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: init 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7faa900a3bb0 0x7faa9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): picked mon.noname-c con 0x7faa900a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 0x7faa9009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): picked mon.noname-a con 0x7faa900a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): picked mon.noname-b con 0x7faa9009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7faa900a3f90 con 0x7faa900a0750 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7faa9006e140 con 0x7faa900a3bb0 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faa9009f910 con 0x7faa9009e540 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.394+0000 7faa97779640 10 monclient(hunting): authenticate will time out at 1778.013935s 2026-02-17T12:04:50.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 0x7faa9009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44796/0 (socket says 10.20.193.51:44796) 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 -- 10.20.193.51:0/2442038336 learned_addr learned my addr 10.20.193.51:0/2442038336 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): get_auth_request con 0x7faa9009e540 auth_method 0 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): get_auth_request con 0x7faa900a0750 auth_method 0 2026-02-17T12:04:50.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa954ee640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.142:3300/0 conn(0x7faa900a3bb0 0x7faa9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa954ee640 10 monclient(hunting): get_auth_request con 0x7faa900a3bb0 auth_method 0 2026-02-17T12:04:50.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa954ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa954ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa954ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient(hunting): handle_auth_done global_id 234221 payload 274 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 -- 10.20.193.51:0/2442038336 >> v2:10.20.193.142:3300/0 conn(0x7faa900a3bb0 msgr2=0x7faa9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.142:3300/0 conn(0x7faa900a3bb0 0x7faa9009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 -- 10.20.193.51:0/2442038336 >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 msgr2=0x7faa9009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 0x7faa9009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 monclient: found mon.noname-b 2026-02-17T12:04:50.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa95cef640 1 -- 10.20.193.51:0/2442038336 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9009ccd0 con 0x7faa9009e540 2026-02-17T12:04:50.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.395+0000 7faa94ced640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 0x7faa9009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:04:50.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa95cef640 1 -- 10.20.193.51:0/2442038336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 msgr2=0x7faa9013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa95cef640 1 --2- 10.20.193.51:0/2442038336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa9006c1c0 tx=0x7faa8c02f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7bab76427d854a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 1 -- 10.20.193.51:0/2442038336 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c02fe50 con 0x7faa9009e540 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: dump: 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.417 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 1 -- 10.20.193.51:0/2442038336 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c0373f0 con 0x7faa9009e540 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa97779640 5 monclient: authenticate success, global_id 234221 2026-02-17T12:04:50.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa97779640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 1 -- 10.20.193.51:0/2442038336 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0377c0 con 0x7faa9009e540 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa7ffff640 10 monclient: dump: 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.419 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa97779640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.397+0000 7faa97779640 4 set_mon_vals no callback set 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 10 monclient: shutdown 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 -- 10.20.193.51:0/2442038336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 msgr2=0x7faa9013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 --2- 10.20.193.51:0/2442038336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa9006c1c0 tx=0x7faa8c02f1e0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 -- 10.20.193.51:0/2442038336 shutdown_connections 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 --2- 10.20.193.51:0/2442038336 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa9009e540 0x7faa9013c760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.51:3300/0 conn(0x7faa900a0750 0x7faa9009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 --2- 10.20.193.51:0/2442038336 >> v2:10.20.193.142:3300/0 conn(0x7faa900a3bb0 0x7faa9009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 -- 10.20.193.51:0/2442038336 >> 10.20.193.51:0/2442038336 conn(0x7faa900a30c0 msgr2=0x7faa900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 -- 10.20.193.51:0/2442038336 shutdown_connections 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 1 -- 10.20.193.51:0/2442038336 wait complete. 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.398+0000 7faa97779640 10 monclient: monmap: 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:50.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 Processor -- start 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 -- start start 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient: init 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 0x7faa90099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): picked mon.noname-a con 0x7faa9009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa900a0750 0x7faa90099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): picked mon.noname-c con 0x7faa900a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa900a3bb0 0x7faa90092530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): picked mon.noname-b con 0x7faa900a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faa900a04b0 con 0x7faa9009e540 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7faa9009c850 con 0x7faa900a3bb0 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7faa9013cca0 con 0x7faa900a0750 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa97779640 10 monclient(hunting): authenticate will time out at 1778.018382s 2026-02-17T12:04:50.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 0x7faa90099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 0x7faa90099910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56818/0 (socket says 10.20.193.51:56818) 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 -- 10.20.193.51:0/3520923338 learned_addr learned my addr 10.20.193.51:0/3520923338 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): get_auth_request con 0x7faa9009e540 auth_method 0 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa900a0750 0x7faa90099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): get_auth_request con 0x7faa900a0750 auth_method 0 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient(hunting): handle_auth_done global_id 244137 payload 824 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa900a0750 msgr2=0x7faa90099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa95cef640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa900a3bb0 0x7faa90092530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7faa900a0750 0x7faa90099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa900a3bb0 msgr2=0x7faa90092530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7faa900a3bb0 0x7faa90092530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.399+0000 7faa954ee640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90095f00 con 0x7faa9009e540 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa954ee640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 msgr2=0x7faa90099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa954ee640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 0x7faa90099910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e7c0 tx=0x7faa8000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80017070 con 0x7faa9009e540 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: dump: 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.428 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8000cae0 con 0x7faa9009e540 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 5 monclient: authenticate success, global_id 244137 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 10 monclient: _renew_subs 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa900961e0 con 0x7faa9009e540 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000f040 con 0x7faa9009e540 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7f7fe640 4 set_mon_vals no callback set 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa7dffb640 10 monclient: dump: 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 10 monclient: _renew_subs 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.401+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa900a2d40 con 0x7faa9009e540 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa97779640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa97779640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 0x7faa90092a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faa90068450 con 0x7faa901ccee0 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 0x7faa90092a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient: get_auth_request con 0x7faa901ccee0 auth_method 0 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7faa80012050 con 0x7faa9009e540 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 10 monclient(hunting): handle_auth_done global_id 244140 payload 824 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa94ced640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa9009d7b0 con 0x7faa901ccee0 2026-02-17T12:04:50.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa7dffb640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa6003dd10 0x7faa600401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.402+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(721..721 src has 323..721) ==== 4799+0+0 (secure 0 0 0) 0x7faa80052470 con 0x7faa9009e540 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.403+0000 7faa95cef640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa6003dd10 0x7faa600401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.403+0000 7faa95cef640 10 monclient: get_auth_request con 0x7faa6003dd10 auth_method 0 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa94ced640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 msgr2=0x7faa90092a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa94ced640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 0x7faa90092a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa90093dd0 tx=0x7faa8400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8400fe80 con 0x7faa901ccee0 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 10 monclient: dump: 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.433 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7faa8400fe80 con 0x7faa901ccee0 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.404+0000 7faa7dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.405+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 msgr2=0x7faa90092a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.405+0000 7faa7dffb640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 0x7faa90092a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa90093dd0 tx=0x7faa8400f610 comp rx=0 tx=0).stop 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.405+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 msgr2=0x7faa90092a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.405+0000 7faa7dffb640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa901ccee0 0x7faa90092a70 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa90093dd0 tx=0x7faa8400f610 comp rx=0 tx=0).stop 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.405+0000 7faa95cef640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa6003dd10 0x7faa600401d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa9006f3c0 tx=0x7faa8c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa97779640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa97779640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 0x7faa901d8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa97779640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7faa900933c0 con 0x7faa90092fb0 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 0x7faa901d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient: get_auth_request con 0x7faa90092fb0 auth_method 0 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 10 monclient(hunting): handle_auth_done global_id 244143 payload 824 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.408+0000 7faa94ced640 1 -- 10.20.193.51:0/3520923338 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa90096420 con 0x7faa90092fb0 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa94ced640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 msgr2=0x7faa901d8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa94ced640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 0x7faa901d8020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa8401c000 tx=0x7faa840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84014850 con 0x7faa90092fb0 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 10 monclient: dump: 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7faa8402c410 con 0x7faa90092fb0 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 msgr2=0x7faa901d8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 0x7faa901d8020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa8401c000 tx=0x7faa840047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 msgr2=0x7faa901d8020 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.410+0000 7faa7dffb640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa90092fb0 0x7faa901d8020 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa8401c000 tx=0x7faa840047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 14606, 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:50.438 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.439 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.440 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:50.441 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.442 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.443 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.444 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.445 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.446 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:50.447 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa6003dd10 msgr2=0x7faa600401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7faa6003dd10 0x7faa600401d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa9006f3c0 tx=0x7faa8c033000 comp rx=0 tx=0).stop 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 10 monclient: shutdown 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 msgr2=0x7faa90099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 --2- 10.20.193.51:0/3520923338 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7faa9009e540 0x7faa90099910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e7c0 tx=0x7faa8000ec90 comp rx=0 tx=0).stop 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa95cef640 1 -- 10.20.193.51:0/3520923338 reap_dead start 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa95cef640 1 -- 10.20.193.51:0/3520923338 reap_dead start 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 shutdown_connections 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 >> 10.20.193.51:0/3520923338 conn(0x7faa900a30c0 msgr2=0x7faa90072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 shutdown_connections 2026-02-17T12:04:50.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.411+0000 7faa97779640 1 -- 10.20.193.51:0/3520923338 wait complete. 2026-02-17T12:04:50.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:50.450 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:04:50.450 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923401730}) 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1231390178}) 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923401730}) 2026-02-17T12:04:50.517 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.515+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=653151695}) 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.516+0000 7f824c25b640 10 monclient: get_monmap_and_config 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.516+0000 7f824c25b640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.516+0000 7f824c25b640 10 monclient: monmap: 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:50.517870+0000 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:50.517870+0000 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:50.518 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 Processor -- start 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 -- start start 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient: init 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f82440a3bb0 0x7f824409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-a con 0x7f82440a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:50.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f82440a0750 0x7f824409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2540737752}) 2026-02-17T12:04:50.519 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3956089824}) 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-c con 0x7f82440a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:50.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2540737752}) 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f824409e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824406e140 con 0x7f824409e540 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f82440a3f90 con 0x7f82440a3bb0 2026-02-17T12:04:50.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.520 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.517+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2161146231}) 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f824409f910 con 0x7f82440a0750 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824c25b640 10 monclient(hunting): authenticate will time out at 1778.136813s 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f8249fd0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f82440a3bb0 0x7f824409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f8249fd0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f82440a3bb0 0x7f824409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56838/0 (socket says 10.20.193.51:56838) 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f824a7d1640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f824409e540 0x7f824413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:43034/0 (socket says 10.20.193.51:43034) 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.517+0000 7f8249fd0640 1 -- 10.20.193.51:0/3126190673 learned_addr learned my addr 10.20.193.51:0/3126190673 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): get_auth_request con 0x7f82440a3bb0 auth_method 0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f82497cf640 1 --2- 10.20.193.51:0/3126190673 >> v2:10.20.193.142:3300/0 conn(0x7f82440a0750 0x7f824409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f82497cf640 10 monclient(hunting): get_auth_request con 0x7f82440a0750 auth_method 0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f82497cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f82497cf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f82497cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient(hunting): handle_auth_done global_id 244146 payload 274 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 1 -- 10.20.193.51:0/3126190673 >> v2:10.20.193.142:3300/0 conn(0x7f82440a0750 msgr2=0x7f824409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3126190673 >> v2:10.20.193.142:3300/0 conn(0x7f82440a0750 0x7f824409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 1 -- 10.20.193.51:0/3126190673 >> v1:10.20.193.142:6789/0 conn(0x7f824409e540 legacy=0x7f824413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.518+0000 7f8249fd0640 1 -- 10.20.193.51:0/3126190673 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824409ccd0 con 0x7f82440a3bb0 2026-02-17T12:04:50.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.520+0000 7f8249fd0640 1 -- 10.20.193.51:0/3126190673 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 msgr2=0x7f824409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.522 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.520+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3126190673 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824409dac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f824406c1c0 tx=0x7f823402edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bdf378708267b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2014415205}) 2026-02-17T12:04:50.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1739930234}) 2026-02-17T12:04:50.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2014415205}) 2026-02-17T12:04:50.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.523+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2011229076}) 2026-02-17T12:04:50.533 INFO:tasks.rados.rados.0.trial142.stdout:3151: done (4 left) 2026-02-17T12:04:50.533 INFO:tasks.rados.rados.0.trial142.stdout:3152: snap_create 2026-02-17T12:04:50.533 INFO:tasks.rados.rados.0.trial142.stdout:3148: finishing rollback tid 0 to trial14245205-25 2026-02-17T12:04:50.533 INFO:tasks.rados.rados.0.trial142.stdout:3150: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 1 -- 10.20.193.51:0/3126190673 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823403c070 con 0x7f82440a3bb0 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: dump: 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.535 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 1 -- 10.20.193.51:0/3126190673 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823402fc70 con 0x7f82440a3bb0 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 1 -- 10.20.193.51:0/3126190673 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037660 con 0x7f82440a3bb0 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 5 monclient: authenticate success, global_id 244146 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 4 set_mon_vals no callback set 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f8248fce640 10 monclient: dump: 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.537 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 10 monclient: shutdown 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 -- 10.20.193.51:0/3126190673 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 msgr2=0x7f824409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 --2- 10.20.193.51:0/3126190673 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824409dac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f824406c1c0 tx=0x7f823402edf0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 -- 10.20.193.51:0/3126190673 shutdown_connections 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 --2- 10.20.193.51:0/3126190673 >> v2:10.20.193.142:3300/0 conn(0x7f82440a0750 0x7f824409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 --2- 10.20.193.51:0/3126190673 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824409dac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 -- 10.20.193.51:0/3126190673 >> 10.20.193.51:0/3126190673 conn(0x7f82440a30c0 msgr2=0x7f82440a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 -- 10.20.193.51:0/3126190673 shutdown_connections 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 1 -- 10.20.193.51:0/3126190673 wait complete. 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.525+0000 7f824c25b640 10 monclient: monmap: 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.539 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 Processor -- start 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 -- start start 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient: init 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f824409e540 0x7f8244099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-b con 0x7f824409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82440a0750 0x7f8244099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-c con 0x7f82440a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): picked mon.noname-a con 0x7f82440a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f82440a04b0 con 0x7f82440a3bb0 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f824409c850 con 0x7f824409e540 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f824413de80 con 0x7f82440a0750 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824c25b640 10 monclient(hunting): authenticate will time out at 1778.145577s 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56844/0 (socket says 10.20.193.51:56844) 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82440a0750 0x7f8244099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 learned_addr learned my addr 10.20.193.51:0/3110537296 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): get_auth_request con 0x7f82440a3bb0 auth_method 0 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): get_auth_request con 0x7f82440a0750 auth_method 0 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f82497cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient(hunting): handle_auth_done global_id 244149 payload 824 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82440a0750 msgr2=0x7f8244099f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82440a0750 0x7f8244099f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f824409e540 msgr2=0x7f8244099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f824409e540 0x7f8244099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.526+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82440921a0 con 0x7f82440a3bb0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.528+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 msgr2=0x7f824408e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.528+0000 7f824a7d1640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f824000cb20 tx=0x7f824000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240017070 con 0x7f82440a3bb0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: dump: 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.545 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824000ae00 con 0x7f82440a3bb0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 5 monclient: authenticate success, global_id 244149 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 monclient: _renew_subs 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824406f730 con 0x7f82440a3bb0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240012640 con 0x7f82440a3bb0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 10 monclient: dump: 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8233fff640 4 set_mon_vals no callback set 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 monclient: _renew_subs 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8244091ec0 con 0x7f82440a3bb0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8240007070 con 0x7f82440a3bb0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 0x7f824408ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f82440a2c70 con 0x7f82441cd1b0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 0x7f824408ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient: get_auth_request con 0x7f82441cd1b0 auth_method 0 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f821403dd10 0x7f82140401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7f82400527a0 con 0x7f82440a3bb0 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 10 monclient(hunting): handle_auth_done global_id 234230 payload 824 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.529+0000 7f8249fd0640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f824409dac0 con 0x7f82441cd1b0 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.530+0000 7f82497cf640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f821403dd10 0x7f82140401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.530+0000 7f82497cf640 10 monclient: get_auth_request con 0x7f821403dd10 auth_method 0 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f8249fd0640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 msgr2=0x7f824408ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 0x7f824408ebe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8234036000 tx=0x7f823402fca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234046070 con 0x7f82441cd1b0 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 10 monclient: dump: 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.550 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8234037b60 con 0x7f82441cd1b0 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 msgr2=0x7f824408ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 0x7f824408ebe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8234036000 tx=0x7f823402fca0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 msgr2=0x7f824408ebe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82327fc640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f82441cd1b0 0x7f824408ebe0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8234036000 tx=0x7f823402fca0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.532+0000 7f82497cf640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f821403dd10 0x7f82140401d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f824408fc70 tx=0x7f8238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f824c25b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f824c25b640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 0x7f82441d82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f824c25b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f824408f530 con 0x7f824408f120 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 0x7f82441d82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient: get_auth_request con 0x7f824408f120 auth_method 0 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 10 monclient(hunting): handle_auth_done global_id 234233 payload 824 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.535+0000 7f8249fd0640 1 -- 10.20.193.51:0/3110537296 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8244090800 con 0x7f824408f120 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.537+0000 7f8249fd0640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 msgr2=0x7f82441d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.537+0000 7f8249fd0640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 0x7f82441d82b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f823402ee30 tx=0x7f8234008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823403c040 con 0x7f824408f120 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 10 monclient: dump: 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.554 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f823404bad0 con 0x7f824408f120 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 msgr2=0x7f82441d82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 0x7f82441d82b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f823402ee30 tx=0x7f8234008030 comp rx=0 tx=0).stop 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 msgr2=0x7f82441d82b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f82327fc640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f824408f120 0x7f82441d82b0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f823402ee30 tx=0x7f8234008030 comp rx=0 tx=0).stop 2026-02-17T12:04:50.555 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 67533, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:50.556 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.557 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:50.558 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.559 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.560 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:50.561 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.562 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.563 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.564 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:50.565 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f821403dd10 msgr2=0x7f82140401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f821403dd10 0x7f82140401d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f824408fc70 tx=0x7f8238008040 comp rx=0 tx=0).stop 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 10 monclient: shutdown 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 msgr2=0x7f824408e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824a7d1640 1 -- 10.20.193.51:0/3110537296 reap_dead start 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f824000cb20 tx=0x7f824000a060 comp rx=0 tx=0).stop 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 shutdown_connections 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 --2- 10.20.193.51:0/3110537296 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f82440a3bb0 0x7f824408e6a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 >> 10.20.193.51:0/3110537296 conn(0x7f82440a30c0 msgr2=0x7f8244072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 shutdown_connections 2026-02-17T12:04:50.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.538+0000 7f824c25b640 1 -- 10.20.193.51:0/3110537296 wait complete. 2026-02-17T12:04:50.567 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:50.567 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:04:50.567 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:04:50.600 INFO:tasks.rados.rados.0.trial142.stdout:3148: finishing rollback tid 1 to trial14245205-25 2026-02-17T12:04:50.600 INFO:tasks.rados.rados.0.trial142.stdout:3148: finishing rollback tid 2 to trial14245205-25 2026-02-17T12:04:50.600 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2692 (ObjNum 967 snap 312 seq_num 967) dirty exists 2026-02-17T12:04:50.600 INFO:tasks.rados.rados.0.trial142.stdout:3145: finishing copy_from racing read to trial14245205-13 2026-02-17T12:04:50.600 INFO:tasks.rados.rados.0.trial142.stdout:3149: finishing copy_from racing read to trial14245205-29 2026-02-17T12:04:50.601 INFO:tasks.rados.rados.0.trial142.stdout:3145: finishing copy_from to trial14245205-13 2026-02-17T12:04:50.601 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 2161 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:04:50.601 INFO:tasks.rados.rados.0.trial142.stdout:3149: finishing copy_from to trial14245205-29 2026-02-17T12:04:50.601 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2714 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.631+0000 7f037d45b640 10 monclient: get_monmap_and_config 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.631+0000 7f037d45b640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.631+0000 7f037d45b640 10 monclient: monmap: 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:50.632782+0000 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:50.632782+0000 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.636 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 Processor -- start 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 -- start start 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient: init 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f03780a3bb0 0x7f037809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-a con 0x7f03780a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f03780a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f037813b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037806e140 con 0x7f037813b760 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037809f910 con 0x7f03780a0750 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f037809ccd0 con 0x7f03780a3bb0 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f037d45b640 10 monclient(hunting): authenticate will time out at 1778.251608s 2026-02-17T12:04:50.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f03780a3bb0 0x7f037809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f03777fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f037813b760 0x7f037813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:60028/0 (socket says 10.20.193.51:60028) 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f03777fe640 1 -- 10.20.193.51:0/296991117 learned_addr learned my addr 10.20.193.51:0/296991117 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): get_auth_request con 0x7f03780a3bb0 auth_method 0 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient(hunting): handle_auth_done global_id 244152 payload 274 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 1 -- 10.20.193.51:0/296991117 >> v1:10.20.193.142:6789/0 conn(0x7f03780a0750 legacy=0x7f037809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 1 -- 10.20.193.51:0/296991117 >> v1:10.20.193.51:6789/0 conn(0x7f037813b760 legacy=0x7f037813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.632+0000 7f0376ffd640 1 -- 10.20.193.51:0/296991117 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037809eec0 con 0x7f03780a3bb0 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0376ffd640 1 -- 10.20.193.51:0/296991117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a3bb0 msgr2=0x7f037809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0376ffd640 1 --2- 10.20.193.51:0/296991117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a3bb0 0x7f037809dac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098a0 tx=0x7f036c02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a1f39e5e7de59b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 1 -- 10.20.193.51:0/296991117 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03c070 con 0x7f03780a3bb0 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: dump: 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.647 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 1 -- 10.20.193.51:0/296991117 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c02fce0 con 0x7f03780a3bb0 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 5 monclient: authenticate success, global_id 244152 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 1 -- 10.20.193.51:0/296991117 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037660 con 0x7f03780a3bb0 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f0375ffb640 10 monclient: dump: 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.649 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 4 set_mon_vals no callback set 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 10 monclient: shutdown 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.635+0000 7f037d45b640 1 -- 10.20.193.51:0/296991117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a3bb0 msgr2=0x7f037809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 --2- 10.20.193.51:0/296991117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a3bb0 0x7f037809dac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098a0 tx=0x7f036c02ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 -- 10.20.193.51:0/296991117 shutdown_connections 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 --2- 10.20.193.51:0/296991117 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a3bb0 0x7f037809dac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 -- 10.20.193.51:0/296991117 >> 10.20.193.51:0/296991117 conn(0x7f03780a30c0 msgr2=0x7f03780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 -- 10.20.193.51:0/296991117 shutdown_connections 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 -- 10.20.193.51:0/296991117 wait complete. 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 10 monclient: monmap: 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.651 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 Processor -- start 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 -- start start 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 10 monclient: init 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.636+0000 7f037d45b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-a con 0x7f03780a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f03780a3bb0 0x7f03781cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-c con 0x7f03780a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f037813b760 0x7f0378090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): picked mon.noname-b con 0x7f037813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f03780a04b0 con 0x7f03780a0750 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f037809c850 con 0x7f037813b760 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f037809e710 con 0x7f03780a3bb0 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f037d45b640 10 monclient(hunting): authenticate will time out at 1778.256032s 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56866/0 (socket says 10.20.193.51:56866) 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 -- 10.20.193.51:0/30215611 learned_addr learned my addr 10.20.193.51:0/30215611 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): get_auth_request con 0x7f03780a0750 auth_method 0 2026-02-17T12:04:50.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f03780a3bb0 0x7f03781cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): get_auth_request con 0x7f03780a3bb0 auth_method 0 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03777fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f037813b760 0x7f0378090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03777fe640 10 monclient(hunting): get_auth_request con 0x7f037813b760 auth_method 0 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient(hunting): handle_auth_done global_id 244155 payload 824 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f03780a3bb0 msgr2=0x7f03781cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f03780a3bb0 0x7f03781cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f037813b760 msgr2=0x7f0378090dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f037813b760 0x7f0378090dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 monclient: found mon.noname-a 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f0376ffd640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378094600 con 0x7f03780a0750 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.637+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f03780a3bb0 0x7f03781cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f0376ffd640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 msgr2=0x7f03781cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f0376ffd640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f036c0099d0 tx=0x7f036c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c047020 con 0x7f03780a0750 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: dump: 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.656 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c042670 con 0x7f03780a0750 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03c040 con 0x7f03780a0750 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 5 monclient: authenticate success, global_id 244155 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03757fa640 4 set_mon_vals no callback set 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 10 monclient: _renew_subs 2026-02-17T12:04:50.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03780948e0 con 0x7f03780a0750 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f03577fe640 10 monclient: dump: 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.658 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 10 monclient: _renew_subs 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.639+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037809d7b0 con 0x7f03780a0750 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f037d45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f037d45b640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 0x7f03780916f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0378094c20 con 0x7f0378091310 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f036c042a60 con 0x7f03780a0750 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 0x7f03780916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient: get_auth_request con 0x7f0378091310 auth_method 0 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03577fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f034403dd60 0x7f0344040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7f036c077ce0 con 0x7f03780a0750 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03777fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f034403dd60 0x7f0344040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 10 monclient(hunting): handle_auth_done global_id 184594 payload 824 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03767fc640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03780a2490 con 0x7f0378091310 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.640+0000 7f03777fe640 10 monclient: get_auth_request con 0x7f034403dd60 auth_method 0 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03767fc640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 msgr2=0x7f03780916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 0x7f03780916f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0378092550 tx=0x7f036000ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360018020 con 0x7f0378091310 2026-02-17T12:04:50.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 10 monclient: dump: 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f036000de30 con 0x7f0378091310 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 msgr2=0x7f03780916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 0x7f03780916f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0378092550 tx=0x7f036000ff80 comp rx=0 tx=0).stop 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 msgr2=0x7f03780916f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03577fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091310 0x7f03780916f0 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0378092550 tx=0x7f036000ff80 comp rx=0 tx=0).stop 2026-02-17T12:04:50.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.643+0000 7f03777fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f034403dd60 0x7f0344040220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f037806dab0 tx=0x7f0368009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f037d45b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f037d45b640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 0x7f03781d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f037d45b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f037809dac0 con 0x7f0378091c30 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 0x7f03781d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient: get_auth_request con 0x7f0378091c30 auth_method 0 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 10 monclient(hunting): handle_auth_done global_id 184597 payload 824 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.646+0000 7f03767fc640 1 -- 10.20.193.51:0/30215611 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0378092d10 con 0x7f0378091c30 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03767fc640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 msgr2=0x7f03781d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03767fc640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 0x7f03781d8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0360019000 tx=0x7f0360003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360018070 con 0x7f0378091c30 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 10 monclient: dump: 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.665 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f0360014a90 con 0x7f0378091c30 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 msgr2=0x7f03781d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 0x7f03781d8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0360019000 tx=0x7f0360003860 comp rx=0 tx=0).stop 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 msgr2=0x7f03781d8ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:50.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03577fe640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0378091c30 0x7f03781d8ab0 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0360019000 tx=0x7f0360003860 comp rx=0 tx=0).stop 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 182, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 323036, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:04:50.667 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:04:50.668 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:04:50.669 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:04:50.670 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:04:50.671 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.672 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.673 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.674 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.675 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:04:50.676 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f034403dd60 msgr2=0x7f0344040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f034403dd60 0x7f0344040220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f037806dab0 tx=0x7f0368009040 comp rx=0 tx=0).stop 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 10 monclient: shutdown 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 msgr2=0x7f03781cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f036c0099d0 tx=0x7f036c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f03777fe640 1 -- 10.20.193.51:0/30215611 reap_dead start 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 shutdown_connections 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 --2- 10.20.193.51:0/30215611 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f03780a0750 0x7f03781cdab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 >> 10.20.193.51:0/30215611 conn(0x7f03780a30c0 msgr2=0x7f037813ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 shutdown_connections 2026-02-17T12:04:50.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.649+0000 7f037d45b640 1 -- 10.20.193.51:0/30215611 wait complete. 2026-02-17T12:04:50.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3574559530}) 2026-02-17T12:04:50.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3541762821}) 2026-02-17T12:04:50.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:04:50.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3574559530}) 2026-02-17T12:04:50.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:04:50.650+0000 7f13cb9b4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1054010984}) 2026-02-17T12:04:50.679 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:04:50.679 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T12:04:50.680 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:04:50.680 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T12:04:50.680 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:04:50.680 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:04:50.680 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:04:50.688 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:04:50.688 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:04:50.688 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 10 monclient: get_monmap_and_config 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 10 monclient: monmap: 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:50.795353+0000 2026-02-17T12:04:50.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:50.795353+0000 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:50.799 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 1 Processor -- start 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 1 -- start start 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.794+0000 7f5bf187c640 10 monclient: init 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5bec0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5bec13b380 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f5bec13ee90 0x7f5bec141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-a con 0x7f5bec13ee90 addr v2:10.20.193.51:3300/0 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec135430 con 0x7f5bec13b380 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec09af60 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f5bec09a5c0 con 0x7f5bec13ee90 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bf187c640 10 monclient(hunting): authenticate will time out at 1778.414131s 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5bea7fc640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f5bec13b380 legacy=0x7f5bec13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5beb7fe640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f5bec13ee90 msgr2=0x7f5bec141280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5beb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f5bec13ee90 0x7f5bec141280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:50.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5beaffd640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f5bec0a3bb0 0x7f5bec09cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:43054/0 (socket says 10.20.193.51:43054) 2026-02-17T12:04:50.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.795+0000 7f5beaffd640 1 -- 10.20.193.51:0/3224549970 learned_addr learned my addr 10.20.193.51:0/3224549970 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:50.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5beaffd640 1 -- 10.20.193.51:0/3224549970 >> v1:10.20.193.142:6789/0 conn(0x7f5bec0a3bb0 legacy=0x7f5bec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756574783 0 0) 0x7f5bec09af60 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient(hunting): _negotiate 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient(hunting): my global_id is 184600 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd8003620 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1476099493 0 0) 0x7f5bd8003620 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 >> v2:10.20.193.51:3300/0 conn(0x7f5bec13ee90 msgr2=0x7f5bec141280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 --2- 10.20.193.51:0/3224549970 >> v2:10.20.193.51:3300/0 conn(0x7f5bec13ee90 0x7f5bec141280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 >> v1:10.20.193.51:6789/0 conn(0x7f5bec13b380 legacy=0x7f5bec13d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec09b240 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5bf187c640 5 monclient: authenticate success, global_id 184600 2026-02-17T12:04:50.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5bf187c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f5be00031b0 con 0x7f5bec0a3bb0 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: dump: 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.797+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 >> v1:10.20.193.142:6789/0 conn(0x7f5bec0a3bb0 legacy=0x7f5bec09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bd8003ab0 0x7f5bd8003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): picked mon.b con 0x7f5bd8003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bd8004900 0x7f5bd8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): picked mon.a con 0x7f5bd8004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bd800bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): picked mon.c con 0x7f5bd8005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec09a5c0 con 0x7f5bd8004900 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd800c420 con 0x7f5bd8003ab0 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd800c620 con 0x7f5bd8005510 2026-02-17T12:04:50.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5bea7fc640 1 -- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bd8004900 msgr2=0x7f5bd8004d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5be9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5bea7fc640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bd8004900 0x7f5bd8004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5bf187c640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bd800bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bd8003ab0 0x7f5bd8003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): get_auth_request con 0x7f5bd8005510 auth_method 0 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:50.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): get_auth_request con 0x7f5bd8003ab0 auth_method 0 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:50.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient(hunting): handle_auth_done global_id 184600 payload 293 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 -- 10.20.193.51:0/3224549970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bd8003ab0 msgr2=0x7f5bd8003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bd8003ab0 0x7f5bd8003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 -- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bd8004900 msgr2=0x7f5bd8004d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bd8004900 0x7f5bd8004d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 monclient: found mon.c 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 -- 10.20.193.51:0/3224549970 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd8003620 con 0x7f5bd8005510 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.798+0000 7f5beb7fe640 1 -- 10.20.193.51:0/3224549970 reap_dead start 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.800+0000 7f5beb7fe640 1 -- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 msgr2=0x7f5bd800bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.800+0000 7f5beb7fe640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bd800bb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009e10 tx=0x7f5bdc02f600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe00252b7f13548 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc008050 con 0x7f5bd8005510 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: dump: 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc037670 con 0x7f5bd8005510 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 1 -- 10.20.193.51:0/3224549970 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009a10 con 0x7f5bd8005510 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 4 set_mon_vals no callback set 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5be9ffb640 10 monclient: dump: 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 10 monclient: shutdown 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 -- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 msgr2=0x7f5bd800bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bd800bb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009e10 tx=0x7f5bdc02f600 comp rx=0 tx=0).stop 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 -- 10.20.193.51:0/3224549970 shutdown_connections 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 --2- 10.20.193.51:0/3224549970 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bd800bb40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 -- 10.20.193.51:0/3224549970 >> 10.20.193.51:0/3224549970 conn(0x7f5bec0a30c0 msgr2=0x7f5bec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 -- 10.20.193.51:0/3224549970 shutdown_connections 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.801+0000 7f5bf187c640 1 -- 10.20.193.51:0/3224549970 wait complete. 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient: build_initial_monmap 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient: monmap: 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 Processor -- start 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 -- start start 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient: init 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-c con 0x7f5bd8005510 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 0x7f5bec1cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-a con 0x7f5bec13a550 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bec1cfe30 0x7f5bec0994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): picked mon.noname-b con 0x7f5bec1cfe30 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec135040 con 0x7f5bec13a550 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0a3f90 con 0x7f5bec1cfe30 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5bec1351c0 con 0x7f5bd8005510 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bf187c640 10 monclient(hunting): authenticate will time out at 1778.421593s 2026-02-17T12:04:50.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bea7fc640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 msgr2=0x7f5bec1cf8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5bea7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 0x7f5bec1cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44860/0 (socket says 10.20.193.51:44860) 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 -- 10.20.193.51:0/4184524074 learned_addr learned my addr 10.20.193.51:0/4184524074 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): get_auth_request con 0x7f5bd8005510 auth_method 0 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:50.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beb7fe640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bec1cfe30 0x7f5bec0994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beb7fe640 10 monclient(hunting): get_auth_request con 0x7f5bec1cfe30 auth_method 0 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient(hunting): handle_auth_done global_id 234239 payload 824 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 -- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bec1cfe30 msgr2=0x7f5bec0994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bec1cfe30 0x7f5bec0994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 -- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 msgr2=0x7f5bec1cf8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 0x7f5bec1cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient: _finish_hunting 0 2026-02-17T12:04:50.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 monclient: found mon.noname-c 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.802+0000 7f5beaffd640 1 -- 10.20.193.51:0/4184524074 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec13ec30 con 0x7f5bd8005510 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.804+0000 7f5beaffd640 1 -- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 msgr2=0x7f5bec1cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.804+0000 7f5beaffd640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007310 tx=0x7f5be00077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5beaffd640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007310 tx=0x7f5be00077e0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f5be00133f0 mon_map magic: 0 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be000fb70 con 0x7f5bd8005510 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: dump: 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: _finish_auth 0 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0018070 con 0x7f5bd8005510 2026-02-17T12:04:50.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 5 monclient: authenticate success, global_id 234239 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _renew_subs 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5be97fa640 4 set_mon_vals no callback set 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bec139ae0 con 0x7f5bd8005510 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _renew_subs 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bec09d7b0 con 0x7f5bd8005510 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:50.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bec09cdc0 con 0x7f5bd8005510 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00133f0 con 0x7f5bd8005510 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 10 monclient: dump: 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:50.834 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5be00135d0 con 0x7f5bd8005510 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.805+0000 7f5bc3fff640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 0x7f5bbc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.806+0000 7f5bea7fc640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 0x7f5bbc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.806+0000 7f5bea7fc640 10 monclient: get_auth_request con 0x7f5bbc03dcc0 auth_method 0 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.808+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7f5be0052730 con 0x7f5bd8005510 2026-02-17T12:04:50.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:50.808+0000 7f5bea7fc640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 0x7f5bbc040180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5bec139730 tx=0x7f5bd40092b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:51.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.633+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5bec13ec30 con 0x7f5bd8005510 2026-02-17T12:04:51.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.633+0000 7f5bc3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:51.635 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.633+0000 7f5bc3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:51.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bf187c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bf187c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bf187c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5bec13e750 con 0x7f5bd8005510 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bc3fff640 1 -- 10.20.193.51:0/4184524074 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f5be0051100 con 0x7f5bd8005510 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bc3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:51.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.746+0000 7f5bc3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:51.750 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 msgr2=0x7f5bbc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 0x7f5bbc040180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5bec139730 tx=0x7f5bd40092b0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 10 monclient: shutdown 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 msgr2=0x7f5bec1cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007310 tx=0x7f5be00077e0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 shutdown_connections 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5bbc03dcc0 0x7f5bbc040180 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5bec1cfe30 0x7f5bec0994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5bec13a550 0x7f5bec1cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 --2- 10.20.193.51:0/4184524074 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5bd8005510 0x7f5bec1cf3b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 >> 10.20.193.51:0/4184524074 conn(0x7f5bec0a30c0 msgr2=0x7f5bec0a1570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 shutdown_connections 2026-02-17T12:04:51.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:51.747+0000 7f5bf187c640 1 -- 10.20.193.51:0/4184524074 wait complete. 2026-02-17T12:04:54.757 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:54.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 10 monclient: get_monmap_and_config 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 10 monclient: monmap: 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:54.826367+0000 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:54.826367+0000 2026-02-17T12:04:54.830 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 1 Processor -- start 2026-02-17T12:04:54.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 1 -- start start 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.825+0000 7fe6f8d46640 10 monclient: init 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe6f40a3bb0 0x7fe6f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-c con 0x7fe6f40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe6f40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-b con 0x7fe6f413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f406e140 con 0x7fe6f40a0750 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f409f910 con 0x7fe6f40a3bb0 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f409ccd0 con 0x7fe6f413b760 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f8d46640 10 monclient(hunting): authenticate will time out at 1782.445114s 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f1d74640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fe6f40a0750 legacy=0x7fe6f409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44872/0 (socket says 10.20.193.51:44872) 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 -- 10.20.193.51:0/3704853990 learned_addr learned my addr 10.20.193.51:0/3704853990 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): get_auth_request con 0x7fe6f413b760 auth_method 0 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2575640 1 --2- 10.20.193.51:0/3704853990 >> v2:10.20.193.142:3300/0 conn(0x7fe6f40a3bb0 0x7fe6f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2575640 10 monclient(hunting): get_auth_request con 0x7fe6f40a3bb0 auth_method 0 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient(hunting): handle_auth_done global_id 234242 payload 274 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 -- 10.20.193.51:0/3704853990 >> v2:10.20.193.142:3300/0 conn(0x7fe6f40a3bb0 msgr2=0x7fe6f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 --2- 10.20.193.51:0/3704853990 >> v2:10.20.193.142:3300/0 conn(0x7fe6f40a3bb0 0x7fe6f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 -- 10.20.193.51:0/3704853990 >> v1:10.20.193.51:6789/0 conn(0x7fe6f40a0750 legacy=0x7fe6f409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 monclient: found mon.noname-b 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:04:54.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.826+0000 7fe6f2d76640 1 -- 10.20.193.51:0/3704853990 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f409eec0 con 0x7fe6f413b760 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.828+0000 7fe6f2d76640 1 -- 10.20.193.51:0/3704853990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 msgr2=0x7fe6f413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.828+0000 7fe6f2d76640 1 --2- 10.20.193.51:0/3704853990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe6f406c1c0 tx=0x7fe6e402f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06e5df2d9fcf159 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 1 -- 10.20.193.51:0/3704853990 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40373f0 con 0x7fe6f413b760 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: dump: 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:54.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 1 -- 10.20.193.51:0/3704853990 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4037590 con 0x7fe6f413b760 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 5 monclient: authenticate success, global_id 234242 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 1 -- 10.20.193.51:0/3704853990 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4037960 con 0x7fe6f413b760 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f1573640 10 monclient: dump: 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.844 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 4 set_mon_vals no callback set 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 10 monclient: shutdown 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 -- 10.20.193.51:0/3704853990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 msgr2=0x7fe6f413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/3704853990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe6f406c1c0 tx=0x7fe6e402f200 comp rx=0 tx=0).stop 2026-02-17T12:04:54.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 -- 10.20.193.51:0/3704853990 shutdown_connections 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/3704853990 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f413b760 0x7fe6f413db50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/3704853990 >> v2:10.20.193.142:3300/0 conn(0x7fe6f40a3bb0 0x7fe6f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 -- 10.20.193.51:0/3704853990 >> 10.20.193.51:0/3704853990 conn(0x7fe6f40a30c0 msgr2=0x7fe6f40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 -- 10.20.193.51:0/3704853990 shutdown_connections 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 -- 10.20.193.51:0/3704853990 wait complete. 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 10 monclient: monmap: 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:54.846 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.829+0000 7fe6f8d46640 1 Processor -- start 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 -- start start 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient: init 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.847 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-c con 0x7fe6f40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 0x7fe6f4092810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-b con 0x7fe6f40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 0x7fe6f4092d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): picked mon.noname-a con 0x7fe6f413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f40a04b0 con 0x7fe6f413b760 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f409c850 con 0x7fe6f40a3bb0 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f409e710 con 0x7fe6f40a0750 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.848 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f8d46640 10 monclient(hunting): authenticate will time out at 1782.449273s 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2d76640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 msgr2=0x7fe6f4092d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 0x7fe6f4092d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44878/0 (socket says 10.20.193.51:44878) 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 -- 10.20.193.51:0/1095790377 learned_addr learned my addr 10.20.193.51:0/1095790377 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): get_auth_request con 0x7fe6f40a0750 auth_method 0 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.849 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f1d74640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 0x7fe6f4092810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient(hunting): handle_auth_done global_id 234245 payload 824 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 -- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 msgr2=0x7fe6f4092810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 0x7fe6f4092810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 -- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 msgr2=0x7fe6f4092d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 0x7fe6f4092d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 monclient: found mon.noname-c 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:54.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f2575640 1 -- 10.20.193.51:0/1095790377 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f4096750 con 0x7fe6f40a0750 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f1d74640 10 monclient: get_auth_request con 0x7fe6f40a3bb0 auth_method 0 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.830+0000 7fe6f1d74640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 0x7fe6f4092810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f2575640 1 -- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 msgr2=0x7fe6f413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f2575640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e7c0 tx=0x7fe6e800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f2575640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e7c0 tx=0x7fe6e800ec90 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fe6e8017070 mon_map magic: 0 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017070 con 0x7fe6f40a0750 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: dump: 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e800cb00 con 0x7fe6f40a0750 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 5 monclient: authenticate success, global_id 234245 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 10 monclient: _renew_subs 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f409d7b0 con 0x7fe6f40a0750 2026-02-17T12:04:54.852 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f0d72640 4 set_mon_vals no callback set 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 10 monclient: _renew_subs 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.832+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f4096470 con 0x7fe6f40a0750 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f8d46640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f8d46640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f8d46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f4096020 con 0x7fe6f40a0750 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800f040 con 0x7fe6f40a0750 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 10 monclient: dump: 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:54.853 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe6e8012050 con 0x7fe6f40a0750 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6daffd640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 0x7fe6c00401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f1d74640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 0x7fe6c00401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.833+0000 7fe6f1d74640 10 monclient: get_auth_request con 0x7fe6c003dcf0 auth_method 0 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.836+0000 7fe6f2575640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e7c0 tx=0x7fe6e800ec90 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fe6f4096020 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-17T12:04:54.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:54.836+0000 7fe6f1d74640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 0x7fe6c00401b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.455+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7fe6e80524d0 con 0x7fe6f40a0750 2026-02-17T12:04:55.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.664+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe6f4096020 con 0x7fe6f40a0750 2026-02-17T12:04:55.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.664+0000 7fe6daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.664+0000 7fe6daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.778+0000 7fe6f8d46640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.778+0000 7fe6f8d46640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.778+0000 7fe6f8d46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.778+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe6f409dac0 con 0x7fe6f40a0750 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6daffd640 1 -- 10.20.193.51:0/1095790377 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fe6e801ac60 con 0x7fe6f40a0750 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:55.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 msgr2=0x7fe6c00401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 0x7fe6c00401b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc008040 comp rx=0 tx=0).stop 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 10 monclient: shutdown 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 msgr2=0x7fe6f413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e7c0 tx=0x7fe6e800ec90 comp rx=0 tx=0).stop 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 shutdown_connections 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe6c003dcf0 0x7fe6c00401b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe6f413b760 0x7fe6f4092d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe6f40a3bb0 0x7fe6f4092810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 --2- 10.20.193.51:0/1095790377 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe6f40a0750 0x7fe6f413b160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 >> 10.20.193.51:0/1095790377 conn(0x7fe6f40a30c0 msgr2=0x7fe6f4072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 shutdown_connections 2026-02-17T12:04:55.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:55.779+0000 7fe6f8d46640 1 -- 10.20.193.51:0/1095790377 wait complete. 2026-02-17T12:04:58.789 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:04:58.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.853+0000 7fde12c6f640 10 monclient: get_monmap_and_config 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.853+0000 7fde12c6f640 10 monclient: build_initial_monmap 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.853+0000 7fde12c6f640 10 monclient: monmap: 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:04:58.854890+0000 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:04:58.854890+0000 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:58.858 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 Processor -- start 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 -- start start 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient: init 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T12:04:58.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fde0c0a3bb0 0x7fde0c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-c con 0x7fde0c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fde0c09dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde0c0a0110 addr v1:10.20.193.51:6789/0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c06e140 con 0x7fde0c0a0110 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c09ce60 con 0x7fde0c09dac0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c09aed0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde12c6f640 10 monclient(hunting): authenticate will time out at 1786.473728s 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde111e5640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fde0c0a0110 legacy=0x7fde0c13c760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde109e4640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fde0c0a3bb0 0x7fde0c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:58.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde03fff640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fde0c09dac0 0x7fde0c09fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:58940/0 (socket says 10.20.193.51:58940) 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde03fff640 1 -- 10.20.193.51:0/2467438782 learned_addr learned my addr 10.20.193.51:0/2467438782 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde109e4640 10 monclient(hunting): get_auth_request con 0x7fde0c0a3bb0 auth_method 0 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde109e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde109e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.854+0000 7fde109e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient(hunting): handle_auth_done global_id 184609 payload 274 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 1 -- 10.20.193.51:0/2467438782 >> v1:10.20.193.142:6789/0 conn(0x7fde0c09dac0 legacy=0x7fde0c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 1 -- 10.20.193.51:0/2467438782 >> v1:10.20.193.51:6789/0 conn(0x7fde0c0a0110 legacy=0x7fde0c13c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient: _finish_hunting 0 2026-02-17T12:04:58.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 1 monclient: found mon.noname-c 2026-02-17T12:04:58.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:58.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:04:58.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.855+0000 7fde109e4640 1 -- 10.20.193.51:0/2467438782 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c09a5c0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde109e4640 1 -- 10.20.193.51:0/2467438782 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c0a3bb0 msgr2=0x7fde0c09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde109e4640 1 --2- 10.20.193.51:0/2467438782 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c0a3bb0 0x7fde0c09f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0098a0 tx=0x7fddfc02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a525f80d2aeb1159 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 1 -- 10.20.193.51:0/2467438782 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc03c070 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: dump: 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:58.869 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde12c6f640 5 monclient: authenticate success, global_id 184609 2026-02-17T12:04:58.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde12c6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 1 -- 10.20.193.51:0/2467438782 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc02fce0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.857+0000 7fde037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde037fe640 1 -- 10.20.193.51:0/2467438782 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc037660 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 4 set_mon_vals no callback set 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde037fe640 10 monclient: dump: 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.871 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 10 monclient: shutdown 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 -- 10.20.193.51:0/2467438782 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c0a3bb0 msgr2=0x7fde0c09f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 --2- 10.20.193.51:0/2467438782 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c0a3bb0 0x7fde0c09f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0098a0 tx=0x7fddfc02ed80 comp rx=0 tx=0).stop 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 -- 10.20.193.51:0/2467438782 shutdown_connections 2026-02-17T12:04:58.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 --2- 10.20.193.51:0/2467438782 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c0a3bb0 0x7fde0c09f4c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 -- 10.20.193.51:0/2467438782 >> 10.20.193.51:0/2467438782 conn(0x7fde0c0a30c0 msgr2=0x7fde0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 -- 10.20.193.51:0/2467438782 shutdown_connections 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 1 -- 10.20.193.51:0/2467438782 wait complete. 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 10 monclient: build_initial_monmap 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.858+0000 7fde12c6f640 10 monclient: monmap: 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 Processor -- start 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 -- start start 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient: init 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c09dac0 0x7fde0c1cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-b con 0x7fde0c09dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:04:58.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 0x7fde0c0999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-a con 0x7fde0c0a0110 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): picked mon.noname-c con 0x7fde0c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c0a3f90 con 0x7fde0c0a0110 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c09caa0 con 0x7fde0c09dac0 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0a0540 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde12c6f640 10 monclient(hunting): authenticate will time out at 1786.478467s 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde03fff640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 msgr2=0x7fde0c0999b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:04:58.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde03fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 0x7fde0c0999b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33722/0 (socket says 10.20.193.51:33722) 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 -- 10.20.193.51:0/1674919563 learned_addr learned my addr 10.20.193.51:0/1674919563 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): get_auth_request con 0x7fde0c0a3bb0 auth_method 0 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde109e4640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c09dac0 0x7fde0c1cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:58.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde109e4640 10 monclient(hunting): get_auth_request con 0x7fde0c09dac0 auth_method 0 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde109e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde109e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde109e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient(hunting): handle_auth_done global_id 234248 payload 824 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 -- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c09dac0 msgr2=0x7fde0c1cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c09dac0 0x7fde0c1cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 -- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 msgr2=0x7fde0c0999b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 0x7fde0c0999b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient: _finish_hunting 0 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 monclient: found mon.noname-c 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:58.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.859+0000 7fde111e5640 1 -- 10.20.193.51:0/1674919563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c09d7b0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.861+0000 7fde111e5640 1 -- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 msgr2=0x7fde0c099ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.861+0000 7fde111e5640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde0800be60 tx=0x7fde0800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08006e60 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: dump: 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: _finish_auth 0 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: _check_auth_tickets 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde08010030 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 5 monclient: authenticate success, global_id 234248 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _renew_subs 2026-02-17T12:04:58.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c093e80 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde080168b0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 10 monclient: dump: 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde02ffd640 4 set_mon_vals no callback set 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _renew_subs 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c1cf860 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:58.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c09f470 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.862+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fde08008070 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.863+0000 7fde017fa640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 0x7fdddc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.863+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7fde080527e0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.863+0000 7fde109e4640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 0x7fdddc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.863+0000 7fde109e4640 10 monclient: get_auth_request con 0x7fdddc03dcc0 auth_method 0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.865+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde0801b020 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.865+0000 7fde017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.865+0000 7fde017fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:58.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.865+0000 7fde109e4640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 0x7fdddc040180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06dd50 tx=0x7fddfc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:58.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde12c6f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde12c6f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde12c6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fde0c050ac0 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde017fa640 1 -- 10.20.193.51:0/1674919563 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fde08052020 con 0x7fde0c0a3bb0 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:04:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.981+0000 7fde017fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:58.985 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 msgr2=0x7fdddc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 0x7fdddc040180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06dd50 tx=0x7fddfc033000 comp rx=0 tx=0).stop 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 10 monclient: shutdown 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 msgr2=0x7fde0c099ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde0800be60 tx=0x7fde0800bf60 comp rx=0 tx=0).stop 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 shutdown_connections 2026-02-17T12:04:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdddc03dcc0 0x7fdddc040180 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fde0c0a3bb0 0x7fde0c099ef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fde0c0a0110 0x7fde0c0999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 --2- 10.20.193.51:0/1674919563 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fde0c09dac0 0x7fde0c1cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 >> 10.20.193.51:0/1674919563 conn(0x7fde0c0a30c0 msgr2=0x7fde0c09e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 shutdown_connections 2026-02-17T12:04:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:04:58.982+0000 7fde12c6f640 1 -- 10.20.193.51:0/1674919563 wait complete. 2026-02-17T12:05:01.992 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:02.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: get_monmap_and_config 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: build_initial_monmap 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: monmap: 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:02.062109+0000 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:02.062109+0000 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:02.066 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 Processor -- start 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 -- start start 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: init 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:02.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): picked mon.noname-c con 0x7f97800a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): picked mon.noname-b con 0x7f978009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f978009ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978006e140 con 0x7f978009ff40 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f978009aed0 con 0x7f97800a3bb0 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f978009caa0 con 0x7f978009dac0 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:02.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9787153640 10 monclient(hunting): authenticate will time out at 1789.680886s 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f97856c9640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f978009ff40 legacy=0x7f978013b750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:33738/0 (socket says 10.20.193.51:33738) 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 learned_addr learned my addr 10.20.193.51:0/3621111197 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f978009dac0 auth_method 0 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.061+0000 7f9777fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:02.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f97800a3bb0 auth_method 0 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.062+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:02.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.262+0000 7f97856c9640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.51:6789/0 conn(0x7f978009ff40 legacy=0x7f978013b750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:02.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f978009dac0 auth_method 0 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:02.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f97800a3bb0 auth_method 0 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.263+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:02.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.663+0000 7f97856c9640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.51:6789/0 conn(0x7f978009ff40 legacy=0x7f978013b750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f978009dac0 auth_method 0 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f97800a3bb0 auth_method 0 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:02.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:02.664+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:03.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.464+0000 7f97856c9640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.51:6789/0 conn(0x7f978009ff40 legacy=0x7f978013b750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f978009dac0 auth_method 0 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:03.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f97800a3bb0 auth_method 0 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:03.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:03.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:03.465+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:05.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): tick 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 msgr2=0x7f978009fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f978009dac0 0x7f978009fa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 msgr2=0x7f978009f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.142:3300/0 conn(0x7f97800a3bb0 0x7f978009f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.51:6789/0 conn(0x7f978009ff40 legacy=0x7f978013b750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient: _add_conns ranks=[3,1] 2026-02-17T12:05:05.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 0x7f9764005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): picked mon.noname-a con 0x7f9764003780 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f97640062f0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 -- 10.20.193.51:0/3621111197 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978009ce60 con 0x7f97640062f0 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 1 -- 10.20.193.51:0/3621111197 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f978009aed0 con 0x7f9764003780 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f97767fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 msgr2=0x7f9764005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.062+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 0x7f9764005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.064+0000 7f9777fff640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.142:6789/0 conn(0x7f97640062f0 legacy=0x7f97640087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.263+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 msgr2=0x7f9764005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.263+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 0x7f9764005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:05.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.1 v1:10.20.193.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812369905 0 0) 0x7f978009ce60 con 0x7f97640062f0 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 10 monclient(hunting): _negotiate 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 10 monclient(hunting): my global_id is 184615 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.529+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 --> v1:10.20.193.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f976c003620 con 0x7f97640062f0 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.1 v1:10.20.193.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1945785433 0 0) 0x7f976c003620 con 0x7f97640062f0 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 msgr2=0x7f9764005c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 --2- 10.20.193.51:0/3621111197 >> v2:10.20.193.51:3300/0 conn(0x7f9764003780 0x7f9764005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.142:6789/0 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 --> v1:10.20.193.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978006e140 con 0x7f97640062f0 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.1 v1:10.20.193.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f97680096c0 con 0x7f97640062f0 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: dump: 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] but i'm connected to v1:10.20.193.142:6789/0, reconnecting 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 >> v1:10.20.193.142:6789/0 conn(0x7f97640062f0 legacy=0x7f97640087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97856c9640 1 -- 10.20.193.51:0/3621111197 reap_dead start 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 0x7f976c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): picked mon.c con 0x7f976c003ab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c004900 0x7f976c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): picked mon.b con 0x7f976c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f976c00bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): picked mon.a con 0x7f976c005470 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f978009aed0 con 0x7f976c005470 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f976c00c3c0 con 0x7f976c004900 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f976c00c5c0 con 0x7f976c003ab0 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97777fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97856c9640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 msgr2=0x7f976c00bae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f97856c9640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f976c00bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 0x7f976c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f976c003ab0 auth_method 0 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:05.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9777fff640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c004900 0x7f976c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f976c004900 auth_method 0 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9777fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient(hunting): handle_auth_done global_id 184615 payload 293 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c004900 msgr2=0x7f976c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c004900 0x7f976c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 msgr2=0x7f976c00bae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f976c00bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 monclient: found mon.c 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c003620 con 0x7f976c003ab0 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9784ec8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9787153640 5 monclient: authenticate success, global_id 184615 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.530+0000 7f9787153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9784ec8640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 msgr2=0x7f976c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 0x7f976c003eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9770012a40 tx=0x7f977002fd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6df4639fd7db9b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770036070 con 0x7f976c003ab0 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: dump: 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.549 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700307a0 con 0x7f976c003ab0 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 1 -- 10.20.193.51:0/3621111197 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977000f040 con 0x7f976c003ab0 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f97777fe640 10 monclient: dump: 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.551 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 4 set_mon_vals no callback set 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 10 monclient: shutdown 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 -- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 msgr2=0x7f976c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 0x7f976c003eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9770012a40 tx=0x7f977002fd60 comp rx=0 tx=0).stop 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 -- 10.20.193.51:0/3621111197 shutdown_connections 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f976c00bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c004900 0x7f976c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 --2- 10.20.193.51:0/3621111197 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c003ab0 0x7f976c003eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 -- 10.20.193.51:0/3621111197 >> 10.20.193.51:0/3621111197 conn(0x7f97800a30c0 msgr2=0x7f97800a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 -- 10.20.193.51:0/3621111197 shutdown_connections 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.533+0000 7f9787153640 1 -- 10.20.193.51:0/3621111197 wait complete. 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient: build_initial_monmap 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient: monmap: 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.553 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 Processor -- start 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 -- start start 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient: init 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:05.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c003ab0 0x7f97801cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): picked mon.noname-b con 0x7f976c003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): picked mon.noname-c con 0x7f976c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f978013b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): picked mon.noname-a con 0x7f976c005470 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f978009a880 con 0x7f976c005470 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f97800a3f90 con 0x7f976c003ab0 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f97800a0370 con 0x7f976c004900 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9787153640 10 monclient(hunting): authenticate will time out at 1793.153823s 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f97856c9640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 msgr2=0x7f978013b640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f97856c9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f978013b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55028/0 (socket says 10.20.193.51:55028) 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 1 -- 10.20.193.51:0/3630978561 learned_addr learned my addr 10.20.193.51:0/3630978561 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): get_auth_request con 0x7f976c004900 auth_method 0 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.534+0000 7f9777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c003ab0 0x7f97801cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9784ec8640 10 monclient(hunting): get_auth_request con 0x7f976c003ab0 auth_method 0 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9784ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9784ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9784ec8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 10 monclient(hunting): handle_auth_done global_id 234251 payload 824 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 -- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c003ab0 msgr2=0x7f97801cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c003ab0 0x7f97801cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 -- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 msgr2=0x7f978013b640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:05.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f978013b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.535+0000 7f9777fff640 1 -- 10.20.193.51:0/3630978561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800a2a10 con 0x7f976c004900 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9777fff640 1 -- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 msgr2=0x7f97801cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9777fff640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9768004660 tx=0x7f9768003ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976801a070 con 0x7f976c004900 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: dump: 2026-02-17T12:05:05.558 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9768016910 con 0x7f976c004900 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 5 monclient: authenticate success, global_id 234251 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _renew_subs 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978009d7b0 con 0x7f976c004900 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768016ce0 con 0x7f976c004900 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9776ffd640 4 set_mon_vals no callback set 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 10 monclient: dump: 2026-02-17T12:05:05.560 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _renew_subs 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f978008e740 con 0x7f976c004900 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f97680153c0 con 0x7f976c004900 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.537+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978009e370 con 0x7f976c004900 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.538+0000 7f97757fa640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 0x7f9750040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.538+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(722..722 src has 323..722) ==== 4827+0+0 (secure 0 0 0) 0x7f9768053430 con 0x7f976c004900 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.538+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 0x7f9750040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.538+0000 7f9784ec8640 10 monclient: get_auth_request con 0x7f975003dcc0 auth_method 0 2026-02-17T12:05:05.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.540+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f976801dc60 con 0x7f976c004900 2026-02-17T12:05:05.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.540+0000 7f97757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.540+0000 7f97757fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:05.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.540+0000 7f9784ec8640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 0x7f9750040180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9770006fb0 tx=0x7f9770036000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3145: done (4 left) 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3148: done (3 left) 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3149: done (2 left) 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3150: done (1 left) 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3152: done (0 left) 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:3153: rollback oid 19 current snap is 351 2026-02-17T12:05:05.586 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 334 2026-02-17T12:05:05.587 INFO:tasks.rados.rados.0.trial142.stdout:3154: read oid 29 snap 331 2026-02-17T12:05:05.587 INFO:tasks.rados.rados.0.trial142.stdout:3154: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:05:05.587 INFO:tasks.rados.rados.0.trial142.stdout:3155: write oid 30 current snap is 351 2026-02-17T12:05:05.587 INFO:tasks.rados.rados.0.trial142.stdout:3155: seq_num 1078 ranges {517946=724195,1932177=185769} 2026-02-17T12:05:05.590 INFO:tasks.rados.rados.0.trial142.stdout:3155: writing trial14245205-30 from 517946 to 1242141 tid 1 2026-02-17T12:05:05.594 INFO:tasks.rados.rados.0.trial142.stdout:3155: writing trial14245205-30 from 1932177 to 2117946 tid 2 2026-02-17T12:05:05.594 INFO:tasks.rados.rados.0.trial142.stdout:3156: read oid 24 snap 347 2026-02-17T12:05:05.594 INFO:tasks.rados.rados.0.trial142.stdout:3156: expect deleted 2026-02-17T12:05:05.594 INFO:tasks.rados.rados.0.trial142.stdout:3157: snap_create 2026-02-17T12:05:05.595 INFO:tasks.rados.rados.0.trial142.stdout:3153: finishing rollback tid 0 to trial14245205-19 2026-02-17T12:05:05.595 INFO:tasks.rados.rados.0.trial142.stdout:3154: expect (ObjNum 932 snap 302 seq_num 932) 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.653+0000 7f9787153640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.653+0000 7f9787153640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.653+0000 7f9787153640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.653+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f978009a220 con 0x7f976c004900 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.654+0000 7f97757fa640 1 -- 10.20.193.51:0/3630978561 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f9768051e00 con 0x7f976c004900 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.654+0000 7f97757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:05.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.654+0000 7f97757fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:05.657 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":186,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 msgr2=0x7f9750040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 0x7f9750040180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9770006fb0 tx=0x7f9770036000 comp rx=0 tx=0).stop 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 10 monclient: shutdown 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 msgr2=0x7f97801cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9768004660 tx=0x7f9768003ae0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 shutdown_connections 2026-02-17T12:05:05.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f975003dcc0 0x7f9750040180 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f976c005470 0x7f978013b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f976c004900 0x7f97801cd570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 --2- 10.20.193.51:0/3630978561 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f976c003ab0 0x7f97801cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 >> 10.20.193.51:0/3630978561 conn(0x7f97800a30c0 msgr2=0x7f978009e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 shutdown_connections 2026-02-17T12:05:05.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.655+0000 7f9787153640 1 -- 10.20.193.51:0/3630978561 wait complete. 2026-02-17T12:05:05.666 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:05:05.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:05:05.666 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.733+0000 7f3ab3687640 10 monclient: get_monmap_and_config 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.733+0000 7f3ab3687640 10 monclient: build_initial_monmap 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.733+0000 7f3ab3687640 10 monclient: monmap: 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.736 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:05.734915+0000 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:05.734915+0000 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 Processor -- start 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 -- start start 2026-02-17T12:05:05.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient: init 2026-02-17T12:05:05.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3aac09e370 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3aac09aa50 0x7f3aac09ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-c con 0x7f3aac09aa50 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3aac139950 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aac0a0980 con 0x7f3aac09e370 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aac06d8e0 con 0x7f3aac139950 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3aac09d600 con 0x7f3aac09aa50 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab13fc640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f3aac09e370 legacy=0x7f3aac09e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.734+0000 7f3ab3687640 10 monclient(hunting): authenticate will time out at 1793.353901s 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3aac09aa50 0x7f3aac09ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab1bfd640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7f3aac139950 0x7f3aac13bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:33420/0 (socket says 10.20.193.51:33420) 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab1bfd640 1 -- 10.20.193.51:0/2218321187 learned_addr learned my addr 10.20.193.51:0/2218321187 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): get_auth_request con 0x7f3aac09aa50 auth_method 0 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_done global_id 184621 payload 274 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/2218321187 >> v1:10.20.193.142:6789/0 conn(0x7f3aac139950 legacy=0x7f3aac13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/2218321187 >> v1:10.20.193.51:6789/0 conn(0x7f3aac09e370 legacy=0x7f3aac09e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 1 monclient: found mon.noname-c 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.735+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/2218321187 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac09ff30 con 0x7f3aac09aa50 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.737+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/2218321187 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 msgr2=0x7f3aac09ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.737+0000 7f3ab0bfb640 1 --2- 10.20.193.51:0/2218321187 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac09ee60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000aa80 tx=0x7f3aa0030200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=878a54abf752d44b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 1 -- 10.20.193.51:0/2218321187 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa003d070 con 0x7f3aac09aa50 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.750 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: dump: 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.751 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 1 -- 10.20.193.51:0/2218321187 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa0038640 con 0x7f3aac09aa50 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 1 -- 10.20.193.51:0/2218321187 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0038a10 con 0x7f3aac09aa50 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 5 monclient: authenticate success, global_id 184621 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 4 set_mon_vals no callback set 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3a9bfff640 10 monclient: dump: 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.752 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 10 monclient: shutdown 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 -- 10.20.193.51:0/2218321187 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 msgr2=0x7f3aac09ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.753 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 --2- 10.20.193.51:0/2218321187 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac09ee60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000aa80 tx=0x7f3aa0030200 comp rx=0 tx=0).stop 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 -- 10.20.193.51:0/2218321187 shutdown_connections 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 --2- 10.20.193.51:0/2218321187 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac09ee60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 -- 10.20.193.51:0/2218321187 >> 10.20.193.51:0/2218321187 conn(0x7f3aac0a30c0 msgr2=0x7f3aac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 -- 10.20.193.51:0/2218321187 shutdown_connections 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 1 -- 10.20.193.51:0/2218321187 wait complete. 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 10 monclient: build_initial_monmap 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.738+0000 7f3ab3687640 10 monclient: monmap: 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:05.754 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 Processor -- start 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 -- start start 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient: init 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:05.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac1cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-b con 0x7f3aac09aa50 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-c con 0x7f3aac09e370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3aac139950 0x7f3aac09a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): picked mon.noname-a con 0x7f3aac139950 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac0a3e20 con 0x7f3aac139950 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac06e140 con 0x7f3aac09aa50 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3aac0a3fa0 con 0x7f3aac09e370 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.756 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab3687640 10 monclient(hunting): authenticate will time out at 1793.358524s 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab1bfd640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3aac139950 msgr2=0x7f3aac09a0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab1bfd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3aac139950 0x7f3aac09a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55032/0 (socket says 10.20.193.51:55032) 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/4178930816 learned_addr learned my addr 10.20.193.51:0/4178930816 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): get_auth_request con 0x7f3aac09e370 auth_method 0 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac1cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): get_auth_request con 0x7f3aac09aa50 auth_method 0 2026-02-17T12:05:05.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient(hunting): handle_auth_done global_id 234254 payload 824 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 msgr2=0x7f3aac1cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3aac09aa50 0x7f3aac1cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3aac139950 msgr2=0x7f3aac09a0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:05.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3aac139950 0x7f3aac09a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 monclient: found mon.noname-c 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.739+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac096360 con 0x7f3aac09e370 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab0bfb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 msgr2=0x7f3aac099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab0bfb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000abb0 tx=0x7f3aa00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0047020 con 0x7f3aac09e370 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: dump: 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 5 monclient: authenticate success, global_id 234254 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa0036880 con 0x7f3aac09e370 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 monclient: _renew_subs 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aac094370 con 0x7f3aac09e370 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa003d040 con 0x7f3aac09e370 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a9b7fe640 4 set_mon_vals no callback set 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 10 monclient: dump: 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.761 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 monclient: _renew_subs 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aac0954b0 con 0x7f3aac09e370 2026-02-17T12:05:05.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 0x7f3aac08e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3aac0961a0 con 0x7f3aac092f80 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 0x7f3aac08e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient: get_auth_request con 0x7f3aac092f80 auth_method 0 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3aa0036cd0 con 0x7f3aac09e370 2026-02-17T12:05:05.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_done global_id 234257 payload 824 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.742+0000 7f3ab13fc640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3aac09dce0 con 0x7f3aac092f80 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.743+0000 7f3a99ffb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a7c03dcc0 0x7f3a7c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.743+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(723..723 src has 323..723) ==== 4799+0+0 (secure 0 0 0) 0x7f3aa0077fe0 con 0x7f3aac09e370 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.743+0000 7f3ab1bfd640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a7c03dcc0 0x7f3a7c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.743+0000 7f3ab1bfd640 10 monclient: get_auth_request con 0x7f3a7c03dcc0 auth_method 0 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3ab13fc640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 msgr2=0x7f3aac08e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3ab13fc640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 0x7f3aac08e400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c016070 con 0x7f3aac092f80 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 10 monclient: dump: 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.764 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3a9c005b40 con 0x7f3aac092f80 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 msgr2=0x7f3aac08e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.765 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 0x7f3aac08e400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c009bc0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 msgr2=0x7f3aac08e400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:05.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3a99ffb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac092f80 0x7f3aac08e400 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c009bc0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.745+0000 7f3ab1bfd640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a7c03dcc0 0x7f3a7c040180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8004c90 tx=0x7f3aa8005220 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: finishing write tid 1 to trial14245205-30 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3153: finishing rollback tid 1 to trial14245205-19 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3153: finishing rollback tid 2 to trial14245205-19 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2717 (ObjNum 1017 snap 329 seq_num 1017) dirty exists 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: finishing write tid 2 to trial14245205-30 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: finishing write tid 3 to trial14245205-30 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: finishing write tid 4 to trial14245205-30 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: oid 30 updating version 0 to 2715 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: oid 30 updating version 2715 to 2717 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:3155: oid 30 version 2717 is already newer than 2716 2026-02-17T12:05:05.767 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 2717 (ObjNum 1078 snap 351 seq_num 1078) dirty exists 2026-02-17T12:05:05.768 INFO:tasks.rados.rados.0.trial142.stdout:3155: left oid 30 (ObjNum 1078 snap 351 seq_num 1078) 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab3687640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab3687640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 0x7f3aac1d8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab3687640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3aac1cdcc0 con 0x7f3aac093360 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 0x7f3aac1d8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient: get_auth_request con 0x7f3aac093360 auth_method 0 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 10 monclient(hunting): handle_auth_done global_id 234260 payload 824 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.748+0000 7f3ab13fc640 1 -- 10.20.193.51:0/4178930816 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3aac08fac0 con 0x7f3aac093360 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab13fc640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 msgr2=0x7f3aac1d8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab13fc640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 0x7f3aac1d8180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c016050 con 0x7f3aac093360 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 10 monclient: dump: 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7f3a9c0123f0 con 0x7f3aac093360 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 msgr2=0x7f3aac1d8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 0x7f3aac1d8180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 msgr2=0x7f3aac1d8180 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:05.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3a99ffb640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac093360 0x7f3aac1d8180 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0096f0 tx=0x7f3a9c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 186, 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 82746, 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:05.772 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.773 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.774 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:05.775 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:05.776 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.777 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.778 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.779 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.780 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.781 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:05.782 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a7c03dcc0 msgr2=0x7f3a7c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a7c03dcc0 0x7f3a7c040180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8004c90 tx=0x7f3aa8005220 comp rx=0 tx=0).stop 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 10 monclient: shutdown 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 msgr2=0x7f3aac099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000abb0 tx=0x7f3aa00047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab1bfd640 1 -- 10.20.193.51:0/4178930816 reap_dead start 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 shutdown_connections 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 --2- 10.20.193.51:0/4178930816 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3aac09e370 0x7f3aac099b90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 >> 10.20.193.51:0/4178930816 conn(0x7f3aac0a30c0 msgr2=0x7f3aac0738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 shutdown_connections 2026-02-17T12:05:05.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.751+0000 7f3ab3687640 1 -- 10.20.193.51:0/4178930816 wait complete. 2026-02-17T12:05:05.784 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:05.784 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:05:05.784 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.849+0000 7f88106c9640 10 monclient: get_monmap_and_config 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.849+0000 7f88106c9640 10 monclient: build_initial_monmap 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.849+0000 7f88106c9640 10 monclient: monmap: 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:05.850536+0000 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:05.850536+0000 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:05.851 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:05.852 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.849+0000 7f88106c9640 1 Processor -- start 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.849+0000 7f88106c9640 1 -- start start 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient: init 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-b con 0x7f88080a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88080a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 0x7f880813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-a con 0x7f880813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f880806e140 con 0x7f88080a0750 2026-02-17T12:05:05.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f880809f910 con 0x7f880813b760 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f880809ccd0 con 0x7f88080a3bb0 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f88106c9640 10 monclient(hunting): authenticate will time out at 1793.469302s 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880dc3d640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7f88080a0750 legacy=0x7f880809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880ec3f640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 msgr2=0x7f880813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880ec3f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 0x7f880813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55068/0 (socket says 10.20.193.51:55068) 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 -- 10.20.193.51:0/1499122584 learned_addr learned my addr 10.20.193.51:0/1499122584 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): get_auth_request con 0x7f88080a3bb0 auth_method 0 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.855 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient(hunting): handle_auth_done global_id 234263 payload 274 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 -- 10.20.193.51:0/1499122584 >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 msgr2=0x7f880813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 --2- 10.20.193.51:0/1499122584 >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 0x7f880813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 -- 10.20.193.51:0/1499122584 >> v1:10.20.193.51:6789/0 conn(0x7f88080a0750 legacy=0x7f880809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 monclient: found mon.noname-b 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.850+0000 7f880e43e640 1 -- 10.20.193.51:0/1499122584 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880809eec0 con 0x7f88080a3bb0 2026-02-17T12:05:05.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880e43e640 1 -- 10.20.193.51:0/1499122584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 msgr2=0x7f880809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880e43e640 1 --2- 10.20.193.51:0/1499122584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f880809f230 tx=0x7f87f802eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179f77456e216479 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 1 -- 10.20.193.51:0/1499122584 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f803c070 con 0x7f88080a3bb0 2026-02-17T12:05:05.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: dump: 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 5 monclient: authenticate success, global_id 234263 2026-02-17T12:05:05.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 1 -- 10.20.193.51:0/1499122584 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f802fdd0 con 0x7f88080a3bb0 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 1 -- 10.20.193.51:0/1499122584 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8037660 con 0x7f88080a3bb0 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 4 set_mon_vals no callback set 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f880d43c640 10 monclient: dump: 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.863 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 10 monclient: shutdown 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 -- 10.20.193.51:0/1499122584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 msgr2=0x7f880809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 --2- 10.20.193.51:0/1499122584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f880809f230 tx=0x7f87f802eeb0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 -- 10.20.193.51:0/1499122584 shutdown_connections 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 --2- 10.20.193.51:0/1499122584 >> v2:10.20.193.51:3300/0 conn(0x7f880813b760 0x7f880813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 --2- 10.20.193.51:0/1499122584 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f88080a3bb0 0x7f880809dac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 -- 10.20.193.51:0/1499122584 >> 10.20.193.51:0/1499122584 conn(0x7f88080a30c0 msgr2=0x7f88080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 -- 10.20.193.51:0/1499122584 shutdown_connections 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 1 -- 10.20.193.51:0/1499122584 wait complete. 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 10 monclient: build_initial_monmap 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.853+0000 7f88106c9640 10 monclient: monmap: 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:05.864 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 Processor -- start 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 -- start start 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient: init 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88080a0750 0x7f88081cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-a con 0x7f88080a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080a3bb0 0x7f88081d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-b con 0x7f88080a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:05.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 0x7f8808095060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): picked mon.noname-c con 0x7f880813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f88080a04b0 con 0x7f88080a0750 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f880809c850 con 0x7f88080a3bb0 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f880809e710 con 0x7f880813b760 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f88106c9640 10 monclient(hunting): authenticate will time out at 1793.473503s 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880e43e640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88080a0750 msgr2=0x7f88081cfb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880e43e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88080a0750 0x7f88081cfb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 0x7f8808095060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 0x7f8808095060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55072/0 (socket says 10.20.193.51:55072) 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 learned_addr learned my addr 10.20.193.51:0/3922067063 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): get_auth_request con 0x7f880813b760 auth_method 0 2026-02-17T12:05:05.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880dc3d640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080a3bb0 0x7f88081d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880dc3d640 10 monclient(hunting): get_auth_request con 0x7f88080a3bb0 auth_method 0 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880dc3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880dc3d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880dc3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient(hunting): handle_auth_done global_id 234266 payload 824 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080a3bb0 msgr2=0x7f88081d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080a3bb0 0x7f88081d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88080a0750 msgr2=0x7f88081cfb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f88080a0750 0x7f88081cfb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient: _finish_hunting 0 2026-02-17T12:05:05.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 monclient: found mon.noname-c 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.854+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880809d7b0 con 0x7f880813b760 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 msgr2=0x7f8808095060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f880ec3f640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 0x7f8808095060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f880400be90 tx=0x7f880400bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804006e60 con 0x7f880813b760 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: dump: 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.868 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8804010030 con 0x7f880813b760 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804016870 con 0x7f880813b760 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.856+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f87eeffd640 10 monclient: dump: 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.869 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 5 monclient: authenticate success, global_id 234266 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880cc3b640 4 set_mon_vals no callback set 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 monclient: _renew_subs 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8808097cb0 con 0x7f880813b760 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 monclient: _renew_subs 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88080a2cb0 con 0x7f880813b760 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 0x7f88080955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8808096a00 con 0x7f88080988f0 2026-02-17T12:05:05.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8804008070 con 0x7f880813b760 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 0x7f88080955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient: get_auth_request con 0x7f88080988f0 auth_method 0 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f87eeffd640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87d803dd10 0x7f87d80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.857+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(723..723 src has 323..723) ==== 4799+0+0 (secure 0 0 0) 0x7f8804052420 con 0x7f880813b760 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.858+0000 7f880e43e640 10 monclient(hunting): handle_auth_done global_id 184630 payload 824 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.858+0000 7f880e43e640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f880809dac0 con 0x7f88080988f0 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.858+0000 7f880dc3d640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87d803dd10 0x7f87d80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.858+0000 7f880dc3d640 10 monclient: get_auth_request con 0x7f87d803dd10 auth_method 0 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f880e43e640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 msgr2=0x7f88080955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f880e43e640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 0x7f88080955a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8808069d60 tx=0x7f87f80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8047070 con 0x7f88080988f0 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 10 monclient: dump: 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.874 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f880dc3d640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87d803dd10 0x7f87d80401d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f880813b730 tx=0x7f87fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f87f8037d70 con 0x7f88080988f0 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 msgr2=0x7f88080955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 0x7f88080955a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8808069d60 tx=0x7f87f80047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 msgr2=0x7f88080955a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.860+0000 7f87eeffd640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f88080988f0 0x7f88080955a0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8808069d60 tx=0x7f87f80047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f88106c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:05.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f88106c9640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 0x7f88081daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f88106c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88080984d0 con 0x7f8808095ae0 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 0x7f88081daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient: get_auth_request con 0x7f8808095ae0 auth_method 0 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.863+0000 7f880e43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.864+0000 7f880e43e640 10 monclient(hunting): handle_auth_done global_id 184633 payload 824 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.864+0000 7f880e43e640 1 -- 10.20.193.51:0/3922067063 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88080976d0 con 0x7f8808095ae0 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f880e43e640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 msgr2=0x7f88081daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f880e43e640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 0x7f88081daad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87f802eef0 tx=0x7f87f8009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:05.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f803c040 con 0x7f8808095ae0 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 10 monclient: dump: 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4867 (secure 0 0 0) 0x7f87f8003710 con 0x7f8808095ae0 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:05.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 msgr2=0x7f88081daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 0x7f88081daad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87f802eef0 tx=0x7f87f8009340 comp rx=0 tx=0).stop 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 msgr2=0x7f88081daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f87eeffd640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8808095ae0 0x7f88081daad0 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87f802eef0 tx=0x7f87f8009340 comp rx=0 tx=0).stop 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 186, 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 338253, 2026-02-17T12:05:05.878 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.879 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.880 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:05.881 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.882 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.883 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.884 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:05.885 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.886 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.887 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:05.888 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87d803dd10 msgr2=0x7f87d80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f87d803dd10 0x7f87d80401d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f880813b730 tx=0x7f87fc008040 comp rx=0 tx=0).stop 2026-02-17T12:05:05.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 10 monclient: shutdown 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 msgr2=0x7f8808095060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f88106c9640 1 --2- 10.20.193.51:0/3922067063 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f880813b760 0x7f8808095060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f880400be90 tx=0x7f880400bf90 comp rx=0 tx=0).stop 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 reap_dead start 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.866+0000 7f880ec3f640 1 -- 10.20.193.51:0/3922067063 reap_dead start 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.867+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 shutdown_connections 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.867+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 >> 10.20.193.51:0/3922067063 conn(0x7f88080a30c0 msgr2=0x7f880813ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.867+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 shutdown_connections 2026-02-17T12:05:05.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:05.867+0000 7f88106c9640 1 -- 10.20.193.51:0/3922067063 wait complete. 2026-02-17T12:05:05.890 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:05.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:05:06.591 INFO:tasks.rados.rados.0.trial142.stdout:3153: done (4 left) 2026-02-17T12:05:06.591 INFO:tasks.rados.rados.0.trial142.stdout:3154: done (3 left) 2026-02-17T12:05:06.591 INFO:tasks.rados.rados.0.trial142.stdout:3155: done (2 left) 2026-02-17T12:05:06.591 INFO:tasks.rados.rados.0.trial142.stdout:3156: done (1 left) 2026-02-17T12:05:06.591 INFO:tasks.rados.rados.0.trial142.stdout:3157: done (0 left) 2026-02-17T12:05:06.592 INFO:tasks.rados.rados.0.trial142.stdout:3158: snap_remove snap 332 2026-02-17T12:05:07.591 INFO:tasks.rados.rados.0.trial142.stdout:3158: done (0 left) 2026-02-17T12:05:07.592 INFO:tasks.rados.rados.0.trial142.stdout:3159: rollback oid 1 current snap is 352 2026-02-17T12:05:07.592 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 346 2026-02-17T12:05:07.592 INFO:tasks.rados.rados.0.trial142.stdout:3160: snap_create 2026-02-17T12:05:07.596 INFO:tasks.rados.rados.0.trial142.stdout:3159: finishing rollback tid 0 to trial14245205-1 2026-02-17T12:05:07.597 INFO:tasks.rados.rados.0.trial142.stdout:3159: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:05:07.597 INFO:tasks.rados.rados.0.trial142.stdout:3159: finishing rollback tid 2 to trial14245205-1 2026-02-17T12:05:07.597 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2699 (ObjNum 958 snap 310 seq_num 958) dirty exists 2026-02-17T12:05:07.647 INFO:tasks.rados.rados.0.trial142.stdout:3159: done (1 left) 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3160: done (0 left) 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3161: copy_from oid 4 from oid 47 current snap is 353 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3162: rollback oid 8 current snap is 353 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 8 to 349 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3163: read oid 31 snap 350 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3163: expect (ObjNum 1075 snap 349 seq_num 1075) 2026-02-17T12:05:07.648 INFO:tasks.rados.rados.0.trial142.stdout:3164: snap_remove snap 323 2026-02-17T12:05:08.649 INFO:tasks.rados.rados.0.trial142.stdout:3164: done (3 left) 2026-02-17T12:05:08.649 INFO:tasks.rados.rados.0.trial142.stdout:3165: rollback oid 6 current snap is 353 2026-02-17T12:05:08.649 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 347 2026-02-17T12:05:08.649 INFO:tasks.rados.rados.0.trial142.stdout:3161: finishing copy_from to trial14245205-4 2026-02-17T12:05:08.649 INFO:tasks.rados.rados.0.trial142.stdout:3161: got expected ENOENT (src dne) 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:3161: finishing copy_from racing read to trial14245205-4 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:3162: finishing rollback tid 0 to trial14245205-8 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:3162: finishing rollback tid 1 to trial14245205-8 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:3162: finishing rollback tid 2 to trial14245205-8 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2727 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:05:08.650 INFO:tasks.rados.rados.0.trial142.stdout:3163: expect (ObjNum 1075 snap 349 seq_num 1075) 2026-02-17T12:05:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3165: finishing rollback tid 1 to trial14245205-6 2026-02-17T12:05:08.695 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:05:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3161: done (3 left) 2026-02-17T12:05:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3162: done (2 left) 2026-02-17T12:05:08.696 INFO:tasks.rados.rados.0.trial142.stdout:3163: done (1 left) 2026-02-17T12:05:08.696 INFO:tasks.rados.rados.0.trial142.stdout:3165: done (0 left) 2026-02-17T12:05:08.696 INFO:tasks.rados.rados.0.trial142.stdout:3166: snap_create 2026-02-17T12:05:09.651 INFO:tasks.rados.rados.0.trial142.stdout:3166: done (0 left) 2026-02-17T12:05:09.651 INFO:tasks.rados.rados.0.trial142.stdout:3167: read oid 39 snap -1 2026-02-17T12:05:09.651 INFO:tasks.rados.rados.0.trial142.stdout:3167: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:09.651 INFO:tasks.rados.rados.0.trial142.stdout:3168: write oid 2 current snap is 354 2026-02-17T12:05:09.652 INFO:tasks.rados.rados.0.trial142.stdout:3168: seq_num 1079 ranges {534753=799444,1990659=144094} 2026-02-17T12:05:09.656 INFO:tasks.rados.rados.0.trial142.stdout:3168: writing trial14245205-2 from 534753 to 1334197 tid 1 2026-02-17T12:05:09.659 INFO:tasks.rados.rados.0.trial142.stdout:3168: writing trial14245205-2 from 1990659 to 2134753 tid 2 2026-02-17T12:05:09.659 INFO:tasks.rados.rados.0.trial142.stdout:3169: read oid 4 snap -1 2026-02-17T12:05:09.659 INFO:tasks.rados.rados.0.trial142.stdout:3169: expect (ObjNum 900 snap 287 seq_num 900) 2026-02-17T12:05:09.659 INFO:tasks.rados.rados.0.trial142.stdout:3170: snap_remove snap 338 2026-02-17T12:05:10.654 INFO:tasks.rados.rados.0.trial142.stdout:3170: done (3 left) 2026-02-17T12:05:10.654 INFO:tasks.rados.rados.0.trial142.stdout:3171: snap_remove snap 348 2026-02-17T12:05:11.655 INFO:tasks.rados.rados.0.trial142.stdout:3171: done (3 left) 2026-02-17T12:05:11.655 INFO:tasks.rados.rados.0.trial142.stdout:3172: read oid 9 snap 331 2026-02-17T12:05:11.655 INFO:tasks.rados.rados.0.trial142.stdout:3172: expect deleted 2026-02-17T12:05:11.655 INFO:tasks.rados.rados.0.trial142.stdout:3173: delete oid 48 current snap is 354 2026-02-17T12:05:11.655 INFO:tasks.rados.rados.0.trial142.stdout:3167: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:11.721 INFO:tasks.rados.rados.0.trial142.stdout:3168: finishing write tid 1 to trial14245205-2 2026-02-17T12:05:11.721 INFO:tasks.rados.rados.0.trial142.stdout:3168: finishing write tid 2 to trial14245205-2 2026-02-17T12:05:11.721 INFO:tasks.rados.rados.0.trial142.stdout:3167: done (4 left) 2026-02-17T12:05:11.721 INFO:tasks.rados.rados.0.trial142.stdout:3173: done (3 left) 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3174: read oid 43 snap -1 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3174: expect (ObjNum 1028 snap 333 seq_num 1028) 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3175: read oid 26 snap -1 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3175: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3176: write oid 38 current snap is 354 2026-02-17T12:05:11.722 INFO:tasks.rados.rados.0.trial142.stdout:3168: finishing write tid 3 to trial14245205-2 2026-02-17T12:05:11.723 INFO:tasks.rados.rados.0.trial142.stdout:3169: expect (ObjNum 900 snap 287 seq_num 900) 2026-02-17T12:05:11.899 INFO:tasks.rados.rados.0.trial142.stdout:3168: finishing write tid 4 to trial14245205-2 2026-02-17T12:05:11.899 INFO:tasks.rados.rados.0.trial142.stdout:3168: oid 2 updating version 0 to 2131 2026-02-17T12:05:11.899 INFO:tasks.rados.rados.0.trial142.stdout:3168: oid 2 updating version 2131 to 2132 2026-02-17T12:05:11.900 INFO:tasks.rados.rados.0.trial142.stdout:3168: oid 2 updating version 2132 to 2133 2026-02-17T12:05:11.900 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2133 (ObjNum 1079 snap 354 seq_num 1079) dirty exists 2026-02-17T12:05:11.900 INFO:tasks.rados.rados.0.trial142.stdout:3168: left oid 2 (ObjNum 1079 snap 354 seq_num 1079) 2026-02-17T12:05:11.900 INFO:tasks.rados.rados.0.trial142.stdout:3174: expect (ObjNum 1028 snap 333 seq_num 1028) 2026-02-17T12:05:12.053 INFO:tasks.rados.rados.0.trial142.stdout:3175: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:12.125 INFO:tasks.rados.rados.0.trial142.stdout:3176: seq_num 1081 ranges {568367=666295,1707623=460744} 2026-02-17T12:05:12.130 INFO:tasks.rados.rados.0.trial142.stdout:3176: writing trial14245205-38 from 568367 to 1234662 tid 1 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3176: writing trial14245205-38 from 1707623 to 2168367 tid 2 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3168: done (5 left) 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3169: done (4 left) 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3172: done (3 left) 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3174: done (2 left) 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3175: done (1 left) 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3177: copy_from oid 28 from oid 14 current snap is 354 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3178: delete oid 36 current snap is 354 2026-02-17T12:05:12.134 INFO:tasks.rados.rados.0.trial142.stdout:3176: finishing write tid 1 to trial14245205-38 2026-02-17T12:05:12.135 INFO:tasks.rados.rados.0.trial142.stdout:3177: finishing copy_from to trial14245205-28 2026-02-17T12:05:12.135 INFO:tasks.rados.rados.0.trial142.stdout:3177: got expected ENOENT (src dne) 2026-02-17T12:05:12.135 INFO:tasks.rados.rados.0.trial142.stdout:3177: finishing copy_from racing read to trial14245205-28 2026-02-17T12:05:12.135 INFO:tasks.rados.rados.0.trial142.stdout:3176: finishing write tid 2 to trial14245205-38 2026-02-17T12:05:12.135 INFO:tasks.rados.rados.0.trial142.stdout:3176: finishing write tid 3 to trial14245205-38 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: finishing write tid 4 to trial14245205-38 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: oid 38 updating version 0 to 1994 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: oid 38 updating version 1994 to 1995 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: oid 38 version 1995 is already newer than 1993 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1995 (ObjNum 1081 snap 354 seq_num 1081) dirty exists 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: left oid 38 (ObjNum 1081 snap 354 seq_num 1081) 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3176: done (2 left) 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3177: done (1 left) 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3178: done (0 left) 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:3179: rollback oid 7 current snap is 354 2026-02-17T12:05:12.136 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 342 2026-02-17T12:05:12.137 INFO:tasks.rados.rados.0.trial142.stdout:3180: rollback oid 17 current snap is 354 2026-02-17T12:05:12.137 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 347 2026-02-17T12:05:12.137 INFO:tasks.rados.rados.0.trial142.stdout:3181: delete oid 50 current snap is 354 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:3179: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:3181: done (2 left) 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:3182: copy_from oid 49 from oid 28 current snap is 354 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:3183: snap_create 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:3179: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:05:12.138 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2996 (ObjNum 1052 snap 341 seq_num 1052) dirty exists 2026-02-17T12:05:12.140 INFO:tasks.rados.rados.0.trial142.stdout:3180: finishing rollback tid 0 to trial14245205-17 2026-02-17T12:05:12.140 INFO:tasks.rados.rados.0.trial142.stdout:3180: finishing rollback tid 1 to trial14245205-17 2026-02-17T12:05:12.140 INFO:tasks.rados.rados.0.trial142.stdout:3180: finishing rollback tid 2 to trial14245205-17 2026-02-17T12:05:12.140 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2545 (ObjNum 1068 snap 346 seq_num 1068) dirty exists 2026-02-17T12:05:12.147 INFO:tasks.rados.rados.0.trial142.stdout:3182: finishing copy_from racing read to trial14245205-49 2026-02-17T12:05:12.148 INFO:tasks.rados.rados.0.trial142.stdout:3182: finishing copy_from to trial14245205-49 2026-02-17T12:05:12.148 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 2149 (ObjNum 1060 snap 343 seq_num 1060) dirty exists 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3179: done (3 left) 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3180: done (2 left) 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3182: done (1 left) 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3183: done (0 left) 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3184: write oid 19 current snap is 355 2026-02-17T12:05:13.334 INFO:tasks.rados.rados.0.trial142.stdout:3184: seq_num 1084 ranges {618788=492042,1883069=335719} 2026-02-17T12:05:13.338 INFO:tasks.rados.rados.0.trial142.stdout:3184: writing trial14245205-19 from 618788 to 1110830 tid 1 2026-02-17T12:05:13.344 INFO:tasks.rados.rados.0.trial142.stdout:3184: writing trial14245205-19 from 1883069 to 2218788 tid 2 2026-02-17T12:05:13.344 INFO:tasks.rados.rados.0.trial142.stdout:3185: delete oid 13 current snap is 355 2026-02-17T12:05:13.344 INFO:tasks.rados.rados.0.trial142.stdout:3184: finishing write tid 1 to trial14245205-19 2026-02-17T12:05:13.346 INFO:tasks.rados.rados.0.trial142.stdout:3184: finishing write tid 2 to trial14245205-19 2026-02-17T12:05:13.346 INFO:tasks.rados.rados.0.trial142.stdout:3184: finishing write tid 3 to trial14245205-19 2026-02-17T12:05:13.346 INFO:tasks.rados.rados.0.trial142.stdout:3184: finishing write tid 4 to trial14245205-19 2026-02-17T12:05:13.346 INFO:tasks.rados.rados.0.trial142.stdout:3184: oid 19 updating version 0 to 2719 2026-02-17T12:05:13.346 INFO:tasks.rados.rados.0.trial142.stdout:3184: oid 19 updating version 2719 to 2720 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:3184: oid 19 version 2720 is already newer than 2718 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2720 (ObjNum 1084 snap 355 seq_num 1084) dirty exists 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:3184: left oid 19 (ObjNum 1084 snap 355 seq_num 1084) 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:3184: done (1 left) 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:3185: done (0 left) 2026-02-17T12:05:13.347 INFO:tasks.rados.rados.0.trial142.stdout:3186: snap_create 2026-02-17T12:05:13.659 INFO:tasks.rados.rados.0.trial142.stdout:3186: done (0 left) 2026-02-17T12:05:13.659 INFO:tasks.rados.rados.0.trial142.stdout:3187: write oid 20 current snap is 356 2026-02-17T12:05:13.659 INFO:tasks.rados.rados.0.trial142.stdout:3187: seq_num 1086 ranges {652402=642540,1883680=368722} 2026-02-17T12:05:13.664 INFO:tasks.rados.rados.0.trial142.stdout:3187: writing trial14245205-20 from 652402 to 1294942 tid 1 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3187: writing trial14245205-20 from 1883680 to 2252402 tid 2 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3188: copy_from oid 8 from oid 44 current snap is 356 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3189: copy_from oid 15 from oid 32 current snap is 356 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3190: rollback oid 21 current snap is 356 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 351 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3191: rollback oid 6 current snap is 356 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 346 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3192: write (excl) oid 31 current snap is 356 2026-02-17T12:05:13.668 INFO:tasks.rados.rados.0.trial142.stdout:3192: seq_num 1087 ranges {669209=717789,1942162=327047} 2026-02-17T12:05:13.673 INFO:tasks.rados.rados.0.trial142.stdout:3192: writing trial14245205-31 from 669209 to 1386998 tid 1 2026-02-17T12:05:13.677 INFO:tasks.rados.rados.0.trial142.stdout:3192: writing trial14245205-31 from 1942162 to 2269209 tid 2 2026-02-17T12:05:13.677 INFO:tasks.rados.rados.0.trial142.stdout:3193: snap_remove snap 353 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3193: done (6 left) 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3194: copy_from oid 45 from oid 41 current snap is 356 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3191: finishing rollback tid 1 to trial14245205-6 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 0 (ObjNum 129 snap 0 seq_num 3495931248) dirty dne 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3187: finishing write tid 1 to trial14245205-20 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3190: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3190: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:3190: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:05:14.664 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2164 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: finishing write tid 2 to trial14245205-20 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: finishing write tid 3 to trial14245205-20 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: finishing write tid 4 to trial14245205-20 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: oid 20 updating version 0 to 2721 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: oid 20 updating version 2721 to 2722 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: oid 20 version 2722 is already newer than 2720 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2722 (ObjNum 1086 snap 356 seq_num 1086) dirty exists 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: left oid 20 (ObjNum 1086 snap 356 seq_num 1086) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3189: finishing copy_from racing read to trial14245205-15 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3188: finishing copy_from racing read to trial14245205-8 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3188: finishing copy_from to trial14245205-8 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2696 (ObjNum 1073 snap 348 seq_num 1073) dirty exists 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3189: finishing copy_from to trial14245205-15 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3192: finishing write tid 1 to trial14245205-31 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3187: done (6 left) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3188: done (5 left) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3189: done (4 left) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3190: done (3 left) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3191: done (2 left) 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3195: write (excl) oid 20 current snap is 356 2026-02-17T12:05:14.665 INFO:tasks.rados.rados.0.trial142.stdout:3195: seq_num 1088 ranges {686016=509391,1716997=569019} 2026-02-17T12:05:14.669 INFO:tasks.rados.rados.0.trial142.stdout:3195: writing trial14245205-20 from 686016 to 1195407 tid 1 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3195: writing trial14245205-20 from 1716997 to 2286016 tid 2 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3196: rollback oid 47 current snap is 356 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 350 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: finishing write tid 2 to trial14245205-31 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: finishing write tid 3 to trial14245205-31 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: finishing write tid 4 to trial14245205-31 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: oid 31 updating version 0 to 2731 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: oid 31 version 2731 is already newer than 2730 2026-02-17T12:05:14.674 INFO:tasks.rados.rados.0.trial142.stdout:3192: oid 31 version 2731 is already newer than 2729 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 2731 (ObjNum 1087 snap 356 seq_num 1087) dirty exists 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3192: left oid 31 (ObjNum 1087 snap 356 seq_num 1087) 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3195: finishing write tid 1 to trial14245205-20 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3194: finishing copy_from racing read to trial14245205-45 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3192: done (3 left) 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3197: delete oid 19 current snap is 356 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:3194: finishing copy_from to trial14245205-45 2026-02-17T12:05:14.675 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2129 (ObjNum 897 snap 285 seq_num 897) dirty exists 2026-02-17T12:05:14.676 INFO:tasks.rados.rados.0.trial142.stdout:3195: finishing write tid 2 to trial14245205-20 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: finishing write tid 3 to trial14245205-20 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3196: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2521 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: finishing write tid 4 to trial14245205-20 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: oid 20 updating version 0 to 2723 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: oid 20 updating version 2723 to 2725 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: oid 20 version 2725 is already newer than 2724 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2725 (ObjNum 1088 snap 356 seq_num 1088) dirty exists 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: left oid 20 (ObjNum 1088 snap 356 seq_num 1088) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3194: done (3 left) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3195: done (2 left) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3196: done (1 left) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3197: done (0 left) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3198: read oid 7 snap -1 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3198: expect (ObjNum 1052 snap 341 seq_num 1052) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3199: read oid 10 snap 322 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3199: expect deleted 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3200: read oid 28 snap -1 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3200: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:05:14.677 INFO:tasks.rados.rados.0.trial142.stdout:3201: snap_remove snap 350 2026-02-17T12:05:15.667 INFO:tasks.rados.rados.0.trial142.stdout:3201: done (3 left) 2026-02-17T12:05:15.667 INFO:tasks.rados.rados.0.trial142.stdout:3202: copy_from oid 15 from oid 33 current snap is 356 2026-02-17T12:05:15.667 INFO:tasks.rados.rados.0.trial142.stdout:3200: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:05:15.756 INFO:tasks.rados.rados.0.trial142.stdout:3198: expect (ObjNum 1052 snap 341 seq_num 1052) 2026-02-17T12:05:15.934 INFO:tasks.rados.rados.0.trial142.stdout:3202: finishing copy_from racing read to trial14245205-15 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3202: finishing copy_from to trial14245205-15 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3198: done (3 left) 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3199: done (2 left) 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3200: done (1 left) 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3202: done (0 left) 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3203: write (excl) oid 8 current snap is 356 2026-02-17T12:05:15.935 INFO:tasks.rados.rados.0.trial142.stdout:3203: seq_num 1090 ranges {719630=659889,2117608=202022} 2026-02-17T12:05:15.939 INFO:tasks.rados.rados.0.trial142.stdout:3203: writing trial14245205-8 from 719630 to 1379519 tid 1 2026-02-17T12:05:15.943 INFO:tasks.rados.rados.0.trial142.stdout:3203: writing trial14245205-8 from 2117608 to 2319630 tid 2 2026-02-17T12:05:15.943 INFO:tasks.rados.rados.0.trial142.stdout:3204: delete oid 40 current snap is 356 2026-02-17T12:05:15.943 INFO:tasks.rados.rados.0.trial142.stdout:3203: finishing write tid 1 to trial14245205-8 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: finishing write tid 2 to trial14245205-8 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3204: done (1 left) 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3205: snap_create 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: finishing write tid 3 to trial14245205-8 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: finishing write tid 4 to trial14245205-8 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: oid 8 updating version 0 to 2734 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: oid 8 version 2734 is already newer than 2733 2026-02-17T12:05:15.945 INFO:tasks.rados.rados.0.trial142.stdout:3203: oid 8 version 2734 is already newer than 2732 2026-02-17T12:05:15.946 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 2734 (ObjNum 1090 snap 356 seq_num 1090) dirty exists 2026-02-17T12:05:15.946 INFO:tasks.rados.rados.0.trial142.stdout:3203: left oid 8 (ObjNum 1090 snap 356 seq_num 1090) 2026-02-17T12:05:16.670 INFO:tasks.rados.rados.0.trial142.stdout:3203: done (1 left) 2026-02-17T12:05:16.671 INFO:tasks.rados.rados.0.trial142.stdout:3205: done (0 left) 2026-02-17T12:05:16.671 INFO:tasks.rados.rados.0.trial142.stdout:3206: write oid 35 current snap is 357 2026-02-17T12:05:16.671 INFO:tasks.rados.rados.0.trial142.stdout:3206: seq_num 1092 ranges {753244=410387,1834572=518672} 2026-02-17T12:05:16.674 INFO:tasks.rados.rados.0.trial142.stdout:3206: writing trial14245205-35 from 753244 to 1163631 tid 1 2026-02-17T12:05:16.679 INFO:tasks.rados.rados.0.trial142.stdout:3206: writing trial14245205-35 from 1834572 to 2353244 tid 2 2026-02-17T12:05:16.679 INFO:tasks.rados.rados.0.trial142.stdout:3207: write oid 15 current snap is 357 2026-02-17T12:05:16.679 INFO:tasks.rados.rados.0.trial142.stdout:3206: finishing write tid 1 to trial14245205-35 2026-02-17T12:05:16.679 INFO:tasks.rados.rados.0.trial142.stdout:3207: seq_num 1093 ranges {770051=485636,1776701=511047} 2026-02-17T12:05:16.684 INFO:tasks.rados.rados.0.trial142.stdout:3207: writing trial14245205-15 from 770051 to 1255687 tid 1 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3207: writing trial14245205-15 from 1776701 to 2287748 tid 2 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3208: delete oid 6 current snap is 357 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: finishing write tid 2 to trial14245205-35 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: finishing write tid 3 to trial14245205-35 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: finishing write tid 4 to trial14245205-35 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: oid 35 updating version 0 to 2735 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: oid 35 updating version 2735 to 2737 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: oid 35 version 2737 is already newer than 2736 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 2737 (ObjNum 1092 snap 357 seq_num 1092) dirty exists 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3206: left oid 35 (ObjNum 1092 snap 357 seq_num 1092) 2026-02-17T12:05:16.688 INFO:tasks.rados.rados.0.trial142.stdout:3207: finishing write tid 1 to trial14245205-15 2026-02-17T12:05:16.690 INFO:tasks.rados.rados.0.trial142.stdout:3207: finishing write tid 2 to trial14245205-15 2026-02-17T12:05:16.690 INFO:tasks.rados.rados.0.trial142.stdout:3206: done (2 left) 2026-02-17T12:05:16.690 INFO:tasks.rados.rados.0.trial142.stdout:3208: done (1 left) 2026-02-17T12:05:16.690 INFO:tasks.rados.rados.0.trial142.stdout:3209: rollback oid 14 current snap is 357 2026-02-17T12:05:16.691 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 356 2026-02-17T12:05:16.691 INFO:tasks.rados.rados.0.trial142.stdout:3210: read oid 12 snap -1 2026-02-17T12:05:16.691 INFO:tasks.rados.rados.0.trial142.stdout:3210: expect deleted 2026-02-17T12:05:16.691 INFO:tasks.rados.rados.0.trial142.stdout:3211: snap_remove snap 346 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3211: done (3 left) 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3212: delete oid 4 current snap is 357 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: finishing write tid 3 to trial14245205-15 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: finishing write tid 4 to trial14245205-15 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: oid 15 updating version 0 to 2740 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: oid 15 version 2740 is already newer than 2739 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: oid 15 version 2740 is already newer than 2738 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2740 (ObjNum 1093 snap 357 seq_num 1093) dirty exists 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3207: left oid 15 (ObjNum 1093 snap 357 seq_num 1093) 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:3209: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:05:17.649 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2846 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3207: done (3 left) 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3209: done (2 left) 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3210: done (1 left) 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3212: done (0 left) 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3213: copy_from oid 40 from oid 12 current snap is 357 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3214: rollback oid 29 current snap is 357 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 355 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3215: write (excl) oid 9 current snap is 357 2026-02-17T12:05:17.653 INFO:tasks.rados.rados.0.trial142.stdout:3215: seq_num 1096 ranges {420472=427736,1268500=658374,2347953=72519} 2026-02-17T12:05:17.656 INFO:tasks.rados.rados.0.trial142.stdout:3215: writing trial14245205-9 from 420472 to 848208 tid 1 2026-02-17T12:05:17.660 INFO:tasks.rados.rados.0.trial142.stdout:3215: writing trial14245205-9 from 1268500 to 1926874 tid 2 2026-02-17T12:05:17.662 INFO:tasks.rados.rados.0.trial142.stdout:3215: writing trial14245205-9 from 2347953 to 2420472 tid 3 2026-02-17T12:05:17.662 INFO:tasks.rados.rados.0.trial142.stdout:3216: read oid 45 snap -1 2026-02-17T12:05:17.662 INFO:tasks.rados.rados.0.trial142.stdout:3216: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:17.662 INFO:tasks.rados.rados.0.trial142.stdout:3217: write (excl) oid 26 current snap is 357 2026-02-17T12:05:17.662 INFO:tasks.rados.rados.0.trial142.stdout:3213: finishing copy_from to trial14245205-40 2026-02-17T12:05:17.663 INFO:tasks.rados.rados.0.trial142.stdout:3213: got expected ENOENT (src dne) 2026-02-17T12:05:17.663 INFO:tasks.rados.rados.0.trial142.stdout:3217: seq_num 1097 ranges {437279=502985,1610629=518385} 2026-02-17T12:05:17.666 INFO:tasks.rados.rados.0.trial142.stdout:3217: writing trial14245205-26 from 437279 to 940264 tid 1 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3217: writing trial14245205-26 from 1610629 to 2129014 tid 2 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3218: copy_from oid 17 from oid 39 current snap is 357 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3213: finishing copy_from racing read to trial14245205-40 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3214: finishing rollback tid 0 to trial14245205-29 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3214: finishing rollback tid 1 to trial14245205-29 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3214: finishing rollback tid 2 to trial14245205-29 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2721 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3213: done (5 left) 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3214: done (4 left) 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3219: read oid 38 snap -1 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3219: expect (ObjNum 1081 snap 354 seq_num 1081) 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3220: read oid 50 snap -1 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3220: expect deleted 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3221: write oid 24 current snap is 357 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3215: finishing write tid 1 to trial14245205-9 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3215: finishing write tid 2 to trial14245205-9 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3215: finishing write tid 3 to trial14245205-9 2026-02-17T12:05:17.672 INFO:tasks.rados.rados.0.trial142.stdout:3221: seq_num 1098 ranges {454086=578234,1669111=662043} 2026-02-17T12:05:17.675 INFO:tasks.rados.rados.0.trial142.stdout:3221: writing trial14245205-24 from 454086 to 1032320 tid 1 2026-02-17T12:05:17.680 INFO:tasks.rados.rados.0.trial142.stdout:3221: writing trial14245205-24 from 1669111 to 2331154 tid 2 2026-02-17T12:05:17.680 INFO:tasks.rados.rados.0.trial142.stdout:3222: snap_remove snap 322 2026-02-17T12:05:18.676 INFO:tasks.rados.rados.0.trial142.stdout:3222: done (7 left) 2026-02-17T12:05:18.676 INFO:tasks.rados.rados.0.trial142.stdout:3223: read oid 33 snap 344 2026-02-17T12:05:18.676 INFO:tasks.rados.rados.0.trial142.stdout:3223: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:18.676 INFO:tasks.rados.rados.0.trial142.stdout:3224: read oid 12 snap 356 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3224: expect deleted 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3225: rollback oid 42 current snap is 357 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 349 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3215: finishing write tid 4 to trial14245205-9 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3215: finishing write tid 5 to trial14245205-9 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3215: oid 9 updating version 0 to 3010 2026-02-17T12:05:18.677 INFO:tasks.rados.rados.0.trial142.stdout:3215: oid 9 updating version 3010 to 3012 2026-02-17T12:05:18.678 INFO:tasks.rados.rados.0.trial142.stdout:3215: oid 9 updating version 3012 to 3013 2026-02-17T12:05:18.678 INFO:tasks.rados.rados.0.trial142.stdout:3215: oid 9 version 3013 is already newer than 3011 2026-02-17T12:05:18.678 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3013 (ObjNum 1096 snap 357 seq_num 1096) dirty exists 2026-02-17T12:05:18.678 INFO:tasks.rados.rados.0.trial142.stdout:3215: left oid 9 (ObjNum 1096 snap 357 seq_num 1096) 2026-02-17T12:05:18.678 INFO:tasks.rados.rados.0.trial142.stdout:3216: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: finishing write tid 1 to trial14245205-26 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: finishing write tid 2 to trial14245205-26 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: finishing write tid 3 to trial14245205-26 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3215: done (9 left) 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3216: done (8 left) 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3220: done (7 left) 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3226: rollback oid 7 current snap is 357 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 334 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: finishing write tid 4 to trial14245205-26 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: oid 26 updating version 0 to 2696 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: oid 26 version 2696 is already newer than 2694 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: oid 26 version 2696 is already newer than 2695 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2696 (ObjNum 1097 snap 357 seq_num 1097) dirty exists 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3217: left oid 26 (ObjNum 1097 snap 357 seq_num 1097) 2026-02-17T12:05:18.748 INFO:tasks.rados.rados.0.trial142.stdout:3219: expect (ObjNum 1081 snap 354 seq_num 1081) 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3218: finishing copy_from racing read to trial14245205-17 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3217: done (7 left) 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3219: done (6 left) 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3227: read oid 6 snap -1 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3227: expect deleted 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3228: write oid 50 current snap is 357 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:3218: finishing copy_from to trial14245205-17 2026-02-17T12:05:18.816 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2139 (ObjNum 961 snap 310 seq_num 961) dirty exists 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: finishing write tid 1 to trial14245205-24 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: finishing write tid 2 to trial14245205-24 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: finishing write tid 3 to trial14245205-24 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: finishing write tid 4 to trial14245205-24 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: oid 24 updating version 0 to 2158 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: oid 24 version 2158 is already newer than 2157 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: oid 24 updating version 2158 to 2159 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2159 (ObjNum 1098 snap 357 seq_num 1098) dirty exists 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3221: left oid 24 (ObjNum 1098 snap 357 seq_num 1098) 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3225: finishing rollback tid 0 to trial14245205-42 2026-02-17T12:05:18.817 INFO:tasks.rados.rados.0.trial142.stdout:3228: seq_num 1099 ranges {470893=653483,1727593=522054} 2026-02-17T12:05:18.819 INFO:tasks.rados.rados.0.trial142.stdout:3228: writing trial14245205-50 from 470893 to 1124376 tid 1 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3228: writing trial14245205-50 from 1727593 to 2249647 tid 2 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3218: done (7 left) 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3221: done (6 left) 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3229: read oid 34 snap -1 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3229: expect deleted 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3230: read oid 38 snap -1 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3230: expect (ObjNum 1081 snap 354 seq_num 1081) 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:3231: rollback oid 20 current snap is 357 2026-02-17T12:05:18.824 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 334 2026-02-17T12:05:18.825 INFO:tasks.rados.rados.0.trial142.stdout:3225: finishing rollback tid 1 to trial14245205-42 2026-02-17T12:05:18.825 INFO:tasks.rados.rados.0.trial142.stdout:3225: finishing rollback tid 2 to trial14245205-42 2026-02-17T12:05:18.825 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2728 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:05:18.825 INFO:tasks.rados.rados.0.trial142.stdout:3223: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3226: finishing rollback tid 0 to trial14245205-7 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3226: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3223: done (8 left) 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3224: done (7 left) 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3225: done (6 left) 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3232: read oid 11 snap -1 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3232: expect deleted 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3233: read oid 44 snap -1 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3233: expect (ObjNum 1073 snap 348 seq_num 1073) 2026-02-17T12:05:19.012 INFO:tasks.rados.rados.0.trial142.stdout:3234: delete oid 24 current snap is 357 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3226: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 3031 (ObjNum 979 snap 315 seq_num 979) dirty exists 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: finishing write tid 1 to trial14245205-50 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: finishing write tid 2 to trial14245205-50 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: finishing write tid 3 to trial14245205-50 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3231: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: finishing write tid 4 to trial14245205-50 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: oid 50 updating version 0 to 2697 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: oid 50 updating version 2697 to 2699 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: oid 50 version 2699 is already newer than 2698 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2699 (ObjNum 1099 snap 357 seq_num 1099) dirty exists 2026-02-17T12:05:19.013 INFO:tasks.rados.rados.0.trial142.stdout:3228: left oid 50 (ObjNum 1099 snap 357 seq_num 1099) 2026-02-17T12:05:19.014 INFO:tasks.rados.rados.0.trial142.stdout:3230: expect (ObjNum 1081 snap 354 seq_num 1081) 2026-02-17T12:05:19.078 INFO:tasks.rados.rados.0.trial142.stdout:3231: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:05:19.078 INFO:tasks.rados.rados.0.trial142.stdout:3231: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:05:19.078 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2731 (ObjNum 960 snap 310 seq_num 960) dirty exists 2026-02-17T12:05:19.078 INFO:tasks.rados.rados.0.trial142.stdout:3233: expect (ObjNum 1073 snap 348 seq_num 1073) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3226: done (8 left) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3227: done (7 left) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3228: done (6 left) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3229: done (5 left) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3230: done (4 left) 2026-02-17T12:05:19.125 INFO:tasks.rados.rados.0.trial142.stdout:3231: done (3 left) 2026-02-17T12:05:19.126 INFO:tasks.rados.rados.0.trial142.stdout:3232: done (2 left) 2026-02-17T12:05:19.126 INFO:tasks.rados.rados.0.trial142.stdout:3233: done (1 left) 2026-02-17T12:05:19.126 INFO:tasks.rados.rados.0.trial142.stdout:3234: done (0 left) 2026-02-17T12:05:19.126 INFO:tasks.rados.rados.0.trial142.stdout:3235: write oid 47 current snap is 357 2026-02-17T12:05:19.126 INFO:tasks.rados.rados.0.trial142.stdout:3235: seq_num 1101 ranges {504507=403981,1328204=409370,2252362=252145} 2026-02-17T12:05:19.128 INFO:tasks.rados.rados.0.trial142.stdout:3235: writing trial14245205-47 from 504507 to 908488 tid 1 2026-02-17T12:05:19.131 INFO:tasks.rados.rados.0.trial142.stdout:3235: writing trial14245205-47 from 1328204 to 1737574 tid 2 2026-02-17T12:05:19.134 INFO:tasks.rados.rados.0.trial142.stdout:3235: writing trial14245205-47 from 2252362 to 2504507 tid 3 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3236: read oid 14 snap 334 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3236: expect (ObjNum 953 snap 310 seq_num 953) 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3237: write (excl) oid 45 current snap is 357 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3235: finishing write tid 1 to trial14245205-47 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3235: finishing write tid 2 to trial14245205-47 2026-02-17T12:05:19.135 INFO:tasks.rados.rados.0.trial142.stdout:3237: seq_num 1102 ranges {521314=479230,1786686=669381} 2026-02-17T12:05:19.138 INFO:tasks.rados.rados.0.trial142.stdout:3237: writing trial14245205-45 from 521314 to 1000544 tid 1 2026-02-17T12:05:19.143 INFO:tasks.rados.rados.0.trial142.stdout:3237: writing trial14245205-45 from 1786686 to 2456067 tid 2 2026-02-17T12:05:19.143 INFO:tasks.rados.rados.0.trial142.stdout:3238: snap_create 2026-02-17T12:05:19.144 INFO:tasks.rados.rados.0.trial142.stdout:3236: expect (ObjNum 953 snap 310 seq_num 953) 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: finishing write tid 3 to trial14245205-47 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: finishing write tid 4 to trial14245205-47 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: finishing write tid 5 to trial14245205-47 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: oid 47 updating version 0 to 2723 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: oid 47 version 2723 is already newer than 2722 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: oid 47 updating version 2723 to 2724 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: oid 47 updating version 2724 to 2725 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2725 (ObjNum 1101 snap 357 seq_num 1101) dirty exists 2026-02-17T12:05:19.218 INFO:tasks.rados.rados.0.trial142.stdout:3235: left oid 47 (ObjNum 1101 snap 357 seq_num 1101) 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: finishing write tid 1 to trial14245205-45 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: finishing write tid 2 to trial14245205-45 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: finishing write tid 3 to trial14245205-45 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: finishing write tid 4 to trial14245205-45 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: oid 45 updating version 0 to 2167 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: oid 45 version 2167 is already newer than 2165 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: oid 45 version 2167 is already newer than 2166 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2167 (ObjNum 1102 snap 357 seq_num 1102) dirty exists 2026-02-17T12:05:19.219 INFO:tasks.rados.rados.0.trial142.stdout:3237: left oid 45 (ObjNum 1102 snap 357 seq_num 1102) 2026-02-17T12:05:19.678 INFO:tasks.rados.rados.0.trial142.stdout:3235: done (3 left) 2026-02-17T12:05:19.679 INFO:tasks.rados.rados.0.trial142.stdout:3236: done (2 left) 2026-02-17T12:05:19.679 INFO:tasks.rados.rados.0.trial142.stdout:3237: done (1 left) 2026-02-17T12:05:19.679 INFO:tasks.rados.rados.0.trial142.stdout:3238: done (0 left) 2026-02-17T12:05:19.679 INFO:tasks.rados.rados.0.trial142.stdout:3239: write oid 26 current snap is 358 2026-02-17T12:05:19.679 INFO:tasks.rados.rados.0.trial142.stdout:3239: seq_num 1103 ranges {538121=670832,1961521=413039} 2026-02-17T12:05:19.682 INFO:tasks.rados.rados.0.trial142.stdout:3239: writing trial14245205-26 from 538121 to 1208953 tid 1 2026-02-17T12:05:19.687 INFO:tasks.rados.rados.0.trial142.stdout:3239: writing trial14245205-26 from 1961521 to 2374560 tid 2 2026-02-17T12:05:19.687 INFO:tasks.rados.rados.0.trial142.stdout:3240: write (excl) oid 25 current snap is 358 2026-02-17T12:05:19.687 INFO:tasks.rados.rados.0.trial142.stdout:3239: finishing write tid 1 to trial14245205-26 2026-02-17T12:05:19.688 INFO:tasks.rados.rados.0.trial142.stdout:3240: seq_num 1104 ranges {554928=746081,2020003=534925} 2026-02-17T12:05:19.692 INFO:tasks.rados.rados.0.trial142.stdout:3240: writing trial14245205-25 from 554928 to 1301009 tid 1 2026-02-17T12:05:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3240: writing trial14245205-25 from 2020003 to 2554928 tid 2 2026-02-17T12:05:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3241: read oid 45 snap -1 2026-02-17T12:05:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3241: expect (ObjNum 1102 snap 357 seq_num 1102) 2026-02-17T12:05:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3242: write (excl) oid 14 current snap is 358 2026-02-17T12:05:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3242: seq_num 1105 ranges {571735=421330,1562132=416708} 2026-02-17T12:05:19.700 INFO:tasks.rados.rados.0.trial142.stdout:3242: writing trial14245205-14 from 571735 to 993065 tid 1 2026-02-17T12:05:19.705 INFO:tasks.rados.rados.0.trial142.stdout:3242: writing trial14245205-14 from 1562132 to 1978840 tid 2 2026-02-17T12:05:19.705 INFO:tasks.rados.rados.0.trial142.stdout:3243: write oid 4 current snap is 358 2026-02-17T12:05:19.705 INFO:tasks.rados.rados.0.trial142.stdout:3243: seq_num 1106 ranges {588542=496579,1620614=676719} 2026-02-17T12:05:19.708 INFO:tasks.rados.rados.0.trial142.stdout:3243: writing trial14245205-4 from 588542 to 1085121 tid 1 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3243: writing trial14245205-4 from 1620614 to 2297333 tid 2 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3244: snap_create 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: finishing write tid 2 to trial14245205-26 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: finishing write tid 3 to trial14245205-26 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: finishing write tid 4 to trial14245205-26 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: oid 26 updating version 0 to 2701 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: oid 26 updating version 2701 to 2702 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: oid 26 version 2702 is already newer than 2700 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2702 (ObjNum 1103 snap 358 seq_num 1103) dirty exists 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3239: left oid 26 (ObjNum 1103 snap 358 seq_num 1103) 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: finishing write tid 1 to trial14245205-25 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: finishing write tid 2 to trial14245205-25 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: finishing write tid 3 to trial14245205-25 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: finishing write tid 4 to trial14245205-25 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: oid 25 updating version 0 to 2704 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: oid 25 version 2704 is already newer than 2703 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: oid 25 updating version 2704 to 2705 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2705 (ObjNum 1104 snap 358 seq_num 1104) dirty exists 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3240: left oid 25 (ObjNum 1104 snap 358 seq_num 1104) 2026-02-17T12:05:19.713 INFO:tasks.rados.rados.0.trial142.stdout:3241: expect (ObjNum 1102 snap 357 seq_num 1102) 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: finishing write tid 1 to trial14245205-14 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: finishing write tid 2 to trial14245205-14 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: finishing write tid 3 to trial14245205-14 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: finishing write tid 4 to trial14245205-14 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: oid 14 updating version 0 to 3032 2026-02-17T12:05:19.794 INFO:tasks.rados.rados.0.trial142.stdout:3242: oid 14 updating version 3032 to 3033 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3242: oid 14 updating version 3033 to 3034 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3034 (ObjNum 1105 snap 358 seq_num 1105) dirty exists 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3242: left oid 14 (ObjNum 1105 snap 358 seq_num 1105) 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: finishing write tid 1 to trial14245205-4 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: finishing write tid 2 to trial14245205-4 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: finishing write tid 3 to trial14245205-4 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: finishing write tid 4 to trial14245205-4 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: oid 4 updating version 0 to 3037 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: oid 4 version 3037 is already newer than 3035 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:3243: oid 4 version 3037 is already newer than 3036 2026-02-17T12:05:19.795 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3037 (ObjNum 1106 snap 358 seq_num 1106) dirty exists 2026-02-17T12:05:19.796 INFO:tasks.rados.rados.0.trial142.stdout:3243: left oid 4 (ObjNum 1106 snap 358 seq_num 1106) 2026-02-17T12:05:20.682 INFO:tasks.rados.rados.0.trial142.stdout:3239: done (5 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3240: done (4 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3241: done (3 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3242: done (2 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3243: done (1 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3244: done (0 left) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3245: read oid 9 snap -1 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3245: expect (ObjNum 1096 snap 357 seq_num 1096) 2026-02-17T12:05:20.683 INFO:tasks.rados.rados.0.trial142.stdout:3246: snap_remove snap 317 2026-02-17T12:05:21.682 INFO:tasks.rados.rados.0.trial142.stdout:3246: done (1 left) 2026-02-17T12:05:21.682 INFO:tasks.rados.rados.0.trial142.stdout:3247: read oid 22 snap -1 2026-02-17T12:05:21.682 INFO:tasks.rados.rados.0.trial142.stdout:3247: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:05:21.682 INFO:tasks.rados.rados.0.trial142.stdout:3248: copy_from oid 16 from oid 5 current snap is 359 2026-02-17T12:05:21.682 INFO:tasks.rados.rados.0.trial142.stdout:3245: expect (ObjNum 1096 snap 357 seq_num 1096) 2026-02-17T12:05:21.737 INFO:tasks.rados.rados.0.trial142.stdout:3248: finishing copy_from to trial14245205-16 2026-02-17T12:05:21.738 INFO:tasks.rados.rados.0.trial142.stdout:3248: got expected ENOENT (src dne) 2026-02-17T12:05:21.738 INFO:tasks.rados.rados.0.trial142.stdout:3248: finishing copy_from racing read to trial14245205-16 2026-02-17T12:05:21.738 INFO:tasks.rados.rados.0.trial142.stdout:3247: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:05:21.963 INFO:tasks.rados.rados.0.trial142.stdout:3245: done (2 left) 2026-02-17T12:05:21.963 INFO:tasks.rados.rados.0.trial142.stdout:3247: done (1 left) 2026-02-17T12:05:21.963 INFO:tasks.rados.rados.0.trial142.stdout:3248: done (0 left) 2026-02-17T12:05:21.963 INFO:tasks.rados.rados.0.trial142.stdout:3249: snap_create 2026-02-17T12:05:22.651 INFO:tasks.rados.rados.0.trial142.stdout:3249: done (0 left) 2026-02-17T12:05:22.651 INFO:tasks.rados.rados.0.trial142.stdout:3250: write oid 39 current snap is 360 2026-02-17T12:05:22.651 INFO:tasks.rados.rados.0.trial142.stdout:3250: seq_num 1107 ranges {605349=571828,1679096=420377} 2026-02-17T12:05:22.656 INFO:tasks.rados.rados.0.trial142.stdout:3250: writing trial14245205-39 from 605349 to 1177177 tid 1 2026-02-17T12:05:22.660 INFO:tasks.rados.rados.0.trial142.stdout:3250: writing trial14245205-39 from 1679096 to 2099473 tid 2 2026-02-17T12:05:22.660 INFO:tasks.rados.rados.0.trial142.stdout:3251: write oid 9 current snap is 360 2026-02-17T12:05:22.660 INFO:tasks.rados.rados.0.trial142.stdout:3251: seq_num 1108 ranges {622156=647077,1737578=680388} 2026-02-17T12:05:22.664 INFO:tasks.rados.rados.0.trial142.stdout:3251: writing trial14245205-9 from 622156 to 1269233 tid 1 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3251: writing trial14245205-9 from 1737578 to 2417966 tid 2 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3252: copy_from oid 46 from oid 48 current snap is 360 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: finishing write tid 1 to trial14245205-39 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: finishing write tid 2 to trial14245205-39 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: finishing write tid 3 to trial14245205-39 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3253: snap_create 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: finishing write tid 4 to trial14245205-39 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: oid 39 updating version 0 to 2162 2026-02-17T12:05:22.669 INFO:tasks.rados.rados.0.trial142.stdout:3250: oid 39 version 2162 is already newer than 2161 2026-02-17T12:05:22.670 INFO:tasks.rados.rados.0.trial142.stdout:3250: oid 39 updating version 2162 to 2163 2026-02-17T12:05:22.670 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2163 (ObjNum 1107 snap 360 seq_num 1107) dirty exists 2026-02-17T12:05:22.670 INFO:tasks.rados.rados.0.trial142.stdout:3250: left oid 39 (ObjNum 1107 snap 360 seq_num 1107) 2026-02-17T12:05:22.671 INFO:tasks.rados.rados.0.trial142.stdout:3252: finishing copy_from to trial14245205-46 2026-02-17T12:05:22.671 INFO:tasks.rados.rados.0.trial142.stdout:3252: got expected ENOENT (src dne) 2026-02-17T12:05:22.671 INFO:tasks.rados.rados.0.trial142.stdout:3252: finishing copy_from racing read to trial14245205-46 2026-02-17T12:05:22.675 INFO:tasks.rados.rados.0.trial142.stdout:3251: finishing write tid 1 to trial14245205-9 2026-02-17T12:05:22.675 INFO:tasks.rados.rados.0.trial142.stdout:3251: finishing write tid 2 to trial14245205-9 2026-02-17T12:05:22.675 INFO:tasks.rados.rados.0.trial142.stdout:3251: finishing write tid 3 to trial14245205-9 2026-02-17T12:05:22.675 INFO:tasks.rados.rados.0.trial142.stdout:3251: finishing write tid 4 to trial14245205-9 2026-02-17T12:05:22.675 INFO:tasks.rados.rados.0.trial142.stdout:3251: oid 9 updating version 0 to 3056 2026-02-17T12:05:22.676 INFO:tasks.rados.rados.0.trial142.stdout:3251: oid 9 version 3056 is already newer than 3055 2026-02-17T12:05:22.676 INFO:tasks.rados.rados.0.trial142.stdout:3251: oid 9 updating version 3056 to 3057 2026-02-17T12:05:22.676 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3057 (ObjNum 1108 snap 360 seq_num 1108) dirty exists 2026-02-17T12:05:22.676 INFO:tasks.rados.rados.0.trial142.stdout:3251: left oid 9 (ObjNum 1108 snap 360 seq_num 1108) 2026-02-17T12:05:23.657 INFO:tasks.rados.rados.0.trial142.stdout:3250: done (3 left) 2026-02-17T12:05:23.658 INFO:tasks.rados.rados.0.trial142.stdout:3251: done (2 left) 2026-02-17T12:05:23.658 INFO:tasks.rados.rados.0.trial142.stdout:3252: done (1 left) 2026-02-17T12:05:23.658 INFO:tasks.rados.rados.0.trial142.stdout:3253: done (0 left) 2026-02-17T12:05:23.658 INFO:tasks.rados.rados.0.trial142.stdout:3254: write oid 3 current snap is 361 2026-02-17T12:05:23.658 INFO:tasks.rados.rados.0.trial142.stdout:3254: seq_num 1109 ranges {638963=722326,2079707=424046} 2026-02-17T12:05:23.663 INFO:tasks.rados.rados.0.trial142.stdout:3254: writing trial14245205-3 from 638963 to 1361289 tid 1 2026-02-17T12:05:23.667 INFO:tasks.rados.rados.0.trial142.stdout:3254: writing trial14245205-3 from 2079707 to 2503753 tid 2 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3255: read oid 48 snap 349 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3255: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3256: rollback oid 45 current snap is 361 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 349 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3254: finishing write tid 1 to trial14245205-3 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3257: write oid 47 current snap is 361 2026-02-17T12:05:23.668 INFO:tasks.rados.rados.0.trial142.stdout:3257: seq_num 1110 ranges {655770=513928,1854542=684057} 2026-02-17T12:05:23.671 INFO:tasks.rados.rados.0.trial142.stdout:3257: writing trial14245205-47 from 655770 to 1169698 tid 1 2026-02-17T12:05:23.677 INFO:tasks.rados.rados.0.trial142.stdout:3257: writing trial14245205-47 from 1854542 to 2538599 tid 2 2026-02-17T12:05:23.677 INFO:tasks.rados.rados.0.trial142.stdout:3258: write oid 30 current snap is 361 2026-02-17T12:05:23.677 INFO:tasks.rados.rados.0.trial142.stdout:3254: finishing write tid 2 to trial14245205-3 2026-02-17T12:05:23.677 INFO:tasks.rados.rados.0.trial142.stdout:3254: finishing write tid 3 to trial14245205-3 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3254: finishing write tid 4 to trial14245205-3 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3254: oid 3 updating version 0 to 2721 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3254: oid 3 version 2721 is already newer than 2720 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3254: oid 3 version 2721 is already newer than 2719 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2721 (ObjNum 1109 snap 361 seq_num 1109) dirty exists 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3254: left oid 3 (ObjNum 1109 snap 361 seq_num 1109) 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3256: finishing rollback tid 0 to trial14245205-45 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3256: finishing rollback tid 1 to trial14245205-45 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3256: finishing rollback tid 2 to trial14245205-45 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2170 (ObjNum 1048 snap 340 seq_num 1048) dirty exists 2026-02-17T12:05:23.678 INFO:tasks.rados.rados.0.trial142.stdout:3255: expect (ObjNum 897 snap 285 seq_num 897) 2026-02-17T12:05:23.750 INFO:tasks.rados.rados.0.trial142.stdout:3257: finishing write tid 1 to trial14245205-47 2026-02-17T12:05:23.750 INFO:tasks.rados.rados.0.trial142.stdout:3257: finishing write tid 2 to trial14245205-47 2026-02-17T12:05:23.750 INFO:tasks.rados.rados.0.trial142.stdout:3258: seq_num 1111 ranges {672577=589177,1913024=427715} 2026-02-17T12:05:23.755 INFO:tasks.rados.rados.0.trial142.stdout:3258: writing trial14245205-30 from 672577 to 1261754 tid 1 2026-02-17T12:05:23.759 INFO:tasks.rados.rados.0.trial142.stdout:3258: writing trial14245205-30 from 1913024 to 2340739 tid 2 2026-02-17T12:05:23.759 INFO:tasks.rados.rados.0.trial142.stdout:3254: done (4 left) 2026-02-17T12:05:23.759 INFO:tasks.rados.rados.0.trial142.stdout:3255: done (3 left) 2026-02-17T12:05:23.759 INFO:tasks.rados.rados.0.trial142.stdout:3256: done (2 left) 2026-02-17T12:05:23.759 INFO:tasks.rados.rados.0.trial142.stdout:3259: write oid 26 current snap is 361 2026-02-17T12:05:23.760 INFO:tasks.rados.rados.0.trial142.stdout:3259: seq_num 1112 ranges {689384=664426,1971506=687726} 2026-02-17T12:05:23.764 INFO:tasks.rados.rados.0.trial142.stdout:3259: writing trial14245205-26 from 689384 to 1353810 tid 1 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3259: writing trial14245205-26 from 1971506 to 2659232 tid 2 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3260: delete oid 31 current snap is 361 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: finishing write tid 3 to trial14245205-47 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: finishing write tid 4 to trial14245205-47 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: oid 47 updating version 0 to 2728 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: oid 47 version 2728 is already newer than 2727 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: oid 47 version 2728 is already newer than 2726 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2728 (ObjNum 1110 snap 361 seq_num 1110) dirty exists 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3257: left oid 47 (ObjNum 1110 snap 361 seq_num 1110) 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3258: finishing write tid 1 to trial14245205-30 2026-02-17T12:05:23.770 INFO:tasks.rados.rados.0.trial142.stdout:3258: finishing write tid 2 to trial14245205-30 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: finishing write tid 3 to trial14245205-30 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: finishing write tid 4 to trial14245205-30 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: oid 30 updating version 0 to 2724 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: oid 30 version 2724 is already newer than 2723 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: oid 30 version 2724 is already newer than 2722 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 2724 (ObjNum 1111 snap 361 seq_num 1111) dirty exists 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3258: left oid 30 (ObjNum 1111 snap 361 seq_num 1111) 2026-02-17T12:05:23.771 INFO:tasks.rados.rados.0.trial142.stdout:3259: finishing write tid 1 to trial14245205-26 2026-02-17T12:05:23.772 INFO:tasks.rados.rados.0.trial142.stdout:3257: done (3 left) 2026-02-17T12:05:23.772 INFO:tasks.rados.rados.0.trial142.stdout:3258: done (2 left) 2026-02-17T12:05:23.772 INFO:tasks.rados.rados.0.trial142.stdout:3260: done (1 left) 2026-02-17T12:05:23.772 INFO:tasks.rados.rados.0.trial142.stdout:3261: write (excl) oid 9 current snap is 361 2026-02-17T12:05:23.772 INFO:tasks.rados.rados.0.trial142.stdout:3261: seq_num 1114 ranges {722998=414924,1572117=575042} 2026-02-17T12:05:23.775 INFO:tasks.rados.rados.0.trial142.stdout:3261: writing trial14245205-9 from 722998 to 1137922 tid 1 2026-02-17T12:05:23.780 INFO:tasks.rados.rados.0.trial142.stdout:3261: writing trial14245205-9 from 1572117 to 2147159 tid 2 2026-02-17T12:05:23.780 INFO:tasks.rados.rados.0.trial142.stdout:3262: write oid 18 current snap is 361 2026-02-17T12:05:23.780 INFO:tasks.rados.rados.0.trial142.stdout:3262: seq_num 1115 ranges {739805=490173,1630599=435053,2636284=103521} 2026-02-17T12:05:23.784 INFO:tasks.rados.rados.0.trial142.stdout:3262: writing trial14245205-18 from 739805 to 1229978 tid 1 2026-02-17T12:05:23.787 INFO:tasks.rados.rados.0.trial142.stdout:3262: writing trial14245205-18 from 1630599 to 2065652 tid 2 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3262: writing trial14245205-18 from 2636284 to 2739805 tid 3 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3263: snap_create 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: finishing write tid 2 to trial14245205-26 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: finishing write tid 3 to trial14245205-26 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: finishing write tid 4 to trial14245205-26 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: oid 26 updating version 0 to 2706 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: oid 26 updating version 2706 to 2707 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: oid 26 updating version 2707 to 2708 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2708 (ObjNum 1112 snap 361 seq_num 1112) dirty exists 2026-02-17T12:05:23.791 INFO:tasks.rados.rados.0.trial142.stdout:3259: left oid 26 (ObjNum 1112 snap 361 seq_num 1112) 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: finishing write tid 1 to trial14245205-9 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: finishing write tid 2 to trial14245205-9 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: finishing write tid 3 to trial14245205-9 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: finishing write tid 4 to trial14245205-9 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: oid 9 updating version 0 to 3061 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: oid 9 version 3061 is already newer than 3059 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: oid 9 version 3061 is already newer than 3060 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3061 (ObjNum 1114 snap 361 seq_num 1114) dirty exists 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3261: left oid 9 (ObjNum 1114 snap 361 seq_num 1114) 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3262: finishing write tid 1 to trial14245205-18 2026-02-17T12:05:23.792 INFO:tasks.rados.rados.0.trial142.stdout:3262: finishing write tid 2 to trial14245205-18 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: finishing write tid 3 to trial14245205-18 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: finishing write tid 4 to trial14245205-18 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: finishing write tid 5 to trial14245205-18 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: oid 18 updating version 0 to 3064 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: oid 18 version 3064 is already newer than 3063 2026-02-17T12:05:23.793 INFO:tasks.rados.rados.0.trial142.stdout:3262: oid 18 updating version 3064 to 3065 2026-02-17T12:05:23.794 INFO:tasks.rados.rados.0.trial142.stdout:3262: oid 18 updating version 3065 to 3066 2026-02-17T12:05:23.794 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 3066 (ObjNum 1115 snap 361 seq_num 1115) dirty exists 2026-02-17T12:05:23.794 INFO:tasks.rados.rados.0.trial142.stdout:3262: left oid 18 (ObjNum 1115 snap 361 seq_num 1115) 2026-02-17T12:05:24.689 INFO:tasks.rados.rados.0.trial142.stdout:3259: done (3 left) 2026-02-17T12:05:24.689 INFO:tasks.rados.rados.0.trial142.stdout:3261: done (2 left) 2026-02-17T12:05:24.690 INFO:tasks.rados.rados.0.trial142.stdout:3262: done (1 left) 2026-02-17T12:05:24.690 INFO:tasks.rados.rados.0.trial142.stdout:3263: done (0 left) 2026-02-17T12:05:24.690 INFO:tasks.rados.rados.0.trial142.stdout:3264: copy_from oid 41 from oid 37 current snap is 362 2026-02-17T12:05:24.690 INFO:tasks.rados.rados.0.trial142.stdout:3265: snap_remove snap 331 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3265: done (1 left) 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3266: copy_from oid 44 from oid 49 current snap is 362 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3264: finishing copy_from racing read to trial14245205-41 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3264: finishing copy_from to trial14245205-41 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3264: done (1 left) 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3267: read oid 16 snap -1 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3267: expect deleted 2026-02-17T12:05:25.691 INFO:tasks.rados.rados.0.trial142.stdout:3268: snap_create 2026-02-17T12:05:25.700 INFO:tasks.rados.rados.0.trial142.stdout:3266: finishing copy_from racing read to trial14245205-44 2026-02-17T12:05:25.701 INFO:tasks.rados.rados.0.trial142.stdout:3266: finishing copy_from to trial14245205-44 2026-02-17T12:05:25.701 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 2149 (ObjNum 1060 snap 343 seq_num 1060) dirty exists 2026-02-17T12:05:25.891 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:05:25.891 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T12:05:25.891 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:05:25.891 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:05:25.894 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:05:25.894 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:05:25.895 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:25.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.960+0000 7fae111b6640 10 monclient: get_monmap_and_config 2026-02-17T12:05:25.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.960+0000 7fae111b6640 10 monclient: build_initial_monmap 2026-02-17T12:05:25.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.960+0000 7fae111b6640 10 monclient: monmap: 2026-02-17T12:05:25.965 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:25.965 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:25.961808+0000 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:25.961808+0000 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 Processor -- start 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 -- start start 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient: init 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fae0c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae0c13b380 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fae0c13ee90 0x7fae0c141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-c con 0x7fae0c13ee90 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0c135430 con 0x7fae0c13b380 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0c09af60 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c09a5c0 con 0x7fae0c13ee90 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae111b6640 10 monclient(hunting): authenticate will time out at 1813.580648s 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0a575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fae0c13b380 0x7fae0c13d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55920/0 (socket says 10.20.193.51:55920) 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0a575640 1 -- 10.20.193.51:0/2633831963 learned_addr learned my addr 10.20.193.51:0/2633831963 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 1 --2- 10.20.193.51:0/2633831963 >> v2:10.20.193.142:3300/0 conn(0x7fae0c13ee90 0x7fae0c141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): get_auth_request con 0x7fae0c13ee90 auth_method 0 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:25.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.961+0000 7fae0b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 10 monclient(hunting): handle_auth_done global_id 184636 payload 274 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 1 -- 10.20.193.51:0/2633831963 >> v1:10.20.193.142:6789/0 conn(0x7fae0c0a3bb0 legacy=0x7fae0c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 1 -- 10.20.193.51:0/2633831963 >> v1:10.20.193.51:6789/0 conn(0x7fae0c13b380 legacy=0x7fae0c13d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 10 monclient: _finish_hunting 0 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 1 monclient: found mon.noname-c 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:05:25.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.962+0000 7fae0b577640 1 -- 10.20.193.51:0/2633831963 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c09b240 con 0x7fae0c13ee90 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae0b577640 1 -- 10.20.193.51:0/2633831963 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13ee90 msgr2=0x7fae0c141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae0b577640 1 --2- 10.20.193.51:0/2633831963 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13ee90 0x7fae0c141280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0a3020 tx=0x7fadfc02f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65ee10cc4997d04 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 1 -- 10.20.193.51:0/2633831963 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc03c070 con 0x7fae0c13ee90 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:25.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: dump: 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: _finish_auth 0 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: _check_auth_tickets 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae111b6640 5 monclient: authenticate success, global_id 184636 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae111b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 1 -- 10.20.193.51:0/2633831963 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc037640 con 0x7fae0c13ee90 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 1 -- 10.20.193.51:0/2633831963 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc037a10 con 0x7fae0c13ee90 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae09d74640 10 monclient: dump: 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:25.979 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae111b6640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:25.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.964+0000 7fae111b6640 4 set_mon_vals no callback set 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 10 monclient: shutdown 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- 10.20.193.51:0/2633831963 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13ee90 msgr2=0x7fae0c141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 --2- 10.20.193.51:0/2633831963 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13ee90 0x7fae0c141280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0a3020 tx=0x7fadfc02f130 comp rx=0 tx=0).stop 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- 10.20.193.51:0/2633831963 shutdown_connections 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 --2- 10.20.193.51:0/2633831963 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13ee90 0x7fae0c141280 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- 10.20.193.51:0/2633831963 >> 10.20.193.51:0/2633831963 conn(0x7fae0c0a30c0 msgr2=0x7fae0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- 10.20.193.51:0/2633831963 shutdown_connections 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- 10.20.193.51:0/2633831963 wait complete. 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 10 monclient: build_initial_monmap 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 10 monclient: monmap: 2026-02-17T12:05:25.981 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 Processor -- start 2026-02-17T12:05:25.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 1 -- start start 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.965+0000 7fae111b6640 10 monclient: init 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-c con 0x7fae0c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13b380 0x7fae0c1cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-b con 0x7fae0c13b380 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): picked mon.noname-a con 0x7fae0c13ee90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c135040 con 0x7fae0c13ee90 2026-02-17T12:05:25.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0a3f90 con 0x7fae0c13b380 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c1351c0 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae111b6640 10 monclient(hunting): authenticate will time out at 1813.585111s 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59346/0 (socket says 10.20.193.51:59346) 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 -- 10.20.193.51:0/927105894 learned_addr learned my addr 10.20.193.51:0/927105894 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35994/0 (socket says 10.20.193.51:35994) 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): get_auth_request con 0x7fae0c0a3bb0 auth_method 0 2026-02-17T12:05:25.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 10 monclient(hunting): get_auth_request con 0x7fae0c13ee90 auth_method 0 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 msgr2=0x7fae0c1cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:05:25.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 msgr2=0x7fae0c1cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13b380 0x7fae0c1cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0b577640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): get_auth_request con 0x7fae0c13b380 auth_method 0 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:25.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient(hunting): handle_auth_done global_id 234269 payload 824 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13b380 msgr2=0x7fae0c1cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13b380 0x7fae0c1cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 msgr2=0x7fae0c1cf960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 monclient: found mon.noname-c 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:25.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.966+0000 7fae0ad76640 1 -- 10.20.193.51:0/927105894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c09ea70 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae0ad76640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 msgr2=0x7fae0c0a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae0ad76640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b580 tx=0x7fae0000ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae000026e0 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: dump: 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00014070 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 5 monclient: authenticate success, global_id 234269 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 10 monclient: _renew_subs 2026-02-17T12:05:25.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c09d7b0 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00002ac0 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fadeb7fe640 10 monclient: dump: 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:25.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae09573640 4 set_mon_vals no callback set 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 10 monclient: _renew_subs 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.968+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c09f260 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fae00002ce0 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae111b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:25.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae111b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae111b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c13b150 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fadeb7fe640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 0x7fadd80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(744..744 src has 323..744) ==== 4811+0+0 (secure 0 0 0) 0x7fae00052250 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae0a575640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 0x7fadd80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.969+0000 7fae0a575640 10 monclient: get_auth_request con 0x7fadd803dd10 auth_method 0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.972+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fae0c13b150 con 0x7fae0c0a3bb0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.972+0000 7fadeb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.972+0000 7fadeb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:25.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:25.972+0000 7fae0a575640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 0x7fadd80401d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadf4007d90 tx=0x7fadf4007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fae111b6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fae111b6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fae111b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae0c074d80 con 0x7fae0c0a3bb0 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fadeb7fe640 1 -- 10.20.193.51:0/927105894 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fae00050c30 con 0x7fae0c0a3bb0 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fadeb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.086+0000 7fadeb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:26.088 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":186,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 msgr2=0x7fadd80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 0x7fadd80401d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadf4007d90 tx=0x7fadf4007ce0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 10 monclient: shutdown 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 msgr2=0x7fae0c0a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b580 tx=0x7fae0000ba50 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 shutdown_connections 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fadd803dd10 0x7fadd80401d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fae0c13ee90 0x7fae0c1cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fae0c13b380 0x7fae0c1cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 --2- 10.20.193.51:0/927105894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fae0c0a3bb0 0x7fae0c0a0290 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 >> 10.20.193.51:0/927105894 conn(0x7fae0c0a30c0 msgr2=0x7fae0c0a1500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:26.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 shutdown_connections 2026-02-17T12:05:26.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:26.087+0000 7fae111b6640 1 -- 10.20.193.51:0/927105894 wait complete. 2026-02-17T12:05:26.692 INFO:tasks.rados.rados.0.trial142.stdout:3266: done (2 left) 2026-02-17T12:05:26.692 INFO:tasks.rados.rados.0.trial142.stdout:3267: done (1 left) 2026-02-17T12:05:26.692 INFO:tasks.rados.rados.0.trial142.stdout:3268: done (0 left) 2026-02-17T12:05:26.692 INFO:tasks.rados.rados.0.trial142.stdout:3269: snap_create 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3269: done (0 left) 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3270: read oid 17 snap -1 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3270: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3271: read oid 30 snap 352 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3271: expect (ObjNum 1078 snap 351 seq_num 1078) 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3272: write oid 15 current snap is 364 2026-02-17T12:05:27.652 INFO:tasks.rados.rados.0.trial142.stdout:3272: seq_num 1116 ranges {756612=565422,2089081=578711} 2026-02-17T12:05:27.657 INFO:tasks.rados.rados.0.trial142.stdout:3272: writing trial14245205-15 from 756612 to 1322034 tid 1 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3272: writing trial14245205-15 from 2089081 to 2667792 tid 2 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3273: read oid 28 snap 352 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3273: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3274: read oid 37 snap -1 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3274: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3275: read oid 33 snap -1 2026-02-17T12:05:27.663 INFO:tasks.rados.rados.0.trial142.stdout:3275: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:27.664 INFO:tasks.rados.rados.0.trial142.stdout:3276: read oid 48 snap -1 2026-02-17T12:05:27.664 INFO:tasks.rados.rados.0.trial142.stdout:3276: expect deleted 2026-02-17T12:05:27.664 INFO:tasks.rados.rados.0.trial142.stdout:3277: write (excl) oid 50 current snap is 364 2026-02-17T12:05:27.664 INFO:tasks.rados.rados.0.trial142.stdout:3277: seq_num 1117 ranges {773419=640671,2147563=438722} 2026-02-17T12:05:27.667 INFO:tasks.rados.rados.0.trial142.stdout:3277: writing trial14245205-50 from 773419 to 1414090 tid 1 2026-02-17T12:05:27.672 INFO:tasks.rados.rados.0.trial142.stdout:3277: writing trial14245205-50 from 2147563 to 2586285 tid 2 2026-02-17T12:05:27.672 INFO:tasks.rados.rados.0.trial142.stdout:3278: write (excl) oid 27 current snap is 364 2026-02-17T12:05:27.672 INFO:tasks.rados.rados.0.trial142.stdout:3278: seq_num 1118 ranges {790226=432273,1806045=582380} 2026-02-17T12:05:27.677 INFO:tasks.rados.rados.0.trial142.stdout:3278: writing trial14245205-27 from 790226 to 1222499 tid 1 2026-02-17T12:05:27.681 INFO:tasks.rados.rados.0.trial142.stdout:3278: writing trial14245205-27 from 1806045 to 2388425 tid 2 2026-02-17T12:05:27.681 INFO:tasks.rados.rados.0.trial142.stdout:3279: snap_create 2026-02-17T12:05:27.681 INFO:tasks.rados.rados.0.trial142.stdout:3271: expect (ObjNum 1078 snap 351 seq_num 1078) 2026-02-17T12:05:27.765 INFO:tasks.rados.rados.0.trial142.stdout:3270: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:27.829 INFO:tasks.rados.rados.0.trial142.stdout:3272: finishing write tid 1 to trial14245205-15 2026-02-17T12:05:27.830 INFO:tasks.rados.rados.0.trial142.stdout:3273: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:05:27.919 INFO:tasks.rados.rados.0.trial142.stdout:3275: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: finishing write tid 2 to trial14245205-15 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: finishing write tid 3 to trial14245205-15 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: finishing write tid 4 to trial14245205-15 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: oid 15 updating version 0 to 2742 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: oid 15 updating version 2742 to 2744 2026-02-17T12:05:28.106 INFO:tasks.rados.rados.0.trial142.stdout:3272: oid 15 version 2744 is already newer than 2743 2026-02-17T12:05:28.107 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2744 (ObjNum 1116 snap 364 seq_num 1116) dirty exists 2026-02-17T12:05:28.107 INFO:tasks.rados.rados.0.trial142.stdout:3272: left oid 15 (ObjNum 1116 snap 364 seq_num 1116) 2026-02-17T12:05:28.107 INFO:tasks.rados.rados.0.trial142.stdout:3274: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: finishing write tid 1 to trial14245205-50 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: finishing write tid 2 to trial14245205-50 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: finishing write tid 3 to trial14245205-50 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: finishing write tid 4 to trial14245205-50 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: oid 50 updating version 0 to 2710 2026-02-17T12:05:28.292 INFO:tasks.rados.rados.0.trial142.stdout:3277: oid 50 version 2710 is already newer than 2709 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3277: oid 50 updating version 2710 to 2711 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2711 (ObjNum 1117 snap 364 seq_num 1117) dirty exists 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3277: left oid 50 (ObjNum 1117 snap 364 seq_num 1117) 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: finishing write tid 1 to trial14245205-27 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: finishing write tid 2 to trial14245205-27 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: finishing write tid 3 to trial14245205-27 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: finishing write tid 4 to trial14245205-27 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: oid 27 updating version 0 to 2747 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: oid 27 version 2747 is already newer than 2746 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: oid 27 version 2747 is already newer than 2745 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 2747 (ObjNum 1118 snap 364 seq_num 1118) dirty exists 2026-02-17T12:05:28.293 INFO:tasks.rados.rados.0.trial142.stdout:3278: left oid 27 (ObjNum 1118 snap 364 seq_num 1118) 2026-02-17T12:05:28.655 INFO:tasks.rados.rados.0.trial142.stdout:3270: done (9 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3271: done (8 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3272: done (7 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3273: done (6 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3274: done (5 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3275: done (4 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3276: done (3 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3277: done (2 left) 2026-02-17T12:05:28.656 INFO:tasks.rados.rados.0.trial142.stdout:3278: done (1 left) 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3279: done (0 left) 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3280: rollback oid 21 current snap is 365 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 351 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3281: read oid 39 snap -1 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3281: expect (ObjNum 1107 snap 360 seq_num 1107) 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3282: rollback oid 3 current snap is 365 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 354 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3283: write oid 5 current snap is 365 2026-02-17T12:05:28.657 INFO:tasks.rados.rados.0.trial142.stdout:3283: seq_num 1119 ranges {407033=507522,1464527=442391,2345976=461057} 2026-02-17T12:05:28.659 INFO:tasks.rados.rados.0.trial142.stdout:3283: writing trial14245205-5 from 407033 to 914555 tid 1 2026-02-17T12:05:28.662 INFO:tasks.rados.rados.0.trial142.stdout:3283: writing trial14245205-5 from 1464527 to 1906918 tid 2 2026-02-17T12:05:28.666 INFO:tasks.rados.rados.0.trial142.stdout:3283: writing trial14245205-5 from 2345976 to 2807033 tid 3 2026-02-17T12:05:28.666 INFO:tasks.rados.rados.0.trial142.stdout:3284: write oid 1 current snap is 365 2026-02-17T12:05:28.666 INFO:tasks.rados.rados.0.trial142.stdout:3284: seq_num 1120 ranges {423840=582771,1523009=586049,2657046=166794} 2026-02-17T12:05:28.670 INFO:tasks.rados.rados.0.trial142.stdout:3284: writing trial14245205-1 from 423840 to 1006611 tid 1 2026-02-17T12:05:28.674 INFO:tasks.rados.rados.0.trial142.stdout:3284: writing trial14245205-1 from 1523009 to 2109058 tid 2 2026-02-17T12:05:28.676 INFO:tasks.rados.rados.0.trial142.stdout:3284: writing trial14245205-1 from 2657046 to 2823840 tid 3 2026-02-17T12:05:28.677 INFO:tasks.rados.rados.0.trial142.stdout:3285: write oid 13 current snap is 365 2026-02-17T12:05:28.677 INFO:tasks.rados.rados.0.trial142.stdout:3285: seq_num 1121 ranges {440647=658020,1581491=446060,2800822=39825} 2026-02-17T12:05:28.680 INFO:tasks.rados.rados.0.trial142.stdout:3285: writing trial14245205-13 from 440647 to 1098667 tid 1 2026-02-17T12:05:28.684 INFO:tasks.rados.rados.0.trial142.stdout:3285: writing trial14245205-13 from 1581491 to 2027551 tid 2 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3285: writing trial14245205-13 from 2800822 to 2840647 tid 3 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3286: copy_from oid 14 from oid 43 current snap is 365 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3282: finishing rollback tid 0 to trial14245205-3 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3282: finishing rollback tid 1 to trial14245205-3 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2723 (ObjNum 129 snap 0 seq_num 1213212840) dirty dne 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3280: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3280: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:05:28.688 INFO:tasks.rados.rados.0.trial142.stdout:3282: done (6 left) 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3287: read oid 8 snap -1 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3287: expect (ObjNum 1090 snap 356 seq_num 1090) 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3288: write (excl) oid 3 current snap is 365 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3280: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2173 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:05:28.689 INFO:tasks.rados.rados.0.trial142.stdout:3281: expect (ObjNum 1107 snap 360 seq_num 1107) 2026-02-17T12:05:28.787 INFO:tasks.rados.rados.0.trial142.stdout:3283: finishing write tid 1 to trial14245205-5 2026-02-17T12:05:28.787 INFO:tasks.rados.rados.0.trial142.stdout:3283: finishing write tid 2 to trial14245205-5 2026-02-17T12:05:28.787 INFO:tasks.rados.rados.0.trial142.stdout:3283: finishing write tid 3 to trial14245205-5 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: finishing write tid 4 to trial14245205-5 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: finishing write tid 5 to trial14245205-5 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: oid 5 updating version 0 to 2549 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: oid 5 version 2549 is already newer than 2548 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: oid 5 version 2549 is already newer than 2547 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: oid 5 version 2549 is already newer than 2546 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2549 (ObjNum 1119 snap 365 seq_num 1119) dirty exists 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3283: left oid 5 (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3284: finishing write tid 1 to trial14245205-1 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3284: finishing write tid 2 to trial14245205-1 2026-02-17T12:05:28.788 INFO:tasks.rados.rados.0.trial142.stdout:3284: finishing write tid 3 to trial14245205-1 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: finishing write tid 4 to trial14245205-1 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: finishing write tid 5 to trial14245205-1 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: oid 1 updating version 0 to 2700 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: oid 1 updating version 2700 to 2702 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: oid 1 version 2702 is already newer than 2701 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: oid 1 updating version 2702 to 2703 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2703 (ObjNum 1120 snap 365 seq_num 1120) dirty exists 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3284: left oid 1 (ObjNum 1120 snap 365 seq_num 1120) 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3285: finishing write tid 1 to trial14245205-13 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3285: finishing write tid 2 to trial14245205-13 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3285: finishing write tid 3 to trial14245205-13 2026-02-17T12:05:28.789 INFO:tasks.rados.rados.0.trial142.stdout:3285: finishing write tid 4 to trial14245205-13 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: finishing write tid 5 to trial14245205-13 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: oid 13 updating version 0 to 2748 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: oid 13 updating version 2748 to 2749 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: oid 13 updating version 2749 to 2750 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: oid 13 updating version 2750 to 2751 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 2751 (ObjNum 1121 snap 365 seq_num 1121) dirty exists 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3285: left oid 13 (ObjNum 1121 snap 365 seq_num 1121) 2026-02-17T12:05:28.790 INFO:tasks.rados.rados.0.trial142.stdout:3287: expect (ObjNum 1090 snap 356 seq_num 1090) 2026-02-17T12:05:28.859 INFO:tasks.rados.rados.0.trial142.stdout:3286: finishing copy_from racing read to trial14245205-14 2026-02-17T12:05:28.859 INFO:tasks.rados.rados.0.trial142.stdout:3286: finishing copy_from to trial14245205-14 2026-02-17T12:05:28.859 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 2804 (ObjNum 1028 snap 333 seq_num 1028) dirty exists 2026-02-17T12:05:28.859 INFO:tasks.rados.rados.0.trial142.stdout:3288: seq_num 1122 ranges {457454=733269,1923620=589718} 2026-02-17T12:05:28.864 INFO:tasks.rados.rados.0.trial142.stdout:3288: writing trial14245205-3 from 457454 to 1190723 tid 1 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3288: writing trial14245205-3 from 1923620 to 2513338 tid 2 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3280: done (7 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3281: done (6 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3283: done (5 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3284: done (4 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3285: done (3 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3286: done (2 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3287: done (1 left) 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3289: write oid 38 current snap is 365 2026-02-17T12:05:28.869 INFO:tasks.rados.rados.0.trial142.stdout:3289: seq_num 1123 ranges {474261=408518,1582102=449729,2739315=134946} 2026-02-17T12:05:28.872 INFO:tasks.rados.rados.0.trial142.stdout:3289: writing trial14245205-38 from 474261 to 882779 tid 1 2026-02-17T12:05:28.877 INFO:tasks.rados.rados.0.trial142.stdout:3289: writing trial14245205-38 from 1582102 to 2031831 tid 2 2026-02-17T12:05:28.880 INFO:tasks.rados.rados.0.trial142.stdout:3289: writing trial14245205-38 from 2739315 to 2874261 tid 3 2026-02-17T12:05:28.880 INFO:tasks.rados.rados.0.trial142.stdout:3290: read oid 22 snap -1 2026-02-17T12:05:28.880 INFO:tasks.rados.rados.0.trial142.stdout:3290: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:05:28.880 INFO:tasks.rados.rados.0.trial142.stdout:3291: write (excl) oid 34 current snap is 365 2026-02-17T12:05:28.880 INFO:tasks.rados.rados.0.trial142.stdout:3288: finishing write tid 1 to trial14245205-3 2026-02-17T12:05:28.881 INFO:tasks.rados.rados.0.trial142.stdout:3288: finishing write tid 2 to trial14245205-3 2026-02-17T12:05:28.881 INFO:tasks.rados.rados.0.trial142.stdout:3291: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2026-02-17T12:05:28.885 INFO:tasks.rados.rados.0.trial142.stdout:3291: writing trial14245205-34 from 491068 to 974835 tid 1 2026-02-17T12:05:28.890 INFO:tasks.rados.rados.0.trial142.stdout:3291: writing trial14245205-34 from 1640584 to 2233971 tid 2 2026-02-17T12:05:28.892 INFO:tasks.rados.rados.0.trial142.stdout:3291: writing trial14245205-34 from 2650385 to 2891068 tid 3 2026-02-17T12:05:28.892 INFO:tasks.rados.rados.0.trial142.stdout:3292: delete oid 24 current snap is 365 2026-02-17T12:05:28.892 INFO:tasks.rados.rados.0.trial142.stdout:3288: finishing write tid 3 to trial14245205-3 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3288: finishing write tid 4 to trial14245205-3 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3288: oid 3 updating version 0 to 2726 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3288: oid 3 version 2726 is already newer than 2724 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3288: oid 3 version 2726 is already newer than 2725 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2726 (ObjNum 1122 snap 365 seq_num 1122) dirty exists 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3288: left oid 3 (ObjNum 1122 snap 365 seq_num 1122) 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: finishing write tid 1 to trial14245205-38 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: finishing write tid 2 to trial14245205-38 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: finishing write tid 3 to trial14245205-38 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: finishing write tid 4 to trial14245205-38 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: finishing write tid 5 to trial14245205-38 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: oid 38 updating version 0 to 1999 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: oid 38 version 1999 is already newer than 1998 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: oid 38 version 1999 is already newer than 1996 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: oid 38 version 1999 is already newer than 1997 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 1999 (ObjNum 1123 snap 365 seq_num 1123) dirty exists 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3289: left oid 38 (ObjNum 1123 snap 365 seq_num 1123) 2026-02-17T12:05:28.893 INFO:tasks.rados.rados.0.trial142.stdout:3290: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:05:29.097 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: finishing write tid 1 to trial14245205-34 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: finishing write tid 2 to trial14245205-34 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: finishing write tid 3 to trial14245205-34 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: finishing write tid 4 to trial14245205-34 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: finishing write tid 5 to trial14245205-34 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: oid 34 updating version 0 to 2177 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: oid 34 version 2177 is already newer than 2174 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: oid 34 version 2177 is already newer than 2176 2026-02-17T12:05:29.121 INFO:tasks.rados.rados.0.trial142.stdout:3291: oid 34 version 2177 is already newer than 2175 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 2177 (ObjNum 1124 snap 365 seq_num 1124) dirty exists 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3291: left oid 34 (ObjNum 1124 snap 365 seq_num 1124) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3288: done (4 left) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3289: done (3 left) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3290: done (2 left) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3291: done (1 left) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3292: done (0 left) 2026-02-17T12:05:29.122 INFO:tasks.rados.rados.0.trial142.stdout:3293: snap_create 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 10 monclient: get_monmap_and_config 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 10 monclient: build_initial_monmap 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 10 monclient: monmap: 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:29.167 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:29.164530+0000 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:29.164530+0000 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 1 Processor -- start 2026-02-17T12:05:29.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 1 -- start start 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.163+0000 7f577d151640 10 monclient: init 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f57780a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f577809dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f57780a02e0 0x7f577813d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): picked mon.noname-c con 0x7f57780a02e0 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577806e140 con 0x7f57780a3bb0 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577809ce60 con 0x7f577809dac0 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:29.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f577809aed0 con 0x7f57780a02e0 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f577d151640 10 monclient(hunting): authenticate will time out at 1816.783279s 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5776d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f57780a3bb0 0x7f577809f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:55934/0 (socket says 10.20.193.51:55934) 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5776d76640 1 -- 10.20.193.51:0/1673855449 learned_addr learned my addr 10.20.193.51:0/1673855449 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 1 --2- 10.20.193.51:0/1673855449 >> v2:10.20.193.142:3300/0 conn(0x7f57780a02e0 0x7f577813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): get_auth_request con 0x7f57780a02e0 auth_method 0 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:29.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient(hunting): handle_auth_done global_id 184642 payload 274 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 1 -- 10.20.193.51:0/1673855449 >> v1:10.20.193.142:6789/0 conn(0x7f577809dac0 legacy=0x7f577809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 1 -- 10.20.193.51:0/1673855449 >> v1:10.20.193.51:6789/0 conn(0x7f57780a3bb0 legacy=0x7f577809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient: _finish_hunting 0 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 1 monclient: found mon.noname-c 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:05:29.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.164+0000 7f5777577640 1 -- 10.20.193.51:0/1673855449 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577809a5c0 con 0x7f57780a02e0 2026-02-17T12:05:29.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5777577640 1 -- 10.20.193.51:0/1673855449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 msgr2=0x7f577813d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:29.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5777577640 1 --2- 10.20.193.51:0/1673855449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f577813d770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576802f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb56a891ff8ae9e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:29.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 1 -- 10.20.193.51:0/1673855449 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576803c070 con 0x7f57780a02e0 2026-02-17T12:05:29.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:29.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: dump: 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: _finish_auth 0 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: _check_auth_tickets 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 1 -- 10.20.193.51:0/1673855449 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5768037640 con 0x7f57780a02e0 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 5 monclient: authenticate success, global_id 184642 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 1 -- 10.20.193.51:0/1673855449 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768037a10 con 0x7f57780a02e0 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 4 set_mon_vals no callback set 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:29.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f5775d74640 10 monclient: dump: 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 10 monclient: shutdown 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 -- 10.20.193.51:0/1673855449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 msgr2=0x7f577813d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 --2- 10.20.193.51:0/1673855449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f577813d770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576802f190 comp rx=0 tx=0).stop 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 -- 10.20.193.51:0/1673855449 shutdown_connections 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 --2- 10.20.193.51:0/1673855449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f577813d770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 -- 10.20.193.51:0/1673855449 >> 10.20.193.51:0/1673855449 conn(0x7f57780a30c0 msgr2=0x7f57780a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 -- 10.20.193.51:0/1673855449 shutdown_connections 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.167+0000 7f577d151640 1 -- 10.20.193.51:0/1673855449 wait complete. 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient: build_initial_monmap 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient: monmap: 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:29.182 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 Processor -- start 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 -- start start 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient: init 2026-02-17T12:05:29.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 0x7f57780998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): picked mon.noname-c con 0x7f577809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f5778099e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): picked mon.noname-b con 0x7f57780a02e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): picked mon.noname-a con 0x7f57780a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f57780a3f90 con 0x7f57780a3bb0 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f577809caa0 con 0x7f57780a02e0 2026-02-17T12:05:29.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f577813dcb0 con 0x7f577809dac0 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f577d151640 10 monclient(hunting): authenticate will time out at 1816.787861s 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 0x7f57780998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36000/0 (socket says 10.20.193.51:36000) 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 -- 10.20.193.51:0/3427665172 learned_addr learned my addr 10.20.193.51:0/3427665172 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 10 monclient(hunting): get_auth_request con 0x7f57780a3bb0 auth_method 0 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:29.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): get_auth_request con 0x7f577809dac0 auth_method 0 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 msgr2=0x7f5778094430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 msgr2=0x7f5778094430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5777577640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.168+0000 7f5776575640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f5778099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:29.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776575640 10 monclient(hunting): get_auth_request con 0x7f57780a02e0 auth_method 0 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 10 monclient(hunting): handle_auth_done global_id 234272 payload 824 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 msgr2=0x7f5778099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f5778099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 msgr2=0x7f5778094430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 monclient: found mon.noname-c 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:29.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.169+0000 7f5776d76640 1 -- 10.20.193.51:0/3427665172 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57781cff80 con 0x7f577809dac0 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f5776d76640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 msgr2=0x7f57780998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f5776d76640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 0x7f57780998f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c4d0 tx=0x7f576c00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c007070 con 0x7f577809dac0 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: dump: 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.188 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 5 monclient: authenticate success, global_id 234272 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _renew_subs 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:29.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c007230 con 0x7f577809dac0 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577809d7b0 con 0x7f577809dac0 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c007620 con 0x7f577809dac0 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f57577fe640 10 monclient: dump: 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:29.190 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f5775573640 4 set_mon_vals no callback set 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _renew_subs 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5778097e00 con 0x7f577809dac0 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:29.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.171+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577809d0a0 con 0x7f577809dac0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.172+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f576c01b400 con 0x7f577809dac0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.172+0000 7f57577fe640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 0x7f57440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.172+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(747..747 src has 323..747) ==== 4735+0+0 (secure 0 0 0) 0x7f576c0523a0 con 0x7f577809dac0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.172+0000 7f5776575640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 0x7f57440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.172+0000 7f5776575640 10 monclient: get_auth_request con 0x7f574403dd10 auth_method 0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.174+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f577809d0a0 con 0x7f577809dac0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.174+0000 7f57577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.174+0000 7f57577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:29.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.175+0000 7f5776575640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 0x7f57440401d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5778095d20 tx=0x7f5760009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f577d151640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f577d151640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f577d151640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f577809f4c0 con 0x7f577809dac0 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f57577fe640 1 -- 10.20.193.51:0/3427665172 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f577809d7b0 con 0x7f577809dac0 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f57577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:29.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.287+0000 7f57577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":186,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 msgr2=0x7f57440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 0x7f57440401d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5778095d20 tx=0x7f5760009040 comp rx=0 tx=0).stop 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 10 monclient: shutdown 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 msgr2=0x7f57780998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 0x7f57780998f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c4d0 tx=0x7f576c00c9a0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 shutdown_connections 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f574403dd10 0x7f57440401d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f57780a3bb0 0x7f5778094430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f57780a02e0 0x7f5778099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 --2- 10.20.193.51:0/3427665172 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f577809dac0 0x7f57780998f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:29.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 >> 10.20.193.51:0/3427665172 conn(0x7f57780a30c0 msgr2=0x7f57780a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:29.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 shutdown_connections 2026-02-17T12:05:29.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:29.288+0000 7f577d151640 1 -- 10.20.193.51:0/3427665172 wait complete. 2026-02-17T12:05:29.697 INFO:tasks.rados.rados.0.trial142.stdout:3293: done (0 left) 2026-02-17T12:05:29.697 INFO:tasks.rados.rados.0.trial142.stdout:3294: write oid 29 current snap is 366 2026-02-17T12:05:29.697 INFO:tasks.rados.rados.0.trial142.stdout:3294: seq_num 1126 ranges {524682=750618,1757548=597056} 2026-02-17T12:05:29.701 INFO:tasks.rados.rados.0.trial142.stdout:3294: writing trial14245205-29 from 524682 to 1275300 tid 1 2026-02-17T12:05:29.705 INFO:tasks.rados.rados.0.trial142.stdout:3294: writing trial14245205-29 from 1757548 to 2354604 tid 2 2026-02-17T12:05:29.706 INFO:tasks.rados.rados.0.trial142.stdout:3295: delete oid 25 current snap is 366 2026-02-17T12:05:29.706 INFO:tasks.rados.rados.0.trial142.stdout:3294: finishing write tid 1 to trial14245205-29 2026-02-17T12:05:29.707 INFO:tasks.rados.rados.0.trial142.stdout:3294: finishing write tid 2 to trial14245205-29 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: finishing write tid 3 to trial14245205-29 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: finishing write tid 4 to trial14245205-29 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: oid 29 updating version 0 to 2727 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: oid 29 version 2727 is already newer than 2725 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: oid 29 version 2727 is already newer than 2726 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2727 (ObjNum 1126 snap 366 seq_num 1126) dirty exists 2026-02-17T12:05:29.708 INFO:tasks.rados.rados.0.trial142.stdout:3294: left oid 29 (ObjNum 1126 snap 366 seq_num 1126) 2026-02-17T12:05:29.709 INFO:tasks.rados.rados.0.trial142.stdout:3294: done (1 left) 2026-02-17T12:05:29.709 INFO:tasks.rados.rados.0.trial142.stdout:3295: done (0 left) 2026-02-17T12:05:29.709 INFO:tasks.rados.rados.0.trial142.stdout:3296: snap_remove snap 355 2026-02-17T12:05:30.699 INFO:tasks.rados.rados.0.trial142.stdout:3296: done (0 left) 2026-02-17T12:05:30.699 INFO:tasks.rados.rados.0.trial142.stdout:3297: delete oid 15 current snap is 366 2026-02-17T12:05:30.705 INFO:tasks.rados.rados.0.trial142.stdout:3297: done (0 left) 2026-02-17T12:05:30.705 INFO:tasks.rados.rados.0.trial142.stdout:3298: write oid 33 current snap is 366 2026-02-17T12:05:30.705 INFO:tasks.rados.rados.0.trial142.stdout:3298: seq_num 1129 ranges {575103=576365,1932994=744383} 2026-02-17T12:05:30.710 INFO:tasks.rados.rados.0.trial142.stdout:3298: writing trial14245205-33 from 575103 to 1151468 tid 1 2026-02-17T12:05:30.717 INFO:tasks.rados.rados.0.trial142.stdout:3298: writing trial14245205-33 from 1932994 to 2677377 tid 2 2026-02-17T12:05:30.717 INFO:tasks.rados.rados.0.trial142.stdout:3299: snap_remove snap 344 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3299: done (1 left) 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3300: rollback oid 38 current snap is 366 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 38 to 342 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: finishing write tid 1 to trial14245205-33 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: finishing write tid 2 to trial14245205-33 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: finishing write tid 3 to trial14245205-33 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: finishing write tid 4 to trial14245205-33 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: oid 33 updating version 0 to 2754 2026-02-17T12:05:31.703 INFO:tasks.rados.rados.0.trial142.stdout:3298: oid 33 version 2754 is already newer than 2753 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:3298: oid 33 updating version 2754 to 2755 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 2755 (ObjNum 1129 snap 366 seq_num 1129) dirty exists 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:3298: left oid 33 (ObjNum 1129 snap 366 seq_num 1129) 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:3298: done (1 left) 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:3301: write oid 32 current snap is 366 2026-02-17T12:05:31.704 INFO:tasks.rados.rados.0.trial142.stdout:3301: seq_num 1130 ranges {591910=651614,1875123=604394} 2026-02-17T12:05:31.707 INFO:tasks.rados.rados.0.trial142.stdout:3301: writing trial14245205-32 from 591910 to 1243524 tid 1 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3301: writing trial14245205-32 from 1875123 to 2479517 tid 2 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3302: read oid 46 snap -1 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3302: expect (ObjNum 1065 snap 346 seq_num 1065) 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3303: snap_create 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3300: finishing rollback tid 0 to trial14245205-38 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3300: finishing rollback tid 1 to trial14245205-38 2026-02-17T12:05:31.713 INFO:tasks.rados.rados.0.trial142.stdout:3300: finishing rollback tid 2 to trial14245205-38 2026-02-17T12:05:31.714 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 2002 (ObjNum 964 snap 310 seq_num 964) dirty exists 2026-02-17T12:05:31.714 INFO:tasks.rados.rados.0.trial142.stdout:3301: finishing write tid 1 to trial14245205-32 2026-02-17T12:05:31.714 INFO:tasks.rados.rados.0.trial142.stdout:3301: finishing write tid 2 to trial14245205-32 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: finishing write tid 3 to trial14245205-32 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: finishing write tid 4 to trial14245205-32 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: oid 32 updating version 0 to 2732 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: oid 32 updating version 2732 to 2733 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: oid 32 updating version 2733 to 2734 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2734 (ObjNum 1130 snap 366 seq_num 1130) dirty exists 2026-02-17T12:05:31.715 INFO:tasks.rados.rados.0.trial142.stdout:3301: left oid 32 (ObjNum 1130 snap 366 seq_num 1130) 2026-02-17T12:05:31.717 INFO:tasks.rados.rados.0.trial142.stdout:3302: expect (ObjNum 1065 snap 346 seq_num 1065) 2026-02-17T12:05:32.298 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:32.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.366+0000 7f6a41e7e640 10 monclient: get_monmap_and_config 2026-02-17T12:05:32.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.366+0000 7f6a41e7e640 10 monclient: build_initial_monmap 2026-02-17T12:05:32.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.366+0000 7f6a41e7e640 10 monclient: monmap: 2026-02-17T12:05:32.371 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:32.371 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:32.367617+0000 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:32.367617+0000 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 Processor -- start 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 -- start start 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient: init 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-b con 0x7f6a3c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-a con 0x7f6a3c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6a3c09e540 0x7f6a3c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-c con 0x7f6a3c09e540 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c0a3f90 con 0x7f6a3c0a0750 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c06e140 con 0x7f6a3c09e540 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c09f910 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a41e7e640 10 monclient(hunting): authenticate will time out at 1819.986403s 2026-02-17T12:05:32.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59414/0 (socket says 10.20.193.51:59414) 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1756929675 learned_addr learned my addr 10.20.193.51:0/1756929675 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): get_auth_request con 0x7f6a3c0a3bb0 auth_method 0 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 10 monclient(hunting): get_auth_request con 0x7f6a3c0a0750 auth_method 0 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:32.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 1 -- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 msgr2=0x7f6a3c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 1 -- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 msgr2=0x7f6a3c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3affd640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient(hunting): handle_auth_done global_id 234275 payload 274 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1756929675 >> v2:10.20.193.142:3300/0 conn(0x7f6a3c09e540 msgr2=0x7f6a3c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.142:3300/0 conn(0x7f6a3c09e540 0x7f6a3c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 msgr2=0x7f6a3c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:32.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:32.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 monclient: found mon.noname-b 2026-02-17T12:05:32.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:32.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.367+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1756929675 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c09ccd0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1756929675 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 msgr2=0x7f6a3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1756929675 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c09f230 tx=0x7f6a2802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8949dbcafad4c20c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 1 -- 10.20.193.51:0/1756929675 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2803c070 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:32.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: dump: 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:32.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 1 -- 10.20.193.51:0/1756929675 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2802fca0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 5 monclient: authenticate success, global_id 234275 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 1 -- 10.20.193.51:0/1756929675 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28037660 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 4 set_mon_vals no callback set 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a3a7fc640 10 monclient: dump: 2026-02-17T12:05:32.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 10 monclient: shutdown 2026-02-17T12:05:32.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1756929675 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 msgr2=0x7f6a3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1756929675 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c09f230 tx=0x7f6a2802ee60 comp rx=0 tx=0).stop 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1756929675 shutdown_connections 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.142:3300/0 conn(0x7f6a3c09e540 0x7f6a3c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1756929675 >> v2:10.20.193.51:3300/0 conn(0x7f6a3c0a0750 0x7f6a3c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1756929675 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c09dac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1756929675 >> 10.20.193.51:0/1756929675 conn(0x7f6a3c0a30c0 msgr2=0x7f6a3c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1756929675 shutdown_connections 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.370+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1756929675 wait complete. 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient: build_initial_monmap 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient: monmap: 2026-02-17T12:05:32.388 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:32.389 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 Processor -- start 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 -- start start 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient: init 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-b con 0x7f6a3c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:32.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-a con 0x7f6a3c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c1cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): picked mon.noname-c con 0x7f6a3c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c0a04b0 con 0x7f6a3c0a0750 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c09c850 con 0x7f6a3c09e540 2026-02-17T12:05:32.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c13cca0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a41e7e640 10 monclient(hunting): authenticate will time out at 1819.990604s 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36022/0 (socket says 10.20.193.51:36022) 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 -- 10.20.193.51:0/1232474161 learned_addr learned my addr 10.20.193.51:0/1232474161 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c1cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 10 monclient(hunting): get_auth_request con 0x7f6a3c0a0750 auth_method 0 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): get_auth_request con 0x7f6a3c0a3bb0 auth_method 0 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:32.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 msgr2=0x7f6a3c1cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 msgr2=0x7f6a3c1cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3affd640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient(hunting): handle_auth_done global_id 234278 payload 824 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 msgr2=0x7f6a3c13be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3b7fe640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 msgr2=0x7f6a3c13be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 msgr2=0x7f6a3c13be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 msgr2=0x7f6a3c1cf540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:32.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 monclient: found mon.noname-c 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.371+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1232474161 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c06f840 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.373+0000 7f6a3bfff640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 msgr2=0x7f6a3c1cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.373+0000 7f6a3bfff640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c1cfa80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000be50 tx=0x7f6a3000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.373+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000cc10 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: dump: 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.397 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:32.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a30010070 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a300040f0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:32.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 10 monclient: dump: 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:32.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a39ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 5 monclient: authenticate success, global_id 234278 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _renew_subs 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c091f50 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _renew_subs 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c06f410 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c09dac0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6a3001d030 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 0x7f6a0c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.376+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(750..750 src has 323..750) ==== 4795+0+0 (secure 0 0 0) 0x7f6a30052500 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.377+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 0x7f6a0c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.377+0000 7f6a3b7fe640 10 monclient: get_auth_request con 0x7f6a0c03dd60 auth_method 0 2026-02-17T12:05:32.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.379+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6a3c06f840 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.379+0000 7f6a17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:32.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.379+0000 7f6a17fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:32.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.379+0000 7f6a3b7fe640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 0x7f6a0c040220 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6a28036000 tx=0x7f6a28039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a41e7e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:32.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a41e7e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:32.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a41e7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:32.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6a3c0008d0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a17fff640 1 -- 10.20.193.51:0/1232474161 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f6a300046c0 con 0x7f6a3c0a3bb0 2026-02-17T12:05:32.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a17fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:32.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.491+0000 7f6a17fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:32.494 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":186,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:32.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 msgr2=0x7f6a0c040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 0x7f6a0c040220 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6a28036000 tx=0x7f6a28039040 comp rx=0 tx=0).stop 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 10 monclient: shutdown 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 msgr2=0x7f6a3c1cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c1cfa80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000be50 tx=0x7f6a3000bf50 comp rx=0 tx=0).stop 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 shutdown_connections 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f6a0c03dd60 0x7f6a0c040220 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6a3c0a3bb0 0x7f6a3c1cfa80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6a3c0a0750 0x7f6a3c1cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 --2- 10.20.193.51:0/1232474161 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6a3c09e540 0x7f6a3c13be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 >> 10.20.193.51:0/1232474161 conn(0x7f6a3c0a30c0 msgr2=0x7f6a3c072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 shutdown_connections 2026-02-17T12:05:32.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:32.492+0000 7f6a41e7e640 1 -- 10.20.193.51:0/1232474161 wait complete. 2026-02-17T12:05:32.653 INFO:tasks.rados.rados.0.trial142.stdout:3300: done (3 left) 2026-02-17T12:05:32.653 INFO:tasks.rados.rados.0.trial142.stdout:3301: done (2 left) 2026-02-17T12:05:32.653 INFO:tasks.rados.rados.0.trial142.stdout:3302: done (1 left) 2026-02-17T12:05:32.654 INFO:tasks.rados.rados.0.trial142.stdout:3303: done (0 left) 2026-02-17T12:05:32.654 INFO:tasks.rados.rados.0.trial142.stdout:3304: delete oid 33 current snap is 367 2026-02-17T12:05:32.656 INFO:tasks.rados.rados.0.trial142.stdout:3304: done (0 left) 2026-02-17T12:05:32.656 INFO:tasks.rados.rados.0.trial142.stdout:3305: rollback oid 1 current snap is 367 2026-02-17T12:05:32.656 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 362 2026-02-17T12:05:32.656 INFO:tasks.rados.rados.0.trial142.stdout:3306: write (excl) oid 50 current snap is 367 2026-02-17T12:05:32.656 INFO:tasks.rados.rados.0.trial142.stdout:3306: seq_num 1132 ranges {625524=402112,1592087=608063,2869769=155755} 2026-02-17T12:05:32.660 INFO:tasks.rados.rados.0.trial142.stdout:3306: writing trial14245205-50 from 625524 to 1027636 tid 1 2026-02-17T12:05:32.664 INFO:tasks.rados.rados.0.trial142.stdout:3306: writing trial14245205-50 from 1592087 to 2200150 tid 2 2026-02-17T12:05:32.667 INFO:tasks.rados.rados.0.trial142.stdout:3306: writing trial14245205-50 from 2869769 to 3025524 tid 3 2026-02-17T12:05:32.668 INFO:tasks.rados.rados.0.trial142.stdout:3307: write oid 3 current snap is 367 2026-02-17T12:05:32.668 INFO:tasks.rados.rados.0.trial142.stdout:3307: seq_num 1133 ranges {642331=593714,1766922=751721} 2026-02-17T12:05:32.672 INFO:tasks.rados.rados.0.trial142.stdout:3307: writing trial14245205-3 from 642331 to 1236045 tid 1 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3307: writing trial14245205-3 from 1766922 to 2518643 tid 2 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3308: read oid 4 snap -1 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3308: expect (ObjNum 1106 snap 358 seq_num 1106) 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3309: copy_from oid 20 from oid 25 current snap is 367 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3305: finishing rollback tid 0 to trial14245205-1 2026-02-17T12:05:32.679 INFO:tasks.rados.rados.0.trial142.stdout:3305: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3305: finishing rollback tid 2 to trial14245205-1 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2706 (ObjNum 958 snap 310 seq_num 958) dirty exists 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: finishing write tid 1 to trial14245205-50 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: finishing write tid 2 to trial14245205-50 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: finishing write tid 3 to trial14245205-50 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: finishing write tid 4 to trial14245205-50 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: finishing write tid 5 to trial14245205-50 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: oid 50 updating version 0 to 2716 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: oid 50 version 2716 is already newer than 2714 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: oid 50 version 2716 is already newer than 2715 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:3306: oid 50 version 2716 is already newer than 2713 2026-02-17T12:05:32.680 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2716 (ObjNum 1132 snap 367 seq_num 1132) dirty exists 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3306: left oid 50 (ObjNum 1132 snap 367 seq_num 1132) 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3307: finishing write tid 1 to trial14245205-3 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3305: done (4 left) 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3306: done (3 left) 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3310: read oid 7 snap -1 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3310: expect (ObjNum 979 snap 315 seq_num 979) 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3311: read oid 19 snap -1 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3311: expect deleted 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3312: delete oid 1 current snap is 367 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3309: finishing copy_from to trial14245205-20 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3309: got expected ENOENT (src dne) 2026-02-17T12:05:32.681 INFO:tasks.rados.rados.0.trial142.stdout:3309: finishing copy_from racing read to trial14245205-20 2026-02-17T12:05:32.682 INFO:tasks.rados.rados.0.trial142.stdout:3309: done (5 left) 2026-02-17T12:05:32.682 INFO:tasks.rados.rados.0.trial142.stdout:3311: done (4 left) 2026-02-17T12:05:32.682 INFO:tasks.rados.rados.0.trial142.stdout:3312: done (3 left) 2026-02-17T12:05:32.682 INFO:tasks.rados.rados.0.trial142.stdout:3313: write (excl) oid 11 current snap is 367 2026-02-17T12:05:32.682 INFO:tasks.rados.rados.0.trial142.stdout:3313: seq_num 1135 ranges {675945=744212,2167533=755390} 2026-02-17T12:05:32.684 INFO:tasks.rados.rados.0.trial142.stdout:3313: writing trial14245205-11 from 675945 to 1420157 tid 1 2026-02-17T12:05:32.691 INFO:tasks.rados.rados.0.trial142.stdout:3313: writing trial14245205-11 from 2167533 to 2922923 tid 2 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3314: write oid 2 current snap is 367 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: finishing write tid 2 to trial14245205-3 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: finishing write tid 3 to trial14245205-3 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: finishing write tid 4 to trial14245205-3 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: oid 3 updating version 0 to 2728 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: oid 3 version 2728 is already newer than 2727 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: oid 3 updating version 2728 to 2729 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2729 (ObjNum 1133 snap 367 seq_num 1133) dirty exists 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3307: left oid 3 (ObjNum 1133 snap 367 seq_num 1133) 2026-02-17T12:05:32.692 INFO:tasks.rados.rados.0.trial142.stdout:3308: expect (ObjNum 1106 snap 358 seq_num 1106) 2026-02-17T12:05:32.752 INFO:tasks.rados.rados.0.trial142.stdout:3310: expect (ObjNum 979 snap 315 seq_num 979) 2026-02-17T12:05:32.867 INFO:tasks.rados.rados.0.trial142.stdout:3313: finishing write tid 1 to trial14245205-11 2026-02-17T12:05:32.867 INFO:tasks.rados.rados.0.trial142.stdout:3314: seq_num 1136 ranges {692752=419461,1826015=615401,2979461=113291} 2026-02-17T12:05:32.871 INFO:tasks.rados.rados.0.trial142.stdout:3314: writing trial14245205-2 from 692752 to 1112213 tid 1 2026-02-17T12:05:32.876 INFO:tasks.rados.rados.0.trial142.stdout:3314: writing trial14245205-2 from 1826015 to 2441416 tid 2 2026-02-17T12:05:32.879 INFO:tasks.rados.rados.0.trial142.stdout:3314: writing trial14245205-2 from 2979461 to 3092752 tid 3 2026-02-17T12:05:32.879 INFO:tasks.rados.rados.0.trial142.stdout:3307: done (4 left) 2026-02-17T12:05:32.879 INFO:tasks.rados.rados.0.trial142.stdout:3308: done (3 left) 2026-02-17T12:05:32.880 INFO:tasks.rados.rados.0.trial142.stdout:3310: done (2 left) 2026-02-17T12:05:32.880 INFO:tasks.rados.rados.0.trial142.stdout:3315: snap_remove snap 359 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3315: done (2 left) 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3316: copy_from oid 32 from oid 21 current snap is 367 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: finishing write tid 2 to trial14245205-11 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: finishing write tid 3 to trial14245205-11 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: finishing write tid 4 to trial14245205-11 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: oid 11 updating version 0 to 1146 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: oid 11 updating version 1146 to 1147 2026-02-17T12:05:33.707 INFO:tasks.rados.rados.0.trial142.stdout:3313: oid 11 version 1147 is already newer than 1145 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 1147 (ObjNum 1135 snap 367 seq_num 1135) dirty exists 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3313: left oid 11 (ObjNum 1135 snap 367 seq_num 1135) 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: finishing write tid 1 to trial14245205-2 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: finishing write tid 2 to trial14245205-2 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: finishing write tid 3 to trial14245205-2 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: finishing write tid 4 to trial14245205-2 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: finishing write tid 5 to trial14245205-2 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: oid 2 updating version 0 to 2722 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: oid 2 version 2722 is already newer than 2719 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: oid 2 version 2722 is already newer than 2720 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:3314: oid 2 version 2722 is already newer than 2721 2026-02-17T12:05:33.708 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2722 (ObjNum 1136 snap 367 seq_num 1136) dirty exists 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3314: left oid 2 (ObjNum 1136 snap 367 seq_num 1136) 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3313: done (2 left) 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3314: done (1 left) 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3317: read oid 16 snap -1 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3317: expect deleted 2026-02-17T12:05:33.709 INFO:tasks.rados.rados.0.trial142.stdout:3318: snap_remove snap 360 2026-02-17T12:05:34.707 INFO:tasks.rados.rados.0.trial142.stdout:3318: done (2 left) 2026-02-17T12:05:34.707 INFO:tasks.rados.rados.0.trial142.stdout:3319: write (excl) oid 25 current snap is 367 2026-02-17T12:05:34.707 INFO:tasks.rados.rados.0.trial142.stdout:3319: seq_num 1137 ranges {709559=494710,1884497=759059} 2026-02-17T12:05:34.712 INFO:tasks.rados.rados.0.trial142.stdout:3319: writing trial14245205-25 from 709559 to 1204269 tid 1 2026-02-17T12:05:34.718 INFO:tasks.rados.rados.0.trial142.stdout:3319: writing trial14245205-25 from 1884497 to 2643556 tid 2 2026-02-17T12:05:34.719 INFO:tasks.rados.rados.0.trial142.stdout:3320: snap_create 2026-02-17T12:05:34.719 INFO:tasks.rados.rados.0.trial142.stdout:3316: finishing copy_from racing read to trial14245205-32 2026-02-17T12:05:34.719 INFO:tasks.rados.rados.0.trial142.stdout:3316: finishing copy_from to trial14245205-32 2026-02-17T12:05:34.719 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2173 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:05:34.719 INFO:tasks.rados.rados.0.trial142.stdout:3319: finishing write tid 1 to trial14245205-25 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: finishing write tid 2 to trial14245205-25 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: finishing write tid 3 to trial14245205-25 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: finishing write tid 4 to trial14245205-25 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: oid 25 updating version 0 to 2717 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: oid 25 updating version 2717 to 2718 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:3319: oid 25 updating version 2718 to 2719 2026-02-17T12:05:34.721 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2719 (ObjNum 1137 snap 367 seq_num 1137) dirty exists 2026-02-17T12:05:34.722 INFO:tasks.rados.rados.0.trial142.stdout:3319: left oid 25 (ObjNum 1137 snap 367 seq_num 1137) 2026-02-17T12:05:35.503 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:35.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: get_monmap_and_config 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: build_initial_monmap 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: monmap: 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:35.571095+0000 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:35.571095+0000 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:35.572 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:35.573 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 Processor -- start 2026-02-17T12:05:35.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 -- start start 2026-02-17T12:05:35.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: init 2026-02-17T12:05:35.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdec00a3bb0 0x7fdec009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-c con 0x7fdec00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdec009dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-b con 0x7fdec00a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec006e140 con 0x7fdec009dac0 2026-02-17T12:05:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdec009aed0 con 0x7fdec00a3bb0 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdec009caa0 con 0x7fdec00a0110 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec79f7640 10 monclient(hunting): authenticate will time out at 1823.189890s 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.570+0000 7fdec5f6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40470/0 (socket says 10.20.193.51:40470) 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 -- 10.20.193.51:0/2005567712 learned_addr learned my addr 10.20.193.51:0/2005567712 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): get_auth_request con 0x7fdec00a0110 auth_method 0 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec576c640 1 --2- 10.20.193.51:0/2005567712 >> v2:10.20.193.142:3300/0 conn(0x7fdec00a3bb0 0x7fdec009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec576c640 10 monclient(hunting): get_auth_request con 0x7fdec00a3bb0 auth_method 0 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec576c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec576c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec576c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient(hunting): handle_auth_done global_id 234281 payload 274 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 -- 10.20.193.51:0/2005567712 >> v2:10.20.193.142:3300/0 conn(0x7fdec00a3bb0 msgr2=0x7fdec009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:35.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 --2- 10.20.193.51:0/2005567712 >> v2:10.20.193.142:3300/0 conn(0x7fdec00a3bb0 0x7fdec009f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 -- 10.20.193.51:0/2005567712 >> v1:10.20.193.142:6789/0 conn(0x7fdec009dac0 legacy=0x7fdec009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient: _finish_hunting 0 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 monclient: found mon.noname-b 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.571+0000 7fdec5f6d640 1 -- 10.20.193.51:0/2005567712 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec009ce60 con 0x7fdec00a0110 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdec5f6d640 1 -- 10.20.193.51:0/2005567712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 msgr2=0x7fdec013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdec5f6d640 1 --2- 10.20.193.51:0/2005567712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009e50 tx=0x7fdebc02f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c10de4e3ea3d33a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 1 -- 10.20.193.51:0/2005567712 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0373f0 con 0x7fdec00a0110 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: dump: 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: _finish_auth 0 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 1 -- 10.20.193.51:0/2005567712 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc037590 con 0x7fdec00a0110 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 1 -- 10.20.193.51:0/2005567712 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc037960 con 0x7fdec00a0110 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdeaffff640 10 monclient: dump: 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.584 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdec79f7640 5 monclient: authenticate success, global_id 234281 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdec79f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.573+0000 7fdec79f7640 4 set_mon_vals no callback set 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 10 monclient: shutdown 2026-02-17T12:05:35.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- 10.20.193.51:0/2005567712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 msgr2=0x7fdec013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 --2- 10.20.193.51:0/2005567712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009e50 tx=0x7fdebc02f260 comp rx=0 tx=0).stop 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- 10.20.193.51:0/2005567712 shutdown_connections 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 --2- 10.20.193.51:0/2005567712 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec013c760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 --2- 10.20.193.51:0/2005567712 >> v2:10.20.193.142:3300/0 conn(0x7fdec00a3bb0 0x7fdec009f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- 10.20.193.51:0/2005567712 >> 10.20.193.51:0/2005567712 conn(0x7fdec00a30c0 msgr2=0x7fdec00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- 10.20.193.51:0/2005567712 shutdown_connections 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- 10.20.193.51:0/2005567712 wait complete. 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 10 monclient: build_initial_monmap 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 10 monclient: monmap: 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:35.586 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 Processor -- start 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 1 -- start start 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.574+0000 7fdec79f7640 10 monclient: init 2026-02-17T12:05:35.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdec009dac0 0x7fdec0099e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-b con 0x7fdec009dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-c con 0x7fdec00a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): picked mon.noname-a con 0x7fdec00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdec009a880 con 0x7fdec00a3bb0 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdec00a3f90 con 0x7fdec009dac0 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:35.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdec00a0540 con 0x7fdec00a0110 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec79f7640 10 monclient(hunting): authenticate will time out at 1823.194259s 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40474/0 (socket says 10.20.193.51:40474) 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 -- 10.20.193.51:0/1365615700 learned_addr learned my addr 10.20.193.51:0/1365615700 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): get_auth_request con 0x7fdec00a0110 auth_method 0 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 10 monclient(hunting): get_auth_request con 0x7fdec00a3bb0 auth_method 0 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 msgr2=0x7fdec0094ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 msgr2=0x7fdec0094ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec5f6d640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec576c640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdec009dac0 0x7fdec0099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec576c640 10 monclient(hunting): get_auth_request con 0x7fdec009dac0 auth_method 0 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec576c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec576c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec576c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:35.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient(hunting): handle_auth_done global_id 234284 payload 824 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdec009dac0 msgr2=0x7fdec0099e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdec009dac0 0x7fdec0099e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 msgr2=0x7fdec0094ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient: _finish_hunting 0 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 monclient: found mon.noname-c 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.575+0000 7fdec4f6b640 1 -- 10.20.193.51:0/1365615700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec0098760 con 0x7fdec00a0110 2026-02-17T12:05:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec4f6b640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 msgr2=0x7fdec0094ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec4f6b640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c600 tx=0x7fdeb400cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4012a40 con 0x7fdec00a0110 2026-02-17T12:05:35.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: dump: 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:35.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb4017070 con 0x7fdec00a0110 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4012e20 con 0x7fdec00a0110 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeaf7fe640 4 set_mon_vals no callback set 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdeadffb640 10 monclient: dump: 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:35.595 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 5 monclient: authenticate success, global_id 234284 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 10 monclient: _renew_subs 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec00a2a60 con 0x7fdec00a0110 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 10 monclient: _renew_subs 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.577+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec009d7b0 con 0x7fdec00a0110 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdeb401c460 con 0x7fdec00a0110 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec79f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec79f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec79f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec009d0a0 con 0x7fdec00a0110 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdeadffb640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 0x7fde900401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(753..753 src has 323..753) ==== 4795+0+0 (secure 0 0 0) 0x7fdeb40525b0 con 0x7fdec00a0110 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec576c640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 0x7fde900401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.578+0000 7fdec576c640 10 monclient: get_auth_request con 0x7fde9003dd10 auth_method 0 2026-02-17T12:05:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.581+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdec009d0a0 con 0x7fdec00a0110 2026-02-17T12:05:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.581+0000 7fdeadffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.581+0000 7fdeadffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:35.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.581+0000 7fdec576c640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 0x7fde900401d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00099b0 tx=0x7fdeb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdec79f7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:35.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdec79f7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdec79f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdec009f4c0 con 0x7fdec00a0110 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdeadffb640 1 -- 10.20.193.51:0/1365615700 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fdeb401ac60 con 0x7fdec00a0110 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdeadffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.697+0000 7fdeadffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:35.700 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":186,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":30,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:35.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 msgr2=0x7fde900401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 0x7fde900401d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00099b0 tx=0x7fdeb0008040 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 10 monclient: shutdown 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 msgr2=0x7fdec0094ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c600 tx=0x7fdeb400cad0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 shutdown_connections 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fde9003dd10 0x7fde900401d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdec00a3bb0 0x7fdec0094ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdec00a0110 0x7fdec0094ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 --2- 10.20.193.51:0/1365615700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdec009dac0 0x7fdec0099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 >> 10.20.193.51:0/1365615700 conn(0x7fdec00a30c0 msgr2=0x7fdec006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:35.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 shutdown_connections 2026-02-17T12:05:35.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:35.698+0000 7fdec79f7640 1 -- 10.20.193.51:0/1365615700 wait complete. 2026-02-17T12:05:35.711 INFO:tasks.rados.rados.0.trial142.stdout:3316: done (3 left) 2026-02-17T12:05:35.711 INFO:tasks.rados.rados.0.trial142.stdout:3317: done (2 left) 2026-02-17T12:05:35.711 INFO:tasks.rados.rados.0.trial142.stdout:3319: done (1 left) 2026-02-17T12:05:35.711 INFO:tasks.rados.rados.0.trial142.stdout:3320: done (0 left) 2026-02-17T12:05:35.711 INFO:tasks.rados.rados.0.trial142.stdout:3321: read oid 24 snap -1 2026-02-17T12:05:35.712 INFO:tasks.rados.rados.0.trial142.stdout:3321: expect deleted 2026-02-17T12:05:35.712 INFO:tasks.rados.rados.0.trial142.stdout:3322: delete oid 30 current snap is 368 2026-02-17T12:05:35.713 INFO:tasks.rados.rados.0.trial142.stdout:3321: done (1 left) 2026-02-17T12:05:35.713 INFO:tasks.rados.rados.0.trial142.stdout:3322: done (0 left) 2026-02-17T12:05:35.713 INFO:tasks.rados.rados.0.trial142.stdout:3323: read oid 2 snap -1 2026-02-17T12:05:35.713 INFO:tasks.rados.rados.0.trial142.stdout:3323: expect (ObjNum 1136 snap 367 seq_num 1136) 2026-02-17T12:05:35.714 INFO:tasks.rados.rados.0.trial142.stdout:3324: read oid 24 snap -1 2026-02-17T12:05:35.714 INFO:tasks.rados.rados.0.trial142.stdout:3324: expect deleted 2026-02-17T12:05:35.714 INFO:tasks.rados.rados.0.trial142.stdout:3325: delete oid 15 current snap is 368 2026-02-17T12:05:35.714 INFO:tasks.rados.rados.0.trial142.stdout:3324: done (2 left) 2026-02-17T12:05:35.715 INFO:tasks.rados.rados.0.trial142.stdout:3325: done (1 left) 2026-02-17T12:05:35.715 INFO:tasks.rados.rados.0.trial142.stdout:3326: delete oid 39 current snap is 368 2026-02-17T12:05:35.716 INFO:tasks.rados.rados.0.trial142.stdout:3326: done (1 left) 2026-02-17T12:05:35.716 INFO:tasks.rados.rados.0.trial142.stdout:3327: read oid 5 snap -1 2026-02-17T12:05:35.716 INFO:tasks.rados.rados.0.trial142.stdout:3327: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:05:35.717 INFO:tasks.rados.rados.0.trial142.stdout:3328: copy_from oid 27 from oid 9 current snap is 368 2026-02-17T12:05:35.717 INFO:tasks.rados.rados.0.trial142.stdout:3329: snap_create 2026-02-17T12:05:35.718 INFO:tasks.rados.rados.0.trial142.stdout:3323: expect (ObjNum 1136 snap 367 seq_num 1136) 2026-02-17T12:05:35.817 INFO:tasks.rados.rados.0.trial142.stdout:3327: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:05:35.882 INFO:tasks.rados.rados.0.trial142.stdout:3328: finishing copy_from racing read to trial14245205-27 2026-02-17T12:05:35.882 INFO:tasks.rados.rados.0.trial142.stdout:3328: finishing copy_from to trial14245205-27 2026-02-17T12:05:35.882 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 3061 (ObjNum 1114 snap 361 seq_num 1114) dirty exists 2026-02-17T12:05:36.714 INFO:tasks.rados.rados.0.trial142.stdout:3323: done (3 left) 2026-02-17T12:05:36.714 INFO:tasks.rados.rados.0.trial142.stdout:3327: done (2 left) 2026-02-17T12:05:36.714 INFO:tasks.rados.rados.0.trial142.stdout:3328: done (1 left) 2026-02-17T12:05:36.715 INFO:tasks.rados.rados.0.trial142.stdout:3329: done (0 left) 2026-02-17T12:05:36.715 INFO:tasks.rados.rados.0.trial142.stdout:3330: delete oid 39 current snap is 369 2026-02-17T12:05:36.717 INFO:tasks.rados.rados.0.trial142.stdout:3330: done (0 left) 2026-02-17T12:05:36.717 INFO:tasks.rados.rados.0.trial142.stdout:3331: snap_remove snap 347 2026-02-17T12:05:37.652 INFO:tasks.rados.rados.0.trial142.stdout:3331: done (0 left) 2026-02-17T12:05:37.653 INFO:tasks.rados.rados.0.trial142.stdout:3332: delete oid 14 current snap is 369 2026-02-17T12:05:37.657 INFO:tasks.rados.rados.0.trial142.stdout:3332: done (0 left) 2026-02-17T12:05:37.657 INFO:tasks.rados.rados.0.trial142.stdout:3333: snap_create 2026-02-17T12:05:38.659 INFO:tasks.rados.rados.0.trial142.stdout:3333: done (0 left) 2026-02-17T12:05:38.660 INFO:tasks.rados.rados.0.trial142.stdout:3334: delete oid 24 current snap is 370 2026-02-17T12:05:38.661 INFO:tasks.rados.rados.0.trial142.stdout:3334: done (0 left) 2026-02-17T12:05:38.661 INFO:tasks.rados.rados.0.trial142.stdout:3335: write (excl) oid 15 current snap is 370 2026-02-17T12:05:38.661 INFO:tasks.rados.rados.0.trial142.stdout:3335: seq_num 1144 ranges {427208=737806,1777518=513724,2966139=261069} 2026-02-17T12:05:38.665 INFO:tasks.rados.rados.0.trial142.stdout:3335: writing trial14245205-15 from 427208 to 1165014 tid 1 2026-02-17T12:05:38.670 INFO:tasks.rados.rados.0.trial142.stdout:3335: writing trial14245205-15 from 1777518 to 2291242 tid 2 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3335: writing trial14245205-15 from 2966139 to 3227208 tid 3 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3336: copy_from oid 41 from oid 16 current snap is 370 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3335: finishing write tid 1 to trial14245205-15 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3335: finishing write tid 2 to trial14245205-15 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3337: read oid 32 snap 354 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3337: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3338: read oid 26 snap -1 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3338: expect (ObjNum 1112 snap 361 seq_num 1112) 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3339: read oid 10 snap 334 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3339: expect deleted 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3340: read oid 34 snap 362 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3340: expect deleted 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3341: write (excl) oid 33 current snap is 370 2026-02-17T12:05:38.674 INFO:tasks.rados.rados.0.trial142.stdout:3341: seq_num 1145 ranges {444015=413055,1436000=773735,2709915=534100} 2026-02-17T12:05:38.677 INFO:tasks.rados.rados.0.trial142.stdout:3341: writing trial14245205-33 from 444015 to 857070 tid 1 2026-02-17T12:05:38.682 INFO:tasks.rados.rados.0.trial142.stdout:3341: writing trial14245205-33 from 1436000 to 2209735 tid 2 2026-02-17T12:05:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3341: writing trial14245205-33 from 2709915 to 3244015 tid 3 2026-02-17T12:05:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3342: copy_from oid 11 from oid 45 current snap is 370 2026-02-17T12:05:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3339: done (7 left) 2026-02-17T12:05:38.686 INFO:tasks.rados.rados.0.trial142.stdout:3340: done (6 left) 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3343: delete oid 31 current snap is 370 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3336: finishing copy_from to trial14245205-41 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3336: got expected ENOENT (src dne) 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3336: finishing copy_from racing read to trial14245205-41 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: finishing write tid 3 to trial14245205-15 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: finishing write tid 4 to trial14245205-15 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: finishing write tid 5 to trial14245205-15 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: oid 15 updating version 0 to 3064 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: oid 15 version 3064 is already newer than 3062 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: oid 15 version 3064 is already newer than 3063 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: oid 15 updating version 3064 to 3065 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3065 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3335: left oid 15 (ObjNum 1144 snap 370 seq_num 1144) 2026-02-17T12:05:38.687 INFO:tasks.rados.rados.0.trial142.stdout:3337: expect (ObjNum 961 snap 310 seq_num 961) 2026-02-17T12:05:38.709 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3341: finishing write tid 1 to trial14245205-33 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3335: done (6 left) 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3336: done (5 left) 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3337: done (4 left) 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3343: done (3 left) 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3344: write oid 25 current snap is 370 2026-02-17T12:05:38.752 INFO:tasks.rados.rados.0.trial142.stdout:3344: seq_num 1147 ranges {477629=563553,1836611=777404,3048408=229221} 2026-02-17T12:05:38.756 INFO:tasks.rados.rados.0.trial142.stdout:3344: writing trial14245205-25 from 477629 to 1041182 tid 1 2026-02-17T12:05:38.762 INFO:tasks.rados.rados.0.trial142.stdout:3344: writing trial14245205-25 from 1836611 to 2614015 tid 2 2026-02-17T12:05:38.764 INFO:tasks.rados.rados.0.trial142.stdout:3344: writing trial14245205-25 from 3048408 to 3277629 tid 3 2026-02-17T12:05:38.765 INFO:tasks.rados.rados.0.trial142.stdout:3345: rollback oid 48 current snap is 370 2026-02-17T12:05:38.765 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 364 2026-02-17T12:05:38.765 INFO:tasks.rados.rados.0.trial142.stdout:3338: expect (ObjNum 1112 snap 361 seq_num 1112) 2026-02-17T12:05:38.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.773+0000 7f2484856640 10 monclient: get_monmap_and_config 2026-02-17T12:05:38.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.773+0000 7f2484856640 10 monclient: build_initial_monmap 2026-02-17T12:05:38.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.773+0000 7f2484856640 10 monclient: monmap: 2026-02-17T12:05:38.775 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:38.775 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:38.774565+0000 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:38.774565+0000 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:38.776 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 Processor -- start 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 -- start start 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient: init 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): picked mon.noname-b con 0x7f247c06eb80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f247c0a4c10 0x7f247c1383d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): picked mon.noname-c con 0x7f247c0a4c10 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:38.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f247c138910 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c06f9c0 con 0x7f247c138910 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f247c06ef60 con 0x7f247c0a4c10 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f247c06fca0 con 0x7f247c06eb80 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2484856640 10 monclient(hunting): authenticate will time out at 1826.393440s 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40508/0 (socket says 10.20.193.51:40508) 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 -- 10.20.193.51:0/2810461832 learned_addr learned my addr 10.20.193.51:0/2810461832 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): get_auth_request con 0x7f247c06eb80 auth_method 0 2026-02-17T12:05:38.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2481dca640 1 --2- 10.20.193.51:0/2810461832 >> v2:10.20.193.142:3300/0 conn(0x7f247c0a4c10 0x7f247c1383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2481dca640 10 monclient(hunting): get_auth_request con 0x7f247c0a4c10 auth_method 0 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2481dca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2481dca640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f2481dca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient(hunting): handle_auth_done global_id 234287 payload 274 2026-02-17T12:05:38.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 -- 10.20.193.51:0/2810461832 >> v2:10.20.193.142:3300/0 conn(0x7f247c0a4c10 msgr2=0x7f247c1383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 --2- 10.20.193.51:0/2810461832 >> v2:10.20.193.142:3300/0 conn(0x7f247c0a4c10 0x7f247c1383d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 -- 10.20.193.51:0/2810461832 >> v1:10.20.193.142:6789/0 conn(0x7f247c138910 legacy=0x7f247c134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient: _finish_hunting 0 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 monclient: found mon.noname-b 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.774+0000 7f24825cb640 1 -- 10.20.193.51:0/2810461832 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c06ff80 con 0x7f247c06eb80 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24825cb640 1 -- 10.20.193.51:0/2810461832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 msgr2=0x7f247c137e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24825cb640 1 --2- 10.20.193.51:0/2810461832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2474009970 tx=0x7f247402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b2bf058d6b268d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 1 -- 10.20.193.51:0/2810461832 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247403c070 con 0x7f247c06eb80 2026-02-17T12:05:38.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: dump: 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.789 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: _finish_auth 0 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 5 monclient: authenticate success, global_id 234287 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 1 -- 10.20.193.51:0/2810461832 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247402fcd0 con 0x7f247c06eb80 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:38.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 4 set_mon_vals no callback set 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 1 -- 10.20.193.51:0/2810461832 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474037660 con 0x7f247c06eb80 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f24815c9640 10 monclient: dump: 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.791 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 10 monclient: shutdown 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 -- 10.20.193.51:0/2810461832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 msgr2=0x7f247c137e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 --2- 10.20.193.51:0/2810461832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2474009970 tx=0x7f247402ee90 comp rx=0 tx=0).stop 2026-02-17T12:05:38.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 -- 10.20.193.51:0/2810461832 shutdown_connections 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 --2- 10.20.193.51:0/2810461832 >> v2:10.20.193.142:3300/0 conn(0x7f247c0a4c10 0x7f247c1383d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 --2- 10.20.193.51:0/2810461832 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c137e90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 -- 10.20.193.51:0/2810461832 >> 10.20.193.51:0/2810461832 conn(0x7f247c0a8c80 msgr2=0x7f247c0a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 -- 10.20.193.51:0/2810461832 shutdown_connections 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.777+0000 7f2484856640 1 -- 10.20.193.51:0/2810461832 wait complete. 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient: build_initial_monmap 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient: monmap: 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:38.793 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 Processor -- start 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 -- start start 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient: init 2026-02-17T12:05:38.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): picked mon.noname-c con 0x7f247c06eb80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 0x7f247c131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): picked mon.noname-a con 0x7f247c0a4c10 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c138910 0x7f247c09c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): picked mon.noname-b con 0x7f247c138910 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1353d0 con 0x7f247c0a4c10 2026-02-17T12:05:38.795 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f247c135250 con 0x7f247c138910 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f247c135550 con 0x7f247c06eb80 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2484856640 10 monclient(hunting): authenticate will time out at 1826.397561s 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40514/0 (socket says 10.20.193.51:40514) 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 -- 10.20.193.51:0/1661174824 learned_addr learned my addr 10.20.193.51:0/1661174824 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): get_auth_request con 0x7f247c06eb80 auth_method 0 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.796 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 0x7f247c131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 10 monclient(hunting): get_auth_request con 0x7f247c0a4c10 auth_method 0 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient(hunting): handle_auth_done global_id 234290 payload 824 2026-02-17T12:05:38.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 -- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c138910 msgr2=0x7f247c09c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c138910 0x7f247c09c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 -- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 msgr2=0x7f247c131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 0x7f247c131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient: _finish_hunting 0 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 monclient: found mon.noname-c 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f24825cb640 1 -- 10.20.193.51:0/1661174824 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c09fa50 con 0x7f247c06eb80 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.778+0000 7f2481dca640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 0x7f247c131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:05:38.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.780+0000 7f24825cb640 1 -- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 msgr2=0x7f247c131710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.780+0000 7f24825cb640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2474009970 tx=0x7f2474004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247403c040 con 0x7f247c06eb80 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: dump: 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.799 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2474047070 con 0x7f247c06eb80 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:38.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 5 monclient: authenticate success, global_id 234290 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474042890 con 0x7f247c06eb80 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _renew_subs 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c074bc0 con 0x7f247c06eb80 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2480dc8640 4 set_mon_vals no callback set 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 10 monclient: dump: 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.801 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _renew_subs 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c09ec30 con 0x7f247c06eb80 2026-02-17T12:05:38.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247c134930 con 0x7f247c06eb80 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2474042a30 con 0x7f247c06eb80 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 0x7f244c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.781+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(757..757 src has 323..757) ==== 4751+0+0 (secure 0 0 0) 0x7f2474077a30 con 0x7f247c06eb80 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.782+0000 7f2481dca640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 0x7f244c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.782+0000 7f2481dca640 10 monclient: get_auth_request con 0x7f244c03dd10 auth_method 0 2026-02-17T12:05:38.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.784+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f24740363a0 con 0x7f247c06eb80 2026-02-17T12:05:38.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.784+0000 7f2466ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:38.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.784+0000 7f2466ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:38.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.784+0000 7f2481dca640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 0x7f244c0401d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f247c074860 tx=0x7f2468008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: finishing write tid 2 to trial14245205-33 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: finishing write tid 3 to trial14245205-33 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: finishing write tid 4 to trial14245205-33 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: finishing write tid 5 to trial14245205-33 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: oid 33 updating version 0 to 3066 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: oid 33 updating version 3066 to 3068 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: oid 33 version 3068 is already newer than 3067 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: oid 33 updating version 3068 to 3069 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 3069 (ObjNum 1145 snap 370 seq_num 1145) dirty exists 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3341: left oid 33 (ObjNum 1145 snap 370 seq_num 1145) 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3342: finishing copy_from racing read to trial14245205-11 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3342: finishing copy_from to trial14245205-11 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 2170 (ObjNum 1048 snap 340 seq_num 1048) dirty exists 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: finishing write tid 1 to trial14245205-25 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: finishing write tid 2 to trial14245205-25 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: finishing write tid 3 to trial14245205-25 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: finishing write tid 4 to trial14245205-25 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: finishing write tid 5 to trial14245205-25 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: oid 25 updating version 0 to 2721 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: oid 25 updating version 2721 to 2722 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: oid 25 version 2722 is already newer than 2720 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:3344: oid 25 updating version 2722 to 2723 2026-02-17T12:05:38.886 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2723 (ObjNum 1147 snap 370 seq_num 1147) dirty exists 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3344: left oid 25 (ObjNum 1147 snap 370 seq_num 1147) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3345: finishing rollback tid 1 to trial14245205-48 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2718 (ObjNum 16513 snap 0 seq_num 3495932944) dirty dne 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3338: done (4 left) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3341: done (3 left) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3342: done (2 left) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3344: done (1 left) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3345: done (0 left) 2026-02-17T12:05:38.887 INFO:tasks.rados.rados.0.trial142.stdout:3346: snap_remove snap 368 2026-02-17T12:05:38.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.896+0000 7f2484856640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:38.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.896+0000 7f2484856640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:38.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.896+0000 7f2484856640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.896+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f247c069830 con 0x7f247c06eb80 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.897+0000 7f2466ffd640 1 -- 10.20.193.51:0/1661174824 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f2474042e00 con 0x7f247c06eb80 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.897+0000 7f2466ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.897+0000 7f2466ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:38.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 msgr2=0x7f244c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 0x7f244c0401d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f247c074860 tx=0x7f2468008040 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 10 monclient: shutdown 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 msgr2=0x7f247c131710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2474009970 tx=0x7f2474004830 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 shutdown_connections 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f244c03dd10 0x7f244c0401d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f247c138910 0x7f247c09c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f247c0a4c10 0x7f247c131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 --2- 10.20.193.51:0/1661174824 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f247c06eb80 0x7f247c131710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 >> 10.20.193.51:0/1661174824 conn(0x7f247c0a8c80 msgr2=0x7f247c0a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 shutdown_connections 2026-02-17T12:05:38.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.898+0000 7f2484856640 1 -- 10.20.193.51:0/1661174824 wait complete. 2026-02-17T12:05:38.907 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:05:38.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:05:38.907 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 10 monclient: get_monmap_and_config 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 10 monclient: build_initial_monmap 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 10 monclient: monmap: 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:38.975374+0000 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:38.975374+0000 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:38.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 1 Processor -- start 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 1 -- start start 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.974+0000 7f3db7196640 10 monclient: init 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-b con 0x7f3db00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3db00a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3db013b760 0x7f3db013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-c con 0x7f3db013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db006e140 con 0x7f3db00a0750 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3db009f910 con 0x7f3db013b760 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3db009ccd0 con 0x7f3db00a3bb0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db7196640 10 monclient(hunting): authenticate will time out at 1826.594287s 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40524/0 (socket says 10.20.193.51:40524) 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 -- 10.20.193.51:0/3872515759 learned_addr learned my addr 10.20.193.51:0/3872515759 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request con 0x7f3db00a3bb0 auth_method 0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db570c640 1 --2- 10.20.193.51:0/3872515759 >> v2:10.20.193.142:3300/0 conn(0x7f3db013b760 0x7f3db013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db570c640 10 monclient(hunting): get_auth_request con 0x7f3db013b760 auth_method 0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db570c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db570c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db570c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_done global_id 234293 payload 274 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 -- 10.20.193.51:0/3872515759 >> v2:10.20.193.142:3300/0 conn(0x7f3db013b760 msgr2=0x7f3db013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/3872515759 >> v2:10.20.193.142:3300/0 conn(0x7f3db013b760 0x7f3db013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 -- 10.20.193.51:0/3872515759 >> v1:10.20.193.142:6789/0 conn(0x7f3db00a0750 legacy=0x7f3db009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient: _finish_hunting 0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 monclient: found mon.noname-b 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.975+0000 7f3db4f0b640 1 -- 10.20.193.51:0/3872515759 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db009eec0 con 0x7f3db00a3bb0 2026-02-17T12:05:38.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db4f0b640 1 -- 10.20.193.51:0/3872515759 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 msgr2=0x7f3db009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/3872515759 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3db009f230 tx=0x7f3da002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2d18a7acab833 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 1 -- 10.20.193.51:0/3872515759 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da003c070 con 0x7f3db00a3bb0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: dump: 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 1 -- 10.20.193.51:0/3872515759 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da002fcc0 con 0x7f3db00a3bb0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 5 monclient: authenticate success, global_id 234293 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 1 -- 10.20.193.51:0/3872515759 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0037660 con 0x7f3db00a3bb0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 4 set_mon_vals no callback set 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3da77fe640 10 monclient: dump: 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 10 monclient: shutdown 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 -- 10.20.193.51:0/3872515759 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 msgr2=0x7f3db009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 --2- 10.20.193.51:0/3872515759 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3db009f230 tx=0x7f3da002ee80 comp rx=0 tx=0).stop 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 -- 10.20.193.51:0/3872515759 shutdown_connections 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 --2- 10.20.193.51:0/3872515759 >> v2:10.20.193.142:3300/0 conn(0x7f3db013b760 0x7f3db013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 --2- 10.20.193.51:0/3872515759 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db009dac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 -- 10.20.193.51:0/3872515759 >> 10.20.193.51:0/3872515759 conn(0x7f3db00a30c0 msgr2=0x7f3db00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 -- 10.20.193.51:0/3872515759 shutdown_connections 2026-02-17T12:05:38.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.978+0000 7f3db7196640 1 -- 10.20.193.51:0/3872515759 wait complete. 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient: build_initial_monmap 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient: monmap: 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:38.982 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 Processor -- start 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 -- start start 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient: init 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3db00a0750 0x7f3db01cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-b con 0x7f3db00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db01cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-c con 0x7f3db00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db013b760 0x7f3db01d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): picked mon.noname-a con 0x7f3db013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3db00a04b0 con 0x7f3db013b760 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3db009c850 con 0x7f3db00a0750 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3db009e710 con 0x7f3db00a3bb0 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db7196640 10 monclient(hunting): authenticate will time out at 1826.598529s 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db01cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db01cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40532/0 (socket says 10.20.193.51:40532) 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 -- 10.20.193.51:0/500887438 learned_addr learned my addr 10.20.193.51:0/500887438 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): get_auth_request con 0x7f3db00a3bb0 auth_method 0 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db013b760 0x7f3db01d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): get_auth_request con 0x7f3db013b760 auth_method 0 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3db00a0750 0x7f3db01cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request con 0x7f3db00a0750 auth_method 0 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db4f0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db4f0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3db570c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient(hunting): handle_auth_done global_id 234296 payload 824 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3db00a0750 msgr2=0x7f3db01cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3db00a0750 0x7f3db01cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db013b760 msgr2=0x7f3db01d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db013b760 0x7f3db01d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.979+0000 7f3da7fff640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db0098620 con 0x7f3db00a3bb0 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da7fff640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 msgr2=0x7f3db01cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da7fff640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db01cfda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c500 tx=0x7f3d9800c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98012a40 con 0x7f3db00a3bb0 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: dump: 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: _finish_auth 0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: _check_auth_tickets 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d98017070 con 0x7f3db00a3bb0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3db7196640 5 monclient: authenticate success, global_id 234296 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98012e40 con 0x7f3db00a3bb0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da57fa640 10 monclient: dump: 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3da6ffd640 4 set_mon_vals no callback set 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3db7196640 10 monclient: _renew_subs 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3db7196640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.981+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db0098900 con 0x7f3db00a3bb0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 10 monclient: _renew_subs 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db006f6a0 con 0x7f3db00a3bb0 2026-02-17T12:05:38.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 0x7f3db0091ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3db009d7b0 con 0x7f3db0091900 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 0x7f3db0091ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient: get_auth_request con 0x7f3db0091900 auth_method 0 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3d9801c460 con 0x7f3db00a3bb0 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_done global_id 254103 payload 824 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3db4f0b640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3db009dac0 con 0x7f3db0091900 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3da57fa640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d8003dd10 0x7f3d800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.982+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(757..757 src has 323..757) ==== 4751+0+0 (secure 0 0 0) 0x7f3d98052430 con 0x7f3db00a3bb0 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.983+0000 7f3db570c640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d8003dd10 0x7f3d800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.983+0000 7f3db570c640 10 monclient: get_auth_request con 0x7f3d8003dd10 auth_method 0 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.984+0000 7f3db4f0b640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 msgr2=0x7f3db0091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.984+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 0x7f3db0091ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3db0069d60 tx=0x7f3da0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da003c040 con 0x7f3db0091900 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 10 monclient: dump: 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3da0041660 con 0x7f3db0091900 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 msgr2=0x7f3db0091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 0x7f3db0091ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3db0069d60 tx=0x7f3da0004830 comp rx=0 tx=0).stop 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 msgr2=0x7f3db0091ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3da57fa640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0091900 0x7f3db0091ce0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3db0069d60 tx=0x7f3da0004830 comp rx=0 tx=0).stop 2026-02-17T12:05:38.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.985+0000 7f3db570c640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d8003dd10 0x7f3d800401d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3dac003ba0 tx=0x7f3dac009770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db7196640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db7196640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 0x7f3db01daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db7196640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0096b60 con 0x7f3db0092220 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 0x7f3db01daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient: get_auth_request con 0x7f3db0092220 auth_method 0 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 10 monclient(hunting): handle_auth_done global_id 254106 payload 824 2026-02-17T12:05:38.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.988+0000 7f3db4f0b640 1 -- 10.20.193.51:0/500887438 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3db00008d0 con 0x7f3db0092220 2026-02-17T12:05:38.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3db4f0b640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 msgr2=0x7f3db01daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:38.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3db4f0b640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 0x7f3db01daad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3da002eec0 tx=0x7f3da0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da003c040 con 0x7f3db0092220 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3da57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3da57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.990+0000 7f3da57fa640 10 monclient: dump: 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7f3da00423f0 con 0x7f3db0092220 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:38.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 msgr2=0x7f3db01daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 0x7f3db01daad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3da002eec0 tx=0x7f3da0008030 comp rx=0 tx=0).stop 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 msgr2=0x7f3db01daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3da57fa640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3db0092220 0x7f3db01daad0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3da002eec0 tx=0x7f3da0008030 comp rx=0 tx=0).stop 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 13037, 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:38.994 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:38.995 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:38.996 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:38.997 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:38.998 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:38.999 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.000 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:39.001 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:39.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d8003dd10 msgr2=0x7f3d800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3d8003dd10 0x7f3d800401d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3dac003ba0 tx=0x7f3dac009770 comp rx=0 tx=0).stop 2026-02-17T12:05:39.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 10 monclient: shutdown 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 msgr2=0x7f3db01cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 --2- 10.20.193.51:0/500887438 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3db00a3bb0 0x7f3db01cfda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c500 tx=0x7f3d9800c9d0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db570c640 1 -- 10.20.193.51:0/500887438 reap_dead start 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db570c640 1 -- 10.20.193.51:0/500887438 reap_dead start 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 shutdown_connections 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 >> 10.20.193.51:0/500887438 conn(0x7f3db00a30c0 msgr2=0x7f3db013ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 shutdown_connections 2026-02-17T12:05:39.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:38.991+0000 7f3db7196640 1 -- 10.20.193.51:0/500887438 wait complete. 2026-02-17T12:05:39.003 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:39.003 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:05:39.003 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.069+0000 7f63693e7640 10 monclient: get_monmap_and_config 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient: monmap: 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.071 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:39.070999+0000 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:39.070999+0000 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:39.072 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 Processor -- start 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 -- start start 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient: init 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f6364138600 0x7f63641389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-c con 0x7f6364138600 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f63640a35a0 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f63640a5a70 0x7f6364140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-a con 0x7f63640a5a70 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63640a1df0 con 0x7f63640a35a0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f63640a6830 con 0x7f63640a5a70 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f63640a2c00 con 0x7f6364138600 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63693e7640 10 monclient(hunting): authenticate will time out at 1826.689871s 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63627fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f63640a35a0 0x7f63640a5360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44186/0 (socket says 10.20.193.51:44186) 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63627fc640 1 -- 10.20.193.51:0/3954694058 learned_addr learned my addr 10.20.193.51:0/3954694058 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63637fe640 1 --2- 10.20.193.51:0/3954694058 >> v2:10.20.193.51:3300/0 conn(0x7f63640a5a70 0x7f6364140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63637fe640 10 monclient(hunting): get_auth_request con 0x7f63640a5a70 auth_method 0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.070+0000 7f63637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 1 --2- 10.20.193.51:0/3954694058 >> v2:10.20.193.142:3300/0 conn(0x7f6364138600 0x7f63641389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): get_auth_request con 0x7f6364138600 auth_method 0 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient(hunting): handle_auth_done global_id 254109 payload 274 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 1 -- 10.20.193.51:0/3954694058 >> v2:10.20.193.142:3300/0 conn(0x7f6364138600 msgr2=0x7f63641389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 1 --2- 10.20.193.51:0/3954694058 >> v2:10.20.193.142:3300/0 conn(0x7f6364138600 0x7f63641389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 1 -- 10.20.193.51:0/3954694058 >> v1:10.20.193.51:6789/0 conn(0x7f63640a35a0 legacy=0x7f63640a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:39.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.071+0000 7f63637fe640 1 -- 10.20.193.51:0/3954694058 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6364138f20 con 0x7f63640a5a70 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f63637fe640 1 -- 10.20.193.51:0/3954694058 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63640a5a70 msgr2=0x7f6364140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f63637fe640 1 --2- 10.20.193.51:0/3954694058 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63640a5a70 0x7f6364140380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63640ab950 tx=0x7f635402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee11180d904d616 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 1 -- 10.20.193.51:0/3954694058 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635403c070 con 0x7f63640a5a70 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: dump: 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 1 -- 10.20.193.51:0/3954694058 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354037440 con 0x7f63640a5a70 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 1 -- 10.20.193.51:0/3954694058 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037810 con 0x7f63640a5a70 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f63693e7640 5 monclient: authenticate success, global_id 254109 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f63693e7640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f63693e7640 4 set_mon_vals no callback set 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.073+0000 7f6361ffb640 10 monclient: dump: 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.076 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 10 monclient: shutdown 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- 10.20.193.51:0/3954694058 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63640a5a70 msgr2=0x7f6364140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 --2- 10.20.193.51:0/3954694058 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63640a5a70 0x7f6364140380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63640ab950 tx=0x7f635402f130 comp rx=0 tx=0).stop 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- 10.20.193.51:0/3954694058 shutdown_connections 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 --2- 10.20.193.51:0/3954694058 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f63640a5a70 0x7f6364140380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 --2- 10.20.193.51:0/3954694058 >> v2:10.20.193.142:3300/0 conn(0x7f6364138600 0x7f63641389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- 10.20.193.51:0/3954694058 >> 10.20.193.51:0/3954694058 conn(0x7f63640a7460 msgr2=0x7f63640a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- 10.20.193.51:0/3954694058 shutdown_connections 2026-02-17T12:05:39.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- 10.20.193.51:0/3954694058 wait complete. 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 10 monclient: monmap: 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 Processor -- start 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 1 -- start start 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.074+0000 7f63693e7640 10 monclient: init 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63640a35a0 0x7f63641cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-b con 0x7f63640a35a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63640a5a70 0x7f6364136620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-c con 0x7f63640a5a70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:39.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): picked mon.noname-a con 0x7f6364138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f63640a25b0 con 0x7f6364138600 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f63640a22d0 con 0x7f63640a35a0 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f63640a15f0 con 0x7f63640a5a70 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63693e7640 10 monclient(hunting): authenticate will time out at 1826.694049s 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33270/0 (socket says 10.20.193.51:33270) 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 learned_addr learned my addr 10.20.193.51:0/2061395248 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): get_auth_request con 0x7f6364138600 auth_method 0 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63640a5a70 0x7f6364136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): get_auth_request con 0x7f63640a5a70 auth_method 0 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63627fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient(hunting): handle_auth_done global_id 254112 payload 824 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63640a5a70 msgr2=0x7f6364136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63640a5a70 0x7f6364136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63640a35a0 msgr2=0x7f63641cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f63640a35a0 0x7f63641cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:39.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.075+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6364127a60 con 0x7f6364138600 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 msgr2=0x7f6364136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63637fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f635403a040 tx=0x7f6354004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635403c050 con 0x7f6364138600 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: dump: 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354048070 con 0x7f6364138600 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 5 monclient: authenticate success, global_id 254112 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 10 monclient: _renew_subs 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63641261d0 con 0x7f6364138600 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354041c60 con 0x7f6364138600 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63617fa640 4 set_mon_vals no callback set 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63437fe640 10 monclient: dump: 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 10 monclient: _renew_subs 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6364137c70 con 0x7f6364138600 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.077+0000 7f63693e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63693e7640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 0x7f6364124470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f63640a5e80 con 0x7f6364124090 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 0x7f6364124470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient: get_auth_request con 0x7f6364124090 auth_method 0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 10 monclient(hunting): handle_auth_done global_id 234302 payload 824 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6354043450 con 0x7f6364138600 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f6362ffd640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63641cf760 con 0x7f6364124090 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63437fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f633003dd40 0x7f6330040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(757..757 src has 323..757) ==== 4751+0+0 (secure 0 0 0) 0x7f6354077f30 con 0x7f6364138600 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63627fc640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f633003dd40 0x7f6330040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.078+0000 7f63627fc640 10 monclient: get_auth_request con 0x7f633003dd40 auth_method 0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f6362ffd640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 msgr2=0x7f6364124470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f6362ffd640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 0x7f6364124470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f635800edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f6364124090 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 10 monclient: dump: 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f635800cc00 con 0x7f6364124090 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 msgr2=0x7f6364124470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 0x7f6364124470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f635800edb0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 msgr2=0x7f6364124470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.080+0000 7f63437fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f6364124090 0x7f6364124470 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f635800edb0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.081+0000 7f63627fc640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f633003dd40 0x7f6330040200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f634c007d90 tx=0x7f634c007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f63693e7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f63693e7640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 0x7f63641da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f63693e7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6364069780 con 0x7f63641249b0 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 0x7f63641da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient: get_auth_request con 0x7f63641249b0 auth_method 0 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.083+0000 7f6362ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.084+0000 7f6362ffd640 10 monclient(hunting): handle_auth_done global_id 234305 payload 824 2026-02-17T12:05:39.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.084+0000 7f6362ffd640 1 -- 10.20.193.51:0/2061395248 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6364124dc0 con 0x7f63641249b0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f6362ffd640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 msgr2=0x7f63641da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f6362ffd640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 0x7f63641da5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f63580047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f63641249b0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 10 monclient: dump: 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f6358003920 con 0x7f63641249b0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 msgr2=0x7f63641da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 0x7f63641da5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f63580047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 msgr2=0x7f63641da5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63437fe640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f63641249b0 0x7f63641da5d0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f635800e8e0 tx=0x7f63580047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 116081, 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:39.088 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:39.089 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.090 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:39.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:39.092 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f633003dd40 msgr2=0x7f6330040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f633003dd40 0x7f6330040200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f634c007d90 tx=0x7f634c007ce0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 10 monclient: shutdown 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 msgr2=0x7f6364136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f635403a040 tx=0x7f6354004b40 comp rx=0 tx=0).stop 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63637fe640 1 -- 10.20.193.51:0/2061395248 reap_dead start 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 shutdown_connections 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 --2- 10.20.193.51:0/2061395248 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f6364138600 0x7f6364136b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 >> 10.20.193.51:0/2061395248 conn(0x7f63640a7460 msgr2=0x7f63640a9080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 shutdown_connections 2026-02-17T12:05:39.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.086+0000 7f63693e7640 1 -- 10.20.193.51:0/2061395248 wait complete. 2026-02-17T12:05:39.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:39.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:05:39.095 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.158+0000 7fb0cd9a9640 10 monclient: get_monmap_and_config 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.158+0000 7fb0cd9a9640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.158+0000 7fb0cd9a9640 10 monclient: monmap: 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:39.159514+0000 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:39.159514+0000 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.158+0000 7fb0cd9a9640 1 Processor -- start 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 -- start start 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient: init 2026-02-17T12:05:39.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 0x7fb0c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-a con 0x7fb0c80a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-b con 0x7fb0c80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0c809e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c806e140 con 0x7fb0c809e540 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c80a3f90 con 0x7fb0c80a3bb0 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c809f910 con 0x7fb0c80a0750 2026-02-17T12:05:39.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0cd9a9640 10 monclient(hunting): authenticate will time out at 1826.778310s 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 0x7fb0c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 0x7fb0c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33278/0 (socket says 10.20.193.51:33278) 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/3897318470 learned_addr learned my addr 10.20.193.51:0/3897318470 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request con 0x7fb0c80a3bb0 auth_method 0 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): get_auth_request con 0x7fb0c80a0750 auth_method 0 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_done global_id 234308 payload 274 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 -- 10.20.193.51:0/3897318470 >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 msgr2=0x7fb0c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 --2- 10.20.193.51:0/3897318470 >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 0x7fb0c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 -- 10.20.193.51:0/3897318470 >> v1:10.20.193.142:6789/0 conn(0x7fb0c809e540 legacy=0x7fb0c813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 monclient: found mon.noname-b 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.159+0000 7fb0c67fc640 1 -- 10.20.193.51:0/3897318470 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c809ccd0 con 0x7fb0c80a0750 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c67fc640 1 -- 10.20.193.51:0/3897318470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 msgr2=0x7fb0c809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c67fc640 1 --2- 10.20.193.51:0/3897318470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c809e000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0c806c1c0 tx=0x7fb0b002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2b14fbde3131200 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 1 -- 10.20.193.51:0/3897318470 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b003c070 con 0x7fb0c80a0750 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: dump: 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 1 -- 10.20.193.51:0/3897318470 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b002fbd0 con 0x7fb0c80a0750 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 1 -- 10.20.193.51:0/3897318470 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0037440 con 0x7fb0c80a0750 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0c5ffb640 10 monclient: dump: 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.173 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 5 monclient: authenticate success, global_id 234308 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 4 set_mon_vals no callback set 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 10 monclient: shutdown 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/3897318470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 msgr2=0x7fb0c809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/3897318470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c809e000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0c806c1c0 tx=0x7fb0b002ed50 comp rx=0 tx=0).stop 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/3897318470 shutdown_connections 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/3897318470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c809e000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/3897318470 >> v2:10.20.193.51:3300/0 conn(0x7fb0c80a3bb0 0x7fb0c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/3897318470 >> 10.20.193.51:0/3897318470 conn(0x7fb0c80a30c0 msgr2=0x7fb0c80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/3897318470 shutdown_connections 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.162+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/3897318470 wait complete. 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient: monmap: 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:39.174 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 Processor -- start 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 -- start start 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient: init 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 0x7fb0c81381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-a con 0x7fb0c809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c812fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-c con 0x7fb0c80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c80a3bb0 0x7fb0c8130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): picked mon.noname-b con 0x7fb0c80a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80a04b0 con 0x7fb0c809e540 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c809c850 con 0x7fb0c80a3bb0 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c813de80 con 0x7fb0c80a0750 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0cd9a9640 10 monclient(hunting): authenticate will time out at 1826.782601s 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 0x7fb0c81381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c812fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 0x7fb0c81381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33280/0 (socket says 10.20.193.51:33280) 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/395384518 learned_addr learned my addr 10.20.193.51:0/395384518 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request con 0x7fb0c809e540 auth_method 0 2026-02-17T12:05:39.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c812fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40578/0 (socket says 10.20.193.51:40578) 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): get_auth_request con 0x7fb0c80a0750 auth_method 0 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c77fe640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c80a3bb0 0x7fb0c8130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient(hunting): handle_auth_done global_id 234311 payload 824 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c80a3bb0 msgr2=0x7fb0c8130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c80a3bb0 0x7fb0c8130530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 msgr2=0x7fb0c81381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 0x7fb0c81381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 monclient: found mon.noname-c 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c67fc640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c81337a0 con 0x7fb0c80a0750 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c6ffd640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb0c809e540 0x7fb0c81381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:39.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c77fe640 10 monclient: get_auth_request con 0x7fb0c80a3bb0 auth_method 0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.163+0000 7fb0c77fe640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c80a3bb0 0x7fb0c8130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.165+0000 7fb0c67fc640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 msgr2=0x7fb0c812fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.165+0000 7fb0c67fc640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c812fff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0036000 tx=0x7fb0b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0046020 con 0x7fb0c80a0750 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: dump: 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 5 monclient: authenticate success, global_id 234311 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 monclient: _renew_subs 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c8131f10 con 0x7fb0c80a0750 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 monclient: _renew_subs 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0040800 con 0x7fb0c80a0750 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c809d7b0 con 0x7fb0c80a0750 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b003c040 con 0x7fb0c80a0750 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c57fa640 4 set_mon_vals no callback set 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 10 monclient: dump: 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 0x7fb0c8139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c8131a70 con 0x7fb0c8130a70 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb0b003f030 con 0x7fb0c80a0750 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 0x7fb0c8139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient: get_auth_request con 0x7fb0c8130a70 auth_method 0 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb09803dd10 0x7fb0980401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(757..757 src has 323..757) ==== 4751+0+0 (secure 0 0 0) 0x7fb0b00772a0 con 0x7fb0c80a0750 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_done global_id 184666 payload 824 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.166+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0c8130e50 con 0x7fb0c8130a70 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.167+0000 7fb0c77fe640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb09803dd10 0x7fb0980401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.167+0000 7fb0c77fe640 10 monclient: get_auth_request con 0x7fb09803dd10 auth_method 0 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 msgr2=0x7fb0c8139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb0c6ffd640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 0x7fb0c8139960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009fa0 tx=0x7fb0bc00f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc004020 con 0x7fb0c8130a70 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 10 monclient: dump: 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.180 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb0c77fe640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb09803dd10 0x7fb0980401d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800d1a0 tx=0x7fb0b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb0bc004020 con 0x7fb0c8130a70 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 msgr2=0x7fb0c8139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 0x7fb0c8139960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009fa0 tx=0x7fb0bc00f610 comp rx=0 tx=0).stop 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 msgr2=0x7fb0c8139960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.169+0000 7fb09ffff640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8130a70 0x7fb0c8139960 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009fa0 tx=0x7fb0bc00f610 comp rx=0 tx=0).stop 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0cd9a9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 0x7fb0c813a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0cd9a9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c809dac0 con 0x7fb0c8139ea0 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 0x7fb0c813a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient: get_auth_request con 0x7fb0c8139ea0 auth_method 0 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 10 monclient(hunting): handle_auth_done global_id 184669 payload 824 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.172+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/395384518 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0c80008d0 con 0x7fb0c8139ea0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0c6ffd640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 msgr2=0x7fb0c813a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0c6ffd640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 0x7fb0c813a280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc01b000 tx=0x7fb0bc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003cd0 con 0x7fb0c8139ea0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 10 monclient: dump: 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fb0bc003cd0 con 0x7fb0c8139ea0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 msgr2=0x7fb0c813a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 0x7fb0c813a280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc01b000 tx=0x7fb0bc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 msgr2=0x7fb0c813a280 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:39.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb09ffff640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb0c8139ea0 0x7fb0c813a280 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc01b000 tx=0x7fb0bc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 371561, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.183 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:39.184 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.185 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.186 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:39.187 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:39.188 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb09803dd10 msgr2=0x7fb0980401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb09803dd10 0x7fb0980401d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800d1a0 tx=0x7fb0b8009040 comp rx=0 tx=0).stop 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 10 monclient: shutdown 2026-02-17T12:05:39.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 msgr2=0x7fb0c812fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 --2- 10.20.193.51:0/395384518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb0c80a0750 0x7fb0c812fff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0036000 tx=0x7fb0b00047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0c77fe640 1 -- 10.20.193.51:0/395384518 reap_dead start 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0c77fe640 1 -- 10.20.193.51:0/395384518 reap_dead start 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 shutdown_connections 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 >> 10.20.193.51:0/395384518 conn(0x7fb0c80a30c0 msgr2=0x7fb0c80a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 shutdown_connections 2026-02-17T12:05:39.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.175+0000 7fb0cd9a9640 1 -- 10.20.193.51:0/395384518 wait complete. 2026-02-17T12:05:39.190 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:39.190 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:05:39.190 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:05:39.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 10 monclient: get_monmap_and_config 2026-02-17T12:05:39.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 10 monclient: monmap: 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:39.255380+0000 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:39.255380+0000 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 1 Processor -- start 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 1 -- start start 2026-02-17T12:05:39.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.254+0000 7f56a98a0640 10 monclient: init 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-b con 0x7f56a40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f56a40a0750 0x7f56a409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-a con 0x7f56a40a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f56a409e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a406e140 con 0x7f56a409e540 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f56a40a3f90 con 0x7f56a40a0750 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f56a409f910 con 0x7f56a40a3bb0 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a98a0640 10 monclient(hunting): authenticate will time out at 1826.874140s 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40580/0 (socket says 10.20.193.51:40580) 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 -- 10.20.193.51:0/889384176 learned_addr learned my addr 10.20.193.51:0/889384176 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:39.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): get_auth_request con 0x7f56a40a3bb0 auth_method 0 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 1 --2- 10.20.193.51:0/889384176 >> v2:10.20.193.51:3300/0 conn(0x7f56a40a0750 0x7f56a409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): get_auth_request con 0x7f56a40a0750 auth_method 0 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_done global_id 234314 payload 274 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 -- 10.20.193.51:0/889384176 >> v2:10.20.193.51:3300/0 conn(0x7f56a40a0750 msgr2=0x7f56a409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 --2- 10.20.193.51:0/889384176 >> v2:10.20.193.51:3300/0 conn(0x7f56a40a0750 0x7f56a409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 -- 10.20.193.51:0/889384176 >> v1:10.20.193.142:6789/0 conn(0x7f56a409e540 legacy=0x7f56a413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 monclient: found mon.noname-b 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.255+0000 7f56a2ffd640 1 -- 10.20.193.51:0/889384176 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a409ccd0 con 0x7f56a40a3bb0 2026-02-17T12:05:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.257+0000 7f56a2ffd640 1 -- 10.20.193.51:0/889384176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 msgr2=0x7f56a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.257+0000 7f56a2ffd640 1 --2- 10.20.193.51:0/889384176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56a4069d60 tx=0x7f569802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52363b598440dab server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 1 -- 10.20.193.51:0/889384176 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569803c070 con 0x7f56a40a3bb0 2026-02-17T12:05:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: dump: 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 1 -- 10.20.193.51:0/889384176 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569802fcc0 con 0x7f56a40a3bb0 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 5 monclient: authenticate success, global_id 234314 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 1 -- 10.20.193.51:0/889384176 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698037660 con 0x7f56a40a3bb0 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a1ffb640 10 monclient: dump: 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.263 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 4 set_mon_vals no callback set 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 10 monclient: shutdown 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 -- 10.20.193.51:0/889384176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 msgr2=0x7f56a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 --2- 10.20.193.51:0/889384176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56a4069d60 tx=0x7f569802ee80 comp rx=0 tx=0).stop 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 -- 10.20.193.51:0/889384176 shutdown_connections 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 --2- 10.20.193.51:0/889384176 >> v2:10.20.193.51:3300/0 conn(0x7f56a40a0750 0x7f56a409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 --2- 10.20.193.51:0/889384176 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a409dac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 -- 10.20.193.51:0/889384176 >> 10.20.193.51:0/889384176 conn(0x7f56a40a30c0 msgr2=0x7f56a40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 -- 10.20.193.51:0/889384176 shutdown_connections 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 1 -- 10.20.193.51:0/889384176 wait complete. 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 10 monclient: build_initial_monmap 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.258+0000 7f56a98a0640 10 monclient: monmap: 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:39.264 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 Processor -- start 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 -- start start 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient: init 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 0x7f56a4099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-a con 0x7f56a409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f56a40a0750 0x7f56a409a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-b con 0x7f56a40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): picked mon.noname-c con 0x7f56a40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f56a40a04b0 con 0x7f56a409e540 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f56a409c850 con 0x7f56a40a0750 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f56a413de80 con 0x7f56a40a3bb0 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a98a0640 10 monclient(hunting): authenticate will time out at 1826.878326s 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 0x7f56a4099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 0x7f56a4099b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33298/0 (socket says 10.20.193.51:33298) 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40590/0 (socket says 10.20.193.51:40590) 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 1 -- 10.20.193.51:0/227716636 learned_addr learned my addr 10.20.193.51:0/227716636 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): get_auth_request con 0x7f56a409e540 auth_method 0 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): get_auth_request con 0x7f56a40a3bb0 auth_method 0 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient(hunting): handle_auth_done global_id 234317 payload 824 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 -- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f56a40a0750 msgr2=0x7f56a409a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f56a40a0750 0x7f56a409a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 -- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 msgr2=0x7f56a4099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 0x7f56a4099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:39.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.259+0000 7f56a37fe640 1 -- 10.20.193.51:0/227716636 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4092160 con 0x7f56a40a3bb0 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a37fe640 1 -- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 msgr2=0x7f56a408e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a37fe640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f569400be20 tx=0x7f569400bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694006e60 con 0x7f56a40a3bb0 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: dump: 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:39.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5694010070 con 0x7f56a40a3bb0 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569400ce40 con 0x7f56a40a3bb0 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a17fa640 4 set_mon_vals no callback set 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f567bfff640 10 monclient: dump: 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 5 monclient: authenticate success, global_id 234317 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 10 monclient: _renew_subs 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a40905f0 con 0x7f56a40a3bb0 2026-02-17T12:05:39.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 10 monclient: _renew_subs 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.261+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a406f960 con 0x7f56a40a3bb0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a98a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a98a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5694004070 con 0x7f56a40a3bb0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a98a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a406f410 con 0x7f56a40a3bb0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f567bfff640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 0x7f56740401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(757..757 src has 323..757) ==== 4751+0+0 (secure 0 0 0) 0x7f5694052550 con 0x7f56a40a3bb0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a2ffd640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 0x7f56740401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.262+0000 7f56a2ffd640 10 monclient: get_auth_request con 0x7f567403dd10 auth_method 0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.265+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5694014cd0 con 0x7f56a40a3bb0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.265+0000 7f567bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.265+0000 7f567bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:39.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.265+0000 7f56a2ffd640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 0x7f56740401d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5698009730 tx=0x7f5698033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.380+0000 7f56a98a0640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.380+0000 7f56a98a0640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.380+0000 7f56a98a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.380+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f56a409dac0 con 0x7f56a40a3bb0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.381+0000 7f567bfff640 1 -- 10.20.193.51:0/227716636 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f5694050f70 con 0x7f56a40a3bb0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.381+0000 7f567bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.381+0000 7f567bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1239238869,config=692619927,health=4230565447,kv=643764953,logm=1593965644}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=30,config=2,health=11,kv=12,logm=45} crc {auth=2118008914,config=692619927,health=215887143,kv=643764953,logm=2024300687}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1239238869,config=692619927,health=4230565447,kv=643764953,logm=1593965644}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=28,config=2,health=12,kv=10,logm=48} crc {auth=1256736799,config=692619927,health=4230565447,kv=2473509290,logm=1275812546}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3577152529}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1494389212}) 2026-02-17T12:05:39.385 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3577152529}) 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.381+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=588026882}) 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3443594610}) 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=765005479}) 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3443594610}) 2026-02-17T12:05:39.386 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1461131320}) 2026-02-17T12:05:39.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 msgr2=0x7f56740401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 0x7f56740401d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5698009730 tx=0x7f5698033000 comp rx=0 tx=0).stop 2026-02-17T12:05:39.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 10 monclient: shutdown 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 msgr2=0x7f56a408e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f569400be20 tx=0x7f569400bf20 comp rx=0 tx=0).stop 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 shutdown_connections 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f567403dd10 0x7f56740401d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56a40a3bb0 0x7f56a408e6a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f56a40a0750 0x7f56a409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 --2- 10.20.193.51:0/227716636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56a409e540 0x7f56a4099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 >> 10.20.193.51:0/227716636 conn(0x7f56a40a30c0 msgr2=0x7f56a4073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 shutdown_connections 2026-02-17T12:05:39.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:39.382+0000 7f56a98a0640 1 -- 10.20.193.51:0/227716636 wait complete. 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2716399460}) 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1367476811}) 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2716399460}) 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.382+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1041136315}) 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2669371080}) 2026-02-17T12:05:39.396 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=940984820}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2669371080}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2721837247}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953793941}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1658064975}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953793941}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.383+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2229818277}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1480731883}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=950896213}) 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.397 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1480731883}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1380962869}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534128101}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1176727221}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534128101}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=838066209}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4121459049}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1028480745}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.384+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4121459049}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1717782991}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1828099377}) 2026-02-17T12:05:39.398 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=937801814}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1828099377}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1635471863}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3170615534}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=638204482}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3170615534}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.385+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3728503453}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1448343437}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2686428262}) 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.399 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1448343437}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=177405600}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804351707}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1832646946}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804351707}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2258595949}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3911586001}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3403331398}) 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.400 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3911586001}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.386+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=242916344}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516979295}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1811186364}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516979295}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3258018025}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638789958}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2372800573}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638789958}) 2026-02-17T12:05:39.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=769103315}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=342712200}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3028634078}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=342712200}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.387+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3001108673}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504886578}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3577072993}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504886578}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4188572908}) 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800071056}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3806135896}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800071056}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1996800417}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=777731302}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=282993125}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=777731302}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.388+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1149622320}) 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=563845365}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3813030806}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=563845365}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4180979941}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1335403525}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484550094}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1335403525}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3892156252}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887740486}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1488710299}) 2026-02-17T12:05:39.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887740486}) 2026-02-17T12:05:39.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.389+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=810926933}) 2026-02-17T12:05:39.406 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:05:39.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180373037}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3199595342}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180373037}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3038846424}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1261727850}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3743913660}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1261727850}) 2026-02-17T12:05:39.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1429870843}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766743790}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2896156061}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766743790}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.390+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1166325007}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1158797398}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2176715654}) 2026-02-17T12:05:39.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1158797398}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3778829562}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751498293}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1425568710}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751498293}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1919810828}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3710668426}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2522721480}) 2026-02-17T12:05:39.424 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3710668426}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.391+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1372904085}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013857299}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=365403662}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013857299}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.398+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2528594009}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2809118006}) 2026-02-17T12:05:39.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=805374676}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2809118006}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=914112290}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355881209}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4084632936}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355881209}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2984713734}) 2026-02-17T12:05:39.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279753388}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=726079942}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279753388}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.399+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=731031051}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1584915625}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=150479716}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1584915625}) 2026-02-17T12:05:39.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=732743309}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2751930533}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=427362712}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2751930533}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=706962170}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1010919706}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2016058700}) 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1010919706}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.400+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3529516586}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=736762775}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1869112348}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=736762775}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=760751170}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3887788324}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2649033004}) 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3887788324}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3662927258}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3920806997}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3966862891}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3920806997}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.401+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2998864461}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163971361}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3903496421}) 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163971361}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1082405752}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444378707}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1229214357}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444378707}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=897038011}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3054169637}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3605807008}) 2026-02-17T12:05:39.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3054169637}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.402+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=828715829}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2191403439}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2333969386}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2191403439}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=326721542}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1314391261}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1415552463}) 2026-02-17T12:05:39.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1314391261}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=278871001}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5002367}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3365052950}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5002367}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.403+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=847180958}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2494696293}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3693569256}) 2026-02-17T12:05:39.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2494696293}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=126272077}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3952958101}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3179421269}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3952958101}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3851254096}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4153525614}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2409109138}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4153525614}) 2026-02-17T12:05:39.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.404+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1107181265}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3928427652}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3701016905}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3928427652}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2223105611}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1884284789}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=371405933}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1884284789}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3323577932}) 2026-02-17T12:05:39.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2409884898}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3720680555}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2409884898}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.405+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3265179205}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109670742}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2860561008}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109670742}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3775614743}) 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.436 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2302985051}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1363512821}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2302985051}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3198523809}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2363677286}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4050870925}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2363677286}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.406+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2780877120}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3992440759}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=159905925}) 2026-02-17T12:05:39.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3992440759}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1788177014}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486694716}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4256037426}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486694716}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=776732156}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1505430761}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2475537082}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1505430761}) 2026-02-17T12:05:39.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.407+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1275262954}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3063336096}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1999567465}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3063336096}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3862837650}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=984700165}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3898814245}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=984700165}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=502633079}) 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990784716}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=349102788}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990784716}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.408+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1536508469}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253015814}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=395196025}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253015814}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1535406288}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3195079998}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2720977513}) 2026-02-17T12:05:39.440 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3195079998}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2159045472}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1390932548}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4073030166}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1390932548}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.409+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1686953046}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3959642287}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1364467242}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3959642287}) 2026-02-17T12:05:39.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1371263441}) 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2774658930}) 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1639102212}) 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2774658930}) 2026-02-17T12:05:39.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.410+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=401958501}) 2026-02-17T12:05:39.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1573759491}) 2026-02-17T12:05:39.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=177437540}) 2026-02-17T12:05:39.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1573759491}) 2026-02-17T12:05:39.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.590+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2455239527}) 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526311786}) 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2109943194}) 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526311786}) 2026-02-17T12:05:39.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.595+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2908422005}) 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=84836045}) 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1910978471}) 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=84836045}) 2026-02-17T12:05:39.653 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.651+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3978491125}) 2026-02-17T12:05:39.656 INFO:tasks.rados.rados.0.trial142.stdout:3346: done (0 left) 2026-02-17T12:05:39.656 INFO:tasks.rados.rados.0.trial142.stdout:3347: snap_create 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830348742}) 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4189981757}) 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830348742}) 2026-02-17T12:05:39.657 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.655+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=540457899}) 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514679554}) 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2232725640}) 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514679554}) 2026-02-17T12:05:39.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.662+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3521828586}) 2026-02-17T12:05:40.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335798773}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3795495041}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335798773}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2942001711}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2781152320}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=258737263}) 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2781152320}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.994+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1889022353}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2171671392}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3555233324}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2171671392}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3636040296}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248521242}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1642117119}) 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248521242}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4045990036}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801635287}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=418389091}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801635287}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.995+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=823804334}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2831458554}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2117050080}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2831458554}) 2026-02-17T12:05:40.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1593696098}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947317687}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3145496992}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947317687}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=831311166}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=347342535}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2856101834}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=347342535}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.996+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4067623250}) 2026-02-17T12:05:40.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=829983756}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3599321174}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=829983756}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1288649024}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1579386866}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2784709783}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1579386866}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3265922727}) 2026-02-17T12:05:40.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3135202150}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1152123018}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3135202150}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484269328}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2199130458}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1578016467}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2199130458}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.997+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2876655615}) 2026-02-17T12:05:40.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2787842199}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2908825943}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2787842199}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=21987748}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574568848}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2800374197}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574568848}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2952456850}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1584397869}) 2026-02-17T12:05:40.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3593273282}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1584397869}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.998+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2066757970}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257185306}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1807116054}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257185306}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=979044907}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1382492847}) 2026-02-17T12:05:40.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3463738006}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1382492847}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2613680302}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=232707747}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=701153740}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=232707747}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2399151433}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2087444425}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3844409246}) 2026-02-17T12:05:40.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2087444425}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:39.999+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=572141956}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4173520504}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4125403074}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4173520504}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3296891407}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635762632}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=588432488}) 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635762632}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2088249579}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1207114584}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2270144360}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1207114584}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.000+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2011252304}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545664376}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1201501507}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545664376}) 2026-02-17T12:05:40.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1600053764}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2117543703}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=687916054}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2117543703}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2039911232}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=736908830}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3607600832}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=736908830}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.001+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=298870050}) 2026-02-17T12:05:40.023 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2218994156}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=172278265}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2218994156}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=998445815}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1618053113}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2339828783}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1618053113}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=992596592}) 2026-02-17T12:05:40.024 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1731405157}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=617374001}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1731405157}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3733524528}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470394452}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3917946322}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470394452}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.002+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=479839226}) 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.025 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=66,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=1} crc {logm=2211091970,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=778089445,mon_config_key=3390328712,monmap=2917003991}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=69,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=11} crc {logm=2932504513,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=111140517,mon_config_key=1983055269}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=66,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=1} crc {logm=2211091970,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=778089445,mon_config_key=3390328712,monmap=2917003991}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=13,monmap=2,osd_metadata=1} crc {logm=979808021,mdsmap=3207544932,mgr=2354395410,mgr_metadata=3312392843,mgrstat=3884217839,mon_config_key=3390328712,monmap=1614227248,osd_metadata=384969676}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=92} crc {monmap=3140514009,osd_metadata=3812721542,osd_pg_creating=269710225,osd_snap=3643635837}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=92} crc {monmap=3140514009,osd_metadata=3812721542,osd_pg_creating=269710225,osd_snap=3932093555}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=92} crc {monmap=3140514009,osd_metadata=3812721542,osd_pg_creating=269710225,osd_snap=3643635837}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=91} crc {monmap=3140514009,osd_metadata=3956758304,osd_pg_creating=269710225,osd_snap=3077944495}) 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.026 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=35,osdmap=65} crc {osd_snap=2714377658,osdmap=2510648793}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=37,osdmap=63} crc {osd_snap=3689187868,osdmap=3669117612}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=35,osdmap=65} crc {osd_snap=2714377658,osdmap=2510648793}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.003+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=36,osdmap=64} crc {osd_snap=3575144843,osdmap=1143982367}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3023092154}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2550290302}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3023092154}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1376542604}) 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.027 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=607177011}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1566944891}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=607177011}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2844543805}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3116763706}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1852238594}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3116763706}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.004+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2120116308}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4257798072}) 2026-02-17T12:05:40.028 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=273283679}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4257798072}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3666089072}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1342146167}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3513026402}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1342146167}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.005+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=479796029}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=60} crc {osdmap=3023718034}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=2214842081}) 2026-02-17T12:05:40.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:05:40.030 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=60} crc {osdmap=3023718034}) 2026-02-17T12:05:40.030 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:05:40.008+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=61} crc {osdmap=1431553657}) 2026-02-17T12:05:40.407 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:05:40.407 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:40.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.473+0000 7face8ce8640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.473+0000 7face8ce8640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient: monmap: 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:40.474965+0000 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:40.474965+0000 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:40.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 Processor -- start 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 -- start start 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient: init 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7face40a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7face40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7face413c770 0x7face413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-c con 0x7face413c770 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face409e8e0 con 0x7face40a0750 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face406e140 con 0x7face40a3bb0 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7face409f910 con 0x7face413c770 2026-02-17T12:05:40.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face8ce8640 10 monclient(hunting): authenticate will time out at 1828.093706s 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face1d74640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7face40a0750 0x7face409e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44190/0 (socket says 10.20.193.51:44190) 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face1d74640 1 -- 10.20.193.51:0/1532922351 learned_addr learned my addr 10.20.193.51:0/1532922351 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face2d76640 1 --2- 10.20.193.51:0/1532922351 >> v2:10.20.193.142:3300/0 conn(0x7face413c770 0x7face413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face2d76640 10 monclient(hunting): get_auth_request con 0x7face413c770 auth_method 0 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.474+0000 7face2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient(hunting): handle_auth_done global_id 184672 payload 274 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 1 -- 10.20.193.51:0/1532922351 >> v1:10.20.193.142:6789/0 conn(0x7face40a3bb0 legacy=0x7face409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 1 -- 10.20.193.51:0/1532922351 >> v1:10.20.193.51:6789/0 conn(0x7face40a0750 legacy=0x7face409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 1 monclient: found mon.noname-c 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:05:40.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.475+0000 7face2d76640 1 -- 10.20.193.51:0/1532922351 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face409ccd0 con 0x7face413c770 2026-02-17T12:05:40.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face2d76640 1 -- 10.20.193.51:0/1532922351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face413c770 msgr2=0x7face413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face2d76640 1 --2- 10.20.193.51:0/1532922351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face413c770 0x7face413eb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d90 tx=0x7facd402f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10574c48654578df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face1573640 1 -- 10.20.193.51:0/1532922351 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd403c070 con 0x7face413c770 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.477+0000 7face1573640 10 monclient: dump: 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 5 monclient: authenticate success, global_id 184672 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 1 -- 10.20.193.51:0/1532922351 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4037640 con 0x7face413c770 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 1 -- 10.20.193.51:0/1532922351 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4037a10 con 0x7face413c770 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face1573640 10 monclient: dump: 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 4 set_mon_vals no callback set 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 10 monclient: shutdown 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 -- 10.20.193.51:0/1532922351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face413c770 msgr2=0x7face413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 --2- 10.20.193.51:0/1532922351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face413c770 0x7face413eb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d90 tx=0x7facd402f190 comp rx=0 tx=0).stop 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 -- 10.20.193.51:0/1532922351 shutdown_connections 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 --2- 10.20.193.51:0/1532922351 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face413c770 0x7face413eb60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 -- 10.20.193.51:0/1532922351 >> 10.20.193.51:0/1532922351 conn(0x7face40a30c0 msgr2=0x7face40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 -- 10.20.193.51:0/1532922351 shutdown_connections 2026-02-17T12:05:40.481 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 1 -- 10.20.193.51:0/1532922351 wait complete. 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.478+0000 7face8ce8640 10 monclient: monmap: 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 Processor -- start 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 -- start start 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient: init 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face40a0750 0x7face41d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-b con 0x7face40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.483 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-a con 0x7face40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 0x7face4093ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): picked mon.noname-c con 0x7face413c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7face409c850 con 0x7face40a3bb0 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7face409ebe0 con 0x7face40a0750 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7face40a04b0 con 0x7face413c770 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face8ce8640 10 monclient(hunting): authenticate will time out at 1828.098376s 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33310/0 (socket says 10.20.193.51:33310) 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 1 -- 10.20.193.51:0/3469612613 learned_addr learned my addr 10.20.193.51:0/3469612613 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): get_auth_request con 0x7face40a3bb0 auth_method 0 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 0x7face4093ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): get_auth_request con 0x7face413c770 auth_method 0 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.484 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2575640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face40a0750 0x7face41d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2575640 10 monclient(hunting): get_auth_request con 0x7face40a0750 auth_method 0 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient(hunting): handle_auth_done global_id 234320 payload 824 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 -- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face40a0750 msgr2=0x7face41d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face40a0750 0x7face41d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 -- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 msgr2=0x7face41d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 monclient: found mon.noname-c 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face2d76640 1 -- 10.20.193.51:0/3469612613 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face4097e60 con 0x7face413c770 2026-02-17T12:05:40.485 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.479+0000 7face1d74640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face2d76640 1 -- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 msgr2=0x7face4093ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face2d76640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 0x7face4093ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facd4036000 tx=0x7facd4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4047020 con 0x7face413c770 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: dump: 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.486 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4042880 con 0x7face413c770 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd403c040 con 0x7face413c770 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7faccaffd640 10 monclient: dump: 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face0d72640 4 set_mon_vals no callback set 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face8ce8640 5 monclient: authenticate success, global_id 234320 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face8ce8640 10 monclient: _renew_subs 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face8ce8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.481+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face413ecd0 con 0x7face413c770 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 10 monclient: _renew_subs 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7face4095b70 con 0x7face413c770 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face409dac0 con 0x7face413c770 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7facd40374c0 con 0x7face413c770 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7faccaffd640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 0x7facb00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.482+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(758..758 src has 323..758) ==== 4795+0+0 (secure 0 0 0) 0x7facd4078540 con 0x7face413c770 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.483+0000 7face2575640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 0x7facb00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.483+0000 7face2575640 10 monclient: get_auth_request con 0x7facb003dd10 auth_method 0 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.485+0000 7face2575640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 0x7facb00401d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7facd8005020 tx=0x7facd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.485+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7facd4051030 con 0x7face413c770 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.485+0000 7faccaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.485+0000 7faccaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7face8ce8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7face8ce8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7face8ce8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7face413d700 con 0x7face413c770 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7faccaffd640 1 -- 10.20.193.51:0/3469612613 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7facd4036e20 con 0x7face413c770 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7faccaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.601+0000 7faccaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 msgr2=0x7facb00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 0x7facb00401d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7facd8005020 tx=0x7facd8009040 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 10 monclient: shutdown 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 msgr2=0x7face4093ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 0x7face4093ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facd4036000 tx=0x7facd4004b40 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 shutdown_connections 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7facb003dd10 0x7facb00401d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7face413c770 0x7face4093ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7face40a3bb0 0x7face41d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 --2- 10.20.193.51:0/3469612613 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7face40a0750 0x7face41d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 >> 10.20.193.51:0/3469612613 conn(0x7face40a30c0 msgr2=0x7face413bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 shutdown_connections 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.602+0000 7face8ce8640 1 -- 10.20.193.51:0/3469612613 wait complete. 2026-02-17T12:05:40.611 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:05:40.611 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:05:40.611 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:05:40.612 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:05:40.656 INFO:tasks.rados.rados.0.trial142.stdout:3347: done (0 left) 2026-02-17T12:05:40.656 INFO:tasks.rados.rados.0.trial142.stdout:3348: snap_create 2026-02-17T12:05:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.678+0000 7f80555fb640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.678+0000 7f80555fb640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.678+0000 7f80555fb640 10 monclient: monmap: 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:40.679848+0000 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:40.679848+0000 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.706 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 Processor -- start 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 -- start start 2026-02-17T12:05:40.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient: init 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f80500a3bb0 0x7f805009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-a con 0x7f80500a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-b con 0x7f80500a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f805009e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:40.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f805006e140 con 0x7f805009e540 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f80500a3f90 con 0x7f80500a3bb0 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f805009f910 con 0x7f80500a0750 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f80555fb640 10 monclient(hunting): authenticate will time out at 1828.298755s 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40614/0 (socket says 10.20.193.51:40614) 2026-02-17T12:05:40.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 -- 10.20.193.51:0/2703450864 learned_addr learned my addr 10.20.193.51:0/2703450864 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): get_auth_request con 0x7f80500a0750 auth_method 0 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 1 --2- 10.20.193.51:0/2703450864 >> v2:10.20.193.51:3300/0 conn(0x7f80500a3bb0 0x7f805009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): get_auth_request con 0x7f80500a3bb0 auth_method 0 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 10 monclient(hunting): handle_auth_done global_id 234323 payload 274 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 -- 10.20.193.51:0/2703450864 >> v2:10.20.193.51:3300/0 conn(0x7f80500a3bb0 msgr2=0x7f805009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 --2- 10.20.193.51:0/2703450864 >> v2:10.20.193.51:3300/0 conn(0x7f80500a3bb0 0x7f805009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.679+0000 7f804e7fc640 1 -- 10.20.193.51:0/2703450864 >> v1:10.20.193.142:6789/0 conn(0x7f805009e540 legacy=0x7f805013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.680+0000 7f804e7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.680+0000 7f804e7fc640 1 monclient: found mon.noname-b 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.680+0000 7f804e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.680+0000 7f804e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.680+0000 7f804e7fc640 1 -- 10.20.193.51:0/2703450864 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805009ccd0 con 0x7f80500a0750 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804e7fc640 1 -- 10.20.193.51:0/2703450864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 msgr2=0x7f805009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804e7fc640 1 --2- 10.20.193.51:0/2703450864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f805006c1c0 tx=0x7f803802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ec1f55aa49fe51a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 1 -- 10.20.193.51:0/2703450864 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803803c070 con 0x7f80500a0750 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:40.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: dump: 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 1 -- 10.20.193.51:0/2703450864 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803802fcc0 con 0x7f80500a0750 2026-02-17T12:05:40.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 1 -- 10.20.193.51:0/2703450864 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037660 con 0x7f80500a0750 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f804dffb640 10 monclient: dump: 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 5 monclient: authenticate success, global_id 234323 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 4 set_mon_vals no callback set 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 10 monclient: shutdown 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 1 -- 10.20.193.51:0/2703450864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 msgr2=0x7f805009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.682+0000 7f80555fb640 1 --2- 10.20.193.51:0/2703450864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f805006c1c0 tx=0x7f803802ee80 comp rx=0 tx=0).stop 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- 10.20.193.51:0/2703450864 shutdown_connections 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 --2- 10.20.193.51:0/2703450864 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a0750 0x7f805009e000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 --2- 10.20.193.51:0/2703450864 >> v2:10.20.193.51:3300/0 conn(0x7f80500a3bb0 0x7f805009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- 10.20.193.51:0/2703450864 >> 10.20.193.51:0/2703450864 conn(0x7f80500a30c0 msgr2=0x7f80500a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- 10.20.193.51:0/2703450864 shutdown_connections 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- 10.20.193.51:0/2703450864 wait complete. 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient: monmap: 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.714 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 Processor -- start 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- start start 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient: init 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-a con 0x7f805009e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:40.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80500a0750 0x7f805008ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-b con 0x7f80500a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a3bb0 0x7f805008f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): picked mon.noname-c con 0x7f80500a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f80500a04b0 con 0x7f805009e540 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f805009c850 con 0x7f80500a0750 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f805013de80 con 0x7f80500a3bb0 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.683+0000 7f80555fb640 10 monclient(hunting): authenticate will time out at 1828.302987s 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a3bb0 0x7f805008f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33318/0 (socket says 10.20.193.51:33318) 2026-02-17T12:05:40.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 -- 10.20.193.51:0/3478816807 learned_addr learned my addr 10.20.193.51:0/3478816807 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): get_auth_request con 0x7f805009e540 auth_method 0 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): get_auth_request con 0x7f80500a3bb0 auth_method 0 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804e7fc640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80500a0750 0x7f805008ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804e7fc640 10 monclient(hunting): get_auth_request con 0x7f80500a0750 auth_method 0 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient(hunting): handle_auth_done global_id 254133 payload 824 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a3bb0 msgr2=0x7f805008f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a3bb0 0x7f805008f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80500a0750 msgr2=0x7f805008ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f80500a0750 0x7f805008ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804effd640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80500920d0 con 0x7f805009e540 2026-02-17T12:05:40.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.684+0000 7f804f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f80500a3bb0 0x7f805008f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f804effd640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 msgr2=0x7f805008e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f804effd640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f804400ebe0 tx=0x7f804400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8044017070 con 0x7f805009e540 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804400cdf0 con 0x7f805009e540 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80440136b0 con 0x7f805009e540 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 5 monclient: authenticate success, global_id 254133 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 monclient: _renew_subs 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f804d7fa640 4 set_mon_vals no callback set 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80500923b0 con 0x7f805009e540 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.720 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 monclient: _renew_subs 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805009d7b0 con 0x7f805009e540 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 0x7f80501cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.686+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f805009dac0 con 0x7f80501ccf50 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 0x7f80501cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient: get_auth_request con 0x7f80501ccf50 auth_method 0 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 10 monclient(hunting): handle_auth_done global_id 254136 payload 824 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8044024060 con 0x7f805009e540 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804e7fc640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8050091070 con 0x7f80501ccf50 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f802f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f801c03dd10 0x7f801c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7f8044052790 con 0x7f805009e540 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f801c03dd10 0x7f801c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.687+0000 7f804f7fe640 10 monclient: get_auth_request con 0x7f801c03dd10 auth_method 0 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f804e7fc640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 msgr2=0x7f80501cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f804e7fc640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 0x7f80501cd330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f805009f230 tx=0x7f8038004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803803c040 con 0x7f80501ccf50 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8038037d70 con 0x7f80501ccf50 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 msgr2=0x7f80501cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 0x7f80501cd330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f805009f230 tx=0x7f8038004830 comp rx=0 tx=0).stop 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 msgr2=0x7f80501cd330 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.689+0000 7f802f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501ccf50 0x7f80501cd330 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f805009f230 tx=0x7f8038004830 comp rx=0 tx=0).stop 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.690+0000 7f804f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f801c03dd10 0x7f801c0401d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8040009fd0 tx=0x7f804000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f80555fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f80555fb640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 0x7f80501d82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f80555fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f80500008d0 con 0x7f80501cd870 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 0x7f80501d82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient: get_auth_request con 0x7f80501cd870 auth_method 0 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.692+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.693+0000 7f804e7fc640 10 monclient(hunting): handle_auth_done global_id 254139 payload 824 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.693+0000 7f804e7fc640 1 -- 10.20.193.51:0/3478816807 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8050050ac0 con 0x7f80501cd870 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f804e7fc640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 msgr2=0x7f80501d82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f804e7fc640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 0x7f80501d82a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8038002410 tx=0x7f80380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038053070 con 0x7f80501cd870 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 10 monclient: dump: 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7f803804cb70 con 0x7f80501cd870 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 msgr2=0x7f80501d82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 0x7f80501d82a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8038002410 tx=0x7f80380047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 msgr2=0x7f80501d82a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f802f7fe640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f80501cd870 0x7f80501d82a0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8038002410 tx=0x7f80380047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 14742, 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:40.726 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:40.727 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:40.728 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.729 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.730 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.731 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.732 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.733 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:40.734 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:40.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f801c03dd10 msgr2=0x7f801c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f801c03dd10 0x7f801c0401d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8040009fd0 tx=0x7f804000d040 comp rx=0 tx=0).stop 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 10 monclient: shutdown 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 msgr2=0x7f805008e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f804f7fe640 1 -- 10.20.193.51:0/3478816807 reap_dead start 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f804400ebe0 tx=0x7f804400c520 comp rx=0 tx=0).stop 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 shutdown_connections 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 --2- 10.20.193.51:0/3478816807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f805009e540 0x7f805008e6a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 >> 10.20.193.51:0/3478816807 conn(0x7f80500a30c0 msgr2=0x7f8050073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 shutdown_connections 2026-02-17T12:05:40.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.695+0000 7f80555fb640 1 -- 10.20.193.51:0/3478816807 wait complete. 2026-02-17T12:05:40.735 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:40.735 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:05:40.735 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:40.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.800+0000 7fb8d90c7640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.800+0000 7fb8d90c7640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.800+0000 7fb8d90c7640 10 monclient: monmap: 2026-02-17T12:05:40.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.802 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:40.801689+0000 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:40.801689+0000 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:40.803 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 Processor -- start 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 -- start start 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient: init 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb8d40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8d409dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb8d40a02e0 0x7fb8d413d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-a con 0x7fb8d40a02e0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d406e140 con 0x7fb8d40a3bb0 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d409ce60 con 0x7fb8d409dac0 2026-02-17T12:05:40.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d409aed0 con 0x7fb8d40a02e0 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d90c7640 10 monclient(hunting): authenticate will time out at 1828.420456s 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb8d40a02e0 0x7fb8d413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d2d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb8d40a3bb0 0x7fb8d409f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44202/0 (socket says 10.20.193.51:44202) 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d2d76640 1 -- 10.20.193.51:0/2912900602 learned_addr learned my addr 10.20.193.51:0/2912900602 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): get_auth_request con 0x7fb8d40a02e0 auth_method 0 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient(hunting): handle_auth_done global_id 254142 payload 274 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 1 -- 10.20.193.51:0/2912900602 >> v1:10.20.193.142:6789/0 conn(0x7fb8d409dac0 legacy=0x7fb8d409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 1 -- 10.20.193.51:0/2912900602 >> v1:10.20.193.51:6789/0 conn(0x7fb8d40a3bb0 legacy=0x7fb8d409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.801+0000 7fb8d3577640 1 -- 10.20.193.51:0/2912900602 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d409a5c0 con 0x7fb8d40a02e0 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d3577640 1 -- 10.20.193.51:0/2912900602 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d40a02e0 msgr2=0x7fb8d413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d3577640 1 --2- 10.20.193.51:0/2912900602 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d40a02e0 0x7fb8d413d770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009d90 tx=0x7fb8c4031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c91338f6f5cab1e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 1 -- 10.20.193.51:0/2912900602 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c403e070 con 0x7fb8d40a02e0 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: dump: 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 1 -- 10.20.193.51:0/2912900602 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c4007740 con 0x7fb8d40a02e0 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 5 monclient: authenticate success, global_id 254142 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 1 -- 10.20.193.51:0/2912900602 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4007b10 con 0x7fb8d40a02e0 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 4 set_mon_vals no callback set 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d1d74640 10 monclient: dump: 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.813 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 10 monclient: shutdown 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 -- 10.20.193.51:0/2912900602 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d40a02e0 msgr2=0x7fb8d413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/2912900602 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d40a02e0 0x7fb8d413d770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009d90 tx=0x7fb8c4031420 comp rx=0 tx=0).stop 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 -- 10.20.193.51:0/2912900602 shutdown_connections 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/2912900602 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d40a02e0 0x7fb8d413d770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 -- 10.20.193.51:0/2912900602 >> 10.20.193.51:0/2912900602 conn(0x7fb8d40a30c0 msgr2=0x7fb8d40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 -- 10.20.193.51:0/2912900602 shutdown_connections 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.804+0000 7fb8d90c7640 1 -- 10.20.193.51:0/2912900602 wait complete. 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient: monmap: 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.814 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 Processor -- start 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 -- start start 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient: init 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-a con 0x7fb8d409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8d40a02e0 0x7fb8d4095470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-b con 0x7fb8d40a02e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d40a3bb0 0x7fb8d40959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): picked mon.noname-c con 0x7fb8d40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d40a3f90 con 0x7fb8d409dac0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d409caa0 con 0x7fb8d40a02e0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d409e370 con 0x7fb8d40a3bb0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d90c7640 10 monclient(hunting): authenticate will time out at 1828.424523s 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d40a3bb0 0x7fb8d40959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33336/0 (socket says 10.20.193.51:33336) 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d40a3bb0 0x7fb8d40959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40630/0 (socket says 10.20.193.51:40630) 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 -- 10.20.193.51:0/3419386862 learned_addr learned my addr 10.20.193.51:0/3419386862 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): get_auth_request con 0x7fb8d409dac0 auth_method 0 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): get_auth_request con 0x7fb8d40a3bb0 auth_method 0 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8d40a02e0 0x7fb8d4095470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient(hunting): handle_auth_done global_id 254145 payload 824 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d40a3bb0 msgr2=0x7fb8d40959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d40a3bb0 0x7fb8d40959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8d40a02e0 msgr2=0x7fb8d4095470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8d40a02e0 0x7fb8d4095470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2d76640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d4098500 con 0x7fb8d409dac0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2575640 10 monclient: get_auth_request con 0x7fb8d40a02e0 auth_method 0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.805+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8d40a02e0 0x7fb8d4095470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.807+0000 7fb8d2d76640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 msgr2=0x7fb8d4094f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.807+0000 7fb8d2d76640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c700 tx=0x7fb8c800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8005de0 con 0x7fb8d409dac0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: dump: 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.818 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8007070 con 0x7fb8d409dac0 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 5 monclient: authenticate success, global_id 254145 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8007440 con 0x7fb8d409dac0 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d1573640 4 set_mon_vals no callback set 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 10 monclient: dump: 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.819 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 monclient: _renew_subs 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d4096f50 con 0x7fb8d409dac0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 monclient: _renew_subs 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d40a1170 con 0x7fb8d409dac0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 0x7fb8d408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d40a2790 con 0x7fb8d408d3f0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb8c8007620 con 0x7fb8d409dac0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 0x7fb8d408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient: get_auth_request con 0x7fb8d408d3f0 auth_method 0 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 10 monclient(hunting): handle_auth_done global_id 234332 payload 824 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8a003dd10 0x7fb8a00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8d2575640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8d409d7b0 con 0x7fb8d408d3f0 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.808+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7fb8c8052380 con 0x7fb8d409dac0 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.809+0000 7fb8d3577640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8a003dd10 0x7fb8a00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.809+0000 7fb8d3577640 10 monclient: get_auth_request con 0x7fb8a003dd10 auth_method 0 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8d2575640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 msgr2=0x7fb8d408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 0x7fb8d408d7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc00dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc016020 con 0x7fb8d408d3f0 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 10 monclient: dump: 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.823 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb8bc005460 con 0x7fb8d408d3f0 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 msgr2=0x7fb8d408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 0x7fb8d408d7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc00dbc0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 msgr2=0x7fb8d408d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8b37fe640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408d3f0 0x7fb8d408d7d0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc00dbc0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.811+0000 7fb8d3577640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8a003dd10 0x7fb8a00401d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb8d406c1c0 tx=0x7fb8c400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d90c7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 0x7fb8d41d9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d90c7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d409e740 con 0x7fb8d408dd10 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 0x7fb8d41d9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient: get_auth_request con 0x7fb8d408dd10 auth_method 0 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 10 monclient(hunting): handle_auth_done global_id 234335 payload 824 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.814+0000 7fb8d2575640 1 -- 10.20.193.51:0/3419386862 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8d4098740 con 0x7fb8d408dd10 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.816+0000 7fb8d2575640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 msgr2=0x7fb8d41d9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d2575640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 0x7fb8d41d9980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc016030 con 0x7fb8d408dd10 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 10 monclient: dump: 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7fb8bc00b720 con 0x7fb8d408dd10 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 msgr2=0x7fb8d41d9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 0x7fb8d41d9980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc003860 comp rx=0 tx=0).stop 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 msgr2=0x7fb8d41d9980 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8b37fe640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8d408dd10 0x7fb8d41d9980 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d6f0 tx=0x7fb8bc003860 comp rx=0 tx=0).stop 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 117812, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:40.827 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.828 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.829 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.830 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:40.831 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.832 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.833 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.834 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.835 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:40.836 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.836 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.836 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.836 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:40.836 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8a003dd10 msgr2=0x7fb8a00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8a003dd10 0x7fb8a00401d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb8d406c1c0 tx=0x7fb8c400d040 comp rx=0 tx=0).stop 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 10 monclient: shutdown 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 msgr2=0x7fb8d4094f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c700 tx=0x7fb8c800cbd0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d3577640 1 -- 10.20.193.51:0/3419386862 reap_dead start 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 shutdown_connections 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 --2- 10.20.193.51:0/3419386862 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8d409dac0 0x7fb8d4094f30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 >> 10.20.193.51:0/3419386862 conn(0x7fb8d40a30c0 msgr2=0x7fb8d4071420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 shutdown_connections 2026-02-17T12:05:40.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.817+0000 7fb8d90c7640 1 -- 10.20.193.51:0/3419386862 wait complete. 2026-02-17T12:05:40.838 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:40.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:05:40.838 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.903+0000 7f6619953640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.903+0000 7f6619953640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.903+0000 7f6619953640 10 monclient: monmap: 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:40.904702+0000 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:40.904702+0000 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 Processor -- start 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 -- start start 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient: init 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f66140a3bb0 0x7f661409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): picked mon.noname-a con 0x7f66140a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f66140a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f661413b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661406e140 con 0x7f66140a0750 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661409f910 con 0x7f661413b760 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f661409ccd0 con 0x7f66140a3bb0 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6619953640 10 monclient(hunting): authenticate will time out at 1828.523457s 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f66140a3bb0 0x7f661409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f66127fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f66140a0750 0x7f661409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44208/0 (socket says 10.20.193.51:44208) 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f66127fc640 1 -- 10.20.193.51:0/3945101187 learned_addr learned my addr 10.20.193.51:0/3945101187 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): get_auth_request con 0x7f66140a3bb0 auth_method 0 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient(hunting): handle_auth_done global_id 254148 payload 274 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 1 -- 10.20.193.51:0/3945101187 >> v1:10.20.193.142:6789/0 conn(0x7f661413b760 legacy=0x7f661413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 1 -- 10.20.193.51:0/3945101187 >> v1:10.20.193.51:6789/0 conn(0x7f66140a0750 legacy=0x7f661409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.904+0000 7f6612ffd640 1 -- 10.20.193.51:0/3945101187 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661409eec0 con 0x7f66140a3bb0 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6612ffd640 1 -- 10.20.193.51:0/3945101187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f66140a3bb0 msgr2=0x7f661409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6612ffd640 1 --2- 10.20.193.51:0/3945101187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f66140a3bb0 0x7f661409dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66080098a0 tx=0x7f660802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf1e62d66b69377 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 1 -- 10.20.193.51:0/3945101187 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660803c070 con 0x7f66140a3bb0 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: dump: 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 1 -- 10.20.193.51:0/3945101187 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660802fce0 con 0x7f66140a3bb0 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 5 monclient: authenticate success, global_id 254148 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 1 -- 10.20.193.51:0/3945101187 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608037660 con 0x7f66140a3bb0 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 4 set_mon_vals no callback set 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6611ffb640 10 monclient: dump: 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 10 monclient: shutdown 2026-02-17T12:05:40.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 -- 10.20.193.51:0/3945101187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f66140a3bb0 msgr2=0x7f661409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 --2- 10.20.193.51:0/3945101187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f66140a3bb0 0x7f661409dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66080098a0 tx=0x7f660802ed80 comp rx=0 tx=0).stop 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 -- 10.20.193.51:0/3945101187 shutdown_connections 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 --2- 10.20.193.51:0/3945101187 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f66140a3bb0 0x7f661409dac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 -- 10.20.193.51:0/3945101187 >> 10.20.193.51:0/3945101187 conn(0x7f66140a30c0 msgr2=0x7f66140a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 -- 10.20.193.51:0/3945101187 shutdown_connections 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.907+0000 7f6619953640 1 -- 10.20.193.51:0/3945101187 wait complete. 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient: monmap: 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:40.921 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 Processor -- start 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 -- start start 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient: init 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f66140a0750 0x7f66141381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): picked mon.noname-b con 0x7f66140a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:40.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f66140a3bb0 0x7f661412dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): picked mon.noname-c con 0x7f66140a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 0x7f661412e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): picked mon.noname-a con 0x7f661413b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f66140a04b0 con 0x7f661413b760 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f661409c850 con 0x7f66140a0750 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f661409e710 con 0x7f66140a3bb0 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6619953640 10 monclient(hunting): authenticate will time out at 1828.527650s 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 0x7f661412e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f66140a3bb0 0x7f661412dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f66140a3bb0 0x7f661412dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40666/0 (socket says 10.20.193.51:40666) 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 1 -- 10.20.193.51:0/394029935 learned_addr learned my addr 10.20.193.51:0/394029935 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): get_auth_request con 0x7f661413b760 auth_method 0 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): get_auth_request con 0x7f66140a3bb0 auth_method 0 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f66140a0750 0x7f66141381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 10 monclient(hunting): get_auth_request con 0x7f66140a0750 auth_method 0 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient(hunting): handle_auth_done global_id 254151 payload 824 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f66140a3bb0 msgr2=0x7f661412dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f66140a3bb0 0x7f661412dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f66140a0750 msgr2=0x7f66141381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f66140a0750 0x7f66141381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66141314c0 con 0x7f661413b760 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.908+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f66140a0750 0x7f66141381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 msgr2=0x7f661412e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f66137fe640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 0x7f661412e100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f660400cac0 tx=0x7f660400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604016020 con 0x7f661413b760 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: dump: 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.926 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660400ae30 con 0x7f661413b760 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604012640 con 0x7f661413b760 2026-02-17T12:05:40.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f66117fa640 4 set_mon_vals no callback set 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 10 monclient: dump: 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 5 monclient: authenticate success, global_id 254151 2026-02-17T12:05:40.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 monclient: _renew_subs 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66141317a0 con 0x7f661413b760 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 monclient: _renew_subs 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6614131a80 con 0x7f661413b760 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 0x7f66141398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f66140a2e30 con 0x7f661412e640 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f6604012860 con 0x7f661413b760 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 0x7f66141398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65e403dd60 0x7f65e4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6612ffd640 10 monclient: get_auth_request con 0x7f661412e640 auth_method 0 2026-02-17T12:05:40.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6612ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f6612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.911+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7f6604052b40 con 0x7f661413b760 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f66127fc640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65e403dd60 0x7f65e4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f66127fc640 10 monclient: get_auth_request con 0x7f65e403dd60 auth_method 0 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f6612ffd640 10 monclient(hunting): handle_auth_done global_id 184684 payload 824 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.912+0000 7f6612ffd640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f661412ea20 con 0x7f661412e640 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f66127fc640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65e403dd60 0x7f65e4040220 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007e50 tx=0x7f65fc007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f6612ffd640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 msgr2=0x7f66141398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 0x7f66141398f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f661406f3c0 tx=0x7f66080047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608048070 con 0x7f661412e640 2026-02-17T12:05:40.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f65ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f65ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.914+0000 7f65ebfff640 10 monclient: dump: 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f6608037e00 con 0x7f661412e640 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 msgr2=0x7f66141398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 0x7f66141398f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f661406f3c0 tx=0x7f66080047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 msgr2=0x7f66141398f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.915+0000 7f65ebfff640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f661412e640 0x7f66141398f0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f661406f3c0 tx=0x7f66080047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6619953640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:40.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6619953640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 0x7f661413a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6619953640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f661409dac0 con 0x7f6614139e30 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 0x7f661413a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient: get_auth_request con 0x7f6614139e30 auth_method 0 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 10 monclient(hunting): handle_auth_done global_id 184687 payload 824 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.918+0000 7f6612ffd640 1 -- 10.20.193.51:0/394029935 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f661412fe00 con 0x7f6614139e30 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6612ffd640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 msgr2=0x7f661413a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6612ffd640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 0x7f661413a210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6608002410 tx=0x7f6608009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660803c040 con 0x7f6614139e30 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 10 monclient: dump: 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f6608003710 con 0x7f6614139e30 2026-02-17T12:05:40.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 msgr2=0x7f661413a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 0x7f661413a210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6608002410 tx=0x7f6608009290 comp rx=0 tx=0).stop 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 msgr2=0x7f661413a210 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f65ebfff640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f6614139e30 0x7f661413a210 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6608002410 tx=0x7f6608009290 comp rx=0 tx=0).stop 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:40.936 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 190, 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 373307, 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.937 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.938 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:40.939 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:40.940 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.941 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.942 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:40.943 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.944 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:05:40.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:40.946 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65e403dd60 msgr2=0x7f65e4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f65e403dd60 0x7f65e4040220 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007e50 tx=0x7f65fc007da0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 10 monclient: shutdown 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 msgr2=0x7f661412e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 --2- 10.20.193.51:0/394029935 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f661413b760 0x7f661412e100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f660400cac0 tx=0x7f660400cf90 comp rx=0 tx=0).stop 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 reap_dead start 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f66137fe640 1 -- 10.20.193.51:0/394029935 reap_dead start 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 shutdown_connections 2026-02-17T12:05:40.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 >> 10.20.193.51:0/394029935 conn(0x7f66140a30c0 msgr2=0x7f661413ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 shutdown_connections 2026-02-17T12:05:40.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:40.921+0000 7f6619953640 1 -- 10.20.193.51:0/394029935 wait complete. 2026-02-17T12:05:40.948 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:40.948 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T12:05:40.948 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:05:40.948 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T12:05:40.948 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:05:40.948 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:05:40.948 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:05:40.963 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:05:40.963 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:05:40.963 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.027+0000 7fc240f90640 10 monclient: get_monmap_and_config 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient: build_initial_monmap 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient: monmap: 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:41.028974+0000 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:41.028974+0000 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:41.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 Processor -- start 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 -- start start 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient: init 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:41.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc23c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc23c13b380 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fc23c13ee90 0x7fc23c141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-a con 0x7fc23c13ee90 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c135430 con 0x7fc23c0a3bb0 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c09af60 con 0x7fc23c13b380 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc23c09a5c0 con 0x7fc23c13ee90 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc240f90640 10 monclient(hunting): authenticate will time out at 1828.647768s 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc239d74640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fc23c13b380 legacy=0x7fc23c13d770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:41.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23a575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc23c0a3bb0 0x7fc23c09cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44222/0 (socket says 10.20.193.51:44222) 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23a575640 1 -- 10.20.193.51:0/4183221997 learned_addr learned my addr 10.20.193.51:0/4183221997 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 1 --2- 10.20.193.51:0/4183221997 >> v2:10.20.193.51:3300/0 conn(0x7fc23c13ee90 0x7fc23c141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): get_auth_request con 0x7fc23c13ee90 auth_method 0 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.028+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 10 monclient(hunting): handle_auth_done global_id 254154 payload 274 2026-02-17T12:05:41.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 1 -- 10.20.193.51:0/4183221997 >> v1:10.20.193.142:6789/0 conn(0x7fc23c13b380 legacy=0x7fc23c13d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 1 -- 10.20.193.51:0/4183221997 >> v1:10.20.193.51:6789/0 conn(0x7fc23c0a3bb0 legacy=0x7fc23c09cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 1 monclient: found mon.noname-a 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.029+0000 7fc23ad76640 1 -- 10.20.193.51:0/4183221997 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c09b240 con 0x7fc23c13ee90 2026-02-17T12:05:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc23ad76640 1 -- 10.20.193.51:0/4183221997 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 msgr2=0x7fc23c141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc23ad76640 1 --2- 10.20.193.51:0/4183221997 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c141280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0694e0 tx=0x7fc22c02f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5278c136a1c81872 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 1 -- 10.20.193.51:0/4183221997 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c03c070 con 0x7fc23c13ee90 2026-02-17T12:05:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:41.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: dump: 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: _finish_auth 0 2026-02-17T12:05:41.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 1 -- 10.20.193.51:0/4183221997 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c037640 con 0x7fc23c13ee90 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 5 monclient: authenticate success, global_id 254154 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 1 -- 10.20.193.51:0/4183221997 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c037a10 con 0x7fc23c13ee90 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 4 set_mon_vals no callback set 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc239573640 10 monclient: dump: 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:41.044 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 10 monclient: shutdown 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 1 -- 10.20.193.51:0/4183221997 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 msgr2=0x7fc23c141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.031+0000 7fc240f90640 1 --2- 10.20.193.51:0/4183221997 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c141280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0694e0 tx=0x7fc22c02f130 comp rx=0 tx=0).stop 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- 10.20.193.51:0/4183221997 shutdown_connections 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 --2- 10.20.193.51:0/4183221997 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c141280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- 10.20.193.51:0/4183221997 >> 10.20.193.51:0/4183221997 conn(0x7fc23c0a30c0 msgr2=0x7fc23c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- 10.20.193.51:0/4183221997 shutdown_connections 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- 10.20.193.51:0/4183221997 wait complete. 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient: build_initial_monmap 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient: monmap: 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:41.046 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 Processor -- start 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- start start 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient: init 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc23c0a3bb0 0x7fc23c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-c con 0x7fc23c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 0x7fc23c13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-b con 0x7fc23c13b380 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): picked mon.noname-a con 0x7fc23c13ee90 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:41.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c135040 con 0x7fc23c13ee90 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c0a3f90 con 0x7fc23c13b380 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc23c1351c0 con 0x7fc23c0a3bb0 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc240f90640 10 monclient(hunting): authenticate will time out at 1828.651926s 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc23ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.032+0000 7fc239d74640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 msgr2=0x7fc23c13d0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33378/0 (socket says 10.20.193.51:33378) 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc239d74640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 0x7fc23c13d0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 -- 10.20.193.51:0/1743096905 learned_addr learned my addr 10.20.193.51:0/1743096905 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:41.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc23c0a3bb0 0x7fc23c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): get_auth_request con 0x7fc23c13ee90 auth_method 0 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): get_auth_request con 0x7fc23c0a3bb0 auth_method 0 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:41.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient(hunting): handle_auth_done global_id 254157 payload 824 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 -- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc23c0a3bb0 msgr2=0x7fc23c135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc23c0a3bb0 0x7fc23c135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 -- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 msgr2=0x7fc23c13d0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 0x7fc23c13d0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 monclient: found mon.noname-a 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.033+0000 7fc23ad76640 1 -- 10.20.193.51:0/1743096905 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c1377b0 con 0x7fc23c13ee90 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc23ad76640 1 -- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 msgr2=0x7fc23c13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc23ad76640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009e90 tx=0x7fc22c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c047020 con 0x7fc23c13ee90 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:41.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: dump: 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:41.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c042880 con 0x7fc23c13ee90 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c03c040 con 0x7fc23c13ee90 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc222ffd640 10 monclient: dump: 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:41.052 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc238d72640 4 set_mon_vals no callback set 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 5 monclient: authenticate success, global_id 254157 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _renew_subs 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c137a90 con 0x7fc23c13ee90 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _renew_subs 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c13d5e0 con 0x7fc23c13ee90 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.035+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c09cd30 con 0x7fc23c13ee90 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.036+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc22c043420 con 0x7fc23c13ee90 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.036+0000 7fc222ffd640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 0x7fc208040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.036+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7fc22c0782f0 con 0x7fc23c13ee90 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.036+0000 7fc23a575640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 0x7fc208040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.036+0000 7fc23a575640 10 monclient: get_auth_request con 0x7fc20803dcc0 auth_method 0 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.038+0000 7fc23a575640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 0x7fc208040180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2300093b0 tx=0x7fc230009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.038+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc22c051070 con 0x7fc23c13ee90 2026-02-17T12:05:41.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.038+0000 7fc222ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:41.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.038+0000 7fc222ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc240f90640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc240f90640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc240f90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc23c074d80 con 0x7fc23c13ee90 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc222ffd640 1 -- 10.20.193.51:0/1743096905 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fc22c0780d0 con 0x7fc23c13ee90 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc222ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.152+0000 7fc222ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:41.154 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 msgr2=0x7fc208040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 0x7fc208040180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2300093b0 tx=0x7fc230009340 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 10 monclient: shutdown 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 msgr2=0x7fc23c13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009e90 tx=0x7fc22c004b40 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 shutdown_connections 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc20803dcc0 0x7fc208040180 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc23c13ee90 0x7fc23c13a2b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc23c13b380 0x7fc23c13d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 --2- 10.20.193.51:0/1743096905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc23c0a3bb0 0x7fc23c135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 >> 10.20.193.51:0/1743096905 conn(0x7fc23c0a30c0 msgr2=0x7fc23c09f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 shutdown_connections 2026-02-17T12:05:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:41.153+0000 7fc240f90640 1 -- 10.20.193.51:0/1743096905 wait complete. 2026-02-17T12:05:44.163 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 10 monclient: get_monmap_and_config 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 10 monclient: build_initial_monmap 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 10 monclient: monmap: 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:44.231406+0000 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:44.231406+0000 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:44.232 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:44.233 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:44.233 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 1 Processor -- start 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 1 -- start start 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.230+0000 7fe310d53640 10 monclient: init 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 0x7fe30c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-c con 0x7fe30c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-a con 0x7fe30c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-b con 0x7fe30c09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c0a3f90 con 0x7fe30c0a0750 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c06e140 con 0x7fe30c0a3bb0 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c09f910 con 0x7fe30c09e540 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:44.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe310d53640 10 monclient(hunting): authenticate will time out at 1831.850131s 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30a575640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 msgr2=0x7fe30c09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30a575640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 0x7fe30c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:33392/0 (socket says 10.20.193.51:33392) 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40688/0 (socket says 10.20.193.51:40688) 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 1 -- 10.20.193.51:0/2032621802 learned_addr learned my addr 10.20.193.51:0/2032621802 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): get_auth_request con 0x7fe30c0a0750 auth_method 0 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): get_auth_request con 0x7fe30c09e540 auth_method 0 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient(hunting): handle_auth_done global_id 234344 payload 274 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 -- 10.20.193.51:0/2032621802 >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 msgr2=0x7fe30c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 --2- 10.20.193.51:0/2032621802 >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 0x7fe30c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 -- 10.20.193.51:0/2032621802 >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 msgr2=0x7fe30c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 --2- 10.20.193.51:0/2032621802 >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:44.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 monclient: found mon.noname-b 2026-02-17T12:05:44.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:44.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe30ad76640 1 -- 10.20.193.51:0/2032621802 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c09ccd0 con 0x7fe30c09e540 2026-02-17T12:05:44.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.231+0000 7fe309d74640 1 --2- 10.20.193.51:0/2032621802 >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:44.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe30ad76640 1 -- 10.20.193.51:0/2032621802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 msgr2=0x7fe30c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:44.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe30ad76640 1 --2- 10.20.193.51:0/2032621802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe30c06c1c0 tx=0x7fe2fc02f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef7e8260f779fb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 1 -- 10.20.193.51:0/2032621802 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc03c070 con 0x7fe30c09e540 2026-02-17T12:05:44.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: dump: 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: _finish_auth 0 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 1 -- 10.20.193.51:0/2032621802 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc037440 con 0x7fe30c09e540 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe310d53640 5 monclient: authenticate success, global_id 234344 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe310d53640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:44.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 1 -- 10.20.193.51:0/2032621802 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc037810 con 0x7fe30c09e540 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe309573640 10 monclient: dump: 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.245 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe310d53640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.233+0000 7fe310d53640 4 set_mon_vals no callback set 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 10 monclient: shutdown 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 -- 10.20.193.51:0/2032621802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 msgr2=0x7fe30c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 --2- 10.20.193.51:0/2032621802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe30c06c1c0 tx=0x7fe2fc02f150 comp rx=0 tx=0).stop 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 -- 10.20.193.51:0/2032621802 shutdown_connections 2026-02-17T12:05:44.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 --2- 10.20.193.51:0/2032621802 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c09e540 0x7fe30c13c760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 --2- 10.20.193.51:0/2032621802 >> v2:10.20.193.51:3300/0 conn(0x7fe30c0a0750 0x7fe30c09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 --2- 10.20.193.51:0/2032621802 >> v2:10.20.193.142:3300/0 conn(0x7fe30c0a3bb0 0x7fe30c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 -- 10.20.193.51:0/2032621802 >> 10.20.193.51:0/2032621802 conn(0x7fe30c0a30c0 msgr2=0x7fe30c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 -- 10.20.193.51:0/2032621802 shutdown_connections 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 -- 10.20.193.51:0/2032621802 wait complete. 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 10 monclient: build_initial_monmap 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 10 monclient: monmap: 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:44.247 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.234+0000 7fe310d53640 1 Processor -- start 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 -- start start 2026-02-17T12:05:44.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient: init 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe30c09e540 0x7fe30c09c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-a con 0x7fe30c09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-c con 0x7fe30c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 0x7fe30c0940e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): picked mon.noname-b con 0x7fe30c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0a04b0 con 0x7fe30c09e540 2026-02-17T12:05:44.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c09c850 con 0x7fe30c0a3bb0 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c13cca0 con 0x7fe30c0a0750 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe310d53640 10 monclient(hunting): authenticate will time out at 1831.854326s 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe30c09e540 0x7fe30c09c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40700/0 (socket says 10.20.193.51:40700) 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 -- 10.20.193.51:0/3924768702 learned_addr learned my addr 10.20.193.51:0/3924768702 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): get_auth_request con 0x7fe30c0a0750 auth_method 0 2026-02-17T12:05:44.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): get_auth_request con 0x7fe30c09e540 auth_method 0 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30ad76640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 msgr2=0x7fe30c0940e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30ad76640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 0x7fe30c0940e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:44.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe30a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient(hunting): handle_auth_done global_id 234347 payload 824 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 msgr2=0x7fe30c0940e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 0x7fe30c0940e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe30c09e540 msgr2=0x7fe30c09c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe30c09e540 0x7fe30c09c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:44.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 monclient: found mon.noname-c 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.235+0000 7fe309d74640 1 -- 10.20.193.51:0/3924768702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c097470 con 0x7fe30c0a0750 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe309d74640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 msgr2=0x7fe30c093ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe309d74640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400ebe0 tx=0x7fe2f400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4017070 con 0x7fe30c0a0750 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: dump: 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:44.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:44.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f400ce50 con 0x7fe30c0a0750 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4013690 con 0x7fe30c0a0750 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe308d72640 4 set_mon_vals no callback set 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe2f2ffd640 10 monclient: dump: 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 5 monclient: authenticate success, global_id 234347 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 10 monclient: _renew_subs 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c095be0 con 0x7fe30c0a0750 2026-02-17T12:05:44.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 10 monclient: _renew_subs 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.237+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c0a2650 con 0x7fe30c0a0750 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe310d53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe310d53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe310d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c073d20 con 0x7fe30c0a0750 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe2f4013830 con 0x7fe30c0a0750 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe2f2ffd640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 0x7fe2d8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.238+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7fe2f4052dc0 con 0x7fe30c0a0750 2026-02-17T12:05:44.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.239+0000 7fe30a575640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 0x7fe2d8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.239+0000 7fe30a575640 10 monclient: get_auth_request con 0x7fe2d803dcc0 auth_method 0 2026-02-17T12:05:44.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.241+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe30c073d20 con 0x7fe30c0a0750 2026-02-17T12:05:44.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.241+0000 7fe2f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:44.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.241+0000 7fe2f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:44.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.241+0000 7fe30a575640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 0x7fe2d8040180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe3000094d0 tx=0x7fe300009460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe310d53640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:44.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe310d53640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:44.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe310d53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:44.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe30c09dac0 con 0x7fe30c0a0750 2026-02-17T12:05:44.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe2f2ffd640 1 -- 10.20.193.51:0/3924768702 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fe2f4011cc0 con 0x7fe30c0a0750 2026-02-17T12:05:44.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe2f2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:44.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.355+0000 7fe2f2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:44.359 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 msgr2=0x7fe2d8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 0x7fe2d8040180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe3000094d0 tx=0x7fe300009460 comp rx=0 tx=0).stop 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 10 monclient: shutdown 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 msgr2=0x7fe30c093ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400ebe0 tx=0x7fe2f400c520 comp rx=0 tx=0).stop 2026-02-17T12:05:44.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 shutdown_connections 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe2d803dcc0 0x7fe2d8040180 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe30c0a3bb0 0x7fe30c0940e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe30c0a0750 0x7fe30c093ba0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 --2- 10.20.193.51:0/3924768702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe30c09e540 0x7fe30c09c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 >> 10.20.193.51:0/3924768702 conn(0x7fe30c0a30c0 msgr2=0x7fe30c072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 shutdown_connections 2026-02-17T12:05:44.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:44.356+0000 7fe310d53640 1 -- 10.20.193.51:0/3924768702 wait complete. 2026-02-17T12:05:47.366 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.432+0000 7fcdd1dd6640 10 monclient: get_monmap_and_config 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.432+0000 7fcdd1dd6640 10 monclient: build_initial_monmap 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.432+0000 7fcdd1dd6640 10 monclient: monmap: 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:47.433660+0000 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:47.433660+0000 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:47.434 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 Processor -- start 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 -- start start 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient: init 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-a con 0x7fcdcc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcdcc09d270 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 0x7fcdcc1403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-c con 0x7fcdcc138780 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:47.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdcc135430 con 0x7fcdcc09d270 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc09a5c0 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc09b520 con 0x7fcdcc138780 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdd1dd6640 10 monclient(hunting): authenticate will time out at 1835.052422s 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcaffd640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fcdcc09d270 legacy=0x7fcdcc138070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59358/0 (socket says 10.20.193.51:59358) 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 -- 10.20.193.51:0/3638040922 learned_addr learned my addr 10.20.193.51:0/3638040922 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): get_auth_request con 0x7fcdcc0a3bb0 auth_method 0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcbfff640 1 -- 10.20.193.51:0/3638040922 >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 msgr2=0x7fcdcc1403b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcbfff640 1 --2- 10.20.193.51:0/3638040922 >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 0x7fcdcc1403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient(hunting): handle_auth_done global_id 254166 payload 274 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 -- 10.20.193.51:0/3638040922 >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 msgr2=0x7fcdcc1403b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 --2- 10.20.193.51:0/3638040922 >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 0x7fcdcc1403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 -- 10.20.193.51:0/3638040922 >> v1:10.20.193.142:6789/0 conn(0x7fcdcc09d270 legacy=0x7fcdcc138070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:47.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.433+0000 7fcdcb7fe640 1 -- 10.20.193.51:0/3638040922 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc09af60 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdcb7fe640 1 -- 10.20.193.51:0/3638040922 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc0a3bb0 msgr2=0x7fcdcc09cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:47.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdcb7fe640 1 --2- 10.20.193.51:0/3638040922 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0a3020 tx=0x7fcdb802ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bde27409c4fb528 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 1 -- 10.20.193.51:0/3638040922 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb803c070 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: dump: 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 5 monclient: authenticate success, global_id 254166 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 1 -- 10.20.193.51:0/3638040922 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb802fd90 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 1 -- 10.20.193.51:0/3638040922 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8037660 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdca7fc640 10 monclient: dump: 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 4 set_mon_vals no callback set 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 10 monclient: shutdown 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/3638040922 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc0a3bb0 msgr2=0x7fcdcc09cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/3638040922 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0a3020 tx=0x7fcdb802ee30 comp rx=0 tx=0).stop 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/3638040922 shutdown_connections 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/3638040922 >> v2:10.20.193.142:3300/0 conn(0x7fcdcc138780 0x7fcdcc1403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/3638040922 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc0a3bb0 0x7fcdcc09cd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/3638040922 >> 10.20.193.51:0/3638040922 conn(0x7fcdcc0a30c0 msgr2=0x7fcdcc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:47.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/3638040922 shutdown_connections 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.436+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/3638040922 wait complete. 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient: build_initial_monmap 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient: monmap: 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 Processor -- start 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 -- start start 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient: init 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 0x7fcdcc12ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-b con 0x7fcdcc09d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcdcc0a3bb0 0x7fcdcc12d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-c con 0x7fcdcc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): picked mon.noname-a con 0x7fcdcc138780 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc074ac0 con 0x7fcdcc138780 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0a3f90 con 0x7fcdcc09d270 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc135040 con 0x7fcdcc0a3bb0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdd1dd6640 10 monclient(hunting): authenticate will time out at 1835.056717s 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcb7fe640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 msgr2=0x7fcdcc12ccd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcb7fe640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 0x7fcdcc12ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:59372/0 (socket says 10.20.193.51:59372) 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 -- 10.20.193.51:0/739213498 learned_addr learned my addr 10.20.193.51:0/739213498 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): get_auth_request con 0x7fcdcc138780 auth_method 0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcdcc0a3bb0 0x7fcdcc12d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): get_auth_request con 0x7fcdcc0a3bb0 auth_method 0 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:47.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient(hunting): handle_auth_done global_id 254169 payload 824 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 -- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcdcc0a3bb0 msgr2=0x7fcdcc12d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcdcc0a3bb0 0x7fcdcc12d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 -- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 msgr2=0x7fcdcc12ccd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 0x7fcdcc12ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 monclient: found mon.noname-a 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.437+0000 7fcdcbfff640 1 -- 10.20.193.51:0/739213498 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc130980 con 0x7fcdcc138780 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdcbfff640 1 -- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 msgr2=0x7fcdcc12d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdcbfff640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000be50 tx=0x7fcdc000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0016630 con 0x7fcdcc138780 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:47.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdcbfff640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000be50 tx=0x7fcdc000bf50 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fcdc0010030 config(0 keys) 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: dump: 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 5 monclient: authenticate success, global_id 254169 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _renew_subs 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc130c60 con 0x7fcdcc138780 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc0010030 con 0x7fcdcc138780 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdc9ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _renew_subs 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc138360 con 0x7fcdcc138780 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc0a1d90 con 0x7fcdcc138780 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0016a10 con 0x7fcdcc138780 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 10 monclient: dump: 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:47.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.440+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcdc00153e0 con 0x7fcdcc138780 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.441+0000 7fcda7fff640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 0x7fcd9c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.441+0000 7fcdcb7fe640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 0x7fcd9c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.441+0000 7fcdcb7fe640 10 monclient: get_auth_request con 0x7fcd9c03dcc0 auth_method 0 2026-02-17T12:05:47.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.443+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7fcdc0052e80 con 0x7fcdcc138780 2026-02-17T12:05:47.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.443+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:05:47.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:47.443+0000 7fcdcb7fe640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 0x7fcd9c040180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8036000 tx=0x7fcdb8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:48.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.063+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcdcc0a1d90 con 0x7fcdcc138780 2026-02-17T12:05:48.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.063+0000 7fcda7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:48.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.063+0000 7fcda7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcdd1dd6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcdd1dd6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcdd1dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcdcc138bb0 con 0x7fcdcc138780 2026-02-17T12:05:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcda7fff640 1 -- 10.20.193.51:0/739213498 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fcdc0051890 con 0x7fcdcc138780 2026-02-17T12:05:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcda7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.176+0000 7fcda7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:48.179 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 msgr2=0x7fcd9c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 0x7fcd9c040180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8036000 tx=0x7fcdb8033000 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 10 monclient: shutdown 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 msgr2=0x7fcdcc12d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000be50 tx=0x7fcdc000bf50 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 shutdown_connections 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd9c03dcc0 0x7fcd9c040180 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcdcc138780 0x7fcdcc12d750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcdcc0a3bb0 0x7fcdcc12d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 --2- 10.20.193.51:0/739213498 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcdcc09d270 0x7fcdcc12ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 >> 10.20.193.51:0/739213498 conn(0x7fcdcc0a30c0 msgr2=0x7fcdcc09c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 shutdown_connections 2026-02-17T12:05:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:48.177+0000 7fcdd1dd6640 1 -- 10.20.193.51:0/739213498 wait complete. 2026-02-17T12:05:51.187 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:51.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.255+0000 7f2bbd0a0640 10 monclient: get_monmap_and_config 2026-02-17T12:05:51.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.255+0000 7f2bbd0a0640 10 monclient: build_initial_monmap 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.255+0000 7f2bbd0a0640 10 monclient: monmap: 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:51.256908+0000 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:51.256908+0000 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:51.260 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 Processor -- start 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 -- start start 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient: init 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-b con 0x7f2bb80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2bb80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2bb813b760 0x7f2bb813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-a con 0x7f2bb813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb806e140 con 0x7f2bb80a0750 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb809f910 con 0x7f2bb813b760 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb809ccd0 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bbd0a0640 10 monclient(hunting): authenticate will time out at 1838.875680s 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f2bb80a0750 0x7f2bb809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36642/0 (socket says 10.20.193.51:36642) 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2bb813b760 0x7f2bb813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6575640 1 -- 10.20.193.51:0/2927523286 learned_addr learned my addr 10.20.193.51:0/2927523286 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): get_auth_request con 0x7f2bb80a3bb0 auth_method 0 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): get_auth_request con 0x7f2bb813b760 auth_method 0 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:51.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient(hunting): handle_auth_done global_id 254172 payload 274 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 -- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 msgr2=0x7f2bb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 --2- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 -- 10.20.193.51:0/2927523286 >> v1:10.20.193.51:6789/0 conn(0x7f2bb80a0750 legacy=0x7f2bb809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient: _finish_hunting 0 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 monclient: found mon.noname-a 2026-02-17T12:05:51.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:05:51.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.256+0000 7f2bb7577640 1 -- 10.20.193.51:0/2927523286 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb809eec0 con 0x7f2bb813b760 2026-02-17T12:05:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb7577640 1 -- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 msgr2=0x7f2bb813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:51.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb7577640 1 --2- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb813db50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bb809f230 tx=0x7f2ba802f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef7d0ccc37caa45 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 1 -- 10.20.193.51:0/2927523286 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba803c070 con 0x7f2bb813b760 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: dump: 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.273 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: _finish_auth 0 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: _check_auth_tickets 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 5 monclient: authenticate success, global_id 254172 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 1 -- 10.20.193.51:0/2927523286 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8037440 con 0x7f2bb813b760 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:51.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 1 -- 10.20.193.51:0/2927523286 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037810 con 0x7f2bb813b760 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 4 set_mon_vals no callback set 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bb5d74640 10 monclient: dump: 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.275 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 10 monclient: shutdown 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 msgr2=0x7f2bb813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb813db50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bb809f230 tx=0x7f2ba802f150 comp rx=0 tx=0).stop 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/2927523286 shutdown_connections 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb813db50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/2927523286 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/2927523286 >> 10.20.193.51:0/2927523286 conn(0x7f2bb80a30c0 msgr2=0x7f2bb80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/2927523286 shutdown_connections 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.259+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/2927523286 wait complete. 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient: build_initial_monmap 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient: monmap: 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:51.277 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 Processor -- start 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 -- start start 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient: init 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 0x7f2bb81311b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-b con 0x7f2bb80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-c con 0x7f2bb80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb8131c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): picked mon.noname-a con 0x7f2bb813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80a04b0 con 0x7f2bb813b760 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb809c850 con 0x7f2bb80a0750 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb809e710 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bbd0a0640 10 monclient(hunting): authenticate will time out at 1838.879664s 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37890/0 (socket says 10.20.193.51:37890) 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb8131c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 -- 10.20.193.51:0/1040834733 learned_addr learned my addr 10.20.193.51:0/1040834733 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:51.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6d76640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 msgr2=0x7f2bb81311b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): get_auth_request con 0x7f2bb80a3bb0 auth_method 0 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): get_auth_request con 0x7f2bb813b760 auth_method 0 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6d76640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 0x7f2bb81311b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:51.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient(hunting): handle_auth_done global_id 234356 payload 824 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 -- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 msgr2=0x7f2bb81311b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 0x7f2bb81311b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 -- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 msgr2=0x7f2bb8131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb8131c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 monclient: found mon.noname-c 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb6575640 1 -- 10.20.193.51:0/1040834733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb81332b0 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.260+0000 7f2bb7577640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb8131c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.262+0000 7f2bb6575640 1 -- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 msgr2=0x7f2bb81316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.262+0000 7f2bb6575640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c530 tx=0x7f2ba000ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0007070 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:51.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: dump: 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba0007230 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 5 monclient: authenticate success, global_id 234356 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _renew_subs 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb80a21f0 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0007620 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:51.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bb5573640 4 set_mon_vals no callback set 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 10 monclient: dump: 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:51.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _renew_subs 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb8134890 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb80a2740 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2ba001b400 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 0x7f2b84040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.263+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7f2ba0052330 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.264+0000 7f2bb6d76640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 0x7f2b84040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.264+0000 7f2bb6d76640 10 monclient: get_auth_request con 0x7f2b8403dcc0 auth_method 0 2026-02-17T12:05:51.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.266+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2bb80a21f0 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.266+0000 7f2b977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.266+0000 7f2b977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:51.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.267+0000 7f2bb6d76640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 0x7f2b84040180 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0095a0 tx=0x7f2bac009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2bbd0a0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2bbd0a0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:51.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2bbd0a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2bb8132b60 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2b977fe640 1 -- 10.20.193.51:0/1040834733 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f2ba001ac60 con 0x7f2bb80a3bb0 2026-02-17T12:05:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2b977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:51.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.380+0000 7f2b977fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:51.383 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:51.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 msgr2=0x7f2b84040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 0x7f2b84040180 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0095a0 tx=0x7f2bac009290 comp rx=0 tx=0).stop 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 10 monclient: shutdown 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 msgr2=0x7f2bb81316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c530 tx=0x7f2ba000ca00 comp rx=0 tx=0).stop 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 shutdown_connections 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2b8403dcc0 0x7f2b84040180 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2bb813b760 0x7f2bb8131c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2bb80a3bb0 0x7f2bb81316f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 --2- 10.20.193.51:0/1040834733 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2bb80a0750 0x7f2bb81311b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 >> 10.20.193.51:0/1040834733 conn(0x7f2bb80a30c0 msgr2=0x7f2bb8139fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 shutdown_connections 2026-02-17T12:05:51.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:51.381+0000 7f2bbd0a0640 1 -- 10.20.193.51:0/1040834733 wait complete. 2026-02-17T12:05:54.391 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 10 monclient: get_monmap_and_config 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 10 monclient: build_initial_monmap 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 10 monclient: monmap: 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:54.460472+0000 2026-02-17T12:05:54.463 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:54.460472+0000 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 1 Processor -- start 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 1 -- start start 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.459+0000 7f4fede8f640 10 monclient: init 2026-02-17T12:05:54.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-b con 0x7f4fe80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4fe80a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4fe813b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe806e140 con 0x7f4fe80a0750 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe809f910 con 0x7f4fe813b760 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe809ccd0 con 0x7f4fe80a3bb0 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fede8f640 10 monclient(hunting): authenticate will time out at 1842.079212s 2026-02-17T12:05:54.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe6ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f4fe80a0750 0x7f4fe809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:36650/0 (socket says 10.20.193.51:36650) 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe7fff640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f4fe813b760 legacy=0x7f4fe813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe6ffd640 1 -- 10.20.193.51:0/2079330082 learned_addr learned my addr 10.20.193.51:0/2079330082 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe80a3bb0 auth_method 0 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:54.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.460+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:54.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.462+0000 7f4fe6ffd640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.51:6789/0 conn(0x7f4fe80a0750 legacy=0x7f4fe809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:54.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.142:6789/0 conn(0x7f4fe813b760 legacy=0x7f4fe813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:54.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:54.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe80a3bb0 auth_method 0 2026-02-17T12:05:54.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:54.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:54.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:54.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:05:54.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:54.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:54.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:54.661+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe80a3bb0 auth_method 0 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.142:6789/0 conn(0x7f4fe813b760 legacy=0x7f4fe813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:55.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.062+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:55.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:55.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe80a3bb0 auth_method 0 2026-02-17T12:05:55.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:55.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:55.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:55.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.142:6789/0 conn(0x7f4fe813b760 legacy=0x7f4fe813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:55.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:55.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:55.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:55.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:55.863+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007654042 0 0) 0x7f4fe806e140 con 0x7f4fe80a0750 2026-02-17T12:05:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 10 monclient(hunting): _negotiate 2026-02-17T12:05:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 10 monclient(hunting): my global_id is 254178 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.600+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fcc003620 con 0x7f4fe80a0750 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3175191907 0 0) 0x7f4fcc003620 con 0x7f4fe80a0750 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fe809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.142:6789/0 conn(0x7f4fe813b760 legacy=0x7f4fe813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe809eec0 con 0x7f4fe80a0750 2026-02-17T12:05:56.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f4fd8003160 con 0x7f4fe80a0750 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fede8f640 5 monclient: authenticate success, global_id 254178 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fede8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: dump: 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.614 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:05:56.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 >> v1:10.20.193.51:6789/0 conn(0x7f4fe80a0750 legacy=0x7f4fe809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fcc003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): picked mon.c con 0x7f4fe80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fcc0040f0 0x7f4fcc004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): picked mon.b con 0x7f4fcc0040f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 0x7f4fcc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): picked mon.a con 0x7f4fcc004e40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe809ccd0 con 0x7f4fcc004e40 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc00bcd0 con 0x7f4fcc0040f0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc00bed0 con 0x7f4fe80a3bb0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fede8f640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fcc003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 0x7f4fcc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): get_auth_request con 0x7f4fcc004e40 auth_method 0 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:56.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe6ffd640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fcc0040f0 msgr2=0x7f4fcc004900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe80a3bb0 auth_method 0 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe6ffd640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fcc0040f0 0x7f4fcc004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_done global_id 254178 payload 293 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 msgr2=0x7f4fcc003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe80a3bb0 0x7f4fcc003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fcc0040f0 msgr2=0x7f4fcc004900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fcc0040f0 0x7f4fcc004900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 monclient: found mon.a 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc003620 con 0x7f4fcc004e40 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:56.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.601+0000 7f4fe7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 msgr2=0x7f4fcc0052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe7fff640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 0x7f4fcc0052c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c5a0 tx=0x7f4fdc02f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2a3d7dc1afac27 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc03b070 con 0x7f4fcc004e40 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: dump: 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.620 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fdc036420 con 0x7f4fcc004e40 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 1 -- 10.20.193.51:0/2079330082 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc007ce0 con 0x7f4fcc004e40 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 4 set_mon_vals no callback set 2026-02-17T12:05:56.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe67fc640 10 monclient: dump: 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 10 monclient: shutdown 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 -- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 msgr2=0x7f4fcc0052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2079330082 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fcc004e40 0x7f4fcc0052c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c5a0 tx=0x7f4fdc02f6c0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fe7fff640 1 -- 10.20.193.51:0/2079330082 reap_dead start 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 -- 10.20.193.51:0/2079330082 shutdown_connections 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 -- 10.20.193.51:0/2079330082 >> 10.20.193.51:0/2079330082 conn(0x7f4fe80a30c0 msgr2=0x7f4fe80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 -- 10.20.193.51:0/2079330082 shutdown_connections 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.604+0000 7f4fede8f640 1 -- 10.20.193.51:0/2079330082 wait complete. 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient: build_initial_monmap 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient: monmap: 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:56.623 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 Processor -- start 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 -- start start 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient: init 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:56.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-c con 0x7f4fe81311f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 0x7f4fe8131f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-b con 0x7f4fe8131b10 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 0x7f4fe81d5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): picked mon.noname-a con 0x7f4fe81d3880 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe80a04b0 con 0x7f4fe81d3880 2026-02-17T12:05:56.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe809c850 con 0x7f4fe8131b10 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe809e710 con 0x7f4fe81311f0 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fede8f640 10 monclient(hunting): authenticate will time out at 1844.224921s 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe7fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 0x7f4fe81d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe6ffd640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 msgr2=0x7f4fe8131f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe77fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37632/0 (socket says 10.20.193.51:37632) 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2202895025 learned_addr learned my addr 10.20.193.51:0/2202895025 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request con 0x7f4fe81311f0 auth_method 0 2026-02-17T12:05:56.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe6ffd640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 0x7f4fe8131f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.605+0000 7f4fe77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): get_auth_request con 0x7f4fe81d3880 auth_method 0 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient(hunting): handle_auth_done global_id 234359 payload 824 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 msgr2=0x7f4fe8131f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 0x7f4fe8131f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 msgr2=0x7f4fe81d5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 0x7f4fe81d5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2202895025 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe80a2180 con 0x7f4fe81311f0 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.606+0000 7f4fe7fff640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 0x7f4fe81d5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:56.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fe77fe640 1 -- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 msgr2=0x7f4fe81315d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fe77fe640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4012670 tx=0x7f4fd4012b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400f040 con 0x7f4fe81311f0 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: dump: 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.629 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd4016d60 con 0x7f4fe81311f0 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 5 monclient: authenticate success, global_id 234359 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 10 monclient: _renew_subs 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe8133190 con 0x7f4fe81311f0 2026-02-17T12:05:56.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4018690 con 0x7f4fe81311f0 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fe5ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fc3fff640 10 monclient: dump: 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.631 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 10 monclient: _renew_subs 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.608+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe8133770 con 0x7f4fe81311f0 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4fd4015040 con 0x7f4fe81311f0 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fc3fff640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 0x7f4fb80401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fede8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fede8f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fede8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7f4fd40533c0 con 0x7f4fe81311f0 2026-02-17T12:05:56.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe809dac0 con 0x7f4fe81311f0 2026-02-17T12:05:56.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fe6ffd640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 0x7f4fb80401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.609+0000 7f4fe6ffd640 10 monclient: get_auth_request con 0x7f4fb803dcf0 auth_method 0 2026-02-17T12:05:56.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.612+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4fe80a2180 con 0x7f4fe81311f0 2026-02-17T12:05:56.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.612+0000 7f4fc3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:56.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.612+0000 7f4fc3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:56.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.612+0000 7f4fe6ffd640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 0x7f4fb80401b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8133700 tx=0x7f4fd8002bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fede8f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:56.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fede8f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:56.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fede8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4fe8050ac0 con 0x7f4fe81311f0 2026-02-17T12:05:56.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fc3fff640 1 -- 10.20.193.51:0/2202895025 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f4fd40530d0 con 0x7f4fe81311f0 2026-02-17T12:05:56.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fc3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:56.728 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.725+0000 7f4fc3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:56.728 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":194,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:56.729 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 msgr2=0x7f4fb80401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 0x7f4fb80401b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8133700 tx=0x7f4fd8002bf0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 10 monclient: shutdown 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 msgr2=0x7f4fe81315d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4012670 tx=0x7f4fd4012b40 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 shutdown_connections 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4fb803dcf0 0x7f4fb80401b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4fe81d3880 0x7f4fe81d5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4fe8131b10 0x7f4fe8131f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 --2- 10.20.193.51:0/2202895025 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4fe81311f0 0x7f4fe81315d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.730 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 >> 10.20.193.51:0/2202895025 conn(0x7f4fe80a30c0 msgr2=0x7f4fe8139ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:56.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 shutdown_connections 2026-02-17T12:05:56.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.726+0000 7f4fede8f640 1 -- 10.20.193.51:0/2202895025 wait complete. 2026-02-17T12:05:56.736 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:05:56.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:05:56.737 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: get_monmap_and_config 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: build_initial_monmap 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: monmap: 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:56.805148+0000 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:56.805148+0000 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:56.806 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 Processor -- start 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 -- start start 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: init 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-b con 0x7f7d600a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7d6009dac0 0x7f7d6009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-a con 0x7f7d6009dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7d6009ff40 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6006e140 con 0x7f7d6009ff40 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6009aed0 con 0x7f7d6009dac0 2026-02-17T12:05:56.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6009caa0 con 0x7f7d600a3bb0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d65dfb640 10 monclient(hunting): authenticate will time out at 1844.423898s 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37640/0 (socket says 10.20.193.51:37640) 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/1938095999 learned_addr learned my addr 10.20.193.51:0/1938095999 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 10 monclient(hunting): get_auth_request con 0x7f7d600a3bb0 auth_method 0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.804+0000 7f7d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 1 --2- 10.20.193.51:0/1938095999 >> v2:10.20.193.51:3300/0 conn(0x7f7d6009dac0 0x7f7d6009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): get_auth_request con 0x7f7d6009dac0 auth_method 0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_done global_id 234362 payload 274 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/1938095999 >> v2:10.20.193.51:3300/0 conn(0x7f7d6009dac0 msgr2=0x7f7d6009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 1 --2- 10.20.193.51:0/1938095999 >> v2:10.20.193.51:3300/0 conn(0x7f7d6009dac0 0x7f7d6009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/1938095999 >> v1:10.20.193.51:6789/0 conn(0x7f7d6009ff40 legacy=0x7f7d6013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 1 monclient: found mon.noname-b 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.805+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/1938095999 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6009ce60 con 0x7f7d600a3bb0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/1938095999 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 msgr2=0x7f7d6009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5f7fe640 1 --2- 10.20.193.51:0/1938095999 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d60069d60 tx=0x7f7d4c031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dbd6ffec913a5ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 1 -- 10.20.193.51:0/1938095999 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c036920 con 0x7f7d600a3bb0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: dump: 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 1 -- 10.20.193.51:0/1938095999 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c036ac0 con 0x7f7d600a3bb0 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d65dfb640 5 monclient: authenticate success, global_id 234362 2026-02-17T12:05:56.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d65dfb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 1 -- 10.20.193.51:0/1938095999 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c038400 con 0x7f7d600a3bb0 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d65dfb640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d65dfb640 4 set_mon_vals no callback set 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.807+0000 7f7d5e7fc640 10 monclient: dump: 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.810 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 10 monclient: shutdown 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- 10.20.193.51:0/1938095999 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 msgr2=0x7f7d6009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/1938095999 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d60069d60 tx=0x7f7d4c031700 comp rx=0 tx=0).stop 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- 10.20.193.51:0/1938095999 shutdown_connections 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/1938095999 >> v2:10.20.193.51:3300/0 conn(0x7f7d6009dac0 0x7f7d6009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/1938095999 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d600a3bb0 0x7f7d6009f4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- 10.20.193.51:0/1938095999 >> 10.20.193.51:0/1938095999 conn(0x7f7d600a30c0 msgr2=0x7f7d600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- 10.20.193.51:0/1938095999 shutdown_connections 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- 10.20.193.51:0/1938095999 wait complete. 2026-02-17T12:05:56.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 10 monclient: build_initial_monmap 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 10 monclient: monmap: 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 Processor -- start 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 1 -- start start 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.808+0000 7f7d65dfb640 10 monclient: init 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 0x7f7d601b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-c con 0x7f7d6009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7d6009ff40 0x7f7d601b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-b con 0x7f7d6009ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d600a3bb0 0x7f7d601b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): picked mon.noname-a con 0x7f7d600a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6009a880 con 0x7f7d600a3bb0 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600a0350 con 0x7f7d6009ff40 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7d600a04d0 con 0x7f7d6009dac0 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d65dfb640 10 monclient(hunting): authenticate will time out at 1844.428182s 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 0x7f7d601b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 0x7f7d601b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37644/0 (socket says 10.20.193.51:37644) 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/2653576534 learned_addr learned my addr 10.20.193.51:0/2653576534 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): get_auth_request con 0x7f7d6009dac0 auth_method 0 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d600a3bb0 0x7f7d601b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5effd640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7d6009ff40 msgr2=0x7f7d601b8200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5effd640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7d6009ff40 0x7f7d601b8200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): get_auth_request con 0x7f7d600a3bb0 auth_method 0 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient(hunting): handle_auth_done global_id 234365 payload 824 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7d6009ff40 msgr2=0x7f7d601b8200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7d6009ff40 0x7f7d601b8200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d600a3bb0 msgr2=0x7f7d601b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d600a3bb0 0x7f7d601b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.809+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d601bba60 con 0x7f7d6009dac0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d5f7fe640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 msgr2=0x7f7d601b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d5f7fe640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 0x7f7d601b7cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00bd90 tx=0x7f7d4c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c045020 con 0x7f7d6009dac0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: dump: 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c041660 con 0x7f7d6009dac0 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 5 monclient: authenticate success, global_id 234365 2026-02-17T12:05:56.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c041a50 con 0x7f7d6009dac0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d3bfff640 10 monclient: dump: 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d5dffb640 4 set_mon_vals no callback set 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 10 monclient: _renew_subs 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d600a1370 con 0x7f7d6009dac0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 10 monclient: _renew_subs 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.811+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d601bb4a0 con 0x7f7d6009dac0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7d4c00c040 con 0x7f7d6009dac0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d65dfb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 0x7f7d601cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7d601bd1e0 con 0x7f7d601cfba0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 0x7f7d601cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient: get_auth_request con 0x7f7d601cfba0 auth_method 0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d3bfff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7d3003dcc0 0x7f7d30040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(759..759 src has 323..759) ==== 4767+0+0 (secure 0 0 0) 0x7f7d4c078370 con 0x7f7d6009dac0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 10 monclient(hunting): handle_auth_done global_id 254190 payload 824 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5effd640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d6009e400 con 0x7f7d601cfba0 2026-02-17T12:05:56.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5ffff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7d3003dcc0 0x7f7d30040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.812+0000 7f7d5ffff640 10 monclient: get_auth_request con 0x7f7d3003dcc0 auth_method 0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d5effd640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 msgr2=0x7f7d601cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d5effd640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 0x7f7d601cff80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d500095a0 tx=0x7f7d5000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50017070 con 0x7f7d601cfba0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 10 monclient: dump: 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7d5000cbc0 con 0x7f7d601cfba0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:56.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 msgr2=0x7f7d601cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 0x7f7d601cff80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d500095a0 tx=0x7f7d5000ed50 comp rx=0 tx=0).stop 2026-02-17T12:05:56.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 msgr2=0x7f7d601cff80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:56.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.814+0000 7f7d3bfff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601cfba0 0x7f7d601cff80 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d500095a0 tx=0x7f7d5000ed50 comp rx=0 tx=0).stop 2026-02-17T12:05:56.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.815+0000 7f7d5ffff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7d3003dcc0 0x7f7d30040180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400f2e0 tx=0x7f7d54004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d65dfb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 0x7f7d601dae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d65dfb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600a3fc0 con 0x7f7d601d04c0 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 0x7f7d601dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient: get_auth_request con 0x7f7d601d04c0 auth_method 0 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:56.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:56.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:56.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:56.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:56.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 10 monclient(hunting): handle_auth_done global_id 254193 payload 824 2026-02-17T12:05:56.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.818+0000 7f7d5effd640 1 -- 10.20.193.51:0/2653576534 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d600a2e00 con 0x7f7d601d04c0 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d5effd640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 msgr2=0x7f7d601dae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d5effd640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 0x7f7d601dae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d50018000 tx=0x7f7d50004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50017030 con 0x7f7d601d04c0 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 10 monclient: dump: 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f7d50003030 con 0x7f7d601d04c0 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:56.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 msgr2=0x7f7d601dae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 0x7f7d601dae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d50018000 tx=0x7f7d50004830 comp rx=0 tx=0).stop 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 msgr2=0x7f7d601dae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d3bfff640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7d601d04c0 0x7f7d601dae10 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d50018000 tx=0x7f7d50004830 comp rx=0 tx=0).stop 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 194, 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 30867, 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:56.823 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:56.824 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:56.826 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:56.827 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7d3003dcc0 msgr2=0x7f7d30040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7d3003dcc0 0x7f7d30040180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400f2e0 tx=0x7f7d54004200 comp rx=0 tx=0).stop 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 10 monclient: shutdown 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 msgr2=0x7f7d601b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 --2- 10.20.193.51:0/2653576534 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7d6009dac0 0x7f7d601b7cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00bd90 tx=0x7f7d4c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d5ffff640 1 -- 10.20.193.51:0/2653576534 reap_dead start 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d5ffff640 1 -- 10.20.193.51:0/2653576534 reap_dead start 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 shutdown_connections 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 >> 10.20.193.51:0/2653576534 conn(0x7f7d600a30c0 msgr2=0x7f7d6009e610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:56.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 shutdown_connections 2026-02-17T12:05:56.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.820+0000 7f7d65dfb640 1 -- 10.20.193.51:0/2653576534 wait complete. 2026-02-17T12:05:56.829 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:56.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:05:56.829 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 10 monclient: get_monmap_and_config 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 10 monclient: build_initial_monmap 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 10 monclient: monmap: 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:05:56.896436+0000 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:05:56.896436+0000 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:05:56.897 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 1 Processor -- start 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 1 -- start start 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.895+0000 7ff798cfa640 10 monclient: init 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff7940a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-c con 0x7ff7940a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff79413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79406e140 con 0x7ff79413b760 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79409f910 con 0x7ff7940a3bb0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff79409ccd0 con 0x7ff7940a0750 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff798cfa640 10 monclient(hunting): authenticate will time out at 1844.515378s 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff792575640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7ff7940a3bb0 legacy=0x7ff79409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff791d74640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 msgr2=0x7ff79409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff791d74640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff792d76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 0x7ff79413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:38348/0 (socket says 10.20.193.51:38348) 2026-02-17T12:05:56.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.896+0000 7ff792d76640 1 -- 10.20.193.51:0/1771459905 learned_addr learned my addr 10.20.193.51:0/1771459905 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff792d76640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 legacy=0x7ff79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff792d76640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 legacy=0x7ff79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff792d76640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 legacy=0x7ff79413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff792d76640 1 --1- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 0x7ff79413db50 :-1 s=OPENED pgs=75 cs=1 l=1).handle_message read tag failed 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff792d76640 1 --1- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 0x7ff79413db50 :-1 s=OPENED pgs=75 cs=1 l=1).fault on lossy channel, failing 2026-02-17T12:05:56.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:56.898+0000 7ff791573640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.51:6789/0 2026-02-17T12:05:57.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.097+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 msgr2=0x7ff79409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.097+0000 7ff792575640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.142:6789/0 conn(0x7ff7940a3bb0 legacy=0x7ff79409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:57.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.097+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:57.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.498+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 msgr2=0x7ff79409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:57.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.498+0000 7ff792575640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.142:6789/0 conn(0x7ff7940a3bb0 legacy=0x7ff79409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:57.500 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:57.498+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:57.603 INFO:tasks.rados.rados.0.trial142.stdout:3348: done (0 left) 2026-02-17T12:05:57.603 INFO:tasks.rados.rados.0.trial142.stdout:3349: delete oid 30 current snap is 372 2026-02-17T12:05:57.607 INFO:tasks.rados.rados.0.trial142.stdout:3349: done (0 left) 2026-02-17T12:05:57.608 INFO:tasks.rados.rados.0.trial142.stdout:3350: delete oid 38 current snap is 372 2026-02-17T12:05:57.609 INFO:tasks.rados.rados.0.trial142.stdout:3350: done (0 left) 2026-02-17T12:05:57.609 INFO:tasks.rados.rados.0.trial142.stdout:3351: write oid 25 current snap is 372 2026-02-17T12:05:57.609 INFO:tasks.rados.rados.0.trial142.stdout:3351: seq_num 1150 ranges {528050=505653,1612057=524731,2614324=567403} 2026-02-17T12:05:57.613 INFO:tasks.rados.rados.0.trial142.stdout:3351: writing trial14245205-25 from 528050 to 1033703 tid 1 2026-02-17T12:05:57.617 INFO:tasks.rados.rados.0.trial142.stdout:3351: writing trial14245205-25 from 1612057 to 2136788 tid 2 2026-02-17T12:05:57.621 INFO:tasks.rados.rados.0.trial142.stdout:3351: writing trial14245205-25 from 2614324 to 3181727 tid 3 2026-02-17T12:05:57.621 INFO:tasks.rados.rados.0.trial142.stdout:3352: delete oid 29 current snap is 372 2026-02-17T12:05:57.621 INFO:tasks.rados.rados.0.trial142.stdout:3351: finishing write tid 1 to trial14245205-25 2026-02-17T12:05:57.621 INFO:tasks.rados.rados.0.trial142.stdout:3351: finishing write tid 2 to trial14245205-25 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3352: done (1 left) 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3353: snap_create 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3351: finishing write tid 3 to trial14245205-25 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3351: finishing write tid 4 to trial14245205-25 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3351: finishing write tid 5 to trial14245205-25 2026-02-17T12:05:57.623 INFO:tasks.rados.rados.0.trial142.stdout:3351: oid 25 updating version 0 to 2726 2026-02-17T12:05:57.624 INFO:tasks.rados.rados.0.trial142.stdout:3351: oid 25 updating version 2726 to 2727 2026-02-17T12:05:57.624 INFO:tasks.rados.rados.0.trial142.stdout:3351: oid 25 version 2727 is already newer than 2724 2026-02-17T12:05:57.624 INFO:tasks.rados.rados.0.trial142.stdout:3351: oid 25 version 2727 is already newer than 2725 2026-02-17T12:05:57.624 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2727 (ObjNum 1150 snap 372 seq_num 1150) dirty exists 2026-02-17T12:05:57.624 INFO:tasks.rados.rados.0.trial142.stdout:3351: left oid 25 (ObjNum 1150 snap 372 seq_num 1150) 2026-02-17T12:05:58.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:58.299+0000 7ff792575640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.142:6789/0 conn(0x7ff7940a3bb0 legacy=0x7ff79409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:05:58.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:58.299+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 msgr2=0x7ff79409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:58.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:58.299+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:58.810 INFO:tasks.rados.rados.0.trial142.stdout:3351: done (1 left) 2026-02-17T12:05:58.811 INFO:tasks.rados.rados.0.trial142.stdout:3353: done (0 left) 2026-02-17T12:05:58.811 INFO:tasks.rados.rados.0.trial142.stdout:3354: write oid 26 current snap is 373 2026-02-17T12:05:58.811 INFO:tasks.rados.rados.0.trial142.stdout:3354: seq_num 1152 ranges {561664=656151,1729021=528400,2669170=692494} 2026-02-17T12:05:58.815 INFO:tasks.rados.rados.0.trial142.stdout:3354: writing trial14245205-26 from 561664 to 1217815 tid 1 2026-02-17T12:05:58.819 INFO:tasks.rados.rados.0.trial142.stdout:3354: writing trial14245205-26 from 1729021 to 2257421 tid 2 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3354: writing trial14245205-26 from 2669170 to 3361664 tid 3 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3355: copy_from oid 7 from oid 23 current snap is 373 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3354: finishing write tid 1 to trial14245205-26 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3354: finishing write tid 2 to trial14245205-26 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3356: read oid 36 snap -1 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3356: expect deleted 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3357: write (excl) oid 14 current snap is 373 2026-02-17T12:05:58.824 INFO:tasks.rados.rados.0.trial142.stdout:3357: seq_num 1153 ranges {578471=731400,1787503=672058,3096593=281878} 2026-02-17T12:05:58.828 INFO:tasks.rados.rados.0.trial142.stdout:3357: writing trial14245205-14 from 578471 to 1309871 tid 1 2026-02-17T12:05:58.833 INFO:tasks.rados.rados.0.trial142.stdout:3357: writing trial14245205-14 from 1787503 to 2459561 tid 2 2026-02-17T12:05:58.837 INFO:tasks.rados.rados.0.trial142.stdout:3357: writing trial14245205-14 from 3096593 to 3378471 tid 3 2026-02-17T12:05:58.837 INFO:tasks.rados.rados.0.trial142.stdout:3358: delete oid 46 current snap is 373 2026-02-17T12:05:58.837 INFO:tasks.rados.rados.0.trial142.stdout:3354: finishing write tid 3 to trial14245205-26 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: finishing write tid 4 to trial14245205-26 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: finishing write tid 5 to trial14245205-26 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: oid 26 updating version 0 to 2729 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: oid 26 updating version 2729 to 2731 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: oid 26 version 2731 is already newer than 2730 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: oid 26 version 2731 is already newer than 2728 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2731 (ObjNum 1152 snap 373 seq_num 1152) dirty exists 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3354: left oid 26 (ObjNum 1152 snap 373 seq_num 1152) 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3355: finishing copy_from racing read to trial14245205-7 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3355: finishing copy_from to trial14245205-7 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 2714 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3357: finishing write tid 1 to trial14245205-14 2026-02-17T12:05:58.838 INFO:tasks.rados.rados.0.trial142.stdout:3357: finishing write tid 2 to trial14245205-14 2026-02-17T12:05:58.839 INFO:tasks.rados.rados.0.trial142.stdout:3357: finishing write tid 3 to trial14245205-14 2026-02-17T12:05:58.840 INFO:tasks.rados.rados.0.trial142.stdout:3357: finishing write tid 4 to trial14245205-14 2026-02-17T12:05:58.840 INFO:tasks.rados.rados.0.trial142.stdout:3357: finishing write tid 5 to trial14245205-14 2026-02-17T12:05:58.840 INFO:tasks.rados.rados.0.trial142.stdout:3357: oid 14 updating version 0 to 3120 2026-02-17T12:05:58.840 INFO:tasks.rados.rados.0.trial142.stdout:3357: oid 14 version 3120 is already newer than 3119 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3357: oid 14 updating version 3120 to 3121 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3357: oid 14 updating version 3121 to 3122 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3122 (ObjNum 1153 snap 373 seq_num 1153) dirty exists 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3357: left oid 14 (ObjNum 1153 snap 373 seq_num 1153) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3354: done (4 left) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3355: done (3 left) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3356: done (2 left) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3357: done (1 left) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3358: done (0 left) 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3359: copy_from oid 16 from oid 39 current snap is 373 2026-02-17T12:05:58.841 INFO:tasks.rados.rados.0.trial142.stdout:3360: delete oid 8 current snap is 373 2026-02-17T12:05:58.842 INFO:tasks.rados.rados.0.trial142.stdout:3359: finishing copy_from to trial14245205-16 2026-02-17T12:05:58.842 INFO:tasks.rados.rados.0.trial142.stdout:3359: got expected ENOENT (src dne) 2026-02-17T12:05:58.842 INFO:tasks.rados.rados.0.trial142.stdout:3359: finishing copy_from racing read to trial14245205-16 2026-02-17T12:05:58.842 INFO:tasks.rados.rados.0.trial142.stdout:3359: done (1 left) 2026-02-17T12:05:58.843 INFO:tasks.rados.rados.0.trial142.stdout:3360: done (0 left) 2026-02-17T12:05:58.843 INFO:tasks.rados.rados.0.trial142.stdout:3361: snap_create 2026-02-17T12:05:59.812 INFO:tasks.rados.rados.0.trial142.stdout:3361: done (0 left) 2026-02-17T12:05:59.812 INFO:tasks.rados.rados.0.trial142.stdout:3362: copy_from oid 45 from oid 5 current snap is 374 2026-02-17T12:05:59.813 INFO:tasks.rados.rados.0.trial142.stdout:3363: delete oid 39 current snap is 374 2026-02-17T12:05:59.814 INFO:tasks.rados.rados.0.trial142.stdout:3363: done (1 left) 2026-02-17T12:05:59.814 INFO:tasks.rados.rados.0.trial142.stdout:3364: write oid 50 current snap is 374 2026-02-17T12:05:59.814 INFO:tasks.rados.rados.0.trial142.stdout:3364: seq_num 1157 ranges {645699=748749,2021431=679396,3206285=239414} 2026-02-17T12:05:59.820 INFO:tasks.rados.rados.0.trial142.stdout:3364: writing trial14245205-50 from 645699 to 1394448 tid 1 2026-02-17T12:05:59.825 INFO:tasks.rados.rados.0.trial142.stdout:3364: writing trial14245205-50 from 2021431 to 2700827 tid 2 2026-02-17T12:05:59.828 INFO:tasks.rados.rados.0.trial142.stdout:3364: writing trial14245205-50 from 3206285 to 3445699 tid 3 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3365: rollback oid 11 current snap is 374 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 358 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3362: finishing copy_from racing read to trial14245205-45 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3362: finishing copy_from to trial14245205-45 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2549 (ObjNum 1119 snap 365 seq_num 1119) dirty exists 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3364: finishing write tid 1 to trial14245205-50 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3362: done (2 left) 2026-02-17T12:05:59.829 INFO:tasks.rados.rados.0.trial142.stdout:3366: write (excl) oid 26 current snap is 374 2026-02-17T12:05:59.830 INFO:tasks.rados.rados.0.trial142.stdout:3366: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2026-02-17T12:05:59.832 INFO:tasks.rados.rados.0.trial142.stdout:3366: writing trial14245205-26 from 662506 to 1086504 tid 1 2026-02-17T12:05:59.836 INFO:tasks.rados.rados.0.trial142.stdout:3366: writing trial14245205-26 from 1563560 to 2102967 tid 2 2026-02-17T12:05:59.840 INFO:tasks.rados.rados.0.trial142.stdout:3366: writing trial14245205-26 from 2717355 to 3207640 tid 3 2026-02-17T12:05:59.840 INFO:tasks.rados.rados.0.trial142.stdout:3367: write oid 49 current snap is 374 2026-02-17T12:05:59.840 INFO:tasks.rados.rados.0.trial142.stdout:3364: finishing write tid 2 to trial14245205-50 2026-02-17T12:05:59.840 INFO:tasks.rados.rados.0.trial142.stdout:3365: finishing rollback tid 0 to trial14245205-11 2026-02-17T12:05:59.840 INFO:tasks.rados.rados.0.trial142.stdout:3364: finishing write tid 3 to trial14245205-50 2026-02-17T12:05:59.841 INFO:tasks.rados.rados.0.trial142.stdout:3364: finishing write tid 4 to trial14245205-50 2026-02-17T12:05:59.841 INFO:tasks.rados.rados.0.trial142.stdout:3367: seq_num 1159 ranges {679313=499247,1622042=683065,2744778=701557} 2026-02-17T12:05:59.844 INFO:tasks.rados.rados.0.trial142.stdout:3367: writing trial14245205-49 from 679313 to 1178560 tid 1 2026-02-17T12:05:59.848 INFO:tasks.rados.rados.0.trial142.stdout:3367: writing trial14245205-49 from 1622042 to 2305107 tid 2 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3367: writing trial14245205-49 from 2744778 to 3446335 tid 3 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3368: write oid 46 current snap is 374 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3364: finishing write tid 5 to trial14245205-50 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3364: oid 50 updating version 0 to 2734 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3364: oid 50 updating version 2734 to 2735 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3364: oid 50 version 2735 is already newer than 2732 2026-02-17T12:05:59.853 INFO:tasks.rados.rados.0.trial142.stdout:3364: oid 50 version 2735 is already newer than 2733 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2735 (ObjNum 1157 snap 374 seq_num 1157) dirty exists 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3364: left oid 50 (ObjNum 1157 snap 374 seq_num 1157) 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3365: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 2172 (ObjNum 65 snap 0 seq_num 321759979) dirty dne 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3366: finishing write tid 1 to trial14245205-26 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3366: finishing write tid 2 to trial14245205-26 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3366: finishing write tid 3 to trial14245205-26 2026-02-17T12:05:59.854 INFO:tasks.rados.rados.0.trial142.stdout:3368: seq_num 1160 ranges {696120=574496,1680524=543076,2888554=512829} 2026-02-17T12:05:59.859 INFO:tasks.rados.rados.0.trial142.stdout:3368: writing trial14245205-46 from 696120 to 1270616 tid 1 2026-02-17T12:05:59.862 INFO:tasks.rados.rados.0.trial142.stdout:3368: writing trial14245205-46 from 1680524 to 2223600 tid 2 2026-02-17T12:05:59.868 INFO:tasks.rados.rados.0.trial142.stdout:3368: writing trial14245205-46 from 2888554 to 3401383 tid 3 2026-02-17T12:05:59.868 INFO:tasks.rados.rados.0.trial142.stdout:3364: done (4 left) 2026-02-17T12:05:59.868 INFO:tasks.rados.rados.0.trial142.stdout:3365: done (3 left) 2026-02-17T12:05:59.868 INFO:tasks.rados.rados.0.trial142.stdout:3369: read oid 16 snap -1 2026-02-17T12:05:59.868 INFO:tasks.rados.rados.0.trial142.stdout:3369: expect deleted 2026-02-17T12:05:59.869 INFO:tasks.rados.rados.0.trial142.stdout:3370: snap_remove snap 354 2026-02-17T12:05:59.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): tick 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 monclient(hunting): continuing hunt 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 -- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 msgr2=0x7ff79409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.142:3300/0 conn(0x7ff7940a0750 0x7ff79409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.142:6789/0 conn(0x7ff7940a3bb0 legacy=0x7ff79409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 -- 10.20.193.51:0/1771459905 >> v1:10.20.193.51:6789/0 conn(0x7ff79413b760 legacy=0x7ff79413db50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient: _add_conns ranks=[3,2] 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.51:3300/0 conn(0x7ff7700036f0 0x7ff770005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): picked mon.noname-a con 0x7ff7700036f0 addr v2:10.20.193.51:3300/0 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 --2- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7700086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): picked mon.noname-b con 0x7ff770006200 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 -- 10.20.193.51:0/1771459905 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff79409ccd0 con 0x7ff7700036f0 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 1 -- 10.20.193.51:0/1771459905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff770008da0 con 0x7ff770006200 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff77bfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7700086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.51:3300/0 conn(0x7ff7700036f0 0x7ff770005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): get_auth_request con 0x7ff770006200 auth_method 0 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): get_auth_request con 0x7ff7700036f0 auth_method 0 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient(hunting): handle_auth_done global_id 234368 payload 274 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 >> v2:10.20.193.51:3300/0 conn(0x7ff7700036f0 msgr2=0x7ff770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> v2:10.20.193.51:3300/0 conn(0x7ff7700036f0 0x7ff770005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 1 monclient: found mon.noname-b 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.897+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79409eec0 con 0x7ff770006200 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791d74640 1 -- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 msgr2=0x7ff7700086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791d74640 1 --2- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7700086c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003a30 tx=0x7ff77c02f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f4646cc80be867 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 1 -- 10.20.193.51:0/1771459905 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c005480 con 0x7ff770006200 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:59.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: dump: 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: _finish_auth 0 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 1 -- 10.20.193.51:0/1771459905 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c005640 con 0x7ff770006200 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 1 -- 10.20.193.51:0/1771459905 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c005a30 con 0x7ff770006200 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 5 monclient: authenticate success, global_id 234368 2026-02-17T12:05:59.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 4 set_mon_vals no callback set 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff791573640 10 monclient: dump: 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 10 monclient: shutdown 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 1 -- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 msgr2=0x7ff7700086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 1 --2- 10.20.193.51:0/1771459905 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7700086c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003a30 tx=0x7ff77c02f7d0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff792d76640 1 -- 10.20.193.51:0/1771459905 reap_dead start 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 1 -- 10.20.193.51:0/1771459905 shutdown_connections 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 1 -- 10.20.193.51:0/1771459905 >> 10.20.193.51:0/1771459905 conn(0x7ff7940a30c0 msgr2=0x7ff7940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.899+0000 7ff798cfa640 1 -- 10.20.193.51:0/1771459905 shutdown_connections 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 -- 10.20.193.51:0/1771459905 wait complete. 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient: build_initial_monmap 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient: monmap: 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 Processor -- start 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 -- start start 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient: init 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7941311e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-c con 0x7ff770006200 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff794131720 0x7ff794131b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-b con 0x7ff794131720 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff794132080 0x7ff7941d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): picked mon.noname-a con 0x7ff794132080 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff7940a04b0 con 0x7ff794132080 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff79409c850 con 0x7ff794131720 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff79409e710 con 0x7ff770006200 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:59.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.900+0000 7ff798cfa640 10 monclient(hunting): authenticate will time out at 1847.519986s 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7941311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff791d74640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff794131720 msgr2=0x7ff794131b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff791d74640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff794131720 0x7ff794131b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7941311e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37652/0 (socket says 10.20.193.51:37652) 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 -- 10.20.193.51:0/1491713967 learned_addr learned my addr 10.20.193.51:0/1491713967 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): get_auth_request con 0x7ff770006200 auth_method 0 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff794132080 0x7ff7941d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): get_auth_request con 0x7ff794132080 auth_method 0 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient(hunting): handle_auth_done global_id 234371 payload 824 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff794131720 msgr2=0x7ff794131b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff794131720 0x7ff794131b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff794132080 msgr2=0x7ff7941d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff794132080 0x7ff7941d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 monclient: found mon.noname-c 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792575640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7940a20a0 con 0x7ff770006200 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.901+0000 7ff792d76640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff794132080 0x7ff7941d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff792575640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 msgr2=0x7ff7941311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff792575640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7941311e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff78800be70 tx=0x7ff788007660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78801a070 con 0x7ff770006200 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:59.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: dump: 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: _finish_auth 0 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788005500 con 0x7ff770006200 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 5 monclient: authenticate success, global_id 234371 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 10 monclient: _renew_subs 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:59.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79409d7b0 con 0x7ff770006200 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7880058f0 con 0x7ff770006200 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff790d72640 4 set_mon_vals no callback set 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff77affd640 10 monclient: dump: 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 10 monclient: _renew_subs 2026-02-17T12:05:59.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.903+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7941345a0 con 0x7ff770006200 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff7880143e0 con 0x7ff770006200 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff798cfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff798cfa640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 0x7ff79412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff79409dac0 con 0x7ff79412d690 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff77affd640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff76003dcc0 0x7ff760040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 0x7ff79412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient: get_auth_request con 0x7ff79412d690 auth_method 0 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(762..762 src has 323..762) ==== 4767+0+0 (secure 0 0 0) 0x7ff7880530c0 con 0x7ff770006200 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 10 monclient(hunting): handle_auth_done global_id 234374 payload 824 2026-02-17T12:05:59.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff792d76640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff76003dcc0 0x7ff760040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff791d74640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff794069830 con 0x7ff79412d690 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.904+0000 7ff792d76640 10 monclient: get_auth_request con 0x7ff76003dcc0 auth_method 0 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff791d74640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 msgr2=0x7ff79412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff791d74640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 0x7ff79412da70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff77c037000 tx=0x7ff77c005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c046020 con 0x7ff79412d690 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 10 monclient: dump: 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.924 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff77c005a80 con 0x7ff79412d690 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.906+0000 7ff77affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff77affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 msgr2=0x7ff79412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff77affd640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 0x7ff79412da70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff77c037000 tx=0x7ff77c005d70 comp rx=0 tx=0).stop 2026-02-17T12:05:59.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 msgr2=0x7ff79412da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:59.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff77affd640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412d690 0x7ff79412da70 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff77c037000 tx=0x7ff77c005d70 comp rx=0 tx=0).stop 2026-02-17T12:05:59.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.907+0000 7ff792d76640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff76003dcc0 0x7ff760040180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff794077090 tx=0x7ff7840033b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff798cfa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff798cfa640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 0x7ff7941d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:59.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff798cfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff7941347a0 con 0x7ff79412dfb0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 0x7ff7941d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient: get_auth_request con 0x7ff79412dfb0 auth_method 0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 10 monclient(hunting): handle_auth_done global_id 234377 payload 824 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.910+0000 7ff791d74640 1 -- 10.20.193.51:0/1491713967 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff794050ac0 con 0x7ff79412dfb0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff791d74640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 msgr2=0x7ff7941d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff791d74640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 0x7ff7941d9df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff77c02f810 tx=0x7ff77c009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c046050 con 0x7ff79412dfb0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:59.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 10 monclient: dump: 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7ff77c057420 con 0x7ff79412dfb0 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 msgr2=0x7ff7941d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 0x7ff7941d9df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff77c02f810 tx=0x7ff77c009670 comp rx=0 tx=0).stop 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 msgr2=0x7ff7941d9df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:59.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff77affd640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff79412dfb0 0x7ff7941d9df0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff77c02f810 tx=0x7ff77c009670 comp rx=0 tx=0).stop 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 194, 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 136907, 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:59.930 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:59.931 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:05:59.932 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:05:59.933 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:05:59.934 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.935 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:05:59.936 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:05:59.937 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:05:59.938 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.939 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:05:59.940 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:05:59.941 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff76003dcc0 msgr2=0x7ff760040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff76003dcc0 0x7ff760040180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff794077090 tx=0x7ff7840033b0 comp rx=0 tx=0).stop 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 10 monclient: shutdown 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 msgr2=0x7ff7941311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 --2- 10.20.193.51:0/1491713967 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff770006200 0x7ff7941311e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff78800be70 tx=0x7ff788007660 comp rx=0 tx=0).stop 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff792d76640 1 -- 10.20.193.51:0/1491713967 reap_dead start 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff792d76640 1 -- 10.20.193.51:0/1491713967 reap_dead start 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 shutdown_connections 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 >> 10.20.193.51:0/1491713967 conn(0x7ff7940a30c0 msgr2=0x7ff79413a170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.912+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 shutdown_connections 2026-02-17T12:05:59.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:05:59.913+0000 7ff798cfa640 1 -- 10.20.193.51:0/1491713967 wait complete. 2026-02-17T12:05:59.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:59.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:06:00.817 INFO:tasks.rados.rados.0.trial142.stdout:3370: done (4 left) 2026-02-17T12:06:00.817 INFO:tasks.rados.rados.0.trial142.stdout:3371: write (excl) oid 39 current snap is 374 2026-02-17T12:06:00.817 INFO:tasks.rados.rados.0.trial142.stdout:3371: seq_num 1161 ranges {712927=649745,2139006=686734} 2026-02-17T12:06:00.822 INFO:tasks.rados.rados.0.trial142.stdout:3371: writing trial14245205-39 from 712927 to 1362672 tid 1 2026-02-17T12:06:00.827 INFO:tasks.rados.rados.0.trial142.stdout:3371: writing trial14245205-39 from 2139006 to 2825740 tid 2 2026-02-17T12:06:00.828 INFO:tasks.rados.rados.0.trial142.stdout:3372: snap_remove snap 369 2026-02-17T12:06:01.021 INFO:tasks.rados.rados.0.trial142.stdout:3372: done (5 left) 2026-02-17T12:06:01.021 INFO:tasks.rados.rados.0.trial142.stdout:3373: copy_from oid 11 from oid 4 current snap is 374 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: finishing write tid 4 to trial14245205-26 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: finishing write tid 5 to trial14245205-26 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: oid 26 updating version 0 to 2738 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: oid 26 version 2738 is already newer than 2737 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: oid 26 version 2738 is already newer than 2736 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: oid 26 updating version 2738 to 2739 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2739 (ObjNum 1158 snap 374 seq_num 1158) dirty exists 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: left oid 26 (ObjNum 1158 snap 374 seq_num 1158) 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3366: done (5 left) 2026-02-17T12:06:01.022 INFO:tasks.rados.rados.0.trial142.stdout:3374: snap_remove snap 352 2026-02-17T12:06:01.966 INFO:tasks.rados.rados.0.trial142.stdout:3374: done (5 left) 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3375: delete oid 26 current snap is 374 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: finishing write tid 1 to trial14245205-49 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: finishing write tid 2 to trial14245205-49 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: finishing write tid 3 to trial14245205-49 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: finishing write tid 4 to trial14245205-49 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: finishing write tid 5 to trial14245205-49 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: oid 49 updating version 0 to 3127 2026-02-17T12:06:01.967 INFO:tasks.rados.rados.0.trial142.stdout:3367: oid 49 version 3127 is already newer than 3126 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3367: oid 49 updating version 3127 to 3128 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3367: oid 49 updating version 3128 to 3129 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3129 (ObjNum 1159 snap 374 seq_num 1159) dirty exists 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3367: left oid 49 (ObjNum 1159 snap 374 seq_num 1159) 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: finishing write tid 1 to trial14245205-46 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: finishing write tid 2 to trial14245205-46 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: finishing write tid 3 to trial14245205-46 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: finishing write tid 4 to trial14245205-46 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: finishing write tid 5 to trial14245205-46 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: oid 46 updating version 0 to 3130 2026-02-17T12:06:01.968 INFO:tasks.rados.rados.0.trial142.stdout:3368: oid 46 updating version 3130 to 3131 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3368: oid 46 updating version 3131 to 3132 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3368: oid 46 updating version 3132 to 3133 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3133 (ObjNum 1160 snap 374 seq_num 1160) dirty exists 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3368: left oid 46 (ObjNum 1160 snap 374 seq_num 1160) 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: finishing write tid 1 to trial14245205-39 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: finishing write tid 2 to trial14245205-39 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: finishing write tid 3 to trial14245205-39 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: finishing write tid 4 to trial14245205-39 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: oid 39 updating version 0 to 2167 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: oid 39 version 2167 is already newer than 2166 2026-02-17T12:06:01.969 INFO:tasks.rados.rados.0.trial142.stdout:3371: oid 39 version 2167 is already newer than 2165 2026-02-17T12:06:01.970 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2167 (ObjNum 1161 snap 374 seq_num 1161) dirty exists 2026-02-17T12:06:01.970 INFO:tasks.rados.rados.0.trial142.stdout:3371: left oid 39 (ObjNum 1161 snap 374 seq_num 1161) 2026-02-17T12:06:01.970 INFO:tasks.rados.rados.0.trial142.stdout:3373: finishing copy_from racing read to trial14245205-11 2026-02-17T12:06:01.970 INFO:tasks.rados.rados.0.trial142.stdout:3373: finishing copy_from to trial14245205-11 2026-02-17T12:06:01.970 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3037 (ObjNum 1106 snap 358 seq_num 1106) dirty exists 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3367: done (5 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3368: done (4 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3369: done (3 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3371: done (2 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3373: done (1 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3375: done (0 left) 2026-02-17T12:06:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3376: snap_create 2026-02-17T12:06:02.965 INFO:tasks.rados.rados.0.trial142.stdout:3376: done (0 left) 2026-02-17T12:06:02.965 INFO:tasks.rados.rados.0.trial142.stdout:3377: snap_create 2026-02-17T12:06:03.966 INFO:tasks.rados.rados.0.trial142.stdout:3377: done (0 left) 2026-02-17T12:06:03.966 INFO:tasks.rados.rados.0.trial142.stdout:3378: rollback oid 47 current snap is 376 2026-02-17T12:06:03.966 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 370 2026-02-17T12:06:03.966 INFO:tasks.rados.rados.0.trial142.stdout:3379: write (excl) oid 3 current snap is 376 2026-02-17T12:06:03.966 INFO:tasks.rados.rados.0.trial142.stdout:3379: seq_num 1163 ranges {746541=400243,1739617=690403,3138117=408424} 2026-02-17T12:06:03.970 INFO:tasks.rados.rados.0.trial142.stdout:3379: writing trial14245205-3 from 746541 to 1146784 tid 1 2026-02-17T12:06:03.975 INFO:tasks.rados.rados.0.trial142.stdout:3379: writing trial14245205-3 from 1739617 to 2430020 tid 2 2026-02-17T12:06:03.979 INFO:tasks.rados.rados.0.trial142.stdout:3379: writing trial14245205-3 from 3138117 to 3546541 tid 3 2026-02-17T12:06:03.980 INFO:tasks.rados.rados.0.trial142.stdout:3380: write (excl) oid 26 current snap is 376 2026-02-17T12:06:03.980 INFO:tasks.rados.rados.0.trial142.stdout:3380: seq_num 1164 ranges {763348=591845,1914452=434061,2881893=674270} 2026-02-17T12:06:03.984 INFO:tasks.rados.rados.0.trial142.stdout:3380: writing trial14245205-26 from 763348 to 1355193 tid 1 2026-02-17T12:06:03.988 INFO:tasks.rados.rados.0.trial142.stdout:3380: writing trial14245205-26 from 1914452 to 2348513 tid 2 2026-02-17T12:06:03.993 INFO:tasks.rados.rados.0.trial142.stdout:3380: writing trial14245205-26 from 2881893 to 3556163 tid 3 2026-02-17T12:06:03.993 INFO:tasks.rados.rados.0.trial142.stdout:3381: delete oid 15 current snap is 376 2026-02-17T12:06:03.993 INFO:tasks.rados.rados.0.trial142.stdout:3378: finishing rollback tid 0 to trial14245205-47 2026-02-17T12:06:03.993 INFO:tasks.rados.rados.0.trial142.stdout:3378: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:06:03.993 INFO:tasks.rados.rados.0.trial142.stdout:3378: finishing rollback tid 2 to trial14245205-47 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 2731 (ObjNum 1110 snap 361 seq_num 1110) dirty exists 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: finishing write tid 1 to trial14245205-3 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: finishing write tid 2 to trial14245205-3 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: finishing write tid 3 to trial14245205-3 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: finishing write tid 4 to trial14245205-3 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: finishing write tid 5 to trial14245205-3 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: oid 3 updating version 0 to 2731 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: oid 3 updating version 2731 to 2733 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: oid 3 version 2733 is already newer than 2730 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:3379: oid 3 version 2733 is already newer than 2732 2026-02-17T12:06:03.994 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2733 (ObjNum 1163 snap 376 seq_num 1163) dirty exists 2026-02-17T12:06:03.995 INFO:tasks.rados.rados.0.trial142.stdout:3379: left oid 3 (ObjNum 1163 snap 376 seq_num 1163) 2026-02-17T12:06:03.995 INFO:tasks.rados.rados.0.trial142.stdout:3380: finishing write tid 1 to trial14245205-26 2026-02-17T12:06:03.995 INFO:tasks.rados.rados.0.trial142.stdout:3380: finishing write tid 2 to trial14245205-26 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3378: done (3 left) 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3379: done (2 left) 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3381: done (1 left) 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3382: snap_create 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: finishing write tid 3 to trial14245205-26 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: finishing write tid 4 to trial14245205-26 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: finishing write tid 5 to trial14245205-26 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: oid 26 updating version 0 to 2744 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: oid 26 version 2744 is already newer than 2743 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: oid 26 version 2744 is already newer than 2742 2026-02-17T12:06:03.996 INFO:tasks.rados.rados.0.trial142.stdout:3380: oid 26 version 2744 is already newer than 2741 2026-02-17T12:06:03.997 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2744 (ObjNum 1164 snap 376 seq_num 1164) dirty exists 2026-02-17T12:06:03.997 INFO:tasks.rados.rados.0.trial142.stdout:3380: left oid 26 (ObjNum 1164 snap 376 seq_num 1164) 2026-02-17T12:06:04.969 INFO:tasks.rados.rados.0.trial142.stdout:3380: done (1 left) 2026-02-17T12:06:04.970 INFO:tasks.rados.rados.0.trial142.stdout:3382: done (0 left) 2026-02-17T12:06:04.970 INFO:tasks.rados.rados.0.trial142.stdout:3383: delete oid 17 current snap is 377 2026-02-17T12:06:04.973 INFO:tasks.rados.rados.0.trial142.stdout:3383: done (0 left) 2026-02-17T12:06:04.973 INFO:tasks.rados.rados.0.trial142.stdout:3384: rollback oid 1 current snap is 377 2026-02-17T12:06:04.973 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 374 2026-02-17T12:06:04.973 INFO:tasks.rados.rados.0.trial142.stdout:3385: write (excl) oid 40 current snap is 377 2026-02-17T12:06:04.973 INFO:tasks.rados.rados.0.trial142.stdout:3385: seq_num 1167 ranges {413769=417592,1573545=697741,2847809=624439} 2026-02-17T12:06:04.976 INFO:tasks.rados.rados.0.trial142.stdout:3385: writing trial14245205-40 from 413769 to 831361 tid 1 2026-02-17T12:06:04.981 INFO:tasks.rados.rados.0.trial142.stdout:3385: writing trial14245205-40 from 1573545 to 2271286 tid 2 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:3385: writing trial14245205-40 from 2847809 to 3472248 tid 3 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:3386: snap_create 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:3384: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 2707 (ObjNum 129 snap 0 seq_num 1213726144) dirty dne 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:3385: finishing write tid 1 to trial14245205-40 2026-02-17T12:06:04.986 INFO:tasks.rados.rados.0.trial142.stdout:3385: finishing write tid 2 to trial14245205-40 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: finishing write tid 3 to trial14245205-40 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: finishing write tid 4 to trial14245205-40 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: finishing write tid 5 to trial14245205-40 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: oid 40 updating version 0 to 2534 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: oid 40 version 2534 is already newer than 2532 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: oid 40 version 2534 is already newer than 2533 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:3385: oid 40 version 2534 is already newer than 2531 2026-02-17T12:06:04.988 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 2534 (ObjNum 1167 snap 377 seq_num 1167) dirty exists 2026-02-17T12:06:04.989 INFO:tasks.rados.rados.0.trial142.stdout:3385: left oid 40 (ObjNum 1167 snap 377 seq_num 1167) 2026-02-17T12:06:05.962 INFO:tasks.rados.rados.0.trial142.stdout:3384: done (2 left) 2026-02-17T12:06:05.963 INFO:tasks.rados.rados.0.trial142.stdout:3385: done (1 left) 2026-02-17T12:06:05.963 INFO:tasks.rados.rados.0.trial142.stdout:3386: done (0 left) 2026-02-17T12:06:05.963 INFO:tasks.rados.rados.0.trial142.stdout:3387: snap_remove snap 373 2026-02-17T12:06:06.963 INFO:tasks.rados.rados.0.trial142.stdout:3387: done (0 left) 2026-02-17T12:06:06.964 INFO:tasks.rados.rados.0.trial142.stdout:3388: copy_from oid 44 from oid 14 current snap is 378 2026-02-17T12:06:06.964 INFO:tasks.rados.rados.0.trial142.stdout:3389: write (excl) oid 3 current snap is 378 2026-02-17T12:06:06.964 INFO:tasks.rados.rados.0.trial142.stdout:3389: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2026-02-17T12:06:06.967 INFO:tasks.rados.rados.0.trial142.stdout:3389: writing trial14245205-3 from 430576 to 923417 tid 1 2026-02-17T12:06:06.972 INFO:tasks.rados.rados.0.trial142.stdout:3389: writing trial14245205-3 from 1632027 to 2073426 tid 2 2026-02-17T12:06:06.975 INFO:tasks.rados.rados.0.trial142.stdout:3389: writing trial14245205-3 from 2475232 to 2910943 tid 3 2026-02-17T12:06:06.978 INFO:tasks.rados.rados.0.trial142.stdout:3389: writing trial14245205-3 from 3365397 to 3630576 tid 4 2026-02-17T12:06:06.978 INFO:tasks.rados.rados.0.trial142.stdout:3390: rollback oid 7 current snap is 378 2026-02-17T12:06:06.978 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 372 2026-02-17T12:06:06.978 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 1 to trial14245205-3 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 2 to trial14245205-3 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3388: finishing copy_from racing read to trial14245205-44 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3388: finishing copy_from to trial14245205-44 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3122 (ObjNum 1153 snap 373 seq_num 1153) dirty exists 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 3 to trial14245205-3 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3388: done (2 left) 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3391: write oid 27 current snap is 378 2026-02-17T12:06:06.979 INFO:tasks.rados.rados.0.trial142.stdout:3391: seq_num 1169 ranges {447383=568090,1690509=701410,2902655=646983} 2026-02-17T12:06:06.982 INFO:tasks.rados.rados.0.trial142.stdout:3391: writing trial14245205-27 from 447383 to 1015473 tid 1 2026-02-17T12:06:06.987 INFO:tasks.rados.rados.0.trial142.stdout:3391: writing trial14245205-27 from 1690509 to 2391919 tid 2 2026-02-17T12:06:06.991 INFO:tasks.rados.rados.0.trial142.stdout:3391: writing trial14245205-27 from 2902655 to 3549638 tid 3 2026-02-17T12:06:06.991 INFO:tasks.rados.rados.0.trial142.stdout:3392: write (excl) oid 8 current snap is 378 2026-02-17T12:06:06.991 INFO:tasks.rados.rados.0.trial142.stdout:3392: seq_num 1170 ranges {464190=643339,1748991=445068,2930078=574608} 2026-02-17T12:06:06.995 INFO:tasks.rados.rados.0.trial142.stdout:3392: writing trial14245205-8 from 464190 to 1107529 tid 1 2026-02-17T12:06:06.999 INFO:tasks.rados.rados.0.trial142.stdout:3392: writing trial14245205-8 from 1748991 to 2194059 tid 2 2026-02-17T12:06:07.005 INFO:tasks.rados.rados.0.trial142.stdout:3392: writing trial14245205-8 from 2930078 to 3504686 tid 3 2026-02-17T12:06:07.005 INFO:tasks.rados.rados.0.trial142.stdout:3393: delete oid 25 current snap is 378 2026-02-17T12:06:07.005 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 4 to trial14245205-3 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 5 to trial14245205-3 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: finishing write tid 6 to trial14245205-3 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: oid 3 updating version 0 to 2736 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: oid 3 updating version 2736 to 2737 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: oid 3 updating version 2737 to 2738 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: oid 3 version 2738 is already newer than 2734 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: oid 3 version 2738 is already newer than 2735 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2738 (ObjNum 1168 snap 378 seq_num 1168) dirty exists 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3389: left oid 3 (ObjNum 1168 snap 378 seq_num 1168) 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3390: finishing rollback tid 0 to trial14245205-7 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3390: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:06:07.006 INFO:tasks.rados.rados.0.trial142.stdout:3390: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 3159 (ObjNum 979 snap 315 seq_num 979) dirty exists 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: finishing write tid 1 to trial14245205-27 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: finishing write tid 2 to trial14245205-27 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: finishing write tid 3 to trial14245205-27 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: finishing write tid 4 to trial14245205-27 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: finishing write tid 5 to trial14245205-27 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: oid 27 updating version 0 to 3073 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: oid 27 version 3073 is already newer than 3072 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: oid 27 updating version 3073 to 3075 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: oid 27 version 3075 is already newer than 3074 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 3075 (ObjNum 1169 snap 378 seq_num 1169) dirty exists 2026-02-17T12:06:07.007 INFO:tasks.rados.rados.0.trial142.stdout:3391: left oid 27 (ObjNum 1169 snap 378 seq_num 1169) 2026-02-17T12:06:07.008 INFO:tasks.rados.rados.0.trial142.stdout:3392: finishing write tid 1 to trial14245205-8 2026-02-17T12:06:07.008 INFO:tasks.rados.rados.0.trial142.stdout:3392: finishing write tid 2 to trial14245205-8 2026-02-17T12:06:07.008 INFO:tasks.rados.rados.0.trial142.stdout:3389: done (4 left) 2026-02-17T12:06:07.009 INFO:tasks.rados.rados.0.trial142.stdout:3390: done (3 left) 2026-02-17T12:06:07.009 INFO:tasks.rados.rados.0.trial142.stdout:3391: done (2 left) 2026-02-17T12:06:07.009 INFO:tasks.rados.rados.0.trial142.stdout:3393: done (1 left) 2026-02-17T12:06:07.009 INFO:tasks.rados.rados.0.trial142.stdout:3394: copy_from oid 41 from oid 35 current snap is 378 2026-02-17T12:06:07.009 INFO:tasks.rados.rados.0.trial142.stdout:3395: snap_remove snap 349 2026-02-17T12:06:07.974 INFO:tasks.rados.rados.0.trial142.stdout:3395: done (2 left) 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3396: snap_create 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: finishing write tid 3 to trial14245205-8 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: finishing write tid 4 to trial14245205-8 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: finishing write tid 5 to trial14245205-8 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: oid 8 updating version 0 to 3076 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: oid 8 updating version 3076 to 3079 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: oid 8 version 3079 is already newer than 3078 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: oid 8 version 3079 is already newer than 3077 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 3079 (ObjNum 1170 snap 378 seq_num 1170) dirty exists 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3392: left oid 8 (ObjNum 1170 snap 378 seq_num 1170) 2026-02-17T12:06:07.975 INFO:tasks.rados.rados.0.trial142.stdout:3394: finishing copy_from racing read to trial14245205-41 2026-02-17T12:06:07.976 INFO:tasks.rados.rados.0.trial142.stdout:3394: finishing copy_from to trial14245205-41 2026-02-17T12:06:07.976 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2737 (ObjNum 1092 snap 357 seq_num 1092) dirty exists 2026-02-17T12:06:08.976 INFO:tasks.rados.rados.0.trial142.stdout:3392: done (2 left) 2026-02-17T12:06:08.976 INFO:tasks.rados.rados.0.trial142.stdout:3394: done (1 left) 2026-02-17T12:06:08.976 INFO:tasks.rados.rados.0.trial142.stdout:3396: done (0 left) 2026-02-17T12:06:08.977 INFO:tasks.rados.rados.0.trial142.stdout:3397: copy_from oid 29 from oid 42 current snap is 379 2026-02-17T12:06:08.977 INFO:tasks.rados.rados.0.trial142.stdout:3398: snap_remove snap 374 2026-02-17T12:06:09.978 INFO:tasks.rados.rados.0.trial142.stdout:3398: done (1 left) 2026-02-17T12:06:09.979 INFO:tasks.rados.rados.0.trial142.stdout:3399: snap_create 2026-02-17T12:06:09.979 INFO:tasks.rados.rados.0.trial142.stdout:3397: finishing copy_from racing read to trial14245205-29 2026-02-17T12:06:09.979 INFO:tasks.rados.rados.0.trial142.stdout:3397: finishing copy_from to trial14245205-29 2026-02-17T12:06:09.979 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 2728 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:06:10.964 INFO:tasks.rados.rados.0.trial142.stdout:3397: done (1 left) 2026-02-17T12:06:10.964 INFO:tasks.rados.rados.0.trial142.stdout:3399: done (0 left) 2026-02-17T12:06:10.964 INFO:tasks.rados.rados.0.trial142.stdout:3400: read oid 22 snap -1 2026-02-17T12:06:10.965 INFO:tasks.rados.rados.0.trial142.stdout:3400: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:06:10.965 INFO:tasks.rados.rados.0.trial142.stdout:3401: write (excl) oid 48 current snap is 380 2026-02-17T12:06:10.965 INFO:tasks.rados.rados.0.trial142.stdout:3401: seq_num 1172 ranges {497804=510190,1465955=448737,2584924=597152} 2026-02-17T12:06:10.968 INFO:tasks.rados.rados.0.trial142.stdout:3401: writing trial14245205-48 from 497804 to 1007994 tid 1 2026-02-17T12:06:10.972 INFO:tasks.rados.rados.0.trial142.stdout:3401: writing trial14245205-48 from 1465955 to 1914692 tid 2 2026-02-17T12:06:10.978 INFO:tasks.rados.rados.0.trial142.stdout:3401: writing trial14245205-48 from 2584924 to 3182076 tid 3 2026-02-17T12:06:10.978 INFO:tasks.rados.rados.0.trial142.stdout:3402: snap_remove snap 363 2026-02-17T12:06:11.967 INFO:tasks.rados.rados.0.trial142.stdout:3402: done (2 left) 2026-02-17T12:06:11.967 INFO:tasks.rados.rados.0.trial142.stdout:3403: write (excl) oid 7 current snap is 380 2026-02-17T12:06:11.967 INFO:tasks.rados.rados.0.trial142.stdout:3403: seq_num 1173 ranges {514611=585439,1524437=592395,2895994=408424} 2026-02-17T12:06:11.971 INFO:tasks.rados.rados.0.trial142.stdout:3403: writing trial14245205-7 from 514611 to 1100050 tid 1 2026-02-17T12:06:11.974 INFO:tasks.rados.rados.0.trial142.stdout:3403: writing trial14245205-7 from 1524437 to 2116832 tid 2 2026-02-17T12:06:11.979 INFO:tasks.rados.rados.0.trial142.stdout:3403: writing trial14245205-7 from 2895994 to 3304418 tid 3 2026-02-17T12:06:11.979 INFO:tasks.rados.rados.0.trial142.stdout:3404: write (excl) oid 17 current snap is 380 2026-02-17T12:06:11.979 INFO:tasks.rados.rados.0.trial142.stdout:3404: seq_num 1174 ranges {531418=660688,1982919=452406,3039770=691648} 2026-02-17T12:06:11.983 INFO:tasks.rados.rados.0.trial142.stdout:3404: writing trial14245205-17 from 531418 to 1192106 tid 1 2026-02-17T12:06:11.988 INFO:tasks.rados.rados.0.trial142.stdout:3404: writing trial14245205-17 from 1982919 to 2435325 tid 2 2026-02-17T12:06:11.993 INFO:tasks.rados.rados.0.trial142.stdout:3404: writing trial14245205-17 from 3039770 to 3731418 tid 3 2026-02-17T12:06:11.994 INFO:tasks.rados.rados.0.trial142.stdout:3405: write oid 41 current snap is 380 2026-02-17T12:06:11.994 INFO:tasks.rados.rados.0.trial142.stdout:3405: seq_num 1175 ranges {548225=735937,1925048=596064,2950840=547321} 2026-02-17T12:06:11.998 INFO:tasks.rados.rados.0.trial142.stdout:3405: writing trial14245205-41 from 548225 to 1284162 tid 1 2026-02-17T12:06:12.002 INFO:tasks.rados.rados.0.trial142.stdout:3405: writing trial14245205-41 from 1925048 to 2521112 tid 2 2026-02-17T12:06:12.006 INFO:tasks.rados.rados.0.trial142.stdout:3405: writing trial14245205-41 from 2950840 to 3498161 tid 3 2026-02-17T12:06:12.006 INFO:tasks.rados.rados.0.trial142.stdout:3406: read oid 13 snap -1 2026-02-17T12:06:12.007 INFO:tasks.rados.rados.0.trial142.stdout:3406: expect (ObjNum 1121 snap 365 seq_num 1121) 2026-02-17T12:06:12.007 INFO:tasks.rados.rados.0.trial142.stdout:3407: snap_create 2026-02-17T12:06:12.007 INFO:tasks.rados.rados.0.trial142.stdout:3400: expect (ObjNum 1062 snap 344 seq_num 1062) 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: finishing write tid 1 to trial14245205-48 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: finishing write tid 2 to trial14245205-48 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: finishing write tid 3 to trial14245205-48 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: finishing write tid 4 to trial14245205-48 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: finishing write tid 5 to trial14245205-48 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: oid 48 updating version 0 to 2732 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: oid 48 updating version 2732 to 2733 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: oid 48 version 2733 is already newer than 2730 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: oid 48 version 2733 is already newer than 2731 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2733 (ObjNum 1172 snap 380 seq_num 1172) dirty exists 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3401: left oid 48 (ObjNum 1172 snap 380 seq_num 1172) 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3403: finishing write tid 1 to trial14245205-7 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3403: finishing write tid 2 to trial14245205-7 2026-02-17T12:06:12.233 INFO:tasks.rados.rados.0.trial142.stdout:3403: finishing write tid 3 to trial14245205-7 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: finishing write tid 4 to trial14245205-7 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: finishing write tid 5 to trial14245205-7 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: oid 7 updating version 0 to 3181 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: oid 7 version 3181 is already newer than 3171 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: oid 7 version 3181 is already newer than 3176 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: oid 7 updating version 3181 to 3182 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 3182 (ObjNum 1173 snap 380 seq_num 1173) dirty exists 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3403: left oid 7 (ObjNum 1173 snap 380 seq_num 1173) 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: finishing write tid 1 to trial14245205-17 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: finishing write tid 2 to trial14245205-17 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: finishing write tid 3 to trial14245205-17 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: finishing write tid 4 to trial14245205-17 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: finishing write tid 5 to trial14245205-17 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: oid 17 updating version 0 to 2553 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: oid 17 version 2553 is already newer than 2551 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: oid 17 updating version 2553 to 2554 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: oid 17 version 2554 is already newer than 2552 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2554 (ObjNum 1174 snap 380 seq_num 1174) dirty exists 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3404: left oid 17 (ObjNum 1174 snap 380 seq_num 1174) 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: finishing write tid 1 to trial14245205-41 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: finishing write tid 2 to trial14245205-41 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: finishing write tid 3 to trial14245205-41 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: finishing write tid 4 to trial14245205-41 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: finishing write tid 5 to trial14245205-41 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: oid 41 updating version 0 to 2740 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: oid 41 version 2740 is already newer than 2738 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: oid 41 updating version 2740 to 2741 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: oid 41 version 2741 is already newer than 2739 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2741 (ObjNum 1175 snap 380 seq_num 1175) dirty exists 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3405: left oid 41 (ObjNum 1175 snap 380 seq_num 1175) 2026-02-17T12:06:12.234 INFO:tasks.rados.rados.0.trial142.stdout:3406: expect (ObjNum 1121 snap 365 seq_num 1121) 2026-02-17T12:06:12.970 INFO:tasks.rados.rados.0.trial142.stdout:3400: done (6 left) 2026-02-17T12:06:12.970 INFO:tasks.rados.rados.0.trial142.stdout:3401: done (5 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3403: done (4 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3404: done (3 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3405: done (2 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3406: done (1 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3407: done (0 left) 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3408: write oid 4 current snap is 381 2026-02-17T12:06:12.971 INFO:tasks.rados.rados.0.trial142.stdout:3408: seq_num 1176 ranges {565032=411186,1583530=456075,2578263=758593} 2026-02-17T12:06:12.973 INFO:tasks.rados.rados.0.trial142.stdout:3408: writing trial14245205-4 from 565032 to 976218 tid 1 2026-02-17T12:06:12.977 INFO:tasks.rados.rados.0.trial142.stdout:3408: writing trial14245205-4 from 1583530 to 2039605 tid 2 2026-02-17T12:06:12.982 INFO:tasks.rados.rados.0.trial142.stdout:3408: writing trial14245205-4 from 2578263 to 3336856 tid 3 2026-02-17T12:06:12.982 INFO:tasks.rados.rados.0.trial142.stdout:3409: snap_remove snap 367 2026-02-17T12:06:13.973 INFO:tasks.rados.rados.0.trial142.stdout:3409: done (1 left) 2026-02-17T12:06:13.973 INFO:tasks.rados.rados.0.trial142.stdout:3410: write (excl) oid 11 current snap is 381 2026-02-17T12:06:13.973 INFO:tasks.rados.rados.0.trial142.stdout:3410: seq_num 1177 ranges {581839=486435,1642012=599733,3005686=569865} 2026-02-17T12:06:13.977 INFO:tasks.rados.rados.0.trial142.stdout:3410: writing trial14245205-11 from 581839 to 1068274 tid 1 2026-02-17T12:06:13.982 INFO:tasks.rados.rados.0.trial142.stdout:3410: writing trial14245205-11 from 1642012 to 2241745 tid 2 2026-02-17T12:06:13.987 INFO:tasks.rados.rados.0.trial142.stdout:3410: writing trial14245205-11 from 3005686 to 3575551 tid 3 2026-02-17T12:06:13.987 INFO:tasks.rados.rados.0.trial142.stdout:3411: write (excl) oid 42 current snap is 381 2026-02-17T12:06:13.987 INFO:tasks.rados.rados.0.trial142.stdout:3411: seq_num 1178 ranges {598646=561684,1700494=459744,2633109=781137} 2026-02-17T12:06:13.991 INFO:tasks.rados.rados.0.trial142.stdout:3411: writing trial14245205-42 from 598646 to 1160330 tid 1 2026-02-17T12:06:13.995 INFO:tasks.rados.rados.0.trial142.stdout:3411: writing trial14245205-42 from 1700494 to 2160238 tid 2 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3411: writing trial14245205-42 from 2633109 to 3414246 tid 3 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3412: snap_create 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: finishing write tid 1 to trial14245205-4 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: finishing write tid 2 to trial14245205-4 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: finishing write tid 3 to trial14245205-4 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: finishing write tid 4 to trial14245205-4 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: finishing write tid 5 to trial14245205-4 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: oid 4 updating version 0 to 3184 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: oid 4 updating version 3184 to 3186 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: oid 4 version 3186 is already newer than 3185 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: oid 4 updating version 3186 to 3187 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3187 (ObjNum 1176 snap 381 seq_num 1176) dirty exists 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3408: left oid 4 (ObjNum 1176 snap 381 seq_num 1176) 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: finishing write tid 1 to trial14245205-11 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: finishing write tid 2 to trial14245205-11 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: finishing write tid 3 to trial14245205-11 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: finishing write tid 4 to trial14245205-11 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: finishing write tid 5 to trial14245205-11 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: oid 11 updating version 0 to 3040 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: oid 11 version 3040 is already newer than 3039 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: oid 11 version 3040 is already newer than 3038 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: oid 11 updating version 3040 to 3041 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3041 (ObjNum 1177 snap 381 seq_num 1177) dirty exists 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3410: left oid 11 (ObjNum 1177 snap 381 seq_num 1177) 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3411: finishing write tid 1 to trial14245205-42 2026-02-17T12:06:14.001 INFO:tasks.rados.rados.0.trial142.stdout:3411: finishing write tid 2 to trial14245205-42 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: finishing write tid 3 to trial14245205-42 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: finishing write tid 4 to trial14245205-42 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: finishing write tid 5 to trial14245205-42 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: oid 42 updating version 0 to 2736 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: oid 42 updating version 2736 to 2738 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: oid 42 version 2738 is already newer than 2737 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: oid 42 version 2738 is already newer than 2735 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2738 (ObjNum 1178 snap 381 seq_num 1178) dirty exists 2026-02-17T12:06:14.003 INFO:tasks.rados.rados.0.trial142.stdout:3411: left oid 42 (ObjNum 1178 snap 381 seq_num 1178) 2026-02-17T12:06:14.976 INFO:tasks.rados.rados.0.trial142.stdout:3408: done (3 left) 2026-02-17T12:06:14.976 INFO:tasks.rados.rados.0.trial142.stdout:3410: done (2 left) 2026-02-17T12:06:14.976 INFO:tasks.rados.rados.0.trial142.stdout:3411: done (1 left) 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3412: done (0 left) 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3413: rollback oid 42 current snap is 382 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 42 to 351 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3414: read oid 44 snap -1 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3414: expect (ObjNum 1153 snap 373 seq_num 1153) 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3415: read oid 6 snap -1 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3415: expect deleted 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3416: write oid 24 current snap is 382 2026-02-17T12:06:14.977 INFO:tasks.rados.rados.0.trial142.stdout:3416: seq_num 1179 ranges {615453=753286,2158976=603402,3460532=354921} 2026-02-17T12:06:14.980 INFO:tasks.rados.rados.0.trial142.stdout:3416: writing trial14245205-24 from 615453 to 1368739 tid 1 2026-02-17T12:06:14.986 INFO:tasks.rados.rados.0.trial142.stdout:3416: writing trial14245205-24 from 2158976 to 2762378 tid 2 2026-02-17T12:06:14.990 INFO:tasks.rados.rados.0.trial142.stdout:3416: writing trial14245205-24 from 3460532 to 3815453 tid 3 2026-02-17T12:06:14.990 INFO:tasks.rados.rados.0.trial142.stdout:3417: read oid 18 snap 351 2026-02-17T12:06:14.990 INFO:tasks.rados.rados.0.trial142.stdout:3417: expect (ObjNum 1044 snap 340 seq_num 1044) 2026-02-17T12:06:14.990 INFO:tasks.rados.rados.0.trial142.stdout:3418: rollback oid 21 current snap is 382 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 21 to 371 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:3413: finishing rollback tid 0 to trial14245205-42 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:3413: finishing rollback tid 1 to trial14245205-42 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:3413: finishing rollback tid 2 to trial14245205-42 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2741 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:06:14.991 INFO:tasks.rados.rados.0.trial142.stdout:3414: expect (ObjNum 1153 snap 373 seq_num 1153) 2026-02-17T12:06:15.068 INFO:tasks.rados.rados.0.trial142.stdout:3416: finishing write tid 1 to trial14245205-24 2026-02-17T12:06:15.068 INFO:tasks.rados.rados.0.trial142.stdout:3416: finishing write tid 2 to trial14245205-24 2026-02-17T12:06:15.068 INFO:tasks.rados.rados.0.trial142.stdout:3413: done (5 left) 2026-02-17T12:06:15.068 INFO:tasks.rados.rados.0.trial142.stdout:3414: done (4 left) 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3415: done (3 left) 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3419: copy_from oid 49 from oid 7 current snap is 382 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: finishing write tid 3 to trial14245205-24 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: finishing write tid 4 to trial14245205-24 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: finishing write tid 5 to trial14245205-24 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: oid 24 updating version 0 to 2169 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: oid 24 version 2169 is already newer than 2168 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: oid 24 updating version 2169 to 2170 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: oid 24 updating version 2170 to 2171 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2171 (ObjNum 1179 snap 382 seq_num 1179) dirty exists 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3416: left oid 24 (ObjNum 1179 snap 382 seq_num 1179) 2026-02-17T12:06:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3418: finishing rollback tid 0 to trial14245205-21 2026-02-17T12:06:15.070 INFO:tasks.rados.rados.0.trial142.stdout:3418: finishing rollback tid 1 to trial14245205-21 2026-02-17T12:06:15.070 INFO:tasks.rados.rados.0.trial142.stdout:3417: expect (ObjNum 1044 snap 340 seq_num 1044) 2026-02-17T12:06:15.150 INFO:tasks.rados.rados.0.trial142.stdout:3418: finishing rollback tid 2 to trial14245205-21 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2552 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3419: finishing copy_from racing read to trial14245205-49 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3416: done (3 left) 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3417: done (2 left) 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3418: done (1 left) 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3420: snap_create 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:3419: finishing copy_from to trial14245205-49 2026-02-17T12:06:15.151 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3182 (ObjNum 1173 snap 380 seq_num 1173) dirty exists 2026-02-17T12:06:15.964 INFO:tasks.rados.rados.0.trial142.stdout:3419: done (1 left) 2026-02-17T12:06:15.964 INFO:tasks.rados.rados.0.trial142.stdout:3420: done (0 left) 2026-02-17T12:06:15.964 INFO:tasks.rados.rados.0.trial142.stdout:3421: snap_remove snap 351 2026-02-17T12:06:16.966 INFO:tasks.rados.rados.0.trial142.stdout:3421: done (0 left) 2026-02-17T12:06:16.966 INFO:tasks.rados.rados.0.trial142.stdout:3422: snap_remove snap 377 2026-02-17T12:06:17.967 INFO:tasks.rados.rados.0.trial142.stdout:3422: done (0 left) 2026-02-17T12:06:17.967 INFO:tasks.rados.rados.0.trial142.stdout:3423: rollback oid 39 current snap is 383 2026-02-17T12:06:17.967 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 39 to 376 2026-02-17T12:06:17.968 INFO:tasks.rados.rados.0.trial142.stdout:3424: snap_remove snap 365 2026-02-17T12:06:18.968 INFO:tasks.rados.rados.0.trial142.stdout:3424: done (1 left) 2026-02-17T12:06:18.968 INFO:tasks.rados.rados.0.trial142.stdout:3425: write (excl) oid 1 current snap is 383 2026-02-17T12:06:18.969 INFO:tasks.rados.rados.0.trial142.stdout:3423: finishing rollback tid 0 to trial14245205-39 2026-02-17T12:06:18.969 INFO:tasks.rados.rados.0.trial142.stdout:3423: finishing rollback tid 1 to trial14245205-39 2026-02-17T12:06:18.969 INFO:tasks.rados.rados.0.trial142.stdout:3423: finishing rollback tid 2 to trial14245205-39 2026-02-17T12:06:18.969 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2174 (ObjNum 1161 snap 374 seq_num 1161) dirty exists 2026-02-17T12:06:18.969 INFO:tasks.rados.rados.0.trial142.stdout:3425: seq_num 1180 ranges {632260=428535,1817458=463413,2687955=520034,3709324=122936} 2026-02-17T12:06:18.972 INFO:tasks.rados.rados.0.trial142.stdout:3425: writing trial14245205-1 from 632260 to 1060795 tid 1 2026-02-17T12:06:18.977 INFO:tasks.rados.rados.0.trial142.stdout:3425: writing trial14245205-1 from 1817458 to 2280871 tid 2 2026-02-17T12:06:18.980 INFO:tasks.rados.rados.0.trial142.stdout:3425: writing trial14245205-1 from 2687955 to 3207989 tid 3 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3425: writing trial14245205-1 from 3709324 to 3832260 tid 4 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3423: done (1 left) 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3426: delete oid 46 current snap is 383 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 1 to trial14245205-1 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 2 to trial14245205-1 2026-02-17T12:06:18.983 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 3 to trial14245205-1 2026-02-17T12:06:18.984 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 4 to trial14245205-1 2026-02-17T12:06:18.984 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 5 to trial14245205-1 2026-02-17T12:06:18.984 INFO:tasks.rados.rados.0.trial142.stdout:3425: finishing write tid 6 to trial14245205-1 2026-02-17T12:06:18.984 INFO:tasks.rados.rados.0.trial142.stdout:3425: oid 1 updating version 0 to 3124 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:3425: oid 1 updating version 3124 to 3125 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:3425: oid 1 version 3125 is already newer than 3123 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:3425: oid 1 updating version 3125 to 3126 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:3425: oid 1 updating version 3126 to 3127 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3127 (ObjNum 1180 snap 383 seq_num 1180) dirty exists 2026-02-17T12:06:18.985 INFO:tasks.rados.rados.0.trial142.stdout:3425: left oid 1 (ObjNum 1180 snap 383 seq_num 1180) 2026-02-17T12:06:18.987 INFO:tasks.rados.rados.0.trial142.stdout:3425: done (1 left) 2026-02-17T12:06:18.987 INFO:tasks.rados.rados.0.trial142.stdout:3426: done (0 left) 2026-02-17T12:06:18.987 INFO:tasks.rados.rados.0.trial142.stdout:3427: read oid 6 snap -1 2026-02-17T12:06:18.987 INFO:tasks.rados.rados.0.trial142.stdout:3427: expect deleted 2026-02-17T12:06:18.987 INFO:tasks.rados.rados.0.trial142.stdout:3428: write (excl) oid 4 current snap is 383 2026-02-17T12:06:18.988 INFO:tasks.rados.rados.0.trial142.stdout:3428: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2026-02-17T12:06:18.992 INFO:tasks.rados.rados.0.trial142.stdout:3428: writing trial14245205-4 from 665874 to 1244907 tid 1 2026-02-17T12:06:18.996 INFO:tasks.rados.rados.0.trial142.stdout:3428: writing trial14245205-4 from 1934422 to 2401504 tid 2 2026-02-17T12:06:19.001 INFO:tasks.rados.rados.0.trial142.stdout:3428: writing trial14245205-4 from 3142801 to 3685379 tid 3 2026-02-17T12:06:19.001 INFO:tasks.rados.rados.0.trial142.stdout:3429: read oid 28 snap 376 2026-02-17T12:06:19.001 INFO:tasks.rados.rados.0.trial142.stdout:3429: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:06:19.002 INFO:tasks.rados.rados.0.trial142.stdout:3430: delete oid 23 current snap is 383 2026-02-17T12:06:19.002 INFO:tasks.rados.rados.0.trial142.stdout:3428: finishing write tid 1 to trial14245205-4 2026-02-17T12:06:19.002 INFO:tasks.rados.rados.0.trial142.stdout:3428: finishing write tid 2 to trial14245205-4 2026-02-17T12:06:19.003 INFO:tasks.rados.rados.0.trial142.stdout:3428: finishing write tid 3 to trial14245205-4 2026-02-17T12:06:19.003 INFO:tasks.rados.rados.0.trial142.stdout:3428: finishing write tid 4 to trial14245205-4 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: finishing write tid 5 to trial14245205-4 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: oid 4 updating version 0 to 3228 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: oid 4 version 3228 is already newer than 3227 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: oid 4 updating version 3228 to 3230 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: oid 4 version 3230 is already newer than 3229 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3230 (ObjNum 1182 snap 383 seq_num 1182) dirty exists 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: left oid 4 (ObjNum 1182 snap 383 seq_num 1182) 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3427: done (3 left) 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3428: done (2 left) 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3430: done (1 left) 2026-02-17T12:06:19.004 INFO:tasks.rados.rados.0.trial142.stdout:3431: snap_remove snap 334 2026-02-17T12:06:19.945 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:06:19.945 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T12:06:19.945 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:06:19.945 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:06:19.947 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:06:19.947 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:06:19.947 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:06:19.970 INFO:tasks.rados.rados.0.trial142.stdout:3431: done (1 left) 2026-02-17T12:06:19.971 INFO:tasks.rados.rados.0.trial142.stdout:3432: copy_from oid 14 from oid 8 current snap is 383 2026-02-17T12:06:19.971 INFO:tasks.rados.rados.0.trial142.stdout:3429: expect (ObjNum 1060 snap 343 seq_num 1060) 2026-02-17T12:06:20.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: get_monmap_and_config 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: build_initial_monmap 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: monmap: 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:20.017059+0000 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:20.017059+0000 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:20.018 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:20.019 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:20.019 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:20.019 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:20.019 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 Processor -- start 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 -- start start 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: init 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc8540a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-c con 0x7fc8540a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-b con 0x7fc85413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85406e140 con 0x7fc8540a3bb0 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc85409f910 con 0x7fc8540a0750 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc85409ccd0 con 0x7fc85413b760 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85c2fb640 10 monclient(hunting): authenticate will time out at 1867.635796s 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.016+0000 7fc85986f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.142:3300/0 says I am v2:10.20.193.51:40042/0 (socket says 10.20.193.51:40042) 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 -- 10.20.193.51:0/953788631 learned_addr learned my addr 10.20.193.51:0/953788631 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 10 monclient(hunting): get_auth_request con 0x7fc8540a0750 auth_method 0 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): get_auth_request con 0x7fc85413b760 auth_method 0 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:20.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 -- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 msgr2=0x7fc85409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 -- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 msgr2=0x7fc85409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 --2- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85986f640 1 --2- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient(hunting): handle_auth_done global_id 234380 payload 274 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 msgr2=0x7fc85409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 --2- 10.20.193.51:0/953788631 >> v2:10.20.193.142:3300/0 conn(0x7fc8540a0750 0x7fc85409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 >> v1:10.20.193.51:6789/0 conn(0x7fc8540a3bb0 legacy=0x7fc85409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient: _finish_hunting 0 2026-02-17T12:06:20.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 monclient: found mon.noname-b 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.017+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85409eec0 con 0x7fc85413b760 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 msgr2=0x7fc85413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc85406f3c0 tx=0x7fc85002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b3884586a2b27d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 msgr2=0x7fc85413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 msgr2=0x7fc85413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc85406f3c0 tx=0x7fc85002f130 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a871640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc85406f3c0 tx=0x7fc85002f130 comp rx=0 tx=0).stop 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:20.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 msgr2=0x7fc85413db50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc85413b760 0x7fc85413db50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient: _add_conns ranks=[3,1] 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 1 --2- 10.20.193.51:0/953788631 >> v2:10.20.193.51:3300/0 conn(0x7fc83c003600 0x7fc83c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient(hunting): picked mon.noname-a con 0x7fc83c003600 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc83c0063b0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83c00a320 con 0x7fc83c0063b0 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fc83c00b520 con 0x7fc83c003600 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85906e640 10 monclient(hunting): ms_handle_reset stray mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:20.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a070640 1 --2- 10.20.193.51:0/953788631 >> v2:10.20.193.51:3300/0 conn(0x7fc83c003600 0x7fc83c005a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a070640 10 monclient(hunting): get_auth_request con 0x7fc83c003600 auth_method 0 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a070640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.019+0000 7fc85a070640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient(hunting): handle_auth_done global_id 234380 payload 293 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 1 -- 10.20.193.51:0/953788631 >> v1:10.20.193.142:6789/0 conn(0x7fc83c0063b0 legacy=0x7fc83c008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient: _finish_hunting 0 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 1 monclient: found mon.noname-a 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:20.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.020+0000 7fc85a070640 1 -- 10.20.193.51:0/953788631 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c00b790 con 0x7fc83c003600 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85a070640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 msgr2=0x7fc83c005a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85a070640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc83c005a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc844003f00 tx=0x7fc850009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a58e9145d1bb7e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844003b80 con 0x7fc83c003600 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: dump: 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: _finish_auth 0 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: _check_auth_tickets 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844005480 con 0x7fc83c003600 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:20.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 1 -- 10.20.193.51:0/953788631 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844006b10 con 0x7fc83c003600 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85906e640 10 monclient: dump: 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:20.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 5 monclient: authenticate success, global_id 234380 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 4 set_mon_vals no callback set 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 10 monclient: shutdown 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 -- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 msgr2=0x7fc83c005a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc83c005a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc844003f00 tx=0x7fc850009750 comp rx=0 tx=0).stop 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85a871640 1 -- 10.20.193.51:0/953788631 reap_dead start 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 -- 10.20.193.51:0/953788631 shutdown_connections 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/953788631 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc83c005a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 -- 10.20.193.51:0/953788631 >> 10.20.193.51:0/953788631 conn(0x7fc8540a30c0 msgr2=0x7fc8540a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:20.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 -- 10.20.193.51:0/953788631 shutdown_connections 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.022+0000 7fc85c2fb640 1 -- 10.20.193.51:0/953788631 wait complete. 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient: build_initial_monmap 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient: monmap: 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:20.041 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 Processor -- start 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 -- start start 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient: init 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:20.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc8540932a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-a con 0x7fc83c003600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc854090e70 0x7fc854091290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-b con 0x7fc854090e70 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): picked mon.noname-c con 0x7fc8540917d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540a04b0 con 0x7fc83c003600 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc85409c850 con 0x7fc854090e70 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:20.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc85409e710 con 0x7fc8540917d0 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85c2fb640 10 monclient(hunting): authenticate will time out at 1867.642677s 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc8540932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55098/0 (socket says 10.20.193.51:55098) 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 -- 10.20.193.51:0/2693460205 learned_addr learned my addr 10.20.193.51:0/2693460205 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): get_auth_request con 0x7fc8540917d0 auth_method 0 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): get_auth_request con 0x7fc83c003600 auth_method 0 2026-02-17T12:06:20.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient(hunting): handle_auth_done global_id 234383 payload 824 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 -- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc854090e70 msgr2=0x7fc854091290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc854090e70 0x7fc854091290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 -- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 msgr2=0x7fc8540932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc8540932a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient: _finish_hunting 0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 monclient: found mon.noname-c 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.023+0000 7fc85a871640 1 -- 10.20.193.51:0/2693460205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc854094fa0 con 0x7fc8540917d0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85a871640 1 -- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 msgr2=0x7fc8541d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85a871640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc850009d60 tx=0x7fc850004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850046020 con 0x7fc8540917d0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: dump: 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.046 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: _finish_auth 0 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc850037440 con 0x7fc8540917d0 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85003c070 con 0x7fc8540917d0 2026-02-17T12:06:20.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 10 monclient: dump: 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85886d640 4 set_mon_vals no callback set 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 5 monclient: authenticate success, global_id 234383 2026-02-17T12:06:20.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _renew_subs 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85409a3d0 con 0x7fc8540917d0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _renew_subs 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8540942e0 con 0x7fc8540917d0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85409dac0 con 0x7fc8540917d0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.026+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc850037830 con 0x7fc8540917d0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.027+0000 7fc83affd640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 0x7fc8240401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.027+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(783..783 src has 323..783) ==== 4859+0+0 (secure 0 0 0) 0x7fc850078530 con 0x7fc8540917d0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.027+0000 7fc85a070640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 0x7fc8240401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:20.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.027+0000 7fc85a070640 10 monclient: get_auth_request con 0x7fc82403dd10 auth_method 0 2026-02-17T12:06:20.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.029+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc850050030 con 0x7fc8540917d0 2026-02-17T12:06:20.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.029+0000 7fc83affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:20.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.029+0000 7fc83affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:20.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.030+0000 7fc85a070640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 0x7fc8240401d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc844014040 tx=0x7fc844009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:20.062 INFO:tasks.rados.rados.0.trial142.stdout:3429: done (1 left) 2026-02-17T12:06:20.062 INFO:tasks.rados.rados.0.trial142.stdout:3433: delete oid 38 current snap is 383 2026-02-17T12:06:20.063 INFO:tasks.rados.rados.0.trial142.stdout:3433: done (1 left) 2026-02-17T12:06:20.063 INFO:tasks.rados.rados.0.trial142.stdout:3434: snap_remove snap 371 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.143+0000 7fc85c2fb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.143+0000 7fc85c2fb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.143+0000 7fc85c2fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.143+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc8540008d0 con 0x7fc8540917d0 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.144+0000 7fc83affd640 1 -- 10.20.193.51:0/2693460205 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7fc854094fa0 con 0x7fc8540917d0 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.144+0000 7fc83affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:20.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.144+0000 7fc83affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:20.147 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":194,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.144+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 msgr2=0x7fc8240401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 0x7fc8240401d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc844014040 tx=0x7fc844009030 comp rx=0 tx=0).stop 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 10 monclient: shutdown 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 msgr2=0x7fc8541d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:20.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc850009d60 tx=0x7fc850004b40 comp rx=0 tx=0).stop 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 shutdown_connections 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc82403dd10 0x7fc8240401d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc8540917d0 0x7fc8541d3870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc854090e70 0x7fc854091290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 --2- 10.20.193.51:0/2693460205 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc83c003600 0x7fc8540932a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 >> 10.20.193.51:0/2693460205 conn(0x7fc8540a30c0 msgr2=0x7fc85413acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 shutdown_connections 2026-02-17T12:06:20.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:20.145+0000 7fc85c2fb640 1 -- 10.20.193.51:0/2693460205 wait complete. 2026-02-17T12:06:20.967 INFO:tasks.rados.rados.0.trial142.stdout:3434: done (1 left) 2026-02-17T12:06:20.968 INFO:tasks.rados.rados.0.trial142.stdout:3435: write (excl) oid 23 current snap is 383 2026-02-17T12:06:20.968 INFO:tasks.rados.rados.0.trial142.stdout:3432: finishing copy_from racing read to trial14245205-14 2026-02-17T12:06:20.968 INFO:tasks.rados.rados.0.trial142.stdout:3432: finishing copy_from to trial14245205-14 2026-02-17T12:06:20.968 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3079 (ObjNum 1170 snap 378 seq_num 1170) dirty exists 2026-02-17T12:06:20.968 INFO:tasks.rados.rados.0.trial142.stdout:3435: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2026-02-17T12:06:20.972 INFO:tasks.rados.rados.0.trial142.stdout:3435: writing trial14245205-23 from 716295 to 1121075 tid 1 2026-02-17T12:06:20.977 INFO:tasks.rados.rados.0.trial142.stdout:3435: writing trial14245205-23 from 1593515 to 2207924 tid 2 2026-02-17T12:06:20.980 INFO:tasks.rados.rados.0.trial142.stdout:3435: writing trial14245205-23 from 2708717 to 3201464 tid 3 2026-02-17T12:06:20.983 INFO:tasks.rados.rados.0.trial142.stdout:3435: writing trial14245205-23 from 3640519 to 3916295 tid 4 2026-02-17T12:06:20.983 INFO:tasks.rados.rados.0.trial142.stdout:3432: done (1 left) 2026-02-17T12:06:20.983 INFO:tasks.rados.rados.0.trial142.stdout:3436: snap_create 2026-02-17T12:06:20.984 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 1 to trial14245205-23 2026-02-17T12:06:20.984 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 2 to trial14245205-23 2026-02-17T12:06:20.985 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 3 to trial14245205-23 2026-02-17T12:06:20.985 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 4 to trial14245205-23 2026-02-17T12:06:20.985 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 5 to trial14245205-23 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: finishing write tid 6 to trial14245205-23 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: oid 23 updating version 0 to 2736 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: oid 23 updating version 2736 to 2737 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: oid 23 version 2737 is already newer than 2733 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: oid 23 version 2737 is already newer than 2734 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: oid 23 version 2737 is already newer than 2735 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2737 (ObjNum 1185 snap 383 seq_num 1185) dirty exists 2026-02-17T12:06:20.986 INFO:tasks.rados.rados.0.trial142.stdout:3435: left oid 23 (ObjNum 1185 snap 383 seq_num 1185) 2026-02-17T12:06:21.977 INFO:tasks.rados.rados.0.trial142.stdout:3435: done (1 left) 2026-02-17T12:06:21.977 INFO:tasks.rados.rados.0.trial142.stdout:3436: done (0 left) 2026-02-17T12:06:21.977 INFO:tasks.rados.rados.0.trial142.stdout:3437: snap_remove snap 376 2026-02-17T12:06:22.978 INFO:tasks.rados.rados.0.trial142.stdout:3437: done (0 left) 2026-02-17T12:06:22.978 INFO:tasks.rados.rados.0.trial142.stdout:3438: snap_create 2026-02-17T12:06:23.155 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:06:23.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: get_monmap_and_config 2026-02-17T12:06:23.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: monmap: 2026-02-17T12:06:23.226 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:23.223158+0000 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:23.223158+0000 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:23.227 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 Processor -- start 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 -- start start 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: init 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe3880a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-b con 0x7fe3880a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe38813b760 0x7fe38813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-c con 0x7fe38813b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:23.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38806e140 con 0x7fe3880a3bb0 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe38809f910 con 0x7fe38813b760 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe38809ccd0 con 0x7fe3880a0750 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe38dc0e640 10 monclient(hunting): authenticate will time out at 1870.841888s 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.222+0000 7fe386ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55100/0 (socket says 10.20.193.51:55100) 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 -- 10.20.193.51:0/2496194010 learned_addr learned my addr 10.20.193.51:0/2496194010 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): get_auth_request con 0x7fe3880a0750 auth_method 0 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe387fff640 1 --2- 10.20.193.51:0/2496194010 >> v2:10.20.193.142:3300/0 conn(0x7fe38813b760 0x7fe38813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe387fff640 10 monclient(hunting): get_auth_request con 0x7fe38813b760 auth_method 0 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe387fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe387fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe387fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient(hunting): handle_auth_done global_id 234386 payload 274 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 -- 10.20.193.51:0/2496194010 >> v2:10.20.193.142:3300/0 conn(0x7fe38813b760 msgr2=0x7fe38813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 --2- 10.20.193.51:0/2496194010 >> v2:10.20.193.142:3300/0 conn(0x7fe38813b760 0x7fe38813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 -- 10.20.193.51:0/2496194010 >> v1:10.20.193.142:6789/0 conn(0x7fe3880a3bb0 legacy=0x7fe38809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 monclient: found mon.noname-b 2026-02-17T12:06:23.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:23.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.223+0000 7fe386ffd640 1 -- 10.20.193.51:0/2496194010 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38809eec0 con 0x7fe3880a0750 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe386ffd640 1 -- 10.20.193.51:0/2496194010 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 msgr2=0x7fe38809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe386ffd640 1 --2- 10.20.193.51:0/2496194010 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe38809f230 tx=0x7fe37802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aec30da65493ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 1 -- 10.20.193.51:0/2496194010 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37803c070 con 0x7fe3880a0750 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:23.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: dump: 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 1 -- 10.20.193.51:0/2496194010 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37802fca0 con 0x7fe3880a0750 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe38dc0e640 5 monclient: authenticate success, global_id 234386 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 1 -- 10.20.193.51:0/2496194010 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378037660 con 0x7fe3880a0750 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe38dc0e640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe38dc0e640 4 set_mon_vals no callback set 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:23.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.225+0000 7fe3867fc640 10 monclient: dump: 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 10 monclient: shutdown 2026-02-17T12:06:23.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- 10.20.193.51:0/2496194010 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 msgr2=0x7fe38809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/2496194010 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe38809f230 tx=0x7fe37802ee60 comp rx=0 tx=0).stop 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- 10.20.193.51:0/2496194010 shutdown_connections 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/2496194010 >> v2:10.20.193.142:3300/0 conn(0x7fe38813b760 0x7fe38813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/2496194010 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38809e1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- 10.20.193.51:0/2496194010 >> 10.20.193.51:0/2496194010 conn(0x7fe3880a30c0 msgr2=0x7fe3880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- 10.20.193.51:0/2496194010 shutdown_connections 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- 10.20.193.51:0/2496194010 wait complete. 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 10 monclient: monmap: 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 Processor -- start 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 1 -- start start 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.226+0000 7fe38dc0e640 10 monclient: init 2026-02-17T12:06:23.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38812dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-c con 0x7fe3880a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 0x7fe38812e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-a con 0x7fe3880a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 0x7fe38812e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): picked mon.noname-b con 0x7fe38813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880a04b0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe38809c850 con 0x7fe38813b760 2026-02-17T12:06:23.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe38809e710 con 0x7fe3880a0750 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe38dc0e640 10 monclient(hunting): authenticate will time out at 1870.846195s 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38812dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 0x7fe38812e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38812dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55102/0 (socket says 10.20.193.51:55102) 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): get_auth_request con 0x7fe3880a3bb0 auth_method 0 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 1 -- 10.20.193.51:0/3551358276 learned_addr learned my addr 10.20.193.51:0/3551358276 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): get_auth_request con 0x7fe3880a0750 auth_method 0 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe3877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient(hunting): handle_auth_done global_id 254205 payload 824 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe387fff640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 0x7fe38812e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 -- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 msgr2=0x7fe38812dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38812dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 -- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 msgr2=0x7fe38812e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 0x7fe38812e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 monclient: found mon.noname-a 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe386ffd640 1 -- 10.20.193.51:0/3551358276 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3881315a0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe387fff640 10 monclient: get_auth_request con 0x7fe38813b760 auth_method 0 2026-02-17T12:06:23.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.227+0000 7fe387fff640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 0x7fe38812e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe386ffd640 1 -- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 msgr2=0x7fe38812e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe386ffd640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 0x7fe38812e190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe38809cea0 tx=0x7fe378004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37803c040 con 0x7fe3880a3bb0 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: dump: 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378047070 con 0x7fe3880a3bb0 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3780428d0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe385ffb640 4 set_mon_vals no callback set 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe363fff640 10 monclient: dump: 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 5 monclient: authenticate success, global_id 254205 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 10 monclient: _renew_subs 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38806f410 con 0x7fe3880a3bb0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 10 monclient: _renew_subs 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.229+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3880a2b60 con 0x7fe3880a3bb0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe378042ab0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe38dc0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe38dc0e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe38dc0e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38812f8a0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe363fff640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 0x7fe358040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(786..786 src has 323..786) ==== 4843+0+0 (secure 0 0 0) 0x7fe378077290 con 0x7fe3880a3bb0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe3877fe640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 0x7fe358040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.230+0000 7fe3877fe640 10 monclient: get_auth_request con 0x7fe35803dd40 auth_method 0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.233+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe378050020 con 0x7fe3880a3bb0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.233+0000 7fe363fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.233+0000 7fe363fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:23.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.233+0000 7fe3877fe640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 0x7fe358040200 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3740052b0 tx=0x7fe374003960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe38dc0e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe38dc0e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe38dc0e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe38809dac0 con 0x7fe3880a3bb0 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe363fff640 1 -- 10.20.193.51:0/3551358276 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fe378041e00 con 0x7fe3880a3bb0 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe363fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.347+0000 7fe363fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:23.349 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":196,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:06:23.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 msgr2=0x7fe358040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 0x7fe358040200 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3740052b0 tx=0x7fe374003960 comp rx=0 tx=0).stop 2026-02-17T12:06:23.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 10 monclient: shutdown 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 msgr2=0x7fe38812e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 0x7fe38812e190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe38809cea0 tx=0x7fe378004830 comp rx=0 tx=0).stop 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 shutdown_connections 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe35803dd40 0x7fe358040200 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe38813b760 0x7fe38812e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe3880a3bb0 0x7fe38812e190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 --2- 10.20.193.51:0/3551358276 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe3880a0750 0x7fe38812dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 >> 10.20.193.51:0/3551358276 conn(0x7fe3880a30c0 msgr2=0x7fe388138960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 shutdown_connections 2026-02-17T12:06:23.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.348+0000 7fe38dc0e640 1 -- 10.20.193.51:0/3551358276 wait complete. 2026-02-17T12:06:23.357 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:06:23.357 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:06:23.358 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:06:23.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: get_monmap_and_config 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: monmap: 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:23.426984+0000 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:23.426984+0000 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.435 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 Processor -- start 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 -- start start 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: init 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1c0c0a3bb0 0x7f1c0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-a con 0x7f1c0c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c0c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-c con 0x7f1c0c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c0c06e140 con 0x7f1c0c0a0750 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0c09f910 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0c09ccd0 con 0x7f1c0c13b760 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c14722640 10 monclient(hunting): authenticate will time out at 1871.045723s 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f1c0c0a3bb0 0x7f1c0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c11c96640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f1c0c0a0750 0x7f1c0c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35944/0 (socket says 10.20.193.51:35944) 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c11c96640 1 -- 10.20.193.51:0/2121216128 learned_addr learned my addr 10.20.193.51:0/2121216128 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): get_auth_request con 0x7f1c0c0a3bb0 auth_method 0 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12c98640 1 --2- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12c98640 10 monclient(hunting): get_auth_request con 0x7f1c0c13b760 auth_method 0 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12c98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12c98640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.426+0000 7f1c12c98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 10 monclient(hunting): handle_auth_done global_id 254208 payload 274 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12c98640 1 -- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 msgr2=0x7f1c0c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12c98640 1 -- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 msgr2=0x7f1c0c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:23.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12c98640 1 --2- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 1 -- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 msgr2=0x7f1c0c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12c98640 1 --2- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 1 --2- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 1 -- 10.20.193.51:0/2121216128 >> v1:10.20.193.51:6789/0 conn(0x7f1c0c0a0750 legacy=0x7f1c0c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 1 monclient: found mon.noname-a 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.427+0000 7f1c12497640 1 -- 10.20.193.51:0/2121216128 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c09eec0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c12497640 1 -- 10.20.193.51:0/2121216128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 msgr2=0x7f1c0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c12497640 1 --2- 10.20.193.51:0/2121216128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c09dac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c09f5f0 tx=0x7f1bfc02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ed5f6cf073b82b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 1 -- 10.20.193.51:0/2121216128 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc03c070 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: dump: 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.441 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 1 -- 10.20.193.51:0/2121216128 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc02fbd0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c14722640 5 monclient: authenticate success, global_id 254208 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 1 -- 10.20.193.51:0/2121216128 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc037440 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c11495640 10 monclient: dump: 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c14722640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.429+0000 7f1c14722640 4 set_mon_vals no callback set 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 10 monclient: shutdown 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- 10.20.193.51:0/2121216128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 msgr2=0x7f1c0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 --2- 10.20.193.51:0/2121216128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c09dac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c09f5f0 tx=0x7f1bfc02ed50 comp rx=0 tx=0).stop 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- 10.20.193.51:0/2121216128 shutdown_connections 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 --2- 10.20.193.51:0/2121216128 >> v2:10.20.193.142:3300/0 conn(0x7f1c0c13b760 0x7f1c0c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 --2- 10.20.193.51:0/2121216128 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c09dac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- 10.20.193.51:0/2121216128 >> 10.20.193.51:0/2121216128 conn(0x7f1c0c0a30c0 msgr2=0x7f1c0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- 10.20.193.51:0/2121216128 shutdown_connections 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- 10.20.193.51:0/2121216128 wait complete. 2026-02-17T12:06:23.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 10 monclient: monmap: 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 Processor -- start 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 1 -- start start 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 10 monclient: init 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.430+0000 7f1c14722640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1c0c0a0750 0x7f1c0c1cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-c con 0x7f1c0c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-a con 0x7f1c0c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1c0c13b760 0x7f1c0c1d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): picked mon.noname-b con 0x7f1c0c13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:23.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c0a04b0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c09c850 con 0x7f1c0c13b760 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c09e710 con 0x7f1c0c0a0750 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c14722640 10 monclient(hunting): authenticate will time out at 1871.050060s 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38170/0 (socket says 10.20.193.51:38170) 2026-02-17T12:06:23.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 -- 10.20.193.51:0/3013271457 learned_addr learned my addr 10.20.193.51:0/3013271457 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): get_auth_request con 0x7f1c0c0a3bb0 auth_method 0 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1c0c0a0750 0x7f1c0c1cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): get_auth_request con 0x7f1c0c0a0750 auth_method 0 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient(hunting): handle_auth_done global_id 254211 payload 824 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1c0c0a0750 msgr2=0x7f1c0c1cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1c0c0a0750 0x7f1c0c1cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1c0c13b760 msgr2=0x7f1c0c1d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1c0c13b760 0x7f1c0c1d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 monclient: found mon.noname-a 2026-02-17T12:06:23.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.431+0000 7f1c11c96640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c0961d0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c11c96640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 msgr2=0x7f1c0c1cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c11c96640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c750 tx=0x7f1c0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00005de0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: dump: 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.455 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00007070 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00007440 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1bf2ffd640 10 monclient: dump: 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.457 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c10c94640 4 set_mon_vals no callback set 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 5 monclient: authenticate success, global_id 254211 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 10 monclient: _renew_subs 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c096590 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 10 monclient: _renew_subs 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.433+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c095140 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c14722640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c14722640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 0x7f1c0c08d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c0956a0 con 0x7f1c0c08d3f0 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 0x7f1c0c08d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient: get_auth_request con 0x7f1c0c08d3f0 auth_method 0 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1c00007620 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 10 monclient(hunting): handle_auth_done global_id 254214 payload 824 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12497640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c0c09c250 con 0x7f1c0c08d3f0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1bf2ffd640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1bdc03dd60 0x7f1bdc040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(786..786 src has 323..786) ==== 4843+0+0 (secure 0 0 0) 0x7f1c000523b0 con 0x7f1c0c0a3bb0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12c98640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1bdc03dd60 0x7f1bdc040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.434+0000 7f1c12c98640 10 monclient: get_auth_request con 0x7f1bdc03dd60 auth_method 0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1c12497640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 msgr2=0x7f1c0c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1c12497640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 0x7f1c0c08d7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc039000 tx=0x7f1bfc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc03c040 con 0x7f1c0c08d3f0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 10 monclient: dump: 2026-02-17T12:06:23.460 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1bfc037e30 con 0x7f1c0c08d3f0 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 msgr2=0x7f1c0c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 0x7f1c0c08d7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc039000 tx=0x7f1bfc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 msgr2=0x7f1c0c08d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.436+0000 7f1bf2ffd640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08d3f0 0x7f1c0c08d7d0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc039000 tx=0x7f1bfc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.437+0000 7f1c12c98640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1bdc03dd60 0x7f1bdc040220 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c097320 tx=0x7f1c080096d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c14722640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c14722640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 0x7f1c0c1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c14722640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c09dac0 con 0x7f1c0c08dd10 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 0x7f1c0c1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient: get_auth_request con 0x7f1c0c08dd10 auth_method 0 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.439+0000 7f1c12497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.440+0000 7f1c12497640 10 monclient(hunting): handle_auth_done global_id 254217 payload 824 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.440+0000 7f1c12497640 1 -- 10.20.193.51:0/3013271457 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c0c09d7b0 con 0x7f1c0c08dd10 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c12497640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 msgr2=0x7f1c0c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c12497640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 0x7f1c0c1daad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc02ed90 tx=0x7f1bfc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc03c030 con 0x7f1c0c08dd10 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 10 monclient: dump: 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.463 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f1bfc003bd0 con 0x7f1c0c08dd10 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 msgr2=0x7f1c0c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 0x7f1c0c1daad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc02ed90 tx=0x7f1bfc008030 comp rx=0 tx=0).stop 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 msgr2=0x7f1c0c1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:23.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1bf2ffd640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c08dd10 0x7f1c0c1daad0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc02ed90 tx=0x7f1bfc008030 comp rx=0 tx=0).stop 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 57489, 2026-02-17T12:06:23.465 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.466 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.467 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:23.468 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.469 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.470 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.471 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.472 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.473 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.474 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.475 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.476 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:23.476 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1bdc03dd60 msgr2=0x7f1bdc040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1bdc03dd60 0x7f1bdc040220 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c097320 tx=0x7f1c080096d0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 10 monclient: shutdown 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 msgr2=0x7f1c0c1cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c750 tx=0x7f1c0000cc20 comp rx=0 tx=0).stop 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c12c98640 1 -- 10.20.193.51:0/3013271457 reap_dead start 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 shutdown_connections 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 --2- 10.20.193.51:0/3013271457 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1c0c0a3bb0 0x7f1c0c1cfda0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 >> 10.20.193.51:0/3013271457 conn(0x7f1c0c0a30c0 msgr2=0x7f1c0c13ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 shutdown_connections 2026-02-17T12:06:23.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.442+0000 7f1c14722640 1 -- 10.20.193.51:0/3013271457 wait complete. 2026-02-17T12:06:23.478 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:23.478 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:06:23.478 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:06:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 10 monclient: get_monmap_and_config 2026-02-17T12:06:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 10 monclient: monmap: 2026-02-17T12:06:23.544 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.544 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:23.543289+0000 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:23.543289+0000 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:23.545 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 1 Processor -- start 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 1 -- start start 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.542+0000 7f77623f5640 10 monclient: init 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-17T12:06:23.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 0x7f775c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-a con 0x7f775c138600 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-b con 0x7f775c0a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f775c0a58a0 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c0a1df0 con 0x7f775c0a58a0 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f775c0a6830 con 0x7f775c138600 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f775c0a2c00 con 0x7f775c0a35a0 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f77623f5640 10 monclient(hunting): authenticate will time out at 1871.162249s 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 0x7f775c1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f776096b640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f775c0a58a0 0x7f775c13f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:35948/0 (socket says 10.20.193.51:35948) 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f776096b640 1 -- 10.20.193.51:0/1297207424 learned_addr learned my addr 10.20.193.51:0/1297207424 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): get_auth_request con 0x7f775c0a35a0 auth_method 0 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): get_auth_request con 0x7f775c138600 auth_method 0 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient(hunting): handle_auth_done global_id 234395 payload 274 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 -- 10.20.193.51:0/1297207424 >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 msgr2=0x7f775c1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 --2- 10.20.193.51:0/1297207424 >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 0x7f775c1389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 -- 10.20.193.51:0/1297207424 >> v1:10.20.193.51:6789/0 conn(0x7f775c0a58a0 legacy=0x7f775c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 monclient: found mon.noname-b 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775b7fe640 1 -- 10.20.193.51:0/1297207424 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c138f20 con 0x7f775c0a35a0 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.543+0000 7f775bfff640 1 --2- 10.20.193.51:0/1297207424 >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 0x7f775c1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:06:23.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.545+0000 7f775b7fe640 1 -- 10.20.193.51:0/1297207424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 msgr2=0x7f775c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.545+0000 7f775b7fe640 1 --2- 10.20.193.51:0/1297207424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c0a5360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5aa2ff1d9c9e97 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 1 -- 10.20.193.51:0/1297207424 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c03c070 con 0x7f775c0a35a0 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: dump: 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.559 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 1 -- 10.20.193.51:0/1297207424 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c02fc00 con 0x7f775c0a35a0 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 1 -- 10.20.193.51:0/1297207424 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c037440 con 0x7f775c0a35a0 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 5 monclient: authenticate success, global_id 234395 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 4 set_mon_vals no callback set 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f775affd640 10 monclient: dump: 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 10 monclient: shutdown 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 -- 10.20.193.51:0/1297207424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 msgr2=0x7f775c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 --2- 10.20.193.51:0/1297207424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c0a5360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c02ed80 comp rx=0 tx=0).stop 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 -- 10.20.193.51:0/1297207424 shutdown_connections 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 --2- 10.20.193.51:0/1297207424 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c0a5360 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 --2- 10.20.193.51:0/1297207424 >> v2:10.20.193.51:3300/0 conn(0x7f775c138600 0x7f775c1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 -- 10.20.193.51:0/1297207424 >> 10.20.193.51:0/1297207424 conn(0x7f775c0a7460 msgr2=0x7f775c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 -- 10.20.193.51:0/1297207424 shutdown_connections 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 1 -- 10.20.193.51:0/1297207424 wait complete. 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.546+0000 7f77623f5640 10 monclient: monmap: 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:23.562 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 Processor -- start 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 -- start start 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient: init 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c1cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-c con 0x7f775c0a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f775c0a58a0 0x7f775c1366c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-b con 0x7f775c0a58a0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 0x7f775c136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): picked mon.noname-a con 0x7f775c138600 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0a25b0 con 0x7f775c138600 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0a22d0 con 0x7f775c0a58a0 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f775c0a15f0 con 0x7f775c0a35a0 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f77623f5640 10 monclient(hunting): authenticate will time out at 1871.166335s 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c1cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 0x7f775c136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c1cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55136/0 (socket says 10.20.193.51:55136) 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 1 -- 10.20.193.51:0/2740343378 learned_addr learned my addr 10.20.193.51:0/2740343378 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): get_auth_request con 0x7f775c0a35a0 auth_method 0 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): get_auth_request con 0x7f775c138600 auth_method 0 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient(hunting): handle_auth_done global_id 254223 payload 824 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 msgr2=0x7f775c1cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c0a35a0 0x7f775c1cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f775c0a58a0 msgr2=0x7f775c1366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f775c0a58a0 0x7f775c1366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 monclient: found mon.noname-a 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.547+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c127b00 con 0x7f775c138600 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 msgr2=0x7f775c136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f776096b640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 0x7f775c136c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775000caf0 tx=0x7f7750005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775000add0 con 0x7f775c138600 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: dump: 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 5 monclient: authenticate success, global_id 254223 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 10 monclient: _renew_subs 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c126270 con 0x7f775c138600 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750012400 con 0x7f775c138600 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77500127f0 con 0x7f775c138600 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f7758ff9640 10 monclient: dump: 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f775a7fc640 4 set_mon_vals no callback set 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 10 monclient: _renew_subs 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.549+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c137f80 con 0x7f775c138600 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f77623f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f77623f5640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 0x7f775c1248f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f775c0a5360 con 0x7f775c127fb0 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 0x7f775c1248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient: get_auth_request con 0x7f775c127fb0 auth_method 0 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f77500129d0 con 0x7f775c138600 2026-02-17T12:06:23.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 10 monclient(hunting): handle_auth_done global_id 234401 payload 824 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775bfff640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f775c1cf760 con 0x7f775c127fb0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f7758ff9640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f772c03dd40 0x7f772c040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(786..786 src has 323..786) ==== 4843+0+0 (secure 0 0 0) 0x7f7750052ad0 con 0x7f775c138600 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775b7fe640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f772c03dd40 0x7f772c040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.550+0000 7f775b7fe640 10 monclient: get_auth_request con 0x7f772c03dd40 auth_method 0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.552+0000 7f775bfff640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 msgr2=0x7f775c1248f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.552+0000 7f775bfff640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 0x7f775c1248f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7748011c00 tx=0x7f774800f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748014650 con 0x7f775c127fb0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 10 monclient: dump: 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.571 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7748014650 con 0x7f775c127fb0 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 msgr2=0x7f775c1248f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 0x7f775c1248f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7748011c00 tx=0x7f774800f610 comp rx=0 tx=0).stop 2026-02-17T12:06:23.572 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 msgr2=0x7f775c1248f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:23.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f7758ff9640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c127fb0 0x7f775c1248f0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7748011c00 tx=0x7f774800f610 comp rx=0 tx=0).stop 2026-02-17T12:06:23.573 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.553+0000 7f775b7fe640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f772c03dd40 0x7f772c040200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f77623f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:23.574 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f77623f5640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 0x7f775c1da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f77623f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f775c069780 con 0x7f775c072880 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 0x7f775c1da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient: get_auth_request con 0x7f775c072880 auth_method 0 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 10 monclient(hunting): handle_auth_done global_id 234404 payload 824 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.556+0000 7f775bfff640 1 -- 10.20.193.51:0/2740343378 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f775c124e30 con 0x7f775c072880 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f775bfff640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 msgr2=0x7f775c1da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.575 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f775bfff640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 0x7f775c1da5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f774801c000 tx=0x7f77480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748004220 con 0x7f775c072880 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 10 monclient: dump: 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.576 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f7748004220 con 0x7f775c072880 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 msgr2=0x7f775c1da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 0x7f775c1da5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f774801c000 tx=0x7f77480047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 msgr2=0x7f775c1da5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.558+0000 7f7758ff9640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f775c072880 0x7f775c1da5d0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f774801c000 tx=0x7f77480047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:23.577 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 160553, 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.578 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.579 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:23.580 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:23.581 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.582 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.583 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:23.584 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:23.585 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.586 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:23.587 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:23.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f772c03dd40 msgr2=0x7f772c040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f772c03dd40 0x7f772c040200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c031000 comp rx=0 tx=0).stop 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 10 monclient: shutdown 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 msgr2=0x7f775c136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 --2- 10.20.193.51:0/2740343378 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f775c138600 0x7f775c136c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775000caf0 tx=0x7f7750005c70 comp rx=0 tx=0).stop 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 reap_dead start 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f776096b640 1 -- 10.20.193.51:0/2740343378 reap_dead start 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 shutdown_connections 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 >> 10.20.193.51:0/2740343378 conn(0x7f775c0a7460 msgr2=0x7f775c06fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 shutdown_connections 2026-02-17T12:06:23.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.559+0000 7f77623f5640 1 -- 10.20.193.51:0/2740343378 wait complete. 2026-02-17T12:06:23.589 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:23.589 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:06:23.590 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: get_monmap_and_config 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: monmap: 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:23.658076+0000 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:23.658076+0000 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 Processor -- start 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 -- start start 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: init 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 0x7f342809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-a con 0x7f34280a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-b con 0x7f34280a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f342809e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342806e140 con 0x7f342809e540 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f34280a3f90 con 0x7f34280a3bb0 2026-02-17T12:06:23.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f342809f910 con 0x7f34280a0750 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f342e32c640 10 monclient(hunting): authenticate will time out at 1871.276829s 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 0x7f342809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 0x7f342809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38202/0 (socket says 10.20.193.51:38202) 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:55162/0 (socket says 10.20.193.51:55162) 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 1 -- 10.20.193.51:0/1723705642 learned_addr learned my addr 10.20.193.51:0/1723705642 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): get_auth_request con 0x7f34280a3bb0 auth_method 0 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): get_auth_request con 0x7f34280a0750 auth_method 0 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.657+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 10 monclient(hunting): handle_auth_done global_id 234407 payload 274 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 1 -- 10.20.193.51:0/1723705642 >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 msgr2=0x7f342809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 1 --2- 10.20.193.51:0/1723705642 >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 0x7f342809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 1 -- 10.20.193.51:0/1723705642 >> v1:10.20.193.142:6789/0 conn(0x7f342809e540 legacy=0x7f342813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 1 monclient: found mon.noname-b 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:23.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.658+0000 7f34277fe640 1 -- 10.20.193.51:0/1723705642 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342809ccd0 con 0x7f34280a0750 2026-02-17T12:06:23.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f34277fe640 1 -- 10.20.193.51:0/1723705642 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 msgr2=0x7f342809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f34277fe640 1 --2- 10.20.193.51:0/1723705642 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f342806c1c0 tx=0x7f341802ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ab69b4cea4e9b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 1 -- 10.20.193.51:0/1723705642 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341803c070 con 0x7f34280a0750 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: dump: 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 1 -- 10.20.193.51:0/1723705642 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341802fbf0 con 0x7f34280a0750 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 5 monclient: authenticate success, global_id 234407 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 1 -- 10.20.193.51:0/1723705642 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418037440 con 0x7f34280a0750 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 4 set_mon_vals no callback set 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f3426ffd640 10 monclient: dump: 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.670 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 10 monclient: shutdown 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 1 -- 10.20.193.51:0/1723705642 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 msgr2=0x7f342809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 1 --2- 10.20.193.51:0/1723705642 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f342806c1c0 tx=0x7f341802ed70 comp rx=0 tx=0).stop 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.660+0000 7f342e32c640 1 -- 10.20.193.51:0/1723705642 shutdown_connections 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 --2- 10.20.193.51:0/1723705642 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a0750 0x7f342809e000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 --2- 10.20.193.51:0/1723705642 >> v2:10.20.193.51:3300/0 conn(0x7f34280a3bb0 0x7f342809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 -- 10.20.193.51:0/1723705642 >> 10.20.193.51:0/1723705642 conn(0x7f34280a30c0 msgr2=0x7f34280a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 -- 10.20.193.51:0/1723705642 shutdown_connections 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 -- 10.20.193.51:0/1723705642 wait complete. 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 10 monclient: build_initial_monmap 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 10 monclient: monmap: 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:23.671 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 Processor -- start 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 1 -- start start 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.661+0000 7f342e32c640 10 monclient: init 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 0x7f34281cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-a con 0x7f342809e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34280a0750 0x7f342809be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-b con 0x7f34280a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a3bb0 0x7f3428092b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): picked mon.noname-c con 0x7f34280a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f34280a04b0 con 0x7f342809e540 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f342809c850 con 0x7f34280a0750 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f342813de80 con 0x7f34280a3bb0 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342e32c640 10 monclient(hunting): authenticate will time out at 1871.281114s 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 0x7f34281cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 0x7f34281cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38204/0 (socket says 10.20.193.51:38204) 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 -- 10.20.193.51:0/3133553738 learned_addr learned my addr 10.20.193.51:0/3133553738 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): get_auth_request con 0x7f342809e540 auth_method 0 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a3bb0 0x7f3428092b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): get_auth_request con 0x7f34280a3bb0 auth_method 0 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f342c8a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient(hunting): handle_auth_done global_id 254229 payload 824 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a3bb0 msgr2=0x7f3428092b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f34280a3bb0 0x7f3428092b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34280a0750 msgr2=0x7f342809be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f34280a0750 0x7f342809be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient: _finish_hunting 0 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 monclient: found mon.noname-a 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.662+0000 7f3427fff640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342809d7b0 con 0x7f342809e540 2026-02-17T12:06:23.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3427fff640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 msgr2=0x7f34281cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3427fff640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 0x7f34281cf150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f341400e930 tx=0x7f341400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414017070 con 0x7f342809e540 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: dump: 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: _finish_auth 0 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:06:23.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341400cb90 con 0x7f342809e540 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 5 monclient: authenticate success, global_id 254229 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 10 monclient: _renew_subs 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3428095780 con 0x7f342809e540 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414013470 con 0x7f342809e540 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f3424ff9640 10 monclient: dump: 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:23.676 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f34267fc640 4 set_mon_vals no callback set 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 10 monclient: _renew_subs 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.664+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34280965c0 con 0x7f342809e540 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342e32c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342e32c640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f342809dac0 con 0x7f342809c350 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3414024060 con 0x7f342809e540 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f3424ff9640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33f803dd10 0x7f33f80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(786..786 src has 323..786) ==== 4843+0+0 (secure 0 0 0) 0x7f3414052670 con 0x7f342809e540 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f342809c350 auth_method 0 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:23.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342c8a2640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33f803dd10 0x7f33f80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.665+0000 7f342c8a2640 10 monclient: get_auth_request con 0x7f33f803dd10 auth_method 0 2026-02-17T12:06:23.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.668+0000 7f342c8a2640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33f803dd10 0x7f33f80401d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f342809d210 tx=0x7f341c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f342809c350 auth_method 0 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:23.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:23.866+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:06:23.980 INFO:tasks.rados.rados.0.trial142.stdout:3438: done (0 left) 2026-02-17T12:06:23.980 INFO:tasks.rados.rados.0.trial142.stdout:3439: read oid 37 snap -1 2026-02-17T12:06:23.980 INFO:tasks.rados.rados.0.trial142.stdout:3439: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:23.980 INFO:tasks.rados.rados.0.trial142.stdout:3440: write (excl) oid 44 current snap is 385 2026-02-17T12:06:23.980 INFO:tasks.rados.rados.0.trial142.stdout:3440: seq_num 1186 ranges {733102=596382,1768350=758067,3136140=704019} 2026-02-17T12:06:23.984 INFO:tasks.rados.rados.0.trial142.stdout:3440: writing trial14245205-44 from 733102 to 1329484 tid 1 2026-02-17T12:06:23.989 INFO:tasks.rados.rados.0.trial142.stdout:3440: writing trial14245205-44 from 1768350 to 2526417 tid 2 2026-02-17T12:06:23.994 INFO:tasks.rados.rados.0.trial142.stdout:3440: writing trial14245205-44 from 3136140 to 3840159 tid 3 2026-02-17T12:06:23.994 INFO:tasks.rados.rados.0.trial142.stdout:3441: copy_from oid 3 from oid 42 current snap is 385 2026-02-17T12:06:23.994 INFO:tasks.rados.rados.0.trial142.stdout:3439: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:24.182 INFO:tasks.rados.rados.0.trial142.stdout:3440: finishing write tid 1 to trial14245205-44 2026-02-17T12:06:24.182 INFO:tasks.rados.rados.0.trial142.stdout:3440: finishing write tid 2 to trial14245205-44 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: finishing write tid 3 to trial14245205-44 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3439: done (2 left) 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3442: copy_from oid 39 from oid 37 current snap is 385 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: finishing write tid 4 to trial14245205-44 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: finishing write tid 5 to trial14245205-44 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: oid 44 updating version 0 to 3129 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: oid 44 version 3129 is already newer than 3128 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: oid 44 updating version 3129 to 3131 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:3440: oid 44 version 3131 is already newer than 3130 2026-02-17T12:06:24.183 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3131 (ObjNum 1186 snap 385 seq_num 1186) dirty exists 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3440: left oid 44 (ObjNum 1186 snap 385 seq_num 1186) 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3441: finishing copy_from racing read to trial14245205-3 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3441: finishing copy_from to trial14245205-3 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2741 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3440: done (2 left) 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3441: done (1 left) 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3443: delete oid 2 current snap is 385 2026-02-17T12:06:24.184 INFO:tasks.rados.rados.0.trial142.stdout:3443: done (1 left) 2026-02-17T12:06:24.185 INFO:tasks.rados.rados.0.trial142.stdout:3444: snap_create 2026-02-17T12:06:24.187 INFO:tasks.rados.rados.0.trial142.stdout:3442: finishing copy_from racing read to trial14245205-39 2026-02-17T12:06:24.189 INFO:tasks.rados.rados.0.trial142.stdout:3442: finishing copy_from to trial14245205-39 2026-02-17T12:06:24.189 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2718 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:06:24.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:24.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f342809c350 auth_method 0 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:24.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:24.267+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:06:24.985 INFO:tasks.rados.rados.0.trial142.stdout:3442: done (1 left) 2026-02-17T12:06:24.985 INFO:tasks.rados.rados.0.trial142.stdout:3444: done (0 left) 2026-02-17T12:06:24.985 INFO:tasks.rados.rados.0.trial142.stdout:3445: write oid 23 current snap is 386 2026-02-17T12:06:24.985 INFO:tasks.rados.rados.0.trial142.stdout:3445: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2026-02-17T12:06:24.991 INFO:tasks.rados.rados.0.trial142.stdout:3445: writing trial14245205-23 from 766716 to 1513596 tid 1 2026-02-17T12:06:24.996 INFO:tasks.rados.rados.0.trial142.stdout:3445: writing trial14245205-23 from 2168961 to 2930697 tid 2 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3445: writing trial14245205-23 from 3474633 to 3917549 tid 3 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3446: copy_from oid 32 from oid 21 current snap is 386 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3445: finishing write tid 1 to trial14245205-23 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3445: finishing write tid 2 to trial14245205-23 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3447: write (excl) oid 48 current snap is 386 2026-02-17T12:06:25.000 INFO:tasks.rados.rados.0.trial142.stdout:3447: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2026-02-17T12:06:25.004 INFO:tasks.rados.rados.0.trial142.stdout:3447: writing trial14245205-48 from 783523 to 1205652 tid 1 2026-02-17T12:06:25.009 INFO:tasks.rados.rados.0.trial142.stdout:3447: writing trial14245205-48 from 1827443 to 2449190 tid 2 2026-02-17T12:06:25.015 INFO:tasks.rados.rados.0.trial142.stdout:3447: writing trial14245205-48 from 3218409 to 3872597 tid 3 2026-02-17T12:06:25.015 INFO:tasks.rados.rados.0.trial142.stdout:3448: snap_remove snap 356 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f342809c350 auth_method 0 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:25.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 10 monclient(hunting): handle_auth_done global_id 264100 payload 824 2026-02-17T12:06:25.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.068+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3428069830 con 0x7f342809c350 2026-02-17T12:06:25.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f342809f230 tx=0x7f3418037670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341803c070 con 0x7f342809c350 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 10 monclient: dump: 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.074 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f341803d040 con 0x7f342809c350 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:25.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f342809f230 tx=0x7f3418037670 comp rx=0 tx=0).stop 2026-02-17T12:06:25.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 msgr2=0x7f34280930c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:25.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.071+0000 7f3424ff9640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f342809c350 0x7f34280930c0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f342809f230 tx=0x7f3418037670 comp rx=0 tx=0).stop 2026-02-17T12:06:25.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.074+0000 7f342e32c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:25.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.074+0000 7f342e32c640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.074+0000 7f342e32c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.074+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3428093a10 con 0x7f3428093600 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f3428093600 auth_method 0 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 10 monclient(hunting): handle_auth_done global_id 264103 payload 824 2026-02-17T12:06:25.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.075+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3428096190 con 0x7f3428093600 2026-02-17T12:06:25.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.077+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 msgr2=0x7f34281da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:06:25.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.077+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 msgr2=0x7f34281da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:06:25.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.077+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f3418002410 tx=0x7f3418033000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:25.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.077+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: get_auth_request con 0x7f3428093600 auth_method 0 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: _init_auth method 2 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: _init_auth already have auth, reseting 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: handle_auth_reply_more payload 9 2026-02-17T12:06:25.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-17T12:06:25.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.278+0000 7f34277fe640 10 monclient: handle_auth_done global_id 264103 payload 293 2026-02-17T12:06:25.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f34277fe640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 msgr2=0x7f34281da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:25.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f34277fe640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3418002410 tx=0x7f3418041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:25.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341805b070 con 0x7f3428093600 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 10 monclient: dump: 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.284 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f3418003b20 con 0x7f3428093600 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 msgr2=0x7f34281da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3418002410 tx=0x7f3418041000 comp rx=0 tx=0).stop 2026-02-17T12:06:25.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 msgr2=0x7f34281da4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f3424ff9640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3428093600 0x7f34281da4a0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3418002410 tx=0x7f3418041000 comp rx=0 tx=0).stop 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:06:25.286 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 5272, 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 3, 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:25.287 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:25.288 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:25.289 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:25.290 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:25.291 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:25.292 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:25.293 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.294 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.295 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:25.296 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.297 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:25.298 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:25.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:25.300 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:25.300 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:25.300 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:25.300 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:25.300 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:25.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33f803dd10 msgr2=0x7f33f80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33f803dd10 0x7f33f80401d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f342809d210 tx=0x7f341c00d040 comp rx=0 tx=0).stop 2026-02-17T12:06:25.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 10 monclient: shutdown 2026-02-17T12:06:25.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:25.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 msgr2=0x7f34281cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 --2- 10.20.193.51:0/3133553738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f342809e540 0x7f34281cf150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f341400e930 tx=0x7f341400ee00 comp rx=0 tx=0).stop 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342c8a2640 1 -- 10.20.193.51:0/3133553738 reap_dead start 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342c8a2640 1 -- 10.20.193.51:0/3133553738 reap_dead start 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 shutdown_connections 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 >> 10.20.193.51:0/3133553738 conn(0x7f34280a30c0 msgr2=0x7f3428073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 shutdown_connections 2026-02-17T12:06:25.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.281+0000 7f342e32c640 1 -- 10.20.193.51:0/3133553738 wait complete. 2026-02-17T12:06:25.304 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:25.304 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:06:25.304 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:06:25.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.369+0000 7f8db0cbf640 10 monclient: get_monmap_and_config 2026-02-17T12:06:25.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.369+0000 7f8db0cbf640 10 monclient: build_initial_monmap 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient: monmap: 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:25.370957+0000 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:25.370957+0000 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:25.375 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 Processor -- start 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 -- start start 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient: init 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 0x7f8dac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-b con 0x7f8dac0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 0x7f8dac09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-c con 0x7f8dac0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8dac09e540 0x7f8dac13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-a con 0x7f8dac09e540 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0a3f90 con 0x7f8dac09e540 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac06e140 con 0x7f8dac0a0750 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac09f910 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8db0cbf640 10 monclient(hunting): authenticate will time out at 1872.989728s 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 0x7f8dac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8dac09e540 0x7f8dac13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 0x7f8dac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58382/0 (socket says 10.20.193.51:58382) 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 1 -- 10.20.193.51:0/807190410 learned_addr learned my addr 10.20.193.51:0/807190410 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): get_auth_request con 0x7f8dac09e540 auth_method 0 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): get_auth_request con 0x7f8dac0a3bb0 auth_method 0 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8da9d74640 1 --2- 10.20.193.51:0/807190410 >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 0x7f8dac09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8da9d74640 10 monclient(hunting): get_auth_request con 0x7f8dac0a0750 auth_method 0 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8da9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8da9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.370+0000 7f8da9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 10 monclient(hunting): handle_auth_done global_id 254232 payload 274 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 -- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 msgr2=0x7f8dac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:25.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 --2- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 0x7f8dac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 -- 10.20.193.51:0/807190410 >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 msgr2=0x7f8dac09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 --2- 10.20.193.51:0/807190410 >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 0x7f8dac09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 10 monclient: _finish_hunting 0 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 monclient: found mon.noname-a 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8daad76640 1 -- 10.20.193.51:0/807190410 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac09ccd0 con 0x7f8dac09e540 2026-02-17T12:06:25.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.371+0000 7f8da9d74640 1 --2- 10.20.193.51:0/807190410 >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 0x7f8dac09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:06:25.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8daad76640 1 -- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac09e540 msgr2=0x7f8dac13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:25.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8daad76640 1 --2- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac09e540 0x7f8dac13c760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069d60 tx=0x7f8d9c02f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9018697ea50c996a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 1 -- 10.20.193.51:0/807190410 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c03c070 con 0x7f8dac09e540 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: dump: 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.387 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: _finish_auth 0 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: _check_auth_tickets 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 5 monclient: authenticate success, global_id 254232 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 1 -- 10.20.193.51:0/807190410 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c037440 con 0x7f8dac09e540 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:25.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 1 -- 10.20.193.51:0/807190410 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c037810 con 0x7f8dac09e540 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 4 set_mon_vals no callback set 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8da9573640 10 monclient: dump: 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.389 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 10 monclient: shutdown 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 1 -- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac09e540 msgr2=0x7f8dac13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.373+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac09e540 0x7f8dac13c760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069d60 tx=0x7f8d9c02f130 comp rx=0 tx=0).stop 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- 10.20.193.51:0/807190410 shutdown_connections 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac09e540 0x7f8dac13c760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/807190410 >> v2:10.20.193.142:3300/0 conn(0x7f8dac0a0750 0x7f8dac09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/807190410 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac0a3bb0 0x7f8dac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- 10.20.193.51:0/807190410 >> 10.20.193.51:0/807190410 conn(0x7f8dac0a30c0 msgr2=0x7f8dac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- 10.20.193.51:0/807190410 shutdown_connections 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- 10.20.193.51:0/807190410 wait complete. 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient: build_initial_monmap 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient: monmap: 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:25.391 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 Processor -- start 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- start start 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient: init 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac09e540 0x7f8dac138030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-c con 0x7f8dac09e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8dac0a0750 0x7f8dac130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-b con 0x7f8dac0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): picked mon.noname-a con 0x7f8dac0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0a04b0 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac09c850 con 0x7f8dac0a0750 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac13cca0 con 0x7f8dac09e540 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8db0cbf640 10 monclient(hunting): authenticate will time out at 1872.993889s 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daa575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac09e540 0x7f8dac138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52078/0 (socket says 10.20.193.51:52078) 2026-02-17T12:06:25.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 1 -- 10.20.193.51:0/2667854292 learned_addr learned my addr 10.20.193.51:0/2667854292 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 10 monclient(hunting): get_auth_request con 0x7f8dac0a3bb0 auth_method 0 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daa575640 10 monclient(hunting): get_auth_request con 0x7f8dac09e540 auth_method 0 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.374+0000 7f8daa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:25.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient(hunting): handle_auth_done global_id 254235 payload 824 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 -- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac09e540 msgr2=0x7f8dac138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac09e540 0x7f8dac138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 -- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8dac0a0750 msgr2=0x7f8dac130e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8dac0a0750 0x7f8dac130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient: _finish_hunting 0 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 monclient: found mon.noname-a 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.375+0000 7f8daad76640 1 -- 10.20.193.51:0/2667854292 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac133420 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8daad76640 1 -- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 msgr2=0x7f8dac131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8daad76640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c02f640 tx=0x7f8d9c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c03c050 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: dump: 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.396 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: _finish_auth 0 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c048070 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c041a50 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8da8d72640 4 set_mon_vals no callback set 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8d92ffd640 10 monclient: dump: 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:25.398 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 5 monclient: authenticate success, global_id 254235 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 10 monclient: _renew_subs 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac1328e0 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 10 monclient: _renew_subs 2026-02-17T12:06:25.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.377+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac0a26a0 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8db0cbf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8db0cbf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8db0cbf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac09dac0 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8d9c041c70 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8d92ffd640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 0x7f8d78040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(788..788 src has 323..788) ==== 4815+0+0 (secure 0 0 0) 0x7f8d9c077e40 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8daa575640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 0x7f8d78040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:25.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.378+0000 7f8daa575640 10 monclient: get_auth_request con 0x7f8d7803dd60 auth_method 0 2026-02-17T12:06:25.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.380+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8d9c051020 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.380+0000 7f8d92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:25.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.380+0000 7f8d92ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:25.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.381+0000 7f8daa575640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 0x7f8d78040220 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006dc0 tx=0x7f8da0009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.495+0000 7f8db0cbf640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.495+0000 7f8db0cbf640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.495+0000 7f8db0cbf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.495+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8dac132d00 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.496+0000 7f8d92ffd640 1 -- 10.20.193.51:0/2667854292 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f8d9c035d80 con 0x7f8dac0a3bb0 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.496+0000 7f8d92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:06:25.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.496+0000 7f8d92ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=10,logm=51} crc {auth=3518401045,config=692619927,health=215887143,kv=282413766,logm=3772815853}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=11,kv=11,logm=53} crc {auth=3511623358,config=692619927,health=1633030943,kv=4015639851,logm=2592097300}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=10,logm=51} crc {auth=3518401045,config=692619927,health=215887143,kv=282413766,logm=3772815853}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.496+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=1,health=12,kv=11,logm=49} crc {auth=274265197,config=1228700967,health=4230565447,kv=393982321,logm=4188765709}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=611332556}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1417315111}) 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=611332556}) 2026-02-17T12:06:25.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4075344889}) 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 msgr2=0x7f8d78040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 0x7f8d78040220 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006dc0 tx=0x7f8da0009340 comp rx=0 tx=0).stop 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 10 monclient: shutdown 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 msgr2=0x7f8dac131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c02f640 tx=0x7f8d9c004b40 comp rx=0 tx=0).stop 2026-02-17T12:06:25.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 shutdown_connections 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8d7803dd60 0x7f8d78040220 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8dac0a3bb0 0x7f8dac131350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8dac0a0750 0x7f8dac130e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 --2- 10.20.193.51:0/2667854292 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8dac09e540 0x7f8dac138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 >> 10.20.193.51:0/2667854292 conn(0x7f8dac0a30c0 msgr2=0x7f8dac072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 shutdown_connections 2026-02-17T12:06:25.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:25.497+0000 7f8db0cbf640 1 -- 10.20.193.51:0/2667854292 wait complete. 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495657166}) 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1560266863}) 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495657166}) 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.497+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=114653766}) 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062965074}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1510923767}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062965074}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.498+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3305974092}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566686526}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2695473059}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566686526}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1948617477}) 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=418113466}) 2026-02-17T12:06:25.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2431197017}) 2026-02-17T12:06:25.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=418113466}) 2026-02-17T12:06:25.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.499+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3016043982}) 2026-02-17T12:06:25.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853227880}) 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082811993}) 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853227880}) 2026-02-17T12:06:25.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2835840170}) 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1161485688}) 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2101112943}) 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1161485688}) 2026-02-17T12:06:25.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3211520803}) 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1234880301}) 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=672425155}) 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1234880301}) 2026-02-17T12:06:25.966 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.963+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3566374447}) 2026-02-17T12:06:25.968 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.969 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493027400}) 2026-02-17T12:06:25.969 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1247027764}) 2026-02-17T12:06:25.969 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.969 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493027400}) 2026-02-17T12:06:25.969 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.966+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3218688591}) 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:3448: done (3 left) 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:3449: rollback oid 43 current snap is 386 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 362 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:3445: finishing write tid 3 to trial14245205-23 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:3445: finishing write tid 4 to trial14245205-23 2026-02-17T12:06:25.971 INFO:tasks.rados.rados.0.trial142.stdout:3445: finishing write tid 5 to trial14245205-23 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3445: oid 23 updating version 0 to 2739 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3445: oid 23 updating version 2739 to 2740 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3445: oid 23 version 2740 is already newer than 2738 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3445: oid 23 updating version 2740 to 2741 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 2741 (ObjNum 1188 snap 386 seq_num 1188) dirty exists 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3445: left oid 23 (ObjNum 1188 snap 386 seq_num 1188) 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3446: finishing copy_from racing read to trial14245205-32 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3446: finishing copy_from to trial14245205-32 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2552 (ObjNum 1013 snap 329 seq_num 1013) dirty exists 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3447: finishing write tid 1 to trial14245205-48 2026-02-17T12:06:25.972 INFO:tasks.rados.rados.0.trial142.stdout:3447: finishing write tid 2 to trial14245205-48 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: finishing write tid 3 to trial14245205-48 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: finishing write tid 4 to trial14245205-48 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: finishing write tid 5 to trial14245205-48 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: oid 48 updating version 0 to 2737 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: oid 48 version 2737 is already newer than 2736 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: oid 48 version 2737 is already newer than 2734 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: oid 48 version 2737 is already newer than 2735 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2737 (ObjNum 1189 snap 386 seq_num 1189) dirty exists 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: left oid 48 (ObjNum 1189 snap 386 seq_num 1189) 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3445: done (3 left) 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3446: done (2 left) 2026-02-17T12:06:25.973 INFO:tasks.rados.rados.0.trial142.stdout:3447: done (1 left) 2026-02-17T12:06:25.974 INFO:tasks.rados.rados.0.trial142.stdout:3450: write oid 42 current snap is 386 2026-02-17T12:06:25.974 INFO:tasks.rados.rados.0.trial142.stdout:3450: seq_num 1190 ranges {400330=497378,1485925=514405} 2026-02-17T12:06:25.974 INFO:tasks.rados.rados.0.trial142.stdout:3450: writing trial14245205-42 from 400330 to 897708 tid 1 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:3450: writing trial14245205-42 from 1485925 to 2000330 tid 2 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:3451: rollback oid 24 current snap is 386 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 357 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:3452: copy_from oid 46 from oid 17 current snap is 386 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:3453: write (excl) oid 49 current snap is 386 2026-02-17T12:06:25.978 INFO:tasks.rados.rados.0.trial142.stdout:3453: seq_num 1191 ranges {417137=572627,1428054=589083} 2026-02-17T12:06:25.982 INFO:tasks.rados.rados.0.trial142.stdout:3453: writing trial14245205-49 from 417137 to 989764 tid 1 2026-02-17T12:06:25.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1057426157}) 2026-02-17T12:06:25.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1683279633}) 2026-02-17T12:06:25.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1057426157}) 2026-02-17T12:06:25.985 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.982+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4135717229}) 2026-02-17T12:06:25.986 INFO:tasks.rados.rados.0.trial142.stdout:3453: writing trial14245205-49 from 1428054 to 2017137 tid 2 2026-02-17T12:06:25.986 INFO:tasks.rados.rados.0.trial142.stdout:3454: snap_remove snap 364 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192621943}) 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3745200078}) 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192621943}) 2026-02-17T12:06:25.987 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:25.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1927954094}) 2026-02-17T12:06:26.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1136184823}) 2026-02-17T12:06:26.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2582549876}) 2026-02-17T12:06:26.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1136184823}) 2026-02-17T12:06:26.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.009+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3657279188}) 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2228902985}) 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1932122927}) 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2228902985}) 2026-02-17T12:06:26.140 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.137+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3807512944}) 2026-02-17T12:06:26.301 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.301 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323919907}) 2026-02-17T12:06:26.301 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2103801085}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323919907}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2424569885}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3792651420}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4002918618}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3792651420}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.291+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3114960653}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247007229}) 2026-02-17T12:06:26.302 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=38681926}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247007229}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2165934777}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049373721}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=290582705}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049373721}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3366161407}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1118050020}) 2026-02-17T12:06:26.303 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=970079561}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1118050020}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.292+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3214895929}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2351266305}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4190452295}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2351266305}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1824980978}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3550259240}) 2026-02-17T12:06:26.304 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4210613694}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3550259240}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3333356862}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4190747915}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4163292967}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4190747915}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.293+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1510688424}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359155378}) 2026-02-17T12:06:26.305 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3097579917}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359155378}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2096129893}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335424484}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4071922599}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335424484}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.294+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1277234055}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450006450}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3282883907}) 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.306 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450006450}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1485895341}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=764453387}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=632119336}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=764453387}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=933000142}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601010288}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3346637815}) 2026-02-17T12:06:26.307 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601010288}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.295+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=599209866}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3923973100}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4032920565}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3923973100}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1614117881}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3132782123}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1912577944}) 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.308 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3132782123}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3307928710}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1183631522}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2708181779}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1183631522}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.296+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3342980509}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2729920123}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1749808334}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2729920123}) 2026-02-17T12:06:26.309 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2140550054}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932445319}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=190100302}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932445319}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1316541230}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662768250}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3427575306}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662768250}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.297+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1853244463}) 2026-02-17T12:06:26.310 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493243262}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3578645300}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493243262}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3669754156}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354461388}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3354622818}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354461388}) 2026-02-17T12:06:26.311 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.298+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=252610693}) 2026-02-17T12:06:26.509 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:06:26.509 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:06:26.577 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 10 monclient: get_monmap_and_config 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 10 monclient: monmap: 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:26.576216+0000 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:26.576216+0000 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:26.578 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 1 Processor -- start 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 1 -- start start 2026-02-17T12:06:26.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.575+0000 7fe2ae27e640 10 monclient: init 2026-02-17T12:06:26.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-17T12:06:26.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe2a80a8140 0x7fe2a8073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-a con 0x7fe2a80a8140 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:26.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe2a80a1d20 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe2a80744e0 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a80a8fe0 con 0x7fe2a80744e0 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a81368f0 con 0x7fe2a80a1d20 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a80a8520 con 0x7fe2a80a8140 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2ae27e640 10 monclient(hunting): authenticate will time out at 1874.195333s 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe2a80a8140 0x7fe2a8073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a7fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe2a80744e0 0x7fe2a81361e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46756/0 (socket says 10.20.193.51:46756) 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a7fff640 1 -- 10.20.193.51:0/133316837 learned_addr learned my addr 10.20.193.51:0/133316837 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:06:26.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe2a80a8140 0x7fe2a8073fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52088/0 (socket says 10.20.193.51:52088) 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): get_auth_request con 0x7fe2a80a8140 auth_method 0 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_done global_id 254238 payload 274 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 -- 10.20.193.51:0/133316837 >> v1:10.20.193.142:6789/0 conn(0x7fe2a80a1d20 legacy=0x7fe2a8135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 -- 10.20.193.51:0/133316837 >> v1:10.20.193.51:6789/0 conn(0x7fe2a80744e0 legacy=0x7fe2a81361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 monclient: found mon.noname-a 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.576+0000 7fe2a77fe640 1 -- 10.20.193.51:0/133316837 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80a3130 con 0x7fe2a80a8140 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a77fe640 1 -- 10.20.193.51:0/133316837 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80a8140 msgr2=0x7fe2a8073fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a77fe640 1 --2- 10.20.193.51:0/133316837 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80a8140 0x7fe2a8073fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2940098d0 tx=0x7fe29402edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343621d54af6c112 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 1 -- 10.20.193.51:0/133316837 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29403c070 con 0x7fe2a80a8140 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: dump: 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 1 -- 10.20.193.51:0/133316837 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29402fce0 con 0x7fe2a80a8140 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 5 monclient: authenticate success, global_id 254238 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 4 set_mon_vals no callback set 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 1 -- 10.20.193.51:0/133316837 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294037660 con 0x7fe2a80a8140 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2a67fc640 10 monclient: dump: 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.592 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 10 monclient: shutdown 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 -- 10.20.193.51:0/133316837 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80a8140 msgr2=0x7fe2a8073fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/133316837 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80a8140 0x7fe2a8073fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2940098d0 tx=0x7fe29402edc0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 -- 10.20.193.51:0/133316837 shutdown_connections 2026-02-17T12:06:26.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/133316837 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80a8140 0x7fe2a8073fa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 -- 10.20.193.51:0/133316837 >> 10.20.193.51:0/133316837 conn(0x7fe2a80a3fd0 msgr2=0x7fe2a806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 -- 10.20.193.51:0/133316837 shutdown_connections 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 1 -- 10.20.193.51:0/133316837 wait complete. 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.579+0000 7fe2ae27e640 10 monclient: monmap: 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.594 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 Processor -- start 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 -- start start 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient: init 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-a con 0x7fe2a80744e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe2a80a1d20 0x7fe2a8139570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-c con 0x7fe2a80a1d20 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2a80a8140 0x7fe2a8139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): picked mon.noname-b con 0x7fe2a80a8140 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80a1200 con 0x7fe2a80744e0 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80a2a50 con 0x7fe2a80a8140 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80a1380 con 0x7fe2a80a1d20 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2ae27e640 10 monclient(hunting): authenticate will time out at 1874.199432s 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52104/0 (socket says 10.20.193.51:52104) 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 -- 10.20.193.51:0/2237196483 learned_addr learned my addr 10.20.193.51:0/2237196483 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): get_auth_request con 0x7fe2a80744e0 auth_method 0 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe2a80a1d20 0x7fe2a8139570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): get_auth_request con 0x7fe2a80a1d20 auth_method 0 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient(hunting): handle_auth_done global_id 254241 payload 824 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 -- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe2a80a1d20 msgr2=0x7fe2a8139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a7fff640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2a80a8140 0x7fe2a8139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe2a80a1d20 0x7fe2a8139570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 -- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2a80a8140 msgr2=0x7fe2a8139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2a80a8140 0x7fe2a8139ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 monclient: found mon.noname-a 2026-02-17T12:06:26.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.580+0000 7fe2a77fe640 1 -- 10.20.193.51:0/2237196483 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a813cec0 con 0x7fe2a80744e0 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2a77fe640 1 -- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 msgr2=0x7fe2a8133960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2a77fe640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe29402f2d0 tx=0x7fe2940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294047020 con 0x7fe2a80744e0 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: dump: 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.599 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe294042670 con 0x7fe2a80744e0 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29403c040 con 0x7fe2a80744e0 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2a5ffb640 4 set_mon_vals no callback set 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe283fff640 10 monclient: dump: 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.601 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2ae27e640 5 monclient: authenticate success, global_id 254241 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2ae27e640 10 monclient: _renew_subs 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2ae27e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.582+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a813bc80 con 0x7fe2a80744e0 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 10 monclient: _renew_subs 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a813cbe0 con 0x7fe2a80744e0 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a80a6550 con 0x7fe2a80744e0 2026-02-17T12:06:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe294042a60 con 0x7fe2a80744e0 2026-02-17T12:06:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe283fff640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 0x7fe278040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(789..789 src has 323..789) ==== 4887+0+0 (secure 0 0 0) 0x7fe294077fc0 con 0x7fe2a80744e0 2026-02-17T12:06:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2a6ffd640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 0x7fe278040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.583+0000 7fe2a6ffd640 10 monclient: get_auth_request con 0x7fe27803dd60 auth_method 0 2026-02-17T12:06:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.586+0000 7fe2a6ffd640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 0x7fe278040220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2a813d0d0 tx=0x7fe298007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.586+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe294051030 con 0x7fe2a80744e0 2026-02-17T12:06:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.586+0000 7fe283fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.604 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.586+0000 7fe283fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3361226680}) 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3792666926}) 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3361226680}) 2026-02-17T12:06:26.605 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.591+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1022366437}) 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.603+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.603+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240701926}) 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1247642991}) 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240701926}) 2026-02-17T12:06:26.606 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.604+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3470106999}) 2026-02-17T12:06:26.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe2ae27e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:06:26.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe2ae27e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:26.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe2ae27e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:26.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe2a813ba00 con 0x7fe2a80744e0 2026-02-17T12:06:26.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe283fff640 1 -- 10.20.193.51:0/2237196483 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fe294040370 con 0x7fe2a80744e0 2026-02-17T12:06:26.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe283fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:26.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.700+0000 7fe283fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:26.703 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":196,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:06:26.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 msgr2=0x7fe278040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 0x7fe278040220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2a813d0d0 tx=0x7fe298007f30 comp rx=0 tx=0).stop 2026-02-17T12:06:26.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 10 monclient: shutdown 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 msgr2=0x7fe2a8133960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe29402f2d0 tx=0x7fe2940047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 shutdown_connections 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe27803dd60 0x7fe278040220 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe2a80a8140 0x7fe2a8139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe2a80a1d20 0x7fe2a8139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 --2- 10.20.193.51:0/2237196483 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe2a80744e0 0x7fe2a8133960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 >> 10.20.193.51:0/2237196483 conn(0x7fe2a80a3fd0 msgr2=0x7fe2a81348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 shutdown_connections 2026-02-17T12:06:26.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.701+0000 7fe2ae27e640 1 -- 10.20.193.51:0/2237196483 wait complete. 2026-02-17T12:06:26.710 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:06:26.710 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:06:26.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:06:26.711 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:06:26.733 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.733 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=125958097}) 2026-02-17T12:06:26.733 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3669136330}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=125958097}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=318318295}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3940827242}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1675167753}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3940827242}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4035460969}) 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2490866113}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=230858849}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2490866113}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.729+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=455372070}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588840146}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2863903150}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588840146}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4018975181}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=374831990}) 2026-02-17T12:06:26.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=356514822}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=374831990}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4007373932}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325268557}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2373718645}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325268557}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.730+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3177920800}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720797120}) 2026-02-17T12:06:26.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3385097003}) 2026-02-17T12:06:26.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720797120}) 2026-02-17T12:06:26.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.731+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3577676396}) 2026-02-17T12:06:26.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.777+0000 7ffafd8b9640 10 monclient: get_monmap_and_config 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.777+0000 7ffafd8b9640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.777+0000 7ffafd8b9640 10 monclient: monmap: 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:26.778872+0000 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:26.778872+0000 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:26.783 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 Processor -- start 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 -- start start 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient: init 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-b con 0x7ffaf80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:26.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffaf80a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 0x7ffaf813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-a con 0x7ffaf813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf806e140 con 0x7ffaf80a0750 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf809f910 con 0x7ffaf813b760 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf809ccd0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffafd8b9640 10 monclient(hunting): authenticate will time out at 1874.397652s 2026-02-17T12:06:26.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 0x7ffaf813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58406/0 (socket says 10.20.193.51:58406) 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/3788423178 learned_addr learned my addr 10.20.193.51:0/3788423178 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request con 0x7ffaf80a3bb0 auth_method 0 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): get_auth_request con 0x7ffaf813b760 auth_method 0 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_done global_id 234422 payload 274 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/3788423178 >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 msgr2=0x7ffaf813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/3788423178 >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 0x7ffaf813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/3788423178 >> v1:10.20.193.142:6789/0 conn(0x7ffaf80a0750 legacy=0x7ffaf809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 monclient: found mon.noname-b 2026-02-17T12:06:26.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/3788423178 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf809eec0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.778+0000 7ffaf77fe640 1 --2- 10.20.193.51:0/3788423178 >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 0x7ffaf813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:06:26.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/3788423178 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 msgr2=0x7ffaf809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/3788423178 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaf809f230 tx=0x7ffaec02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a60aff661fe1bcfe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 1 -- 10.20.193.51:0/3788423178 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec03c070 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: dump: 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 1 -- 10.20.193.51:0/3788423178 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec02fcd0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 1 -- 10.20.193.51:0/3788423178 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec037660 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 5 monclient: authenticate success, global_id 234422 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 4 set_mon_vals no callback set 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffaf5ffb640 10 monclient: dump: 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.800 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 10 monclient: shutdown 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 1 -- 10.20.193.51:0/3788423178 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 msgr2=0x7ffaf809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.781+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/3788423178 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaf809f230 tx=0x7ffaec02ee90 comp rx=0 tx=0).stop 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 -- 10.20.193.51:0/3788423178 shutdown_connections 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/3788423178 >> v2:10.20.193.51:3300/0 conn(0x7ffaf813b760 0x7ffaf813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/3788423178 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf809dac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 -- 10.20.193.51:0/3788423178 >> 10.20.193.51:0/3788423178 conn(0x7ffaf80a30c0 msgr2=0x7ffaf80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 -- 10.20.193.51:0/3788423178 shutdown_connections 2026-02-17T12:06:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 -- 10.20.193.51:0/3788423178 wait complete. 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 10 monclient: monmap: 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:26.802 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 Processor -- start 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 1 -- start start 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.782+0000 7ffafd8b9640 10 monclient: init 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf80a0750 0x7ffaf80950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-a con 0x7ffaf80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf8095610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-c con 0x7ffaf80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffaf813b760 0x7ffaf8095b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): picked mon.noname-b con 0x7ffaf813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:26.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80a04b0 con 0x7ffaf80a0750 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf809c850 con 0x7ffaf813b760 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf809e710 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffafd8b9640 10 monclient(hunting): authenticate will time out at 1874.402133s 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf80a0750 0x7ffaf80950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf8095610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf80a0750 0x7ffaf80950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52124/0 (socket says 10.20.193.51:52124) 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/2102341702 learned_addr learned my addr 10.20.193.51:0/2102341702 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:26.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request con 0x7ffaf80a0750 auth_method 0 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): get_auth_request con 0x7ffaf80a3bb0 auth_method 0 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf77fe640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffaf813b760 0x7ffaf8095b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient(hunting): handle_auth_done global_id 234425 payload 824 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffaf813b760 msgr2=0x7ffaf8095b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ffaf813b760 0x7ffaf8095b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf80a0750 msgr2=0x7ffaf80950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf80a0750 0x7ffaf80950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 monclient: found mon.noname-c 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.783+0000 7ffaf67fc640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf8098a10 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffaf67fc640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 msgr2=0x7ffaf8095610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffaf67fc640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf8095610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c450 tx=0x7ffae000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0016020 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: dump: 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae0012a40 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0012e30 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffacffff640 10 monclient: dump: 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffaf57fa640 4 set_mon_vals no callback set 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 5 monclient: authenticate success, global_id 234425 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 10 monclient: _renew_subs 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf8098cf0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 10 monclient: _renew_subs 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.785+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf809d7b0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffafd8b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 0x7ffaf808d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80a2ba0 con 0x7ffaf808d3f0 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 0x7ffaf808d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient: get_auth_request con 0x7ffaf808d3f0 auth_method 0 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ffae001b400 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_done global_id 254250 payload 824 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaf809dac0 con 0x7ffaf808d3f0 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffacffff640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffac803dd10 0x7ffac80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(789..789 src has 323..789) ==== 4887+0+0 (secure 0 0 0) 0x7ffae00526c0 con 0x7ffaf80a3bb0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf77fe640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffac803dd10 0x7ffac80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.786+0000 7ffaf77fe640 10 monclient: get_auth_request con 0x7ffac803dd10 auth_method 0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 msgr2=0x7ffaf808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 0x7ffaf808d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0091b0 tx=0x7ffaec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec03c040 con 0x7ffaf808d3f0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 10 monclient: dump: 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ffaec041660 con 0x7ffaf808d3f0 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 msgr2=0x7ffaf808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 0x7ffaf808d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0091b0 tx=0x7ffaec0047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 msgr2=0x7ffaf808d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.788+0000 7ffacffff640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808d3f0 0x7ffaf808d7d0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0091b0 tx=0x7ffaec0047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.789+0000 7ffaf77fe640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffac803dd10 0x7ffac80401d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8097190 tx=0x7ffae800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffafd8b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 0x7ffaf81d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffafd8b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf8097560 con 0x7ffaf808dd10 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 0x7ffaf81d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient: get_auth_request con 0x7ffaf808dd10 auth_method 0 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 10 monclient(hunting): handle_auth_done global_id 254253 payload 824 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.792+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/2102341702 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffaf80008d0 con 0x7ffaf808dd10 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffaf6ffd640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 msgr2=0x7ffaf81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffaf6ffd640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 0x7ffaf81d98b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02eed0 tx=0x7ffaec008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec03c040 con 0x7ffaf808dd10 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 10 monclient: dump: 2026-02-17T12:06:26.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7ffaec041e80 con 0x7ffaf808dd10 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 msgr2=0x7ffaf81d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 0x7ffaf81d98b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02eed0 tx=0x7ffaec008030 comp rx=0 tx=0).stop 2026-02-17T12:06:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 msgr2=0x7ffaf81d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffacffff640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ffaf808dd10 0x7ffaf81d98b0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02eed0 tx=0x7ffaec008030 comp rx=0 tx=0).stop 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 60841, 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:26.817 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.818 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.819 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:26.820 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.821 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:26.822 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.823 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.824 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.825 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.826 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:26.827 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffac803dd10 msgr2=0x7ffac80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ffac803dd10 0x7ffac80401d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8097190 tx=0x7ffae800b040 comp rx=0 tx=0).stop 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 10 monclient: shutdown 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 msgr2=0x7ffaf8095610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffafd8b9640 1 --2- 10.20.193.51:0/2102341702 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ffaf80a3bb0 0x7ffaf8095610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c450 tx=0x7ffae000c920 comp rx=0 tx=0).stop 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.794+0000 7ffaf77fe640 1 -- 10.20.193.51:0/2102341702 reap_dead start 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.795+0000 7ffaf77fe640 1 -- 10.20.193.51:0/2102341702 reap_dead start 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.795+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 shutdown_connections 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.795+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 >> 10.20.193.51:0/2102341702 conn(0x7ffaf80a30c0 msgr2=0x7ffaf8072db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.795+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 shutdown_connections 2026-02-17T12:06:26.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.795+0000 7ffafd8b9640 1 -- 10.20.193.51:0/2102341702 wait complete. 2026-02-17T12:06:26.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:26.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:06:26.830 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:06:26.830 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.830 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=320790619}) 2026-02-17T12:06:26.830 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1972907383}) 2026-02-17T12:06:26.831 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.831 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=320790619}) 2026-02-17T12:06:26.831 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.824+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=125529177}) 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 10 monclient: get_monmap_and_config 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 10 monclient: monmap: 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:26.934380+0000 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:26.934380+0000 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.935 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:26.936 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:26.936 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:26.936 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:26.936 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:26.936 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 1 Processor -- start 2026-02-17T12:06:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 1 -- start start 2026-02-17T12:06:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.933+0000 7f3a2020c640 10 monclient: init 2026-02-17T12:06:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a1809dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 0x7f3a1813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a180a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1806e140 con 0x7f3a1809dac0 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3a1809aed0 con 0x7f3a180a0110 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1809caa0 con 0x7f3a180a3bb0 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a2020c640 10 monclient(hunting): authenticate will time out at 1874.553140s 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58414/0 (socket says 10.20.193.51:58414) 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 -- 10.20.193.51:0/621143861 learned_addr learned my addr 10.20.193.51:0/621143861 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): get_auth_request con 0x7f3a180a3bb0 auth_method 0 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1e782640 1 --2- 10.20.193.51:0/621143861 >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 0x7f3a1813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient(hunting): handle_auth_done global_id 234428 payload 274 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 -- 10.20.193.51:0/621143861 >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 msgr2=0x7f3a1813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 --2- 10.20.193.51:0/621143861 >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 0x7f3a1813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 -- 10.20.193.51:0/621143861 >> v1:10.20.193.142:6789/0 conn(0x7f3a1809dac0 legacy=0x7f3a1809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 monclient: found mon.noname-b 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1df81640 1 -- 10.20.193.51:0/621143861 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1809ce60 con 0x7f3a180a3bb0 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1e782640 10 monclient: get_auth_request con 0x7f3a180a0110 auth_method 0 2026-02-17T12:06:26.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.934+0000 7f3a1e782640 1 --2- 10.20.193.51:0/621143861 >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 0x7f3a1813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:06:26.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.936+0000 7f3a1df81640 1 -- 10.20.193.51:0/621143861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 msgr2=0x7f3a1809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.936+0000 7f3a1df81640 1 --2- 10.20.193.51:0/621143861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a1806dc20 tx=0x7f3a0802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3120acd3ebe326f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 1 -- 10.20.193.51:0/621143861 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0803c070 con 0x7f3a180a3bb0 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: dump: 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.951 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 1 -- 10.20.193.51:0/621143861 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0802fe30 con 0x7f3a180a3bb0 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 5 monclient: authenticate success, global_id 234428 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:06:26.952 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 1 -- 10.20.193.51:0/621143861 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08037640 con 0x7f3a180a3bb0 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 4 set_mon_vals no callback set 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a1cf7f640 10 monclient: dump: 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.953 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 10 monclient: shutdown 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 -- 10.20.193.51:0/621143861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 msgr2=0x7f3a1809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 --2- 10.20.193.51:0/621143861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a1806dc20 tx=0x7f3a0802eed0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 -- 10.20.193.51:0/621143861 shutdown_connections 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 --2- 10.20.193.51:0/621143861 >> v2:10.20.193.142:3300/0 conn(0x7f3a180a0110 0x7f3a1813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 --2- 10.20.193.51:0/621143861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a3bb0 0x7f3a1809f4c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 -- 10.20.193.51:0/621143861 >> 10.20.193.51:0/621143861 conn(0x7f3a180a30c0 msgr2=0x7f3a180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 -- 10.20.193.51:0/621143861 shutdown_connections 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 1 -- 10.20.193.51:0/621143861 wait complete. 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 10 monclient: build_initial_monmap 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.937+0000 7f3a2020c640 10 monclient: monmap: 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:26.955 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 Processor -- start 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 -- start start 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient: init 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:06:26.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a1809dac0 0x7f3a1812b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a1809dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 0x7f3a1812bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a180a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a3bb0 0x7f3a1812c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): picked mon.noname-a con 0x7f3a180a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1809a880 con 0x7f3a180a3bb0 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180a0520 con 0x7f3a1809dac0 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1813cca0 con 0x7f3a180a0110 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:26.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a2020c640 10 monclient(hunting): authenticate will time out at 1874.557418s 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a3bb0 0x7f3a1812c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 0x7f3a1812bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 0x7f3a1812bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58418/0 (socket says 10.20.193.51:58418) 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a3bb0 0x7f3a1812c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52152/0 (socket says 10.20.193.51:52152) 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 -- 10.20.193.51:0/1144235273 learned_addr learned my addr 10.20.193.51:0/1144235273 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): get_auth_request con 0x7f3a180a0110 auth_method 0 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): get_auth_request con 0x7f3a180a3bb0 auth_method 0 2026-02-17T12:06:26.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1e782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1df81640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a1809dac0 0x7f3a1812b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1df81640 10 monclient(hunting): get_auth_request con 0x7f3a1809dac0 auth_method 0 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1df81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1df81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1df81640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient(hunting): handle_auth_done global_id 234431 payload 824 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a1809dac0 msgr2=0x7f3a1812b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a1809dac0 0x7f3a1812b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a3bb0 msgr2=0x7f3a1812c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a180a3bb0 0x7f3a1812c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient: _finish_hunting 0 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 monclient: found mon.noname-c 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.938+0000 7f3a1d780640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1806d450 con 0x7f3a180a0110 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a1d780640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 msgr2=0x7f3a1812bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a1d780640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 0x7f3a1812bc40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c600 tx=0x7f3a0c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c012a40 con 0x7f3a180a0110 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: dump: 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.961 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: _finish_auth 0 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: _check_auth_tickets 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c017070 con 0x7f3a180a0110 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c012e20 con 0x7f3a180a0110 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a07fff640 4 set_mon_vals no callback set 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a067fc640 10 monclient: dump: 2026-02-17T12:06:26.962 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 5 monclient: authenticate success, global_id 234431 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 10 monclient: _renew_subs 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a180a2a80 con 0x7f3a180a0110 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 10 monclient: _renew_subs 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.940+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1812f650 con 0x7f3a180a0110 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a2020c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a2020c640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 0x7f3a181cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a180a3fc0 con 0x7f3a181ccff0 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a0c01c460 con 0x7f3a180a0110 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 0x7f3a181cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient: get_auth_request con 0x7f3a181ccff0 auth_method 0 2026-02-17T12:06:26.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 10 monclient(hunting): handle_auth_done global_id 234434 payload 824 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a1df81640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a1809fe20 con 0x7f3a181ccff0 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a067fc640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.941+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(789..789 src has 323..789) ==== 4887+0+0 (secure 0 0 0) 0x7f3a0c0524e0 con 0x7f3a180a0110 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.942+0000 7f3a1e782640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.942+0000 7f3a1e782640 10 monclient: get_auth_request con 0x7f39e803dd10 auth_method 0 2026-02-17T12:06:26.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.943+0000 7f3a1df81640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 msgr2=0x7f3a181cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.943+0000 7f3a1df81640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 0x7f3a181cd3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a18069d60 tx=0x7f3a080047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0803c050 con 0x7f3a181ccff0 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 10 monclient: dump: 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.966 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3a0803d040 con 0x7f3a181ccff0 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 msgr2=0x7f3a181cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 0x7f3a181cd3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a18069d60 tx=0x7f3a080047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 msgr2=0x7f3a181cd3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a067fc640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181ccff0 0x7f3a181cd3d0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a18069d60 tx=0x7f3a080047c0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.944+0000 7f3a1e782640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3a181377f0 tx=0x7f3a140076d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.947+0000 7f3a2020c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:26.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.947+0000 7f3a2020c640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 0x7f3a181d8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.947+0000 7f3a2020c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.947+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1809f4c0 con 0x7f3a181cd910 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 0x7f3a181d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient: get_auth_request con 0x7f3a181cd910 auth_method 0 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 10 monclient(hunting): handle_auth_done global_id 234437 payload 824 2026-02-17T12:06:26.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.948+0000 7f3a1df81640 1 -- 10.20.193.51:0/1144235273 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a1812dec0 con 0x7f3a181cd910 2026-02-17T12:06:26.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a1df81640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 msgr2=0x7f3a181d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a1df81640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 0x7f3a181d8340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a0802ef10 tx=0x7f3a08009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0804aca0 con 0x7f3a181cd910 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 10 monclient: dump: 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:26.970 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f3a0804e070 con 0x7f3a181cd910 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 msgr2=0x7f3a181d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 0x7f3a181d8340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a0802ef10 tx=0x7f3a08009340 comp rx=0 tx=0).stop 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 msgr2=0x7f3a181d8340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a067fc640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a181cd910 0x7f3a181d8340 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a0802ef10 tx=0x7f3a08009340 comp rx=0 tx=0).stop 2026-02-17T12:06:26.971 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 163945, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:26.972 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:26.973 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:26.974 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:26.975 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:26.976 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:26.977 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.978 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.979 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.980 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:26.981 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:26.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 msgr2=0x7f39e80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39e803dd10 0x7f39e80401d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3a181377f0 tx=0x7f3a140076d0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 10 monclient: shutdown 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 msgr2=0x7f3a1812bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 --2- 10.20.193.51:0/1144235273 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a180a0110 0x7f3a1812bc40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c600 tx=0x7f3a0c00cad0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a1e782640 1 -- 10.20.193.51:0/1144235273 reap_dead start 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a1e782640 1 -- 10.20.193.51:0/1144235273 reap_dead start 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 shutdown_connections 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 >> 10.20.193.51:0/1144235273 conn(0x7f3a180a30c0 msgr2=0x7f3a1809e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 shutdown_connections 2026-02-17T12:06:26.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:26.950+0000 7f3a2020c640 1 -- 10.20.193.51:0/1144235273 wait complete. 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789095265}) 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=229342279}) 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789095265}) 2026-02-17T12:06:26.984 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.951+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=755220203}) 2026-02-17T12:06:26.985 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:26.985 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:06:26.985 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.983+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.983+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=442998261}) 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.983+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=920440090}) 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=442998261}) 2026-02-17T12:06:26.986 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.984+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1030839021}) 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384934382}) 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2643148477}) 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384934382}) 2026-02-17T12:06:26.988 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.986+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=237501909}) 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985226781}) 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=17736933}) 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985226781}) 2026-02-17T12:06:26.993 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:06:26.991+0000 7fec0417b640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1839016082}) 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3454: done (5 left) 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3455: read oid 45 snap -1 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3455: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3456: read oid 3 snap -1 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3456: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:26.995 INFO:tasks.rados.rados.0.trial142.stdout:3457: snap_remove snap 382 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.051+0000 7efee5c05640 10 monclient: get_monmap_and_config 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.051+0000 7efee5c05640 10 monclient: build_initial_monmap 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.051+0000 7efee5c05640 10 monclient: monmap: 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:27.052788+0000 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:27.052788+0000 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:27.056 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 Processor -- start 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 -- start start 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient: init 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efee00a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7efee009dac0 0x7efee009fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-a con 0x7efee009dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 0x7efee013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-b con 0x7efee00a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee006e140 con 0x7efee00a3bb0 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7efee009aed0 con 0x7efee009dac0 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7efee009caa0 con 0x7efee00a0110 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efee5c05640 10 monclient(hunting): authenticate will time out at 1874.671525s 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedf7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7efee00a3bb0 0x7efee009f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:46772/0 (socket says 10.20.193.51:46772) 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedf7fe640 1 -- 10.20.193.51:0/3504959395 learned_addr learned my addr 10.20.193.51:0/3504959395 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 0x7efee013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): get_auth_request con 0x7efee00a0110 auth_method 0 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.058 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 --2- 10.20.193.51:0/3504959395 >> v2:10.20.193.51:3300/0 conn(0x7efee009dac0 0x7efee009fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): get_auth_request con 0x7efee009dac0 auth_method 0 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient(hunting): handle_auth_done global_id 254259 payload 274 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 -- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 msgr2=0x7efee013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:27.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 0x7efee013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 -- 10.20.193.51:0/3504959395 >> v1:10.20.193.51:6789/0 conn(0x7efee00a3bb0 legacy=0x7efee009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient: _finish_hunting 0 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 monclient: found mon.noname-a 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedeffd640 1 -- 10.20.193.51:0/3504959395 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee009ce60 con 0x7efee009dac0 2026-02-17T12:06:27.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.052+0000 7efedffff640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 0x7efee013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:06:27.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efedeffd640 1 -- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee009dac0 msgr2=0x7efee009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:27.066 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efedeffd640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee009dac0 0x7efee009fbd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efed00098a0 tx=0x7efed002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd53ac5b4b661877 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 1 -- 10.20.193.51:0/3504959395 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed003c070 con 0x7efee009dac0 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: dump: 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.067 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: _finish_auth 0 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 1 -- 10.20.193.51:0/3504959395 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed002fc00 con 0x7efee009dac0 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 1 -- 10.20.193.51:0/3504959395 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0037440 con 0x7efee009dac0 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 5 monclient: authenticate success, global_id 254259 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 4 set_mon_vals no callback set 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efede7fc640 10 monclient: dump: 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.068 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 10 monclient: shutdown 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 -- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee009dac0 msgr2=0x7efee009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee009dac0 0x7efee009fbd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efed00098a0 tx=0x7efed002ed80 comp rx=0 tx=0).stop 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 -- 10.20.193.51:0/3504959395 shutdown_connections 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee00a0110 0x7efee013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 --2- 10.20.193.51:0/3504959395 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee009dac0 0x7efee009fbd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 -- 10.20.193.51:0/3504959395 >> 10.20.193.51:0/3504959395 conn(0x7efee00a30c0 msgr2=0x7efee00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:27.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 -- 10.20.193.51:0/3504959395 shutdown_connections 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.055+0000 7efee5c05640 1 -- 10.20.193.51:0/3504959395 wait complete. 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient: build_initial_monmap 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient: monmap: 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 Processor -- start 2026-02-17T12:06:27.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 -- start start 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient: init 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 0x7efee0099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-c con 0x7efee009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee00a0110 0x7efee006f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-b con 0x7efee00a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 0x7efee006f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): picked mon.noname-a con 0x7efee00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7efee009a880 con 0x7efee00a3bb0 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efee00a0540 con 0x7efee00a0110 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7efee013cca0 con 0x7efee009dac0 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efee5c05640 10 monclient(hunting): authenticate will time out at 1874.675677s 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 0x7efee0099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 0x7efee0099f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58450/0 (socket says 10.20.193.51:58450) 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 1 -- 10.20.193.51:0/775261409 learned_addr learned my addr 10.20.193.51:0/775261409 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): get_auth_request con 0x7efee009dac0 auth_method 0 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 0x7efee006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): get_auth_request con 0x7efee00a3bb0 auth_method 0 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedeffd640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee00a0110 0x7efee006f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedeffd640 10 monclient(hunting): get_auth_request con 0x7efee00a0110 auth_method 0 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient(hunting): handle_auth_done global_id 254262 payload 824 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 msgr2=0x7efee0099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 0x7efee0099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee00a0110 msgr2=0x7efee006f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee00a0110 0x7efee006f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient: _finish_hunting 0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 monclient: found mon.noname-a 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedffff640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0095140 con 0x7efee00a3bb0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.056+0000 7efedf7fe640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7efee009dac0 0x7efee0099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedffff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 msgr2=0x7efee006f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedffff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 0x7efee006f950 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efed400efc0 tx=0x7efed400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4018030 con 0x7efee00a3bb0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: dump: 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.074 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: _finish_auth 0 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: _check_auth_tickets 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed4003a90 con 0x7efee00a3bb0 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4003e60 con 0x7efee00a3bb0 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 10 monclient: dump: 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efeddffb640 4 set_mon_vals no callback set 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 5 monclient: authenticate success, global_id 254262 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 monclient: _renew_subs 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee0095420 con 0x7efee00a3bb0 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 monclient: _renew_subs 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee009d7b0 con 0x7efee00a3bb0 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 0x7efee00716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efee00a3fc0 con 0x7efee006fe90 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 0x7efee00716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient: get_auth_request con 0x7efee006fe90 auth_method 0 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.059+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7efed4004000 con 0x7efee00a3bb0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efedf7fe640 10 monclient(hunting): handle_auth_done global_id 264115 payload 824 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efedf7fe640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efee0070270 con 0x7efee006fe90 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efebbfff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efeb003dd10 0x7efeb00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(790..790 src has 323..790) ==== 4827+0+0 (secure 0 0 0) 0x7efed40531f0 con 0x7efee00a3bb0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efedeffd640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efeb003dd10 0x7efeb00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.060+0000 7efedeffd640 10 monclient: get_auth_request con 0x7efeb003dd10 auth_method 0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efedf7fe640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 msgr2=0x7efee00716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efedf7fe640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 0x7efee00716a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efecc0075e0 tx=0x7efecc00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc00fe50 con 0x7efee006fe90 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 10 monclient: dump: 2026-02-17T12:06:27.078 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7efecc00fe50 con 0x7efee006fe90 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 msgr2=0x7efee00716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 0x7efee00716a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efecc0075e0 tx=0x7efecc00f5a0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 msgr2=0x7efee00716a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efebbfff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee006fe90 0x7efee00716a0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efecc0075e0 tx=0x7efecc00f5a0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.062+0000 7efedeffd640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efeb003dd10 0x7efeb00401d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efed0036000 tx=0x7efed0033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efee5c05640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efee5c05640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 0x7efee0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efee5c05640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:27.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7efee009cc50 con 0x7efee0071be0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efedf7fe640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 0x7efee0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efedf7fe640 10 monclient: get_auth_request con 0x7efee0071be0 auth_method 0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efedf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efedf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.065+0000 7efedf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.066+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.066+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.066+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.066+0000 7efedf7fe640 10 monclient(hunting): handle_auth_done global_id 264118 payload 824 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.066+0000 7efedf7fe640 1 -- 10.20.193.51:0/775261409 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efee009fe20 con 0x7efee0071be0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efedf7fe640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 msgr2=0x7efee0071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efedf7fe640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 0x7efee0071fc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efecc006fd0 tx=0x7efecc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc006240 con 0x7efee0071be0 2026-02-17T12:06:27.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 10 monclient: dump: 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7efecc006240 con 0x7efee0071be0 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:27.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 msgr2=0x7efee0071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 0x7efee0071fc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efecc006fd0 tx=0x7efecc004a40 comp rx=0 tx=0).stop 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 msgr2=0x7efee0071fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efebbfff640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7efee0071be0 0x7efee0071fc0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efecc006fd0 tx=0x7efecc004a40 comp rx=0 tx=0).stop 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 196, 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 7060, 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:27.084 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:27.085 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:27.086 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:27.087 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:27.088 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.089 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.090 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:27.091 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:27.092 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:27.093 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efeb003dd10 msgr2=0x7efeb00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efee5c05640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7efeb003dd10 0x7efeb00401d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efed0036000 tx=0x7efed0033000 comp rx=0 tx=0).stop 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efee5c05640 10 monclient: shutdown 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efee5c05640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efedffff640 1 -- 10.20.193.51:0/775261409 reap_dead start 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.068+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 msgr2=0x7efee006f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 0x7efee006f950 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efed400efc0 tx=0x7efed400c490 comp rx=0 tx=0).stop 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 shutdown_connections 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 --2- 10.20.193.51:0/775261409 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7efee00a3bb0 0x7efee006f950 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 >> 10.20.193.51:0/775261409 conn(0x7efee00a30c0 msgr2=0x7efee006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 shutdown_connections 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:27.069+0000 7efee5c05640 1 -- 10.20.193.51:0/775261409 wait complete. 2026-02-17T12:06:27.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:06:27.095 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T12:06:27.095 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-17T12:06:27.095 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T12:06:27.095 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:06:27.095 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:06:27.095 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:06:27.145 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:06:27.145 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T12:06:27.145 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T12:06:27.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:06:42.145 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T12:06:42.146 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T12:06:42.146 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:06:42.146 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:06:42.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 10 monclient: get_monmap_and_config 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 10 monclient: build_initial_monmap 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 10 monclient: monmap: 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:42.213503+0000 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:42.213503+0000 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:42.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 1 Processor -- start 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 1 -- start start 2026-02-17T12:06:42.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.212+0000 7fb91ef03640 10 monclient: init 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9180a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-c con 0x7fb9180a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb91813b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:42.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91806e140 con 0x7fb91813b760 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91809f910 con 0x7fb9180a3bb0 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb91809ccd0 con 0x7fb9180a0750 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91ef03640 10 monclient(hunting): authenticate will time out at 1889.832443s 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91d479640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb91813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91cc78640 1 --1- >> v1:10.20.193.142:6789/0 conn(0x7fb9180a3bb0 0x7fb91809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.142:6789/0 says I am v1:10.20.193.51:58748/0 (socket says 10.20.193.51:58748) 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 learned_addr learned my addr 10.20.193.51:0/574646928 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 10 monclient(hunting): get_auth_request con 0x7fb9180a0750 auth_method 0 2026-02-17T12:06:42.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.213+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:42.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.215+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.142:6789/0 conn(0x7fb9180a3bb0 legacy=0x7fb91809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:42.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb91813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 10 monclient(hunting): get_auth_request con 0x7fb9180a0750 auth_method 0 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:42.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.414+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:06:42.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb91813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:42.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:42.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 10 monclient(hunting): get_auth_request con 0x7fb9180a0750 auth_method 0 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:42.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:42.815+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:06:43.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb91813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:43.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:43.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 10 monclient(hunting): get_auth_request con 0x7fb9180a0750 auth_method 0 2026-02-17T12:06:43.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:43.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:43.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:43.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:43.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:43.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:43.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:43.616+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:06:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): tick 2026-02-17T12:06:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:06:45.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 msgr2=0x7fb91809e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.142:3300/0 conn(0x7fb9180a0750 0x7fb91809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.142:6789/0 conn(0x7fb9180a3bb0 legacy=0x7fb91809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb91813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient: _add_conns ranks=[2,3] 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fb8fc003820 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fb8fc006330 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb91809ccd0 con 0x7fb8fc006330 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc008eb0 con 0x7fb8fc003820 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 msgr2=0x7fb8fc0087f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:45.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.213+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:45.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 msgr2=0x7fb8fc0087f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:45.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:45.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.414+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:06:45.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 msgr2=0x7fb8fc0087f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:45.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:45.815+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:06:46.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb90ffff640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 msgr2=0x7fb8fc0087f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:46.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb90ffff640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:06:46.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:46.616+0000 7fb91cc78640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3457: done (7 left) 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3458: copy_from oid 28 from oid 29 current snap is 386 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: finishing write tid 1 to trial14245205-42 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3451: finishing rollback tid 0 to trial14245205-24 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3451: finishing rollback tid 1 to trial14245205-24 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2720 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: finishing write tid 2 to trial14245205-42 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: finishing write tid 3 to trial14245205-42 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: finishing write tid 4 to trial14245205-42 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: oid 42 updating version 0 to 2742 2026-02-17T12:06:47.208 INFO:tasks.rados.rados.0.trial142.stdout:3450: oid 42 updating version 2742 to 2743 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3450: oid 42 updating version 2743 to 2744 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 2744 (ObjNum 1190 snap 386 seq_num 1190) dirty exists 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3450: left oid 42 (ObjNum 1190 snap 386 seq_num 1190) 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3449: finishing rollback tid 0 to trial14245205-43 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3449: finishing rollback tid 1 to trial14245205-43 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3449: finishing rollback tid 2 to trial14245205-43 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 3264 (ObjNum 1028 snap 333 seq_num 1028) dirty exists 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3452: finishing copy_from racing read to trial14245205-46 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3452: finishing copy_from to trial14245205-46 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2554 (ObjNum 1174 snap 380 seq_num 1174) dirty exists 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3453: finishing write tid 1 to trial14245205-49 2026-02-17T12:06:47.209 INFO:tasks.rados.rados.0.trial142.stdout:3449: done (7 left) 2026-02-17T12:06:47.210 INFO:tasks.rados.rados.0.trial142.stdout:3450: done (6 left) 2026-02-17T12:06:47.210 INFO:tasks.rados.rados.0.trial142.stdout:3451: done (5 left) 2026-02-17T12:06:47.210 INFO:tasks.rados.rados.0.trial142.stdout:3452: done (4 left) 2026-02-17T12:06:47.210 INFO:tasks.rados.rados.0.trial142.stdout:3459: write oid 50 current snap is 386 2026-02-17T12:06:47.210 INFO:tasks.rados.rados.0.trial142.stdout:3459: seq_num 1192 ranges {433944=647876,1486536=547408} 2026-02-17T12:06:47.211 INFO:tasks.rados.rados.0.trial142.stdout:3459: writing trial14245205-50 from 433944 to 1081820 tid 1 2026-02-17T12:06:47.215 INFO:tasks.rados.rados.0.trial142.stdout:3459: writing trial14245205-50 from 1486536 to 2033944 tid 2 2026-02-17T12:06:47.215 INFO:tasks.rados.rados.0.trial142.stdout:3460: read oid 35 snap -1 2026-02-17T12:06:47.215 INFO:tasks.rados.rados.0.trial142.stdout:3460: expect (ObjNum 1092 snap 357 seq_num 1092) 2026-02-17T12:06:47.215 INFO:tasks.rados.rados.0.trial142.stdout:3461: write oid 41 current snap is 386 2026-02-17T12:06:47.215 INFO:tasks.rados.rados.0.trial142.stdout:3461: seq_num 1193 ranges {450751=723125,1945018=105733} 2026-02-17T12:06:47.219 INFO:tasks.rados.rados.0.trial142.stdout:3461: writing trial14245205-41 from 450751 to 1173876 tid 1 2026-02-17T12:06:47.222 INFO:tasks.rados.rados.0.trial142.stdout:3461: writing trial14245205-41 from 1945018 to 2050751 tid 2 2026-02-17T12:06:47.222 INFO:tasks.rados.rados.0.trial142.stdout:3462: snap_remove snap 370 2026-02-17T12:06:48.209 INFO:tasks.rados.rados.0.trial142.stdout:3462: done (7 left) 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3463: read oid 13 snap 361 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3463: expect deleted 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3464: snap_create 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: finishing write tid 2 to trial14245205-49 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: finishing write tid 3 to trial14245205-49 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: finishing write tid 4 to trial14245205-49 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: oid 49 updating version 0 to 3272 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: oid 49 version 3272 is already newer than 3271 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:3453: oid 49 updating version 3272 to 3273 2026-02-17T12:06:48.210 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3273 (ObjNum 1191 snap 386 seq_num 1191) dirty exists 2026-02-17T12:06:48.211 INFO:tasks.rados.rados.0.trial142.stdout:3453: left oid 49 (ObjNum 1191 snap 386 seq_num 1191) 2026-02-17T12:06:48.211 INFO:tasks.rados.rados.0.trial142.stdout:3455: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:06:48.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): tick 2026-02-17T12:06:48.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:06:48.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:06:48.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:06:48.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc005c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 msgr2=0x7fb8fc0087f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> v2:10.20.193.51:3300/0 conn(0x7fb8fc006330 0x7fb8fc0087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 reap_dead start 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb91813b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9180a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fb8fc003820 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91809eec0 con 0x7fb91813b760 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91806e140 con 0x7fb9180a3bb0 2026-02-17T12:06:48.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 1 -- 10.20.193.51:0/574646928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb91809ccd0 con 0x7fb8fc003820 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91cc78640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb8fc00b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb90e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient(hunting): handle_auth_done global_id 234446 payload 274 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.142:6789/0 conn(0x7fb9180a3bb0 legacy=0x7fb8fc00ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> v1:10.20.193.51:6789/0 conn(0x7fb91813b760 legacy=0x7fb8fc00b3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 monclient: found mon.noname-b 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.213+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc005de0 con 0x7fb8fc003820 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91d479640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc0101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91d479640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb91809f230 tx=0x7fb91402fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0fa47675ae5af35 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91d479640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb91809f230 tx=0x7fb91402fd50 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fb914030c70 mon_map magic: 0 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 1 -- 10.20.193.51:0/574646928 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914030c70 con 0x7fb8fc003820 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: dump: 2026-02-17T12:06:48.228 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.229 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 1 -- 10.20.193.51:0/574646928 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914034070 con 0x7fb8fc003820 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb90f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91ef03640 5 monclient: authenticate success, global_id 234446 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91ef03640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.216+0000 7fb91ef03640 4 set_mon_vals no callback set 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 10 monclient: shutdown 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 msgr2=0x7fb8fc0101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb91809f230 tx=0x7fb91402fd50 comp rx=0 tx=0).stop 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb90f7fe640 1 -- 10.20.193.51:0/574646928 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7fb914038650 con 0x7fb8fc003820 2026-02-17T12:06:48.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb90f7fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- 10.20.193.51:0/574646928 shutdown_connections 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 --2- 10.20.193.51:0/574646928 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8fc003820 0x7fb8fc0101f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- 10.20.193.51:0/574646928 >> 10.20.193.51:0/574646928 conn(0x7fb9180a30c0 msgr2=0x7fb9180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- 10.20.193.51:0/574646928 shutdown_connections 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- 10.20.193.51:0/574646928 wait complete. 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 10 monclient: build_initial_monmap 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 10 monclient: monmap: 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:48.231 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 Processor -- start 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 1 -- start start 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.217+0000 7fb91ef03640 10 monclient: init 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 0x7fb918092e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-b con 0x7fb8fc003820 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-c con 0x7fb9180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 0x7fb918091260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): picked mon.noname-a con 0x7fb91813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180a04b0 con 0x7fb91813b760 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb91809c850 con 0x7fb8fc003820 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb91809dac0 con 0x7fb9180a3bb0 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91ef03640 10 monclient(hunting): authenticate will time out at 1895.837095s 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91d479640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 msgr2=0x7fb918091260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91d479640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 0x7fb918091260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60132/0 (socket says 10.20.193.51:60132) 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 -- 10.20.193.51:0/2914042700 learned_addr learned my addr 10.20.193.51:0/2914042700 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): get_auth_request con 0x7fb9180a3bb0 auth_method 0 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 0x7fb918092e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 10 monclient(hunting): get_auth_request con 0x7fb8fc003820 auth_method 0 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient(hunting): handle_auth_done global_id 234449 payload 824 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 -- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 msgr2=0x7fb918092e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 0x7fb918092e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 -- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 msgr2=0x7fb918091260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 0x7fb918091260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 monclient: found mon.noname-c 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb90ffff640 1 -- 10.20.193.51:0/2914042700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91809d7b0 con 0x7fb9180a3bb0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.218+0000 7fb91cc78640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 0x7fb918092e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90ffff640 1 -- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 msgr2=0x7fb918090d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90ffff640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c250 tx=0x7fb900013a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90001a030 con 0x7fb9180a3bb0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: dump: 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90000c780 con 0x7fb9180a3bb0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90000f040 con 0x7fb9180a3bb0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 5 monclient: authenticate success, global_id 234449 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 10 monclient: _renew_subs 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90effd640 4 set_mon_vals no callback set 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb918094180 con 0x7fb9180a3bb0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb90d7fa640 10 monclient: dump: 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 10 monclient: _renew_subs 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.220+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb918099620 con 0x7fb9180a3bb0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb900027060 con 0x7fb9180a3bb0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91ef03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91ef03640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91ef03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91809dee0 con 0x7fb9180a3bb0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb90d7fa640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 0x7fb8e80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(792..792 src has 323..792) ==== 4843+0+0 (secure 0 0 0) 0x7fb9000525a0 con 0x7fb9180a3bb0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91cc78640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 0x7fb8e80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.221+0000 7fb91cc78640 10 monclient: get_auth_request con 0x7fb8e803dd10 auth_method 0 2026-02-17T12:06:48.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.224+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9000153c0 con 0x7fb9180a3bb0 2026-02-17T12:06:48.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.224+0000 7fb90d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.224+0000 7fb90d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:48.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.224+0000 7fb91cc78640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 0x7fb8e80401d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb908007d00 tx=0x7fb908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.273 INFO:tasks.rados.rados.0.trial142.stdout:3456: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb91ef03640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb91ef03640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb91ef03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb918094a80 con 0x7fb9180a3bb0 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb90d7fa640 1 -- 10.20.193.51:0/2914042700 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fb900050f60 con 0x7fb9180a3bb0 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb90d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:06:48.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.336+0000 7fb90d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:48.340 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":198,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 msgr2=0x7fb8e80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 0x7fb8e80401d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb908007d00 tx=0x7fb908009040 comp rx=0 tx=0).stop 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 10 monclient: shutdown 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 msgr2=0x7fb918090d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c250 tx=0x7fb900013a80 comp rx=0 tx=0).stop 2026-02-17T12:06:48.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 shutdown_connections 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb8e803dd10 0x7fb8e80401d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb91813b760 0x7fb918091260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9180a3bb0 0x7fb918090d20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 --2- 10.20.193.51:0/2914042700 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb8fc003820 0x7fb918092e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 >> 10.20.193.51:0/2914042700 conn(0x7fb9180a30c0 msgr2=0x7fb91813aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 shutdown_connections 2026-02-17T12:06:48.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.337+0000 7fb91ef03640 1 -- 10.20.193.51:0/2914042700 wait complete. 2026-02-17T12:06:48.348 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:06:48.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:06:48.348 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:06:48.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: get_monmap_and_config 2026-02-17T12:06:48.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: build_initial_monmap 2026-02-17T12:06:48.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: monmap: 2026-02-17T12:06:48.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:48.419 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:48.416055+0000 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:48.416055+0000 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 Processor -- start 2026-02-17T12:06:48.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 -- start start 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: init 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc714138190 addr v1:10.20.193.51:6789/0 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc714070bf0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-b con 0x7fc71413e6f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7140a03e0 con 0x7fc714138190 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71406fdc0 con 0x7fc714070bf0 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc7137fe640 1 -- >> v1:10.20.193.51:6789/0 conn(0x7fc714138190 legacy=0x7fc714138570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.51:6789/0 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc714071000 con 0x7fc71413e6f0 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc71a03f640 10 monclient(hunting): authenticate will time out at 1896.034901s 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.415+0000 7fc713fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60134/0 (socket says 10.20.193.51:60134) 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 -- 10.20.193.51:0/3797063672 learned_addr learned my addr 10.20.193.51:0/3797063672 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): get_auth_request con 0x7fc71413e6f0 auth_method 0 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient(hunting): handle_auth_done global_id 234452 payload 274 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 -- 10.20.193.51:0/3797063672 >> v1:10.20.193.142:6789/0 conn(0x7fc714070bf0 legacy=0x7fc71413cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 -- 10.20.193.51:0/3797063672 >> v1:10.20.193.51:6789/0 conn(0x7fc714138190 legacy=0x7fc714138570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 monclient: found mon.noname-b 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.416+0000 7fc713fff640 1 -- 10.20.193.51:0/3797063672 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7140700a0 con 0x7fc71413e6f0 2026-02-17T12:06:48.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc713fff640 1 -- 10.20.193.51:0/3797063672 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 msgr2=0x7fc714140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc713fff640 1 --2- 10.20.193.51:0/3797063672 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc708009e80 tx=0x7fc70802f250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32e2a090ade1a4c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 1 -- 10.20.193.51:0/3797063672 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080373f0 con 0x7fc71413e6f0 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: dump: 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.433 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 1 -- 10.20.193.51:0/3797063672 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708037590 con 0x7fc71413e6f0 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc71a03f640 5 monclient: authenticate success, global_id 234452 2026-02-17T12:06:48.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc71a03f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 1 -- 10.20.193.51:0/3797063672 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708037960 con 0x7fc71413e6f0 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc7127fc640 10 monclient: dump: 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.435 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc71a03f640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.418+0000 7fc71a03f640 4 set_mon_vals no callback set 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 10 monclient: shutdown 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- 10.20.193.51:0/3797063672 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 msgr2=0x7fc714140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 --2- 10.20.193.51:0/3797063672 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc708009e80 tx=0x7fc70802f250 comp rx=0 tx=0).stop 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- 10.20.193.51:0/3797063672 shutdown_connections 2026-02-17T12:06:48.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 --2- 10.20.193.51:0/3797063672 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc71413e6f0 0x7fc714140ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- 10.20.193.51:0/3797063672 >> 10.20.193.51:0/3797063672 conn(0x7fc7140a3940 msgr2=0x7fc7140a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- 10.20.193.51:0/3797063672 shutdown_connections 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- 10.20.193.51:0/3797063672 wait complete. 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 10 monclient: build_initial_monmap 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 10 monclient: monmap: 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.437 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 Processor -- start 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.419+0000 7fc71a03f640 1 -- start start 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient: init 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-c con 0x7fc714070bf0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc714138190 0x7fc7141392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-b con 0x7fc714138190 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc71413e6f0 0x7fc7141397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): picked mon.noname-a con 0x7fc71413e6f0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140a4850 con 0x7fc71413e6f0 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140a46d0 con 0x7fc714138190 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc714141020 con 0x7fc714070bf0 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc71a03f640 10 monclient(hunting): authenticate will time out at 1896.039266s 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc713fff640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc71413e6f0 msgr2=0x7fc7141397e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc713fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc71413e6f0 0x7fc7141397e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:48.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60148/0 (socket says 10.20.193.51:60148) 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 -- 10.20.193.51:0/2120379648 learned_addr learned my addr 10.20.193.51:0/2120379648 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): get_auth_request con 0x7fc714070bf0 auth_method 0 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc712ffd640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc714138190 0x7fc7141392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient(hunting): handle_auth_done global_id 234455 payload 824 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc714138190 msgr2=0x7fc7141392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc714138190 0x7fc7141392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc71413e6f0 msgr2=0x7fc7141397e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc71413e6f0 0x7fc7141397e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 monclient: found mon.noname-c 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.420+0000 7fc7137fe640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71413b230 con 0x7fc714070bf0 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc7137fe640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 msgr2=0x7fc714138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc7137fe640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc70000b780 tx=0x7fc70000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700005270 con 0x7fc714070bf0 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: dump: 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.442 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc700010070 con 0x7fc714070bf0 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 5 monclient: authenticate success, global_id 234455 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700005650 con 0x7fc714070bf0 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc711ffb640 4 set_mon_vals no callback set 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc6effff640 10 monclient: dump: 2026-02-17T12:06:48.443 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 10 monclient: _renew_subs 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71413b510 con 0x7fc714070bf0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 10 monclient: _renew_subs 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.422+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71413b7f0 con 0x7fc714070bf0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc71a03f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc71a03f640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 0x7fc714131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc714138570 con 0x7fc7141316d0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 0x7fc714131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient: get_auth_request con 0x7fc7141316d0 auth_method 0 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc700015470 con 0x7fc714070bf0 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc6effff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc6e403dcc0 0x7fc6e4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 10 monclient(hunting): handle_auth_done global_id 234458 payload 824 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc712ffd640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc71413d690 con 0x7fc7141316d0 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(792..792 src has 323..792) ==== 4843+0+0 (secure 0 0 0) 0x7fc700051c30 con 0x7fc714070bf0 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc713fff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc6e403dcc0 0x7fc6e4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.423+0000 7fc713fff640 10 monclient: get_auth_request con 0x7fc6e403dcc0 auth_method 0 2026-02-17T12:06:48.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc712ffd640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 msgr2=0x7fc714131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc712ffd640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 0x7fc714131ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc714134b70 tx=0x7fc70400d8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704016070 con 0x7fc7141316d0 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc6effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc6effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.425+0000 7fc6effff640 10 monclient: dump: 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.447 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc704012a10 con 0x7fc7141316d0 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 msgr2=0x7fc714131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 0x7fc714131ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc714134b70 tx=0x7fc70400d8f0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 msgr2=0x7fc714131ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc6effff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc7141316d0 0x7fc714131ab0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc714134b70 tx=0x7fc70400d8f0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.426+0000 7fc713fff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc6e403dcc0 0x7fc6e4040180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc71406e1d0 tx=0x7fc708033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc71a03f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:48.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc71a03f640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 0x7fc7141da450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc71a03f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc71413a060 con 0x7fc714131ff0 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 0x7fc7141da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient: get_auth_request con 0x7fc714131ff0 auth_method 0 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 10 monclient(hunting): handle_auth_done global_id 234461 payload 824 2026-02-17T12:06:48.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.429+0000 7fc712ffd640 1 -- 10.20.193.51:0/2120379648 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc714069780 con 0x7fc714131ff0 2026-02-17T12:06:48.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc712ffd640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 msgr2=0x7fc7141da450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc712ffd640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 0x7fc7141da450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc704018000 tx=0x7fc7040037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704019770 con 0x7fc714131ff0 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 10 monclient: dump: 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.451 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7fc704012e20 con 0x7fc714131ff0 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 msgr2=0x7fc7141da450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 0x7fc7141da450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc704018000 tx=0x7fc7040037f0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 msgr2=0x7fc7141da450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.431+0000 7fc6effff640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714131ff0 0x7fc7141da450 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc704018000 tx=0x7fc7040037f0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.452 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 198, 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 185426, 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:48.453 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:48.454 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:48.455 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.456 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:48.457 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:48.458 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:48.459 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.460 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.461 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.462 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:48.463 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc6e403dcc0 msgr2=0x7fc6e4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc6e403dcc0 0x7fc6e4040180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc71406e1d0 tx=0x7fc708033000 comp rx=0 tx=0).stop 2026-02-17T12:06:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 10 monclient: shutdown 2026-02-17T12:06:48.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 msgr2=0x7fc714138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc70000b780 tx=0x7fc70000bc50 comp rx=0 tx=0).stop 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc713fff640 1 -- 10.20.193.51:0/2120379648 reap_dead start 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 shutdown_connections 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 --2- 10.20.193.51:0/2120379648 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc714070bf0 0x7fc714138d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 >> 10.20.193.51:0/2120379648 conn(0x7fc7140a3940 msgr2=0x7fc714135860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 shutdown_connections 2026-02-17T12:06:48.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.432+0000 7fc71a03f640 1 -- 10.20.193.51:0/2120379648 wait complete. 2026-02-17T12:06:48.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:06:48.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:06:48.465 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: finishing write tid 1 to trial14245205-50 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: finishing write tid 2 to trial14245205-50 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: finishing write tid 3 to trial14245205-50 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: finishing write tid 4 to trial14245205-50 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: oid 50 updating version 0 to 2746 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: oid 50 updating version 2746 to 2748 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: oid 50 version 2748 is already newer than 2747 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2748 (ObjNum 1192 snap 386 seq_num 1192) dirty exists 2026-02-17T12:06:48.466 INFO:tasks.rados.rados.0.trial142.stdout:3459: left oid 50 (ObjNum 1192 snap 386 seq_num 1192) 2026-02-17T12:06:48.467 INFO:tasks.rados.rados.0.trial142.stdout:3460: expect (ObjNum 1092 snap 357 seq_num 1092) 2026-02-17T12:06:48.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: get_monmap_and_config 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: build_initial_monmap 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: monmap: 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:06:48.533995+0000 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:06:48.533995+0000 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:06:48.535 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:06:48.536 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:06:48.536 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:06:48.536 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 Processor -- start 2026-02-17T12:06:48.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 -- start start 2026-02-17T12:06:48.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: init 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 0x7f394c0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): picked mon.noname-a con 0x7f394c06c8d0 addr v2:10.20.193.51:3300/0 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): picked mon.noname-b con 0x7f394c074d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f394c06d1f0 addr v1:10.20.193.142:6789/0 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0a0210 con 0x7f394c06d1f0 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f394c0a07d0 con 0x7f394c06c8d0 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f394c0a04f0 con 0x7f394c074d60 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f3954456640 10 monclient(hunting): authenticate will time out at 1896.152785s 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39521cb640 1 -- >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 msgr2=0x7f394c0a13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39521cb640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 0x7f394c0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60188/0 (socket says 10.20.193.51:60188) 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 1 -- 10.20.193.51:0/466934902 learned_addr learned my addr 10.20.193.51:0/466934902 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): get_auth_request con 0x7f394c074d60 auth_method 0 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.533+0000 7f39519ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 10 monclient(hunting): handle_auth_done global_id 234464 payload 274 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 1 -- 10.20.193.51:0/466934902 >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 msgr2=0x7f394c0a13b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 1 --2- 10.20.193.51:0/466934902 >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 0x7f394c0a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 1 -- 10.20.193.51:0/466934902 >> v1:10.20.193.142:6789/0 conn(0x7f394c06d1f0 legacy=0x7f394c09d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 1 monclient: found mon.noname-b 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.534+0000 7f39519ca640 1 -- 10.20.193.51:0/466934902 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c09ecd0 con 0x7f394c074d60 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39519ca640 1 -- 10.20.193.51:0/466934902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 msgr2=0x7f394c06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39519ca640 1 --2- 10.20.193.51:0/466934902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3940009970 tx=0x7f394002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8e3e98f5281bd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 1 -- 10.20.193.51:0/466934902 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394003c070 con 0x7f394c074d60 2026-02-17T12:06:48.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: dump: 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 1 -- 10.20.193.51:0/466934902 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394002fdd0 con 0x7f394c074d60 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 5 monclient: authenticate success, global_id 234464 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 1 -- 10.20.193.51:0/466934902 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940037660 con 0x7f394c074d60 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 10 monclient: get_monmap_and_config success 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 4 set_mon_vals no callback set 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f39511c9640 10 monclient: dump: 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.549 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 10 monclient: shutdown 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 -- 10.20.193.51:0/466934902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 msgr2=0x7f394c06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 --2- 10.20.193.51:0/466934902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3940009970 tx=0x7f394002eeb0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 -- 10.20.193.51:0/466934902 shutdown_connections 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 --2- 10.20.193.51:0/466934902 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c06ccb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 --2- 10.20.193.51:0/466934902 >> v2:10.20.193.51:3300/0 conn(0x7f394c06c8d0 0x7f394c0a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.536+0000 7f3954456640 1 -- 10.20.193.51:0/466934902 >> 10.20.193.51:0/466934902 conn(0x7f394c0aaa60 msgr2=0x7f394c0aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- 10.20.193.51:0/466934902 shutdown_connections 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- 10.20.193.51:0/466934902 wait complete. 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient: build_initial_monmap 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient: monmap: 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.551 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 Processor -- start 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- start start 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient: init 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient: _reopen_session rank -1 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f394c06c8d0 0x7f394c12fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): picked mon.noname-a con 0x7f394c06c8d0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c06d1f0 0x7f394c130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): picked mon.noname-b con 0x7f394c06d1f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c1305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): picked mon.noname-c con 0x7f394c074d60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f394c0ab970 con 0x7f394c06c8d0 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f394c0ab7f0 con 0x7f394c06d1f0 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f394c09e0d0 con 0x7f394c074d60 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): _renew_subs 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f3954456640 10 monclient(hunting): authenticate will time out at 1896.156813s 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39521cb640 1 -- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f394c06c8d0 msgr2=0x7f394c12fb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3300/0 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39521cb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f394c06c8d0 0x7f394c12fb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c1305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c1305a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:60196/0 (socket says 10.20.193.51:60196) 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 learned_addr learned my addr 10.20.193.51:0/1199596444 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:06:48.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): get_auth_request con 0x7f394c074d60 auth_method 0 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.537+0000 7f39529cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39519ca640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c06d1f0 0x7f394c130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39519ca640 10 monclient(hunting): get_auth_request con 0x7f394c06d1f0 auth_method 0 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39519ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39519ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39519ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 10 monclient(hunting): handle_auth_done global_id 234467 payload 824 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c06d1f0 msgr2=0x7f394c130060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c06d1f0 0x7f394c130060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f394c06c8d0 msgr2=0x7f394c12fb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f394c06c8d0 0x7f394c12fb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 10 monclient: _finish_hunting 0 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 monclient: found mon.noname-c 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.538+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c132860 con 0x7f394c074d60 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 msgr2=0x7f394c1305a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f39529cc640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c1305a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f394800cc40 tx=0x7f394800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948016020 con 0x7f394c074d60 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:06:48.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: dump: 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: _finish_auth 0 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:06:48.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3948012620 con 0x7f394c074d60 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 5 monclient: authenticate success, global_id 234467 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 monclient: _renew_subs 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394c131fc0 con 0x7f394c074d60 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394800ce60 con 0x7f394c074d60 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3932ffd640 10 monclient: dump: 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.557 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f39509c8640 4 set_mon_vals no callback set 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 monclient: _renew_subs 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f394c073fd0 con 0x7f394c074d60 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 0x7f394c1cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.540+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f394c0a82a0 con 0x7f394c132190 2026-02-17T12:06:48.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 0x7f394c1cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3948012a50 con 0x7f394c074d60 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient: get_auth_request con 0x7f394c132190 auth_method 0 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f3932ffd640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f391c03dcc0 0x7f391c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(792..792 src has 323..792) ==== 4843+0+0 (secure 0 0 0) 0x7f39480532b0 con 0x7f394c074d60 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 10 monclient(hunting): handle_auth_done global_id 264127 payload 824 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39521cb640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f394c09e5c0 con 0x7f394c132190 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39519ca640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f391c03dcc0 0x7f391c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.541+0000 7f39519ca640 10 monclient: get_auth_request con 0x7f391c03dcc0 auth_method 0 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3458: finishing copy_from racing read to trial14245205-28 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3458: finishing copy_from to trial14245205-28 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2728 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: finishing write tid 1 to trial14245205-41 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: finishing write tid 2 to trial14245205-41 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: finishing write tid 3 to trial14245205-41 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: finishing write tid 4 to trial14245205-41 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: oid 41 updating version 0 to 2745 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: oid 41 version 2745 is already newer than 2743 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: oid 41 version 2745 is already newer than 2744 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2745 (ObjNum 1193 snap 386 seq_num 1193) dirty exists 2026-02-17T12:06:48.561 INFO:tasks.rados.rados.0.trial142.stdout:3461: left oid 41 (ObjNum 1193 snap 386 seq_num 1193) 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f39521cb640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 msgr2=0x7f394c1cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f39521cb640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 0x7f394c1cf070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c00bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c005070 con 0x7f394c132190 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 10 monclient: dump: 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.564 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f39519ca640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f391c03dcc0 0x7f391c040180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3940036000 tx=0x7f3940033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f393c005070 con 0x7f394c132190 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 msgr2=0x7f394c1cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 0x7f394c1cf070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c00bcf0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 msgr2=0x7f394c1cf070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:48.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.543+0000 7f3932ffd640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c132190 0x7f394c1cf070 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c00bcf0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f3954456640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f3954456640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 0x7f394c1da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f3954456640 10 monclient(hunting): start opening mon connection 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f394c0a1c10 con 0x7f394c1cf5b0 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 0x7f394c1da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient: get_auth_request con 0x7f394c1cf5b0 auth_method 0 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.547+0000 7f39521cb640 10 monclient(hunting): handle_auth_done global_id 264130 payload 824 2026-02-17T12:06:48.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.548+0000 7f39521cb640 1 -- 10.20.193.51:0/1199596444 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f394c069830 con 0x7f394c1cf5b0 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f39521cb640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 msgr2=0x7f394c1da4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f39521cb640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 0x7f394c1da4f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c01a730 con 0x7f394c1cf5b0 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 10 monclient: dump: 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:06:48.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f393c014430 con 0x7f394c1cf5b0 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 msgr2=0x7f394c1da4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 0x7f394c1da4f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 msgr2=0x7f394c1da4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3932ffd640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f394c1cf5b0 0x7f394c1da4f0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bcc0 tx=0x7f393c005ad0 comp rx=0 tx=0).stop 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:06:48.568 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 198, 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 28542, 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.569 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.570 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:06:48.571 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:06:48.572 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.573 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.574 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:06:48.575 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.576 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:06:48.577 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:06:48.578 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:06:48.578 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f391c03dcc0 msgr2=0x7f391c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f391c03dcc0 0x7f391c040180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3940036000 tx=0x7f3940033000 comp rx=0 tx=0).stop 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 10 monclient: shutdown 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 msgr2=0x7f394c1305a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 --2- 10.20.193.51:0/1199596444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f394c074d60 0x7f394c1305a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f394800cc40 tx=0x7f394800a430 comp rx=0 tx=0).stop 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 reap_dead start 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f39529cc640 1 -- 10.20.193.51:0/1199596444 reap_dead start 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 shutdown_connections 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 >> 10.20.193.51:0/1199596444 conn(0x7f394c0aaa60 msgr2=0x7f394c0a0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.550+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 shutdown_connections 2026-02-17T12:06:48.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:06:48.551+0000 7f3954456640 1 -- 10.20.193.51:0/1199596444 wait complete. 2026-02-17T12:06:48.579 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:06:48.580 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3453: done (8 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3455: done (7 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3456: done (6 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3458: done (5 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3459: done (4 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3460: done (3 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3461: done (2 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3463: done (1 left) 2026-02-17T12:06:49.211 INFO:tasks.rados.rados.0.trial142.stdout:3464: done (0 left) 2026-02-17T12:06:49.212 INFO:tasks.rados.rados.0.trial142.stdout:3465: write oid 41 current snap is 387 2026-02-17T12:06:49.212 INFO:tasks.rados.rados.0.trial142.stdout:3465: seq_num 1194 ranges {467558=514727,1719853=347705} 2026-02-17T12:06:49.214 INFO:tasks.rados.rados.0.trial142.stdout:3465: writing trial14245205-41 from 467558 to 982285 tid 1 2026-02-17T12:06:49.219 INFO:tasks.rados.rados.0.trial142.stdout:3465: writing trial14245205-41 from 1719853 to 2067558 tid 2 2026-02-17T12:06:49.219 INFO:tasks.rados.rados.0.trial142.stdout:3466: read oid 33 snap 361 2026-02-17T12:06:49.219 INFO:tasks.rados.rados.0.trial142.stdout:3466: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:49.219 INFO:tasks.rados.rados.0.trial142.stdout:3467: write oid 3 current snap is 387 2026-02-17T12:06:49.219 INFO:tasks.rados.rados.0.trial142.stdout:3467: seq_num 1195 ranges {484365=589976,1661982=422383} 2026-02-17T12:06:49.222 INFO:tasks.rados.rados.0.trial142.stdout:3467: writing trial14245205-3 from 484365 to 1074341 tid 1 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3467: writing trial14245205-3 from 1661982 to 2084365 tid 2 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3468: rollback oid 6 current snap is 387 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 385 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: finishing write tid 1 to trial14245205-41 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: finishing write tid 2 to trial14245205-41 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: finishing write tid 3 to trial14245205-41 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: finishing write tid 4 to trial14245205-41 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: oid 41 updating version 0 to 2747 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: oid 41 updating version 2747 to 2748 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:3465: oid 41 version 2748 is already newer than 2746 2026-02-17T12:06:49.228 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2748 (ObjNum 1194 snap 387 seq_num 1194) dirty exists 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3465: left oid 41 (ObjNum 1194 snap 387 seq_num 1194) 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3467: finishing write tid 1 to trial14245205-3 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3465: done (3 left) 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3469: read oid 15 snap 379 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3469: expect deleted 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3470: read oid 21 snap -1 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3470: expect (ObjNum 1013 snap 329 seq_num 1013) 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3471: rollback oid 30 current snap is 387 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 30 to 362 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3472: copy_from oid 35 from oid 23 current snap is 387 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3473: rollback oid 45 current snap is 387 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 45 to 366 2026-02-17T12:06:49.229 INFO:tasks.rados.rados.0.trial142.stdout:3474: copy_from oid 42 from oid 25 current snap is 387 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3475: read oid 49 snap -1 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3475: expect (ObjNum 1191 snap 386 seq_num 1191) 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3476: read oid 24 snap -1 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3476: expect deleted 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3477: snap_create 2026-02-17T12:06:49.230 INFO:tasks.rados.rados.0.trial142.stdout:3466: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3471: finishing rollback tid 1 to trial14245205-30 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: finishing write tid 2 to trial14245205-3 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3474: finishing copy_from to trial14245205-42 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3474: got expected ENOENT (src dne) 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3471: finishing rollback tid 2 to trial14245205-30 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 2739 (ObjNum 1111 snap 361 seq_num 1111) dirty exists 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: finishing write tid 3 to trial14245205-3 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: finishing write tid 4 to trial14245205-3 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: oid 3 updating version 0 to 2743 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: oid 3 version 2743 is already newer than 2742 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: oid 3 updating version 2743 to 2744 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2744 (ObjNum 1195 snap 387 seq_num 1195) dirty exists 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3467: left oid 3 (ObjNum 1195 snap 387 seq_num 1195) 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3474: finishing copy_from racing read to trial14245205-42 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:3468: finishing rollback tid 1 to trial14245205-6 2026-02-17T12:06:49.413 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 0 (ObjNum 129 snap 0 seq_num 1213745184) dirty dne 2026-02-17T12:06:49.414 INFO:tasks.rados.rados.0.trial142.stdout:3470: expect (ObjNum 1013 snap 329 seq_num 1013) 2026-02-17T12:06:49.572 INFO:tasks.rados.rados.0.trial142.stdout:3475: expect (ObjNum 1191 snap 386 seq_num 1191) 2026-02-17T12:06:49.682 INFO:tasks.rados.rados.0.trial142.stdout:3473: finishing rollback tid 0 to trial14245205-45 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:3473: finishing rollback tid 1 to trial14245205-45 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:3473: finishing rollback tid 2 to trial14245205-45 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2555 (ObjNum 1048 snap 340 seq_num 1048) dirty exists 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:3472: finishing copy_from racing read to trial14245205-35 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:3472: finishing copy_from to trial14245205-35 2026-02-17T12:06:49.683 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 2741 (ObjNum 1188 snap 386 seq_num 1188) dirty exists 2026-02-17T12:06:50.218 INFO:tasks.rados.rados.0.trial142.stdout:3466: done (11 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3467: done (10 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3468: done (9 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3469: done (8 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3470: done (7 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3471: done (6 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3472: done (5 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3473: done (4 left) 2026-02-17T12:06:50.219 INFO:tasks.rados.rados.0.trial142.stdout:3474: done (3 left) 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3475: done (2 left) 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3476: done (1 left) 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3477: done (0 left) 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3478: read oid 44 snap 384 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3478: expect (ObjNum 1153 snap 373 seq_num 1153) 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3479: rollback oid 15 current snap is 388 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 366 2026-02-17T12:06:50.220 INFO:tasks.rados.rados.0.trial142.stdout:3480: snap_remove snap 372 2026-02-17T12:06:51.220 INFO:tasks.rados.rados.0.trial142.stdout:3480: done (2 left) 2026-02-17T12:06:51.221 INFO:tasks.rados.rados.0.trial142.stdout:3481: write (excl) oid 48 current snap is 388 2026-02-17T12:06:51.221 INFO:tasks.rados.rados.0.trial142.stdout:3479: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:06:51.221 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3071 (ObjNum 129 snap 0 seq_num 1213373144) dirty dne 2026-02-17T12:06:51.221 INFO:tasks.rados.rados.0.trial142.stdout:3481: seq_num 1196 ranges {501172=665225,1720464=380708} 2026-02-17T12:06:51.225 INFO:tasks.rados.rados.0.trial142.stdout:3481: writing trial14245205-48 from 501172 to 1166397 tid 1 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3481: writing trial14245205-48 from 1720464 to 2101172 tid 2 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3479: done (2 left) 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3482: read oid 12 snap -1 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3482: expect deleted 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3483: rollback oid 24 current snap is 388 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 362 2026-02-17T12:06:51.229 INFO:tasks.rados.rados.0.trial142.stdout:3478: expect (ObjNum 1153 snap 373 seq_num 1153) 2026-02-17T12:06:51.307 INFO:tasks.rados.rados.0.trial142.stdout:3478: done (3 left) 2026-02-17T12:06:51.308 INFO:tasks.rados.rados.0.trial142.stdout:3482: done (2 left) 2026-02-17T12:06:51.308 INFO:tasks.rados.rados.0.trial142.stdout:3484: snap_remove snap 342 2026-02-17T12:06:52.152 INFO:tasks.rados.rados.0.trial142.stdout:3484: done (2 left) 2026-02-17T12:06:52.152 INFO:tasks.rados.rados.0.trial142.stdout:3485: snap_remove snap 358 2026-02-17T12:06:53.151 INFO:tasks.rados.rados.0.trial142.stdout:3485: done (2 left) 2026-02-17T12:06:53.151 INFO:tasks.rados.rados.0.trial142.stdout:3486: snap_remove snap 384 2026-02-17T12:06:54.151 INFO:tasks.rados.rados.0.trial142.stdout:3486: done (2 left) 2026-02-17T12:06:54.151 INFO:tasks.rados.rados.0.trial142.stdout:3487: snap_remove snap 387 2026-02-17T12:06:55.153 INFO:tasks.rados.rados.0.trial142.stdout:3487: done (2 left) 2026-02-17T12:06:55.153 INFO:tasks.rados.rados.0.trial142.stdout:3488: read oid 2 snap -1 2026-02-17T12:06:55.153 INFO:tasks.rados.rados.0.trial142.stdout:3488: expect deleted 2026-02-17T12:06:55.153 INFO:tasks.rados.rados.0.trial142.stdout:3489: write oid 50 current snap is 388 2026-02-17T12:06:55.153 INFO:tasks.rados.rados.0.trial142.stdout:3483: finishing rollback tid 1 to trial14245205-24 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2720 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: finishing write tid 1 to trial14245205-48 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: finishing write tid 2 to trial14245205-48 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: finishing write tid 3 to trial14245205-48 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: finishing write tid 4 to trial14245205-48 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: oid 48 updating version 0 to 2742 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: oid 48 version 2742 is already newer than 2741 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:3481: oid 48 version 2742 is already newer than 2740 2026-02-17T12:06:55.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 2742 (ObjNum 1196 snap 388 seq_num 1196) dirty exists 2026-02-17T12:06:55.155 INFO:tasks.rados.rados.0.trial142.stdout:3481: left oid 48 (ObjNum 1196 snap 388 seq_num 1196) 2026-02-17T12:06:55.155 INFO:tasks.rados.rados.0.trial142.stdout:3489: seq_num 1197 ranges {517979=740474,1778946=339033} 2026-02-17T12:06:55.157 INFO:tasks.rados.rados.0.trial142.stdout:3489: writing trial14245205-50 from 517979 to 1258453 tid 1 2026-02-17T12:06:55.161 INFO:tasks.rados.rados.0.trial142.stdout:3489: writing trial14245205-50 from 1778946 to 2117979 tid 2 2026-02-17T12:06:55.161 INFO:tasks.rados.rados.0.trial142.stdout:3481: done (3 left) 2026-02-17T12:06:55.161 INFO:tasks.rados.rados.0.trial142.stdout:3483: done (2 left) 2026-02-17T12:06:55.161 INFO:tasks.rados.rados.0.trial142.stdout:3490: snap_create 2026-02-17T12:06:55.162 INFO:tasks.rados.rados.0.trial142.stdout:3489: finishing write tid 1 to trial14245205-50 2026-02-17T12:06:55.163 INFO:tasks.rados.rados.0.trial142.stdout:3489: finishing write tid 2 to trial14245205-50 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: finishing write tid 3 to trial14245205-50 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: finishing write tid 4 to trial14245205-50 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: oid 50 updating version 0 to 2749 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: oid 50 updating version 2749 to 2750 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: oid 50 updating version 2750 to 2751 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2751 (ObjNum 1197 snap 388 seq_num 1197) dirty exists 2026-02-17T12:06:55.164 INFO:tasks.rados.rados.0.trial142.stdout:3489: left oid 50 (ObjNum 1197 snap 388 seq_num 1197) 2026-02-17T12:06:56.155 INFO:tasks.rados.rados.0.trial142.stdout:3488: done (2 left) 2026-02-17T12:06:56.156 INFO:tasks.rados.rados.0.trial142.stdout:3489: done (1 left) 2026-02-17T12:06:56.156 INFO:tasks.rados.rados.0.trial142.stdout:3490: done (0 left) 2026-02-17T12:06:56.156 INFO:tasks.rados.rados.0.trial142.stdout:3491: delete oid 37 current snap is 389 2026-02-17T12:06:56.157 INFO:tasks.rados.rados.0.trial142.stdout:3491: done (0 left) 2026-02-17T12:06:56.157 INFO:tasks.rados.rados.0.trial142.stdout:3492: rollback oid 14 current snap is 389 2026-02-17T12:06:56.158 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 378 2026-02-17T12:06:56.158 INFO:tasks.rados.rados.0.trial142.stdout:3493: copy_from oid 42 from oid 10 current snap is 389 2026-02-17T12:06:56.158 INFO:tasks.rados.rados.0.trial142.stdout:3494: write (excl) oid 35 current snap is 389 2026-02-17T12:06:56.158 INFO:tasks.rados.rados.0.trial142.stdout:3494: seq_num 1199 ranges {551593=490972,1779557=372036} 2026-02-17T12:06:56.162 INFO:tasks.rados.rados.0.trial142.stdout:3494: writing trial14245205-35 from 551593 to 1042565 tid 1 2026-02-17T12:06:56.167 INFO:tasks.rados.rados.0.trial142.stdout:3494: writing trial14245205-35 from 1779557 to 2151593 tid 2 2026-02-17T12:06:56.167 INFO:tasks.rados.rados.0.trial142.stdout:3495: write (excl) oid 15 current snap is 389 2026-02-17T12:06:56.167 INFO:tasks.rados.rados.0.trial142.stdout:3495: seq_num 1200 ranges {568400=566221,1838039=330361} 2026-02-17T12:06:56.171 INFO:tasks.rados.rados.0.trial142.stdout:3495: writing trial14245205-15 from 568400 to 1134621 tid 1 2026-02-17T12:06:56.175 INFO:tasks.rados.rados.0.trial142.stdout:3495: writing trial14245205-15 from 1838039 to 2168400 tid 2 2026-02-17T12:06:56.175 INFO:tasks.rados.rados.0.trial142.stdout:3496: snap_remove snap 357 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3496: done (4 left) 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3497: delete oid 45 current snap is 389 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3493: finishing copy_from to trial14245205-42 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3493: got expected ENOENT (src dne) 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3493: finishing copy_from racing read to trial14245205-42 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3492: finishing rollback tid 0 to trial14245205-14 2026-02-17T12:06:57.152 INFO:tasks.rados.rados.0.trial142.stdout:3492: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3492: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3357 (ObjNum 1153 snap 373 seq_num 1153) dirty exists 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: finishing write tid 1 to trial14245205-35 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: finishing write tid 2 to trial14245205-35 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: finishing write tid 3 to trial14245205-35 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: finishing write tid 4 to trial14245205-35 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: oid 35 updating version 0 to 3080 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: oid 35 updating version 3080 to 3082 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: oid 35 version 3082 is already newer than 3081 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 3082 (ObjNum 1199 snap 389 seq_num 1199) dirty exists 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3494: left oid 35 (ObjNum 1199 snap 389 seq_num 1199) 2026-02-17T12:06:57.153 INFO:tasks.rados.rados.0.trial142.stdout:3495: finishing write tid 1 to trial14245205-15 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: finishing write tid 2 to trial14245205-15 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: finishing write tid 3 to trial14245205-15 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: finishing write tid 4 to trial14245205-15 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: oid 15 updating version 0 to 3085 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: oid 15 version 3085 is already newer than 3083 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: oid 15 version 3085 is already newer than 3084 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3085 (ObjNum 1200 snap 389 seq_num 1200) dirty exists 2026-02-17T12:06:57.154 INFO:tasks.rados.rados.0.trial142.stdout:3495: left oid 15 (ObjNum 1200 snap 389 seq_num 1200) 2026-02-17T12:06:57.155 INFO:tasks.rados.rados.0.trial142.stdout:3492: done (4 left) 2026-02-17T12:06:57.155 INFO:tasks.rados.rados.0.trial142.stdout:3493: done (3 left) 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:3494: done (2 left) 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:3495: done (1 left) 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:3497: done (0 left) 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:3498: rollback oid 7 current snap is 389 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 7 to 375 2026-02-17T12:06:57.156 INFO:tasks.rados.rados.0.trial142.stdout:3499: snap_create 2026-02-17T12:06:57.161 INFO:tasks.rados.rados.0.trial142.stdout:3498: finishing rollback tid 0 to trial14245205-7 2026-02-17T12:06:57.161 INFO:tasks.rados.rados.0.trial142.stdout:3498: finishing rollback tid 1 to trial14245205-7 2026-02-17T12:06:57.162 INFO:tasks.rados.rados.0.trial142.stdout:3498: finishing rollback tid 2 to trial14245205-7 2026-02-17T12:06:57.163 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 7 v 3361 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:06:58.158 INFO:tasks.rados.rados.0.trial142.stdout:3498: done (1 left) 2026-02-17T12:06:58.158 INFO:tasks.rados.rados.0.trial142.stdout:3499: done (0 left) 2026-02-17T12:06:58.158 INFO:tasks.rados.rados.0.trial142.stdout:3500: copy_from oid 19 from oid 22 current snap is 390 2026-02-17T12:06:58.158 INFO:tasks.rados.rados.0.trial142.stdout:3501: delete oid 9 current snap is 390 2026-02-17T12:06:58.160 INFO:tasks.rados.rados.0.trial142.stdout:3501: done (1 left) 2026-02-17T12:06:58.160 INFO:tasks.rados.rados.0.trial142.stdout:3502: write oid 46 current snap is 390 2026-02-17T12:06:58.161 INFO:tasks.rados.rados.0.trial142.stdout:3502: seq_num 1203 ranges {618821=508321,1613485=531077} 2026-02-17T12:06:58.165 INFO:tasks.rados.rados.0.trial142.stdout:3502: writing trial14245205-46 from 618821 to 1127142 tid 1 2026-02-17T12:06:58.170 INFO:tasks.rados.rados.0.trial142.stdout:3502: writing trial14245205-46 from 1613485 to 2144562 tid 2 2026-02-17T12:06:58.170 INFO:tasks.rados.rados.0.trial142.stdout:3503: read oid 36 snap -1 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3503: expect deleted 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3504: write oid 33 current snap is 390 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3500: finishing copy_from racing read to trial14245205-19 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3500: finishing copy_from to trial14245205-19 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2693 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3502: finishing write tid 1 to trial14245205-46 2026-02-17T12:06:58.171 INFO:tasks.rados.rados.0.trial142.stdout:3504: seq_num 1204 ranges {635628=583570,1671967=563661} 2026-02-17T12:06:58.174 INFO:tasks.rados.rados.0.trial142.stdout:3504: writing trial14245205-33 from 635628 to 1219198 tid 1 2026-02-17T12:06:58.179 INFO:tasks.rados.rados.0.trial142.stdout:3504: writing trial14245205-33 from 1671967 to 2235628 tid 2 2026-02-17T12:06:58.179 INFO:tasks.rados.rados.0.trial142.stdout:3500: done (3 left) 2026-02-17T12:06:58.179 INFO:tasks.rados.rados.0.trial142.stdout:3505: snap_remove snap 378 2026-02-17T12:06:59.160 INFO:tasks.rados.rados.0.trial142.stdout:3505: done (3 left) 2026-02-17T12:06:59.160 INFO:tasks.rados.rados.0.trial142.stdout:3506: read oid 16 snap -1 2026-02-17T12:06:59.160 INFO:tasks.rados.rados.0.trial142.stdout:3506: expect deleted 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3507: read oid 1 snap -1 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3507: expect (ObjNum 1180 snap 383 seq_num 1180) 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3508: read oid 48 snap -1 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3508: expect (ObjNum 1196 snap 388 seq_num 1196) 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3509: rollback oid 43 current snap is 390 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 361 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3510: read oid 2 snap 388 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3510: expect deleted 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3511: snap_create 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3502: finishing write tid 2 to trial14245205-46 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3502: finishing write tid 3 to trial14245205-46 2026-02-17T12:06:59.161 INFO:tasks.rados.rados.0.trial142.stdout:3502: finishing write tid 4 to trial14245205-46 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3502: oid 46 updating version 0 to 3377 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3502: oid 46 updating version 3377 to 3379 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3502: oid 46 version 3379 is already newer than 3378 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3379 (ObjNum 1203 snap 390 seq_num 1203) dirty exists 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3502: left oid 46 (ObjNum 1203 snap 390 seq_num 1203) 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: finishing write tid 1 to trial14245205-33 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: finishing write tid 2 to trial14245205-33 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: finishing write tid 3 to trial14245205-33 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: finishing write tid 4 to trial14245205-33 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: oid 33 updating version 0 to 3088 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: oid 33 version 3088 is already newer than 3086 2026-02-17T12:06:59.162 INFO:tasks.rados.rados.0.trial142.stdout:3504: oid 33 version 3088 is already newer than 3087 2026-02-17T12:06:59.163 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 3088 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:06:59.163 INFO:tasks.rados.rados.0.trial142.stdout:3504: left oid 33 (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:06:59.164 INFO:tasks.rados.rados.0.trial142.stdout:3508: expect (ObjNum 1196 snap 388 seq_num 1196) 2026-02-17T12:06:59.242 INFO:tasks.rados.rados.0.trial142.stdout:3509: finishing rollback tid 0 to trial14245205-43 2026-02-17T12:06:59.243 INFO:tasks.rados.rados.0.trial142.stdout:3509: finishing rollback tid 1 to trial14245205-43 2026-02-17T12:06:59.243 INFO:tasks.rados.rados.0.trial142.stdout:3509: finishing rollback tid 2 to trial14245205-43 2026-02-17T12:06:59.243 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 3387 (ObjNum 1028 snap 333 seq_num 1028) dirty exists 2026-02-17T12:06:59.243 INFO:tasks.rados.rados.0.trial142.stdout:3507: expect (ObjNum 1180 snap 383 seq_num 1180) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3502: done (8 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3503: done (7 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3504: done (6 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3506: done (5 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3507: done (4 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3508: done (3 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3509: done (2 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3510: done (1 left) 2026-02-17T12:07:00.161 INFO:tasks.rados.rados.0.trial142.stdout:3511: done (0 left) 2026-02-17T12:07:00.162 INFO:tasks.rados.rados.0.trial142.stdout:3512: read oid 33 snap 389 2026-02-17T12:07:00.162 INFO:tasks.rados.rados.0.trial142.stdout:3512: expect (ObjNum 1145 snap 370 seq_num 1145) 2026-02-17T12:07:00.162 INFO:tasks.rados.rados.0.trial142.stdout:3513: write (excl) oid 21 current snap is 391 2026-02-17T12:07:00.162 INFO:tasks.rados.rados.0.trial142.stdout:3513: seq_num 1205 ranges {652435=658819,1730449=521986} 2026-02-17T12:07:00.165 INFO:tasks.rados.rados.0.trial142.stdout:3513: writing trial14245205-21 from 652435 to 1311254 tid 1 2026-02-17T12:07:00.169 INFO:tasks.rados.rados.0.trial142.stdout:3513: writing trial14245205-21 from 1730449 to 2252435 tid 2 2026-02-17T12:07:00.169 INFO:tasks.rados.rados.0.trial142.stdout:3514: copy_from oid 46 from oid 35 current snap is 391 2026-02-17T12:07:00.169 INFO:tasks.rados.rados.0.trial142.stdout:3515: read oid 45 snap -1 2026-02-17T12:07:00.169 INFO:tasks.rados.rados.0.trial142.stdout:3515: expect deleted 2026-02-17T12:07:00.169 INFO:tasks.rados.rados.0.trial142.stdout:3516: read oid 12 snap 380 2026-02-17T12:07:00.170 INFO:tasks.rados.rados.0.trial142.stdout:3516: expect deleted 2026-02-17T12:07:00.170 INFO:tasks.rados.rados.0.trial142.stdout:3517: snap_remove snap 388 2026-02-17T12:07:01.166 INFO:tasks.rados.rados.0.trial142.stdout:3517: done (5 left) 2026-02-17T12:07:01.167 INFO:tasks.rados.rados.0.trial142.stdout:3518: rollback oid 36 current snap is 391 2026-02-17T12:07:01.167 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 381 2026-02-17T12:07:01.167 INFO:tasks.rados.rados.0.trial142.stdout:3512: expect (ObjNum 1145 snap 370 seq_num 1145) 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3513: finishing write tid 1 to trial14245205-21 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3513: finishing write tid 2 to trial14245205-21 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3513: finishing write tid 3 to trial14245205-21 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3512: done (5 left) 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3515: done (4 left) 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3516: done (3 left) 2026-02-17T12:07:01.240 INFO:tasks.rados.rados.0.trial142.stdout:3519: read oid 2 snap -1 2026-02-17T12:07:01.241 INFO:tasks.rados.rados.0.trial142.stdout:3519: expect deleted 2026-02-17T12:07:01.241 INFO:tasks.rados.rados.0.trial142.stdout:3520: snap_remove snap 366 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3520: done (4 left) 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3521: write oid 13 current snap is 391 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3513: finishing write tid 4 to trial14245205-21 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3513: oid 21 updating version 0 to 2559 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3513: oid 21 version 2559 is already newer than 2558 2026-02-17T12:07:02.153 INFO:tasks.rados.rados.0.trial142.stdout:3513: oid 21 version 2559 is already newer than 2557 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2559 (ObjNum 1205 snap 391 seq_num 1205) dirty exists 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:3513: left oid 21 (ObjNum 1205 snap 391 seq_num 1205) 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:3514: finishing copy_from racing read to trial14245205-46 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:3514: finishing copy_from to trial14245205-46 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3082 (ObjNum 1199 snap 389 seq_num 1199) dirty exists 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:3518: finishing rollback tid 1 to trial14245205-36 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T12:07:02.154 INFO:tasks.rados.rados.0.trial142.stdout:3521: seq_num 1206 ranges {669242=734068,2188931=80311} 2026-02-17T12:07:02.158 INFO:tasks.rados.rados.0.trial142.stdout:3521: writing trial14245205-13 from 669242 to 1403310 tid 1 2026-02-17T12:07:02.162 INFO:tasks.rados.rados.0.trial142.stdout:3521: writing trial14245205-13 from 2188931 to 2269242 tid 2 2026-02-17T12:07:02.162 INFO:tasks.rados.rados.0.trial142.stdout:3513: done (4 left) 2026-02-17T12:07:02.162 INFO:tasks.rados.rados.0.trial142.stdout:3514: done (3 left) 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3518: done (2 left) 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3519: done (1 left) 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3522: read oid 32 snap -1 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3522: expect (ObjNum 1013 snap 329 seq_num 1013) 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3523: read oid 20 snap -1 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3523: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:07:02.163 INFO:tasks.rados.rados.0.trial142.stdout:3524: delete oid 50 current snap is 391 2026-02-17T12:07:02.164 INFO:tasks.rados.rados.0.trial142.stdout:3521: finishing write tid 1 to trial14245205-13 2026-02-17T12:07:02.164 INFO:tasks.rados.rados.0.trial142.stdout:3521: finishing write tid 2 to trial14245205-13 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3524: done (3 left) 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3525: delete oid 23 current snap is 391 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: finishing write tid 3 to trial14245205-13 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: finishing write tid 4 to trial14245205-13 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: oid 13 updating version 0 to 3091 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: oid 13 version 3091 is already newer than 3089 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: oid 13 version 3091 is already newer than 3090 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 3091 (ObjNum 1206 snap 391 seq_num 1206) dirty exists 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3521: left oid 13 (ObjNum 1206 snap 391 seq_num 1206) 2026-02-17T12:07:02.165 INFO:tasks.rados.rados.0.trial142.stdout:3522: expect (ObjNum 1013 snap 329 seq_num 1013) 2026-02-17T12:07:02.324 INFO:tasks.rados.rados.0.trial142.stdout:3521: done (3 left) 2026-02-17T12:07:02.324 INFO:tasks.rados.rados.0.trial142.stdout:3522: done (2 left) 2026-02-17T12:07:02.324 INFO:tasks.rados.rados.0.trial142.stdout:3525: done (1 left) 2026-02-17T12:07:02.325 INFO:tasks.rados.rados.0.trial142.stdout:3526: snap_create 2026-02-17T12:07:02.325 INFO:tasks.rados.rados.0.trial142.stdout:3523: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:07:03.173 INFO:tasks.rados.rados.0.trial142.stdout:3523: done (1 left) 2026-02-17T12:07:03.173 INFO:tasks.rados.rados.0.trial142.stdout:3526: done (0 left) 2026-02-17T12:07:03.173 INFO:tasks.rados.rados.0.trial142.stdout:3527: delete oid 25 current snap is 392 2026-02-17T12:07:03.175 INFO:tasks.rados.rados.0.trial142.stdout:3527: done (0 left) 2026-02-17T12:07:03.175 INFO:tasks.rados.rados.0.trial142.stdout:3528: snap_remove snap 383 2026-02-17T12:07:04.176 INFO:tasks.rados.rados.0.trial142.stdout:3528: done (0 left) 2026-02-17T12:07:04.176 INFO:tasks.rados.rados.0.trial142.stdout:3529: rollback oid 10 current snap is 392 2026-02-17T12:07:04.177 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 10 to 380 2026-02-17T12:07:04.177 INFO:tasks.rados.rados.0.trial142.stdout:3530: read oid 28 snap -1 2026-02-17T12:07:04.177 INFO:tasks.rados.rados.0.trial142.stdout:3530: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:07:04.177 INFO:tasks.rados.rados.0.trial142.stdout:3531: snap_create 2026-02-17T12:07:04.177 INFO:tasks.rados.rados.0.trial142.stdout:3529: finishing rollback tid 1 to trial14245205-10 2026-02-17T12:07:04.178 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:07:04.181 INFO:tasks.rados.rados.0.trial142.stdout:3530: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:07:05.178 INFO:tasks.rados.rados.0.trial142.stdout:3529: done (2 left) 2026-02-17T12:07:05.178 INFO:tasks.rados.rados.0.trial142.stdout:3530: done (1 left) 2026-02-17T12:07:05.178 INFO:tasks.rados.rados.0.trial142.stdout:3531: done (0 left) 2026-02-17T12:07:05.179 INFO:tasks.rados.rados.0.trial142.stdout:3532: snap_create 2026-02-17T12:07:06.178 INFO:tasks.rados.rados.0.trial142.stdout:3532: done (0 left) 2026-02-17T12:07:06.178 INFO:tasks.rados.rados.0.trial142.stdout:3533: read oid 40 snap -1 2026-02-17T12:07:06.179 INFO:tasks.rados.rados.0.trial142.stdout:3533: expect (ObjNum 1167 snap 377 seq_num 1167) 2026-02-17T12:07:06.179 INFO:tasks.rados.rados.0.trial142.stdout:3534: snap_create 2026-02-17T12:07:06.185 INFO:tasks.rados.rados.0.trial142.stdout:3533: expect (ObjNum 1167 snap 377 seq_num 1167) 2026-02-17T12:07:07.153 INFO:tasks.rados.rados.0.trial142.stdout:3533: done (1 left) 2026-02-17T12:07:07.153 INFO:tasks.rados.rados.0.trial142.stdout:3534: done (0 left) 2026-02-17T12:07:07.153 INFO:tasks.rados.rados.0.trial142.stdout:3535: snap_remove snap 394 2026-02-17T12:07:08.154 INFO:tasks.rados.rados.0.trial142.stdout:3535: done (0 left) 2026-02-17T12:07:08.154 INFO:tasks.rados.rados.0.trial142.stdout:3536: snap_remove snap 391 2026-02-17T12:07:08.581 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T12:07:08.581 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T12:07:08.581 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:07:08.581 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:07:08.584 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:07:08.584 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T12:07:08.585 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T12:07:08.585 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:07:23.586 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T12:07:23.586 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T12:07:23.586 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:07:23.586 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: get_monmap_and_config 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: build_initial_monmap 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: monmap: 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:23.654034+0000 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:23.654034+0000 2026-02-17T12:07:23.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 Processor -- start 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 -- start start 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: init 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:23.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1a740a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-b con 0x7f1a740a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a7413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7406e140 con 0x7f1a7413b760 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7409f910 con 0x7f1a740a3bb0 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7409ccd0 con 0x7f1a740a0750 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a7acfa640 10 monclient(hunting): authenticate will time out at 1931.272798s 2026-02-17T12:07:23.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a79270640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f1a7413b760 0x7f1a7413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53072/0 (socket says 10.20.193.51:53072) 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a79270640 1 -- 10.20.193.51:0/2159450050 learned_addr learned my addr 10.20.193.51:0/2159450050 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a740a0750 auth_method 0 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.653+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:23.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.656+0000 7f1a79270640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.51:6789/0 conn(0x7f1a7413b760 legacy=0x7f1a7413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:23.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.656+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.142:6789/0 conn(0x7f1a740a3bb0 legacy=0x7f1a7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:23.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:23.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a740a0750 auth_method 0 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:23.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:23.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:24.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:24.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a740a0750 auth_method 0 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:24.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:24.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:25.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:25.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a740a0750 auth_method 0 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:25.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:25.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:26.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): tick 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 msgr2=0x7f1a7409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a740a0750 0x7f1a7409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.142:6789/0 conn(0x7f1a740a3bb0 legacy=0x7f1a7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.51:6789/0 conn(0x7f1a7413b760 legacy=0x7f1a7413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient: _add_conns ranks=[4,3] 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f1a580038f0 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f1a58006440 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7409ccd0 con 0x7f1a58006440 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1a58008fa0 con 0x7f1a580038f0 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a580038f0 auth_method 0 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:26.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:26.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:26.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:26.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:26.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a580038f0 auth_method 0 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:26.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:26.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:26.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:27.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:27.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a580038f0 auth_method 0 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:27.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:28.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:28.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a580038f0 auth_method 0 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:28.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:28.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:28.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:28.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:28.057+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:28.596 INFO:tasks.rados.rados.0.trial142.stdout:3536: done (0 left) 2026-02-17T12:07:28.596 INFO:tasks.rados.rados.0.trial142.stdout:3537: copy_from oid 6 from oid 7 current snap is 395 2026-02-17T12:07:28.596 INFO:tasks.rados.rados.0.trial142.stdout:3538: snap_remove snap 361 2026-02-17T12:07:29.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 10 monclient(hunting): tick 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 msgr2=0x7f1a58005d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a580038f0 0x7f1a58005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a79270640 1 -- 10.20.193.51:0/2159450050 reap_dead start 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a7413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.653+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f1a58006440 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1a58003d40 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7409eec0 con 0x7f1a7413b760 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5800f2d0 con 0x7f1a58003d40 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7409ccd0 con 0x7f1a58006440 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:29.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:29.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.656+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.51:6789/0 conn(0x7f1a7413b760 legacy=0x7f1a5800b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.656+0000 7f1a79270640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.142:6789/0 conn(0x7f1a58003d40 legacy=0x7f1a5800cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:29.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:29.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:30.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:30.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:30.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:30.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:31.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.059 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a58006440 auth_method 0 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:31.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:31.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:32.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): tick 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 msgr2=0x7f1a580088e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.51:3300/0 conn(0x7f1a58006440 0x7f1a580088e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.142:6789/0 conn(0x7f1a58003d40 legacy=0x7f1a5800cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 >> v1:10.20.193.51:6789/0 conn(0x7f1a7413b760 legacy=0x7f1a5800b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient: _add_conns ranks=[4,2] 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f1a5800f6d0 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f1a5800e2c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7409ccd0 con 0x7f1a5800f6d0 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 1 -- 10.20.193.51:0/2159450050 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a58008fa0 con 0x7f1a5800e2c0 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a5800e2c0 auth_method 0 2026-02-17T12:07:32.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a5800f6d0 auth_method 0 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:32.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:32.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:32.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.654+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a5800e2c0 auth_method 0 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:32.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a5800f6d0 auth_method 0 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:32.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:32.855+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:33.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:33.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a5800e2c0 auth_method 0 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a5800f6d0 auth_method 0 2026-02-17T12:07:33.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:33.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:33.256+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:33.732 INFO:tasks.rados.rados.0.trial142.stdout:3538: done (1 left) 2026-02-17T12:07:33.732 INFO:tasks.rados.rados.0.trial142.stdout:3539: snap_create 2026-02-17T12:07:33.732 INFO:tasks.rados.rados.0.trial142.stdout:3537: finishing copy_from racing read to trial14245205-6 2026-02-17T12:07:33.733 INFO:tasks.rados.rados.0.trial142.stdout:3537: finishing copy_from to trial14245205-6 2026-02-17T12:07:33.733 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3361 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:07:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a5800e2c0 auth_method 0 2026-02-17T12:07:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.060 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> v2:10.20.193.142:3300/0 conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a5800f6d0 auth_method 0 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.061 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient(hunting): handle_auth_done global_id 264133 payload 274 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 msgr2=0x7f1a5800e6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a5800e2c0 0x7f1a5800e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 1 monclient: found mon.noname-c 2026-02-17T12:07:34.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:07:34.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.057+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a580105a0 con 0x7f1a5800f6d0 2026-02-17T12:07:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a78a6f640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a5800fae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007bf0 tx=0x7f1a64030950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59552d8068ec1d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 1 -- 10.20.193.51:0/2159450050 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64036050 con 0x7f1a5800f6d0 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: dump: 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.071 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 1 -- 10.20.193.51:0/2159450050 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64037560 con 0x7f1a5800f6d0 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a7acfa640 5 monclient: authenticate success, global_id 264133 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a7acfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a7acfa640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:34.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a7acfa640 4 set_mon_vals no callback set 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 1 -- 10.20.193.51:0/2159450050 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64037930 con 0x7f1a5800f6d0 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.060+0000 7f1a6b7fe640 10 monclient: dump: 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.073 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 10 monclient: shutdown 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2159450050 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 msgr2=0x7f1a5800fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a5800fae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007bf0 tx=0x7f1a64030950 comp rx=0 tx=0).stop 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a79270640 1 -- 10.20.193.51:0/2159450050 reap_dead start 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2159450050 shutdown_connections 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2159450050 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a5800fae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2159450050 >> 10.20.193.51:0/2159450050 conn(0x7f1a740a30c0 msgr2=0x7f1a740a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2159450050 shutdown_connections 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2159450050 wait complete. 2026-02-17T12:07:34.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.061+0000 7f1a7acfa640 10 monclient: monmap: 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 Processor -- start 2026-02-17T12:07:34.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 -- start start 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient: init 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a74130f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-b con 0x7f1a5800f6d0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-c con 0x7f1a741314c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 0x7f1a741d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): picked mon.noname-a con 0x7f1a74131e40 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f1a740a04b0 con 0x7f1a74131e40 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7409c850 con 0x7f1a5800f6d0 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7409dac0 con 0x7f1a741314c0 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a7acfa640 10 monclient(hunting): authenticate will time out at 1941.681507s 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41276/0 (socket says 10.20.193.51:41276) 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2755479155 learned_addr learned my addr 10.20.193.51:0/2755479155 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request con 0x7f1a741314c0 auth_method 0 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 0x7f1a741d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.077 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): get_auth_request con 0x7f1a74131e40 auth_method 0 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 msgr2=0x7f1a74131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 msgr2=0x7f1a74131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a6bfff640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a74130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request con 0x7f1a5800f6d0 auth_method 0 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a78a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.078 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a78a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a78a6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient(hunting): handle_auth_done global_id 274098 payload 824 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 msgr2=0x7f1a74131900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 msgr2=0x7f1a74130f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a74130f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 monclient: found mon.noname-a 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.062+0000 7f1a79270640 1 -- 10.20.193.51:0/2755479155 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7409d7b0 con 0x7f1a74131e40 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a79270640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 msgr2=0x7f1a741d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a79270640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 0x7f1a741d5890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1a74069d60 tx=0x7f1a7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70018070 con 0x7f1a74131e40 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: dump: 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7000ab50 con 0x7f1a74131e40 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 5 monclient: authenticate success, global_id 274098 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000cea0 con 0x7f1a74131e40 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a6affd640 4 set_mon_vals no callback set 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _renew_subs 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a74133080 con 0x7f1a74131e40 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 10 monclient: dump: 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.081 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _renew_subs 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a74132970 con 0x7f1a74131e40 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f1a70007030 con 0x7f1a74131e40 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.065+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7409dea0 con 0x7f1a74131e40 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.066+0000 7f1a697fa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.066+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(814..814 src has 323..814) ==== 4827+0+0 (secure 0 0 0) 0x7f1a70051af0 con 0x7f1a74131e40 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.066+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.066+0000 7f1a78a6f640 10 monclient: get_auth_request con 0x7f1a4403dd10 auth_method 0 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.068+0000 7f1a78a6f640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800f6a0 tx=0x7f1a64035000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.068+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1a7409d7b0 con 0x7f1a74131e40 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.069+0000 7f1a697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.069+0000 7f1a697fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.183+0000 7f1a7acfa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.183+0000 7f1a7acfa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.183+0000 7f1a7acfa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.183+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a740008d0 con 0x7f1a74131e40 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.184+0000 7f1a697fa640 1 -- 10.20.193.51:0/2755479155 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f1a700504c0 con 0x7f1a74131e40 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.184+0000 7f1a697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:34.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.184+0000 7f1a697fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:34.187 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":208,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:07:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 msgr2=0x7f1a440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800f6a0 tx=0x7f1a64035000 comp rx=0 tx=0).stop 2026-02-17T12:07:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 10 monclient: shutdown 2026-02-17T12:07:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 msgr2=0x7f1a741d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 0x7f1a741d5890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1a74069d60 tx=0x7f1a7000cc40 comp rx=0 tx=0).stop 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 shutdown_connections 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f1a4403dd10 0x7f1a440401d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f1a74131e40 0x7f1a741d5890 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f1a741314c0 0x7f1a74131900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 --2- 10.20.193.51:0/2755479155 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f1a5800f6d0 0x7f1a74130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 >> 10.20.193.51:0/2755479155 conn(0x7f1a740a30c0 msgr2=0x7f1a7413a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 shutdown_connections 2026-02-17T12:07:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.185+0000 7f1a7acfa640 1 -- 10.20.193.51:0/2755479155 wait complete. 2026-02-17T12:07:34.195 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:07:34.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:07:34.195 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:07:34.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.259+0000 7f41dd2a7640 10 monclient: get_monmap_and_config 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.259+0000 7f41dd2a7640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.259+0000 7f41dd2a7640 10 monclient: monmap: 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:34.260849+0000 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:34.260849+0000 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:34.262 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:34.263 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:34.263 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:34.263 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:34.263 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 Processor -- start 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 -- start start 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient: init 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2026-02-17T12:07:34.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f41d80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 0x7f41d809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-b con 0x7f41d80a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f41d813b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d806e140 con 0x7f41d80a3bb0 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d809f910 con 0x7f41d813b760 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f41d809ccd0 con 0x7f41d80a0750 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41dd2a7640 10 monclient(hunting): authenticate will time out at 1941.879632s 2026-02-17T12:07:34.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d6ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f41d80a3bb0 0x7f41d809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57156/0 (socket says 10.20.193.51:57156) 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d6ffd640 1 -- 10.20.193.51:0/2499438212 learned_addr learned my addr 10.20.193.51:0/2499438212 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 1 --2- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 0x7f41d809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): get_auth_request con 0x7f41d80a0750 auth_method 0 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient(hunting): handle_auth_done global_id 234470 payload 274 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 1 -- 10.20.193.51:0/2499438212 >> v1:10.20.193.142:6789/0 conn(0x7f41d813b760 legacy=0x7f41d813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 1 -- 10.20.193.51:0/2499438212 >> v1:10.20.193.51:6789/0 conn(0x7f41d80a3bb0 legacy=0x7f41d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 1 monclient: found mon.noname-b 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.260+0000 7f41d67fc640 1 -- 10.20.193.51:0/2499438212 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d809eec0 con 0x7f41d80a0750 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d67fc640 1 -- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 msgr2=0x7f41d809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d67fc640 1 --2- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 0x7f41d809e1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f41d809f230 tx=0x7f41c002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f6ac567d7ebfc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 1 -- 10.20.193.51:0/2499438212 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003c070 con 0x7f41d80a0750 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: dump: 2026-02-17T12:07:34.275 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 1 -- 10.20.193.51:0/2499438212 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c002fce0 con 0x7f41d80a0750 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 1 -- 10.20.193.51:0/2499438212 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0037660 con 0x7f41d80a0750 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 5 monclient: authenticate success, global_id 234470 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 4 set_mon_vals no callback set 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41d5ffb640 10 monclient: dump: 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.277 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 10 monclient: shutdown 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 -- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 msgr2=0x7f41d809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 0x7f41d809e1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f41d809f230 tx=0x7f41c002ed80 comp rx=0 tx=0).stop 2026-02-17T12:07:34.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 -- 10.20.193.51:0/2499438212 shutdown_connections 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/2499438212 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a0750 0x7f41d809e1d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 -- 10.20.193.51:0/2499438212 >> 10.20.193.51:0/2499438212 conn(0x7f41d80a30c0 msgr2=0x7f41d80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 -- 10.20.193.51:0/2499438212 shutdown_connections 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.263+0000 7f41dd2a7640 1 -- 10.20.193.51:0/2499438212 wait complete. 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient: monmap: 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.279 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 Processor -- start 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 -- start start 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient: init 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80a0750 0x7f41d8099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-a con 0x7f41d80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 0x7f41d8090870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-c con 0x7f41d80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41d813b760 0x7f41d8090db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): picked mon.noname-b con 0x7f41d813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80a04b0 con 0x7f41d80a0750 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41d809c850 con 0x7f41d813b760 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f41d809e710 con 0x7f41d80a3bb0 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41dd2a7640 10 monclient(hunting): authenticate will time out at 1941.883638s 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80a0750 0x7f41d8099ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 0x7f41d8090870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80a0750 0x7f41d8099ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:60964/0 (socket says 10.20.193.51:60964) 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 1 -- 10.20.193.51:0/3714485657 learned_addr learned my addr 10.20.193.51:0/3714485657 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request con 0x7f41d80a0750 auth_method 0 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): get_auth_request con 0x7f41d80a3bb0 auth_method 0 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient(hunting): handle_auth_done global_id 234473 payload 824 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41d813b760 msgr2=0x7f41d8090db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f41d813b760 0x7f41d8090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80a0750 msgr2=0x7f41d8099ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80a0750 0x7f41d8099ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 monclient: found mon.noname-c 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.264+0000 7f41d67fc640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80929b0 con 0x7f41d80a3bb0 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.266+0000 7f41d67fc640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 msgr2=0x7f41d8090870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.266+0000 7f41d67fc640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 0x7f41d8090870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41d8051340 tx=0x7f41c00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0046070 con 0x7f41d80a3bb0 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.284 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c00418b0 con 0x7f41d80a3bb0 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003c040 con 0x7f41d80a3bb0 2026-02-17T12:07:34.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d57fa640 4 set_mon_vals no callback set 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 5 monclient: authenticate success, global_id 234473 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 monclient: _renew_subs 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d8094240 con 0x7f41d80a3bb0 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 monclient: _renew_subs 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d8094520 con 0x7f41d80a3bb0 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 0x7f41d808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80a26c0 con 0x7f41d80912f0 2026-02-17T12:07:34.287 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 0x7f41d808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient: get_auth_request con 0x7f41d80912f0 auth_method 0 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f41c0041ca0 con 0x7f41d80a3bb0 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_done global_id 274104 payload 824 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41d6ffd640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41d80916d0 con 0x7f41d80912f0 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.267+0000 7f41b77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f41a403dd60 0x7f41a4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.268+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(814..814 src has 323..814) ==== 4827+0+0 (secure 0 0 0) 0x7f41c00776e0 con 0x7f41d80a3bb0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.268+0000 7f41d77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f41a403dd60 0x7f41a4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.268+0000 7f41d77fe640 10 monclient: get_auth_request con 0x7f41a403dd60 auth_method 0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41d6ffd640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 msgr2=0x7f41d808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41d6ffd640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 0x7f41d808d3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ea70 tx=0x7f41cc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc01a070 con 0x7f41d80912f0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.289 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f41cc00cba0 con 0x7f41d80912f0 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 msgr2=0x7f41d808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 0x7f41d808d3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ea70 tx=0x7f41cc00ef40 comp rx=0 tx=0).stop 2026-02-17T12:07:34.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 msgr2=0x7f41d808d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41b77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d80912f0 0x7f41d808d3f0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ea70 tx=0x7f41cc00ef40 comp rx=0 tx=0).stop 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.270+0000 7f41d77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f41a403dd60 0x7f41a4040220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41d8099710 tx=0x7f41c80091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41dd2a7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 0x7f41d808dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41dd2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f41d806f6a0 con 0x7f41d808d930 2026-02-17T12:07:34.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 0x7f41d808dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient: get_auth_request con 0x7f41d808d930 auth_method 0 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_done global_id 274107 payload 824 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.273+0000 7f41d6ffd640 1 -- 10.20.193.51:0/3714485657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41d809dac0 con 0x7f41d808d930 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41d6ffd640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 msgr2=0x7f41d808dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41d6ffd640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 0x7f41d808dd40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41cc017000 tx=0x7f41cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc01a070 con 0x7f41d808d930 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7f41cc01b040 con 0x7f41d808d930 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:34.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 msgr2=0x7f41d808dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 0x7f41d808dd40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41cc017000 tx=0x7f41cc004a40 comp rx=0 tx=0).stop 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 msgr2=0x7f41d808dd40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.275+0000 7f41b77fe640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f41d808d930 0x7f41d808dd40 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41cc017000 tx=0x7f41cc004a40 comp rx=0 tx=0).stop 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:34.296 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 25632, 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.297 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.298 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:34.299 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.300 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:34.301 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.302 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.303 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.304 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.305 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:34.306 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:34.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f41a403dd60 msgr2=0x7f41a4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f41a403dd60 0x7f41a4040220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41d8099710 tx=0x7f41c80091c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 10 monclient: shutdown 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 msgr2=0x7f41d8090870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41d77fe640 1 -- 10.20.193.51:0/3714485657 reap_dead start 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 0x7f41d8090870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41d8051340 tx=0x7f41c00047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 shutdown_connections 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 --2- 10.20.193.51:0/3714485657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f41d80a3bb0 0x7f41d8090870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 >> 10.20.193.51:0/3714485657 conn(0x7f41d80a30c0 msgr2=0x7f41d813ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 shutdown_connections 2026-02-17T12:07:34.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.276+0000 7f41dd2a7640 1 -- 10.20.193.51:0/3714485657 wait complete. 2026-02-17T12:07:34.308 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:34.308 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:07:34.309 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: get_monmap_and_config 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: monmap: 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:34.377106+0000 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:34.377106+0000 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.380 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 Processor -- start 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 -- start start 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: init 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5d00a3bb0 0x7fb5d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-a con 0x7fb5d00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:34.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5d00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb5d013b760 0x7fb5d013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-c con 0x7fb5d013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d006e140 con 0x7fb5d00a0750 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d009f910 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d009ccd0 con 0x7fb5d013b760 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d7ef3640 10 monclient(hunting): authenticate will time out at 1941.995843s 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5d00a3bb0 0x7fb5d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5467640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb5d00a0750 0x7fb5d009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57172/0 (socket says 10.20.193.51:57172) 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5467640 1 -- 10.20.193.51:0/1698067551 learned_addr learned my addr 10.20.193.51:0/1698067551 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:34.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb5d00a3bb0 0x7fb5d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:60986/0 (socket says 10.20.193.51:60986) 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request con 0x7fb5d00a3bb0 auth_method 0 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.376+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_done global_id 274110 payload 274 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 1 -- 10.20.193.51:0/1698067551 >> v2:10.20.193.142:3300/0 conn(0x7fb5d013b760 msgr2=0x7fb5d013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/1698067551 >> v2:10.20.193.142:3300/0 conn(0x7fb5d013b760 0x7fb5d013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 1 -- 10.20.193.51:0/1698067551 >> v1:10.20.193.51:6789/0 conn(0x7fb5d00a0750 legacy=0x7fb5d009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 1 monclient: found mon.noname-a 2026-02-17T12:07:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.377+0000 7fb5d5c68640 1 -- 10.20.193.51:0/1698067551 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d009eec0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d5c68640 1 -- 10.20.193.51:0/1698067551 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d00a3bb0 msgr2=0x7fb5d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/1698067551 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d00a3bb0 0x7fb5d009dac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5d009f5f0 tx=0x7fb5c002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b052d83b5ca73ff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 1 -- 10.20.193.51:0/1698067551 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c003c070 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: dump: 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.391 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 1 -- 10.20.193.51:0/1698067551 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c002fcb0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d7ef3640 5 monclient: authenticate success, global_id 274110 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d7ef3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d7ef3640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 1 -- 10.20.193.51:0/1698067551 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c002fe60 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d7ef3640 4 set_mon_vals no callback set 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.379+0000 7fb5d4c66640 10 monclient: dump: 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 10 monclient: shutdown 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/1698067551 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d00a3bb0 msgr2=0x7fb5d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/1698067551 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d00a3bb0 0x7fb5d009dac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5d009f5f0 tx=0x7fb5c002ed50 comp rx=0 tx=0).stop 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/1698067551 shutdown_connections 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/1698067551 >> v2:10.20.193.142:3300/0 conn(0x7fb5d013b760 0x7fb5d013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/1698067551 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d00a3bb0 0x7fb5d009dac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/1698067551 >> 10.20.193.51:0/1698067551 conn(0x7fb5d00a30c0 msgr2=0x7fb5d00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/1698067551 shutdown_connections 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/1698067551 wait complete. 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 10 monclient: monmap: 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:34.394 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 Processor -- start 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 1 -- start start 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.380+0000 7fb5d7ef3640 10 monclient: init 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5d00a0750 0x7fb5d0090fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-b con 0x7fb5d00a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.395 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-c con 0x7fb5d00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d013b760 0x7fb5d0091a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): picked mon.noname-a con 0x7fb5d013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00a04b0 con 0x7fb5d013b760 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d009c850 con 0x7fb5d00a0750 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d009e710 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d7ef3640 10 monclient(hunting): authenticate will time out at 1942.000121s 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d013b760 0x7fb5d0091a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.396 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41320/0 (socket says 10.20.193.51:41320) 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d013b760 0x7fb5d0091a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:60994/0 (socket says 10.20.193.51:60994) 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 -- 10.20.193.51:0/3110960966 learned_addr learned my addr 10.20.193.51:0/3110960966 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): get_auth_request con 0x7fb5d00a3bb0 auth_method 0 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): get_auth_request con 0x7fb5d013b760 auth_method 0 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.397 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d6469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5d00a0750 0x7fb5d0090fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request con 0x7fb5d00a0750 auth_method 0 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5c68640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5c68640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient(hunting): handle_auth_done global_id 234476 payload 824 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5d00a0750 msgr2=0x7fb5d0090fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb5d00a0750 0x7fb5d0090fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d013b760 msgr2=0x7fb5d0091a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb5d013b760 0x7fb5d0091a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.398 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 monclient: found mon.noname-c 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.381+0000 7fb5d5467640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d00947a0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d5467640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 msgr2=0x7fb5d00914f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d5467640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400b530 tx=0x7fb5c400ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400fa60 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: dump: 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.399 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c400fc00 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4017400 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5be7fc640 10 monclient: dump: 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5bffff640 4 set_mon_vals no callback set 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 5 monclient: authenticate success, global_id 234476 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 10 monclient: _renew_subs 2026-02-17T12:07:34.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d00a2d70 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 10 monclient: _renew_subs 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.383+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d00944c0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d7ef3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 0x7fb5d008d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d009dac0 con 0x7fb5d008d3f0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 0x7fb5d008d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient: get_auth_request con 0x7fb5d008d3f0 auth_method 0 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb5c400d3e0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_done global_id 234479 payload 824 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d5c68640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5d0069830 con 0x7fb5d008d3f0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5be7fc640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5a003dd10 0x7fb5a00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(814..814 src has 323..814) ==== 4827+0+0 (secure 0 0 0) 0x7fb5c40526d0 con 0x7fb5d00a3bb0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d6469640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5a003dd10 0x7fb5a00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.384+0000 7fb5d6469640 10 monclient: get_auth_request con 0x7fb5a003dd10 auth_method 0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5d5c68640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 msgr2=0x7fb5d008d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 0x7fb5d008d7d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0039000 tx=0x7fb5c00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0048070 con 0x7fb5d008d3f0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 10 monclient: dump: 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb5c0037e30 con 0x7fb5d008d3f0 2026-02-17T12:07:34.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 msgr2=0x7fb5d008d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 0x7fb5d008d7d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0039000 tx=0x7fb5c00047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 msgr2=0x7fb5d008d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.386+0000 7fb5be7fc640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008d3f0 0x7fb5d008d7d0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0039000 tx=0x7fb5c00047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.387+0000 7fb5d6469640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5a003dd10 0x7fb5a00401d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006dab0 tx=0x7fb5cc00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d7ef3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 0x7fb5d01d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d7ef3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d0050ac0 con 0x7fb5d008dd10 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 0x7fb5d01d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient: get_auth_request con 0x7fb5d008dd10 auth_method 0 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 10 monclient(hunting): handle_auth_done global_id 234482 payload 824 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.390+0000 7fb5d5c68640 1 -- 10.20.193.51:0/3110960966 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5d0092b60 con 0x7fb5d008dd10 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d5c68640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 msgr2=0x7fb5d01d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d5c68640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 0x7fb5d01d7890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5c002ed90 tx=0x7fb5c0009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c003c040 con 0x7fb5d008dd10 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 10 monclient: dump: 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.408 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fb5c004d650 con 0x7fb5d008dd10 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 msgr2=0x7fb5d01d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 0x7fb5d01d7890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5c002ed90 tx=0x7fb5c0009290 comp rx=0 tx=0).stop 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 msgr2=0x7fb5d01d7890 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5be7fc640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d008dd10 0x7fb5d01d7890 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5c002ed90 tx=0x7fb5c0009290 comp rx=0 tx=0).stop 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 231387, 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:34.410 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.411 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.412 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:34.413 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.414 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.415 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.416 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:34.417 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.418 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:34.419 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:34.420 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5a003dd10 msgr2=0x7fb5a00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb5a003dd10 0x7fb5a00401d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006dab0 tx=0x7fb5cc00d040 comp rx=0 tx=0).stop 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 10 monclient: shutdown 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 msgr2=0x7fb5d00914f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400b530 tx=0x7fb5c400ba00 comp rx=0 tx=0).stop 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.392+0000 7fb5d6469640 1 -- 10.20.193.51:0/3110960966 reap_dead start 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.393+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 shutdown_connections 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.393+0000 7fb5d7ef3640 1 --2- 10.20.193.51:0/3110960966 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb5d00a3bb0 0x7fb5d00914f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.393+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 >> 10.20.193.51:0/3110960966 conn(0x7fb5d00a30c0 msgr2=0x7fb5d013adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.393+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 shutdown_connections 2026-02-17T12:07:34.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.393+0000 7fb5d7ef3640 1 -- 10.20.193.51:0/3110960966 wait complete. 2026-02-17T12:07:34.422 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:34.422 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:07:34.422 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:07:34.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 10 monclient: get_monmap_and_config 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 10 monclient: monmap: 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:34.488414+0000 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:34.488414+0000 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.492 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 1 Processor -- start 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 1 -- start start 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.487+0000 7f31fba4d640 10 monclient: init 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-b con 0x7f31f40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 0x7f31f409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.493 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-a con 0x7f31f40a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f31f409e540 0x7f31f413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-c con 0x7f31f409e540 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f31f40a3f90 con 0x7f31f40a0750 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f31f406e140 con 0x7f31f409e540 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31f409f910 con 0x7f31f40a3bb0 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31fba4d640 10 monclient(hunting): authenticate will time out at 1942.107148s 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 0x7f31f409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:41358/0 (socket says 10.20.193.51:41358) 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 -- 10.20.193.51:0/3067872758 learned_addr learned my addr 10.20.193.51:0/3067872758 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): get_auth_request con 0x7f31f40a3bb0 auth_method 0 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request con 0x7f31f40a0750 auth_method 0 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f9fc3640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.142:3300/0 conn(0x7f31f409e540 0x7f31f413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f9fc3640 10 monclient(hunting): get_auth_request con 0x7f31f409e540 auth_method 0 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f9fc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f9fc3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f9fc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient(hunting): handle_auth_done global_id 234485 payload 274 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 -- 10.20.193.51:0/3067872758 >> v2:10.20.193.142:3300/0 conn(0x7f31f409e540 msgr2=0x7f31f413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.142:3300/0 conn(0x7f31f409e540 0x7f31f413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 -- 10.20.193.51:0/3067872758 >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 msgr2=0x7f31f409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.496 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 0x7f31f409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 monclient: found mon.noname-b 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f97c2640 1 -- 10.20.193.51:0/3067872758 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f409ccd0 con 0x7f31f40a3bb0 2026-02-17T12:07:34.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.488+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 0x7f31f409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.490+0000 7f31f97c2640 1 -- 10.20.193.51:0/3067872758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 msgr2=0x7f31f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.490+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3067872758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31f409f230 tx=0x7f31e402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13cf16a432730f06 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 1 -- 10.20.193.51:0/3067872758 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e403c070 con 0x7f31f40a3bb0 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: dump: 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.503 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 1 -- 10.20.193.51:0/3067872758 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e402fca0 con 0x7f31f40a3bb0 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 1 -- 10.20.193.51:0/3067872758 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4037660 con 0x7f31f40a3bb0 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 5 monclient: authenticate success, global_id 234485 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 4 set_mon_vals no callback set 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31e3fff640 10 monclient: dump: 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 10 monclient: shutdown 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 -- 10.20.193.51:0/3067872758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 msgr2=0x7f31f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3067872758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31f409f230 tx=0x7f31e402ee60 comp rx=0 tx=0).stop 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 -- 10.20.193.51:0/3067872758 shutdown_connections 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.142:3300/0 conn(0x7f31f409e540 0x7f31f413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3067872758 >> v2:10.20.193.51:3300/0 conn(0x7f31f40a0750 0x7f31f409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3067872758 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a3bb0 0x7f31f409dac0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 -- 10.20.193.51:0/3067872758 >> 10.20.193.51:0/3067872758 conn(0x7f31f40a30c0 msgr2=0x7f31f40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 -- 10.20.193.51:0/3067872758 shutdown_connections 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 1 -- 10.20.193.51:0/3067872758 wait complete. 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.491+0000 7f31fba4d640 10 monclient: monmap: 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.506 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 Processor -- start 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 -- start start 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient: init 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 0x7f31f408f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-a con 0x7f31f409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a0750 0x7f31f408fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-c con 0x7f31f40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f40a3bb0 0x7f31f40902f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): picked mon.noname-b con 0x7f31f40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f31f40a04b0 con 0x7f31f409e540 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31f409c850 con 0x7f31f40a3bb0 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f31f413cca0 con 0x7f31f40a0750 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31fba4d640 10 monclient(hunting): authenticate will time out at 1942.111447s 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 0x7f31f408f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a0750 0x7f31f408fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 0x7f31f408f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32784/0 (socket says 10.20.193.51:32784) 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 -- 10.20.193.51:0/3066339004 learned_addr learned my addr 10.20.193.51:0/3066339004 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): get_auth_request con 0x7f31f409e540 auth_method 0 2026-02-17T12:07:34.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request con 0x7f31f40a0750 auth_method 0 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient(hunting): handle_auth_done global_id 274119 payload 824 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a0750 msgr2=0x7f31f408fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a0750 0x7f31f408fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.509 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f40a3bb0 msgr2=0x7f31f40902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f40a3bb0 0x7f31f40902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 monclient: found mon.noname-a 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f97c2640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f409d7b0 con 0x7f31f409e540 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.492+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f31f40a0750 0x7f31f408fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31f97c2640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 msgr2=0x7f31f408f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31f97c2640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 0x7f31f408f870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31e4002410 tx=0x7f31e4004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4047070 con 0x7f31f409e540 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: dump: 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.510 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e402fe50 con 0x7f31f409e540 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31fba4d640 5 monclient: authenticate success, global_id 274119 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31fba4d640 10 monclient: _renew_subs 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31fba4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.511 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f406f6a0 con 0x7f31f409e540 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e403c040 con 0x7f31f409e540 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e1ffb640 10 monclient: dump: 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.494+0000 7f31e37fe640 4 set_mon_vals no callback set 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 10 monclient: _renew_subs 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f4093670 con 0x7f31f409e540 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 0x7f31f41cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31f40a2e60 con 0x7f31f41ccfd0 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 0x7f31f41cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient: get_auth_request con 0x7f31f41ccfd0 auth_method 0 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f31e403f9f0 con 0x7f31f409e540 2026-02-17T12:07:34.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31e1ffb640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31c403dd10 0x7f31c40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_done global_id 264145 payload 824 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(814..814 src has 323..814) ==== 4827+0+0 (secure 0 0 0) 0x7f31e4077200 con 0x7f31f409e540 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.495+0000 7f31f8fc1640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31f4092f40 con 0x7f31f41ccfd0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.496+0000 7f31f9fc3640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31c403dd10 0x7f31c40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.496+0000 7f31f9fc3640 10 monclient: get_auth_request con 0x7f31c403dd10 auth_method 0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31f8fc1640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 msgr2=0x7f31f41cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 0x7f31f41cd3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31f40a1ba0 tx=0x7f31e800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e800fe90 con 0x7f31f41ccfd0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 10 monclient: dump: 2026-02-17T12:07:34.514 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f31e8004020 con 0x7f31f41ccfd0 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 msgr2=0x7f31f41cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 0x7f31f41cd3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31f40a1ba0 tx=0x7f31e800f610 comp rx=0 tx=0).stop 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 msgr2=0x7f31f41cd3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31e1ffb640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41ccfd0 0x7f31f41cd3b0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31f40a1ba0 tx=0x7f31e800f610 comp rx=0 tx=0).stop 2026-02-17T12:07:34.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.498+0000 7f31f9fc3640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31c403dd10 0x7f31c40401d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31f409a590 tx=0x7f31f00096a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.501+0000 7f31fba4d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:34.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.501+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 0x7f31f41d8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.501+0000 7f31fba4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.501+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31f40740f0 con 0x7f31f41cd8f0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 0x7f31f41d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient: get_auth_request con 0x7f31f41cd8f0 auth_method 0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 10 monclient(hunting): handle_auth_done global_id 264148 payload 824 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.502+0000 7f31f8fc1640 1 -- 10.20.193.51:0/3066339004 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31f40a2360 con 0x7f31f41cd8f0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.504+0000 7f31f8fc1640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 msgr2=0x7f31f41d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.504+0000 7f31f8fc1640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 0x7f31f41d8340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31e801b000 tx=0x7f31e80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e802b020 con 0x7f31f41cd8f0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 10 monclient: dump: 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f31e8003d30 con 0x7f31f41cd8f0 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:34.519 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 msgr2=0x7f31f41d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 0x7f31f41d8340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31e801b000 tx=0x7f31e80047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 msgr2=0x7f31f41d8340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31e1ffb640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f31f41cd8f0 0x7f31f41d8340 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31e801b000 tx=0x7f31e80047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 74496, 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:34.520 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.521 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.522 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:34.523 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:34.524 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.525 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.526 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:34.527 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.528 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:34.529 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:07:34.530 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:34.530 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:34.530 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:34.530 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:34.530 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31c403dd10 msgr2=0x7f31c40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f31c403dd10 0x7f31c40401d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31f409a590 tx=0x7f31f00096a0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 10 monclient: shutdown 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 msgr2=0x7f31f408f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 --2- 10.20.193.51:0/3066339004 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f31f409e540 0x7f31f408f870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31e4002410 tx=0x7f31e4004830 comp rx=0 tx=0).stop 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31f9fc3640 1 -- 10.20.193.51:0/3066339004 reap_dead start 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31f9fc3640 1 -- 10.20.193.51:0/3066339004 reap_dead start 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 shutdown_connections 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 >> 10.20.193.51:0/3066339004 conn(0x7f31f40a30c0 msgr2=0x7f31f4072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 shutdown_connections 2026-02-17T12:07:34.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.505+0000 7f31fba4d640 1 -- 10.20.193.51:0/3066339004 wait complete. 2026-02-17T12:07:34.532 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:34.532 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:07:34.532 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:07:34.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.595+0000 7f3a24d85640 10 monclient: get_monmap_and_config 2026-02-17T12:07:34.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.595+0000 7f3a24d85640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient: monmap: 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:34.596959+0000 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:34.596959+0000 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:34.598 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 Processor -- start 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 -- start start 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient: init 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a200a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a200a0750 0x7f3a2009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-a con 0x7f3a200a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 0x7f3a2013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-c con 0x7f3a2013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2006e140 con 0x7f3a200a3bb0 2026-02-17T12:07:34.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2009f910 con 0x7f3a200a0750 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2009ccd0 con 0x7f3a2013b760 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a24d85640 10 monclient(hunting): authenticate will time out at 1942.215733s 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1e575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f3a200a3bb0 0x7f3a2009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57184/0 (socket says 10.20.193.51:57184) 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1e575640 1 -- 10.20.193.51:0/2741873135 learned_addr learned my addr 10.20.193.51:0/2741873135 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 1 --2- 10.20.193.51:0/2741873135 >> v2:10.20.193.51:3300/0 conn(0x7f3a200a0750 0x7f3a2009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): get_auth_request con 0x7f3a200a0750 auth_method 0 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1ed76640 1 --2- 10.20.193.51:0/2741873135 >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 0x7f3a2013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.596+0000 7f3a1dd74640 10 monclient(hunting): handle_auth_done global_id 274122 payload 274 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 1 -- 10.20.193.51:0/2741873135 >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 msgr2=0x7f3a2013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 1 --2- 10.20.193.51:0/2741873135 >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 0x7f3a2013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 1 -- 10.20.193.51:0/2741873135 >> v1:10.20.193.51:6789/0 conn(0x7f3a200a3bb0 legacy=0x7f3a2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 1 monclient: found mon.noname-a 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1dd74640 1 -- 10.20.193.51:0/2741873135 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2009eec0 con 0x7f3a200a0750 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1ed76640 10 monclient: get_auth_request con 0x7f3a2013b760 auth_method 0 2026-02-17T12:07:34.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.597+0000 7f3a1ed76640 1 --2- 10.20.193.51:0/2741873135 >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 0x7f3a2013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1dd74640 1 -- 10.20.193.51:0/2741873135 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 msgr2=0x7f3a2009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1dd74640 1 --2- 10.20.193.51:0/2741873135 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a2009e1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a2009f5f0 tx=0x7f3a0802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb48fd887cd9f6d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 1 -- 10.20.193.51:0/2741873135 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0803c070 con 0x7f3a200a0750 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: dump: 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.607 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 1 -- 10.20.193.51:0/2741873135 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0802fcb0 con 0x7f3a200a0750 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 1 -- 10.20.193.51:0/2741873135 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0802fe60 con 0x7f3a200a0750 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a1d573640 10 monclient: dump: 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.608 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 5 monclient: authenticate success, global_id 274122 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 4 set_mon_vals no callback set 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 10 monclient: shutdown 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 1 -- 10.20.193.51:0/2741873135 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 msgr2=0x7f3a2009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.599+0000 7f3a24d85640 1 --2- 10.20.193.51:0/2741873135 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a2009e1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a2009f5f0 tx=0x7f3a0802ed50 comp rx=0 tx=0).stop 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- 10.20.193.51:0/2741873135 shutdown_connections 2026-02-17T12:07:34.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 --2- 10.20.193.51:0/2741873135 >> v2:10.20.193.142:3300/0 conn(0x7f3a2013b760 0x7f3a2013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 --2- 10.20.193.51:0/2741873135 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a2009e1d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- 10.20.193.51:0/2741873135 >> 10.20.193.51:0/2741873135 conn(0x7f3a200a30c0 msgr2=0x7f3a200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- 10.20.193.51:0/2741873135 shutdown_connections 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- 10.20.193.51:0/2741873135 wait complete. 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient: build_initial_monmap 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient: monmap: 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 Processor -- start 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- start start 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient: init 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-a con 0x7f3a200a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a200a3bb0 0x7f3a201d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-b con 0x7f3a200a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 0x7f3a200953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): picked mon.noname-c con 0x7f3a2013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200a04b0 con 0x7f3a200a0750 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2009c850 con 0x7f3a200a3bb0 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2009e710 con 0x7f3a2013b760 2026-02-17T12:07:34.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a24d85640 10 monclient(hunting): authenticate will time out at 1942.219935s 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a1e575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.600+0000 7f3a1e575640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:32808/0 (socket says 10.20.193.51:32808) 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 -- 10.20.193.51:0/23850657 learned_addr learned my addr 10.20.193.51:0/23850657 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): get_auth_request con 0x7f3a200a0750 auth_method 0 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 0x7f3a200953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): get_auth_request con 0x7f3a2013b760 auth_method 0 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient(hunting): handle_auth_done global_id 274125 payload 824 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 -- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 msgr2=0x7f3a200953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 0x7f3a200953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 -- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a200a3bb0 msgr2=0x7f3a201d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a200a3bb0 0x7f3a201d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient: _finish_hunting 0 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 monclient: found mon.noname-a 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1e575640 1 -- 10.20.193.51:0/23850657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a200a2290 con 0x7f3a200a0750 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.601+0000 7f3a1ed76640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 0x7f3a200953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a1e575640 1 -- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 msgr2=0x7f3a201cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a1e575640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c750 tx=0x7f3a1400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14005de0 con 0x7f3a200a0750 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: dump: 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:34.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 5 monclient: authenticate success, global_id 274125 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14007070 con 0x7f3a200a0750 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 10 monclient: _renew_subs 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20098cd0 con 0x7f3a200a0750 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007440 con 0x7f3a200a0750 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a06ffd640 10 monclient: dump: 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:34.615 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a1cd72640 4 set_mon_vals no callback set 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 10 monclient: _renew_subs 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.603+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20099290 con 0x7f3a200a0750 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a24d85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a24d85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a24d85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a20077c20 con 0x7f3a200a0750 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a14007660 con 0x7f3a200a0750 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a06ffd640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 0x7f39ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(814..814 src has 323..814) ==== 4827+0+0 (secure 0 0 0) 0x7f3a14052410 con 0x7f3a200a0750 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a1dd74640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 0x7f39ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:34.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.604+0000 7f3a1dd74640 10 monclient: get_auth_request con 0x7f39ec03dd10 auth_method 0 2026-02-17T12:07:34.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.606+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3a20077c20 con 0x7f3a200a0750 2026-02-17T12:07:34.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.606+0000 7f3a06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:34.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.606+0000 7f3a06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:34.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.607+0000 7f3a1dd74640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 0x7f39ec0401d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3a08039000 tx=0x7f3a08031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:34.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a24d85640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:07:34.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a24d85640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:07:34.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a24d85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:34.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3a2009dac0 con 0x7f3a200a0750 2026-02-17T12:07:34.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a06ffd640 1 -- 10.20.193.51:0/23850657 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3a200a2290 con 0x7f3a200a0750 2026-02-17T12:07:34.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:07:34.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.722+0000 7f3a06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:34.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 msgr2=0x7f39ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 0x7f39ec0401d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3a08039000 tx=0x7f3a08031000 comp rx=0 tx=0).stop 2026-02-17T12:07:34.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 10 monclient: shutdown 2026-02-17T12:07:34.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:34.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 msgr2=0x7f3a201cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c750 tx=0x7f3a1400cc20 comp rx=0 tx=0).stop 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 shutdown_connections 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f39ec03dd10 0x7f39ec0401d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a2013b760 0x7f3a200953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a200a3bb0 0x7f3a201d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 --2- 10.20.193.51:0/23850657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a200a0750 0x7f3a201cfad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 >> 10.20.193.51:0/23850657 conn(0x7f3a200a30c0 msgr2=0x7f3a2013abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 shutdown_connections 2026-02-17T12:07:34.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:34.723+0000 7f3a24d85640 1 -- 10.20.193.51:0/23850657 wait complete. 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=12,kv=12,logm=46} crc {auth=3163436395,config=692619927,health=2499132454,kv=643764953,logm=816117416}) 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=26,config=1,health=12,kv=12,logm=49} crc {auth=3558531415,config=3678701417,health=2499132454,kv=643764953,logm=1000370045}) 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=12,kv=12,logm=46} crc {auth=3163436395,config=692619927,health=2499132454,kv=643764953,logm=816117416}) 2026-02-17T12:07:34.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.729+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=29,config=2,health=11,kv=12,logm=46} crc {auth=4240125394,config=692619927,health=1606178032,kv=643764953,logm=110583172}) 2026-02-17T12:07:34.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:07:34.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171444173}) 2026-02-17T12:07:34.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=515566116}) 2026-02-17T12:07:34.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171444173}) 2026-02-17T12:07:34.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.731+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1534194070}) 2026-02-17T12:07:34.735 INFO:tasks.rados.rados.0.trial142.stdout:3537: done (1 left) 2026-02-17T12:07:34.735 INFO:tasks.rados.rados.0.trial142.stdout:3539: done (0 left) 2026-02-17T12:07:34.735 INFO:tasks.rados.rados.0.trial142.stdout:3540: snap_create 2026-02-17T12:07:34.736 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241417555}) 2026-02-17T12:07:34.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3280815246}) 2026-02-17T12:07:34.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241417555}) 2026-02-17T12:07:34.737 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.734+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1191662578}) 2026-02-17T12:07:34.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1729978660}) 2026-02-17T12:07:34.943 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3316186686}) 2026-02-17T12:07:34.943 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.943 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1729978660}) 2026-02-17T12:07:34.943 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.940+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3454026308}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255457916}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2881560289}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255457916}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3778608989}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=970623539}) 2026-02-17T12:07:34.955 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3169056929}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=970623539}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=248838234}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624292411}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=530756881}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624292411}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3953511460}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3823725555}) 2026-02-17T12:07:34.956 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1537998726}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3823725555}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739265433}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027531082}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1745749052}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027531082}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3364601603}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=524785915}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3136882964}) 2026-02-17T12:07:34.957 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=524785915}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1101750918}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3442754190}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3296566360}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3442754190}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.949+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2884087686}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=80361699}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3368104889}) 2026-02-17T12:07:34.958 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=80361699}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2149814447}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627460587}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3242636568}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627460587}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4159693812}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=55157832}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1607245254}) 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.959 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=55157832}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.950+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=313509351}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439160176}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3783472038}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439160176}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3610233778}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801818921}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1330779734}) 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.960 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801818921}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1281531135}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1417234809}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3063100717}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1417234809}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.951+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4084038786}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3948092916}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3931517768}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3948092916}) 2026-02-17T12:07:34.961 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:34.952+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2583710072}) 2026-02-17T12:07:35.089 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.089 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1673543801}) 2026-02-17T12:07:35.089 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=540902326}) 2026-02-17T12:07:35.090 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.090 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1673543801}) 2026-02-17T12:07:35.090 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3398059095}) 2026-02-17T12:07:35.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880167066}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3020793982}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880167066}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2071940407}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604089394}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=162577299}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604089394}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=274863839}) 2026-02-17T12:07:35.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1116496289}) 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3854546733}) 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1116496289}) 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.403+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3552283782}) 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874369064}) 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=171309294}) 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874369064}) 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3674573660}) 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=370359231}) 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1306360562}) 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=370359231}) 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2080582523}) 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=342271458}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1282627257}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=342271458}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.404+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=18989906}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666197053}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2679144368}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666197053}) 2026-02-17T12:07:35.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3024564880}) 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1303178110}) 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1854981483}) 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1303178110}) 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1142111222}) 2026-02-17T12:07:35.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3552068152}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2719362717}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3552068152}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.405+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3025130769}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700199554}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2442763683}) 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700199554}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=607283337}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409273018}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=736147476}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409273018}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2830603681}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371016648}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3537329399}) 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.420 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371016648}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.406+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4276013348}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=408072585}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1101900517}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=408072585}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=897254805}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2462599472}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2795699543}) 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.421 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2462599472}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.407+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2803999653}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2191994770}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=312780107}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2191994770}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1349566319}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131048905}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2159158921}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131048905}) 2026-02-17T12:07:35.422 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3839245142}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606384757}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2831953430}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606384757}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.408+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3911796427}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087442309}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3515590809}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087442309}) 2026-02-17T12:07:35.423 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.409+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3180501927}) 2026-02-17T12:07:35.477 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455010874}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=762764892}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455010874}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=618259291}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243662783}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3406864829}) 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.478 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243662783}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.471+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=320058325}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862388325}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3769877169}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862388325}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3694380762}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170463450}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1660386429}) 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.479 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170463450}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1343113127}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=469943531}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1514691626}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=469943531}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.472+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3030583356}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2413385842}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2641312100}) 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.480 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2413385842}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2505928554}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=87659895}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1304130399}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=87659895}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4137889140}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1598596063}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2099186719}) 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.481 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1598596063}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.473+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1832569982}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4229588950}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=97980315}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4229588950}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=381519599}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3045543349}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=129805790}) 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.482 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3045543349}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2629182762}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=710369096}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4271246383}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=710369096}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.474+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1554992750}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3014371161}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1107745814}) 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.483 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3014371161}) 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=328041798}) 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056864949}) 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3322461949}) 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056864949}) 2026-02-17T12:07:35.484 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.475+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3982040711}) 2026-02-17T12:07:35.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.498 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3520408506}) 2026-02-17T12:07:35.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1488707790}) 2026-02-17T12:07:35.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3520408506}) 2026-02-17T12:07:35.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.482+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=362855041}) 2026-02-17T12:07:35.499 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=293138587}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=142965405}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=293138587}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=609989118}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228705120}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=682911653}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228705120}) 2026-02-17T12:07:35.500 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.483+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3446906650}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1734748310}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1894990211}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1734748310}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2466448728}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=416685843}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2891958325}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=416685843}) 2026-02-17T12:07:35.501 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1147423103}) 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370144326}) 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1767704956}) 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370144326}) 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.484+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1823546571}) 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.502 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2005285711}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=785577054}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2005285711}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1764996625}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=452835108}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2488692803}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=452835108}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.485+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2462376314}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853275775}) 2026-02-17T12:07:35.503 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2181408434}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853275775}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2591707357}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335357151}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3222460050}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335357151}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=168773228}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2267028891}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2191172193}) 2026-02-17T12:07:35.504 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2267028891}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.486+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3551741097}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356960333}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4215049351}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356960333}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=977140967}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032764553}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2486992199}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032764553}) 2026-02-17T12:07:35.505 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3808820406}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913892614}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2165018175}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913892614}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.487+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3483671205}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589884006}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2300514754}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589884006}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1801618308}) 2026-02-17T12:07:35.506 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3349998006}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2774223900}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3349998006}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.488+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2715403620}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=502128077}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3271920615}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=502128077}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1859676367}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3596342855}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2283184251}) 2026-02-17T12:07:35.507 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3596342855}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1582368669}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3465711061}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3723721727}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3465711061}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.489+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1667226956}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3541101401}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=350093772}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3541101401}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3896151907}) 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.508 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223664349}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2573942605}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223664349}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.490+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1413147613}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2389118733}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=592172463}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2389118733}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3644527392}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2992543766}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=298846714}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2992543766}) 2026-02-17T12:07:35.509 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=625840875}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170607352}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3571201691}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170607352}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.491+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1272087706}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3245201929}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1081728903}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3245201929}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089177573}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111504247}) 2026-02-17T12:07:35.510 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=96771219}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111504247}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3201370416}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.492+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338612294}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3255080701}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338612294}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2502302182}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797394949}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1936885600}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797394949}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1126251333}) 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.511 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413600281}) 2026-02-17T12:07:35.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1907546418}) 2026-02-17T12:07:35.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413600281}) 2026-02-17T12:07:35.512 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.493+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=101999468}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2355261216}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2995390061}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2355261216}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.500+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2989052880}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2331397907}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2809126266}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2331397907}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1875211257}) 2026-02-17T12:07:35.522 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241543362}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3011285439}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241543362}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.501+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=540159917}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152974187}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3974551369}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152974187}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2198863208}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929893034}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=839311902}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929893034}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3137370013}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728323107}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2638563519}) 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.523 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728323107}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.502+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2586593931}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1614619114}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1052980604}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1614619114}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2542158922}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3727365871}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2249890173}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3727365871}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2606683838}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993235195}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=547143503}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993235195}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=666369243}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1915949589}) 2026-02-17T12:07:35.524 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3220172597}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.503+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1915949589}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=721358346}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1869927612}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=285859860}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1869927612}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2848632196}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155156750}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3960533591}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155156750}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=963746563}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128970414}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2331462237}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128970414}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.504+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2730571097}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2378672208}) 2026-02-17T12:07:35.525 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3131134758}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2378672208}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2884034322}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735721923}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=471040565}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735721923}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3166464360}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=261658641}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=721594293}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=261658641}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.505+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2091231103}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=397038508}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1348525685}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=397038508}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3122983269}) 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.526 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209965979}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880295676}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209965979}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1373215286}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153326231}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=911765986}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153326231}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.506+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4195166011}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2108472248}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1688233511}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2108472248}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2182014559}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3256576945}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4015127132}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3256576945}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3378036005}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909616468}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1094548408}) 2026-02-17T12:07:35.527 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909616468}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1953460598}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3983563843}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2976521630}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3983563843}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.507+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2395147613}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1790785554}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3320680190}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1790785554}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1324450712}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=316888368}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1519140678}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=316888368}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2391292931}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277342426}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=965670517}) 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.528 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277342426}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.508+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3702523364}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1015709787}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4172544789}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1015709787}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2526318439}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=2,osd_metadata=2} crc {logm=3219003965,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=492727048,mon_config_key=3390328712,monmap=1614227248,osd_metadata=1950611787}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=12,monmap=3,osd_metadata=3} crc {logm=1808419245,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=4133287286,mon_config_key=829000412,monmap=263989209,osd_metadata=1704541179}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=2,osd_metadata=2} crc {logm=3219003965,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=492727048,mon_config_key=3390328712,monmap=1614227248,osd_metadata=1950611787}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=13,monmap=2} crc {logm=2465024369,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3407589415,mon_config_key=3390328713,monmap=1614227248}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=95} crc {osd_metadata=1027059165,osd_pg_creating=3668006792,osd_snap=2649032471}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=95} crc {osd_metadata=1027059165,osd_pg_creating=3668006792,osd_snap=2151414337}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=95} crc {osd_metadata=1027059165,osd_pg_creating=3668006792,osd_snap=2649032471}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.509+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osd_snap=96} crc {osd_metadata=2684632667,osd_pg_creating=3668006792,osd_snap=3096410209}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=37,osdmap=63} crc {osd_snap=2814180473,osdmap=1922944665}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=40,osdmap=60} crc {osd_snap=2981869808,osdmap=3851211263}) 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.529 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=37,osdmap=63} crc {osd_snap=2814180473,osdmap=1922944665}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=44,osdmap=56} crc {osd_snap=4269144001,osdmap=2058667406}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=242754961}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2984916460}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=242754961}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3919682829}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4090153955}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4092177178}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4090153955}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.510+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2797592597}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1710001912}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=686575180}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1710001912}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3322939668}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1781325330}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3882276890}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1781325330}) 2026-02-17T12:07:35.530 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.511+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2825759449}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1027128998}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1498965202}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1027128998}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3503082982}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1716401522}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2745695541}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1716401522}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.512+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4290778033}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=56} crc {osdmap=3823006387}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=56} crc {osdmap=3402770750}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=56} crc {osdmap=3823006387}) 2026-02-17T12:07:35.531 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:07:35.515+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=54} crc {osdmap=1474858734}) 2026-02-17T12:07:35.734 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:07:35.734 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:3540: done (0 left) 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:3541: rollback oid 35 current snap is 397 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 386 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:3542: read oid 2 snap 396 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:3542: expect deleted 2026-02-17T12:07:35.759 INFO:tasks.rados.rados.0.trial142.stdout:3543: snap_create 2026-02-17T12:07:35.762 INFO:tasks.rados.rados.0.trial142.stdout:3541: finishing rollback tid 0 to trial14245205-35 2026-02-17T12:07:35.762 INFO:tasks.rados.rados.0.trial142.stdout:3541: finishing rollback tid 1 to trial14245205-35 2026-02-17T12:07:35.762 INFO:tasks.rados.rados.0.trial142.stdout:3541: finishing rollback tid 2 to trial14245205-35 2026-02-17T12:07:35.763 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 3094 (ObjNum 1092 snap 357 seq_num 1092) dirty exists 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: get_monmap_and_config 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: build_initial_monmap 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: monmap: 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:35.806 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:35.803310+0000 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:35.803310+0000 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 1 Processor -- start 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 1 -- start start 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: init 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.802+0000 7f268f787640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26880a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26880a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 0x7f268813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): picked mon.noname-b con 0x7f268813c770 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268809e8e0 con 0x7f26880a0750 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268806e140 con 0x7f26880a3bb0 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:35.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f268809f910 con 0x7f268813c770 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268f787640 10 monclient(hunting): authenticate will time out at 1943.422055s 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268ccfb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f26880a0750 0x7f268809e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42878/0 (socket says 10.20.193.51:42878) 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268ccfb640 1 -- 10.20.193.51:0/2094661167 learned_addr learned my addr 10.20.193.51:0/2094661167 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 1 --2- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 0x7f268813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): get_auth_request con 0x7f268813c770 auth_method 0 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:35.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient(hunting): handle_auth_done global_id 234494 payload 274 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 1 -- 10.20.193.51:0/2094661167 >> v1:10.20.193.142:6789/0 conn(0x7f26880a3bb0 legacy=0x7f268809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 1 -- 10.20.193.51:0/2094661167 >> v1:10.20.193.51:6789/0 conn(0x7f26880a0750 legacy=0x7f268809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 1 monclient: found mon.noname-b 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:07:35.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.803+0000 7f268dcfd640 1 -- 10.20.193.51:0/2094661167 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268809ccd0 con 0x7f268813c770 2026-02-17T12:07:35.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268dcfd640 1 -- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 msgr2=0x7f268813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:35.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268dcfd640 1 --2- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 0x7f268813eb60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f268402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c379b211cb536 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:35.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 1 -- 10.20.193.51:0/2094661167 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268403c070 con 0x7f268813c770 2026-02-17T12:07:35.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: dump: 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:35.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 1 -- 10.20.193.51:0/2094661167 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2684037640 con 0x7f268813c770 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268f787640 5 monclient: authenticate success, global_id 234494 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268f787640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 1 -- 10.20.193.51:0/2094661167 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684037a10 con 0x7f268813c770 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:35.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f2677fff640 10 monclient: dump: 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268f787640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:35.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.805+0000 7f268f787640 4 set_mon_vals no callback set 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 10 monclient: shutdown 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 msgr2=0x7f268813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 --2- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 0x7f268813eb60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f268402f1c0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- 10.20.193.51:0/2094661167 shutdown_connections 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 --2- 10.20.193.51:0/2094661167 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f268813c770 0x7f268813eb60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- 10.20.193.51:0/2094661167 >> 10.20.193.51:0/2094661167 conn(0x7f26880a30c0 msgr2=0x7f26880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- 10.20.193.51:0/2094661167 shutdown_connections 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- 10.20.193.51:0/2094661167 wait complete. 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 10 monclient: build_initial_monmap 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 10 monclient: monmap: 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:35.821 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 Processor -- start 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 1 -- start start 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.806+0000 7f268f787640 10 monclient: init 2026-02-17T12:07:35.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f26880a0750 0x7f268809b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): picked mon.noname-c con 0x7f26880a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f26880a3bb0 0x7f268809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): picked mon.noname-b con 0x7f26880a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): picked mon.noname-a con 0x7f268813c770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f268809c850 con 0x7f268813c770 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f268809eef0 con 0x7f26880a3bb0 2026-02-17T12:07:35.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f26880a04b0 con 0x7f26880a0750 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268f787640 10 monclient(hunting): authenticate will time out at 1943.426236s 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f26880a0750 0x7f268809b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34128/0 (socket says 10.20.193.51:34128) 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 -- 10.20.193.51:0/1388089349 learned_addr learned my addr 10.20.193.51:0/1388089349 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): get_auth_request con 0x7f268813c770 auth_method 0 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:35.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): get_auth_request con 0x7f26880a0750 auth_method 0 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268d4fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268ccfb640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f26880a3bb0 0x7f268809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268ccfb640 10 monclient(hunting): get_auth_request con 0x7f26880a3bb0 auth_method 0 2026-02-17T12:07:35.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268ccfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268ccfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268ccfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient(hunting): handle_auth_done global_id 274128 payload 824 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 -- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f26880a0750 msgr2=0x7f268809b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f26880a0750 0x7f268809b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 -- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f26880a3bb0 msgr2=0x7f268809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f26880a3bb0 0x7f268809be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 monclient: found mon.noname-a 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.807+0000 7f268dcfd640 1 -- 10.20.193.51:0/1388089349 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268813e650 con 0x7f268813c770 2026-02-17T12:07:35.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268dcfd640 1 -- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 msgr2=0x7f26880923c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268dcfd640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f268403a040 tx=0x7f2684004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684047020 con 0x7f268813c770 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: dump: 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.827 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 5 monclient: authenticate success, global_id 274128 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2684042880 con 0x7f268813c770 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 10 monclient: _renew_subs 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2688095d90 con 0x7f268813c770 2026-02-17T12:07:35.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268403c040 con 0x7f268813c770 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f26777fe640 4 set_mon_vals no callback set 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f2675ffb640 10 monclient: dump: 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:35.829 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 10 monclient: _renew_subs 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.809+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26880a2ac0 con 0x7f268813c770 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268f787640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268f787640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268f787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2684043420 con 0x7f268813c770 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268809d7b0 con 0x7f268813c770 2026-02-17T12:07:35.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f2675ffb640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 0x7f2658040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(816..816 src has 323..816) ==== 4799+0+0 (secure 0 0 0) 0x7f26840781d0 con 0x7f268813c770 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268d4fc640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 0x7f2658040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.810+0000 7f268d4fc640 10 monclient: get_auth_request con 0x7f265803dd40 auth_method 0 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.813+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2684051070 con 0x7f268813c770 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.813+0000 7f2675ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.813+0000 7f2675ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:35.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.813+0000 7f268d4fc640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 0x7f2658040200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2678005160 tx=0x7f2678007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f268f787640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:07:35.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f268f787640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f268f787640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f268809dac0 con 0x7f268813c770 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f2675ffb640 1 -- 10.20.193.51:0/1388089349 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f268813e650 con 0x7f268813c770 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f2675ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.927+0000 7f2675ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:35.930 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":208,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:07:35.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 msgr2=0x7f2658040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 0x7f2658040200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2678005160 tx=0x7f2678007f30 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 10 monclient: shutdown 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 msgr2=0x7f26880923c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f268403a040 tx=0x7f2684004b40 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 shutdown_connections 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f265803dd40 0x7f2658040200 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f268813c770 0x7f26880923c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f26880a3bb0 0x7f268809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 --2- 10.20.193.51:0/1388089349 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f26880a0750 0x7f268809b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:35.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 >> 10.20.193.51:0/1388089349 conn(0x7f26880a30c0 msgr2=0x7f26880a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:35.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 shutdown_connections 2026-02-17T12:07:35.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:35.928+0000 7f268f787640 1 -- 10.20.193.51:0/1388089349 wait complete. 2026-02-17T12:07:35.937 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:07:35.937 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:07:35.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:07:35.938 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:07:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: get_monmap_and_config 2026-02-17T12:07:36.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: monmap: 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:36.004108+0000 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:36.004108+0000 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:36.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 Processor -- start 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 -- start start 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: init 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd6bc0a3bb0 0x7fd6bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-c con 0x7fd6bc0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:36.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd6bc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd6bc13b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6bc06e140 con 0x7fd6bc0a0750 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6bc09f910 con 0x7fd6bc13b760 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd6bc09ccd0 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c329f640 10 monclient(hunting): authenticate will time out at 1943.622861s 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c0813640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd6bc0a0750 0x7fd6bc09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:42882/0 (socket says 10.20.193.51:42882) 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.003+0000 7fd6c0813640 1 -- 10.20.193.51:0/2904760779 learned_addr learned my addr 10.20.193.51:0/2904760779 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 1 --2- 10.20.193.51:0/2904760779 >> v2:10.20.193.142:3300/0 conn(0x7fd6bc0a3bb0 0x7fd6bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): get_auth_request con 0x7fd6bc0a3bb0 auth_method 0 2026-02-17T12:07:36.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient(hunting): handle_auth_done global_id 264154 payload 274 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 1 -- 10.20.193.51:0/2904760779 >> v1:10.20.193.142:6789/0 conn(0x7fd6bc13b760 legacy=0x7fd6bc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 1 -- 10.20.193.51:0/2904760779 >> v1:10.20.193.51:6789/0 conn(0x7fd6bc0a0750 legacy=0x7fd6bc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 1 monclient: found mon.noname-c 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:07:36.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.004+0000 7fd6c1014640 1 -- 10.20.193.51:0/2904760779 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc09eec0 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c1014640 1 -- 10.20.193.51:0/2904760779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc0a3bb0 msgr2=0x7fd6bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c1014640 1 --2- 10.20.193.51:0/2904760779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc09dac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0098a0 tx=0x7fd6ac02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35b9b705105730da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 1 -- 10.20.193.51:0/2904760779 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac03c070 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:36.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: dump: 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.021 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 1 -- 10.20.193.51:0/2904760779 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac02fce0 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 5 monclient: authenticate success, global_id 264154 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 1 -- 10.20.193.51:0/2904760779 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac037660 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 4 set_mon_vals no callback set 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6abfff640 10 monclient: dump: 2026-02-17T12:07:36.022 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 10 monclient: shutdown 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.023 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 -- 10.20.193.51:0/2904760779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc0a3bb0 msgr2=0x7fd6bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 --2- 10.20.193.51:0/2904760779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc09dac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0098a0 tx=0x7fd6ac02ed80 comp rx=0 tx=0).stop 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 -- 10.20.193.51:0/2904760779 shutdown_connections 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 --2- 10.20.193.51:0/2904760779 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc09dac0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 -- 10.20.193.51:0/2904760779 >> 10.20.193.51:0/2904760779 conn(0x7fd6bc0a30c0 msgr2=0x7fd6bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 -- 10.20.193.51:0/2904760779 shutdown_connections 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.007+0000 7fd6c329f640 1 -- 10.20.193.51:0/2904760779 wait complete. 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient: monmap: 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:36.024 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 Processor -- start 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 -- start start 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient: init 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:36.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 0x7fd6bc1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-c con 0x7fd6bc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc12dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-a con 0x7fd6bc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc13b760 0x7fd6bc12e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): picked mon.noname-b con 0x7fd6bc13b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc0a04b0 con 0x7fd6bc0a3bb0 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc09c850 con 0x7fd6bc13b760 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd6bc09e710 con 0x7fd6bc0a0750 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c329f640 10 monclient(hunting): authenticate will time out at 1943.627617s 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 0x7fd6bc1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc12dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 0x7fd6bc1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40026/0 (socket says 10.20.193.51:40026) 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 -- 10.20.193.51:0/1583374488 learned_addr learned my addr 10.20.193.51:0/1583374488 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): get_auth_request con 0x7fd6bc0a0750 auth_method 0 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): get_auth_request con 0x7fd6bc0a3bb0 auth_method 0 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1815640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc13b760 0x7fd6bc12e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1815640 10 monclient(hunting): get_auth_request con 0x7fd6bc13b760 auth_method 0 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1815640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1815640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1815640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient(hunting): handle_auth_done global_id 234500 payload 824 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc13b760 msgr2=0x7fd6bc12e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd6bc13b760 0x7fd6bc12e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc0a3bb0 msgr2=0x7fd6bc12dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc0a3bb0 0x7fd6bc12dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 monclient: found mon.noname-c 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.008+0000 7fd6c1014640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc1314c0 con 0x7fd6bc0a0750 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.010+0000 7fd6c1014640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 msgr2=0x7fd6bc1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.010+0000 7fd6c1014640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 0x7fd6bc1381c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0099d0 tx=0x7fd6ac0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac047020 con 0x7fd6bc0a0750 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: dump: 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.030 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac042670 con 0x7fd6bc0a0750 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 5 monclient: authenticate success, global_id 234500 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 monclient: _renew_subs 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc1317a0 con 0x7fd6bc0a0750 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac03c040 con 0x7fd6bc0a0750 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6ab7fe640 4 set_mon_vals no callback set 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 10 monclient: dump: 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 monclient: _renew_subs 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc131a80 con 0x7fd6bc0a0750 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 0x7fd6bc1398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc0a2e30 con 0x7fd6bc12e640 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 0x7fd6bc1398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient: get_auth_request con 0x7fd6bc12e640 auth_method 0 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd6ac042a60 con 0x7fd6bc0a0750 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 10 monclient(hunting): handle_auth_done global_id 274134 payload 824 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6c0813640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6bc12ea20 con 0x7fd6bc12e640 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.011+0000 7fd6a9ffb640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd68c03dd10 0x7fd68c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.012+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(816..816 src has 323..816) ==== 4799+0+0 (secure 0 0 0) 0x7fd6ac077fe0 con 0x7fd6bc0a0750 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.012+0000 7fd6c1815640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd68c03dd10 0x7fd68c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.012+0000 7fd6c1815640 10 monclient: get_auth_request con 0x7fd68c03dd10 auth_method 0 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6c0813640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 msgr2=0x7fd6bc1398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6c0813640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 0x7fd6bc1398f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000cba0 con 0x7fd6bc12e640 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 10 monclient: dump: 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd6b0019070 con 0x7fd6bc12e640 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:36.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 msgr2=0x7fd6bc1398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 0x7fd6bc1398f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b000ef40 comp rx=0 tx=0).stop 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 msgr2=0x7fd6bc1398f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6a9ffb640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc12e640 0x7fd6bc1398f0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b000ef40 comp rx=0 tx=0).stop 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.014+0000 7fd6c1815640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd68c03dd10 0x7fd68c0401d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc130700 tx=0x7fd6b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c329f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c329f640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 0x7fd6bc13a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c329f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc09dac0 con 0x7fd6bc139e30 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 0x7fd6bc13a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient: get_auth_request con 0x7fd6bc139e30 auth_method 0 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 10 monclient(hunting): handle_auth_done global_id 274137 payload 824 2026-02-17T12:07:36.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.017+0000 7fd6c0813640 1 -- 10.20.193.51:0/1583374488 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6bc12fe00 con 0x7fd6bc139e30 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6c0813640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 msgr2=0x7fd6bc13a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6c0813640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 0x7fd6bc13a210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0014680 con 0x7fd6bc139e30 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.019+0000 7fd6a9ffb640 10 monclient: dump: 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4543 (secure 0 0 0) 0x7fd6b0014680 con 0x7fd6bc139e30 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 msgr2=0x7fd6bc13a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 0x7fd6bc13a210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b0004a40 comp rx=0 tx=0).stop 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 msgr2=0x7fd6bc13a210 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6a9ffb640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd6bc139e30 0x7fd6bc13a210 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ea70 tx=0x7fd6b0004a40 comp rx=0 tx=0).stop 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 27376, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:36.040 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.041 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.042 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:36.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.045 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.046 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:36.047 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:36.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd68c03dd10 msgr2=0x7fd68c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd68c03dd10 0x7fd68c0401d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc130700 tx=0x7fd6b8009040 comp rx=0 tx=0).stop 2026-02-17T12:07:36.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 10 monclient: shutdown 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 msgr2=0x7fd6bc1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 --2- 10.20.193.51:0/1583374488 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd6bc0a0750 0x7fd6bc1381c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0099d0 tx=0x7fd6ac0047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c1815640 1 -- 10.20.193.51:0/1583374488 reap_dead start 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c1815640 1 -- 10.20.193.51:0/1583374488 reap_dead start 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 shutdown_connections 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 >> 10.20.193.51:0/1583374488 conn(0x7fd6bc0a30c0 msgr2=0x7fd6bc13ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 shutdown_connections 2026-02-17T12:07:36.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.020+0000 7fd6c329f640 1 -- 10.20.193.51:0/1583374488 wait complete. 2026-02-17T12:07:36.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:36.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:07:36.048 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:07:36.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.114+0000 7fe18eee1640 10 monclient: get_monmap_and_config 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.114+0000 7fe18eee1640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.114+0000 7fe18eee1640 10 monclient: monmap: 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:36.115907+0000 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:36.115907+0000 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:36.117 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:36.118 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 Processor -- start 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 -- start start 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient: init 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 0x7fe18809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-a con 0x7fe1880a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 0x7fe18809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-b con 0x7fe1880a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe18809e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18806e140 con 0x7fe18809e540 2026-02-17T12:07:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fe1880a3f90 con 0x7fe1880a3bb0 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe18809f910 con 0x7fe1880a0750 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18eee1640 10 monclient(hunting): authenticate will time out at 1943.734734s 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 0x7fe18809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 0x7fe18809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:34166/0 (socket says 10.20.193.51:34166) 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 1 -- 10.20.193.51:0/3549691071 learned_addr learned my addr 10.20.193.51:0/3549691071 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 10 monclient(hunting): get_auth_request con 0x7fe1880a3bb0 auth_method 0 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe18cc56640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 1 --2- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 0x7fe18809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): get_auth_request con 0x7fe1880a0750 auth_method 0 2026-02-17T12:07:36.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.115+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 10 monclient(hunting): handle_auth_done global_id 234503 payload 274 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 1 -- 10.20.193.51:0/3549691071 >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 msgr2=0x7fe18809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 1 --2- 10.20.193.51:0/3549691071 >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 0x7fe18809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 1 -- 10.20.193.51:0/3549691071 >> v1:10.20.193.51:6789/0 conn(0x7fe18809e540 legacy=0x7fe18813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 1 monclient: found mon.noname-b 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.116+0000 7fe17ffff640 1 -- 10.20.193.51:0/3549691071 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18809ccd0 con 0x7fe1880a0750 2026-02-17T12:07:36.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17ffff640 1 -- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 msgr2=0x7fe18809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17ffff640 1 --2- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 0x7fe18809e000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe18806c1c0 tx=0x7fe17002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e97272a10d5c5a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 1 -- 10.20.193.51:0/3549691071 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17003c070 con 0x7fe1880a0750 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: dump: 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.126 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 1 -- 10.20.193.51:0/3549691071 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17002fbd0 con 0x7fe1880a0750 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe18eee1640 5 monclient: authenticate success, global_id 234503 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe18eee1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 1 -- 10.20.193.51:0/3549691071 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170037440 con 0x7fe1880a0750 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe18eee1640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe18eee1640 4 set_mon_vals no callback set 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.118+0000 7fe17f7fe640 10 monclient: dump: 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.127 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: shutdown 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 msgr2=0x7fe18809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 --2- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 0x7fe18809e000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe18806c1c0 tx=0x7fe17002ed50 comp rx=0 tx=0).stop 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- 10.20.193.51:0/3549691071 shutdown_connections 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 --2- 10.20.193.51:0/3549691071 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1880a0750 0x7fe18809e000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 --2- 10.20.193.51:0/3549691071 >> v2:10.20.193.51:3300/0 conn(0x7fe1880a3bb0 0x7fe18809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- 10.20.193.51:0/3549691071 >> 10.20.193.51:0/3549691071 conn(0x7fe1880a30c0 msgr2=0x7fe1880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- 10.20.193.51:0/3549691071 shutdown_connections 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- 10.20.193.51:0/3549691071 wait complete. 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: monmap: 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:36.129 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 Processor -- start 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 -- start start 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: init 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 0x7fe18812bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-c con 0x7fe18809e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.119+0000 7fe18eee1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 0x7fe18812c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-a con 0x7fe1880a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1880a3bb0 0x7fe18812c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): picked mon.noname-b con 0x7fe1880a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880a04b0 con 0x7fe1880a0750 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe18809c850 con 0x7fe1880a3bb0 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe18813de80 con 0x7fe18809e540 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18eee1640 10 monclient(hunting): authenticate will time out at 1943.739028s 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 0x7fe18812bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 0x7fe18812bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40046/0 (socket says 10.20.193.51:40046) 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 1 -- 10.20.193.51:0/705499285 learned_addr learned my addr 10.20.193.51:0/705499285 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 0x7fe18812c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): get_auth_request con 0x7fe18809e540 auth_method 0 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): get_auth_request con 0x7fe1880a0750 auth_method 0 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient(hunting): handle_auth_done global_id 274143 payload 824 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 msgr2=0x7fe18812bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 0x7fe18812bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1880a3bb0 msgr2=0x7fe18812c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1880a3bb0 0x7fe18812c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 monclient: found mon.noname-a 2026-02-17T12:07:36.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:36.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe17ffff640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18812d560 con 0x7fe1880a0750 2026-02-17T12:07:36.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.120+0000 7fe18cc56640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18809e540 0x7fe18812bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17ffff640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 msgr2=0x7fe18812c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17ffff640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 0x7fe18812c050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe170036000 tx=0x7fe1700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17003c040 con 0x7fe1880a0750 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: dump: 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.137 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 5 monclient: authenticate success, global_id 274143 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe170037e50 con 0x7fe1880a0750 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 10 monclient: _renew_subs 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18812efb0 con 0x7fe1880a0750 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170040840 con 0x7fe1880a0750 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17effd640 4 set_mon_vals no callback set 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe17d7fa640 10 monclient: dump: 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 10 monclient: _renew_subs 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.122+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18806f8d0 con 0x7fe1880a0750 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18eee1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18eee1640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 0x7fe1881cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe18812e0c0 con 0x7fe18812f1f0 2026-02-17T12:07:36.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 0x7fe1881cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient: get_auth_request con 0x7fe18812f1f0 auth_method 0 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe17003f030 con 0x7fe1880a0750 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 10 monclient(hunting): handle_auth_done global_id 234509 payload 824 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18cc56640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe18806f410 con 0x7fe18812f1f0 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe17d7fa640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe15803dd10 0x7fe1580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(816..816 src has 323..816) ==== 4799+0+0 (secure 0 0 0) 0x7fe170077400 con 0x7fe1880a0750 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18d457640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe15803dd10 0x7fe1580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.123+0000 7fe18d457640 10 monclient: get_auth_request con 0x7fe15803dd10 auth_method 0 2026-02-17T12:07:36.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe18cc56640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 msgr2=0x7fe1881cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe18cc56640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 0x7fe1881cd1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe178003ce0 tx=0x7fe178010620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178018070 con 0x7fe18812f1f0 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 10 monclient: dump: 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.143 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fe178014640 con 0x7fe18812f1f0 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 msgr2=0x7fe1881cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 0x7fe1881cd1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe178003ce0 tx=0x7fe178010620 comp rx=0 tx=0).stop 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 msgr2=0x7fe1881cd1a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.125+0000 7fe17d7fa640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe18812f1f0 0x7fe1881cd1a0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe178003ce0 tx=0x7fe178010620 comp rx=0 tx=0).stop 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.126+0000 7fe18d457640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe15803dd10 0x7fe1580401d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe184004980 tx=0x7fe184003fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18eee1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18eee1640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 0x7fe1881d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18eee1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe18809dac0 con 0x7fe1881cd6e0 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 0x7fe1881d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient: get_auth_request con 0x7fe1881cd6e0 auth_method 0 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 10 monclient(hunting): handle_auth_done global_id 234512 payload 824 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.128+0000 7fe18cc56640 1 -- 10.20.193.51:0/705499285 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe1880008d0 con 0x7fe1881cd6e0 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18cc56640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 msgr2=0x7fe1881d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18cc56640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 0x7fe1881d84f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe178004750 tx=0x7fe178004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17801dd70 con 0x7fe1881cd6e0 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 10 monclient: dump: 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.146 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fe1780133d0 con 0x7fe1881cd6e0 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 msgr2=0x7fe1881d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 0x7fe1881d84f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe178004750 tx=0x7fe178004830 comp rx=0 tx=0).stop 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 msgr2=0x7fe1881d84f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe17d7fa640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe1881cd6e0 0x7fe1881d84f0 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe178004750 tx=0x7fe178004830 comp rx=0 tx=0).stop 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 233126, 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:36.148 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.149 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:36.150 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:36.151 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:36.152 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.153 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:36.155 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:36.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.157 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:36.158 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe15803dd10 msgr2=0x7fe1580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe15803dd10 0x7fe1580401d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe184004980 tx=0x7fe184003fc0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 10 monclient: shutdown 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 msgr2=0x7fe18812c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 --2- 10.20.193.51:0/705499285 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1880a0750 0x7fe18812c050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe170036000 tx=0x7fe1700047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18d457640 1 -- 10.20.193.51:0/705499285 reap_dead start 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18d457640 1 -- 10.20.193.51:0/705499285 reap_dead start 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 shutdown_connections 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 >> 10.20.193.51:0/705499285 conn(0x7fe1880a30c0 msgr2=0x7fe1880a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 shutdown_connections 2026-02-17T12:07:36.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.131+0000 7fe18eee1640 1 -- 10.20.193.51:0/705499285 wait complete. 2026-02-17T12:07:36.159 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:36.159 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:07:36.160 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:07:36.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.225+0000 7fa264e15640 10 monclient: get_monmap_and_config 2026-02-17T12:07:36.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.225+0000 7fa264e15640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.225+0000 7fa264e15640 10 monclient: monmap: 2026-02-17T12:07:36.227 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:36.226592+0000 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:36.226592+0000 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:36.228 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 Processor -- start 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 -- start start 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient: init 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa2600a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa2600a0750 0x7fa26009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-c con 0x7fa2600a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-b con 0x7fa26013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26006e140 con 0x7fa2600a3bb0 2026-02-17T12:07:36.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa26009f910 con 0x7fa2600a0750 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa26009ccd0 con 0x7fa26013b760 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa264e15640 10 monclient(hunting): authenticate will time out at 1943.845396s 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40068/0 (socket says 10.20.193.51:40068) 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 -- 10.20.193.51:0/977011615 learned_addr learned my addr 10.20.193.51:0/977011615 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): get_auth_request con 0x7fa26013b760 auth_method 0 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25dd74640 1 --2- 10.20.193.51:0/977011615 >> v2:10.20.193.142:3300/0 conn(0x7fa2600a0750 0x7fa26009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25dd74640 10 monclient(hunting): get_auth_request con 0x7fa2600a0750 auth_method 0 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient(hunting): handle_auth_done global_id 234515 payload 274 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 -- 10.20.193.51:0/977011615 >> v2:10.20.193.142:3300/0 conn(0x7fa2600a0750 msgr2=0x7fa26009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 --2- 10.20.193.51:0/977011615 >> v2:10.20.193.142:3300/0 conn(0x7fa2600a0750 0x7fa26009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 -- 10.20.193.51:0/977011615 >> v1:10.20.193.142:6789/0 conn(0x7fa2600a3bb0 legacy=0x7fa26009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 monclient: found mon.noname-b 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.226+0000 7fa25ed76640 1 -- 10.20.193.51:0/977011615 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26009eec0 con 0x7fa26013b760 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25ed76640 1 -- 10.20.193.51:0/977011615 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 msgr2=0x7fa26013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25ed76640 1 --2- 10.20.193.51:0/977011615 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa26006f3c0 tx=0x7fa25002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0011d47727a185 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 1 -- 10.20.193.51:0/977011615 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25002fe60 con 0x7fa26013b760 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: dump: 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 5 monclient: authenticate success, global_id 234515 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 1 -- 10.20.193.51:0/977011615 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2500373f0 con 0x7fa26013b760 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:36.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 1 -- 10.20.193.51:0/977011615 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500377c0 con 0x7fa26013b760 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 4 set_mon_vals no callback set 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa25d573640 10 monclient: dump: 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.240 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 10 monclient: shutdown 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 -- 10.20.193.51:0/977011615 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 msgr2=0x7fa26013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 --2- 10.20.193.51:0/977011615 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa26006f3c0 tx=0x7fa25002f230 comp rx=0 tx=0).stop 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 -- 10.20.193.51:0/977011615 shutdown_connections 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 --2- 10.20.193.51:0/977011615 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa26013db50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 --2- 10.20.193.51:0/977011615 >> v2:10.20.193.142:3300/0 conn(0x7fa2600a0750 0x7fa26009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 -- 10.20.193.51:0/977011615 >> 10.20.193.51:0/977011615 conn(0x7fa2600a30c0 msgr2=0x7fa2600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 -- 10.20.193.51:0/977011615 shutdown_connections 2026-02-17T12:07:36.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.229+0000 7fa264e15640 1 -- 10.20.193.51:0/977011615 wait complete. 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient: build_initial_monmap 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient: monmap: 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 Processor -- start 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 -- start start 2026-02-17T12:07:36.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient: init 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600a0750 0x7fa2600950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-b con 0x7fa2600a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa2600a3bb0 0x7fa260095620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-a con 0x7fa2600a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): picked mon.noname-c con 0x7fa26013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600a04b0 con 0x7fa2600a3bb0 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa26009c850 con 0x7fa2600a0750 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa26009e710 con 0x7fa26013b760 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa264e15640 10 monclient(hunting): authenticate will time out at 1943.849758s 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa2600a3bb0 0x7fa260095620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:40078/0 (socket says 10.20.193.51:40078) 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 learned_addr learned my addr 10.20.193.51:0/251637382 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): get_auth_request con 0x7fa26013b760 auth_method 0 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): get_auth_request con 0x7fa2600a3bb0 auth_method 0 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient(hunting): handle_auth_done global_id 234518 payload 824 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600a0750 msgr2=0x7fa2600950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600a0750 0x7fa2600950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa2600a3bb0 msgr2=0x7fa260095620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa2600a3bb0 0x7fa260095620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 monclient: found mon.noname-c 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa260098b20 con 0x7fa26013b760 2026-02-17T12:07:36.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.230+0000 7fa25dd74640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa2600a3bb0 0x7fa260095620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:36.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 msgr2=0x7fa260095b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25ed76640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f50 tx=0x7fa250004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250046020 con 0x7fa26013b760 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: dump: 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250041870 con 0x7fa26013b760 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 5 monclient: authenticate success, global_id 234518 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 monclient: _renew_subs 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa260098e00 con 0x7fa26013b760 2026-02-17T12:07:36.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250041c60 con 0x7fa26013b760 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 10 monclient: dump: 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25cd72640 4 set_mon_vals no callback set 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 monclient: _renew_subs 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:07:36.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26009d7b0 con 0x7fa26013b760 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 0x7fa26008d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa26009dac0 con 0x7fa2600960a0 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 0x7fa26008d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient: get_auth_request con 0x7fa2600960a0 auth_method 0 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa250042400 con 0x7fa26013b760 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.233+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa25e575640 10 monclient(hunting): handle_auth_done global_id 264163 payload 824 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa25e575640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa260097670 con 0x7fa2600960a0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa246ffd640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa22c03dd10 0x7fa22c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(816..816 src has 323..816) ==== 4799+0+0 (secure 0 0 0) 0x7fa250078560 con 0x7fa26013b760 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa25dd74640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa22c03dd10 0x7fa22c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.234+0000 7fa25dd74640 10 monclient: get_auth_request con 0x7fa22c03dd10 auth_method 0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa25e575640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 msgr2=0x7fa26008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa25e575640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 0x7fa26008d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa25400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254011a80 con 0x7fa2600960a0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:36.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 10 monclient: dump: 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fa254017070 con 0x7fa2600960a0 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 msgr2=0x7fa26008d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 0x7fa26008d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa25400c860 comp rx=0 tx=0).stop 2026-02-17T12:07:36.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 msgr2=0x7fa26008d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa246ffd640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa2600960a0 0x7fa26008d3f0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa25400c860 comp rx=0 tx=0).stop 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.236+0000 7fa25dd74640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa22c03dd10 0x7fa22c0401d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa2600740c0 tx=0x7fa248008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.239+0000 7fa264e15640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.239+0000 7fa264e15640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 0x7fa26008dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.239+0000 7fa264e15640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.239+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600008d0 con 0x7fa26008d930 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 0x7fa26008dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient: get_auth_request con 0x7fa26008d930 auth_method 0 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 10 monclient(hunting): handle_auth_done global_id 264166 payload 824 2026-02-17T12:07:36.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.240+0000 7fa25e575640 1 -- 10.20.193.51:0/251637382 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa260050ac0 con 0x7fa26008d930 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa25e575640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 msgr2=0x7fa26008dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa25e575640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 0x7fa26008dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa254003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25401caf0 con 0x7fa26008d930 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa246ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa246ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.242+0000 7fa246ffd640 10 monclient: dump: 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:36.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7fa25401caf0 con 0x7fa26008d930 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 msgr2=0x7fa26008dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 0x7fa26008dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa254003860 comp rx=0 tx=0).stop 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 msgr2=0x7fa26008dd40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa246ffd640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa26008d930 0x7fa26008dd40 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c390 tx=0x7fa254003860 comp rx=0 tx=0).stop 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 208, 2026-02-17T12:07:36.261 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 76234, 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:36.262 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.263 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:36.264 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:36.265 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.266 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.267 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:36.268 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.269 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:36.270 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:36.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa22c03dd10 msgr2=0x7fa22c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa22c03dd10 0x7fa22c0401d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa2600740c0 tx=0x7fa248008040 comp rx=0 tx=0).stop 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 10 monclient: shutdown 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 msgr2=0x7fa260095b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f50 tx=0x7fa250004b40 comp rx=0 tx=0).stop 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa25ed76640 1 -- 10.20.193.51:0/251637382 reap_dead start 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 shutdown_connections 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 --2- 10.20.193.51:0/251637382 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa26013b760 0x7fa260095b60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 >> 10.20.193.51:0/251637382 conn(0x7fa2600a30c0 msgr2=0x7fa26013ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 shutdown_connections 2026-02-17T12:07:36.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:36.243+0000 7fa264e15640 1 -- 10.20.193.51:0/251637382 wait complete. 2026-02-17T12:07:36.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:36.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T12:07:36.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-17T12:07:36.272 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T12:07:36.273 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:07:36.273 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:07:36.273 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:36.283 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:07:36.283 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:07:36.283 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:07:36.283 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:07:51.284 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:07:51.285 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:07:51.285 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:07:51.285 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:07:51.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: get_monmap_and_config 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: build_initial_monmap 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: monmap: 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:51.354064+0000 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:51.354064+0000 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:51.358 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 Processor -- start 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 -- start start 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: init 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:51.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): picked mon.noname-b con 0x7f61840a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f618409d270 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): picked mon.noname-a con 0x7f6184138780 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6184135430 con 0x7f618409d270 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f618409a5c0 con 0x7f6184138780 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f618409b520 con 0x7f61840a3bb0 2026-02-17T12:07:51.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:51.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f618b604640 10 monclient(hunting): authenticate will time out at 1958.972852s 2026-02-17T12:07:51.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6188b78640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f618409d270 0x7f6184138070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:53718/0 (socket says 10.20.193.51:53718) 2026-02-17T12:07:51.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189379640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 learned_addr learned my addr 10.20.193.51:0/818196110 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:51.361 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189379640 10 monclient(hunting): get_auth_request con 0x7f61840a3bb0 auth_method 0 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189379640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189379640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.353+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 10 monclient(hunting): get_auth_request con 0x7f6184138780 auth_method 0 2026-02-17T12:07:51.362 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.363 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.354+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:51.364 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.356+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.51:6789/0 conn(0x7f618409d270 legacy=0x7f6184138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:51.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 10 monclient(hunting): get_auth_request con 0x7f61840a3bb0 auth_method 0 2026-02-17T12:07:51.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 10 monclient(hunting): get_auth_request con 0x7f6184138780 auth_method 0 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:51.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:07:51.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.555+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 10 monclient(hunting): get_auth_request con 0x7f61840a3bb0 auth_method 0 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:51.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 10 monclient(hunting): get_auth_request con 0x7f6184138780 auth_method 0 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:51.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:51.956+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 10 monclient(hunting): get_auth_request con 0x7f61840a3bb0 auth_method 0 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 10 monclient(hunting): get_auth_request con 0x7f6184138780 auth_method 0 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:52.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:52.756+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): tick 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 monclient(hunting): continuing hunt 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 msgr2=0x7f618409cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:54.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61840a3bb0 0x7f618409cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 msgr2=0x7f61841403b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.51:3300/0 conn(0x7f6184138780 0x7f61841403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.51:6789/0 conn(0x7f618409d270 legacy=0x7f6184138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient: _add_conns ranks=[1,4] 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6168003820 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f6168007550 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618409af60 con 0x7f6168003820 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f618409a5c0 con 0x7f6168007550 2026-02-17T12:07:54.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6172ffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:54.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 msgr2=0x7f6168009a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:54.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:54.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.353+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168003820 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:54.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.554+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 msgr2=0x7f6168009a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:54.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.554+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:07:54.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.554+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168003820 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.955+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168003820 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.955+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 msgr2=0x7f6168009a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:54.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:54.955+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:07:55.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:55.756+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168003820 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:55.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:55.756+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 msgr2=0x7f6168009a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:55.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:55.756+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:07:57.293 INFO:tasks.rados.rados.0.trial142.stdout:3541: done (2 left) 2026-02-17T12:07:57.293 INFO:tasks.rados.rados.0.trial142.stdout:3542: done (1 left) 2026-02-17T12:07:57.293 INFO:tasks.rados.rados.0.trial142.stdout:3543: done (0 left) 2026-02-17T12:07:57.293 INFO:tasks.rados.rados.0.trial142.stdout:3544: write (excl) oid 27 current snap is 398 2026-02-17T12:07:57.293 INFO:tasks.rados.rados.0.trial142.stdout:3544: seq_num 1210 ranges {736470=751417,2022859=313611} 2026-02-17T12:07:57.299 INFO:tasks.rados.rados.0.trial142.stdout:3544: writing trial14245205-27 from 736470 to 1487887 tid 1 2026-02-17T12:07:57.302 INFO:tasks.rados.rados.0.trial142.stdout:3544: writing trial14245205-27 from 2022859 to 2336470 tid 2 2026-02-17T12:07:57.303 INFO:tasks.rados.rados.0.trial142.stdout:3545: delete oid 19 current snap is 398 2026-02-17T12:07:57.305 INFO:tasks.rados.rados.0.trial142.stdout:3545: done (1 left) 2026-02-17T12:07:57.305 INFO:tasks.rados.rados.0.trial142.stdout:3546: snap_create 2026-02-17T12:07:57.306 INFO:tasks.rados.rados.0.trial142.stdout:3544: finishing write tid 1 to trial14245205-27 2026-02-17T12:07:57.306 INFO:tasks.rados.rados.0.trial142.stdout:3544: finishing write tid 2 to trial14245205-27 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: finishing write tid 3 to trial14245205-27 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: finishing write tid 4 to trial14245205-27 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: oid 27 updating version 0 to 3096 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: oid 27 updating version 3096 to 3097 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: oid 27 version 3097 is already newer than 3095 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 3097 (ObjNum 1210 snap 398 seq_num 1210) dirty exists 2026-02-17T12:07:57.307 INFO:tasks.rados.rados.0.trial142.stdout:3544: left oid 27 (ObjNum 1210 snap 398 seq_num 1210) 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): tick 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 monclient(hunting): continuing hunt 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 msgr2=0x7f6168009a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007550 0x7f6168009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168003820 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 reap_dead start 2026-02-17T12:07:57.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6168006450 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6168009ab0 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007030 0x7f616800e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f6168007030 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616800b1a0 con 0x7f6168006450 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618409af60 con 0x7f6168009ab0 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 1 -- 10.20.193.51:0/818196110 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f618409a5c0 con 0x7f6168007030 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6172ffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6188b78640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168009ab0 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:57.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007030 msgr2=0x7f616800e610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.354+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007030 0x7f616800e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.51:6789/0 conn(0x7f6168006450 legacy=0x7f6168006830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719706800 0 0) 0x7f616800b1a0 con 0x7f6168006450 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): _negotiate 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): my global_id is 274149 2026-02-17T12:07:57.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f616c003620 con 0x7f6168006450 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 369637870 0 0) 0x7f616c003620 con 0x7f6168006450 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007030 msgr2=0x7f616800e610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 --2- 10.20.193.51:0/818196110 >> v2:10.20.193.142:3300/0 conn(0x7f6168007030 0x7f616800e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.142:6789/0 conn(0x7f6168009ab0 legacy=0x7f6168005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6168010de0 con 0x7f6168006450 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f617400f040 con 0x7f6168006450 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: dump: 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.373 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 >> v1:10.20.193.51:6789/0 conn(0x7f6168006450 legacy=0x7f6168006830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 0x7f616c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): picked mon.a con 0x7f616c003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f616c004900 0x7f616c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): picked mon.c con 0x7f616c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:57.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c0053e0 0x7f616c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): picked mon.b con 0x7f616c0053e0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f618409a5c0 con 0x7f616c003ab0 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f616c00c330 con 0x7f616c0053e0 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f616c00c530 con 0x7f616c004900 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6173fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 0x7f616c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f616c004900 0x7f616c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.375 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): get_auth_request con 0x7f616c003ab0 auth_method 0 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c0053e0 msgr2=0x7f616c00bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189b7a640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c0053e0 0x7f616c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): get_auth_request con 0x7f616c004900 auth_method 0 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.376 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient(hunting): handle_auth_done global_id 274149 payload 293 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f616c004900 msgr2=0x7f616c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f616c004900 0x7f616c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c0053e0 msgr2=0x7f616c00bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c0053e0 0x7f616c00bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 monclient: found mon.a 2026-02-17T12:07:57.377 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189b7a640 1 -- 10.20.193.51:0/818196110 reap_dead start 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c003620 con 0x7f616c003ab0 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6189379640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f618b604640 5 monclient: authenticate success, global_id 274149 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f6188b78640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f616c004900 0x7f616c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.356+0000 7f618b604640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6189379640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 msgr2=0x7f616c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6189379640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 0x7f616c003eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f617400cae0 tx=0x7f6174030210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac427c39d0d27c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.378 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174036070 con 0x7f616c003ab0 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: dump: 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6174030c50 con 0x7f616c003ab0 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 1 -- 10.20.193.51:0/818196110 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174004040 con 0x7f616c003ab0 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f6173fff640 10 monclient: dump: 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.380 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 4 set_mon_vals no callback set 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 10 monclient: shutdown 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 1 -- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 msgr2=0x7f616c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.359+0000 7f618b604640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 0x7f616c003eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f617400cae0 tx=0x7f6174030210 comp rx=0 tx=0).stop 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 -- 10.20.193.51:0/818196110 shutdown_connections 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 --2- 10.20.193.51:0/818196110 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f616c003ab0 0x7f616c003eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 -- 10.20.193.51:0/818196110 >> 10.20.193.51:0/818196110 conn(0x7f61840a30c0 msgr2=0x7f61840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 -- 10.20.193.51:0/818196110 shutdown_connections 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 -- 10.20.193.51:0/818196110 wait complete. 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 10 monclient: build_initial_monmap 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 10 monclient: monmap: 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:57.382 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 Processor -- start 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 1 -- start start 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.360+0000 7f618b604640 10 monclient: init 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 0x7f61841cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): picked mon.noname-b con 0x7f616c003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:57.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): picked mon.noname-a con 0x7f61841cc360 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61841cf320 0x7f61841cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): picked mon.noname-c con 0x7f61841cf320 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f6184074ac0 con 0x7f61841cc360 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f61840a3f90 con 0x7f616c003ab0 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f6184135040 con 0x7f61841cf320 2026-02-17T12:07:57.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f618b604640 10 monclient(hunting): authenticate will time out at 1964.980201s 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189379640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 msgr2=0x7f61841cbe20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189379640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 0x7f61841cbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35128/0 (socket says 10.20.193.51:35128) 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 -- 10.20.193.51:0/2251544014 learned_addr learned my addr 10.20.193.51:0/2251544014 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61841cf320 0x7f61841cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): get_auth_request con 0x7f61841cc360 auth_method 0 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): get_auth_request con 0x7f61841cf320 auth_method 0 2026-02-17T12:07:57.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6189b7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient(hunting): handle_auth_done global_id 274152 payload 824 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 -- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61841cf320 msgr2=0x7f61841cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61841cf320 0x7f61841cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 -- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 msgr2=0x7f61841cbe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 0x7f61841cbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 monclient: found mon.noname-a 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.361+0000 7f6188b78640 1 -- 10.20.193.51:0/2251544014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840a11c0 con 0x7f61841cc360 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6188b78640 1 -- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 msgr2=0x7f61841cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6188b78640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6178002d40 tx=0x7f6178007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178003260 con 0x7f61841cc360 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: dump: 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.387 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178018070 con 0x7f61841cc360 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 5 monclient: authenticate success, global_id 274152 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 10 monclient: _renew_subs 2026-02-17T12:07:57.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618412c8b0 con 0x7f61841cc360 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617800fd80 con 0x7f61841cc360 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f61737fe640 4 set_mon_vals no callback set 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f6171ffb640 10 monclient: dump: 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.389 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 10 monclient: _renew_subs 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.363+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618409d7b0 con 0x7f61841cc360 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f617801d460 con 0x7f61841cc360 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f6171ffb640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 0x7f6154040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f618b604640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f618b604640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f618b604640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(818..818 src has 323..818) ==== 4799+0+0 (secure 0 0 0) 0x7f61780523e0 con 0x7f61841cc360 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6184138c10 con 0x7f61841cc360 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f6189379640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 0x7f6154040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.364+0000 7f6189379640 10 monclient: get_auth_request con 0x7f615403dcc0 auth_method 0 2026-02-17T12:07:57.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.367+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f61840a11c0 con 0x7f61841cc360 2026-02-17T12:07:57.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.367+0000 7f6171ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.367+0000 7f6171ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:57.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.367+0000 7f6189379640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 0x7f6154040180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6174038000 tx=0x7f6174010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f618b604640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:07:57.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f618b604640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:57.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f618b604640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61841c2980 con 0x7f61841cc360 2026-02-17T12:07:57.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f6171ffb640 1 -- 10.20.193.51:0/2251544014 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f617801bc60 con 0x7f61841cc360 2026-02-17T12:07:57.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f6171ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:57.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.485+0000 7f6171ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:57.488 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":212,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:07:57.489 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 msgr2=0x7f6154040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 0x7f6154040180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6174038000 tx=0x7f6174010040 comp rx=0 tx=0).stop 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 10 monclient: shutdown 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 msgr2=0x7f61841cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6178002d40 tx=0x7f6178007660 comp rx=0 tx=0).stop 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 shutdown_connections 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f615403dcc0 0x7f6154040180 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f61841cf320 0x7f61841cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f61841cc360 0x7f61841cc7e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.490 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 --2- 10.20.193.51:0/2251544014 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f616c003ab0 0x7f61841cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 >> 10.20.193.51:0/2251544014 conn(0x7f61840a30c0 msgr2=0x7f618409bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 shutdown_connections 2026-02-17T12:07:57.491 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.486+0000 7f618b604640 1 -- 10.20.193.51:0/2251544014 wait complete. 2026-02-17T12:07:57.496 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:07:57.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:07:57.496 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:07:57.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 10 monclient: get_monmap_and_config 2026-02-17T12:07:57.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 10 monclient: build_initial_monmap 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 10 monclient: monmap: 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:57.563300+0000 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:57.563300+0000 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:57.567 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 1 Processor -- start 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 1 -- start start 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 10 monclient: init 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.562+0000 7f33a4e0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f33a00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f33a00a0750 0x7f33a009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-a con 0x7f33a00a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:57.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f33a013b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a006e140 con 0x7f33a013b760 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a009f910 con 0x7f33a00a3bb0 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f33a009ccd0 con 0x7f33a00a0750 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f33a4e0c640 10 monclient(hunting): authenticate will time out at 1965.182102s 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339e575640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f33a00a3bb0 legacy=0x7f33a009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f33a00a0750 0x7f33a009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339ed76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f33a013b760 0x7f33a013db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49426/0 (socket says 10.20.193.51:49426) 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339ed76640 1 -- 10.20.193.51:0/1191904068 learned_addr learned my addr 10.20.193.51:0/1191904068 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): get_auth_request con 0x7f33a00a0750 auth_method 0 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient(hunting): handle_auth_done global_id 274155 payload 274 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 1 -- 10.20.193.51:0/1191904068 >> v1:10.20.193.142:6789/0 conn(0x7f33a00a3bb0 legacy=0x7f33a009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 1 -- 10.20.193.51:0/1191904068 >> v1:10.20.193.51:6789/0 conn(0x7f33a013b760 legacy=0x7f33a013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 1 monclient: found mon.noname-a 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.563+0000 7f339dd74640 1 -- 10.20.193.51:0/1191904068 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a009eec0 con 0x7f33a00a0750 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339dd74640 1 -- 10.20.193.51:0/1191904068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a0750 msgr2=0x7f33a009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339dd74640 1 --2- 10.20.193.51:0/1191904068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a0750 0x7f33a009e1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f33880098a0 tx=0x7f338802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e286a689e2283abd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339d573640 1 -- 10.20.193.51:0/1191904068 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338803c070 con 0x7f33a00a0750 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:57.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.565+0000 7f339d573640 10 monclient: dump: 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 1 -- 10.20.193.51:0/1191904068 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338802fce0 con 0x7f33a00a0750 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 5 monclient: authenticate success, global_id 274155 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 1 -- 10.20.193.51:0/1191904068 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388037660 con 0x7f33a00a0750 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f339d573640 10 monclient: dump: 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.581 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.582 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 4 set_mon_vals no callback set 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 10 monclient: shutdown 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1191904068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a0750 msgr2=0x7f33a009e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1191904068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a0750 0x7f33a009e1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f33880098a0 tx=0x7f338802ed80 comp rx=0 tx=0).stop 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1191904068 shutdown_connections 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1191904068 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a0750 0x7f33a009e1d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1191904068 >> 10.20.193.51:0/1191904068 conn(0x7f33a00a30c0 msgr2=0x7f33a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1191904068 shutdown_connections 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1191904068 wait complete. 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 10 monclient: build_initial_monmap 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.566+0000 7f33a4e0c640 10 monclient: monmap: 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:57.584 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 Processor -- start 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 -- start start 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient: init 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33a00a0750 0x7f33a01cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-c con 0x7f33a00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 0x7f33a01d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-a con 0x7f33a00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:57.585 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33a013b760 0x7f33a009a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): picked mon.noname-b con 0x7f33a013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00a04b0 con 0x7f33a00a3bb0 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33a009c850 con 0x7f33a013b760 2026-02-17T12:07:57.586 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f33a009e710 con 0x7f33a00a0750 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f33a4e0c640 10 monclient(hunting): authenticate will time out at 1965.186522s 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 0x7f33a01d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 0x7f33a01d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35144/0 (socket says 10.20.193.51:35144) 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 -- 10.20.193.51:0/1606825194 learned_addr learned my addr 10.20.193.51:0/1606825194 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): get_auth_request con 0x7f33a00a3bb0 auth_method 0 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.587 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33a00a0750 0x7f33a01cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339ed76640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33a013b760 msgr2=0x7f33a009a5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): get_auth_request con 0x7f33a00a0750 auth_method 0 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339ed76640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33a013b760 0x7f33a009a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.588 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient(hunting): handle_auth_done global_id 274158 payload 824 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33a00a0750 msgr2=0x7f33a01cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33a00a0750 0x7f33a01cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33a013b760 msgr2=0x7f33a009a5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33a013b760 0x7f33a009a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 monclient: found mon.noname-a 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.567+0000 7f339dd74640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a0095dd0 con 0x7f33a00a3bb0 2026-02-17T12:07:57.589 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.569+0000 7f339dd74640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 msgr2=0x7f33a01d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.569+0000 7f339dd74640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 0x7f33a01d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33880098a0 tx=0x7f33880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388046070 con 0x7f33a00a3bb0 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: dump: 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.590 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3388041870 con 0x7f33a00a3bb0 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338803c040 con 0x7f33a00a3bb0 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 5 monclient: authenticate success, global_id 274158 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 monclient: _renew_subs 2026-02-17T12:07:57.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339cd72640 4 set_mon_vals no callback set 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a0095200 con 0x7f33a00a3bb0 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 10 monclient: dump: 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.592 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 monclient: _renew_subs 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a009d7b0 con 0x7f33a00a3bb0 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 0x7f33a009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f33a009dac0 con 0x7f33a00959e0 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 0x7f33a009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient: get_auth_request con 0x7f33a00959e0 auth_method 0 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3388041c60 con 0x7f33a00a3bb0 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 10 monclient(hunting): handle_auth_done global_id 274161 payload 824 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f339e575640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33a009c290 con 0x7f33a00959e0 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.570+0000 7f3386ffd640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f336c03dd10 0x7f336c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.571+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(818..818 src has 323..818) ==== 4799+0+0 (secure 0 0 0) 0x7f3388077e60 con 0x7f33a00a3bb0 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.571+0000 7f339ed76640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f336c03dd10 0x7f336c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.571+0000 7f339ed76640 10 monclient: get_auth_request con 0x7f336c03dd10 auth_method 0 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f339e575640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 msgr2=0x7f33a009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f339e575640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 0x7f33a009ab30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3394003a30 tx=0x7f3394005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394016070 con 0x7f33a00959e0 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 10 monclient: dump: 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f339400eb60 con 0x7f33a00959e0 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 msgr2=0x7f33a009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 0x7f33a009ab30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3394003a30 tx=0x7f3394005a60 comp rx=0 tx=0).stop 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 msgr2=0x7f33a009ab30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f3386ffd640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00959e0 0x7f33a009ab30 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3394003a30 tx=0x7f3394005a60 comp rx=0 tx=0).stop 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.573+0000 7f339ed76640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f336c03dd10 0x7f336c0401d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f33a006dab0 tx=0x7f3390005170 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f33a4e0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 0x7f33a01daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f33a4e0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00008d0 con 0x7f33a009b070 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 0x7f33a01daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient: get_auth_request con 0x7f33a009b070 auth_method 0 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 10 monclient(hunting): handle_auth_done global_id 274164 payload 824 2026-02-17T12:07:57.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.576+0000 7f339e575640 1 -- 10.20.193.51:0/1606825194 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f33a0050ac0 con 0x7f33a009b070 2026-02-17T12:07:57.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f339e575640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 msgr2=0x7f33a01daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f339e575640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 0x7f33a01daad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3394005aa0 tx=0x7f3394005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394016040 con 0x7f33a009b070 2026-02-17T12:07:57.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 10 monclient: dump: 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4699 (secure 0 0 0) 0x7f339401b450 con 0x7f33a009b070 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:57.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 msgr2=0x7f33a01daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 0x7f33a01daad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3394005aa0 tx=0x7f3394005ad0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 msgr2=0x7f33a01daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.578+0000 7f3386ffd640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a009b070 0x7f33a01daad0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3394005aa0 tx=0x7f3394005ad0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:57.601 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 212, 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 48936, 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.602 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:57.603 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:57.604 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:57.605 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:57.606 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.607 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.608 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.609 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.610 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.611 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:57.612 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f336c03dd10 msgr2=0x7f336c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f336c03dd10 0x7f336c0401d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f33a006dab0 tx=0x7f3390005170 comp rx=0 tx=0).stop 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 10 monclient: shutdown 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 msgr2=0x7f33a01d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 --2- 10.20.193.51:0/1606825194 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33a00a3bb0 0x7f33a01d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33880098a0 tx=0x7f33880047c0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f339ed76640 1 -- 10.20.193.51:0/1606825194 reap_dead start 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f339ed76640 1 -- 10.20.193.51:0/1606825194 reap_dead start 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 shutdown_connections 2026-02-17T12:07:57.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 >> 10.20.193.51:0/1606825194 conn(0x7f33a00a30c0 msgr2=0x7f33a013adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 shutdown_connections 2026-02-17T12:07:57.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.579+0000 7f33a4e0c640 1 -- 10.20.193.51:0/1606825194 wait complete. 2026-02-17T12:07:57.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:07:57.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:07:57.614 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 10 monclient: get_monmap_and_config 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 10 monclient: build_initial_monmap 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 10 monclient: monmap: 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:07:57.681494+0000 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:07:57.681494+0000 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:07:57.682 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 1 Processor -- start 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 1 -- start start 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.680+0000 7fb9d098f640 10 monclient: init 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 0x7fb9c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-c con 0x7fb9c80a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9c80a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb9c813b760 0x7fb9c813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-a con 0x7fb9c813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c806e140 con 0x7fb9c80a0750 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c809f910 con 0x7fb9c813b760 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c809ccd0 con 0x7fb9c80a3bb0 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9d098f640 10 monclient(hunting): authenticate will time out at 1965.300237s 2026-02-17T12:07:57.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9ce704640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 msgr2=0x7fb9c809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9ce704640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 0x7fb9c809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cdf03640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fb9c80a0750 legacy=0x7fb9c809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb9c813b760 0x7fb9c813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fb9c813b760 0x7fb9c813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35162/0 (socket says 10.20.193.51:35162) 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 -- 10.20.193.51:0/2187513738 learned_addr learned my addr 10.20.193.51:0/2187513738 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): get_auth_request con 0x7fb9c813b760 auth_method 0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient(hunting): handle_auth_done global_id 274167 payload 274 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 -- 10.20.193.51:0/2187513738 >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 msgr2=0x7fb9c809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 --2- 10.20.193.51:0/2187513738 >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 0x7fb9c809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 -- 10.20.193.51:0/2187513738 >> v1:10.20.193.142:6789/0 conn(0x7fb9c80a0750 legacy=0x7fb9c809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 monclient: found mon.noname-a 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.681+0000 7fb9cef05640 1 -- 10.20.193.51:0/2187513738 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c809eec0 con 0x7fb9c813b760 2026-02-17T12:07:57.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cef05640 1 -- 10.20.193.51:0/2187513738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 msgr2=0x7fb9c813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cef05640 1 --2- 10.20.193.51:0/2187513738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c813db50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9c806c1c0 tx=0x7fb9bc02f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429a53eeb990995b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 1 -- 10.20.193.51:0/2187513738 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0373f0 con 0x7fb9c813b760 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: dump: 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 1 -- 10.20.193.51:0/2187513738 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc037590 con 0x7fb9c813b760 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 5 monclient: authenticate success, global_id 274167 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 1 -- 10.20.193.51:0/2187513738 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc037960 con 0x7fb9c813b760 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9cd702640 10 monclient: dump: 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 4 set_mon_vals no callback set 2026-02-17T12:07:57.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 10 monclient: shutdown 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 -- 10.20.193.51:0/2187513738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 msgr2=0x7fb9c813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 --2- 10.20.193.51:0/2187513738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c813db50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9c806c1c0 tx=0x7fb9bc02f200 comp rx=0 tx=0).stop 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 -- 10.20.193.51:0/2187513738 shutdown_connections 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 --2- 10.20.193.51:0/2187513738 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c813db50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 --2- 10.20.193.51:0/2187513738 >> v2:10.20.193.142:3300/0 conn(0x7fb9c80a3bb0 0x7fb9c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 -- 10.20.193.51:0/2187513738 >> 10.20.193.51:0/2187513738 conn(0x7fb9c80a30c0 msgr2=0x7fb9c80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 -- 10.20.193.51:0/2187513738 shutdown_connections 2026-02-17T12:07:57.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 1 -- 10.20.193.51:0/2187513738 wait complete. 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 10 monclient: build_initial_monmap 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.684+0000 7fb9d098f640 10 monclient: monmap: 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 Processor -- start 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 -- start start 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient: init 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9c80a0750 0x7fb9c813a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-b con 0x7fb9c80a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80a3bb0 0x7fb9c813af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-c con 0x7fb9c80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c8092960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): picked mon.noname-a con 0x7fb9c813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80a04b0 con 0x7fb9c813b760 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c809c850 con 0x7fb9c80a0750 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c809e710 con 0x7fb9c80a3bb0 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9d098f640 10 monclient(hunting): authenticate will time out at 1965.304564s 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9ce704640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9c80a0750 msgr2=0x7fb9c813a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9ce704640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9c80a0750 0x7fb9c813a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c8092960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c8092960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35174/0 (socket says 10.20.193.51:35174) 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 learned_addr learned my addr 10.20.193.51:0/540088449 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): get_auth_request con 0x7fb9c813b760 auth_method 0 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80a3bb0 0x7fb9c813af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): get_auth_request con 0x7fb9c80a3bb0 auth_method 0 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cdf03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient(hunting): handle_auth_done global_id 274170 payload 824 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80a3bb0 msgr2=0x7fb9c813af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80a3bb0 0x7fb9c813af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9c80a0750 msgr2=0x7fb9c813a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb9c80a0750 0x7fb9c813a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient: _finish_hunting 0 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 monclient: found mon.noname-a 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.685+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c80994a0 con 0x7fb9c813b760 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.687+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 msgr2=0x7fb9c8092960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.687+0000 7fb9cef05640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c8092960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc039040 tx=0x7fb9bc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.687+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc046020 con 0x7fb9c813b760 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: dump: 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc041870 con 0x7fb9c813b760 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc041c60 con 0x7fb9c813b760 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 5 monclient: authenticate success, global_id 274170 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 monclient: _renew_subs 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ccf01640 4 set_mon_vals no callback set 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c8094e40 con 0x7fb9c813b760 2026-02-17T12:07:57.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 10 monclient: dump: 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 monclient: _renew_subs 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c80a2cd0 con 0x7fb9c813b760 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 0x7fb9c80638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c80968a0 con 0x7fb9c80961f0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 0x7fb9c80638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient: get_auth_request con 0x7fb9c80961f0 auth_method 0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb9bc042400 con 0x7fb9c813b760 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 10 monclient(hunting): handle_auth_done global_id 234530 payload 824 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9ce704640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9c809d7b0 con 0x7fb9c80961f0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb99803dcc0 0x7fb998040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.688+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(818..818 src has 323..818) ==== 4799+0+0 (secure 0 0 0) 0x7fb9bc078530 con 0x7fb9c813b760 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.689+0000 7fb9cdf03640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb99803dcc0 0x7fb998040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.689+0000 7fb9cdf03640 10 monclient: get_auth_request con 0x7fb99803dcc0 auth_method 0 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.690+0000 7fb9ce704640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 msgr2=0x7fb9c80638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.690+0000 7fb9ce704640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 0x7fb9c80638c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005070 con 0x7fb9c80961f0 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 10 monclient: dump: 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb9c0005070 con 0x7fb9c80961f0 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 msgr2=0x7fb9c80638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 0x7fb9c80638c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c000bcf0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 msgr2=0x7fb9c80638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9b2ffd640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c80961f0 0x7fb9c80638c0 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c000bcf0 comp rx=0 tx=0).stop 2026-02-17T12:07:57.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.691+0000 7fb9cdf03640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb99803dcc0 0x7fb998040180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009470 tx=0x7fb9b4009400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9d098f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9d098f640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 0x7fb9c81d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9d098f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c809dac0 con 0x7fb9c8063e00 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 0x7fb9c81d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient: get_auth_request con 0x7fb9c8063e00 auth_method 0 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 10 monclient(hunting): handle_auth_done global_id 234533 payload 824 2026-02-17T12:07:57.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.694+0000 7fb9ce704640 1 -- 10.20.193.51:0/540088449 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9c80965d0 con 0x7fb9c8063e00 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9ce704640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 msgr2=0x7fb9c81d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9ce704640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 0x7fb9c81d88a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c0005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005220 con 0x7fb9c8063e00 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.696+0000 7fb9b2ffd640 10 monclient: dump: 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7fb9c0005220 con 0x7fb9c8063e00 2026-02-17T12:07:57.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 msgr2=0x7fb9c81d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 0x7fb9c81d88a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c0005b20 comp rx=0 tx=0).stop 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 msgr2=0x7fb9c81d88a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9b2ffd640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb9c8063e00 0x7fb9c81d88a0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bcc0 tx=0x7fb9c0005b20 comp rx=0 tx=0).stop 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 212, 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 254692, 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.699 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:07:57.700 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.701 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:07:57.702 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb99803dcc0 msgr2=0x7fb998040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb99803dcc0 0x7fb998040180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009470 tx=0x7fb9b4009400 comp rx=0 tx=0).stop 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 10 monclient: shutdown 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 msgr2=0x7fb9c8092960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 --2- 10.20.193.51:0/540088449 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb9c813b760 0x7fb9c8092960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc039040 tx=0x7fb9bc004b40 comp rx=0 tx=0).stop 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 reap_dead start 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9cef05640 1 -- 10.20.193.51:0/540088449 reap_dead start 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 shutdown_connections 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 >> 10.20.193.51:0/540088449 conn(0x7fb9c80a30c0 msgr2=0x7fb9c80a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 shutdown_connections 2026-02-17T12:07:57.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:07:57.697+0000 7fb9d098f640 1 -- 10.20.193.51:0/540088449 wait complete. 2026-02-17T12:07:57.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:07:57.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:07:58.298 INFO:tasks.rados.rados.0.trial142.stdout:3544: done (1 left) 2026-02-17T12:07:58.299 INFO:tasks.rados.rados.0.trial142.stdout:3546: done (0 left) 2026-02-17T12:07:58.299 INFO:tasks.rados.rados.0.trial142.stdout:3547: copy_from oid 29 from oid 33 current snap is 399 2026-02-17T12:07:58.299 INFO:tasks.rados.rados.0.trial142.stdout:3548: write (excl) oid 15 current snap is 399 2026-02-17T12:07:58.299 INFO:tasks.rados.rados.0.trial142.stdout:3548: seq_num 1212 ranges {770084=501915,2023470=346614} 2026-02-17T12:07:58.304 INFO:tasks.rados.rados.0.trial142.stdout:3548: writing trial14245205-15 from 770084 to 1271999 tid 1 2026-02-17T12:07:58.308 INFO:tasks.rados.rados.0.trial142.stdout:3548: writing trial14245205-15 from 2023470 to 2370084 tid 2 2026-02-17T12:07:58.308 INFO:tasks.rados.rados.0.trial142.stdout:3549: write (excl) oid 9 current snap is 399 2026-02-17T12:07:58.308 INFO:tasks.rados.rados.0.trial142.stdout:3549: seq_num 1213 ranges {786891=577164,2081952=304939} 2026-02-17T12:07:58.313 INFO:tasks.rados.rados.0.trial142.stdout:3549: writing trial14245205-9 from 786891 to 1364055 tid 1 2026-02-17T12:07:58.318 INFO:tasks.rados.rados.0.trial142.stdout:3549: writing trial14245205-9 from 2081952 to 2386891 tid 2 2026-02-17T12:07:58.318 INFO:tasks.rados.rados.0.trial142.stdout:3550: read oid 18 snap -1 2026-02-17T12:07:58.318 INFO:tasks.rados.rados.0.trial142.stdout:3550: expect (ObjNum 1115 snap 361 seq_num 1115) 2026-02-17T12:07:58.318 INFO:tasks.rados.rados.0.trial142.stdout:3551: snap_remove snap 379 2026-02-17T12:07:59.301 INFO:tasks.rados.rados.0.trial142.stdout:3551: done (4 left) 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3552: rollback oid 20 current snap is 399 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 375 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3547: finishing copy_from racing read to trial14245205-29 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3547: finishing copy_from to trial14245205-29 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 3088 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: finishing write tid 1 to trial14245205-15 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: finishing write tid 2 to trial14245205-15 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: finishing write tid 3 to trial14245205-15 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: finishing write tid 4 to trial14245205-15 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: oid 15 updating version 0 to 3099 2026-02-17T12:07:59.302 INFO:tasks.rados.rados.0.trial142.stdout:3548: oid 15 version 3099 is already newer than 3098 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3548: oid 15 updating version 3099 to 3100 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3100 (ObjNum 1212 snap 399 seq_num 1212) dirty exists 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3548: left oid 15 (ObjNum 1212 snap 399 seq_num 1212) 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3549: finishing write tid 1 to trial14245205-9 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3547: done (4 left) 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3548: done (3 left) 2026-02-17T12:07:59.303 INFO:tasks.rados.rados.0.trial142.stdout:3553: snap_remove snap 393 2026-02-17T12:08:00.302 INFO:tasks.rados.rados.0.trial142.stdout:3553: done (3 left) 2026-02-17T12:08:00.302 INFO:tasks.rados.rados.0.trial142.stdout:3554: snap_create 2026-02-17T12:08:00.302 INFO:tasks.rados.rados.0.trial142.stdout:3549: finishing write tid 2 to trial14245205-9 2026-02-17T12:08:00.302 INFO:tasks.rados.rados.0.trial142.stdout:3550: expect (ObjNum 1115 snap 361 seq_num 1115) 2026-02-17T12:08:00.391 INFO:tasks.rados.rados.0.trial142.stdout:3549: finishing write tid 3 to trial14245205-9 2026-02-17T12:08:00.391 INFO:tasks.rados.rados.0.trial142.stdout:3549: finishing write tid 4 to trial14245205-9 2026-02-17T12:08:00.391 INFO:tasks.rados.rados.0.trial142.stdout:3549: oid 9 updating version 0 to 3450 2026-02-17T12:08:00.391 INFO:tasks.rados.rados.0.trial142.stdout:3549: oid 9 version 3450 is already newer than 3448 2026-02-17T12:08:00.391 INFO:tasks.rados.rados.0.trial142.stdout:3549: oid 9 version 3450 is already newer than 3449 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3450 (ObjNum 1213 snap 399 seq_num 1213) dirty exists 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:3549: left oid 9 (ObjNum 1213 snap 399 seq_num 1213) 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:3552: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:3552: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:3552: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:08:00.392 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 2747 (ObjNum 960 snap 310 seq_num 960) dirty exists 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3549: done (3 left) 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3550: done (2 left) 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3552: done (1 left) 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3554: done (0 left) 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3555: copy_from oid 32 from oid 29 current snap is 400 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3556: read oid 11 snap -1 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3556: expect (ObjNum 1177 snap 381 seq_num 1177) 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3557: rollback oid 18 current snap is 400 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 18 to 399 2026-02-17T12:08:01.289 INFO:tasks.rados.rados.0.trial142.stdout:3558: snap_create 2026-02-17T12:08:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3557: finishing rollback tid 0 to trial14245205-18 2026-02-17T12:08:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3557: finishing rollback tid 1 to trial14245205-18 2026-02-17T12:08:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3557: finishing rollback tid 2 to trial14245205-18 2026-02-17T12:08:01.294 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 3468 (ObjNum 1115 snap 361 seq_num 1115) dirty exists 2026-02-17T12:08:01.297 INFO:tasks.rados.rados.0.trial142.stdout:3556: expect (ObjNum 1177 snap 381 seq_num 1177) 2026-02-17T12:08:01.424 INFO:tasks.rados.rados.0.trial142.stdout:3555: finishing copy_from racing read to trial14245205-32 2026-02-17T12:08:01.425 INFO:tasks.rados.rados.0.trial142.stdout:3555: finishing copy_from to trial14245205-32 2026-02-17T12:08:01.425 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 3088 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:08:02.292 INFO:tasks.rados.rados.0.trial142.stdout:3555: done (3 left) 2026-02-17T12:08:02.292 INFO:tasks.rados.rados.0.trial142.stdout:3556: done (2 left) 2026-02-17T12:08:02.292 INFO:tasks.rados.rados.0.trial142.stdout:3557: done (1 left) 2026-02-17T12:08:02.292 INFO:tasks.rados.rados.0.trial142.stdout:3558: done (0 left) 2026-02-17T12:08:02.292 INFO:tasks.rados.rados.0.trial142.stdout:3559: snap_create 2026-02-17T12:08:03.292 INFO:tasks.rados.rados.0.trial142.stdout:3559: done (0 left) 2026-02-17T12:08:03.292 INFO:tasks.rados.rados.0.trial142.stdout:3560: snap_create 2026-02-17T12:08:04.296 INFO:tasks.rados.rados.0.trial142.stdout:3560: done (0 left) 2026-02-17T12:08:04.296 INFO:tasks.rados.rados.0.trial142.stdout:3561: read oid 16 snap 396 2026-02-17T12:08:04.296 INFO:tasks.rados.rados.0.trial142.stdout:3561: expect deleted 2026-02-17T12:08:04.296 INFO:tasks.rados.rados.0.trial142.stdout:3562: snap_create 2026-02-17T12:08:05.297 INFO:tasks.rados.rados.0.trial142.stdout:3561: done (1 left) 2026-02-17T12:08:05.297 INFO:tasks.rados.rados.0.trial142.stdout:3562: done (0 left) 2026-02-17T12:08:05.297 INFO:tasks.rados.rados.0.trial142.stdout:3563: read oid 28 snap -1 2026-02-17T12:08:05.298 INFO:tasks.rados.rados.0.trial142.stdout:3563: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:08:05.298 INFO:tasks.rados.rados.0.trial142.stdout:3564: snap_create 2026-02-17T12:08:05.300 INFO:tasks.rados.rados.0.trial142.stdout:3563: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3563: done (1 left) 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3564: done (0 left) 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3565: read oid 31 snap -1 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3565: expect deleted 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3566: read oid 12 snap -1 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3566: expect deleted 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3567: copy_from oid 6 from oid 4 current snap is 405 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3568: read oid 13 snap -1 2026-02-17T12:08:06.290 INFO:tasks.rados.rados.0.trial142.stdout:3568: expect (ObjNum 1206 snap 391 seq_num 1206) 2026-02-17T12:08:06.291 INFO:tasks.rados.rados.0.trial142.stdout:3569: snap_remove snap 375 2026-02-17T12:08:07.292 INFO:tasks.rados.rados.0.trial142.stdout:3569: done (4 left) 2026-02-17T12:08:07.292 INFO:tasks.rados.rados.0.trial142.stdout:3570: write (excl) oid 16 current snap is 405 2026-02-17T12:08:07.292 INFO:tasks.rados.rados.0.trial142.stdout:3570: seq_num 1214 ranges {403698=652413,1740434=663264} 2026-02-17T12:08:07.296 INFO:tasks.rados.rados.0.trial142.stdout:3570: writing trial14245205-16 from 403698 to 1056111 tid 1 2026-02-17T12:08:07.302 INFO:tasks.rados.rados.0.trial142.stdout:3570: writing trial14245205-16 from 1740434 to 2403698 tid 2 2026-02-17T12:08:07.302 INFO:tasks.rados.rados.0.trial142.stdout:3571: read oid 29 snap -1 2026-02-17T12:08:07.302 INFO:tasks.rados.rados.0.trial142.stdout:3571: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:08:07.302 INFO:tasks.rados.rados.0.trial142.stdout:3572: write (excl) oid 5 current snap is 405 2026-02-17T12:08:07.302 INFO:tasks.rados.rados.0.trial142.stdout:3572: seq_num 1215 ranges {420505=727662,1798916=553091} 2026-02-17T12:08:07.306 INFO:tasks.rados.rados.0.trial142.stdout:3572: writing trial14245205-5 from 420505 to 1148167 tid 1 2026-02-17T12:08:07.311 INFO:tasks.rados.rados.0.trial142.stdout:3572: writing trial14245205-5 from 1798916 to 2352007 tid 2 2026-02-17T12:08:07.311 INFO:tasks.rados.rados.0.trial142.stdout:3573: rollback oid 17 current snap is 405 2026-02-17T12:08:07.311 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 17 to 398 2026-02-17T12:08:07.311 INFO:tasks.rados.rados.0.trial142.stdout:3568: expect (ObjNum 1206 snap 391 seq_num 1206) 2026-02-17T12:08:07.381 INFO:tasks.rados.rados.0.trial142.stdout:3567: finishing copy_from racing read to trial14245205-6 2026-02-17T12:08:07.381 INFO:tasks.rados.rados.0.trial142.stdout:3567: finishing copy_from to trial14245205-6 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3230 (ObjNum 1182 snap 383 seq_num 1182) dirty exists 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3565: done (7 left) 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3566: done (6 left) 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3567: done (5 left) 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3568: done (4 left) 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3574: write (excl) oid 26 current snap is 405 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3570: finishing write tid 1 to trial14245205-16 2026-02-17T12:08:07.382 INFO:tasks.rados.rados.0.trial142.stdout:3571: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:08:07.445 INFO:tasks.rados.rados.0.trial142.stdout:3570: finishing write tid 2 to trial14245205-16 2026-02-17T12:08:07.446 INFO:tasks.rados.rados.0.trial142.stdout:3574: seq_num 1216 ranges {437312=402911,1341045=696749} 2026-02-17T12:08:07.448 INFO:tasks.rados.rados.0.trial142.stdout:3574: writing trial14245205-26 from 437312 to 840223 tid 1 2026-02-17T12:08:07.453 INFO:tasks.rados.rados.0.trial142.stdout:3574: writing trial14245205-26 from 1341045 to 2037794 tid 2 2026-02-17T12:08:07.453 INFO:tasks.rados.rados.0.trial142.stdout:3571: done (4 left) 2026-02-17T12:08:07.453 INFO:tasks.rados.rados.0.trial142.stdout:3575: write (excl) oid 13 current snap is 405 2026-02-17T12:08:07.454 INFO:tasks.rados.rados.0.trial142.stdout:3575: seq_num 1217 ranges {454119=594513,1515880=556760} 2026-02-17T12:08:07.457 INFO:tasks.rados.rados.0.trial142.stdout:3575: writing trial14245205-13 from 454119 to 1048632 tid 1 2026-02-17T12:08:07.461 INFO:tasks.rados.rados.0.trial142.stdout:3575: writing trial14245205-13 from 1515880 to 2072640 tid 2 2026-02-17T12:08:07.461 INFO:tasks.rados.rados.0.trial142.stdout:3576: snap_remove snap 404 2026-02-17T12:08:08.303 INFO:tasks.rados.rados.0.trial142.stdout:3576: done (5 left) 2026-02-17T12:08:08.303 INFO:tasks.rados.rados.0.trial142.stdout:3577: write (excl) oid 25 current snap is 405 2026-02-17T12:08:08.303 INFO:tasks.rados.rados.0.trial142.stdout:3577: seq_num 1218 ranges {470926=669762,1574362=700418} 2026-02-17T12:08:08.307 INFO:tasks.rados.rados.0.trial142.stdout:3577: writing trial14245205-25 from 470926 to 1140688 tid 1 2026-02-17T12:08:08.312 INFO:tasks.rados.rados.0.trial142.stdout:3577: writing trial14245205-25 from 1574362 to 2274780 tid 2 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3578: rollback oid 36 current snap is 405 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 396 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: finishing write tid 3 to trial14245205-16 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: finishing write tid 4 to trial14245205-16 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: oid 16 updating version 0 to 2555 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: oid 16 updating version 2555 to 2557 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: oid 16 version 2557 is already newer than 2556 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 2557 (ObjNum 1214 snap 405 seq_num 1214) dirty exists 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3570: left oid 16 (ObjNum 1214 snap 405 seq_num 1214) 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3572: finishing write tid 1 to trial14245205-5 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3572: finishing write tid 2 to trial14245205-5 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3572: finishing write tid 3 to trial14245205-5 2026-02-17T12:08:08.313 INFO:tasks.rados.rados.0.trial142.stdout:3572: finishing write tid 4 to trial14245205-5 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3572: oid 5 updating version 0 to 2559 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3572: oid 5 updating version 2559 to 2560 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3572: oid 5 version 2560 is already newer than 2558 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2560 (ObjNum 1215 snap 405 seq_num 1215) dirty exists 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3572: left oid 5 (ObjNum 1215 snap 405 seq_num 1215) 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3573: finishing rollback tid 0 to trial14245205-17 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3570: done (6 left) 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3572: done (5 left) 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3579: read oid 6 snap -1 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3579: expect (ObjNum 1182 snap 383 seq_num 1182) 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3580: delete oid 7 current snap is 405 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3573: finishing rollback tid 1 to trial14245205-17 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:3573: finishing rollback tid 2 to trial14245205-17 2026-02-17T12:08:08.314 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2563 (ObjNum 1174 snap 380 seq_num 1174) dirty exists 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: finishing write tid 1 to trial14245205-26 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: finishing write tid 2 to trial14245205-26 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: finishing write tid 3 to trial14245205-26 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: finishing write tid 4 to trial14245205-26 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: oid 26 updating version 0 to 2754 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: oid 26 updating version 2754 to 2755 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: oid 26 version 2755 is already newer than 2753 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2755 (ObjNum 1216 snap 405 seq_num 1216) dirty exists 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3574: left oid 26 (ObjNum 1216 snap 405 seq_num 1216) 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3575: finishing write tid 1 to trial14245205-13 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3575: finishing write tid 2 to trial14245205-13 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3575: finishing write tid 3 to trial14245205-13 2026-02-17T12:08:08.315 INFO:tasks.rados.rados.0.trial142.stdout:3575: finishing write tid 4 to trial14245205-13 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:3575: oid 13 updating version 0 to 3103 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:3575: oid 13 version 3103 is already newer than 3102 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:3575: oid 13 version 3103 is already newer than 3101 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 3103 (ObjNum 1217 snap 405 seq_num 1217) dirty exists 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:3575: left oid 13 (ObjNum 1217 snap 405 seq_num 1217) 2026-02-17T12:08:08.316 INFO:tasks.rados.rados.0.trial142.stdout:3577: finishing write tid 1 to trial14245205-25 2026-02-17T12:08:08.317 INFO:tasks.rados.rados.0.trial142.stdout:3578: finishing rollback tid 1 to trial14245205-36 2026-02-17T12:08:08.317 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 0 (ObjNum 81 snap 0 seq_num 1) dirty dne 2026-02-17T12:08:08.317 INFO:tasks.rados.rados.0.trial142.stdout:3577: finishing write tid 2 to trial14245205-25 2026-02-17T12:08:08.317 INFO:tasks.rados.rados.0.trial142.stdout:3577: finishing write tid 3 to trial14245205-25 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: finishing write tid 4 to trial14245205-25 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: oid 25 updating version 0 to 2758 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: oid 25 version 2758 is already newer than 2757 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: oid 25 version 2758 is already newer than 2756 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2758 (ObjNum 1218 snap 405 seq_num 1218) dirty exists 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: left oid 25 (ObjNum 1218 snap 405 seq_num 1218) 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3573: done (6 left) 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3574: done (5 left) 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3575: done (4 left) 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3577: done (3 left) 2026-02-17T12:08:08.318 INFO:tasks.rados.rados.0.trial142.stdout:3578: done (2 left) 2026-02-17T12:08:08.319 INFO:tasks.rados.rados.0.trial142.stdout:3580: done (1 left) 2026-02-17T12:08:08.319 INFO:tasks.rados.rados.0.trial142.stdout:3581: write oid 35 current snap is 405 2026-02-17T12:08:08.319 INFO:tasks.rados.rados.0.trial142.stdout:3581: seq_num 1220 ranges {504540=420260,1574973=704087} 2026-02-17T12:08:08.319 INFO:tasks.rados.rados.0.trial142.stdout:3581: writing trial14245205-35 from 504540 to 924800 tid 1 2026-02-17T12:08:08.323 INFO:tasks.rados.rados.0.trial142.stdout:3581: writing trial14245205-35 from 1574973 to 2279060 tid 2 2026-02-17T12:08:08.323 INFO:tasks.rados.rados.0.trial142.stdout:3582: delete oid 4 current snap is 405 2026-02-17T12:08:08.324 INFO:tasks.rados.rados.0.trial142.stdout:3579: expect (ObjNum 1182 snap 383 seq_num 1182) 2026-02-17T12:08:08.487 INFO:tasks.rados.rados.0.trial142.stdout:3581: finishing write tid 1 to trial14245205-35 2026-02-17T12:08:08.487 INFO:tasks.rados.rados.0.trial142.stdout:3581: finishing write tid 2 to trial14245205-35 2026-02-17T12:08:08.487 INFO:tasks.rados.rados.0.trial142.stdout:3581: finishing write tid 3 to trial14245205-35 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: finishing write tid 4 to trial14245205-35 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: oid 35 updating version 0 to 3105 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: oid 35 updating version 3105 to 3106 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: oid 35 version 3106 is already newer than 3104 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 3106 (ObjNum 1220 snap 405 seq_num 1220) dirty exists 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: left oid 35 (ObjNum 1220 snap 405 seq_num 1220) 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3579: done (2 left) 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3581: done (1 left) 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3582: done (0 left) 2026-02-17T12:08:08.488 INFO:tasks.rados.rados.0.trial142.stdout:3583: snap_remove snap 386 2026-02-17T12:08:09.895 INFO:tasks.rados.rados.0.trial142.stdout:3583: done (0 left) 2026-02-17T12:08:09.895 INFO:tasks.rados.rados.0.trial142.stdout:3584: rollback oid 15 current snap is 405 2026-02-17T12:08:09.895 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 395 2026-02-17T12:08:09.895 INFO:tasks.rados.rados.0.trial142.stdout:3585: snap_remove snap 398 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3585: done (1 left) 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3586: read oid 5 snap 403 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3586: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3587: read oid 23 snap 390 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3587: expect (ObjNum 1188 snap 386 seq_num 1188) 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3588: read oid 8 snap -1 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3588: expect (ObjNum 1170 snap 378 seq_num 1170) 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3589: read oid 30 snap 390 2026-02-17T12:08:10.897 INFO:tasks.rados.rados.0.trial142.stdout:3589: expect (ObjNum 1111 snap 361 seq_num 1111) 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3590: read oid 28 snap 389 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3590: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3591: snap_create 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3584: finishing rollback tid 0 to trial14245205-15 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3584: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:3584: finishing rollback tid 2 to trial14245205-15 2026-02-17T12:08:10.898 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3109 (ObjNum 1200 snap 389 seq_num 1200) dirty exists 2026-02-17T12:08:10.899 INFO:tasks.rados.rados.0.trial142.stdout:3590: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:08:11.086 INFO:tasks.rados.rados.0.trial142.stdout:3587: expect (ObjNum 1188 snap 386 seq_num 1188) 2026-02-17T12:08:11.211 INFO:tasks.rados.rados.0.trial142.stdout:3589: expect (ObjNum 1111 snap 361 seq_num 1111) 2026-02-17T12:08:11.335 INFO:tasks.rados.rados.0.trial142.stdout:3586: expect (ObjNum 1119 snap 365 seq_num 1119) 2026-02-17T12:08:11.399 INFO:tasks.rados.rados.0.trial142.stdout:3588: expect (ObjNum 1170 snap 378 seq_num 1170) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3584: done (6 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3586: done (5 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3587: done (4 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3588: done (3 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3589: done (2 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3590: done (1 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3591: done (0 left) 2026-02-17T12:08:11.486 INFO:tasks.rados.rados.0.trial142.stdout:3592: snap_remove snap 397 2026-02-17T12:08:12.296 INFO:tasks.rados.rados.0.trial142.stdout:3592: done (0 left) 2026-02-17T12:08:12.296 INFO:tasks.rados.rados.0.trial142.stdout:3593: write oid 49 current snap is 406 2026-02-17T12:08:12.296 INFO:tasks.rados.rados.0.trial142.stdout:3593: seq_num 1222 ranges {538154=570758,1691937=707756} 2026-02-17T12:08:12.300 INFO:tasks.rados.rados.0.trial142.stdout:3593: writing trial14245205-49 from 538154 to 1108912 tid 1 2026-02-17T12:08:12.305 INFO:tasks.rados.rados.0.trial142.stdout:3593: writing trial14245205-49 from 1691937 to 2399693 tid 2 2026-02-17T12:08:12.305 INFO:tasks.rados.rados.0.trial142.stdout:3594: delete oid 32 current snap is 406 2026-02-17T12:08:12.307 INFO:tasks.rados.rados.0.trial142.stdout:3594: done (1 left) 2026-02-17T12:08:12.307 INFO:tasks.rados.rados.0.trial142.stdout:3595: snap_remove snap 385 2026-02-17T12:08:13.297 INFO:tasks.rados.rados.0.trial142.stdout:3593: finishing write tid 1 to trial14245205-49 2026-02-17T12:08:13.297 INFO:tasks.rados.rados.0.trial142.stdout:3593: finishing write tid 2 to trial14245205-49 2026-02-17T12:08:13.297 INFO:tasks.rados.rados.0.trial142.stdout:3595: done (1 left) 2026-02-17T12:08:13.297 INFO:tasks.rados.rados.0.trial142.stdout:3596: snap_remove snap 401 2026-02-17T12:08:14.298 INFO:tasks.rados.rados.0.trial142.stdout:3596: done (1 left) 2026-02-17T12:08:14.298 INFO:tasks.rados.rados.0.trial142.stdout:3597: snap_remove snap 396 2026-02-17T12:08:15.302 INFO:tasks.rados.rados.0.trial142.stdout:3597: done (1 left) 2026-02-17T12:08:15.302 INFO:tasks.rados.rados.0.trial142.stdout:3598: write oid 14 current snap is 406 2026-02-17T12:08:15.302 INFO:tasks.rados.rados.0.trial142.stdout:3598: seq_num 1224 ranges {571768=437609,1808901=711425} 2026-02-17T12:08:15.306 INFO:tasks.rados.rados.0.trial142.stdout:3598: writing trial14245205-14 from 571768 to 1009377 tid 1 2026-02-17T12:08:15.313 INFO:tasks.rados.rados.0.trial142.stdout:3598: writing trial14245205-14 from 1808901 to 2520326 tid 2 2026-02-17T12:08:15.313 INFO:tasks.rados.rados.0.trial142.stdout:3599: write oid 38 current snap is 406 2026-02-17T12:08:15.313 INFO:tasks.rados.rados.0.trial142.stdout:3599: seq_num 1225 ranges {588575=512858,1867383=455083} 2026-02-17T12:08:15.317 INFO:tasks.rados.rados.0.trial142.stdout:3599: writing trial14245205-38 from 588575 to 1101433 tid 1 2026-02-17T12:08:15.322 INFO:tasks.rados.rados.0.trial142.stdout:3599: writing trial14245205-38 from 1867383 to 2322466 tid 2 2026-02-17T12:08:15.322 INFO:tasks.rados.rados.0.trial142.stdout:3600: write (excl) oid 3 current snap is 406 2026-02-17T12:08:15.322 INFO:tasks.rados.rados.0.trial142.stdout:3600: seq_num 1226 ranges {605382=588107,1925865=679517} 2026-02-17T12:08:15.326 INFO:tasks.rados.rados.0.trial142.stdout:3600: writing trial14245205-3 from 605382 to 1193489 tid 1 2026-02-17T12:08:15.331 INFO:tasks.rados.rados.0.trial142.stdout:3600: writing trial14245205-3 from 1925865 to 2605382 tid 2 2026-02-17T12:08:15.332 INFO:tasks.rados.rados.0.trial142.stdout:3601: write oid 42 current snap is 406 2026-02-17T12:08:15.332 INFO:tasks.rados.rados.0.trial142.stdout:3601: seq_num 1227 ranges {622189=663356,1984347=458752} 2026-02-17T12:08:15.336 INFO:tasks.rados.rados.0.trial142.stdout:3601: writing trial14245205-42 from 622189 to 1285545 tid 1 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3601: writing trial14245205-42 from 1984347 to 2443099 tid 2 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: finishing write tid 3 to trial14245205-49 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: finishing write tid 4 to trial14245205-49 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: oid 49 updating version 0 to 3515 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: oid 49 version 3515 is already newer than 3510 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: oid 49 updating version 3515 to 3516 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3516 (ObjNum 1222 snap 406 seq_num 1222) dirty exists 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3593: left oid 49 (ObjNum 1222 snap 406 seq_num 1222) 2026-02-17T12:08:15.342 INFO:tasks.rados.rados.0.trial142.stdout:3602: read oid 46 snap -1 2026-02-17T12:08:15.343 INFO:tasks.rados.rados.0.trial142.stdout:3602: expect (ObjNum 1199 snap 389 seq_num 1199) 2026-02-17T12:08:15.343 INFO:tasks.rados.rados.0.trial142.stdout:3593: done (5 left) 2026-02-17T12:08:15.343 INFO:tasks.rados.rados.0.trial142.stdout:3603: snap_remove snap 395 2026-02-17T12:08:16.293 INFO:tasks.rados.rados.0.trial142.stdout:3603: done (5 left) 2026-02-17T12:08:16.293 INFO:tasks.rados.rados.0.trial142.stdout:3604: rollback oid 43 current snap is 406 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 43 to 389 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: finishing write tid 1 to trial14245205-14 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: finishing write tid 2 to trial14245205-14 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: finishing write tid 3 to trial14245205-14 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: finishing write tid 4 to trial14245205-14 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: oid 14 updating version 0 to 3549 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: oid 14 version 3549 is already newer than 3540 2026-02-17T12:08:16.294 INFO:tasks.rados.rados.0.trial142.stdout:3598: oid 14 updating version 3549 to 3550 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3550 (ObjNum 1224 snap 406 seq_num 1224) dirty exists 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3598: left oid 14 (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: finishing write tid 1 to trial14245205-38 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: finishing write tid 2 to trial14245205-38 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: finishing write tid 3 to trial14245205-38 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: finishing write tid 4 to trial14245205-38 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: oid 38 updating version 0 to 2006 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: oid 38 version 2006 is already newer than 2004 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: oid 38 version 2006 is already newer than 2005 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 2006 (ObjNum 1225 snap 406 seq_num 1225) dirty exists 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3599: left oid 38 (ObjNum 1225 snap 406 seq_num 1225) 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3600: finishing write tid 1 to trial14245205-3 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3600: finishing write tid 2 to trial14245205-3 2026-02-17T12:08:16.295 INFO:tasks.rados.rados.0.trial142.stdout:3600: finishing write tid 3 to trial14245205-3 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: finishing write tid 4 to trial14245205-3 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: oid 3 updating version 0 to 2746 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: oid 3 updating version 2746 to 2747 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: oid 3 updating version 2747 to 2748 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2748 (ObjNum 1226 snap 406 seq_num 1226) dirty exists 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: left oid 3 (ObjNum 1226 snap 406 seq_num 1226) 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3601: finishing write tid 1 to trial14245205-42 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3598: done (5 left) 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3599: done (4 left) 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3600: done (3 left) 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3605: copy_from oid 38 from oid 27 current snap is 406 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3601: finishing write tid 2 to trial14245205-42 2026-02-17T12:08:16.296 INFO:tasks.rados.rados.0.trial142.stdout:3601: finishing write tid 3 to trial14245205-42 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3601: finishing write tid 4 to trial14245205-42 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3601: oid 42 updating version 0 to 3091 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3601: oid 42 version 3091 is already newer than 3090 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3601: oid 42 updating version 3091 to 3092 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 3092 (ObjNum 1227 snap 406 seq_num 1227) dirty exists 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3601: left oid 42 (ObjNum 1227 snap 406 seq_num 1227) 2026-02-17T12:08:16.297 INFO:tasks.rados.rados.0.trial142.stdout:3602: expect (ObjNum 1199 snap 389 seq_num 1199) 2026-02-17T12:08:16.373 INFO:tasks.rados.rados.0.trial142.stdout:3604: finishing rollback tid 0 to trial14245205-43 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3604: finishing rollback tid 1 to trial14245205-43 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3604: finishing rollback tid 2 to trial14245205-43 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 3554 (ObjNum 1028 snap 333 seq_num 1028) dirty exists 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3605: finishing copy_from racing read to trial14245205-38 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3605: finishing copy_from to trial14245205-38 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3097 (ObjNum 1210 snap 398 seq_num 1210) dirty exists 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3601: done (3 left) 2026-02-17T12:08:16.374 INFO:tasks.rados.rados.0.trial142.stdout:3602: done (2 left) 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3604: done (1 left) 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3605: done (0 left) 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3606: copy_from oid 41 from oid 28 current snap is 406 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3607: rollback oid 6 current snap is 406 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 405 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3608: copy_from oid 10 from oid 33 current snap is 406 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3609: write (excl) oid 47 current snap is 406 2026-02-17T12:08:16.375 INFO:tasks.rados.rados.0.trial142.stdout:3609: seq_num 1228 ranges {638996=738605,1926476=712520} 2026-02-17T12:08:16.378 INFO:tasks.rados.rados.0.trial142.stdout:3609: writing trial14245205-47 from 638996 to 1377601 tid 1 2026-02-17T12:08:16.383 INFO:tasks.rados.rados.0.trial142.stdout:3609: writing trial14245205-47 from 1926476 to 2638996 tid 2 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3610: copy_from oid 15 from oid 30 current snap is 406 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3607: finishing rollback tid 0 to trial14245205-6 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3607: finishing rollback tid 1 to trial14245205-6 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3607: finishing rollback tid 2 to trial14245205-6 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3364 (ObjNum 1182 snap 383 seq_num 1182) dirty exists 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3608: finishing copy_from racing read to trial14245205-10 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3606: finishing copy_from racing read to trial14245205-41 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3608: finishing copy_from to trial14245205-10 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 3088 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:08:16.384 INFO:tasks.rados.rados.0.trial142.stdout:3606: finishing copy_from to trial14245205-41 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2728 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3609: finishing write tid 1 to trial14245205-47 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3606: done (4 left) 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3607: done (3 left) 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3608: done (2 left) 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3611: copy_from oid 39 from oid 22 current snap is 406 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3612: rollback oid 34 current snap is 406 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 34 to 402 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3613: rollback oid 3 current snap is 406 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 3 to 380 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3614: write (excl) oid 32 current snap is 406 2026-02-17T12:08:16.385 INFO:tasks.rados.rados.0.trial142.stdout:3614: seq_num 1229 ranges {655803=413854,1584958=462421} 2026-02-17T12:08:16.387 INFO:tasks.rados.rados.0.trial142.stdout:3614: writing trial14245205-32 from 655803 to 1069657 tid 1 2026-02-17T12:08:16.392 INFO:tasks.rados.rados.0.trial142.stdout:3614: writing trial14245205-32 from 1584958 to 2047379 tid 2 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3615: read oid 14 snap -1 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3615: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3616: write oid 28 current snap is 406 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3613: finishing rollback tid 0 to trial14245205-3 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: finishing write tid 2 to trial14245205-47 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: finishing write tid 3 to trial14245205-47 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3613: finishing rollback tid 1 to trial14245205-3 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: finishing write tid 4 to trial14245205-47 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: oid 47 updating version 0 to 3090 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: oid 47 updating version 3090 to 3091 2026-02-17T12:08:16.393 INFO:tasks.rados.rados.0.trial142.stdout:3609: oid 47 version 3091 is already newer than 3089 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 3091 (ObjNum 1228 snap 406 seq_num 1228) dirty exists 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:3609: left oid 47 (ObjNum 1228 snap 406 seq_num 1228) 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:3613: finishing rollback tid 2 to trial14245205-3 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2751 (ObjNum 1168 snap 378 seq_num 1168) dirty exists 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:3612: finishing rollback tid 0 to trial14245205-34 2026-02-17T12:08:16.394 INFO:tasks.rados.rados.0.trial142.stdout:3616: seq_num 1230 ranges {672610=489103,1643440=722432} 2026-02-17T12:08:16.396 INFO:tasks.rados.rados.0.trial142.stdout:3616: writing trial14245205-28 from 672610 to 1161713 tid 1 2026-02-17T12:08:16.402 INFO:tasks.rados.rados.0.trial142.stdout:3616: writing trial14245205-28 from 1643440 to 2365872 tid 2 2026-02-17T12:08:16.402 INFO:tasks.rados.rados.0.trial142.stdout:3609: done (7 left) 2026-02-17T12:08:16.402 INFO:tasks.rados.rados.0.trial142.stdout:3613: done (6 left) 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3617: read oid 16 snap -1 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3617: expect (ObjNum 1214 snap 405 seq_num 1214) 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3618: write oid 44 current snap is 406 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3612: finishing rollback tid 1 to trial14245205-34 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3612: finishing rollback tid 2 to trial14245205-34 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 2562 (ObjNum 1124 snap 365 seq_num 1124) dirty exists 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3610: finishing copy_from racing read to trial14245205-15 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3614: finishing write tid 1 to trial14245205-32 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3611: finishing copy_from racing read to trial14245205-39 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3610: finishing copy_from to trial14245205-15 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 2739 (ObjNum 1111 snap 361 seq_num 1111) dirty exists 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:3611: finishing copy_from to trial14245205-39 2026-02-17T12:08:16.403 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2693 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: finishing write tid 2 to trial14245205-32 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: finishing write tid 3 to trial14245205-32 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: finishing write tid 4 to trial14245205-32 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: oid 32 updating version 0 to 3095 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: oid 32 version 3095 is already newer than 3093 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: oid 32 version 3095 is already newer than 3094 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 3095 (ObjNum 1229 snap 406 seq_num 1229) dirty exists 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3614: left oid 32 (ObjNum 1229 snap 406 seq_num 1229) 2026-02-17T12:08:16.404 INFO:tasks.rados.rados.0.trial142.stdout:3615: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:08:16.478 INFO:tasks.rados.rados.0.trial142.stdout:3616: finishing write tid 1 to trial14245205-28 2026-02-17T12:08:16.478 INFO:tasks.rados.rados.0.trial142.stdout:3616: finishing write tid 2 to trial14245205-28 2026-02-17T12:08:16.478 INFO:tasks.rados.rados.0.trial142.stdout:3616: finishing write tid 3 to trial14245205-28 2026-02-17T12:08:16.478 INFO:tasks.rados.rados.0.trial142.stdout:3618: seq_num 1231 ranges {689417=564352,1701922=466090} 2026-02-17T12:08:16.483 INFO:tasks.rados.rados.0.trial142.stdout:3618: writing trial14245205-44 from 689417 to 1253769 tid 1 2026-02-17T12:08:16.487 INFO:tasks.rados.rados.0.trial142.stdout:3618: writing trial14245205-44 from 1701922 to 2168012 tid 2 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3610: done (7 left) 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3611: done (6 left) 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3612: done (5 left) 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3614: done (4 left) 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3615: done (3 left) 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3619: write oid 3 current snap is 406 2026-02-17T12:08:16.488 INFO:tasks.rados.rados.0.trial142.stdout:3619: seq_num 1232 ranges {706224=755954,2160404=545820} 2026-02-17T12:08:16.493 INFO:tasks.rados.rados.0.trial142.stdout:3619: writing trial14245205-3 from 706224 to 1462178 tid 1 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3619: writing trial14245205-3 from 2160404 to 2706224 tid 2 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3620: write oid 4 current snap is 406 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3616: finishing write tid 4 to trial14245205-28 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3616: oid 28 updating version 0 to 2754 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3616: oid 28 version 2754 is already newer than 2753 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3616: oid 28 version 2754 is already newer than 2752 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2754 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3616: left oid 28 (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:08:16.498 INFO:tasks.rados.rados.0.trial142.stdout:3617: expect (ObjNum 1214 snap 405 seq_num 1214) 2026-02-17T12:08:16.552 INFO:tasks.rados.rados.0.trial142.stdout:3618: finishing write tid 1 to trial14245205-44 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: finishing write tid 2 to trial14245205-44 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: finishing write tid 3 to trial14245205-44 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: finishing write tid 4 to trial14245205-44 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: oid 44 updating version 0 to 3132 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: oid 44 updating version 3132 to 3134 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: oid 44 version 3134 is already newer than 3133 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3134 (ObjNum 1231 snap 406 seq_num 1231) dirty exists 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3618: left oid 44 (ObjNum 1231 snap 406 seq_num 1231) 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3619: finishing write tid 1 to trial14245205-3 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3619: finishing write tid 2 to trial14245205-3 2026-02-17T12:08:16.553 INFO:tasks.rados.rados.0.trial142.stdout:3619: finishing write tid 3 to trial14245205-3 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3619: finishing write tid 4 to trial14245205-3 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3619: oid 3 updating version 0 to 2755 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3619: oid 3 updating version 2755 to 2757 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3619: oid 3 version 2757 is already newer than 2756 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2757 (ObjNum 1232 snap 406 seq_num 1232) dirty exists 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3619: left oid 3 (ObjNum 1232 snap 406 seq_num 1232) 2026-02-17T12:08:16.554 INFO:tasks.rados.rados.0.trial142.stdout:3620: seq_num 1233 ranges {723031=431203,1818886=469759} 2026-02-17T12:08:16.557 INFO:tasks.rados.rados.0.trial142.stdout:3620: writing trial14245205-4 from 723031 to 1154234 tid 1 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3620: writing trial14245205-4 from 1818886 to 2288645 tid 2 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3616: done (4 left) 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3617: done (3 left) 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3618: done (2 left) 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3619: done (1 left) 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3621: read oid 31 snap -1 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3621: expect deleted 2026-02-17T12:08:16.562 INFO:tasks.rados.rados.0.trial142.stdout:3622: snap_remove snap 403 2026-02-17T12:08:17.305 INFO:tasks.rados.rados.0.trial142.stdout:3622: done (2 left) 2026-02-17T12:08:17.305 INFO:tasks.rados.rados.0.trial142.stdout:3623: snap_remove snap 362 2026-02-17T12:08:17.706 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:08:17.706 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T12:08:17.707 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:08:17.707 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:08:17.710 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:08:17.710 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:08:17.710 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:08:17.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:08:32.712 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:08:32.712 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:08:32.712 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:08:32.713 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:32.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: get_monmap_and_config 2026-02-17T12:08:32.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: build_initial_monmap 2026-02-17T12:08:32.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: monmap: 2026-02-17T12:08:32.785 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:32.782258+0000 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:32.782258+0000 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:32.786 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 1 Processor -- start 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 1 -- start start 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: init 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.781+0000 7fcb81549640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-c con 0x7fcb7c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-b con 0x7fcb7c0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcb7c09e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c06e140 con 0x7fcb7c09e540 2026-02-17T12:08:32.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0a3f90 con 0x7fcb7c0a3bb0 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c09f910 con 0x7fcb7c0a0750 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb81549640 10 monclient(hunting): authenticate will time out at 2000.401059s 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:58172/0 (socket says 10.20.193.51:58172) 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 learned_addr learned my addr 10.20.193.51:0/3606687020 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a0750 auth_method 0 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:32.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a3bb0 auth_method 0 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:32.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:32.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:32.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.782+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:32.790 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.784+0000 7fcb7b7fe640 1 -- 10.20.193.51:0/3606687020 >> v1:10.20.193.142:6789/0 conn(0x7fcb7c09e540 legacy=0x7fcb7c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:32.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:32.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a0750 auth_method 0 2026-02-17T12:08:32.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:32.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:32.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a3bb0 auth_method 0 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:32.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:32.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:32.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:32.983+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a0750 auth_method 0 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:33.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a3bb0 auth_method 0 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:33.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:33.384+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a0750 auth_method 0 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:34.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb7c0a3bb0 auth_method 0 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:34.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:34.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:34.185+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): tick 2026-02-17T12:08:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:08:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 monclient(hunting): continuing hunt 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 msgr2=0x7fcb7c09e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb7c0a0750 0x7fcb7c09e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 msgr2=0x7fcb7c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.142:3300/0 conn(0x7fcb7c0a3bb0 0x7fcb7c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 -- 10.20.193.51:0/3606687020 >> v1:10.20.193.142:6789/0 conn(0x7fcb7c09e540 legacy=0x7fcb7c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient: _add_conns ranks=[0,3] 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcb60003840 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): picked mon.noname-a con 0x7fcb60007550 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 -- 10.20.193.51:0/3606687020 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c09ccd0 con 0x7fcb60003840 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 1 -- 10.20.193.51:0/3606687020 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0a3f90 con 0x7fcb60007550 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb78ff9640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb60007550 auth_method 0 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.782+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.784+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> v1:10.20.193.51:6789/0 conn(0x7fcb60003840 legacy=0x7fcb60005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb60007550 auth_method 0 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:35.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:35.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:35.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:35.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:35.983+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:36.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:36.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb60007550 auth_method 0 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:36.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:36.384+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:37.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb60007550 auth_method 0 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:37.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.185+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193497403 0 0) 0x7fcb7c09ccd0 con 0x7fcb60003840 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 10 monclient(hunting): _negotiate 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 10 monclient(hunting): my global_id is 274173 2026-02-17T12:08:37.731 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.727+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb68003620 con 0x7fcb60003840 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386048249 0 0) 0x7fcb68003620 con 0x7fcb60003840 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 msgr2=0x7fcb60009a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 --2- 10.20.193.51:0/3606687020 >> v2:10.20.193.51:3300/0 conn(0x7fcb60007550 0x7fcb60009a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _finish_hunting 0 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6000b1a0 con 0x7fcb60003840 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _finish_auth 0 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fcb7000f040 con 0x7fcb60003840 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: dump: 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.732 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 >> v1:10.20.193.51:6789/0 conn(0x7fcb60003840 legacy=0x7fcb60005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 1 -- 10.20.193.51:0/3606687020 reap_dead start 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb68003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): picked mon.c con 0x7fcb68003ba0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68004900 0x7fcb68004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): picked mon.b con 0x7fcb68004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68005510 0x7fcb6800bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): picked mon.a con 0x7fcb68005510 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0a3f90 con 0x7fcb68005510 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6800c420 con 0x7fcb68004900 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6800c620 con 0x7fcb68003ba0 2026-02-17T12:08:37.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb79ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb68003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb68003ba0 auth_method 0 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68005510 0x7fcb6800bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): get_auth_request con 0x7fcb68005510 auth_method 0 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient(hunting): handle_auth_done global_id 274173 payload 293 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68004900 msgr2=0x7fcb68004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68004900 0x7fcb68004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68005510 msgr2=0x7fcb6800bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:37.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68005510 0x7fcb6800bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient: _finish_hunting 0 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 monclient: found mon.c 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb68003620 con 0x7fcb68003ba0 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient: _finish_auth 0 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb81549640 5 monclient: authenticate success, global_id 274173 2026-02-17T12:08:37.735 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.728+0000 7fcb81549640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3623: done (2 left) 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3624: snap_create 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: finishing write tid 1 to trial14245205-4 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: finishing write tid 2 to trial14245205-4 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: finishing write tid 3 to trial14245205-4 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: finishing write tid 4 to trial14245205-4 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: oid 4 updating version 0 to 3567 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: oid 4 version 3567 is already newer than 3565 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: oid 4 version 3567 is already newer than 3566 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3567 (ObjNum 1233 snap 406 seq_num 1233) dirty exists 2026-02-17T12:08:37.736 INFO:tasks.rados.rados.0.trial142.stdout:3620: left oid 4 (ObjNum 1233 snap 406 seq_num 1233) 2026-02-17T12:08:37.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb7affd640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb68003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb7affd640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb68003fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb70006fb0 tx=0x7fcb70030480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc605fb844fdcb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70036070 con 0x7fcb68003ba0 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: dump: 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7003a400 con 0x7fcb68003ba0 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 1 -- 10.20.193.51:0/3606687020 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700142f0 con 0x7fcb68003ba0 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb79ffb640 10 monclient: dump: 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb81549640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.730+0000 7fcb81549640 4 set_mon_vals no callback set 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 10 monclient: shutdown 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 -- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb68003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb68003fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb70006fb0 tx=0x7fcb70030480 comp rx=0 tx=0).stop 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 -- 10.20.193.51:0/3606687020 shutdown_connections 2026-02-17T12:08:37.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68005510 0x7fcb6800bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68004900 0x7fcb68004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 --2- 10.20.193.51:0/3606687020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb68003fa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 -- 10.20.193.51:0/3606687020 >> 10.20.193.51:0/3606687020 conn(0x7fcb7c0a30c0 msgr2=0x7fcb7c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 -- 10.20.193.51:0/3606687020 shutdown_connections 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 1 -- 10.20.193.51:0/3606687020 wait complete. 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.731+0000 7fcb81549640 10 monclient: build_initial_monmap 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient: monmap: 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 Processor -- start 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 -- start start 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient: init 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:37.742 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-c con 0x7fcb68003ba0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb7c0976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-a con 0x7fcb68004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb7c097c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): picked mon.noname-b con 0x7fcb68005510 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c09c850 con 0x7fcb68004900 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c09ef20 con 0x7fcb68005510 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c0a04b0 con 0x7fcb68003ba0 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb81549640 10 monclient(hunting): authenticate will time out at 2005.351572s 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46028/0 (socket says 10.20.193.51:46028) 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 learned_addr learned my addr 10.20.193.51:0/1153044719 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb68003ba0 auth_method 0 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:37.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb7c0976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request con 0x7fcb68004900 auth_method 0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient(hunting): handle_auth_done global_id 234536 payload 824 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb7c097c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 msgr2=0x7fcb7c097c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb7c097c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 msgr2=0x7fcb7c0976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb7c0976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient: _finish_hunting 0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 monclient: found mon.noname-c 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c09a670 con 0x7fcb68003ba0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7b7fe640 10 monclient: get_auth_request con 0x7fcb68005510 auth_method 0 2026-02-17T12:08:37.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb7c097c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.732+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb7c0976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.734+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb7c097180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.734+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb700304c0 tx=0x7fcb700047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70049020 con 0x7fcb68003ba0 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: dump: 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70045470 con 0x7fcb68003ba0 2026-02-17T12:08:37.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000f040 con 0x7fcb68003ba0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 5 monclient: authenticate success, global_id 234536 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _renew_subs 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb797fa640 4 set_mon_vals no callback set 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c098bf0 con 0x7fcb68003ba0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 10 monclient: dump: 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _renew_subs 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c09b880 con 0x7fcb68003ba0 2026-02-17T12:08:37.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcb70015040 con 0x7fcb68003ba0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 0x7fcb48040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(839..839 src has 323..839) ==== 4843+0+0 (secure 0 0 0) 0x7fcb70078c20 con 0x7fcb68003ba0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.735+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c073cf0 con 0x7fcb68003ba0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.736+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 0x7fcb48040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.736+0000 7fcb7a7fc640 10 monclient: get_auth_request con 0x7fcb4803dd60 auth_method 0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.738+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb7c073cf0 con 0x7fcb68003ba0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.738+0000 7fcb5b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.738+0000 7fcb5b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:37.747 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.739+0000 7fcb7a7fc640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 0x7fcb48040220 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcb64004750 tx=0x7fcb64006e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:37.857 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb81549640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb81549640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb81549640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb7c09dbe0 con 0x7fcb68003ba0 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb7c097180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb7c097180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb700304c0 tx=0x7fcb700047c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb700304c0 tx=0x7fcb700047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:37.858 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 msgr2=0x7fcb7c097180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb68003ba0 0x7fcb7c097180 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 0x7fcb48046710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): picked mon.c con 0x7fcb48044320 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb48049080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): picked mon.b con 0x7fcb68005510 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb4804ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:37.859 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): picked mon.a con 0x7fcb68004900 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4804c440 con 0x7fcb68004900 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 0x7fcb48046710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4804c5c0 con 0x7fcb68005510 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4804c790 con 0x7fcb48044320 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb5b7fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb48044320 auth_method 0 2026-02-17T12:08:37.860 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb4804ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): get_auth_request con 0x7fcb68004900 auth_method 0 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:37.861 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient(hunting): handle_auth_done global_id 234536 payload 293 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 msgr2=0x7fcb48049080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7b7fe640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb48049080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb48049080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 msgr2=0x7fcb4804ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb4804ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _finish_hunting 0 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 monclient: found mon.c 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.862 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fcb4804c960 con 0x7fcb48044320 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb7c09dbe0 con 0x7fcb48044320 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _finish_auth 0 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.851+0000 7fcb7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb7affd640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 msgr2=0x7fcb48046710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb7affd640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 0x7fcb48046710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb700774d0 tx=0x7fcb70036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7005b020 con 0x7fcb48044320 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: dump: 2026-02-17T12:08:37.863 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb700395b0 con 0x7fcb48044320 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb797fa640 4 set_mon_vals no callback set 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcb7005f040 con 0x7fcb48044320 2026-02-17T12:08:37.864 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 1 -- 10.20.193.51:0/1153044719 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7fcb70053030 con 0x7fcb48044320 2026-02-17T12:08:37.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:37.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.854+0000 7fcb5b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:37.865 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":216,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 msgr2=0x7fcb48040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 0x7fcb48040220 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcb64004750 tx=0x7fcb64006e80 comp rx=0 tx=0).stop 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 10 monclient: shutdown 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 msgr2=0x7fcb48046710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 0x7fcb48046710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb700774d0 tx=0x7fcb70036000 comp rx=0 tx=0).stop 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 shutdown_connections 2026-02-17T12:08:37.867 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcb68004900 0x7fcb4804ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcb68005510 0x7fcb48049080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcb48044320 0x7fcb48046710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 --2- 10.20.193.51:0/1153044719 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcb4803dd60 0x7fcb48040220 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 >> 10.20.193.51:0/1153044719 conn(0x7fcb7c0a30c0 msgr2=0x7fcb7c072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 shutdown_connections 2026-02-17T12:08:37.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:37.855+0000 7fcb81549640 1 -- 10.20.193.51:0/1153044719 wait complete. 2026-02-17T12:08:38.732 INFO:tasks.rados.rados.0.trial142.stdout:3620: done (2 left) 2026-02-17T12:08:38.733 INFO:tasks.rados.rados.0.trial142.stdout:3621: done (1 left) 2026-02-17T12:08:38.733 INFO:tasks.rados.rados.0.trial142.stdout:3624: done (0 left) 2026-02-17T12:08:38.733 INFO:tasks.rados.rados.0.trial142.stdout:3625: delete oid 19 current snap is 407 2026-02-17T12:08:38.737 INFO:tasks.rados.rados.0.trial142.stdout:3625: done (0 left) 2026-02-17T12:08:38.737 INFO:tasks.rados.rados.0.trial142.stdout:3626: read oid 6 snap 402 2026-02-17T12:08:38.737 INFO:tasks.rados.rados.0.trial142.stdout:3626: expect (ObjNum 878 snap 277 seq_num 878) 2026-02-17T12:08:38.737 INFO:tasks.rados.rados.0.trial142.stdout:3627: write oid 44 current snap is 407 2026-02-17T12:08:38.737 INFO:tasks.rados.rados.0.trial142.stdout:3627: seq_num 1235 ranges {756645=581701,1935850=473428} 2026-02-17T12:08:38.742 INFO:tasks.rados.rados.0.trial142.stdout:3627: writing trial14245205-44 from 756645 to 1338346 tid 1 2026-02-17T12:08:38.746 INFO:tasks.rados.rados.0.trial142.stdout:3627: writing trial14245205-44 from 1935850 to 2409278 tid 2 2026-02-17T12:08:38.746 INFO:tasks.rados.rados.0.trial142.stdout:3628: snap_remove snap 389 2026-02-17T12:08:39.860 INFO:tasks.rados.rados.0.trial142.stdout:3628: done (2 left) 2026-02-17T12:08:39.860 INFO:tasks.rados.rados.0.trial142.stdout:3629: delete oid 45 current snap is 407 2026-02-17T12:08:39.860 INFO:tasks.rados.rados.0.trial142.stdout:3626: expect (ObjNum 878 snap 277 seq_num 878) 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: finishing write tid 1 to trial14245205-44 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: finishing write tid 2 to trial14245205-44 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: finishing write tid 3 to trial14245205-44 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: finishing write tid 4 to trial14245205-44 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: oid 44 updating version 0 to 3136 2026-02-17T12:08:40.003 INFO:tasks.rados.rados.0.trial142.stdout:3627: oid 44 version 3136 is already newer than 3135 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3627: oid 44 updating version 3136 to 3137 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3137 (ObjNum 1235 snap 407 seq_num 1235) dirty exists 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3627: left oid 44 (ObjNum 1235 snap 407 seq_num 1235) 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3626: done (2 left) 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3627: done (1 left) 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3629: done (0 left) 2026-02-17T12:08:40.004 INFO:tasks.rados.rados.0.trial142.stdout:3630: snap_remove snap 402 2026-02-17T12:08:40.864 INFO:tasks.rados.rados.0.trial142.stdout:3630: done (0 left) 2026-02-17T12:08:40.865 INFO:tasks.rados.rados.0.trial142.stdout:3631: write oid 38 current snap is 407 2026-02-17T12:08:40.865 INFO:tasks.rados.rados.0.trial142.stdout:3631: seq_num 1237 ranges {790259=732199,1936461=477097} 2026-02-17T12:08:40.869 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:40.871 INFO:tasks.rados.rados.0.trial142.stdout:3631: writing trial14245205-38 from 790259 to 1522458 tid 1 2026-02-17T12:08:40.873 INFO:tasks.rados.rados.0.trial142.stdout:3631: writing trial14245205-38 from 1936461 to 2413558 tid 2 2026-02-17T12:08:40.874 INFO:tasks.rados.rados.0.trial142.stdout:3632: read oid 47 snap -1 2026-02-17T12:08:40.874 INFO:tasks.rados.rados.0.trial142.stdout:3632: expect (ObjNum 1228 snap 406 seq_num 1228) 2026-02-17T12:08:40.874 INFO:tasks.rados.rados.0.trial142.stdout:3633: write (excl) oid 39 current snap is 407 2026-02-17T12:08:40.874 INFO:tasks.rados.rados.0.trial142.stdout:3633: seq_num 1238 ranges {407066=407448,1594943=620755} 2026-02-17T12:08:40.876 INFO:tasks.rados.rados.0.trial142.stdout:3633: writing trial14245205-39 from 407066 to 814514 tid 1 2026-02-17T12:08:40.881 INFO:tasks.rados.rados.0.trial142.stdout:3633: writing trial14245205-39 from 1594943 to 2215698 tid 2 2026-02-17T12:08:40.882 INFO:tasks.rados.rados.0.trial142.stdout:3634: snap_remove snap 399 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 10 monclient: get_monmap_and_config 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 10 monclient: build_initial_monmap 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 10 monclient: monmap: 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:40.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:40.937456+0000 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:40.937456+0000 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 1 Processor -- start 2026-02-17T12:08:40.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 1 -- start start 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.936+0000 7f2a1f9a1640 10 monclient: init 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-b con 0x7f2a180a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2a1809dac0 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2a180a0110 0x7f2a1813c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-c con 0x7f2a180a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1806e140 con 0x7f2a1809dac0 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:40.943 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1809aed0 con 0x7f2a180a0110 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1809caa0 con 0x7f2a180a3bb0 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1f9a1640 10 monclient(hunting): authenticate will time out at 2008.556195s 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46050/0 (socket says 10.20.193.51:46050) 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 -- 10.20.193.51:0/1471660502 learned_addr learned my addr 10.20.193.51:0/1471660502 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): get_auth_request con 0x7f2a180a3bb0 auth_method 0 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:40.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1df17640 1 --2- 10.20.193.51:0/1471660502 >> v2:10.20.193.142:3300/0 conn(0x7f2a180a0110 0x7f2a1813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1df17640 10 monclient(hunting): get_auth_request con 0x7f2a180a0110 auth_method 0 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1df17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1df17640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1df17640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1cf15640 1 -- 10.20.193.51:0/1471660502 >> v1:10.20.193.142:6789/0 conn(0x7f2a1809dac0 legacy=0x7f2a1809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient(hunting): handle_auth_done global_id 234539 payload 274 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1cf15640 1 -- 10.20.193.51:0/1471660502 >> v1:10.20.193.142:6789/0 conn(0x7f2a1809dac0 legacy=0x7f2a1809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1cf15640 1 --1- 10.20.193.51:0/1471660502 >> v1:10.20.193.142:6789/0 conn(0x7f2a1809dac0 0x7f2a1809fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2026-02-17T12:08:40.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 -- 10.20.193.51:0/1471660502 >> v2:10.20.193.142:3300/0 conn(0x7f2a180a0110 msgr2=0x7f2a1813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 --2- 10.20.193.51:0/1471660502 >> v2:10.20.193.142:3300/0 conn(0x7f2a180a0110 0x7f2a1813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 -- 10.20.193.51:0/1471660502 >> v1:10.20.193.142:6789/0 conn(0x7f2a1809dac0 legacy=0x7f2a1809fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient: _finish_hunting 0 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 monclient: found mon.noname-b 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:08:40.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.937+0000 7f2a1d716640 1 -- 10.20.193.51:0/1471660502 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1809ce60 con 0x7f2a180a3bb0 2026-02-17T12:08:40.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1d716640 1 -- 10.20.193.51:0/1471660502 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 msgr2=0x7f2a1809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:40.955 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1d716640 1 --2- 10.20.193.51:0/1471660502 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a1806dc20 tx=0x7f2a0802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a0aa5e8fa25e35 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 1 -- 10.20.193.51:0/1471660502 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0803c070 con 0x7f2a180a3bb0 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: dump: 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:40.956 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: _finish_auth 0 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: _check_auth_tickets 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 1 -- 10.20.193.51:0/1471660502 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0802fd70 con 0x7f2a180a3bb0 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 5 monclient: authenticate success, global_id 234539 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:40.957 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 1 -- 10.20.193.51:0/1471660502 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08037660 con 0x7f2a180a3bb0 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 4 set_mon_vals no callback set 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a07fff640 10 monclient: dump: 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:40.958 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 10 monclient: shutdown 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/1471660502 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 msgr2=0x7f2a1809f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/1471660502 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a1806dc20 tx=0x7f2a0802eef0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/1471660502 shutdown_connections 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/1471660502 >> v2:10.20.193.142:3300/0 conn(0x7f2a180a0110 0x7f2a1813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/1471660502 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a180a3bb0 0x7f2a1809f4c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.959 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/1471660502 >> 10.20.193.51:0/1471660502 conn(0x7f2a180a30c0 msgr2=0x7f2a180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/1471660502 shutdown_connections 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/1471660502 wait complete. 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 10 monclient: build_initial_monmap 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.940+0000 7f2a1f9a1640 10 monclient: monmap: 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:40.960 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 Processor -- start 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 -- start start 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient: init 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-c con 0x7f2a1809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 0x7f2a181369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-b con 0x7f2a180a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:40.961 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 0x7f2a1812c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): picked mon.noname-a con 0x7f2a180a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1809a880 con 0x7f2a180a3bb0 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2a180a0520 con 0x7f2a180a0110 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1813cca0 con 0x7f2a1809dac0 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1f9a1640 10 monclient(hunting): authenticate will time out at 2008.560507s 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.962 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46054/0 (socket says 10.20.193.51:46054) 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 -- 10.20.193.51:0/2292734244 learned_addr learned my addr 10.20.193.51:0/2292734244 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): get_auth_request con 0x7f2a1809dac0 auth_method 0 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 0x7f2a1812c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 10 monclient(hunting): get_auth_request con 0x7f2a180a3bb0 auth_method 0 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:40.963 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient(hunting): handle_auth_done global_id 234542 payload 824 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1cf15640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 0x7f2a181369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 -- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 msgr2=0x7f2a181369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 0x7f2a181369f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 -- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 msgr2=0x7f2a1812c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 0x7f2a1812c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient: _finish_hunting 0 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 monclient: found mon.noname-c 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:08:40.964 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1d716640 1 -- 10.20.193.51:0/2292734244 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a181cd210 con 0x7f2a1809dac0 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1df17640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 0x7f2a1812c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1cf15640 10 monclient: get_auth_request con 0x7f2a180a0110 auth_method 0 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.941+0000 7f2a1cf15640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 0x7f2a181369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1d716640 1 -- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 msgr2=0x7f2a18072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1d716640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2a08002410 tx=0x7f2a08004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0803c040 con 0x7f2a1809dac0 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: dump: 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:40.965 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: _finish_auth 0 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08047070 con 0x7f2a1809dac0 2026-02-17T12:08:40.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08041800 con 0x7f2a1809dac0 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a05ffb640 10 monclient: dump: 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:40.967 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1f9a1640 5 monclient: authenticate success, global_id 234542 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a077fe640 4 set_mon_vals no callback set 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1f9a1640 10 monclient: _renew_subs 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1f9a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.943+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1812f180 con 0x7f2a1809dac0 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 10 monclient: _renew_subs 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1806d590 con 0x7f2a1809dac0 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:40.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a180a2c50 con 0x7f2a1809dac0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2a080419e0 con 0x7f2a1809dac0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a05ffb640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 0x7f29e80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.944+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(842..842 src has 323..842) ==== 4843+0+0 (secure 0 0 0) 0x7f2a08077920 con 0x7f2a1809dac0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.945+0000 7f2a1cf15640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 0x7f29e80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.945+0000 7f2a1cf15640 10 monclient: get_auth_request con 0x7f29e803dd10 auth_method 0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.947+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2a181cd210 con 0x7f2a1809dac0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.947+0000 7f2a05ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.947+0000 7f2a05ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:40.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:40.948+0000 7f2a1cf15640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 0x7f29e80401d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a180a1000 tx=0x7f2a0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.065+0000 7f2a1f9a1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.065+0000 7f2a1f9a1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.065+0000 7f2a1f9a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:41.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.065+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2a1809f4c0 con 0x7f2a1809dac0 2026-02-17T12:08:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a05ffb640 1 -- 10.20.193.51:0/2292734244 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f2a080363a0 con 0x7f2a1809dac0 2026-02-17T12:08:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a05ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:41.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a05ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:41.069 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":218,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:41.070 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 msgr2=0x7f29e80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 0x7f29e80401d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a180a1000 tx=0x7f2a0c009040 comp rx=0 tx=0).stop 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.066+0000 7f2a1f9a1640 10 monclient: shutdown 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 msgr2=0x7f2a18072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2a08002410 tx=0x7f2a08004830 comp rx=0 tx=0).stop 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 shutdown_connections 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f29e803dd10 0x7f29e80401d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.071 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2a180a3bb0 0x7f2a1812c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2a180a0110 0x7f2a181369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 --2- 10.20.193.51:0/2292734244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2a1809dac0 0x7f2a18072a10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 >> 10.20.193.51:0/2292734244 conn(0x7f2a180a30c0 msgr2=0x7f2a1809e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 shutdown_connections 2026-02-17T12:08:41.072 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.067+0000 7f2a1f9a1640 1 -- 10.20.193.51:0/2292734244 wait complete. 2026-02-17T12:08:41.076 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:08:41.076 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:08:41.076 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:08:41.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: get_monmap_and_config 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: monmap: 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:41.142037+0000 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:41.142037+0000 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.155 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 Processor -- start 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 -- start start 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: init 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-17T12:08:41.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-a con 0x7f3cdc0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3cdc09dac0 0x7f3cdc09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-c con 0x7f3cdc09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-b con 0x7f3cdc09ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc09aed0 con 0x7f3cdc0a3bb0 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc09caa0 con 0x7f3cdc09dac0 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc0a3f90 con 0x7f3cdc09ff40 2026-02-17T12:08:41.157 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce440e640 10 monclient(hunting): authenticate will time out at 2008.760835s 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2984640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42814/0 (socket says 10.20.193.51:42814) 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 1 -- 10.20.193.51:0/2762281232 learned_addr learned my addr 10.20.193.51:0/2762281232 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2984640 10 monclient(hunting): get_auth_request con 0x7f3cdc09ff40 auth_method 0 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2984640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2984640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2984640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 10 monclient(hunting): get_auth_request con 0x7f3cdc0a3bb0 auth_method 0 2026-02-17T12:08:41.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce2183640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.141+0000 7f3ce1982640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.142:3300/0 conn(0x7f3cdc09dac0 0x7f3cdc09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce1982640 10 monclient(hunting): get_auth_request con 0x7f3cdc09dac0 auth_method 0 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce1982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce1982640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce1982640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient(hunting): handle_auth_done global_id 234545 payload 274 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 -- 10.20.193.51:0/2762281232 >> v2:10.20.193.142:3300/0 conn(0x7f3cdc09dac0 msgr2=0x7f3cdc09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.142:3300/0 conn(0x7f3cdc09dac0 0x7f3cdc09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 -- 10.20.193.51:0/2762281232 >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 msgr2=0x7f3cdc09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 monclient: found mon.noname-b 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2984640 1 -- 10.20.193.51:0/2762281232 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc06e140 con 0x7f3cdc09ff40 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.142+0000 7f3ce2183640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:08:41.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce2984640 1 -- 10.20.193.51:0/2762281232 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 msgr2=0x7f3cdc13b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce2984640 1 --2- 10.20.193.51:0/2762281232 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13b750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc06dc20 tx=0x7f3cd802f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b57a8efe2cb5bba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 1 -- 10.20.193.51:0/2762281232 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd803c070 con 0x7f3cdc09ff40 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: dump: 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.161 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 1 -- 10.20.193.51:0/2762281232 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd8037440 con 0x7f3cdc09ff40 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce440e640 5 monclient: authenticate success, global_id 234545 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 1 -- 10.20.193.51:0/2762281232 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8037810 con 0x7f3cdc09ff40 2026-02-17T12:08:41.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce1181640 10 monclient: dump: 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.163 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce440e640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.144+0000 7f3ce440e640 4 set_mon_vals no callback set 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 10 monclient: shutdown 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- 10.20.193.51:0/2762281232 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 msgr2=0x7f3cdc13b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 --2- 10.20.193.51:0/2762281232 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13b750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc06dc20 tx=0x7f3cd802f130 comp rx=0 tx=0).stop 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- 10.20.193.51:0/2762281232 shutdown_connections 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 --2- 10.20.193.51:0/2762281232 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13b750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.142:3300/0 conn(0x7f3cdc09dac0 0x7f3cdc09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 --2- 10.20.193.51:0/2762281232 >> v2:10.20.193.51:3300/0 conn(0x7f3cdc0a3bb0 0x7f3cdc09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- 10.20.193.51:0/2762281232 >> 10.20.193.51:0/2762281232 conn(0x7f3cdc0a30c0 msgr2=0x7f3cdc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- 10.20.193.51:0/2762281232 shutdown_connections 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- 10.20.193.51:0/2762281232 wait complete. 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 10 monclient: monmap: 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:41.165 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 Processor -- start 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 1 -- start start 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.145+0000 7f3ce440e640 10 monclient: init 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-a con 0x7f3cdc09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-c con 0x7f3cdc09ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3cdc0a3bb0 0x7f3cdc13c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): picked mon.noname-b con 0x7f3cdc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0a0370 con 0x7f3cdc09dac0 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc09a880 con 0x7f3cdc0a3bb0 2026-02-17T12:08:41.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc0a04f0 con 0x7f3cdc09ff40 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce440e640 10 monclient(hunting): authenticate will time out at 2008.765141s 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42816/0 (socket says 10.20.193.51:42816) 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 -- 10.20.193.51:0/3742205244 learned_addr learned my addr 10.20.193.51:0/3742205244 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): get_auth_request con 0x7f3cdc09dac0 auth_method 0 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): get_auth_request con 0x7f3cdc09ff40 auth_method 0 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2984640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3cdc0a3bb0 0x7f3cdc13c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2984640 10 monclient(hunting): get_auth_request con 0x7f3cdc0a3bb0 auth_method 0 2026-02-17T12:08:41.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2984640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2984640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2984640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient(hunting): handle_auth_done global_id 274185 payload 824 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 msgr2=0x7f3cdc13c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3cdc0a3bb0 msgr2=0x7f3cdc13c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3cdc0a3bb0 0x7f3cdc13c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 monclient: found mon.noname-a 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce2183640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc130210 con 0x7f3cdc09dac0 2026-02-17T12:08:41.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.146+0000 7f3ce1982640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3cdc09ff40 0x7f3cdc13c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce2183640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 msgr2=0x7f3cdc13bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce2183640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00ebe0 tx=0x7f3ccc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc017070 con 0x7f3cdc09dac0 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: dump: 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.171 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc00ce50 con 0x7f3cdc09dac0 2026-02-17T12:08:41.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 5 monclient: authenticate success, global_id 274185 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 10 monclient: _renew_subs 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc1304f0 con 0x7f3cdc09dac0 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc013690 con 0x7f3cdc09dac0 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce0980640 4 set_mon_vals no callback set 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3cc2ffd640 10 monclient: dump: 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.173 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 10 monclient: _renew_subs 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.148+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc074060 con 0x7f3cdc09dac0 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce440e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:41.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce440e640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 0x7f3cdc099990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc09e370 con 0x7f3cdc0995b0 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 0x7f3cdc099990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient: get_auth_request con 0x7f3cdc0995b0 auth_method 0 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3ccc024060 con 0x7f3cdc09dac0 2026-02-17T12:08:41.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 10 monclient(hunting): handle_auth_done global_id 274188 payload 824 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce1982640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cdc12fb90 con 0x7f3cdc0995b0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3cc2ffd640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cac03dd10 0x7f3cac0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(842..842 src has 323..842) ==== 4843+0+0 (secure 0 0 0) 0x7f3ccc0526a0 con 0x7f3cdc09dac0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce2984640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cac03dd10 0x7f3cac0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.149+0000 7f3ce2984640 10 monclient: get_auth_request con 0x7f3cac03dd10 auth_method 0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3ce1982640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 msgr2=0x7f3cdc099990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3ce1982640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 0x7f3cdc099990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011a60 tx=0x7f3cd0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0019070 con 0x7f3cdc0995b0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 10 monclient: dump: 2026-02-17T12:08:41.176 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3cd0015660 con 0x7f3cdc0995b0 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:41.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 msgr2=0x7f3cdc099990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 0x7f3cdc099990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011a60 tx=0x7f3cd0011f30 comp rx=0 tx=0).stop 2026-02-17T12:08:41.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 msgr2=0x7f3cdc099990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:41.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.151+0000 7f3cc2ffd640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc0995b0 0x7f3cdc099990 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011a60 tx=0x7f3cd0011f30 comp rx=0 tx=0).stop 2026-02-17T12:08:41.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.152+0000 7f3ce2984640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cac03dd10 0x7f3cac0401d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc06c1c0 tx=0x7f3cd8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.154+0000 7f3ce440e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.154+0000 7f3ce440e640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 0x7f3cdc1da480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce440e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0008d0 con 0x7f3cdc099ed0 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 0x7f3cdc1da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient: get_auth_request con 0x7f3cdc099ed0 auth_method 0 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 10 monclient(hunting): handle_auth_done global_id 274191 payload 824 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.155+0000 7f3ce1982640 1 -- 10.20.193.51:0/3742205244 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3cdc050ac0 con 0x7f3cdc099ed0 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce1982640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 msgr2=0x7f3cdc1da480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce1982640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 0x7f3cdc1da480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011a60 tx=0x7f3cd0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000f040 con 0x7f3cdc099ed0 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 10 monclient: dump: 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.181 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f3cd0029430 con 0x7f3cdc099ed0 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 msgr2=0x7f3cdc1da480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 0x7f3cdc1da480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011a60 tx=0x7f3cd0004830 comp rx=0 tx=0).stop 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 msgr2=0x7f3cdc1da480 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3cc2ffd640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc099ed0 0x7f3cdc1da480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:41.183 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 92514, 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.184 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.185 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:41.186 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.187 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.188 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:41.189 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.190 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.191 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.192 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:41.193 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cac03dd10 msgr2=0x7f3cac0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3cac03dd10 0x7f3cac0401d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc06c1c0 tx=0x7f3cd8033000 comp rx=0 tx=0).stop 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 10 monclient: shutdown 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 msgr2=0x7f3cdc13bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce2984640 1 -- 10.20.193.51:0/3742205244 reap_dead start 2026-02-17T12:08:41.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00ebe0 tx=0x7f3ccc00c520 comp rx=0 tx=0).stop 2026-02-17T12:08:41.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 shutdown_connections 2026-02-17T12:08:41.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 --2- 10.20.193.51:0/3742205244 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3cdc09dac0 0x7f3cdc13bc50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 >> 10.20.193.51:0/3742205244 conn(0x7f3cdc0a30c0 msgr2=0x7f3cdc09e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 shutdown_connections 2026-02-17T12:08:41.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.157+0000 7f3ce440e640 1 -- 10.20.193.51:0/3742205244 wait complete. 2026-02-17T12:08:41.195 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:41.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:08:41.195 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: get_monmap_and_config 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: monmap: 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:41.262110+0000 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:41.262110+0000 2026-02-17T12:08:41.265 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 Processor -- start 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 -- start start 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: init 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient: _add_conns ranks=[1,3,2,4,0] 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fca7c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fca7c0a0750 0x7fca7c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): picked mon.noname-a con 0x7fca7c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): picked mon.noname-b con 0x7fca7c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca7c06e140 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c09f910 con 0x7fca7c0a0750 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c09ccd0 con 0x7fca7c13b760 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca827be640 10 monclient(hunting): authenticate will time out at 2008.880872s 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca80d34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca7b7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fca7c0a0750 0x7fca7c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca80d34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46072/0 (socket says 10.20.193.51:46072) 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca80d34640 1 -- 10.20.193.51:0/2014174889 learned_addr learned my addr 10.20.193.51:0/2014174889 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca7b7fe640 10 monclient(hunting): get_auth_request con 0x7fca7c0a0750 auth_method 0 2026-02-17T12:08:41.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.261+0000 7fca80d34640 10 monclient(hunting): get_auth_request con 0x7fca7c13b760 auth_method 0 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_done global_id 274194 payload 274 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 1 -- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 msgr2=0x7fca7c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 1 --2- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 1 -- 10.20.193.51:0/2014174889 >> v1:10.20.193.142:6789/0 conn(0x7fca7c0a3bb0 legacy=0x7fca7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:41.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:08:41.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.262+0000 7fca7b7fe640 1 -- 10.20.193.51:0/2014174889 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c09eec0 con 0x7fca7c0a0750 2026-02-17T12:08:41.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7b7fe640 1 -- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a0750 msgr2=0x7fca7c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7b7fe640 1 --2- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a0750 0x7fca7c09e1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca7c06f3c0 tx=0x7fca6c02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4866164d2c6d50 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 1 -- 10.20.193.51:0/2014174889 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c03c070 con 0x7fca7c0a0750 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: dump: 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca827be640 5 monclient: authenticate success, global_id 274194 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca827be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 1 -- 10.20.193.51:0/2014174889 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c02fbd0 con 0x7fca7c0a0750 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 1 -- 10.20.193.51:0/2014174889 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037440 con 0x7fca7c0a0750 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca7affd640 10 monclient: dump: 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca827be640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.264+0000 7fca827be640 4 set_mon_vals no callback set 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 10 monclient: shutdown 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a0750 msgr2=0x7fca7c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 --2- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a0750 0x7fca7c09e1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca7c06f3c0 tx=0x7fca6c02ed50 comp rx=0 tx=0).stop 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- 10.20.193.51:0/2014174889 shutdown_connections 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 --2- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 --2- 10.20.193.51:0/2014174889 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a0750 0x7fca7c09e1d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- 10.20.193.51:0/2014174889 >> 10.20.193.51:0/2014174889 conn(0x7fca7c0a30c0 msgr2=0x7fca7c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- 10.20.193.51:0/2014174889 shutdown_connections 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- 10.20.193.51:0/2014174889 wait complete. 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 10 monclient: monmap: 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.277 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 Processor -- start 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 1 -- start start 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.265+0000 7fca827be640 10 monclient: init 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca7c0a0750 0x7fca7c095280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): picked mon.noname-b con 0x7fca7c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:41.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 0x7fca7c0957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): picked mon.noname-a con 0x7fca7c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c095d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): picked mon.noname-c con 0x7fca7c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c0a04b0 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c09c850 con 0x7fca7c0a0750 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c09e710 con 0x7fca7c13b760 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca827be640 10 monclient(hunting): authenticate will time out at 2008.885221s 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 0x7fca7c0957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c095d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 0x7fca7c0957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42842/0 (socket says 10.20.193.51:42842) 2026-02-17T12:08:41.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c095d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46084/0 (socket says 10.20.193.51:46084) 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 -- 10.20.193.51:0/3014931894 learned_addr learned my addr 10.20.193.51:0/3014931894 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): get_auth_request con 0x7fca7c0a3bb0 auth_method 0 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): get_auth_request con 0x7fca7c13b760 auth_method 0 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca80d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient(hunting): handle_auth_done global_id 274197 payload 824 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 msgr2=0x7fca7c095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c13b760 0x7fca7c095d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca7c0a0750 msgr2=0x7fca7c095280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fca7c0a0750 0x7fca7c095280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.266+0000 7fca7b7fe640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c0a2be0 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca7b7fe640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 msgr2=0x7fca7c0957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca7b7fe640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 0x7fca7c0957c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca6c002410 tx=0x7fca6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c046070 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: dump: 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.281 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c041680 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c03c040 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca7a7fc640 4 set_mon_vals no callback set 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca78ff9640 10 monclient: dump: 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 5 monclient: authenticate success, global_id 274197 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 10 monclient: _renew_subs 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c098ba0 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 10 monclient: _renew_subs 2026-02-17T12:08:41.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.268+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c0988c0 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca827be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca827be640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 0x7fca7c08d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c09d7b0 con 0x7fca7c08d3f0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 0x7fca7c08d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient: get_auth_request con 0x7fca7c08d3f0 auth_method 0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fca6c041a70 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 10 monclient(hunting): handle_auth_done global_id 234557 payload 824 2026-02-17T12:08:41.284 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca7bfff640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca7c06ff20 con 0x7fca7c08d3f0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca78ff9640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca4c03dd10 0x7fca4c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(842..842 src has 323..842) ==== 4843+0+0 (secure 0 0 0) 0x7fca6c077ec0 con 0x7fca7c0a3bb0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca80d34640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca4c03dd10 0x7fca4c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.269+0000 7fca80d34640 10 monclient: get_auth_request con 0x7fca4c03dd10 auth_method 0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca7bfff640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 msgr2=0x7fca7c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca7bfff640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 0x7fca7c08d7d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca6800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68011a80 con 0x7fca7c08d3f0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 10 monclient: dump: 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.285 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fca68017070 con 0x7fca7c08d3f0 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 msgr2=0x7fca7c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 0x7fca7c08d7d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca6800c860 comp rx=0 tx=0).stop 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 msgr2=0x7fca7c08d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.271+0000 7fca78ff9640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08d3f0 0x7fca7c08d7d0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca6800c860 comp rx=0 tx=0).stop 2026-02-17T12:08:41.286 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.272+0000 7fca80d34640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca4c03dd10 0x7fca4c0401d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fca7c06dab0 tx=0x7fca7000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca827be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca827be640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 0x7fca7c1d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca827be640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c09dac0 con 0x7fca7c08dd10 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 0x7fca7c1d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient: get_auth_request con 0x7fca7c08dd10 auth_method 0 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.288 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 10 monclient(hunting): handle_auth_done global_id 234560 payload 824 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.275+0000 7fca7bfff640 1 -- 10.20.193.51:0/3014931894 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca7c0008d0 con 0x7fca7c08dd10 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca7bfff640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 msgr2=0x7fca7c1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca7bfff640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 0x7fca7c1d98b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca68003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca680055b0 con 0x7fca7c08dd10 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 10 monclient: dump: 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.289 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fca680046e0 con 0x7fca7c08dd10 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 msgr2=0x7fca7c1d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 0x7fca7c1d98b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca68003860 comp rx=0 tx=0).stop 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 msgr2=0x7fca7c1d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca78ff9640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fca7c08dd10 0x7fca7c1d98b0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c390 tx=0x7fca68003860 comp rx=0 tx=0).stop 2026-02-17T12:08:41.290 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 298272, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:41.291 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.292 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:41.293 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:41.294 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:41.295 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.296 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.297 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:41.298 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.299 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:41.300 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:41.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca4c03dd10 msgr2=0x7fca4c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fca4c03dd10 0x7fca4c0401d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fca7c06dab0 tx=0x7fca7000b040 comp rx=0 tx=0).stop 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 10 monclient: shutdown 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 msgr2=0x7fca7c0957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca827be640 1 --2- 10.20.193.51:0/3014931894 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fca7c0a3bb0 0x7fca7c0957c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca6c002410 tx=0x7fca6c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.277+0000 7fca80d34640 1 -- 10.20.193.51:0/3014931894 reap_dead start 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.278+0000 7fca80d34640 1 -- 10.20.193.51:0/3014931894 reap_dead start 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.278+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 shutdown_connections 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.278+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 >> 10.20.193.51:0/3014931894 conn(0x7fca7c0a30c0 msgr2=0x7fca7c0a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.278+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 shutdown_connections 2026-02-17T12:08:41.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.278+0000 7fca827be640 1 -- 10.20.193.51:0/3014931894 wait complete. 2026-02-17T12:08:41.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:41.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:08:41.303 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.367+0000 7f784083a640 10 monclient: get_monmap_and_config 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.367+0000 7f784083a640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.367+0000 7f784083a640 10 monclient: monmap: 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:41.368619+0000 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:41.368619+0000 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.371 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 Processor -- start 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 -- start start 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient: init 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f78380a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): picked mon.noname-c con 0x7f78380a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f783813b760 0x7f783813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): picked mon.noname-a con 0x7f783813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783806e140 con 0x7f78380a3bb0 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f783809f910 con 0x7f783813b760 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f783809ccd0 con 0x7f78380a0750 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f784083a640 10 monclient(hunting): authenticate will time out at 2008.987360s 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f783813b760 0x7f783813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.372 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f783813b760 0x7f783813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42844/0 (socket says 10.20.193.51:42844) 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 -- 10.20.193.51:0/4061305475 learned_addr learned my addr 10.20.193.51:0/4061305475 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): get_auth_request con 0x7f783813b760 auth_method 0 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 1 --2- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 10 monclient(hunting): get_auth_request con 0x7f78380a0750 auth_method 0 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 1 -- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 msgr2=0x7f783809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 1 -- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 msgr2=0x7f783809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 1 --2- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient(hunting): handle_auth_done global_id 274200 payload 274 2026-02-17T12:08:41.373 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783ddae640 1 --2- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 -- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 msgr2=0x7f783809e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 --2- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 -- 10.20.193.51:0/4061305475 >> v1:10.20.193.142:6789/0 conn(0x7f78380a3bb0 legacy=0x7f783809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 monclient: found mon.noname-a 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.374 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.368+0000 7f783edb0640 1 -- 10.20.193.51:0/4061305475 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783809eec0 con 0x7f783813b760 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783edb0640 1 -- 10.20.193.51:0/4061305475 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f783813b760 msgr2=0x7f783813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783edb0640 1 --2- 10.20.193.51:0/4061305475 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f783813b760 0x7f783813db50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f783806f3c0 tx=0x7f782c02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd1858481e633a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 1 -- 10.20.193.51:0/4061305475 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c02fe60 con 0x7f783813b760 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: dump: 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.379 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 1 -- 10.20.193.51:0/4061305475 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c0373f0 con 0x7f783813b760 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 5 monclient: authenticate success, global_id 274200 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 1 -- 10.20.193.51:0/4061305475 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c0377c0 con 0x7f783813b760 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 4 set_mon_vals no callback set 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f783d5ad640 10 monclient: dump: 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.380 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 10 monclient: shutdown 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 -- 10.20.193.51:0/4061305475 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f783813b760 msgr2=0x7f783813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 --2- 10.20.193.51:0/4061305475 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f783813b760 0x7f783813db50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f783806f3c0 tx=0x7f782c02f230 comp rx=0 tx=0).stop 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 -- 10.20.193.51:0/4061305475 shutdown_connections 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 --2- 10.20.193.51:0/4061305475 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f783813b760 0x7f783813db50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 --2- 10.20.193.51:0/4061305475 >> v2:10.20.193.142:3300/0 conn(0x7f78380a0750 0x7f783809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 -- 10.20.193.51:0/4061305475 >> 10.20.193.51:0/4061305475 conn(0x7f78380a30c0 msgr2=0x7f78380a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 -- 10.20.193.51:0/4061305475 shutdown_connections 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.371+0000 7f784083a640 1 -- 10.20.193.51:0/4061305475 wait complete. 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient: build_initial_monmap 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient: monmap: 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:41.381 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 Processor -- start 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 -- start start 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient: init 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 0x7f7838091e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): picked mon.noname-a con 0x7f78380a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f78380a3bb0 0x7f7838092390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): picked mon.noname-c con 0x7f78380a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783813b760 0x7f78380928d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): picked mon.noname-b con 0x7f783813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f78380a04b0 con 0x7f78380a0750 2026-02-17T12:08:41.382 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f783809c850 con 0x7f783813b760 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f783809e710 con 0x7f78380a3bb0 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f784083a640 10 monclient(hunting): authenticate will time out at 2008.991685s 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 0x7f7838091e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 0x7f7838091e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42850/0 (socket says 10.20.193.51:42850) 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 -- 10.20.193.51:0/2110136536 learned_addr learned my addr 10.20.193.51:0/2110136536 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): get_auth_request con 0x7f78380a0750 auth_method 0 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f78380a3bb0 0x7f7838092390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): get_auth_request con 0x7f78380a3bb0 auth_method 0 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.383 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783edb0640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783813b760 0x7f78380928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783edb0640 10 monclient(hunting): get_auth_request con 0x7f783813b760 auth_method 0 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783edb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783edb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783edb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient(hunting): handle_auth_done global_id 274203 payload 824 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f78380a3bb0 msgr2=0x7f7838092390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f78380a3bb0 0x7f7838092390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783813b760 msgr2=0x7f78380928d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783813b760 0x7f78380928d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient: _finish_hunting 0 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 monclient: found mon.noname-a 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.384 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.372+0000 7f783e5af640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7838095b70 con 0x7f78380a0750 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f783e5af640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 msgr2=0x7f7838091e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f783e5af640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 0x7f7838091e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f783000c5d0 tx=0x7f783000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830016020 con 0x7f78380a0750 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: dump: 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7830012a60 con 0x7f78380a0750 2026-02-17T12:08:41.385 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 5 monclient: authenticate success, global_id 274203 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830012e50 con 0x7f78380a0750 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f783cdac640 4 set_mon_vals no callback set 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 10 monclient: dump: 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 monclient: _renew_subs 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78380a2a40 con 0x7f78380a0750 2026-02-17T12:08:41.386 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 monclient: _renew_subs 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78380955b0 con 0x7f78380a0750 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f783809a190 con 0x7f783808e570 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f783001b400 con 0x7f78380a0750 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.375+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 10 monclient: get_auth_request con 0x7f783808e570 auth_method 0 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f7822ffd640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f780803df00 0x7f78080403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(842..842 src has 323..842) ==== 4843+0+0 (secure 0 0 0) 0x7f78300526c0 con 0x7f78380a0750 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:41.387 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783edb0640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f780803df00 0x7f78080403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.376+0000 7f783edb0640 10 monclient: get_auth_request con 0x7f780803df00 auth_method 0 2026-02-17T12:08:41.388 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.378+0000 7f783edb0640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f780803df00 0x7f78080403c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f783806c1c0 tx=0x7f782c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 10 monclient: get_auth_request con 0x7f783808e570 auth_method 0 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:08:41.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:08:41.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:41.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.577+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:3634: done (3 left) 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:3635: rollback oid 31 current snap is 407 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 31 to 400 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:3631: finishing write tid 1 to trial14245205-38 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:3631: finishing write tid 2 to trial14245205-38 2026-02-17T12:08:41.937 INFO:tasks.rados.rados.0.trial142.stdout:3631: finishing write tid 3 to trial14245205-38 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3631: finishing write tid 4 to trial14245205-38 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3631: oid 38 updating version 0 to 3099 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3631: oid 38 version 3099 is already newer than 3098 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3631: oid 38 updating version 3099 to 3100 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3100 (ObjNum 1237 snap 407 seq_num 1237) dirty exists 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3631: left oid 38 (ObjNum 1237 snap 407 seq_num 1237) 2026-02-17T12:08:41.938 INFO:tasks.rados.rados.0.trial142.stdout:3632: expect (ObjNum 1228 snap 406 seq_num 1228) 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 10 monclient: get_auth_request con 0x7f783808e570 auth_method 0 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:08:41.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:41.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:41.978+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:42.029 INFO:tasks.rados.rados.0.trial142.stdout:3633: finishing write tid 1 to trial14245205-39 2026-02-17T12:08:42.029 INFO:tasks.rados.rados.0.trial142.stdout:3631: done (3 left) 2026-02-17T12:08:42.030 INFO:tasks.rados.rados.0.trial142.stdout:3632: done (2 left) 2026-02-17T12:08:42.030 INFO:tasks.rados.rados.0.trial142.stdout:3636: snap_remove snap 390 2026-02-17T12:08:42.718 INFO:tasks.rados.rados.0.trial142.stdout:3636: done (2 left) 2026-02-17T12:08:42.718 INFO:tasks.rados.rados.0.trial142.stdout:3637: read oid 13 snap -1 2026-02-17T12:08:42.718 INFO:tasks.rados.rados.0.trial142.stdout:3637: expect (ObjNum 1217 snap 405 seq_num 1217) 2026-02-17T12:08:42.718 INFO:tasks.rados.rados.0.trial142.stdout:3638: snap_remove snap 380 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient: get_auth_request con 0x7f783808e570 auth_method 0 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:42.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 10 monclient(hunting): handle_auth_done global_id 284098 payload 824 2026-02-17T12:08:42.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.780+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7838093d20 con 0x7f783808e570 2026-02-17T12:08:42.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:42.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7838093480 tx=0x7f7824017e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:42.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400f040 con 0x7f783808e570 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 10 monclient: dump: 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f7824015e80 con 0x7f783808e570 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7838093480 tx=0x7f7824017e20 comp rx=0 tx=0).stop 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 msgr2=0x7f78380638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:42.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.782+0000 7f7822ffd640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e570 0x7f78380638c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:42.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f784083a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:42.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f784083a640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 0x7f78381d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f784083a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:42.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f783809dac0 con 0x7f783808e950 2026-02-17T12:08:42.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 0x7f78381d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f783ddae640 10 monclient: get_auth_request con 0x7f783808e950 auth_method 0 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f783ddae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f783ddae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.785+0000 7f783ddae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.786+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.786+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.786+0000 7f783ddae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.786+0000 7f783ddae640 10 monclient(hunting): handle_auth_done global_id 284101 payload 824 2026-02-17T12:08:42.789 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.786+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f78380008d0 con 0x7f783808e950 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f783ddae640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 msgr2=0x7f78381d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f783ddae640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 0x7f78381d7890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7824021000 tx=0x7f7824004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824003ce0 con 0x7f783808e950 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 10 monclient: dump: 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.791 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f7824003ce0 con 0x7f783808e950 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 msgr2=0x7f78381d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.792 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 0x7f78381d7890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7824021000 tx=0x7f7824004830 comp rx=0 tx=0).stop 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 msgr2=0x7f78381d7890 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.788+0000 7f7822ffd640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f783808e950 0x7f78381d7890 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7824021000 tx=0x7f7824004830 comp rx=0 tx=0).stop 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:08:42.793 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 25019, 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:42.794 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:42.795 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:42.796 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:42.797 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:42.798 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:42.799 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.800 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:42.801 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.802 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:42.803 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.804 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.805 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:42.806 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:42.807 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f780803df00 msgr2=0x7f78080403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f780803df00 0x7f78080403c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f783806c1c0 tx=0x7f782c033000 comp rx=0 tx=0).stop 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 10 monclient: shutdown 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 msgr2=0x7f7838091e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 --2- 10.20.193.51:0/2110136536 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f78380a0750 0x7f7838091e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f783000c5d0 tx=0x7f783000caa0 comp rx=0 tx=0).stop 2026-02-17T12:08:42.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f783edb0640 1 -- 10.20.193.51:0/2110136536 reap_dead start 2026-02-17T12:08:42.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f783edb0640 1 -- 10.20.193.51:0/2110136536 reap_dead start 2026-02-17T12:08:42.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 shutdown_connections 2026-02-17T12:08:42.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 >> 10.20.193.51:0/2110136536 conn(0x7f78380a30c0 msgr2=0x7f783813ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:42.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 shutdown_connections 2026-02-17T12:08:42.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.789+0000 7f784083a640 1 -- 10.20.193.51:0/2110136536 wait complete. 2026-02-17T12:08:42.811 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:42.811 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:08:42.811 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:08:42.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: get_monmap_and_config 2026-02-17T12:08:42.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: build_initial_monmap 2026-02-17T12:08:42.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: monmap: 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:42.877164+0000 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:42.877164+0000 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:42.881 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 Processor -- start 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 -- start start 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: init 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa8e40a3bb0 0x7fa8e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-a con 0x7fa8e40a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8e40a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:42.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa8e413b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e406e140 con 0x7fa8e40a0750 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e409f910 con 0x7fa8e413b760 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e409ccd0 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.876+0000 7fa8eadb6640 10 monclient(hunting): authenticate will time out at 2010.495943s 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa8e40a3bb0 0x7fa8e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8dbfff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa8e40a0750 0x7fa8e409e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44720/0 (socket says 10.20.193.51:44720) 2026-02-17T12:08:42.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8dbfff640 1 -- 10.20.193.51:0/1601620295 learned_addr learned my addr 10.20.193.51:0/1601620295 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): get_auth_request con 0x7fa8e40a3bb0 auth_method 0 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_done global_id 274206 payload 274 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1601620295 >> v1:10.20.193.142:6789/0 conn(0x7fa8e413b760 legacy=0x7fa8e413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1601620295 >> v1:10.20.193.51:6789/0 conn(0x7fa8e40a0750 legacy=0x7fa8e409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient: _finish_hunting 0 2026-02-17T12:08:42.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 1 monclient: found mon.noname-a 2026-02-17T12:08:42.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:42.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:42.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.877+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1601620295 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e409eec0 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1601620295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a3bb0 msgr2=0x7fa8e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:42.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8e8b2b640 1 --2- 10.20.193.51:0/1601620295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e93cee1599888e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:42.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 1 -- 10.20.193.51:0/1601620295 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d403c070 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: dump: 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.893 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: _finish_auth 0 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 1 -- 10.20.193.51:0/1601620295 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d402fce0 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 1 -- 10.20.193.51:0/1601620295 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4037660 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8db7fe640 10 monclient: dump: 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.895 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8eadb6640 5 monclient: authenticate success, global_id 274206 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8eadb6640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.879+0000 7fa8eadb6640 4 set_mon_vals no callback set 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 10 monclient: shutdown 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1601620295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a3bb0 msgr2=0x7fa8e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1601620295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d402ed80 comp rx=0 tx=0).stop 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1601620295 shutdown_connections 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1601620295 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409dac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:42.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1601620295 >> 10.20.193.51:0/1601620295 conn(0x7fa8e40a30c0 msgr2=0x7fa8e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1601620295 shutdown_connections 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1601620295 wait complete. 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 10 monclient: build_initial_monmap 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 10 monclient: monmap: 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:42.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 Processor -- start 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 1 -- start start 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 10 monclient: init 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.880+0000 7fa8eadb6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-a con 0x7fa8e40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-b con 0x7fa8e40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8e413b760 0x7fa8e41322a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): picked mon.noname-c con 0x7fa8e413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e40a04b0 con 0x7fa8e40a0750 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e409c850 con 0x7fa8e40a3bb0 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e409e710 con 0x7fa8e413b760 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8eadb6640 10 monclient(hunting): authenticate will time out at 2010.500045s 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42862/0 (socket says 10.20.193.51:42862) 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1900263258 learned_addr learned my addr 10.20.193.51:0/1900263258 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:42.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): get_auth_request con 0x7fa8e40a0750 auth_method 0 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e932c640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8e413b760 0x7fa8e41322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e932c640 10 monclient(hunting): get_auth_request con 0x7fa8e413b760 auth_method 0 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e932c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e932c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:42.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e932c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient(hunting): handle_auth_done global_id 274209 payload 824 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8e413b760 msgr2=0x7fa8e41322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8e413b760 0x7fa8e41322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 msgr2=0x7fa8e409bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8dbfff640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient: _finish_hunting 0 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 monclient: found mon.noname-a 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1900263258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e41360e0 con 0x7fa8e40a0750 2026-02-17T12:08:42.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8dbfff640 10 monclient: get_auth_request con 0x7fa8e40a3bb0 auth_method 0 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.881+0000 7fa8dbfff640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8e8b2b640 1 -- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 msgr2=0x7fa8e409b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8e8b2b640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4046070 con 0x7fa8e40a0750 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: dump: 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.902 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: _finish_auth 0 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: _check_auth_tickets 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4041870 con 0x7fa8e40a0750 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 5 monclient: authenticate success, global_id 274209 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _renew_subs 2026-02-17T12:08:42.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e406f730 con 0x7fa8e40a0750 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d403c040 con 0x7fa8e40a0750 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8d97fa640 10 monclient: dump: 2026-02-17T12:08:42.904 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:42.905 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8daffd640 4 set_mon_vals no callback set 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _renew_subs 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e4135b20 con 0x7fa8e40a0750 2026-02-17T12:08:42.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.883+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e409dac0 con 0x7fa8e40a0750 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.884+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa8d4041c60 con 0x7fa8e40a0750 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.884+0000 7fa8d97fa640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 0x7fa8b40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.884+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(844..844 src has 323..844) ==== 4903+0+0 (secure 0 0 0) 0x7fa8d4077f40 con 0x7fa8e40a0750 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.884+0000 7fa8dbfff640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 0x7fa8b40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.884+0000 7fa8dbfff640 10 monclient: get_auth_request con 0x7fa8b403dd10 auth_method 0 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.886+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa8d4037e10 con 0x7fa8e40a0750 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.886+0000 7fa8d97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:42.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.886+0000 7fa8d97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:42.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:42.886+0000 7fa8dbfff640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 0x7fa8b40401d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4133a70 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.003+0000 7fa8eadb6640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:08:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.003+0000 7fa8eadb6640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:08:43.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.003+0000 7fa8eadb6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:43.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.003+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa8e40a2e50 con 0x7fa8e40a0750 2026-02-17T12:08:43.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=10,logm=49} crc {auth=2064839335,config=692619927,health=3645331052,kv=3101636042,logm=3881406231}) 2026-02-17T12:08:43.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=3797656961,config=692619927,health=1442407819,kv=1542691753,logm=2256440985}) 2026-02-17T12:08:43.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=10,logm=49} crc {auth=2064839335,config=692619927,health=3645331052,kv=3101636042,logm=3881406231}) 2026-02-17T12:08:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.004+0000 7fa8d97fa640 1 -- 10.20.193.51:0/1900263258 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa8d4053c00 con 0x7fa8e40a0750 2026-02-17T12:08:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.004+0000 7fa8d97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:08:43.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.004+0000 7fa8d97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=30,config=2,health=12,kv=12,logm=44} crc {auth=4207396976,config=692619927,health=1442407819,kv=643764953,logm=3022671122}) 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3647353812}) 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2972512844}) 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3647353812}) 2026-02-17T12:08:43.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3486837262}) 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 msgr2=0x7fa8b40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 0x7fa8b40401d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4133a70 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 10 monclient: shutdown 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 msgr2=0x7fa8e409b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d40047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 shutdown_connections 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa8b403dd10 0x7fa8b40401d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:43.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa8e413b760 0x7fa8e41322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa8e40a3bb0 0x7fa8e409bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 --2- 10.20.193.51:0/1900263258 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa8e40a0750 0x7fa8e409b740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 >> 10.20.193.51:0/1900263258 conn(0x7fa8e40a30c0 msgr2=0x7fa8e413adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 shutdown_connections 2026-02-17T12:08:43.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:43.005+0000 7fa8eadb6640 1 -- 10.20.193.51:0/1900263258 wait complete. 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2549238593}) 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=888195927}) 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2549238593}) 2026-02-17T12:08:43.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2779333659}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598130608}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2167213025}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598130608}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=685465916}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3912961392}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2696146821}) 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.016 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3912961392}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=293492729}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=974758091}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3658774436}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=974758091}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3011861511}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1176917296}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3120399444}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1176917296}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3620309594}) 2026-02-17T12:08:43.017 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3291732914}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=633540600}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3291732914}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=732981327}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=668273199}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3837202010}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=668273199}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3342834411}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=490559593}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3605985190}) 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.018 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=490559593}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3956642821}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1333737398}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2827378218}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1333737398}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4161611777}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958571439}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3247448338}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958571439}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=127828389}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866386102}) 2026-02-17T12:08:43.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3495198024}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1866386102}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3828184294}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3178316169}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3544398649}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3178316169}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=482092080}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614708605}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1077234766}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614708605}) 2026-02-17T12:08:43.020 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2440555916}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2572416067}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=940871526}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2572416067}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4075653575}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3924210824}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3696705080}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3924210824}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2485991312}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049878048}) 2026-02-17T12:08:43.021 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2234243956}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049878048}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4188805081}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985916320}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4191569699}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985916320}) 2026-02-17T12:08:43.022 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3316378399}) 2026-02-17T12:08:43.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807878406}) 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3973546875}) 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807878406}) 2026-02-17T12:08:43.425 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1522174651}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75760769}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4267425750}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75760769}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.423+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1769337278}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4196318215}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2735404059}) 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.426 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4196318215}) 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=437520445}) 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907156536}) 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1545017011}) 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907156536}) 2026-02-17T12:08:43.427 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.424+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=419702684}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465182451}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1255163113}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465182451}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1662955122}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4089252485}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2452612449}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4089252485}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=350374547}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3448404100}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3819046135}) 2026-02-17T12:08:43.428 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3448404100}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.425+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4017789195}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2515049106}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1157265029}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2515049106}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3071663918}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671945626}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2713868988}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671945626}) 2026-02-17T12:08:43.429 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.426+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=129888067}) 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=15585488}) 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2887147465}) 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=15585488}) 2026-02-17T12:08:43.430 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1236088359}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=707641068}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3663794440}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=707641068}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=328650065}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092599212}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2473806164}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092599212}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.427+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2152115560}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302566720}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3606457703}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302566720}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=491445167}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=893518771}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2606201618}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=893518771}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.428+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=600858503}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026494120}) 2026-02-17T12:08:43.431 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3755754771}) 2026-02-17T12:08:43.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026494120}) 2026-02-17T12:08:43.432 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=471712399}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2372881878}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2761656206}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2372881878}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=53056698}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4204120100}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=581114209}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4204120100}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.429+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1588474114}) 2026-02-17T12:08:43.433 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1716697263}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=990546361}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1716697263}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968566075}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3217372514}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2639572395}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3217372514}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2792669986}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3511143172}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=988153226}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3511143172}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.430+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2159747123}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1244429097}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4151402778}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1244429097}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1791407502}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3105783981}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=190637870}) 2026-02-17T12:08:43.434 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3105783981}) 2026-02-17T12:08:43.435 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.431+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1004570439}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3650851489}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2120534981}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3650851489}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3998625785}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1452370286}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2922308494}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1452370286}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1045346599}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021024844}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4121600887}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021024844}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.432+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1953988545}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910605432}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1026518185}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910605432}) 2026-02-17T12:08:43.437 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2948237816}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117954954}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3878583979}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117954954}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=116014974}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913291896}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1949211993}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913291896}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.433+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=606159554}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714419755}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=328780236}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714419755}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1878705591}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585278138}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2444706099}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585278138}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1974664940}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.434+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=262921623}) 2026-02-17T12:08:43.438 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=294449758}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=262921623}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2939385050}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233745706}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4265486649}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233745706}) 2026-02-17T12:08:43.439 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2208922864}) 2026-02-17T12:08:43.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220408794}) 2026-02-17T12:08:43.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=111665956}) 2026-02-17T12:08:43.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.441 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4220408794}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.435+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1520903070}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2325156713}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=245323907}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2325156713}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2420893059}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180866451}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=190020247}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1180866451}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650331987}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=309799041}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3291291058}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=309799041}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4266962814}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674380558}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=93592342}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674380558}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3087899007}) 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.442 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360922310}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=968143585}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360922310}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=402660893}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1790050587}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1778117003}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1790050587}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.437+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=261954029}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3989440716}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1673514810}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3989440716}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2319096182}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1509248521}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2236022113}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1509248521}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=136453790}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066638864}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=496238001}) 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.443 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066638864}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.438+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3793077}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3282094746}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2605520587}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3282094746}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=779022084}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=954762768}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2536206243}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=954762768}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.439+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1381292879}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653253241}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2116903295}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653253241}) 2026-02-17T12:08:43.444 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2392628990}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3564719851}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2060595541}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3564719851}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3458041413}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739947680}) 2026-02-17T12:08:43.445 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1170408129}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739947680}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.440+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1274356891}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149894395}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4127145744}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149894395}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4283432130}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4085946409}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3831218971}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4085946409}) 2026-02-17T12:08:43.446 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.441+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=633236779}) 2026-02-17T12:08:43.719 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.720 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2621460299}) 2026-02-17T12:08:43.720 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1201411842}) 2026-02-17T12:08:43.720 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.720 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2621460299}) 2026-02-17T12:08:43.720 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.716+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1370255134}) 2026-02-17T12:08:43.722 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.722 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4196695521}) 2026-02-17T12:08:43.722 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1779254010}) 2026-02-17T12:08:43.723 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.723 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4196695521}) 2026-02-17T12:08:43.723 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.719+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1024938888}) 2026-02-17T12:08:43.724 INFO:tasks.rados.rados.0.trial142.stdout:3638: done (3 left) 2026-02-17T12:08:43.724 INFO:tasks.rados.rados.0.trial142.stdout:3639: read oid 8 snap -1 2026-02-17T12:08:43.724 INFO:tasks.rados.rados.0.trial142.stdout:3639: expect (ObjNum 1170 snap 378 seq_num 1170) 2026-02-17T12:08:43.724 INFO:tasks.rados.rados.0.trial142.stdout:3640: read oid 50 snap 400 2026-02-17T12:08:43.724 INFO:tasks.rados.rados.0.trial142.stdout:3640: expect deleted 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3641: rollback oid 33 current snap is 407 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 392 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: finishing write tid 2 to trial14245205-39 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: finishing write tid 3 to trial14245205-39 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: finishing write tid 4 to trial14245205-39 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: oid 39 updating version 0 to 2721 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: oid 39 updating version 2721 to 2723 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: oid 39 version 2723 is already newer than 2722 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2723 (ObjNum 1238 snap 407 seq_num 1238) dirty exists 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3633: left oid 39 (ObjNum 1238 snap 407 seq_num 1238) 2026-02-17T12:08:43.725 INFO:tasks.rados.rados.0.trial142.stdout:3635: finishing rollback tid 1 to trial14245205-31 2026-02-17T12:08:43.726 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:08:43.726 INFO:tasks.rados.rados.0.trial142.stdout:3637: expect (ObjNum 1217 snap 405 seq_num 1217) 2026-02-17T12:08:43.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789041812}) 2026-02-17T12:08:43.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1273118054}) 2026-02-17T12:08:43.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789041812}) 2026-02-17T12:08:43.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.727+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3060331494}) 2026-02-17T12:08:43.806 INFO:tasks.rados.rados.0.trial142.stdout:3639: expect (ObjNum 1170 snap 378 seq_num 1170) 2026-02-17T12:08:43.892 INFO:tasks.rados.rados.0.trial142.stdout:3641: finishing rollback tid 0 to trial14245205-33 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3641: finishing rollback tid 1 to trial14245205-33 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3633: done (5 left) 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3635: done (4 left) 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3637: done (3 left) 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3639: done (2 left) 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3640: done (1 left) 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3642: delete oid 15 current snap is 407 2026-02-17T12:08:43.893 INFO:tasks.rados.rados.0.trial142.stdout:3641: finishing rollback tid 2 to trial14245205-33 2026-02-17T12:08:43.894 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 3112 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3641: done (1 left) 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3642: done (0 left) 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3643: read oid 25 snap 381 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3643: expect deleted 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3644: read oid 30 snap 406 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3644: expect (ObjNum 1111 snap 361 seq_num 1111) 2026-02-17T12:08:43.895 INFO:tasks.rados.rados.0.trial142.stdout:3645: delete oid 47 current snap is 407 2026-02-17T12:08:43.897 INFO:tasks.rados.rados.0.trial142.stdout:3643: done (2 left) 2026-02-17T12:08:43.897 INFO:tasks.rados.rados.0.trial142.stdout:3645: done (1 left) 2026-02-17T12:08:43.897 INFO:tasks.rados.rados.0.trial142.stdout:3646: write (excl) oid 16 current snap is 407 2026-02-17T12:08:43.897 INFO:tasks.rados.rados.0.trial142.stdout:3646: seq_num 1241 ranges {457487=749548,1770389=484435,2746287=111200} 2026-02-17T12:08:43.901 INFO:tasks.rados.rados.0.trial142.stdout:3646: writing trial14245205-16 from 457487 to 1207035 tid 1 2026-02-17T12:08:43.905 INFO:tasks.rados.rados.0.trial142.stdout:3646: writing trial14245205-16 from 1770389 to 2254824 tid 2 2026-02-17T12:08:43.908 INFO:tasks.rados.rados.0.trial142.stdout:3646: writing trial14245205-16 from 2746287 to 2857487 tid 3 2026-02-17T12:08:43.908 INFO:tasks.rados.rados.0.trial142.stdout:3647: read oid 15 snap -1 2026-02-17T12:08:43.908 INFO:tasks.rados.rados.0.trial142.stdout:3647: expect deleted 2026-02-17T12:08:43.908 INFO:tasks.rados.rados.0.trial142.stdout:3648: delete oid 7 current snap is 407 2026-02-17T12:08:43.908 INFO:tasks.rados.rados.0.trial142.stdout:3644: expect (ObjNum 1111 snap 361 seq_num 1111) 2026-02-17T12:08:43.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1745805954}) 2026-02-17T12:08:43.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1266599580}) 2026-02-17T12:08:43.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1745805954}) 2026-02-17T12:08:43.942 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1893775811}) 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1270045966}) 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=955467325}) 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1270045966}) 2026-02-17T12:08:43.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:43.944+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=106642985}) 2026-02-17T12:08:44.024 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:08:44.024 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:44.031 INFO:tasks.rados.rados.0.trial142.stdout:3646: finishing write tid 1 to trial14245205-16 2026-02-17T12:08:44.031 INFO:tasks.rados.rados.0.trial142.stdout:3646: finishing write tid 2 to trial14245205-16 2026-02-17T12:08:44.031 INFO:tasks.rados.rados.0.trial142.stdout:3644: done (3 left) 2026-02-17T12:08:44.031 INFO:tasks.rados.rados.0.trial142.stdout:3648: done (2 left) 2026-02-17T12:08:44.031 INFO:tasks.rados.rados.0.trial142.stdout:3649: delete oid 35 current snap is 407 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: finishing write tid 3 to trial14245205-16 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: finishing write tid 4 to trial14245205-16 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: finishing write tid 5 to trial14245205-16 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: oid 16 updating version 0 to 2566 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: oid 16 version 2566 is already newer than 2565 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: oid 16 version 2566 is already newer than 2564 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: oid 16 updating version 2566 to 2567 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 2567 (ObjNum 1241 snap 407 seq_num 1241) dirty exists 2026-02-17T12:08:44.032 INFO:tasks.rados.rados.0.trial142.stdout:3646: left oid 16 (ObjNum 1241 snap 407 seq_num 1241) 2026-02-17T12:08:44.033 INFO:tasks.rados.rados.0.trial142.stdout:3646: done (2 left) 2026-02-17T12:08:44.033 INFO:tasks.rados.rados.0.trial142.stdout:3647: done (1 left) 2026-02-17T12:08:44.033 INFO:tasks.rados.rados.0.trial142.stdout:3649: done (0 left) 2026-02-17T12:08:44.033 INFO:tasks.rados.rados.0.trial142.stdout:3650: read oid 38 snap -1 2026-02-17T12:08:44.033 INFO:tasks.rados.rados.0.trial142.stdout:3650: expect (ObjNum 1237 snap 407 seq_num 1237) 2026-02-17T12:08:44.034 INFO:tasks.rados.rados.0.trial142.stdout:3651: delete oid 17 current snap is 407 2026-02-17T12:08:44.034 INFO:tasks.rados.rados.0.trial142.stdout:3651: done (1 left) 2026-02-17T12:08:44.034 INFO:tasks.rados.rados.0.trial142.stdout:3652: snap_remove snap 400 2026-02-17T12:08:44.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: get_monmap_and_config 2026-02-17T12:08:44.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: monmap: 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:44.092306+0000 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:44.092306+0000 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:44.096 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 1 Processor -- start 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 1 -- start start 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: init 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.090+0000 7f25d39e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-c con 0x7f25cc0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:44.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f25cc09e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc06e140 con 0x7f25cc09e540 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0a3f90 con 0x7f25cc0a3bb0 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc09f910 con 0x7f25cc0a0750 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d39e6640 10 monclient(hunting): authenticate will time out at 2011.711038s 2026-02-17T12:08:44.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46132/0 (socket says 10.20.193.51:46132) 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 -- 10.20.193.51:0/98585282 learned_addr learned my addr 10.20.193.51:0/98585282 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): get_auth_request con 0x7f25cc0a0750 auth_method 0 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d175b640 1 --2- 10.20.193.51:0/98585282 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_done global_id 234569 payload 274 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 -- 10.20.193.51:0/98585282 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a3bb0 msgr2=0x7f25cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 --2- 10.20.193.51:0/98585282 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 -- 10.20.193.51:0/98585282 >> v1:10.20.193.142:6789/0 conn(0x7f25cc09e540 legacy=0x7f25cc13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 monclient: found mon.noname-b 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.091+0000 7f25d0f5a640 1 -- 10.20.193.51:0/98585282 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc09ccd0 con 0x7f25cc0a0750 2026-02-17T12:08:44.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3412677436}) 2026-02-17T12:08:44.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1800611561}) 2026-02-17T12:08:44.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3412677436}) 2026-02-17T12:08:44.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3028511089}) 2026-02-17T12:08:44.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.093+0000 7f25d0f5a640 1 -- 10.20.193.51:0/98585282 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 msgr2=0x7f25cc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.093+0000 7f25d0f5a640 1 --2- 10.20.193.51:0/98585282 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25cc06c1c0 tx=0x7f25c002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd1cbc215e96555b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.103 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 1 -- 10.20.193.51:0/98585282 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c003c070 con 0x7f25cc0a0750 2026-02-17T12:08:44.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=480347661}) 2026-02-17T12:08:44.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:08:44.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3018832408}) 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: dump: 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.105 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 1 -- 10.20.193.51:0/98585282 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c002fd80 con 0x7f25cc0a0750 2026-02-17T12:08:44.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 5 monclient: authenticate success, global_id 234569 2026-02-17T12:08:44.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=480347661}) 2026-02-17T12:08:44.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:44.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 4 set_mon_vals no callback set 2026-02-17T12:08:44.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 1 -- 10.20.193.51:0/98585282 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0037660 con 0x7f25cc0a0750 2026-02-17T12:08:44.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.108 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1307603468}) 2026-02-17T12:08:44.109 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25bbfff640 10 monclient: dump: 2026-02-17T12:08:44.109 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.109 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 10 monclient: shutdown 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- 10.20.193.51:0/98585282 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 msgr2=0x7f25cc09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.110 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 --2- 10.20.193.51:0/98585282 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25cc06c1c0 tx=0x7f25c002ee60 comp rx=0 tx=0).stop 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- 10.20.193.51:0/98585282 shutdown_connections 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 --2- 10.20.193.51:0/98585282 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc09e000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 --2- 10.20.193.51:0/98585282 >> v2:10.20.193.142:3300/0 conn(0x7f25cc0a3bb0 0x7f25cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- 10.20.193.51:0/98585282 >> 10.20.193.51:0/98585282 conn(0x7f25cc0a30c0 msgr2=0x7f25cc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- 10.20.193.51:0/98585282 shutdown_connections 2026-02-17T12:08:44.111 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- 10.20.193.51:0/98585282 wait complete. 2026-02-17T12:08:44.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3808398996}) 2026-02-17T12:08:44.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2446743553}) 2026-02-17T12:08:44.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3808398996}) 2026-02-17T12:08:44.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=194137101}) 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 10 monclient: monmap: 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.113 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:44.114 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:44.114 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:44.114 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 Processor -- start 2026-02-17T12:08:44.114 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1688098684}) 2026-02-17T12:08:44.115 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2107846370}) 2026-02-17T12:08:44.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 1 -- start start 2026-02-17T12:08:44.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.094+0000 7f25d39e6640 10 monclient: init 2026-02-17T12:08:44.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1688098684}) 2026-02-17T12:08:44.116 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=859375558}) 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc1381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-a con 0x7f25cc09e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-c con 0x7f25cc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a3bb0 0x7f25cc130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0a04b0 con 0x7f25cc09e540 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc09c850 con 0x7f25cc0a3bb0 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc13de80 con 0x7f25cc0a0750 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d39e6640 10 monclient(hunting): authenticate will time out at 2011.715264s 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46146/0 (socket says 10.20.193.51:46146) 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 -- 10.20.193.51:0/4276223206 learned_addr learned my addr 10.20.193.51:0/4276223206 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc1381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): get_auth_request con 0x7f25cc0a0750 auth_method 0 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): get_auth_request con 0x7f25cc09e540 auth_method 0 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274611196}) 2026-02-17T12:08:44.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3552671411}) 2026-02-17T12:08:44.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.121 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274611196}) 2026-02-17T12:08:44.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.122 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3034883900}) 2026-02-17T12:08:44.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d175b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d1f5c640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a3bb0 0x7f25cc130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d1f5c640 10 monclient(hunting): get_auth_request con 0x7f25cc0a3bb0 auth_method 0 2026-02-17T12:08:44.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d1f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d1f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d1f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient(hunting): handle_auth_done global_id 234572 payload 824 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 -- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a3bb0 msgr2=0x7f25cc130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a3bb0 0x7f25cc130530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 -- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 msgr2=0x7f25cc1381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc1381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 monclient: found mon.noname-c 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.095+0000 7f25d0f5a640 1 -- 10.20.193.51:0/4276223206 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc1337a0 con 0x7f25cc0a0750 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d0f5a640 1 -- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 msgr2=0x7f25cc12fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d0f5a640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25c0002410 tx=0x7f25c0004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.125 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.125 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851346341}) 2026-02-17T12:08:44.125 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1913154295}) 2026-02-17T12:08:44.125 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.125 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851346341}) 2026-02-17T12:08:44.126 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2860806665}) 2026-02-17T12:08:44.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c003c040 con 0x7f25cc0a0750 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: dump: 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.127 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 5 monclient: authenticate success, global_id 234572 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0047070 con 0x7f25cc0a0750 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 10 monclient: _renew_subs 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc131f10 con 0x7f25cc0a0750 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0042890 con 0x7f25cc0a0750 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25b9ffb640 10 monclient: dump: 2026-02-17T12:08:44.128 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25bb7fe640 4 set_mon_vals no callback set 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 10 monclient: _renew_subs 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.097+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc09d7b0 con 0x7f25cc0a0750 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058286419}) 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2234386219}) 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058286419}) 2026-02-17T12:08:44.130 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3414486159}) 2026-02-17T12:08:44.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d39e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d39e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d39e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc09dac0 con 0x7f25cc0a0750 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95562762}) 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3937202026}) 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95562762}) 2026-02-17T12:08:44.132 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2498118327}) 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f25c0042a70 con 0x7f25cc0a0750 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25b9ffb640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 0x7f259c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f25c0078420 con 0x7f25cc0a0750 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d175b640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 0x7f259c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.098+0000 7f25d175b640 10 monclient: get_auth_request con 0x7f259c03dd10 auth_method 0 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.101+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f25c004b3c0 con 0x7f25cc0a0750 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.101+0000 7f25b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.101+0000 7f25b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2270128008}) 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2213482433}) 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2270128008}) 2026-02-17T12:08:44.134 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1180769806}) 2026-02-17T12:08:44.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.101+0000 7f25d175b640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 0x7f259c0401d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006fd0 tx=0x7f25bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974192002}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4131644251}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974192002}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2104599420}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=993722016}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4210482516}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=993722016}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1287223978}) 2026-02-17T12:08:44.145 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1093461795}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1127851588}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1093461795}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1337231807}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1399426686}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3623786244}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1399426686}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.102+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=759370271}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222121390}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1090560604}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222121390}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=338632748}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=122833325}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2472489080}) 2026-02-17T12:08:44.146 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=122833325}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.103+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=8114755}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3276846172}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1941704895}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3276846172}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.110+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2522419919}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2945814657}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=415402746}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2945814657}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1939328269}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770783352}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2456781851}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1770783352}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.111+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=219594527}) 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.147 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059650816}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=30889949}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059650816}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1978980836}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492672137}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=552804894}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492672137}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2540907886}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3067277430}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=930246190}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3067277430}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.112+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2363741519}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175211075}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2438918493}) 2026-02-17T12:08:44.148 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175211075}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=403816498}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2825167504}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=515211476}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2825167504}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3651047656}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2305648116}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=44450558}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2305648116}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.113+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1773192195}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359367923}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1085653370}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359367923}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1313770520}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1545864612}) 2026-02-17T12:08:44.149 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3617280568}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1545864612}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2035514252}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635261963}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1833565499}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635261963}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3796789278}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3608157978}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1816694913}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3608157978}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.114+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=90530863}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3091285814}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=468628550}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3091285814}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2043474000}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463414410}) 2026-02-17T12:08:44.150 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2506650011}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463414410}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4240288806}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3776017528}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3008121698}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3776017528}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.115+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2306916387}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1841151361}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268972412}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1841151361}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1161749089}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=379601646}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3707039703}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=379601646}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2338549070}) 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.151 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2739826428}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3594603049}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2739826428}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.116+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3930043538}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197997428}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2600580846}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197997428}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1177314943}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=137198528}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1238968265}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=137198528}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=81213219}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864984797}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=604812022}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864984797}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=346713672}) 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.152 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641766993}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2482384201}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641766993}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.117+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2598160934}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=1189605425,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=708721668}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=80,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7} crc {logm=437556335,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3331017110}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=1189605425,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=708721668}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=79,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8} crc {logm=2900451255,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1622008996}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=6,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=73} crc {mgrstat=2731550260,mon_config_key=1527621129,monmap=263989209,osd_metadata=4184050976,osd_pg_creating=697718499,osd_snap=1412416437}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=6,mon_config_key=13,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=72} crc {mgrstat=2731550260,mon_config_key=3390328712,monmap=263989209,osd_metadata=1167792592,osd_pg_creating=697718499,osd_snap=1612656675}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=6,mon_config_key=12,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=73} crc {mgrstat=2731550260,mon_config_key=1527621129,monmap=263989209,osd_metadata=4184050976,osd_pg_creating=697718499,osd_snap=1412416437}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.118+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=6,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=72} crc {mgrstat=2731550260,mon_config_key=1527621129,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=697718499,osd_snap=3283829295}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=3769809909,osdmap=2303819018}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=70,osdmap=30} crc {osd_snap=1157586726,osdmap=827004160}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=3769809909,osdmap=2303819018}) 2026-02-17T12:08:44.153 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=2660208721,osdmap=1964573371}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2816237834}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4089920708}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2816237834}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=694715186}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=523966880}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1906685941}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=523966880}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3039950287}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2075928190}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2355383562}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2075928190}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.119+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=439732230}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1676278767}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2994900371}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1676278767}) 2026-02-17T12:08:44.154 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3735333764}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3025843336}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1291319387}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3025843336}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.120+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4135117773}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3997448770}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2074064454}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3997448770}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.121+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=570332849}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3104663206}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4245450644}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3104663206}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.122+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=926788555}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=1320639205}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=41} crc {osdmap=3942781808}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=1320639205}) 2026-02-17T12:08:44.155 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:08:44.125+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=42} crc {osdmap=3879813022}) 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25d39e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25d39e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25d39e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f25cc0008d0 con 0x7f25cc0a0750 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25b9ffb640 1 -- 10.20.193.51:0/4276223206 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f25c0075e40 con 0x7f25cc0a0750 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.214+0000 7f25b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:44.217 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":218,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 msgr2=0x7f259c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 0x7f259c0401d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006fd0 tx=0x7f25bc008040 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 10 monclient: shutdown 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 msgr2=0x7f25cc12fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25c0002410 tx=0x7f25c0004830 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 shutdown_connections 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f259c03dd10 0x7f259c0401d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f25cc0a3bb0 0x7f25cc130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f25cc0a0750 0x7f25cc12fff0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 --2- 10.20.193.51:0/4276223206 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f25cc09e540 0x7f25cc1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 >> 10.20.193.51:0/4276223206 conn(0x7f25cc0a30c0 msgr2=0x7f25cc0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 shutdown_connections 2026-02-17T12:08:44.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.215+0000 7f25d39e6640 1 -- 10.20.193.51:0/4276223206 wait complete. 2026-02-17T12:08:44.226 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:08:44.227 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:08:44.227 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:08:44.227 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:08:44.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.291+0000 7f560f84d640 10 monclient: get_monmap_and_config 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.291+0000 7f560f84d640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.291+0000 7f560f84d640 10 monclient: monmap: 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:44.293942+0000 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:44.293942+0000 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.298 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 Processor -- start 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 -- start start 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient: init 2026-02-17T12:08:44.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f56080a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 0x7f560809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-b con 0x7f56080a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f560813b760 0x7f560813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-a con 0x7f560813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560806e140 con 0x7f56080a3bb0 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f560809f910 con 0x7f560813b760 2026-02-17T12:08:44.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f560809ccd0 con 0x7f56080a0750 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560f84d640 10 monclient(hunting): authenticate will time out at 2011.912697s 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560d5c2640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f56080a3bb0 0x7f560809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44732/0 (socket says 10.20.193.51:44732) 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560d5c2640 1 -- 10.20.193.51:0/24887650 learned_addr learned my addr 10.20.193.51:0/24887650 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 0x7f560809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): get_auth_request con 0x7f56080a0750 auth_method 0 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 1 --2- 10.20.193.51:0/24887650 >> v2:10.20.193.51:3300/0 conn(0x7f560813b760 0x7f560813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): get_auth_request con 0x7f560813b760 auth_method 0 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560ddc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient(hunting): handle_auth_done global_id 234575 payload 274 2026-02-17T12:08:44.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 -- 10.20.193.51:0/24887650 >> v2:10.20.193.51:3300/0 conn(0x7f560813b760 msgr2=0x7f560813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 --2- 10.20.193.51:0/24887650 >> v2:10.20.193.51:3300/0 conn(0x7f560813b760 0x7f560813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 -- 10.20.193.51:0/24887650 >> v1:10.20.193.51:6789/0 conn(0x7f56080a3bb0 legacy=0x7f560809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 monclient: found mon.noname-b 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.292+0000 7f560cdc1640 1 -- 10.20.193.51:0/24887650 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560809eec0 con 0x7f56080a0750 2026-02-17T12:08:44.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560cdc1640 1 -- 10.20.193.51:0/24887650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 msgr2=0x7f560809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560cdc1640 1 --2- 10.20.193.51:0/24887650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 0x7f560809e1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f560809f230 tx=0x7f55fc02ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b59194effb728ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 1 -- 10.20.193.51:0/24887650 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc03c070 con 0x7f56080a0750 2026-02-17T12:08:44.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: dump: 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.315 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 5 monclient: authenticate success, global_id 234575 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 1 -- 10.20.193.51:0/24887650 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc02fbd0 con 0x7f56080a0750 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 1 -- 10.20.193.51:0/24887650 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc037440 con 0x7f56080a0750 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f55f7fff640 10 monclient: dump: 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.317 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 4 set_mon_vals no callback set 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 10 monclient: shutdown 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 -- 10.20.193.51:0/24887650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 msgr2=0x7f560809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 --2- 10.20.193.51:0/24887650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 0x7f560809e1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f560809f230 tx=0x7f55fc02ed50 comp rx=0 tx=0).stop 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 -- 10.20.193.51:0/24887650 shutdown_connections 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 --2- 10.20.193.51:0/24887650 >> v2:10.20.193.51:3300/0 conn(0x7f560813b760 0x7f560813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 --2- 10.20.193.51:0/24887650 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a0750 0x7f560809e1d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 -- 10.20.193.51:0/24887650 >> 10.20.193.51:0/24887650 conn(0x7f56080a30c0 msgr2=0x7f56080a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 -- 10.20.193.51:0/24887650 shutdown_connections 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.295+0000 7f560f84d640 1 -- 10.20.193.51:0/24887650 wait complete. 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient: monmap: 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.319 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 Processor -- start 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 -- start start 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient: init 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56080a0750 0x7f56081cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-a con 0x7f56080a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 0x7f56081d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-c con 0x7f56080a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f560813b760 0x7f5608131260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): picked mon.noname-b con 0x7f560813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f56080a04b0 con 0x7f56080a0750 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f560809c850 con 0x7f560813b760 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f560809e710 con 0x7f56080a3bb0 2026-02-17T12:08:44.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560f84d640 10 monclient(hunting): authenticate will time out at 2011.916903s 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56080a0750 0x7f56081cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 0x7f56081d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56080a0750 0x7f56081cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42892/0 (socket says 10.20.193.51:42892) 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 1 -- 10.20.193.51:0/3158189316 learned_addr learned my addr 10.20.193.51:0/3158189316 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 10 monclient(hunting): get_auth_request con 0x7f56080a0750 auth_method 0 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560d5c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): get_auth_request con 0x7f56080a3bb0 auth_method 0 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.296+0000 7f560cdc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560ddc3640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f560813b760 0x7f5608131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 10 monclient(hunting): handle_auth_done global_id 234578 payload 824 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f560813b760 msgr2=0x7f5608131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f560813b760 0x7f5608131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56080a0750 msgr2=0x7f56081cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56080a0750 0x7f56081cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 monclient: found mon.noname-c 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560cdc1640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608134a70 con 0x7f56080a3bb0 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560ddc3640 10 monclient: get_auth_request con 0x7f560813b760 auth_method 0 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.297+0000 7f560ddc3640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f560813b760 0x7f5608131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560cdc1640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 msgr2=0x7f56081d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560cdc1640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 0x7f56081d0010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f55fc036000 tx=0x7f55fc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.324 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc046020 con 0x7f56080a3bb0 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: dump: 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.325 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc040800 con 0x7f56080a3bb0 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 5 monclient: authenticate success, global_id 234578 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 10 monclient: _renew_subs 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.326 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560809d7b0 con 0x7f56080a3bb0 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc03c040 con 0x7f56080a3bb0 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f77fe640 4 set_mon_vals no callback set 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f55f5ffb640 10 monclient: dump: 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.327 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 10 monclient: _renew_subs 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5608134d50 con 0x7f56080a3bb0 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.299+0000 7f560f84d640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 0x7f5608131b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f560809dac0 con 0x7f56081317a0 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f55fc03f030 con 0x7f56080a3bb0 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 0x7f5608131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient: get_auth_request con 0x7f56081317a0 auth_method 0 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 10 monclient(hunting): handle_auth_done global_id 274221 payload 824 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560d5c2640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5608132d10 con 0x7f56081317a0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f55f5ffb640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f55d803dd10 0x7f55d80401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f55fc077090 con 0x7f56080a3bb0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560ddc3640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f55d803dd10 0x7f55d80401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.300+0000 7f560ddc3640 10 monclient: get_auth_request con 0x7f55d803dd10 auth_method 0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f560d5c2640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 msgr2=0x7f5608131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f560d5c2640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 0x7f5608131b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ea70 tx=0x7f55f800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f801a070 con 0x7f56081317a0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:44.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 10 monclient: dump: 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f55f800cba0 con 0x7f56081317a0 2026-02-17T12:08:44.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 msgr2=0x7f5608131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 0x7f5608131b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ea70 tx=0x7f55f800ef40 comp rx=0 tx=0).stop 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 msgr2=0x7f5608131b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f55f5ffb640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081317a0 0x7f5608131b80 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ea70 tx=0x7f55f800ef40 comp rx=0 tx=0).stop 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.302+0000 7f560ddc3640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f55d803dd10 0x7f55d80401d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5604007560 tx=0x7f560400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.305+0000 7f560f84d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560f84d640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 0x7f56081daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560f84d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f56080008d0 con 0x7f56081320c0 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 0x7f56081daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient: get_auth_request con 0x7f56081320c0 auth_method 0 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 10 monclient(hunting): handle_auth_done global_id 274224 payload 824 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.306+0000 7f560d5c2640 1 -- 10.20.193.51:0/3158189316 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5608050ac0 con 0x7f56081320c0 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560d5c2640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 msgr2=0x7f56081daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560d5c2640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 0x7f56081daad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55f8017000 tx=0x7f55f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f801a030 con 0x7f56081320c0 2026-02-17T12:08:44.333 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 10 monclient: dump: 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f55f801b040 con 0x7f56081320c0 2026-02-17T12:08:44.334 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 msgr2=0x7f56081daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 0x7f56081daad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55f8017000 tx=0x7f55f8004a40 comp rx=0 tx=0).stop 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 msgr2=0x7f56081daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f55f5ffb640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f56081320c0 0x7f56081daad0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55f8017000 tx=0x7f55f8004a40 comp rx=0 tx=0).stop 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:44.335 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 95666, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 5, 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:44.336 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:44.337 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:44.338 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.339 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.340 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.341 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.342 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.343 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.344 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.345 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:44.346 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f55d803dd10 msgr2=0x7f55d80401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f55d803dd10 0x7f55d80401d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5604007560 tx=0x7f560400b040 comp rx=0 tx=0).stop 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 10 monclient: shutdown 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560ddc3640 1 -- 10.20.193.51:0/3158189316 reap_dead start 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 msgr2=0x7f56081d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 0x7f56081d0010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f55fc036000 tx=0x7f55fc0047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 shutdown_connections 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 --2- 10.20.193.51:0/3158189316 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f56080a3bb0 0x7f56081d0010 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 >> 10.20.193.51:0/3158189316 conn(0x7f56080a30c0 msgr2=0x7f5608139dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 shutdown_connections 2026-02-17T12:08:44.347 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.308+0000 7f560f84d640 1 -- 10.20.193.51:0/3158189316 wait complete. 2026-02-17T12:08:44.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:44.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:08:44.348 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:08:44.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.412+0000 7fc074987640 10 monclient: get_monmap_and_config 2026-02-17T12:08:44.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.412+0000 7fc074987640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.412+0000 7fc074987640 10 monclient: monmap: 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:44.414819+0000 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:44.414819+0000 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 Processor -- start 2026-02-17T12:08:44.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 -- start start 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient: init 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): picked mon.noname-b con 0x7fc06c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc06c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc06c13b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06c06e140 con 0x7fc06c0a0750 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06c09f910 con 0x7fc06c13b760 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c09ccd0 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc074987640 10 monclient(hunting): authenticate will time out at 2012.033628s 2026-02-17T12:08:44.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc071efb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc06c0a0750 0x7fc06c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44748/0 (socket says 10.20.193.51:44748) 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc071efb640 1 -- 10.20.193.51:0/3930618261 learned_addr learned my addr 10.20.193.51:0/3930618261 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 1 --2- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): get_auth_request con 0x7fc06c0a3bb0 auth_method 0 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient(hunting): handle_auth_done global_id 234581 payload 274 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 1 -- 10.20.193.51:0/3930618261 >> v1:10.20.193.142:6789/0 conn(0x7fc06c13b760 legacy=0x7fc06c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 1 -- 10.20.193.51:0/3930618261 >> v1:10.20.193.51:6789/0 conn(0x7fc06c0a0750 legacy=0x7fc06c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 1 monclient: found mon.noname-b 2026-02-17T12:08:44.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.413+0000 7fc0726fc640 1 -- 10.20.193.51:0/3930618261 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c09eec0 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0726fc640 1 -- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 msgr2=0x7fc06c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0726fc640 1 --2- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c09dac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc06c09f230 tx=0x7fc06402eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a327fbb4a34feb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 1 -- 10.20.193.51:0/3930618261 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06403c070 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: dump: 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.427 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 1 -- 10.20.193.51:0/3930618261 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06402fd00 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 5 monclient: authenticate success, global_id 234581 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 1 -- 10.20.193.51:0/3930618261 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064037660 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc0716fa640 10 monclient: dump: 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.428 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 4 set_mon_vals no callback set 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 10 monclient: shutdown 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 -- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 msgr2=0x7fc06c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 --2- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c09dac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc06c09f230 tx=0x7fc06402eda0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 -- 10.20.193.51:0/3930618261 shutdown_connections 2026-02-17T12:08:44.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 --2- 10.20.193.51:0/3930618261 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c09dac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 -- 10.20.193.51:0/3930618261 >> 10.20.193.51:0/3930618261 conn(0x7fc06c0a30c0 msgr2=0x7fc06c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 -- 10.20.193.51:0/3930618261 shutdown_connections 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.416+0000 7fc074987640 1 -- 10.20.193.51:0/3930618261 wait complete. 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient: monmap: 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 Processor -- start 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 -- start start 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient: init 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc06c0a0750 0x7fc06c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): picked mon.noname-b con 0x7fc06c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): picked mon.noname-c con 0x7fc06c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc06c13b760 0x7fc06c130ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): picked mon.noname-a con 0x7fc06c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0a04b0 con 0x7fc06c13b760 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c09c850 con 0x7fc06c0a0750 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c09e710 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc074987640 10 monclient(hunting): authenticate will time out at 2012.037903s 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc072efd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc06c13b760 0x7fc06c130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:46178/0 (socket says 10.20.193.51:46178) 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 1 -- 10.20.193.51:0/990682184 learned_addr learned my addr 10.20.193.51:0/990682184 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 10 monclient(hunting): get_auth_request con 0x7fc06c0a3bb0 auth_method 0 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc071efb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc072efd640 10 monclient(hunting): get_auth_request con 0x7fc06c13b760 auth_method 0 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc072efd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc072efd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.417+0000 7fc072efd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc072efd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc072efd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc072efd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient(hunting): handle_auth_done global_id 234584 payload 824 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc06c0a0750 msgr2=0x7fc06c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc06c0a0750 0x7fc06c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc06c0a0750 0x7fc06c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc06c13b760 msgr2=0x7fc06c130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc06c13b760 0x7fc06c130ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 monclient: found mon.noname-c 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc071efb640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c1385f0 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc072efd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc06c13b760 0x7fc06c130ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc0726fc640 10 monclient: get_auth_request con 0x7fc06c0a0750 auth_method 0 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.418+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc06c0a0750 0x7fc06c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc071efb640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 msgr2=0x7fc06c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc071efb640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c1d0010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c560 tx=0x7fc05800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058007070 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: dump: 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.434 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058007230 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058007620 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc070ef9640 4 set_mon_vals no callback set 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc056ffd640 10 monclient: dump: 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.435 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 5 monclient: authenticate success, global_id 234584 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 monclient: _renew_subs 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c134e50 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 monclient: _renew_subs 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:08:44.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c09d7b0 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 0x7fc06c131400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.420+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c09dac0 con 0x7fc06c1345b0 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 0x7fc06c131400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient: get_auth_request con 0x7fc06c1345b0 auth_method 0 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 10 monclient(hunting): handle_auth_done global_id 234587 payload 824 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc0726fc640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc06c069830 con 0x7fc06c1345b0 2026-02-17T12:08:44.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc05801b400 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc056ffd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc03c03dd10 0x7fc03c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7fc058052450 con 0x7fc06c0a3bb0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc072efd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc03c03dd10 0x7fc03c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.421+0000 7fc072efd640 10 monclient: get_auth_request con 0x7fc03c03dd10 auth_method 0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc0726fc640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 msgr2=0x7fc06c131400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 0x7fc06c131400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc064039000 tx=0x7fc0640047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064047070 con 0x7fc06c1345b0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 10 monclient: dump: 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fc064037db0 con 0x7fc06c1345b0 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 msgr2=0x7fc06c131400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 0x7fc06c131400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc064039000 tx=0x7fc0640047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 msgr2=0x7fc06c131400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.423+0000 7fc056ffd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c1345b0 0x7fc06c131400 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc064039000 tx=0x7fc0640047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.424+0000 7fc072efd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc03c03dd10 0x7fc03c0401d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d5e0 tx=0x7fc060004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc074987640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc074987640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 0x7fc06c1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc074987640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c050ac0 con 0x7fc06c131940 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 0x7fc06c1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient: get_auth_request con 0x7fc06c131940 auth_method 0 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 10 monclient(hunting): handle_auth_done global_id 234590 payload 824 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.426+0000 7fc0726fc640 1 -- 10.20.193.51:0/990682184 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc06c133890 con 0x7fc06c131940 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc0726fc640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 msgr2=0x7fc06c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc0726fc640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 0x7fc06c1daad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc064006de0 tx=0x7fc064009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064058020 con 0x7fc06c131940 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc056ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.428+0000 7fc056ffd640 10 monclient: dump: 2026-02-17T12:08:44.442 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fc064043660 con 0x7fc06c131940 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 msgr2=0x7fc06c1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 0x7fc06c1daad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc064006de0 tx=0x7fc064009290 comp rx=0 tx=0).stop 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 msgr2=0x7fc06c1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc056ffd640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c131940 0x7fc06c1daad0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc064006de0 tx=0x7fc064009290 comp rx=0 tx=0).stop 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 301424, 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:44.444 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.445 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.446 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:44.447 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.448 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.449 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.450 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.451 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:44.452 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "num": 7 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.453 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:44.454 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc03c03dd10 msgr2=0x7fc03c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc03c03dd10 0x7fc03c0401d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d5e0 tx=0x7fc060004200 comp rx=0 tx=0).stop 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 10 monclient: shutdown 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 msgr2=0x7fc06c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 --2- 10.20.193.51:0/990682184 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc06c0a3bb0 0x7fc06c1d0010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c560 tx=0x7fc05800ca30 comp rx=0 tx=0).stop 2026-02-17T12:08:44.455 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc072efd640 1 -- 10.20.193.51:0/990682184 reap_dead start 2026-02-17T12:08:44.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc072efd640 1 -- 10.20.193.51:0/990682184 reap_dead start 2026-02-17T12:08:44.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 shutdown_connections 2026-02-17T12:08:44.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 >> 10.20.193.51:0/990682184 conn(0x7fc06c0a30c0 msgr2=0x7fc06c13a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 shutdown_connections 2026-02-17T12:08:44.456 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.429+0000 7fc074987640 1 -- 10.20.193.51:0/990682184 wait complete. 2026-02-17T12:08:44.456 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:44.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:08:44.456 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:08:44.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 10 monclient: get_monmap_and_config 2026-02-17T12:08:44.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 10 monclient: monmap: 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:44.523337+0000 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:44.523337+0000 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:44.527 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 1 Processor -- start 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 1 -- start start 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.521+0000 7f16ac696640 10 monclient: init 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f16a40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16a40a0750 0x7f16a409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-a con 0x7f16a40a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-b con 0x7f16a413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a406e140 con 0x7f16a40a3bb0 2026-02-17T12:08:44.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f16a409f910 con 0x7f16a40a0750 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f16a409ccd0 con 0x7f16a413b760 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16ac696640 10 monclient(hunting): authenticate will time out at 2012.142086s 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16a40a0750 0x7f16a409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f16a40a0750 0x7f16a409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42924/0 (socket says 10.20.193.51:42924) 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 -- 10.20.193.51:0/2638455207 learned_addr learned my addr 10.20.193.51:0/2638455207 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): get_auth_request con 0x7f16a40a0750 auth_method 0 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aa40b640 1 --1- 10.20.193.51:0/2638455207 >> v1:10.20.193.51:6789/0 conn(0x7f16a40a3bb0 0x7f16a409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44758/0 (socket says 10.20.193.51:44758) 2026-02-17T12:08:44.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): get_auth_request con 0x7f16a413b760 auth_method 0 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_done global_id 274230 payload 274 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 -- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 msgr2=0x7f16a413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 --2- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 -- 10.20.193.51:0/2638455207 >> v1:10.20.193.51:6789/0 conn(0x7f16a40a3bb0 legacy=0x7f16a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 monclient: found mon.noname-a 2026-02-17T12:08:44.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.522+0000 7f16a9c0a640 1 -- 10.20.193.51:0/2638455207 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a409eec0 con 0x7f16a40a0750 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9c0a640 1 -- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a0750 msgr2=0x7f16a409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9c0a640 1 --2- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a0750 0x7f16a409e1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16a406f3c0 tx=0x7f169802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea4064b8aa68d4e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 1 -- 10.20.193.51:0/2638455207 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169803c070 con 0x7f16a40a0750 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:44.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: dump: 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 1 -- 10.20.193.51:0/2638455207 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169802fca0 con 0x7f16a40a0750 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16ac696640 5 monclient: authenticate success, global_id 274230 2026-02-17T12:08:44.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16ac696640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 1 -- 10.20.193.51:0/2638455207 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698037660 con 0x7f16a40a0750 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16a9409640 10 monclient: dump: 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16ac696640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.524+0000 7f16ac696640 4 set_mon_vals no callback set 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 10 monclient: shutdown 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a0750 msgr2=0x7f16a409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 --2- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a0750 0x7f16a409e1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16a406f3c0 tx=0x7f169802ee60 comp rx=0 tx=0).stop 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- 10.20.193.51:0/2638455207 shutdown_connections 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 --2- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 --2- 10.20.193.51:0/2638455207 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a0750 0x7f16a409e1d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- 10.20.193.51:0/2638455207 >> 10.20.193.51:0/2638455207 conn(0x7f16a40a30c0 msgr2=0x7f16a40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- 10.20.193.51:0/2638455207 shutdown_connections 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- 10.20.193.51:0/2638455207 wait complete. 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 10 monclient: monmap: 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:44.539 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 Processor -- start 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 1 -- start start 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.525+0000 7f16ac696640 10 monclient: init 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a40a0750 0x7f16a4090d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-b con 0x7f16a40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 0x7f16a40912b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-a con 0x7f16a40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a40917f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): picked mon.noname-c con 0x7f16a413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40a04b0 con 0x7f16a40a3bb0 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16a409c850 con 0x7f16a40a0750 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f16a409e710 con 0x7f16a413b760 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16ac696640 10 monclient(hunting): authenticate will time out at 2012.146279s 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 0x7f16a40912b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 0x7f16a40912b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42938/0 (socket says 10.20.193.51:42938) 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 -- 10.20.193.51:0/3162254853 learned_addr learned my addr 10.20.193.51:0/3162254853 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): get_auth_request con 0x7f16a40a3bb0 auth_method 0 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a40917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): get_auth_request con 0x7f16a413b760 auth_method 0 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16aac0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient(hunting): handle_auth_done global_id 274233 payload 824 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 msgr2=0x7f16a40917f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f16a413b760 0x7f16a40917f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a40a0750 msgr2=0x7f16a4090d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a40a0750 0x7f16a4090d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 monclient: found mon.noname-a 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.526+0000 7f16a9c0a640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a4094690 con 0x7f16a40a3bb0 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16a9c0a640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 msgr2=0x7f16a40912b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16a9c0a640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 0x7f16a40912b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1698002410 tx=0x7f16980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698046020 con 0x7f16a40a3bb0 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: dump: 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.543 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169802fe50 con 0x7f16a40a3bb0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 5 monclient: authenticate success, global_id 274233 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 10 monclient: _renew_subs 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a4094970 con 0x7f16a40a3bb0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169803c040 con 0x7f16a40a3bb0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16a8c08640 4 set_mon_vals no callback set 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f168affd640 10 monclient: dump: 2026-02-17T12:08:44.544 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 10 monclient: _renew_subs 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.528+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a40a2be0 con 0x7f16a40a3bb0 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16ac696640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16ac696640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16a406ff20 con 0x7f16a408d3f0 2026-02-17T12:08:44.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient: get_auth_request con 0x7f16a408d3f0 auth_method 0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f169803f030 con 0x7f16a40a3bb0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f168affd640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f167403dd10 0x7f16740401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 10 monclient(hunting): handle_auth_done global_id 284107 payload 824 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16a409d7b0 con 0x7f16a408d3f0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f1698077360 con 0x7f16a40a3bb0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 msgr2=0x7f16a408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aac0c640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f167403dd10 0x7f16740401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 msgr2=0x7f16a408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f169400c3d0 tx=0x7f169400c8a0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:44.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aac0c640 10 monclient: get_auth_request con 0x7f167403dd10 auth_method 0 2026-02-17T12:08:44.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.529+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:44.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.532+0000 7f16aac0c640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f167403dd10 0x7f16740401d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f16a40742c0 tx=0x7f16a000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.733 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: get_auth_request con 0x7f16a408d3f0 auth_method 0 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: _init_auth method 2 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: _init_auth already have auth, reseting 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: handle_auth_reply_more payload 9 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:44.734 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.730+0000 7f16aa40b640 10 monclient: handle_auth_done global_id 284107 payload 293 2026-02-17T12:08:44.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 msgr2=0x7f16a408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.736 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f169400cfd0 tx=0x7f1694007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694005b20 con 0x7f16a408d3f0 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 10 monclient: dump: 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.737 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f1694007590 con 0x7f16a408d3f0 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 msgr2=0x7f16a408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f169400cfd0 tx=0x7f1694007ee0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 msgr2=0x7f16a408d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.733+0000 7f168affd640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408d3f0 0x7f16a408d7d0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f169400cfd0 tx=0x7f1694007ee0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.736+0000 7f16ac696640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:44.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.736+0000 7f16ac696640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 0x7f16a41d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.736+0000 7f16ac696640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.740 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.736+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16a409dac0 con 0x7f16a408dd10 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 0x7f16a41d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient: get_auth_request con 0x7f16a408dd10 auth_method 0 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 10 monclient(hunting): handle_auth_done global_id 284110 payload 824 2026-02-17T12:08:44.741 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.737+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16a4092ac0 con 0x7f16a408dd10 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f16aa40b640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 msgr2=0x7f16a41d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f16aa40b640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 0x7f16a41d7890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1694005fd0 tx=0x7f1694004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694015440 con 0x7f16a408dd10 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 10 monclient: dump: 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.743 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f1694015440 con 0x7f16a408dd10 2026-02-17T12:08:44.744 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 msgr2=0x7f16a41d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 0x7f16a41d7890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1694005fd0 tx=0x7f1694004a30 comp rx=0 tx=0).stop 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 msgr2=0x7f16a41d7890 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.739+0000 7f168affd640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f16a408dd10 0x7f16a41d7890 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1694005fd0 tx=0x7f1694004a30 comp rx=0 tx=0).stop 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:44.745 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 218, 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 26971, 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.746 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.747 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.748 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:44.749 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:44.750 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:44.751 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:44.752 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:44.753 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.754 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:44.755 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:44.756 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:44.757 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.758 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:44.759 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:44.760 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:44.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f167403dd10 msgr2=0x7f16740401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f167403dd10 0x7f16740401d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f16a40742c0 tx=0x7f16a000b040 comp rx=0 tx=0).stop 2026-02-17T12:08:44.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 10 monclient: shutdown 2026-02-17T12:08:44.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 msgr2=0x7f16a40912b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 --2- 10.20.193.51:0/3162254853 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f16a40a3bb0 0x7f16a40912b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1698002410 tx=0x7f16980047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16aac0c640 1 -- 10.20.193.51:0/3162254853 reap_dead start 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16aac0c640 1 -- 10.20.193.51:0/3162254853 reap_dead start 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 shutdown_connections 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 >> 10.20.193.51:0/3162254853 conn(0x7f16a40a30c0 msgr2=0x7f16a40a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 shutdown_connections 2026-02-17T12:08:44.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.740+0000 7f16ac696640 1 -- 10.20.193.51:0/3162254853 wait complete. 2026-02-17T12:08:44.764 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:08:44.764 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T12:08:44.764 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:08:44.764 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T12:08:44.764 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:08:44.765 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:08:44.765 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:08:44.777 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:08:44.777 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:08:44.778 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:44.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.880+0000 7fc993dd6640 10 monclient: get_monmap_and_config 2026-02-17T12:08:44.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.880+0000 7fc993dd6640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.880+0000 7fc993dd6640 10 monclient: monmap: 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:44.882596+0000 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:44.882596+0000 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:44.897 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.880+0000 7fc993dd6640 1 Processor -- start 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 -- start start 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient: init 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc98c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fc98c0a0750 0x7fc98c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-c con 0x7fc98c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-b con 0x7fc98c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c06e140 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc98c09f910 con 0x7fc98c0a0750 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c09ccd0 con 0x7fc98c13b760 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc993dd6640 10 monclient(hunting): authenticate will time out at 2012.501329s 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99234c640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 msgr2=0x7fc98c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99234c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc991b4b640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fc98c0a3bb0 0x7fc98c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44766/0 (socket says 10.20.193.51:44766) 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc991b4b640 1 -- 10.20.193.51:0/2874048532 learned_addr learned my addr 10.20.193.51:0/2874048532 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:44.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 1 --2- 10.20.193.51:0/2874048532 >> v2:10.20.193.142:3300/0 conn(0x7fc98c0a0750 0x7fc98c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): get_auth_request con 0x7fc98c0a0750 auth_method 0 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.881+0000 7fc99134a640 10 monclient(hunting): handle_auth_done global_id 284113 payload 274 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 1 -- 10.20.193.51:0/2874048532 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 msgr2=0x7fc98c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 1 --2- 10.20.193.51:0/2874048532 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c13db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 1 -- 10.20.193.51:0/2874048532 >> v1:10.20.193.51:6789/0 conn(0x7fc98c0a3bb0 legacy=0x7fc98c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:44.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 1 monclient: found mon.noname-c 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.882+0000 7fc99134a640 1 -- 10.20.193.51:0/2874048532 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c09eec0 con 0x7fc98c0a0750 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc99134a640 1 -- 10.20.193.51:0/2874048532 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 msgr2=0x7fc98c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc99134a640 1 --2- 10.20.193.51:0/2874048532 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c09e1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc98c06f3c0 tx=0x7fc98002ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de5dcdc84777007 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 1 -- 10.20.193.51:0/2874048532 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98003c070 con 0x7fc98c0a0750 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: dump: 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.901 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 1 -- 10.20.193.51:0/2874048532 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98002fcd0 con 0x7fc98c0a0750 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc993dd6640 5 monclient: authenticate success, global_id 284113 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc993dd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 1 -- 10.20.193.51:0/2874048532 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980037660 con 0x7fc98c0a0750 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc993dd6640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc993dd6640 4 set_mon_vals no callback set 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.884+0000 7fc990b49640 10 monclient: dump: 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.903 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: shutdown 2026-02-17T12:08:44.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- 10.20.193.51:0/2874048532 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 msgr2=0x7fc98c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- 10.20.193.51:0/2874048532 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c09e1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc98c06f3c0 tx=0x7fc98002ed70 comp rx=0 tx=0).stop 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- 10.20.193.51:0/2874048532 shutdown_connections 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- 10.20.193.51:0/2874048532 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- 10.20.193.51:0/2874048532 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c09e1d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- 10.20.193.51:0/2874048532 >> 10.20.193.51:0/2874048532 conn(0x7fc98c0a30c0 msgr2=0x7fc98c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- 10.20.193.51:0/2874048532 shutdown_connections 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- 10.20.193.51:0/2874048532 wait complete. 2026-02-17T12:08:44.905 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: build_initial_monmap 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: monmap: 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 Processor -- start 2026-02-17T12:08:44.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- start start 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: init 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-b con 0x7fc98c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-a con 0x7fc98c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c095010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): picked mon.noname-c con 0x7fc98c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c0a04b0 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c09c850 con 0x7fc98c0a0750 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c09e710 con 0x7fc98c13b760 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc993dd6640 10 monclient(hunting): authenticate will time out at 2012.505994s 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.885+0000 7fc99234c640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 msgr2=0x7fc98c095010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99234c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c095010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:42970/0 (socket says 10.20.193.51:42970) 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 -- 10.20.193.51:0/3253033196 learned_addr learned my addr 10.20.193.51:0/3253033196 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): get_auth_request con 0x7fc98c0a3bb0 auth_method 0 2026-02-17T12:08:44.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc991b4b640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc991b4b640 10 monclient(hunting): get_auth_request con 0x7fc98c0a0750 auth_method 0 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc991b4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc991b4b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc991b4b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient(hunting): handle_auth_done global_id 274236 payload 824 2026-02-17T12:08:44.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 -- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 msgr2=0x7fc98c095010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c095010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 -- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 msgr2=0x7fc98c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient: _finish_hunting 0 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 monclient: found mon.noname-a 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.886+0000 7fc99134a640 1 -- 10.20.193.51:0/3253033196 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c098990 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc99134a640 1 -- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 msgr2=0x7fc98c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc99134a640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc98002f280 tx=0x7fc9800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980047020 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: dump: 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.911 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc980042670 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98003c040 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97a7fc640 10 monclient: dump: 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:44.912 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc97bfff640 4 set_mon_vals no callback set 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 5 monclient: authenticate success, global_id 274236 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 10 monclient: _renew_subs 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c097100 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 10 monclient: _renew_subs 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.888+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c06f630 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc993dd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc993dd6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc993dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c0a2d90 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fc980042a60 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc97a7fc640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 0x7fc95c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7fc980077cc0 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc991b4b640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 0x7fc95c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:44.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.889+0000 7fc991b4b640 10 monclient: get_auth_request con 0x7fc95c03dcc0 auth_method 0 2026-02-17T12:08:44.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.892+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc980051070 con 0x7fc98c0a3bb0 2026-02-17T12:08:44.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.892+0000 7fc97a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:44.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.892+0000 7fc97a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:44.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:44.892+0000 7fc991b4b640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 0x7fc95c040180 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007340 tx=0x7fc97c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:45.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc993dd6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:45.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc993dd6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:45.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc993dd6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:45.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc98c09dac0 con 0x7fc98c0a3bb0 2026-02-17T12:08:45.010 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc97a7fc640 1 -- 10.20.193.51:0/3253033196 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fc98003f2d0 con 0x7fc98c0a3bb0 2026-02-17T12:08:45.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc97a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:45.011 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.006+0000 7fc97a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:45.011 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":218,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:45.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 msgr2=0x7fc95c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:45.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 0x7fc95c040180 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007340 tx=0x7fc97c009040 comp rx=0 tx=0).stop 2026-02-17T12:08:45.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 10 monclient: shutdown 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 msgr2=0x7fc98c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc98002f280 tx=0x7fc9800047c0 comp rx=0 tx=0).stop 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 shutdown_connections 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fc95c03dcc0 0x7fc95c040180 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fc98c13b760 0x7fc98c095010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fc98c0a3bb0 0x7fc98c1d0010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 --2- 10.20.193.51:0/3253033196 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fc98c0a0750 0x7fc98c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 >> 10.20.193.51:0/3253033196 conn(0x7fc98c0a30c0 msgr2=0x7fc98c0a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 shutdown_connections 2026-02-17T12:08:45.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:45.007+0000 7fc993dd6640 1 -- 10.20.193.51:0/3253033196 wait complete. 2026-02-17T12:08:48.019 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: get_monmap_and_config 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: build_initial_monmap 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: monmap: 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:48.087267+0000 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:48.087267+0000 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:48.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 1 Processor -- start 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 1 -- start start 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: init 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f8c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7f8c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7f8c13c770 0x7f7f8c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.086+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-c con 0x7f7f8c13c770 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8c09e8e0 con 0x7f7f8c0a0750 2026-02-17T12:08:48.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8c06e140 con 0x7f7f8c0a3bb0 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8c09f910 con 0x7f7f8c13c770 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f9400c640 10 monclient(hunting): authenticate will time out at 2015.706018s 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f91580640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7f8c0a0750 0x7f7f8c09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37826/0 (socket says 10.20.193.51:37826) 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f91580640 1 -- 10.20.193.51:0/3930937882 learned_addr learned my addr 10.20.193.51:0/3930937882 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 1 --2- 10.20.193.51:0/3930937882 >> v2:10.20.193.142:3300/0 conn(0x7f7f8c13c770 0x7f7f8c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): get_auth_request con 0x7f7f8c13c770 auth_method 0 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.087+0000 7f7f92582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:48.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91580640 1 -- 10.20.193.51:0/3930937882 >> v1:10.20.193.51:6789/0 conn(0x7f7f8c0a0750 legacy=0x7f7f8c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494622982 0 0) 0x7f7f8c09e8e0 con 0x7f7f8c0a0750 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): _negotiate 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): my global_id is 274239 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f74003620 con 0x7f7f8c0a0750 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553116798 0 0) 0x7f7f74003620 con 0x7f7f8c0a0750 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 >> v2:10.20.193.142:3300/0 conn(0x7f7f8c13c770 msgr2=0x7f7f8c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 --2- 10.20.193.51:0/3930937882 >> v2:10.20.193.142:3300/0 conn(0x7f7f8c13c770 0x7f7f8c13eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 >> v1:10.20.193.142:6789/0 conn(0x7f7f8c0a3bb0 legacy=0x7f7f8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _finish_hunting 0 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c09ccd0 con 0x7f7f8c0a0750 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _finish_auth 0 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _check_auth_tickets 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f7f800031b0 con 0x7f7f8c0a0750 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f9400c640 5 monclient: authenticate success, global_id 274239 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f9400c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: dump: 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:08:48.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 >> v1:10.20.193.51:6789/0 conn(0x7f7f8c0a0750 legacy=0x7f7f8c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): picked mon.a con 0x7f7f74003bd0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74004900 0x7f7f74004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): picked mon.b con 0x7f7f74004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f740054c0 0x7f7f7400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): picked mon.c con 0x7f7f740054c0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c09f910 con 0x7f7f74003bd0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7400c3a0 con 0x7f7f74004900 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7400c5a0 con 0x7f7f740054c0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f90d7f640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f9400c640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f92582640 1 -- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f740054c0 msgr2=0x7f7f7400bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f92582640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f740054c0 0x7f7f7400bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): get_auth_request con 0x7f7f74003bd0 auth_method 0 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:48.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91580640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74004900 0x7f7f74004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient(hunting): handle_auth_done global_id 274239 payload 293 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 -- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f740054c0 msgr2=0x7f7f7400bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f740054c0 0x7f7f7400bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 -- 10.20.193.51:0/3930937882 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74004900 msgr2=0x7f7f74004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74004900 0x7f7f74004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient: _finish_hunting 0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 monclient: found mon.a 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f92582640 1 -- 10.20.193.51:0/3930937882 reap_dead start 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 1 -- 10.20.193.51:0/3930937882 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f74003620 con 0x7f7f74003bd0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient: _finish_auth 0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 10 monclient: _check_auth_tickets 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91d81640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91580640 10 monclient: get_auth_request con 0x7f7f74004900 auth_method 0 2026-02-17T12:08:48.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.089+0000 7f7f91580640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74004900 0x7f7f74004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f91d81640 1 -- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 msgr2=0x7f7f74003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f91d81640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c003fb0 tx=0x7f7f7c02ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f3e617293f92ec server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f91d81640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c003fb0 tx=0x7f7f7c02ecb0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f7f7c03c070 mon_map magic: 0 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c03c070 con 0x7f7f74003bd0 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 10 monclient: dump: 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.097 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c02f940 con 0x7f7f74003bd0 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 4 set_mon_vals no callback set 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 10 monclient: shutdown 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 -- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 msgr2=0x7f7f74003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c003fb0 tx=0x7f7f7c02ecb0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 1 -- 10.20.193.51:0/3930937882 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7f7f7c003b80 con 0x7f7f74003bd0 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f90d7f640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 -- 10.20.193.51:0/3930937882 shutdown_connections 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 --2- 10.20.193.51:0/3930937882 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f74003bd0 0x7f7f74003fd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 -- 10.20.193.51:0/3930937882 >> 10.20.193.51:0/3930937882 conn(0x7f7f8c0a30c0 msgr2=0x7f7f8c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 -- 10.20.193.51:0/3930937882 shutdown_connections 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.092+0000 7f7f9400c640 1 -- 10.20.193.51:0/3930937882 wait complete. 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient: build_initial_monmap 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient: monmap: 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:48.098 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 Processor -- start 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 -- start start 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient: init 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 0x7f7f8c13c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-b con 0x7f7f74003bd0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-a con 0x7f7f8c092810 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 0x7f7f8c1d3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): picked mon.noname-c con 0x7f7f8c093170 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c09c850 con 0x7f7f8c092810 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c09ebe0 con 0x7f7f74003bd0 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c0a04b0 con 0x7f7f8c093170 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f9400c640 10 monclient(hunting): authenticate will time out at 2015.712894s 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f92582640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 msgr2=0x7f7f8c1d3870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f92582640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 0x7f7f8c1d3870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:48.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45176/0 (socket says 10.20.193.51:45176) 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 1 -- 10.20.193.51:0/1696528486 learned_addr learned my addr 10.20.193.51:0/1696528486 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): get_auth_request con 0x7f7f8c092810 auth_method 0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.093+0000 7f7f91580640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 0x7f7f8c13c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 10 monclient(hunting): get_auth_request con 0x7f7f74003bd0 auth_method 0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 10 monclient(hunting): handle_auth_done global_id 274242 payload 824 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 -- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 msgr2=0x7f7f8c1d3870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 0x7f7f8c1d3870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 -- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 msgr2=0x7f7f8c13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 0x7f7f8c13c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 10 monclient: _finish_hunting 0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 monclient: found mon.noname-a 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91580640 1 -- 10.20.193.51:0/1696528486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c096440 con 0x7f7f8c092810 2026-02-17T12:08:48.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.094+0000 7f7f91d81640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 0x7f7f8c13c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f91580640 1 -- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 msgr2=0x7f7f8c092c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f91580640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000d770 tx=0x7f7f8000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007110 con 0x7f7f8c092810 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: dump: 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f800072b0 con 0x7f7f8c092810 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007660 con 0x7f7f8c092810 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7bfff640 4 set_mon_vals no callback set 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:48.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f7a7fc640 10 monclient: dump: 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 5 monclient: authenticate success, global_id 274242 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _renew_subs 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c0a29f0 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _renew_subs 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c0935f0 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.096+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c09db50 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.097+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7f8000b6b0 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.097+0000 7f7f7a7fc640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 0x7f7f5c0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.097+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f7f80052790 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.097+0000 7f7f91d81640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 0x7f7f5c0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.097+0000 7f7f91d81640 10 monclient: get_auth_request con 0x7f7f5c03dcf0 auth_method 0 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.099+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f80011dc0 con 0x7f7f8c092810 2026-02-17T12:08:48.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.099+0000 7f7f7a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:48.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.099+0000 7f7f7a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:48.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.099+0000 7f7f91d81640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 0x7f7f5c0401b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c039000 tx=0x7f7f7c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f9400c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f9400c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f9400c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f8c0008d0 con 0x7f7f8c092810 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f7a7fc640 1 -- 10.20.193.51:0/1696528486 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f7f80054be0 con 0x7f7f8c092810 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f7a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.212+0000 7f7f7a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:48.214 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":218,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 msgr2=0x7f7f5c0401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 0x7f7f5c0401b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c039000 tx=0x7f7f7c033000 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 10 monclient: shutdown 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 msgr2=0x7f7f8c092c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000d770 tx=0x7f7f8000dc40 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 shutdown_connections 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7f5c03dcf0 0x7f7f5c0401b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f8c093170 0x7f7f8c1d3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f8c092810 0x7f7f8c092c30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 --2- 10.20.193.51:0/1696528486 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f74003bd0 0x7f7f8c13c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 >> 10.20.193.51:0/1696528486 conn(0x7f7f8c0a30c0 msgr2=0x7f7f8c072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:48.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 shutdown_connections 2026-02-17T12:08:48.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:48.213+0000 7f7f9400c640 1 -- 10.20.193.51:0/1696528486 wait complete. 2026-02-17T12:08:51.223 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:51.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 10 monclient: get_monmap_and_config 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 10 monclient: build_initial_monmap 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 10 monclient: monmap: 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:51.292395+0000 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:51.292395+0000 2026-02-17T12:08:51.295 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 1 Processor -- start 2026-02-17T12:08:51.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 1 -- start start 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.291+0000 7f5b142b6640 10 monclient: init 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f5b0c0a3bb0 0x7f5b0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-c con 0x7f5b0c0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5b0c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b0c13b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c06e140 con 0x7f5b0c13b760 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c09f910 con 0x7f5b0c0a0750 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:51.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0c09ccd0 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b142b6640 10 monclient(hunting): authenticate will time out at 2018.911164s 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1282c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f5b0c13b760 0x7f5b0c13db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37828/0 (socket says 10.20.193.51:37828) 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1282c640 1 -- 10.20.193.51:0/1825590869 learned_addr learned my addr 10.20.193.51:0/1825590869 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1202b640 1 --2- 10.20.193.51:0/1825590869 >> v2:10.20.193.142:3300/0 conn(0x7f5b0c0a3bb0 0x7f5b0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1202b640 10 monclient(hunting): get_auth_request con 0x7f5b0c0a3bb0 auth_method 0 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1202b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1202b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:51.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.292+0000 7f5b1202b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:51.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1282c640 1 -- 10.20.193.51:0/1825590869 >> v1:10.20.193.51:6789/0 conn(0x7f5b0c13b760 legacy=0x7f5b0c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:51.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1182a640 1 -- 10.20.193.51:0/1825590869 >> v1:10.20.193.142:6789/0 conn(0x7f5b0c0a0750 legacy=0x7f5b0c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:51.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:51.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient(hunting): handle_auth_done global_id 284125 payload 274 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 1 -- 10.20.193.51:0/1825590869 >> v1:10.20.193.142:6789/0 conn(0x7f5b0c0a0750 legacy=0x7f5b0c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 1 -- 10.20.193.51:0/1825590869 >> v1:10.20.193.51:6789/0 conn(0x7f5b0c13b760 legacy=0x7f5b0c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient: _finish_hunting 0 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 1 monclient: found mon.noname-c 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.294+0000 7f5b1202b640 1 -- 10.20.193.51:0/1825590869 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c09eec0 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b1202b640 1 -- 10.20.193.51:0/1825590869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a3bb0 msgr2=0x7f5b0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:51.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b1202b640 1 --2- 10.20.193.51:0/1825590869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a3bb0 0x7f5b0c09dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0099a0 tx=0x7f5afc02eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c160773042fb75b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 1 -- 10.20.193.51:0/1825590869 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc03c070 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: dump: 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:51.310 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: _finish_auth 0 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: _check_auth_tickets 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 1 -- 10.20.193.51:0/1825590869 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc037440 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 5 monclient: authenticate success, global_id 284125 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 1 -- 10.20.193.51:0/1825590869 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc037810 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:51.311 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 4 set_mon_vals no callback set 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b11029640 10 monclient: dump: 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:51.312 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 10 monclient: shutdown 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 -- 10.20.193.51:0/1825590869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a3bb0 msgr2=0x7f5b0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 --2- 10.20.193.51:0/1825590869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a3bb0 0x7f5b0c09dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0099a0 tx=0x7f5afc02eee0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 -- 10.20.193.51:0/1825590869 shutdown_connections 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 --2- 10.20.193.51:0/1825590869 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a3bb0 0x7f5b0c09dac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 -- 10.20.193.51:0/1825590869 >> 10.20.193.51:0/1825590869 conn(0x7f5b0c0a30c0 msgr2=0x7f5b0c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 -- 10.20.193.51:0/1825590869 shutdown_connections 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.297+0000 7f5b142b6640 1 -- 10.20.193.51:0/1825590869 wait complete. 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.298+0000 7f5b142b6640 10 monclient: build_initial_monmap 2026-02-17T12:08:51.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.298+0000 7f5b142b6640 10 monclient: monmap: 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.298+0000 7f5b142b6640 1 Processor -- start 2026-02-17T12:08:51.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.298+0000 7f5b142b6640 1 -- start start 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.298+0000 7f5b142b6640 10 monclient: init 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a0750 0x7f5b0c090b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-b con 0x7f5b0c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 0x7f5b0c091040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-c con 0x7f5b0c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): picked mon.noname-a con 0x7f5b0c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c0a04b0 con 0x7f5b0c13b760 2026-02-17T12:08:51.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c09c850 con 0x7f5b0c0a0750 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c09e710 con 0x7f5b0c0a3bb0 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b142b6640 10 monclient(hunting): authenticate will time out at 2018.918066s 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1182a640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 msgr2=0x7f5b0c091040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1182a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 0x7f5b0c091040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45186/0 (socket says 10.20.193.51:45186) 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 -- 10.20.193.51:0/4223258096 learned_addr learned my addr 10.20.193.51:0/4223258096 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): get_auth_request con 0x7f5b0c13b760 auth_method 0 2026-02-17T12:08:51.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1202b640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a0750 0x7f5b0c090b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1202b640 10 monclient(hunting): get_auth_request con 0x7f5b0c0a0750 auth_method 0 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1202b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1202b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1202b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient(hunting): handle_auth_done global_id 274245 payload 824 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 -- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 msgr2=0x7f5b0c091040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:51.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 0x7f5b0c091040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 -- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a0750 msgr2=0x7f5b0c090b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a0750 0x7f5b0c090b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient: _finish_hunting 0 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 monclient: found mon.noname-a 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.299+0000 7f5b1282c640 1 -- 10.20.193.51:0/4223258096 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c0943d0 con 0x7f5b0c13b760 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b1282c640 1 -- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 msgr2=0x7f5b0c091580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b1282c640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800ca40 tx=0x7f5b0800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08017070 con 0x7f5b0c13b760 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:51.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: dump: 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0800add0 con 0x7f5b0c13b760 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 5 monclient: authenticate success, global_id 274245 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 10 monclient: _renew_subs 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c06f6a0 con 0x7f5b0c13b760 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08012600 con 0x7f5b0c13b760 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b10828640 4 set_mon_vals no callback set 2026-02-17T12:08:51.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5af2ffd640 10 monclient: dump: 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:51.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 10 monclient: _renew_subs 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.301+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c092630 con 0x7f5b0c13b760 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b142b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b142b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b142b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c09dac0 con 0x7f5b0c13b760 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5b0801b3b0 con 0x7f5b0c13b760 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5af2ffd640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 0x7f5adc040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f5b080523e0 con 0x7f5b0c13b760 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b1202b640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 0x7f5adc040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.302+0000 7f5b1202b640 10 monclient: get_auth_request con 0x7f5adc03dcc0 auth_method 0 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.304+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b08007070 con 0x7f5b0c13b760 2026-02-17T12:08:51.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.304+0000 7f5af2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:51.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.304+0000 7f5af2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:51.323 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.305+0000 7f5b1202b640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 0x7f5adc040180 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c09f5f0 tx=0x7f5afc033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5b142b6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5b142b6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5b142b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5b0c0008d0 con 0x7f5b0c13b760 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5af2ffd640 1 -- 10.20.193.51:0/4223258096 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f5b08052080 con 0x7f5b0c13b760 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5af2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.418+0000 7f5af2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:51.420 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":218,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 msgr2=0x7f5adc040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 0x7f5adc040180 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c09f5f0 tx=0x7f5afc033000 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 10 monclient: shutdown 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 msgr2=0x7f5b0c091580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800ca40 tx=0x7f5b0800cf10 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 shutdown_connections 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5adc03dcc0 0x7f5adc040180 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5b0c13b760 0x7f5b0c091580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5b0c0a3bb0 0x7f5b0c091040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 --2- 10.20.193.51:0/4223258096 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5b0c0a0750 0x7f5b0c090b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 >> 10.20.193.51:0/4223258096 conn(0x7f5b0c0a30c0 msgr2=0x7f5b0c072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 shutdown_connections 2026-02-17T12:08:51.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:51.419+0000 7f5b142b6640 1 -- 10.20.193.51:0/4223258096 wait complete. 2026-02-17T12:08:54.428 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:08:54.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: get_monmap_and_config 2026-02-17T12:08:54.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: build_initial_monmap 2026-02-17T12:08:54.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: monmap: 2026-02-17T12:08:54.501 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:54.498300+0000 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:54.498300+0000 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:54.502 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 1 Processor -- start 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 1 -- start start 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: init 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.497+0000 7f2248c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-b con 0x7f22440a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:54.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f22440a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-a con 0x7f224413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224406e140 con 0x7f22440a0750 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f224409f910 con 0x7f224413b760 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f224409ccd0 con 0x7f22440a3bb0 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2248c6f640 10 monclient(hunting): authenticate will time out at 2022.117045s 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242575640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 msgr2=0x7f224409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:54.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:45194/0 (socket says 10.20.193.51:45194) 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 learned_addr learned my addr 10.20.193.51:0/2275562708 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 10 monclient(hunting): get_auth_request con 0x7f224413b760 auth_method 0 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:54.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.498+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:54.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.500+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v1:10.20.193.142:6789/0 conn(0x7f22440a0750 legacy=0x7f224409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:54.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 msgr2=0x7f224409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:54.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:54.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:54.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 10 monclient(hunting): get_auth_request con 0x7f224413b760 auth_method 0 2026-02-17T12:08:54.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:54.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:54.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:54.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:08:54.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:54.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:54.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:54.699+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 msgr2=0x7f224409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 10 monclient(hunting): get_auth_request con 0x7f224413b760 auth_method 0 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:55.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:55.104 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.100+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:55.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 msgr2=0x7f224409dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 10 monclient(hunting): get_auth_request con 0x7f224413b760 auth_method 0 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:55.904 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:55.901+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:57.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): tick 2026-02-17T12:08:57.501 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 monclient(hunting): continuing hunt 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 msgr2=0x7f224409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f22440a3bb0 0x7f224409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 msgr2=0x7f224413db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.51:3300/0 conn(0x7f224413b760 0x7f224413db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 -- 10.20.193.51:0/2275562708 >> v1:10.20.193.142:6789/0 conn(0x7f22440a0750 legacy=0x7f224409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient: _add_conns ranks=[0,4] 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2220003840 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:57.502 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f2220007570 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 -- 10.20.193.51:0/2275562708 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224409eec0 con 0x7f2220003840 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 1 -- 10.20.193.51:0/2275562708 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f224409f910 con 0x7f2220007570 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f222bfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 10 monclient(hunting): get_auth_request con 0x7f2220007570 auth_method 0 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:57.503 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:57.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:57.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:57.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.498+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:57.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.500+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> v1:10.20.193.51:6789/0 conn(0x7f2220003840 legacy=0x7f2220005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 10 monclient(hunting): get_auth_request con 0x7f2220007570 auth_method 0 2026-02-17T12:08:57.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:57.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:57.699+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:08:58.102 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 10 monclient(hunting): get_auth_request con 0x7f2220007570 auth_method 0 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:58.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.100+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 10 monclient(hunting): get_auth_request con 0x7f2220007570 auth_method 0 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:08:58.903 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.901+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:08:58.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155355498 0 0) 0x7f224409eec0 con 0x7f2220003840 2026-02-17T12:08:58.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient(hunting): _negotiate 2026-02-17T12:08:58.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient(hunting): my global_id is 274248 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2230003620 con 0x7f2220003840 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1952237168 0 0) 0x7f2230003620 con 0x7f2220003840 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 msgr2=0x7f2220009a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 --2- 10.20.193.51:0/2275562708 >> v2:10.20.193.142:3300/0 conn(0x7f2220007570 0x7f2220009a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: _finish_hunting 0 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:08:58.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222000b1c0 con 0x7f2220003840 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: _finish_auth 0 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: _check_auth_tickets 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f2238004700 con 0x7f2220003840 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: dump: 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:58.972 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:08:58.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 >> v1:10.20.193.51:6789/0 conn(0x7f2220003840 legacy=0x7f2220005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.957+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 reap_dead start 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 0x7f2230003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): picked mon.a con 0x7f2230003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 0x7f2230004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): picked mon.b con 0x7f2230004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 0x7f223000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): picked mon.c con 0x7f2230005390 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:58.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f224409f910 con 0x7f2230003ab0 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f223000c2e0 con 0x7f2230004900 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f223000c4e0 con 0x7f2230005390 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241573640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242d76640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 msgr2=0x7f223000bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242d76640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 0x7f223000bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:58.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 0x7f2230003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): get_auth_request con 0x7f2230003ab0 auth_method 0 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 0x7f2230004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient(hunting): handle_auth_done global_id 274248 payload 293 2026-02-17T12:08:58.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 msgr2=0x7f223000bac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 0x7f223000bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 msgr2=0x7f2230004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 0x7f2230004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient: _finish_hunting 0 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 monclient: found mon.a 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2230003620 con 0x7f2230003ab0 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient: _finish_auth 0 2026-02-17T12:08:58.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 10 monclient: _check_auth_tickets 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2242575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2248c6f640 5 monclient: authenticate success, global_id 274248 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2248c6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241d74640 10 monclient: get_auth_request con 0x7f2230004900 auth_method 0 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.958+0000 7f2241d74640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 0x7f2230004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.960+0000 7f2242575640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 msgr2=0x7f2230003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.960+0000 7f2242575640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 0x7f2230003eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2238003a80 tx=0x7f223802f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2398432b3463133d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800a2d0 con 0x7f2230003ab0 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:58.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: dump: 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:58.979 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238004c90 con 0x7f2230003ab0 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 1 -- 10.20.193.51:0/2275562708 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380062b0 con 0x7f2230003ab0 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2241573640 10 monclient: dump: 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:58.980 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:58.981 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 4 set_mon_vals no callback set 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 10 monclient: shutdown 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 -- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 msgr2=0x7f2230003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 0x7f2230003eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2238003a80 tx=0x7f223802f990 comp rx=0 tx=0).stop 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 -- 10.20.193.51:0/2275562708 shutdown_connections 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230005390 0x7f223000bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230004900 0x7f2230004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 --2- 10.20.193.51:0/2275562708 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230003ab0 0x7f2230003eb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 -- 10.20.193.51:0/2275562708 >> 10.20.193.51:0/2275562708 conn(0x7f22440a30c0 msgr2=0x7f22440a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 -- 10.20.193.51:0/2275562708 shutdown_connections 2026-02-17T12:08:58.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.961+0000 7f2248c6f640 1 -- 10.20.193.51:0/2275562708 wait complete. 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient: build_initial_monmap 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient: monmap: 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:58.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 Processor -- start 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 -- start start 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient: init 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230003ab0 0x7f224413aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-b con 0x7f2230003ab0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 0x7f2244092480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-c con 0x7f2230004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): picked mon.noname-a con 0x7f2230005390 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f22440a04b0 con 0x7f2230005390 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f224409c850 con 0x7f2230003ab0 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f224409dac0 con 0x7f2230004900 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:58.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2248c6f640 10 monclient(hunting): authenticate will time out at 2026.581739s 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2241d74640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 msgr2=0x7f2244092480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2241d74640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 0x7f2244092480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36432/0 (socket says 10.20.193.51:36432) 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 -- 10.20.193.51:0/1759352797 learned_addr learned my addr 10.20.193.51:0/1759352797 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): get_auth_request con 0x7f2230005390 auth_method 0 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:58.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242575640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230003ab0 0x7f224413aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242575640 10 monclient(hunting): get_auth_request con 0x7f2230003ab0 auth_method 0 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient(hunting): handle_auth_done global_id 274251 payload 824 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 -- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 msgr2=0x7f2244092480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 0x7f2244092480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 -- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230003ab0 msgr2=0x7f224413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230003ab0 0x7f224413aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient: _finish_hunting 0 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 monclient: found mon.noname-a 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.962+0000 7f2242d76640 1 -- 10.20.193.51:0/1759352797 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2244095e50 con 0x7f2230005390 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2242d76640 1 -- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 msgr2=0x7f22440929c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2242d76640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22340096d0 tx=0x7f2234007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223401a070 con 0x7f2230005390 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:58.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: dump: 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:58.989 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: _finish_auth 0 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2234012820 con 0x7f2230005390 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234012c30 con 0x7f2230005390 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2240d72640 4 set_mon_vals no callback set 2026-02-17T12:08:58.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 10 monclient: dump: 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:58.991 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 5 monclient: authenticate success, global_id 274251 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _renew_subs 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22440a2630 con 0x7f2230005390 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _renew_subs 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2244096410 con 0x7f2230005390 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2234009700 con 0x7f2230005390 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:58.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.965+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224409de50 con 0x7f2230005390 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.966+0000 7f222affd640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 0x7f2210040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.966+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f2234053160 con 0x7f2230005390 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.966+0000 7f2242575640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 0x7f2210040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.966+0000 7f2242575640 10 monclient: get_auth_request con 0x7f221003dcc0 auth_method 0 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.968+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2234051b30 con 0x7f2230005390 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.968+0000 7f222affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:58.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.968+0000 7f222affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:58.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:58.969+0000 7f2242575640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 0x7f2210040180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2238004920 tx=0x7f2238009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f2248c6f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f2248c6f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f2248c6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2244094590 con 0x7f2230005390 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f222affd640 1 -- 10.20.193.51:0/1759352797 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f2234009a20 con 0x7f2230005390 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f222affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:08:59.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.083+0000 7f222affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:59.087 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":222,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 msgr2=0x7f2210040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 0x7f2210040180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2238004920 tx=0x7f2238009000 comp rx=0 tx=0).stop 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 10 monclient: shutdown 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 msgr2=0x7f22440929c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22340096d0 tx=0x7f2234007d50 comp rx=0 tx=0).stop 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 shutdown_connections 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f221003dcc0 0x7f2210040180 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2230005390 0x7f22440929c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2230004900 0x7f2244092480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 --2- 10.20.193.51:0/1759352797 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2230003ab0 0x7f224413aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 >> 10.20.193.51:0/1759352797 conn(0x7f22440a30c0 msgr2=0x7f2244072840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:59.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 shutdown_connections 2026-02-17T12:08:59.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.084+0000 7f2248c6f640 1 -- 10.20.193.51:0/1759352797 wait complete. 2026-02-17T12:08:59.094 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:08:59.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:08:59.095 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:08:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: get_monmap_and_config 2026-02-17T12:08:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: build_initial_monmap 2026-02-17T12:08:59.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: monmap: 2026-02-17T12:08:59.165 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:59.164205+0000 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:59.164205+0000 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:59.166 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:59.167 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 Processor -- start 2026-02-17T12:08:59.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 -- start start 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: init 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-b con 0x7fb8100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb8100a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb81013b760 0x7fb81013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-c con 0x7fb81013b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81006e140 con 0x7fb8100a0750 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb81009f910 con 0x7fb81013b760 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb81009ccd0 con 0x7fb8100a3bb0 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb8187de640 10 monclient(hunting): authenticate will time out at 2026.782937s 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb816553640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 msgr2=0x7fb81009dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.163+0000 7fb816553640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb815d52640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fb8100a0750 0x7fb81009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34142/0 (socket says 10.20.193.51:34142) 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb815d52640 1 -- 10.20.193.51:0/3383868375 learned_addr learned my addr 10.20.193.51:0/3383868375 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 --2- 10.20.193.51:0/3383868375 >> v2:10.20.193.142:3300/0 conn(0x7fb81013b760 0x7fb81013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): get_auth_request con 0x7fb81013b760 auth_method 0 2026-02-17T12:08:59.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient(hunting): handle_auth_done global_id 284134 payload 274 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 -- 10.20.193.51:0/3383868375 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 msgr2=0x7fb81009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 --2- 10.20.193.51:0/3383868375 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 -- 10.20.193.51:0/3383868375 >> v1:10.20.193.51:6789/0 conn(0x7fb8100a0750 legacy=0x7fb81009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient: _finish_hunting 0 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 monclient: found mon.noname-c 2026-02-17T12:08:59.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.164+0000 7fb816d54640 1 -- 10.20.193.51:0/3383868375 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81009eec0 con 0x7fb81013b760 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb816d54640 1 -- 10.20.193.51:0/3383868375 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 msgr2=0x7fb81013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb816d54640 1 --2- 10.20.193.51:0/3383868375 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 0x7fb81013db50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb81009f230 tx=0x7fb80c02f170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc731dd7618eb549 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 1 -- 10.20.193.51:0/3383868375 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c03c070 con 0x7fb81013b760 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: dump: 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.183 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: _finish_auth 0 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: _check_auth_tickets 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 5 monclient: authenticate success, global_id 284134 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:59.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 1 -- 10.20.193.51:0/3383868375 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c037640 con 0x7fb81013b760 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 1 -- 10.20.193.51:0/3383868375 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c037a10 con 0x7fb81013b760 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 4 set_mon_vals no callback set 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb815551640 10 monclient: dump: 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.185 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 10 monclient: shutdown 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 -- 10.20.193.51:0/3383868375 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 msgr2=0x7fb81013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 --2- 10.20.193.51:0/3383868375 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 0x7fb81013db50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb81009f230 tx=0x7fb80c02f170 comp rx=0 tx=0).stop 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 -- 10.20.193.51:0/3383868375 shutdown_connections 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 --2- 10.20.193.51:0/3383868375 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 0x7fb81013db50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 --2- 10.20.193.51:0/3383868375 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 -- 10.20.193.51:0/3383868375 >> 10.20.193.51:0/3383868375 conn(0x7fb8100a30c0 msgr2=0x7fb8100a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 -- 10.20.193.51:0/3383868375 shutdown_connections 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.167+0000 7fb8187de640 1 -- 10.20.193.51:0/3383868375 wait complete. 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient: build_initial_monmap 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient: monmap: 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:59.187 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 Processor -- start 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 -- start start 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient: init 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-a con 0x7fb8100a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-c con 0x7fb8100a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 0x7fb8100906c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): picked mon.noname-b con 0x7fb81013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:59.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100a04b0 con 0x7fb8100a0750 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb81009c850 con 0x7fb81013b760 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb81009e710 con 0x7fb8100a3bb0 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb8187de640 10 monclient(hunting): authenticate will time out at 2026.787477s 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb815d52640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 msgr2=0x7fb81009a030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb815d52640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36434/0 (socket says 10.20.193.51:36434) 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 -- 10.20.193.51:0/3201130509 learned_addr learned my addr 10.20.193.51:0/3201130509 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): get_auth_request con 0x7fb8100a0750 auth_method 0 2026-02-17T12:08:59.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient(hunting): handle_auth_done global_id 274254 payload 824 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 msgr2=0x7fb81009a030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb8100a3bb0 0x7fb81009a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 msgr2=0x7fb8100906c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb81013b760 0x7fb8100906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient: _finish_hunting 0 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 monclient: found mon.noname-a 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.168+0000 7fb816553640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8100942a0 con 0x7fb8100a0750 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.170+0000 7fb816553640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 msgr2=0x7fb810099af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.170+0000 7fb816553640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b7b0 tx=0x7fb80000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.170+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800005270 con 0x7fb8100a0750 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.170+0000 7fb7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb816553640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b7b0 tx=0x7fb80000bc80 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fb800005670 mon_map magic: 0 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: dump: 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.191 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 5 monclient: authenticate success, global_id 274254 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800010070 con 0x7fb8100a0750 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 monclient: _renew_subs 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8100a2500 con 0x7fb8100a0750 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb814d50640 4 set_mon_vals no callback set 2026-02-17T12:08:59.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 monclient: _renew_subs 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81009d7b0 con 0x7fb8100a0750 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 0x7fb810090c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb81009dac0 con 0x7fb810093e00 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 0x7fb810090c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient: get_auth_request con 0x7fb810093e00 auth_method 0 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800005670 con 0x7fb8100a0750 2026-02-17T12:08:59.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 10 monclient: dump: 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb800013370 con 0x7fb8100a0750 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 10 monclient(hunting): handle_auth_done global_id 274257 payload 824 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb815d52640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8100926f0 con 0x7fb810093e00 2026-02-17T12:08:59.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.171+0000 7fb7f6ffd640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb7e003dcc0 0x7fb7e0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.172+0000 7fb816d54640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb7e003dcc0 0x7fb7e0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.172+0000 7fb816d54640 10 monclient: get_auth_request con 0x7fb7e003dcc0 auth_method 0 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb815d52640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 msgr2=0x7fb810090c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb815d52640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 0x7fb810090c00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb810091e90 tx=0x7fb80400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017070 con 0x7fb810093e00 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb7f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.173+0000 7fb7f6ffd640 10 monclient: dump: 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.195 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fb8040072d0 con 0x7fb810093e00 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 msgr2=0x7fb810090c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 0x7fb810090c00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb810091e90 tx=0x7fb80400c8d0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 msgr2=0x7fb810090c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.174+0000 7fb7f6ffd640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb810093e00 0x7fb810090c00 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb810091e90 tx=0x7fb80400c8d0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.175+0000 7fb816d54640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb7e003dcc0 0x7fb7e0040180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb810069d60 tx=0x7fb80c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb8187de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb8187de640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 0x7fb8101d8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb8187de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100922c0 con 0x7fb8101ccf70 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 0x7fb8101d8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient: get_auth_request con 0x7fb8101ccf70 auth_method 0 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 10 monclient(hunting): handle_auth_done global_id 274260 payload 824 2026-02-17T12:08:59.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.177+0000 7fb815d52640 1 -- 10.20.193.51:0/3201130509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8100008d0 con 0x7fb8101ccf70 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb815d52640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 msgr2=0x7fb8101d8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb815d52640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 0x7fb8101d8050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb804014000 tx=0x7fb804004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017030 con 0x7fb8101ccf70 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 10 monclient: dump: 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.198 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4700 (secure 0 0 0) 0x7fb804019c20 con 0x7fb8101ccf70 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 msgr2=0x7fb8101d8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 0x7fb8101d8050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb804014000 tx=0x7fb804004ad0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 msgr2=0x7fb8101d8050 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8101ccf70 0x7fb8101d8050 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb804014000 tx=0x7fb804004ad0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:08:59.199 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 222, 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 110536, 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.200 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:59.201 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.202 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.203 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.204 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.205 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:59.206 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.207 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:59.208 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:59.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb7e003dcc0 msgr2=0x7fb7e0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb7e003dcc0 0x7fb7e0040180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb810069d60 tx=0x7fb80c031000 comp rx=0 tx=0).stop 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 10 monclient: shutdown 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 msgr2=0x7fb810099af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 --2- 10.20.193.51:0/3201130509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb8100a0750 0x7fb810099af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b7b0 tx=0x7fb80000bc80 comp rx=0 tx=0).stop 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb816d54640 1 -- 10.20.193.51:0/3201130509 reap_dead start 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb7f6ffd640 1 -- 10.20.193.51:0/3201130509 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (unknown 0 0 0) 0x7fb800051c90 con 0x7fb8100a0750 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb816d54640 1 -- 10.20.193.51:0/3201130509 reap_dead start 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 shutdown_connections 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 >> 10.20.193.51:0/3201130509 conn(0x7fb8100a30c0 msgr2=0x7fb810072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 shutdown_connections 2026-02-17T12:08:59.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.179+0000 7fb8187de640 1 -- 10.20.193.51:0/3201130509 wait complete. 2026-02-17T12:08:59.209 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:08:59.209 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:08:59.210 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: get_monmap_and_config 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: build_initial_monmap 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: monmap: 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:08:59.276009+0000 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:08:59.276009+0000 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:59.279 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 Processor -- start 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 -- start start 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: init 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a840a3bb0 0x7f3a8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.280 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-a con 0x7f3a840a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 0x7f3a8409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-b con 0x7f3a840a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 0x7f3a8413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-c con 0x7f3a8409e540 addr v2:10.20.193.142:3300/0 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3a840a3f90 con 0x7f3a840a3bb0 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8406e140 con 0x7f3a8409e540 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8409f910 con 0x7f3a840a0750 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:59.281 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a8a9a0640 10 monclient(hunting): authenticate will time out at 2026.894794s 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a837fe640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 msgr2=0x7f3a8409e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a837fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 0x7f3a8409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a840a3bb0 0x7f3a8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3a840a3bb0 0x7f3a8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36464/0 (socket says 10.20.193.51:36464) 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 1 -- 10.20.193.51:0/2128644253 learned_addr learned my addr 10.20.193.51:0/2128644253 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): get_auth_request con 0x7f3a840a3bb0 auth_method 0 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.275+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 10 monclient(hunting): handle_auth_done global_id 274263 payload 274 2026-02-17T12:08:59.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 -- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 msgr2=0x7f3a8409e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 0x7f3a8409e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 -- 10.20.193.51:0/2128644253 >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 msgr2=0x7f3a8413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a88f16640 1 --2- 10.20.193.51:0/2128644253 >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 0x7f3a8413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2128644253 >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 0x7f3a8413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 10 monclient: _finish_hunting 0 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 monclient: found mon.noname-a 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a83fff640 1 -- 10.20.193.51:0/2128644253 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8409ccd0 con 0x7f3a840a3bb0 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a88f16640 10 monclient: get_auth_request con 0x7f3a8409e540 auth_method 0 2026-02-17T12:08:59.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.276+0000 7f3a88f16640 1 --2- 10.20.193.51:0/2128644253 >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 0x7f3a8413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a83fff640 1 -- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a840a3bb0 msgr2=0x7f3a8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a840a3bb0 0x7f3a8409dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a8409f230 tx=0x7f3a7002ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452d3b20a4560673 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 1 -- 10.20.193.51:0/2128644253 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7003c070 con 0x7f3a840a3bb0 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: dump: 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.290 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: _finish_auth 0 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 1 -- 10.20.193.51:0/2128644253 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7002fda0 con 0x7f3a840a3bb0 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a8a9a0640 5 monclient: authenticate success, global_id 274263 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a8a9a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 1 -- 10.20.193.51:0/2128644253 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70037660 con 0x7f3a840a3bb0 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:59.291 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a82ffd640 10 monclient: dump: 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a8a9a0640 10 monclient: get_monmap_and_config success 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.278+0000 7f3a8a9a0640 4 set_mon_vals no callback set 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 10 monclient: shutdown 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a840a3bb0 msgr2=0x7f3a8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.292 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a840a3bb0 0x7f3a8409dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a8409f230 tx=0x7f3a7002ee80 comp rx=0 tx=0).stop 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2128644253 shutdown_connections 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2128644253 >> v2:10.20.193.142:3300/0 conn(0x7f3a8409e540 0x7f3a8413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a0750 0x7f3a8409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2128644253 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a840a3bb0 0x7f3a8409dac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2128644253 >> 10.20.193.51:0/2128644253 conn(0x7f3a840a30c0 msgr2=0x7f3a840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2128644253 shutdown_connections 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2128644253 wait complete. 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 10 monclient: build_initial_monmap 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 10 monclient: monmap: 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:08:59.293 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 Processor -- start 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 1 -- start start 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.279+0000 7f3a8a9a0640 10 monclient: init 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient: _reopen_session rank -1 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-a con 0x7f3a8409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a840a0750 0x7f3a84132620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-b con 0x7f3a840a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a3bb0 0x7f3a84132b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): picked mon.noname-c con 0x7f3a840a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840a04b0 con 0x7f3a8409e540 2026-02-17T12:08:59.294 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8409c850 con 0x7f3a840a0750 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8413cca0 con 0x7f3a840a3bb0 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): _renew_subs 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a8a9a0640 10 monclient(hunting): authenticate will time out at 2026.899182s 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a88f16640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a3bb0 msgr2=0x7f3a84132b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a88f16640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a3bb0 0x7f3a84132b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:36476/0 (socket says 10.20.193.51:36476) 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 -- 10.20.193.51:0/2775818030 learned_addr learned my addr 10.20.193.51:0/2775818030 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): get_auth_request con 0x7f3a8409e540 auth_method 0 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.295 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient(hunting): handle_auth_done global_id 274266 payload 824 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a3bb0 msgr2=0x7f3a84132b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3a840a3bb0 0x7f3a84132b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a840a0750 msgr2=0x7f3a84132620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a837fe640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a840a0750 0x7f3a84132620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a840a0750 0x7f3a84132620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient: _finish_hunting 0 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 monclient: found mon.noname-a 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.280+0000 7f3a83fff640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84135a90 con 0x7f3a8409e540 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a83fff640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 msgr2=0x7f3a841320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a83fff640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a70002410 tx=0x7f3a70004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7003c040 con 0x7f3a8409e540 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: dump: 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.296 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: _finish_auth 0 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a70047070 con 0x7f3a8409e540 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 5 monclient: authenticate success, global_id 274266 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 10 monclient: _renew_subs 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a84135d70 con 0x7f3a8409e540 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a700428b0 con 0x7f3a8409e540 2026-02-17T12:08:59.297 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a827fc640 4 set_mon_vals no callback set 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a80ff9640 10 monclient: dump: 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 10 monclient: _renew_subs 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.282+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8406f410 con 0x7f3a8409e540 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a8a9a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 0x7f3a8413ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.298 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84134800 con 0x7f3a8413aa00 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3a70042a50 con 0x7f3a8409e540 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a80ff9640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a5403dcc0 0x7f3a54040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 0x7f3a8413ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient: get_auth_request con 0x7f3a8413aa00 auth_method 0 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(845..845 src has 323..845) ==== 4827+0+0 (secure 0 0 0) 0x7f3a70077a10 con 0x7f3a8409e540 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a88f16640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a5403dcc0 0x7f3a54040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a88f16640 10 monclient: get_auth_request con 0x7f3a5403dcc0 auth_method 0 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 10 monclient(hunting): handle_auth_done global_id 284137 payload 824 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.283+0000 7f3a837fe640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a8409dac0 con 0x7f3a8413aa00 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a88f16640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a5403dcc0 0x7f3a54040180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3a840a2d00 tx=0x7f3a78008390 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a837fe640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 msgr2=0x7f3a8413ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.299 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a837fe640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 0x7f3a8413ade0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a84133680 tx=0x7f3a7400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74007660 con 0x7f3a8413aa00 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 10 monclient: dump: 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f3a74016070 con 0x7f3a8413aa00 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 msgr2=0x7f3a8413ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 0x7f3a8413ade0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a84133680 tx=0x7f3a7400cb90 comp rx=0 tx=0).stop 2026-02-17T12:08:59.300 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 msgr2=0x7f3a8413ade0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:59.301 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.286+0000 7f3a80ff9640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413aa00 0x7f3a8413ade0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a84133680 tx=0x7f3a7400cb90 comp rx=0 tx=0).stop 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.289+0000 7f3a8a9a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.289+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 0x7f3a841d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.289+0000 7f3a8a9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.289+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84133ec0 con 0x7f3a8413b320 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 0x7f3a841d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient: get_auth_request con 0x7f3a8413b320 auth_method 0 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 10 monclient(hunting): handle_auth_done global_id 284140 payload 824 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.290+0000 7f3a837fe640 1 -- 10.20.193.51:0/2775818030 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a840008d0 con 0x7f3a8413b320 2026-02-17T12:08:59.302 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.292+0000 7f3a837fe640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 msgr2=0x7f3a841d9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.292+0000 7f3a837fe640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 0x7f3a841d9b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a74015000 tx=0x7f3a74005aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74007d30 con 0x7f3a8413b320 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 10 monclient: dump: 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f3a74007d30 con 0x7f3a8413b320 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 msgr2=0x7f3a841d9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 0x7f3a841d9b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a74015000 tx=0x7f3a74005aa0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 msgr2=0x7f3a841d9b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:08:59.303 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a80ff9640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3a8413b320 0x7f3a841d9b80 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a74015000 tx=0x7f3a74005aa0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 222, 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 41523, 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.304 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.305 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:08:59.306 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.307 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.308 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:08:59.309 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:08:59.310 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:08:59.311 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a5403dcc0 msgr2=0x7f3a54040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3a5403dcc0 0x7f3a54040180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3a840a2d00 tx=0x7f3a78008390 comp rx=0 tx=0).stop 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 10 monclient: shutdown 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 msgr2=0x7f3a841320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a70002410 tx=0x7f3a70004830 comp rx=0 tx=0).stop 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a88f16640 1 -- 10.20.193.51:0/2775818030 reap_dead start 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 shutdown_connections 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 --2- 10.20.193.51:0/2775818030 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3a8409e540 0x7f3a841320e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 >> 10.20.193.51:0/2775818030 conn(0x7f3a840a30c0 msgr2=0x7f3a84072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 shutdown_connections 2026-02-17T12:08:59.312 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:08:59.293+0000 7f3a8a9a0640 1 -- 10.20.193.51:0/2775818030 wait complete. 2026-02-17T12:08:59.312 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:08:59.312 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:08:59.960 INFO:tasks.rados.rados.0.trial142.stdout:3652: done (1 left) 2026-02-17T12:08:59.960 INFO:tasks.rados.rados.0.trial142.stdout:3653: rollback oid 15 current snap is 407 2026-02-17T12:08:59.960 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 406 2026-02-17T12:08:59.960 INFO:tasks.rados.rados.0.trial142.stdout:3654: write oid 4 current snap is 407 2026-02-17T12:08:59.960 INFO:tasks.rados.rados.0.trial142.stdout:3654: seq_num 1245 ranges {524715=650544,1887964=491773} 2026-02-17T12:08:59.964 INFO:tasks.rados.rados.0.trial142.stdout:3654: writing trial14245205-4 from 524715 to 1175259 tid 1 2026-02-17T12:08:59.969 INFO:tasks.rados.rados.0.trial142.stdout:3654: writing trial14245205-4 from 1887964 to 2379737 tid 2 2026-02-17T12:08:59.969 INFO:tasks.rados.rados.0.trial142.stdout:3655: snap_remove snap 392 2026-02-17T12:09:00.967 INFO:tasks.rados.rados.0.trial142.stdout:3655: done (3 left) 2026-02-17T12:09:00.967 INFO:tasks.rados.rados.0.trial142.stdout:3656: read oid 20 snap -1 2026-02-17T12:09:00.967 INFO:tasks.rados.rados.0.trial142.stdout:3656: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:09:00.968 INFO:tasks.rados.rados.0.trial142.stdout:3657: write oid 48 current snap is 407 2026-02-17T12:09:00.968 INFO:tasks.rados.rados.0.trial142.stdout:3657: seq_num 1246 ranges {541522=725793,1946446=635431} 2026-02-17T12:09:00.972 INFO:tasks.rados.rados.0.trial142.stdout:3657: writing trial14245205-48 from 541522 to 1267315 tid 1 2026-02-17T12:09:00.977 INFO:tasks.rados.rados.0.trial142.stdout:3657: writing trial14245205-48 from 1946446 to 2581877 tid 2 2026-02-17T12:09:00.977 INFO:tasks.rados.rados.0.trial142.stdout:3658: rollback oid 23 current snap is 407 2026-02-17T12:09:00.978 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 381 2026-02-17T12:09:00.978 INFO:tasks.rados.rados.0.trial142.stdout:3650: expect (ObjNum 1237 snap 407 seq_num 1237) 2026-02-17T12:09:01.120 INFO:tasks.rados.rados.0.trial142.stdout:3653: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3653: finishing rollback tid 2 to trial14245205-15 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3116 (ObjNum 1111 snap 361 seq_num 1111) dirty exists 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3654: finishing write tid 1 to trial14245205-4 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3654: finishing write tid 2 to trial14245205-4 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3650: done (5 left) 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3653: done (4 left) 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3659: read oid 35 snap -1 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3659: expect deleted 2026-02-17T12:09:01.121 INFO:tasks.rados.rados.0.trial142.stdout:3660: snap_remove snap 405 2026-02-17T12:09:01.971 INFO:tasks.rados.rados.0.trial142.stdout:3654: finishing write tid 3 to trial14245205-4 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3660: done (5 left) 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3661: rollback oid 37 current snap is 407 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 37 to 381 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3654: finishing write tid 4 to trial14245205-4 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3654: oid 4 updating version 0 to 3676 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3654: oid 4 version 3676 is already newer than 3674 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3654: oid 4 version 3676 is already newer than 3675 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3676 (ObjNum 1245 snap 407 seq_num 1245) dirty exists 2026-02-17T12:09:01.972 INFO:tasks.rados.rados.0.trial142.stdout:3654: left oid 4 (ObjNum 1245 snap 407 seq_num 1245) 2026-02-17T12:09:01.973 INFO:tasks.rados.rados.0.trial142.stdout:3656: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3657: finishing write tid 1 to trial14245205-48 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3658: finishing rollback tid 1 to trial14245205-23 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3658: finishing rollback tid 2 to trial14245205-23 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 3094 (ObjNum 878 snap 277 seq_num 878) dirty exists 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3657: finishing write tid 2 to trial14245205-48 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3657: finishing write tid 3 to trial14245205-48 2026-02-17T12:09:02.060 INFO:tasks.rados.rados.0.trial142.stdout:3657: finishing write tid 4 to trial14245205-48 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3657: oid 48 updating version 0 to 3091 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3657: oid 48 version 3091 is already newer than 3089 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3657: oid 48 version 3091 is already newer than 3090 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 3091 (ObjNum 1246 snap 407 seq_num 1246) dirty exists 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3657: left oid 48 (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3654: done (5 left) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3656: done (4 left) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3657: done (3 left) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3658: done (2 left) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3659: done (1 left) 2026-02-17T12:09:02.061 INFO:tasks.rados.rados.0.trial142.stdout:3662: snap_remove snap 406 2026-02-17T12:09:02.719 INFO:tasks.rados.rados.0.trial142.stdout:3662: done (1 left) 2026-02-17T12:09:02.719 INFO:tasks.rados.rados.0.trial142.stdout:3663: write (excl) oid 1 current snap is 407 2026-02-17T12:09:02.719 INFO:tasks.rados.rados.0.trial142.stdout:3663: seq_num 1247 ranges {558329=517395,1721281=779089} 2026-02-17T12:09:02.723 INFO:tasks.rados.rados.0.trial142.stdout:3663: writing trial14245205-1 from 558329 to 1075724 tid 1 2026-02-17T12:09:02.729 INFO:tasks.rados.rados.0.trial142.stdout:3663: writing trial14245205-1 from 1721281 to 2500370 tid 2 2026-02-17T12:09:02.729 INFO:tasks.rados.rados.0.trial142.stdout:3664: write oid 33 current snap is 407 2026-02-17T12:09:02.729 INFO:tasks.rados.rados.0.trial142.stdout:3664: seq_num 1248 ranges {575136=592644,1663410=639100,2705542=269594} 2026-02-17T12:09:02.733 INFO:tasks.rados.rados.0.trial142.stdout:3664: writing trial14245205-33 from 575136 to 1167780 tid 1 2026-02-17T12:09:02.737 INFO:tasks.rados.rados.0.trial142.stdout:3664: writing trial14245205-33 from 1663410 to 2302510 tid 2 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3664: writing trial14245205-33 from 2705542 to 2975136 tid 3 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3665: delete oid 31 current snap is 407 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3661: finishing rollback tid 1 to trial14245205-37 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3661: finishing rollback tid 2 to trial14245205-37 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2759 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3663: finishing write tid 1 to trial14245205-1 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3663: finishing write tid 2 to trial14245205-1 2026-02-17T12:09:02.740 INFO:tasks.rados.rados.0.trial142.stdout:3663: finishing write tid 3 to trial14245205-1 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3663: finishing write tid 4 to trial14245205-1 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3663: oid 1 updating version 0 to 3139 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3663: oid 1 updating version 3139 to 3140 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3663: oid 1 version 3140 is already newer than 3138 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3140 (ObjNum 1247 snap 407 seq_num 1247) dirty exists 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3663: left oid 1 (ObjNum 1247 snap 407 seq_num 1247) 2026-02-17T12:09:02.741 INFO:tasks.rados.rados.0.trial142.stdout:3664: finishing write tid 1 to trial14245205-33 2026-02-17T12:09:02.742 INFO:tasks.rados.rados.0.trial142.stdout:3664: finishing write tid 2 to trial14245205-33 2026-02-17T12:09:02.743 INFO:tasks.rados.rados.0.trial142.stdout:3664: finishing write tid 3 to trial14245205-33 2026-02-17T12:09:02.743 INFO:tasks.rados.rados.0.trial142.stdout:3664: finishing write tid 4 to trial14245205-33 2026-02-17T12:09:02.743 INFO:tasks.rados.rados.0.trial142.stdout:3664: finishing write tid 5 to trial14245205-33 2026-02-17T12:09:02.743 INFO:tasks.rados.rados.0.trial142.stdout:3664: oid 33 updating version 0 to 3120 2026-02-17T12:09:02.743 INFO:tasks.rados.rados.0.trial142.stdout:3664: oid 33 version 3120 is already newer than 3117 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3664: oid 33 version 3120 is already newer than 3118 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3664: oid 33 version 3120 is already newer than 3119 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 3120 (ObjNum 1248 snap 407 seq_num 1248) dirty exists 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3664: left oid 33 (ObjNum 1248 snap 407 seq_num 1248) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3661: done (3 left) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3663: done (2 left) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3664: done (1 left) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3665: done (0 left) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3666: read oid 33 snap -1 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3666: expect (ObjNum 1248 snap 407 seq_num 1248) 2026-02-17T12:09:02.744 INFO:tasks.rados.rados.0.trial142.stdout:3667: snap_create 2026-02-17T12:09:02.750 INFO:tasks.rados.rados.0.trial142.stdout:3666: expect (ObjNum 1248 snap 407 seq_num 1248) 2026-02-17T12:09:03.722 INFO:tasks.rados.rados.0.trial142.stdout:3666: done (1 left) 2026-02-17T12:09:03.723 INFO:tasks.rados.rados.0.trial142.stdout:3667: done (0 left) 2026-02-17T12:09:03.723 INFO:tasks.rados.rados.0.trial142.stdout:3668: snap_remove snap 407 2026-02-17T12:09:04.724 INFO:tasks.rados.rados.0.trial142.stdout:3668: done (0 left) 2026-02-17T12:09:04.724 INFO:tasks.rados.rados.0.trial142.stdout:3669: snap_create 2026-02-17T12:09:05.725 INFO:tasks.rados.rados.0.trial142.stdout:3669: done (0 left) 2026-02-17T12:09:05.726 INFO:tasks.rados.rados.0.trial142.stdout:3670: write oid 26 current snap is 409 2026-02-17T12:09:05.726 INFO:tasks.rados.rados.0.trial142.stdout:3670: seq_num 1250 ranges {608750=743142,1780374=642769} 2026-02-17T12:09:05.730 INFO:tasks.rados.rados.0.trial142.stdout:3670: writing trial14245205-26 from 608750 to 1351892 tid 1 2026-02-17T12:09:05.735 INFO:tasks.rados.rados.0.trial142.stdout:3670: writing trial14245205-26 from 1780374 to 2423143 tid 2 2026-02-17T12:09:05.735 INFO:tasks.rados.rados.0.trial142.stdout:3671: write oid 46 current snap is 409 2026-02-17T12:09:05.735 INFO:tasks.rados.rados.0.trial142.stdout:3671: seq_num 1251 ranges {625557=418391,1838856=786427} 2026-02-17T12:09:05.738 INFO:tasks.rados.rados.0.trial142.stdout:3671: writing trial14245205-46 from 625557 to 1043948 tid 1 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3671: writing trial14245205-46 from 1838856 to 2625283 tid 2 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3672: snap_create 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3670: finishing write tid 1 to trial14245205-26 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3670: finishing write tid 2 to trial14245205-26 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3670: finishing write tid 3 to trial14245205-26 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3670: finishing write tid 4 to trial14245205-26 2026-02-17T12:09:05.745 INFO:tasks.rados.rados.0.trial142.stdout:3670: oid 26 updating version 0 to 2759 2026-02-17T12:09:05.746 INFO:tasks.rados.rados.0.trial142.stdout:3670: oid 26 updating version 2759 to 2761 2026-02-17T12:09:05.746 INFO:tasks.rados.rados.0.trial142.stdout:3670: oid 26 version 2761 is already newer than 2760 2026-02-17T12:09:05.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2761 (ObjNum 1250 snap 409 seq_num 1250) dirty exists 2026-02-17T12:09:05.746 INFO:tasks.rados.rados.0.trial142.stdout:3670: left oid 26 (ObjNum 1250 snap 409 seq_num 1250) 2026-02-17T12:09:05.746 INFO:tasks.rados.rados.0.trial142.stdout:3671: finishing write tid 1 to trial14245205-46 2026-02-17T12:09:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3671: finishing write tid 2 to trial14245205-46 2026-02-17T12:09:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3671: finishing write tid 3 to trial14245205-46 2026-02-17T12:09:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3671: finishing write tid 4 to trial14245205-46 2026-02-17T12:09:05.749 INFO:tasks.rados.rados.0.trial142.stdout:3671: oid 46 updating version 0 to 3699 2026-02-17T12:09:05.749 INFO:tasks.rados.rados.0.trial142.stdout:3671: oid 46 updating version 3699 to 3700 2026-02-17T12:09:05.749 INFO:tasks.rados.rados.0.trial142.stdout:3671: oid 46 version 3700 is already newer than 3698 2026-02-17T12:09:05.749 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3700 (ObjNum 1251 snap 409 seq_num 1251) dirty exists 2026-02-17T12:09:05.749 INFO:tasks.rados.rados.0.trial142.stdout:3671: left oid 46 (ObjNum 1251 snap 409 seq_num 1251) 2026-02-17T12:09:06.730 INFO:tasks.rados.rados.0.trial142.stdout:3670: done (2 left) 2026-02-17T12:09:06.730 INFO:tasks.rados.rados.0.trial142.stdout:3671: done (1 left) 2026-02-17T12:09:06.730 INFO:tasks.rados.rados.0.trial142.stdout:3672: done (0 left) 2026-02-17T12:09:06.730 INFO:tasks.rados.rados.0.trial142.stdout:3673: rollback oid 27 current snap is 410 2026-02-17T12:09:06.731 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 27 to 381 2026-02-17T12:09:06.731 INFO:tasks.rados.rados.0.trial142.stdout:3674: snap_remove snap 408 2026-02-17T12:09:07.721 INFO:tasks.rados.rados.0.trial142.stdout:3674: done (1 left) 2026-02-17T12:09:07.721 INFO:tasks.rados.rados.0.trial142.stdout:3675: snap_create 2026-02-17T12:09:07.721 INFO:tasks.rados.rados.0.trial142.stdout:3673: finishing rollback tid 0 to trial14245205-27 2026-02-17T12:09:07.721 INFO:tasks.rados.rados.0.trial142.stdout:3673: finishing rollback tid 1 to trial14245205-27 2026-02-17T12:09:07.722 INFO:tasks.rados.rados.0.trial142.stdout:3673: finishing rollback tid 2 to trial14245205-27 2026-02-17T12:09:07.722 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 27 v 3123 (ObjNum 1169 snap 378 seq_num 1169) dirty exists 2026-02-17T12:09:08.721 INFO:tasks.rados.rados.0.trial142.stdout:3673: done (1 left) 2026-02-17T12:09:08.722 INFO:tasks.rados.rados.0.trial142.stdout:3675: done (0 left) 2026-02-17T12:09:08.722 INFO:tasks.rados.rados.0.trial142.stdout:3676: copy_from oid 3 from oid 21 current snap is 411 2026-02-17T12:09:08.722 INFO:tasks.rados.rados.0.trial142.stdout:3677: read oid 20 snap -1 2026-02-17T12:09:08.722 INFO:tasks.rados.rados.0.trial142.stdout:3677: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:09:08.722 INFO:tasks.rados.rados.0.trial142.stdout:3678: snap_remove snap 410 2026-02-17T12:09:09.723 INFO:tasks.rados.rados.0.trial142.stdout:3678: done (2 left) 2026-02-17T12:09:09.724 INFO:tasks.rados.rados.0.trial142.stdout:3679: read oid 7 snap -1 2026-02-17T12:09:09.724 INFO:tasks.rados.rados.0.trial142.stdout:3679: expect deleted 2026-02-17T12:09:09.724 INFO:tasks.rados.rados.0.trial142.stdout:3680: copy_from oid 34 from oid 17 current snap is 411 2026-02-17T12:09:09.724 INFO:tasks.rados.rados.0.trial142.stdout:3677: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3676: finishing copy_from racing read to trial14245205-3 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3676: finishing copy_from to trial14245205-3 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2559 (ObjNum 1205 snap 391 seq_num 1205) dirty exists 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3680: finishing copy_from to trial14245205-34 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3680: got expected ENOENT (src dne) 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3680: finishing copy_from racing read to trial14245205-34 2026-02-17T12:09:09.812 INFO:tasks.rados.rados.0.trial142.stdout:3676: done (3 left) 2026-02-17T12:09:09.813 INFO:tasks.rados.rados.0.trial142.stdout:3677: done (2 left) 2026-02-17T12:09:09.813 INFO:tasks.rados.rados.0.trial142.stdout:3679: done (1 left) 2026-02-17T12:09:09.813 INFO:tasks.rados.rados.0.trial142.stdout:3680: done (0 left) 2026-02-17T12:09:09.813 INFO:tasks.rados.rados.0.trial142.stdout:3681: copy_from oid 11 from oid 48 current snap is 411 2026-02-17T12:09:09.813 INFO:tasks.rados.rados.0.trial142.stdout:3682: snap_create 2026-02-17T12:09:09.820 INFO:tasks.rados.rados.0.trial142.stdout:3681: finishing copy_from racing read to trial14245205-11 2026-02-17T12:09:09.822 INFO:tasks.rados.rados.0.trial142.stdout:3681: finishing copy_from to trial14245205-11 2026-02-17T12:09:09.822 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3091 (ObjNum 1246 snap 407 seq_num 1246) dirty exists 2026-02-17T12:09:10.838 INFO:tasks.rados.rados.0.trial142.stdout:3681: done (1 left) 2026-02-17T12:09:10.838 INFO:tasks.rados.rados.0.trial142.stdout:3682: done (0 left) 2026-02-17T12:09:10.838 INFO:tasks.rados.rados.0.trial142.stdout:3683: write (excl) oid 19 current snap is 412 2026-02-17T12:09:10.839 INFO:tasks.rados.rados.0.trial142.stdout:3683: seq_num 1252 ranges {642364=493640,1897338=646438} 2026-02-17T12:09:10.842 INFO:tasks.rados.rados.0.trial142.stdout:3683: writing trial14245205-19 from 642364 to 1136004 tid 1 2026-02-17T12:09:10.848 INFO:tasks.rados.rados.0.trial142.stdout:3683: writing trial14245205-19 from 1897338 to 2543776 tid 2 2026-02-17T12:09:10.848 INFO:tasks.rados.rados.0.trial142.stdout:3684: write oid 44 current snap is 412 2026-02-17T12:09:10.848 INFO:tasks.rados.rados.0.trial142.stdout:3684: seq_num 1253 ranges {659171=568889,1839467=790096} 2026-02-17T12:09:10.852 INFO:tasks.rados.rados.0.trial142.stdout:3684: writing trial14245205-44 from 659171 to 1228060 tid 1 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3684: writing trial14245205-44 from 1839467 to 2629563 tid 2 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3685: copy_from oid 16 from oid 37 current snap is 412 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3683: finishing write tid 1 to trial14245205-19 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3683: finishing write tid 2 to trial14245205-19 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3683: finishing write tid 3 to trial14245205-19 2026-02-17T12:09:10.858 INFO:tasks.rados.rados.0.trial142.stdout:3683: finishing write tid 4 to trial14245205-19 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3683: oid 19 updating version 0 to 3096 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3683: oid 19 updating version 3096 to 3097 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3683: oid 19 version 3097 is already newer than 3095 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 3097 (ObjNum 1252 snap 412 seq_num 1252) dirty exists 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3683: left oid 19 (ObjNum 1252 snap 412 seq_num 1252) 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3684: finishing write tid 1 to trial14245205-44 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3683: done (2 left) 2026-02-17T12:09:10.859 INFO:tasks.rados.rados.0.trial142.stdout:3686: snap_remove snap 411 2026-02-17T12:09:11.737 INFO:tasks.rados.rados.0.trial142.stdout:3686: done (2 left) 2026-02-17T12:09:11.737 INFO:tasks.rados.rados.0.trial142.stdout:3687: snap_remove snap 381 2026-02-17T12:09:12.720 INFO:tasks.rados.rados.0.trial142.stdout:3687: done (2 left) 2026-02-17T12:09:12.721 INFO:tasks.rados.rados.0.trial142.stdout:3688: write (excl) oid 8 current snap is 412 2026-02-17T12:09:12.721 INFO:tasks.rados.rados.0.trial142.stdout:3688: seq_num 1254 ranges {675978=644138,1897949=650107} 2026-02-17T12:09:12.725 INFO:tasks.rados.rados.0.trial142.stdout:3688: writing trial14245205-8 from 675978 to 1320116 tid 1 2026-02-17T12:09:12.730 INFO:tasks.rados.rados.0.trial142.stdout:3688: writing trial14245205-8 from 1897949 to 2548056 tid 2 2026-02-17T12:09:12.730 INFO:tasks.rados.rados.0.trial142.stdout:3689: rollback oid 19 current snap is 412 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 409 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: finishing write tid 2 to trial14245205-44 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: finishing write tid 3 to trial14245205-44 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: finishing write tid 4 to trial14245205-44 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: oid 44 updating version 0 to 3143 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: oid 44 version 3143 is already newer than 3141 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:3684: oid 44 version 3143 is already newer than 3142 2026-02-17T12:09:12.731 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3143 (ObjNum 1253 snap 412 seq_num 1253) dirty exists 2026-02-17T12:09:12.732 INFO:tasks.rados.rados.0.trial142.stdout:3684: left oid 44 (ObjNum 1253 snap 412 seq_num 1253) 2026-02-17T12:09:12.732 INFO:tasks.rados.rados.0.trial142.stdout:3685: finishing copy_from racing read to trial14245205-16 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3685: finishing copy_from to trial14245205-16 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 2759 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3688: finishing write tid 1 to trial14245205-8 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3684: done (3 left) 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3685: done (2 left) 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3690: read oid 48 snap -1 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3690: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3691: write (excl) oid 50 current snap is 412 2026-02-17T12:09:12.733 INFO:tasks.rados.rados.0.trial142.stdout:3691: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2026-02-17T12:09:12.735 INFO:tasks.rados.rados.0.trial142.stdout:3691: writing trial14245205-50 from 692785 to 1128525 tid 1 2026-02-17T12:09:12.741 INFO:tasks.rados.rados.0.trial142.stdout:3691: writing trial14245205-50 from 1672784 to 2466549 tid 2 2026-02-17T12:09:12.744 INFO:tasks.rados.rados.0.trial142.stdout:3691: writing trial14245205-50 from 2897503 to 3092785 tid 3 2026-02-17T12:09:12.744 INFO:tasks.rados.rados.0.trial142.stdout:3692: read oid 14 snap -1 2026-02-17T12:09:12.744 INFO:tasks.rados.rados.0.trial142.stdout:3692: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:09:12.744 INFO:tasks.rados.rados.0.trial142.stdout:3693: delete oid 26 current snap is 412 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3689: finishing rollback tid 0 to trial14245205-19 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: finishing write tid 2 to trial14245205-8 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3689: finishing rollback tid 1 to trial14245205-19 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 3099 (ObjNum 129 snap 0 seq_num 1213320536) dirty dne 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: finishing write tid 3 to trial14245205-8 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: finishing write tid 4 to trial14245205-8 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: oid 8 updating version 0 to 3125 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: oid 8 version 3125 is already newer than 3124 2026-02-17T12:09:12.745 INFO:tasks.rados.rados.0.trial142.stdout:3688: oid 8 updating version 3125 to 3126 2026-02-17T12:09:12.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 8 v 3126 (ObjNum 1254 snap 412 seq_num 1254) dirty exists 2026-02-17T12:09:12.746 INFO:tasks.rados.rados.0.trial142.stdout:3688: left oid 8 (ObjNum 1254 snap 412 seq_num 1254) 2026-02-17T12:09:12.746 INFO:tasks.rados.rados.0.trial142.stdout:3690: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3691: finishing write tid 1 to trial14245205-50 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3688: done (5 left) 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3689: done (4 left) 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3690: done (3 left) 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3693: done (2 left) 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3694: write (excl) oid 25 current snap is 412 2026-02-17T12:09:12.854 INFO:tasks.rados.rados.0.trial142.stdout:3691: finishing write tid 2 to trial14245205-50 2026-02-17T12:09:12.855 INFO:tasks.rados.rados.0.trial142.stdout:3694: seq_num 1257 ranges {726399=586238,2073395=797434} 2026-02-17T12:09:12.859 INFO:tasks.rados.rados.0.trial142.stdout:3694: writing trial14245205-25 from 726399 to 1312637 tid 1 2026-02-17T12:09:12.864 INFO:tasks.rados.rados.0.trial142.stdout:3694: writing trial14245205-25 from 2073395 to 2870829 tid 2 2026-02-17T12:09:12.865 INFO:tasks.rados.rados.0.trial142.stdout:3695: read oid 6 snap 409 2026-02-17T12:09:12.865 INFO:tasks.rados.rados.0.trial142.stdout:3695: expect (ObjNum 1182 snap 383 seq_num 1182) 2026-02-17T12:09:12.865 INFO:tasks.rados.rados.0.trial142.stdout:3696: snap_create 2026-02-17T12:09:12.865 INFO:tasks.rados.rados.0.trial142.stdout:3691: finishing write tid 3 to trial14245205-50 2026-02-17T12:09:12.865 INFO:tasks.rados.rados.0.trial142.stdout:3692: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:09:12.942 INFO:tasks.rados.rados.0.trial142.stdout:3691: finishing write tid 4 to trial14245205-50 2026-02-17T12:09:12.942 INFO:tasks.rados.rados.0.trial142.stdout:3691: finishing write tid 5 to trial14245205-50 2026-02-17T12:09:12.942 INFO:tasks.rados.rados.0.trial142.stdout:3691: oid 50 updating version 0 to 2765 2026-02-17T12:09:12.942 INFO:tasks.rados.rados.0.trial142.stdout:3691: oid 50 version 2765 is already newer than 2762 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3691: oid 50 version 2765 is already newer than 2764 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3691: oid 50 version 2765 is already newer than 2763 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2765 (ObjNum 1255 snap 412 seq_num 1255) dirty exists 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3691: left oid 50 (ObjNum 1255 snap 412 seq_num 1255) 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: finishing write tid 1 to trial14245205-25 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: finishing write tid 2 to trial14245205-25 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: finishing write tid 3 to trial14245205-25 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: finishing write tid 4 to trial14245205-25 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: oid 25 updating version 0 to 2769 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: oid 25 version 2769 is already newer than 2768 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3694: oid 25 version 2769 is already newer than 2767 2026-02-17T12:09:12.943 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2769 (ObjNum 1257 snap 412 seq_num 1257) dirty exists 2026-02-17T12:09:12.944 INFO:tasks.rados.rados.0.trial142.stdout:3694: left oid 25 (ObjNum 1257 snap 412 seq_num 1257) 2026-02-17T12:09:12.944 INFO:tasks.rados.rados.0.trial142.stdout:3695: expect (ObjNum 1182 snap 383 seq_num 1182) 2026-02-17T12:09:13.744 INFO:tasks.rados.rados.0.trial142.stdout:3691: done (4 left) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3692: done (3 left) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3694: done (2 left) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3695: done (1 left) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3696: done (0 left) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3697: read oid 48 snap 409 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3697: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:09:13.745 INFO:tasks.rados.rados.0.trial142.stdout:3698: write (excl) oid 38 current snap is 413 2026-02-17T12:09:13.746 INFO:tasks.rados.rados.0.trial142.stdout:3698: seq_num 1258 ranges {743206=661487,2131877=541092} 2026-02-17T12:09:13.750 INFO:tasks.rados.rados.0.trial142.stdout:3698: writing trial14245205-38 from 743206 to 1404693 tid 1 2026-02-17T12:09:13.754 INFO:tasks.rados.rados.0.trial142.stdout:3698: writing trial14245205-38 from 2131877 to 2672969 tid 2 2026-02-17T12:09:13.755 INFO:tasks.rados.rados.0.trial142.stdout:3699: delete oid 17 current snap is 413 2026-02-17T12:09:13.755 INFO:tasks.rados.rados.0.trial142.stdout:3697: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:09:13.865 INFO:tasks.rados.rados.0.trial142.stdout:3698: finishing write tid 1 to trial14245205-38 2026-02-17T12:09:13.865 INFO:tasks.rados.rados.0.trial142.stdout:3698: finishing write tid 2 to trial14245205-38 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: finishing write tid 3 to trial14245205-38 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: finishing write tid 4 to trial14245205-38 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: oid 38 updating version 0 to 3103 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: oid 38 version 3103 is already newer than 3102 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: oid 38 version 3103 is already newer than 3101 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3103 (ObjNum 1258 snap 413 seq_num 1258) dirty exists 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: left oid 38 (ObjNum 1258 snap 413 seq_num 1258) 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3697: done (2 left) 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3698: done (1 left) 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3699: done (0 left) 2026-02-17T12:09:13.866 INFO:tasks.rados.rados.0.trial142.stdout:3700: delete oid 47 current snap is 413 2026-02-17T12:09:13.867 INFO:tasks.rados.rados.0.trial142.stdout:3700: done (0 left) 2026-02-17T12:09:13.867 INFO:tasks.rados.rados.0.trial142.stdout:3701: write (excl) oid 13 current snap is 413 2026-02-17T12:09:13.867 INFO:tasks.rados.rados.0.trial142.stdout:3701: seq_num 1261 ranges {793627=487234,1790970=404772,2829335=364292} 2026-02-17T12:09:13.871 INFO:tasks.rados.rados.0.trial142.stdout:3701: writing trial14245205-13 from 793627 to 1280861 tid 1 2026-02-17T12:09:13.875 INFO:tasks.rados.rados.0.trial142.stdout:3701: writing trial14245205-13 from 1790970 to 2195742 tid 2 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:3701: writing trial14245205-13 from 2829335 to 3193627 tid 3 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:3702: rollback oid 22 current snap is 413 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 22 to 412 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:3701: finishing write tid 1 to trial14245205-13 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:3701: finishing write tid 2 to trial14245205-13 2026-02-17T12:09:13.879 INFO:tasks.rados.rados.0.trial142.stdout:3703: snap_remove snap 409 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3703: done (2 left) 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3704: write oid 48 current snap is 413 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: finishing write tid 3 to trial14245205-13 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: finishing write tid 4 to trial14245205-13 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: finishing write tid 5 to trial14245205-13 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: oid 13 updating version 0 to 3129 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: oid 13 version 3129 is already newer than 3128 2026-02-17T12:09:14.853 INFO:tasks.rados.rados.0.trial142.stdout:3701: oid 13 version 3129 is already newer than 3127 2026-02-17T12:09:14.854 INFO:tasks.rados.rados.0.trial142.stdout:3701: oid 13 updating version 3129 to 3130 2026-02-17T12:09:14.854 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 3130 (ObjNum 1261 snap 413 seq_num 1261) dirty exists 2026-02-17T12:09:14.854 INFO:tasks.rados.rados.0.trial142.stdout:3701: left oid 13 (ObjNum 1261 snap 413 seq_num 1261) 2026-02-17T12:09:14.854 INFO:tasks.rados.rados.0.trial142.stdout:3702: finishing rollback tid 0 to trial14245205-22 2026-02-17T12:09:14.854 INFO:tasks.rados.rados.0.trial142.stdout:3704: seq_num 1262 ranges {410434=678836,1565805=548430,2573111=637323} 2026-02-17T12:09:14.856 INFO:tasks.rados.rados.0.trial142.stdout:3704: writing trial14245205-48 from 410434 to 1089270 tid 1 2026-02-17T12:09:14.860 INFO:tasks.rados.rados.0.trial142.stdout:3704: writing trial14245205-48 from 1565805 to 2114235 tid 2 2026-02-17T12:09:14.865 INFO:tasks.rados.rados.0.trial142.stdout:3704: writing trial14245205-48 from 2573111 to 3210434 tid 3 2026-02-17T12:09:14.865 INFO:tasks.rados.rados.0.trial142.stdout:3701: done (2 left) 2026-02-17T12:09:14.865 INFO:tasks.rados.rados.0.trial142.stdout:3705: snap_create 2026-02-17T12:09:14.865 INFO:tasks.rados.rados.0.trial142.stdout:3702: finishing rollback tid 1 to trial14245205-22 2026-02-17T12:09:14.866 INFO:tasks.rados.rados.0.trial142.stdout:3702: finishing rollback tid 2 to trial14245205-22 2026-02-17T12:09:14.866 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 3146 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:09:14.866 INFO:tasks.rados.rados.0.trial142.stdout:3704: finishing write tid 1 to trial14245205-48 2026-02-17T12:09:14.866 INFO:tasks.rados.rados.0.trial142.stdout:3704: finishing write tid 2 to trial14245205-48 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: finishing write tid 3 to trial14245205-48 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: finishing write tid 4 to trial14245205-48 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: finishing write tid 5 to trial14245205-48 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: oid 48 updating version 0 to 3093 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: oid 48 updating version 3093 to 3095 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: oid 48 version 3095 is already newer than 3094 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:3704: oid 48 version 3095 is already newer than 3092 2026-02-17T12:09:14.867 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 3095 (ObjNum 1262 snap 413 seq_num 1262) dirty exists 2026-02-17T12:09:14.868 INFO:tasks.rados.rados.0.trial142.stdout:3704: left oid 48 (ObjNum 1262 snap 413 seq_num 1262) 2026-02-17T12:09:15.841 INFO:tasks.rados.rados.0.trial142.stdout:3702: done (2 left) 2026-02-17T12:09:15.841 INFO:tasks.rados.rados.0.trial142.stdout:3704: done (1 left) 2026-02-17T12:09:15.842 INFO:tasks.rados.rados.0.trial142.stdout:3705: done (0 left) 2026-02-17T12:09:15.842 INFO:tasks.rados.rados.0.trial142.stdout:3706: copy_from oid 34 from oid 28 current snap is 414 2026-02-17T12:09:15.842 INFO:tasks.rados.rados.0.trial142.stdout:3707: read oid 44 snap -1 2026-02-17T12:09:15.842 INFO:tasks.rados.rados.0.trial142.stdout:3707: expect (ObjNum 1253 snap 412 seq_num 1253) 2026-02-17T12:09:15.842 INFO:tasks.rados.rados.0.trial142.stdout:3708: delete oid 25 current snap is 414 2026-02-17T12:09:15.843 INFO:tasks.rados.rados.0.trial142.stdout:3708: done (2 left) 2026-02-17T12:09:15.843 INFO:tasks.rados.rados.0.trial142.stdout:3709: write oid 25 current snap is 414 2026-02-17T12:09:15.843 INFO:tasks.rados.rados.0.trial142.stdout:3709: seq_num 1264 ranges {444048=429334,1282769=552099,2627957=616091} 2026-02-17T12:09:15.846 INFO:tasks.rados.rados.0.trial142.stdout:3709: writing trial14245205-25 from 444048 to 873382 tid 1 2026-02-17T12:09:15.849 INFO:tasks.rados.rados.0.trial142.stdout:3709: writing trial14245205-25 from 1282769 to 1834868 tid 2 2026-02-17T12:09:15.855 INFO:tasks.rados.rados.0.trial142.stdout:3709: writing trial14245205-25 from 2627957 to 3244048 tid 3 2026-02-17T12:09:15.855 INFO:tasks.rados.rados.0.trial142.stdout:3710: read oid 26 snap 413 2026-02-17T12:09:15.855 INFO:tasks.rados.rados.0.trial142.stdout:3710: expect deleted 2026-02-17T12:09:15.855 INFO:tasks.rados.rados.0.trial142.stdout:3711: snap_remove snap 412 2026-02-17T12:09:16.844 INFO:tasks.rados.rados.0.trial142.stdout:3711: done (4 left) 2026-02-17T12:09:16.844 INFO:tasks.rados.rados.0.trial142.stdout:3712: read oid 16 snap 413 2026-02-17T12:09:16.844 INFO:tasks.rados.rados.0.trial142.stdout:3712: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:16.844 INFO:tasks.rados.rados.0.trial142.stdout:3713: copy_from oid 38 from oid 32 current snap is 414 2026-02-17T12:09:16.844 INFO:tasks.rados.rados.0.trial142.stdout:3707: expect (ObjNum 1253 snap 412 seq_num 1253) 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3709: finishing write tid 1 to trial14245205-25 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3706: finishing copy_from racing read to trial14245205-34 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3709: finishing write tid 2 to trial14245205-25 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3706: finishing copy_from to trial14245205-34 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 2754 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3709: finishing write tid 3 to trial14245205-25 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3709: finishing write tid 4 to trial14245205-25 2026-02-17T12:09:16.983 INFO:tasks.rados.rados.0.trial142.stdout:3709: finishing write tid 5 to trial14245205-25 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3709: oid 25 updating version 0 to 2772 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3709: oid 25 updating version 2772 to 2773 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3709: oid 25 version 2773 is already newer than 2771 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3709: oid 25 updating version 2773 to 2774 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2774 (ObjNum 1264 snap 414 seq_num 1264) dirty exists 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3709: left oid 25 (ObjNum 1264 snap 414 seq_num 1264) 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3713: finishing copy_from racing read to trial14245205-38 2026-02-17T12:09:16.984 INFO:tasks.rados.rados.0.trial142.stdout:3712: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:17.169 INFO:tasks.rados.rados.0.trial142.stdout:3713: finishing copy_from to trial14245205-38 2026-02-17T12:09:17.169 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3095 (ObjNum 1229 snap 406 seq_num 1229) dirty exists 2026-02-17T12:09:17.169 INFO:tasks.rados.rados.0.trial142.stdout:3706: done (5 left) 2026-02-17T12:09:17.169 INFO:tasks.rados.rados.0.trial142.stdout:3707: done (4 left) 2026-02-17T12:09:17.170 INFO:tasks.rados.rados.0.trial142.stdout:3709: done (3 left) 2026-02-17T12:09:17.170 INFO:tasks.rados.rados.0.trial142.stdout:3710: done (2 left) 2026-02-17T12:09:17.170 INFO:tasks.rados.rados.0.trial142.stdout:3712: done (1 left) 2026-02-17T12:09:17.170 INFO:tasks.rados.rados.0.trial142.stdout:3713: done (0 left) 2026-02-17T12:09:17.170 INFO:tasks.rados.rados.0.trial142.stdout:3714: snap_create 2026-02-17T12:09:17.722 INFO:tasks.rados.rados.0.trial142.stdout:3714: done (0 left) 2026-02-17T12:09:17.723 INFO:tasks.rados.rados.0.trial142.stdout:3715: delete oid 26 current snap is 415 2026-02-17T12:09:17.725 INFO:tasks.rados.rados.0.trial142.stdout:3715: done (0 left) 2026-02-17T12:09:17.726 INFO:tasks.rados.rados.0.trial142.stdout:3716: read oid 40 snap -1 2026-02-17T12:09:17.726 INFO:tasks.rados.rados.0.trial142.stdout:3716: expect (ObjNum 1167 snap 377 seq_num 1167) 2026-02-17T12:09:17.726 INFO:tasks.rados.rados.0.trial142.stdout:3717: write (excl) oid 2 current snap is 415 2026-02-17T12:09:17.726 INFO:tasks.rados.rados.0.trial142.stdout:3717: seq_num 1266 ranges {477662=579832,1683380=555768,2966450=311212} 2026-02-17T12:09:17.731 INFO:tasks.rados.rados.0.trial142.stdout:3717: writing trial14245205-2 from 477662 to 1057494 tid 1 2026-02-17T12:09:17.736 INFO:tasks.rados.rados.0.trial142.stdout:3717: writing trial14245205-2 from 1683380 to 2239148 tid 2 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3717: writing trial14245205-2 from 2966450 to 3277662 tid 3 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3718: read oid 28 snap -1 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3718: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3719: read oid 14 snap -1 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3719: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3720: snap_create 2026-02-17T12:09:17.740 INFO:tasks.rados.rados.0.trial142.stdout:3716: expect (ObjNum 1167 snap 377 seq_num 1167) 2026-02-17T12:09:17.823 INFO:tasks.rados.rados.0.trial142.stdout:3717: finishing write tid 1 to trial14245205-2 2026-02-17T12:09:17.823 INFO:tasks.rados.rados.0.trial142.stdout:3717: finishing write tid 2 to trial14245205-2 2026-02-17T12:09:17.823 INFO:tasks.rados.rados.0.trial142.stdout:3719: expect (ObjNum 1224 snap 406 seq_num 1224) 2026-02-17T12:09:17.900 INFO:tasks.rados.rados.0.trial142.stdout:3718: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: finishing write tid 3 to trial14245205-2 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: finishing write tid 4 to trial14245205-2 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: finishing write tid 5 to trial14245205-2 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: oid 2 updating version 0 to 2750 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: oid 2 updating version 2750 to 2751 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: oid 2 updating version 2751 to 2752 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: oid 2 version 2752 is already newer than 2749 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2752 (ObjNum 1266 snap 415 seq_num 1266) dirty exists 2026-02-17T12:09:18.045 INFO:tasks.rados.rados.0.trial142.stdout:3717: left oid 2 (ObjNum 1266 snap 415 seq_num 1266) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3716: done (4 left) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3717: done (3 left) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3718: done (2 left) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3719: done (1 left) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3720: done (0 left) 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3721: write (excl) oid 38 current snap is 416 2026-02-17T12:09:18.723 INFO:tasks.rados.rados.0.trial142.stdout:3721: seq_num 1267 ranges {494469=655081,1741862=415779,2710226=584243} 2026-02-17T12:09:18.728 INFO:tasks.rados.rados.0.trial142.stdout:3721: writing trial14245205-38 from 494469 to 1149550 tid 1 2026-02-17T12:09:18.732 INFO:tasks.rados.rados.0.trial142.stdout:3721: writing trial14245205-38 from 1741862 to 2157641 tid 2 2026-02-17T12:09:18.737 INFO:tasks.rados.rados.0.trial142.stdout:3721: writing trial14245205-38 from 2710226 to 3294469 tid 3 2026-02-17T12:09:18.737 INFO:tasks.rados.rados.0.trial142.stdout:3722: rollback oid 48 current snap is 416 2026-02-17T12:09:18.737 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 48 to 413 2026-02-17T12:09:18.737 INFO:tasks.rados.rados.0.trial142.stdout:3721: finishing write tid 1 to trial14245205-38 2026-02-17T12:09:18.738 INFO:tasks.rados.rados.0.trial142.stdout:3721: finishing write tid 2 to trial14245205-38 2026-02-17T12:09:18.738 INFO:tasks.rados.rados.0.trial142.stdout:3723: copy_from oid 35 from oid 10 current snap is 416 2026-02-17T12:09:18.738 INFO:tasks.rados.rados.0.trial142.stdout:3724: delete oid 36 current snap is 416 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: finishing write tid 3 to trial14245205-38 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: finishing write tid 4 to trial14245205-38 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: finishing write tid 5 to trial14245205-38 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: oid 38 updating version 0 to 3106 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: oid 38 version 3106 is already newer than 3104 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: oid 38 version 3106 is already newer than 3105 2026-02-17T12:09:18.739 INFO:tasks.rados.rados.0.trial142.stdout:3721: oid 38 updating version 3106 to 3107 2026-02-17T12:09:18.740 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3107 (ObjNum 1267 snap 416 seq_num 1267) dirty exists 2026-02-17T12:09:18.740 INFO:tasks.rados.rados.0.trial142.stdout:3721: left oid 38 (ObjNum 1267 snap 416 seq_num 1267) 2026-02-17T12:09:18.740 INFO:tasks.rados.rados.0.trial142.stdout:3721: done (3 left) 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3724: done (2 left) 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3725: copy_from oid 13 from oid 46 current snap is 416 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3726: read oid 12 snap -1 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3726: expect deleted 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3727: write (excl) oid 30 current snap is 416 2026-02-17T12:09:18.741 INFO:tasks.rados.rados.0.trial142.stdout:3727: seq_num 1269 ranges {528083=405579,1342473=419448,2248719=733949} 2026-02-17T12:09:18.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: writing trial14245205-30 from 528083 to 933662 tid 1 2026-02-17T12:09:18.746 INFO:tasks.rados.rados.0.trial142.stdout:3727: writing trial14245205-30 from 1342473 to 1761921 tid 2 2026-02-17T12:09:18.751 INFO:tasks.rados.rados.0.trial142.stdout:3727: writing trial14245205-30 from 2248719 to 2982668 tid 3 2026-02-17T12:09:18.751 INFO:tasks.rados.rados.0.trial142.stdout:3728: snap_remove snap 415 2026-02-17T12:09:19.314 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:09:19.314 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:09:19.314 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:09:19.314 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:09:19.317 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:09:19.318 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:09:19.318 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:09:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: get_monmap_and_config 2026-02-17T12:09:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: build_initial_monmap 2026-02-17T12:09:19.389 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: monmap: 2026-02-17T12:09:19.389 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:19.389 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:19.386070+0000 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:19.386070+0000 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.390 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 Processor -- start 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 -- start start 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: init 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7f1809e370 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7f1809aa50 0x7f7f1809ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-a con 0x7f7f1809aa50 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f18139950 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f180a0980 con 0x7f7f1809e370 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1806d8e0 con 0x7f7f18139950 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:19.391 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.385+0000 7f7f1deda640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7f1809d600 con 0x7f7f1809aa50 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f1deda640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f1deda640 10 monclient(hunting): authenticate will time out at 2047.005013s 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f177fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7f1809e370 0x7f7f1809e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:39342/0 (socket says 10.20.193.51:39342) 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f177fe640 1 -- 10.20.193.51:0/4236132887 learned_addr learned my addr 10.20.193.51:0/4236132887 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/4236132887 >> v2:10.20.193.51:3300/0 conn(0x7f7f1809aa50 0x7f7f1809ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): get_auth_request con 0x7f7f1809aa50 auth_method 0 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:19.392 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient(hunting): handle_auth_done global_id 274269 payload 274 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 1 -- 10.20.193.51:0/4236132887 >> v1:10.20.193.142:6789/0 conn(0x7f7f18139950 legacy=0x7f7f1813bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 1 -- 10.20.193.51:0/4236132887 >> v1:10.20.193.51:6789/0 conn(0x7f7f1809e370 legacy=0x7f7f1809e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 1 monclient: found mon.noname-a 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.393 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.386+0000 7f7f16ffd640 1 -- 10.20.193.51:0/4236132887 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1809ff30 con 0x7f7f1809aa50 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f16ffd640 1 -- 10.20.193.51:0/4236132887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 msgr2=0x7f7f1809ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/4236132887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f1809ee60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098a0 tx=0x7f7f0802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de41d819f0ad05d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 1 -- 10.20.193.51:0/4236132887 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0803c070 con 0x7f7f1809aa50 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: dump: 2026-02-17T12:09:19.400 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: _finish_auth 0 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: _check_auth_tickets 2026-02-17T12:09:19.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 1 -- 10.20.193.51:0/4236132887 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0802fce0 con 0x7f7f1809aa50 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 5 monclient: authenticate success, global_id 274269 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 1 -- 10.20.193.51:0/4236132887 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08037660 con 0x7f7f1809aa50 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 4 set_mon_vals no callback set 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f167fc640 10 monclient: dump: 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:19.402 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 10 monclient: shutdown 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 1 -- 10.20.193.51:0/4236132887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 msgr2=0x7f7f1809ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:19.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.388+0000 7f7f1deda640 1 --2- 10.20.193.51:0/4236132887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f1809ee60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098a0 tx=0x7f7f0802ed80 comp rx=0 tx=0).stop 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 -- 10.20.193.51:0/4236132887 shutdown_connections 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 --2- 10.20.193.51:0/4236132887 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f1809ee60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 -- 10.20.193.51:0/4236132887 >> 10.20.193.51:0/4236132887 conn(0x7f7f180a30c0 msgr2=0x7f7f180a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 -- 10.20.193.51:0/4236132887 shutdown_connections 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 -- 10.20.193.51:0/4236132887 wait complete. 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 10 monclient: build_initial_monmap 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 10 monclient: monmap: 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:19.404 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 Processor -- start 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 1 -- start start 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.389+0000 7f7f1deda640 10 monclient: init 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-a con 0x7f7f1809aa50 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:19.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-c con 0x7f7f1809e370 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f18139950 0x7f7f18139d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): picked mon.noname-b con 0x7f7f18139950 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f180a3e20 con 0x7f7f1809aa50 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1806e140 con 0x7f7f18139950 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f180a3fa0 con 0x7f7f1809e370 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f1deda640 10 monclient(hunting): authenticate will time out at 2047.009106s 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:19.406 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53066/0 (socket says 10.20.193.51:53066) 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 -- 10.20.193.51:0/2570127511 learned_addr learned my addr 10.20.193.51:0/2570127511 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): get_auth_request con 0x7f7f1809aa50 auth_method 0 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 10 monclient(hunting): get_auth_request con 0x7f7f1809e370 auth_method 0 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:19.407 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 msgr2=0x7f7f18099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 msgr2=0x7f7f18099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient(hunting): handle_auth_done global_id 274272 payload 824 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 msgr2=0x7f7f18099f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f18139950 msgr2=0x7f7f18139d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f18139950 0x7f7f18139d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient: _finish_hunting 0 2026-02-17T12:09:19.408 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 monclient: found mon.noname-a 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.390+0000 7f7f177fe640 1 -- 10.20.193.51:0/2570127511 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f180931f0 con 0x7f7f1809aa50 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.392+0000 7f7f177fe640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 msgr2=0x7f7f18099a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.392+0000 7f7f177fe640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c780 tx=0x7f7f0400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.392+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005de0 con 0x7f7f1809aa50 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: dump: 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:19.409 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: _finish_auth 0 2026-02-17T12:09:19.410 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f04007070 con 0x7f7f1809aa50 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04007440 con 0x7f7f1809aa50 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7ef3fff640 10 monclient: dump: 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:19.411 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f15ffb640 4 set_mon_vals no callback set 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 5 monclient: authenticate success, global_id 274272 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 10 monclient: _renew_subs 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f180944c0 con 0x7f7f1809aa50 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 10 monclient: _renew_subs 2026-02-17T12:09:19.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.394+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1813b920 con 0x7f7f1809aa50 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7f040075e0 con 0x7f7f1809aa50 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f1deda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f1deda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f1deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1806e4a0 con 0x7f7f1809aa50 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7ef3fff640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 0x7f7ee8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(865..865 src has 323..865) ==== 4767+0+0 (secure 0 0 0) 0x7f7f04052430 con 0x7f7f1809aa50 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 0x7f7ee8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.395+0000 7f7f16ffd640 10 monclient: get_auth_request con 0x7f7ee803dd60 auth_method 0 2026-02-17T12:09:19.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.397+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f1806e4a0 con 0x7f7f1809aa50 2026-02-17T12:09:19.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.397+0000 7f7ef3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:19.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.397+0000 7f7ef3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:19.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.398+0000 7f7f16ffd640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 0x7f7ee8040220 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806c1c0 tx=0x7f7f08033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:19.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.517+0000 7f7f1deda640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:09:19.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.517+0000 7f7f1deda640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:19.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.517+0000 7f7f1deda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:19.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.517+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f1809dcc0 con 0x7f7f1809aa50 2026-02-17T12:09:19.520 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.517+0000 7f7ef3fff640 1 -- 10.20.193.51:0/2570127511 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f7f0400a8d0 con 0x7f7f1809aa50 2026-02-17T12:09:19.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7ef3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:19.521 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7ef3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:19.521 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":222,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 msgr2=0x7f7ee8040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 0x7f7ee8040220 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806c1c0 tx=0x7f7f08033000 comp rx=0 tx=0).stop 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 10 monclient: shutdown 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 msgr2=0x7f7f18099a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c780 tx=0x7f7f0400cc50 comp rx=0 tx=0).stop 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 shutdown_connections 2026-02-17T12:09:19.523 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ee803dd60 0x7f7ee8040220 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f18139950 0x7f7f18139d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f1809e370 0x7f7f18099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 --2- 10.20.193.51:0/2570127511 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f1809aa50 0x7f7f18099a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:19.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 >> 10.20.193.51:0/2570127511 conn(0x7f7f180a30c0 msgr2=0x7f7f1813c590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:19.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 shutdown_connections 2026-02-17T12:09:19.525 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:19.518+0000 7f7f1deda640 1 -- 10.20.193.51:0/2570127511 wait complete. 2026-02-17T12:09:19.727 INFO:tasks.rados.rados.0.trial142.stdout:3728: done (5 left) 2026-02-17T12:09:19.727 INFO:tasks.rados.rados.0.trial142.stdout:3729: write (excl) oid 40 current snap is 416 2026-02-17T12:09:19.727 INFO:tasks.rados.rados.0.trial142.stdout:3729: seq_num 1270 ranges {544890=597181,1917308=563106,3076142=268748} 2026-02-17T12:09:19.731 INFO:tasks.rados.rados.0.trial142.stdout:3729: writing trial14245205-40 from 544890 to 1142071 tid 1 2026-02-17T12:09:19.737 INFO:tasks.rados.rados.0.trial142.stdout:3729: writing trial14245205-40 from 1917308 to 2480414 tid 2 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:3729: writing trial14245205-40 from 3076142 to 3344890 tid 3 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:3730: copy_from oid 15 from oid 32 current snap is 416 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:3722: finishing rollback tid 0 to trial14245205-48 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:3722: finishing rollback tid 1 to trial14245205-48 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:3722: finishing rollback tid 2 to trial14245205-48 2026-02-17T12:09:19.741 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 3098 (ObjNum 1262 snap 413 seq_num 1262) dirty exists 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3722: done (6 left) 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3726: done (5 left) 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3731: copy_from oid 29 from oid 45 current snap is 416 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3723: finishing copy_from racing read to trial14245205-35 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3727: finishing write tid 1 to trial14245205-30 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3725: finishing copy_from racing read to trial14245205-13 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3723: finishing copy_from to trial14245205-35 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 3088 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3727: finishing write tid 2 to trial14245205-30 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3725: finishing copy_from to trial14245205-13 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 3700 (ObjNum 1251 snap 409 seq_num 1251) dirty exists 2026-02-17T12:09:19.742 INFO:tasks.rados.rados.0.trial142.stdout:3727: finishing write tid 3 to trial14245205-30 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3723: done (5 left) 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3725: done (4 left) 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3732: snap_create 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: finishing write tid 4 to trial14245205-30 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: finishing write tid 5 to trial14245205-30 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: oid 30 updating version 0 to 3099 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: oid 30 updating version 3099 to 3102 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: oid 30 version 3102 is already newer than 3101 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: oid 30 version 3102 is already newer than 3100 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 3102 (ObjNum 1269 snap 416 seq_num 1269) dirty exists 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3727: left oid 30 (ObjNum 1269 snap 416 seq_num 1269) 2026-02-17T12:09:19.743 INFO:tasks.rados.rados.0.trial142.stdout:3729: finishing write tid 1 to trial14245205-40 2026-02-17T12:09:19.744 INFO:tasks.rados.rados.0.trial142.stdout:3729: finishing write tid 2 to trial14245205-40 2026-02-17T12:09:19.744 INFO:tasks.rados.rados.0.trial142.stdout:3729: finishing write tid 3 to trial14245205-40 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: finishing write tid 4 to trial14245205-40 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: finishing write tid 5 to trial14245205-40 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: oid 40 updating version 0 to 3367 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: oid 40 version 3367 is already newer than 3366 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: oid 40 updating version 3367 to 3368 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: oid 40 version 3368 is already newer than 3365 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 3368 (ObjNum 1270 snap 416 seq_num 1270) dirty exists 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3729: left oid 40 (ObjNum 1270 snap 416 seq_num 1270) 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3731: finishing copy_from to trial14245205-29 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3731: got expected ENOENT (src dne) 2026-02-17T12:09:19.745 INFO:tasks.rados.rados.0.trial142.stdout:3731: finishing copy_from racing read to trial14245205-29 2026-02-17T12:09:19.746 INFO:tasks.rados.rados.0.trial142.stdout:3730: finishing copy_from racing read to trial14245205-15 2026-02-17T12:09:19.746 INFO:tasks.rados.rados.0.trial142.stdout:3730: finishing copy_from to trial14245205-15 2026-02-17T12:09:19.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3095 (ObjNum 1229 snap 406 seq_num 1229) dirty exists 2026-02-17T12:09:20.730 INFO:tasks.rados.rados.0.trial142.stdout:3727: done (4 left) 2026-02-17T12:09:20.730 INFO:tasks.rados.rados.0.trial142.stdout:3729: done (3 left) 2026-02-17T12:09:20.730 INFO:tasks.rados.rados.0.trial142.stdout:3730: done (2 left) 2026-02-17T12:09:20.730 INFO:tasks.rados.rados.0.trial142.stdout:3731: done (1 left) 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3732: done (0 left) 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3733: copy_from oid 48 from oid 26 current snap is 417 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3734: rollback oid 4 current snap is 417 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 4 to 414 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3735: read oid 31 snap -1 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3735: expect deleted 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3736: copy_from oid 3 from oid 21 current snap is 417 2026-02-17T12:09:20.731 INFO:tasks.rados.rados.0.trial142.stdout:3737: snap_create 2026-02-17T12:09:20.732 INFO:tasks.rados.rados.0.trial142.stdout:3733: finishing copy_from to trial14245205-48 2026-02-17T12:09:20.732 INFO:tasks.rados.rados.0.trial142.stdout:3733: got expected ENOENT (src dne) 2026-02-17T12:09:20.732 INFO:tasks.rados.rados.0.trial142.stdout:3733: finishing copy_from racing read to trial14245205-48 2026-02-17T12:09:20.734 INFO:tasks.rados.rados.0.trial142.stdout:3734: finishing rollback tid 0 to trial14245205-4 2026-02-17T12:09:20.734 INFO:tasks.rados.rados.0.trial142.stdout:3734: finishing rollback tid 1 to trial14245205-4 2026-02-17T12:09:20.734 INFO:tasks.rados.rados.0.trial142.stdout:3734: finishing rollback tid 2 to trial14245205-4 2026-02-17T12:09:20.734 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3722 (ObjNum 1245 snap 407 seq_num 1245) dirty exists 2026-02-17T12:09:20.736 INFO:tasks.rados.rados.0.trial142.stdout:3736: finishing copy_from racing read to trial14245205-3 2026-02-17T12:09:20.741 INFO:tasks.rados.rados.0.trial142.stdout:3736: finishing copy_from to trial14245205-3 2026-02-17T12:09:20.741 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2559 (ObjNum 1205 snap 391 seq_num 1205) dirty exists 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3733: done (4 left) 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3734: done (3 left) 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3735: done (2 left) 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3736: done (1 left) 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3737: done (0 left) 2026-02-17T12:09:21.730 INFO:tasks.rados.rados.0.trial142.stdout:3738: snap_remove snap 417 2026-02-17T12:09:22.529 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:09:22.605 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.594+0000 7f8a39751640 10 monclient: get_monmap_and_config 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.594+0000 7f8a39751640 10 monclient: build_initial_monmap 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.594+0000 7f8a39751640 10 monclient: monmap: 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:22.595550+0000 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:22.595550+0000 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:22.606 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.594+0000 7f8a39751640 1 Processor -- start 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 -- start start 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient: init 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.607 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-a con 0x7f8a340a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-c con 0x7f8a340a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-b con 0x7f8a3409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f8a340a3f90 con 0x7f8a340a3bb0 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3406e140 con 0x7f8a340a0750 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3409f910 con 0x7f8a3409e540 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:22.608 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a39751640 10 monclient(hunting): authenticate will time out at 2050.214307s 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53102/0 (socket says 10.20.193.51:53102) 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 -- 10.20.193.51:0/97491020 learned_addr learned my addr 10.20.193.51:0/97491020 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): get_auth_request con 0x7f8a340a3bb0 auth_method 0 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 10 monclient(hunting): get_auth_request con 0x7f8a3409e540 auth_method 0 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:22.609 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 1 --2- 10.20.193.51:0/97491020 >> v2:10.20.193.142:3300/0 conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 1 -- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 msgr2=0x7f8a3413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 1 -- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 msgr2=0x7f8a3413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): get_auth_request con 0x7f8a340a0750 auth_method 0 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a337fe640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:22.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient(hunting): handle_auth_done global_id 274275 payload 274 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 -- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 msgr2=0x7f8a3413c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 -- 10.20.193.51:0/97491020 >> v2:10.20.193.142:3300/0 conn(0x7f8a340a0750 msgr2=0x7f8a3409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/97491020 >> v2:10.20.193.142:3300/0 conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 monclient: found mon.noname-a 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:22.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.595+0000 7f8a32ffd640 1 -- 10.20.193.51:0/97491020 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3409ccd0 con 0x7f8a340a3bb0 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a32ffd640 1 -- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406f3c0 tx=0x7f8a2802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5869d5bbb7205ed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 1 -- 10.20.193.51:0/97491020 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803c070 con 0x7f8a340a3bb0 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: dump: 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.612 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: _finish_auth 0 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 1 -- 10.20.193.51:0/97491020 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2802fca0 con 0x7f8a340a3bb0 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 5 monclient: authenticate success, global_id 274275 2026-02-17T12:09:22.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 1 -- 10.20.193.51:0/97491020 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037660 con 0x7f8a340a3bb0 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 4 set_mon_vals no callback set 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a31ffb640 10 monclient: dump: 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.614 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 10 monclient: shutdown 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 -- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406f3c0 tx=0x7f8a2802ee60 comp rx=0 tx=0).stop 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 -- 10.20.193.51:0/97491020 shutdown_connections 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a3409e540 0x7f8a3413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 --2- 10.20.193.51:0/97491020 >> v2:10.20.193.142:3300/0 conn(0x7f8a340a0750 0x7f8a3409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 --2- 10.20.193.51:0/97491020 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a3bb0 0x7f8a3409dac0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 -- 10.20.193.51:0/97491020 >> 10.20.193.51:0/97491020 conn(0x7f8a340a30c0 msgr2=0x7f8a340a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 -- 10.20.193.51:0/97491020 shutdown_connections 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.598+0000 7f8a39751640 1 -- 10.20.193.51:0/97491020 wait complete. 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient: build_initial_monmap 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient: monmap: 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.616 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 Processor -- start 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 -- start start 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient: init 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 0x7f8a3413b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-b con 0x7f8a3409e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-a con 0x7f8a340a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): picked mon.noname-c con 0x7f8a340a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8a340a04b0 con 0x7f8a340a0750 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3409c850 con 0x7f8a3409e540 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3413cca0 con 0x7f8a340a3bb0 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a39751640 10 monclient(hunting): authenticate will time out at 2050.218684s 2026-02-17T12:09:22.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:53116/0 (socket says 10.20.193.51:53116) 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:59088/0 (socket says 10.20.193.51:59088) 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 -- 10.20.193.51:0/2146942310 learned_addr learned my addr 10.20.193.51:0/2146942310 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): get_auth_request con 0x7f8a340a0750 auth_method 0 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 10 monclient(hunting): get_auth_request con 0x7f8a340a3bb0 auth_method 0 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:22.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a341305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a341305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a337fe640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient(hunting): handle_auth_done global_id 274278 payload 824 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 msgr2=0x7f8a341305b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 0x7f8a3413b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 msgr2=0x7f8a3413b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 0x7f8a3413b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient: _finish_hunting 0 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 monclient: found mon.noname-a 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a327fc640 1 -- 10.20.193.51:0/2146942310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3413c5b0 con 0x7f8a340a0750 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a32ffd640 10 monclient: get_auth_request con 0x7f8a3409e540 auth_method 0 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.599+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 0x7f8a3413b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a327fc640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 msgr2=0x7f8a34130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a327fc640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ebe0 tx=0x7f8a1c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:22.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c017070 con 0x7f8a340a0750 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: dump: 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:22.622 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: _finish_auth 0 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00cdf0 con 0x7f8a340a0750 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 5 monclient: authenticate success, global_id 274278 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _renew_subs 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3409d7b0 con 0x7f8a340a0750 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:22.623 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0136b0 con 0x7f8a340a0750 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a317fa640 4 set_mon_vals no callback set 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 10 monclient: dump: 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:22.624 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _renew_subs 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a341327f0 con 0x7f8a340a0750 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3409dac0 con 0x7f8a340a0750 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.602+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8a1c024060 con 0x7f8a340a0750 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.603+0000 7f8a137fe640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 0x7f8a000401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:22.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.603+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(868..868 src has 323..868) ==== 4783+0+0 (secure 0 0 0) 0x7f8a1c052700 con 0x7f8a340a0750 2026-02-17T12:09:22.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.603+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 0x7f8a000401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:22.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.603+0000 7f8a32ffd640 10 monclient: get_auth_request con 0x7f8a0003dd10 auth_method 0 2026-02-17T12:09:22.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.605+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8a1c013900 con 0x7f8a340a0750 2026-02-17T12:09:22.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.605+0000 7f8a137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:22.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.605+0000 7f8a137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:22.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.605+0000 7f8a32ffd640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 0x7f8a000401d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8a28036000 tx=0x7f8a28039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.718+0000 7f8a39751640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.718+0000 7f8a39751640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.718+0000 7f8a39751640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.718+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8a340008d0 con 0x7f8a340a0750 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.719+0000 7f8a137fe640 1 -- 10.20.193.51:0/2146942310 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f8a1c013bd0 con 0x7f8a340a0750 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.719+0000 7f8a137fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:22.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.719+0000 7f8a137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:22.722 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":222,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:09:22.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 msgr2=0x7f8a000401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:22.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 0x7f8a000401d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8a28036000 tx=0x7f8a28039040 comp rx=0 tx=0).stop 2026-02-17T12:09:22.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 10 monclient: shutdown 2026-02-17T12:09:22.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:22.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 msgr2=0x7f8a34130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ebe0 tx=0x7f8a1c00c520 comp rx=0 tx=0).stop 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 shutdown_connections 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8a0003dd10 0x7f8a000401d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8a340a3bb0 0x7f8a341305b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8a340a0750 0x7f8a34130070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 --2- 10.20.193.51:0/2146942310 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8a3409e540 0x7f8a3413b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 >> 10.20.193.51:0/2146942310 conn(0x7f8a340a30c0 msgr2=0x7f8a34072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 shutdown_connections 2026-02-17T12:09:22.724 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:22.720+0000 7f8a39751640 1 -- 10.20.193.51:0/2146942310 wait complete. 2026-02-17T12:09:22.725 INFO:tasks.rados.rados.0.trial142.stdout:3738: done (0 left) 2026-02-17T12:09:22.725 INFO:tasks.rados.rados.0.trial142.stdout:3739: read oid 13 snap 414 2026-02-17T12:09:22.725 INFO:tasks.rados.rados.0.trial142.stdout:3739: expect (ObjNum 1261 snap 413 seq_num 1261) 2026-02-17T12:09:22.725 INFO:tasks.rados.rados.0.trial142.stdout:3740: read oid 16 snap -1 2026-02-17T12:09:22.725 INFO:tasks.rados.rados.0.trial142.stdout:3740: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:22.726 INFO:tasks.rados.rados.0.trial142.stdout:3741: write (excl) oid 21 current snap is 418 2026-02-17T12:09:22.726 INFO:tasks.rados.rados.0.trial142.stdout:3741: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2026-02-17T12:09:22.727 INFO:tasks.rados.rados.0.trial142.stdout:3741: writing trial14245205-21 from 561697 to 1234127 tid 1 2026-02-17T12:09:22.733 INFO:tasks.rados.rados.0.trial142.stdout:3741: writing trial14245205-21 from 1975790 to 2682554 tid 2 2026-02-17T12:09:22.736 INFO:tasks.rados.rados.0.trial142.stdout:3741: writing trial14245205-21 from 3103565 to 3361697 tid 3 2026-02-17T12:09:22.736 INFO:tasks.rados.rados.0.trial142.stdout:3742: snap_create 2026-02-17T12:09:22.736 INFO:tasks.rados.rados.0.trial142.stdout:3740: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:22.923 INFO:tasks.rados.rados.0.trial142.stdout:3741: finishing write tid 1 to trial14245205-21 2026-02-17T12:09:22.923 INFO:tasks.rados.rados.0.trial142.stdout:3739: expect (ObjNum 1261 snap 413 seq_num 1261) 2026-02-17T12:09:23.048 INFO:tasks.rados.rados.0.trial142.stdout:3741: finishing write tid 2 to trial14245205-21 2026-02-17T12:09:23.048 INFO:tasks.rados.rados.0.trial142.stdout:3741: finishing write tid 3 to trial14245205-21 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: finishing write tid 4 to trial14245205-21 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: finishing write tid 5 to trial14245205-21 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: oid 21 updating version 0 to 2758 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: oid 21 version 2758 is already newer than 2756 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: oid 21 version 2758 is already newer than 2757 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: oid 21 version 2758 is already newer than 2755 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2758 (ObjNum 1271 snap 418 seq_num 1271) dirty exists 2026-02-17T12:09:23.049 INFO:tasks.rados.rados.0.trial142.stdout:3741: left oid 21 (ObjNum 1271 snap 418 seq_num 1271) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3739: done (3 left) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3740: done (2 left) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3741: done (1 left) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3742: done (0 left) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3743: rollback oid 11 current snap is 419 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 418 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3744: rollback oid 15 current snap is 419 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 416 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3745: read oid 30 snap 416 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3745: expect (ObjNum 1269 snap 416 seq_num 1269) 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3746: copy_from oid 46 from oid 28 current snap is 419 2026-02-17T12:09:23.737 INFO:tasks.rados.rados.0.trial142.stdout:3747: snap_create 2026-02-17T12:09:23.740 INFO:tasks.rados.rados.0.trial142.stdout:3743: finishing rollback tid 0 to trial14245205-11 2026-02-17T12:09:23.741 INFO:tasks.rados.rados.0.trial142.stdout:3743: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:09:23.741 INFO:tasks.rados.rados.0.trial142.stdout:3743: finishing rollback tid 2 to trial14245205-11 2026-02-17T12:09:23.741 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3094 (ObjNum 1246 snap 407 seq_num 1246) dirty exists 2026-02-17T12:09:23.741 INFO:tasks.rados.rados.0.trial142.stdout:3744: finishing rollback tid 0 to trial14245205-15 2026-02-17T12:09:23.742 INFO:tasks.rados.rados.0.trial142.stdout:3744: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:09:23.742 INFO:tasks.rados.rados.0.trial142.stdout:3745: expect (ObjNum 1269 snap 416 seq_num 1269) 2026-02-17T12:09:23.884 INFO:tasks.rados.rados.0.trial142.stdout:3744: finishing rollback tid 2 to trial14245205-15 2026-02-17T12:09:23.885 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3703 (ObjNum 1229 snap 406 seq_num 1229) dirty exists 2026-02-17T12:09:23.885 INFO:tasks.rados.rados.0.trial142.stdout:3746: finishing copy_from racing read to trial14245205-46 2026-02-17T12:09:23.885 INFO:tasks.rados.rados.0.trial142.stdout:3746: finishing copy_from to trial14245205-46 2026-02-17T12:09:23.885 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2754 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3743: done (4 left) 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3744: done (3 left) 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3745: done (2 left) 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3746: done (1 left) 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3747: done (0 left) 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3748: rollback oid 28 current snap is 420 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 28 to 414 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3749: rollback oid 15 current snap is 420 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 15 to 418 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3750: write oid 11 current snap is 420 2026-02-17T12:09:24.739 INFO:tasks.rados.rados.0.trial142.stdout:3750: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2026-02-17T12:09:24.744 INFO:tasks.rados.rados.0.trial142.stdout:3750: writing trial14245205-11 from 578504 to 1326183 tid 1 2026-02-17T12:09:24.748 INFO:tasks.rados.rados.0.trial142.stdout:3750: writing trial14245205-11 from 2034272 to 2601047 tid 2 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3750: writing trial14245205-11 from 3130988 to 3378504 tid 3 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3751: snap_create 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3749: finishing rollback tid 0 to trial14245205-15 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3749: finishing rollback tid 1 to trial14245205-15 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3749: finishing rollback tid 2 to trial14245205-15 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3706 (ObjNum 1229 snap 406 seq_num 1229) dirty exists 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3748: finishing rollback tid 0 to trial14245205-28 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3748: finishing rollback tid 1 to trial14245205-28 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3748: finishing rollback tid 2 to trial14245205-28 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 28 v 2762 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3750: finishing write tid 1 to trial14245205-11 2026-02-17T12:09:24.752 INFO:tasks.rados.rados.0.trial142.stdout:3750: finishing write tid 2 to trial14245205-11 2026-02-17T12:09:24.753 INFO:tasks.rados.rados.0.trial142.stdout:3750: finishing write tid 3 to trial14245205-11 2026-02-17T12:09:24.753 INFO:tasks.rados.rados.0.trial142.stdout:3750: finishing write tid 4 to trial14245205-11 2026-02-17T12:09:24.753 INFO:tasks.rados.rados.0.trial142.stdout:3750: finishing write tid 5 to trial14245205-11 2026-02-17T12:09:24.753 INFO:tasks.rados.rados.0.trial142.stdout:3750: oid 11 updating version 0 to 3096 2026-02-17T12:09:24.753 INFO:tasks.rados.rados.0.trial142.stdout:3750: oid 11 version 3096 is already newer than 3095 2026-02-17T12:09:24.754 INFO:tasks.rados.rados.0.trial142.stdout:3750: oid 11 updating version 3096 to 3098 2026-02-17T12:09:24.754 INFO:tasks.rados.rados.0.trial142.stdout:3750: oid 11 version 3098 is already newer than 3097 2026-02-17T12:09:24.754 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3098 (ObjNum 1272 snap 420 seq_num 1272) dirty exists 2026-02-17T12:09:24.754 INFO:tasks.rados.rados.0.trial142.stdout:3750: left oid 11 (ObjNum 1272 snap 420 seq_num 1272) 2026-02-17T12:09:25.732 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:09:25.741 INFO:tasks.rados.rados.0.trial142.stdout:3748: done (3 left) 2026-02-17T12:09:25.741 INFO:tasks.rados.rados.0.trial142.stdout:3749: done (2 left) 2026-02-17T12:09:25.741 INFO:tasks.rados.rados.0.trial142.stdout:3750: done (1 left) 2026-02-17T12:09:25.741 INFO:tasks.rados.rados.0.trial142.stdout:3751: done (0 left) 2026-02-17T12:09:25.742 INFO:tasks.rados.rados.0.trial142.stdout:3752: read oid 26 snap -1 2026-02-17T12:09:25.742 INFO:tasks.rados.rados.0.trial142.stdout:3752: expect deleted 2026-02-17T12:09:25.742 INFO:tasks.rados.rados.0.trial142.stdout:3753: snap_create 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 10 monclient: get_monmap_and_config 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 10 monclient: build_initial_monmap 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 10 monclient: monmap: 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:25.805 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:25.802320+0000 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:25.802320+0000 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 1 Processor -- start 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 1 -- start start 2026-02-17T12:09:25.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 10 monclient: init 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.801+0000 7f9a51afa640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a4c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9a4c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9a4c13c770 0x7f9a4c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-c con 0x7f9a4c13c770 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c09e8e0 con 0x7f9a4c0a3bb0 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c06e140 con 0x7f9a4c0a0750 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4c09f910 con 0x7f9a4c13c770 2026-02-17T12:09:25.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a51afa640 10 monclient(hunting): authenticate will time out at 2053.421069s 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4b7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f9a4c0a3bb0 0x7f9a4c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44066/0 (socket says 10.20.193.51:44066) 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4b7fe640 1 -- 10.20.193.51:0/3621931364 learned_addr learned my addr 10.20.193.51:0/3621931364 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 1 --2- 10.20.193.51:0/3621931364 >> v2:10.20.193.142:3300/0 conn(0x7f9a4c13c770 0x7f9a4c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): get_auth_request con 0x7f9a4c13c770 auth_method 0 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:25.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_done global_id 284146 payload 274 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 1 -- 10.20.193.51:0/3621931364 >> v1:10.20.193.142:6789/0 conn(0x7f9a4c0a0750 legacy=0x7f9a4c09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 1 -- 10.20.193.51:0/3621931364 >> v1:10.20.193.51:6789/0 conn(0x7f9a4c0a3bb0 legacy=0x7f9a4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 1 monclient: found mon.noname-c 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:09:25.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.802+0000 7f9a4bfff640 1 -- 10.20.193.51:0/3621931364 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c09ccd0 con 0x7f9a4c13c770 2026-02-17T12:09:25.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4bfff640 1 -- 10.20.193.51:0/3621931364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c13c770 msgr2=0x7f9a4c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4bfff640 1 --2- 10.20.193.51:0/3621931364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c13c770 0x7f9a4c13eb60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a4002f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b740224f4a1b62a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 1 -- 10.20.193.51:0/3621931364 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4003c070 con 0x7f9a4c13c770 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: dump: 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 5 monclient: authenticate success, global_id 284146 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:25.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 1 -- 10.20.193.51:0/3621931364 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40037640 con 0x7f9a4c13c770 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 1 -- 10.20.193.51:0/3621931364 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40037a10 con 0x7f9a4c13c770 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 4 set_mon_vals no callback set 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a4a7fc640 10 monclient: dump: 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.818 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 10 monclient: shutdown 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 -- 10.20.193.51:0/3621931364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c13c770 msgr2=0x7f9a4c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 --2- 10.20.193.51:0/3621931364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c13c770 0x7f9a4c13eb60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a4002f190 comp rx=0 tx=0).stop 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 -- 10.20.193.51:0/3621931364 shutdown_connections 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 --2- 10.20.193.51:0/3621931364 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c13c770 0x7f9a4c13eb60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 -- 10.20.193.51:0/3621931364 >> 10.20.193.51:0/3621931364 conn(0x7f9a4c0a30c0 msgr2=0x7f9a4c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 -- 10.20.193.51:0/3621931364 shutdown_connections 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.805+0000 7f9a51afa640 1 -- 10.20.193.51:0/3621931364 wait complete. 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient: build_initial_monmap 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient: monmap: 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:25.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 Processor -- start 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 -- start start 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient: init 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 0x7f9a4c0998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-b con 0x7f9a4c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-c con 0x7f9a4c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:25.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): picked mon.noname-a con 0x7f9a4c13c770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c09c850 con 0x7f9a4c13c770 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c09ebe0 con 0x7f9a4c0a0750 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4c0a04b0 con 0x7f9a4c0a3bb0 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a51afa640 10 monclient(hunting): authenticate will time out at 2053.425800s 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41430/0 (socket says 10.20.193.51:41430) 2026-02-17T12:09:25.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 1 -- 10.20.193.51:0/2092248053 learned_addr learned my addr 10.20.193.51:0/2092248053 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): get_auth_request con 0x7f9a4c13c770 auth_method 0 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 10 monclient(hunting): get_auth_request con 0x7f9a4c0a3bb0 auth_method 0 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:25.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 msgr2=0x7f9a4c0903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 msgr2=0x7f9a4c0903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.806+0000 7f9a4affd640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 10 monclient(hunting): handle_auth_done global_id 274281 payload 824 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4b7fe640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 0x7f9a4c0998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 msgr2=0x7f9a4c0903f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 msgr2=0x7f9a4c0998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 0x7f9a4c0998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 monclient: found mon.noname-a 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4bfff640 1 -- 10.20.193.51:0/2092248053 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c0938b0 con 0x7f9a4c13c770 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4b7fe640 10 monclient: get_auth_request con 0x7f9a4c0a0750 auth_method 0 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.807+0000 7f9a4b7fe640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 0x7f9a4c0998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a4bfff640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 msgr2=0x7f9a4c090930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a4bfff640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a40004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40047020 con 0x7f9a4c13c770 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:25.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: dump: 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: _finish_auth 0 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:25.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40042880 con 0x7f9a4c13c770 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 5 monclient: authenticate success, global_id 274281 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _renew_subs 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c093b90 con 0x7f9a4c13c770 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4003c040 con 0x7f9a4c13c770 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a27fff640 10 monclient: dump: 2026-02-17T12:09:25.827 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a49ffb640 4 set_mon_vals no callback set 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _renew_subs 2026-02-17T12:09:25.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c13cb50 con 0x7f9a4c13c770 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.809+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c09dac0 con 0x7f9a4c13c770 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.810+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9a40043420 con 0x7f9a4c13c770 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.810+0000 7f9a27fff640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 0x7f9a1c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.810+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(872..872 src has 323..872) ==== 4751+0+0 (secure 0 0 0) 0x7f9a40078690 con 0x7f9a4c13c770 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.810+0000 7f9a4b7fe640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 0x7f9a1c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.810+0000 7f9a4b7fe640 10 monclient: get_auth_request con 0x7f9a1c03dd10 auth_method 0 2026-02-17T12:09:25.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.812+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9a40051030 con 0x7f9a4c13c770 2026-02-17T12:09:25.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.812+0000 7f9a27fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:25.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.812+0000 7f9a27fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:25.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.813+0000 7f9a4b7fe640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 0x7f9a1c0401d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9a380052b0 tx=0x7f9a38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:25.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a51afa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:09:25.936 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a51afa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a51afa640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9a4c0926d0 con 0x7f9a4c13c770 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a27fff640 1 -- 10.20.193.51:0/2092248053 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f9a40036e20 con 0x7f9a4c13c770 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a27fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.934+0000 7f9a27fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:25.937 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":224,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 msgr2=0x7f9a1c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 0x7f9a1c0401d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9a380052b0 tx=0x7f9a38009040 comp rx=0 tx=0).stop 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 10 monclient: shutdown 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 msgr2=0x7f9a4c090930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a40004b40 comp rx=0 tx=0).stop 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 shutdown_connections 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9a1c03dd10 0x7f9a1c0401d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9a4c13c770 0x7f9a4c090930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9a4c0a3bb0 0x7f9a4c0903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 --2- 10.20.193.51:0/2092248053 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9a4c0a0750 0x7f9a4c0998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:25.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 >> 10.20.193.51:0/2092248053 conn(0x7f9a4c0a30c0 msgr2=0x7f9a4c0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:25.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 shutdown_connections 2026-02-17T12:09:25.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:25.935+0000 7f9a51afa640 1 -- 10.20.193.51:0/2092248053 wait complete. 2026-02-17T12:09:25.944 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:09:25.945 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:09:25.945 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:09:26.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.011+0000 7fd0736c9640 10 monclient: get_monmap_and_config 2026-02-17T12:09:26.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient: build_initial_monmap 2026-02-17T12:09:26.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient: monmap: 2026-02-17T12:09:26.016 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:26.012975+0000 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:26.012975+0000 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 Processor -- start 2026-02-17T12:09:26.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 -- start start 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient: init 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd06c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd06c0a0750 0x7fd06c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd06c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd06c09e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c06e140 con 0x7fd06c09e540 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0a3f90 con 0x7fd06c0a0750 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c09f910 con 0x7fd06c0a3bb0 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd0736c9640 10 monclient(hunting): authenticate will time out at 2053.631769s 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd06c0a0750 0x7fd06c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57430/0 (socket says 10.20.193.51:57430) 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 -- 10.20.193.51:0/1188466949 learned_addr learned my addr 10.20.193.51:0/1188466949 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd06c0a0750 0x7fd06c09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41446/0 (socket says 10.20.193.51:41446) 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 10 monclient(hunting): get_auth_request con 0x7fd06c0a3bb0 auth_method 0 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): get_auth_request con 0x7fd06c0a0750 auth_method 0 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 -- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 -- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.012+0000 7fd07143e640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 10 monclient(hunting): handle_auth_done global_id 274284 payload 274 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 1 -- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 1 -- 10.20.193.51:0/1188466949 >> v1:10.20.193.51:6789/0 conn(0x7fd06c09e540 legacy=0x7fd06c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 10 monclient: _finish_hunting 0 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 1 monclient: found mon.noname-a 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.020 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.013+0000 7fd070c3d640 1 -- 10.20.193.51:0/1188466949 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c09ccd0 con 0x7fd06c0a0750 2026-02-17T12:09:26.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd070c3d640 1 -- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 msgr2=0x7fd06c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd070c3d640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c09e000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd06c069d60 tx=0x7fd06002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d118688ff24280 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 1 -- 10.20.193.51:0/1188466949 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06003c070 con 0x7fd06c0a0750 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: dump: 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.031 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: _finish_auth 0 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 1 -- 10.20.193.51:0/1188466949 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06002fbd0 con 0x7fd06c0a0750 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 5 monclient: authenticate success, global_id 274284 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 1 -- 10.20.193.51:0/1188466949 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060037440 con 0x7fd06c0a0750 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd05bfff640 10 monclient: dump: 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:26.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 4 set_mon_vals no callback set 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 10 monclient: shutdown 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 -- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 msgr2=0x7fd06c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c09e000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd06c069d60 tx=0x7fd06002ed50 comp rx=0 tx=0).stop 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 -- 10.20.193.51:0/1188466949 shutdown_connections 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c09e000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 --2- 10.20.193.51:0/1188466949 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 -- 10.20.193.51:0/1188466949 >> 10.20.193.51:0/1188466949 conn(0x7fd06c0a30c0 msgr2=0x7fd06c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 -- 10.20.193.51:0/1188466949 shutdown_connections 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.015+0000 7fd0736c9640 1 -- 10.20.193.51:0/1188466949 wait complete. 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient: build_initial_monmap 2026-02-17T12:09:26.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient: monmap: 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:26.035 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 Processor -- start 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 -- start start 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient: init 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd06c09e540 0x7fd06c1cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd06c09e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd06c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c1cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): picked mon.noname-c con 0x7fd06c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0a04b0 con 0x7fd06c0a0750 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c09c850 con 0x7fd06c09e540 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c13de80 con 0x7fd06c0a3bb0 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd0736c9640 10 monclient(hunting): authenticate will time out at 2053.635943s 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.016+0000 7fd070c3d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c1cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c099b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41458/0 (socket says 10.20.193.51:41458) 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 -- 10.20.193.51:0/3399924661 learned_addr learned my addr 10.20.193.51:0/3399924661 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): get_auth_request con 0x7fd06c0a0750 auth_method 0 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 10 monclient(hunting): get_auth_request con 0x7fd06c0a3bb0 auth_method 0 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c1cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c1cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c1cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd071c3f640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c1cf2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd07143e640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd06c09e540 0x7fd06c1cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd07143e640 10 monclient(hunting): get_auth_request con 0x7fd06c09e540 auth_method 0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd07143e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd07143e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd07143e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient(hunting): handle_auth_done global_id 274287 payload 824 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 msgr2=0x7fd06c1cf2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd06c0a3bb0 0x7fd06c1cf2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd06c09e540 msgr2=0x7fd06c1cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd06c09e540 0x7fd06c1cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient: _finish_hunting 0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 monclient: found mon.noname-a 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.017+0000 7fd070c3d640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c092670 con 0x7fd06c0a0750 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd070c3d640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 msgr2=0x7fd06c099b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd070c3d640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c099b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd0600099a0 tx=0x7fd0600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060046070 con 0x7fd06c0a0750 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: dump: 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: _finish_auth 0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd060041890 con 0x7fd06c0a0750 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 5 monclient: authenticate success, global_id 274287 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 monclient: _renew_subs 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c091310 con 0x7fd06c0a0750 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06003c040 con 0x7fd06c0a0750 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd05b7fe640 4 set_mon_vals no callback set 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd059ffb640 10 monclient: dump: 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 monclient: _renew_subs 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c1cc800 con 0x7fd06c0a0750 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 0x7fd06c1cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c09d7b0 con 0x7fd06c09a0c0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd07143e640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 0x7fd06c1cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd07143e640 10 monclient: get_auth_request con 0x7fd06c09a0c0 auth_method 0 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd07143e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd07143e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.019+0000 7fd07143e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:26.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd060041c80 con 0x7fd06c0a0750 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd07143e640 10 monclient(hunting): handle_auth_done global_id 274290 payload 824 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd07143e640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd06c0930b0 con 0x7fd06c09a0c0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd059ffb640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd03c03dd10 0x7fd03c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(872..872 src has 323..872) ==== 4751+0+0 (secure 0 0 0) 0x7fd060077ee0 con 0x7fd06c0a0750 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd071c3f640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd03c03dd10 0x7fd03c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.020+0000 7fd071c3f640 10 monclient: get_auth_request con 0x7fd03c03dd10 auth_method 0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd07143e640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 msgr2=0x7fd06c1cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd07143e640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 0x7fd06c1cf820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c019070 con 0x7fd06c09a0c0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 10 monclient: dump: 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd05c00fe70 con 0x7fd06c09a0c0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 msgr2=0x7fd06c1cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 0x7fd06c1cf820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c00fc50 comp rx=0 tx=0).stop 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 msgr2=0x7fd06c1cf820 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.022+0000 7fd059ffb640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c09a0c0 0x7fd06c1cf820 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c00fc50 comp rx=0 tx=0).stop 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.023+0000 7fd071c3f640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd03c03dd10 0x7fd03c0401d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd06c091e00 tx=0x7fd068009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd0736c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd0736c9640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 0x7fd06c1da670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd0736c9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c09dac0 con 0x7fd06c091e70 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 0x7fd06c1da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient: get_auth_request con 0x7fd06c091e70 auth_method 0 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 10 monclient(hunting): handle_auth_done global_id 274293 payload 824 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.025+0000 7fd07143e640 1 -- 10.20.193.51:0/3399924661 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd06c0008d0 con 0x7fd06c091e70 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.027+0000 7fd07143e640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 msgr2=0x7fd06c1da670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.027+0000 7fd07143e640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 0x7fd06c1da670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c004020 con 0x7fd06c091e70 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 10 monclient: dump: 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7fd05c028400 con 0x7fd06c091e70 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 msgr2=0x7fd06c1da670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 0x7fd06c1da670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c004830 comp rx=0 tx=0).stop 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 msgr2=0x7fd06c1da670 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd059ffb640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c091e70 0x7fd06c1da670 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00f780 tx=0x7fd05c004830 comp rx=0 tx=0).stop 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:26.040 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 137385, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:26.041 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:26.042 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:26.043 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.044 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd03c03dd10 msgr2=0x7fd03c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd03c03dd10 0x7fd03c0401d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd06c091e00 tx=0x7fd068009040 comp rx=0 tx=0).stop 2026-02-17T12:09:26.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 10 monclient: shutdown 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 msgr2=0x7fd06c099b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 --2- 10.20.193.51:0/3399924661 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd06c0a0750 0x7fd06c099b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd0600099a0 tx=0x7fd0600047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd071c3f640 1 -- 10.20.193.51:0/3399924661 reap_dead start 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd071c3f640 1 -- 10.20.193.51:0/3399924661 reap_dead start 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 shutdown_connections 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 >> 10.20.193.51:0/3399924661 conn(0x7fd06c0a30c0 msgr2=0x7fd06c09b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 shutdown_connections 2026-02-17T12:09:26.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.028+0000 7fd0736c9640 1 -- 10.20.193.51:0/3399924661 wait complete. 2026-02-17T12:09:26.046 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:26.046 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:09:26.046 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: get_monmap_and_config 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: build_initial_monmap 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: monmap: 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:26.113189+0000 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:26.113189+0000 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:26.114 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 1 Processor -- start 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 1 -- start start 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: init 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f448809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-b con 0x7f44880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f44880a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.112+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f448813b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448806e140 con 0x7f44880a0750 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448809f910 con 0x7f448813b760 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f448809ccd0 con 0x7f44880a3bb0 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f448e36a640 10 monclient(hunting): authenticate will time out at 2053.732091s 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f44877fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f44880a0750 0x7f448809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44076/0 (socket says 10.20.193.51:44076) 2026-02-17T12:09:26.115 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f44877fe640 1 -- 10.20.193.51:0/2831945977 learned_addr learned my addr 10.20.193.51:0/2831945977 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f448809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 10 monclient(hunting): get_auth_request con 0x7f44880a3bb0 auth_method 0 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 msgr2=0x7f448809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 msgr2=0x7f448809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f448809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.113+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f448809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:26.116 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 1 -- 10.20.193.51:0/2831945977 >> v1:10.20.193.51:6789/0 conn(0x7f44880a0750 legacy=0x7f448809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336481216 0 0) 0x7f448806e140 con 0x7f44880a0750 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): _negotiate 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): my global_id is 274296 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f448c8e0640 1 -- 10.20.193.51:0/2831945977 >> v1:10.20.193.142:6789/0 conn(0x7f448813b760 legacy=0x7f448813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f446c003620 con 0x7f44880a0750 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3975646679 0 0) 0x7f446c003620 con 0x7f44880a0750 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 msgr2=0x7f448809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f448809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 >> v1:10.20.193.142:6789/0 conn(0x7f448813b760 legacy=0x7f448813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448809eec0 con 0x7f44880a0750 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _finish_auth 0 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:26.118 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f44780031a0 con 0x7f44880a0750 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: dump: 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 >> v1:10.20.193.51:6789/0 conn(0x7f44880a0750 legacy=0x7f448809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 0x7f446c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): picked mon.a con 0x7f446c003bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f446c004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): picked mon.c con 0x7f44880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f446c004f60 0x7f446c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): picked mon.b con 0x7f446c004f60 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f448809ccd0 con 0x7f446c003bb0 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f446c005720 con 0x7f446c004f60 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f446c00c030 con 0x7f44880a3bb0 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:26.119 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4486ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 0x7f446c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f446c004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): get_auth_request con 0x7f446c003bb0 auth_method 0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): get_auth_request con 0x7f44880a3bb0 auth_method 0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f44877fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient(hunting): handle_auth_done global_id 274296 payload 293 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 msgr2=0x7f446c004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880a3bb0 0x7f446c004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f446c004f60 msgr2=0x7f446c00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f446c004f60 0x7f446c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 monclient: found mon.a 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c003620 con 0x7f446c003bb0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient: _finish_auth 0 2026-02-17T12:09:26.120 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:26.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f4487fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:26.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f448e36a640 5 monclient: authenticate success, global_id 274296 2026-02-17T12:09:26.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.115+0000 7f448e36a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:26.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4487fff640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 msgr2=0x7f446c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4487fff640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 0x7f446c003f90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44740098c0 tx=0x7f447402ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d06f8d9755da7fc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447403c070 con 0x7f446c003bb0 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: dump: 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447402fb60 con 0x7f446c003bb0 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 1 -- 10.20.193.51:0/2831945977 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447400f040 con 0x7f446c003bb0 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f4486ffd640 10 monclient: dump: 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 4 set_mon_vals no callback set 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 10 monclient: shutdown 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 -- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 msgr2=0x7f446c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 --2- 10.20.193.51:0/2831945977 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f446c003bb0 0x7f446c003f90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44740098c0 tx=0x7f447402ef30 comp rx=0 tx=0).stop 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448c8e0640 1 -- 10.20.193.51:0/2831945977 reap_dead start 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 -- 10.20.193.51:0/2831945977 shutdown_connections 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 -- 10.20.193.51:0/2831945977 >> 10.20.193.51:0/2831945977 conn(0x7f44880a30c0 msgr2=0x7f44880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 -- 10.20.193.51:0/2831945977 shutdown_connections 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.118+0000 7f448e36a640 1 -- 10.20.193.51:0/2831945977 wait complete. 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient: build_initial_monmap 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient: monmap: 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 Processor -- start 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 -- start start 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient: init 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-c con 0x7f446c003bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44880967f0 0x7f4488096c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-b con 0x7f44880967f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 0x7f44881d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): picked mon.noname-a con 0x7f4488097170 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44880a04b0 con 0x7f4488097170 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f448809c850 con 0x7f44880967f0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f448809e710 con 0x7f446c003bb0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448e36a640 10 monclient(hunting): authenticate will time out at 2053.738637s 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57462/0 (socket says 10.20.193.51:57462) 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 0x7f44881d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 learned_addr learned my addr 10.20.193.51:0/3938398985 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 10 monclient(hunting): get_auth_request con 0x7f446c003bb0 auth_method 0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): get_auth_request con 0x7f4488097170 auth_method 0 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 msgr2=0x7f44880962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 msgr2=0x7f44880962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient(hunting): handle_auth_done global_id 274299 payload 824 2026-02-17T12:09:26.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f44877fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44880967f0 0x7f4488096c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 msgr2=0x7f44880962b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f446c003bb0 0x7f44880962b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44880967f0 msgr2=0x7f4488096c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f44880967f0 0x7f4488096c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient: _finish_hunting 0 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 monclient: found mon.noname-a 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.119+0000 7f448c8e0640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44880982f0 con 0x7f4488097170 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.121+0000 7f448c8e0640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 msgr2=0x7f44881d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.121+0000 7f448c8e0640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 0x7f44881d5890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f448806da70 tx=0x7f447c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f4488097170 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: dump: 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: _finish_auth 0 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:26.127 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c0038a0 con 0x7f4488097170 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 5 monclient: authenticate success, global_id 274299 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 monclient: _renew_subs 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4488099f00 con 0x7f4488097170 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c007290 con 0x7f4488097170 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 10 monclient: dump: 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f44867fc640 4 set_mon_vals no callback set 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 monclient: _renew_subs 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448809d7b0 con 0x7f4488097170 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f448809cac0 con 0x7f44880998a0 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880998a0 auth_method 0 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f447c007470 con 0x7f4488097170 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.123+0000 7f4484ff9640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 0x7f44580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.123+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(872..872 src has 323..872) ==== 4751+0+0 (secure 0 0 0) 0x7f447c0522b0 con 0x7f4488097170 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.123+0000 7f44877fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 0x7f44580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.123+0000 7f44877fe640 10 monclient: get_auth_request con 0x7f445803dd10 auth_method 0 2026-02-17T12:09:26.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.125+0000 7f44877fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 0x7f44580401d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f44780028f0 tx=0x7f4478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880998a0 auth_method 0 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.325 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.323+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:09:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880998a0 auth_method 0 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:26.724+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3752: done (1 left) 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3753: done (0 left) 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3754: copy_from oid 5 from oid 47 current snap is 422 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3755: read oid 33 snap 413 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3755: expect (ObjNum 1248 snap 407 seq_num 1248) 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:3756: rollback oid 36 current snap is 422 2026-02-17T12:09:26.748 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 414 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:3757: rollback oid 44 current snap is 422 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 44 to 421 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:3758: delete oid 43 current snap is 422 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:3754: finishing copy_from to trial14245205-5 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:3754: got expected ENOENT (src dne) 2026-02-17T12:09:26.749 INFO:tasks.rados.rados.0.trial142.stdout:3754: finishing copy_from racing read to trial14245205-5 2026-02-17T12:09:26.750 INFO:tasks.rados.rados.0.trial142.stdout:3754: done (4 left) 2026-02-17T12:09:26.750 INFO:tasks.rados.rados.0.trial142.stdout:3758: done (3 left) 2026-02-17T12:09:26.750 INFO:tasks.rados.rados.0.trial142.stdout:3759: snap_create 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:3756: finishing rollback tid 1 to trial14245205-36 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 0 (ObjNum 33 snap 0 seq_num 1213358704) dirty dne 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:3757: finishing rollback tid 0 to trial14245205-44 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:3757: finishing rollback tid 1 to trial14245205-44 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:3757: finishing rollback tid 2 to trial14245205-44 2026-02-17T12:09:26.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 3149 (ObjNum 1253 snap 412 seq_num 1253) dirty exists 2026-02-17T12:09:26.752 INFO:tasks.rados.rados.0.trial142.stdout:3755: expect (ObjNum 1248 snap 407 seq_num 1248) 2026-02-17T12:09:27.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:27.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880998a0 auth_method 0 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:27.525+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3755: done (3 left) 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3756: done (2 left) 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3757: done (1 left) 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3759: done (0 left) 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3760: write oid 17 current snap is 423 2026-02-17T12:09:27.724 INFO:tasks.rados.rados.0.trial142.stdout:3760: seq_num 1274 ranges {612118=498177,1634883=570444,2669481=706662} 2026-02-17T12:09:27.728 INFO:tasks.rados.rados.0.trial142.stdout:3760: writing trial14245205-17 from 612118 to 1110295 tid 1 2026-02-17T12:09:27.733 INFO:tasks.rados.rados.0.trial142.stdout:3760: writing trial14245205-17 from 1634883 to 2205327 tid 2 2026-02-17T12:09:27.737 INFO:tasks.rados.rados.0.trial142.stdout:3760: writing trial14245205-17 from 2669481 to 3376143 tid 3 2026-02-17T12:09:27.737 INFO:tasks.rados.rados.0.trial142.stdout:3761: delete oid 30 current snap is 423 2026-02-17T12:09:27.737 INFO:tasks.rados.rados.0.trial142.stdout:3760: finishing write tid 1 to trial14245205-17 2026-02-17T12:09:27.737 INFO:tasks.rados.rados.0.trial142.stdout:3760: finishing write tid 2 to trial14245205-17 2026-02-17T12:09:27.741 INFO:tasks.rados.rados.0.trial142.stdout:3761: done (1 left) 2026-02-17T12:09:27.741 INFO:tasks.rados.rados.0.trial142.stdout:3762: snap_create 2026-02-17T12:09:27.741 INFO:tasks.rados.rados.0.trial142.stdout:3760: finishing write tid 3 to trial14245205-17 2026-02-17T12:09:27.741 INFO:tasks.rados.rados.0.trial142.stdout:3760: finishing write tid 4 to trial14245205-17 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: finishing write tid 5 to trial14245205-17 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: oid 17 updating version 0 to 2760 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: oid 17 updating version 2760 to 2763 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: oid 17 version 2763 is already newer than 2762 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: oid 17 version 2763 is already newer than 2761 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 17 v 2763 (ObjNum 1274 snap 423 seq_num 1274) dirty exists 2026-02-17T12:09:27.742 INFO:tasks.rados.rados.0.trial142.stdout:3760: left oid 17 (ObjNum 1274 snap 423 seq_num 1274) 2026-02-17T12:09:28.727 INFO:tasks.rados.rados.0.trial142.stdout:3760: done (1 left) 2026-02-17T12:09:28.727 INFO:tasks.rados.rados.0.trial142.stdout:3762: done (0 left) 2026-02-17T12:09:28.727 INFO:tasks.rados.rados.0.trial142.stdout:3763: snap_create 2026-02-17T12:09:29.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.120+0000 7f44637fe640 10 monclient: tick 2026-02-17T12:09:29.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.120+0000 7f44637fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:29.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.120+0000 7f44637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:29.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.120+0000 7f44637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:29.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.126+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:29.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880998a0 auth_method 0 2026-02-17T12:09:29.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:29.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:29.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:29.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:09:29.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:29.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:29.130 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:29.127+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T12:09:29.727 INFO:tasks.rados.rados.0.trial142.stdout:3763: done (0 left) 2026-02-17T12:09:29.727 INFO:tasks.rados.rados.0.trial142.stdout:3764: snap_create 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 10 monclient: tick 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 0x7f4454005b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 msgr2=0x7f4488092a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880998a0 0x7f4488092a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f44637fe640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f448809cac0 con 0x7f4454003690 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 0x7f4454005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f4454003690 auth_method 0 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.119+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.120+0000 7f4487fff640 10 monclient(hunting): handle_auth_done global_id 294101 payload 824 2026-02-17T12:09:30.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.120+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4454006200 con 0x7f4454003690 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 msgr2=0x7f4454005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 0x7f4454005b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f447402ef70 tx=0x7f4474004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447403c070 con 0x7f4454003690 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 10 monclient: dump: 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.124 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f447403d040 con 0x7f4454003690 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 msgr2=0x7f4454005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 0x7f4454005b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f447402ef70 tx=0x7f4474004830 comp rx=0 tx=0).stop 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 msgr2=0x7f4454005b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:30.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.122+0000 7f4484ff9640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4454003690 0x7f4454005b20 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f447402ef70 tx=0x7f4474004830 comp rx=0 tx=0).stop 2026-02-17T12:09:30.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f448e36a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:30.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 0x7f4488063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f448e36a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4488099c80 con 0x7f44880638c0 2026-02-17T12:09:30.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 0x7f4488063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient: get_auth_request con 0x7f44880638c0 auth_method 0 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 10 monclient(hunting): handle_auth_done global_id 294104 payload 824 2026-02-17T12:09:30.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.126+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4488092fc0 con 0x7f44880638c0 2026-02-17T12:09:30.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4487fff640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 msgr2=0x7f4488063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4487fff640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 0x7f4488063cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44540061d0 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474051cb0 con 0x7f44880638c0 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4484ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4484ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.128+0000 7f4484ff9640 10 monclient: dump: 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.132 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f447404c460 con 0x7f44880638c0 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 msgr2=0x7f4488063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 0x7f4488063cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44540061d0 tx=0x7f4474008040 comp rx=0 tx=0).stop 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 msgr2=0x7f4488063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f4484ff9640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44880638c0 0x7f4488063cd0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44540061d0 tx=0x7f4474008040 comp rx=0 tx=0).stop 2026-02-17T12:09:30.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448c8e0640 1 -- 10.20.193.51:0/3938398985 reap_dead start 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10752, 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:30.134 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.135 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.136 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:30.137 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:30.138 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.139 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:30.140 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.141 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.142 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.143 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.144 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:30.145 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.146 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:30.147 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:30.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 msgr2=0x7f44580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 0x7f44580401d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f44780028f0 tx=0x7f4478009040 comp rx=0 tx=0).stop 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 10 monclient: shutdown 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 msgr2=0x7f44881d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 0x7f44881d5890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f448806da70 tx=0x7f447c00a430 comp rx=0 tx=0).stop 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 shutdown_connections 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f445803dd10 0x7f44580401d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 --2- 10.20.193.51:0/3938398985 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4488097170 0x7f44881d5890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 >> 10.20.193.51:0/3938398985 conn(0x7f44880a30c0 msgr2=0x7f448813ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 shutdown_connections 2026-02-17T12:09:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.129+0000 7f448e36a640 1 -- 10.20.193.51:0/3938398985 wait complete. 2026-02-17T12:09:30.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:30.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:09:30.152 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: get_monmap_and_config 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: build_initial_monmap 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: monmap: 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.223 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:30.219024+0000 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:30.219024+0000 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 Processor -- start 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 -- start start 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: init 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-a con 0x7f5f000a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5f000a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 0x7f5f0013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-b con 0x7f5f0013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0006e140 con 0x7f5f000a0750 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f5f0009f910 con 0x7f5f000a3bb0 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0009ccd0 con 0x7f5f0013b760 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f088a7640 10 monclient(hunting): authenticate will time out at 2057.837773s 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41522/0 (socket says 10.20.193.51:41522) 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 1 -- 10.20.193.51:0/3487628518 learned_addr learned my addr 10.20.193.51:0/3487628518 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): get_auth_request con 0x7f5f000a3bb0 auth_method 0 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f06e1d640 1 --2- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 0x7f5f0013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f06e1d640 10 monclient(hunting): get_auth_request con 0x7f5f0013b760 auth_method 0 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f06e1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f06e1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f06e1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.218+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient(hunting): handle_auth_done global_id 294107 payload 274 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 1 -- 10.20.193.51:0/3487628518 >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 msgr2=0x7f5f0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 1 --2- 10.20.193.51:0/3487628518 >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 1 -- 10.20.193.51:0/3487628518 >> v1:10.20.193.142:6789/0 conn(0x7f5f000a0750 legacy=0x7f5f0009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient: _finish_hunting 0 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 1 monclient: found mon.noname-b 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f06e1d640 1 -- 10.20.193.51:0/3487628518 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0009eec0 con 0x7f5f0013b760 2026-02-17T12:09:30.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.219+0000 7f5f0661c640 1 --2- 10.20.193.51:0/3487628518 >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:09:30.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f06e1d640 1 -- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 msgr2=0x7f5f0013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f06e1d640 1 --2- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 0x7f5f0013db50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f0006c1c0 tx=0x7f5ef402f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac623261142cf10d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 1 -- 10.20.193.51:0/3487628518 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef403c070 con 0x7f5f0013b760 2026-02-17T12:09:30.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: dump: 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: _finish_auth 0 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: _check_auth_tickets 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 1 -- 10.20.193.51:0/3487628518 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4037440 con 0x7f5f0013b760 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 5 monclient: authenticate success, global_id 294107 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 1 -- 10.20.193.51:0/3487628518 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4037810 con 0x7f5f0013b760 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 4 set_mon_vals no callback set 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f0561a640 10 monclient: dump: 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 10 monclient: shutdown 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 1 -- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 msgr2=0x7f5f0013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 0x7f5f0013db50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f0006c1c0 tx=0x7f5ef402f130 comp rx=0 tx=0).stop 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 1 -- 10.20.193.51:0/3487628518 shutdown_connections 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3487628518 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f0013b760 0x7f5f0013db50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.221+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3487628518 >> v2:10.20.193.51:3300/0 conn(0x7f5f000a3bb0 0x7f5f0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- 10.20.193.51:0/3487628518 >> 10.20.193.51:0/3487628518 conn(0x7f5f000a30c0 msgr2=0x7f5f000a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- 10.20.193.51:0/3487628518 shutdown_connections 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- 10.20.193.51:0/3487628518 wait complete. 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient: build_initial_monmap 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient: monmap: 2026-02-17T12:09:30.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 Processor -- start 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- start start 2026-02-17T12:09:30.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient: init 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-c con 0x7f5f000a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f000a3bb0 0x7f5f001cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-a con 0x7f5f000a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f0013b760 0x7f5f001d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): picked mon.noname-b con 0x7f5f0013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000a04b0 con 0x7f5f000a3bb0 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0009c850 con 0x7f5f0013b760 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0009e710 con 0x7f5f000a0750 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f088a7640 10 monclient(hunting): authenticate will time out at 2057.841930s 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57516/0 (socket says 10.20.193.51:57516) 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f05e1b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f000a3bb0 0x7f5f001cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 1 -- 10.20.193.51:0/3711533998 learned_addr learned my addr 10.20.193.51:0/3711533998 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 10 monclient(hunting): get_auth_request con 0x7f5f000a0750 auth_method 0 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.222+0000 7f5f0661c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): get_auth_request con 0x7f5f000a3bb0 auth_method 0 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient(hunting): handle_auth_done global_id 294110 payload 824 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f0013b760 msgr2=0x7f5f001d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f0013b760 0x7f5f001d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f000a3bb0 msgr2=0x7f5f001cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f5f000a3bb0 0x7f5f001cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient: _finish_hunting 0 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 monclient: found mon.noname-c 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.223+0000 7f5f0661c640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f000a2500 con 0x7f5f000a0750 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f0661c640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 msgr2=0x7f5f001cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f0661c640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800eb90 tx=0x7f5ef800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8017070 con 0x7f5f000a0750 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: dump: 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: _finish_auth 0 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef800ce50 con 0x7f5f000a0750 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 5 monclient: authenticate success, global_id 294110 2026-02-17T12:09:30.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 monclient: _renew_subs 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f000a2dd0 con 0x7f5f000a0750 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8013690 con 0x7f5f000a0750 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f04e19640 4 set_mon_vals no callback set 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5eeaffd640 10 monclient: dump: 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.249 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 monclient: _renew_subs 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f00099cc0 con 0x7f5f000a0750 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 0x7f5f000638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.225+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00099860 con 0x7f5f00097300 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 0x7f5f000638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient: get_auth_request con 0x7f5f00097300 auth_method 0 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f5ef8024060 con 0x7f5f000a0750 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_done global_id 284155 payload 824 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f05e1b640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f0009dac0 con 0x7f5f00097300 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5eeaffd640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(876..876 src has 323..876) ==== 4735+0+0 (secure 0 0 0) 0x7f5ef80525e0 con 0x7f5f000a0750 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f06e1d640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.226+0000 7f5f06e1d640 10 monclient: get_auth_request con 0x7f5ed003dd40 auth_method 0 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5f05e1b640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 msgr2=0x7f5f000638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5f05e1b640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 0x7f5f000638c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f7a0 tx=0x7f5eec00fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec018030 con 0x7f5f00097300 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 10 monclient: dump: 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f5eec00dbc0 con 0x7f5f00097300 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 msgr2=0x7f5f000638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 0x7f5f000638c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f7a0 tx=0x7f5eec00fc70 comp rx=0 tx=0).stop 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 msgr2=0x7f5f000638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.228+0000 7f5eeaffd640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00097300 0x7f5f000638c0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f7a0 tx=0x7f5eec00fc70 comp rx=0 tx=0).stop 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.229+0000 7f5f06e1d640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5f0006f3c0 tx=0x7f5ef4031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f088a7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 0x7f5f001daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f088a7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00098110 con 0x7f5f00063e00 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 0x7f5f001daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient: get_auth_request con 0x7f5f00063e00 auth_method 0 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 10 monclient(hunting): handle_auth_done global_id 284158 payload 824 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.232+0000 7f5f05e1b640 1 -- 10.20.193.51:0/3711533998 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f00069830 con 0x7f5f00063e00 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.234+0000 7f5f05e1b640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 msgr2=0x7f5f001daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.234+0000 7f5f05e1b640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 0x7f5f001daad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5eec018000 tx=0x7f5eec003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec004230 con 0x7f5f00063e00 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 10 monclient: dump: 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.254 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f5eec004230 con 0x7f5f00063e00 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 msgr2=0x7f5f001daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 0x7f5f001daad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5eec018000 tx=0x7f5eec003860 comp rx=0 tx=0).stop 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 msgr2=0x7f5f001daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:30.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5eeaffd640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f5f00063e00 0x7f5f001daad0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5eec018000 tx=0x7f5eec003860 comp rx=0 tx=0).stop 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 72464, 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:30.256 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.257 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.258 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:30.259 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:30.260 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:30.261 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.262 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.263 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.264 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:30.265 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:30.266 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:30.266 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:30.266 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:30.266 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:30.266 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 msgr2=0x7f5ed0040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f5ed003dd40 0x7f5ed0040200 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5f0006f3c0 tx=0x7f5ef4031000 comp rx=0 tx=0).stop 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 10 monclient: shutdown 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 msgr2=0x7f5f001cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800eb90 tx=0x7f5ef800c520 comp rx=0 tx=0).stop 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f06e1d640 1 -- 10.20.193.51:0/3711533998 reap_dead start 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 shutdown_connections 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 --2- 10.20.193.51:0/3711533998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f5f000a0750 0x7f5f001cf860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 >> 10.20.193.51:0/3711533998 conn(0x7f5f000a30c0 msgr2=0x7f5f0013ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 shutdown_connections 2026-02-17T12:09:30.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.235+0000 7f5f088a7640 1 -- 10.20.193.51:0/3711533998 wait complete. 2026-02-17T12:09:30.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:30.268 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:09:30.268 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 10 monclient: get_monmap_and_config 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 10 monclient: build_initial_monmap 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 10 monclient: monmap: 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:30.335303+0000 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:30.335303+0000 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:30.336 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 1 Processor -- start 2026-02-17T12:09:30.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 1 -- start start 2026-02-17T12:09:30.337 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.334+0000 7f766f161640 10 monclient: init 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7668138470 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f76680a0570 0x7f766813d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): picked mon.noname-a con 0x7f76680a0570 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f76680a0d50 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7668138f60 con 0x7f76680a0d50 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680a3050 con 0x7f7668138470 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f76680a1520 con 0x7f76680a0570 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766f161640 10 monclient(hunting): authenticate will time out at 2057.954263s 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766d6d7640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f76680a0d50 0x7f766813f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44086/0 (socket says 10.20.193.51:44086) 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f766d6d7640 1 -- 10.20.193.51:0/1849797053 learned_addr learned my addr 10.20.193.51:0/1849797053 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f765ffff640 1 --2- 10.20.193.51:0/1849797053 >> v2:10.20.193.51:3300/0 conn(0x7f76680a0570 0x7f766813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f765ffff640 10 monclient(hunting): get_auth_request con 0x7f76680a0570 auth_method 0 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f765ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.338 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f765ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.335+0000 7f765ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f766d6d7640 1 -- 10.20.193.51:0/1849797053 >> v1:10.20.193.51:6789/0 conn(0x7f76680a0d50 legacy=0x7f766813f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f766ced6640 1 -- 10.20.193.51:0/1849797053 >> v1:10.20.193.142:6789/0 conn(0x7f7668138470 legacy=0x7f7668138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient(hunting): handle_auth_done global_id 274308 payload 274 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 1 -- 10.20.193.51:0/1849797053 >> v1:10.20.193.142:6789/0 conn(0x7f7668138470 legacy=0x7f7668138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 1 -- 10.20.193.51:0/1849797053 >> v1:10.20.193.51:6789/0 conn(0x7f76680a0d50 legacy=0x7f766813f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 1 monclient: found mon.noname-a 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.340 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.337+0000 7f765ffff640 1 -- 10.20.193.51:0/1849797053 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680a09f0 con 0x7f76680a0570 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765ffff640 1 -- 10.20.193.51:0/1849797053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 msgr2=0x7f766813d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765ffff640 1 --2- 10.20.193.51:0/1849797053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f766813d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76500099a0 tx=0x7f765002efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1f1a5d617c270f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 1 -- 10.20.193.51:0/1849797053 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765003c070 con 0x7f76680a0570 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: dump: 2026-02-17T12:09:30.342 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 1 -- 10.20.193.51:0/1849797053 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650037440 con 0x7f76680a0570 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 5 monclient: authenticate success, global_id 274308 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 1 -- 10.20.193.51:0/1849797053 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650037810 con 0x7f76680a0570 2026-02-17T12:09:30.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f765f7fe640 10 monclient: dump: 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 4 set_mon_vals no callback set 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 10 monclient: shutdown 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 -- 10.20.193.51:0/1849797053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 msgr2=0x7f766813d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 --2- 10.20.193.51:0/1849797053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f766813d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76500099a0 tx=0x7f765002efa0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 -- 10.20.193.51:0/1849797053 shutdown_connections 2026-02-17T12:09:30.344 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 --2- 10.20.193.51:0/1849797053 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f766813d360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 -- 10.20.193.51:0/1849797053 >> 10.20.193.51:0/1849797053 conn(0x7f76680aa960 msgr2=0x7f76680aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:30.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 -- 10.20.193.51:0/1849797053 shutdown_connections 2026-02-17T12:09:30.345 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.340+0000 7f766f161640 1 -- 10.20.193.51:0/1849797053 wait complete. 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient: build_initial_monmap 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient: monmap: 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 Processor -- start 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 -- start start 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient: init 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:09:30.348 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): picked mon.noname-a con 0x7f76680a0570 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76680a0d50 0x7f7668137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): picked mon.noname-b con 0x7f76680a0d50 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7668138470 0x7f766813cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): picked mon.noname-c con 0x7f7668138470 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f76680ab870 con 0x7f76680a0570 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f76680ab6f0 con 0x7f76680a0d50 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7668140fd0 con 0x7f7668138470 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766f161640 10 monclient(hunting): authenticate will time out at 2057.960521s 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41542/0 (socket says 10.20.193.51:41542) 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 -- 10.20.193.51:0/799528773 learned_addr learned my addr 10.20.193.51:0/799528773 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): get_auth_request con 0x7f76680a0570 auth_method 0 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7668138470 0x7f766813cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): get_auth_request con 0x7f7668138470 auth_method 0 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76680a0d50 0x7f7668137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): get_auth_request con 0x7f76680a0d50 auth_method 0 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766d6d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f765ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient(hunting): handle_auth_done global_id 274314 payload 824 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 -- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7668138470 msgr2=0x7f766813cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7668138470 0x7f766813cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 -- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76680a0d50 msgr2=0x7f7668137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76680a0d50 0x7f7668137350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient: _finish_hunting 0 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 monclient: found mon.noname-a 2026-02-17T12:09:30.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.341+0000 7f766ced6640 1 -- 10.20.193.51:0/799528773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76681cff80 con 0x7f76680a0570 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.343+0000 7f766ced6640 1 -- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 msgr2=0x7f76681cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.343+0000 7f766ced6640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f765800c730 tx=0x7f765800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658017070 con 0x7f76680a0570 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: dump: 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7658005cd0 con 0x7f76680a0570 2026-02-17T12:09:30.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658007290 con 0x7f76680a0570 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765effd640 4 set_mon_vals no callback set 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 10 monclient: dump: 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 5 monclient: authenticate success, global_id 274314 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _renew_subs 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76681406e0 con 0x7f76680a0570 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _renew_subs 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681409c0 con 0x7f76680a0570 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7668073fd0 con 0x7f76680a0570 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.344+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7658007470 con 0x7f76680a0570 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.345+0000 7f765d7fa640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 0x7f7638040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.345+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(876..876 src has 323..876) ==== 4735+0+0 (secure 0 0 0) 0x7f7658051cf0 con 0x7f76680a0570 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.345+0000 7f765ffff640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 0x7f7638040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.345+0000 7f765ffff640 10 monclient: get_auth_request con 0x7f763803dd60 auth_method 0 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.347+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f76680a3050 con 0x7f76680a0570 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.347+0000 7f765d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.347+0000 7f765d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:30.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.348+0000 7f765ffff640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 0x7f7638040220 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f766806e730 tx=0x7f7650033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:30.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.459+0000 7f766f161640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:09:30.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.459+0000 7f766f161640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:09:30.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.459+0000 7f766f161640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:30.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.459+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7668138850 con 0x7f76680a0570 2026-02-17T12:09:30.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.460+0000 7f765d7fa640 1 -- 10.20.193.51:0/799528773 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f765801ac80 con 0x7f76680a0570 2026-02-17T12:09:30.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.460+0000 7f765d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:09:30.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.460+0000 7f765d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 msgr2=0x7f7638040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 0x7f7638040220 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f766806e730 tx=0x7f7650033000 comp rx=0 tx=0).stop 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 10 monclient: shutdown 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 msgr2=0x7f76681cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:30.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f765800c730 tx=0x7f765800cc00 comp rx=0 tx=0).stop 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 shutdown_connections 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f763803dd60 0x7f7638040220 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7668138470 0x7f766813cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f76680a0d50 0x7f7668137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 --2- 10.20.193.51:0/799528773 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f76680a0570 0x7f76681cf060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 >> 10.20.193.51:0/799528773 conn(0x7f76680aa960 msgr2=0x7f7668074500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 shutdown_connections 2026-02-17T12:09:30.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:30.461+0000 7f766f161640 1 -- 10.20.193.51:0/799528773 wait complete. 2026-02-17T12:09:30.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:09:30.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=1281612431,config=692619927,health=3259022870,kv=4015639851,logm=3013561545}) 2026-02-17T12:09:30.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=3400971058,config=692619927,health=2612668575,kv=643764953,logm=3278431719}) 2026-02-17T12:09:30.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.686 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=1281612431,config=692619927,health=3259022870,kv=4015639851,logm=3013561545}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=12,kv=10,logm=49} crc {auth=4044226499,config=692619927,health=2612668576,kv=1532923981,logm=4189082463}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=438187434}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3793380758}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=438187434}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.683+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2490081174}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052598265}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2313575031}) 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.687 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3052598265}) 2026-02-17T12:09:30.688 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.684+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4191900753}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958424044}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2675063449}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958424044}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2205485142}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2575313099}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1620851315}) 2026-02-17T12:09:30.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2575313099}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.685+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3612108051}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2775234196}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=826608156}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2775234196}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2539627498}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586516557}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2922221698}) 2026-02-17T12:09:30.692 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586516557}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.686+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1728215121}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=772412942}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4007041513}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=772412942}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2061724608}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3646041804}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=716899982}) 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3646041804}) 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2434611488}) 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785854224}) 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1471433704}) 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785854224}) 2026-02-17T12:09:30.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.687+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4134557929}) 2026-02-17T12:09:30.704 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=71783931}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1602815951}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=71783931}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2520274453}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553429975}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691229645}) 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.705 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553429975}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=243027354}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1296788998}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3935690241}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1296788998}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=509470518}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572251746}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=450975960}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572251746}) 2026-02-17T12:09:30.706 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.695+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3502539190}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4193859166}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2891897724}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4193859166}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1460674334}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978172956}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3980496575}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978172956}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1572658947}) 2026-02-17T12:09:30.707 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169108327}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1575992350}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169108327}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.696+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2660752690}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793915386}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3099687713}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793915386}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=641128472}) 2026-02-17T12:09:30.708 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652668271}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3146481729}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3652668271}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3141184590}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430154863}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3285568257}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430154863}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2690069292}) 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.709 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1386056081}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3918938972}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1386056081}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.697+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4279034419}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=310604363}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=885850778}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=310604363}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1259715241}) 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.710 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2180018528}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=200396087}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2180018528}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2019356075}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092098137}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3351607764}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092098137}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.698+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=674339642}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=560084629}) 2026-02-17T12:09:30.711 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1925132199}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=560084629}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1003343497}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3273540765}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3112488652}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3273540765}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2881100596}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197135318}) 2026-02-17T12:09:30.712 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2750607012}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197135318}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=898783502}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237367017}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1786947529}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237367017}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.699+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1261916764}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1238908162}) 2026-02-17T12:09:30.713 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1478067380}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1238908162}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3168500843}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587052861}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2403250221}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587052861}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2713921257}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4207698260}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=730519032}) 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.714 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4207698260}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.700+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4158637271}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3467314628}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1588145613}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3467314628}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1823389723}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925192158}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3296745641}) 2026-02-17T12:09:30.715 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925192158}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484034082}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2657242763}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=655159957}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2657242763}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=180514404}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.701+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=261660100}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3745163247}) 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.716 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=261660100}) 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3171459730}) 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259451856}) 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4102265200}) 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259451856}) 2026-02-17T12:09:30.717 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.702+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=843852383}) 2026-02-17T12:09:30.728 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.729 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652260800}) 2026-02-17T12:09:30.729 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=744283665}) 2026-02-17T12:09:30.729 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.729 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652260800}) 2026-02-17T12:09:30.729 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.726+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3081229113}) 2026-02-17T12:09:30.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203921346}) 2026-02-17T12:09:30.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1642978020}) 2026-02-17T12:09:30.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.730 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203921346}) 2026-02-17T12:09:30.731 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.728+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=305475680}) 2026-02-17T12:09:30.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=936418603}) 2026-02-17T12:09:30.734 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=149343257}) 2026-02-17T12:09:30.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=936418603}) 2026-02-17T12:09:30.735 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.732+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2280644838}) 2026-02-17T12:09:30.735 INFO:tasks.rados.rados.0.trial142.stdout:3764: done (0 left) 2026-02-17T12:09:30.735 INFO:tasks.rados.rados.0.trial142.stdout:3765: rollback oid 19 current snap is 426 2026-02-17T12:09:30.736 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 19 to 424 2026-02-17T12:09:30.736 INFO:tasks.rados.rados.0.trial142.stdout:3766: snap_create 2026-02-17T12:09:30.738 INFO:tasks.rados.rados.0.trial142.stdout:3765: finishing rollback tid 1 to trial14245205-19 2026-02-17T12:09:30.738 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 0 (ObjNum 465 snap 0 seq_num 3495931584) dirty dne 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=849177938}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=839391650}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=849177938}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1490525351}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088563269}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2443884501}) 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.949 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088563269}) 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3611269388}) 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990004885}) 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3180048451}) 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990004885}) 2026-02-17T12:09:30.950 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=892837572}) 2026-02-17T12:09:30.951 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.951 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=152624329}) 2026-02-17T12:09:30.951 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1840441910}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=152624329}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.947+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3707329382}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3170739495}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1956058785}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3170739495}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=264307811}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088231955}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=855047549}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088231955}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2831080021}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232164881}) 2026-02-17T12:09:30.952 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3484304249}) 2026-02-17T12:09:30.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:30.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232164881}) 2026-02-17T12:09:30.953 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:30.948+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2977835774}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082277272}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2083891448}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082277272}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3487557468}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692557759}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1280063309}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2692557759}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.084+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2343063907}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1977305537}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=201765839}) 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1977305537}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1598245030}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2336006861}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1638232944}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2336006861}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=563129880}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515107284}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2597546540}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515107284}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.085+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1712681784}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2944942799}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=328481332}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2944942799}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=720464526}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=581503282}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=528336577}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=581503282}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3681002499}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3438190909}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=235216053}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3438190909}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.086+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2167605335}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419764626}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=793344535}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419764626}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4270932386}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4054332086}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=841314154}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4054332086}) 2026-02-17T12:09:31.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1326868741}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=689862}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=326601003}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=689862}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=603139096}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2169506135}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2650996337}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2169506135}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.087+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2729341346}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2739278290}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=358794408}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2739278290}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2083516876}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1585301574}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1506610209}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1585301574}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1328944372}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1235228448}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1629126280}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1235228448}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.088+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=831966101}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1310122023}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1556141952}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1310122023}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3935255942}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3330971935}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2417024295}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3330971935}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3054539664}) 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.107 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3062663887}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3361365098}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3062663887}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.089+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2989832331}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277094966}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2051155669}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277094966}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3609325173}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3905685872}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1491473736}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3905685872}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2562837486}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233706188}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1097305553}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233706188}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.090+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=90580993}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536886470}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3891294031}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536886470}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2717265141}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59362700}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2554263723}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59362700}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1974678621}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614602733}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3492761984}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614602733}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.091+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3228934009}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864807624}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2120305327}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864807624}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2589839155}) 2026-02-17T12:09:31.108 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=453091363}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2168307550}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=453091363}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3467079559}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3863113437}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2014440878}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3863113437}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.092+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3683252415}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2705434991}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1601195846}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2705434991}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2810940282}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622329718}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2191765744}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622329718}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1034806104}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=592631160}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3935544927}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=592631160}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4137314695}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728655957}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3868372873}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728655957}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.093+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2872876537}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=720729275}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1056431302}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=720729275}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1882372360}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3715413987}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1727008582}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3715413987}) 2026-02-17T12:09:31.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3107279790}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4197181006}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1255826340}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4197181006}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.094+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1607484013}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3681375884}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=697372173}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3681375884}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2345109111}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693604935}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2883208855}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693604935}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2943905238}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877609796}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1755402530}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877609796}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.095+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=16990927}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394372151}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2585328505}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394372151}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1249543837}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1596240284}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=541097986}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1596240284}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=110146179}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3583045452}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=716614272}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3583045452}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2628543741}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885981269}) 2026-02-17T12:09:31.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=928159350}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885981269}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.096+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2151459370}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413775004}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2954989830}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413775004}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1784574613}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1034225027}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=854424656}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1034225027}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=881430120}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046673709}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4204804989}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046673709}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=464658086}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2138769892}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2614918345}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2138769892}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2235900308}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65548584}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2175005944}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65548584}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=28738159}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3437721851}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1053692609}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3437721851}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2354729810}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=300347357}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1590465537}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=300347357}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3547450192}) 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.111 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3880919337}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1743497908}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3880919337}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1337927196}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3763642709}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=662346966}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3763642709}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2093306120}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361670244}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1164196484}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361670244}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1192550561}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=674954635}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=417366309}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=674954635}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1275353529}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1393524291}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4021499762}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1393524291}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=96759921}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2840369659}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=624494656}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2840369659}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3985355038}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3481735973}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3595520689}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3481735973}) 2026-02-17T12:09:31.112 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.101+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1820974535}) 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454937346}) 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2779867244}) 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454937346}) 2026-02-17T12:09:31.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.415+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2444676336}) 2026-02-17T12:09:31.472 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:09:31.472 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:09:31.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.539+0000 7f2c9b122640 10 monclient: get_monmap_and_config 2026-02-17T12:09:31.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.539+0000 7f2c9b122640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.539+0000 7f2c9b122640 10 monclient: monmap: 2026-02-17T12:09:31.544 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.544 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:31.540797+0000 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:31.540797+0000 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 Processor -- start 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 -- start start 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient: init 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2c940a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2c940a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2c9413c770 0x7f2c9413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-c con 0x7f2c9413c770 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9409e8e0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9406e140 con 0x7f2c940a0750 2026-02-17T12:09:31.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9409f910 con 0x7f2c9413c770 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c9b122640 10 monclient(hunting): authenticate will time out at 2059.159555s 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c98e97640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f2c940a3bb0 0x7f2c9409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44090/0 (socket says 10.20.193.51:44090) 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c98e97640 1 -- 10.20.193.51:0/1267158918 learned_addr learned my addr 10.20.193.51:0/1267158918 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c99698640 1 --2- 10.20.193.51:0/1267158918 >> v2:10.20.193.142:3300/0 conn(0x7f2c9413c770 0x7f2c9413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c99698640 10 monclient(hunting): get_auth_request con 0x7f2c9413c770 auth_method 0 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c99698640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c99698640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.540+0000 7f2c99698640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient(hunting): handle_auth_done global_id 284167 payload 274 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 1 -- 10.20.193.51:0/1267158918 >> v1:10.20.193.142:6789/0 conn(0x7f2c940a0750 legacy=0x7f2c9409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 1 -- 10.20.193.51:0/1267158918 >> v1:10.20.193.51:6789/0 conn(0x7f2c940a3bb0 legacy=0x7f2c9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 1 monclient: found mon.noname-c 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:09:31.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.541+0000 7f2c99698640 1 -- 10.20.193.51:0/1267158918 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9409ccd0 con 0x7f2c9413c770 2026-02-17T12:09:31.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.543+0000 7f2c99698640 1 -- 10.20.193.51:0/1267158918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c9413c770 msgr2=0x7f2c9413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.543+0000 7f2c99698640 1 --2- 10.20.193.51:0/1267158918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c9413c770 0x7f2c9413eb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009d90 tx=0x7f2c9002f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed81a59d7f3d3dc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 1 -- 10.20.193.51:0/1267158918 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9003c070 con 0x7f2c9413c770 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: dump: 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.556 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 1 -- 10.20.193.51:0/1267158918 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90037640 con 0x7f2c9413c770 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 5 monclient: authenticate success, global_id 284167 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 1 -- 10.20.193.51:0/1267158918 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90037a10 con 0x7f2c9413c770 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:31.557 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 4 set_mon_vals no callback set 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c8b7fe640 10 monclient: dump: 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.558 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 10 monclient: shutdown 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 -- 10.20.193.51:0/1267158918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c9413c770 msgr2=0x7f2c9413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 --2- 10.20.193.51:0/1267158918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c9413c770 0x7f2c9413eb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009d90 tx=0x7f2c9002f190 comp rx=0 tx=0).stop 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 -- 10.20.193.51:0/1267158918 shutdown_connections 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 --2- 10.20.193.51:0/1267158918 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c9413c770 0x7f2c9413eb60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 -- 10.20.193.51:0/1267158918 >> 10.20.193.51:0/1267158918 conn(0x7f2c940a30c0 msgr2=0x7f2c940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:31.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 -- 10.20.193.51:0/1267158918 shutdown_connections 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 1 -- 10.20.193.51:0/1267158918 wait complete. 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.544+0000 7f2c9b122640 10 monclient: monmap: 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:31.560 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 Processor -- start 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 -- start start 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient: init 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c940a0750 0x7f2c940997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-b con 0x7f2c940a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 0x7f2c940900d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-c con 0x7f2c940a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.561 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): picked mon.noname-a con 0x7f2c9413c770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9409c850 con 0x7f2c9413c770 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9409ebe0 con 0x7f2c940a0750 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2c940a04b0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c9b122640 10 monclient(hunting): authenticate will time out at 2059.164516s 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 0x7f2c940900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41566/0 (socket says 10.20.193.51:41566) 2026-02-17T12:09:31.562 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 1 -- 10.20.193.51:0/2954256335 learned_addr learned my addr 10.20.193.51:0/2954256335 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): get_auth_request con 0x7f2c9413c770 auth_method 0 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): get_auth_request con 0x7f2c940a3bb0 auth_method 0 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c98e97640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c940a0750 0x7f2c940997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c98e97640 10 monclient(hunting): get_auth_request con 0x7f2c940a0750 auth_method 0 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c98e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c98e97640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c98e97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient(hunting): handle_auth_done global_id 294116 payload 824 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 -- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c940a0750 msgr2=0x7f2c940997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c940a0750 0x7f2c940997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 -- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 msgr2=0x7f2c94090610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 monclient: found mon.noname-c 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c8bfff640 1 -- 10.20.193.51:0/2954256335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c94092600 con 0x7f2c940a3bb0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.545+0000 7f2c99698640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.547+0000 7f2c8bfff640 1 -- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 msgr2=0x7f2c940900d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.547+0000 7f2c8bfff640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 0x7f2c940900d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c450 tx=0x7f2c7c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.547+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c016020 con 0x7f2c940a3bb0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:31.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: dump: 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.566 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c012a40 con 0x7f2c940a3bb0 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 5 monclient: authenticate success, global_id 294116 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _renew_subs 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c94094010 con 0x7f2c940a3bb0 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c011380 con 0x7f2c940a3bb0 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c8affd640 4 set_mon_vals no callback set 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 10 monclient: dump: 2026-02-17T12:09:31.567 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _renew_subs 2026-02-17T12:09:31.568 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c940a2aa0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9409dac0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.548+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2c7c0115e0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.549+0000 7f2c897fa640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 0x7f2c640401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.549+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(877..877 src has 323..877) ==== 4735+0+0 (secure 0 0 0) 0x7f2c7c052650 con 0x7f2c940a3bb0 2026-02-17T12:09:31.569 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.549+0000 7f2c98e97640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 0x7f2c640401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.549+0000 7f2c98e97640 10 monclient: get_auth_request con 0x7f2c6403dd10 auth_method 0 2026-02-17T12:09:31.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.551+0000 7f2c98e97640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 0x7f2c640401d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c84007340 tx=0x7f2c84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.551+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2c7c020030 con 0x7f2c940a3bb0 2026-02-17T12:09:31.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.551+0000 7f2c897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.570 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.551+0000 7f2c897fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559891152}) 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1236702993}) 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559891152}) 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=136076529}) 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2829580145}) 2026-02-17T12:09:31.589 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3784816360}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2829580145}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.580+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1978150376}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2857092068}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3303029203}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2857092068}) 2026-02-17T12:09:31.590 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3777689831}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=288480634}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=533691163}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=288480634}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2242461197}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=994139336}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2519214346}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=994139336}) 2026-02-17T12:09:31.591 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.581+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1796573946}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4127308519}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=762201660}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4127308519}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1610470920}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449832419}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4253418918}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449832419}) 2026-02-17T12:09:31.592 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3129684649}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803295262}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3667187038}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803295262}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.582+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2104164121}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=22,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=31} crc {logm=3159954379,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1371304927,mon_config_key=1638176859,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3993284616,osd_snap=2815013690}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=22,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=31} crc {logm=1314201141,mdsmap=3207544932,mgr=1646349784,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3288294300,mon_config_key=1590488355,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3993284616,osd_snap=1633138789}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=22,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=31} crc {logm=3159954379,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1371304927,mon_config_key=1638176859,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3993284616,osd_snap=2815013690}) 2026-02-17T12:09:31.593 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=22,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=30} crc {logm=1314201141,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1266658861,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=3993284616,osd_snap=2069684013}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=3023638534}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=4054838006}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=3023638534}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.583+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1046381295}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=11,osdmap=89} crc {osd_snap=1730669214,osdmap=3232940699}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=11,osdmap=89} crc {osd_snap=1348738339,osdmap=2177310394}) 2026-02-17T12:09:31.594 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=11,osdmap=89} crc {osd_snap=1730669214,osdmap=3232940699}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=11,osdmap=89} crc {osd_snap=1348738339,osdmap=4223356902}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=299449807}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2919213017}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=299449807}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=365240150}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=281160210}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1153972754}) 2026-02-17T12:09:31.595 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=281160210}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.584+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=850804092}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=203957463}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3591431781}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=203957463}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1448277675}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2965301457}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3773131008}) 2026-02-17T12:09:31.596 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2965301457}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.585+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4204539904}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1809707089}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2257509973}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1809707089}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=378258768}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2422178284}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=355113843}) 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.597 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2422178284}) 2026-02-17T12:09:31.598 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.586+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=977184162}) 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4044425660}) 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=119858340}) 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4044425660}) 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.587+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2968866819}) 2026-02-17T12:09:31.599 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.600 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=13} crc {osdmap=4279951391}) 2026-02-17T12:09:31.600 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=13} crc {osdmap=357432658}) 2026-02-17T12:09:31.600 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:09:31.600 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=13} crc {osdmap=4279951391}) 2026-02-17T12:09:31.600 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:09:31.590+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=13} crc {osdmap=1275798455}) 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c9b122640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c9b122640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c9b122640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2c940008d0 con 0x7f2c940a3bb0 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c897fa640 1 -- 10.20.193.51:0/2954256335 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f2c7c01ac60 con 0x7f2c940a3bb0 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:31.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.665+0000 7f2c897fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:31.669 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":224,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 msgr2=0x7f2c640401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 0x7f2c640401d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c84007340 tx=0x7f2c84009040 comp rx=0 tx=0).stop 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 10 monclient: shutdown 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 msgr2=0x7f2c940900d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 0x7f2c940900d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c450 tx=0x7f2c7c00c920 comp rx=0 tx=0).stop 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 shutdown_connections 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2c6403dd10 0x7f2c640401d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2c9413c770 0x7f2c94090610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2c940a3bb0 0x7f2c940900d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 --2- 10.20.193.51:0/2954256335 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2c940a0750 0x7f2c940997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.666+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 >> 10.20.193.51:0/2954256335 conn(0x7f2c940a30c0 msgr2=0x7f2c9413d060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:31.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.667+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 shutdown_connections 2026-02-17T12:09:31.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.667+0000 7f2c9b122640 1 -- 10.20.193.51:0/2954256335 wait complete. 2026-02-17T12:09:31.677 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:09:31.677 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:09:31.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:09:31.678 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:09:31.743 INFO:tasks.rados.rados.0.trial142.stdout:3765: done (1 left) 2026-02-17T12:09:31.743 INFO:tasks.rados.rados.0.trial142.stdout:3766: done (0 left) 2026-02-17T12:09:31.743 INFO:tasks.rados.rados.0.trial142.stdout:3767: delete oid 21 current snap is 427 2026-02-17T12:09:31.746 INFO:tasks.rados.rados.0.trial142.stdout:3767: done (0 left) 2026-02-17T12:09:31.746 INFO:tasks.rados.rados.0.trial142.stdout:3768: delete oid 15 current snap is 427 2026-02-17T12:09:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.746+0000 7f96a7ee8640 10 monclient: get_monmap_and_config 2026-02-17T12:09:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.746+0000 7f96a7ee8640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.746+0000 7f96a7ee8640 10 monclient: monmap: 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:31.747717+0000 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:31.747717+0000 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:31.749 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.756 INFO:tasks.rados.rados.0.trial142.stdout:3768: done (0 left) 2026-02-17T12:09:31.756 INFO:tasks.rados.rados.0.trial142.stdout:3769: write oid 40 current snap is 427 2026-02-17T12:09:31.756 INFO:tasks.rados.rados.0.trial142.stdout:3769: seq_num 1278 ranges {679346=515526,1868811=577782,3179173=300173} 2026-02-17T12:09:31.756 INFO:tasks.rados.rados.0.trial142.stdout:3769: writing trial14245205-40 from 679346 to 1194872 tid 1 2026-02-17T12:09:31.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 Processor -- start 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 -- start start 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient: init 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f96a00a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f96a009dac0 0x7f96a009fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f96a009dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f96a00a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a006e140 con 0x7f96a00a3bb0 2026-02-17T12:09:31.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f96a009aed0 con 0x7f96a009dac0 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f96a009caa0 con 0x7f96a00a0110 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a7ee8640 10 monclient(hunting): authenticate will time out at 2059.366835s 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57558/0 (socket says 10.20.193.51:57558) 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 1 -- 10.20.193.51:0/2697176772 learned_addr learned my addr 10.20.193.51:0/2697176772 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 10 monclient(hunting): get_auth_request con 0x7f96a00a0110 auth_method 0 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.747+0000 7f96a645e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a545c640 1 --2- 10.20.193.51:0/2697176772 >> v2:10.20.193.142:3300/0 conn(0x7f96a009dac0 0x7f96a009fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a545c640 10 monclient(hunting): get_auth_request con 0x7f96a009dac0 auth_method 0 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a545c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a545c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a545c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient(hunting): handle_auth_done global_id 294119 payload 274 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 1 -- 10.20.193.51:0/2697176772 >> v2:10.20.193.142:3300/0 conn(0x7f96a009dac0 msgr2=0x7f96a009fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 1 --2- 10.20.193.51:0/2697176772 >> v2:10.20.193.142:3300/0 conn(0x7f96a009dac0 0x7f96a009fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 1 -- 10.20.193.51:0/2697176772 >> v1:10.20.193.142:6789/0 conn(0x7f96a00a3bb0 legacy=0x7f96a009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 1 monclient: found mon.noname-b 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.748+0000 7f96a645e640 1 -- 10.20.193.51:0/2697176772 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a009ce60 con 0x7f96a00a0110 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a645e640 1 -- 10.20.193.51:0/2697176772 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 msgr2=0x7f96a013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a645e640 1 --2- 10.20.193.51:0/2697176772 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c02f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdd195411e1a94a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 1 -- 10.20.193.51:0/2697176772 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0373f0 con 0x7f96a00a0110 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:09:31.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: dump: 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.765 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 1 -- 10.20.193.51:0/2697176772 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c037590 con 0x7f96a00a0110 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a7ee8640 5 monclient: authenticate success, global_id 294119 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a7ee8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 1 -- 10.20.193.51:0/2697176772 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c037960 con 0x7f96a00a0110 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a7ee8640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a7ee8640 4 set_mon_vals no callback set 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.750+0000 7f96a4c5b640 10 monclient: dump: 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.767 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: shutdown 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- 10.20.193.51:0/2697176772 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 msgr2=0x7f96a013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/2697176772 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c02f260 comp rx=0 tx=0).stop 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- 10.20.193.51:0/2697176772 shutdown_connections 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/2697176772 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a00a0110 0x7f96a013c760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/2697176772 >> v2:10.20.193.142:3300/0 conn(0x7f96a009dac0 0x7f96a009fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- 10.20.193.51:0/2697176772 >> 10.20.193.51:0/2697176772 conn(0x7f96a00a30c0 msgr2=0x7f96a00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- 10.20.193.51:0/2697176772 shutdown_connections 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- 10.20.193.51:0/2697176772 wait complete. 2026-02-17T12:09:31.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: monmap: 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 Processor -- start 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- start start 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: init 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f96a009dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f96a00a0110 0x7f96a0099c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f96a00a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00a3bb0 0x7f96a006f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): picked mon.noname-a con 0x7f96a00a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f96a009a880 con 0x7f96a00a3bb0 2026-02-17T12:09:31.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00a0540 con 0x7f96a00a0110 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f96a013cca0 con 0x7f96a009dac0 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.751+0000 7f96a7ee8640 10 monclient(hunting): authenticate will time out at 2059.371007s 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00a3bb0 0x7f96a006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57572/0 (socket says 10.20.193.51:57572) 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 -- 10.20.193.51:0/69601023 learned_addr learned my addr 10.20.193.51:0/69601023 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): get_auth_request con 0x7f96a009dac0 auth_method 0 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): get_auth_request con 0x7f96a00a3bb0 auth_method 0 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a645e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient(hunting): handle_auth_done global_id 294122 payload 824 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f96a00a0110 msgr2=0x7f96a0099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f96a00a0110 0x7f96a0099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00a3bb0 msgr2=0x7f96a006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00a3bb0 0x7f96a006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 monclient: found mon.noname-c 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.752+0000 7f96a5c5d640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01304f0 con 0x7f96a009dac0 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a5c5d640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 msgr2=0x7f96a0099720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a5c5d640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f969000c600 tx=0x7f969000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690012a40 con 0x7f96a009dac0 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: dump: 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690017070 con 0x7f96a009dac0 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690012e20 con 0x7f96a009dac0 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968e7fc640 10 monclient: dump: 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.776 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f968ffff640 4 set_mon_vals no callback set 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 5 monclient: authenticate success, global_id 294122 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 10 monclient: _renew_subs 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0132090 con 0x7f96a009dac0 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 10 monclient: _renew_subs 2026-02-17T12:09:31.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a009d7b0 con 0x7f96a009dac0 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.754+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 0x7f96a006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00a3fc0 con 0x7f96a006f980 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f969001c460 con 0x7f96a009dac0 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 0x7f96a006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient: get_auth_request con 0x7f96a006f980 auth_method 0 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f968e7fc640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f967003dd60 0x7f9670040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 10 monclient(hunting): handle_auth_done global_id 274323 payload 824 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a545c640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96a00a2a90 con 0x7f96a006f980 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(878..878 src has 323..878) ==== 4735+0+0 (secure 0 0 0) 0x7f9690052410 con 0x7f96a009dac0 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a645e640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f967003dd60 0x7f9670040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.755+0000 7f96a645e640 10 monclient: get_auth_request con 0x7f967003dd60 auth_method 0 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f96a545c640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 msgr2=0x7f96a006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f96a545c640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 0x7f96a006fd60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96a009ee00 tx=0x7f969400dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694018020 con 0x7f96a006f980 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 10 monclient: dump: 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.780 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f969400b940 con 0x7f96a006f980 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 msgr2=0x7f96a006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 0x7f96a006fd60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96a009ee00 tx=0x7f969400dba0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 msgr2=0x7f96a006fd60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.757+0000 7f968e7fc640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a006f980 0x7f96a006fd60 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96a009ee00 tx=0x7f969400dba0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.758+0000 7f96a645e640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f967003dd60 0x7f9670040220 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f969c035000 tx=0x7f969c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a7ee8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 0x7f96a01db120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a7ee8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f96a009d4e0 con 0x7f96a00702a0 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 0x7f96a01db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient: get_auth_request con 0x7f96a00702a0 auth_method 0 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 10 monclient(hunting): handle_auth_done global_id 274326 payload 824 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.761+0000 7f96a545c640 1 -- 10.20.193.51:0/69601023 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f96a009cc50 con 0x7f96a00702a0 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f96a545c640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 msgr2=0x7f96a01db120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f96a545c640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 0x7f96a01db120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9694009fd0 tx=0x7f96940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694018070 con 0x7f96a00702a0 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 10 monclient: dump: 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7f969401fb80 con 0x7f96a00702a0 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:31.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 msgr2=0x7f96a01db120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 0x7f96a01db120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9694009fd0 tx=0x7f96940047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 msgr2=0x7f96a01db120 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.763+0000 7f968e7fc640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f96a00702a0 0x7f96a01db120 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9694009fd0 tx=0x7f96940047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:09:31.788 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 143120, 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:31.789 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:31.790 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:31.791 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:31.792 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.793 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:31.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:31.795 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:31.797 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:09:31.798 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:31.798 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:31.798 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:31.798 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:31.798 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3769: writing trial14245205-40 from 1868811 to 2446593 tid 2 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3769: writing trial14245205-40 from 3179173 to 3479346 tid 3 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3770: write oid 30 current snap is 427 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3769: finishing write tid 1 to trial14245205-40 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3769: finishing write tid 2 to trial14245205-40 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3770: seq_num 1279 ranges {696153=590775,1927293=721440,3206596=289557} 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3770: writing trial14245205-30 from 696153 to 1286928 tid 1 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3770: writing trial14245205-30 from 1927293 to 2648733 tid 2 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3770: writing trial14245205-30 from 3206596 to 3496153 tid 3 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3771: read oid 1 snap -1 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3771: expect (ObjNum 1247 snap 407 seq_num 1247) 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3772: rollback oid 14 current snap is 427 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:3769: finishing write tid 3 to trial14245205-40 2026-02-17T12:09:31.798 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 14 to 426 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: finishing write tid 4 to trial14245205-40 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: finishing write tid 5 to trial14245205-40 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: oid 40 updating version 0 to 3371 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: oid 40 version 3371 is already newer than 3369 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: oid 40 version 3371 is already newer than 3370 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: oid 40 updating version 3371 to 3372 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 3372 (ObjNum 1278 snap 427 seq_num 1278) dirty exists 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: left oid 40 (ObjNum 1278 snap 427 seq_num 1278) 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3770: finishing write tid 1 to trial14245205-30 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3770: finishing write tid 2 to trial14245205-30 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3769: done (3 left) 2026-02-17T12:09:31.799 INFO:tasks.rados.rados.0.trial142.stdout:3773: snap_remove snap 418 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f967003dd60 msgr2=0x7f9670040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f967003dd60 0x7f9670040220 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f969c035000 tx=0x7f969c033000 comp rx=0 tx=0).stop 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 10 monclient: shutdown 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 msgr2=0x7f96a0099720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f969000c600 tx=0x7f969000cad0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a645e640 1 -- 10.20.193.51:0/69601023 reap_dead start 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 shutdown_connections 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 --2- 10.20.193.51:0/69601023 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f96a009dac0 0x7f96a0099720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 >> 10.20.193.51:0/69601023 conn(0x7f96a00a30c0 msgr2=0x7f96a006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:31.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 shutdown_connections 2026-02-17T12:09:31.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.764+0000 7f96a7ee8640 1 -- 10.20.193.51:0/69601023 wait complete. 2026-02-17T12:09:31.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:31.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:09:31.801 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.866+0000 7f23e25d6640 10 monclient: get_monmap_and_config 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.866+0000 7f23e25d6640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.866+0000 7f23e25d6640 10 monclient: monmap: 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:31.867712+0000 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:31.867712+0000 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.870 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 Processor -- start 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 -- start start 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient: init 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-b con 0x7f23dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f23dc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f23dc13b760 0x7f23dc13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-c con 0x7f23dc13b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc06e140 con 0x7f23dc0a0750 2026-02-17T12:09:31.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f23dc09f910 con 0x7f23dc13b760 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc09ccd0 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23e25d6640 10 monclient(hunting): authenticate will time out at 2059.486471s 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23db7fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f23dc0a0750 0x7f23dc09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:44104/0 (socket says 10.20.193.51:44104) 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23db7fe640 1 -- 10.20.193.51:0/3200067368 learned_addr learned my addr 10.20.193.51:0/3200067368 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): get_auth_request con 0x7f23dc0a3bb0 auth_method 0 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient(hunting): handle_auth_done global_id 294125 payload 274 2026-02-17T12:09:31.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 -- 10.20.193.51:0/3200067368 >> v2:10.20.193.142:3300/0 conn(0x7f23dc13b760 msgr2=0x7f23dc13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 --2- 10.20.193.51:0/3200067368 >> v2:10.20.193.142:3300/0 conn(0x7f23dc13b760 0x7f23dc13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 -- 10.20.193.51:0/3200067368 >> v1:10.20.193.51:6789/0 conn(0x7f23dc0a0750 legacy=0x7f23dc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 monclient: found mon.noname-b 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:09:31.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.867+0000 7f23dbfff640 1 -- 10.20.193.51:0/3200067368 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc09eec0 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23dbfff640 1 -- 10.20.193.51:0/3200067368 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 msgr2=0x7f23dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23dbfff640 1 --2- 10.20.193.51:0/3200067368 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09dac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23dc09f230 tx=0x7f23c802ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e3953b19266a81c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 1 -- 10.20.193.51:0/3200067368 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c803c070 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: dump: 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.878 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 1 -- 10.20.193.51:0/3200067368 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c802fcd0 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 1 -- 10.20.193.51:0/3200067368 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8037660 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23daffd640 10 monclient: dump: 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.879 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 5 monclient: authenticate success, global_id 294125 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 4 set_mon_vals no callback set 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 10 monclient: shutdown 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 -- 10.20.193.51:0/3200067368 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 msgr2=0x7f23dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 --2- 10.20.193.51:0/3200067368 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09dac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23dc09f230 tx=0x7f23c802ed70 comp rx=0 tx=0).stop 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 -- 10.20.193.51:0/3200067368 shutdown_connections 2026-02-17T12:09:31.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 --2- 10.20.193.51:0/3200067368 >> v2:10.20.193.142:3300/0 conn(0x7f23dc13b760 0x7f23dc13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 --2- 10.20.193.51:0/3200067368 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09dac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 -- 10.20.193.51:0/3200067368 >> 10.20.193.51:0/3200067368 conn(0x7f23dc0a30c0 msgr2=0x7f23dc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 -- 10.20.193.51:0/3200067368 shutdown_connections 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.870+0000 7f23e25d6640 1 -- 10.20.193.51:0/3200067368 wait complete. 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient: build_initial_monmap 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient: monmap: 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 Processor -- start 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 -- start start 2026-02-17T12:09:31.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient: init 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f23dc0a0750 0x7f23dc138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-b con 0x7f23dc0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-c con 0x7f23dc0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 0x7f23dc09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): picked mon.noname-a con 0x7f23dc13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc0a04b0 con 0x7f23dc13b760 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc09c850 con 0x7f23dc0a0750 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc09e710 con 0x7f23dc0a3bb0 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e25d6640 10 monclient(hunting): authenticate will time out at 2059.490907s 2026-02-17T12:09:31.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 0x7f23dc09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23db7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 0x7f23dc09ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41602/0 (socket says 10.20.193.51:41602) 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 learned_addr learned my addr 10.20.193.51:0/2431469721 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 10 monclient(hunting): get_auth_request con 0x7f23dc13b760 auth_method 0 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23e0b4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23db7fe640 10 monclient(hunting): get_auth_request con 0x7f23dc0a3bb0 auth_method 0 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.871+0000 7f23db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f23dc0a0750 0x7f23dc138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23dbfff640 10 monclient(hunting): get_auth_request con 0x7f23dc0a0750 auth_method 0 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient(hunting): handle_auth_done global_id 274329 payload 824 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 msgr2=0x7f23dc09a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc0a3bb0 0x7f23dc09a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f23dc0a0750 msgr2=0x7f23dc138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f23dc0a0750 0x7f23dc138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient: _finish_hunting 0 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 monclient: found mon.noname-a 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.872+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc096fd0 con 0x7f23dc13b760 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 msgr2=0x7f23dc09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e0b4c640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 0x7f23dc09ab30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23d000ba10 tx=0x7f23d000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d000c910 con 0x7f23dc13b760 2026-02-17T12:09:31.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: dump: 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: _finish_auth 0 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0010070 con 0x7f23dc13b760 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:31.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d000cd10 con 0x7f23dc13b760 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23d8ff9640 10 monclient: dump: 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23da7fc640 4 set_mon_vals no callback set 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 5 monclient: authenticate success, global_id 274329 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 monclient: _renew_subs 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc09d7b0 con 0x7f23dc13b760 2026-02-17T12:09:31.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 monclient: _renew_subs 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc096a10 con 0x7f23dc13b760 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0979d0 con 0x7f23dc139350 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient: get_auth_request con 0x7f23dc139350 auth_method 0 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.874+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23dbfff640 10 monclient(hunting): handle_auth_done global_id 294131 payload 824 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23dc0a2300 con 0x7f23dc139350 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f23d0004070 con 0x7f23dc13b760 2026-02-17T12:09:31.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23d8ff9640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23ac03dd10 0x7f23ac0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(878..878 src has 323..878) ==== 4735+0+0 (secure 0 0 0) 0x7f23d0052360 con 0x7f23dc13b760 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23db7fe640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23ac03dd10 0x7f23ac0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.875+0000 7f23db7fe640 10 monclient: get_auth_request con 0x7f23ac03dd10 auth_method 0 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.877+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 msgr2=0x7f23dc09b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.877+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 msgr2=0x7f23dc09b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:09:31.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.877+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f23c8039000 tx=0x7f23c80047c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:31.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.877+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:31.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:31.877+0000 7f23db7fe640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23ac03dd10 0x7f23ac0401d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f23cc007d90 tx=0x7f23cc007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: get_auth_request con 0x7f23dc139350 auth_method 0 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: _init_auth method 2 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: _init_auth already have auth, reseting 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: handle_auth_reply_more payload 9 2026-02-17T12:09:32.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-17T12:09:32.081 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.078+0000 7f23dbfff640 10 monclient: handle_auth_done global_id 294131 payload 293 2026-02-17T12:09:32.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.079+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 msgr2=0x7f23dc09b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.079+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23c8042000 tx=0x7f23c8033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.082 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c803c040 con 0x7f23dc139350 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 10 monclient: dump: 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.083 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f23c8048050 con 0x7f23dc139350 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 msgr2=0x7f23dc09b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23c8042000 tx=0x7f23c8033000 comp rx=0 tx=0).stop 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 msgr2=0x7f23dc09b070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:32.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.080+0000 7f23d8ff9640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc139350 0x7f23dc09b070 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23c8042000 tx=0x7f23c8033000 comp rx=0 tx=0).stop 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23e25d6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23e25d6640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 0x7f23dc1daad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23e25d6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc09dac0 con 0x7f23dc09b5b0 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 0x7f23dc1daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient: get_auth_request con 0x7f23dc09b5b0 auth_method 0 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 10 monclient(hunting): handle_auth_done global_id 294134 payload 824 2026-02-17T12:09:32.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.083+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23dc0008d0 con 0x7f23dc09b5b0 2026-02-17T12:09:32.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.085+0000 7f23dbfff640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 msgr2=0x7f23dc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.085+0000 7f23dbfff640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 0x7f23dc1daad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23c802edb0 tx=0x7f23c8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c805b070 con 0x7f23dc09b5b0 2026-02-17T12:09:32.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 10 monclient: dump: 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f23c8057840 con 0x7f23dc09b5b0 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 msgr2=0x7f23dc1daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 0x7f23dc1daad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23c802edb0 tx=0x7f23c8008030 comp rx=0 tx=0).stop 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 msgr2=0x7f23dc1daad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23d8ff9640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f23dc09b5b0 0x7f23dc1daad0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23c802edb0 tx=0x7f23c8008030 comp rx=0 tx=0).stop 2026-02-17T12:09:32.090 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 12710, 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.091 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.092 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.093 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:32.094 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:32.095 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.096 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.097 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.098 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.099 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.100 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.101 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.102 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.103 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:32.104 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.104 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.104 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.104 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:32.104 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23ac03dd10 msgr2=0x7f23ac0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23ac03dd10 0x7f23ac0401d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f23cc007d90 tx=0x7f23cc007ce0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 10 monclient: shutdown 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 msgr2=0x7f23dc09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 --2- 10.20.193.51:0/2431469721 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f23dc13b760 0x7f23dc09ab30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23d000ba10 tx=0x7f23d000bee0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 reap_dead start 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e0b4c640 1 -- 10.20.193.51:0/2431469721 reap_dead start 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 shutdown_connections 2026-02-17T12:09:32.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 >> 10.20.193.51:0/2431469721 conn(0x7f23dc0a30c0 msgr2=0x7f23dc13ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:32.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 shutdown_connections 2026-02-17T12:09:32.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.086+0000 7f23e25d6640 1 -- 10.20.193.51:0/2431469721 wait complete. 2026-02-17T12:09:32.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:32.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:09:32.108 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:09:32.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.172+0000 7f90b1133640 10 monclient: get_monmap_and_config 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.172+0000 7f90b1133640 10 monclient: build_initial_monmap 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.172+0000 7f90b1133640 10 monclient: monmap: 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:32.173869+0000 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:32.173869+0000 2026-02-17T12:09:32.175 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:32.176 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 Processor -- start 2026-02-17T12:09:32.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 -- start start 2026-02-17T12:09:32.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient: init 2026-02-17T12:09:32.187 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 0x7f90ac09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-c con 0x7f90ac0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-b con 0x7f90ac09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f90ac09ff40 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac06e140 con 0x7f90ac09ff40 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac09aed0 con 0x7f90ac0a3bb0 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.188 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac09caa0 con 0x7f90ac09dac0 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90b1133640 10 monclient(hunting): authenticate will time out at 2059.792755s 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57624/0 (socket says 10.20.193.51:57624) 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 1 -- 10.20.193.51:0/583950026 learned_addr learned my addr 10.20.193.51:0/583950026 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): get_auth_request con 0x7f90ac09dac0 auth_method 0 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.189 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 10 monclient(hunting): handle_auth_done global_id 294137 payload 274 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aad76640 1 --2- 10.20.193.51:0/583950026 >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 0x7f90ac09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.173+0000 7f90aa575640 1 -- 10.20.193.51:0/583950026 >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 msgr2=0x7f90ac09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 1 --2- 10.20.193.51:0/583950026 >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 0x7f90ac09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 1 -- 10.20.193.51:0/583950026 >> v1:10.20.193.142:6789/0 conn(0x7f90ac09ff40 legacy=0x7f90ac13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 10 monclient: _finish_hunting 0 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 1 monclient: found mon.noname-b 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:09:32.190 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aa575640 1 -- 10.20.193.51:0/583950026 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac09ce60 con 0x7f90ac09dac0 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aad76640 10 monclient: get_auth_request con 0x7f90ac0a3bb0 auth_method 0 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.174+0000 7f90aad76640 1 --2- 10.20.193.51:0/583950026 >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 0x7f90ac09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90aa575640 1 -- 10.20.193.51:0/583950026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 msgr2=0x7f90ac09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90aa575640 1 --2- 10.20.193.51:0/583950026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9094009970 tx=0x7f909402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb33e8112cc4d6c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 1 -- 10.20.193.51:0/583950026 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909403c070 con 0x7f90ac09dac0 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: dump: 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.191 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: _finish_auth 0 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: _check_auth_tickets 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 1 -- 10.20.193.51:0/583950026 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909402fdb0 con 0x7f90ac09dac0 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90b1133640 5 monclient: authenticate success, global_id 294137 2026-02-17T12:09:32.192 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90b1133640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 1 -- 10.20.193.51:0/583950026 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094037660 con 0x7f90ac09dac0 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90b1133640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90b1133640 4 set_mon_vals no callback set 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.176+0000 7f90a9d74640 10 monclient: dump: 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.193 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 10 monclient: shutdown 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- 10.20.193.51:0/583950026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 msgr2=0x7f90ac09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 --2- 10.20.193.51:0/583950026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9094009970 tx=0x7f909402ee90 comp rx=0 tx=0).stop 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- 10.20.193.51:0/583950026 shutdown_connections 2026-02-17T12:09:32.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 --2- 10.20.193.51:0/583950026 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac09dac0 0x7f90ac09fa00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 --2- 10.20.193.51:0/583950026 >> v2:10.20.193.142:3300/0 conn(0x7f90ac0a3bb0 0x7f90ac09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- 10.20.193.51:0/583950026 >> 10.20.193.51:0/583950026 conn(0x7f90ac0a30c0 msgr2=0x7f90ac0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- 10.20.193.51:0/583950026 shutdown_connections 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- 10.20.193.51:0/583950026 wait complete. 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 10 monclient: build_initial_monmap 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 10 monclient: monmap: 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.195 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 Processor -- start 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 1 -- start start 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.177+0000 7f90b1133640 10 monclient: init 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 0x7f90ac099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-a con 0x7f90ac09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac09ff40 0x7f90ac06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-b con 0x7f90ac09ff40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 0x7f90ac0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): picked mon.noname-c con 0x7f90ac0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0a0370 con 0x7f90ac09dac0 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac09a880 con 0x7f90ac09ff40 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac0a04f0 con 0x7f90ac0a3bb0 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90b1133640 10 monclient(hunting): authenticate will time out at 2059.797349s 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 0x7f90ac099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 0x7f90ac0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 0x7f90ac099f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:41606/0 (socket says 10.20.193.51:41606) 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 0x7f90ac0704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:57634/0 (socket says 10.20.193.51:57634) 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 -- 10.20.193.51:0/1687756169 learned_addr learned my addr 10.20.193.51:0/1687756169 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): get_auth_request con 0x7f90ac09dac0 auth_method 0 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): get_auth_request con 0x7f90ac0a3bb0 auth_method 0 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac09ff40 0x7f90ac06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient(hunting): handle_auth_done global_id 274332 payload 824 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 msgr2=0x7f90ac0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 0x7f90ac0704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac09ff40 msgr2=0x7f90ac06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac09ff40 0x7f90ac06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient: _finish_hunting 0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 monclient: found mon.noname-a 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aad76640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0969d0 con 0x7f90ac09dac0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aa575640 10 monclient: get_auth_request con 0x7f90ac09ff40 auth_method 0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac09ff40 0x7f90ac06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.178+0000 7f90ab577640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f90ac0a3bb0 0x7f90ac0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90aad76640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 msgr2=0x7f90ac099f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90aad76640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 0x7f90ac099f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7d0 tx=0x7f90a000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0015070 con 0x7f90ac09dac0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: dump: 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a000acd0 con 0x7f90ac09dac0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 5 monclient: authenticate success, global_id 274332 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 10 monclient: _renew_subs 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac096cb0 con 0x7f90ac09dac0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011630 con 0x7f90ac09dac0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f908b7fe640 10 monclient: dump: 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90a9573640 4 set_mon_vals no callback set 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 10 monclient: _renew_subs 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:32.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.180+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac0963a0 con 0x7f90ac09dac0 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90b1133640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90b1133640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 0x7f90ac1c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac070dc0 con 0x7f90ac0709e0 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f90a00117d0 con 0x7f90ac09dac0 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 0x7f90ac1c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient: get_auth_request con 0x7f90ac0709e0 auth_method 0 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f908b7fe640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f907803dd10 0x7f90780401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(878..878 src has 323..878) ==== 4735+0+0 (secure 0 0 0) 0x7f90a0052b30 con 0x7f90ac09dac0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 10 monclient(hunting): handle_auth_done global_id 284179 payload 824 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90aa575640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90ac0a17b0 con 0x7f90ac0709e0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90ab577640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f907803dd10 0x7f90780401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.181+0000 7f90ab577640 10 monclient: get_auth_request con 0x7f907803dd10 auth_method 0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f90aa575640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 msgr2=0x7f90ac1c0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 0x7f90ac1c0670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90ac076590 tx=0x7f9094004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094046070 con 0x7f90ac0709e0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 10 monclient: dump: 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.205 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f9094041460 con 0x7f90ac0709e0 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 msgr2=0x7f90ac1c0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 0x7f90ac1c0670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90ac076590 tx=0x7f9094004830 comp rx=0 tx=0).stop 2026-02-17T12:09:32.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 msgr2=0x7f90ac1c0670 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:32.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f908b7fe640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac0709e0 0x7f90ac1c0670 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90ac076590 tx=0x7f9094004830 comp rx=0 tx=0).stop 2026-02-17T12:09:32.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.184+0000 7f90ab577640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f907803dd10 0x7f90780401d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0a2110 tx=0x7f909c004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90b1133640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90b1133640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 0x7f90ac1c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90b1133640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac09f4c0 con 0x7f90ac1c0bb0 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 0x7f90ac1c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient: get_auth_request con 0x7f90ac1c0bb0 auth_method 0 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.187+0000 7f90aa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.188+0000 7f90aa575640 10 monclient(hunting): handle_auth_done global_id 284182 payload 824 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.188+0000 7f90aa575640 1 -- 10.20.193.51:0/1687756169 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90ac0008d0 con 0x7f90ac1c0bb0 2026-02-17T12:09:32.209 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90aa575640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 msgr2=0x7f90ac1c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90aa575640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 0x7f90ac1c0fc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f909402eed0 tx=0x7f90940047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094046050 con 0x7f90ac1c0bb0 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 10 monclient: dump: 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:32.210 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f9094041860 con 0x7f90ac1c0bb0 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 msgr2=0x7f90ac1c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 0x7f90ac1c0fc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f909402eed0 tx=0x7f90940047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 msgr2=0x7f90ac1c0fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f908b7fe640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f90ac1c0bb0 0x7f90ac1c0fc0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f909402eed0 tx=0x7f90940047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.211 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 224, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 74420, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 6, 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:32.212 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.213 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:32.214 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:32.215 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.216 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.217 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:32.218 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.219 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.220 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:32.221 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:32.222 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f907803dd10 msgr2=0x7f90780401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f907803dd10 0x7f90780401d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0a2110 tx=0x7f909c004200 comp rx=0 tx=0).stop 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 10 monclient: shutdown 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 msgr2=0x7f90ac099f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 --2- 10.20.193.51:0/1687756169 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f90ac09dac0 0x7f90ac099f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7d0 tx=0x7f90a000cca0 comp rx=0 tx=0).stop 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90ab577640 1 -- 10.20.193.51:0/1687756169 reap_dead start 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90ab577640 1 -- 10.20.193.51:0/1687756169 reap_dead start 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 shutdown_connections 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 >> 10.20.193.51:0/1687756169 conn(0x7f90ac0a30c0 msgr2=0x7f90ac09e370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.190+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 shutdown_connections 2026-02-17T12:09:32.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:32.191+0000 7f90b1133640 1 -- 10.20.193.51:0/1687756169 wait complete. 2026-02-17T12:09:32.224 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:09:32.224 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-17T12:09:32.224 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'b'] 2026-02-17T12:09:32.224 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-17T12:09:32.224 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:09:32.224 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:09:32.224 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:09:32.233 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:09:32.233 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:09:32.233 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:09:32.233 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T12:09:32.234 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T12:09:32.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:09:47.234 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:09:47.235 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:09:47.235 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T12:09:47.235 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T12:09:47.235 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:09:47.235 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.301+0000 7f21f01f5640 10 monclient: get_monmap_and_config 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.301+0000 7f21f01f5640 10 monclient: build_initial_monmap 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.301+0000 7f21f01f5640 10 monclient: monmap: 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:47.305 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:47.302875+0000 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:47.302875+0000 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 Processor -- start 2026-02-17T12:09:47.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 -- start start 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient: init 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f21e80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-b con 0x7f21e809dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f21e80a0110 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e806e140 con 0x7f21e80a3bb0 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e809ce60 con 0x7f21e80a0110 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f21e809aed0 con 0x7f21e809dac0 2026-02-17T12:09:47.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:47.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21f01f5640 10 monclient(hunting): authenticate will time out at 2074.921603s 2026-02-17T12:09:47.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21ed769640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 msgr2=0x7f21e809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:47.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21ed769640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:47.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21edf6a640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f21e80a3bb0 0x7f21e809f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52756/0 (socket says 10.20.193.51:52756) 2026-02-17T12:09:47.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.302+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 learned_addr learned my addr 10.20.193.51:0/4193263076 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:47.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.304+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v1:10.20.193.51:6789/0 conn(0x7f21e80a3bb0 legacy=0x7f21e809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:47.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.305+0000 7f21ee76b640 1 -- 10.20.193.51:0/4193263076 >> v1:10.20.193.142:6789/0 conn(0x7f21e80a0110 legacy=0x7f21e813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:47.504 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.503+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 msgr2=0x7f21e809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:47.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.503+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:09:47.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.904+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 msgr2=0x7f21e809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:47.906 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:47.904+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:09:48.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:48.705+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 msgr2=0x7f21e809fbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:48.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:48.705+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:09:50.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): tick 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 monclient(hunting): continuing hunt 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 msgr2=0x7f21e809fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21e809dac0 0x7f21e809fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 >> v1:10.20.193.142:6789/0 conn(0x7f21e80a0110 legacy=0x7f21e813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 >> v1:10.20.193.51:6789/0 conn(0x7f21e80a3bb0 legacy=0x7f21e809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient: _add_conns ranks=[3,4] 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:50.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc003910 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc006440 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f21e809aed0 con 0x7f21cc003910 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f21cc008f90 con 0x7f21cc006440 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21d77fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003910 auth_method 0 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006440 auth_method 0 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21ed769640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.302+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:50.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.303+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:09:50.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.303+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.303+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.303+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:50.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.505 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003910 auth_method 0 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.506 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.503+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:09:50.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006440 auth_method 0 2026-02-17T12:09:50.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.507 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:50.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:50.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.508 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.504+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:09:50.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003910 auth_method 0 2026-02-17T12:09:50.907 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.904+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006440 auth_method 0 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:50.908 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:50.909 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:50.905+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003910 auth_method 0 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:51.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.705+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006440 auth_method 0 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:09:51.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:51.706+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:09:52.247 INFO:tasks.rados.rados.0.trial142.stdout:3773: done (3 left) 2026-02-17T12:09:52.248 INFO:tasks.rados.rados.0.trial142.stdout:3774: write oid 48 current snap is 427 2026-02-17T12:09:52.248 INFO:tasks.rados.rados.0.trial142.stdout:3774: seq_num 1280 ranges {712960=666024,1985775=581451,3234019=278941} 2026-02-17T12:09:52.252 INFO:tasks.rados.rados.0.trial142.stdout:3774: writing trial14245205-48 from 712960 to 1378984 tid 1 2026-02-17T12:09:52.256 INFO:tasks.rados.rados.0.trial142.stdout:3774: writing trial14245205-48 from 1985775 to 2567226 tid 2 2026-02-17T12:09:52.261 INFO:tasks.rados.rados.0.trial142.stdout:3774: writing trial14245205-48 from 3234019 to 3512960 tid 3 2026-02-17T12:09:52.261 INFO:tasks.rados.rados.0.trial142.stdout:3775: snap_create 2026-02-17T12:09:52.261 INFO:tasks.rados.rados.0.trial142.stdout:3770: finishing write tid 3 to trial14245205-30 2026-02-17T12:09:52.261 INFO:tasks.rados.rados.0.trial142.stdout:3770: finishing write tid 4 to trial14245205-30 2026-02-17T12:09:52.261 INFO:tasks.rados.rados.0.trial142.stdout:3770: finishing write tid 5 to trial14245205-30 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3770: oid 30 updating version 0 to 3104 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3770: oid 30 updating version 3104 to 3107 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3770: oid 30 version 3107 is already newer than 3106 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3770: oid 30 version 3107 is already newer than 3105 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 3107 (ObjNum 1279 snap 427 seq_num 1279) dirty exists 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3770: left oid 30 (ObjNum 1279 snap 427 seq_num 1279) 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3772: finishing rollback tid 0 to trial14245205-14 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3772: finishing rollback tid 1 to trial14245205-14 2026-02-17T12:09:52.262 INFO:tasks.rados.rados.0.trial142.stdout:3771: expect (ObjNum 1247 snap 407 seq_num 1247) 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3772: finishing rollback tid 2 to trial14245205-14 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3730 (ObjNum 1224 snap 406 seq_num 1224) dirty exists 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3774: finishing write tid 1 to trial14245205-48 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3774: finishing write tid 2 to trial14245205-48 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3774: finishing write tid 3 to trial14245205-48 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3774: finishing write tid 4 to trial14245205-48 2026-02-17T12:09:52.361 INFO:tasks.rados.rados.0.trial142.stdout:3774: finishing write tid 5 to trial14245205-48 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:3774: oid 48 updating version 0 to 3109 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:3774: oid 48 version 3109 is already newer than 3108 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:3774: oid 48 updating version 3109 to 3110 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:3774: oid 48 updating version 3110 to 3111 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 3111 (ObjNum 1280 snap 427 seq_num 1280) dirty exists 2026-02-17T12:09:52.362 INFO:tasks.rados.rados.0.trial142.stdout:3774: left oid 48 (ObjNum 1280 snap 427 seq_num 1280) 2026-02-17T12:09:53.256 INFO:tasks.rados.rados.0.trial142.stdout:3770: done (4 left) 2026-02-17T12:09:53.256 INFO:tasks.rados.rados.0.trial142.stdout:3771: done (3 left) 2026-02-17T12:09:53.256 INFO:tasks.rados.rados.0.trial142.stdout:3772: done (2 left) 2026-02-17T12:09:53.257 INFO:tasks.rados.rados.0.trial142.stdout:3774: done (1 left) 2026-02-17T12:09:53.257 INFO:tasks.rados.rados.0.trial142.stdout:3775: done (0 left) 2026-02-17T12:09:53.257 INFO:tasks.rados.rados.0.trial142.stdout:3776: write oid 14 current snap is 428 2026-02-17T12:09:53.257 INFO:tasks.rados.rados.0.trial142.stdout:3776: seq_num 1281 ranges {729767=741273,1927904=725109,3145089=384678} 2026-02-17T12:09:53.262 INFO:tasks.rados.rados.0.trial142.stdout:3776: writing trial14245205-14 from 729767 to 1471040 tid 1 2026-02-17T12:09:53.267 INFO:tasks.rados.rados.0.trial142.stdout:3776: writing trial14245205-14 from 1927904 to 2653013 tid 2 2026-02-17T12:09:53.270 INFO:tasks.rados.rados.0.trial142.stdout:3776: writing trial14245205-14 from 3145089 to 3529767 tid 3 2026-02-17T12:09:53.271 INFO:tasks.rados.rados.0.trial142.stdout:3777: write (excl) oid 5 current snap is 428 2026-02-17T12:09:53.271 INFO:tasks.rados.rados.0.trial142.stdout:3777: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2026-02-17T12:09:53.274 INFO:tasks.rados.rados.0.trial142.stdout:3777: writing trial14245205-5 from 746574 to 1163096 tid 1 2026-02-17T12:09:53.278 INFO:tasks.rados.rados.0.trial142.stdout:3777: writing trial14245205-5 from 1586386 to 2055153 tid 2 2026-02-17T12:09:53.283 INFO:tasks.rados.rados.0.trial142.stdout:3777: writing trial14245205-5 from 2772512 to 3402056 tid 3 2026-02-17T12:09:53.283 INFO:tasks.rados.rados.0.trial142.stdout:3778: write oid 42 current snap is 428 2026-02-17T12:09:53.283 INFO:tasks.rados.rados.0.trial142.stdout:3778: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2026-02-17T12:09:53.288 INFO:tasks.rados.rados.0.trial142.stdout:3778: writing trial14245205-42 from 763381 to 1255152 tid 1 2026-02-17T12:09:53.293 INFO:tasks.rados.rados.0.trial142.stdout:3778: writing trial14245205-42 from 2044868 to 2773646 tid 2 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3778: writing trial14245205-42 from 3199935 to 3563381 tid 3 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3779: delete oid 29 current snap is 428 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: finishing write tid 1 to trial14245205-14 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: finishing write tid 2 to trial14245205-14 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: finishing write tid 3 to trial14245205-14 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: finishing write tid 4 to trial14245205-14 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: finishing write tid 5 to trial14245205-14 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: oid 14 updating version 0 to 3740 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: oid 14 version 3740 is already newer than 3738 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: oid 14 version 3740 is already newer than 3739 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: oid 14 updating version 3740 to 3741 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3741 (ObjNum 1281 snap 428 seq_num 1281) dirty exists 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3776: left oid 14 (ObjNum 1281 snap 428 seq_num 1281) 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: finishing write tid 1 to trial14245205-5 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: finishing write tid 2 to trial14245205-5 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: finishing write tid 3 to trial14245205-5 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: finishing write tid 4 to trial14245205-5 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: finishing write tid 5 to trial14245205-5 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: oid 5 updating version 0 to 2765 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: oid 5 updating version 2765 to 2766 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: oid 5 updating version 2766 to 2767 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: oid 5 version 2767 is already newer than 2764 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2767 (ObjNum 1282 snap 428 seq_num 1282) dirty exists 2026-02-17T12:09:53.297 INFO:tasks.rados.rados.0.trial142.stdout:3777: left oid 5 (ObjNum 1282 snap 428 seq_num 1282) 2026-02-17T12:09:53.298 INFO:tasks.rados.rados.0.trial142.stdout:3778: finishing write tid 1 to trial14245205-42 2026-02-17T12:09:53.298 INFO:tasks.rados.rados.0.trial142.stdout:3776: done (3 left) 2026-02-17T12:09:53.298 INFO:tasks.rados.rados.0.trial142.stdout:3777: done (2 left) 2026-02-17T12:09:53.298 INFO:tasks.rados.rados.0.trial142.stdout:3779: done (1 left) 2026-02-17T12:09:53.298 INFO:tasks.rados.rados.0.trial142.stdout:3780: snap_create 2026-02-17T12:09:53.299 INFO:tasks.rados.rados.0.trial142.stdout:3778: finishing write tid 2 to trial14245205-42 2026-02-17T12:09:53.299 INFO:tasks.rados.rados.0.trial142.stdout:3778: finishing write tid 3 to trial14245205-42 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: finishing write tid 4 to trial14245205-42 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: finishing write tid 5 to trial14245205-42 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: oid 42 updating version 0 to 3098 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: oid 42 updating version 3098 to 3099 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: oid 42 version 3099 is already newer than 3096 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: oid 42 version 3099 is already newer than 3097 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 3099 (ObjNum 1283 snap 428 seq_num 1283) dirty exists 2026-02-17T12:09:53.300 INFO:tasks.rados.rados.0.trial142.stdout:3778: left oid 42 (ObjNum 1283 snap 428 seq_num 1283) 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): tick 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 monclient(hunting): continuing hunt 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 msgr2=0x7f21cc008900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006440 0x7f21cc008900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 msgr2=0x7f21cc005d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003910 0x7f21cc005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ee76b640 1 -- 10.20.193.51:0/4193263076 reap_dead start 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:09:53.305 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003d40 0x7f21cc0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc003d40 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006e30 0x7f21cc007210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc006e30 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f21cc007750 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e809a5c0 con 0x7f21cc007750 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f21e809aed0 con 0x7f21cc003d40 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 1 -- 10.20.193.51:0/4193263076 --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f21cc008f90 con 0x7f21cc006e30 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21d77fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003d40 0x7f21cc0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003d40 auth_method 0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21edf6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.142:3300/0 conn(0x7f21cc006e30 0x7f21cc007210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006e30 auth_method 0 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient(hunting): handle_auth_done global_id 284185 payload 274 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003d40 msgr2=0x7f21cc0068f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003d40 0x7f21cc0068f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> v1:10.20.193.51:6789/0 conn(0x7f21cc007750 legacy=0x7f21cc007c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 monclient: found mon.noname-c 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.303+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc008590 con 0x7f21cc006e30 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ed769640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc006e30 msgr2=0x7f21cc007210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ed769640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc006e30 0x7f21cc007210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21cc003710 tx=0x7f21dc030070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97567a64ffd471e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 1 -- 10.20.193.51:0/4193263076 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc036070 con 0x7f21cc006e30 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: dump: 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.308 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 5 monclient: authenticate success, global_id 284185 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 1 -- 10.20.193.51:0/4193263076 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc030cb0 con 0x7f21cc006e30 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 1 -- 10.20.193.51:0/4193263076 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc030e60 con 0x7f21cc006e30 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21ecf68640 10 monclient: dump: 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.309 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 4 set_mon_vals no callback set 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 10 monclient: shutdown 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 -- 10.20.193.51:0/4193263076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc006e30 msgr2=0x7f21cc007210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc006e30 0x7f21cc007210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21cc003710 tx=0x7f21dc030070 comp rx=0 tx=0).stop 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 -- 10.20.193.51:0/4193263076 shutdown_connections 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 --2- 10.20.193.51:0/4193263076 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc006e30 0x7f21cc007210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 --2- 10.20.193.51:0/4193263076 >> v2:10.20.193.51:3300/0 conn(0x7f21cc003d40 0x7f21cc0068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 -- 10.20.193.51:0/4193263076 >> 10.20.193.51:0/4193263076 conn(0x7f21e80a30c0 msgr2=0x7f21e80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 -- 10.20.193.51:0/4193263076 shutdown_connections 2026-02-17T12:09:53.310 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.306+0000 7f21f01f5640 1 -- 10.20.193.51:0/4193263076 wait complete. 2026-02-17T12:09:53.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient: build_initial_monmap 2026-02-17T12:09:53.313 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient: monmap: 2026-02-17T12:09:53.313 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:53.313 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:53.313 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 Processor -- start 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 -- start start 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient: init 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc003d40 0x7f21e80942b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.314 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-b con 0x7f21cc003d40 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc006e30 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 0x7f21e8094d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc007750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f21e80a3f90 con 0x7f21cc006e30 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f21e809cad0 con 0x7f21cc003d40 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f21e80a0540 con 0x7f21cc007750 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21f01f5640 10 monclient(hunting): authenticate will time out at 2080.926968s 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21ee76b640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 msgr2=0x7f21e8094d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:53.315 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.307+0000 7f21ee76b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 0x7f21e8094d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48714/0 (socket says 10.20.193.51:48714) 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 -- 10.20.193.51:0/1169677501 learned_addr learned my addr 10.20.193.51:0/1169677501 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): get_auth_request con 0x7f21cc006e30 auth_method 0 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21edf6a640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc003d40 0x7f21e80942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21edf6a640 10 monclient(hunting): get_auth_request con 0x7f21cc003d40 auth_method 0 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21edf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21edf6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21edf6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.316 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient(hunting): handle_auth_done global_id 274338 payload 824 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 -- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 msgr2=0x7f21e8094d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 0x7f21e8094d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 -- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc003d40 msgr2=0x7f21e80942b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc003d40 0x7f21e80942b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 monclient: found mon.noname-a 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.308+0000 7f21ed769640 1 -- 10.20.193.51:0/1169677501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e8097c80 con 0x7f21cc006e30 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21ed769640 1 -- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 msgr2=0x7f21e80947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21ed769640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f40 tx=0x7f21dc005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc030e60 con 0x7f21cc006e30 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.317 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: dump: 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.318 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 5 monclient: authenticate success, global_id 274338 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc049070 con 0x7f21cc006e30 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc044690 con 0x7f21cc006e30 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d67fc640 10 monclient: dump: 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.319 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21d7fff640 4 set_mon_vals no callback set 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 10 monclient: _renew_subs 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e8097f60 con 0x7f21cc006e30 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 10 monclient: _renew_subs 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.310+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e80a1510 con 0x7f21cc006e30 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f21dc043070 con 0x7f21cc006e30 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21f01f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21f01f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21f01f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.320 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e809d7b0 con 0x7f21cc006e30 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21d67fc640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 0x7f21b8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(880..880 src has 323..880) ==== 4735+0+0 (secure 0 0 0) 0x7f21dc0782a0 con 0x7f21cc006e30 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21edf6a640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 0x7f21b8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.311+0000 7f21edf6a640 10 monclient: get_auth_request con 0x7f21b803dcc0 auth_method 0 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.313+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f21dc076cd0 con 0x7f21cc006e30 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.313+0000 7f21d67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.313+0000 7f21d67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:53.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.314+0000 7f21edf6a640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 0x7f21b8040180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f21d8002410 tx=0x7f21d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21f01f5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21f01f5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21f01f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f21e809f710 con 0x7f21cc006e30 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21d67fc640 1 -- 10.20.193.51:0/1169677501 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f21dc044d50 con 0x7f21cc006e30 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21d67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:09:53.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.430+0000 7f21d67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:53.434 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":228,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 msgr2=0x7f21b8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 0x7f21b8040180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f21d8002410 tx=0x7f21d8009040 comp rx=0 tx=0).stop 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 10 monclient: shutdown 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 msgr2=0x7f21e80947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.431+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f40 tx=0x7f21dc005e40 comp rx=0 tx=0).stop 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 shutdown_connections 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f21b803dcc0 0x7f21b8040180 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21cc007750 0x7f21e8094d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21cc006e30 0x7f21e80947f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 --2- 10.20.193.51:0/1169677501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21cc003d40 0x7f21e80942b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 >> 10.20.193.51:0/1169677501 conn(0x7f21e80a30c0 msgr2=0x7f21e80a1720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 shutdown_connections 2026-02-17T12:09:53.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.432+0000 7f21f01f5640 1 -- 10.20.193.51:0/1169677501 wait complete. 2026-02-17T12:09:53.443 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:09:53.443 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:09:53.444 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:09:53.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.508+0000 7f04c5d87640 10 monclient: get_monmap_and_config 2026-02-17T12:09:53.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.508+0000 7f04c5d87640 10 monclient: build_initial_monmap 2026-02-17T12:09:53.513 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.508+0000 7f04c5d87640 10 monclient: monmap: 2026-02-17T12:09:53.513 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:53.509884+0000 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:53.509884+0000 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:53.514 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 Processor -- start 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 -- start start 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient: init 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f04c00a3bb0 0x7f04c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-c con 0x7f04c00a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f04c00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 0x7f04c013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-a con 0x7f04c013b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:09:53.515 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c006e140 con 0x7f04c00a0750 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f04c009f910 con 0x7f04c013b760 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f04c009ccd0 con 0x7f04c00a3bb0 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04c5d87640 10 monclient(hunting): authenticate will time out at 2081.128663s 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 0x7f04c013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 0x7f04c013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48720/0 (socket says 10.20.193.51:48720) 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 1 -- 10.20.193.51:0/3756081976 learned_addr learned my addr 10.20.193.51:0/3756081976 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): get_auth_request con 0x7f04c013b760 auth_method 0 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.516 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/3756081976 >> v2:10.20.193.142:3300/0 conn(0x7f04c00a3bb0 0x7f04c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bf7fe640 10 monclient(hunting): get_auth_request con 0x7f04c00a3bb0 auth_method 0 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.509+0000 7f04bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.517 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_done global_id 284191 payload 274 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 1 -- 10.20.193.51:0/3756081976 >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 msgr2=0x7f04c013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/3756081976 >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 0x7f04c013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 1 -- 10.20.193.51:0/3756081976 >> v1:10.20.193.51:6789/0 conn(0x7f04c00a0750 legacy=0x7f04c009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 1 monclient: found mon.noname-c 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:09:53.518 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.510+0000 7f04bf7fe640 1 -- 10.20.193.51:0/3756081976 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c009eec0 con 0x7f04c00a3bb0 2026-02-17T12:09:53.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04bf7fe640 1 -- 10.20.193.51:0/3756081976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c00a3bb0 msgr2=0x7f04c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/3756081976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c00a3bb0 0x7f04c009dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04c006c1c0 tx=0x7f04ac02ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d804e962f533bf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 1 -- 10.20.193.51:0/3756081976 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac03c070 con 0x7f04c00a3bb0 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: dump: 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.530 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 1 -- 10.20.193.51:0/3756081976 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac02fbd0 con 0x7f04c00a3bb0 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04c5d87640 5 monclient: authenticate success, global_id 284191 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 1 -- 10.20.193.51:0/3756081976 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac037440 con 0x7f04c00a3bb0 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04c5d87640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04c5d87640 4 set_mon_vals no callback set 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.512+0000 7f04be7fc640 10 monclient: dump: 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.532 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 10 monclient: shutdown 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 -- 10.20.193.51:0/3756081976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c00a3bb0 msgr2=0x7f04c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 --2- 10.20.193.51:0/3756081976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c00a3bb0 0x7f04c009dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04c006c1c0 tx=0x7f04ac02ed50 comp rx=0 tx=0).stop 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 -- 10.20.193.51:0/3756081976 shutdown_connections 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 --2- 10.20.193.51:0/3756081976 >> v2:10.20.193.51:3300/0 conn(0x7f04c013b760 0x7f04c013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 --2- 10.20.193.51:0/3756081976 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c00a3bb0 0x7f04c009dac0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 -- 10.20.193.51:0/3756081976 >> 10.20.193.51:0/3756081976 conn(0x7f04c00a30c0 msgr2=0x7f04c00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 -- 10.20.193.51:0/3756081976 shutdown_connections 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 -- 10.20.193.51:0/3756081976 wait complete. 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 10 monclient: build_initial_monmap 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 10 monclient: monmap: 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.534 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.513+0000 7f04c5d87640 1 Processor -- start 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 -- start start 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient: init 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-a con 0x7f04c00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04c00a3bb0 0x7f04c0095390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-c con 0x7f04c00a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:53.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c013b760 0x7f04c00958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): picked mon.noname-b con 0x7f04c013b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f04c00a04b0 con 0x7f04c00a0750 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f04c009c850 con 0x7f04c013b760 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f04c009e710 con 0x7f04c00a3bb0 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04c5d87640 10 monclient(hunting): authenticate will time out at 2081.133298s 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04beffd640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04c00a3bb0 msgr2=0x7f04c0095390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:53.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04beffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04c00a3bb0 0x7f04c0095390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48736/0 (socket says 10.20.193.51:48736) 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 -- 10.20.193.51:0/1334863998 learned_addr learned my addr 10.20.193.51:0/1334863998 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): get_auth_request con 0x7f04c00a0750 auth_method 0 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient(hunting): handle_auth_done global_id 274344 payload 824 2026-02-17T12:09:53.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04c00a3bb0 msgr2=0x7f04c0095390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f04c00a3bb0 0x7f04c0095390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c013b760 msgr2=0x7f04c00958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f04c013b760 0x7f04c00958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 monclient: found mon.noname-a 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.514+0000 7f04bf7fe640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c00a2650 con 0x7f04c00a0750 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04bf7fe640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 msgr2=0x7f04c0094e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04bf7fe640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0099a0 tx=0x7f04ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac045020 con 0x7f04c00a0750 2026-02-17T12:09:53.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: dump: 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.539 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac03d040 con 0x7f04c00a0750 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 5 monclient: authenticate success, global_id 274344 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac03c070 con 0x7f04c00a0750 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04bdffb640 4 set_mon_vals no callback set 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f049bfff640 10 monclient: dump: 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.540 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 10 monclient: _renew_subs 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c009d7b0 con 0x7f04c00a0750 2026-02-17T12:09:53.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 10 monclient: _renew_subs 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.516+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c0096930 con 0x7f04c00a0750 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04c5d87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04c5d87640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 0x7f04c00988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f04c009dac0 con 0x7f04c0095e10 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 0x7f04c00988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient: get_auth_request con 0x7f04c0095e10 auth_method 0 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 10 monclient(hunting): handle_auth_done global_id 274347 payload 824 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04beffd640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04c00961f0 con 0x7f04c0095e10 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f04ac041ca0 con 0x7f04c00a0750 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f049bfff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f049003dcf0 0x7f04900401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(880..880 src has 323..880) ==== 4735+0+0 (secure 0 0 0) 0x7f04ac077af0 con 0x7f04c00a0750 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.517+0000 7f04bffff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f049003dcf0 0x7f04900401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.518+0000 7f04bffff640 10 monclient: get_auth_request con 0x7f049003dcf0 auth_method 0 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f04beffd640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 msgr2=0x7f04c00988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f04beffd640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 0x7f04c00988a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0017070 con 0x7f04c0095e10 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 10 monclient: dump: 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.544 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f04b0007070 con 0x7f04c0095e10 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 msgr2=0x7f04c00988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 0x7f04c00988a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b000c900 comp rx=0 tx=0).stop 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 msgr2=0x7f04c00988a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.519+0000 7f049bfff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c0095e10 0x7f04c00988a0 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b000c900 comp rx=0 tx=0).stop 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.520+0000 7f04bffff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f049003dcf0 0x7f04900401b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f04c0097300 tx=0x7f04b400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04c5d87640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04c5d87640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 0x7f04c01d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04c5d87640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f04c00008d0 con 0x7f04c008d3f0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 0x7f04c01d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient: get_auth_request con 0x7f04c008d3f0 auth_method 0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.522+0000 7f04beffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.523+0000 7f04beffd640 10 monclient(hunting): handle_auth_done global_id 274350 payload 824 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.523+0000 7f04beffd640 1 -- 10.20.193.51:0/1334863998 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04c0050ac0 con 0x7f04c008d3f0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04beffd640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 msgr2=0x7f04c01d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04beffd640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 0x7f04c01d98b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b00038e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0017030 con 0x7f04c008d3f0 2026-02-17T12:09:53.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 10 monclient: dump: 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4700 (secure 0 0 0) 0x7f04b0019b60 con 0x7f04c008d3f0 2026-02-17T12:09:53.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 msgr2=0x7f04c01d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 0x7f04c01d98b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b00038e0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 msgr2=0x7f04c01d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f049bfff640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c008d3f0 0x7f04c01d98b0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04b000c430 tx=0x7f04b00038e0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:53.548 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 228, 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 164882, 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.549 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.550 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:53.551 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.552 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.553 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.554 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:53.555 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.556 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:53.557 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:53.558 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f049003dcf0 msgr2=0x7f04900401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f049003dcf0 0x7f04900401b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f04c0097300 tx=0x7f04b400b040 comp rx=0 tx=0).stop 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 10 monclient: shutdown 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 msgr2=0x7f04c0094e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04bffff640 1 -- 10.20.193.51:0/1334863998 reap_dead start 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0099a0 tx=0x7f04ac0047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 shutdown_connections 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 --2- 10.20.193.51:0/1334863998 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f04c00a0750 0x7f04c0094e50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 >> 10.20.193.51:0/1334863998 conn(0x7f04c00a30c0 msgr2=0x7f04c013a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 shutdown_connections 2026-02-17T12:09:53.560 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.525+0000 7f04c5d87640 1 -- 10.20.193.51:0/1334863998 wait complete. 2026-02-17T12:09:53.560 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:09:53.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T12:09:53.561 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: get_monmap_and_config 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: build_initial_monmap 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: monmap: 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.630 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:09:53.627233+0000 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:09:53.627233+0000 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 1 Processor -- start 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 1 -- start start 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: init 2026-02-17T12:09:53.631 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdbf40a3bb0 0x7fdbf409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.626+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdbf40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdbf409d270 addr v1:10.20.193.142:6789/0 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdbf4138780 addr v1:10.20.193.51:6789/0 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf4135430 con 0x7fdbf4138780 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf409af60 con 0x7fdbf409d270 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf409a5c0 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbfb5b6640 10 monclient(hunting): authenticate will time out at 2081.246031s 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf9b2c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fdbf4138780 0x7fdbf41403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:52780/0 (socket says 10.20.193.51:52780) 2026-02-17T12:09:53.632 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf9b2c640 1 -- 10.20.193.51:0/3007348171 learned_addr learned my addr 10.20.193.51:0/3007348171 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 1 --2- 10.20.193.51:0/3007348171 >> v2:10.20.193.142:3300/0 conn(0x7fdbf40a3bb0 0x7fdbf409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): get_auth_request con 0x7fdbf40a3bb0 auth_method 0 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient(hunting): handle_auth_done global_id 284194 payload 274 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 1 -- 10.20.193.51:0/3007348171 >> v1:10.20.193.142:6789/0 conn(0x7fdbf409d270 legacy=0x7fdbf4138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 1 -- 10.20.193.51:0/3007348171 >> v1:10.20.193.51:6789/0 conn(0x7fdbf4138780 legacy=0x7fdbf41403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.633 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 1 monclient: found mon.noname-c 2026-02-17T12:09:53.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:09:53.634 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.627+0000 7fdbf932b640 1 -- 10.20.193.51:0/3007348171 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf409b240 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbf932b640 1 -- 10.20.193.51:0/3007348171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40a3bb0 msgr2=0x7fdbf409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbf932b640 1 --2- 10.20.193.51:0/3007348171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40a3bb0 0x7fdbf409cd30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40694e0 tx=0x7fdbe402ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0a4671a907d10a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 1 -- 10.20.193.51:0/3007348171 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe403c070 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: dump: 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.641 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 1 -- 10.20.193.51:0/3007348171 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe402fcb0 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 5 monclient: authenticate success, global_id 284194 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 1 -- 10.20.193.51:0/3007348171 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe402fe60 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 10 monclient: get_monmap_and_config success 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 4 set_mon_vals no callback set 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbe3fff640 10 monclient: dump: 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.643 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 10 monclient: shutdown 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/3007348171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40a3bb0 msgr2=0x7fdbf409cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/3007348171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40a3bb0 0x7fdbf409cd30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40694e0 tx=0x7fdbe402ed50 comp rx=0 tx=0).stop 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/3007348171 shutdown_connections 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/3007348171 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40a3bb0 0x7fdbf409cd30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/3007348171 >> 10.20.193.51:0/3007348171 conn(0x7fdbf40a30c0 msgr2=0x7fdbf40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/3007348171 shutdown_connections 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.630+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/3007348171 wait complete. 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient: build_initial_monmap 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient: monmap: 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:09:53.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 Processor -- start 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 -- start start 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient: init 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:09:53.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 0x7fdbf4130f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-a con 0x7fdbf409d270 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdbf40a3bb0 0x7fdbf412cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdbf40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf4138780 0x7fdbf412d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): picked mon.noname-b con 0x7fdbf4138780 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf40a3f90 con 0x7fdbf409d270 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf409b520 con 0x7fdbf4138780 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf4135040 con 0x7fdbf40a3bb0 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbfb5b6640 10 monclient(hunting): authenticate will time out at 2081.250631s 2026-02-17T12:09:53.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf8b2a640 1 -- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdbf40a3bb0 msgr2=0x7fdbf412cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.51:3301/0 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf8b2a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdbf40a3bb0 0x7fdbf412cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 0x7fdbf4130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 0x7fdbf4130f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:48756/0 (socket says 10.20.193.51:48756) 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 -- 10.20.193.51:0/788167406 learned_addr learned my addr 10.20.193.51:0/788167406 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): get_auth_request con 0x7fdbf409d270 auth_method 0 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf9b2c640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf4138780 0x7fdbf412d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf9b2c640 10 monclient(hunting): get_auth_request con 0x7fdbf4138780 auth_method 0 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf9b2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf9b2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf9b2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient(hunting): handle_auth_done global_id 274353 payload 824 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdbf40a3bb0 msgr2=0x7fdbf412cb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdbf40a3bb0 0x7fdbf412cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf4138780 msgr2=0x7fdbf412d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf4138780 0x7fdbf412d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient: _finish_hunting 0 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 monclient: found mon.noname-a 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.631+0000 7fdbf932b640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf40a2780 con 0x7fdbf409d270 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf932b640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 msgr2=0x7fdbf4130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf932b640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 0x7fdbf4130f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40099a0 tx=0x7fdbe40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4047020 con 0x7fdbf409d270 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: dump: 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.649 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe4042690 con 0x7fdbf409d270 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 5 monclient: authenticate success, global_id 274353 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 monclient: _renew_subs 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf412ec90 con 0x7fdbf409d270 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe403c040 con 0x7fdbf409d270 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:09:53.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 10 monclient: dump: 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe37fe640 4 set_mon_vals no callback set 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 monclient: _renew_subs 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:09:53.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf4130ae0 con 0x7fdbf409d270 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdbe4042a80 con 0x7fdbf409d270 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 0x7fdbf409eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf412f180 con 0x7fdbf412d610 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf8b2a640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 0x7fdbf409eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf8b2a640 10 monclient: get_auth_request con 0x7fdbf412d610 auth_method 0 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbe1ffb640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdbc403dcc0 0x7fdbc4040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf8b2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf8b2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.634+0000 7fdbf8b2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(880..880 src has 323..880) ==== 4735+0+0 (secure 0 0 0) 0x7fdbe4077f40 con 0x7fdbf409d270 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf9b2c640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdbc403dcc0 0x7fdbc4040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf9b2c640 10 monclient: get_auth_request con 0x7fdbc403dcc0 auth_method 0 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_done global_id 284200 payload 824 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.635+0000 7fdbf8b2a640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbf412d9f0 con 0x7fdbf412d610 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbf8b2a640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 msgr2=0x7fdbf409eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbf8b2a640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 0x7fdbf409eb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80037d0 tx=0x7fdbe800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbf9b2c640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdbc403dcc0 0x7fdbc4040180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4130730 tx=0x7fdbf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8017070 con 0x7fdbf412d610 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 10 monclient: dump: 2026-02-17T12:09:53.653 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fdbe80070d0 con 0x7fdbf412d610 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 msgr2=0x7fdbf409eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 0x7fdbf409eb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80037d0 tx=0x7fdbe800c840 comp rx=0 tx=0).stop 2026-02-17T12:09:53.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 msgr2=0x7fdbf409eb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:53.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.637+0000 7fdbe1ffb640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf412d610 0x7fdbf409eb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.640+0000 7fdbfb5b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.640+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 0x7fdbf4063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.640+0000 7fdbfb5b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.640+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf4138cd0 con 0x7fdbf40638c0 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 0x7fdbf4063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient: get_auth_request con 0x7fdbf40638c0 auth_method 0 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:09:53.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 10 monclient(hunting): handle_auth_done global_id 284203 payload 824 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.641+0000 7fdbf8b2a640 1 -- 10.20.193.51:0/788167406 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdbf4074db0 con 0x7fdbf40638c0 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbf8b2a640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 msgr2=0x7fdbf4063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbf8b2a640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 0x7fdbf4063cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80037d0 tx=0x7fdbe8003840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8017030 con 0x7fdbf40638c0 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 10 monclient: dump: 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:09:53.658 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7fdbe8022450 con 0x7fdbf40638c0 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 msgr2=0x7fdbf4063cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 0x7fdbf4063cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80037d0 tx=0x7fdbe8003840 comp rx=0 tx=0).stop 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 msgr2=0x7fdbf4063cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.643+0000 7fdbe1ffb640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdbf40638c0 0x7fdbf4063cd0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80037d0 tx=0x7fdbe8003840 comp rx=0 tx=0).stop 2026-02-17T12:09:53.659 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 228, 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 95874, 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: 1 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:09:53.660 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:09:53.661 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:09:53.662 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:09:53.663 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.664 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.665 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:09:53.666 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:09:53.667 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:09:53.668 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:09:53.669 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:09:53.670 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:09:53.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdbc403dcc0 msgr2=0x7fdbc4040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdbc403dcc0 0x7fdbc4040180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4130730 tx=0x7fdbf0009040 comp rx=0 tx=0).stop 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 10 monclient: shutdown 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 msgr2=0x7fdbf4130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 --2- 10.20.193.51:0/788167406 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdbf409d270 0x7fdbf4130f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40099a0 tx=0x7fdbe40047c0 comp rx=0 tx=0).stop 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbf9b2c640 1 -- 10.20.193.51:0/788167406 reap_dead start 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbf9b2c640 1 -- 10.20.193.51:0/788167406 reap_dead start 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 shutdown_connections 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 >> 10.20.193.51:0/788167406 conn(0x7fdbf40a30c0 msgr2=0x7fdbf409c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 shutdown_connections 2026-02-17T12:09:53.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:09:53.644+0000 7fdbfb5b6640 1 -- 10.20.193.51:0/788167406 wait complete. 2026-02-17T12:09:53.671 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:09:53.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:09:54.260 INFO:tasks.rados.rados.0.trial142.stdout:3778: done (1 left) 2026-02-17T12:09:54.260 INFO:tasks.rados.rados.0.trial142.stdout:3780: done (0 left) 2026-02-17T12:09:54.260 INFO:tasks.rados.rados.0.trial142.stdout:3781: snap_remove snap 428 2026-02-17T12:09:55.262 INFO:tasks.rados.rados.0.trial142.stdout:3781: done (0 left) 2026-02-17T12:09:55.262 INFO:tasks.rados.rados.0.trial142.stdout:3782: read oid 37 snap 424 2026-02-17T12:09:55.262 INFO:tasks.rados.rados.0.trial142.stdout:3782: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:55.262 INFO:tasks.rados.rados.0.trial142.stdout:3783: snap_remove snap 427 2026-02-17T12:09:57.196 INFO:tasks.rados.rados.0.trial142.stdout:3783: done (1 left) 2026-02-17T12:09:57.196 INFO:tasks.rados.rados.0.trial142.stdout:3784: delete oid 12 current snap is 429 2026-02-17T12:09:57.196 INFO:tasks.rados.rados.0.trial142.stdout:3782: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:09:57.382 INFO:tasks.rados.rados.0.trial142.stdout:3782: done (1 left) 2026-02-17T12:09:57.382 INFO:tasks.rados.rados.0.trial142.stdout:3784: done (0 left) 2026-02-17T12:09:57.382 INFO:tasks.rados.rados.0.trial142.stdout:3785: write oid 49 current snap is 429 2026-02-17T12:09:57.382 INFO:tasks.rados.rados.0.trial142.stdout:3785: seq_num 1286 ranges {413802=433871,1420314=476105,2482204=790985} 2026-02-17T12:09:57.384 INFO:tasks.rados.rados.0.trial142.stdout:3785: writing trial14245205-49 from 413802 to 847673 tid 1 2026-02-17T12:09:57.388 INFO:tasks.rados.rados.0.trial142.stdout:3785: writing trial14245205-49 from 1420314 to 1896419 tid 2 2026-02-17T12:09:57.394 INFO:tasks.rados.rados.0.trial142.stdout:3785: writing trial14245205-49 from 2482204 to 3273189 tid 3 2026-02-17T12:09:57.394 INFO:tasks.rados.rados.0.trial142.stdout:3785: finishing write tid 1 to trial14245205-49 2026-02-17T12:09:57.394 INFO:tasks.rados.rados.0.trial142.stdout:3786: read oid 39 snap -1 2026-02-17T12:09:57.394 INFO:tasks.rados.rados.0.trial142.stdout:3786: expect (ObjNum 1238 snap 407 seq_num 1238) 2026-02-17T12:09:57.394 INFO:tasks.rados.rados.0.trial142.stdout:3787: snap_remove snap 421 2026-02-17T12:09:58.242 INFO:tasks.rados.rados.0.trial142.stdout:3787: done (2 left) 2026-02-17T12:09:58.242 INFO:tasks.rados.rados.0.trial142.stdout:3788: rollback oid 1 current snap is 429 2026-02-17T12:09:58.242 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 416 2026-02-17T12:09:58.242 INFO:tasks.rados.rados.0.trial142.stdout:3785: finishing write tid 2 to trial14245205-49 2026-02-17T12:09:58.242 INFO:tasks.rados.rados.0.trial142.stdout:3786: expect (ObjNum 1238 snap 407 seq_num 1238) 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: finishing write tid 3 to trial14245205-49 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: finishing write tid 4 to trial14245205-49 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: finishing write tid 5 to trial14245205-49 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: oid 49 updating version 0 to 3747 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: oid 49 version 3747 is already newer than 3746 2026-02-17T12:09:58.454 INFO:tasks.rados.rados.0.trial142.stdout:3785: oid 49 updating version 3747 to 3749 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3785: oid 49 version 3749 is already newer than 3748 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 49 v 3749 (ObjNum 1286 snap 429 seq_num 1286) dirty exists 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3785: left oid 49 (ObjNum 1286 snap 429 seq_num 1286) 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3788: finishing rollback tid 0 to trial14245205-1 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3788: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3788: finishing rollback tid 2 to trial14245205-1 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3152 (ObjNum 1247 snap 407 seq_num 1247) dirty exists 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3785: done (2 left) 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3786: done (1 left) 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3788: done (0 left) 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3789: read oid 36 snap -1 2026-02-17T12:09:58.455 INFO:tasks.rados.rados.0.trial142.stdout:3789: expect deleted 2026-02-17T12:09:58.456 INFO:tasks.rados.rados.0.trial142.stdout:3790: snap_remove snap 420 2026-02-17T12:09:59.245 INFO:tasks.rados.rados.0.trial142.stdout:3790: done (1 left) 2026-02-17T12:09:59.245 INFO:tasks.rados.rados.0.trial142.stdout:3791: delete oid 17 current snap is 429 2026-02-17T12:09:59.249 INFO:tasks.rados.rados.0.trial142.stdout:3789: done (1 left) 2026-02-17T12:09:59.249 INFO:tasks.rados.rados.0.trial142.stdout:3791: done (0 left) 2026-02-17T12:09:59.249 INFO:tasks.rados.rados.0.trial142.stdout:3792: write (excl) oid 5 current snap is 429 2026-02-17T12:09:59.249 INFO:tasks.rados.rados.0.trial142.stdout:3792: seq_num 1288 ranges {447416=584369,1537278=479774,2537050=529882,3524784=122632} 2026-02-17T12:09:59.253 INFO:tasks.rados.rados.0.trial142.stdout:3792: writing trial14245205-5 from 447416 to 1031785 tid 1 2026-02-17T12:09:59.257 INFO:tasks.rados.rados.0.trial142.stdout:3792: writing trial14245205-5 from 1537278 to 2017052 tid 2 2026-02-17T12:09:59.261 INFO:tasks.rados.rados.0.trial142.stdout:3792: writing trial14245205-5 from 2537050 to 3066932 tid 3 2026-02-17T12:09:59.263 INFO:tasks.rados.rados.0.trial142.stdout:3792: writing trial14245205-5 from 3524784 to 3647416 tid 4 2026-02-17T12:09:59.263 INFO:tasks.rados.rados.0.trial142.stdout:3793: snap_remove snap 425 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3793: done (1 left) 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3794: snap_create 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 1 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 2 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 3 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 4 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 5 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: finishing write tid 6 to trial14245205-5 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: oid 5 updating version 0 to 2772 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: oid 5 version 2772 is already newer than 2771 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: oid 5 updating version 2772 to 2773 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: oid 5 version 2773 is already newer than 2769 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: oid 5 version 2773 is already newer than 2770 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2773 (ObjNum 1288 snap 429 seq_num 1288) dirty exists 2026-02-17T12:10:00.247 INFO:tasks.rados.rados.0.trial142.stdout:3792: left oid 5 (ObjNum 1288 snap 429 seq_num 1288) 2026-02-17T12:10:01.248 INFO:tasks.rados.rados.0.trial142.stdout:3792: done (1 left) 2026-02-17T12:10:01.248 INFO:tasks.rados.rados.0.trial142.stdout:3794: done (0 left) 2026-02-17T12:10:01.248 INFO:tasks.rados.rados.0.trial142.stdout:3795: write oid 37 current snap is 430 2026-02-17T12:10:01.248 INFO:tasks.rados.rados.0.trial142.stdout:3795: seq_num 1289 ranges {464223=659618,1879407=739785,3248120=416103} 2026-02-17T12:10:01.252 INFO:tasks.rados.rados.0.trial142.stdout:3795: writing trial14245205-37 from 464223 to 1123841 tid 1 2026-02-17T12:10:01.258 INFO:tasks.rados.rados.0.trial142.stdout:3795: writing trial14245205-37 from 1879407 to 2619192 tid 2 2026-02-17T12:10:01.262 INFO:tasks.rados.rados.0.trial142.stdout:3795: writing trial14245205-37 from 3248120 to 3664223 tid 3 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:3796: rollback oid 10 current snap is 430 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 10 to 426 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:3795: finishing write tid 1 to trial14245205-37 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:3795: finishing write tid 2 to trial14245205-37 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:3797: copy_from oid 23 from oid 22 current snap is 430 2026-02-17T12:10:01.263 INFO:tasks.rados.rados.0.trial142.stdout:3798: delete oid 12 current snap is 430 2026-02-17T12:10:01.264 INFO:tasks.rados.rados.0.trial142.stdout:3795: finishing write tid 3 to trial14245205-37 2026-02-17T12:10:01.264 INFO:tasks.rados.rados.0.trial142.stdout:3798: done (3 left) 2026-02-17T12:10:01.264 INFO:tasks.rados.rados.0.trial142.stdout:3799: read oid 19 snap -1 2026-02-17T12:10:01.264 INFO:tasks.rados.rados.0.trial142.stdout:3799: expect deleted 2026-02-17T12:10:01.264 INFO:tasks.rados.rados.0.trial142.stdout:3800: rollback oid 50 current snap is 430 2026-02-17T12:10:01.265 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 423 2026-02-17T12:10:01.265 INFO:tasks.rados.rados.0.trial142.stdout:3801: write oid 6 current snap is 430 2026-02-17T12:10:01.265 INFO:tasks.rados.rados.0.trial142.stdout:3801: seq_num 1291 ranges {497837=410116,1596371=743454,2902966=763698} 2026-02-17T12:10:01.267 INFO:tasks.rados.rados.0.trial142.stdout:3801: writing trial14245205-6 from 497837 to 907953 tid 1 2026-02-17T12:10:01.273 INFO:tasks.rados.rados.0.trial142.stdout:3801: writing trial14245205-6 from 1596371 to 2339825 tid 2 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3801: writing trial14245205-6 from 2902966 to 3666664 tid 3 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3802: write oid 40 current snap is 430 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3795: finishing write tid 4 to trial14245205-37 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3795: finishing write tid 5 to trial14245205-37 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3795: oid 37 updating version 0 to 2764 2026-02-17T12:10:01.278 INFO:tasks.rados.rados.0.trial142.stdout:3795: oid 37 updating version 2764 to 2766 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3795: oid 37 version 2766 is already newer than 2765 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3795: oid 37 version 2766 is already newer than 2763 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2766 (ObjNum 1289 snap 430 seq_num 1289) dirty exists 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3795: left oid 37 (ObjNum 1289 snap 430 seq_num 1289) 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3800: finishing rollback tid 0 to trial14245205-50 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3800: finishing rollback tid 1 to trial14245205-50 2026-02-17T12:10:01.279 INFO:tasks.rados.rados.0.trial142.stdout:3802: seq_num 1292 ranges {514644=485365,1654853=487112,2930389=574970} 2026-02-17T12:10:01.281 INFO:tasks.rados.rados.0.trial142.stdout:3802: writing trial14245205-40 from 514644 to 1000009 tid 1 2026-02-17T12:10:01.285 INFO:tasks.rados.rados.0.trial142.stdout:3802: writing trial14245205-40 from 1654853 to 2141965 tid 2 2026-02-17T12:10:01.291 INFO:tasks.rados.rados.0.trial142.stdout:3802: writing trial14245205-40 from 2930389 to 3505359 tid 3 2026-02-17T12:10:01.291 INFO:tasks.rados.rados.0.trial142.stdout:3795: done (6 left) 2026-02-17T12:10:01.291 INFO:tasks.rados.rados.0.trial142.stdout:3803: snap_create 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3800: finishing rollback tid 2 to trial14245205-50 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2777 (ObjNum 1255 snap 412 seq_num 1255) dirty exists 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3801: finishing write tid 1 to trial14245205-6 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3796: finishing rollback tid 0 to trial14245205-10 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3796: finishing rollback tid 1 to trial14245205-10 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3796: finishing rollback tid 2 to trial14245205-10 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 3102 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3801: finishing write tid 2 to trial14245205-6 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3797: finishing copy_from racing read to trial14245205-23 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3801: finishing write tid 3 to trial14245205-6 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3801: finishing write tid 4 to trial14245205-6 2026-02-17T12:10:01.292 INFO:tasks.rados.rados.0.trial142.stdout:3801: finishing write tid 5 to trial14245205-6 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3801: oid 6 updating version 0 to 3374 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3801: oid 6 version 3374 is already newer than 3373 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3801: oid 6 updating version 3374 to 3376 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3801: oid 6 version 3376 is already newer than 3375 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3376 (ObjNum 1291 snap 430 seq_num 1291) dirty exists 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3801: left oid 6 (ObjNum 1291 snap 430 seq_num 1291) 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3797: finishing copy_from to trial14245205-23 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 3146 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3802: finishing write tid 1 to trial14245205-40 2026-02-17T12:10:01.293 INFO:tasks.rados.rados.0.trial142.stdout:3802: finishing write tid 2 to trial14245205-40 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: finishing write tid 3 to trial14245205-40 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: finishing write tid 4 to trial14245205-40 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: finishing write tid 5 to trial14245205-40 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: oid 40 updating version 0 to 3378 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: oid 40 updating version 3378 to 3379 2026-02-17T12:10:01.294 INFO:tasks.rados.rados.0.trial142.stdout:3802: oid 40 updating version 3379 to 3380 2026-02-17T12:10:01.295 INFO:tasks.rados.rados.0.trial142.stdout:3802: oid 40 version 3380 is already newer than 3377 2026-02-17T12:10:01.295 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 3380 (ObjNum 1292 snap 430 seq_num 1292) dirty exists 2026-02-17T12:10:01.295 INFO:tasks.rados.rados.0.trial142.stdout:3802: left oid 40 (ObjNum 1292 snap 430 seq_num 1292) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3796: done (6 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3797: done (5 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3799: done (4 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3800: done (3 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3801: done (2 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3802: done (1 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3803: done (0 left) 2026-02-17T12:10:02.241 INFO:tasks.rados.rados.0.trial142.stdout:3804: snap_create 2026-02-17T12:10:03.241 INFO:tasks.rados.rados.0.trial142.stdout:3804: done (0 left) 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3805: read oid 29 snap -1 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3805: expect deleted 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3806: read oid 45 snap 424 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3806: expect deleted 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3807: rollback oid 24 current snap is 432 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 24 to 424 2026-02-17T12:10:03.242 INFO:tasks.rados.rados.0.trial142.stdout:3808: snap_remove snap 429 2026-02-17T12:10:04.241 INFO:tasks.rados.rados.0.trial142.stdout:3808: done (3 left) 2026-02-17T12:10:04.241 INFO:tasks.rados.rados.0.trial142.stdout:3809: write (excl) oid 3 current snap is 432 2026-02-17T12:10:04.241 INFO:tasks.rados.rados.0.trial142.stdout:3809: seq_num 1293 ranges {531451=676967,1713335=747123,2957812=502595} 2026-02-17T12:10:04.246 INFO:tasks.rados.rados.0.trial142.stdout:3809: writing trial14245205-3 from 531451 to 1208418 tid 1 2026-02-17T12:10:04.251 INFO:tasks.rados.rados.0.trial142.stdout:3809: writing trial14245205-3 from 1713335 to 2460458 tid 2 2026-02-17T12:10:04.255 INFO:tasks.rados.rados.0.trial142.stdout:3809: writing trial14245205-3 from 2957812 to 3460407 tid 3 2026-02-17T12:10:04.255 INFO:tasks.rados.rados.0.trial142.stdout:3810: write oid 31 current snap is 432 2026-02-17T12:10:04.255 INFO:tasks.rados.rados.0.trial142.stdout:3810: seq_num 1294 ranges {548258=752216,1771817=490781,2985235=713867} 2026-02-17T12:10:04.260 INFO:tasks.rados.rados.0.trial142.stdout:3810: writing trial14245205-31 from 548258 to 1300474 tid 1 2026-02-17T12:10:04.264 INFO:tasks.rados.rados.0.trial142.stdout:3810: writing trial14245205-31 from 1771817 to 2262598 tid 2 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:3810: writing trial14245205-31 from 2985235 to 3699102 tid 3 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:3811: rollback oid 20 current snap is 432 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 424 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:3807: finishing rollback tid 1 to trial14245205-24 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 0 (ObjNum 33 snap 0 seq_num 1213567664) dirty dne 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:3809: finishing write tid 1 to trial14245205-3 2026-02-17T12:10:04.270 INFO:tasks.rados.rados.0.trial142.stdout:3809: finishing write tid 2 to trial14245205-3 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: finishing write tid 3 to trial14245205-3 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: finishing write tid 4 to trial14245205-3 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3805: done (5 left) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3806: done (4 left) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3807: done (3 left) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3812: read oid 8 snap -1 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3812: expect (ObjNum 1254 snap 412 seq_num 1254) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3813: read oid 1 snap -1 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3813: expect (ObjNum 1247 snap 407 seq_num 1247) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3814: write oid 18 current snap is 432 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: finishing write tid 5 to trial14245205-3 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: oid 3 updating version 0 to 2770 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: oid 3 version 2770 is already newer than 2769 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: oid 3 version 2770 is already newer than 2768 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: oid 3 version 2770 is already newer than 2767 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2770 (ObjNum 1293 snap 432 seq_num 1293) dirty exists 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3809: left oid 3 (ObjNum 1293 snap 432 seq_num 1293) 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3810: finishing write tid 1 to trial14245205-31 2026-02-17T12:10:04.271 INFO:tasks.rados.rados.0.trial142.stdout:3814: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2026-02-17T12:10:04.275 INFO:tasks.rados.rados.0.trial142.stdout:3814: writing trial14245205-18 from 565065 to 992530 tid 1 2026-02-17T12:10:04.279 INFO:tasks.rados.rados.0.trial142.stdout:3814: writing trial14245205-18 from 1430299 to 2064738 tid 2 2026-02-17T12:10:04.283 INFO:tasks.rados.rados.0.trial142.stdout:3814: writing trial14245205-18 from 2496305 to 3021444 tid 3 2026-02-17T12:10:04.286 INFO:tasks.rados.rados.0.trial142.stdout:3814: writing trial14245205-18 from 3472104 to 3765065 tid 4 2026-02-17T12:10:04.286 INFO:tasks.rados.rados.0.trial142.stdout:3809: done (5 left) 2026-02-17T12:10:04.286 INFO:tasks.rados.rados.0.trial142.stdout:3815: read oid 17 snap 430 2026-02-17T12:10:04.286 INFO:tasks.rados.rados.0.trial142.stdout:3815: expect deleted 2026-02-17T12:10:04.286 INFO:tasks.rados.rados.0.trial142.stdout:3816: snap_remove snap 422 2026-02-17T12:10:04.287 INFO:tasks.rados.rados.0.trial142.stdout:3810: finishing write tid 2 to trial14245205-31 2026-02-17T12:10:05.253 INFO:tasks.rados.rados.0.trial142.stdout:3816: done (6 left) 2026-02-17T12:10:05.253 INFO:tasks.rados.rados.0.trial142.stdout:3817: read oid 42 snap 416 2026-02-17T12:10:05.253 INFO:tasks.rados.rados.0.trial142.stdout:3817: expect (ObjNum 1227 snap 406 seq_num 1227) 2026-02-17T12:10:05.253 INFO:tasks.rados.rados.0.trial142.stdout:3818: write (excl) oid 37 current snap is 432 2026-02-17T12:10:05.253 INFO:tasks.rados.rados.0.trial142.stdout:3818: seq_num 1296 ranges {581872=502714,1488781=494450,2640081=736411} 2026-02-17T12:10:05.258 INFO:tasks.rados.rados.0.trial142.stdout:3818: writing trial14245205-37 from 581872 to 1084586 tid 1 2026-02-17T12:10:05.262 INFO:tasks.rados.rados.0.trial142.stdout:3818: writing trial14245205-37 from 1488781 to 1983231 tid 2 2026-02-17T12:10:05.267 INFO:tasks.rados.rados.0.trial142.stdout:3818: writing trial14245205-37 from 2640081 to 3376492 tid 3 2026-02-17T12:10:05.268 INFO:tasks.rados.rados.0.trial142.stdout:3819: write (excl) oid 46 current snap is 432 2026-02-17T12:10:05.268 INFO:tasks.rados.rados.0.trial142.stdout:3819: seq_num 1297 ranges {598679=577963,1947263=638108,3351151=447528} 2026-02-17T12:10:05.272 INFO:tasks.rados.rados.0.trial142.stdout:3819: writing trial14245205-46 from 598679 to 1176642 tid 1 2026-02-17T12:10:05.277 INFO:tasks.rados.rados.0.trial142.stdout:3819: writing trial14245205-46 from 1947263 to 2585371 tid 2 2026-02-17T12:10:05.282 INFO:tasks.rados.rados.0.trial142.stdout:3819: writing trial14245205-46 from 3351151 to 3798679 tid 3 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:3820: snap_create 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:3811: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:3811: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:3811: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 3102 (ObjNum 960 snap 310 seq_num 960) dirty exists 2026-02-17T12:10:05.283 INFO:tasks.rados.rados.0.trial142.stdout:3813: expect (ObjNum 1247 snap 407 seq_num 1247) 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: finishing write tid 3 to trial14245205-31 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: finishing write tid 4 to trial14245205-31 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: finishing write tid 5 to trial14245205-31 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: oid 31 updating version 0 to 3710 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: oid 31 version 3710 is already newer than 3709 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: oid 31 updating version 3710 to 3711 2026-02-17T12:10:05.382 INFO:tasks.rados.rados.0.trial142.stdout:3810: oid 31 version 3711 is already newer than 3708 2026-02-17T12:10:05.383 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 3711 (ObjNum 1294 snap 432 seq_num 1294) dirty exists 2026-02-17T12:10:05.383 INFO:tasks.rados.rados.0.trial142.stdout:3810: left oid 31 (ObjNum 1294 snap 432 seq_num 1294) 2026-02-17T12:10:05.383 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 1 to trial14245205-18 2026-02-17T12:10:05.383 INFO:tasks.rados.rados.0.trial142.stdout:3812: expect (ObjNum 1254 snap 412 seq_num 1254) 2026-02-17T12:10:05.483 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 2 to trial14245205-18 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 3 to trial14245205-18 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 4 to trial14245205-18 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 5 to trial14245205-18 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: finishing write tid 6 to trial14245205-18 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: oid 18 updating version 0 to 3771 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: oid 18 updating version 3771 to 3772 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: oid 18 version 3772 is already newer than 3770 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: oid 18 version 3772 is already newer than 3768 2026-02-17T12:10:05.484 INFO:tasks.rados.rados.0.trial142.stdout:3814: oid 18 version 3772 is already newer than 3769 2026-02-17T12:10:05.485 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 3772 (ObjNum 1295 snap 432 seq_num 1295) dirty exists 2026-02-17T12:10:05.485 INFO:tasks.rados.rados.0.trial142.stdout:3814: left oid 18 (ObjNum 1295 snap 432 seq_num 1295) 2026-02-17T12:10:05.485 INFO:tasks.rados.rados.0.trial142.stdout:3818: finishing write tid 1 to trial14245205-37 2026-02-17T12:10:05.485 INFO:tasks.rados.rados.0.trial142.stdout:3818: finishing write tid 2 to trial14245205-37 2026-02-17T12:10:05.485 INFO:tasks.rados.rados.0.trial142.stdout:3817: expect (ObjNum 1227 snap 406 seq_num 1227) 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: finishing write tid 3 to trial14245205-37 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: finishing write tid 4 to trial14245205-37 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: finishing write tid 5 to trial14245205-37 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: oid 37 updating version 0 to 2773 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: oid 37 updating version 2773 to 2774 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: oid 37 version 2774 is already newer than 2771 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: oid 37 version 2774 is already newer than 2772 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 2774 (ObjNum 1296 snap 432 seq_num 1296) dirty exists 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3818: left oid 37 (ObjNum 1296 snap 432 seq_num 1296) 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3819: finishing write tid 1 to trial14245205-46 2026-02-17T12:10:05.611 INFO:tasks.rados.rados.0.trial142.stdout:3819: finishing write tid 2 to trial14245205-46 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: finishing write tid 3 to trial14245205-46 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: finishing write tid 4 to trial14245205-46 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: finishing write tid 5 to trial14245205-46 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: oid 46 updating version 0 to 3783 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: oid 46 version 3783 is already newer than 3780 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: oid 46 version 3783 is already newer than 3781 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: oid 46 version 3783 is already newer than 3782 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3783 (ObjNum 1297 snap 432 seq_num 1297) dirty exists 2026-02-17T12:10:05.612 INFO:tasks.rados.rados.0.trial142.stdout:3819: left oid 46 (ObjNum 1297 snap 432 seq_num 1297) 2026-02-17T12:10:06.258 INFO:tasks.rados.rados.0.trial142.stdout:3810: done (9 left) 2026-02-17T12:10:06.258 INFO:tasks.rados.rados.0.trial142.stdout:3811: done (8 left) 2026-02-17T12:10:06.258 INFO:tasks.rados.rados.0.trial142.stdout:3812: done (7 left) 2026-02-17T12:10:06.258 INFO:tasks.rados.rados.0.trial142.stdout:3813: done (6 left) 2026-02-17T12:10:06.258 INFO:tasks.rados.rados.0.trial142.stdout:3814: done (5 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3815: done (4 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3817: done (3 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3818: done (2 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3819: done (1 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3820: done (0 left) 2026-02-17T12:10:06.259 INFO:tasks.rados.rados.0.trial142.stdout:3821: snap_remove snap 432 2026-02-17T12:10:07.242 INFO:tasks.rados.rados.0.trial142.stdout:3821: done (0 left) 2026-02-17T12:10:07.242 INFO:tasks.rados.rados.0.trial142.stdout:3822: write oid 39 current snap is 433 2026-02-17T12:10:07.242 INFO:tasks.rados.rados.0.trial142.stdout:3822: seq_num 1298 ranges {615486=653212,1889392=498119,2978574=475308} 2026-02-17T12:10:07.246 INFO:tasks.rados.rados.0.trial142.stdout:3822: writing trial14245205-39 from 615486 to 1268698 tid 1 2026-02-17T12:10:07.251 INFO:tasks.rados.rados.0.trial142.stdout:3822: writing trial14245205-39 from 1889392 to 2387511 tid 2 2026-02-17T12:10:07.255 INFO:tasks.rados.rados.0.trial142.stdout:3822: writing trial14245205-39 from 2978574 to 3453882 tid 3 2026-02-17T12:10:07.255 INFO:tasks.rados.rados.0.trial142.stdout:3823: read oid 34 snap 424 2026-02-17T12:10:07.255 INFO:tasks.rados.rados.0.trial142.stdout:3823: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:10:07.255 INFO:tasks.rados.rados.0.trial142.stdout:3824: snap_remove snap 423 2026-02-17T12:10:08.246 INFO:tasks.rados.rados.0.trial142.stdout:3824: done (2 left) 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3825: read oid 10 snap -1 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3825: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3826: read oid 4 snap -1 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3826: expect (ObjNum 1245 snap 407 seq_num 1245) 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3827: write (excl) oid 6 current snap is 433 2026-02-17T12:10:08.247 INFO:tasks.rados.rados.0.trial142.stdout:3827: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2026-02-17T12:10:08.251 INFO:tasks.rados.rados.0.trial142.stdout:3827: writing trial14245205-6 from 632293 to 1360754 tid 1 2026-02-17T12:10:08.256 INFO:tasks.rados.rados.0.trial142.stdout:3827: writing trial14245205-6 from 1947874 to 2589651 tid 2 2026-02-17T12:10:08.260 INFO:tasks.rados.rados.0.trial142.stdout:3827: writing trial14245205-6 from 3005997 to 3692577 tid 3 2026-02-17T12:10:08.261 INFO:tasks.rados.rados.0.trial142.stdout:3828: delete oid 12 current snap is 433 2026-02-17T12:10:08.261 INFO:tasks.rados.rados.0.trial142.stdout:3822: finishing write tid 1 to trial14245205-39 2026-02-17T12:10:08.261 INFO:tasks.rados.rados.0.trial142.stdout:3822: finishing write tid 2 to trial14245205-39 2026-02-17T12:10:08.261 INFO:tasks.rados.rados.0.trial142.stdout:3822: finishing write tid 3 to trial14245205-39 2026-02-17T12:10:08.261 INFO:tasks.rados.rados.0.trial142.stdout:3823: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:10:08.406 INFO:tasks.rados.rados.0.trial142.stdout:3822: finishing write tid 4 to trial14245205-39 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3823: done (5 left) 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3828: done (4 left) 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3829: write oid 23 current snap is 433 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: finishing write tid 5 to trial14245205-39 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: oid 39 updating version 0 to 2724 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: oid 39 updating version 2724 to 2727 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: oid 39 version 2727 is already newer than 2725 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: oid 39 version 2727 is already newer than 2726 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 39 v 2727 (ObjNum 1298 snap 433 seq_num 1298) dirty exists 2026-02-17T12:10:08.407 INFO:tasks.rados.rados.0.trial142.stdout:3822: left oid 39 (ObjNum 1298 snap 433 seq_num 1298) 2026-02-17T12:10:08.408 INFO:tasks.rados.rados.0.trial142.stdout:3829: seq_num 1301 ranges {665907=595312,1781191=645446,3177196=688711} 2026-02-17T12:10:08.410 INFO:tasks.rados.rados.0.trial142.stdout:3829: writing trial14245205-23 from 665907 to 1261219 tid 1 2026-02-17T12:10:08.415 INFO:tasks.rados.rados.0.trial142.stdout:3829: writing trial14245205-23 from 1781191 to 2426637 tid 2 2026-02-17T12:10:08.421 INFO:tasks.rados.rados.0.trial142.stdout:3829: writing trial14245205-23 from 3177196 to 3865907 tid 3 2026-02-17T12:10:08.421 INFO:tasks.rados.rados.0.trial142.stdout:3822: done (4 left) 2026-02-17T12:10:08.421 INFO:tasks.rados.rados.0.trial142.stdout:3830: rollback oid 20 current snap is 433 2026-02-17T12:10:08.421 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 20 to 414 2026-02-17T12:10:08.421 INFO:tasks.rados.rados.0.trial142.stdout:3826: expect (ObjNum 1245 snap 407 seq_num 1245) 2026-02-17T12:10:08.521 INFO:tasks.rados.rados.0.trial142.stdout:3825: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: finishing write tid 1 to trial14245205-6 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3825: done (4 left) 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3826: done (3 left) 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3831: rollback oid 11 current snap is 433 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 11 to 419 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: finishing write tid 2 to trial14245205-6 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: finishing write tid 3 to trial14245205-6 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: finishing write tid 4 to trial14245205-6 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: finishing write tid 5 to trial14245205-6 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: oid 6 updating version 0 to 3382 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: oid 6 version 3382 is already newer than 3381 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: oid 6 updating version 3382 to 3384 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: oid 6 version 3384 is already newer than 3383 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3384 (ObjNum 1299 snap 433 seq_num 1299) dirty exists 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3827: left oid 6 (ObjNum 1299 snap 433 seq_num 1299) 2026-02-17T12:10:08.586 INFO:tasks.rados.rados.0.trial142.stdout:3829: finishing write tid 1 to trial14245205-23 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: finishing write tid 2 to trial14245205-23 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3830: finishing rollback tid 0 to trial14245205-20 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: finishing write tid 3 to trial14245205-23 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: finishing write tid 4 to trial14245205-23 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3830: finishing rollback tid 1 to trial14245205-20 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: finishing write tid 5 to trial14245205-23 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: oid 23 updating version 0 to 3149 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: oid 23 version 3149 is already newer than 3148 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: oid 23 updating version 3149 to 3150 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: oid 23 version 3150 is already newer than 3147 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 3150 (ObjNum 1301 snap 433 seq_num 1301) dirty exists 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: left oid 23 (ObjNum 1301 snap 433 seq_num 1301) 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3830: finishing rollback tid 2 to trial14245205-20 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 20 v 3105 (ObjNum 960 snap 310 seq_num 960) dirty exists 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3827: done (3 left) 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3829: done (2 left) 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3830: done (1 left) 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3832: rollback oid 46 current snap is 433 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 46 to 431 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3833: write oid 36 current snap is 433 2026-02-17T12:10:08.587 INFO:tasks.rados.rados.0.trial142.stdout:3833: seq_num 1302 ranges {682714=670561,2123320=505457,3088266=636749} 2026-02-17T12:10:08.591 INFO:tasks.rados.rados.0.trial142.stdout:3833: writing trial14245205-36 from 682714 to 1353275 tid 1 2026-02-17T12:10:08.595 INFO:tasks.rados.rados.0.trial142.stdout:3833: writing trial14245205-36 from 2123320 to 2628777 tid 2 2026-02-17T12:10:08.600 INFO:tasks.rados.rados.0.trial142.stdout:3833: writing trial14245205-36 from 3088266 to 3725015 tid 3 2026-02-17T12:10:08.600 INFO:tasks.rados.rados.0.trial142.stdout:3834: write oid 32 current snap is 433 2026-02-17T12:10:08.600 INFO:tasks.rados.rados.0.trial142.stdout:3831: finishing rollback tid 0 to trial14245205-11 2026-02-17T12:10:08.600 INFO:tasks.rados.rados.0.trial142.stdout:3834: seq_num 1303 ranges {699521=745810,2181802=649115,3515689=383832} 2026-02-17T12:10:08.605 INFO:tasks.rados.rados.0.trial142.stdout:3834: writing trial14245205-32 from 699521 to 1445331 tid 1 2026-02-17T12:10:08.611 INFO:tasks.rados.rados.0.trial142.stdout:3834: writing trial14245205-32 from 2181802 to 2830917 tid 2 2026-02-17T12:10:08.615 INFO:tasks.rados.rados.0.trial142.stdout:3834: writing trial14245205-32 from 3515689 to 3899521 tid 3 2026-02-17T12:10:08.615 INFO:tasks.rados.rados.0.trial142.stdout:3835: read oid 16 snap -1 2026-02-17T12:10:08.615 INFO:tasks.rados.rados.0.trial142.stdout:3835: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:10:08.615 INFO:tasks.rados.rados.0.trial142.stdout:3836: snap_remove snap 413 2026-02-17T12:10:09.260 INFO:tasks.rados.rados.0.trial142.stdout:3836: done (5 left) 2026-02-17T12:10:09.260 INFO:tasks.rados.rados.0.trial142.stdout:3837: snap_remove snap 424 2026-02-17T12:10:10.263 INFO:tasks.rados.rados.0.trial142.stdout:3837: done (5 left) 2026-02-17T12:10:10.263 INFO:tasks.rados.rados.0.trial142.stdout:3838: write oid 31 current snap is 433 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:3831: finishing rollback tid 1 to trial14245205-11 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:3832: finishing rollback tid 0 to trial14245205-46 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:3831: finishing rollback tid 2 to trial14245205-11 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 11 v 3101 (ObjNum 1246 snap 407 seq_num 1246) dirty exists 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:3832: finishing rollback tid 1 to trial14245205-46 2026-02-17T12:10:10.264 INFO:tasks.rados.rados.0.trial142.stdout:3838: seq_num 1304 ranges {716328=421059,1840284=509126,3143112=659293} 2026-02-17T12:10:10.267 INFO:tasks.rados.rados.0.trial142.stdout:3838: writing trial14245205-31 from 716328 to 1137387 tid 1 2026-02-17T12:10:10.272 INFO:tasks.rados.rados.0.trial142.stdout:3838: writing trial14245205-31 from 1840284 to 2349410 tid 2 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3838: writing trial14245205-31 from 3143112 to 3802405 tid 3 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3831: done (5 left) 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3839: write (excl) oid 18 current snap is 433 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3832: finishing rollback tid 2 to trial14245205-46 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 3795 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3833: finishing write tid 1 to trial14245205-36 2026-02-17T12:10:10.278 INFO:tasks.rados.rados.0.trial142.stdout:3839: seq_num 1305 ranges {733135=496308,1898766=652784,3170535=470565} 2026-02-17T12:10:10.282 INFO:tasks.rados.rados.0.trial142.stdout:3839: writing trial14245205-18 from 733135 to 1229443 tid 1 2026-02-17T12:10:10.287 INFO:tasks.rados.rados.0.trial142.stdout:3839: writing trial14245205-18 from 1898766 to 2551550 tid 2 2026-02-17T12:10:10.292 INFO:tasks.rados.rados.0.trial142.stdout:3839: writing trial14245205-18 from 3170535 to 3641100 tid 3 2026-02-17T12:10:10.292 INFO:tasks.rados.rados.0.trial142.stdout:3832: done (5 left) 2026-02-17T12:10:10.292 INFO:tasks.rados.rados.0.trial142.stdout:3840: delete oid 29 current snap is 433 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: finishing write tid 2 to trial14245205-36 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: finishing write tid 3 to trial14245205-36 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: finishing write tid 4 to trial14245205-36 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: finishing write tid 5 to trial14245205-36 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: oid 36 updating version 0 to 3108 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: oid 36 updating version 3108 to 3109 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: oid 36 version 3109 is already newer than 3106 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: oid 36 version 3109 is already newer than 3107 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 3109 (ObjNum 1302 snap 433 seq_num 1302) dirty exists 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3833: left oid 36 (ObjNum 1302 snap 433 seq_num 1302) 2026-02-17T12:10:10.293 INFO:tasks.rados.rados.0.trial142.stdout:3834: finishing write tid 1 to trial14245205-32 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: finishing write tid 2 to trial14245205-32 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: finishing write tid 3 to trial14245205-32 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: finishing write tid 4 to trial14245205-32 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: finishing write tid 5 to trial14245205-32 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: oid 32 updating version 0 to 3113 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: oid 32 version 3113 is already newer than 3111 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: oid 32 version 3113 is already newer than 3110 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: oid 32 version 3113 is already newer than 3112 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 3113 (ObjNum 1303 snap 433 seq_num 1303) dirty exists 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3834: left oid 32 (ObjNum 1303 snap 433 seq_num 1303) 2026-02-17T12:10:10.294 INFO:tasks.rados.rados.0.trial142.stdout:3835: expect (ObjNum 1059 snap 343 seq_num 1059) 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: finishing write tid 1 to trial14245205-31 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: finishing write tid 2 to trial14245205-31 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3833: done (5 left) 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3834: done (4 left) 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3835: done (3 left) 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3840: done (2 left) 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3841: delete oid 46 current snap is 433 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: finishing write tid 3 to trial14245205-31 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: finishing write tid 4 to trial14245205-31 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: finishing write tid 5 to trial14245205-31 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: oid 31 updating version 0 to 3715 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: oid 31 version 3715 is already newer than 3714 2026-02-17T12:10:10.476 INFO:tasks.rados.rados.0.trial142.stdout:3838: oid 31 version 3715 is already newer than 3713 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3838: oid 31 version 3715 is already newer than 3712 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 31 v 3715 (ObjNum 1304 snap 433 seq_num 1304) dirty exists 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3838: left oid 31 (ObjNum 1304 snap 433 seq_num 1304) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: finishing write tid 1 to trial14245205-18 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: finishing write tid 2 to trial14245205-18 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: finishing write tid 3 to trial14245205-18 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: finishing write tid 4 to trial14245205-18 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: finishing write tid 5 to trial14245205-18 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: oid 18 updating version 0 to 3816 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: oid 18 updating version 3816 to 3817 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: oid 18 updating version 3817 to 3818 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: oid 18 updating version 3818 to 3819 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 18 v 3819 (ObjNum 1305 snap 433 seq_num 1305) dirty exists 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: left oid 18 (ObjNum 1305 snap 433 seq_num 1305) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3838: done (2 left) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3839: done (1 left) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3841: done (0 left) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3842: read oid 29 snap 426 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3842: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3843: write oid 25 current snap is 433 2026-02-17T12:10:10.477 INFO:tasks.rados.rados.0.trial142.stdout:3843: seq_num 1308 ranges {783556=438408,1674212=400111,2736451=420734,3882270=101286} 2026-02-17T12:10:10.482 INFO:tasks.rados.rados.0.trial142.stdout:3843: writing trial14245205-25 from 783556 to 1221964 tid 1 2026-02-17T12:10:10.485 INFO:tasks.rados.rados.0.trial142.stdout:3843: writing trial14245205-25 from 1674212 to 2074323 tid 2 2026-02-17T12:10:10.489 INFO:tasks.rados.rados.0.trial142.stdout:3843: writing trial14245205-25 from 2736451 to 3157185 tid 3 2026-02-17T12:10:10.492 INFO:tasks.rados.rados.0.trial142.stdout:3843: writing trial14245205-25 from 3882270 to 3983556 tid 4 2026-02-17T12:10:10.492 INFO:tasks.rados.rados.0.trial142.stdout:3844: write oid 1 current snap is 433 2026-02-17T12:10:10.492 INFO:tasks.rados.rados.0.trial142.stdout:3844: seq_num 1309 ranges {400363=513657,1332694=660122} 2026-02-17T12:10:10.495 INFO:tasks.rados.rados.0.trial142.stdout:3844: writing trial14245205-1 from 400363 to 914020 tid 1 2026-02-17T12:10:10.500 INFO:tasks.rados.rados.0.trial142.stdout:3844: writing trial14245205-1 from 1332694 to 1992816 tid 2 2026-02-17T12:10:10.500 INFO:tasks.rados.rados.0.trial142.stdout:3845: write oid 26 current snap is 433 2026-02-17T12:10:10.500 INFO:tasks.rados.rados.0.trial142.stdout:3845: seq_num 1310 ranges {417170=588906,1674823=342347} 2026-02-17T12:10:10.503 INFO:tasks.rados.rados.0.trial142.stdout:3845: writing trial14245205-26 from 417170 to 1006076 tid 1 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3845: writing trial14245205-26 from 1674823 to 2017170 tid 2 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3846: read oid 47 snap -1 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3846: expect deleted 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3847: read oid 12 snap -1 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3847: expect deleted 2026-02-17T12:10:10.508 INFO:tasks.rados.rados.0.trial142.stdout:3848: snap_remove snap 431 2026-02-17T12:10:11.264 INFO:tasks.rados.rados.0.trial142.stdout:3848: done (6 left) 2026-02-17T12:10:11.264 INFO:tasks.rados.rados.0.trial142.stdout:3849: read oid 42 snap 426 2026-02-17T12:10:11.265 INFO:tasks.rados.rados.0.trial142.stdout:3849: expect (ObjNum 1227 snap 406 seq_num 1227) 2026-02-17T12:10:11.265 INFO:tasks.rados.rados.0.trial142.stdout:3842: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:10:11.329 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 1 to trial14245205-25 2026-02-17T12:10:11.329 INFO:tasks.rados.rados.0.trial142.stdout:3842: done (6 left) 2026-02-17T12:10:11.329 INFO:tasks.rados.rados.0.trial142.stdout:3850: snap_remove snap 416 2026-02-17T12:10:12.243 INFO:tasks.rados.rados.0.trial142.stdout:3850: done (6 left) 2026-02-17T12:10:12.243 INFO:tasks.rados.rados.0.trial142.stdout:3851: read oid 14 snap -1 2026-02-17T12:10:12.243 INFO:tasks.rados.rados.0.trial142.stdout:3851: expect (ObjNum 1281 snap 428 seq_num 1281) 2026-02-17T12:10:12.244 INFO:tasks.rados.rados.0.trial142.stdout:3852: read oid 11 snap 430 2026-02-17T12:10:12.244 INFO:tasks.rados.rados.0.trial142.stdout:3852: expect (ObjNum 1272 snap 420 seq_num 1272) 2026-02-17T12:10:12.244 INFO:tasks.rados.rados.0.trial142.stdout:3853: snap_remove snap 414 2026-02-17T12:10:13.243 INFO:tasks.rados.rados.0.trial142.stdout:3853: done (8 left) 2026-02-17T12:10:13.243 INFO:tasks.rados.rados.0.trial142.stdout:3854: write oid 9 current snap is 433 2026-02-17T12:10:13.243 INFO:tasks.rados.rados.0.trial142.stdout:3854: seq_num 1311 ranges {433977=664155,1733305=300672} 2026-02-17T12:10:13.247 INFO:tasks.rados.rados.0.trial142.stdout:3854: writing trial14245205-9 from 433977 to 1098132 tid 1 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3854: writing trial14245205-9 from 1733305 to 2033977 tid 2 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3855: write oid 13 current snap is 433 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 2 to trial14245205-25 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 3 to trial14245205-25 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 4 to trial14245205-25 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 5 to trial14245205-25 2026-02-17T12:10:13.251 INFO:tasks.rados.rados.0.trial142.stdout:3855: seq_num 1312 ranges {450784=739404,1791787=258997} 2026-02-17T12:10:13.256 INFO:tasks.rados.rados.0.trial142.stdout:3855: writing trial14245205-13 from 450784 to 1190188 tid 1 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3855: writing trial14245205-13 from 1791787 to 2050784 tid 2 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3856: write (excl) oid 50 current snap is 433 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: finishing write tid 6 to trial14245205-25 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: oid 25 updating version 0 to 2782 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: oid 25 version 2782 is already newer than 2779 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: oid 25 version 2782 is already newer than 2780 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: oid 25 version 2782 is already newer than 2781 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: oid 25 version 2782 is already newer than 2778 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 25 v 2782 (ObjNum 1308 snap 433 seq_num 1308) dirty exists 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3843: left oid 25 (ObjNum 1308 snap 433 seq_num 1308) 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: finishing write tid 1 to trial14245205-1 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: finishing write tid 2 to trial14245205-1 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: finishing write tid 3 to trial14245205-1 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: finishing write tid 4 to trial14245205-1 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: oid 1 updating version 0 to 3154 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: oid 1 updating version 3154 to 3155 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: oid 1 version 3155 is already newer than 3153 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3155 (ObjNum 1309 snap 433 seq_num 1309) dirty exists 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3844: left oid 1 (ObjNum 1309 snap 433 seq_num 1309) 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3845: finishing write tid 1 to trial14245205-26 2026-02-17T12:10:13.260 INFO:tasks.rados.rados.0.trial142.stdout:3856: seq_num 1313 ranges {467591=414653,1450269=617322} 2026-02-17T12:10:13.263 INFO:tasks.rados.rados.0.trial142.stdout:3856: writing trial14245205-50 from 467591 to 882244 tid 1 2026-02-17T12:10:13.267 INFO:tasks.rados.rados.0.trial142.stdout:3856: writing trial14245205-50 from 1450269 to 2067591 tid 2 2026-02-17T12:10:13.267 INFO:tasks.rados.rados.0.trial142.stdout:3843: done (10 left) 2026-02-17T12:10:13.267 INFO:tasks.rados.rados.0.trial142.stdout:3844: done (9 left) 2026-02-17T12:10:13.268 INFO:tasks.rados.rados.0.trial142.stdout:3857: write (excl) oid 16 current snap is 433 2026-02-17T12:10:13.268 INFO:tasks.rados.rados.0.trial142.stdout:3857: seq_num 1314 ranges {484398=489902,1392398=411118} 2026-02-17T12:10:13.271 INFO:tasks.rados.rados.0.trial142.stdout:3857: writing trial14245205-16 from 484398 to 974300 tid 1 2026-02-17T12:10:13.275 INFO:tasks.rados.rados.0.trial142.stdout:3857: writing trial14245205-16 from 1392398 to 1803516 tid 2 2026-02-17T12:10:13.275 INFO:tasks.rados.rados.0.trial142.stdout:3858: read oid 20 snap -1 2026-02-17T12:10:13.275 INFO:tasks.rados.rados.0.trial142.stdout:3858: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:10:13.275 INFO:tasks.rados.rados.0.trial142.stdout:3859: rollback oid 29 current snap is 433 2026-02-17T12:10:13.275 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 29 to 430 2026-02-17T12:10:13.276 INFO:tasks.rados.rados.0.trial142.stdout:3846: done (11 left) 2026-02-17T12:10:13.276 INFO:tasks.rados.rados.0.trial142.stdout:3847: done (10 left) 2026-02-17T12:10:13.276 INFO:tasks.rados.rados.0.trial142.stdout:3860: write (excl) oid 3 current snap is 433 2026-02-17T12:10:13.276 INFO:tasks.rados.rados.0.trial142.stdout:3860: seq_num 1315 ranges {501205=565151,1850880=250325} 2026-02-17T12:10:13.279 INFO:tasks.rados.rados.0.trial142.stdout:3860: writing trial14245205-3 from 501205 to 1066356 tid 1 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3860: writing trial14245205-3 from 1850880 to 2101205 tid 2 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3861: snap_create 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3845: finishing write tid 2 to trial14245205-26 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3845: finishing write tid 3 to trial14245205-26 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3845: finishing write tid 4 to trial14245205-26 2026-02-17T12:10:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3845: oid 26 updating version 0 to 2783 2026-02-17T12:10:13.284 INFO:tasks.rados.rados.0.trial142.stdout:3845: oid 26 updating version 2783 to 2784 2026-02-17T12:10:13.284 INFO:tasks.rados.rados.0.trial142.stdout:3845: oid 26 updating version 2784 to 2785 2026-02-17T12:10:13.284 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2785 (ObjNum 1310 snap 433 seq_num 1310) dirty exists 2026-02-17T12:10:13.284 INFO:tasks.rados.rados.0.trial142.stdout:3845: left oid 26 (ObjNum 1310 snap 433 seq_num 1310) 2026-02-17T12:10:13.284 INFO:tasks.rados.rados.0.trial142.stdout:3849: expect (ObjNum 1227 snap 406 seq_num 1227) 2026-02-17T12:10:13.411 INFO:tasks.rados.rados.0.trial142.stdout:3851: expect (ObjNum 1281 snap 428 seq_num 1281) 2026-02-17T12:10:13.538 INFO:tasks.rados.rados.0.trial142.stdout:3852: expect (ObjNum 1272 snap 420 seq_num 1272) 2026-02-17T12:10:13.672 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-17T12:10:13.673 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-17T12:10:13.673 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:10:13.673 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:10:13.676 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:10:13.676 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:10:13.676 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:10:13.677 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T12:10:13.677 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T12:10:13.677 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:10:13.691 INFO:tasks.rados.rados.0.trial142.stdout:3854: finishing write tid 1 to trial14245205-9 2026-02-17T12:10:13.691 INFO:tasks.rados.rados.0.trial142.stdout:3854: finishing write tid 2 to trial14245205-9 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: finishing write tid 3 to trial14245205-9 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: finishing write tid 4 to trial14245205-9 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: oid 9 updating version 0 to 3850 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: oid 9 updating version 3850 to 3852 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: oid 9 version 3852 is already newer than 3851 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3852 (ObjNum 1311 snap 433 seq_num 1311) dirty exists 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3854: left oid 9 (ObjNum 1311 snap 433 seq_num 1311) 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3855: finishing write tid 1 to trial14245205-13 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3855: finishing write tid 2 to trial14245205-13 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3855: finishing write tid 3 to trial14245205-13 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3855: finishing write tid 4 to trial14245205-13 2026-02-17T12:10:13.692 INFO:tasks.rados.rados.0.trial142.stdout:3855: oid 13 updating version 0 to 3717 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3855: oid 13 updating version 3717 to 3718 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3855: oid 13 version 3718 is already newer than 3716 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 13 v 3718 (ObjNum 1312 snap 433 seq_num 1312) dirty exists 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3855: left oid 13 (ObjNum 1312 snap 433 seq_num 1312) 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: finishing write tid 1 to trial14245205-50 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: finishing write tid 2 to trial14245205-50 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: finishing write tid 3 to trial14245205-50 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: finishing write tid 4 to trial14245205-50 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: oid 50 updating version 0 to 2787 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: oid 50 version 2787 is already newer than 2786 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: oid 50 updating version 2787 to 2788 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 2788 (ObjNum 1313 snap 433 seq_num 1313) dirty exists 2026-02-17T12:10:13.693 INFO:tasks.rados.rados.0.trial142.stdout:3856: left oid 50 (ObjNum 1313 snap 433 seq_num 1313) 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: finishing write tid 1 to trial14245205-16 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3859: finishing rollback tid 1 to trial14245205-29 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 3112 (ObjNum 33 snap 0 seq_num 1214064848) dirty dne 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: finishing write tid 2 to trial14245205-16 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: finishing write tid 3 to trial14245205-16 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: finishing write tid 4 to trial14245205-16 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: oid 16 updating version 0 to 2775 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: oid 16 updating version 2775 to 2776 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: oid 16 version 2776 is already newer than 2774 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 2776 (ObjNum 1314 snap 433 seq_num 1314) dirty exists 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: left oid 16 (ObjNum 1314 snap 433 seq_num 1314) 2026-02-17T12:10:13.694 INFO:tasks.rados.rados.0.trial142.stdout:3858: expect (ObjNum 960 snap 310 seq_num 960) 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: finishing write tid 1 to trial14245205-3 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: finishing write tid 2 to trial14245205-3 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: finishing write tid 3 to trial14245205-3 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: finishing write tid 4 to trial14245205-3 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: oid 3 updating version 0 to 2777 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: oid 3 version 2777 is already newer than 2776 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: oid 3 version 2777 is already newer than 2775 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 2777 (ObjNum 1315 snap 433 seq_num 1315) dirty exists 2026-02-17T12:10:13.778 INFO:tasks.rados.rados.0.trial142.stdout:3860: left oid 3 (ObjNum 1315 snap 433 seq_num 1315) 2026-02-17T12:10:28.678 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:10:28.678 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:10:28.678 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T12:10:28.678 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T12:10:28.678 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:10:28.678 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:28.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.744+0000 7f33f21c3640 10 monclient: get_monmap_and_config 2026-02-17T12:10:28.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.744+0000 7f33f21c3640 10 monclient: build_initial_monmap 2026-02-17T12:10:28.746 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.744+0000 7f33f21c3640 10 monclient: monmap: 2026-02-17T12:10:28.746 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:28.746 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:28.745850+0000 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:28.745850+0000 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:28.747 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 Processor -- start 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 -- start start 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient: init 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f33ec0a5280 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-a con 0x7f33ec0a3150 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-c con 0x7f33ec0a5d70 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec0a2750 con 0x7f33ec0a5280 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:28.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f33ec0a2220 con 0x7f33ec0a3150 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f33ec0a14f0 con 0x7f33ec0a5d70 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f21c3640 10 monclient(hunting): authenticate will time out at 2116.364836s 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38130/0 (socket says 10.20.193.51:38130) 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 learned_addr learned my addr 10.20.193.51:0/1648869150 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 10 monclient(hunting): get_auth_request con 0x7f33ec0a3150 auth_method 0 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.745+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33ec0a5d70 auth_method 0 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.746+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:28.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.748+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> v1:10.20.193.142:6789/0 conn(0x7f33ec0a5280 legacy=0x7f33ec0a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:28.948 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 10 monclient(hunting): get_auth_request con 0x7f33ec0a3150 auth_method 0 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:28.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.946+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:28.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:28.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33ec0a5d70 auth_method 0 2026-02-17T12:10:28.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:28.951 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:28.947+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:29.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 10 monclient(hunting): get_auth_request con 0x7f33ec0a3150 auth_method 0 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:29.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.347+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:29.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:29.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33ec0a5d70 auth_method 0 2026-02-17T12:10:29.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:29.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:29.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:29.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:29.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:29.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:29.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:29.348+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:30.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 10 monclient(hunting): get_auth_request con 0x7f33ec0a3150 auth_method 0 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:30.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.148+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:30.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:30.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33ec0a5d70 auth_method 0 2026-02-17T12:10:30.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:30.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:30.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:30.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:30.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:30.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:30.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:30.149+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): tick 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 monclient(hunting): continuing hunt 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 msgr2=0x7f33ec13f7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.142:3300/0 conn(0x7f33ec0a5d70 0x7f33ec13f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 -- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 msgr2=0x7f33ec13d280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 --2- 10.20.193.51:0/1648869150 >> v2:10.20.193.51:3300/0 conn(0x7f33ec0a3150 0x7f33ec13d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 -- 10.20.193.51:0/1648869150 >> v1:10.20.193.142:6789/0 conn(0x7f33ec0a5280 legacy=0x7f33ec0a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient: _add_conns ranks=[2,0] 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): picked mon.noname-b con 0x7f33d0003820 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f33d0006380 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 -- 10.20.193.51:0/1648869150 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec0a1730 con 0x7f33d0006380 2026-02-17T12:10:31.748 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 1 -- 10.20.193.51:0/1648869150 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec0a2220 con 0x7f33d0003820 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.745+0000 7f33daffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 10 monclient(hunting): get_auth_request con 0x7f33d0003820 auth_method 0 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.746+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:31.749 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.748+0000 7f33f09c0640 1 -- 10.20.193.51:0/1648869150 >> v1:10.20.193.51:6789/0 conn(0x7f33d0006380 legacy=0x7f33d0008840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:31.949 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 10 monclient(hunting): get_auth_request con 0x7f33d0003820 auth_method 0 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:31.950 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:31.947+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:32.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:32.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 10 monclient(hunting): get_auth_request con 0x7f33d0003820 auth_method 0 2026-02-17T12:10:32.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:32.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:32.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:32.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:32.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:32.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:32.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:32.348+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:33.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 10 monclient(hunting): get_auth_request con 0x7f33d0003820 auth_method 0 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:33.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.149+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674919688 0 0) 0x7f33ec0a1730 con 0x7f33d0006380 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient(hunting): _negotiate 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient(hunting): my global_id is 274356 2026-02-17T12:10:33.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d4003620 con 0x7f33d0006380 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3359006784 0 0) 0x7f33d4003620 con 0x7f33d0006380 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 msgr2=0x7f33d0005c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d0003820 0x7f33d0005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d000b1f0 con 0x7f33d0006380 2026-02-17T12:10:33.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: _finish_auth 0 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: _check_auth_tickets 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f33e0004560 con 0x7f33d0006380 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33f21c3640 5 monclient: authenticate success, global_id 274356 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33f21c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: dump: 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.687+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 >> v1:10.20.193.51:6789/0 conn(0x7f33d0006380 legacy=0x7f33d0008840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 reap_dead start 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 0x7f33d4003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): picked mon.b con 0x7f33d4003b00 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4004900 0x7f33d4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): picked mon.c con 0x7f33d4004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33d400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): picked mon.a con 0x7f33d4005410 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0a2220 con 0x7f33d4005410 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33d400c350 con 0x7f33d4003b00 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f33d400c550 con 0x7f33d4004900 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33dbfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f21c3640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33d400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33d4005410 auth_method 0 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:33.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4004900 0x7f33d4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): get_auth_request con 0x7f33d4004900 auth_method 0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f09c0640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 0x7f33d4003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient(hunting): handle_auth_done global_id 274356 payload 293 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4004900 msgr2=0x7f33d4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4004900 0x7f33d4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 msgr2=0x7f33d4003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 0x7f33d4003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient: _finish_hunting 0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 monclient: found mon.a 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d4003620 con 0x7f33d4005410 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient: _finish_auth 0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 10 monclient: _check_auth_tickets 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f19c2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f11c1640 10 monclient: get_auth_request con 0x7f33d4003b00 auth_method 0 2026-02-17T12:10:33.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.688+0000 7f33f11c1640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 0x7f33d4003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.690+0000 7f33f19c2640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 msgr2=0x7f33d400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.690+0000 7f33f19c2640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33d400bac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0a3560 tx=0x7f33e802fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9364ad371fc26bd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8039070 con 0x7f33d4005410 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: dump: 2026-02-17T12:10:33.697 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8034870 con 0x7f33d4005410 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 1 -- 10.20.193.51:0/1648869150 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8009640 con 0x7f33d4005410 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 4 set_mon_vals no callback set 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33dbfff640 10 monclient: dump: 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.698 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 10 monclient: shutdown 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 -- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 msgr2=0x7f33d400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33d400bac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0a3560 tx=0x7f33e802fb50 comp rx=0 tx=0).stop 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 -- 10.20.193.51:0/1648869150 shutdown_connections 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33d400bac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4004900 0x7f33d4004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 --2- 10.20.193.51:0/1648869150 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4003b00 0x7f33d4003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 -- 10.20.193.51:0/1648869150 >> 10.20.193.51:0/1648869150 conn(0x7f33ec0aaca0 msgr2=0x7f33ec0ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 -- 10.20.193.51:0/1648869150 shutdown_connections 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 1 -- 10.20.193.51:0/1648869150 wait complete. 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 10 monclient: build_initial_monmap 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.691+0000 7f33f21c3640 10 monclient: monmap: 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.699 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 Processor -- start 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 -- start start 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient: init 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-c con 0x7f33d4003b00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 0x7f33ec1be280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-b con 0x7f33d4004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33ec1be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): picked mon.noname-a con 0x7f33d4005410 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0a0b40 con 0x7f33d4005410 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0a6420 con 0x7f33d4004900 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec0a0cc0 con 0x7f33d4003b00 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f21c3640 10 monclient(hunting): authenticate will time out at 2121.311459s 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33ec1be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43456/0 (socket says 10.20.193.51:43456) 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 -- 10.20.193.51:0/3886019067 learned_addr learned my addr 10.20.193.51:0/3886019067 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 10 monclient(hunting): get_auth_request con 0x7f33d4003b00 auth_method 0 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): get_auth_request con 0x7f33d4005410 auth_method 0 2026-02-17T12:10:33.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 msgr2=0x7f33ec1cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 msgr2=0x7f33ec1cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f11c1640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f09c0640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 0x7f33ec1be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient(hunting): handle_auth_done global_id 274359 payload 824 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 msgr2=0x7f33ec1cb180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 msgr2=0x7f33ec1be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.702 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 0x7f33ec1be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient: _finish_hunting 0 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 monclient: found mon.noname-a 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f19c2640 1 -- 10.20.193.51:0/3886019067 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec1aa960 con 0x7f33d4005410 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f09c0640 10 monclient: get_auth_request con 0x7f33d4004900 auth_method 0 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.692+0000 7f33f09c0640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 0x7f33ec1be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f19c2640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 msgr2=0x7f33ec1be7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f19c2640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33ec1be7c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33e803b000 tx=0x7f33e8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e804c070 con 0x7f33d4005410 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: dump: 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.703 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8034670 con 0x7f33d4005410 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 5 monclient: authenticate success, global_id 274359 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 10 monclient: _renew_subs 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec1acc50 con 0x7f33d4005410 2026-02-17T12:10:33.704 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8039040 con 0x7f33d4005410 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33db7fe640 4 set_mon_vals no callback set 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33d9ffb640 10 monclient: dump: 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.705 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 10 monclient: _renew_subs 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.694+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec1ac3b0 con 0x7f33d4005410 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f33e803eab0 con 0x7f33d4005410 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f21c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f21c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f21c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec0a5780 con 0x7f33d4005410 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33d9ffb640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 0x7f33bc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(900..900 src has 323..900) ==== 4811+0+0 (secure 0 0 0) 0x7f33e80783e0 con 0x7f33d4005410 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f11c1640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 0x7f33bc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.706 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.695+0000 7f33f11c1640 10 monclient: get_auth_request con 0x7f33bc03dd10 auth_method 0 2026-02-17T12:10:33.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.698+0000 7f33f11c1640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 0x7f33bc0401d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f33dc002410 tx=0x7f33dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.698+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f33e8034820 con 0x7f33d4005410 2026-02-17T12:10:33.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.698+0000 7f33d9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:33.707 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.698+0000 7f33d9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:33.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33f21c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33f21c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33f21c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f33ec1ac790 con 0x7f33d4005410 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33d9ffb640 1 -- 10.20.193.51:0/3886019067 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f33e8076dc0 con 0x7f33d4005410 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33d9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:33.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.814+0000 7f33d9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:33.818 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 msgr2=0x7f33bc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 0x7f33bc0401d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f33dc002410 tx=0x7f33dc009040 comp rx=0 tx=0).stop 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 10 monclient: shutdown 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 msgr2=0x7f33ec1be7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33ec1be7c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33e803b000 tx=0x7f33e8004b40 comp rx=0 tx=0).stop 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 shutdown_connections 2026-02-17T12:10:33.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f33bc03dd10 0x7f33bc0401d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f33d4005410 0x7f33ec1be7c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f33d4004900 0x7f33ec1be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 --2- 10.20.193.51:0/3886019067 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f33d4003b00 0x7f33ec1cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 >> 10.20.193.51:0/3886019067 conn(0x7f33ec0aaca0 msgr2=0x7f33ec1c0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 shutdown_connections 2026-02-17T12:10:33.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.815+0000 7f33f21c3640 1 -- 10.20.193.51:0/3886019067 wait complete. 2026-02-17T12:10:33.826 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:10:33.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:10:33.826 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:10:33.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.894+0000 7ff5967ee640 10 monclient: get_monmap_and_config 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.894+0000 7ff5967ee640 10 monclient: build_initial_monmap 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.894+0000 7ff5967ee640 10 monclient: monmap: 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:33.895751+0000 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:33.895751+0000 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:33.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 Processor -- start 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 -- start start 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient: init 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:33.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff5900a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff59009dac0 0x7ff59009fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-a con 0x7ff59009dac0 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff5900a0110 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59006e140 con 0x7ff5900a0110 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59009ce60 con 0x7ff5900a3bb0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff59009aed0 con 0x7ff59009dac0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff5967ee640 10 monclient(hunting): authenticate will time out at 2121.514499s 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff59009dac0 0x7ff59009fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff59009dac0 0x7ff59009fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38192/0 (socket says 10.20.193.51:38192) 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff594d64640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7ff5900a0110 0x7ff59013c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54846/0 (socket says 10.20.193.51:54846) 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 1 -- 10.20.193.51:0/3979392959 learned_addr learned my addr 10.20.193.51:0/3979392959 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 10 monclient(hunting): get_auth_request con 0x7ff59009dac0 auth_method 0 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.895+0000 7ff58f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff594d64640 1 -- 10.20.193.51:0/3979392959 >> v1:10.20.193.51:6789/0 conn(0x7ff5900a0110 legacy=0x7ff59013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_done global_id 274362 payload 274 2026-02-17T12:10:33.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 1 -- 10.20.193.51:0/3979392959 >> v1:10.20.193.142:6789/0 conn(0x7ff5900a3bb0 legacy=0x7ff59009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58ffff640 1 -- 10.20.193.51:0/3979392959 >> v1:10.20.193.142:6789/0 conn(0x7ff5900a3bb0 legacy=0x7ff59009f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 1 -- 10.20.193.51:0/3979392959 >> v1:10.20.193.51:6789/0 conn(0x7ff5900a0110 legacy=0x7ff59013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58effd640 1 -- 10.20.193.51:0/3979392959 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920009421 0 0) 0x7ff59006e140 con 0x7ff5900a0110 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58f7fe640 1 -- 10.20.193.51:0/3979392959 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59009a5c0 con 0x7ff59009dac0 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.897+0000 7ff58effd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T12:10:33.912 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58f7fe640 1 -- 10.20.193.51:0/3979392959 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 msgr2=0x7ff59009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58f7fe640 1 --2- 10.20.193.51:0/3979392959 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff59009fbd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff580009a70 tx=0x7ff58002efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cf14b3637493f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 1 -- 10.20.193.51:0/3979392959 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58003c070 con 0x7ff59009dac0 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: dump: 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.913 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: _finish_auth 0 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 1 -- 10.20.193.51:0/3979392959 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580037440 con 0x7ff59009dac0 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 1 -- 10.20.193.51:0/3979392959 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580037810 con 0x7ff59009dac0 2026-02-17T12:10:33.914 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 5 monclient: authenticate success, global_id 274362 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff58effd640 10 monclient: dump: 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.915 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 4 set_mon_vals no callback set 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 10 monclient: shutdown 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 -- 10.20.193.51:0/3979392959 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 msgr2=0x7ff59009fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 --2- 10.20.193.51:0/3979392959 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff59009fbd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff580009a70 tx=0x7ff58002efb0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 -- 10.20.193.51:0/3979392959 shutdown_connections 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 --2- 10.20.193.51:0/3979392959 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff59009fbd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 -- 10.20.193.51:0/3979392959 >> 10.20.193.51:0/3979392959 conn(0x7ff5900a30c0 msgr2=0x7ff5900a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 -- 10.20.193.51:0/3979392959 shutdown_connections 2026-02-17T12:10:33.916 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.900+0000 7ff5967ee640 1 -- 10.20.193.51:0/3979392959 wait complete. 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient: build_initial_monmap 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient: monmap: 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.917 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 Processor -- start 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 -- start start 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient: init 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff590094ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-a con 0x7ff59009dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 0x7ff590095400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-c con 0x7ff5900a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff5900a3bb0 0x7ff590095940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.918 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): picked mon.noname-b con 0x7ff5900a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900a3f90 con 0x7ff59009dac0 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff59009caa0 con 0x7ff5900a3bb0 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff5900a0540 con 0x7ff5900a0110 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff5967ee640 10 monclient(hunting): authenticate will time out at 2121.520888s 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 0x7ff590095400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.919 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58ffff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff590094ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 0x7ff590095400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43472/0 (socket says 10.20.193.51:43472) 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 1 -- 10.20.193.51:0/4087564104 learned_addr learned my addr 10.20.193.51:0/4087564104 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 10 monclient(hunting): get_auth_request con 0x7ff5900a0110 auth_method 0 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58ffff640 10 monclient(hunting): get_auth_request con 0x7ff59009dac0 auth_method 0 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.901+0000 7ff58ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.920 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient(hunting): handle_auth_done global_id 304100 payload 824 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff5900a3bb0 msgr2=0x7ff590095940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff5900a3bb0 0x7ff590095940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 msgr2=0x7ff590094ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff590094ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 monclient: found mon.noname-c 2026-02-17T12:10:33.921 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58f7fe640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5900974f0 con 0x7ff5900a0110 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.902+0000 7ff58ffff640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff59009dac0 0x7ff590094ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58f7fe640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 msgr2=0x7ff590095400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58f7fe640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 0x7ff590095400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff58002f4e0 tx=0x7ff580004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58003c040 con 0x7ff5900a0110 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: dump: 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.922 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: _finish_auth 0 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580047070 con 0x7ff5900a0110 2026-02-17T12:10:33.923 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580041ac0 con 0x7ff5900a0110 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58e7fc640 4 set_mon_vals no callback set 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff58cff9640 10 monclient: dump: 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.924 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 5 monclient: authenticate success, global_id 304100 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 monclient: _renew_subs 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff590098a10 con 0x7ff5900a0110 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 monclient: _renew_subs 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff590098450 con 0x7ff5900a0110 2026-02-17T12:10:33.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 0x7ff590090410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.904+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff59009e5c0 con 0x7ff5901cfc60 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 0x7ff590090410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff580041c60 con 0x7ff5900a0110 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient: get_auth_request con 0x7ff5901cfc60 auth_method 0 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 10 monclient(hunting): handle_auth_done global_id 274371 payload 824 2026-02-17T12:10:33.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58ffff640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5900a2bc0 con 0x7ff5901cfc60 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58cff9640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff56003dd10 0x7ff5600401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(900..900 src has 323..900) ==== 4811+0+0 (secure 0 0 0) 0x7ff580077ca0 con 0x7ff5900a0110 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff594d64640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff56003dd10 0x7ff5600401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.905+0000 7ff594d64640 10 monclient: get_auth_request con 0x7ff56003dd10 auth_method 0 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58ffff640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 msgr2=0x7ff590090410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58ffff640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 0x7ff590090410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00fdc0 tx=0x7ff57c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00de90 con 0x7ff5901cfc60 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 10 monclient: dump: 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.927 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff57c018070 con 0x7ff5901cfc60 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 msgr2=0x7ff590090410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 0x7ff590090410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00fdc0 tx=0x7ff57c00d520 comp rx=0 tx=0).stop 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 msgr2=0x7ff590090410 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.907+0000 7ff58cff9640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901cfc60 0x7ff590090410 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00fdc0 tx=0x7ff57c00d520 comp rx=0 tx=0).stop 2026-02-17T12:10:33.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.908+0000 7ff594d64640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff56003dd10 0x7ff5600401d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff584003120 tx=0x7ff584003340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff5967ee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff5967ee640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 0x7ff5901da710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff5967ee640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff590091ad0 con 0x7ff5901d0040 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 0x7ff5901da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient: get_auth_request con 0x7ff5901d0040 auth_method 0 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:33.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 10 monclient(hunting): handle_auth_done global_id 274374 payload 824 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.910+0000 7ff58ffff640 1 -- 10.20.193.51:0/4087564104 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5900008d0 con 0x7ff5901d0040 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58ffff640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 msgr2=0x7ff5901da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58ffff640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 0x7ff5901da710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff57c017000 tx=0x7ff57c002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c005ad0 con 0x7ff5901d0040 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 10 monclient: dump: 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:33.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7ff57c005ad0 con 0x7ff5901d0040 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 msgr2=0x7ff5901da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 0x7ff5901da710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff57c017000 tx=0x7ff57c002cc0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 msgr2=0x7ff5901da710 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:33.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff58cff9640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff5901d0040 0x7ff5901da710 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff57c017000 tx=0x7ff57c002cc0 comp rx=0 tx=0).stop 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 205270, 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:33.934 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:33.935 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:33.936 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:33.937 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:33.938 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:33.939 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.940 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.941 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:33.942 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:33.943 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:33.944 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:33.945 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:33.946 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff56003dd10 msgr2=0x7ff5600401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff56003dd10 0x7ff5600401d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff584003120 tx=0x7ff584003340 comp rx=0 tx=0).stop 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 10 monclient: shutdown 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 msgr2=0x7ff590095400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 --2- 10.20.193.51:0/4087564104 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff5900a0110 0x7ff590095400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff58002f4e0 tx=0x7ff580004830 comp rx=0 tx=0).stop 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff594d64640 1 -- 10.20.193.51:0/4087564104 reap_dead start 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff594d64640 1 -- 10.20.193.51:0/4087564104 reap_dead start 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 shutdown_connections 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 >> 10.20.193.51:0/4087564104 conn(0x7ff5900a30c0 msgr2=0x7ff590073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 shutdown_connections 2026-02-17T12:10:33.947 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:33.913+0000 7ff5967ee640 1 -- 10.20.193.51:0/4087564104 wait complete. 2026-02-17T12:10:33.948 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:33.948 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:10:33.948 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.012+0000 7fbcac9bc640 10 monclient: get_monmap_and_config 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.012+0000 7fbcac9bc640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.012+0000 7fbcac9bc640 10 monclient: monmap: 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:34.013750+0000 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:34.013750+0000 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:34.016 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 Processor -- start 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 -- start start 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient: init 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-b con 0x7fbca40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fbca40a0750 0x7fbca409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-c con 0x7fbca40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fbca409e540 0x7fbca413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-a con 0x7fbca409e540 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fbca40a3f90 con 0x7fbca409e540 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbca406e140 con 0x7fbca40a0750 2026-02-17T12:10:34.017 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbca409f910 con 0x7fbca40a3bb0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcac9bc640 10 monclient(hunting): authenticate will time out at 2121.632487s 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43482/0 (socket says 10.20.193.51:43482) 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 learned_addr learned my addr 10.20.193.51:0/88749122 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): get_auth_request con 0x7fbca40a3bb0 auth_method 0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> v2:10.20.193.51:3300/0 conn(0x7fbca409e540 0x7fbca413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): get_auth_request con 0x7fbca409e540 auth_method 0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbca9f30640 1 --2- 10.20.193.51:0/88749122 >> v2:10.20.193.142:3300/0 conn(0x7fbca40a0750 0x7fbca409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.018 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbca9f30640 10 monclient(hunting): get_auth_request con 0x7fbca40a0750 auth_method 0 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbca9f30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbca9f30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbca9f30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient(hunting): handle_auth_done global_id 304103 payload 274 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 >> v2:10.20.193.142:3300/0 conn(0x7fbca40a0750 msgr2=0x7fbca409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> v2:10.20.193.142:3300/0 conn(0x7fbca40a0750 0x7fbca409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 >> v2:10.20.193.51:3300/0 conn(0x7fbca409e540 msgr2=0x7fbca413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> v2:10.20.193.51:3300/0 conn(0x7fbca409e540 0x7fbca413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 monclient: found mon.noname-b 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca409ccd0 con 0x7fbca40a3bb0 2026-02-17T12:10:34.019 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.013+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> v2:10.20.193.51:3300/0 conn(0x7fbca409e540 0x7fbca413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 msgr2=0x7fbca409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbca4069d60 tx=0x7fbc9c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade0081ce6ebeeed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c03c070 con 0x7fbca40a3bb0 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 msgr2=0x7fbca409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 msgr2=0x7fbca409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbca4069d60 tx=0x7fbc9c02ee60 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbca4069d60 tx=0x7fbc9c02ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: dump: 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.024 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: ms_handle_reset current mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 msgr2=0x7fbca409dac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca40a3bb0 0x7fbca409dac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc94003850 0x7fbc94005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): picked mon.b con 0x7fbc94003850 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc940064c0 0x7fbc94008950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): picked mon.a con 0x7fbc940064c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbc9400b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): picked mon.c con 0x7fbc94009230 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.025 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9400bfb0 con 0x7fbc940064c0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9400c160 con 0x7fbc94003850 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9400c360 con 0x7fbc94009230 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): ms_handle_reset hunted mon [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc9c02fca0 con 0x7fbca40a3bb0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca972f640 10 monclient(hunting): discarding stray monitor message config(0 keys) 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbc9400b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): get_auth_request con 0x7fbc94009230 auth_method 0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc940064c0 0x7fbc94008950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): get_auth_request con 0x7fbc940064c0 auth_method 0 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc94003850 0x7fbc94005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 10 monclient(hunting): get_auth_request con 0x7fbc94003850 auth_method 0 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaa731640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient(hunting): handle_auth_done global_id 304103 payload 293 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc94003850 msgr2=0x7fbc94005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbc94003850 0x7fbc94005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc940064c0 msgr2=0x7fbc94008950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbc940064c0 0x7fbc94008950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 monclient: found mon.c 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 1 -- 10.20.193.51:0/88749122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=2+}) -- 0x7fbc9400c620 con 0x7fbc94009230 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcaaf32640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcac9bc640 5 monclient: authenticate success, global_id 304103 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.016+0000 7fbcac9bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbcaaf32640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 msgr2=0x7fbc9400b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbc9400b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800e350 tx=0x7fbc9c009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7802cf8721041704 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98018020 con 0x7fbc94009230 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbca972f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbca972f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbca972f640 10 monclient: dump: 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbca972f640 1 -- 10.20.193.51:0/88749122 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc98014890 con 0x7fbc94009230 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.018+0000 7fbcac9bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:34.028 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbca972f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 4 set_mon_vals no callback set 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 10 monclient: shutdown 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 -- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 msgr2=0x7fbc9400b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/88749122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbc9400b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800e350 tx=0x7fbc9c009340 comp rx=0 tx=0).stop 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcaaf32640 1 -- 10.20.193.51:0/88749122 reap_dead start 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 -- 10.20.193.51:0/88749122 shutdown_connections 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 -- 10.20.193.51:0/88749122 >> 10.20.193.51:0/88749122 conn(0x7fbca40a30c0 msgr2=0x7fbca40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 -- 10.20.193.51:0/88749122 shutdown_connections 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 1 -- 10.20.193.51:0/88749122 wait complete. 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.019+0000 7fbcac9bc640 10 monclient: monmap: 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:34.029 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 Processor -- start 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 -- start start 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient: init 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbca409a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-c con 0x7fbc94009230 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-a con 0x7fbca409ab30 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbca409b490 0x7fbca41d5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): picked mon.noname-b con 0x7fbca409b490 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fbca409c850 con 0x7fbca409ab30 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbca40a04b0 con 0x7fbca409b490 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbca409dac0 con 0x7fbc94009230 2026-02-17T12:10:34.030 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcac9bc640 10 monclient(hunting): authenticate will time out at 2121.639370s 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbca409a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbca409a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43492/0 (socket says 10.20.193.51:43492) 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 1 -- 10.20.193.51:0/2062574429 learned_addr learned my addr 10.20.193.51:0/2062574429 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38222/0 (socket says 10.20.193.51:38222) 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): get_auth_request con 0x7fbc94009230 auth_method 0 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): get_auth_request con 0x7fbca409ab30 auth_method 0 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient(hunting): handle_auth_done global_id 274380 payload 824 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 msgr2=0x7fbca409a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbc94009230 0x7fbca409a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbca409b490 msgr2=0x7fbca41d5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fbca409b490 0x7fbca41d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 monclient: found mon.noname-a 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.032 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.020+0000 7fbca9f30640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca40975b0 con 0x7fbca409ab30 2026-02-17T12:10:34.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbca9f30640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 msgr2=0x7fbca409af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbca9f30640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc900116a0 tx=0x7fbc90011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90019070 con 0x7fbca409ab30 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: dump: 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.036 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9000fb70 con 0x7fbca409ab30 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 5 monclient: authenticate success, global_id 274380 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 10 monclient: _renew_subs 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca409d7b0 con 0x7fbca409ab30 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbca8f2e640 4 set_mon_vals no callback set 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000f040 con 0x7fbca409ab30 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbc8effd640 10 monclient: dump: 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.037 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 10 monclient: _renew_subs 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.022+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca406d580 con 0x7fbca409ab30 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcac9bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 0x7fbca408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbca409ef50 con 0x7fbca408d3f0 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fbc90004020 con 0x7fbca409ab30 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 0x7fbca408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient: get_auth_request con 0x7fbca408d3f0 auth_method 0 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 10 monclient(hunting): handle_auth_done global_id 304109 payload 824 2026-02-17T12:10:34.038 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaa731640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca4096340 con 0x7fbca408d3f0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbc8effd640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc7403dd60 0x7fbc74040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(900..900 src has 323..900) ==== 4811+0+0 (secure 0 0 0) 0x7fbc90052980 con 0x7fbca409ab30 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc7403dd60 0x7fbc74040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.023+0000 7fbcaaf32640 10 monclient: get_auth_request con 0x7fbc7403dd60 auth_method 0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbcaa731640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 msgr2=0x7fbca408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbcaa731640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 0x7fbca408d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009380 tx=0x7fbc9c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c03c070 con 0x7fbca408d3f0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbc8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbc8effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbc8effd640 10 monclient: dump: 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.039 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.025+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fbc9c04b670 con 0x7fbca408d3f0 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 msgr2=0x7fbca408d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 0x7fbca408d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009380 tx=0x7fbc9c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 msgr2=0x7fbca408d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbc8effd640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408d3f0 0x7fbca408d7d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.026+0000 7fbcaaf32640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc7403dd60 0x7fbc74040220 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbca406dd50 tx=0x7fbc98011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.028+0000 7fbcac9bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.028+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 0x7fbca41da010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.028+0000 7fbcac9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.028+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fbca40a3bb0 con 0x7fbca408dd10 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 0x7fbca41da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient: get_auth_request con 0x7fbca408dd10 auth_method 0 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.040 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 10 monclient(hunting): handle_auth_done global_id 304112 payload 824 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.029+0000 7fbcaa731640 1 -- 10.20.193.51:0/2062574429 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbca4096100 con 0x7fbca408dd10 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcaa731640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 msgr2=0x7fbca41da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcaa731640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 0x7fbca41da010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c038000 tx=0x7fbc9c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003910 con 0x7fbca408dd10 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 10 monclient: dump: 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.041 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fbc9c054070 con 0x7fbca408dd10 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 msgr2=0x7fbca41da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 0x7fbca41da010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c038000 tx=0x7fbc9c02ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 msgr2=0x7fbca41da010 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbc8effd640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fbca408dd10 0x7fbca41da010 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c038000 tx=0x7fbc9c02ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:34.042 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 20298, 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.043 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.044 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.045 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.046 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:34.047 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.048 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.049 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:34.050 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc7403dd60 msgr2=0x7fbc74040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fbc7403dd60 0x7fbc74040220 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbca406dd50 tx=0x7fbc98011000 comp rx=0 tx=0).stop 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 10 monclient: shutdown 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 msgr2=0x7fbca409af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc900116a0 tx=0x7fbc90011b70 comp rx=0 tx=0).stop 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcaaf32640 1 -- 10.20.193.51:0/2062574429 reap_dead start 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 shutdown_connections 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 --2- 10.20.193.51:0/2062574429 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fbca409ab30 0x7fbca409af50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 >> 10.20.193.51:0/2062574429 conn(0x7fbca40a30c0 msgr2=0x7fbca4072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 shutdown_connections 2026-02-17T12:10:34.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.031+0000 7fbcac9bc640 1 -- 10.20.193.51:0/2062574429 wait complete. 2026-02-17T12:10:34.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:34.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:10:34.053 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:10:34.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: get_monmap_and_config 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: monmap: 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:34.119993+0000 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:34.119993+0000 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:34.123 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 Processor -- start 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 -- start start 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: init 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-b con 0x7fcd440a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcd440a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcd4413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4406e140 con 0x7fcd4413b760 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4409f910 con 0x7fcd440a0750 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4409ccd0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd4a53e640 10 monclient(hunting): authenticate will time out at 2121.738922s 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43506/0 (socket says 10.20.193.51:43506) 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 1 -- 10.20.193.51:0/2129551709 learned_addr learned my addr 10.20.193.51:0/2129551709 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 10 monclient(hunting): get_auth_request con 0x7fcd440a3bb0 auth_method 0 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.119+0000 7fcd43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient(hunting): handle_auth_done global_id 304115 payload 274 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 1 -- 10.20.193.51:0/2129551709 >> v1:10.20.193.142:6789/0 conn(0x7fcd440a0750 legacy=0x7fcd4409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.125 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 1 -- 10.20.193.51:0/2129551709 >> v1:10.20.193.51:6789/0 conn(0x7fcd4413b760 legacy=0x7fcd4413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 1 monclient: found mon.noname-b 2026-02-17T12:10:34.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.126 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.120+0000 7fcd43fff640 1 -- 10.20.193.51:0/2129551709 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4409eec0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd43fff640 1 -- 10.20.193.51:0/2129551709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 msgr2=0x7fcd4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd43fff640 1 --2- 10.20.193.51:0/2129551709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd44069d60 tx=0x7fcd3002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b4c1b1316034dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.131 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 1 -- 10.20.193.51:0/2129551709 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3003c070 con 0x7fcd440a3bb0 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: dump: 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.132 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 1 -- 10.20.193.51:0/2129551709 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3002fdb0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 5 monclient: authenticate success, global_id 304115 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 4 set_mon_vals no callback set 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 1 -- 10.20.193.51:0/2129551709 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30037660 con 0x7fcd440a3bb0 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd42ffd640 10 monclient: dump: 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.133 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 10 monclient: shutdown 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 1 -- 10.20.193.51:0/2129551709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 msgr2=0x7fcd4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.122+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/2129551709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd44069d60 tx=0x7fcd3002ee90 comp rx=0 tx=0).stop 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 -- 10.20.193.51:0/2129551709 shutdown_connections 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/2129551709 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd440a3bb0 0x7fcd4409dac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 -- 10.20.193.51:0/2129551709 >> 10.20.193.51:0/2129551709 conn(0x7fcd440a30c0 msgr2=0x7fcd440a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 -- 10.20.193.51:0/2129551709 shutdown_connections 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 -- 10.20.193.51:0/2129551709 wait complete. 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.134 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 10 monclient: monmap: 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 Processor -- start 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 1 -- start start 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.123+0000 7fcd4a53e640 10 monclient: init 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:10:34.135 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd440a0750 0x7fcd440951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-b con 0x7fcd440a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 0x7fcd44095700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-a con 0x7fcd440a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 0x7fcd44095c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): picked mon.noname-c con 0x7fcd4413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fcd440a04b0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4409c850 con 0x7fcd440a0750 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4409e710 con 0x7fcd4413b760 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd4a53e640 10 monclient(hunting): authenticate will time out at 2121.743071s 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 0x7fcd44095700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 0x7fcd44095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.136 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 0x7fcd44095700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38230/0 (socket says 10.20.193.51:38230) 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 0x7fcd44095c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:43514/0 (socket says 10.20.193.51:43514) 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 -- 10.20.193.51:0/1356037432 learned_addr learned my addr 10.20.193.51:0/1356037432 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): get_auth_request con 0x7fcd440a3bb0 auth_method 0 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): get_auth_request con 0x7fcd4413b760 auth_method 0 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.137 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient(hunting): handle_auth_done global_id 274383 payload 824 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 msgr2=0x7fcd44095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 0x7fcd44095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd440a0750 0x7fcd440951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd440a0750 msgr2=0x7fcd440951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd440a0750 0x7fcd440951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 monclient: found mon.noname-a 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd437fe640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd44098d60 con 0x7fcd440a3bb0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd48ab4640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fcd4413b760 0x7fcd44095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd43fff640 10 monclient: get_auth_request con 0x7fcd440a0750 auth_method 0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.124+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd440a0750 0x7fcd440951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd437fe640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 msgr2=0x7fcd44095700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd437fe640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 0x7fcd44095700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b750 tx=0x7fcd3400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34002780 con 0x7fcd440a3bb0 2026-02-17T12:10:34.138 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: dump: 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.139 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34010070 con 0x7fcd440a3bb0 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34002b40 con 0x7fcd440a3bb0 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd427fc640 4 set_mon_vals no callback set 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd40ff9640 10 monclient: dump: 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.140 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 5 monclient: authenticate success, global_id 274383 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 10 monclient: _renew_subs 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4409d7b0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 10 monclient: _renew_subs 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.126+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd44098a80 con 0x7fcd440a3bb0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd4a53e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 0x7fcd44091ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44098700 con 0x7fcd44091900 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fcd34002ce0 con 0x7fcd440a3bb0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 0x7fcd44091ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd40ff9640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd1403dd10 0x7fcd140401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient: get_auth_request con 0x7fcd44091900 auth_method 0 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.141 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(900..900 src has 323..900) ==== 4811+0+0 (secure 0 0 0) 0x7fcd34051d50 con 0x7fcd440a3bb0 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd48ab4640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd1403dd10 0x7fcd140401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd48ab4640 10 monclient: get_auth_request con 0x7fcd1403dd10 auth_method 0 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 10 monclient(hunting): handle_auth_done global_id 284212 payload 824 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.127+0000 7fcd43fff640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd4409dac0 con 0x7fcd44091900 2026-02-17T12:10:34.142 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd48ab4640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd1403dd10 0x7fcd140401d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800d5e0 tx=0x7fcd38004200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd43fff640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 msgr2=0x7fcd44091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 0x7fcd44091ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd4409f230 tx=0x7fcd300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30047070 con 0x7fcd44091900 2026-02-17T12:10:34.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.144 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 10 monclient: dump: 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fcd30037d50 con 0x7fcd44091900 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 msgr2=0x7fcd44091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.145 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 0x7fcd44091ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd4409f230 tx=0x7fcd300047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 msgr2=0x7fcd44091ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.130+0000 7fcd40ff9640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44091900 0x7fcd44091ce0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd4409f230 tx=0x7fcd300047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd4a53e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 0x7fcd441d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd4a53e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44098520 con 0x7fcd44092220 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 0x7fcd441d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient: get_auth_request con 0x7fcd44092220 auth_method 0 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.133+0000 7fcd43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.134+0000 7fcd43fff640 10 monclient(hunting): handle_auth_done global_id 284215 payload 824 2026-02-17T12:10:34.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.134+0000 7fcd43fff640 1 -- 10.20.193.51:0/1356037432 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd440a2d20 con 0x7fcd44092220 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd43fff640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 msgr2=0x7fcd441d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd43fff640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 0x7fcd441d98b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd30006d80 tx=0x7fcd30009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3003c040 con 0x7fcd44092220 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 10 monclient: dump: 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fcd30003e20 con 0x7fcd44092220 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 msgr2=0x7fcd441d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 0x7fcd441d98b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd30006d80 tx=0x7fcd30009340 comp rx=0 tx=0).stop 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 msgr2=0x7fcd441d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.136+0000 7fcd40ff9640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fcd44092220 0x7fcd441d98b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:10:34.148 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 136366, 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.149 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.150 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:34.151 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:34.152 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.153 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.154 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:34.155 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:34.156 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:10:34.157 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:34.158 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd1403dd10 msgr2=0x7fcd140401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fcd1403dd10 0x7fcd140401d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800d5e0 tx=0x7fcd38004200 comp rx=0 tx=0).stop 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 10 monclient: shutdown 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 msgr2=0x7fcd44095700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 --2- 10.20.193.51:0/1356037432 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fcd440a3bb0 0x7fcd44095700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b750 tx=0x7fcd3400bc20 comp rx=0 tx=0).stop 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd48ab4640 1 -- 10.20.193.51:0/1356037432 reap_dead start 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd48ab4640 1 -- 10.20.193.51:0/1356037432 reap_dead start 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 shutdown_connections 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 >> 10.20.193.51:0/1356037432 conn(0x7fcd440a30c0 msgr2=0x7fcd4413ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 shutdown_connections 2026-02-17T12:10:34.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.137+0000 7fcd4a53e640 1 -- 10.20.193.51:0/1356037432 wait complete. 2026-02-17T12:10:34.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:34.160 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:10:34.160 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:10:34.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 10 monclient: get_monmap_and_config 2026-02-17T12:10:34.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 10 monclient: monmap: 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:34.226406+0000 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:34.226406+0000 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 1 Processor -- start 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 1 -- start start 2026-02-17T12:10:34.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.225+0000 7f8fe93d3640 10 monclient: init 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-b con 0x7f8fe40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8fe409dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 0x7f8fe413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-c con 0x7f8fe40a0110 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe406e140 con 0x7f8fe409dac0 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe409aed0 con 0x7f8fe40a0110 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe409caa0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe93d3640 10 monclient(hunting): authenticate will time out at 2121.845267s 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe27fc640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f8fe409dac0 0x7f8fe409fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:54856/0 (socket says 10.20.193.51:54856) 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe27fc640 1 -- 10.20.193.51:0/1415974226 learned_addr learned my addr 10.20.193.51:0/1415974226 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): get_auth_request con 0x7f8fe40a3bb0 auth_method 0 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_done global_id 304121 payload 274 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 -- 10.20.193.51:0/1415974226 >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 msgr2=0x7f8fe413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe37fe640 1 --2- 10.20.193.51:0/1415974226 >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 0x7f8fe413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 --2- 10.20.193.51:0/1415974226 >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 0x7f8fe413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 -- 10.20.193.51:0/1415974226 >> v1:10.20.193.51:6789/0 conn(0x7f8fe409dac0 legacy=0x7f8fe409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 monclient: found mon.noname-b 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe2ffd640 1 -- 10.20.193.51:0/1415974226 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe409ce60 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe37fe640 10 monclient: get_auth_request con 0x7f8fe40a0110 auth_method 0 2026-02-17T12:10:34.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.226+0000 7f8fe37fe640 1 --2- 10.20.193.51:0/1415974226 >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 0x7f8fe413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:34.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe2ffd640 1 -- 10.20.193.51:0/1415974226 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 msgr2=0x7f8fe409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe2ffd640 1 --2- 10.20.193.51:0/1415974226 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe409f4c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8fe406dc20 tx=0x7f8fd802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c2dfdebae937f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 1 -- 10.20.193.51:0/1415974226 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd803c070 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: dump: 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 1 -- 10.20.193.51:0/1415974226 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd802fd40 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 5 monclient: authenticate success, global_id 304121 2026-02-17T12:10:34.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 1 -- 10.20.193.51:0/1415974226 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8037660 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 4 set_mon_vals no callback set 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe1ffb640 10 monclient: dump: 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 10 monclient: shutdown 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 -- 10.20.193.51:0/1415974226 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 msgr2=0x7f8fe409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/1415974226 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe409f4c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8fe406dc20 tx=0x7f8fd802ede0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 -- 10.20.193.51:0/1415974226 shutdown_connections 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/1415974226 >> v2:10.20.193.142:3300/0 conn(0x7f8fe40a0110 0x7f8fe413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/1415974226 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe409f4c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 -- 10.20.193.51:0/1415974226 >> 10.20.193.51:0/1415974226 conn(0x7f8fe40a30c0 msgr2=0x7f8fe40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 -- 10.20.193.51:0/1415974226 shutdown_connections 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 1 -- 10.20.193.51:0/1415974226 wait complete. 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 10 monclient: build_initial_monmap 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.229+0000 7f8fe93d3640 10 monclient: monmap: 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 Processor -- start 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 -- start start 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient: init 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-a con 0x7f8fe409dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8fe40a0110 0x7f8fe413b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-b con 0x7f8fe40a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe413b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): picked mon.noname-c con 0x7f8fe40a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe409a880 con 0x7f8fe409dac0 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe40a0520 con 0x7f8fe40a0110 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe413cca0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe93d3640 10 monclient(hunting): authenticate will time out at 2121.849435s 2026-02-17T12:10:34.240 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe413b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38236/0 (socket says 10.20.193.51:38236) 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 1 -- 10.20.193.51:0/4176714514 learned_addr learned my addr 10.20.193.51:0/4176714514 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): get_auth_request con 0x7f8fe409dac0 auth_method 0 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): get_auth_request con 0x7f8fe40a3bb0 auth_method 0 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient(hunting): handle_auth_done global_id 304124 payload 824 2026-02-17T12:10:34.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 -- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8fe40a0110 msgr2=0x7f8fe413b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8fe40a0110 0x7f8fe413b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 -- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 msgr2=0x7f8fe4136360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 monclient: found mon.noname-c 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe37fe640 1 -- 10.20.193.51:0/4176714514 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe409d7b0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.230+0000 7f8fe2ffd640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe37fe640 1 -- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 msgr2=0x7f8fe413b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe37fe640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe413b8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400cdd0 tx=0x7f8fd400a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd401a070 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: dump: 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.242 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: _finish_auth 0 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: _check_auth_tickets 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd400da90 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400ae30 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fc37fe640 10 monclient: dump: 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:34.243 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe17fa640 4 set_mon_vals no callback set 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 5 monclient: authenticate success, global_id 304124 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 10 monclient: _renew_subs 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe412d6b0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 10 monclient: _renew_subs 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.232+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe412dc70 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fe93d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fe93d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fe93d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe413d0b0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f8fd4015440 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fc37fe640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 0x7f8fb00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.233+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(900..900 src has 323..900) ==== 4811+0+0 (secure 0 0 0) 0x7f8fd4052fa0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.234+0000 7f8fe2ffd640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 0x7f8fb00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.234+0000 7f8fe2ffd640 10 monclient: get_auth_request con 0x7f8fb003dd10 auth_method 0 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.236+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8fd4013c60 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.236+0000 7f8fc37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.236+0000 7f8fc37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:34.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.236+0000 7f8fe2ffd640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 0x7f8fb00401d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009660 tx=0x7f8fd8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:34.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.352+0000 7f8fe93d3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:10:34.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.352+0000 7f8fe93d3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:10:34.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.352+0000 7f8fe93d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:34.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.352+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8fe40008d0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.353+0000 7f8fc37fe640 1 -- 10.20.193.51:0/4176714514 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f8fd40143a0 con 0x7f8fe40a3bb0 2026-02-17T12:10:34.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.353+0000 7f8fc37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:10:34.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.353+0000 7f8fc37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:34.356 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.356 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=3437220553,config=692619927,health=3405722006,kv=2474110515,logm=3601035325}) 2026-02-17T12:10:34.356 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=2726275487,config=692619927,health=1084904687,kv=643764953,logm=1495883782}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=3437220553,config=692619927,health=3405722006,kv=2474110515,logm=3601035325}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=26,config=2,health=12,kv=11,logm=49} crc {auth=3113061892,config=692619927,health=1084904687,kv=2841418214,logm=401933779}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057736112}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1976341106}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057736112}) 2026-02-17T12:10:34.357 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.353+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2322420371}) 2026-02-17T12:10:34.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 msgr2=0x7f8fb00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 0x7f8fb00401d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009660 tx=0x7f8fd8033000 comp rx=0 tx=0).stop 2026-02-17T12:10:34.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 10 monclient: shutdown 2026-02-17T12:10:34.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 msgr2=0x7f8fe413b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe413b8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400cdd0 tx=0x7f8fd400a710 comp rx=0 tx=0).stop 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 shutdown_connections 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f8fb003dd10 0x7f8fb00401d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f8fe40a3bb0 0x7f8fe413b8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8fe40a0110 0x7f8fe413b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 --2- 10.20.193.51:0/4176714514 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8fe409dac0 0x7f8fe4136360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 >> 10.20.193.51:0/4176714514 conn(0x7f8fe40a30c0 msgr2=0x7f8fe4073920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 shutdown_connections 2026-02-17T12:10:34.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:34.354+0000 7f8fe93d3640 1 -- 10.20.193.51:0/4176714514 wait complete. 2026-02-17T12:10:34.366 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1998842541}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1807934128}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1998842541}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.354+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1149045963}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517573232}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4066349824}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517573232}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.355+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3177110427}) 2026-02-17T12:10:34.367 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=850074154}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1244179727}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=850074154}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1230141286}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=988428287}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2343483986}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=988428287}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2319309489}) 2026-02-17T12:10:34.368 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762735658}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2250547004}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762735658}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.356+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=426341062}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678541241}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3817308567}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678541241}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1402406120}) 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.369 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2352562456}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3879443646}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2352562456}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.357+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=146236173}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2531256349}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2068607223}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2531256349}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2625386206}) 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.370 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664454267}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3044746785}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664454267}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1403508892}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3143924231}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3347614219}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3143924231}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3302390743}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2996511690}) 2026-02-17T12:10:34.371 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3337100032}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2996511690}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.358+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=574367118}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3803503956}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3304708468}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3803503956}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1589587167}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148836905}) 2026-02-17T12:10:34.372 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2691187711}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148836905}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2236954495}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=44318163}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1658028808}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=44318163}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.359+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3849280383}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904896667}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2255490072}) 2026-02-17T12:10:34.373 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904896667}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3649800423}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817962517}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=154114105}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817962517}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2493076149}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3159926109}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2661989453}) 2026-02-17T12:10:34.374 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3159926109}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.360+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=407724459}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2161398966}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1101966456}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2161398966}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3143707008}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2993507792}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3494755500}) 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.375 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2993507792}) 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3732693621}) 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844473056}) 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1709559277}) 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844473056}) 2026-02-17T12:10:34.376 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.361+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=72937049}) 2026-02-17T12:10:34.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179433870}) 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=182512099}) 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179433870}) 2026-02-17T12:10:34.401 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3051069275}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541858143}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3448063425}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541858143}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2469018036}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1595153099}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1906569485}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1595153099}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.362+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2886518136}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=528560393}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=827498380}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=528560393}) 2026-02-17T12:10:34.402 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4081380439}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000129871}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=796889643}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000129871}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=854033143}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3226406892}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3908723039}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3226406892}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.363+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3486105897}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=827952560}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4092057922}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=827952560}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2829770516}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=346121234}) 2026-02-17T12:10:34.403 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=655146382}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=346121234}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=606568853}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1797344932}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3274673523}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1797344932}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.364+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=49165174}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2410816666}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2232449823}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2410816666}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=632399973}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=310194958}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1477344200}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=310194958}) 2026-02-17T12:10:34.404 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1613267235}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291730566}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=974781118}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291730566}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1388196900}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997302213}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3653297843}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997302213}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.365+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2086536812}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3300933092}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4033586176}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3300933092}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3021749701}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1827014180}) 2026-02-17T12:10:34.405 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=717927255}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1827014180}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1356213587}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=392007716}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=840004502}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=392007716}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.366+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3446627291}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4190230222}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1929039948}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4190230222}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2776375893}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=365194878}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3018293057}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=365194878}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1633860269}) 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.406 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287397156}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1653033630}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287397156}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.367+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3436590881}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035555609}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1398010635}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035555609}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=102279390}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232685790}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3932735240}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232685790}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2157475768}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3725685414}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1822025582}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3725685414}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1700294384}) 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.407 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635929621}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2802456452}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635929621}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.368+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2334982175}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396760396}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2889971599}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396760396}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=607548683}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145106509}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=120658534}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145106509}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2869136562}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1330503537}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=181085718}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1330503537}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.369+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1232225932}) 2026-02-17T12:10:34.408 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1127640685}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2331574982}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1127640685}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1849471031}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361731259}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1978704864}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361731259}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=346982154}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1656946119}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=513971416}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1656946119}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.370+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3815244050}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411078249}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=117158468}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411078249}) 2026-02-17T12:10:34.409 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3375659798}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1416074285}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=516971013}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1416074285}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3983228332}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=157060808}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1815763381}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=157060808}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4271943002}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939776470}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=792100177}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939776470}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.371+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3270929984}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=743797568}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4179992180}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=743797568}) 2026-02-17T12:10:34.410 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2830792870}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382805493}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1907591988}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382805493}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3727779716}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6816175}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1042126517}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6816175}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.372+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=288901980}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742238044}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=427171602}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742238044}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560571081}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=134140505}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3025683238}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=134140505}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3508736259}) 2026-02-17T12:10:34.411 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918409519}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3128518420}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918409519}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.373+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1933169943}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1263896903}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4262699526}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1263896903}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2675985428}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3260011157}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=353314405}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3260011157}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3109838662}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826311417}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2434350856}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826311417}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272202606}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761403216}) 2026-02-17T12:10:34.412 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2254769354}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761403216}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.374+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4067675486}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2935452170}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268713960}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2935452170}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3462381810}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1873708243}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=405381533}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1873708243}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2927145538}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2530996701}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1858566271}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2530996701}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.375+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4267881561}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071888990}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=667028715}) 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.413 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071888990}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4160862456}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=599416693}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1085426629}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=599416693}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=471822594}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2197044181}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=495186348}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2197044181}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.376+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=773775667}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2581504932}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=301904715}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2581504932}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805388769}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999134784}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1838924810}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999134784}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=651770189}) 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.414 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564550431}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2470298939}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564550431}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3553401335}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305653252}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2817983759}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305653252}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.377+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2553555907}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=268009948}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=430215474}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=268009948}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3512331002}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123975627}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1095321255}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123975627}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=426772013}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=35746209}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=258979957}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=35746209}) 2026-02-17T12:10:34.415 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.378+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=584534032}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253056581}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1885871068}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253056581}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2487453054}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1052947305}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=976316347}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1052947305}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3552477473}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1328797857}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1632269083}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1328797857}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3032263890}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3727664848}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=368622550}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.379+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3727664848}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1175153698}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3067934849}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1972233486}) 2026-02-17T12:10:34.416 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3067934849}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4031738879}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241312136}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1476851063}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1241312136}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=710813145}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801674400}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2252157561}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2801674400}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.380+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=429500238}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=510249101}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=64297775}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=510249101}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=245144235}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3374949651}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3907200922}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3374949651}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1730598100}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=391300041}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1778619416}) 2026-02-17T12:10:34.417 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=391300041}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.381+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2320022794}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3284272414}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3867410222}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3284272414}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2609257522}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3550539312}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3996288896}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3550539312}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.388+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1817165584}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4093743996}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1900538930}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4093743996}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2540624212}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3731019092}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4132198568}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3731019092}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2525521673}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210175730}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2462876174}) 2026-02-17T12:10:34.418 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.389+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210175730}) 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=97457539}) 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1330050665}) 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3580894578}) 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1330050665}) 2026-02-17T12:10:34.419 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.390+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1452841660}) 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4121543921}) 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4279933022}) 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4121543921}) 2026-02-17T12:10:34.671 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3020929016}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632056527}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3373909991}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632056527}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=695188693}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5429836}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2359468663}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5429836}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2255045817}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1755962699}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3135840390}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1755962699}) 2026-02-17T12:10:34.672 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3447150735}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1178487194}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1285507360}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1178487194}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1135812660}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=181599658}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1236065634}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=181599658}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2803508119}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=916549968}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1192942891}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=916549968}) 2026-02-17T12:10:34.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2977422405}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=623046185}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2641653317}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=623046185}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3462629836}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2092648156}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=572399876}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2092648156}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3837694725}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=920846747}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2669894003}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=920846747}) 2026-02-17T12:10:34.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2323257303}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282764243}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3573963358}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282764243}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1972062927}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155524905}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=743476202}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155524905}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2555388965}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730974120}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1957429103}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730974120}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2313210457}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2816782986}) 2026-02-17T12:10:34.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1406602148}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2816782986}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.673+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4267842987}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=45,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=9} crc {logm=2162980541,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1127339842,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1540486198,osd_snap=4225141372}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=45,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=12,monmap=3,osd_metadata=6,osd_snap=11} crc {logm=3786040485,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=3305035467,mon_config_key=829000412,monmap=263989209,osd_metadata=3956758304,osd_snap=2493294070}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=45,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=9} crc {logm=2162980541,mdsmap=3207544932,mgr=899712112,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1127339842,mon_config_key=3390328712,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=1540486198,osd_snap=4225141372}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=42,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=14} crc {logm=2261995504,mdsmap=3207544932,mgr=1868332333,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1127339842,mon_config_key=4138928500,monmap=1614227248,osd_metadata=3956758304,osd_pg_creating=1540486198,osd_snap=578783007}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=2922921582}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=2581204703}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=2922921582}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=3494128172}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.674+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=43,osdmap=57} crc {osd_snap=2761103881,osdmap=2563065811}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=40,osdmap=60} crc {osd_snap=500175675,osdmap=1150082441}) 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.676 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=43,osdmap=57} crc {osd_snap=2761103881,osdmap=2563065811}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=42,osdmap=58} crc {osd_snap=2498181468,osdmap=468354742}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=904417653}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3825710774}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=904417653}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2805580229}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2197083110}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1384706532}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2197083110}) 2026-02-17T12:10:34.677 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.675+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2634250610}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4007204723}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2445103522}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4007204723}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2413484624}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3532904836}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=701399273}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3532904836}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=797964465}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1716452229}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=889076026}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1716452229}) 2026-02-17T12:10:34.678 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.676+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=455024296}) 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2600585508}) 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=694501204}) 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2600585508}) 2026-02-17T12:10:34.679 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.677+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=950731384}) 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4280173792}) 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1380640675}) 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4280173792}) 2026-02-17T12:10:34.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.678+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2853817892}) 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=684225815}) 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=81} crc {osdmap=411739220}) 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=684225815}) 2026-02-17T12:10:34.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:10:34.681+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=83} crc {osdmap=928437019}) 2026-02-17T12:10:34.693 INFO:tasks.rados.rados.0.trial142.stdout:3845: done (11 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3849: done (10 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3851: done (9 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3852: done (8 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3854: done (7 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3855: done (6 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3856: done (5 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3857: done (4 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3858: done (3 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3859: done (2 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3860: done (1 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3861: done (0 left) 2026-02-17T12:10:34.694 INFO:tasks.rados.rados.0.trial142.stdout:3862: snap_create 2026-02-17T12:10:35.378 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:10:35.378 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:35.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: get_monmap_and_config 2026-02-17T12:10:35.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.459 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: monmap: 2026-02-17T12:10:35.459 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:35.448013+0000 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:35.448013+0000 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:35.460 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 Processor -- start 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 -- start start 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: init 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-b con 0x7f7f200a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.461 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7f200a0750 0x7f7f2009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-c con 0x7f7f200a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 0x7f7f2013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-a con 0x7f7f2009e540 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7f200a3f90 con 0x7f7f2009e540 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2006e140 con 0x7f7f200a0750 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2009f910 con 0x7f7f200a3bb0 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.462 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f283a1640 10 monclient(hunting): authenticate will time out at 2123.066781s 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36676/0 (socket says 10.20.193.51:36676) 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 1 -- 10.20.193.51:0/1196760236 learned_addr learned my addr 10.20.193.51:0/1196760236 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): get_auth_request con 0x7f7f200a3bb0 auth_method 0 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 0x7f7f2013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.463 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): get_auth_request con 0x7f7f2009e540 auth_method 0 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26116640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.447+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f25915640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.142:3300/0 conn(0x7f7f200a0750 0x7f7f2009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f25915640 10 monclient(hunting): get_auth_request con 0x7f7f200a0750 auth_method 0 2026-02-17T12:10:35.464 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f25915640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f25915640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f25915640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 10 monclient(hunting): handle_auth_done global_id 304127 payload 274 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 -- 10.20.193.51:0/1196760236 >> v2:10.20.193.142:3300/0 conn(0x7f7f200a0750 msgr2=0x7f7f2009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.142:3300/0 conn(0x7f7f200a0750 0x7f7f2009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 -- 10.20.193.51:0/1196760236 >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 msgr2=0x7f7f2013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 0x7f7f2013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 monclient: found mon.noname-b 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.465 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26116640 1 -- 10.20.193.51:0/1196760236 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2009ccd0 con 0x7f7f200a3bb0 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.448+0000 7f7f26917640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 0x7f7f2013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f26116640 1 -- 10.20.193.51:0/1196760236 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 msgr2=0x7f7f2009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f26116640 1 --2- 10.20.193.51:0/1196760236 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f20069d60 tx=0x7f7f1002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcbec2c52cd22c63 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 1 -- 10.20.193.51:0/1196760236 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1003c070 con 0x7f7f200a3bb0 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: dump: 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.466 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 1 -- 10.20.193.51:0/1196760236 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1002fca0 con 0x7f7f200a3bb0 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.467 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f283a1640 5 monclient: authenticate success, global_id 304127 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 1 -- 10.20.193.51:0/1196760236 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10037660 con 0x7f7f200a3bb0 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f283a1640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f283a1640 4 set_mon_vals no callback set 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.450+0000 7f7f25114640 10 monclient: dump: 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.468 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 10 monclient: shutdown 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 -- 10.20.193.51:0/1196760236 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 msgr2=0x7f7f2009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 --2- 10.20.193.51:0/1196760236 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f20069d60 tx=0x7f7f1002ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 -- 10.20.193.51:0/1196760236 shutdown_connections 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.51:3300/0 conn(0x7f7f2009e540 0x7f7f2013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 --2- 10.20.193.51:0/1196760236 >> v2:10.20.193.142:3300/0 conn(0x7f7f200a0750 0x7f7f2009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 --2- 10.20.193.51:0/1196760236 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a3bb0 0x7f7f2009dac0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.469 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 -- 10.20.193.51:0/1196760236 >> 10.20.193.51:0/1196760236 conn(0x7f7f200a30c0 msgr2=0x7f7f200a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 -- 10.20.193.51:0/1196760236 shutdown_connections 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 -- 10.20.193.51:0/1196760236 wait complete. 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 10 monclient: monmap: 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:35.470 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.451+0000 7f7f283a1640 1 Processor -- start 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 -- start start 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient: init 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 0x7f7f2008d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-b con 0x7f7f2009e540 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-c con 0x7f7f200a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 0x7f7f201cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.471 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): picked mon.noname-a con 0x7f7f200a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200a04b0 con 0x7f7f200a3bb0 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2009c850 con 0x7f7f2009e540 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2013cca0 con 0x7f7f200a0750 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f283a1640 10 monclient(hunting): authenticate will time out at 2123.071378s 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 0x7f7f201cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36686/0 (socket says 10.20.193.51:36686) 2026-02-17T12:10:35.472 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 -- 10.20.193.51:0/2532639290 learned_addr learned my addr 10.20.193.51:0/2532639290 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): get_auth_request con 0x7f7f200a0750 auth_method 0 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): get_auth_request con 0x7f7f200a3bb0 auth_method 0 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.473 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient(hunting): handle_auth_done global_id 304130 payload 824 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 -- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 msgr2=0x7f7f2008d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26116640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 0x7f7f2008d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 0x7f7f2008d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 -- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 msgr2=0x7f7f201cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 0x7f7f201cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 monclient: found mon.noname-c 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.474 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f25915640 1 -- 10.20.193.51:0/2532639290 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2009d7b0 con 0x7f7f200a0750 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26116640 10 monclient: get_auth_request con 0x7f7f2009e540 auth_method 0 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26917640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 0x7f7f201cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.452+0000 7f7f26116640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 0x7f7f2008d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f25915640 1 -- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 msgr2=0x7f7f2008dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f25915640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e7a0 tx=0x7f7f1400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14017020 con 0x7f7f200a0750 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: dump: 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.475 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f14004440 con 0x7f7f200a0750 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 5 monclient: authenticate success, global_id 304130 2026-02-17T12:10:35.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 10 monclient: _renew_subs 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f200a2e70 con 0x7f7f200a0750 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400f040 con 0x7f7f200a0750 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f24913640 4 set_mon_vals no callback set 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f06ffd640 10 monclient: dump: 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.477 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 10 monclient: _renew_subs 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.454+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f20090170 con 0x7f7f200a0750 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f283a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f283a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.478 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f283a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2009dac0 con 0x7f7f200a0750 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7f14012050 con 0x7f7f200a0750 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f06ffd640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 0x7f7ef0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(901..901 src has 323..901) ==== 4783+0+0 (secure 0 0 0) 0x7f7f14052460 con 0x7f7f200a0750 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f26116640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 0x7f7ef0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.479 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.455+0000 7f7f26116640 10 monclient: get_auth_request con 0x7f7ef003dd60 auth_method 0 2026-02-17T12:10:35.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.457+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f14021020 con 0x7f7f200a0750 2026-02-17T12:10:35.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.457+0000 7f7f06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.457+0000 7f7f06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:35.480 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.458+0000 7f7f26116640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 0x7f7ef0040220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7f2009fa90 tx=0x7f7f10033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f283a1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f283a1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f283a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f20090510 con 0x7f7f200a0750 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f06ffd640 1 -- 10.20.193.51:0/2532639290 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f7f14012370 con 0x7f7f200a0750 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:35.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.577+0000 7f7f06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:35.581 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 msgr2=0x7f7ef0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 0x7f7ef0040220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7f2009fa90 tx=0x7f7f10033000 comp rx=0 tx=0).stop 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 10 monclient: shutdown 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 msgr2=0x7f7f2008dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e7a0 tx=0x7f7f1400ec70 comp rx=0 tx=0).stop 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 shutdown_connections 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7ef003dd60 0x7f7ef0040220 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7f200a3bb0 0x7f7f201cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7f200a0750 0x7f7f2008dde0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 --2- 10.20.193.51:0/2532639290 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7f2009e540 0x7f7f2008d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 >> 10.20.193.51:0/2532639290 conn(0x7f7f200a30c0 msgr2=0x7f7f20072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 shutdown_connections 2026-02-17T12:10:35.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.578+0000 7f7f283a1640 1 -- 10.20.193.51:0/2532639290 wait complete. 2026-02-17T12:10:35.588 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:10:35.588 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:10:35.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:10:35.588 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.655+0000 7fd39012c640 10 monclient: get_monmap_and_config 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.655+0000 7fd39012c640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.655+0000 7fd39012c640 10 monclient: monmap: 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.660 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:35.656589+0000 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:35.656589+0000 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 Processor -- start 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 -- start start 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient: init 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd3880a3bb0 0x7fd38809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-c con 0x7fd3880a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3880a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 0x7fd38813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-a con 0x7fd38813b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38806e140 con 0x7fd3880a0750 2026-02-17T12:10:35.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd38809f910 con 0x7fd38813b760 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd38809ccd0 con 0x7fd3880a3bb0 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd39012c640 10 monclient(hunting): authenticate will time out at 2123.275365s 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 0x7fd38813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 0x7fd38813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35520/0 (socket says 10.20.193.51:35520) 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 1 -- 10.20.193.51:0/3150660347 learned_addr learned my addr 10.20.193.51:0/3150660347 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38d6a0640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd3880a0750 0x7fd38809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34562/0 (socket says 10.20.193.51:34562) 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 10 monclient(hunting): get_auth_request con 0x7fd38813b760 auth_method 0 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38e6a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 --2- 10.20.193.51:0/3150660347 >> v2:10.20.193.142:3300/0 conn(0x7fd3880a3bb0 0x7fd38809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): get_auth_request con 0x7fd3880a3bb0 auth_method 0 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient(hunting): handle_auth_done global_id 284221 payload 274 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 -- 10.20.193.51:0/3150660347 >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 msgr2=0x7fd38813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 --2- 10.20.193.51:0/3150660347 >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 0x7fd38813db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 -- 10.20.193.51:0/3150660347 >> v1:10.20.193.51:6789/0 conn(0x7fd3880a0750 legacy=0x7fd38809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 monclient: found mon.noname-c 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:10:35.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.656+0000 7fd38dea1640 1 -- 10.20.193.51:0/3150660347 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38809eec0 con 0x7fd3880a3bb0 2026-02-17T12:10:35.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38dea1640 1 -- 10.20.193.51:0/3150660347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a3bb0 msgr2=0x7fd38809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38dea1640 1 --2- 10.20.193.51:0/3150660347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a3bb0 0x7fd38809dac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd38806c1c0 tx=0x7fd37802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4896c00f1fdc8264 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 1 -- 10.20.193.51:0/3150660347 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37803c070 con 0x7fd3880a3bb0 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: dump: 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.676 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 5 monclient: authenticate success, global_id 284221 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 1 -- 10.20.193.51:0/3150660347 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37802fbd0 con 0x7fd3880a3bb0 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 1 -- 10.20.193.51:0/3150660347 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378037440 con 0x7fd3880a3bb0 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 4 set_mon_vals no callback set 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd38ce9f640 10 monclient: dump: 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.678 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 10 monclient: shutdown 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 -- 10.20.193.51:0/3150660347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a3bb0 msgr2=0x7fd38809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 --2- 10.20.193.51:0/3150660347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a3bb0 0x7fd38809dac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd38806c1c0 tx=0x7fd37802ed50 comp rx=0 tx=0).stop 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 -- 10.20.193.51:0/3150660347 shutdown_connections 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 --2- 10.20.193.51:0/3150660347 >> v2:10.20.193.51:3300/0 conn(0x7fd38813b760 0x7fd38813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 --2- 10.20.193.51:0/3150660347 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a3bb0 0x7fd38809dac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.659+0000 7fd39012c640 1 -- 10.20.193.51:0/3150660347 >> 10.20.193.51:0/3150660347 conn(0x7fd3880a30c0 msgr2=0x7fd3880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.679 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- 10.20.193.51:0/3150660347 shutdown_connections 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- 10.20.193.51:0/3150660347 wait complete. 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient: monmap: 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:35.680 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 Processor -- start 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- start start 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient: init 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a0750 0x7fd388094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-b con 0x7fd3880a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3880a3bb0 0x7fd388095390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-c con 0x7fd3880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 0x7fd3880958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.681 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): picked mon.noname-a con 0x7fd38813b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880a04b0 con 0x7fd38813b760 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd38809c850 con 0x7fd3880a0750 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd38809e710 con 0x7fd3880a3bb0 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.660+0000 7fd39012c640 10 monclient(hunting): authenticate will time out at 2123.279992s 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 0x7fd3880958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 0x7fd3880958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35528/0 (socket says 10.20.193.51:35528) 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 learned_addr learned my addr 10.20.193.51:0/238026116 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.682 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3880a3bb0 0x7fd388095390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): get_auth_request con 0x7fd38813b760 auth_method 0 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): get_auth_request con 0x7fd3880a3bb0 auth_method 0 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.683 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38d6a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient(hunting): handle_auth_done global_id 274398 payload 824 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a0750 0x7fd388094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3880a3bb0 msgr2=0x7fd388095390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd3880a3bb0 0x7fd388095390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a0750 msgr2=0x7fd388094e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a0750 0x7fd388094e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 monclient: found mon.noname-a 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.684 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3880a2650 con 0x7fd38813b760 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38dea1640 10 monclient: get_auth_request con 0x7fd3880a0750 auth_method 0 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.661+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd3880a0750 0x7fd388094e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 msgr2=0x7fd3880958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd38e6a2640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 0x7fd3880958d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd384007a70 tx=0x7fd384007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38400dcc0 con 0x7fd38813b760 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: dump: 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.685 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd384003a90 con 0x7fd38813b760 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 5 monclient: authenticate success, global_id 274398 2026-02-17T12:10:35.686 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 monclient: _renew_subs 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38809d7b0 con 0x7fd38813b760 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384004020 con 0x7fd38813b760 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd377fff640 4 set_mon_vals no callback set 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd3767fc640 10 monclient: dump: 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.687 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 monclient: _renew_subs 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd388096930 con 0x7fd38813b760 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 0x7fd3880988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.663+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd38809dac0 con 0x7fd388095e10 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 0x7fd3880988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient: get_auth_request con 0x7fd388095e10 auth_method 0 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd3840041c0 con 0x7fd38813b760 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 10 monclient(hunting): handle_auth_done global_id 274401 payload 824 2026-02-17T12:10:35.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38dea1640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3880961f0 con 0x7fd388095e10 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd3767fc640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd35803dd40 0x7fd358040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(901..901 src has 323..901) ==== 4783+0+0 (secure 0 0 0) 0x7fd384052630 con 0x7fd38813b760 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38d6a0640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd35803dd40 0x7fd358040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.664+0000 7fd38d6a0640 10 monclient: get_auth_request con 0x7fd35803dd40 auth_method 0 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd38dea1640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 msgr2=0x7fd3880988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 0x7fd3880988a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd378039000 tx=0x7fd3780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37803c040 con 0x7fd388095e10 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 10 monclient: dump: 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.690 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd378041660 con 0x7fd388095e10 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 msgr2=0x7fd3880988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.691 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 0x7fd3880988a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd378039000 tx=0x7fd3780047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 msgr2=0x7fd3880988a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.666+0000 7fd3767fc640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd388095e10 0x7fd3880988a0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd378039000 tx=0x7fd3780047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.667+0000 7fd38d6a0640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd35803dd40 0x7fd358040200 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd37c007fd0 tx=0x7fd37c007f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd39012c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd39012c640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 0x7fd3881d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd39012c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880008d0 con 0x7fd38808d3f0 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 0x7fd3881d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient: get_auth_request con 0x7fd38808d3f0 auth_method 0 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.669+0000 7fd38dea1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.670+0000 7fd38dea1640 10 monclient(hunting): handle_auth_done global_id 274404 payload 824 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.670+0000 7fd38dea1640 1 -- 10.20.193.51:0/238026116 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd388050ac0 con 0x7fd38808d3f0 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd38dea1640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 msgr2=0x7fd3881d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd38dea1640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 0x7fd3881d98b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd37802ed90 tx=0x7fd378008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37803c050 con 0x7fd38808d3f0 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 10 monclient: dump: 2026-02-17T12:10:35.693 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4711 (secure 0 0 0) 0x7fd378041e30 con 0x7fd38808d3f0 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 msgr2=0x7fd3881d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 0x7fd3881d98b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd37802ed90 tx=0x7fd378008030 comp rx=0 tx=0).stop 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 msgr2=0x7fd3881d98b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd3767fc640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38808d3f0 0x7fd3881d98b0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd37802ed90 tx=0x7fd378008030 comp rx=0 tx=0).stop 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:35.695 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 207029, 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.696 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.697 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:35.698 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.699 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:35.700 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.701 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.702 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.703 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:35.704 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.705 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.706 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:35.706 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:3862: done (0 left) 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:3863: copy_from oid 4 from oid 36 current snap is 435 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:3864: snap_create 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:3863: finishing copy_from racing read to trial14245205-4 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:3863: finishing copy_from to trial14245205-4 2026-02-17T12:10:35.707 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 4 v 3109 (ObjNum 1302 snap 433 seq_num 1302) dirty exists 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd35803dd40 msgr2=0x7fd358040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd35803dd40 0x7fd358040200 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd37c007fd0 tx=0x7fd37c007f60 comp rx=0 tx=0).stop 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 10 monclient: shutdown 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 msgr2=0x7fd3880958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 --2- 10.20.193.51:0/238026116 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd38813b760 0x7fd3880958d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd384007a70 tx=0x7fd384007f40 comp rx=0 tx=0).stop 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 reap_dead start 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd38e6a2640 1 -- 10.20.193.51:0/238026116 reap_dead start 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 shutdown_connections 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 >> 10.20.193.51:0/238026116 conn(0x7fd3880a30c0 msgr2=0x7fd38813a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 shutdown_connections 2026-02-17T12:10:35.708 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.672+0000 7fd39012c640 1 -- 10.20.193.51:0/238026116 wait complete. 2026-02-17T12:10:35.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:35.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:10:35.709 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:10:35.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.774+0000 7fab6e6bf640 10 monclient: get_monmap_and_config 2026-02-17T12:10:35.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.774+0000 7fab6e6bf640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient: monmap: 2026-02-17T12:10:35.776 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.776 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:35.775970+0000 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:35.775970+0000 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:35.777 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 Processor -- start 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 -- start start 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient: init 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fab680a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-b con 0x7fab680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fab6813b760 0x7fab6813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-c con 0x7fab6813b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6806e140 con 0x7fab680a3bb0 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fab6809f910 con 0x7fab6813b760 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fab6809ccd0 con 0x7fab680a0750 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab6e6bf640 10 monclient(hunting): authenticate will time out at 2123.394751s 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36696/0 (socket says 10.20.193.51:36696) 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 1 -- 10.20.193.51:0/3843101779 learned_addr learned my addr 10.20.193.51:0/3843101779 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): get_auth_request con 0x7fab680a0750 auth_method 0 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.775+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 10 monclient(hunting): handle_auth_done global_id 304136 payload 274 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 1 -- 10.20.193.51:0/3843101779 >> v2:10.20.193.142:3300/0 conn(0x7fab6813b760 msgr2=0x7fab6813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 1 --2- 10.20.193.51:0/3843101779 >> v2:10.20.193.142:3300/0 conn(0x7fab6813b760 0x7fab6813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 1 -- 10.20.193.51:0/3843101779 >> v1:10.20.193.142:6789/0 conn(0x7fab680a3bb0 legacy=0x7fab6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 1 monclient: found mon.noname-b 2026-02-17T12:10:35.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.779 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.776+0000 7fab677fe640 1 -- 10.20.193.51:0/3843101779 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6809eec0 con 0x7fab680a0750 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab677fe640 1 -- 10.20.193.51:0/3843101779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 msgr2=0x7fab6809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab677fe640 1 --2- 10.20.193.51:0/3843101779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab6809f230 tx=0x7fab5802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e353c30113039c9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 1 -- 10.20.193.51:0/3843101779 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5803c070 con 0x7fab680a0750 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: dump: 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.780 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 1 -- 10.20.193.51:0/3843101779 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5802fd80 con 0x7fab680a0750 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 5 monclient: authenticate success, global_id 304136 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 1 -- 10.20.193.51:0/3843101779 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58037660 con 0x7fab680a0750 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 4 set_mon_vals no callback set 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab66ffd640 10 monclient: dump: 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 10 monclient: shutdown 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3843101779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 msgr2=0x7fab6809e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3843101779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab6809f230 tx=0x7fab5802ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3843101779 shutdown_connections 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3843101779 >> v2:10.20.193.142:3300/0 conn(0x7fab6813b760 0x7fab6813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3843101779 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab6809e1d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.778+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3843101779 >> 10.20.193.51:0/3843101779 conn(0x7fab680a30c0 msgr2=0x7fab680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3843101779 shutdown_connections 2026-02-17T12:10:35.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3843101779 wait complete. 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient: monmap: 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 Processor -- start 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- start start 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient: init 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab681cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-c con 0x7fab680a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 0x7fab681d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-a con 0x7fab680a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6813b760 0x7fab68096090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): picked mon.noname-b con 0x7fab6813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fab680a04b0 con 0x7fab680a3bb0 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab6809c850 con 0x7fab6813b760 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fab6809e710 con 0x7fab680a0750 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6e6bf640 10 monclient(hunting): authenticate will time out at 2123.398821s 2026-02-17T12:10:35.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab681cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 0x7fab681d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab681cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36698/0 (socket says 10.20.193.51:36698) 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 1 -- 10.20.193.51:0/3469303969 learned_addr learned my addr 10.20.193.51:0/3469303969 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): get_auth_request con 0x7fab680a0750 auth_method 0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): get_auth_request con 0x7fab680a3bb0 auth_method 0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6cc35640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6813b760 0x7fab68096090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6cc35640 10 monclient(hunting): get_auth_request con 0x7fab6813b760 auth_method 0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6cc35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6cc35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.779+0000 7fab6cc35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 10 monclient(hunting): handle_auth_done global_id 274407 payload 824 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 msgr2=0x7fab681cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab681cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6813b760 msgr2=0x7fab68096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fab6813b760 0x7fab68096090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 monclient: found mon.noname-a 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab677fe640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68099fd0 con 0x7fab680a3bb0 2026-02-17T12:10:35.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.780+0000 7fab67fff640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab680a0750 0x7fab681cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab677fe640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 msgr2=0x7fab681d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab677fe640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 0x7fab681d0010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fab6809cea0 tx=0x7fab580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58046020 con 0x7fab680a3bb0 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: dump: 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.785 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab58042640 con 0x7fab680a3bb0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5803c040 con 0x7fab680a3bb0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 5 monclient: authenticate success, global_id 274407 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 monclient: _renew_subs 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab667fc640 4 set_mon_vals no callback set 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab680a2c20 con 0x7fab680a3bb0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 10 monclient: dump: 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 monclient: _renew_subs 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab68099a10 con 0x7fab680a3bb0 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 0x7fab6808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fab680992e0 con 0x7fab68096d90 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.782+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fab5803f030 con 0x7fab680a3bb0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 0x7fab6808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient: get_auth_request con 0x7fab68096d90 auth_method 0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab64ff9640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd10 0x7fab380401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 10 monclient(hunting): handle_auth_done global_id 304142 payload 824 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab67fff640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab6809e420 con 0x7fab68096d90 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(902..902 src has 323..902) ==== 4783+0+0 (secure 0 0 0) 0x7fab58077510 con 0x7fab680a3bb0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab6cc35640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd10 0x7fab380401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.783+0000 7fab6cc35640 10 monclient: get_auth_request con 0x7fab3803dd10 auth_method 0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab67fff640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 msgr2=0x7fab6808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab67fff640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 0x7fab6808d3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5400fc30 tx=0x7fab5400d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54018020 con 0x7fab68096d90 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 10 monclient: dump: 2026-02-17T12:10:35.787 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fab5400fe70 con 0x7fab68096d90 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 msgr2=0x7fab6808d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 0x7fab6808d3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5400fc30 tx=0x7fab5400d520 comp rx=0 tx=0).stop 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 msgr2=0x7fab6808d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.785+0000 7fab64ff9640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68096d90 0x7fab6808d3f0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5400fc30 tx=0x7fab5400d520 comp rx=0 tx=0).stop 2026-02-17T12:10:35.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.786+0000 7fab6cc35640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd10 0x7fab380401d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0044c0 tx=0x7fab5c002a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab6e6bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 0x7fab681dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab6e6bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fab68097de0 con 0x7fab68097170 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 0x7fab681dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient: get_auth_request con 0x7fab68097170 auth_method 0 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 10 monclient(hunting): handle_auth_done global_id 304145 payload 824 2026-02-17T12:10:35.791 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.789+0000 7fab67fff640 1 -- 10.20.193.51:0/3469303969 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fab6809dac0 con 0x7fab68097170 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab67fff640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 msgr2=0x7fab681dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab67fff640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 0x7fab681dab40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab54019000 tx=0x7fab54003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54018070 con 0x7fab68097170 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 10 monclient: dump: 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fab54014ca0 con 0x7fab68097170 2026-02-17T12:10:35.793 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 msgr2=0x7fab681dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 0x7fab681dab40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab54019000 tx=0x7fab54003860 comp rx=0 tx=0).stop 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 msgr2=0x7fab681dab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.791+0000 7fab64ff9640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fab68097170 0x7fab681dab40 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab54019000 tx=0x7fab54003860 comp rx=0 tx=0).stop 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 22058, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.794 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.795 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.796 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.797 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd10 msgr2=0x7fab380401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fab3803dd10 0x7fab380401d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0044c0 tx=0x7fab5c002a60 comp rx=0 tx=0).stop 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 10 monclient: shutdown 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 msgr2=0x7fab681d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 0x7fab681d0010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fab6809cea0 tx=0x7fab580047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6cc35640 1 -- 10.20.193.51:0/3469303969 reap_dead start 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 shutdown_connections 2026-02-17T12:10:35.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 --2- 10.20.193.51:0/3469303969 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fab680a3bb0 0x7fab681d0010 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 >> 10.20.193.51:0/3469303969 conn(0x7fab680a30c0 msgr2=0x7fab680a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 shutdown_connections 2026-02-17T12:10:35.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.792+0000 7fab6e6bf640 1 -- 10.20.193.51:0/3469303969 wait complete. 2026-02-17T12:10:35.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:35.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:10:35.801 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 10 monclient: get_monmap_and_config 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 10 monclient: monmap: 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:35.868404+0000 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:35.868404+0000 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.871 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 1 Processor -- start 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 1 -- start start 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.867+0000 7fd1e991b640 10 monclient: init 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 0x7fd1e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e40a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd1e409e540 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e406e140 con 0x7fd1e409e540 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e40a3f90 con 0x7fd1e40a3bb0 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e409f910 con 0x7fd1e40a0750 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e991b640 10 monclient(hunting): authenticate will time out at 2123.487167s 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36718/0 (socket says 10.20.193.51:36718) 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 -- 10.20.193.51:0/813788886 learned_addr learned my addr 10.20.193.51:0/813788886 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fd1e409e540 0x7fd1e413c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34574/0 (socket says 10.20.193.51:34574) 2026-02-17T12:10:35.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): get_auth_request con 0x7fd1e40a0750 auth_method 0 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/813788886 >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 0x7fd1e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_done global_id 304148 payload 274 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 -- 10.20.193.51:0/813788886 >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 msgr2=0x7fd1e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 --2- 10.20.193.51:0/813788886 >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 0x7fd1e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 -- 10.20.193.51:0/813788886 >> v1:10.20.193.51:6789/0 conn(0x7fd1e409e540 legacy=0x7fd1e413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 monclient: found mon.noname-b 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e27fc640 1 -- 10.20.193.51:0/813788886 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e409ccd0 con 0x7fd1e40a0750 2026-02-17T12:10:35.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e2ffd640 10 monclient: get_auth_request con 0x7fd1e40a3bb0 auth_method 0 2026-02-17T12:10:35.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.868+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/813788886 >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 0x7fd1e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e27fc640 1 -- 10.20.193.51:0/813788886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 msgr2=0x7fd1e409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e27fc640 1 --2- 10.20.193.51:0/813788886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1e406c1c0 tx=0x7fd1cc02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3803d03224a711c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 1 -- 10.20.193.51:0/813788886 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc03c070 con 0x7fd1e40a0750 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: dump: 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.879 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 1 -- 10.20.193.51:0/813788886 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc02fd80 con 0x7fd1e40a0750 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 1 -- 10.20.193.51:0/813788886 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc037660 con 0x7fd1e40a0750 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e1ffb640 10 monclient: dump: 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.880 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e991b640 5 monclient: authenticate success, global_id 304148 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e991b640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.870+0000 7fd1e991b640 4 set_mon_vals no callback set 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 10 monclient: shutdown 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 -- 10.20.193.51:0/813788886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 msgr2=0x7fd1e409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 --2- 10.20.193.51:0/813788886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1e406c1c0 tx=0x7fd1cc02ee60 comp rx=0 tx=0).stop 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 -- 10.20.193.51:0/813788886 shutdown_connections 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 --2- 10.20.193.51:0/813788886 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e40a0750 0x7fd1e409e000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 --2- 10.20.193.51:0/813788886 >> v2:10.20.193.142:3300/0 conn(0x7fd1e40a3bb0 0x7fd1e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 -- 10.20.193.51:0/813788886 >> 10.20.193.51:0/813788886 conn(0x7fd1e40a30c0 msgr2=0x7fd1e40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 -- 10.20.193.51:0/813788886 shutdown_connections 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 1 -- 10.20.193.51:0/813788886 wait complete. 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.871+0000 7fd1e991b640 10 monclient: monmap: 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:35.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 Processor -- start 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 -- start start 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient: init 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e409e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 0x7fd1e412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-a con 0x7fd1e40a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e40a3bb0 0x7fd1e4130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:35.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40a04b0 con 0x7fd1e40a0750 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e409c850 con 0x7fd1e40a3bb0 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e413de80 con 0x7fd1e409e540 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e991b640 10 monclient(hunting): authenticate will time out at 2123.491333s 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36720/0 (socket says 10.20.193.51:36720) 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 learned_addr learned my addr 10.20.193.51:0/3541548095 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 0x7fd1e412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 10 monclient(hunting): get_auth_request con 0x7fd1e409e540 auth_method 0 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): get_auth_request con 0x7fd1e40a0750 auth_method 0 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 msgr2=0x7fd1e4137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 msgr2=0x7fd1e4137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:35.884 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e37fe640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e40a3bb0 0x7fd1e4130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient(hunting): handle_auth_done global_id 274410 payload 824 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 msgr2=0x7fd1e4137ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd1e409e540 0x7fd1e4137ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e40a3bb0 msgr2=0x7fd1e4130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e40a3bb0 0x7fd1e4130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.885 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 monclient: found mon.noname-a 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e27fc640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e41332e0 con 0x7fd1e40a0750 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e37fe640 10 monclient: get_auth_request con 0x7fd1e40a3bb0 auth_method 0 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.872+0000 7fd1e37fe640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e40a3bb0 0x7fd1e4130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e27fc640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 msgr2=0x7fd1e412fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e27fc640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 0x7fd1e412fdc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1e409fa90 tx=0x7fd1cc004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc03c040 con 0x7fd1e40a0750 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:35.886 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: dump: 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.887 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc047070 con 0x7fd1e40a0750 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0428d0 con 0x7fd1e40a0750 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 5 monclient: authenticate success, global_id 274410 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 10 monclient: _renew_subs 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e17fa640 4 set_mon_vals no callback set 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e41335c0 con 0x7fd1e40a0750 2026-02-17T12:10:35.888 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1bbfff640 10 monclient: dump: 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.889 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 10 monclient: _renew_subs 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.874+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e406f8d0 con 0x7fd1e40a0750 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e991b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e991b640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 0x7fd1e4139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e4131920 con 0x7fd1e4130840 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd1cc042a70 con 0x7fd1e40a0750 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 0x7fd1e4139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.890 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient: get_auth_request con 0x7fd1e4130840 auth_method 0 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1bbfff640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1b403dd10 0x7fd1b40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(902..902 src has 323..902) ==== 4783+0+0 (secure 0 0 0) 0x7fd1cc077960 con 0x7fd1e40a0750 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e37fe640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1b403dd10 0x7fd1b40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e37fe640 10 monclient: get_auth_request con 0x7fd1b403dd10 auth_method 0 2026-02-17T12:10:35.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.875+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_done global_id 284227 payload 824 2026-02-17T12:10:35.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.876+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1e41323f0 con 0x7fd1e4130840 2026-02-17T12:10:35.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 msgr2=0x7fd1e4139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 0x7fd1e4139960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8018020 con 0x7fd1e4130840 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 10 monclient: dump: 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.895 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1e37fe640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1b403dd10 0x7fd1b40401d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400d150 tx=0x7fd1d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd1d800cbc0 con 0x7fd1e4130840 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 msgr2=0x7fd1e4139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 0x7fd1e4139960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d800ec40 comp rx=0 tx=0).stop 2026-02-17T12:10:35.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 msgr2=0x7fd1e4139960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.878+0000 7fd1bbfff640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4130840 0x7fd1e4139960 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d800ec40 comp rx=0 tx=0).stop 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e991b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e991b640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 0x7fd1e413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e991b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e4130c20 con 0x7fd1e4139ea0 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 0x7fd1e413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient: get_auth_request con 0x7fd1e4139ea0 auth_method 0 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.897 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 10 monclient(hunting): handle_auth_done global_id 284230 payload 824 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.882+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1e406e4a0 con 0x7fd1e4139ea0 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e2ffd640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 msgr2=0x7fd1e413a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e2ffd640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 0x7fd1e413a280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8018040 con 0x7fd1e4139ea0 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.898 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 10 monclient: dump: 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.899 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fd1d8003030 con 0x7fd1e4139ea0 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:35.900 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 msgr2=0x7fd1e413a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 0x7fd1e413a280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d80047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 msgr2=0x7fd1e413a280 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1bbfff640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd1e4139ea0 0x7fd1e413a280 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e770 tx=0x7fd1d80047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:10:35.901 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 234, 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 138114, 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 2, 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.902 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.903 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:35.904 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.905 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.906 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:35.907 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.908 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:35.909 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:35.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1b403dd10 msgr2=0x7fd1b40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd1b403dd10 0x7fd1b40401d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400d150 tx=0x7fd1d4009040 comp rx=0 tx=0).stop 2026-02-17T12:10:35.910 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 10 monclient: shutdown 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e37fe640 1 -- 10.20.193.51:0/3541548095 reap_dead start 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 msgr2=0x7fd1e412fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 0x7fd1e412fdc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1e409fa90 tx=0x7fd1cc004830 comp rx=0 tx=0).stop 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 shutdown_connections 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 --2- 10.20.193.51:0/3541548095 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd1e40a0750 0x7fd1e412fdc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 >> 10.20.193.51:0/3541548095 conn(0x7fd1e40a30c0 msgr2=0x7fd1e4073020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 shutdown_connections 2026-02-17T12:10:35.911 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.885+0000 7fd1e991b640 1 -- 10.20.193.51:0/3541548095 wait complete. 2026-02-17T12:10:35.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:10:35.911 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T12:10:35.911 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T12:10:35.911 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T12:10:35.911 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:10:35.911 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:10:35.912 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:10:35.923 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:10:35.923 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:10:35.923 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.989+0000 7fa06dfff640 10 monclient: get_monmap_and_config 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.989+0000 7fa06dfff640 10 monclient: build_initial_monmap 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.989+0000 7fa06dfff640 10 monclient: monmap: 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:35.990811+0000 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:35.990811+0000 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:35.991 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 Processor -- start 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 -- start start 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient: init 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa0680a3bb0 0x7fa06809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-c con 0x7fa0680a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa0680a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa06813b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06806e140 con 0x7fa06813b760 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06809f910 con 0x7fa0680a0750 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa06809ccd0 con 0x7fa0680a3bb0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa06dfff640 10 monclient(hunting): authenticate will time out at 2123.609649s 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa0677fe640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fa0680a3bb0 msgr2=0x7fa06809dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa0677fe640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fa0680a3bb0 0x7fa06809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa066ffd640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7fa0680a0750 legacy=0x7fa06809e000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa067fff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa06813b760 0x7fa06813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34576/0 (socket says 10.20.193.51:34576) 2026-02-17T12:10:35.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.990+0000 7fa067fff640 1 -- 10.20.193.51:0/1737434195 learned_addr learned my addr 10.20.193.51:0/1737434195 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:35.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa067fff640 1 -- 10.20.193.51:0/1737434195 >> v1:10.20.193.51:6789/0 conn(0x7fa06813b760 legacy=0x7fa06813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370972811 0 0) 0x7fa06806e140 con 0x7fa06813b760 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa0667fc640 10 monclient(hunting): _negotiate 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa0667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa0667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.992+0000 7fa0667fc640 10 monclient(hunting): my global_id is 274413 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa04c003620 con 0x7fa06813b760 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3605200132 0 0) 0x7fa04c003620 con 0x7fa06813b760 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 >> v2:10.20.193.142:3300/0 conn(0x7fa0680a3bb0 msgr2=0x7fa06809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 --2- 10.20.193.51:0/1737434195 >> v2:10.20.193.142:3300/0 conn(0x7fa0680a3bb0 0x7fa06809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 >> v1:10.20.193.142:6789/0 conn(0x7fa0680a0750 legacy=0x7fa06809e000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06809eec0 con 0x7fa06813b760 2026-02-17T12:10:35.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7fa05c003530 con 0x7fa06813b760 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: dump: 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 >> v1:10.20.193.51:6789/0 conn(0x7fa06813b760 legacy=0x7fa06813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa04c003ab0 0x7fa04c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): picked mon.a con 0x7fa04c003ab0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 0x7fa04c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): picked mon.c con 0x7fa04c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c0054c0 0x7fa04c00bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): picked mon.b con 0x7fa04c0054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa06809ccd0 con 0x7fa04c003ab0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c00c400 con 0x7fa04c0054c0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa04c00c600 con 0x7fa04c004900 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0667fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa04c003ab0 0x7fa04c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 0x7fa04c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): get_auth_request con 0x7fa04c003ab0 auth_method 0 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa067fff640 1 -- 10.20.193.51:0/1737434195 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c0054c0 msgr2=0x7fa04c00bb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): get_auth_request con 0x7fa04c004900 auth_method 0 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa067fff640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c0054c0 0x7fa04c00bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient(hunting): handle_auth_done global_id 274413 payload 293 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 -- 10.20.193.51:0/1737434195 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c0054c0 msgr2=0x7fa04c00bb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c0054c0 0x7fa04c00bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 -- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa04c003ab0 msgr2=0x7fa04c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa04c003ab0 0x7fa04c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 monclient: found mon.c 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa067fff640 1 -- 10.20.193.51:0/1737434195 reap_dead start 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 1 -- 10.20.193.51:0/1737434195 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c003620 con 0x7fa04c004900 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient: _finish_auth 0 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa066ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa06dfff640 5 monclient: authenticate success, global_id 274413 2026-02-17T12:10:35.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.993+0000 7fa06dfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa066ffd640 1 -- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 msgr2=0x7fa04c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa066ffd640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 0x7fa04c004d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa058009e30 tx=0x7fa05802f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b23ca9061009b1c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058009a30 con 0x7fa04c004900 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa0667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa0667fc640 10 monclient: dump: 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.995+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa058003cb0 con 0x7fa04c004900 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa0667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa0667fc640 1 -- 10.20.193.51:0/1737434195 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058003e60 con 0x7fa04c004900 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 4 set_mon_vals no callback set 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa0667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:35.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa0667fc640 10 monclient: dump: 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 10 monclient: shutdown 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 -- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 msgr2=0x7fa04c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 0x7fa04c004d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa058009e30 tx=0x7fa05802f660 comp rx=0 tx=0).stop 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 -- 10.20.193.51:0/1737434195 shutdown_connections 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 --2- 10.20.193.51:0/1737434195 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa04c004900 0x7fa04c004d80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 -- 10.20.193.51:0/1737434195 >> 10.20.193.51:0/1737434195 conn(0x7fa0680a30c0 msgr2=0x7fa0680a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 -- 10.20.193.51:0/1737434195 shutdown_connections 2026-02-17T12:10:35.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 1 -- 10.20.193.51:0/1737434195 wait complete. 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 10 monclient: build_initial_monmap 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.996+0000 7fa06dfff640 10 monclient: monmap: 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 Processor -- start 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 -- start start 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient: init 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 0x7fa068095390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:36.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-b con 0x7fa04c004900 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-c con 0x7fa0680958d0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 0x7fa0681d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): picked mon.noname-a con 0x7fa068096230 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680a04b0 con 0x7fa068096230 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa06809c850 con 0x7fa04c004900 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa06809dac0 con 0x7fa0680958d0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa06dfff640 10 monclient(hunting): authenticate will time out at 2123.616469s 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa0677fe640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 msgr2=0x7fa068095390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa0677fe640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 0x7fa068095390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36738/0 (socket says 10.20.193.51:36738) 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 0x7fa0681d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 -- 10.20.193.51:0/894224940 learned_addr learned my addr 10.20.193.51:0/894224940 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): get_auth_request con 0x7fa0680958d0 auth_method 0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): get_auth_request con 0x7fa068096230 auth_method 0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient(hunting): handle_auth_done global_id 304151 payload 824 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 -- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 msgr2=0x7fa068095390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 0x7fa068095390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 -- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 msgr2=0x7fa0681d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 0x7fa0681d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:10:36.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 monclient: found mon.noname-c 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa066ffd640 1 -- 10.20.193.51:0/894224940 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa068097180 con 0x7fa0680958d0 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.997+0000 7fa067fff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 0x7fa0681d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa066ffd640 1 -- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 msgr2=0x7fa068095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa066ffd640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa058002410 tx=0x7fa058005b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058046020 con 0x7fa0680958d0 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:36.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: dump: 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: _finish_auth 0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: _check_auth_tickets 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa06dfff640 5 monclient: authenticate success, global_id 304151 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05803d040 con 0x7fa0680958d0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058037430 con 0x7fa0680958d0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa043fff640 10 monclient: dump: 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa065ffb640 4 set_mon_vals no callback set 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa06dfff640 10 monclient: _renew_subs 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa06dfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:35.999+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa068098fd0 con 0x7fa0680958d0 2026-02-17T12:10:36.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 10 monclient: _renew_subs 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa068073fe0 con 0x7fa0680958d0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa0580375d0 con 0x7fa0680958d0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068098730 con 0x7fa0680958d0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa043fff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 0x7fa038040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(902..902 src has 323..902) ==== 4783+0+0 (secure 0 0 0) 0x7fa0580781f0 con 0x7fa0680958d0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa0677fe640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 0x7fa038040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.000+0000 7fa0677fe640 10 monclient: get_auth_request con 0x7fa03803dcc0 auth_method 0 2026-02-17T12:10:36.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.003+0000 7fa0677fe640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 0x7fa038040180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa068052350 tx=0x7fa054009520 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.003+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa058050030 con 0x7fa0680958d0 2026-02-17T12:10:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.003+0000 7fa043fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:36.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.003+0000 7fa043fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.118+0000 7fa06dfff640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.118+0000 7fa06dfff640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.118+0000 7fa06dfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.118+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa06809de50 con 0x7fa0680958d0 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.119+0000 7fa043fff640 1 -- 10.20.193.51:0/894224940 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fa058076bf0 con 0x7fa0680958d0 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.119+0000 7fa043fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.119+0000 7fa043fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:36.121 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:36.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 msgr2=0x7fa038040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:36.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 0x7fa038040180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa068052350 tx=0x7fa054009520 comp rx=0 tx=0).stop 2026-02-17T12:10:36.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 10 monclient: shutdown 2026-02-17T12:10:36.122 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 msgr2=0x7fa068095cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa058002410 tx=0x7fa058005b10 comp rx=0 tx=0).stop 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 shutdown_connections 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa03803dcc0 0x7fa038040180 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa068096230 0x7fa0681d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa0680958d0 0x7fa068095cf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 --2- 10.20.193.51:0/894224940 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa04c004900 0x7fa068095390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 >> 10.20.193.51:0/894224940 conn(0x7fa0680a30c0 msgr2=0x7fa06813a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 shutdown_connections 2026-02-17T12:10:36.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:36.120+0000 7fa06dfff640 1 -- 10.20.193.51:0/894224940 wait complete. 2026-02-17T12:10:39.130 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:39.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.198+0000 7f7149ca7640 10 monclient: get_monmap_and_config 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.198+0000 7f7149ca7640 10 monclient: build_initial_monmap 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.198+0000 7f7149ca7640 10 monclient: monmap: 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:39.199852+0000 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:39.199852+0000 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.201 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:39.202 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:39.202 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:39.202 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:39.202 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:39.202 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.210 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 Processor -- start 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 -- start start 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient: init 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7144138600 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 0x7f714413d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-b con 0x7f71440a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 0x7f714413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f714413d8a0 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:39.211 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71440a1df0 con 0x7f7144138600 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f71440a6830 con 0x7f714413d8a0 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71440a2c00 con 0x7f71440a35a0 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7149ca7640 10 monclient(hunting): authenticate will time out at 2126.818802s 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f71437fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f7144138600 0x7f71441389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34580/0 (socket says 10.20.193.51:34580) 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f71437fe640 1 -- 10.20.193.51:0/1730137684 learned_addr learned my addr 10.20.193.51:0/1730137684 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7143fff640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 msgr2=0x7f714413fc90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7143fff640 1 --2- 10.20.193.51:0/1730137684 >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 0x7f714413fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 1 --2- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 0x7f714413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:39.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): get_auth_request con 0x7f71440a35a0 auth_method 0 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.199+0000 7f7142ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 10 monclient(hunting): handle_auth_done global_id 304154 payload 274 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 1 -- 10.20.193.51:0/1730137684 >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 msgr2=0x7f714413fc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 1 --2- 10.20.193.51:0/1730137684 >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 0x7f714413fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 1 -- 10.20.193.51:0/1730137684 >> v1:10.20.193.51:6789/0 conn(0x7f7144138600 legacy=0x7f71441389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:10:39.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 1 monclient: found mon.noname-b 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.200+0000 7f7142ffd640 1 -- 10.20.193.51:0/1730137684 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71440a65b0 con 0x7f71440a35a0 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f7142ffd640 1 -- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 msgr2=0x7f714413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f7142ffd640 1 --2- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 0x7f714413d360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71340098a0 tx=0x7f713402eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e82599a85ac3df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 1 -- 10.20.193.51:0/1730137684 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713403c070 con 0x7f71440a35a0 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: dump: 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:39.214 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: _finish_auth 0 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: _check_auth_tickets 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:39.215 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 1 -- 10.20.193.51:0/1730137684 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713402fd00 con 0x7f71440a35a0 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 1 -- 10.20.193.51:0/1730137684 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134037660 con 0x7f71440a35a0 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f71427fc640 10 monclient: dump: 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:39.216 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f7149ca7640 5 monclient: authenticate success, global_id 304154 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f7149ca7640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.202+0000 7f7149ca7640 4 set_mon_vals no callback set 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: shutdown 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 msgr2=0x7f714413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 --2- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 0x7f714413d360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71340098a0 tx=0x7f713402eda0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- 10.20.193.51:0/1730137684 shutdown_connections 2026-02-17T12:10:39.217 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 --2- 10.20.193.51:0/1730137684 >> v2:10.20.193.142:3300/0 conn(0x7f714413d8a0 0x7f714413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 --2- 10.20.193.51:0/1730137684 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f71440a35a0 0x7f714413d360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- 10.20.193.51:0/1730137684 >> 10.20.193.51:0/1730137684 conn(0x7f71440a7460 msgr2=0x7f71440a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- 10.20.193.51:0/1730137684 shutdown_connections 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- 10.20.193.51:0/1730137684 wait complete. 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: build_initial_monmap 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: monmap: 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:39.218 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 Processor -- start 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 -- start start 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: init 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:39.219 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71440a35a0 0x7f7144070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-a con 0x7f71440a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 0x7f7144070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.203+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-b con 0x7f7144138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f714413d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f71440a15f0 con 0x7f71440a35a0 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71440a25b0 con 0x7f7144138600 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:39.220 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f71440a1770 con 0x7f714413d8a0 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7149ca7640 10 monclient(hunting): authenticate will time out at 2126.823016s 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7142ffd640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 msgr2=0x7f7144070580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7142ffd640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 0x7f7144070580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71440a35a0 0x7f7144070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36764/0 (socket says 10.20.193.51:36764) 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 -- 10.20.193.51:0/4018696387 learned_addr learned my addr 10.20.193.51:0/4018696387 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): get_auth_request con 0x7f714413d8a0 auth_method 0 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:39.221 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): get_auth_request con 0x7f71440a35a0 auth_method 0 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f71437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient(hunting): handle_auth_done global_id 304157 payload 824 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 -- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 msgr2=0x7f7144070580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 0x7f7144070580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.222 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 -- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71440a35a0 msgr2=0x7f7144070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71440a35a0 0x7f7144070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient: _finish_hunting 0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 monclient: found mon.noname-c 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.204+0000 7f7143fff640 1 -- 10.20.193.51:0/4018696387 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7144074450 con 0x7f714413d8a0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7143fff640 1 -- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 msgr2=0x7f71441cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7143fff640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f713800be50 tx=0x7f713800bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138016630 con 0x7f714413d8a0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:39.223 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: dump: 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.224 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: _finish_auth 0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7138010030 con 0x7f714413d8a0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138016a10 con 0x7f714413d8a0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 5 monclient: authenticate success, global_id 304157 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7141ffb640 4 set_mon_vals no callback set 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 10 monclient: _renew_subs 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71440724c0 con 0x7f714413d8a0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:39.225 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f711ffff640 10 monclient: dump: 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 10 monclient: _renew_subs 2026-02-17T12:10:39.226 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.206+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7144074640 con 0x7f714413d8a0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f7149ca7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f7149ca7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f7149ca7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144072110 con 0x7f714413d8a0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f71380153e0 con 0x7f714413d8a0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f711ffff640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 0x7f7114040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(902..902 src has 323..902) ==== 4783+0+0 (secure 0 0 0) 0x7f7138052ed0 con 0x7f714413d8a0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f71437fe640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 0x7f7114040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:39.227 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.207+0000 7f71437fe640 10 monclient: get_auth_request con 0x7f711403dcc0 auth_method 0 2026-02-17T12:10:39.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.210+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f71380132e0 con 0x7f714413d8a0 2026-02-17T12:10:39.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.210+0000 7f711ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:39.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.210+0000 7f711ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:39.228 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.210+0000 7f71437fe640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 0x7f7114040180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7130007d90 tx=0x7f7130007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:39.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.325+0000 7f7149ca7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:39.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.325+0000 7f7149ca7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:39.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.325+0000 7f7149ca7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:39.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.325+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f71441389e0 con 0x7f714413d8a0 2026-02-17T12:10:39.328 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f711ffff640 1 -- 10.20.193.51:0/4018696387 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f71380148c0 con 0x7f714413d8a0 2026-02-17T12:10:39.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f711ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:39.329 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f711ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:39.329 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:39.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 msgr2=0x7f7114040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:39.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 0x7f7114040180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7130007d90 tx=0x7f7130007ce0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.330 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 10 monclient: shutdown 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 msgr2=0x7f71441cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.326+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f713800be50 tx=0x7f713800bf50 comp rx=0 tx=0).stop 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 shutdown_connections 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f711403dcc0 0x7f7114040180 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f714413d8a0 0x7f71441cf1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7144138600 0x7f7144070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.331 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 --2- 10.20.193.51:0/4018696387 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f71440a35a0 0x7f7144070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:39.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 >> 10.20.193.51:0/4018696387 conn(0x7f71440a7460 msgr2=0x7f7144137310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:39.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 shutdown_connections 2026-02-17T12:10:39.332 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:39.327+0000 7f7149ca7640 1 -- 10.20.193.51:0/4018696387 wait complete. 2026-02-17T12:10:42.337 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:42.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: get_monmap_and_config 2026-02-17T12:10:42.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: build_initial_monmap 2026-02-17T12:10:42.409 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: monmap: 2026-02-17T12:10:42.409 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:42.406096+0000 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:42.406096+0000 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:42.410 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 Processor -- start 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 -- start start 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: init 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f00bc0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f00bc0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:42.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f00bc13c770 0x7f00bc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-a con 0x7f00bc13c770 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00bc09e8e0 con 0x7f00bc0a0750 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00bc06e140 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f00bc09f910 con 0x7f00bc13c770 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c49f8640 10 monclient(hunting): authenticate will time out at 2130.024861s 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c276d640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f00bc0a3bb0 legacy=0x7f00bc09dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c2f6e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f00bc13c770 0x7f00bc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c1f6c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f00bc0a0750 0x7f00bc09e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:34596/0 (socket says 10.20.193.51:34596) 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c1f6c640 1 -- 10.20.193.51:0/12260722 learned_addr learned my addr 10.20.193.51:0/12260722 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:42.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c2f6e640 10 monclient(hunting): get_auth_request con 0x7f00bc13c770 auth_method 0 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c2f6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c2f6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.405+0000 7f00c2f6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient(hunting): handle_auth_done global_id 274422 payload 274 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 1 -- 10.20.193.51:0/12260722 >> v1:10.20.193.142:6789/0 conn(0x7f00bc0a3bb0 legacy=0x7f00bc09dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 1 -- 10.20.193.51:0/12260722 >> v1:10.20.193.51:6789/0 conn(0x7f00bc0a0750 legacy=0x7f00bc09e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient: _finish_hunting 0 2026-02-17T12:10:42.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 1 monclient: found mon.noname-a 2026-02-17T12:10:42.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:42.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.406+0000 7f00c2f6e640 1 -- 10.20.193.51:0/12260722 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc09ccd0 con 0x7f00bc13c770 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c2f6e640 1 -- 10.20.193.51:0/12260722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc13c770 msgr2=0x7f00bc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c2f6e640 1 --2- 10.20.193.51:0/12260722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc13c770 0x7f00bc13eb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdab4f481d1a2644 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 1 -- 10.20.193.51:0/12260722 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b003c070 con 0x7f00bc13c770 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: dump: 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:42.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: _finish_auth 0 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: _check_auth_tickets 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:42.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 5 monclient: authenticate success, global_id 274422 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 1 -- 10.20.193.51:0/12260722 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0037640 con 0x7f00bc13c770 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 1 -- 10.20.193.51:0/12260722 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0037a10 con 0x7f00bc13c770 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 4 set_mon_vals no callback set 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c176b640 10 monclient: dump: 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:42.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 10 monclient: shutdown 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 1 -- 10.20.193.51:0/12260722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc13c770 msgr2=0x7f00bc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.408+0000 7f00c49f8640 1 --2- 10.20.193.51:0/12260722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc13c770 0x7f00bc13eb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b002f190 comp rx=0 tx=0).stop 2026-02-17T12:10:42.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- 10.20.193.51:0/12260722 shutdown_connections 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 --2- 10.20.193.51:0/12260722 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc13c770 0x7f00bc13eb60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- 10.20.193.51:0/12260722 >> 10.20.193.51:0/12260722 conn(0x7f00bc0a30c0 msgr2=0x7f00bc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- 10.20.193.51:0/12260722 shutdown_connections 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- 10.20.193.51:0/12260722 wait complete. 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient: build_initial_monmap 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient: monmap: 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:42.425 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 Processor -- start 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- start start 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient: init 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 0x7f00bc099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-c con 0x7f00bc0a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:42.426 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-a con 0x7f00bc0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 0x7f00bc090740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): picked mon.noname-b con 0x7f00bc13c770 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc09c850 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc09ebe0 con 0x7f00bc13c770 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f00bc0a04b0 con 0x7f00bc0a0750 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c49f8640 10 monclient(hunting): authenticate will time out at 2130.028865s 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:42.427 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 0x7f00bc099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:35596/0 (socket says 10.20.193.51:35596) 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 1 -- 10.20.193.51:0/2761541754 learned_addr learned my addr 10.20.193.51:0/2761541754 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): get_auth_request con 0x7f00bc0a3bb0 auth_method 0 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): get_auth_request con 0x7f00bc0a0750 auth_method 0 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c2f6e640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 msgr2=0x7f00bc090740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:42.428 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c2f6e640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 0x7f00bc090740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c1f6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.409+0000 7f00c276d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c276d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 10 monclient(hunting): handle_auth_done global_id 274425 payload 824 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 msgr2=0x7f00bc099ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 0x7f00bc099ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 msgr2=0x7f00bc090740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 0x7f00bc090740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.429 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 10 monclient: _finish_hunting 0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 monclient: found mon.noname-a 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c1f6c640 1 -- 10.20.193.51:0/2761541754 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc13e700 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.410+0000 7f00c276d640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 0x7f00bc099ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c1f6c640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 msgr2=0x7f00bc090200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c1f6c640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c750 tx=0x7f00a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8005de0 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: dump: 2026-02-17T12:10:42.430 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:10:42.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8007070 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007440 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 5 monclient: authenticate success, global_id 274425 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c0f6a640 4 set_mon_vals no callback set 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _renew_subs 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00bc094190 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00a6ffd640 10 monclient: dump: 2026-02-17T12:10:42.432 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _renew_subs 2026-02-17T12:10:42.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00bc093bd0 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.412+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00bc09dac0 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.413+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f00a8007660 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.413+0000 7f00a6ffd640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 0x7f008c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.413+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(902..902 src has 323..902) ==== 4783+0+0 (secure 0 0 0) 0x7f00a8052350 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.413+0000 7f00c276d640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 0x7f008c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.413+0000 7f00c276d640 10 monclient: get_auth_request con 0x7f008c03dd10 auth_method 0 2026-02-17T12:10:42.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.415+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f00bc13e700 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.415+0000 7f00a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:42.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.415+0000 7f00a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:42.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.416+0000 7f00c276d640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 0x7f008c0401d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f00b4003a30 tx=0x7f00b4003c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:42.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.529+0000 7f00c49f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:42.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.529+0000 7f00c49f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:42.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.529+0000 7f00c49f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:42.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.529+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f00bc092780 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00a6ffd640 1 -- 10.20.193.51:0/2761541754 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f00a800a8d0 con 0x7f00bc0a3bb0 2026-02-17T12:10:42.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00a6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:42.533 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:42.533 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 msgr2=0x7f008c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 0x7f008c0401d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f00b4003a30 tx=0x7f00b4003c40 comp rx=0 tx=0).stop 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 10 monclient: shutdown 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 msgr2=0x7f00bc090200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c750 tx=0x7f00a800cc20 comp rx=0 tx=0).stop 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 shutdown_connections 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f008c03dd10 0x7f008c0401d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f00bc13c770 0x7f00bc090740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.535 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f00bc0a3bb0 0x7f00bc090200 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 --2- 10.20.193.51:0/2761541754 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f00bc0a0750 0x7f00bc099ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:42.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 >> 10.20.193.51:0/2761541754 conn(0x7f00bc0a30c0 msgr2=0x7f00bc0a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:42.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 shutdown_connections 2026-02-17T12:10:42.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:42.530+0000 7f00c49f8640 1 -- 10.20.193.51:0/2761541754 wait complete. 2026-02-17T12:10:45.541 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:10:45.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: get_monmap_and_config 2026-02-17T12:10:45.610 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: build_initial_monmap 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: monmap: 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:45.608161+0000 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:45.608161+0000 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:45.611 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 Processor -- start 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 -- start start 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: init 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f242c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-c con 0x7f242c0a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f242c13b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:45.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f242c06e140 con 0x7f242c0a3bb0 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f242c09f910 con 0x7f242c13b760 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f242c09ccd0 con 0x7f242c0a0750 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.607+0000 7f24313e6640 10 monclient(hunting): authenticate will time out at 2133.226944s 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.608+0000 7f242a7fc640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 msgr2=0x7f242c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.608+0000 7f242b7fe640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f242c13b760 legacy=0x7f242c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.608+0000 7f242affd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f242c0a3bb0 0x7f242c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49896/0 (socket says 10.20.193.51:49896) 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.608+0000 7f242a7fc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:45.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.608+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 learned_addr learned my addr 10.20.193.51:0/1082964242 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:45.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.610+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.51:6789/0 conn(0x7f242c0a3bb0 legacy=0x7f242c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:45.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.809+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.142:6789/0 conn(0x7f242c13b760 legacy=0x7f242c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:45.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.809+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 msgr2=0x7f242c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:45.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:45.809+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:46.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:46.210+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.142:6789/0 conn(0x7f242c13b760 legacy=0x7f242c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:46.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:46.210+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 msgr2=0x7f242c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:46.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:46.210+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:47.011+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.142:6789/0 conn(0x7f242c13b760 legacy=0x7f242c13db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:47.011+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 msgr2=0x7f242c09e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:47.012 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:47.011+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:48.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 10 monclient(hunting): tick 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 1 monclient(hunting): continuing hunt 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 msgr2=0x7f242c09e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.142:3300/0 conn(0x7f242c0a0750 0x7f242c09e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.142:6789/0 conn(0x7f242c13b760 legacy=0x7f242c13db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.51:6789/0 conn(0x7f242c0a3bb0 legacy=0x7f242c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.607+0000 7f2428ff9640 10 monclient: _add_conns ranks=[3,2] 2026-02-17T12:10:48.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f2410003840 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f2410006330 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f242c09ccd0 con 0x7f2410003840 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2410008ed0 con 0x7f2410006330 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f2428ff9640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 10 monclient(hunting): get_auth_request con 0x7f2410003840 auth_method 0 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:48.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 10 monclient(hunting): get_auth_request con 0x7f2410006330 auth_method 0 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:48.614 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:48.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:48.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.608+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:48.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:48.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 10 monclient(hunting): get_auth_request con 0x7f2410006330 auth_method 0 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 10 monclient(hunting): get_auth_request con 0x7f2410003840 auth_method 0 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:48.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:48.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:48.809+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:10:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 10 monclient(hunting): get_auth_request con 0x7f2410006330 auth_method 0 2026-02-17T12:10:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:49.212 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 10 monclient(hunting): get_auth_request con 0x7f2410003840 auth_method 0 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:49.213 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:49.214 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:49.210+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:10:50.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:50.013 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 10 monclient(hunting): get_auth_request con 0x7f2410003840 auth_method 0 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 10 monclient(hunting): get_auth_request con 0x7f2410006330 auth_method 0 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:50.014 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:10:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:10:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:10:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242a7fc640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:50.015 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:50.011+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): tick 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 monclient(hunting): continuing hunt 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 msgr2=0x7f24100087f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006330 0x7f24100087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.611 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 msgr2=0x7f2410005cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410003840 0x7f2410005cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 reap_dead start 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 0x7f24100067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f2410003cb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2410006d00 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410008940 0x7f241000d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f2410008940 addr v2:10.20.193.51:3300/0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f242c09eec0 con 0x7f2410006d00 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f242c09ccd0 con 0x7f2410008940 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 1 -- 10.20.193.51:0/1082964242 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2410008ed0 con 0x7f2410003cb0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f2428ff9640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 0x7f24100067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 --2- 10.20.193.51:0/1082964242 >> v2:10.20.193.51:3300/0 conn(0x7f2410008940 0x7f241000d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): get_auth_request con 0x7f2410003cb0 auth_method 0 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.612 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): get_auth_request con 0x7f2410008940 auth_method 0 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient(hunting): handle_auth_done global_id 274428 payload 274 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 msgr2=0x7f24100067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 0x7f24100067c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> v1:10.20.193.51:6789/0 conn(0x7f2410006d00 legacy=0x7f2410007160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c09f910 con 0x7f2410008940 2026-02-17T12:10:51.613 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.608+0000 7f242affd640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 0x7f24100067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f242b7fe640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2410008940 msgr2=0x7f241000d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f242b7fe640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2410008940 0x7f241000d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f242c09f620 tx=0x7f241c02f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6377581ed2c3544 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 1 -- 10.20.193.51:0/1082964242 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c008040 con 0x7f2410008940 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: dump: 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.616 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 1 -- 10.20.193.51:0/1082964242 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241c037630 con 0x7f2410008940 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 1 -- 10.20.193.51:0/1082964242 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c037a20 con 0x7f2410008940 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f2429ffb640 10 monclient: dump: 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.617 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 5 monclient: authenticate success, global_id 274428 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 4 set_mon_vals no callback set 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 10 monclient: shutdown 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 -- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2410008940 msgr2=0x7f241000d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2410008940 0x7f241000d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f242c09f620 tx=0x7f241c02f690 comp rx=0 tx=0).stop 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 -- 10.20.193.51:0/1082964242 shutdown_connections 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2410008940 0x7f241000d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 --2- 10.20.193.51:0/1082964242 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410003cb0 0x7f24100067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 -- 10.20.193.51:0/1082964242 >> 10.20.193.51:0/1082964242 conn(0x7f242c0a30c0 msgr2=0x7f242c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 -- 10.20.193.51:0/1082964242 shutdown_connections 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.611+0000 7f24313e6640 1 -- 10.20.193.51:0/1082964242 wait complete. 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.612+0000 7f24313e6640 10 monclient: build_initial_monmap 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.612+0000 7f24313e6640 10 monclient: monmap: 2026-02-17T12:10:51.618 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 Processor -- start 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 -- start start 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient: init 2026-02-17T12:10:51.619 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 0x7f242c1cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-b con 0x7f2410003cb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 0x7f242c1cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-c con 0x7f2410006d00 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): picked mon.noname-a con 0x7f242c1d02e0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f242c0a04b0 con 0x7f242c1d02e0 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f242c09c850 con 0x7f2410003cb0 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.620 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f242c09dac0 con 0x7f2410006d00 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f24313e6640 10 monclient(hunting): authenticate will time out at 2139.232418s 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 0x7f242c1cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38938/0 (socket says 10.20.193.51:38938) 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 1 -- 10.20.193.51:0/529364635 learned_addr learned my addr 10.20.193.51:0/529364635 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): get_auth_request con 0x7f242c1d02e0 auth_method 0 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242affd640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 msgr2=0x7f242c1cf860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): get_auth_request con 0x7f2410006d00 auth_method 0 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242affd640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 0x7f242c1cf860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.621 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient(hunting): handle_auth_done global_id 304166 payload 824 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 msgr2=0x7f242c1cf860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 0x7f242c1cf860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 msgr2=0x7f242c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 monclient: found mon.noname-c 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242a7fc640 1 -- 10.20.193.51:0/529364635 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c09c600 con 0x7f2410006d00 2026-02-17T12:10:51.622 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.613+0000 7f242b7fe640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:10:51.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f242a7fc640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 msgr2=0x7f242c1cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f242a7fc640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 0x7f242c1cfda0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f241400cbd0 tx=0x7f241400b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.625 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241401c070 con 0x7f2410006d00 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: dump: 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.626 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241400e710 con 0x7f2410006d00 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 5 monclient: authenticate success, global_id 304166 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 10 monclient: _renew_subs 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242c06f410 con 0x7f2410006d00 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.627 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241400eb00 con 0x7f2410006d00 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24297fa640 4 set_mon_vals no callback set 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f240b7fe640 10 monclient: dump: 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.628 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 10 monclient: _renew_subs 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.615+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f242c095ac0 con 0x7f2410006d00 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f24313e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f24313e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f24313e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242c06dae0 con 0x7f2410006d00 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f241400ece0 con 0x7f2410006d00 2026-02-17T12:10:51.629 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f240b7fe640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 0x7f23f8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(903..903 src has 323..903) ==== 4783+0+0 (secure 0 0 0) 0x7f2414052f10 con 0x7f2410006d00 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.616+0000 7f242affd640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 0x7f23f8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.617+0000 7f242affd640 10 monclient: get_auth_request con 0x7f23f803dcc0 auth_method 0 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.619+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f242c06dae0 con 0x7f2410006d00 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.619+0000 7f240b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.619+0000 7f240b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:51.630 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.619+0000 7f242affd640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 0x7f23f8040180 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2420002410 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:3863: done (1 left) 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:3864: done (0 left) 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:3865: rollback oid 23 current snap is 436 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 23 to 433 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:3866: write oid 29 current snap is 436 2026-02-17T12:10:51.707 INFO:tasks.rados.rados.0.trial142.stdout:3866: seq_num 1316 ranges {518012=756753,2025715=92297} 2026-02-17T12:10:51.712 INFO:tasks.rados.rados.0.trial142.stdout:3866: writing trial14245205-29 from 518012 to 1274765 tid 1 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3866: writing trial14245205-29 from 2025715 to 2118012 tid 2 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3867: read oid 36 snap -1 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3867: expect (ObjNum 1302 snap 433 seq_num 1302) 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3868: delete oid 37 current snap is 436 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3865: finishing rollback tid 0 to trial14245205-23 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3865: finishing rollback tid 1 to trial14245205-23 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:3865: finishing rollback tid 2 to trial14245205-23 2026-02-17T12:10:51.716 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 23 v 3153 (ObjNum 1301 snap 433 seq_num 1301) dirty exists 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: finishing write tid 1 to trial14245205-29 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: finishing write tid 2 to trial14245205-29 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: finishing write tid 3 to trial14245205-29 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: finishing write tid 4 to trial14245205-29 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: oid 29 updating version 0 to 3115 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: oid 29 version 3115 is already newer than 3113 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: oid 29 version 3115 is already newer than 3114 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 3115 (ObjNum 1316 snap 436 seq_num 1316) dirty exists 2026-02-17T12:10:51.719 INFO:tasks.rados.rados.0.trial142.stdout:3866: left oid 29 (ObjNum 1316 snap 436 seq_num 1316) 2026-02-17T12:10:51.720 INFO:tasks.rados.rados.0.trial142.stdout:3867: expect (ObjNum 1302 snap 433 seq_num 1302) 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f24313e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f24313e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f24313e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f242c09dea0 con 0x7f2410006d00 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f240b7fe640 1 -- 10.20.193.51:0/529364635 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1551 (secure 0 0 0) 0x7f2414051910 con 0x7f2410006d00 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f240b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.735+0000 7f240b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:51.737 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":238,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 msgr2=0x7f23f8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 0x7f23f8040180 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2420002410 tx=0x7f2420009040 comp rx=0 tx=0).stop 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 10 monclient: shutdown 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 msgr2=0x7f242c1cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 0x7f242c1cfda0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f241400cbd0 tx=0x7f241400b780 comp rx=0 tx=0).stop 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 shutdown_connections 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f23f803dcc0 0x7f23f8040180 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.738 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f242c1d02e0 0x7f242c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2410006d00 0x7f242c1cfda0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 --2- 10.20.193.51:0/529364635 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2410003cb0 0x7f242c1cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 >> 10.20.193.51:0/529364635 conn(0x7f242c0a30c0 msgr2=0x7f242c13ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 shutdown_connections 2026-02-17T12:10:51.739 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.736+0000 7f24313e6640 1 -- 10.20.193.51:0/529364635 wait complete. 2026-02-17T12:10:51.747 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:10:51.747 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:10:51.748 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:10:51.809 INFO:tasks.rados.rados.0.trial142.stdout:3865: done (3 left) 2026-02-17T12:10:51.810 INFO:tasks.rados.rados.0.trial142.stdout:3866: done (2 left) 2026-02-17T12:10:51.810 INFO:tasks.rados.rados.0.trial142.stdout:3867: done (1 left) 2026-02-17T12:10:51.810 INFO:tasks.rados.rados.0.trial142.stdout:3868: done (0 left) 2026-02-17T12:10:51.810 INFO:tasks.rados.rados.0.trial142.stdout:3869: write oid 41 current snap is 436 2026-02-17T12:10:51.810 INFO:tasks.rados.rados.0.trial142.stdout:3869: seq_num 1318 ranges {551626=507251,1626326=418456} 2026-02-17T12:10:51.813 INFO:tasks.rados.rados.0.trial142.stdout:3869: writing trial14245205-41 from 551626 to 1058877 tid 1 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 10 monclient: get_monmap_and_config 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 10 monclient: build_initial_monmap 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 10 monclient: monmap: 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:51.814438+0000 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:51.814438+0000 2026-02-17T12:10:51.815 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:51.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 1 Processor -- start 2026-02-17T12:10:51.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 1 -- start start 2026-02-17T12:10:51.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.813+0000 7f059b7d3640 10 monclient: init 2026-02-17T12:10:51.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f05940a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f05940a0750 0x7f059409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-c con 0x7f05940a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f059413b760 addr v1:10.20.193.142:6789/0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059406e140 con 0x7f05940a3bb0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059409f910 con 0x7f059413b760 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f059409ccd0 con 0x7f05940a0750 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f059b7d3640 10 monclient(hunting): authenticate will time out at 2139.433214s 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f0599548640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f05940a3bb0 0x7f059409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49908/0 (socket says 10.20.193.51:49908) 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f0599d49640 1 -- >> v1:10.20.193.142:6789/0 conn(0x7f059413b760 legacy=0x7f059413db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.142:6789/0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f0599548640 1 -- 10.20.193.51:0/2434065666 learned_addr learned my addr 10.20.193.51:0/2434065666 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f0598d47640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7f05940a0750 msgr2=0x7f059409e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.814+0000 7f0598d47640 1 --2- 10.20.193.51:0/2434065666 >> v2:10.20.193.142:3300/0 conn(0x7f05940a0750 0x7f059409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: writing trial14245205-41 from 1626326 to 2044782 tid 2 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3870: snap_create 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: finishing write tid 1 to trial14245205-41 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: finishing write tid 2 to trial14245205-41 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: finishing write tid 3 to trial14245205-41 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: finishing write tid 4 to trial14245205-41 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: oid 41 updating version 0 to 2754 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: oid 41 updating version 2754 to 2755 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: oid 41 version 2755 is already newer than 2753 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 2755 (ObjNum 1318 snap 436 seq_num 1318) dirty exists 2026-02-17T12:10:51.820 INFO:tasks.rados.rados.0.trial142.stdout:3869: left oid 41 (ObjNum 1318 snap 436 seq_num 1318) 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599548640 1 -- 10.20.193.51:0/2434065666 >> v1:10.20.193.51:6789/0 conn(0x7f05940a3bb0 legacy=0x7f059409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041188730 0 0) 0x7f059406e140 con 0x7f05940a3bb0 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): _negotiate 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): my global_id is 274434 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f057c003620 con 0x7f05940a3bb0 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2402881814 0 0) 0x7f057c003620 con 0x7f05940a3bb0 2026-02-17T12:10:51.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 >> v2:10.20.193.142:3300/0 conn(0x7f05940a0750 msgr2=0x7f059409e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 --2- 10.20.193.51:0/2434065666 >> v2:10.20.193.142:3300/0 conn(0x7f05940a0750 0x7f059409e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 >> v1:10.20.193.142:6789/0 conn(0x7f059413b760 legacy=0x7f059413db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059409eec0 con 0x7f05940a3bb0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f05840031b0 con 0x7f05940a3bb0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f059b7d3640 5 monclient: authenticate success, global_id 274434 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f059b7d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: dump: 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.827 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 >> v1:10.20.193.51:6789/0 conn(0x7f05940a3bb0 legacy=0x7f059409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f057c003b00 0x7f057c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): picked mon.b con 0x7f057c003b00 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f057c004900 0x7f057c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): picked mon.c con 0x7f057c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f057c00bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): picked mon.a con 0x7f057c005510 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f059409ccd0 con 0x7f057c005510 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f057c00c450 con 0x7f057c003b00 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f057c00c650 con 0x7f057c004900 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0583fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f059b7d3640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599548640 1 -- 10.20.193.51:0/2434065666 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f057c003b00 msgr2=0x7f057c003f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599548640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f057c003b00 0x7f057c003f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f057c00bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f057c004900 0x7f057c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): get_auth_request con 0x7f057c005510 auth_method 0 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): get_auth_request con 0x7f057c004900 auth_method 0 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0599d49640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.816+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 10 monclient(hunting): handle_auth_done global_id 274434 payload 293 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 -- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f057c004900 msgr2=0x7f057c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f057c004900 0x7f057c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 -- 10.20.193.51:0/2434065666 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f057c003b00 msgr2=0x7f057c003f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f057c003b00 0x7f057c003f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 monclient: found mon.a 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 -- 10.20.193.51:0/2434065666 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c003620 con 0x7f057c005510 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.817+0000 7f0599d49640 1 -- 10.20.193.51:0/2434065666 reap_dead start 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0599d49640 1 -- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 msgr2=0x7f057c00bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0599d49640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f057c00bb70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0590003db0 tx=0x7f059002f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef27c161f976d3c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590009a30 con 0x7f057c005510 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: dump: 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0590037630 con 0x7f057c005510 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.830 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 1 -- 10.20.193.51:0/2434065666 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590037a20 con 0x7f057c005510 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 4 set_mon_vals no callback set 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f0583fff640 10 monclient: dump: 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 10 monclient: shutdown 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 -- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 msgr2=0x7f057c00bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f057c00bb70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0590003db0 tx=0x7f059002f630 comp rx=0 tx=0).stop 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 -- 10.20.193.51:0/2434065666 shutdown_connections 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 --2- 10.20.193.51:0/2434065666 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f057c00bb70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 -- 10.20.193.51:0/2434065666 >> 10.20.193.51:0/2434065666 conn(0x7f05940a30c0 msgr2=0x7f05940a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 -- 10.20.193.51:0/2434065666 shutdown_connections 2026-02-17T12:10:51.831 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.819+0000 7f059b7d3640 1 -- 10.20.193.51:0/2434065666 wait complete. 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient: build_initial_monmap 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient: monmap: 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 Processor -- start 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 -- start start 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient: init 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f059413b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-a con 0x7f057c005510 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 0x7f0594095f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-c con 0x7f0594095b20 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0594096460 0x7f05941d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): picked mon.noname-b con 0x7f0594096460 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.832 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f05940a04b0 con 0x7f057c005510 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f059409c850 con 0x7f0594096460 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f059409dac0 con 0x7f0594095b20 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f059b7d3640 10 monclient(hunting): authenticate will time out at 2139.439897s 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f059413b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 0x7f0594095f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f059413b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:38962/0 (socket says 10.20.193.51:38962) 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 1 -- 10.20.193.51:0/624031885 learned_addr learned my addr 10.20.193.51:0/624031885 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): get_auth_request con 0x7f057c005510 auth_method 0 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): get_auth_request con 0x7f0594095b20 auth_method 0 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.833 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599d49640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0594096460 msgr2=0x7f05941d5890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599d49640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0594096460 0x7f05941d5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0598d47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.820+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 10 monclient(hunting): handle_auth_done global_id 304169 payload 824 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0594096460 msgr2=0x7f05941d5890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f0594096460 0x7f05941d5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 msgr2=0x7f059413b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.834 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f057c005510 0x7f059413b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 monclient: found mon.noname-c 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.821+0000 7f0598d47640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059409b7d0 con 0x7f0594095b20 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0598d47640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 msgr2=0x7f0594095f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0598d47640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 0x7f0594095f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05880039b0 tx=0x7f058800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588016020 con 0x7f0594095b20 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: dump: 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.835 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588003bf0 con 0x7f0594095b20 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.836 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058800c730 con 0x7f0594095b20 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0581ffb640 10 monclient: dump: 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.837 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f05837fe640 4 set_mon_vals no callback set 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 5 monclient: authenticate success, global_id 304169 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 monclient: _renew_subs 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05940997d0 con 0x7f0594095b20 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 monclient: _renew_subs 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0594073f50 con 0x7f0594095b20 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 0x7f0594091ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0594098520 con 0x7f0594091900 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.823+0000 7f0599548640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 0x7f0594091ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient: get_auth_request con 0x7f0594091900 auth_method 0 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.838 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f058800c910 con 0x7f0594095b20 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 10 monclient(hunting): handle_auth_done global_id 274440 payload 824 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599548640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05940a2910 con 0x7f0594091900 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0581ffb640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f056403dcc0 0x7f0564040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(904..904 src has 323..904) ==== 4783+0+0 (secure 0 0 0) 0x7f0588052290 con 0x7f0594095b20 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599d49640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f056403dcc0 0x7f0564040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.839 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.824+0000 7f0599d49640 10 monclient: get_auth_request con 0x7f056403dcc0 auth_method 0 2026-02-17T12:10:51.841 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0599548640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 msgr2=0x7f0594091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0599548640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 0x7f0594091ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584018070 con 0x7f0594091900 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 10 monclient: dump: 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.842 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f058400fc30 con 0x7f0594091900 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 msgr2=0x7f0594091ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 0x7f0594091ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584007760 comp rx=0 tx=0).stop 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 msgr2=0x7f0594091ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0581ffb640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594091900 0x7f0594091ce0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584007760 comp rx=0 tx=0).stop 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.826+0000 7f0599d49640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f056403dcc0 0x7f0564040180 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f059409f620 tx=0x7f0590005000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f059b7d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:51.843 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f059b7d3640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 0x7f05941d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f059b7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f0594097ea0 con 0x7f0594092220 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 0x7f05941d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient: get_auth_request con 0x7f0594092220 auth_method 0 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 10 monclient(hunting): handle_auth_done global_id 274443 payload 824 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.829+0000 7f0599548640 1 -- 10.20.193.51:0/624031885 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f05940008d0 con 0x7f0594092220 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0599548640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 msgr2=0x7f05941d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.844 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0599548640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 0x7f05941d9df0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584002bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584018040 con 0x7f0594092220 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 10 monclient: dump: 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.845 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4867 (secure 0 0 0) 0x7f058401a3c0 con 0x7f0594092220 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 msgr2=0x7f05941d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 0x7f05941d9df0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584002bb0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 msgr2=0x7f05941d9df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0581ffb640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f0594092220 0x7f05941d9df0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0584007290 tx=0x7f0584002bb0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.846 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 238, 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 223189, 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.847 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.848 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.849 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.850 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.851 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:51.852 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.853 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "num": 5 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:10:51.854 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:51.855 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f056403dcc0 msgr2=0x7f0564040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f056403dcc0 0x7f0564040180 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f059409f620 tx=0x7f0590005000 comp rx=0 tx=0).stop 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 10 monclient: shutdown 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 msgr2=0x7f0594095f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 --2- 10.20.193.51:0/624031885 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f0594095b20 0x7f0594095f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05880039b0 tx=0x7f058800ece0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0599d49640 1 -- 10.20.193.51:0/624031885 reap_dead start 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f0599d49640 1 -- 10.20.193.51:0/624031885 reap_dead start 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 shutdown_connections 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 >> 10.20.193.51:0/624031885 conn(0x7f05940a30c0 msgr2=0x7f059406f760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 shutdown_connections 2026-02-17T12:10:51.856 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.832+0000 7f059b7d3640 1 -- 10.20.193.51:0/624031885 wait complete. 2026-02-17T12:10:51.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:10:51.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:10:51.856 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:10:51.924 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: get_monmap_and_config 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: build_initial_monmap 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: monmap: 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:10:51.924023+0000 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:10:51.924023+0000 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:10:51.925 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 Processor -- start 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 -- start start 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: init 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 0x7fdb8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.926 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-b con 0x7fdb880a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdb880a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 0x7fdb8813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-c con 0x7fdb8813b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8806e140 con 0x7fdb880a0750 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8809f910 con 0x7fdb8813b760 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8809ccd0 con 0x7fdb880a3bb0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8fc98640 10 monclient(hunting): authenticate will time out at 2139.542790s 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 0x7fdb8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8e20e640 1 -- >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 msgr2=0x7fdb8813db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8d20c640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fdb880a0750 0x7fdb8809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:49912/0 (socket says 10.20.193.51:49912) 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8d20c640 1 -- 10.20.193.51:0/3131119444 learned_addr learned my addr 10.20.193.51:0/3131119444 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request con 0x7fdb880a3bb0 auth_method 0 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8e20e640 1 --2- 10.20.193.51:0/3131119444 >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 0x7fdb8813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.923+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_done global_id 304172 payload 274 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 1 -- 10.20.193.51:0/3131119444 >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 msgr2=0x7fdb8813db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/3131119444 >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 0x7fdb8813db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 1 -- 10.20.193.51:0/3131119444 >> v1:10.20.193.51:6789/0 conn(0x7fdb880a0750 legacy=0x7fdb8809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:10:51.927 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 1 monclient: found mon.noname-b 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.924+0000 7fdb8da0d640 1 -- 10.20.193.51:0/3131119444 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8809eec0 con 0x7fdb880a3bb0 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8da0d640 1 -- 10.20.193.51:0/3131119444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 msgr2=0x7fdb8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/3131119444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 0x7fdb8809dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb8809f230 tx=0x7fdb7802eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de60536e928d5fae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 1 -- 10.20.193.51:0/3131119444 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7803c070 con 0x7fdb880a3bb0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: dump: 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 1 -- 10.20.193.51:0/3131119444 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7802fd00 con 0x7fdb880a3bb0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8fc98640 5 monclient: authenticate success, global_id 304172 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8fc98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 1 -- 10.20.193.51:0/3131119444 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78037660 con 0x7fdb880a3bb0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8fc98640 10 monclient: get_monmap_and_config success 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8fc98640 4 set_mon_vals no callback set 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.926+0000 7fdb8ca0b640 10 monclient: dump: 2026-02-17T12:10:51.929 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: shutdown 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- 10.20.193.51:0/3131119444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 msgr2=0x7fdb8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/3131119444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 0x7fdb8809dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb8809f230 tx=0x7fdb7802eda0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- 10.20.193.51:0/3131119444 shutdown_connections 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/3131119444 >> v2:10.20.193.142:3300/0 conn(0x7fdb8813b760 0x7fdb8813db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/3131119444 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb880a3bb0 0x7fdb8809dac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- 10.20.193.51:0/3131119444 >> 10.20.193.51:0/3131119444 conn(0x7fdb880a30c0 msgr2=0x7fdb880a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- 10.20.193.51:0/3131119444 shutdown_connections 2026-02-17T12:10:51.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- 10.20.193.51:0/3131119444 wait complete. 2026-02-17T12:10:51.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: build_initial_monmap 2026-02-17T12:10:51.931 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: monmap: 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 Processor -- start 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 -- start start 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: init 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: _reopen_session rank -1 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdb880a0750 0x7fdb88099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.932 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.927+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-a con 0x7fdb880a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdb880a3bb0 0x7fdb88090b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-b con 0x7fdb880a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 0x7fdb880910c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): picked mon.noname-c con 0x7fdb8813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880a04b0 con 0x7fdb880a0750 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8809c850 con 0x7fdb880a3bb0 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8809e710 con 0x7fdb8813b760 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): _renew_subs 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8fc98640 10 monclient(hunting): authenticate will time out at 2139.547023s 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdb880a0750 0x7fdb88099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8d20c640 1 -- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdb880a3bb0 msgr2=0x7fdb88090b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.142:3300/0 2026-02-17T12:10:51.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 0x7fdb880910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8d20c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdb880a3bb0 0x7fdb88090b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdb880a0750 0x7fdb88099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39002/0 (socket says 10.20.193.51:39002) 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 1 -- 10.20.193.51:0/1581146657 learned_addr learned my addr 10.20.193.51:0/1581146657 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request con 0x7fdb880a0750 auth_method 0 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): get_auth_request con 0x7fdb8813b760 auth_method 0 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.934 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient(hunting): handle_auth_done global_id 304175 payload 824 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdb880a3bb0 msgr2=0x7fdb88090b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fdb880a3bb0 0x7fdb88090b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdb880a0750 msgr2=0x7fdb88099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fdb880a0750 0x7fdb88099f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient: _finish_hunting 0 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 monclient: found mon.noname-c 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.928+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb880947b0 con 0x7fdb8813b760 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 msgr2=0x7fdb880910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.935 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8e20e640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 0x7fdb880910c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400bd90 tx=0x7fdb8400be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.937 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840064e0 con 0x7fdb8813b760 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: dump: 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: _finish_auth 0 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: _check_auth_tickets 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb84010030 con 0x7fdb8813b760 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840068c0 con 0x7fdb8813b760 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.938 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb767fc640 10 monclient: dump: 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb77fff640 4 set_mon_vals no callback set 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 5 monclient: authenticate success, global_id 304175 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 10 monclient: _renew_subs 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb88093f10 con 0x7fdb8813b760 2026-02-17T12:10:51.939 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 10 monclient: _renew_subs 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.930+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb88091600 con 0x7fdb8813b760 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8fc98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fdb84016430 con 0x7fdb8813b760 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 0x7fdb8808d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdb88099460 con 0x7fdb8808d3f0 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 0x7fdb8808d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient: get_auth_request con 0x7fdb8808d3f0 auth_method 0 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.940 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb767fc640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdb5803dd10 0x7fdb580401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_done global_id 304178 payload 824 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8da0d640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb8806f630 con 0x7fdb8808d3f0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(904..904 src has 323..904) ==== 4783+0+0 (secure 0 0 0) 0x7fdb84052d00 con 0x7fdb8813b760 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8d20c640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdb5803dd10 0x7fdb580401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.931+0000 7fdb8d20c640 10 monclient: get_auth_request con 0x7fdb5803dd10 auth_method 0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb8da0d640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 msgr2=0x7fdb8808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 0x7fdb8808d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb78002410 tx=0x7fdb780047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7803c040 con 0x7fdb8808d3f0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.933+0000 7fdb767fc640 10 monclient: dump: 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.941 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fdb78041410 con 0x7fdb8808d3f0 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 msgr2=0x7fdb8808d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 0x7fdb8808d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb78002410 tx=0x7fdb780047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 msgr2=0x7fdb8808d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb767fc640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808d3f0 0x7fdb8808d7d0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb78002410 tx=0x7fdb780047c0 comp rx=0 tx=0).stop 2026-02-17T12:10:51.942 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.934+0000 7fdb8d20c640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdb5803dd10 0x7fdb580401d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdb8809d990 tx=0x7fdb7c007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.936+0000 7fdb8fc98640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.936+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 0x7fdb881d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.936+0000 7fdb8fc98640 10 monclient(hunting): start opening mon connection 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.936+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fdb88092fb0 con 0x7fdb8808dd10 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 0x7fdb881d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient: get_auth_request con 0x7fdb8808dd10 auth_method 0 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:10:51.944 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 10 monclient(hunting): handle_auth_done global_id 304181 payload 824 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.937+0000 7fdb8da0d640 1 -- 10.20.193.51:0/1581146657 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb880a2cb0 con 0x7fdb8808dd10 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8da0d640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 msgr2=0x7fdb881d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8da0d640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 0x7fdb881d7890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb78048000 tx=0x7fdb78008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7803c040 con 0x7fdb8808dd10 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 10 monclient: dump: 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:10:51.945 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4697 (secure 0 0 0) 0x7fdb78051940 con 0x7fdb8808dd10 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 msgr2=0x7fdb881d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 0x7fdb881d7890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb78048000 tx=0x7fdb78008030 comp rx=0 tx=0).stop 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 msgr2=0x7fdb881d7890 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb767fc640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8808dd10 0x7fdb881d7890 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb78048000 tx=0x7fdb78008030 comp rx=0 tx=0).stop 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 238, 2026-02-17T12:10:51.946 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 38206, 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 1, 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.947 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.948 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:10:51.949 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.950 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:10:51.951 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.952 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "num": 3 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:10:51.953 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdb5803dd10 msgr2=0x7fdb580401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fdb5803dd10 0x7fdb580401d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdb8809d990 tx=0x7fdb7c007c20 comp rx=0 tx=0).stop 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 10 monclient: shutdown 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 msgr2=0x7fdb880910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 --2- 10.20.193.51:0/1581146657 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fdb8813b760 0x7fdb880910c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400bd90 tx=0x7fdb8400be90 comp rx=0 tx=0).stop 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 reap_dead start 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8e20e640 1 -- 10.20.193.51:0/1581146657 reap_dead start 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 shutdown_connections 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 >> 10.20.193.51:0/1581146657 conn(0x7fdb880a30c0 msgr2=0x7fdb8813ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 shutdown_connections 2026-02-17T12:10:51.954 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:10:51.939+0000 7fdb8fc98640 1 -- 10.20.193.51:0/1581146657 wait complete. 2026-02-17T12:10:51.955 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:10:51.955 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-17T12:10:52.710 INFO:tasks.rados.rados.0.trial142.stdout:3869: done (1 left) 2026-02-17T12:10:52.710 INFO:tasks.rados.rados.0.trial142.stdout:3870: done (0 left) 2026-02-17T12:10:52.710 INFO:tasks.rados.rados.0.trial142.stdout:3871: snap_remove snap 433 2026-02-17T12:10:53.683 INFO:tasks.rados.rados.0.trial142.stdout:3871: done (0 left) 2026-02-17T12:10:53.683 INFO:tasks.rados.rados.0.trial142.stdout:3872: write (excl) oid 10 current snap is 437 2026-02-17T12:10:53.683 INFO:tasks.rados.rados.0.trial142.stdout:3872: seq_num 1319 ranges {568433=582500,1684808=483625} 2026-02-17T12:10:53.687 INFO:tasks.rados.rados.0.trial142.stdout:3872: writing trial14245205-10 from 568433 to 1150933 tid 1 2026-02-17T12:10:53.691 INFO:tasks.rados.rados.0.trial142.stdout:3872: writing trial14245205-10 from 1684808 to 2168433 tid 2 2026-02-17T12:10:53.691 INFO:tasks.rados.rados.0.trial142.stdout:3873: snap_create 2026-02-17T12:10:53.694 INFO:tasks.rados.rados.0.trial142.stdout:3872: finishing write tid 1 to trial14245205-10 2026-02-17T12:10:53.694 INFO:tasks.rados.rados.0.trial142.stdout:3872: finishing write tid 2 to trial14245205-10 2026-02-17T12:10:53.698 INFO:tasks.rados.rados.0.trial142.stdout:3872: finishing write tid 3 to trial14245205-10 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:3872: finishing write tid 4 to trial14245205-10 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:3872: oid 10 updating version 0 to 3156 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:3872: oid 10 version 3156 is already newer than 3154 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:3872: oid 10 version 3156 is already newer than 3155 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 3156 (ObjNum 1319 snap 437 seq_num 1319) dirty exists 2026-02-17T12:10:53.699 INFO:tasks.rados.rados.0.trial142.stdout:3872: left oid 10 (ObjNum 1319 snap 437 seq_num 1319) 2026-02-17T12:10:54.686 INFO:tasks.rados.rados.0.trial142.stdout:3872: done (1 left) 2026-02-17T12:10:54.686 INFO:tasks.rados.rados.0.trial142.stdout:3873: done (0 left) 2026-02-17T12:10:54.686 INFO:tasks.rados.rados.0.trial142.stdout:3874: write (excl) oid 24 current snap is 438 2026-02-17T12:10:54.687 INFO:tasks.rados.rados.0.trial142.stdout:3874: seq_num 1320 ranges {585240=657749,1743290=422125} 2026-02-17T12:10:54.691 INFO:tasks.rados.rados.0.trial142.stdout:3874: writing trial14245205-24 from 585240 to 1242989 tid 1 2026-02-17T12:10:54.695 INFO:tasks.rados.rados.0.trial142.stdout:3874: writing trial14245205-24 from 1743290 to 2165415 tid 2 2026-02-17T12:10:54.695 INFO:tasks.rados.rados.0.trial142.stdout:3875: write (excl) oid 30 current snap is 438 2026-02-17T12:10:54.695 INFO:tasks.rados.rados.0.trial142.stdout:3875: seq_num 1321 ranges {602047=732998,1801772=400275} 2026-02-17T12:10:54.700 INFO:tasks.rados.rados.0.trial142.stdout:3875: writing trial14245205-30 from 602047 to 1335045 tid 1 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3875: writing trial14245205-30 from 1801772 to 2202047 tid 2 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3876: copy_from oid 38 from oid 31 current snap is 438 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: finishing write tid 1 to trial14245205-24 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: finishing write tid 2 to trial14245205-24 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: finishing write tid 3 to trial14245205-24 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: finishing write tid 4 to trial14245205-24 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: oid 24 updating version 0 to 2730 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: oid 24 version 2730 is already newer than 2728 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: oid 24 version 2730 is already newer than 2729 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2730 (ObjNum 1320 snap 438 seq_num 1320) dirty exists 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: left oid 24 (ObjNum 1320 snap 438 seq_num 1320) 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3874: done (2 left) 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:3877: rollback oid 35 current snap is 438 2026-02-17T12:10:54.704 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 35 to 436 2026-02-17T12:10:54.705 INFO:tasks.rados.rados.0.trial142.stdout:3878: write (excl) oid 5 current snap is 438 2026-02-17T12:10:54.705 INFO:tasks.rados.rados.0.trial142.stdout:3878: seq_num 1322 ranges {618854=408247,1743901=425794} 2026-02-17T12:10:54.708 INFO:tasks.rados.rados.0.trial142.stdout:3878: writing trial14245205-5 from 618854 to 1027101 tid 1 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3878: writing trial14245205-5 from 1743901 to 2169695 tid 2 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3879: rollback oid 33 current snap is 438 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 33 to 434 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: finishing write tid 1 to trial14245205-30 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: finishing write tid 2 to trial14245205-30 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: finishing write tid 3 to trial14245205-30 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: finishing write tid 4 to trial14245205-30 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: oid 30 updating version 0 to 3117 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: oid 30 updating version 3117 to 3118 2026-02-17T12:10:54.712 INFO:tasks.rados.rados.0.trial142.stdout:3875: oid 30 version 3118 is already newer than 3116 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 30 v 3118 (ObjNum 1321 snap 438 seq_num 1321) dirty exists 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3875: left oid 30 (ObjNum 1321 snap 438 seq_num 1321) 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3877: finishing rollback tid 0 to trial14245205-35 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3875: done (4 left) 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3880: snap_create 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3877: finishing rollback tid 1 to trial14245205-35 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3877: finishing rollback tid 2 to trial14245205-35 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 35 v 3721 (ObjNum 1204 snap 390 seq_num 1204) dirty exists 2026-02-17T12:10:54.713 INFO:tasks.rados.rados.0.trial142.stdout:3878: finishing write tid 1 to trial14245205-5 2026-02-17T12:10:54.714 INFO:tasks.rados.rados.0.trial142.stdout:3878: finishing write tid 2 to trial14245205-5 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: finishing write tid 3 to trial14245205-5 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: finishing write tid 4 to trial14245205-5 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: oid 5 updating version 0 to 2778 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: oid 5 updating version 2778 to 2779 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: oid 5 version 2779 is already newer than 2777 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2779 (ObjNum 1322 snap 438 seq_num 1322) dirty exists 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3878: left oid 5 (ObjNum 1322 snap 438 seq_num 1322) 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3879: finishing rollback tid 0 to trial14245205-33 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3879: finishing rollback tid 1 to trial14245205-33 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:3879: finishing rollback tid 2 to trial14245205-33 2026-02-17T12:10:54.715 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 33 v 3724 (ObjNum 1248 snap 407 seq_num 1248) dirty exists 2026-02-17T12:10:54.716 INFO:tasks.rados.rados.0.trial142.stdout:3876: finishing copy_from racing read to trial14245205-38 2026-02-17T12:10:54.718 INFO:tasks.rados.rados.0.trial142.stdout:3876: finishing copy_from to trial14245205-38 2026-02-17T12:10:54.718 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3715 (ObjNum 1304 snap 433 seq_num 1304) dirty exists 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3876: done (4 left) 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3877: done (3 left) 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3878: done (2 left) 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3879: done (1 left) 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3880: done (0 left) 2026-02-17T12:10:55.712 INFO:tasks.rados.rados.0.trial142.stdout:3881: delete oid 33 current snap is 439 2026-02-17T12:10:55.715 INFO:tasks.rados.rados.0.trial142.stdout:3881: done (0 left) 2026-02-17T12:10:55.715 INFO:tasks.rados.rados.0.trial142.stdout:3882: write (excl) oid 32 current snap is 439 2026-02-17T12:10:55.715 INFO:tasks.rados.rados.0.trial142.stdout:3882: seq_num 1324 ranges {652468=675098,1977218=275250} 2026-02-17T12:10:55.720 INFO:tasks.rados.rados.0.trial142.stdout:3882: writing trial14245205-32 from 652468 to 1327566 tid 1 2026-02-17T12:10:55.724 INFO:tasks.rados.rados.0.trial142.stdout:3882: writing trial14245205-32 from 1977218 to 2252468 tid 2 2026-02-17T12:10:55.724 INFO:tasks.rados.rados.0.trial142.stdout:3883: snap_remove snap 435 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3883: done (1 left) 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3884: read oid 1 snap 437 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3884: expect (ObjNum 1309 snap 433 seq_num 1309) 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3885: rollback oid 47 current snap is 439 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 47 to 434 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3882: finishing write tid 1 to trial14245205-32 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3882: finishing write tid 2 to trial14245205-32 2026-02-17T12:10:56.715 INFO:tasks.rados.rados.0.trial142.stdout:3882: finishing write tid 3 to trial14245205-32 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: finishing write tid 4 to trial14245205-32 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: oid 32 updating version 0 to 3114 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: oid 32 updating version 3114 to 3116 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: oid 32 version 3116 is already newer than 3115 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 3116 (ObjNum 1324 snap 439 seq_num 1324) dirty exists 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: left oid 32 (ObjNum 1324 snap 439 seq_num 1324) 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3882: done (2 left) 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3886: write (excl) oid 14 current snap is 439 2026-02-17T12:10:56.716 INFO:tasks.rados.rados.0.trial142.stdout:3886: seq_num 1325 ranges {669275=750347,2035700=233575} 2026-02-17T12:10:56.720 INFO:tasks.rados.rados.0.trial142.stdout:3886: writing trial14245205-14 from 669275 to 1419622 tid 1 2026-02-17T12:10:56.724 INFO:tasks.rados.rados.0.trial142.stdout:3886: writing trial14245205-14 from 2035700 to 2269275 tid 2 2026-02-17T12:10:56.724 INFO:tasks.rados.rados.0.trial142.stdout:3887: copy_from oid 40 from oid 3 current snap is 439 2026-02-17T12:10:56.724 INFO:tasks.rados.rados.0.trial142.stdout:3885: finishing rollback tid 1 to trial14245205-47 2026-02-17T12:10:56.724 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 47 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T12:10:56.724 INFO:tasks.rados.rados.0.trial142.stdout:3884: expect (ObjNum 1309 snap 433 seq_num 1309) 2026-02-17T12:10:56.789 INFO:tasks.rados.rados.0.trial142.stdout:3886: finishing write tid 1 to trial14245205-14 2026-02-17T12:10:56.789 INFO:tasks.rados.rados.0.trial142.stdout:3886: finishing write tid 2 to trial14245205-14 2026-02-17T12:10:56.789 INFO:tasks.rados.rados.0.trial142.stdout:3886: finishing write tid 3 to trial14245205-14 2026-02-17T12:10:56.789 INFO:tasks.rados.rados.0.trial142.stdout:3884: done (3 left) 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3885: done (2 left) 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3888: snap_create 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3886: finishing write tid 4 to trial14245205-14 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3886: oid 14 updating version 0 to 3860 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3886: oid 14 version 3860 is already newer than 3859 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3886: oid 14 version 3860 is already newer than 3858 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3860 (ObjNum 1325 snap 439 seq_num 1325) dirty exists 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3886: left oid 14 (ObjNum 1325 snap 439 seq_num 1325) 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3887: finishing copy_from racing read to trial14245205-40 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:3887: finishing copy_from to trial14245205-40 2026-02-17T12:10:56.790 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 2777 (ObjNum 1315 snap 433 seq_num 1315) dirty exists 2026-02-17T12:10:57.716 INFO:tasks.rados.rados.0.trial142.stdout:3886: done (2 left) 2026-02-17T12:10:57.717 INFO:tasks.rados.rados.0.trial142.stdout:3887: done (1 left) 2026-02-17T12:10:57.717 INFO:tasks.rados.rados.0.trial142.stdout:3888: done (0 left) 2026-02-17T12:10:57.717 INFO:tasks.rados.rados.0.trial142.stdout:3889: copy_from oid 43 from oid 39 current snap is 440 2026-02-17T12:10:57.717 INFO:tasks.rados.rados.0.trial142.stdout:3890: delete oid 13 current snap is 440 2026-02-17T12:10:57.719 INFO:tasks.rados.rados.0.trial142.stdout:3890: done (1 left) 2026-02-17T12:10:57.719 INFO:tasks.rados.rados.0.trial142.stdout:3891: copy_from oid 45 from oid 15 current snap is 440 2026-02-17T12:10:57.719 INFO:tasks.rados.rados.0.trial142.stdout:3892: snap_create 2026-02-17T12:10:57.720 INFO:tasks.rados.rados.0.trial142.stdout:3891: finishing copy_from to trial14245205-45 2026-02-17T12:10:57.720 INFO:tasks.rados.rados.0.trial142.stdout:3891: got expected ENOENT (src dne) 2026-02-17T12:10:57.720 INFO:tasks.rados.rados.0.trial142.stdout:3891: finishing copy_from racing read to trial14245205-45 2026-02-17T12:10:57.727 INFO:tasks.rados.rados.0.trial142.stdout:3889: finishing copy_from racing read to trial14245205-43 2026-02-17T12:10:57.728 INFO:tasks.rados.rados.0.trial142.stdout:3889: finishing copy_from to trial14245205-43 2026-02-17T12:10:57.728 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 2727 (ObjNum 1298 snap 433 seq_num 1298) dirty exists 2026-02-17T12:10:58.685 INFO:tasks.rados.rados.0.trial142.stdout:3889: done (2 left) 2026-02-17T12:10:58.685 INFO:tasks.rados.rados.0.trial142.stdout:3891: done (1 left) 2026-02-17T12:10:58.685 INFO:tasks.rados.rados.0.trial142.stdout:3892: done (0 left) 2026-02-17T12:10:58.685 INFO:tasks.rados.rados.0.trial142.stdout:3893: read oid 27 snap 437 2026-02-17T12:10:58.686 INFO:tasks.rados.rados.0.trial142.stdout:3893: expect (ObjNum 1169 snap 378 seq_num 1169) 2026-02-17T12:10:58.686 INFO:tasks.rados.rados.0.trial142.stdout:3894: write (excl) oid 26 current snap is 441 2026-02-17T12:10:58.686 INFO:tasks.rados.rados.0.trial142.stdout:3894: seq_num 1327 ranges {702889=500845,1636311=576790} 2026-02-17T12:10:58.690 INFO:tasks.rados.rados.0.trial142.stdout:3894: writing trial14245205-26 from 702889 to 1203734 tid 1 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3894: writing trial14245205-26 from 1636311 to 2213101 tid 2 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3895: read oid 10 snap 438 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3895: expect (ObjNum 1319 snap 437 seq_num 1319) 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3896: read oid 8 snap 430 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3896: expect (ObjNum 1254 snap 412 seq_num 1254) 2026-02-17T12:10:58.695 INFO:tasks.rados.rados.0.trial142.stdout:3897: read oid 11 snap -1 2026-02-17T12:10:58.696 INFO:tasks.rados.rados.0.trial142.stdout:3897: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:10:58.696 INFO:tasks.rados.rados.0.trial142.stdout:3898: write oid 45 current snap is 441 2026-02-17T12:10:58.696 INFO:tasks.rados.rados.0.trial142.stdout:3898: seq_num 1328 ranges {719696=576094,2094793=224903} 2026-02-17T12:10:58.698 INFO:tasks.rados.rados.0.trial142.stdout:3898: writing trial14245205-45 from 719696 to 1295790 tid 1 2026-02-17T12:10:58.703 INFO:tasks.rados.rados.0.trial142.stdout:3898: writing trial14245205-45 from 2094793 to 2319696 tid 2 2026-02-17T12:10:58.703 INFO:tasks.rados.rados.0.trial142.stdout:3899: read oid 1 snap -1 2026-02-17T12:10:58.703 INFO:tasks.rados.rados.0.trial142.stdout:3899: expect (ObjNum 1309 snap 433 seq_num 1309) 2026-02-17T12:10:58.703 INFO:tasks.rados.rados.0.trial142.stdout:3900: copy_from oid 21 from oid 3 current snap is 441 2026-02-17T12:10:58.703 INFO:tasks.rados.rados.0.trial142.stdout:3893: expect (ObjNum 1169 snap 378 seq_num 1169) 2026-02-17T12:10:58.872 INFO:tasks.rados.rados.0.trial142.stdout:3894: finishing write tid 1 to trial14245205-26 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3893: done (7 left) 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3901: read oid 18 snap 419 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3901: expect (ObjNum 1115 snap 361 seq_num 1115) 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3902: copy_from oid 2 from oid 25 current snap is 441 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3894: finishing write tid 2 to trial14245205-26 2026-02-17T12:10:58.873 INFO:tasks.rados.rados.0.trial142.stdout:3894: finishing write tid 3 to trial14245205-26 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3894: finishing write tid 4 to trial14245205-26 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3894: oid 26 updating version 0 to 2789 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3894: oid 26 updating version 2789 to 2790 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3894: oid 26 updating version 2790 to 2791 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 26 v 2791 (ObjNum 1327 snap 441 seq_num 1327) dirty exists 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3894: left oid 26 (ObjNum 1327 snap 441 seq_num 1327) 2026-02-17T12:10:58.874 INFO:tasks.rados.rados.0.trial142.stdout:3896: expect (ObjNum 1254 snap 412 seq_num 1254) 2026-02-17T12:10:58.974 INFO:tasks.rados.rados.0.trial142.stdout:3895: expect (ObjNum 1319 snap 437 seq_num 1319) 2026-02-17T12:10:59.056 INFO:tasks.rados.rados.0.trial142.stdout:3897: expect (ObjNum 1246 snap 407 seq_num 1246) 2026-02-17T12:10:59.168 INFO:tasks.rados.rados.0.trial142.stdout:3898: finishing write tid 1 to trial14245205-45 2026-02-17T12:10:59.168 INFO:tasks.rados.rados.0.trial142.stdout:3894: done (8 left) 2026-02-17T12:10:59.168 INFO:tasks.rados.rados.0.trial142.stdout:3895: done (7 left) 2026-02-17T12:10:59.168 INFO:tasks.rados.rados.0.trial142.stdout:3896: done (6 left) 2026-02-17T12:10:59.168 INFO:tasks.rados.rados.0.trial142.stdout:3897: done (5 left) 2026-02-17T12:10:59.169 INFO:tasks.rados.rados.0.trial142.stdout:3903: snap_remove snap 438 2026-02-17T12:10:59.723 INFO:tasks.rados.rados.0.trial142.stdout:3903: done (5 left) 2026-02-17T12:10:59.724 INFO:tasks.rados.rados.0.trial142.stdout:3904: snap_create 2026-02-17T12:10:59.724 INFO:tasks.rados.rados.0.trial142.stdout:3899: expect (ObjNum 1309 snap 433 seq_num 1309) 2026-02-17T12:10:59.788 INFO:tasks.rados.rados.0.trial142.stdout:3898: finishing write tid 2 to trial14245205-45 2026-02-17T12:10:59.788 INFO:tasks.rados.rados.0.trial142.stdout:3898: finishing write tid 3 to trial14245205-45 2026-02-17T12:10:59.788 INFO:tasks.rados.rados.0.trial142.stdout:3898: finishing write tid 4 to trial14245205-45 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3898: oid 45 updating version 0 to 2760 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3898: oid 45 updating version 2760 to 2762 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3898: oid 45 version 2762 is already newer than 2761 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2762 (ObjNum 1328 snap 441 seq_num 1328) dirty exists 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3898: left oid 45 (ObjNum 1328 snap 441 seq_num 1328) 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3900: finishing copy_from racing read to trial14245205-21 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3900: finishing copy_from to trial14245205-21 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 21 v 2777 (ObjNum 1315 snap 433 seq_num 1315) dirty exists 2026-02-17T12:10:59.789 INFO:tasks.rados.rados.0.trial142.stdout:3901: expect (ObjNum 1115 snap 361 seq_num 1115) 2026-02-17T12:10:59.877 INFO:tasks.rados.rados.0.trial142.stdout:3902: finishing copy_from racing read to trial14245205-2 2026-02-17T12:10:59.878 INFO:tasks.rados.rados.0.trial142.stdout:3902: finishing copy_from to trial14245205-2 2026-02-17T12:10:59.878 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2782 (ObjNum 1308 snap 433 seq_num 1308) dirty exists 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3898: done (5 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3899: done (4 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3900: done (3 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3901: done (2 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3902: done (1 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3904: done (0 left) 2026-02-17T12:11:00.726 INFO:tasks.rados.rados.0.trial142.stdout:3905: copy_from oid 50 from oid 22 current snap is 442 2026-02-17T12:11:00.727 INFO:tasks.rados.rados.0.trial142.stdout:3906: snap_remove snap 441 2026-02-17T12:11:01.728 INFO:tasks.rados.rados.0.trial142.stdout:3906: done (1 left) 2026-02-17T12:11:01.728 INFO:tasks.rados.rados.0.trial142.stdout:3907: delete oid 30 current snap is 442 2026-02-17T12:11:01.728 INFO:tasks.rados.rados.0.trial142.stdout:3905: finishing copy_from racing read to trial14245205-50 2026-02-17T12:11:01.728 INFO:tasks.rados.rados.0.trial142.stdout:3905: finishing copy_from to trial14245205-50 2026-02-17T12:11:01.729 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 3146 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2026-02-17T12:11:01.730 INFO:tasks.rados.rados.0.trial142.stdout:3905: done (1 left) 2026-02-17T12:11:01.730 INFO:tasks.rados.rados.0.trial142.stdout:3907: done (0 left) 2026-02-17T12:11:01.730 INFO:tasks.rados.rados.0.trial142.stdout:3908: snap_create 2026-02-17T12:11:02.730 INFO:tasks.rados.rados.0.trial142.stdout:3908: done (0 left) 2026-02-17T12:11:02.731 INFO:tasks.rados.rados.0.trial142.stdout:3909: write oid 24 current snap is 443 2026-02-17T12:11:02.731 INFO:tasks.rados.rados.0.trial142.stdout:3909: seq_num 1330 ranges {753310=726592,2095404=257906} 2026-02-17T12:11:02.736 INFO:tasks.rados.rados.0.trial142.stdout:3909: writing trial14245205-24 from 753310 to 1479902 tid 1 2026-02-17T12:11:02.739 INFO:tasks.rados.rados.0.trial142.stdout:3909: writing trial14245205-24 from 2095404 to 2353310 tid 2 2026-02-17T12:11:02.739 INFO:tasks.rados.rados.0.trial142.stdout:3910: snap_remove snap 434 2026-02-17T12:11:02.739 INFO:tasks.rados.rados.0.trial142.stdout:3909: finishing write tid 1 to trial14245205-24 2026-02-17T12:11:03.757 INFO:tasks.rados.rados.0.trial142.stdout:3910: done (1 left) 2026-02-17T12:11:03.757 INFO:tasks.rados.rados.0.trial142.stdout:3911: write (excl) oid 42 current snap is 443 2026-02-17T12:11:03.757 INFO:tasks.rados.rados.0.trial142.stdout:3911: seq_num 1331 ranges {770117=518194,1870239=499878} 2026-02-17T12:11:03.762 INFO:tasks.rados.rados.0.trial142.stdout:3911: writing trial14245205-42 from 770117 to 1288311 tid 1 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3911: writing trial14245205-42 from 1870239 to 2370117 tid 2 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3912: copy_from oid 32 from oid 28 current snap is 443 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: finishing write tid 2 to trial14245205-24 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: finishing write tid 3 to trial14245205-24 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3913: snap_create 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: finishing write tid 4 to trial14245205-24 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: oid 24 updating version 0 to 2732 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: oid 24 updating version 2732 to 2733 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: oid 24 version 2733 is already newer than 2731 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 2733 (ObjNum 1330 snap 443 seq_num 1330) dirty exists 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3909: left oid 24 (ObjNum 1330 snap 443 seq_num 1330) 2026-02-17T12:11:03.767 INFO:tasks.rados.rados.0.trial142.stdout:3911: finishing write tid 1 to trial14245205-42 2026-02-17T12:11:03.768 INFO:tasks.rados.rados.0.trial142.stdout:3911: finishing write tid 2 to trial14245205-42 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: finishing write tid 3 to trial14245205-42 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: finishing write tid 4 to trial14245205-42 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: oid 42 updating version 0 to 3119 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: oid 42 version 3119 is already newer than 3118 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: oid 42 version 3119 is already newer than 3117 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 42 v 3119 (ObjNum 1331 snap 443 seq_num 1331) dirty exists 2026-02-17T12:11:03.769 INFO:tasks.rados.rados.0.trial142.stdout:3911: left oid 42 (ObjNum 1331 snap 443 seq_num 1331) 2026-02-17T12:11:03.774 INFO:tasks.rados.rados.0.trial142.stdout:3912: finishing copy_from racing read to trial14245205-32 2026-02-17T12:11:03.776 INFO:tasks.rados.rados.0.trial142.stdout:3912: finishing copy_from to trial14245205-32 2026-02-17T12:11:03.776 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 32 v 2762 (ObjNum 1230 snap 406 seq_num 1230) dirty exists 2026-02-17T12:11:04.734 INFO:tasks.rados.rados.0.trial142.stdout:3909: done (3 left) 2026-02-17T12:11:04.734 INFO:tasks.rados.rados.0.trial142.stdout:3911: done (2 left) 2026-02-17T12:11:04.734 INFO:tasks.rados.rados.0.trial142.stdout:3912: done (1 left) 2026-02-17T12:11:04.734 INFO:tasks.rados.rados.0.trial142.stdout:3913: done (0 left) 2026-02-17T12:11:04.734 INFO:tasks.rados.rados.0.trial142.stdout:3914: snap_remove snap 437 2026-02-17T12:11:05.734 INFO:tasks.rados.rados.0.trial142.stdout:3914: done (0 left) 2026-02-17T12:11:05.734 INFO:tasks.rados.rados.0.trial142.stdout:3915: delete oid 26 current snap is 444 2026-02-17T12:11:05.739 INFO:tasks.rados.rados.0.trial142.stdout:3915: done (0 left) 2026-02-17T12:11:05.739 INFO:tasks.rados.rados.0.trial142.stdout:3916: write oid 15 current snap is 444 2026-02-17T12:11:05.739 INFO:tasks.rados.rados.0.trial142.stdout:3916: seq_num 1333 ranges {403731=668692,1587203=587797} 2026-02-17T12:11:05.743 INFO:tasks.rados.rados.0.trial142.stdout:3916: writing trial14245205-15 from 403731 to 1072423 tid 1 2026-02-17T12:11:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3916: writing trial14245205-15 from 1587203 to 2175000 tid 2 2026-02-17T12:11:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3917: snap_create 2026-02-17T12:11:05.748 INFO:tasks.rados.rados.0.trial142.stdout:3916: finishing write tid 1 to trial14245205-15 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: finishing write tid 2 to trial14245205-15 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: finishing write tid 3 to trial14245205-15 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: finishing write tid 4 to trial14245205-15 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: oid 15 updating version 0 to 3729 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: oid 15 version 3729 is already newer than 3727 2026-02-17T12:11:05.750 INFO:tasks.rados.rados.0.trial142.stdout:3916: oid 15 version 3729 is already newer than 3728 2026-02-17T12:11:05.751 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 15 v 3729 (ObjNum 1333 snap 444 seq_num 1333) dirty exists 2026-02-17T12:11:05.751 INFO:tasks.rados.rados.0.trial142.stdout:3916: left oid 15 (ObjNum 1333 snap 444 seq_num 1333) 2026-02-17T12:11:06.737 INFO:tasks.rados.rados.0.trial142.stdout:3916: done (1 left) 2026-02-17T12:11:06.738 INFO:tasks.rados.rados.0.trial142.stdout:3917: done (0 left) 2026-02-17T12:11:06.738 INFO:tasks.rados.rados.0.trial142.stdout:3918: snap_create 2026-02-17T12:11:07.738 INFO:tasks.rados.rados.0.trial142.stdout:3918: done (0 left) 2026-02-17T12:11:07.739 INFO:tasks.rados.rados.0.trial142.stdout:3919: snap_create 2026-02-17T12:11:08.686 INFO:tasks.rados.rados.0.trial142.stdout:3919: done (0 left) 2026-02-17T12:11:08.687 INFO:tasks.rados.rados.0.trial142.stdout:3920: write (excl) oid 5 current snap is 447 2026-02-17T12:11:08.687 INFO:tasks.rados.rados.0.trial142.stdout:3920: seq_num 1334 ranges {420538=743941,1929332=491206} 2026-02-17T12:11:08.690 INFO:tasks.rados.rados.0.trial142.stdout:3920: writing trial14245205-5 from 420538 to 1164479 tid 1 2026-02-17T12:11:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3920: writing trial14245205-5 from 1929332 to 2420538 tid 2 2026-02-17T12:11:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3921: delete oid 28 current snap is 447 2026-02-17T12:11:08.695 INFO:tasks.rados.rados.0.trial142.stdout:3920: finishing write tid 1 to trial14245205-5 2026-02-17T12:11:08.698 INFO:tasks.rados.rados.0.trial142.stdout:3920: finishing write tid 2 to trial14245205-5 2026-02-17T12:11:08.698 INFO:tasks.rados.rados.0.trial142.stdout:3920: finishing write tid 3 to trial14245205-5 2026-02-17T12:11:08.698 INFO:tasks.rados.rados.0.trial142.stdout:3920: finishing write tid 4 to trial14245205-5 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3920: oid 5 updating version 0 to 2780 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3920: oid 5 updating version 2780 to 2782 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3920: oid 5 version 2782 is already newer than 2781 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 5 v 2782 (ObjNum 1334 snap 447 seq_num 1334) dirty exists 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3920: left oid 5 (ObjNum 1334 snap 447 seq_num 1334) 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3920: done (1 left) 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3921: done (0 left) 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3922: rollback oid 6 current snap is 447 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 6 to 443 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3923: write (excl) oid 43 current snap is 447 2026-02-17T12:11:08.699 INFO:tasks.rados.rados.0.trial142.stdout:3923: seq_num 1336 ranges {454152=494439,1646296=735124} 2026-02-17T12:11:08.701 INFO:tasks.rados.rados.0.trial142.stdout:3923: writing trial14245205-43 from 454152 to 948591 tid 1 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:3923: writing trial14245205-43 from 1646296 to 2381420 tid 2 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:3924: delete oid 4 current snap is 447 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:3922: finishing rollback tid 0 to trial14245205-6 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:3922: finishing rollback tid 1 to trial14245205-6 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:3922: finishing rollback tid 2 to trial14245205-6 2026-02-17T12:11:08.707 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3387 (ObjNum 1299 snap 433 seq_num 1299) dirty exists 2026-02-17T12:11:08.913 INFO:tasks.rados.rados.0.trial142.stdout:3923: finishing write tid 1 to trial14245205-43 2026-02-17T12:11:08.914 INFO:tasks.rados.rados.0.trial142.stdout:3923: finishing write tid 2 to trial14245205-43 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: finishing write tid 3 to trial14245205-43 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: finishing write tid 4 to trial14245205-43 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: oid 43 updating version 0 to 3871 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: oid 43 updating version 3871 to 3872 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: oid 43 updating version 3872 to 3873 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 43 v 3873 (ObjNum 1336 snap 447 seq_num 1336) dirty exists 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: left oid 43 (ObjNum 1336 snap 447 seq_num 1336) 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3922: done (2 left) 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3923: done (1 left) 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3924: done (0 left) 2026-02-17T12:11:08.915 INFO:tasks.rados.rados.0.trial142.stdout:3925: snap_remove snap 445 2026-02-17T12:11:09.744 INFO:tasks.rados.rados.0.trial142.stdout:3925: done (0 left) 2026-02-17T12:11:09.744 INFO:tasks.rados.rados.0.trial142.stdout:3926: delete oid 10 current snap is 447 2026-02-17T12:11:09.748 INFO:tasks.rados.rados.0.trial142.stdout:3926: done (0 left) 2026-02-17T12:11:09.748 INFO:tasks.rados.rados.0.trial142.stdout:3927: write oid 38 current snap is 447 2026-02-17T12:11:09.748 INFO:tasks.rados.rados.0.trial142.stdout:3927: seq_num 1339 ranges {504573=436539,1421742=598804,2437505=67068} 2026-02-17T12:11:09.751 INFO:tasks.rados.rados.0.trial142.stdout:3927: writing trial14245205-38 from 504573 to 941112 tid 1 2026-02-17T12:11:09.755 INFO:tasks.rados.rados.0.trial142.stdout:3927: writing trial14245205-38 from 1421742 to 2020546 tid 2 2026-02-17T12:11:09.758 INFO:tasks.rados.rados.0.trial142.stdout:3927: writing trial14245205-38 from 2437505 to 2504573 tid 3 2026-02-17T12:11:09.758 INFO:tasks.rados.rados.0.trial142.stdout:3928: copy_from oid 3 from oid 43 current snap is 447 2026-02-17T12:11:09.759 INFO:tasks.rados.rados.0.trial142.stdout:3927: finishing write tid 1 to trial14245205-38 2026-02-17T12:11:09.759 INFO:tasks.rados.rados.0.trial142.stdout:3929: rollback oid 2 current snap is 447 2026-02-17T12:11:09.759 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 2 to 436 2026-02-17T12:11:09.759 INFO:tasks.rados.rados.0.trial142.stdout:3930: copy_from oid 24 from oid 10 current snap is 447 2026-02-17T12:11:09.759 INFO:tasks.rados.rados.0.trial142.stdout:3931: snap_remove snap 442 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3931: done (4 left) 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3932: delete oid 26 current snap is 447 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3930: finishing copy_from to trial14245205-24 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3930: got expected ENOENT (src dne) 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3930: finishing copy_from racing read to trial14245205-24 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: finishing write tid 2 to trial14245205-38 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: finishing write tid 3 to trial14245205-38 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: finishing write tid 4 to trial14245205-38 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: finishing write tid 5 to trial14245205-38 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: oid 38 updating version 0 to 3718 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: oid 38 version 3718 is already newer than 3717 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: oid 38 updating version 3718 to 3719 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: oid 38 version 3719 is already newer than 3716 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 38 v 3719 (ObjNum 1339 snap 447 seq_num 1339) dirty exists 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3927: left oid 38 (ObjNum 1339 snap 447 seq_num 1339) 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3929: finishing rollback tid 0 to trial14245205-2 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3929: finishing rollback tid 1 to trial14245205-2 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3929: finishing rollback tid 2 to trial14245205-2 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 2 v 2785 (ObjNum 1266 snap 415 seq_num 1266) dirty exists 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3928: finishing copy_from racing read to trial14245205-3 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:3928: finishing copy_from to trial14245205-3 2026-02-17T12:11:10.746 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 3873 (ObjNum 1336 snap 447 seq_num 1336) dirty exists 2026-02-17T12:11:10.750 INFO:tasks.rados.rados.0.trial142.stdout:3927: done (4 left) 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3928: done (3 left) 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3929: done (2 left) 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3930: done (1 left) 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3932: done (0 left) 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3933: write oid 22 current snap is 447 2026-02-17T12:11:10.751 INFO:tasks.rados.rados.0.trial142.stdout:3933: seq_num 1341 ranges {538187=587037,1538706=602473} 2026-02-17T12:11:10.755 INFO:tasks.rados.rados.0.trial142.stdout:3933: writing trial14245205-22 from 538187 to 1125224 tid 1 2026-02-17T12:11:10.759 INFO:tasks.rados.rados.0.trial142.stdout:3933: writing trial14245205-22 from 1538706 to 2141179 tid 2 2026-02-17T12:11:10.759 INFO:tasks.rados.rados.0.trial142.stdout:3934: copy_from oid 36 from oid 30 current snap is 447 2026-02-17T12:11:10.759 INFO:tasks.rados.rados.0.trial142.stdout:3933: finishing write tid 1 to trial14245205-22 2026-02-17T12:11:10.759 INFO:tasks.rados.rados.0.trial142.stdout:3935: snap_create 2026-02-17T12:11:10.761 INFO:tasks.rados.rados.0.trial142.stdout:3934: finishing copy_from to trial14245205-36 2026-02-17T12:11:10.761 INFO:tasks.rados.rados.0.trial142.stdout:3934: got expected ENOENT (src dne) 2026-02-17T12:11:10.761 INFO:tasks.rados.rados.0.trial142.stdout:3934: finishing copy_from racing read to trial14245205-36 2026-02-17T12:11:10.761 INFO:tasks.rados.rados.0.trial142.stdout:3933: finishing write tid 2 to trial14245205-22 2026-02-17T12:11:10.761 INFO:tasks.rados.rados.0.trial142.stdout:3933: finishing write tid 3 to trial14245205-22 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:3933: finishing write tid 4 to trial14245205-22 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:3933: oid 22 updating version 0 to 3158 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:3933: oid 22 version 3158 is already newer than 3157 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:3933: oid 22 version 3158 is already newer than 3156 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 3158 (ObjNum 1341 snap 447 seq_num 1341) dirty exists 2026-02-17T12:11:10.762 INFO:tasks.rados.rados.0.trial142.stdout:3933: left oid 22 (ObjNum 1341 snap 447 seq_num 1341) 2026-02-17T12:11:11.955 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:11:11.956 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T12:11:11.956 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:11:11.956 DEBUG:teuthology.orchestra.run.trial142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:11:11.959 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:11:11.959 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:11:11.959 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:11:12.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: get_monmap_and_config 2026-02-17T12:11:12.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: build_initial_monmap 2026-02-17T12:11:12.031 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: monmap: 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:12.028225+0000 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:12.028225+0000 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:12.032 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 Processor -- start 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 -- start start 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: init 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa00c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-b con 0x7fa00c09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:12.033 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa00c0a0110 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00c06e140 con 0x7fa00c0a0110 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00c09ce60 con 0x7fa00c0a3bb0 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.027+0000 7fa0144b9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c09aed0 con 0x7fa00c09dac0 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa0144b9640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa0144b9640 10 monclient(hunting): authenticate will time out at 2159.647003s 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:44712/0 (socket says 10.20.193.51:44712) 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 -- 10.20.193.51:0/2592859279 learned_addr learned my addr 10.20.193.51:0/2592859279 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): get_auth_request con 0x7fa00c09dac0 auth_method 0 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:12.034 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient(hunting): handle_auth_done global_id 304184 payload 274 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 -- 10.20.193.51:0/2592859279 >> v1:10.20.193.142:6789/0 conn(0x7fa00c0a3bb0 legacy=0x7fa00c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 -- 10.20.193.51:0/2592859279 >> v1:10.20.193.51:6789/0 conn(0x7fa00c0a0110 legacy=0x7fa00c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient: _finish_hunting 0 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 monclient: found mon.noname-b 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:12.035 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.028+0000 7fa011a2d640 1 -- 10.20.193.51:0/2592859279 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c09a5c0 con 0x7fa00c09dac0 2026-02-17T12:11:12.042 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa011a2d640 1 -- 10.20.193.51:0/2592859279 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 msgr2=0x7fa00c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa011a2d640 1 --2- 10.20.193.51:0/2592859279 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa00c06e310 tx=0x7fa00002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728831b5ccd03e56 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 1 -- 10.20.193.51:0/2592859279 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00003c070 con 0x7fa00c09dac0 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: dump: 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.043 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: _finish_auth 0 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: _check_auth_tickets 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 1 -- 10.20.193.51:0/2592859279 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00002fdd0 con 0x7fa00c09dac0 2026-02-17T12:11:12.044 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa0144b9640 5 monclient: authenticate success, global_id 304184 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa0144b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 1 -- 10.20.193.51:0/2592859279 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000037660 con 0x7fa00c09dac0 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa0144b9640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa0144b9640 4 set_mon_vals no callback set 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.030+0000 7fa01122c640 10 monclient: dump: 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:12.045 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 10 monclient: shutdown 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- 10.20.193.51:0/2592859279 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 msgr2=0x7fa00c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 --2- 10.20.193.51:0/2592859279 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa00c06e310 tx=0x7fa00002eeb0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.046 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- 10.20.193.51:0/2592859279 shutdown_connections 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 --2- 10.20.193.51:0/2592859279 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c09dac0 0x7fa00c09fbd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- 10.20.193.51:0/2592859279 >> 10.20.193.51:0/2592859279 conn(0x7fa00c0a30c0 msgr2=0x7fa00c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- 10.20.193.51:0/2592859279 shutdown_connections 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- 10.20.193.51:0/2592859279 wait complete. 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 10 monclient: build_initial_monmap 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 10 monclient: monmap: 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:12.047 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 Processor -- start 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 1 -- start start 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.031+0000 7fa0144b9640 10 monclient: init 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:12.048 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-a con 0x7fa00c09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0a0110 0x7fa00c099c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-b con 0x7fa00c0a0110 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 0x7fa00c1cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): picked mon.noname-c con 0x7fa00c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0a0540 con 0x7fa00c09dac0 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0a3f90 con 0x7fa00c0a0110 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c13de80 con 0x7fa00c0a3bb0 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:12.049 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa0144b9640 10 monclient(hunting): authenticate will time out at 2159.651186s 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 0x7fa00c1cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:37342/0 (socket says 10.20.193.51:37342) 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 -- 10.20.193.51:0/867510188 learned_addr learned my addr 10.20.193.51:0/867510188 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): get_auth_request con 0x7fa00c09dac0 auth_method 0 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): get_auth_request con 0x7fa00c0a3bb0 auth_method 0 2026-02-17T12:11:12.050 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient(hunting): handle_auth_done global_id 274449 payload 824 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 -- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 msgr2=0x7fa00c1cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 0x7fa00c1cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.051 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 -- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0a0110 msgr2=0x7fa00c099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0a0110 0x7fa00c099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient: _finish_hunting 0 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 monclient: found mon.noname-a 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa01222e640 1 -- 10.20.193.51:0/867510188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c1cc8b0 con 0x7fa00c09dac0 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.032+0000 7fa012a2f640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 0x7fa00c1cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa01222e640 1 -- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 msgr2=0x7fa00c1cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa01222e640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c5d0 tx=0x7f9ffc00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc016020 con 0x7fa00c09dac0 2026-02-17T12:11:12.052 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: dump: 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:12.053 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc012a60 con 0x7fa00c09dac0 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc012e50 con 0x7fa00c09dac0 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa010a2b640 4 set_mon_vals no callback set 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7f9ff2ffd640 10 monclient: dump: 2026-02-17T12:11:12.054 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 5 monclient: authenticate success, global_id 274449 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 10 monclient: _renew_subs 2026-02-17T12:11:12.055 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c093e50 con 0x7fa00c09dac0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 10 monclient: _renew_subs 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.034+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c093180 con 0x7fa00c09dac0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa0144b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa0144b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa0144b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9ffc01b400 con 0x7fa00c09dac0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c09f4c0 con 0x7fa00c09dac0 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7f9ff2ffd640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 0x7f9fdc0403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:12.056 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(924..924 src has 323..924) ==== 4783+0+0 (secure 0 0 0) 0x7f9ffc052630 con 0x7fa00c09dac0 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa011a2d640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 0x7f9fdc0403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.035+0000 7fa011a2d640 10 monclient: get_auth_request con 0x7f9fdc03dee0 auth_method 0 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.038+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ffc020030 con 0x7fa00c09dac0 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.038+0000 7f9ff2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.038+0000 7f9ff2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:12.057 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.038+0000 7fa011a2d640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 0x7f9fdc0403a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa000036000 tx=0x7fa000031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:12.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7fa0144b9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7fa0144b9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7fa0144b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa00c09d7b0 con 0x7fa00c09dac0 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7f9ff2ffd640 1 -- 10.20.193.51:0/867510188 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f9ffc051030 con 0x7fa00c09dac0 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7f9ff2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.150+0000 7f9ff2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":238,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 msgr2=0x7f9fdc0403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:12.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 0x7f9fdc0403a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa000036000 tx=0x7fa000031000 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 10 monclient: shutdown 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 msgr2=0x7fa00c1cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c5d0 tx=0x7f9ffc00caa0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 shutdown_connections 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9fdc03dee0 0x7f9fdc0403a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa00c0a3bb0 0x7fa00c1cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa00c0a0110 0x7fa00c099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 --2- 10.20.193.51:0/867510188 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa00c09dac0 0x7fa00c1cbec0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 >> 10.20.193.51:0/867510188 conn(0x7fa00c0a30c0 msgr2=0x7fa00c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 shutdown_connections 2026-02-17T12:11:12.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:12.151+0000 7fa0144b9640 1 -- 10.20.193.51:0/867510188 wait complete. 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3933: done (2 left) 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3934: done (1 left) 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3935: done (0 left) 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3936: read oid 14 snap 443 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3936: expect (ObjNum 1325 snap 439 seq_num 1325) 2026-02-17T12:11:12.537 INFO:tasks.rados.rados.0.trial142.stdout:3937: delete oid 21 current snap is 448 2026-02-17T12:11:12.539 INFO:tasks.rados.rados.0.trial142.stdout:3937: done (1 left) 2026-02-17T12:11:12.539 INFO:tasks.rados.rados.0.trial142.stdout:3938: read oid 42 snap -1 2026-02-17T12:11:12.539 INFO:tasks.rados.rados.0.trial142.stdout:3938: expect (ObjNum 1331 snap 443 seq_num 1331) 2026-02-17T12:11:12.539 INFO:tasks.rados.rados.0.trial142.stdout:3939: snap_create 2026-02-17T12:11:12.542 INFO:tasks.rados.rados.0.trial142.stdout:3936: expect (ObjNum 1325 snap 439 seq_num 1325) 2026-02-17T12:11:12.656 INFO:tasks.rados.rados.0.trial142.stdout:3938: expect (ObjNum 1331 snap 443 seq_num 1331) 2026-02-17T12:11:12.789 INFO:tasks.rados.rados.0.trial142.stdout:3936: done (2 left) 2026-02-17T12:11:12.789 INFO:tasks.rados.rados.0.trial142.stdout:3938: done (1 left) 2026-02-17T12:11:12.789 INFO:tasks.rados.rados.0.trial142.stdout:3939: done (0 left) 2026-02-17T12:11:12.790 INFO:tasks.rados.rados.0.trial142.stdout:3940: write (excl) oid 6 current snap is 449 2026-02-17T12:11:12.790 INFO:tasks.rados.rados.0.trial142.stdout:3940: seq_num 1343 ranges {571801=737535,1939317=489789} 2026-02-17T12:11:12.794 INFO:tasks.rados.rados.0.trial142.stdout:3940: writing trial14245205-6 from 571801 to 1309336 tid 1 2026-02-17T12:11:12.798 INFO:tasks.rados.rados.0.trial142.stdout:3940: writing trial14245205-6 from 1939317 to 2429106 tid 2 2026-02-17T12:11:12.799 INFO:tasks.rados.rados.0.trial142.stdout:3941: delete oid 25 current snap is 449 2026-02-17T12:11:12.802 INFO:tasks.rados.rados.0.trial142.stdout:3940: finishing write tid 1 to trial14245205-6 2026-02-17T12:11:12.802 INFO:tasks.rados.rados.0.trial142.stdout:3940: finishing write tid 2 to trial14245205-6 2026-02-17T12:11:12.802 INFO:tasks.rados.rados.0.trial142.stdout:3940: finishing write tid 3 to trial14245205-6 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: finishing write tid 4 to trial14245205-6 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: oid 6 updating version 0 to 3390 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: oid 6 version 3390 is already newer than 3389 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: oid 6 version 3390 is already newer than 3388 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3390 (ObjNum 1343 snap 449 seq_num 1343) dirty exists 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: left oid 6 (ObjNum 1343 snap 449 seq_num 1343) 2026-02-17T12:11:12.803 INFO:tasks.rados.rados.0.trial142.stdout:3940: done (1 left) 2026-02-17T12:11:12.804 INFO:tasks.rados.rados.0.trial142.stdout:3941: done (0 left) 2026-02-17T12:11:12.804 INFO:tasks.rados.rados.0.trial142.stdout:3942: write oid 9 current snap is 449 2026-02-17T12:11:12.804 INFO:tasks.rados.rados.0.trial142.stdout:3942: seq_num 1345 ranges {605415=488033,1656281=493458} 2026-02-17T12:11:12.807 INFO:tasks.rados.rados.0.trial142.stdout:3942: writing trial14245205-9 from 605415 to 1093448 tid 1 2026-02-17T12:11:12.812 INFO:tasks.rados.rados.0.trial142.stdout:3942: writing trial14245205-9 from 1656281 to 2149739 tid 2 2026-02-17T12:11:12.812 INFO:tasks.rados.rados.0.trial142.stdout:3943: read oid 38 snap -1 2026-02-17T12:11:12.812 INFO:tasks.rados.rados.0.trial142.stdout:3943: expect (ObjNum 1339 snap 447 seq_num 1339) 2026-02-17T12:11:12.812 INFO:tasks.rados.rados.0.trial142.stdout:3944: read oid 42 snap -1 2026-02-17T12:11:12.813 INFO:tasks.rados.rados.0.trial142.stdout:3944: expect (ObjNum 1331 snap 443 seq_num 1331) 2026-02-17T12:11:12.813 INFO:tasks.rados.rados.0.trial142.stdout:3945: copy_from oid 41 from oid 31 current snap is 449 2026-02-17T12:11:12.813 INFO:tasks.rados.rados.0.trial142.stdout:3942: finishing write tid 1 to trial14245205-9 2026-02-17T12:11:12.813 INFO:tasks.rados.rados.0.trial142.stdout:3946: delete oid 28 current snap is 449 2026-02-17T12:11:12.813 INFO:tasks.rados.rados.0.trial142.stdout:3944: expect (ObjNum 1331 snap 443 seq_num 1331) 2026-02-17T12:11:12.943 INFO:tasks.rados.rados.0.trial142.stdout:3942: finishing write tid 2 to trial14245205-9 2026-02-17T12:11:12.944 INFO:tasks.rados.rados.0.trial142.stdout:3942: finishing write tid 3 to trial14245205-9 2026-02-17T12:11:12.944 INFO:tasks.rados.rados.0.trial142.stdout:3943: expect (ObjNum 1339 snap 447 seq_num 1339) 2026-02-17T12:11:13.036 INFO:tasks.rados.rados.0.trial142.stdout:3945: finishing copy_from racing read to trial14245205-41 2026-02-17T12:11:13.036 INFO:tasks.rados.rados.0.trial142.stdout:3943: done (4 left) 2026-02-17T12:11:13.036 INFO:tasks.rados.rados.0.trial142.stdout:3944: done (3 left) 2026-02-17T12:11:13.036 INFO:tasks.rados.rados.0.trial142.stdout:3946: done (2 left) 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3947: delete oid 39 current snap is 449 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3942: finishing write tid 4 to trial14245205-9 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3942: oid 9 updating version 0 to 3886 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3942: oid 9 version 3886 is already newer than 3885 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3942: oid 9 updating version 3886 to 3887 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 9 v 3887 (ObjNum 1345 snap 449 seq_num 1345) dirty exists 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3942: left oid 9 (ObjNum 1345 snap 449 seq_num 1345) 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:3945: finishing copy_from to trial14245205-41 2026-02-17T12:11:13.037 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 41 v 3715 (ObjNum 1304 snap 433 seq_num 1304) dirty exists 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3942: done (2 left) 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3945: done (1 left) 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3947: done (0 left) 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3948: read oid 21 snap -1 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3948: expect deleted 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3949: rollback oid 16 current snap is 449 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 16 to 426 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3950: read oid 28 snap 440 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3950: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3951: write oid 37 current snap is 449 2026-02-17T12:11:13.038 INFO:tasks.rados.rados.0.trial142.stdout:3951: seq_num 1348 ranges {655836=430133,1831727=757138} 2026-02-17T12:11:13.042 INFO:tasks.rados.rados.0.trial142.stdout:3951: writing trial14245205-37 from 655836 to 1085969 tid 1 2026-02-17T12:11:13.048 INFO:tasks.rados.rados.0.trial142.stdout:3951: writing trial14245205-37 from 1831727 to 2588865 tid 2 2026-02-17T12:11:13.048 INFO:tasks.rados.rados.0.trial142.stdout:3952: write oid 6 current snap is 449 2026-02-17T12:11:13.049 INFO:tasks.rados.rados.0.trial142.stdout:3952: seq_num 1349 ranges {672643=505382,1890209=500796} 2026-02-17T12:11:13.052 INFO:tasks.rados.rados.0.trial142.stdout:3952: writing trial14245205-6 from 672643 to 1178025 tid 1 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3952: writing trial14245205-6 from 1890209 to 2391005 tid 2 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3953: copy_from oid 33 from oid 10 current snap is 449 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3949: finishing rollback tid 0 to trial14245205-16 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3949: finishing rollback tid 1 to trial14245205-16 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3948: done (5 left) 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3954: delete oid 47 current snap is 449 2026-02-17T12:11:13.058 INFO:tasks.rados.rados.0.trial142.stdout:3949: finishing rollback tid 2 to trial14245205-16 2026-02-17T12:11:13.059 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 16 v 2785 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:11:13.059 INFO:tasks.rados.rados.0.trial142.stdout:3950: expect (ObjNum 1230 snap 406 seq_num 1230) 2026-02-17T12:11:13.204 INFO:tasks.rados.rados.0.trial142.stdout:3951: finishing write tid 1 to trial14245205-37 2026-02-17T12:11:13.204 INFO:tasks.rados.rados.0.trial142.stdout:3949: done (5 left) 2026-02-17T12:11:13.204 INFO:tasks.rados.rados.0.trial142.stdout:3950: done (4 left) 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3954: done (3 left) 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3955: read oid 21 snap -1 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3955: expect deleted 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3956: read oid 24 snap -1 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3956: expect (ObjNum 1330 snap 443 seq_num 1330) 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3957: rollback oid 50 current snap is 449 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 50 to 430 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3951: finishing write tid 2 to trial14245205-37 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3951: finishing write tid 3 to trial14245205-37 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3951: finishing write tid 4 to trial14245205-37 2026-02-17T12:11:13.205 INFO:tasks.rados.rados.0.trial142.stdout:3951: oid 37 updating version 0 to 3874 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3951: oid 37 updating version 3874 to 3876 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3951: oid 37 version 3876 is already newer than 3875 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 37 v 3876 (ObjNum 1348 snap 449 seq_num 1348) dirty exists 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3951: left oid 37 (ObjNum 1348 snap 449 seq_num 1348) 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: finishing write tid 1 to trial14245205-6 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: finishing write tid 2 to trial14245205-6 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: finishing write tid 3 to trial14245205-6 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: finishing write tid 4 to trial14245205-6 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: oid 6 updating version 0 to 3391 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: oid 6 updating version 3391 to 3393 2026-02-17T12:11:13.206 INFO:tasks.rados.rados.0.trial142.stdout:3952: oid 6 version 3393 is already newer than 3392 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 6 v 3393 (ObjNum 1349 snap 449 seq_num 1349) dirty exists 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3952: left oid 6 (ObjNum 1349 snap 449 seq_num 1349) 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3953: finishing copy_from to trial14245205-33 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3953: got expected ENOENT (src dne) 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3953: finishing copy_from racing read to trial14245205-33 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3951: done (5 left) 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3952: done (4 left) 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3953: done (3 left) 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3958: read oid 17 snap -1 2026-02-17T12:11:13.207 INFO:tasks.rados.rados.0.trial142.stdout:3958: expect deleted 2026-02-17T12:11:13.208 INFO:tasks.rados.rados.0.trial142.stdout:3959: delete oid 39 current snap is 449 2026-02-17T12:11:13.208 INFO:tasks.rados.rados.0.trial142.stdout:3957: finishing rollback tid 0 to trial14245205-50 2026-02-17T12:11:13.209 INFO:tasks.rados.rados.0.trial142.stdout:3957: finishing rollback tid 1 to trial14245205-50 2026-02-17T12:11:13.209 INFO:tasks.rados.rados.0.trial142.stdout:3957: finishing rollback tid 2 to trial14245205-50 2026-02-17T12:11:13.209 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 50 v 3151 (ObjNum 1255 snap 412 seq_num 1255) dirty exists 2026-02-17T12:11:13.209 INFO:tasks.rados.rados.0.trial142.stdout:3956: expect (ObjNum 1330 snap 443 seq_num 1330) 2026-02-17T12:11:13.282 INFO:tasks.rados.rados.0.trial142.stdout:3955: done (4 left) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3956: done (3 left) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3957: done (2 left) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3958: done (1 left) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3959: done (0 left) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3960: copy_from oid 46 from oid 5 current snap is 449 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3961: read oid 29 snap -1 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3961: expect (ObjNum 1316 snap 436 seq_num 1316) 2026-02-17T12:11:13.283 INFO:tasks.rados.rados.0.trial142.stdout:3962: snap_create 2026-02-17T12:11:13.286 INFO:tasks.rados.rados.0.trial142.stdout:3961: expect (ObjNum 1316 snap 436 seq_num 1316) 2026-02-17T12:11:13.336 INFO:tasks.rados.rados.0.trial142.stdout:3960: finishing copy_from racing read to trial14245205-46 2026-02-17T12:11:13.337 INFO:tasks.rados.rados.0.trial142.stdout:3960: finishing copy_from to trial14245205-46 2026-02-17T12:11:13.337 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 46 v 2782 (ObjNum 1334 snap 447 seq_num 1334) dirty exists 2026-02-17T12:11:13.688 INFO:tasks.rados.rados.0.trial142.stdout:3960: done (2 left) 2026-02-17T12:11:13.688 INFO:tasks.rados.rados.0.trial142.stdout:3961: done (1 left) 2026-02-17T12:11:13.689 INFO:tasks.rados.rados.0.trial142.stdout:3962: done (0 left) 2026-02-17T12:11:13.689 INFO:tasks.rados.rados.0.trial142.stdout:3963: snap_create 2026-02-17T12:11:14.688 INFO:tasks.rados.rados.0.trial142.stdout:3963: done (0 left) 2026-02-17T12:11:14.688 INFO:tasks.rados.rados.0.trial142.stdout:3964: copy_from oid 19 from oid 40 current snap is 451 2026-02-17T12:11:14.689 INFO:tasks.rados.rados.0.trial142.stdout:3965: write oid 36 current snap is 451 2026-02-17T12:11:14.689 INFO:tasks.rados.rados.0.trial142.stdout:3965: seq_num 1352 ranges {723064=731129,1949302=764476} 2026-02-17T12:11:14.694 INFO:tasks.rados.rados.0.trial142.stdout:3965: writing trial14245205-36 from 723064 to 1454193 tid 1 2026-02-17T12:11:14.700 INFO:tasks.rados.rados.0.trial142.stdout:3965: writing trial14245205-36 from 1949302 to 2713778 tid 2 2026-02-17T12:11:14.700 INFO:tasks.rados.rados.0.trial142.stdout:3966: read oid 35 snap -1 2026-02-17T12:11:14.700 INFO:tasks.rados.rados.0.trial142.stdout:3966: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:11:14.700 INFO:tasks.rados.rados.0.trial142.stdout:3967: read oid 3 snap -1 2026-02-17T12:11:14.700 INFO:tasks.rados.rados.0.trial142.stdout:3967: expect (ObjNum 1336 snap 447 seq_num 1336) 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3968: copy_from oid 48 from oid 8 current snap is 451 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3964: finishing copy_from racing read to trial14245205-19 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3964: finishing copy_from to trial14245205-19 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 19 v 2777 (ObjNum 1315 snap 433 seq_num 1315) dirty exists 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3964: done (4 left) 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3969: read oid 13 snap -1 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3969: expect deleted 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3970: delete oid 49 current snap is 451 2026-02-17T12:11:14.701 INFO:tasks.rados.rados.0.trial142.stdout:3965: finishing write tid 1 to trial14245205-36 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3970: done (5 left) 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3971: read oid 5 snap 450 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3971: expect (ObjNum 1334 snap 447 seq_num 1334) 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3972: delete oid 18 current snap is 451 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: finishing write tid 2 to trial14245205-36 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: finishing write tid 3 to trial14245205-36 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: finishing write tid 4 to trial14245205-36 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: oid 36 updating version 0 to 3121 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: oid 36 updating version 3121 to 3122 2026-02-17T12:11:14.703 INFO:tasks.rados.rados.0.trial142.stdout:3965: oid 36 version 3122 is already newer than 3120 2026-02-17T12:11:14.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 3122 (ObjNum 1352 snap 451 seq_num 1352) dirty exists 2026-02-17T12:11:14.704 INFO:tasks.rados.rados.0.trial142.stdout:3965: left oid 36 (ObjNum 1352 snap 451 seq_num 1352) 2026-02-17T12:11:14.704 INFO:tasks.rados.rados.0.trial142.stdout:3967: expect (ObjNum 1336 snap 447 seq_num 1336) 2026-02-17T12:11:14.879 INFO:tasks.rados.rados.0.trial142.stdout:3966: expect (ObjNum 1204 snap 390 seq_num 1204) 2026-02-17T12:11:14.943 INFO:tasks.rados.rados.0.trial142.stdout:3971: expect (ObjNum 1334 snap 447 seq_num 1334) 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3968: finishing copy_from racing read to trial14245205-48 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3968: finishing copy_from to trial14245205-48 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 48 v 3126 (ObjNum 1254 snap 412 seq_num 1254) dirty exists 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3965: done (6 left) 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3966: done (5 left) 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3967: done (4 left) 2026-02-17T12:11:15.057 INFO:tasks.rados.rados.0.trial142.stdout:3968: done (3 left) 2026-02-17T12:11:15.058 INFO:tasks.rados.rados.0.trial142.stdout:3969: done (2 left) 2026-02-17T12:11:15.058 INFO:tasks.rados.rados.0.trial142.stdout:3971: done (1 left) 2026-02-17T12:11:15.058 INFO:tasks.rados.rados.0.trial142.stdout:3972: done (0 left) 2026-02-17T12:11:15.058 INFO:tasks.rados.rados.0.trial142.stdout:3973: write oid 29 current snap is 451 2026-02-17T12:11:15.058 INFO:tasks.rados.rados.0.trial142.stdout:3973: seq_num 1355 ranges {773485=673229,2124748=511803} 2026-02-17T12:11:15.062 INFO:tasks.rados.rados.0.trial142.stdout:3973: writing trial14245205-29 from 773485 to 1446714 tid 1 2026-02-17T12:11:15.067 INFO:tasks.rados.rados.0.trial142.stdout:3973: writing trial14245205-29 from 2124748 to 2636551 tid 2 2026-02-17T12:11:15.067 INFO:tasks.rados.rados.0.trial142.stdout:3974: copy_from oid 45 from oid 19 current snap is 451 2026-02-17T12:11:15.067 INFO:tasks.rados.rados.0.trial142.stdout:3973: finishing write tid 1 to trial14245205-29 2026-02-17T12:11:15.067 INFO:tasks.rados.rados.0.trial142.stdout:3975: snap_create 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: finishing write tid 2 to trial14245205-29 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: finishing write tid 3 to trial14245205-29 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: finishing write tid 4 to trial14245205-29 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: oid 29 updating version 0 to 3129 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: oid 29 version 3129 is already newer than 3128 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: oid 29 version 3129 is already newer than 3127 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 29 v 3129 (ObjNum 1355 snap 451 seq_num 1355) dirty exists 2026-02-17T12:11:15.069 INFO:tasks.rados.rados.0.trial142.stdout:3973: left oid 29 (ObjNum 1355 snap 451 seq_num 1355) 2026-02-17T12:11:15.073 INFO:tasks.rados.rados.0.trial142.stdout:3974: finishing copy_from racing read to trial14245205-45 2026-02-17T12:11:15.075 INFO:tasks.rados.rados.0.trial142.stdout:3974: finishing copy_from to trial14245205-45 2026-02-17T12:11:15.076 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 45 v 2777 (ObjNum 1315 snap 433 seq_num 1315) dirty exists 2026-02-17T12:11:15.161 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:11:15.230 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.226+0000 7f212bb0a640 10 monclient: get_monmap_and_config 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.226+0000 7f212bb0a640 10 monclient: build_initial_monmap 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.226+0000 7f212bb0a640 10 monclient: monmap: 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:15.227511+0000 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:15.227511+0000 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.231 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.226+0000 7f212bb0a640 1 Processor -- start 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 -- start start 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient: init 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-17T12:11:15.232 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f21240a3bb0 0x7f212409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-c con 0x7f21240a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f21240a0750 0x7f212409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-a con 0x7f21240a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f212409e540 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212406e140 con 0x7f212409e540 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f21240a3f90 con 0x7f21240a0750 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f212409f910 con 0x7f21240a3bb0 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212bb0a640 10 monclient(hunting): authenticate will time out at 2162.846309s 2026-02-17T12:11:15.233 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f21240a0750 0x7f212409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f21240a0750 0x7f212409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39720/0 (socket says 10.20.193.51:39720) 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 -- 10.20.193.51:0/3434248881 learned_addr learned my addr 10.20.193.51:0/3434248881 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): get_auth_request con 0x7f21240a0750 auth_method 0 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212987f640 1 --2- 10.20.193.51:0/3434248881 >> v2:10.20.193.142:3300/0 conn(0x7f21240a3bb0 0x7f212409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212987f640 10 monclient(hunting): get_auth_request con 0x7f21240a3bb0 auth_method 0 2026-02-17T12:11:15.234 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212987f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212987f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212987f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient(hunting): handle_auth_done global_id 274452 payload 274 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 -- 10.20.193.51:0/3434248881 >> v2:10.20.193.142:3300/0 conn(0x7f21240a3bb0 msgr2=0x7f212409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 --2- 10.20.193.51:0/3434248881 >> v2:10.20.193.142:3300/0 conn(0x7f21240a3bb0 0x7f212409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 -- 10.20.193.51:0/3434248881 >> v1:10.20.193.142:6789/0 conn(0x7f212409e540 legacy=0x7f212413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient: _finish_hunting 0 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 monclient: found mon.noname-a 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.235 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.227+0000 7f212907e640 1 -- 10.20.193.51:0/3434248881 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212409ccd0 con 0x7f21240a0750 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212907e640 1 -- 10.20.193.51:0/3434248881 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0750 msgr2=0x7f212409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212907e640 1 --2- 10.20.193.51:0/3434248881 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0750 0x7f212409e000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f212406f3c0 tx=0x7f211802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bd5a65cfffaef4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 1 -- 10.20.193.51:0/3434248881 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211803c070 con 0x7f21240a0750 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: dump: 2026-02-17T12:11:15.243 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: _finish_auth 0 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: _check_auth_tickets 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 1 -- 10.20.193.51:0/3434248881 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211802fc70 con 0x7f21240a0750 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 1 -- 10.20.193.51:0/3434248881 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118037660 con 0x7f21240a0750 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212887d640 10 monclient: dump: 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 5 monclient: authenticate success, global_id 274452 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 4 set_mon_vals no callback set 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 10 monclient: shutdown 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:15.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 -- 10.20.193.51:0/3434248881 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0750 msgr2=0x7f212409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 --2- 10.20.193.51:0/3434248881 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0750 0x7f212409e000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f212406f3c0 tx=0x7f211802edf0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 -- 10.20.193.51:0/3434248881 shutdown_connections 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 --2- 10.20.193.51:0/3434248881 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f21240a0750 0x7f212409e000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 --2- 10.20.193.51:0/3434248881 >> v2:10.20.193.142:3300/0 conn(0x7f21240a3bb0 0x7f212409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 -- 10.20.193.51:0/3434248881 >> 10.20.193.51:0/3434248881 conn(0x7f21240a30c0 msgr2=0x7f21240a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 -- 10.20.193.51:0/3434248881 shutdown_connections 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 1 -- 10.20.193.51:0/3434248881 wait complete. 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 10 monclient: build_initial_monmap 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.230+0000 7f212bb0a640 10 monclient: monmap: 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:15.247 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 Processor -- start 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 -- start start 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient: init 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:15.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-a con 0x7f212409e540 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 0x7f2124092d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-b con 0x7f21240a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f2124093270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): picked mon.noname-c con 0x7f21240a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f21240a04b0 con 0x7f212409e540 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f212409c850 con 0x7f21240a0750 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:15.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f212413de80 con 0x7f21240a3bb0 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212bb0a640 10 monclient(hunting): authenticate will time out at 2162.850437s 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39732/0 (socket says 10.20.193.51:39732) 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 -- 10.20.193.51:0/2830172509 learned_addr learned my addr 10.20.193.51:0/2830172509 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): get_auth_request con 0x7f212409e540 auth_method 0 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f2124093270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:15.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): get_auth_request con 0x7f21240a3bb0 auth_method 0 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212a080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212907e640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 0x7f2124092d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient(hunting): handle_auth_done global_id 274455 payload 824 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 -- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 msgr2=0x7f2124093270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:15.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f2124093270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 -- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 msgr2=0x7f2124092d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 0x7f2124092d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient: _finish_hunting 0 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 monclient: found mon.noname-a 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212987f640 1 -- 10.20.193.51:0/2830172509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21240946f0 con 0x7f212409e540 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212907e640 10 monclient: get_auth_request con 0x7f21240a0750 auth_method 0 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.231+0000 7f212907e640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 0x7f2124092d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212987f640 1 -- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 msgr2=0x7f212409c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212987f640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f211400e7f0 tx=0x7f211400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:15.252 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114017070 con 0x7f212409e540 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: dump: 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:15.253 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211400cae0 con 0x7f212409e540 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212bb0a640 5 monclient: authenticate success, global_id 274455 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212bb0a640 10 monclient: _renew_subs 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212bb0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2124096750 con 0x7f212409e540 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211400f040 con 0x7f212409e540 2026-02-17T12:11:15.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f2113fff640 4 set_mon_vals no callback set 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.233+0000 7f21127fc640 10 monclient: dump: 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:15.255 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 10 monclient: _renew_subs 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212409b6c0 con 0x7f212409e540 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21240a2cc0 con 0x7f212409e540 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2114012050 con 0x7f212409e540 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.234+0000 7f21127fc640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 0x7f20f4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.235+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(927..927 src has 323..927) ==== 4751+0+0 (secure 0 0 0) 0x7f21140523c0 con 0x7f212409e540 2026-02-17T12:11:15.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.235+0000 7f212907e640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 0x7f20f4040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:15.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.235+0000 7f212907e640 10 monclient: get_auth_request con 0x7f20f403dd90 auth_method 0 2026-02-17T12:11:15.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.237+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f21240a2cc0 con 0x7f212409e540 2026-02-17T12:11:15.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.237+0000 7f21127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:15.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.237+0000 7f21127fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:15.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.237+0000 7f212907e640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 0x7f20f4040250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2118036000 tx=0x7f2118039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f212bb0a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f212bb0a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f212bb0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f212409dac0 con 0x7f212409e540 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f21127fc640 1 -- 10.20.193.51:0/2830172509 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1552 (secure 0 0 0) 0x7f2114023d80 con 0x7f212409e540 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f21127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.353+0000 7f21127fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:15.355 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":238,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:11:15.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 msgr2=0x7f20f4040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:15.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 0x7f20f4040250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2118036000 tx=0x7f2118039040 comp rx=0 tx=0).stop 2026-02-17T12:11:15.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 10 monclient: shutdown 2026-02-17T12:11:15.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 msgr2=0x7f212409c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f211400e7f0 tx=0x7f211400ecc0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 shutdown_connections 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f20f403dd90 0x7f20f4040250 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f21240a3bb0 0x7f2124093270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f21240a0750 0x7f2124092d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 --2- 10.20.193.51:0/2830172509 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f212409e540 0x7f212409c060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 >> 10.20.193.51:0/2830172509 conn(0x7f21240a30c0 msgr2=0x7f2124072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 shutdown_connections 2026-02-17T12:11:15.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:15.354+0000 7f212bb0a640 1 -- 10.20.193.51:0/2830172509 wait complete. 2026-02-17T12:11:15.753 INFO:tasks.rados.rados.0.trial142.stdout:3973: done (2 left) 2026-02-17T12:11:15.753 INFO:tasks.rados.rados.0.trial142.stdout:3974: done (1 left) 2026-02-17T12:11:15.753 INFO:tasks.rados.rados.0.trial142.stdout:3975: done (0 left) 2026-02-17T12:11:15.753 INFO:tasks.rados.rados.0.trial142.stdout:3976: delete oid 30 current snap is 452 2026-02-17T12:11:15.754 INFO:tasks.rados.rados.0.trial142.stdout:3976: done (0 left) 2026-02-17T12:11:15.755 INFO:tasks.rados.rados.0.trial142.stdout:3977: copy_from oid 22 from oid 11 current snap is 452 2026-02-17T12:11:15.755 INFO:tasks.rados.rados.0.trial142.stdout:3978: rollback oid 1 current snap is 452 2026-02-17T12:11:15.755 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 1 to 430 2026-02-17T12:11:15.755 INFO:tasks.rados.rados.0.trial142.stdout:3979: snap_create 2026-02-17T12:11:15.758 INFO:tasks.rados.rados.0.trial142.stdout:3978: finishing rollback tid 0 to trial14245205-1 2026-02-17T12:11:15.758 INFO:tasks.rados.rados.0.trial142.stdout:3978: finishing rollback tid 1 to trial14245205-1 2026-02-17T12:11:15.759 INFO:tasks.rados.rados.0.trial142.stdout:3978: finishing rollback tid 2 to trial14245205-1 2026-02-17T12:11:15.759 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 1 v 3161 (ObjNum 1247 snap 407 seq_num 1247) dirty exists 2026-02-17T12:11:15.762 INFO:tasks.rados.rados.0.trial142.stdout:3977: finishing copy_from racing read to trial14245205-22 2026-02-17T12:11:15.763 INFO:tasks.rados.rados.0.trial142.stdout:3977: finishing copy_from to trial14245205-22 2026-02-17T12:11:15.763 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 22 v 3101 (ObjNum 1246 snap 407 seq_num 1246) dirty exists 2026-02-17T12:11:16.755 INFO:tasks.rados.rados.0.trial142.stdout:3977: done (2 left) 2026-02-17T12:11:16.755 INFO:tasks.rados.rados.0.trial142.stdout:3978: done (1 left) 2026-02-17T12:11:16.755 INFO:tasks.rados.rados.0.trial142.stdout:3979: done (0 left) 2026-02-17T12:11:16.755 INFO:tasks.rados.rados.0.trial142.stdout:3980: read oid 10 snap 440 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3980: expect (ObjNum 1319 snap 437 seq_num 1319) 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3981: read oid 4 snap -1 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3981: expect deleted 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3982: read oid 19 snap -1 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3982: expect (ObjNum 1315 snap 433 seq_num 1315) 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3983: read oid 29 snap -1 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3983: expect (ObjNum 1355 snap 451 seq_num 1355) 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3984: copy_from oid 24 from oid 43 current snap is 453 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3985: read oid 9 snap 436 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3985: expect (ObjNum 1311 snap 433 seq_num 1311) 2026-02-17T12:11:16.756 INFO:tasks.rados.rados.0.trial142.stdout:3986: copy_from oid 40 from oid 48 current snap is 453 2026-02-17T12:11:16.757 INFO:tasks.rados.rados.0.trial142.stdout:3987: snap_create 2026-02-17T12:11:16.759 INFO:tasks.rados.rados.0.trial142.stdout:3983: expect (ObjNum 1355 snap 451 seq_num 1355) 2026-02-17T12:11:16.851 INFO:tasks.rados.rados.0.trial142.stdout:3985: expect (ObjNum 1311 snap 433 seq_num 1311) 2026-02-17T12:11:16.910 INFO:tasks.rados.rados.0.trial142.stdout:3980: expect (ObjNum 1319 snap 437 seq_num 1319) 2026-02-17T12:11:16.993 INFO:tasks.rados.rados.0.trial142.stdout:3982: expect (ObjNum 1315 snap 433 seq_num 1315) 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:3984: finishing copy_from racing read to trial14245205-24 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:3986: finishing copy_from racing read to trial14245205-40 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:3984: finishing copy_from to trial14245205-24 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 24 v 3873 (ObjNum 1336 snap 447 seq_num 1336) dirty exists 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:3986: finishing copy_from to trial14245205-40 2026-02-17T12:11:17.128 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 40 v 3126 (ObjNum 1254 snap 412 seq_num 1254) dirty exists 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3980: done (7 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3981: done (6 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3982: done (5 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3983: done (4 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3984: done (3 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3985: done (2 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3986: done (1 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3987: done (0 left) 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3988: read oid 49 snap -1 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3988: expect deleted 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3989: rollback oid 10 current snap is 454 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 10 to 447 2026-02-17T12:11:17.757 INFO:tasks.rados.rados.0.trial142.stdout:3990: snap_create 2026-02-17T12:11:17.759 INFO:tasks.rados.rados.0.trial142.stdout:3989: finishing rollback tid 1 to trial14245205-10 2026-02-17T12:11:17.759 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 10 v 3157 (ObjNum 81 snap 0 seq_num 1213559056) dirty dne 2026-02-17T12:11:18.365 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.431+0000 7f29223e6640 10 monclient: get_monmap_and_config 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.431+0000 7f29223e6640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.431+0000 7f29223e6640 10 monclient: monmap: 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.434 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:18.433726+0000 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:18.433726+0000 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:18.435 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 Processor -- start 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 -- start start 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient: init 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f291c0a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f291c0a0750 0x7f291c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-a con 0x7f291c0a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f291c13b760 0x7f291c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-c con 0x7f291c13b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291c06e140 con 0x7f291c0a3bb0 2026-02-17T12:11:18.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f291c09f910 con 0x7f291c0a0750 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f291c09ccd0 con 0x7f291c13b760 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f29223e6640 10 monclient(hunting): authenticate will time out at 2166.052586s 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291bfff640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f291c0a3bb0 0x7f291c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57324/0 (socket says 10.20.193.51:57324) 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291bfff640 1 -- 10.20.193.51:0/3399434352 learned_addr learned my addr 10.20.193.51:0/3399434352 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 --2- 10.20.193.51:0/3399434352 >> v2:10.20.193.51:3300/0 conn(0x7f291c0a0750 0x7f291c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): get_auth_request con 0x7f291c0a0750 auth_method 0 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient(hunting): handle_auth_done global_id 274458 payload 274 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 -- 10.20.193.51:0/3399434352 >> v2:10.20.193.142:3300/0 conn(0x7f291c13b760 msgr2=0x7f291c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f292095c640 1 --2- 10.20.193.51:0/3399434352 >> v2:10.20.193.142:3300/0 conn(0x7f291c13b760 0x7f291c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 --2- 10.20.193.51:0/3399434352 >> v2:10.20.193.142:3300/0 conn(0x7f291c13b760 0x7f291c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 -- 10.20.193.51:0/3399434352 >> v1:10.20.193.51:6789/0 conn(0x7f291c0a3bb0 legacy=0x7f291c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.432+0000 7f291b7fe640 1 -- 10.20.193.51:0/3399434352 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c09eec0 con 0x7f291c0a0750 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291b7fe640 1 -- 10.20.193.51:0/3399434352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c0a0750 msgr2=0x7f291c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291b7fe640 1 --2- 10.20.193.51:0/3399434352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c0a0750 0x7f291c09e1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f291c09f5f0 tx=0x7f290c02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0a907ed9017e59 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 1 -- 10.20.193.51:0/3399434352 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c03c070 con 0x7f291c0a0750 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: dump: 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 1 -- 10.20.193.51:0/3399434352 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c02fcb0 con 0x7f291c0a0750 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 5 monclient: authenticate success, global_id 274458 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 1 -- 10.20.193.51:0/3399434352 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c02fe60 con 0x7f291c0a0750 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 4 set_mon_vals no callback set 2026-02-17T12:11:18.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f291affd640 10 monclient: dump: 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 10 monclient: shutdown 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 -- 10.20.193.51:0/3399434352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c0a0750 msgr2=0x7f291c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 --2- 10.20.193.51:0/3399434352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c0a0750 0x7f291c09e1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f291c09f5f0 tx=0x7f290c02ed50 comp rx=0 tx=0).stop 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 -- 10.20.193.51:0/3399434352 shutdown_connections 2026-02-17T12:11:18.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 --2- 10.20.193.51:0/3399434352 >> v2:10.20.193.142:3300/0 conn(0x7f291c13b760 0x7f291c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 --2- 10.20.193.51:0/3399434352 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c0a0750 0x7f291c09e1d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 -- 10.20.193.51:0/3399434352 >> 10.20.193.51:0/3399434352 conn(0x7f291c0a30c0 msgr2=0x7f291c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 -- 10.20.193.51:0/3399434352 shutdown_connections 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.435+0000 7f29223e6640 1 -- 10.20.193.51:0/3399434352 wait complete. 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient: monmap: 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 Processor -- start 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 -- start start 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient: init 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 0x7f291c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-b con 0x7f291c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f291c0a3bb0 0x7f291c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-c con 0x7f291c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): picked mon.noname-a con 0x7f291c13b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f291c0a04b0 con 0x7f291c13b760 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f291c09c850 con 0x7f291c0a0750 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f291c09e710 con 0x7f291c0a3bb0 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f29223e6640 10 monclient(hunting): authenticate will time out at 2166.056688s 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39746/0 (socket says 10.20.193.51:39746) 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f291c0a3bb0 0x7f291c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 -- 10.20.193.51:0/3724034819 learned_addr learned my addr 10.20.193.51:0/3724034819 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): get_auth_request con 0x7f291c13b760 auth_method 0 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): get_auth_request con 0x7f291c0a3bb0 auth_method 0 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient(hunting): handle_auth_done global_id 274461 payload 824 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291bfff640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 0x7f291c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 -- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f291c0a3bb0 msgr2=0x7f291c1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f291c0a3bb0 0x7f291c1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 -- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 msgr2=0x7f291c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 0x7f291c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f292095c640 1 -- 10.20.193.51:0/3724034819 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c098940 con 0x7f291c13b760 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291bfff640 10 monclient: get_auth_request con 0x7f291c0a0750 auth_method 0 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.436+0000 7f291bfff640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 0x7f291c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f292095c640 1 -- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 msgr2=0x7f291c094f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f292095c640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f291000cd20 tx=0x7f291000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910003c90 con 0x7f291c13b760 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: dump: 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2910003e30 con 0x7f291c13b760 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 5 monclient: authenticate success, global_id 274461 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000e800 con 0x7f291c13b760 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _renew_subs 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c098c20 con 0x7f291c13b760 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f291a7fc640 4 set_mon_vals no callback set 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 10 monclient: dump: 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _renew_subs 2026-02-17T12:11:18.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c06f510 con 0x7f291c13b760 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291c0a28c0 con 0x7f291c13b760 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.439+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f291000ea20 con 0x7f291c13b760 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.440+0000 7f2918ff9640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 0x7f28ec0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.440+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(930..930 src has 323..930) ==== 4751+0+0 (secure 0 0 0) 0x7f29100530a0 con 0x7f291c13b760 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.440+0000 7f291bfff640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 0x7f28ec0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.440+0000 7f291bfff640 10 monclient: get_auth_request con 0x7f28ec03dd10 auth_method 0 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.442+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f291c0a28c0 con 0x7f291c13b760 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.442+0000 7f2918ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.442+0000 7f2918ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:18.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.442+0000 7f291bfff640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 0x7f28ec0401d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f29080052b0 tx=0x7f2908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f291c06a290 con 0x7f291c13b760 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f2918ff9640 1 -- 10.20.193.51:0/3724034819 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f291c06a290 con 0x7f291c13b760 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f2918ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:18.563 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f2918ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":240,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 msgr2=0x7f28ec0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 0x7f28ec0401d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f29080052b0 tx=0x7f2908009040 comp rx=0 tx=0).stop 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 10 monclient: shutdown 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 msgr2=0x7f291c094f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f291000cd20 tx=0x7f291000a660 comp rx=0 tx=0).stop 2026-02-17T12:11:18.564 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 shutdown_connections 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f28ec03dd10 0x7f28ec0401d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f291c13b760 0x7f291c094f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f291c0a3bb0 0x7f291c1d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 --2- 10.20.193.51:0/3724034819 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f291c0a0750 0x7f291c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 >> 10.20.193.51:0/3724034819 conn(0x7f291c0a30c0 msgr2=0x7f291c0a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 shutdown_connections 2026-02-17T12:11:18.565 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.561+0000 7f29223e6640 1 -- 10.20.193.51:0/3724034819 wait complete. 2026-02-17T12:11:18.572 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:11:18.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:11:18.572 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:11:18.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 10 monclient: get_monmap_and_config 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 10 monclient: monmap: 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:18.637482+0000 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:18.637482+0000 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.641 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 1 Processor -- start 2026-02-17T12:11:18.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 1 -- start start 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.635+0000 7f11f8b2c640 10 monclient: init 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f11f40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f11f40a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f11f413c770 0x7f11f413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-a con 0x7f11f413c770 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11f409e8e0 con 0x7f11f40a3bb0 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11f406e140 con 0x7f11f40a0750 2026-02-17T12:11:18.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f11f409f910 con 0x7f11f413c770 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f8b2c640 10 monclient(hunting): authenticate will time out at 2166.256258s 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2575640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f11f40a3bb0 0x7f11f409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57330/0 (socket says 10.20.193.51:57330) 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f11f413c770 0x7f11f413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2575640 1 -- 10.20.193.51:0/556547713 learned_addr learned my addr 10.20.193.51:0/556547713 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): get_auth_request con 0x7f11f413c770 auth_method 0 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient(hunting): handle_auth_done global_id 274464 payload 274 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 1 -- 10.20.193.51:0/556547713 >> v1:10.20.193.142:6789/0 conn(0x7f11f40a0750 legacy=0x7f11f409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 1 -- 10.20.193.51:0/556547713 >> v1:10.20.193.51:6789/0 conn(0x7f11f40a3bb0 legacy=0x7f11f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.636+0000 7f11f2d76640 1 -- 10.20.193.51:0/556547713 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f409ccd0 con 0x7f11f413c770 2026-02-17T12:11:18.655 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.638+0000 7f11f2d76640 1 -- 10.20.193.51:0/556547713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 msgr2=0x7f11f413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.638+0000 7f11f2d76640 1 --2- 10.20.193.51:0/556547713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f413eb60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1e5b8ae9a16555 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.638+0000 7f11f1573640 1 -- 10.20.193.51:0/556547713 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e403c070 con 0x7f11f413c770 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.638+0000 7f11f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: dump: 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.656 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 5 monclient: authenticate success, global_id 274464 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:18.657 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 1 -- 10.20.193.51:0/556547713 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e4037640 con 0x7f11f413c770 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 1 -- 10.20.193.51:0/556547713 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4037a10 con 0x7f11f413c770 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f1573640 10 monclient: dump: 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.658 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 4 set_mon_vals no callback set 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 10 monclient: shutdown 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 -- 10.20.193.51:0/556547713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 msgr2=0x7f11f413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/556547713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f413eb60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e402f190 comp rx=0 tx=0).stop 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 -- 10.20.193.51:0/556547713 shutdown_connections 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/556547713 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f413eb60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.659 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 -- 10.20.193.51:0/556547713 >> 10.20.193.51:0/556547713 conn(0x7f11f40a30c0 msgr2=0x7f11f40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 -- 10.20.193.51:0/556547713 shutdown_connections 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 1 -- 10.20.193.51:0/556547713 wait complete. 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.639+0000 7f11f8b2c640 10 monclient: monmap: 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:18.660 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 Processor -- start 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 -- start start 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient: init 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11f40a0750 0x7f11f40998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-c con 0x7f11f40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11f40a3bb0 0x7f11f40903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.661 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-b con 0x7f11f40a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f4090930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): picked mon.noname-a con 0x7f11f413c770 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11f409c850 con 0x7f11f413c770 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11f409ebe0 con 0x7f11f40a3bb0 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f11f40a04b0 con 0x7f11f40a0750 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f8b2c640 10 monclient(hunting): authenticate will time out at 2166.260423s 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f4090930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f4090930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39776/0 (socket says 10.20.193.51:39776) 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 learned_addr learned my addr 10.20.193.51:0/3048995941 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): get_auth_request con 0x7f11f413c770 auth_method 0 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11f40a0750 0x7f11f40998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): get_auth_request con 0x7f11f40a0750 auth_method 0 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.664 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient(hunting): handle_auth_done global_id 274467 payload 824 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11f40a0750 msgr2=0x7f11f40998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f11f40a0750 0x7f11f40998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11f40a3bb0 msgr2=0x7f11f40903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f11f40a3bb0 0x7f11f40903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.640+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f40938b0 con 0x7f11f413c770 2026-02-17T12:11:18.665 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 msgr2=0x7f11f4090930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2d76640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f4090930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4047020 con 0x7f11f413c770 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: dump: 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.666 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e4042880 con 0x7f11f413c770 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.667 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e403c040 con 0x7f11f413c770 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f0d72640 4 set_mon_vals no callback set 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 10 monclient: dump: 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.668 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 5 monclient: authenticate success, global_id 274467 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 monclient: _renew_subs 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f4093b90 con 0x7f11f413c770 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 monclient: _renew_subs 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f413e6c0 con 0x7f11f413c770 2026-02-17T12:11:18.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 0x7f11f4090e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11f413cb50 con 0x7f11f4099e10 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 0x7f11f4090e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient: get_auth_request con 0x7f11f4099e10 auth_method 0 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f11e4043420 con 0x7f11f413c770 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 10 monclient(hunting): handle_auth_done global_id 274470 payload 824 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11f2575640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11f409dac0 con 0x7f11f4099e10 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11c003dd60 0x7f11c0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.643+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(930..930 src has 323..930) ==== 4751+0+0 (secure 0 0 0) 0x7f11e4078550 con 0x7f11f413c770 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.644+0000 7f11f1d74640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11c003dd60 0x7f11c0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.644+0000 7f11f1d74640 10 monclient: get_auth_request con 0x7f11c003dd60 auth_method 0 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11f2575640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 msgr2=0x7f11f4090e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11f2575640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 0x7f11f4090e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e800cbf0 con 0x7f11f4099e10 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.645+0000 7f11daffd640 10 monclient: dump: 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f11e8019070 con 0x7f11f4099e10 2026-02-17T12:11:18.672 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 msgr2=0x7f11f4090e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 0x7f11f4090e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e800ef70 comp rx=0 tx=0).stop 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 msgr2=0x7f11f4090e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11daffd640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4099e10 0x7f11f4090e70 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e800ef70 comp rx=0 tx=0).stop 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.646+0000 7f11f1d74640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11c003dd60 0x7f11c0040220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11f40a2790 tx=0x7f11dc006cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f8b2c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 0x7f11f41d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f8b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f11f40926d0 con 0x7f11f4072820 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 0x7f11f41d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient: get_auth_request con 0x7f11f4072820 auth_method 0 2026-02-17T12:11:18.673 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 10 monclient(hunting): handle_auth_done global_id 274473 payload 824 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.649+0000 7f11f2575640 1 -- 10.20.193.51:0/3048995941 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11f40008d0 con 0x7f11f4072820 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11f2575640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 msgr2=0x7f11f41d7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11f2575640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 0x7f11f41d7ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e801e250 con 0x7f11f4072820 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 10 monclient: dump: 2026-02-17T12:11:18.674 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 <== mon.0 v2:10.20.193.51:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f11e801e250 con 0x7f11f4072820 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 msgr2=0x7f11f41d7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.675 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 0x7f11f41d7ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e8004a40 comp rx=0 tx=0).stop 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 msgr2=0x7f11f41d7ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.651+0000 7f11daffd640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f4072820 0x7f11f41d7ee0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11e800eaa0 tx=0x7f11e8004a40 comp rx=0 tx=0).stop 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stdout: "state": "leader", 2026-02-17T12:11:18.676 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 240, 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 250009, 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.677 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.678 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:18.679 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.680 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.681 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.682 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.683 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:11:18.684 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.685 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "num": 4 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "num": 6 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:18.686 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.687 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.687 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.687 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:11:18.687 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11c003dd60 msgr2=0x7f11c0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f11c003dd60 0x7f11c0040220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11f40a2790 tx=0x7f11dc006cc0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 10 monclient: shutdown 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 msgr2=0x7f11f4090930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 --2- 10.20.193.51:0/3048995941 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f11f413c770 0x7f11f4090930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e4004b40 comp rx=0 tx=0).stop 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 reap_dead start 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f2d76640 1 -- 10.20.193.51:0/3048995941 reap_dead start 2026-02-17T12:11:18.688 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 shutdown_connections 2026-02-17T12:11:18.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 >> 10.20.193.51:0/3048995941 conn(0x7f11f40a30c0 msgr2=0x7f11f40a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 shutdown_connections 2026-02-17T12:11:18.689 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.652+0000 7f11f8b2c640 1 -- 10.20.193.51:0/3048995941 wait complete. 2026-02-17T12:11:18.689 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:11:18.689 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:11:18.689 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:11:18.690 INFO:tasks.rados.rados.0.trial142.stdout:3988: done (2 left) 2026-02-17T12:11:18.690 INFO:tasks.rados.rados.0.trial142.stdout:3989: done (1 left) 2026-02-17T12:11:18.690 INFO:tasks.rados.rados.0.trial142.stdout:3990: done (0 left) 2026-02-17T12:11:18.690 INFO:tasks.rados.rados.0.trial142.stdout:3991: snap_create 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 10 monclient: get_monmap_and_config 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 10 monclient: monmap: 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:18.758246+0000 2026-02-17T12:11:18.759 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:18.758246+0000 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:18.760 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 1 Processor -- start 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 1 -- start start 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.756+0000 7f4464ff5640 10 monclient: init 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 0x7f446009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-c con 0x7f44600a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f44600a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f446013b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446006e140 con 0x7f446013b760 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446009f910 con 0x7f44600a0750 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f446009ccd0 con 0x7f44600a3bb0 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f4464ff5640 10 monclient(hunting): authenticate will time out at 2166.377313s 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445ed76640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f446013b760 0x7f446013db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57336/0 (socket says 10.20.193.51:57336) 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 learned_addr learned my addr 10.20.193.51:0/3603658501 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 1 --2- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 0x7f446009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 10 monclient(hunting): get_auth_request con 0x7f44600a3bb0 auth_method 0 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 1 -- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 msgr2=0x7f446009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 1 -- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 msgr2=0x7f446009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 1 --2- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 0x7f446009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:18.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.757+0000 7f445e575640 1 --2- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 0x7f446009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 >> v1:10.20.193.51:6789/0 conn(0x7f446013b760 legacy=0x7f446013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062865258 0 0) 0x7f446006e140 con 0x7f446013b760 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): _negotiate 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): my global_id is 274476 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 --> v1:10.20.193.51:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f444c003620 con 0x7f446013b760 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v1:10.20.193.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3975520502 0 0) 0x7f444c003620 con 0x7f446013b760 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 msgr2=0x7f446009dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:11:18.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 --2- 10.20.193.51:0/3603658501 >> v2:10.20.193.142:3300/0 conn(0x7f44600a3bb0 0x7f446009dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 >> v1:10.20.193.142:6789/0 conn(0x7f44600a0750 legacy=0x7f446009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.51:6789/0 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 --> v1:10.20.193.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446009eec0 con 0x7f446013b760 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v1:10.20.193.51:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1607964689 0 0) 0x7f4450003530 con 0x7f446013b760 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f4464ff5640 5 monclient: authenticate success, global_id 274476 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f4464ff5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: dump: 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.769 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] but i'm connected to v1:10.20.193.51:6789/0, reconnecting 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 >> v1:10.20.193.51:6789/0 conn(0x7f446013b760 legacy=0x7f446013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c003b80 0x7f444c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): picked mon.b con 0x7f444c003b80 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c004900 0x7f444c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): picked mon.c con 0x7f444c004900 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 0x7f444c00bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): picked mon.a con 0x7f444c0054c0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f446009ccd0 con 0x7f444c0054c0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f444c00c3e0 con 0x7f444c003b80 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f444c00c5e0 con 0x7f444c004900 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445d573640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f4464ff5640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445ed76640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 0x7f444c00bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): get_auth_request con 0x7f444c0054c0 auth_method 0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.759+0000 7f445dd74640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c004900 0x7f444c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): get_auth_request con 0x7f444c004900 auth_method 0 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445e575640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c003b80 0x7f444c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445e575640 10 monclient(hunting): get_auth_request con 0x7f444c003b80 auth_method 0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445e575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient(hunting): handle_auth_done global_id 274476 payload 293 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c004900 msgr2=0x7f444c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f444c004900 0x7f444c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c003b80 msgr2=0x7f444c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c003b80 0x7f444c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 monclient: found mon.a 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c003620 con 0x7f444c0054c0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.760+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 reap_dead start 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445ed76640 1 -- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 msgr2=0x7f444c00bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445ed76640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 0x7f444c00bb00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4450003060 tx=0x7f4450030420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3572f021441e1a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450005aa0 con 0x7f444c0054c0 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: dump: 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4450034030 con 0x7f444c0054c0 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 1 -- 10.20.193.51:0/3603658501 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445003a670 con 0x7f444c0054c0 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f445d573640 10 monclient: dump: 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 4 set_mon_vals no callback set 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 10 monclient: shutdown 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 1 -- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 msgr2=0x7f444c00bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.762+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 0x7f444c00bb00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4450003060 tx=0x7f4450030420 comp rx=0 tx=0).stop 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- 10.20.193.51:0/3603658501 shutdown_connections 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3603658501 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f444c0054c0 0x7f444c00bb00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- 10.20.193.51:0/3603658501 >> 10.20.193.51:0/3603658501 conn(0x7f44600a30c0 msgr2=0x7f44600a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- 10.20.193.51:0/3603658501 shutdown_connections 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- 10.20.193.51:0/3603658501 wait complete. 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient: monmap: 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 Processor -- start 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- start start 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient: init 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0054c0 0x7f446009c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-b con 0x7f444c0054c0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 0x7f4460096be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-a con 0x7f4460096800 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460097120 0x7f44601d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): picked mon.noname-c con 0x7f4460097120 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44600a04b0 con 0x7f4460096800 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f446009c850 con 0x7f444c0054c0 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f446009dac0 con 0x7f4460097120 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.763+0000 7f4464ff5640 10 monclient(hunting): authenticate will time out at 2166.383987s 2026-02-17T12:11:18.776 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 0x7f4460096be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 0x7f4460096be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39808/0 (socket says 10.20.193.51:39808) 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 -- 10.20.193.51:0/3139963633 learned_addr learned my addr 10.20.193.51:0/3139963633 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): get_auth_request con 0x7f4460096800 auth_method 0 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460097120 0x7f44601d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): get_auth_request con 0x7f4460097120 auth_method 0 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0054c0 0x7f446009c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.777 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient(hunting): handle_auth_done global_id 274479 payload 824 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460097120 msgr2=0x7f44601d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460097120 0x7f44601d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0054c0 msgr2=0x7f446009c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0054c0 0x7f446009c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445dd74640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446009a150 con 0x7f4460096800 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445e575640 10 monclient: get_auth_request con 0x7f444c0054c0 auth_method 0 2026-02-17T12:11:18.778 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.764+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f444c0054c0 0x7f446009c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f445dd74640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 msgr2=0x7f4460096be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f445dd74640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 0x7f4460096be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f444800f8a0 tx=0x7f444800fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448017020 con 0x7f4460096800 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.781 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: dump: 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444800d730 con 0x7f4460096800 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 5 monclient: authenticate success, global_id 274479 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 10 monclient: _renew_subs 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44600988c0 con 0x7f4460096800 2026-02-17T12:11:18.782 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448003e60 con 0x7f4460096800 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f445cd72640 4 set_mon_vals no callback set 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4446ffd640 10 monclient: dump: 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 10 monclient: _renew_subs 2026-02-17T12:11:18.783 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44600a2730 con 0x7f4460096800 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.766+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 0x7f44600638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f446009de50 con 0x7f4460092a80 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 0x7f44600638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient: get_auth_request con 0x7f4460092a80 auth_method 0 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f444800db80 con 0x7f4460096800 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 10 monclient(hunting): handle_auth_done global_id 304202 payload 824 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445e575640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4460099f30 con 0x7f4460092a80 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f4446ffd640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f442c03dd10 0x7f442c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(931..931 src has 323..931) ==== 4751+0+0 (secure 0 0 0) 0x7f4448052940 con 0x7f4460096800 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445ed76640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f442c03dd10 0x7f442c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.784 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.767+0000 7f445ed76640 10 monclient: get_auth_request con 0x7f442c03dd10 auth_method 0 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f445e575640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 msgr2=0x7f44600638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 0x7f44600638c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f445400fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454019070 con 0x7f4460092a80 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 10 monclient: dump: 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f4454014b60 con 0x7f4460092a80 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.785 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 msgr2=0x7f44600638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 0x7f44600638c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f445400fa20 comp rx=0 tx=0).stop 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 msgr2=0x7f44600638c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.769+0000 7f4446ffd640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092a80 0x7f44600638c0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f445400fa20 comp rx=0 tx=0).stop 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.770+0000 7f445ed76640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f442c03dd10 0x7f442c0401d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f446006dd20 tx=0x7f445000a070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f4464ff5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 0x7f44601d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f4464ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f44600008d0 con 0x7f4460092e60 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 0x7f44601d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient: get_auth_request con 0x7f4460092e60 auth_method 0 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 10 monclient(hunting): handle_auth_done global_id 304205 payload 824 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.772+0000 7f445e575640 1 -- 10.20.193.51:0/3139963633 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4460050ac0 con 0x7f4460092e60 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f445e575640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 msgr2=0x7f44601d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f445e575640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 0x7f44601d9df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f44540047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454003230 con 0x7f4460092e60 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 10 monclient: dump: 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 <== mon.2 v2:10.20.193.51:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f4454014e80 con 0x7f4460092e60 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 msgr2=0x7f44601d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.787 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 0x7f44601d9df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f44540047c0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 msgr2=0x7f44601d9df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4446ffd640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4460092e60 0x7f44601d9df0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f445400f550 tx=0x7f44540047c0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 240, 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 65042, 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.788 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 0, 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.789 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:11:18.790 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:18.791 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.792 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:11:18.793 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:11:18.794 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.795 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "osd": [ 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "num": 2 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:11:18.796 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:18.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f442c03dd10 msgr2=0x7f442c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f442c03dd10 0x7f442c0401d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f446006dd20 tx=0x7f445000a070 comp rx=0 tx=0).stop 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 10 monclient: shutdown 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 msgr2=0x7f4460096be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 --2- 10.20.193.51:0/3139963633 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4460096800 0x7f4460096be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f444800f8a0 tx=0x7f444800fd70 comp rx=0 tx=0).stop 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f445ed76640 1 -- 10.20.193.51:0/3139963633 reap_dead start 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f445ed76640 1 -- 10.20.193.51:0/3139963633 reap_dead start 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 shutdown_connections 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 >> 10.20.193.51:0/3139963633 conn(0x7f44600a30c0 msgr2=0x7f4460072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 shutdown_connections 2026-02-17T12:11:18.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.775+0000 7f4464ff5640 1 -- 10.20.193.51:0/3139963633 wait complete. 2026-02-17T12:11:18.798 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:11:18.798 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:11:18.798 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:11:18.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.862+0000 7f8654838640 10 monclient: get_monmap_and_config 2026-02-17T12:11:18.865 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.862+0000 7f8654838640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient: monmap: 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:18.864959+0000 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:18.864959+0000 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:18.866 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 Processor -- start 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 -- start start 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient: init 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f864c138600 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): picked mon.noname-b con 0x7f864c0a35a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f864c13d8a0 0x7f864c13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): picked mon.noname-a con 0x7f864c13d8a0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864c0a1df0 con 0x7f864c138600 2026-02-17T12:11:18.868 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f864c0a6830 con 0x7f864c13d8a0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f864c0a2c00 con 0x7f864c0a35a0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8654838640 10 monclient(hunting): authenticate will time out at 2166.483854s 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f864c13d8a0 0x7f864c13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39674/0 (socket says 10.20.193.51:39674) 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 1 -- 10.20.193.51:0/3327653035 learned_addr learned my addr 10.20.193.51:0/3327653035 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): get_auth_request con 0x7f864c0a35a0 auth_method 0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): get_auth_request con 0x7f864c13d8a0 auth_method 0 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.869 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient(hunting): handle_auth_done global_id 274482 payload 274 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 -- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 msgr2=0x7f864c13d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 -- 10.20.193.51:0/3327653035 >> v1:10.20.193.142:6789/0 conn(0x7f864c138600 legacy=0x7f864c1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8652dae640 1 -- 10.20.193.51:0/3327653035 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c0a65b0 con 0x7f864c13d8a0 2026-02-17T12:11:18.870 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.864+0000 7f8651dac640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8652dae640 1 -- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c13d8a0 msgr2=0x7f864c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8652dae640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c13d8a0 0x7f864c13fc90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46b763784924efb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 1 -- 10.20.193.51:0/3327653035 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864003c070 con 0x7f864c13d8a0 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: dump: 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 1 -- 10.20.193.51:0/3327653035 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640037440 con 0x7f864c13d8a0 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8654838640 5 monclient: authenticate success, global_id 274482 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8654838640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 1 -- 10.20.193.51:0/3327653035 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640037810 con 0x7f864c13d8a0 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8654838640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f8654838640 4 set_mon_vals no callback set 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.866+0000 7f86515ab640 10 monclient: dump: 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 10 monclient: shutdown 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c13d8a0 msgr2=0x7f864c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c13d8a0 0x7f864c13fc90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864002f190 comp rx=0 tx=0).stop 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- 10.20.193.51:0/3327653035 shutdown_connections 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c13d8a0 0x7f864c13fc90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 --2- 10.20.193.51:0/3327653035 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c0a35a0 0x7f864c13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- 10.20.193.51:0/3327653035 >> 10.20.193.51:0/3327653035 conn(0x7f864c0a7460 msgr2=0x7f864c0a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- 10.20.193.51:0/3327653035 shutdown_connections 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- 10.20.193.51:0/3327653035 wait complete. 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 10 monclient: build_initial_monmap 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 10 monclient: monmap: 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 Processor -- start 2026-02-17T12:11:18.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 1 -- start start 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.867+0000 7f8654838640 10 monclient: init 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): picked mon.noname-a con 0x7f864c0a35a0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f864c138600 0x7f864c1357e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): picked mon.noname-b con 0x7f864c138600 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c13d8a0 0x7f864c135d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): picked mon.noname-c con 0x7f864c13d8a0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f864c0a15f0 con 0x7f864c0a35a0 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f864c0a25b0 con 0x7f864c138600 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f864c0a1770 con 0x7f864c13d8a0 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8654838640 10 monclient(hunting): authenticate will time out at 2166.488135s 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c13d8a0 0x7f864c135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39826/0 (socket says 10.20.193.51:39826) 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 -- 10.20.193.51:0/2953258015 learned_addr learned my addr 10.20.193.51:0/2953258015 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): get_auth_request con 0x7f864c0a35a0 auth_method 0 2026-02-17T12:11:18.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): get_auth_request con 0x7f864c13d8a0 auth_method 0 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8652dae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f864c138600 0x7f864c1357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8651dac640 10 monclient(hunting): get_auth_request con 0x7f864c138600 auth_method 0 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f8651dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient(hunting): handle_auth_done global_id 274485 payload 824 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c13d8a0 msgr2=0x7f864c135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f864c13d8a0 0x7f864c135d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f864c138600 msgr2=0x7f864c1357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f864c138600 0x7f864c1357e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:18.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient: _finish_hunting 0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 monclient: found mon.noname-a 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.869+0000 7f86525ad640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c0a1ae0 con 0x7f864c0a35a0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f86525ad640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 msgr2=0x7f864c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f86525ad640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f864400c5d0 tx=0x7f864400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644016020 con 0x7f864c0a35a0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: dump: 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:18.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644012a60 con 0x7f864c0a35a0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 5 monclient: authenticate success, global_id 274485 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 10 monclient: _renew_subs 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c071930 con 0x7f864c0a35a0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8650daa640 4 set_mon_vals no callback set 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644012e50 con 0x7f864c0a35a0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8636ffd640 10 monclient: dump: 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 10 monclient: _renew_subs 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:18.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.870+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c073c20 con 0x7f864c0a35a0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8654838640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8618007db0 con 0x7f8618004090 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f864401b400 con 0x7f864c0a35a0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618004090 auth_method 0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8636ffd640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 0x7f861c0403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(931..931 src has 323..931) ==== 4751+0+0 (secure 0 0 0) 0x7f8644052610 con 0x7f864c0a35a0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8652dae640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 0x7f861c0403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:18.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.871+0000 7f8652dae640 10 monclient: get_auth_request con 0x7f861c03df00 auth_method 0 2026-02-17T12:11:18.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:18.874+0000 7f8652dae640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 0x7f861c0403c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f864c0ab950 tx=0x7f8640033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.072+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.072+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618004090 auth_method 0 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.072+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.072+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.072+0000 7f8651dac640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.073+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.073+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.073+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:19.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.073+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:11:19.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.476 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618004090 auth_method 0 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:19.477 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.474+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:11:19.690 INFO:tasks.rados.rados.0.trial142.stdout:3991: done (0 left) 2026-02-17T12:11:19.690 INFO:tasks.rados.rados.0.trial142.stdout:3992: write oid 14 current snap is 456 2026-02-17T12:11:19.690 INFO:tasks.rados.rados.0.trial142.stdout:3992: seq_num 1357 ranges {407099=423727,1441712=515472,2582060=225039} 2026-02-17T12:11:19.693 INFO:tasks.rados.rados.0.trial142.stdout:3992: writing trial14245205-14 from 407099 to 830826 tid 1 2026-02-17T12:11:19.697 INFO:tasks.rados.rados.0.trial142.stdout:3992: writing trial14245205-14 from 1441712 to 1957184 tid 2 2026-02-17T12:11:19.701 INFO:tasks.rados.rados.0.trial142.stdout:3992: writing trial14245205-14 from 2582060 to 2807099 tid 3 2026-02-17T12:11:19.701 INFO:tasks.rados.rados.0.trial142.stdout:3993: delete oid 28 current snap is 456 2026-02-17T12:11:19.701 INFO:tasks.rados.rados.0.trial142.stdout:3992: finishing write tid 1 to trial14245205-14 2026-02-17T12:11:19.701 INFO:tasks.rados.rados.0.trial142.stdout:3992: finishing write tid 2 to trial14245205-14 2026-02-17T12:11:19.703 INFO:tasks.rados.rados.0.trial142.stdout:3992: finishing write tid 3 to trial14245205-14 2026-02-17T12:11:19.703 INFO:tasks.rados.rados.0.trial142.stdout:3992: finishing write tid 4 to trial14245205-14 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3993: done (1 left) 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3994: copy_from oid 44 from oid 2 current snap is 456 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: finishing write tid 5 to trial14245205-14 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: oid 14 updating version 0 to 3897 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: oid 14 version 3897 is already newer than 3895 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: oid 14 version 3897 is already newer than 3896 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: oid 14 version 3897 is already newer than 3894 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 14 v 3897 (ObjNum 1357 snap 456 seq_num 1357) dirty exists 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: left oid 14 (ObjNum 1357 snap 456 seq_num 1357) 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3992: done (1 left) 2026-02-17T12:11:19.704 INFO:tasks.rados.rados.0.trial142.stdout:3995: write (excl) oid 3 current snap is 456 2026-02-17T12:11:19.705 INFO:tasks.rados.rados.0.trial142.stdout:3995: seq_num 1359 ranges {440713=574225,1442323=519141,2636906=203807} 2026-02-17T12:11:19.707 INFO:tasks.rados.rados.0.trial142.stdout:3995: writing trial14245205-3 from 440713 to 1014938 tid 1 2026-02-17T12:11:19.711 INFO:tasks.rados.rados.0.trial142.stdout:3995: writing trial14245205-3 from 1442323 to 1961464 tid 2 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3995: writing trial14245205-3 from 2636906 to 2840713 tid 3 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3996: copy_from oid 34 from oid 16 current snap is 456 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3995: finishing write tid 1 to trial14245205-3 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3995: finishing write tid 2 to trial14245205-3 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3997: rollback oid 36 current snap is 456 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:rollback oid 36 to 436 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3998: read oid 46 snap 436 2026-02-17T12:11:19.715 INFO:tasks.rados.rados.0.trial142.stdout:3998: expect deleted 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout:3999: read oid 25 snap 450 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout:3999: expect deleted 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 6 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout:3998: done (5 left) 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 5 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout:3994: finishing copy_from racing read to trial14245205-44 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout:3999: done (4 left) 2026-02-17T12:11:19.716 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 4 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3994: finishing copy_from to trial14245205-44 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 44 v 2785 (ObjNum 1266 snap 415 seq_num 1266) dirty exists 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3994: done (3 left) 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 3 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3995: finishing write tid 3 to trial14245205-3 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3995: finishing write tid 4 to trial14245205-3 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3995: finishing write tid 5 to trial14245205-3 2026-02-17T12:11:19.718 INFO:tasks.rados.rados.0.trial142.stdout:3995: oid 3 updating version 0 to 3880 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3995: oid 3 version 3880 is already newer than 3877 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3995: oid 3 version 3880 is already newer than 3878 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3995: oid 3 version 3880 is already newer than 3879 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 3 v 3880 (ObjNum 1359 snap 456 seq_num 1359) dirty exists 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3995: left oid 3 (ObjNum 1359 snap 456 seq_num 1359) 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3995: done (2 left) 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 2 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3997: finishing rollback tid 0 to trial14245205-36 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3997: finishing rollback tid 1 to trial14245205-36 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3997: finishing rollback tid 2 to trial14245205-36 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 36 v 3125 (ObjNum 1302 snap 433 seq_num 1302) dirty exists 2026-02-17T12:11:19.719 INFO:tasks.rados.rados.0.trial142.stdout:3997: done (1 left) 2026-02-17T12:11:19.720 INFO:tasks.rados.rados.0.trial142.stdout: waiting on 1 2026-02-17T12:11:19.724 INFO:tasks.rados.rados.0.trial142.stdout:3996: finishing copy_from racing read to trial14245205-34 2026-02-17T12:11:19.727 INFO:tasks.rados.rados.0.trial142.stdout:3996: finishing copy_from to trial14245205-34 2026-02-17T12:11:19.727 INFO:tasks.rados.rados.0.trial142.stdout:update_object_version oid 34 v 2785 (ObjNum 1059 snap 343 seq_num 1059) dirty exists 2026-02-17T12:11:19.727 INFO:tasks.rados.rados.0.trial142.stdout:3996: done (0 left) 2026-02-17T12:11:19.729 INFO:tasks.rados.rados.0.trial142.stderr:0 errors. 2026-02-17T12:11:19.729 INFO:tasks.rados.rados.0.trial142.stderr: 2026-02-17T12:11:19.731 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:11:19.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.795+0000 7f35a9dd3640 10 monclient: get_monmap_and_config 2026-02-17T12:11:19.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.795+0000 7f35a9dd3640 10 monclient: build_initial_monmap 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.795+0000 7f35a9dd3640 10 monclient: monmap: 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:19.796642+0000 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:19.796642+0000 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:19.798 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:19.799 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:19.799 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:19.799 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:19.799 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 Processor -- start 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 -- start start 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient: init 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f35a40a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f35a40a0750 0x7f35a409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-c con 0x7f35a40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 0x7f35a413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-b con 0x7f35a413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:19.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a406e140 con 0x7f35a40a3bb0 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f35a409f910 con 0x7f35a40a0750 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f35a409ccd0 con 0x7f35a413b760 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a9dd3640 10 monclient(hunting): authenticate will time out at 2167.415410s 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a37fe640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f35a40a3bb0 0x7f35a409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57350/0 (socket says 10.20.193.51:57350) 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a37fe640 1 -- 10.20.193.51:0/3827638133 learned_addr learned my addr 10.20.193.51:0/3827638133 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 --2- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 0x7f35a413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): get_auth_request con 0x7f35a413b760 auth_method 0 2026-02-17T12:11:19.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a2ffd640 1 --2- 10.20.193.51:0/3827638133 >> v2:10.20.193.142:3300/0 conn(0x7f35a40a0750 0x7f35a409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a2ffd640 10 monclient(hunting): get_auth_request con 0x7f35a40a0750 auth_method 0 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient(hunting): handle_auth_done global_id 304214 payload 274 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 -- 10.20.193.51:0/3827638133 >> v2:10.20.193.142:3300/0 conn(0x7f35a40a0750 msgr2=0x7f35a409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:19.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 --2- 10.20.193.51:0/3827638133 >> v2:10.20.193.142:3300/0 conn(0x7f35a40a0750 0x7f35a409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 -- 10.20.193.51:0/3827638133 >> v1:10.20.193.51:6789/0 conn(0x7f35a40a3bb0 legacy=0x7f35a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 monclient: found mon.noname-b 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.796+0000 7f35a3fff640 1 -- 10.20.193.51:0/3827638133 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a409eec0 con 0x7f35a413b760 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a3fff640 1 -- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 msgr2=0x7f35a413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a3fff640 1 --2- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 0x7f35a413db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35a406f3c0 tx=0x7f359802f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf2da3df3e0fe076 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 1 -- 10.20.193.51:0/3827638133 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359803c070 con 0x7f35a413b760 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: dump: 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:19.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 1 -- 10.20.193.51:0/3827638133 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3598037440 con 0x7f35a413b760 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 5 monclient: authenticate success, global_id 304214 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 1 -- 10.20.193.51:0/3827638133 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598037810 con 0x7f35a413b760 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 4 set_mon_vals no callback set 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a27fc640 10 monclient: dump: 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.813 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 10 monclient: shutdown 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 msgr2=0x7f35a413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 0x7f35a413db50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35a406f3c0 tx=0x7f359802f130 comp rx=0 tx=0).stop 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3827638133 shutdown_connections 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3827638133 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a413b760 0x7f35a413db50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3827638133 >> v2:10.20.193.142:3300/0 conn(0x7f35a40a0750 0x7f35a409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3827638133 >> 10.20.193.51:0/3827638133 conn(0x7f35a40a30c0 msgr2=0x7f35a40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3827638133 shutdown_connections 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.799+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3827638133 wait complete. 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient: build_initial_monmap 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient: monmap: 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:19.815 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 Processor -- start 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 -- start start 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient: init 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-c con 0x7f35a40a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f35a40a3bb0 0x7f35a409b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-a con 0x7f35a40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 0x7f35a4131350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): picked mon.noname-b con 0x7f35a413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f35a40a04b0 con 0x7f35a40a3bb0 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f35a409c850 con 0x7f35a413b760 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f35a409e710 con 0x7f35a40a0750 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a9dd3640 10 monclient(hunting): authenticate will time out at 2167.419475s 2026-02-17T12:11:19.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39698/0 (socket says 10.20.193.51:39698) 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 -- 10.20.193.51:0/3145300079 learned_addr learned my addr 10.20.193.51:0/3145300079 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): get_auth_request con 0x7f35a40a0750 auth_method 0 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f35a40a3bb0 0x7f35a409b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): get_auth_request con 0x7f35a40a3bb0 auth_method 0 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a3fff640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 0x7f35a4131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient(hunting): handle_auth_done global_id 304217 payload 824 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 -- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 msgr2=0x7f35a4131350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 0x7f35a4131350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 -- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f35a40a3bb0 msgr2=0x7f35a409b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f35a40a3bb0 0x7f35a409b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:19.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 monclient: found mon.noname-c 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a37fe640 1 -- 10.20.193.51:0/3145300079 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a4134fb0 con 0x7f35a40a0750 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a3fff640 10 monclient: get_auth_request con 0x7f35a413b760 auth_method 0 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.800+0000 7f35a3fff640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 0x7f35a4131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a37fe640 1 -- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 msgr2=0x7f35a409b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a37fe640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f359000c750 tx=0x7f359000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590005de0 con 0x7f35a40a0750 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: dump: 2026-02-17T12:11:19.820 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: _finish_auth 0 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:11:19.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3590007070 con 0x7f35a40a0750 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590007440 con 0x7f35a40a0750 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f357ffff640 10 monclient: dump: 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a1ffb640 4 set_mon_vals no callback set 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 5 monclient: authenticate success, global_id 304217 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 10 monclient: _renew_subs 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a4134750 con 0x7f35a40a0750 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 10 monclient: _renew_subs 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.802+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a40a27b0 con 0x7f35a40a0750 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3590007660 con 0x7f35a40a0750 2026-02-17T12:11:19.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a9dd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a9dd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a9dd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a409d7b0 con 0x7f35a40a0750 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f357ffff640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 0x7f3574040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(932..932 src has 323..932) ==== 4707+0+0 (secure 0 0 0) 0x7f35900523f0 con 0x7f35a40a0750 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a2ffd640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 0x7f3574040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.803+0000 7f35a2ffd640 10 monclient: get_auth_request con 0x7f357403dd60 auth_method 0 2026-02-17T12:11:19.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.806+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3590050e30 con 0x7f35a40a0750 2026-02-17T12:11:19.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.806+0000 7f357ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.806+0000 7f357ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:19.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.806+0000 7f35a2ffd640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 0x7f3574040220 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35a4132ba0 tx=0x7f3594008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.890+0000 7f35a9dd3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.890+0000 7f35a9dd3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.890+0000 7f35a9dd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.890+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35a409dac0 con 0x7f35a40a0750 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.891+0000 7f357ffff640 1 -- 10.20.193.51:0/3145300079 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v932) ==== 74+0+14162 (secure 0 0 0) 0x7f3590052120 con 0x7f35a40a0750 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.891+0000 7f357ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:19.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.891+0000 7f357ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:19.894 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:19.894 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":932,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T12:11:19.686010+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:45:34.073497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:57.695908+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"932","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":467,"snap_epoch":932,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:11:19.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 msgr2=0x7f3574040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 0x7f3574040220 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35a4132ba0 tx=0x7f3594008040 comp rx=0 tx=0).stop 2026-02-17T12:11:19.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 10 monclient: shutdown 2026-02-17T12:11:19.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:19.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 msgr2=0x7f35a409b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f359000c750 tx=0x7f359000cc20 comp rx=0 tx=0).stop 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 shutdown_connections 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f357403dd60 0x7f3574040220 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f35a413b760 0x7f35a4131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f35a40a3bb0 0x7f35a409b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 --2- 10.20.193.51:0/3145300079 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f35a40a0750 0x7f35a409b490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 >> 10.20.193.51:0/3145300079 conn(0x7f35a40a30c0 msgr2=0x7f35a4139f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 shutdown_connections 2026-02-17T12:11:19.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.892+0000 7f35a9dd3640 1 -- 10.20.193.51:0/3145300079 wait complete. 2026-02-17T12:11:19.902 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:19.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 10 monclient: get_monmap_and_config 2026-02-17T12:11:19.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 10 monclient: build_initial_monmap 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 10 monclient: monmap: 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:19.968414+0000 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:19.968414+0000 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:19.972 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 1 Processor -- start 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 1 -- start start 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.967+0000 7f4cad28f640 10 monclient: init 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T12:11:19.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4ca80a3bb0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4ca80a0750 0x7f4ca809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-c con 0x7f4ca80a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 0x7f4ca813db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-b con 0x7f4ca813b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca806e140 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca809f910 con 0x7f4ca80a0750 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca809ccd0 con 0x7f4ca813b760 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4cad28f640 10 monclient(hunting): authenticate will time out at 2167.587158s 2026-02-17T12:11:19.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca6ffd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f4ca80a3bb0 0x7f4ca809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57356/0 (socket says 10.20.193.51:57356) 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca6ffd640 1 -- 10.20.193.51:0/1485078679 learned_addr learned my addr 10.20.193.51:0/1485078679 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 --2- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 0x7f4ca813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): get_auth_request con 0x7f4ca813b760 auth_method 0 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca67fc640 1 --2- 10.20.193.51:0/1485078679 >> v2:10.20.193.142:3300/0 conn(0x7f4ca80a0750 0x7f4ca809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca67fc640 10 monclient(hunting): get_auth_request con 0x7f4ca80a0750 auth_method 0 2026-02-17T12:11:19.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient(hunting): handle_auth_done global_id 304220 payload 274 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 -- 10.20.193.51:0/1485078679 >> v2:10.20.193.142:3300/0 conn(0x7f4ca80a0750 msgr2=0x7f4ca809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 --2- 10.20.193.51:0/1485078679 >> v2:10.20.193.142:3300/0 conn(0x7f4ca80a0750 0x7f4ca809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 -- 10.20.193.51:0/1485078679 >> v1:10.20.193.51:6789/0 conn(0x7f4ca80a3bb0 legacy=0x7f4ca809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 monclient: found mon.noname-b 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.968+0000 7f4ca77fe640 1 -- 10.20.193.51:0/1485078679 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca809eec0 con 0x7f4ca813b760 2026-02-17T12:11:19.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.970+0000 7f4ca77fe640 1 -- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 msgr2=0x7f4ca813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:19.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.970+0000 7f4ca77fe640 1 --2- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 0x7f4ca813db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806f3c0 tx=0x7f4c9802f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93888258802b59f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 1 -- 10.20.193.51:0/1485078679 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9803c070 con 0x7f4ca813b760 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: dump: 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 1 -- 10.20.193.51:0/1485078679 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98037440 con 0x7f4ca813b760 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 5 monclient: authenticate success, global_id 304220 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 1 -- 10.20.193.51:0/1485078679 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98037810 con 0x7f4ca813b760 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:19.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 4 set_mon_vals no callback set 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4ca5ffb640 10 monclient: dump: 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.985 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 10 monclient: shutdown 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 -- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 msgr2=0x7f4ca813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 --2- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 0x7f4ca813db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806f3c0 tx=0x7f4c9802f130 comp rx=0 tx=0).stop 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 -- 10.20.193.51:0/1485078679 shutdown_connections 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 --2- 10.20.193.51:0/1485078679 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca813b760 0x7f4ca813db50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 --2- 10.20.193.51:0/1485078679 >> v2:10.20.193.142:3300/0 conn(0x7f4ca80a0750 0x7f4ca809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 -- 10.20.193.51:0/1485078679 >> 10.20.193.51:0/1485078679 conn(0x7f4ca80a30c0 msgr2=0x7f4ca80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 -- 10.20.193.51:0/1485078679 shutdown_connections 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 1 -- 10.20.193.51:0/1485078679 wait complete. 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 10 monclient: build_initial_monmap 2026-02-17T12:11:19.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.971+0000 7f4cad28f640 10 monclient: monmap: 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 Processor -- start 2026-02-17T12:11:19.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 -- start start 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient: init 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 0x7f4ca8138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-a con 0x7f4ca80a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 0x7f4ca8139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-c con 0x7f4ca80a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ca813b760 0x7f4ca80954a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): picked mon.noname-b con 0x7f4ca813b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80a04b0 con 0x7f4ca80a0750 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca809c850 con 0x7f4ca813b760 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca809e710 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4cad28f640 10 monclient(hunting): authenticate will time out at 2167.591326s 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 0x7f4ca8138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 0x7f4ca8139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 0x7f4ca8138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39838/0 (socket says 10.20.193.51:39838) 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 1 -- 10.20.193.51:0/2474534274 learned_addr learned my addr 10.20.193.51:0/2474534274 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): get_auth_request con 0x7f4ca80a3bb0 auth_method 0 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): get_auth_request con 0x7f4ca80a0750 auth_method 0 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient(hunting): handle_auth_done global_id 304223 payload 824 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 -- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ca813b760 msgr2=0x7f4ca80954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ca813b760 0x7f4ca80954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 -- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 msgr2=0x7f4ca8138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 0x7f4ca8138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient: _finish_hunting 0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 monclient: found mon.noname-c 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.972+0000 7f4ca67fc640 1 -- 10.20.193.51:0/2474534274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8099030 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4ca67fc640 1 -- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 msgr2=0x7f4ca8139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4ca67fc640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 0x7f4ca8139000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e840 tx=0x7f4c9000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90017070 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: dump: 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9000ca60 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000f040 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4ca57fa640 4 set_mon_vals no callback set 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4c877fe640 10 monclient: dump: 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.993 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 5 monclient: authenticate success, global_id 304223 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 10 monclient: _renew_subs 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca8099310 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 10 monclient: _renew_subs 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.974+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca80a2d20 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4cad28f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4cad28f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4cad28f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca809d7b0 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4c90012050 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4c877fe640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 0x7f4c74040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(932..932 src has 323..932) ==== 4707+0+0 (secure 0 0 0) 0x7f4c90052280 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4ca6ffd640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 0x7f4c74040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.975+0000 7f4ca6ffd640 10 monclient: get_auth_request con 0x7f4c7403dd60 auth_method 0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.978+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4c9001be40 con 0x7f4ca80a3bb0 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.978+0000 7f4c877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:19.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.978+0000 7f4c877fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:19.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:19.978+0000 7f4ca6ffd640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 0x7f4c74040220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007e50 tx=0x7f4c9c007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:20.063 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.061+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ca809dac0 con 0x7f4c7403dd60 2026-02-17T12:11:20.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.063+0000 7f4c877fe640 1 -- 10.20.193.51:0/2474534274 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+76872 (secure 0 0 0) 0x7f4ca809dac0 con 0x7f4c7403dd60 2026-02-17T12:11:20.066 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:20.067 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:20.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 msgr2=0x7f4c74040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 0x7f4c74040220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007e50 tx=0x7f4c9c007da0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.068 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 10 monclient: shutdown 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 msgr2=0x7f4ca8139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 0x7f4ca8139000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e840 tx=0x7f4c9000ed10 comp rx=0 tx=0).stop 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 shutdown_connections 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4c7403dd60 0x7f4c74040220 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4ca813b760 0x7f4ca80954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4ca80a3bb0 0x7f4ca8139000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 --2- 10.20.193.51:0/2474534274 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4ca80a0750 0x7f4ca8138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 >> 10.20.193.51:0/2474534274 conn(0x7f4ca80a30c0 msgr2=0x7f4ca813ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 shutdown_connections 2026-02-17T12:11:20.069 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.065+0000 7f4cad28f640 1 -- 10.20.193.51:0/2474534274 wait complete. 2026-02-17T12:11:20.075 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1701,"stamp":"2026-02-17T12:11:20.041618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":272237862,"num_objects":137,"num_object_clones":86,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":13,"num_read":7401,"num_read_kb":7105872,"num_write":5477,"num_write_kb":2138591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20858,"ondisk_log_size":20858,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":684392,"kb_used_data":389340,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565546648,"statfs":{"total":579820584960,"available":579119767552,"internally_reserved":0,"allocated":398684160,"data_stored":475162336,"data_compressed":10312709,"data_compressed_allocated":7970816,"data_compressed_original":21486182,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23321327,"num_objects":12,"num_object_clones":11,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":70,"num_read_kb":69125,"num_write":20,"num_write_kb":18001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000479"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":4415,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687271+0000","last_change":"2026-02-17T12:11:10.746233+0000","last_active":"2026-02-17T12:11:18.687271+0000","last_peered":"2026-02-17T12:11:18.687271+0000","last_clean":"2026-02-17T12:11:18.687271+0000","last_became_active":"2026-02-17T11:45:59.917013+0000","last_became_peered":"2026-02-17T11:45:59.917013+0000","last_unstale":"2026-02-17T12:11:18.687271+0000","last_undegraded":"2026-02-17T12:11:18.687271+0000","last_fullsized":"2026-02-17T12:11:18.687271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:30.273923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083874700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"928'967","reported_seq":5426,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687232+0000","last_change":"2026-02-17T12:11:10.745744+0000","last_active":"2026-02-17T12:11:18.687232+0000","last_peered":"2026-02-17T12:11:18.687232+0000","last_clean":"2026-02-17T12:11:18.687232+0000","last_became_active":"2026-02-17T11:45:59.916985+0000","last_became_peered":"2026-02-17T11:45:59.916985+0000","last_unstale":"2026-02-17T12:11:18.687232+0000","last_undegraded":"2026-02-17T12:11:18.687232+0000","last_fullsized":"2026-02-17T12:11:18.687232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:31:00.774958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039853000000000002,"stat_sum":{"num_bytes":17303090,"num_objects":9,"num_object_clones":6,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":443887,"num_write":279,"num_write_kb":98106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"928'1316","reported_seq":5759,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756071+0000","last_change":"2026-02-17T12:11:10.760314+0000","last_active":"2026-02-17T12:11:17.756071+0000","last_peered":"2026-02-17T12:11:17.756071+0000","last_clean":"2026-02-17T12:11:17.756071+0000","last_became_active":"2026-02-17T11:45:59.920594+0000","last_became_peered":"2026-02-17T11:45:59.920594+0000","last_unstale":"2026-02-17T12:11:17.756071+0000","last_undegraded":"2026-02-17T12:11:17.756071+0000","last_fullsized":"2026-02-17T12:11:17.756071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:58:12.542469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040096499999999998,"stat_sum":{"num_bytes":21476264,"num_objects":10,"num_object_clones":7,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":542,"num_read_kb":529715,"num_write":319,"num_write_kb":134849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"3.c","version":"927'1195","reported_seq":5572,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687251+0000","last_change":"2026-02-17T12:11:10.745981+0000","last_active":"2026-02-17T12:11:18.687251+0000","last_peered":"2026-02-17T12:11:18.687251+0000","last_clean":"2026-02-17T12:11:18.687251+0000","last_became_active":"2026-02-17T11:45:59.919613+0000","last_became_peered":"2026-02-17T11:45:59.919613+0000","last_unstale":"2026-02-17T12:11:18.687251+0000","last_undegraded":"2026-02-17T12:11:18.687251+0000","last_fullsized":"2026-02-17T12:11:18.687251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1195,"log_dups_size":0,"ondisk_log_size":1195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:36:51.269339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062147299999999999,"stat_sum":{"num_bytes":12556413,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":350,"num_read_kb":321466,"num_write":279,"num_write_kb":119295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"925'1491","reported_seq":5930,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.753661+0000","last_change":"2026-02-17T12:11:10.750305+0000","last_active":"2026-02-17T12:11:16.753661+0000","last_peered":"2026-02-17T12:11:16.753661+0000","last_clean":"2026-02-17T12:11:16.753661+0000","last_became_active":"2026-02-17T11:45:59.920989+0000","last_became_peered":"2026-02-17T11:45:59.920989+0000","last_unstale":"2026-02-17T12:11:16.753661+0000","last_undegraded":"2026-02-17T12:11:16.753661+0000","last_fullsized":"2026-02-17T12:11:16.753661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1491,"log_dups_size":0,"ondisk_log_size":1491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:44.150205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017583939999999999,"stat_sum":{"num_bytes":17677145,"num_objects":9,"num_object_clones":6,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":569,"num_read_kb":566882,"num_write":408,"num_write_kb":136820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"3.a","version":"927'3892","reported_seq":8055,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756096+0000","last_change":"2026-02-17T12:11:10.762420+0000","last_active":"2026-02-17T12:11:17.756096+0000","last_peered":"2026-02-17T12:11:17.756096+0000","last_clean":"2026-02-17T12:11:17.756096+0000","last_became_active":"2026-02-17T11:45:59.917001+0000","last_became_peered":"2026-02-17T11:45:59.917001+0000","last_unstale":"2026-02-17T12:11:17.756096+0000","last_undegraded":"2026-02-17T12:11:17.756096+0000","last_fullsized":"2026-02-17T12:11:17.756096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:04:25.487305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024945089999999998,"stat_sum":{"num_bytes":41397680,"num_objects":20,"num_object_clones":13,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":3,"num_read":1158,"num_read_kb":1085523,"num_write":952,"num_write_kb":361748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"3.9","version":"923'391","reported_seq":4865,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.716688+0000","last_change":"2026-02-17T12:11:10.746455+0000","last_active":"2026-02-17T12:11:18.716688+0000","last_peered":"2026-02-17T12:11:18.716688+0000","last_clean":"2026-02-17T12:11:18.716688+0000","last_became_active":"2026-02-17T11:45:59.919815+0000","last_became_peered":"2026-02-17T11:45:59.919815+0000","last_unstale":"2026-02-17T12:11:18.716688+0000","last_undegraded":"2026-02-17T12:11:18.716688+0000","last_fullsized":"2026-02-17T12:11:18.716688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:02.963659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015540739999999999,"stat_sum":{"num_bytes":8313208,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":159497,"num_write":111,"num_write_kb":41203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"925'1529","reported_seq":5936,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.827004+0000","last_change":"2026-02-17T12:11:10.751014+0000","last_active":"2026-02-17T12:11:18.827004+0000","last_peered":"2026-02-17T12:11:18.827004+0000","last_clean":"2026-02-17T12:11:18.827004+0000","last_became_active":"2026-02-17T11:45:59.921051+0000","last_became_peered":"2026-02-17T11:45:59.921051+0000","last_unstale":"2026-02-17T12:11:18.827004+0000","last_undegraded":"2026-02-17T12:11:18.827004+0000","last_fullsized":"2026-02-17T12:11:18.827004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1529,"log_dups_size":0,"ondisk_log_size":1529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:12:54.366264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042837309999999998,"stat_sum":{"num_bytes":19493981,"num_objects":11,"num_object_clones":8,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":465,"num_read_kb":413121,"num_write":440,"num_write_kb":163378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":1958,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756018+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T12:11:17.756018+0000","last_peered":"2026-02-17T12:11:17.756018+0000","last_clean":"2026-02-17T12:11:17.756018+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:17.756018+0000","last_undegraded":"2026-02-17T12:11:17.756018+0000","last_fullsized":"2026-02-17T12:11:17.756018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":1816,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687145+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T12:11:18.687145+0000","last_peered":"2026-02-17T12:11:18.687145+0000","last_clean":"2026-02-17T12:11:18.687145+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:18.687145+0000","last_undegraded":"2026-02-17T12:11:18.687145+0000","last_fullsized":"2026-02-17T12:11:18.687145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"918'2610","reported_seq":6993,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.753623+0000","last_change":"2026-02-17T12:11:10.749667+0000","last_active":"2026-02-17T12:11:16.753623+0000","last_peered":"2026-02-17T12:11:16.753623+0000","last_clean":"2026-02-17T12:11:16.753623+0000","last_became_active":"2026-02-17T11:45:59.917944+0000","last_became_peered":"2026-02-17T11:45:59.917944+0000","last_unstale":"2026-02-17T12:11:16.753623+0000","last_undegraded":"2026-02-17T12:11:16.753623+0000","last_fullsized":"2026-02-17T12:11:16.753623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":2610,"log_dups_size":0,"ondisk_log_size":2610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:31:35.212098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094291100000000005,"stat_sum":{"num_bytes":24933945,"num_objects":13,"num_object_clones":6,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":966,"num_read_kb":922987,"num_write":700,"num_write_kb":280827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":1821,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756013+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T12:11:17.756013+0000","last_peered":"2026-02-17T12:11:17.756013+0000","last_clean":"2026-02-17T12:11:17.756013+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:17.756013+0000","last_undegraded":"2026-02-17T12:11:17.756013+0000","last_fullsized":"2026-02-17T12:11:17.756013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"925'857","reported_seq":5267,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687122+0000","last_change":"2026-02-17T12:11:10.748558+0000","last_active":"2026-02-17T12:11:18.687122+0000","last_peered":"2026-02-17T12:11:18.687122+0000","last_clean":"2026-02-17T12:11:18.687122+0000","last_became_active":"2026-02-17T11:45:59.920253+0000","last_became_peered":"2026-02-17T11:45:59.920253+0000","last_unstale":"2026-02-17T12:11:18.687122+0000","last_undegraded":"2026-02-17T12:11:18.687122+0000","last_fullsized":"2026-02-17T12:11:18.687122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:39.825351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015683310000000001,"stat_sum":{"num_bytes":19179528,"num_objects":6,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":165865,"num_write":223,"num_write_kb":102815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1820,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.827033+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T12:11:18.827033+0000","last_peered":"2026-02-17T12:11:18.827033+0000","last_clean":"2026-02-17T12:11:18.827033+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:18.827033+0000","last_undegraded":"2026-02-17T12:11:18.827033+0000","last_fullsized":"2026-02-17T12:11:18.827033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"927'1562","reported_seq":5946,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.758566+0000","last_change":"2026-02-17T12:11:10.751151+0000","last_active":"2026-02-17T12:11:16.758566+0000","last_peered":"2026-02-17T12:11:16.758566+0000","last_clean":"2026-02-17T12:11:16.758566+0000","last_became_active":"2026-02-17T11:45:59.920686+0000","last_became_peered":"2026-02-17T11:45:59.920686+0000","last_unstale":"2026-02-17T12:11:16.758566+0000","last_undegraded":"2026-02-17T12:11:16.758566+0000","last_fullsized":"2026-02-17T12:11:16.758566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:35:20.552584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00113167,"stat_sum":{"num_bytes":13938007,"num_objects":8,"num_object_clones":5,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":491,"num_read_kb":474590,"num_write":427,"num_write_kb":160411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":1817,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687153+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T12:11:18.687153+0000","last_peered":"2026-02-17T12:11:18.687153+0000","last_clean":"2026-02-17T12:11:18.687153+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:18.687153+0000","last_undegraded":"2026-02-17T12:11:18.687153+0000","last_fullsized":"2026-02-17T12:11:18.687153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"925'1240","reported_seq":5671,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.716621+0000","last_change":"2026-02-17T12:11:10.747980+0000","last_active":"2026-02-17T12:11:18.716621+0000","last_peered":"2026-02-17T12:11:18.716621+0000","last_clean":"2026-02-17T12:11:18.716621+0000","last_became_active":"2026-02-17T11:45:59.919951+0000","last_became_peered":"2026-02-17T11:45:59.919951+0000","last_unstale":"2026-02-17T12:11:18.716621+0000","last_undegraded":"2026-02-17T12:11:18.716621+0000","last_fullsized":"2026-02-17T12:11:18.716621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:32:15.718677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029815430000000001,"stat_sum":{"num_bytes":16744235,"num_objects":9,"num_object_clones":6,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":465,"num_read_kb":484694,"num_write":279,"num_write_kb":112575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"927'1675","reported_seq":6100,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687229+0000","last_change":"2026-02-17T12:11:10.748562+0000","last_active":"2026-02-17T12:11:18.687229+0000","last_peered":"2026-02-17T12:11:18.687229+0000","last_clean":"2026-02-17T12:11:18.687229+0000","last_became_active":"2026-02-17T11:45:59.919878+0000","last_became_peered":"2026-02-17T11:45:59.919878+0000","last_unstale":"2026-02-17T12:11:18.687229+0000","last_undegraded":"2026-02-17T12:11:18.687229+0000","last_fullsized":"2026-02-17T12:11:18.687229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":1675,"log_dups_size":0,"ondisk_log_size":1675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:03:05.976793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033188800000000002,"stat_sum":{"num_bytes":21905874,"num_objects":11,"num_object_clones":7,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":712,"num_read_kb":733745,"num_write":391,"num_write_kb":166026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1824,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.753639+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T12:11:16.753639+0000","last_peered":"2026-02-17T12:11:16.753639+0000","last_clean":"2026-02-17T12:11:16.753639+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:16.753639+0000","last_undegraded":"2026-02-17T12:11:16.753639+0000","last_fullsized":"2026-02-17T12:11:16.753639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"900'419","reported_seq":4924,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.753723+0000","last_change":"2026-02-17T12:11:10.749497+0000","last_active":"2026-02-17T12:11:16.753723+0000","last_peered":"2026-02-17T12:11:16.753723+0000","last_clean":"2026-02-17T12:11:16.753723+0000","last_became_active":"2026-02-17T11:45:59.920919+0000","last_became_peered":"2026-02-17T11:45:59.920919+0000","last_unstale":"2026-02-17T12:11:16.753723+0000","last_undegraded":"2026-02-17T12:11:16.753723+0000","last_fullsized":"2026-02-17T12:11:16.753723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:17:58.344775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091076000000000004,"stat_sum":{"num_bytes":6007412,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":237685,"num_write":103,"num_write_kb":42488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c6","length":"1"},{"start":"1c9","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":1821,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756018+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T12:11:17.756018+0000","last_peered":"2026-02-17T12:11:17.756018+0000","last_clean":"2026-02-17T12:11:17.756018+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:17.756018+0000","last_undegraded":"2026-02-17T12:11:17.756018+0000","last_fullsized":"2026-02-17T12:11:17.756018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"929'793","reported_seq":5243,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.827084+0000","last_change":"2026-02-17T12:11:10.748416+0000","last_active":"2026-02-17T12:11:18.827084+0000","last_peered":"2026-02-17T12:11:18.827084+0000","last_clean":"2026-02-17T12:11:18.827084+0000","last_became_active":"2026-02-17T11:45:59.921056+0000","last_became_peered":"2026-02-17T11:45:59.921056+0000","last_unstale":"2026-02-17T12:11:18.827084+0000","last_undegraded":"2026-02-17T12:11:18.827084+0000","last_fullsized":"2026-02-17T12:11:18.827084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:53:40.635679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015622190000000001,"stat_sum":{"num_bytes":20129986,"num_objects":9,"num_object_clones":7,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":286,"num_read_kb":279919,"num_write":227,"num_write_kb":104262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1823,"reported_epoch":929,"state":"active+clean","last_fresh":"2026-02-17T12:11:16.753708+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T12:11:16.753708+0000","last_peered":"2026-02-17T12:11:16.753708+0000","last_clean":"2026-02-17T12:11:16.753708+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:16.753708+0000","last_undegraded":"2026-02-17T12:11:16.753708+0000","last_fullsized":"2026-02-17T12:11:16.753708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"929'806","reported_seq":5252,"reported_epoch":931,"state":"active+clean","last_fresh":"2026-02-17T12:11:18.687132+0000","last_change":"2026-02-17T12:11:10.749856+0000","last_active":"2026-02-17T12:11:18.687132+0000","last_peered":"2026-02-17T12:11:18.687132+0000","last_clean":"2026-02-17T12:11:18.687132+0000","last_became_active":"2026-02-17T11:45:59.920602+0000","last_became_peered":"2026-02-17T11:45:59.920602+0000","last_unstale":"2026-02-17T12:11:18.687132+0000","last_undegraded":"2026-02-17T12:11:18.687132+0000","last_fullsized":"2026-02-17T12:11:18.687132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:58.688508+0000","last_clean_scrub_stamp":"2026-02-17T11:45:58.688508+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:44:19.280793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027742499999999998,"stat_sum":{"num_bytes":10590707,"num_objects":6,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":300,"num_read_kb":286223,"num_write":192,"num_write_kb":111114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1820,"reported_epoch":930,"state":"active+clean","last_fresh":"2026-02-17T12:11:17.756056+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T12:11:17.756056+0000","last_peered":"2026-02-17T12:11:17.756056+0000","last_clean":"2026-02-17T12:11:17.756056+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:17.756056+0000","last_undegraded":"2026-02-17T12:11:17.756056+0000","last_fullsized":"2026-02-17T12:11:17.756056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":271647475,"num_objects":133,"num_object_clones":86,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":13,"num_read":7315,"num_read_kb":7105799,"num_write":5330,"num_write_kb":2135917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":357523456,"data_stored":458581292,"data_compressed":10383226,"data_compressed_allocated":8036352,"data_compressed_original":20789862,"omap_allocated":0,"internal_metadata":0},"log_size":20743,"ondisk_log_size":20743,"up":32,"acting":32,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607867,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108792,"kb_used_data":55460,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94263048,"statfs":{"total":96636764160,"available":96525361152,"internally_reserved":0,"allocated":56791040,"data_stored":66530726,"data_compressed":992838,"data_compressed_allocated":700416,"data_compressed_original":2077591,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116572,"kb_used_data":71556,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94255268,"statfs":{"total":96636764160,"available":96517394432,"internally_reserved":0,"allocated":73273344,"data_stored":85398402,"data_compressed":2194193,"data_compressed_allocated":1937408,"data_compressed_original":4016376,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98928,"kb_used_data":49756,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94272912,"statfs":{"total":96636764160,"available":96535461888,"internally_reserved":0,"allocated":50950144,"data_stored":52832154,"data_compressed":974309,"data_compressed_allocated":946176,"data_compressed_original":2373880,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125384,"kb_used_data":80364,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94246456,"statfs":{"total":96636764160,"available":96508370944,"internally_reserved":0,"allocated":82292736,"data_stored":102637655,"data_compressed":1952708,"data_compressed_allocated":1466368,"data_compressed_original":4171168,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109604,"kb_used_data":56268,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94262236,"statfs":{"total":96636764160,"available":96524529664,"internally_reserved":0,"allocated":57618432,"data_stored":66709906,"data_compressed":1575560,"data_compressed_allocated":1245184,"data_compressed_original":3320580,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640570,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125112,"kb_used_data":75936,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94246728,"statfs":{"total":96636764160,"available":96508649472,"internally_reserved":0,"allocated":77758464,"data_stored":101053493,"data_compressed":2623101,"data_compressed_allocated":1675264,"data_compressed_original":5526587,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50065408,"data_stored":62917999,"data_compressed":1543467,"data_compressed_allocated":1204224,"data_compressed_original":2808580,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":74145792,"data_stored":101829214,"data_compressed":2757804,"data_compressed_allocated":1822720,"data_compressed_original":5854267,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74813440,"data_stored":99380011,"data_compressed":1952708,"data_compressed_allocated":1466368,"data_compressed_original":4171168,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43409408,"data_stored":49045582,"data_compressed":942216,"data_compressed_allocated":905216,"data_compressed_original":1861880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65794048,"data_stored":82140758,"data_compressed":2194193,"data_compressed_allocated":1937408,"data_compressed_original":4016376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49295360,"data_stored":63267728,"data_compressed":992838,"data_compressed_allocated":700416,"data_compressed_original":2077591,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:20.077 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T12:11:20.078 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T12:11:20.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.145+0000 7fa4413ff640 10 monclient: get_monmap_and_config 2026-02-17T12:11:20.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.145+0000 7fa4413ff640 10 monclient: build_initial_monmap 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 10 monclient: monmap: 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:20.146970+0000 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:20.146970+0000 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.151 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 1 Processor -- start 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 1 -- start start 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 10 monclient: init 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2026-02-17T12:11:20.152 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.146+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa43c0a3080 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa43c09be60 0x7fa43c13d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-a con 0x7fa43c09be60 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 0x7fa43c13f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-b con 0x7fa43c0a3b70 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43c09c900 con 0x7fa43c0a3080 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fa43c06d9d0 con 0x7fa43c09be60 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c06dc10 con 0x7fa43c0a3b70 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa4413ff640 10 monclient(hunting): authenticate will time out at 2167.766042s 2026-02-17T12:11:20.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43affd640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fa43c0a3080 0x7fa43c0a3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57358/0 (socket says 10.20.193.51:57358) 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fa43c09be60 0x7fa43c13d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43affd640 1 -- 10.20.193.51:0/1338475191 learned_addr learned my addr 10.20.193.51:0/1338475191 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 0x7fa43c13f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): get_auth_request con 0x7fa43c09be60 auth_method 0 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): get_auth_request con 0x7fa43c0a3b70 auth_method 0 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:20.154 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_done global_id 274494 payload 274 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 msgr2=0x7fa43c13f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 0x7fa43c13f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1338475191 >> v1:10.20.193.51:6789/0 conn(0x7fa43c0a3080 legacy=0x7fa43c0a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:11:20.155 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 monclient: found mon.noname-a 2026-02-17T12:11:20.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:20.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:20.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1338475191 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c06d310 con 0x7fa43c09be60 2026-02-17T12:11:20.156 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.147+0000 7fa43b7fe640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 0x7fa43c13f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 msgr2=0x7fa43c13d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa43a7fc640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c13d320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098a0 tx=0x7fa42402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6959747d3deed4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 1 -- 10.20.193.51:0/1338475191 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42403c070 con 0x7fa43c09be60 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: dump: 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.163 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 1 -- 10.20.193.51:0/1338475191 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42402fc00 con 0x7fa43c09be60 2026-02-17T12:11:20.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 1 -- 10.20.193.51:0/1338475191 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424037440 con 0x7fa43c09be60 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa4413ff640 5 monclient: authenticate success, global_id 274494 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa4413ff640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa4413ff640 4 set_mon_vals no callback set 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.149+0000 7fa439ffb640 10 monclient: dump: 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:20.165 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 10 monclient: shutdown 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 -- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 msgr2=0x7fa43c13d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c13d320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098a0 tx=0x7fa42402ed80 comp rx=0 tx=0).stop 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 -- 10.20.193.51:0/1338475191 shutdown_connections 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3b70 0x7fa43c13f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1338475191 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c13d320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 -- 10.20.193.51:0/1338475191 >> 10.20.193.51:0/1338475191 conn(0x7fa43c06ed20 msgr2=0x7fa43c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 -- 10.20.193.51:0/1338475191 shutdown_connections 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 -- 10.20.193.51:0/1338475191 wait complete. 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 10 monclient: build_initial_monmap 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 10 monclient: monmap: 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:20.167 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.150+0000 7fa4413ff640 1 Processor -- start 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 -- start start 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient: init 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c1cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-a con 0x7fa43c09be60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 0x7fa43c1352a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-c con 0x7fa43c0a3080 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 0x7fa43c13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): picked mon.noname-b con 0x7fa43c0a3b70 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c074cc0 con 0x7fa43c09be60 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c09c620 con 0x7fa43c0a3b70 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c074e40 con 0x7fa43c0a3080 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa4413ff640 10 monclient(hunting): authenticate will time out at 2167.770297s 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c1cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c1cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39860/0 (socket says 10.20.193.51:39860) 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 1 -- 10.20.193.51:0/1243643834 learned_addr learned my addr 10.20.193.51:0/1243643834 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:20.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 0x7fa43c1352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): get_auth_request con 0x7fa43c09be60 auth_method 0 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): get_auth_request con 0x7fa43c0a3080 auth_method 0 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:20.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43b7fe640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 0x7fa43c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient(hunting): handle_auth_done global_id 304229 payload 824 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 msgr2=0x7fa43c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 0x7fa43c13d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 msgr2=0x7fa43c1cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c1cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 monclient: found mon.noname-c 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:20.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1243643834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c11fc30 con 0x7fa43c0a3080 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43b7fe640 10 monclient: get_auth_request con 0x7fa43c0a3b70 auth_method 0 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.151+0000 7fa43b7fe640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 0x7fa43c13d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa43a7fc640 1 -- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 msgr2=0x7fa43c1352a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa43a7fc640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 0x7fa43c1352a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa424036000 tx=0x7fa4240047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42403c040 con 0x7fa43c0a3080 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: dump: 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.172 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa424040800 con 0x7fa43c0a3080 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 5 monclient: authenticate success, global_id 304229 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 10 monclient: _renew_subs 2026-02-17T12:11:20.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c11e6c0 con 0x7fa43c0a3080 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424040bf0 con 0x7fa43c0a3080 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa41b7fe640 10 monclient: dump: 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:20.174 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4397fa640 4 set_mon_vals no callback set 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 10 monclient: _renew_subs 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.153+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c13f070 con 0x7fa43c0a3080 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa4413ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa4413ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa4413ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:20.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c0a3460 con 0x7fa43c0a3080 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fa42403f030 con 0x7fa43c0a3080 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa41b7fe640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 0x7fa4080401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(932..932 src has 323..932) ==== 4707+0+0 (secure 0 0 0) 0x7fa424076e40 con 0x7fa43c0a3080 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa43affd640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 0x7fa4080401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.154+0000 7fa43affd640 10 monclient: get_auth_request con 0x7fa40803dd10 auth_method 0 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.157+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa43c09c900 con 0x7fa43c0a3080 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.157+0000 7fa41b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.157+0000 7fa41b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:20.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.157+0000 7fa43affd640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 0x7fa4080401d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa430007e50 tx=0x7fa430007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:20.241 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.240+0000 7fa4413ff640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T12:11:20.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.240+0000 7fa4413ff640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T12:11:20.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.240+0000 7fa4413ff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:20.242 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.240+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa43c09e860 con 0x7fa43c0a3080 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618004090 auth_method 0 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:20.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.275+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:11:20.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.761+0000 7fa41b7fe640 1 -- 10.20.193.51:0/1243643834 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]=0 pool 'unique_pool_0' removed v933) ==== 175+0+0 (secure 0 0 0) 0x7fa424040e10 con 0x7fa43c0a3080 2026-02-17T12:11:20.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.761+0000 7fa41b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T12:11:20.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.761+0000 7fa41b7fe640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' removed 2026-02-17T12:11:20.764 INFO:teuthology.orchestra.run.trial051.stderr:pool 'unique_pool_0' removed 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 msgr2=0x7fa4080401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 0x7fa4080401d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa430007e50 tx=0x7fa430007da0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 10 monclient: shutdown 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 msgr2=0x7fa43c1352a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 0x7fa43c1352a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa424036000 tx=0x7fa4240047c0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 shutdown_connections 2026-02-17T12:11:20.766 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fa40803dd10 0x7fa4080401d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fa43c0a3b70 0x7fa43c13d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fa43c0a3080 0x7fa43c1352a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 --2- 10.20.193.51:0/1243643834 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fa43c09be60 0x7fa43c1cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 >> 10.20.193.51:0/1243643834 conn(0x7fa43c06ed20 msgr2=0x7fa43c0a0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 shutdown_connections 2026-02-17T12:11:20.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:20.763+0000 7fa4413ff640 1 -- 10.20.193.51:0/1243643834 wait complete. 2026-02-17T12:11:20.774 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-17T12:11:20.789 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-17T12:11:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.869+0000 7f8635ffb640 10 monclient: tick 2026-02-17T12:11:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.869+0000 7f8635ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:21.871 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.869+0000 7f8635ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:21.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.869+0000 7f8635ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:21.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618004090 auth_method 0 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:21.880 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:21.877+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 10 monclient: tick 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.872 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 0x7f8614005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 msgr2=0x7f8618006530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618004090 0x7f8618006530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8635ffb640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8618007db0 con 0x7f8614003640 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 0x7f8614005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8614003640 auth_method 0 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.873 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 10 monclient(hunting): handle_auth_done global_id 314098 payload 824 2026-02-17T12:11:22.874 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.869+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86140061b0 con 0x7f8614003640 2026-02-17T12:11:22.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 msgr2=0x7f8614005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:22.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 0x7f8614005ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f864c0715d0 tx=0x7f8638003a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:22.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638014a90 con 0x7f8614003640 2026-02-17T12:11:22.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.875 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 10 monclient: dump: 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.876 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f8638014a90 con 0x7f8614003640 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 msgr2=0x7f8614005ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 0x7f8614005ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f864c0715d0 tx=0x7f8638003a10 comp rx=0 tx=0).stop 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 msgr2=0x7f8614005ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:22.877 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.872+0000 7f8636ffd640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8614003640 0x7f8614005ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8654838640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:11:22.878 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 0x7f861800a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8654838640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8618007310 con 0x7f8618006dd0 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 0x7f861800a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient: get_auth_request con 0x7f8618006dd0 auth_method 0 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 10 monclient(hunting): handle_auth_done global_id 314101 payload 824 2026-02-17T12:11:22.879 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.876+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8618007510 con 0x7f8618006dd0 2026-02-17T12:11:22.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8651dac640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 msgr2=0x7f861800a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:22.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8651dac640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 0x7f861800a1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f863801b000 tx=0x7f8638004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:22.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638024c10 con 0x7f8618006dd0 2026-02-17T12:11:22.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.881 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 10 monclient: dump: 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.882 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 <== mon.1 v2:10.20.193.142:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f8638024040 con 0x7f8618006dd0 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 msgr2=0x7f861800a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 0x7f861800a1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f863801b000 tx=0x7f8638004830 comp rx=0 tx=0).stop 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 msgr2=0x7f861800a1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8636ffd640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8618006dd0 0x7f861800a1d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8652dae640 1 -- 10.20.193.51:0/2953258015 reap_dead start 2026-02-17T12:11:22.883 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "state": "peon", 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "election_epoch": 240, 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "uptime": 10859, 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: "quorum": [ 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: 0, 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: 1, 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: 2 2026-02-17T12:11:22.884 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_age": 4, 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "required_con": "2450521708007866372", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "required_mon": [ 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:22.885 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "quorum_mon": [ 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:22.886 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "outside_quorum": [], 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "extra_probe_peers": [], 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "sync_provider": [], 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "monmap": { 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "epoch": 1, 2026-02-17T12:11:22.887 INFO:teuthology.orchestra.run.trial051.stdout: "fsid": "d196e788-97c6-436f-bedf-bc3cc9f7e94a", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "modified": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "created": "2026-02-17T11:44:50.142292Z", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release": 19, 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "min_mon_release_name": "squid", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "election_strategy": 1, 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "disallowed_leaders": "", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false, 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "tiebreaker_mon": "", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "removed_ranks": "", 2026-02-17T12:11:22.888 INFO:teuthology.orchestra.run.trial051.stdout: "features": { 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "persistent": [ 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "kraken", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "luminous", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "mimic", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "osdmap-prune", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "nautilus", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "octopus", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "pacific", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "elector-pinging", 2026-02-17T12:11:22.889 INFO:teuthology.orchestra.run.trial051.stdout: "quincy", 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "reef", 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "squid" 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "optional": [] 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "mons": [ 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 0, 2026-02-17T12:11:22.890 INFO:teuthology.orchestra.run.trial051.stdout: "name": "a", 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3300", 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.891 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789", 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6789/0", 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6789/0", 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:22.892 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 1, 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "name": "b", 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:3300", 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.893 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789", 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.142:6789/0", 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.142:6789/0", 2026-02-17T12:11:22.894 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "rank": 2, 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "name": "c", 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "public_addrs": { 2026-02-17T12:11:22.895 INFO:teuthology.orchestra.run.trial051.stdout: "addrvec": [ 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v2", 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:3301", 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "type": "v1", 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790", 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "nonce": 0 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.896 INFO:teuthology.orchestra.run.trial051.stdout: "addr": "10.20.193.51:6790/0", 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "public_addr": "10.20.193.51:6790/0", 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "priority": 0, 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "weight": 0, 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "crush_location": "{}" 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "feature_map": { 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "mon": [ 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:22.897 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "client": [ 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: ], 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "mgr": [ 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: { 2026-02-17T12:11:22.898 INFO:teuthology.orchestra.run.trial051.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: "release": "squid", 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: "num": 1 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: } 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: ] 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: }, 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout: "stretch_mode": false 2026-02-17T12:11:22.899 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 msgr2=0x7f861c0403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 0x7f861c0403c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f864c0ab950 tx=0x7f8640033000 comp rx=0 tx=0).stop 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 10 monclient: shutdown 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 msgr2=0x7f864c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f864400c5d0 tx=0x7f864400caa0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.901 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 shutdown_connections 2026-02-17T12:11:22.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f861c03df00 0x7f861c0403c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 --2- 10.20.193.51:0/2953258015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f864c0a35a0 0x7f864c06fc90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 >> 10.20.193.51:0/2953258015 conn(0x7f864c0a7460 msgr2=0x7f864c0a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:22.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 shutdown_connections 2026-02-17T12:11:22.902 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.879+0000 7f8654838640 1 -- 10.20.193.51:0/2953258015 wait complete. 2026-02-17T12:11:22.902 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:11:22.903 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:11:22.903 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:11:22.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.969+0000 7f43e8385640 10 monclient: get_monmap_and_config 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.969+0000 7f43e8385640 10 monclient: build_initial_monmap 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.969+0000 7f43e8385640 10 monclient: monmap: 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:22.970619+0000 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:22.970619+0000 2026-02-17T12:11:22.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 Processor -- start 2026-02-17T12:11:22.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 -- start start 2026-02-17T12:11:22.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient: init 2026-02-17T12:11:22.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:22.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-17T12:11:22.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 0x7f43e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-a con 0x7f43e00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f43e00a0750 0x7f43e009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-c con 0x7f43e00a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-b con 0x7f43e009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f43e00a3f90 con 0x7f43e00a3bb0 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f43e006e140 con 0x7f43e00a0750 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f43e009f910 con 0x7f43e009e540 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e8385640 10 monclient(hunting): authenticate will time out at 2170.589374s 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 0x7f43e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39730/0 (socket says 10.20.193.51:39730) 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 0x7f43e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39866/0 (socket says 10.20.193.51:39866) 2026-02-17T12:11:22.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 -- 10.20.193.51:0/3719399451 learned_addr learned my addr 10.20.193.51:0/3719399451 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): get_auth_request con 0x7f43e009e540 auth_method 0 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): get_auth_request con 0x7f43e00a3bb0 auth_method 0 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e58f9640 1 --2- 10.20.193.51:0/3719399451 >> v2:10.20.193.142:3300/0 conn(0x7f43e00a0750 0x7f43e009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e58f9640 10 monclient(hunting): get_auth_request con 0x7f43e00a0750 auth_method 0 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e58f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e58f9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e58f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient(hunting): handle_auth_done global_id 304232 payload 274 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 -- 10.20.193.51:0/3719399451 >> v2:10.20.193.142:3300/0 conn(0x7f43e00a0750 msgr2=0x7f43e009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 --2- 10.20.193.51:0/3719399451 >> v2:10.20.193.142:3300/0 conn(0x7f43e00a0750 0x7f43e009e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 -- 10.20.193.51:0/3719399451 >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 msgr2=0x7f43e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 --2- 10.20.193.51:0/3719399451 >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 0x7f43e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient: _finish_hunting 0 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 monclient: found mon.noname-b 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.970+0000 7f43e68fb640 1 -- 10.20.193.51:0/3719399451 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e009ccd0 con 0x7f43e009e540 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e68fb640 1 -- 10.20.193.51:0/3719399451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 msgr2=0x7f43e013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e68fb640 1 --2- 10.20.193.51:0/3719399451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43e006f3c0 tx=0x7f43dc02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb7301f94981fa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 1 -- 10.20.193.51:0/3719399451 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc02fe60 con 0x7f43e009e540 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.982 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: dump: 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: _finish_auth 0 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: _check_auth_tickets 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 1 -- 10.20.193.51:0/3719399451 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc0373f0 con 0x7f43e009e540 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 5 monclient: authenticate success, global_id 304232 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 1 -- 10.20.193.51:0/3719399451 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0377c0 con 0x7f43e009e540 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 4 set_mon_vals no callback set 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e50f8640 10 monclient: dump: 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 10 monclient: shutdown 2026-02-17T12:11:22.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 -- 10.20.193.51:0/3719399451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 msgr2=0x7f43e013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 --2- 10.20.193.51:0/3719399451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43e006f3c0 tx=0x7f43dc02f230 comp rx=0 tx=0).stop 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 -- 10.20.193.51:0/3719399451 shutdown_connections 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 --2- 10.20.193.51:0/3719399451 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e013c760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 --2- 10.20.193.51:0/3719399451 >> v2:10.20.193.142:3300/0 conn(0x7f43e00a0750 0x7f43e009e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 --2- 10.20.193.51:0/3719399451 >> v2:10.20.193.51:3300/0 conn(0x7f43e00a3bb0 0x7f43e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 -- 10.20.193.51:0/3719399451 >> 10.20.193.51:0/3719399451 conn(0x7f43e00a30c0 msgr2=0x7f43e00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 -- 10.20.193.51:0/3719399451 shutdown_connections 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.973+0000 7f43e8385640 1 -- 10.20.193.51:0/3719399451 wait complete. 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient: build_initial_monmap 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient: monmap: 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 Processor -- start 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 -- start start 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient: init 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-c con 0x7f43e009e540 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43e00a0750 0x7f43e0091a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-a con 0x7f43e00a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43e00a3bb0 0x7f43e0099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): picked mon.noname-b con 0x7f43e00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f43e00a04b0 con 0x7f43e00a0750 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f43e009c850 con 0x7f43e00a3bb0 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f43e013cca0 con 0x7f43e009e540 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e8385640 10 monclient(hunting): authenticate will time out at 2170.593748s 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39734/0 (socket says 10.20.193.51:39734) 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 -- 10.20.193.51:0/1314771524 learned_addr learned my addr 10.20.193.51:0/1314771524 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): get_auth_request con 0x7f43e009e540 auth_method 0 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43e00a0750 0x7f43e0091a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): get_auth_request con 0x7f43e00a0750 auth_method 0 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e58f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient(hunting): handle_auth_done global_id 304235 payload 824 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 -- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43e00a3bb0 msgr2=0x7f43e0099ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e68fb640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43e00a3bb0 0x7f43e0099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43e00a3bb0 0x7f43e0099ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 -- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43e00a0750 msgr2=0x7f43e0091a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43e00a0750 0x7f43e0091a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient: _finish_hunting 0 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 monclient: found mon.noname-c 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.974+0000 7f43e60fa640 1 -- 10.20.193.51:0/1314771524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e009d7b0 con 0x7f43e009e540 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e60fa640 1 -- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 msgr2=0x7f43e008fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e60fa640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43d000ebe0 tx=0x7f43d000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017070 con 0x7f43e009e540 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: dump: 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.986 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d000ce50 con 0x7f43e009e540 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00136b0 con 0x7f43e009e540 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 10 monclient: dump: 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:22.987 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e48f7640 4 set_mon_vals no callback set 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 5 monclient: authenticate success, global_id 304235 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _renew_subs 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e0090300 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _renew_subs 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e0093270 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e009dac0 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.977+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f43d0024060 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.978+0000 7f43c6ffd640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 0x7f43b0040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.978+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 323..933) ==== 4342+0+0 (secure 0 0 0) 0x7f43d00524b0 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.978+0000 7f43e58f9640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 0x7f43b0040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.978+0000 7f43e58f9640 10 monclient: get_auth_request con 0x7f43b003dd60 auth_method 0 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.980+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f43d001b3b0 con 0x7f43e009e540 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.980+0000 7f43c6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:22.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.980+0000 7f43c6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:22.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:22.980+0000 7f43e58f9640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 0x7f43b0040220 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f43e0091060 tx=0x7f43d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:23.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.096+0000 7f43e8385640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:11:23.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.096+0000 7f43e8385640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:11:23.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.096+0000 7f43e8385640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:23.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.096+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f43e00008d0 con 0x7f43e009e540 2026-02-17T12:11:23.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.097+0000 7f43c6ffd640 1 -- 10.20.193.51:0/1314771524 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f43d0011c30 con 0x7f43e009e540 2026-02-17T12:11:23.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.097+0000 7f43c6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:11:23.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.097+0000 7f43c6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1739753475,config=692619927,health=3710314602,kv=1900466045,logm=2887342840}) 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=1,health=11,kv=12,logm=49} crc {auth=1271124852,config=1228700967,health=510224161,kv=643764953,logm=2135634117}) 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1739753475,config=692619927,health=3710314602,kv=1900466045,logm=2887342840}) 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.097+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=12,kv=11,logm=48} crc {auth=752208737,config=692619927,health=3710314602,kv=1728028228,logm=1702995827}) 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.101 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571112143}) 2026-02-17T12:11:23.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3972821500}) 2026-02-17T12:11:23.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571112143}) 2026-02-17T12:11:23.102 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2755878752}) 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 msgr2=0x7f43b0040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 0x7f43b0040220 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f43e0091060 tx=0x7f43d4008040 comp rx=0 tx=0).stop 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 10 monclient: shutdown 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 msgr2=0x7f43e008fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:23.103 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43d000ebe0 tx=0x7f43d000c520 comp rx=0 tx=0).stop 2026-02-17T12:11:23.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3070531128}) 2026-02-17T12:11:23.104 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2978608633}) 2026-02-17T12:11:23.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 shutdown_connections 2026-02-17T12:11:23.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f43b003dd60 0x7f43b0040220 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:23.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f43e00a3bb0 0x7f43e0099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:23.105 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.105 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f43e00a0750 0x7f43e0091a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:23.106 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 --2- 10.20.193.51:0/1314771524 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f43e009e540 0x7f43e008fd00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:23.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3070531128}) 2026-02-17T12:11:23.106 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.098+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1218271509}) 2026-02-17T12:11:23.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 >> 10.20.193.51:0/1314771524 conn(0x7f43e00a30c0 msgr2=0x7f43e0072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:23.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 shutdown_connections 2026-02-17T12:11:23.107 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:23.098+0000 7f43e8385640 1 -- 10.20.193.51:0/1314771524 wait complete. 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652077990}) 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=619853923}) 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652077990}) 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.099+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2451902690}) 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2679143839}) 2026-02-17T12:11:23.109 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2982081809}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2679143839}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544418232}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594034265}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4086755804}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=594034265}) 2026-02-17T12:11:23.110 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.100+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3706861240}) 2026-02-17T12:11:23.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587263681}) 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2672182481}) 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587263681}) 2026-02-17T12:11:23.691 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.689+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2911361032}) 2026-02-17T12:11:23.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=808635342}) 2026-02-17T12:11:23.693 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1480199895}) 2026-02-17T12:11:23.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=808635342}) 2026-02-17T12:11:23.694 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.692+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1846522556}) 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.693+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177617534}) 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=259883593}) 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177617534}) 2026-02-17T12:11:23.695 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.694+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1897311786}) 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928638438}) 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=527606887}) 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928638438}) 2026-02-17T12:11:23.917 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.915+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=278189979}) 2026-02-17T12:11:23.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2414765698}) 2026-02-17T12:11:23.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3400218927}) 2026-02-17T12:11:23.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2414765698}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1949266082}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289764904}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2176411041}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289764904}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2206466166}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2574740029}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3823160932}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2574740029}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.929+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2278030693}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830697126}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1326628231}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2830697126}) 2026-02-17T12:11:23.931 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1450264036}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1811626951}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1632317363}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1811626951}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=802077645}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2077386374}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1084756384}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2077386374}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.930+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=416495122}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2275086670}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2916439032}) 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.932 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2275086670}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1530924042}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3540001422}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4013902138}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3540001422}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3994490375}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2486969051}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3721690931}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2486969051}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.931+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4163472196}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=439340310}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=94670087}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=439340310}) 2026-02-17T12:11:23.933 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=358983524}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686798910}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1448687355}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686798910}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3820449228}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=60477936}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2879623333}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=60477936}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.932+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2317439872}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3561145145}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4180567829}) 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.934 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3561145145}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2078646001}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2554832755}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3912157595}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2554832755}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=821611047}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1005787536}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2425533008}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1005787536}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4120688970}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461641854}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=129867205}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461641854}) 2026-02-17T12:11:23.935 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.933+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3982444266}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554386921}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1625044191}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554386921}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=228675849}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088169395}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2783738223}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088169395}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3308196290}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12590438}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1836141430}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12590438}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.934+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2187260963}) 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.936 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1647388136}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3348915384}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1647388136}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2336875124}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606756895}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3144058897}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606756895}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3421690432}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3768327247}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3608807244}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3768327247}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=45697838}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4090280841}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=239225451}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.935+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4090280841}) 2026-02-17T12:11:23.937 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4208757578}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111486478}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=305760695}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4111486478}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=496835578}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000581504}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3246174468}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000581504}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=165744720}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3669175913}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2189262332}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3669175913}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.936+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2248540347}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=135522527}) 2026-02-17T12:11:23.938 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=103788071}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=135522527}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2938044710}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4198585651}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1771814458}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4198585651}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3453130337}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664885746}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=68617687}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664885746}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.937+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2543382621}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103663165}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1773103744}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103663165}) 2026-02-17T12:11:23.939 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3196893885}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=8007345}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3560322757}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=8007345}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1927437370}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3826478717}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4173389827}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3826478717}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.938+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=888575614}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838870052}) 2026-02-17T12:11:23.940 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2541825401}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838870052}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2490507839}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1385485064}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2193000829}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1385485064}) 2026-02-17T12:11:23.941 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.939+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=65778}) 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019554000}) 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2750135701}) 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019554000}) 2026-02-17T12:11:23.948 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:23.946+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1352333362}) 2026-02-17T12:11:24.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916190247}) 2026-02-17T12:11:24.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3218604642}) 2026-02-17T12:11:24.029 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.030 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916190247}) 2026-02-17T12:11:24.030 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.027+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=6084180}) 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.031+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.031+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4247797026}) 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.032+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3230375328}) 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.032+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.032+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4247797026}) 2026-02-17T12:11:24.034 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.032+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1384932000}) 2026-02-17T12:11:24.112 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:11:24.112 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:11:24.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.177+0000 7f4d2247c640 10 monclient: get_monmap_and_config 2026-02-17T12:11:24.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.177+0000 7f4d2247c640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.177+0000 7f4d2247c640 10 monclient: monmap: 2026-02-17T12:11:24.181 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:24.178641+0000 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:24.178641+0000 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:24.182 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 Processor -- start 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 -- start start 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient: init 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4d1c0a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f4d1c09dac0 0x7f4d1c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-c con 0x7f4d1c09dac0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:24.183 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4d1c0a0110 0x7f4d1c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-a con 0x7f4d1c0a0110 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c06e140 con 0x7f4d1c0a3bb0 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c09aed0 con 0x7f4d1c0a0110 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c09caa0 con 0x7f4d1c09dac0 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d2247c640 10 monclient(hunting): authenticate will time out at 2171.797420s 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4d1c0a0110 0x7f4d1c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f4d1c0a0110 0x7f4d1c13c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39890/0 (socket says 10.20.193.51:39890) 2026-02-17T12:11:24.184 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 -- 10.20.193.51:0/2363937883 learned_addr learned my addr 10.20.193.51:0/2363937883 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a0110 auth_method 0 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d1b7fe640 1 --2- 10.20.193.51:0/2363937883 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c09dac0 0x7f4d1c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d1b7fe640 10 monclient(hunting): get_auth_request con 0x7f4d1c09dac0 auth_method 0 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.185 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient(hunting): handle_auth_done global_id 274506 payload 274 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 -- 10.20.193.51:0/2363937883 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c09dac0 msgr2=0x7f4d1c09fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 --2- 10.20.193.51:0/2363937883 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c09dac0 0x7f4d1c09fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 -- 10.20.193.51:0/2363937883 >> v1:10.20.193.142:6789/0 conn(0x7f4d1c0a3bb0 legacy=0x7f4d1c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.186 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.178+0000 7f4d209f2640 1 -- 10.20.193.51:0/2363937883 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c09ce60 con 0x7f4d1c0a0110 2026-02-17T12:11:24.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d209f2640 1 -- 10.20.193.51:0/2363937883 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c0a0110 msgr2=0x7f4d1c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d209f2640 1 --2- 10.20.193.51:0/2363937883 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c0a0110 0x7f4d1c13c760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c09cc20 tx=0x7f4d1002f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7181efe84d89e30 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 1 -- 10.20.193.51:0/2363937883 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1002fe50 con 0x7f4d1c0a0110 2026-02-17T12:11:24.194 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: dump: 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.195 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 1 -- 10.20.193.51:0/2363937883 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100373f0 con 0x7f4d1c0a0110 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 5 monclient: authenticate success, global_id 274506 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 1 -- 10.20.193.51:0/2363937883 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d100377c0 con 0x7f4d1c0a0110 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 4 set_mon_vals no callback set 2026-02-17T12:11:24.196 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d1affd640 10 monclient: dump: 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.197 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 10 monclient: shutdown 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 -- 10.20.193.51:0/2363937883 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c0a0110 msgr2=0x7f4d1c13c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2363937883 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c0a0110 0x7f4d1c13c760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c09cc20 tx=0x7f4d1002f1e0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 -- 10.20.193.51:0/2363937883 shutdown_connections 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2363937883 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c0a0110 0x7f4d1c13c760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2363937883 >> v2:10.20.193.142:3300/0 conn(0x7f4d1c09dac0 0x7f4d1c09fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 -- 10.20.193.51:0/2363937883 >> 10.20.193.51:0/2363937883 conn(0x7f4d1c0a30c0 msgr2=0x7f4d1c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 -- 10.20.193.51:0/2363937883 shutdown_connections 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.181+0000 7f4d2247c640 1 -- 10.20.193.51:0/2363937883 wait complete. 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient: monmap: 2026-02-17T12:11:24.198 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 Processor -- start 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 -- start start 2026-02-17T12:11:24.199 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient: init 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-a con 0x7f4d1c09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c0a0110 0x7f4d1c1cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-c con 0x7f4d1c0a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d1c0a3bb0 0x7f4d1c1cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): picked mon.noname-b con 0x7f4d1c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0a0540 con 0x7f4d1c09dac0 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c09a880 con 0x7f4d1c0a3bb0 2026-02-17T12:11:24.200 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c13cca0 con 0x7f4d1c0a0110 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d2247c640 10 monclient(hunting): authenticate will time out at 2171.801933s 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39896/0 (socket says 10.20.193.51:39896) 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 1 -- 10.20.193.51:0/2455171420 learned_addr learned my addr 10.20.193.51:0/2455171420 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 10 monclient(hunting): get_auth_request con 0x7f4d1c09dac0 auth_method 0 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.182+0000 7f4d1bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.201 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c0a0110 0x7f4d1c1cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a0110 auth_method 0 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d209f2640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d1c0a3bb0 0x7f4d1c1cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d209f2640 10 monclient(hunting): get_auth_request con 0x7f4d1c0a3bb0 auth_method 0 2026-02-17T12:11:24.202 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d209f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d209f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d209f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient(hunting): handle_auth_done global_id 274509 payload 824 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 -- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c0a0110 msgr2=0x7f4d1c1cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c0a0110 0x7f4d1c1cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 -- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d1c0a3bb0 msgr2=0x7f4d1c1cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d1c0a3bb0 0x7f4d1c1cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.203 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.183+0000 7f4d1bfff640 1 -- 10.20.193.51:0/2455171420 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c09e4c0 con 0x7f4d1c09dac0 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d1bfff640 1 -- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 msgr2=0x7f4d1c1cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d1bfff640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c5d0 tx=0x7f4d0800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08016020 con 0x7f4d1c09dac0 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: dump: 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.204 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d08012a60 con 0x7f4d1c09dac0 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08012e50 con 0x7f4d1c09dac0 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 5 monclient: authenticate success, global_id 274509 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 10 monclient: _renew_subs 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d1a7fc640 4 set_mon_vals no callback set 2026-02-17T12:11:24.205 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c09d7b0 con 0x7f4d1c09dac0 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d18ff9640 10 monclient: dump: 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.206 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 10 monclient: _renew_subs 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.185+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c096130 con 0x7f4d1c09dac0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d2247c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d2247c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d2247c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f4d0801b400 con 0x7f4d1c09dac0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c06a290 con 0x7f4d1c09dac0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d18ff9640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 0x7f4cec040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f4d08052510 con 0x7f4d1c09dac0 2026-02-17T12:11:24.207 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d1b7fe640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 0x7f4cec040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.186+0000 7f4d1b7fe640 10 monclient: get_auth_request con 0x7f4cec03deb0 auth_method 0 2026-02-17T12:11:24.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.188+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4d1c06a290 con 0x7f4d1c09dac0 2026-02-17T12:11:24.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.188+0000 7f4d18ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.188+0000 7f4d18ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:24.208 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.188+0000 7f4d1b7fe640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 0x7f4cec040370 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c13a820 tx=0x7f4d0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.301+0000 7f4d2247c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.301+0000 7f4d2247c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.301+0000 7f4d2247c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.301+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d1c0008d0 con 0x7f4d1c09dac0 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.302+0000 7f4d18ff9640 1 -- 10.20.193.51:0/2455171420 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f4d08020030 con 0x7f4d1c09dac0 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.302+0000 7f4d18ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:11:24.304 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.302+0000 7f4d18ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:24.305 INFO:teuthology.orchestra.run.trial051.stdout:{"election_epoch":240,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","modified":"2026-02-17T11:44:50.142292Z","created":"2026-02-17T11:44:50.142292Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3300","nonce":0},{"type":"v1","addr":"10.20.193.51:6789","nonce":0}]},"addr":"10.20.193.51:6789/0","public_addr":"10.20.193.51:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:3300","nonce":0},{"type":"v1","addr":"10.20.193.142:6789","nonce":0}]},"addr":"10.20.193.142:6789/0","public_addr":"10.20.193.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:3301","nonce":0},{"type":"v1","addr":"10.20.193.51:6790","nonce":0}]},"addr":"10.20.193.51:6790/0","public_addr":"10.20.193.51:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:11:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 msgr2=0x7f4cec040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 0x7f4cec040370 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c13a820 tx=0x7f4d0c008040 comp rx=0 tx=0).stop 2026-02-17T12:11:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 10 monclient: shutdown 2026-02-17T12:11:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.306 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 msgr2=0x7f4d1c1cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c5d0 tx=0x7f4d0800caa0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 shutdown_connections 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f4cec03deb0 0x7f4cec040370 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f4d1c0a3bb0 0x7f4d1c1cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f4d1c0a0110 0x7f4d1c1cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 --2- 10.20.193.51:0/2455171420 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f4d1c09dac0 0x7f4d1c1cbb60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 >> 10.20.193.51:0/2455171420 conn(0x7f4d1c0a30c0 msgr2=0x7f4d1c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 shutdown_connections 2026-02-17T12:11:24.307 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.303+0000 7f4d2247c640 1 -- 10.20.193.51:0/2455171420 wait complete. 2026-02-17T12:11:24.313 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:11:24.313 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T12:11:24.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:11:24.330 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:24.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 10 monclient: get_monmap_and_config 2026-02-17T12:11:24.400 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 10 monclient: monmap: 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:24.397528+0000 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:24.397528+0000 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:24.401 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 1 Processor -- start 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 1 -- start start 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.396+0000 7f2dca43b640 10 monclient: init 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2dc40a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f2dc40a0750 0x7f2dc409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-c con 0x7f2dc40a0750 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2dc413b760 0x7f2dc413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.402 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-a con 0x7f2dc413b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc406e140 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc409f910 con 0x7f2dc413b760 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc409ccd0 con 0x7f2dc40a0750 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dca43b640 10 monclient(hunting): authenticate will time out at 2172.016443s 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2dc413b760 0x7f2dc413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f2dc413b760 0x7f2dc413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39912/0 (socket says 10.20.193.51:39912) 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 -- 10.20.193.51:0/2168313636 learned_addr learned my addr 10.20.193.51:0/2168313636 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): get_auth_request con 0x7f2dc413b760 auth_method 0 2026-02-17T12:11:24.403 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc37fe640 1 --2- 10.20.193.51:0/2168313636 >> v2:10.20.193.142:3300/0 conn(0x7f2dc40a0750 0x7f2dc409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc37fe640 10 monclient(hunting): get_auth_request con 0x7f2dc40a0750 auth_method 0 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_done global_id 274512 payload 274 2026-02-17T12:11:24.404 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 -- 10.20.193.51:0/2168313636 >> v2:10.20.193.142:3300/0 conn(0x7f2dc40a0750 msgr2=0x7f2dc409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 --2- 10.20.193.51:0/2168313636 >> v2:10.20.193.142:3300/0 conn(0x7f2dc40a0750 0x7f2dc409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 -- 10.20.193.51:0/2168313636 >> v1:10.20.193.142:6789/0 conn(0x7f2dc40a3bb0 legacy=0x7f2dc409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.405 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.397+0000 7f2dc89b1640 1 -- 10.20.193.51:0/2168313636 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc409eec0 con 0x7f2dc413b760 2026-02-17T12:11:24.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc89b1640 1 -- 10.20.193.51:0/2168313636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc413b760 msgr2=0x7f2dc413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.411 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc89b1640 1 --2- 10.20.193.51:0/2168313636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc413b760 0x7f2dc413db50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2dc406f3c0 tx=0x7f2db802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dec05aa2d21ac32 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 1 -- 10.20.193.51:0/2168313636 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db802fe60 con 0x7f2dc413b760 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: dump: 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.412 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 1 -- 10.20.193.51:0/2168313636 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db80373f0 con 0x7f2dc413b760 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 1 -- 10.20.193.51:0/2168313636 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80377c0 con 0x7f2dc413b760 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.413 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dc2ffd640 10 monclient: dump: 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.414 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 5 monclient: authenticate success, global_id 274512 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 4 set_mon_vals no callback set 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 10 monclient: shutdown 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 -- 10.20.193.51:0/2168313636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc413b760 msgr2=0x7f2dc413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 --2- 10.20.193.51:0/2168313636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc413b760 0x7f2dc413db50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2dc406f3c0 tx=0x7f2db802f230 comp rx=0 tx=0).stop 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 -- 10.20.193.51:0/2168313636 shutdown_connections 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 --2- 10.20.193.51:0/2168313636 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc413b760 0x7f2dc413db50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 --2- 10.20.193.51:0/2168313636 >> v2:10.20.193.142:3300/0 conn(0x7f2dc40a0750 0x7f2dc409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 -- 10.20.193.51:0/2168313636 >> 10.20.193.51:0/2168313636 conn(0x7f2dc40a30c0 msgr2=0x7f2dc40a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 -- 10.20.193.51:0/2168313636 shutdown_connections 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.400+0000 7f2dca43b640 1 -- 10.20.193.51:0/2168313636 wait complete. 2026-02-17T12:11:24.415 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.401+0000 7f2dca43b640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.401+0000 7f2dca43b640 10 monclient: monmap: 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.416 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.401+0000 7f2dca43b640 1 Processor -- start 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.401+0000 7f2dca43b640 1 -- start start 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.401+0000 7f2dca43b640 10 monclient: init 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2dc40a0750 0x7f2dc412d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-b con 0x7f2dc40a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-a con 0x7f2dc40a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2dc413b760 0x7f2dc412daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): picked mon.noname-c con 0x7f2dc413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.417 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc40a04b0 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc409c850 con 0x7f2dc40a0750 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc409e710 con 0x7f2dc413b760 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dca43b640 10 monclient(hunting): authenticate will time out at 2172.021087s 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2dc413b760 0x7f2dc412daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39918/0 (socket says 10.20.193.51:39918) 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 -- 10.20.193.51:0/511112821 learned_addr learned my addr 10.20.193.51:0/511112821 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): get_auth_request con 0x7f2dc40a3bb0 auth_method 0 2026-02-17T12:11:24.418 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): get_auth_request con 0x7f2dc413b760 auth_method 0 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc89b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc3fff640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2dc40a0750 0x7f2dc412d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc3fff640 10 monclient(hunting): get_auth_request con 0x7f2dc40a0750 auth_method 0 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient(hunting): handle_auth_done global_id 274515 payload 824 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 -- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2dc413b760 msgr2=0x7f2dc412daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2dc413b760 0x7f2dc412daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 -- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2dc40a0750 msgr2=0x7f2dc412d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2dc40a0750 0x7f2dc412d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.420 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.402+0000 7f2dc37fe640 1 -- 10.20.193.51:0/511112821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc4130d40 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc37fe640 1 -- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 msgr2=0x7f2dc412d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc37fe640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2db400e7c0 tx=0x7f2db400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4017070 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: dump: 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.421 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db400cae0 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 5 monclient: authenticate success, global_id 274515 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 10 monclient: _renew_subs 2026-02-17T12:11:24.422 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc4074120 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db400f040 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc27fc640 4 set_mon_vals no callback set 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dc0ff9640 10 monclient: dump: 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.423 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 10 monclient: _renew_subs 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.404+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc412ea50 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dca43b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dca43b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dca43b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc409dac0 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.424 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f2db4012050 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dc0ff9640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 0x7f2d94040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f2db4052280 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dc3fff640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 0x7f2d94040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.405+0000 7f2dc3fff640 10 monclient: get_auth_request con 0x7f2d9403dd40 auth_method 0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.407+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2db4023d80 con 0x7f2dc40a3bb0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.407+0000 7f2dc0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.407+0000 7f2dc0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:24.425 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.408+0000 7f2dc3fff640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 0x7f2d94040200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005020 tx=0x7f2db0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.494 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.492+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2dc4137510 con 0x7f2d9403dd40 2026-02-17T12:11:24.495 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.493+0000 7f2dc0ff9640 1 -- 10.20.193.51:0/511112821 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34137 (secure 0 0 0) 0x7f2dc4137510 con 0x7f2d9403dd40 2026-02-17T12:11:24.496 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:24.497 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:24.497 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 msgr2=0x7f2d94040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 0x7f2d94040200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005020 tx=0x7f2db0009040 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 10 monclient: shutdown 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 msgr2=0x7f2dc412d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.494+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2db400e7c0 tx=0x7f2db400ec90 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 shutdown_connections 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f2d9403dd40 0x7f2d94040200 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f2dc413b760 0x7f2dc412daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f2dc40a3bb0 0x7f2dc412d560 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 --2- 10.20.193.51:0/511112821 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f2dc40a0750 0x7f2dc412d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.498 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 >> 10.20.193.51:0/511112821 conn(0x7f2dc40a30c0 msgr2=0x7f2dc4138b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 shutdown_connections 2026-02-17T12:11:24.499 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.495+0000 7f2dca43b640 1 -- 10.20.193.51:0/511112821 wait complete. 2026-02-17T12:11:24.504 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1705,"stamp":"2026-02-17T12:11:24.041989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":339220,"kb_used_data":44192,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565891820,"statfs":{"total":579820584960,"available":579473223680,"internally_reserved":0,"allocated":45252608,"data_stored":20696740,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-253042588,"num_objects":-123,"num_object_clones":-76,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":-11,"num_read":-7280,"num_read_kb":-7072692,"num_write":-5313,"num_write_kb":-2119968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.355988"},"pg_stats":[{"pgid":"1.0","version":"15'112","reported_seq":1964,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762164+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T12:11:20.762164+0000","last_peered":"2026-02-17T12:11:20.762164+0000","last_clean":"2026-02-17T12:11:20.762164+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:20.762164+0000","last_undegraded":"2026-02-17T12:11:20.762164+0000","last_fullsized":"2026-02-17T12:11:20.762164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":1820,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762156+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T12:11:20.762156+0000","last_peered":"2026-02-17T12:11:20.762156+0000","last_clean":"2026-02-17T12:11:20.762156+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:20.762156+0000","last_undegraded":"2026-02-17T12:11:20.762156+0000","last_fullsized":"2026-02-17T12:11:20.762156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1824,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442127+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T12:11:22.442127+0000","last_peered":"2026-02-17T12:11:22.442127+0000","last_clean":"2026-02-17T12:11:22.442127+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:22.442127+0000","last_undegraded":"2026-02-17T12:11:22.442127+0000","last_fullsized":"2026-02-17T12:11:22.442127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":1821,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1832,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762708+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T12:11:20.762708+0000","last_peered":"2026-02-17T12:11:20.762708+0000","last_clean":"2026-02-17T12:11:20.762708+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:20.762708+0000","last_undegraded":"2026-02-17T12:11:20.762708+0000","last_fullsized":"2026-02-17T12:11:20.762708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762131+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T12:11:20.762131+0000","last_peered":"2026-02-17T12:11:20.762131+0000","last_clean":"2026-02-17T12:11:20.762131+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:20.762131+0000","last_undegraded":"2026-02-17T12:11:20.762131+0000","last_fullsized":"2026-02-17T12:11:20.762131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1831,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762758+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T12:11:20.762758+0000","last_peered":"2026-02-17T12:11:20.762758+0000","last_clean":"2026-02-17T12:11:20.762758+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:20.762758+0000","last_undegraded":"2026-02-17T12:11:20.762758+0000","last_fullsized":"2026-02-17T12:11:20.762758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1826,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762203+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T12:11:20.762203+0000","last_peered":"2026-02-17T12:11:20.762203+0000","last_clean":"2026-02-17T12:11:20.762203+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:20.762203+0000","last_undegraded":"2026-02-17T12:11:20.762203+0000","last_fullsized":"2026-02-17T12:11:20.762203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56576,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315264,"statfs":{"total":96636764160,"available":96578830336,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60732,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640571,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56520,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315320,"statfs":{"total":96636764160,"available":96578887680,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:24.505 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:24.578 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 10 monclient: get_monmap_and_config 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 10 monclient: monmap: 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:24.575355+0000 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:24.575355+0000 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.579 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 1 Processor -- start 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 1 -- start start 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.574+0000 7f893e866640 10 monclient: init 2026-02-17T12:11:24.580 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f893806eb80 0x7f8938137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): picked mon.noname-a con 0x7f893806eb80 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8938138370 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f8938138780 0x7f8938135040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): picked mon.noname-c con 0x7f8938138780 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893806f590 con 0x7f8938138370 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f893806fa20 con 0x7f893806eb80 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f893806ef60 con 0x7f8938138780 2026-02-17T12:11:24.581 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893e866640 10 monclient(hunting): authenticate will time out at 2172.194158s 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f893806eb80 0x7f8938137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f893806eb80 0x7f8938137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39926/0 (socket says 10.20.193.51:39926) 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 -- 10.20.193.51:0/2627562166 learned_addr learned my addr 10.20.193.51:0/2627562166 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): get_auth_request con 0x7f893806eb80 auth_method 0 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f89377fe640 1 -- 10.20.193.51:0/2627562166 >> v1:10.20.193.51:6789/0 conn(0x7f8938138370 legacy=0x7f8938134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f89377fe640 1 -- 10.20.193.51:0/2627562166 >> v1:10.20.193.51:6789/0 conn(0x7f8938138370 legacy=0x7f8938134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f89377fe640 1 --1- 10.20.193.51:0/2627562166 >> v1:10.20.193.51:6789/0 conn(0x7f8938138370 0x7f8938134930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2026-02-17T12:11:24.582 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893cddc640 1 --2- 10.20.193.51:0/2627562166 >> v2:10.20.193.142:3300/0 conn(0x7f8938138780 0x7f8938135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893cddc640 10 monclient(hunting): get_auth_request con 0x7f8938138780 auth_method 0 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893cddc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893cddc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f893cddc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient(hunting): handle_auth_done global_id 274518 payload 274 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 -- 10.20.193.51:0/2627562166 >> v2:10.20.193.142:3300/0 conn(0x7f8938138780 msgr2=0x7f8938135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 --2- 10.20.193.51:0/2627562166 >> v2:10.20.193.142:3300/0 conn(0x7f8938138780 0x7f8938135040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.583 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 -- 10.20.193.51:0/2627562166 >> v1:10.20.193.51:6789/0 conn(0x7f8938138370 legacy=0x7f8938134930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:11:24.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.584 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.575+0000 7f8937fff640 1 -- 10.20.193.51:0/2627562166 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893806fd00 con 0x7f893806eb80 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8937fff640 1 -- 10.20.193.51:0/2627562166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f893806eb80 msgr2=0x7f8938137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8937fff640 1 --2- 10.20.193.51:0/2627562166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f893806eb80 0x7f8938137e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8938071740 tx=0x7f892402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257c3d44e9446d0c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 1 -- 10.20.193.51:0/2627562166 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892403c070 con 0x7f893806eb80 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: dump: 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.590 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.591 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 5 monclient: authenticate success, global_id 274518 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 1 -- 10.20.193.51:0/2627562166 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892402fd50 con 0x7f893806eb80 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 1 -- 10.20.193.51:0/2627562166 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037660 con 0x7f893806eb80 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 4 set_mon_vals no callback set 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f8936ffd640 10 monclient: dump: 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.592 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 10 monclient: shutdown 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 -- 10.20.193.51:0/2627562166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f893806eb80 msgr2=0x7f8938137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 --2- 10.20.193.51:0/2627562166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f893806eb80 0x7f8938137e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8938071740 tx=0x7f892402eed0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 -- 10.20.193.51:0/2627562166 shutdown_connections 2026-02-17T12:11:24.593 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 --2- 10.20.193.51:0/2627562166 >> v2:10.20.193.142:3300/0 conn(0x7f8938138780 0x7f8938135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 --2- 10.20.193.51:0/2627562166 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f893806eb80 0x7f8938137e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 -- 10.20.193.51:0/2627562166 >> 10.20.193.51:0/2627562166 conn(0x7f89380a8c80 msgr2=0x7f89380a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 -- 10.20.193.51:0/2627562166 shutdown_connections 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 1 -- 10.20.193.51:0/2627562166 wait complete. 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.578+0000 7f893e866640 10 monclient: monmap: 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.594 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 Processor -- start 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 -- start start 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient: init 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f893806eb80 0x7f89381cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): picked mon.noname-c con 0x7f893806eb80 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.595 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): picked mon.noname-a con 0x7f8938138370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 0x7f89381cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): picked mon.noname-b con 0x7f8938138780 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f89380a4e50 con 0x7f8938138370 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f89380a4cd0 con 0x7f8938138780 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f8938135580 con 0x7f893806eb80 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893e866640 10 monclient(hunting): authenticate will time out at 2172.198358s 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39932/0 (socket says 10.20.193.51:39932) 2026-02-17T12:11:24.596 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 -- 10.20.193.51:0/3685620609 learned_addr learned my addr 10.20.193.51:0/3685620609 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f893806eb80 0x7f89381cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): get_auth_request con 0x7f8938138370 auth_method 0 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): get_auth_request con 0x7f893806eb80 auth_method 0 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.597 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f8937fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893cddc640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 0x7f89381cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient(hunting): handle_auth_done global_id 274521 payload 824 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 -- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f893806eb80 msgr2=0x7f89381cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f893806eb80 0x7f89381cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 -- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 msgr2=0x7f89381cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 0x7f89381cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.598 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f89377fe640 1 -- 10.20.193.51:0/3685620609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8938074660 con 0x7f8938138370 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893cddc640 10 monclient: get_auth_request con 0x7f8938138780 auth_method 0 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.579+0000 7f893cddc640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 0x7f89381cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f89377fe640 1 -- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 msgr2=0x7f89381cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f89377fe640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f892800c580 tx=0x7f892800ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928018070 con 0x7f8938138370 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: dump: 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.599 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89280070d0 con 0x7f8938138370 2026-02-17T12:11:24.600 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280074c0 con 0x7f8938138370 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 5 monclient: authenticate success, global_id 274521 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f89367fc640 4 set_mon_vals no callback set 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 10 monclient: _renew_subs 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8938074940 con 0x7f8938138370 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f8934ff9640 10 monclient: dump: 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.601 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 10 monclient: _renew_subs 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.581+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89380a8410 con 0x7f8938138370 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f893e866640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f893e866640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f892801c3b0 con 0x7f8938138370 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f893e866640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8938137e30 con 0x7f8938138370 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f8934ff9640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 0x7f89080401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f8928051bb0 con 0x7f8938138370 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f8937fff640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 0x7f89080401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.582+0000 7f8937fff640 10 monclient: get_auth_request con 0x7f890803dd10 auth_method 0 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.585+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8928050760 con 0x7f8938138370 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.585+0000 7f8934ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.585+0000 7f8934ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:24.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.585+0000 7f8937fff640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 0x7f89080401d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8924036000 tx=0x7f8924033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.615 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.615 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2319340794}) 2026-02-17T12:11:24.615 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4061837509}) 2026-02-17T12:11:24.615 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.615 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2319340794}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2553334224}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3505603038}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=419097192}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3505603038}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.604+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=413680504}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289823785}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3228814029}) 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.616 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289823785}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3120759871}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2642397018}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3296180430}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2642397018}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.605+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3416498336}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=770886225}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4126733099}) 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.617 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=770886225}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1504147460}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1328004990}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2394282602}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1328004990}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2780764614}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3131638580}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1318015406}) 2026-02-17T12:11:24.618 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3131638580}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.606+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=758071414}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=844525292}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=118964761}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=844525292}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1132792678}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245155155}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2209848635}) 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.619 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245155155}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3625273839}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3164274873}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1833509484}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3164274873}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3452299167}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3348145816}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3496465084}) 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.620 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3348145816}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.607+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2851577020}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3601520753}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=695330130}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3601520753}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3932187654}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838099561}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3669433532}) 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.621 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1838099561}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3110871075}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2690601438}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1940235699}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2690601438}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.608+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1609475748}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4231269358}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2003760650}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4231269358}) 2026-02-17T12:11:24.622 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1144930594}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2410506091}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=602623772}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2410506091}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1871632652}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159352318}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3735406436}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4159352318}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=725145833}) 2026-02-17T12:11:24.623 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200923799}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=151994163}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200923799}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.609+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2653242219}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1283437431}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=830522000}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1283437431}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=916455132}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1283793669}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1013916789}) 2026-02-17T12:11:24.624 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1283793669}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3883298321}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572490013}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2184244821}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572490013}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.610+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=971025602}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=686257983}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=98515167}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=686257983}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1100512154}) 2026-02-17T12:11:24.625 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769478700}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2805639580}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769478700}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1743951643}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1736254762}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2946612057}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1736254762}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.611+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1194685320}) 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.626 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4275956797}) 2026-02-17T12:11:24.627 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3325522579}) 2026-02-17T12:11:24.627 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.627 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4275956797}) 2026-02-17T12:11:24.627 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.612+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3297946589}) 2026-02-17T12:11:24.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47167681}) 2026-02-17T12:11:24.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4190431000}) 2026-02-17T12:11:24.662 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47167681}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=27303965}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3867766639}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=678334725}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3867766639}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1433343271}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2300351908}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1105066596}) 2026-02-17T12:11:24.663 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2300351908}) 2026-02-17T12:11:24.664 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.660+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2525015453}) 2026-02-17T12:11:24.665 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.665 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189467856}) 2026-02-17T12:11:24.665 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1965369834}) 2026-02-17T12:11:24.665 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189467856}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3431994432}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044876728}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=104741067}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1044876728}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3060454736}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2848383274}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2950765711}) 2026-02-17T12:11:24.666 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.667 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2848383274}) 2026-02-17T12:11:24.667 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.661+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1846383866}) 2026-02-17T12:11:24.669 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.668+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8938073700 con 0x7f890803dd10 2026-02-17T12:11:24.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.668+0000 7f8934ff9640 1 -- 10.20.193.51:0/3685620609 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34137 (secure 0 0 0) 0x7f8938073700 con 0x7f890803dd10 2026-02-17T12:11:24.671 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:24.672 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:24.673 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3161316518}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3335439273}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3161316518}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2551148130}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231618910}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3233531631}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231618910}) 2026-02-17T12:11:24.674 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4205635901}) 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=558280591}) 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=67605928}) 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=558280591}) 2026-02-17T12:11:24.675 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.669+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=689597942}) 2026-02-17T12:11:24.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 msgr2=0x7f89080401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 0x7f89080401d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8924036000 tx=0x7f8924033000 comp rx=0 tx=0).stop 2026-02-17T12:11:24.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 10 monclient: shutdown 2026-02-17T12:11:24.676 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 msgr2=0x7f89381cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f892800c580 tx=0x7f892800ca50 comp rx=0 tx=0).stop 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 shutdown_connections 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f890803dd10 0x7f89080401d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f8938138780 0x7f89381cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f8938138370 0x7f89381cf540 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 --2- 10.20.193.51:0/3685620609 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f893806eb80 0x7f89381cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 >> 10.20.193.51:0/3685620609 conn(0x7f89380a8c80 msgr2=0x7f89380a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 shutdown_connections 2026-02-17T12:11:24.677 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.670+0000 7f893e866640 1 -- 10.20.193.51:0/3685620609 wait complete. 2026-02-17T12:11:24.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107336034}) 2026-02-17T12:11:24.680 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=173729674}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107336034}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3095432506}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=482702941}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4004696280}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=482702941}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=264676845}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.670+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=806618959}) 2026-02-17T12:11:24.681 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=470081613}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=806618959}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3676526656}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612206301}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1212029587}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612206301}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3857931010}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4013977944}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3682337600}) 2026-02-17T12:11:24.682 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4013977944}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.671+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4197253309}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2732444683}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400594957}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2732444683}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3190165142}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4177717036}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=352769883}) 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.683 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4177717036}) 2026-02-17T12:11:24.684 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.672+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1717245612}) 2026-02-17T12:11:24.684 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1705,"stamp":"2026-02-17T12:11:24.041989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":339220,"kb_used_data":44192,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565891820,"statfs":{"total":579820584960,"available":579473223680,"internally_reserved":0,"allocated":45252608,"data_stored":20696740,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-253042588,"num_objects":-123,"num_object_clones":-76,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":-11,"num_read":-7280,"num_read_kb":-7072692,"num_write":-5313,"num_write_kb":-2119968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.355988"},"pg_stats":[{"pgid":"1.0","version":"15'112","reported_seq":1964,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762164+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T12:11:20.762164+0000","last_peered":"2026-02-17T12:11:20.762164+0000","last_clean":"2026-02-17T12:11:20.762164+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:20.762164+0000","last_undegraded":"2026-02-17T12:11:20.762164+0000","last_fullsized":"2026-02-17T12:11:20.762164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":1820,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762156+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T12:11:20.762156+0000","last_peered":"2026-02-17T12:11:20.762156+0000","last_clean":"2026-02-17T12:11:20.762156+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:20.762156+0000","last_undegraded":"2026-02-17T12:11:20.762156+0000","last_fullsized":"2026-02-17T12:11:20.762156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1824,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442127+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T12:11:22.442127+0000","last_peered":"2026-02-17T12:11:22.442127+0000","last_clean":"2026-02-17T12:11:22.442127+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:22.442127+0000","last_undegraded":"2026-02-17T12:11:22.442127+0000","last_fullsized":"2026-02-17T12:11:22.442127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":1821,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1832,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762708+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T12:11:20.762708+0000","last_peered":"2026-02-17T12:11:20.762708+0000","last_clean":"2026-02-17T12:11:20.762708+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:20.762708+0000","last_undegraded":"2026-02-17T12:11:20.762708+0000","last_fullsized":"2026-02-17T12:11:20.762708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762131+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T12:11:20.762131+0000","last_peered":"2026-02-17T12:11:20.762131+0000","last_clean":"2026-02-17T12:11:20.762131+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:20.762131+0000","last_undegraded":"2026-02-17T12:11:20.762131+0000","last_fullsized":"2026-02-17T12:11:20.762131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1831,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762758+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T12:11:20.762758+0000","last_peered":"2026-02-17T12:11:20.762758+0000","last_clean":"2026-02-17T12:11:20.762758+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:20.762758+0000","last_undegraded":"2026-02-17T12:11:20.762758+0000","last_fullsized":"2026-02-17T12:11:20.762758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1826,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762203+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T12:11:20.762203+0000","last_peered":"2026-02-17T12:11:20.762203+0000","last_clean":"2026-02-17T12:11:20.762203+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:20.762203+0000","last_undegraded":"2026-02-17T12:11:20.762203+0000","last_fullsized":"2026-02-17T12:11:20.762203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56576,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315264,"statfs":{"total":96636764160,"available":96578830336,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60732,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640571,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56520,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315320,"statfs":{"total":96636764160,"available":96578887680,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:24.686 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:11:24.686 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 10 monclient: get_monmap_and_config 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 10 monclient: monmap: 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:24.754323+0000 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:24.754323+0000 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:24.755 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:24.756 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:24.756 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:24.756 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 1 Processor -- start 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 1 -- start start 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.753+0000 7f680bfcc640 10 monclient: init 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f68040a3bb0 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f68040a0750 0x7f680409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-a con 0x7f68040a0750 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f680413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680406e140 con 0x7f680413b760 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680409f910 con 0x7f68040a3bb0 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f680409ccd0 con 0x7f68040a0750 2026-02-17T12:11:24.757 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680bfcc640 10 monclient(hunting): authenticate will time out at 2172.373082s 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f68040a0750 0x7f680409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f68040a0750 0x7f680409e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39938/0 (socket says 10.20.193.51:39938) 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f680a542640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f680413b760 0x7f680413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57374/0 (socket says 10.20.193.51:57374) 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 1 -- 10.20.193.51:0/2065923478 learned_addr learned my addr 10.20.193.51:0/2065923478 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 10 monclient(hunting): get_auth_request con 0x7f68040a0750 auth_method 0 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.758 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.754+0000 7f6809540640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f680a542640 1 -- 10.20.193.51:0/2065923478 >> v1:10.20.193.51:6789/0 conn(0x7f680413b760 legacy=0x7f680413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809d41640 1 -- 10.20.193.51:0/2065923478 >> v1:10.20.193.142:6789/0 conn(0x7f68040a3bb0 legacy=0x7f680409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient(hunting): handle_auth_done global_id 274524 payload 274 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 1 -- 10.20.193.51:0/2065923478 >> v1:10.20.193.142:6789/0 conn(0x7f68040a3bb0 legacy=0x7f680409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 1 -- 10.20.193.51:0/2065923478 >> v1:10.20.193.51:6789/0 conn(0x7f680413b760 legacy=0x7f680413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6809540640 1 -- 10.20.193.51:0/2065923478 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680409eec0 con 0x7f68040a0750 2026-02-17T12:11:24.759 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6808d3f640 1 -- 10.20.193.51:0/2065923478 <== mon.0 v1:10.20.193.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563036653 0 0) 0x7f680406e140 con 0x7f680413b760 2026-02-17T12:11:24.760 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.756+0000 7f6808d3f640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.758+0000 7f6809540640 1 -- 10.20.193.51:0/2065923478 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 msgr2=0x7f680409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.758+0000 7f6809540640 1 --2- 10.20.193.51:0/2065923478 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f680409e1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009a70 tx=0x7f67f802efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d192331ee46f0b6b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 1 -- 10.20.193.51:0/2065923478 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f803c070 con 0x7f68040a0750 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.761 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: dump: 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 1 -- 10.20.193.51:0/2065923478 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f8037440 con 0x7f68040a0750 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 5 monclient: authenticate success, global_id 274524 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 1 -- 10.20.193.51:0/2065923478 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8037810 con 0x7f68040a0750 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:24.762 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 4 set_mon_vals no callback set 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f6808d3f640 10 monclient: dump: 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 10 monclient: shutdown 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 -- 10.20.193.51:0/2065923478 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 msgr2=0x7f680409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2065923478 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f680409e1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009a70 tx=0x7f67f802efb0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 -- 10.20.193.51:0/2065923478 shutdown_connections 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2065923478 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f680409e1d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.763 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 -- 10.20.193.51:0/2065923478 >> 10.20.193.51:0/2065923478 conn(0x7f68040a30c0 msgr2=0x7f68040a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 -- 10.20.193.51:0/2065923478 shutdown_connections 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 -- 10.20.193.51:0/2065923478 wait complete. 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 10 monclient: monmap: 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.759+0000 7f680bfcc640 1 Processor -- start 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 -- start start 2026-02-17T12:11:24.764 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient: init 2026-02-17T12:11:24.767 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-a con 0x7f68040a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 0x7f68041cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-c con 0x7f68040a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f680413b760 0x7f68041d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): picked mon.noname-b con 0x7f680413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f68040a04b0 con 0x7f68040a0750 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f680409c850 con 0x7f680413b760 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f680409e710 con 0x7f68040a3bb0 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f680bfcc640 10 monclient(hunting): authenticate will time out at 2172.379318s 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.768 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39952/0 (socket says 10.20.193.51:39952) 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 -- 10.20.193.51:0/2008404854 learned_addr learned my addr 10.20.193.51:0/2008404854 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): get_auth_request con 0x7f68040a0750 auth_method 0 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 0x7f68041cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): get_auth_request con 0x7f68040a3bb0 auth_method 0 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient(hunting): handle_auth_done global_id 274530 payload 824 2026-02-17T12:11:24.769 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 -- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 msgr2=0x7f68041cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 0x7f68041cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 -- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f680413b760 msgr2=0x7f68041d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f680413b760 0x7f68041d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 monclient: found mon.noname-a 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809d41640 1 -- 10.20.193.51:0/2008404854 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6804133180 con 0x7f68040a0750 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.760+0000 7f6809540640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 0x7f68041cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:24.770 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f6809d41640 1 -- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 msgr2=0x7f68041cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f6809d41640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c760 tx=0x7f67f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4017070 con 0x7f68040a0750 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: dump: 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.771 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4005cd0 con 0x7f68040a0750 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4007290 con 0x7f68040a0750 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 5 monclient: authenticate success, global_id 274530 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f3fff640 4 set_mon_vals no callback set 2026-02-17T12:11:24.772 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f67f27fc640 10 monclient: dump: 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 10 monclient: _renew_subs 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.773 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68040a2740 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 10 monclient: _renew_subs 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.762+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6804134700 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f680bfcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f680bfcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f680bfcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680409dac0 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f67f4007470 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f67f27fc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 0x7f67d4040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f67f4051b00 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.763+0000 7f6809540640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 0x7f67d4040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.764+0000 7f6809540640 10 monclient: get_auth_request con 0x7f67d403dd60 auth_method 0 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.766+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f68040a2740 con 0x7f68040a0750 2026-02-17T12:11:24.774 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.766+0000 7f67f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.766+0000 7f67f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:24.775 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.766+0000 7f6809540640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 0x7f67d4040220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67f8036000 tx=0x7f67f8033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2550726242}) 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=483393300}) 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2550726242}) 2026-02-17T12:11:24.849 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.846+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3631474646}) 2026-02-17T12:11:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.847+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68040a21f0 con 0x7f67d403dd60 2026-02-17T12:11:24.850 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.848+0000 7f67f27fc640 1 -- 10.20.193.51:0/2008404854 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34137 (secure 0 0 0) 0x7f68040a21f0 con 0x7f67d403dd60 2026-02-17T12:11:24.851 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:24.852 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 msgr2=0x7f67d4040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 0x7f67d4040220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67f8036000 tx=0x7f67f8033000 comp rx=0 tx=0).stop 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 10 monclient: shutdown 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 msgr2=0x7f68041cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c760 tx=0x7f67f400cc30 comp rx=0 tx=0).stop 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 shutdown_connections 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f67d403dd60 0x7f67d4040220 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f680413b760 0x7f68041d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f68040a3bb0 0x7f68041cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.853 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 --2- 10.20.193.51:0/2008404854 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f68040a0750 0x7f68041cf860 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 >> 10.20.193.51:0/2008404854 conn(0x7f68040a30c0 msgr2=0x7f6804138af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 shutdown_connections 2026-02-17T12:11:24.854 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.849+0000 7f680bfcc640 1 -- 10.20.193.51:0/2008404854 wait complete. 2026-02-17T12:11:24.859 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1705,"stamp":"2026-02-17T12:11:24.041989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":339220,"kb_used_data":44192,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565891820,"statfs":{"total":579820584960,"available":579473223680,"internally_reserved":0,"allocated":45252608,"data_stored":20696740,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-253042588,"num_objects":-123,"num_object_clones":-76,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":-11,"num_read":-7280,"num_read_kb":-7072692,"num_write":-5313,"num_write_kb":-2119968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.355988"},"pg_stats":[{"pgid":"1.0","version":"15'112","reported_seq":1964,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762164+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T12:11:20.762164+0000","last_peered":"2026-02-17T12:11:20.762164+0000","last_clean":"2026-02-17T12:11:20.762164+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:20.762164+0000","last_undegraded":"2026-02-17T12:11:20.762164+0000","last_fullsized":"2026-02-17T12:11:20.762164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":1820,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762156+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T12:11:20.762156+0000","last_peered":"2026-02-17T12:11:20.762156+0000","last_clean":"2026-02-17T12:11:20.762156+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:20.762156+0000","last_undegraded":"2026-02-17T12:11:20.762156+0000","last_fullsized":"2026-02-17T12:11:20.762156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1824,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442127+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T12:11:22.442127+0000","last_peered":"2026-02-17T12:11:22.442127+0000","last_clean":"2026-02-17T12:11:22.442127+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:22.442127+0000","last_undegraded":"2026-02-17T12:11:22.442127+0000","last_fullsized":"2026-02-17T12:11:22.442127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":1821,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1832,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762708+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T12:11:20.762708+0000","last_peered":"2026-02-17T12:11:20.762708+0000","last_clean":"2026-02-17T12:11:20.762708+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:20.762708+0000","last_undegraded":"2026-02-17T12:11:20.762708+0000","last_fullsized":"2026-02-17T12:11:20.762708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762131+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T12:11:20.762131+0000","last_peered":"2026-02-17T12:11:20.762131+0000","last_clean":"2026-02-17T12:11:20.762131+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:20.762131+0000","last_undegraded":"2026-02-17T12:11:20.762131+0000","last_fullsized":"2026-02-17T12:11:20.762131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1831,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762758+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T12:11:20.762758+0000","last_peered":"2026-02-17T12:11:20.762758+0000","last_clean":"2026-02-17T12:11:20.762758+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:20.762758+0000","last_undegraded":"2026-02-17T12:11:20.762758+0000","last_fullsized":"2026-02-17T12:11:20.762758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1826,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762203+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T12:11:20.762203+0000","last_peered":"2026-02-17T12:11:20.762203+0000","last_clean":"2026-02-17T12:11:20.762203+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:20.762203+0000","last_undegraded":"2026-02-17T12:11:20.762203+0000","last_fullsized":"2026-02-17T12:11:20.762203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56576,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315264,"statfs":{"total":96636764160,"available":96578830336,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60732,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640571,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56520,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315320,"statfs":{"total":96636764160,"available":96578887680,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:24.860 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:11:24.929 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335310889}) 2026-02-17T12:11:24.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=593644406}) 2026-02-17T12:11:24.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:24.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335310889}) 2026-02-17T12:11:24.930 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:24.927+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2131039574}) 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: get_monmap_and_config 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: monmap: 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:24.965270+0000 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:24.965270+0000 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:24.966 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 1 Processor -- start 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 1 -- start start 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: init 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 0x7f3fe009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-a con 0x7f3fe00a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3fe00a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.964+0000 7f3fe541a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-b con 0x7f3fe013b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe006e140 con 0x7f3fe00a0750 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe009f910 con 0x7f3fe00a3bb0 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe009ccd0 con 0x7f3fe013b760 2026-02-17T12:11:24.967 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fe541a640 10 monclient(hunting): authenticate will time out at 2172.584020s 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 0x7f3fe009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 0x7f3fe009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:39954/0 (socket says 10.20.193.51:39954) 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 1 -- 10.20.193.51:0/2335274681 learned_addr learned my addr 10.20.193.51:0/2335274681 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39798/0 (socket says 10.20.193.51:39798) 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 10 monclient(hunting): get_auth_request con 0x7f3fe00a3bb0 auth_method 0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fde7fc640 1 --1- 10.20.193.51:0/2335274681 >> v1:10.20.193.51:6789/0 conn(0x7f3fe00a0750 0x7f3fe009e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:57376/0 (socket says 10.20.193.51:57376) 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): get_auth_request con 0x7f3fe013b760 auth_method 0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_done global_id 304250 payload 274 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 -- 10.20.193.51:0/2335274681 >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 msgr2=0x7f3fe009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 --2- 10.20.193.51:0/2335274681 >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 0x7f3fe009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 -- 10.20.193.51:0/2335274681 >> v1:10.20.193.51:6789/0 conn(0x7f3fe00a0750 legacy=0x7f3fe009e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 monclient: found mon.noname-b 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:24.968 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.965+0000 7f3fdf7fe640 1 -- 10.20.193.51:0/2335274681 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe009eec0 con 0x7f3fe013b760 2026-02-17T12:11:24.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fdf7fe640 1 -- 10.20.193.51:0/2335274681 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 msgr2=0x7f3fe013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.969 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fdf7fe640 1 --2- 10.20.193.51:0/2335274681 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006c1c0 tx=0x7f3fd002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54f29cc8b49157e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 1 -- 10.20.193.51:0/2335274681 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd003c070 con 0x7f3fe013b760 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: dump: 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 1 -- 10.20.193.51:0/2335274681 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0037440 con 0x7f3fe013b760 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fe541a640 5 monclient: authenticate success, global_id 304250 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fe541a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 1 -- 10.20.193.51:0/2335274681 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0037810 con 0x7f3fe013b760 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fe541a640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fe541a640 4 set_mon_vals no callback set 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.967+0000 7f3fddffb640 10 monclient: dump: 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.970 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 10 monclient: shutdown 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 -- 10.20.193.51:0/2335274681 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 msgr2=0x7f3fe013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 --2- 10.20.193.51:0/2335274681 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006c1c0 tx=0x7f3fd002f130 comp rx=0 tx=0).stop 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 -- 10.20.193.51:0/2335274681 shutdown_connections 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 --2- 10.20.193.51:0/2335274681 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe013b760 0x7f3fe013db50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 --2- 10.20.193.51:0/2335274681 >> v2:10.20.193.51:3300/0 conn(0x7f3fe00a3bb0 0x7f3fe009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 -- 10.20.193.51:0/2335274681 >> 10.20.193.51:0/2335274681 conn(0x7f3fe00a30c0 msgr2=0x7f3fe00a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 -- 10.20.193.51:0/2335274681 shutdown_connections 2026-02-17T12:11:24.971 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 -- 10.20.193.51:0/2335274681 wait complete. 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 10 monclient: build_initial_monmap 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 10 monclient: monmap: 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.968+0000 7f3fe541a640 1 Processor -- start 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 -- start start 2026-02-17T12:11:24.972 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient: init 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-c con 0x7f3fe00a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 0x7f3fe0091ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-b con 0x7f3fe00a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3fe013b760 0x7f3fe00921e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): picked mon.noname-a con 0x7f3fe013b760 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe00a04b0 con 0x7f3fe013b760 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe009c850 con 0x7f3fe00a3bb0 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe009e710 con 0x7f3fe00a0750 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fe541a640 10 monclient(hunting): authenticate will time out at 2172.588301s 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:39810/0 (socket says 10.20.193.51:39810) 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 -- 10.20.193.51:0/1039580682 learned_addr learned my addr 10.20.193.51:0/1039580682 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): get_auth_request con 0x7f3fe00a0750 auth_method 0 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3fe013b760 0x7f3fe00921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): get_auth_request con 0x7f3fe013b760 auth_method 0 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:24.973 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fde7fc640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 0x7f3fe0091ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient(hunting): handle_auth_done global_id 304253 payload 824 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 -- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 msgr2=0x7f3fe0091ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 0x7f3fe0091ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 -- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3fe013b760 msgr2=0x7f3fe00921e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3fe013b760 0x7f3fe00921e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient: _finish_hunting 0 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 monclient: found mon.noname-c 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fdeffd640 1 -- 10.20.193.51:0/1039580682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00954d0 con 0x7f3fe00a0750 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fde7fc640 10 monclient: get_auth_request con 0x7f3fe00a3bb0 auth_method 0 2026-02-17T12:11:24.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.969+0000 7f3fde7fc640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 0x7f3fe0091ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fdeffd640 1 -- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 msgr2=0x7f3fe0099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fdeffd640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400d8a0 tx=0x7f3fd400dd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4018020 con 0x7f3fe00a0750 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: dump: 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd400ba80 con 0x7f3fe00a0750 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 5 monclient: authenticate success, global_id 304253 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 10 monclient: _renew_subs 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe0094300 con 0x7f3fe00a0750 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400be50 con 0x7f3fe00a0750 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fbf7fe640 10 monclient: dump: 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.975 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fdd7fa640 4 set_mon_vals no callback set 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 10 monclient: _renew_subs 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.971+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe00957b0 con 0x7f3fe00a0750 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fe541a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fe541a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fe541a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f3fd4013050 con 0x7f3fe00a0750 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe00a2500 con 0x7f3fe00a0750 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fbf7fe640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 0x7f3fac040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f3fd4052750 con 0x7f3fe00a0750 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fde7fc640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 0x7f3fac040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.972+0000 7f3fde7fc640 10 monclient: get_auth_request con 0x7f3fac03deb0 auth_method 0 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.975+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3fd4022030 con 0x7f3fe00a0750 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.975+0000 7f3fbf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.975+0000 7f3fbf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:24.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:24.975+0000 7f3fde7fc640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 0x7f3fac040370 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0093420 tx=0x7f3fc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353312787}) 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1720146246}) 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353312787}) 2026-02-17T12:11:25.005 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3705447026}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039599502}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3726750416}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039599502}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.004+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3764383919}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=70637542}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3095825366}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=70637542}) 2026-02-17T12:11:25.006 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=398172123}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3487833917}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3229147920}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3487833917}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.005+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2012749274}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338345655}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=439357908}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338345655}) 2026-02-17T12:11:25.007 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3177746281}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449037721}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2086611077}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449037721}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=697399196}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4185151558}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=735867399}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4185151558}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.006+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=889004262}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4141994828}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=429258055}) 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.008 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4141994828}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457841087}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856815944}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1701258462}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856815944}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.007+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2443675412}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75055218}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1916435429}) 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.009 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75055218}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=249460744}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221128893}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3580025027}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221128893}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=128506284}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1230628228}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3464043489}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1230628228}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.008+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=437926427}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2311052831}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4240962124}) 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.010 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2311052831}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2258171991}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839484330}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4051629367}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839484330}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3564328966}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2115367022}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1369880470}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2115367022}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.009+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3786247185}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731924572}) 2026-02-17T12:11:25.011 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4147974047}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731924572}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2544510140}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3500469114}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2724437402}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3500469114}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.010+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2838280963}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857898965}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=812377963}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857898965}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=475885798}) 2026-02-17T12:11:25.012 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813697087}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3136089285}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813697087}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1195524113}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1243052552}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1676499901}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1243052552}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4229211416}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335289935}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1482562991}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335289935}) 2026-02-17T12:11:25.013 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.011+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2533924054}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=52} crc {logm=28448589,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1972481387,mon_config_key=2169156338,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=374361190,osd_snap=3125555890}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=6,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=6,mon_config_key=11,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=58} crc {logm=2561260703,mdsmap=3207544932,mgr=2045898028,mgr_command_descs=1238205435,mgrstat=1975137942,mon_config_key=3610881771,monmap=1614227248,osd_metadata=101123558,osd_pg_creating=374361190,osd_snap=2959498013}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=12,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=52} crc {logm=28448589,mdsmap=3207544932,mgr=2354395410,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1972481387,mon_config_key=2169156338,monmap=263989209,osd_metadata=3956758304,osd_pg_creating=374361190,osd_snap=3125555890}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=6,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=56} crc {logm=2561260703,mdsmap=3207544932,mgr=2535274653,mgr_command_descs=1238205435,mgr_metadata=3312392843,mgrstat=1972481387,mon_config_key=2782503780,monmap=1614227248,osd_metadata=3812721542,osd_pg_creating=374361190,osd_snap=1207592839}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=892226253}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=1700507351}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=892226253}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.012+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1301602505}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=124954582,osdmap=3075749050}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=8,osdmap=92} crc {osd_snap=3696629221,osdmap=1980657282}) 2026-02-17T12:11:25.014 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=124954582,osdmap=3075749050}) 2026-02-17T12:11:25.015 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.013+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=3364026091,osdmap=711995843}) 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=94} crc {osdmap=3583494053}) 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=93} crc {osdmap=186876536}) 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=94} crc {osdmap=3583494053}) 2026-02-17T12:11:25.019 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-17T12:11:25.017+0000 7f814b016640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=96} crc {osdmap=2757449180}) 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.060+0000 7f3fe541a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.060+0000 7f3fe541a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.060+0000 7f3fe541a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.060+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fe009dac0 con 0x7f3fe00a0750 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.060+0000 7f3fbf7fe640 1 -- 10.20.193.51:0/1039580682 <== mon.2 v2:10.20.193.51:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v933) ==== 74+0+12330 (secure 0 0 0) 0x7f3fd4051300 con 0x7f3fe00a0750 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.061+0000 7f3fbf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.061+0000 7f3fbf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:25.062 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":933,"fsid":"d196e788-97c6-436f-bedf-bc3cc9f7e94a","created":"2026-02-17T11:45:16.916483+0000","modified":"2026-02-17T12:11:20.757469+0000","last_up_change":"2026-02-17T11:45:27.940883+0000","last_in_change":"2026-02-17T11:45:19.523218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:45:29.895545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:45:34.073497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ebf244d-48c6-40bb-b862-03bdb5f7e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6809","nonce":3172594222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6811","nonce":3172594222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6814","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6815","nonce":3172594222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":3172594222},{"type":"v1","addr":"10.20.193.51:6813","nonce":3172594222}]},"public_addr":"10.20.193.51:6809/3172594222","cluster_addr":"10.20.193.51:6811/3172594222","heartbeat_back_addr":"10.20.193.51:6815/3172594222","heartbeat_front_addr":"10.20.193.51:6813/3172594222","state":["exists","up"]},{"osd":1,"uuid":"259ec14a-3fe1-44a8-b955-749225995616","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6801","nonce":2218006344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6803","nonce":2218006344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6806","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6807","nonce":2218006344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":2218006344},{"type":"v1","addr":"10.20.193.51:6805","nonce":2218006344}]},"public_addr":"10.20.193.51:6801/2218006344","cluster_addr":"10.20.193.51:6803/2218006344","heartbeat_back_addr":"10.20.193.51:6807/2218006344","heartbeat_front_addr":"10.20.193.51:6805/2218006344","state":["exists","up"]},{"osd":2,"uuid":"d8bfdc36-4f2d-4949-aa78-bf7c180cc26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6817","nonce":1100885920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6818","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6819","nonce":1100885920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6822","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6823","nonce":1100885920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6820","nonce":1100885920},{"type":"v1","addr":"10.20.193.51:6821","nonce":1100885920}]},"public_addr":"10.20.193.51:6817/1100885920","cluster_addr":"10.20.193.51:6819/1100885920","heartbeat_back_addr":"10.20.193.51:6823/1100885920","heartbeat_front_addr":"10.20.193.51:6821/1100885920","state":["exists","up"]},{"osd":3,"uuid":"4dd27506-7b96-49d3-affa-5840d62cd49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6802","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6803","nonce":3494201988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6804","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6805","nonce":3494201988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6808","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6809","nonce":3494201988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6806","nonce":3494201988},{"type":"v1","addr":"10.20.193.142:6807","nonce":3494201988}]},"public_addr":"10.20.193.142:6803/3494201988","cluster_addr":"10.20.193.142:6805/3494201988","heartbeat_back_addr":"10.20.193.142:6809/3494201988","heartbeat_front_addr":"10.20.193.142:6807/3494201988","state":["exists","up"]},{"osd":4,"uuid":"f511bd46-d4f1-4cb2-b311-c9c9ad4c60d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6810","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6811","nonce":4031350650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6812","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6813","nonce":4031350650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6816","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6817","nonce":4031350650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6814","nonce":4031350650},{"type":"v1","addr":"10.20.193.142:6815","nonce":4031350650}]},"public_addr":"10.20.193.142:6811/4031350650","cluster_addr":"10.20.193.142:6813/4031350650","heartbeat_back_addr":"10.20.193.142:6817/4031350650","heartbeat_front_addr":"10.20.193.142:6815/4031350650","state":["exists","up"]},{"osd":5,"uuid":"9a395150-9617-43cb-8cf5-42ebb4535a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6818","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6819","nonce":1680143311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6820","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6821","nonce":1680143311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6824","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6825","nonce":1680143311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.142:6822","nonce":1680143311},{"type":"v1","addr":"10.20.193.142:6823","nonce":1680143311}]},"public_addr":"10.20.193.142:6819/1680143311","cluster_addr":"10.20.193.142:6821/1680143311","heartbeat_back_addr":"10.20.193.142:6825/1680143311","heartbeat_front_addr":"10.20.193.142:6823/1680143311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.941706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.768271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.191548+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:25.989812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.279524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:26.273692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 msgr2=0x7f3fac040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 0x7f3fac040370 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0093420 tx=0x7f3fc8009040 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 10 monclient: shutdown 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 msgr2=0x7f3fe0099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400d8a0 tx=0x7f3fd400dd70 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 shutdown_connections 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f3fac03deb0 0x7f3fac040370 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f3fe013b760 0x7f3fe00921e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f3fe00a3bb0 0x7f3fe0091ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 --2- 10.20.193.51:0/1039580682 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f3fe00a0750 0x7f3fe0099eb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 >> 10.20.193.51:0/1039580682 conn(0x7f3fe00a30c0 msgr2=0x7f3fe013ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:25.064 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 shutdown_connections 2026-02-17T12:11:25.065 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:25.062+0000 7f3fe541a640 1 -- 10.20.193.51:0/1039580682 wait complete. 2026-02-17T12:11:26.073 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T12:11:26.074 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 10 monclient: monmap: 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.146 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.142389+0000 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.142389+0000 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 1 Processor -- start 2026-02-17T12:11:26.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 1 -- start start 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.141+0000 7f01b7b46640 10 monclient: init 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f01b009fce0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 0x7f01b006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-b con 0x7f01b009ac60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f01b013b6f0 0x7f01b013dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-c con 0x7f01b013b6f0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b009bcc0 con 0x7f01b009fce0 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f01b00a00c0 con 0x7f01b013b6f0 2026-02-17T12:11:26.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f01b009b420 con 0x7f01b009ac60 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b7b46640 10 monclient(hunting): authenticate will time out at 2173.761186s 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b58bb640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7f01b009fce0 0x7f01b006c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37928/0 (socket says 10.20.193.51:37928) 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b58bb640 1 -- 10.20.193.51:0/2061788069 learned_addr learned my addr 10.20.193.51:0/2061788069 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 --2- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 0x7f01b006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): get_auth_request con 0x7f01b009ac60 auth_method 0 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.149 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b60bc640 1 --2- 10.20.193.51:0/2061788069 >> v2:10.20.193.142:3300/0 conn(0x7f01b013b6f0 0x7f01b013dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b60bc640 10 monclient(hunting): get_auth_request con 0x7f01b013b6f0 auth_method 0 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b60bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b60bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b60bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient(hunting): handle_auth_done global_id 304256 payload 274 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 -- 10.20.193.51:0/2061788069 >> v2:10.20.193.142:3300/0 conn(0x7f01b013b6f0 msgr2=0x7f01b013dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 --2- 10.20.193.51:0/2061788069 >> v2:10.20.193.142:3300/0 conn(0x7f01b013b6f0 0x7f01b013dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 -- 10.20.193.51:0/2061788069 >> v1:10.20.193.51:6789/0 conn(0x7f01b009fce0 legacy=0x7f01b006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.151 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.142+0000 7f01b50ba640 1 -- 10.20.193.51:0/2061788069 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b00a0980 con 0x7f01b009ac60 2026-02-17T12:11:26.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.144+0000 7f01b50ba640 1 -- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 msgr2=0x7f01b006cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.158 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.144+0000 7f01b50ba640 1 --2- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 0x7f01b006cfe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01a40098a0 tx=0x7f01a402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a7719fd78bc955a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 1 -- 10.20.193.51:0/2061788069 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a403c070 con 0x7f01b009ac60 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: dump: 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.159 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 1 -- 10.20.193.51:0/2061788069 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a402fc00 con 0x7f01b009ac60 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 5 monclient: authenticate success, global_id 304256 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 4 set_mon_vals no callback set 2026-02-17T12:11:26.160 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 1 -- 10.20.193.51:0/2061788069 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4037440 con 0x7f01b009ac60 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b48b9640 10 monclient: dump: 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.161 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 10 monclient: shutdown 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 -- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 msgr2=0x7f01b006cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 --2- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 0x7f01b006cfe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01a40098a0 tx=0x7f01a402ed80 comp rx=0 tx=0).stop 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 -- 10.20.193.51:0/2061788069 shutdown_connections 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 --2- 10.20.193.51:0/2061788069 >> v2:10.20.193.142:3300/0 conn(0x7f01b013b6f0 0x7f01b013dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 --2- 10.20.193.51:0/2061788069 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b009ac60 0x7f01b006cfe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 -- 10.20.193.51:0/2061788069 >> 10.20.193.51:0/2061788069 conn(0x7f01b00a6550 msgr2=0x7f01b00a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 -- 10.20.193.51:0/2061788069 shutdown_connections 2026-02-17T12:11:26.162 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.145+0000 7f01b7b46640 1 -- 10.20.193.51:0/2061788069 wait complete. 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient: monmap: 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.163 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 Processor -- start 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 -- start start 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient: init 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01b009ac60 0x7f01b0099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-a con 0x7f01b009ac60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01b009fce0 0x7f01b00902c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-b con 0x7f01b009fce0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 0x7f01b0090800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): picked mon.noname-c con 0x7f01b013b6f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f01b006d520 con 0x7f01b009ac60 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f01b009a5c0 con 0x7f01b009fce0 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f01b006d6a0 con 0x7f01b013b6f0 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b7b46640 10 monclient(hunting): authenticate will time out at 2173.765610s 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01b009ac60 0x7f01b0099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 0x7f01b0090800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 0x7f01b0090800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36982/0 (socket says 10.20.193.51:36982) 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 learned_addr learned my addr 10.20.193.51:0/4000680122 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): get_auth_request con 0x7f01b013b6f0 auth_method 0 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): get_auth_request con 0x7f01b009ac60 auth_method 0 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b58bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient(hunting): handle_auth_done global_id 304259 payload 824 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01b009fce0 msgr2=0x7f01b00902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f01b009fce0 0x7f01b00902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01b009ac60 msgr2=0x7f01b0099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f01b009ac60 0x7f01b0099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 monclient: found mon.noname-c 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.146+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b0093f20 con 0x7f01b013b6f0 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.148+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 msgr2=0x7f01b0090800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.148+0000 7f01b60bc640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 0x7f01b0090800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01ac007e10 tx=0x7f01ac00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac014620 con 0x7f01b013b6f0 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: dump: 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.168 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac019070 con 0x7f01b013b6f0 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 5 monclient: authenticate success, global_id 304259 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 10 monclient: _renew_subs 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b00923b0 con 0x7f01b013b6f0 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac014a20 con 0x7f01b013b6f0 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019ffff640 4 set_mon_vals no callback set 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 10 monclient: dump: 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.170 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 10 monclient: _renew_subs 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b00a1870 con 0x7f01b013b6f0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01b00a3cb0 con 0x7f01b013b6f0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.149+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f01ac01e460 con 0x7f01b013b6f0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f018003dd10 0x7f01800401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f01ac052e30 con 0x7f01b013b6f0 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7f0180043b80 0x7f0180045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01ac020e70 con 0x7f0180043b80 2026-02-17T12:11:26.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7f01ac055400 con 0x7f01b013b6f0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f019e7fc640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f01b50ba640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7f0180043b80 0x7f0180045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f01b58bb640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f018003dd10 0x7f01800401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f01b50ba640 10 monclient: get_auth_request con 0x7f0180043b80 auth_method 0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.150+0000 7f01b58bb640 10 monclient: get_auth_request con 0x7f018003dd10 auth_method 0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.152+0000 7f01b58bb640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f018003dd10 0x7f01800401d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007d90 tx=0x7f01a0007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.154+0000 7f01b50ba640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7f0180043b80 0x7f0180045fa0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.155+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== osd.0 v2:10.20.193.51:6808/3172594222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f01ac020e70 con 0x7f0180043b80 2026-02-17T12:11:26.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.160+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 --> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01b006c8d0 con 0x7f0180043b80 2026-02-17T12:11:26.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.160+0000 7f019e7fc640 1 -- 10.20.193.51:0/4000680122 <== osd.0 v2:10.20.193.51:6808/3172594222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01b006c8d0 con 0x7f0180043b80 2026-02-17T12:11:26.173 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:26.174 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:26.174 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:26.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7f0180043b80 msgr2=0x7f0180045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:6808/3172594222,v1:10.20.193.51:6809/3172594222] conn(0x7f0180043b80 0x7f0180045fa0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f018003dd10 msgr2=0x7f01800401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f018003dd10 0x7f01800401d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007d90 tx=0x7f01a0007ce0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 10 monclient: shutdown 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 msgr2=0x7f01b0090800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 --2- 10.20.193.51:0/4000680122 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f01b013b6f0 0x7f01b0090800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01ac007e10 tx=0x7f01ac00e4b0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b60bc640 1 -- 10.20.193.51:0/4000680122 reap_dead start 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 shutdown_connections 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 >> 10.20.193.51:0/4000680122 conn(0x7f01b00a6550 msgr2=0x7f01b013c960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 shutdown_connections 2026-02-17T12:11:26.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.161+0000 7f01b7b46640 1 -- 10.20.193.51:0/4000680122 wait complete. 2026-02-17T12:11:26.177 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.242+0000 7f7bf2f1b640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.242+0000 7f7bf2f1b640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.242+0000 7f7bf2f1b640 10 monclient: monmap: 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.244 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.243879+0000 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.243879+0000 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.245 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 Processor -- start 2026-02-17T12:11:26.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 -- start start 2026-02-17T12:11:26.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient: init 2026-02-17T12:11:26.254 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 0x7f7bec09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-c con 0x7f7bec0a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-b con 0x7f7bec09dac0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7bec09ff40 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec06e140 con 0x7f7bec09ff40 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7bec09aed0 con 0x7f7bec0a3bb0 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec09caa0 con 0x7f7bec09dac0 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf2f1b640 10 monclient(hunting): authenticate will time out at 2173.862772s 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36986/0 (socket says 10.20.193.51:36986) 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 1 -- 10.20.193.51:0/1531521687 learned_addr learned my addr 10.20.193.51:0/1531521687 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): get_auth_request con 0x7f7bec09dac0 auth_method 0 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 10 monclient(hunting): handle_auth_done global_id 304262 payload 274 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7be3fff640 1 -- 10.20.193.51:0/1531521687 >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 msgr2=0x7f7bec09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.243+0000 7f7bf0c90640 1 --2- 10.20.193.51:0/1531521687 >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 0x7f7bec09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 1 --2- 10.20.193.51:0/1531521687 >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 0x7f7bec09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 1 -- 10.20.193.51:0/1531521687 >> v1:10.20.193.142:6789/0 conn(0x7f7bec09ff40 legacy=0x7f7bec13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7be3fff640 1 -- 10.20.193.51:0/1531521687 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec09ce60 con 0x7f7bec09dac0 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7bf0c90640 10 monclient: get_auth_request con 0x7f7bec0a3bb0 auth_method 0 2026-02-17T12:11:26.257 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.244+0000 7f7bf0c90640 1 --2- 10.20.193.51:0/1531521687 >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 0x7f7bec09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be3fff640 1 -- 10.20.193.51:0/1531521687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 msgr2=0x7f7bec09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be3fff640 1 --2- 10.20.193.51:0/1531521687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009970 tx=0x7f7bd402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8837d1cbf080a1f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 1 -- 10.20.193.51:0/1531521687 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd403c070 con 0x7f7bec09dac0 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: dump: 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.258 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 1 -- 10.20.193.51:0/1531521687 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd402fdb0 con 0x7f7bec09dac0 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 5 monclient: authenticate success, global_id 304262 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 1 -- 10.20.193.51:0/1531521687 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4037660 con 0x7f7bec09dac0 2026-02-17T12:11:26.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 4 set_mon_vals no callback set 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7be37fe640 10 monclient: dump: 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.260 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 10 monclient: shutdown 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/1531521687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 msgr2=0x7f7bec09fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/1531521687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009970 tx=0x7f7bd402ee90 comp rx=0 tx=0).stop 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/1531521687 shutdown_connections 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/1531521687 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09dac0 0x7f7bec09fa00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/1531521687 >> v2:10.20.193.142:3300/0 conn(0x7f7bec0a3bb0 0x7f7bec09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/1531521687 >> 10.20.193.51:0/1531521687 conn(0x7f7bec0a30c0 msgr2=0x7f7bec0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.246+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/1531521687 shutdown_connections 2026-02-17T12:11:26.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/1531521687 wait complete. 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient: monmap: 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.262 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 Processor -- start 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 -- start start 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient: init 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bec09dac0 0x7f7bec0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-a con 0x7f7bec09dac0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-c con 0x7f7bec09ff40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bec0a3bb0 0x7f7bec08f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): picked mon.noname-b con 0x7f7bec0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0a0370 con 0x7f7bec09dac0 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec09a880 con 0x7f7bec0a3bb0 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec0a04f0 con 0x7f7bec09ff40 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf2f1b640 10 monclient(hunting): authenticate will time out at 2173.866933s 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7be3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.247+0000 7f7bf0c90640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bec09dac0 0x7f7bec0999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:36996/0 (socket says 10.20.193.51:36996) 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): get_auth_request con 0x7f7bec09dac0 auth_method 0 2026-02-17T12:11:26.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 -- 10.20.193.51:0/998748638 learned_addr learned my addr 10.20.193.51:0/998748638 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): get_auth_request con 0x7f7bec09ff40 auth_method 0 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf0c90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf1491640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bec0a3bb0 0x7f7bec08f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf1491640 10 monclient(hunting): get_auth_request con 0x7f7bec0a3bb0 auth_method 0 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf1491640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf1491640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7bf1491640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient(hunting): handle_auth_done global_id 304265 payload 824 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 -- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bec0a3bb0 msgr2=0x7f7bec08f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bec0a3bb0 0x7f7bec08f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 -- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bec09dac0 msgr2=0x7f7bec0999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bec09dac0 0x7f7bec0999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 monclient: found mon.noname-c 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.248+0000 7f7be3fff640 1 -- 10.20.193.51:0/998748638 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec1d00a0 con 0x7f7bec09ff40 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be3fff640 1 -- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 msgr2=0x7f7bec099f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be3fff640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009970 tx=0x7f7bd4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4046020 con 0x7f7bec09ff40 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: dump: 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.267 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd4037e10 con 0x7f7bec09ff40 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd403c040 con 0x7f7bec09ff40 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be17fa640 10 monclient: dump: 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.269 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7be2ffd640 4 set_mon_vals no callback set 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 5 monclient: authenticate success, global_id 304265 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _renew_subs 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec091610 con 0x7f7bec09ff40 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _renew_subs 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec093180 con 0x7f7bec09ff40 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.250+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec0a2130 con 0x7f7bec09ff40 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.251+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7bd403f030 con 0x7f7bec09ff40 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.251+0000 7f7be17fa640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 0x7f7bbc0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.251+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f7bd40773b0 con 0x7f7bec09ff40 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.251+0000 7f7bf0c90640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 0x7f7bbc0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.251+0000 7f7bf0c90640 10 monclient: get_auth_request con 0x7f7bbc03dd10 auth_method 0 2026-02-17T12:11:26.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.254+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7bd4050070 con 0x7f7bec09ff40 2026-02-17T12:11:26.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.254+0000 7f7be17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.254+0000 7f7be17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:26.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.254+0000 7f7bf0c90640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 0x7f7bbc0401d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00ac60 tx=0x7f7bdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.337+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f7bec0739b0 con 0x7f7bbc03dd10 2026-02-17T12:11:26.339 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.337+0000 7f7be17fa640 1 -- 10.20.193.51:0/998748638 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7bec0739b0 con 0x7f7bbc03dd10 2026-02-17T12:11:26.339 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 msgr2=0x7f7bbc0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 0x7f7bbc0401d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00ac60 tx=0x7f7bdc008040 comp rx=0 tx=0).stop 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 10 monclient: shutdown 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 msgr2=0x7f7bec099f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009970 tx=0x7f7bd4004830 comp rx=0 tx=0).stop 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 shutdown_connections 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7bbc03dd10 0x7f7bbc0401d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.341 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7bec0a3bb0 0x7f7bec08f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7bec09ff40 0x7f7bec099f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 --2- 10.20.193.51:0/998748638 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7bec09dac0 0x7f7bec0999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 >> 10.20.193.51:0/998748638 conn(0x7f7bec0a30c0 msgr2=0x7f7bec13bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 shutdown_connections 2026-02-17T12:11:26.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.338+0000 7f7bf2f1b640 1 -- 10.20.193.51:0/998748638 wait complete. 2026-02-17T12:11:26.348 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T12:11:26.348 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:26.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.419 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 10 monclient: monmap: 2026-02-17T12:11:26.419 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.418329+0000 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.418329+0000 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.420 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 1 Processor -- start 2026-02-17T12:11:26.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 1 -- start start 2026-02-17T12:11:26.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.417+0000 7f9bc37f7640 10 monclient: init 2026-02-17T12:11:26.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.431 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f9bbc0a3080 0x7f9bbc0a3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-c con 0x7f9bbc0a3080 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-b con 0x7f9bbc09be60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9bbc137e60 0x7f9bbc1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-a con 0x7f9bbc137e60 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9bbc06d9d0 con 0x7f9bbc137e60 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9bbc0a3ee0 con 0x7f9bbc0a3080 2026-02-17T12:11:26.432 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bbc09c900 con 0x7f9bbc09be60 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc37f7640 10 monclient(hunting): authenticate will time out at 2174.037416s 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9bbc137e60 0x7f9bbc1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37008/0 (socket says 10.20.193.51:37008) 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 -- 10.20.193.51:0/2396350166 learned_addr learned my addr 10.20.193.51:0/2396350166 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): get_auth_request con 0x7f9bbc09be60 auth_method 0 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.433 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): get_auth_request con 0x7f9bbc137e60 auth_method 0 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc156c640 1 --2- 10.20.193.51:0/2396350166 >> v2:10.20.193.142:3300/0 conn(0x7f9bbc0a3080 0x7f9bbc0a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.434 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc156c640 10 monclient(hunting): get_auth_request con 0x7f9bbc0a3080 auth_method 0 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc156c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc156c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc156c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient(hunting): handle_auth_done global_id 304268 payload 274 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 -- 10.20.193.51:0/2396350166 >> v2:10.20.193.142:3300/0 conn(0x7f9bbc0a3080 msgr2=0x7f9bbc0a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/2396350166 >> v2:10.20.193.142:3300/0 conn(0x7f9bbc0a3080 0x7f9bbc0a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 -- 10.20.193.51:0/2396350166 >> v2:10.20.193.51:3300/0 conn(0x7f9bbc137e60 msgr2=0x7f9bbc1382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/2396350166 >> v2:10.20.193.51:3300/0 conn(0x7f9bbc137e60 0x7f9bbc1382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.435 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.418+0000 7f9bc0d6b640 1 -- 10.20.193.51:0/2396350166 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc06dc10 con 0x7f9bbc09be60 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc0d6b640 1 -- 10.20.193.51:0/2396350166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 msgr2=0x7f9bbc0a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/2396350166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0a8700 tx=0x7f9bb002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35bfee344060731c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 1 -- 10.20.193.51:0/2396350166 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb003c070 con 0x7f9bbc09be60 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: dump: 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.436 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 1 -- 10.20.193.51:0/2396350166 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb002fca0 con 0x7f9bbc09be60 2026-02-17T12:11:26.437 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 5 monclient: authenticate success, global_id 304268 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 1 -- 10.20.193.51:0/2396350166 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0037660 con 0x7f9bbc09be60 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9babfff640 10 monclient: dump: 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.438 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 4 set_mon_vals no callback set 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 10 monclient: shutdown 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 -- 10.20.193.51:0/2396350166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 msgr2=0x7f9bbc0a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/2396350166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0a8700 tx=0x7f9bb002ee60 comp rx=0 tx=0).stop 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 -- 10.20.193.51:0/2396350166 shutdown_connections 2026-02-17T12:11:26.439 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/2396350166 >> v2:10.20.193.51:3300/0 conn(0x7f9bbc137e60 0x7f9bbc1382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/2396350166 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc09be60 0x7f9bbc0a39a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/2396350166 >> v2:10.20.193.142:3300/0 conn(0x7f9bbc0a3080 0x7f9bbc0a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 -- 10.20.193.51:0/2396350166 >> 10.20.193.51:0/2396350166 conn(0x7f9bbc06ed20 msgr2=0x7f9bbc06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 -- 10.20.193.51:0/2396350166 shutdown_connections 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.421+0000 7f9bc37f7640 1 -- 10.20.193.51:0/2396350166 wait complete. 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient: monmap: 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.440 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 Processor -- start 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 -- start start 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient: init 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 0x7f9bbc1cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.441 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-a con 0x7f9bbc09be60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bbc0a3080 0x7f9bbc1248c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-b con 0x7f9bbc0a3080 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 0x7f9bbc124e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): picked mon.noname-c con 0x7f9bbc137e60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc074cc0 con 0x7f9bbc09be60 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc09c620 con 0x7f9bbc0a3080 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9bbc074e40 con 0x7f9bbc137e60 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc37f7640 10 monclient(hunting): authenticate will time out at 2174.041682s 2026-02-17T12:11:26.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 0x7f9bbc1cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 0x7f9bbc124e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 0x7f9bbc1cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56824/0 (socket says 10.20.193.51:56824) 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 0x7f9bbc124e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37016/0 (socket says 10.20.193.51:37016) 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 -- 10.20.193.51:0/1586817385 learned_addr learned my addr 10.20.193.51:0/1586817385 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): get_auth_request con 0x7f9bbc09be60 auth_method 0 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): get_auth_request con 0x7f9bbc137e60 auth_method 0 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bbc0a3080 0x7f9bbc1248c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc0d6b640 10 monclient(hunting): get_auth_request con 0x7f9bbc0a3080 auth_method 0 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc0d6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc0d6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc0d6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.444 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient(hunting): handle_auth_done global_id 274548 payload 824 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 msgr2=0x7f9bbc124e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 0x7f9bbc124e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bbc0a3080 msgr2=0x7f9bbc1248c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9bbc0a3080 0x7f9bbc1248c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 monclient: found mon.noname-a 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc156c640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc1270c0 con 0x7f9bbc09be60 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.422+0000 7f9bc1d6d640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9bbc137e60 0x7f9bbc124e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc156c640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 msgr2=0x7f9bbc1cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.445 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc156c640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 0x7f9bbc1cf670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e7f0 tx=0x7f9bac00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bac017070 con 0x7f9bbc09be60 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: dump: 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.446 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bac00cae0 con 0x7f9bbc09be60 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9bbc09be60 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 5 monclient: authenticate success, global_id 274548 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bab7fe640 4 set_mon_vals no callback set 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 10 monclient: _renew_subs 2026-02-17T12:11:26.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bbc0a0f90 con 0x7f9bbc09be60 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9ba9ffb640 10 monclient: dump: 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.448 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 10 monclient: _renew_subs 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bbc128570 con 0x7f9bbc09be60 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.425+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bbc1389b0 con 0x7f9bbc09be60 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9bac012050 con 0x7f9bbc09be60 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b8c03dd10 0x7f9b8c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f9bac0522a0 con 0x7f9bbc09be60 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f9b8c043b80 0x7f9b8c045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b8c046650 con 0x7f9b8c043b80 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7f9bac059050 con 0x7f9bbc09be60 2026-02-17T12:11:26.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9ba9ffb640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:26.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b8c03dd10 0x7f9b8c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9bc1d6d640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f9b8c043b80 0x7f9b8c045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9bc1d6d640 10 monclient: get_auth_request con 0x7f9b8c043b80 auth_method 0 2026-02-17T12:11:26.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.426+0000 7f9bc0d6b640 10 monclient: get_auth_request con 0x7f9b8c03dd10 auth_method 0 2026-02-17T12:11:26.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.429+0000 7f9bc0d6b640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b8c03dd10 0x7f9b8c0401d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.430+0000 7f9bc1d6d640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f9b8c043b80 0x7f9b8c045fa0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.431+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== osd.1 v2:10.20.193.51:6800/2218006344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9b8c046650 con 0x7f9b8c043b80 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 --> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9bbc129250 con 0x7f9b8c043b80 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9ba9ffb640 1 -- 10.20.193.51:0/1586817385 <== osd.1 v2:10.20.193.51:6800/2218006344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9bbc129250 con 0x7f9b8c043b80 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:26.451 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:26.452 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f9b8c043b80 msgr2=0x7f9b8c045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:6800/2218006344,v1:10.20.193.51:6801/2218006344] conn(0x7f9b8c043b80 0x7f9b8c045fa0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b8c03dd10 msgr2=0x7f9b8c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9b8c03dd10 0x7f9b8c0401d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0039040 comp rx=0 tx=0).stop 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 10 monclient: shutdown 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 msgr2=0x7f9bbc1cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc37f7640 1 --2- 10.20.193.51:0/1586817385 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9bbc09be60 0x7f9bbc1cf670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e7f0 tx=0x7f9bac00ecc0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.453 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.437+0000 7f9bc1d6d640 1 -- 10.20.193.51:0/1586817385 reap_dead start 2026-02-17T12:11:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.438+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 shutdown_connections 2026-02-17T12:11:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.438+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 >> 10.20.193.51:0/1586817385 conn(0x7f9bbc06ed20 msgr2=0x7f9bbc09f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.438+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 shutdown_connections 2026-02-17T12:11:26.454 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.438+0000 7f9bc37f7640 1 -- 10.20.193.51:0/1586817385 wait complete. 2026-02-17T12:11:26.454 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T12:11:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.519+0000 7f9f63a91640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.519+0000 7f9f63a91640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.524 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.519+0000 7f9f63a91640 10 monclient: monmap: 2026-02-17T12:11:26.524 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.524 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.520920+0000 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.520920+0000 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.525 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 Processor -- start 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 -- start start 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient: init 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 0x7f9f5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-a con 0x7f9f5c0a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9f5c0a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-b con 0x7f9f5c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.526 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f5c06e140 con 0x7f9f5c0a0750 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c09f910 con 0x7f9f5c0a3bb0 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c09ccd0 con 0x7f9f5c13b760 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f63a91640 10 monclient(hunting): authenticate will time out at 2174.139672s 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 0x7f9f5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 0x7f9f5c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56830/0 (socket says 10.20.193.51:56830) 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 1 -- 10.20.193.51:0/1458170649 learned_addr learned my addr 10.20.193.51:0/1458170649 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): get_auth_request con 0x7f9f5c0a3bb0 auth_method 0 2026-02-17T12:11:26.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): get_auth_request con 0x7f9f5c13b760 auth_method 0 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.528 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient(hunting): handle_auth_done global_id 304274 payload 274 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 -- 10.20.193.51:0/1458170649 >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 msgr2=0x7f9f5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 --2- 10.20.193.51:0/1458170649 >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 0x7f9f5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 -- 10.20.193.51:0/1458170649 >> v1:10.20.193.142:6789/0 conn(0x7f9f5c0a0750 legacy=0x7f9f5c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.520+0000 7f9f62007640 1 -- 10.20.193.51:0/1458170649 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c09eec0 con 0x7f9f5c13b760 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f62007640 1 -- 10.20.193.51:0/1458170649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 msgr2=0x7f9f5c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f62007640 1 --2- 10.20.193.51:0/1458170649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c13db50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06c1c0 tx=0x7f9f5802f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb88fe2c6fad9fa1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 1 -- 10.20.193.51:0/1458170649 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5803c070 con 0x7f9f5c13b760 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.536 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: dump: 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.537 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 1 -- 10.20.193.51:0/1458170649 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58037440 con 0x7f9f5c13b760 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 5 monclient: authenticate success, global_id 304274 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 1 -- 10.20.193.51:0/1458170649 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58037810 con 0x7f9f5c13b760 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 4 set_mon_vals no callback set 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f60804640 10 monclient: dump: 2026-02-17T12:11:26.538 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 10 monclient: shutdown 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.539 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 -- 10.20.193.51:0/1458170649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 msgr2=0x7f9f5c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1458170649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c13db50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06c1c0 tx=0x7f9f5802f130 comp rx=0 tx=0).stop 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 -- 10.20.193.51:0/1458170649 shutdown_connections 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1458170649 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c13db50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1458170649 >> v2:10.20.193.51:3300/0 conn(0x7f9f5c0a3bb0 0x7f9f5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.523+0000 7f9f63a91640 1 -- 10.20.193.51:0/1458170649 >> 10.20.193.51:0/1458170649 conn(0x7f9f5c0a30c0 msgr2=0x7f9f5c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- 10.20.193.51:0/1458170649 shutdown_connections 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- 10.20.193.51:0/1458170649 wait complete. 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient: monmap: 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.540 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 Processor -- start 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- start start 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient: init 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f5c0a0750 0x7f9f5c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-a con 0x7f9f5c0a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f5c0a3bb0 0x7f9f5c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-b con 0x7f9f5c0a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): picked mon.noname-c con 0x7f9f5c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0a04b0 con 0x7f9f5c0a0750 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c09c850 con 0x7f9f5c0a3bb0 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c09e710 con 0x7f9f5c13b760 2026-02-17T12:11:26.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f63a91640 10 monclient(hunting): authenticate will time out at 2174.143839s 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f5c0a0750 0x7f9f5c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37026/0 (socket says 10.20.193.51:37026) 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 1 -- 10.20.193.51:0/1899446179 learned_addr learned my addr 10.20.193.51:0/1899446179 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): get_auth_request con 0x7f9f5c13b760 auth_method 0 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): get_auth_request con 0x7f9f5c0a0750 auth_method 0 2026-02-17T12:11:26.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f62007640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.524+0000 7f9f61806640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f61005640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f5c0a3bb0 0x7f9f5c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f61005640 10 monclient(hunting): get_auth_request con 0x7f9f5c0a3bb0 auth_method 0 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f61005640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f61005640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f61005640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 10 monclient(hunting): handle_auth_done global_id 304277 payload 824 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 -- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f5c0a3bb0 msgr2=0x7f9f5c1d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f5c0a3bb0 0x7f9f5c1d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 -- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f5c0a0750 msgr2=0x7f9f5c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f5c0a0750 0x7f9f5c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 monclient: found mon.noname-c 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.525+0000 7f9f62007640 1 -- 10.20.193.51:0/1899446179 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c099f70 con 0x7f9f5c13b760 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f62007640 1 -- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 msgr2=0x7f9f5c096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f62007640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f5803a040 tx=0x7f9f58004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5803c050 con 0x7f9f5c13b760 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: dump: 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.546 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58048070 con 0x7f9f5c13b760 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 5 monclient: authenticate success, global_id 304277 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _renew_subs 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c098400 con 0x7f9f5c13b760 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58041a50 con 0x7f9f5c13b760 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4bfff640 4 set_mon_vals no callback set 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f4a7fc640 10 monclient: dump: 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _renew_subs 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c0a2500 con 0x7f9f5c13b760 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.527+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c09d7b0 con 0x7f9f5c13b760 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.528+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f9f58041bf0 con 0x7f9f5c13b760 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.528+0000 7f9f4a7fc640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 0x7f9f2c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.528+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f9f580782c0 con 0x7f9f5c13b760 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.528+0000 7f9f61806640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 0x7f9f2c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.528+0000 7f9f61806640 10 monclient: get_auth_request con 0x7f9f2c03dd10 auth_method 0 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.530+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f58035d80 con 0x7f9f5c13b760 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.530+0000 7f9f4a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.530+0000 7f9f4a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:26.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.530+0000 7f9f61806640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 0x7f9f2c0401d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c006dc0 tx=0x7f9f4c009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.613+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9f5c0a2e30 con 0x7f9f2c03dd10 2026-02-17T12:11:26.615 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.613+0000 7f9f4a7fc640 1 -- 10.20.193.51:0/1899446179 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9f5c0a2e30 con 0x7f9f2c03dd10 2026-02-17T12:11:26.615 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T12:11:26.616 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 msgr2=0x7f9f2c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 0x7f9f2c0401d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c006dc0 tx=0x7f9f4c009340 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 10 monclient: shutdown 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 msgr2=0x7f9f5c096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f5803a040 tx=0x7f9f58004b40 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 shutdown_connections 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f9f2c03dd10 0x7f9f2c0401d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f9f5c13b760 0x7f9f5c096300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f9f5c0a3bb0 0x7f9f5c1d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 --2- 10.20.193.51:0/1899446179 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f9f5c0a0750 0x7f9f5c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 >> 10.20.193.51:0/1899446179 conn(0x7f9f5c0a30c0 msgr2=0x7f9f5c13ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.617 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 shutdown_connections 2026-02-17T12:11:26.618 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.614+0000 7f9f63a91640 1 -- 10.20.193.51:0/1899446179 wait complete. 2026-02-17T12:11:26.623 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T12:11:26.623 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.691+0000 7f00418e8640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.691+0000 7f00418e8640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.691+0000 7f00418e8640 10 monclient: monmap: 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.696 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.692731+0000 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.692731+0000 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 Processor -- start 2026-02-17T12:11:26.697 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 -- start start 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient: init 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-b con 0x7f003c09fce0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 0x7f003c06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-a con 0x7f003c09ac60 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f003c06d350 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c09bcc0 con 0x7f003c06d350 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.698 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f003c0a00c0 con 0x7f003c09ac60 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f003c09b420 con 0x7f003c09fce0 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f00418e8640 10 monclient(hunting): authenticate will time out at 2174.311515s 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 0x7f003c06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37032/0 (socket says 10.20.193.51:37032) 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 0x7f003c06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56836/0 (socket says 10.20.193.51:56836) 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 -- 10.20.193.51:0/4268199678 learned_addr learned my addr 10.20.193.51:0/4268199678 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): get_auth_request con 0x7f003c09fce0 auth_method 0 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.699 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): get_auth_request con 0x7f003c09ac60 auth_method 0 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.700 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient(hunting): handle_auth_done global_id 304280 payload 274 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 -- 10.20.193.51:0/4268199678 >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 msgr2=0x7f003c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 --2- 10.20.193.51:0/4268199678 >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 0x7f003c06ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 -- 10.20.193.51:0/4268199678 >> v1:10.20.193.51:6789/0 conn(0x7f003c06d350 legacy=0x7f003c13c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.701 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.692+0000 7f003affd640 1 -- 10.20.193.51:0/4268199678 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0a0980 con 0x7f003c09fce0 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f003affd640 1 -- 10.20.193.51:0/4268199678 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 msgr2=0x7f003c06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f003affd640 1 --2- 10.20.193.51:0/4268199678 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0030009970 tx=0x7f003002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43faa142e733274 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 1 -- 10.20.193.51:0/4268199678 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003003c070 con 0x7f003c09fce0 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: dump: 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.709 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 5 monclient: authenticate success, global_id 304280 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 1 -- 10.20.193.51:0/4268199678 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003002fcd0 con 0x7f003c09fce0 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:26.710 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 1 -- 10.20.193.51:0/4268199678 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030037660 con 0x7f003c09fce0 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 4 set_mon_vals no callback set 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f0039ffb640 10 monclient: dump: 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.711 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 10 monclient: shutdown 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 -- 10.20.193.51:0/4268199678 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 msgr2=0x7f003c06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 --2- 10.20.193.51:0/4268199678 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0030009970 tx=0x7f003002ee90 comp rx=0 tx=0).stop 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 -- 10.20.193.51:0/4268199678 shutdown_connections 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 --2- 10.20.193.51:0/4268199678 >> v2:10.20.193.51:3300/0 conn(0x7f003c09ac60 0x7f003c06ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 --2- 10.20.193.51:0/4268199678 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c06c8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.712 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 -- 10.20.193.51:0/4268199678 >> 10.20.193.51:0/4268199678 conn(0x7f003c0a6550 msgr2=0x7f003c0a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 -- 10.20.193.51:0/4268199678 shutdown_connections 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.695+0000 7f00418e8640 1 -- 10.20.193.51:0/4268199678 wait complete. 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient: monmap: 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.713 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 Processor -- start 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 -- start start 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient: init 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f003c06d350 0x7f003c137940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-b con 0x7f003c06d350 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 0x7f003c137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-a con 0x7f003c09ac60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.714 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c12b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): picked mon.noname-c con 0x7f003c09fce0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f003c09a5c0 con 0x7f003c09ac60 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0a06e0 con 0x7f003c06d350 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f003c13de10 con 0x7f003c09fce0 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f00418e8640 10 monclient(hunting): authenticate will time out at 2174.315886s 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 0x7f003c137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c12b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 0x7f003c137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56838/0 (socket says 10.20.193.51:56838) 2026-02-17T12:11:26.715 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 1 -- 10.20.193.51:0/2234459470 learned_addr learned my addr 10.20.193.51:0/2234459470 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): get_auth_request con 0x7f003c09ac60 auth_method 0 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): get_auth_request con 0x7f003c09fce0 auth_method 0 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.716 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.696+0000 7f003b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003affd640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f003c06d350 0x7f003c137940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 10 monclient(hunting): handle_auth_done global_id 274560 payload 824 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 msgr2=0x7f003c12b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f003c09fce0 0x7f003c12b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f003c06d350 msgr2=0x7f003c137940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f003c06d350 0x7f003c137940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 monclient: found mon.noname-a 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.717 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003a7fc640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c12f0e0 con 0x7f003c09ac60 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003affd640 10 monclient: get_auth_request con 0x7f003c06d350 auth_method 0 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.697+0000 7f003affd640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f003c06d350 0x7f003c137940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f003a7fc640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 msgr2=0x7f003c137e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f003a7fc640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 0x7f003c137e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f002400ebe0 tx=0x7f002400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024017070 con 0x7f003c09ac60 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: dump: 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.718 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002400cdf0 con 0x7f003c09ac60 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024013690 con 0x7f003c09ac60 2026-02-17T12:11:26.719 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 5 monclient: authenticate success, global_id 274560 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 10 monclient: _renew_subs 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00397fa640 4 set_mon_vals no callback set 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c12f3c0 con 0x7f003c09ac60 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f0013fff640 10 monclient: dump: 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.720 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 10 monclient: _renew_subs 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c09d740 con 0x7f003c09ac60 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.699+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f003c074200 con 0x7f003c09ac60 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f0024024060 con 0x7f003c09ac60 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f000c03dd10 0x7f000c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.721 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f0024052560 con 0x7f003c09ac60 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f000c043b10 0x7f000c045f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f000c0465e0 con 0x7f000c043b10 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7f0024059050 con 0x7f003c09ac60 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f0013fff640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f003b7fe640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f000c043b10 0x7f000c045f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f003b7fe640 10 monclient: get_auth_request con 0x7f000c043b10 auth_method 0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f003affd640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f000c03dd10 0x7f000c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.700+0000 7f003affd640 10 monclient: get_auth_request con 0x7f000c03dd10 auth_method 0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.703+0000 7f003affd640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f000c03dd10 0x7f000c0401d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f003c0a0f00 tx=0x7f0030033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.704+0000 7f003b7fe640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f000c043b10 0x7f000c045f30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.722 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.705+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== osd.2 v2:10.20.193.51:6816/1100885920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f000c0465e0 con 0x7f000c043b10 2026-02-17T12:11:26.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 --> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f003c06c8d0 con 0x7f000c043b10 2026-02-17T12:11:26.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f0013fff640 1 -- 10.20.193.51:0/2234459470 <== osd.2 v2:10.20.193.51:6816/1100885920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f003c06c8d0 con 0x7f000c043b10 2026-02-17T12:11:26.724 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:26.724 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:26.724 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f000c043b10 msgr2=0x7f000c045f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:6816/1100885920,v1:10.20.193.51:6817/1100885920] conn(0x7f000c043b10 0x7f000c045f30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f000c03dd10 msgr2=0x7f000c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f000c03dd10 0x7f000c0401d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f003c0a0f00 tx=0x7f0030033000 comp rx=0 tx=0).stop 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 10 monclient: shutdown 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 msgr2=0x7f003c137e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 --2- 10.20.193.51:0/2234459470 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f003c09ac60 0x7f003c137e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f002400ebe0 tx=0x7f002400c520 comp rx=0 tx=0).stop 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f003b7fe640 1 -- 10.20.193.51:0/2234459470 reap_dead start 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 shutdown_connections 2026-02-17T12:11:26.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 >> 10.20.193.51:0/2234459470 conn(0x7f003c0a6550 msgr2=0x7f003c0a1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 shutdown_connections 2026-02-17T12:11:26.727 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.711+0000 7f00418e8640 1 -- 10.20.193.51:0/2234459470 wait complete. 2026-02-17T12:11:26.727 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 10 monclient: monmap: 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.797 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.794342+0000 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.794342+0000 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 1 Processor -- start 2026-02-17T12:11:26.798 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 1 -- start start 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.793+0000 7fe17a3bc640 10 monclient: init 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe1740a3bb0 0x7fe17409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-c con 0x7fe1740a3bb0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe1740a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe17413b760 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17406e140 con 0x7fe17413b760 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17409f910 con 0x7fe1740a0750 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.799 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe17409ccd0 con 0x7fe1740a3bb0 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe17a3bc640 10 monclient(hunting): authenticate will time out at 2174.413129s 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe178932640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe17413b760 0x7fe17413db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37952/0 (socket says 10.20.193.51:37952) 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe178932640 1 -- 10.20.193.51:0/2136648744 learned_addr learned my addr 10.20.193.51:0/2136648744 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 1 --2- 10.20.193.51:0/2136648744 >> v2:10.20.193.142:3300/0 conn(0x7fe1740a3bb0 0x7fe17409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): get_auth_request con 0x7fe1740a3bb0 auth_method 0 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.800 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient(hunting): handle_auth_done global_id 314137 payload 274 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 1 -- 10.20.193.51:0/2136648744 >> v1:10.20.193.142:6789/0 conn(0x7fe1740a0750 legacy=0x7fe17409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 1 -- 10.20.193.51:0/2136648744 >> v1:10.20.193.51:6789/0 conn(0x7fe17413b760 legacy=0x7fe17413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 1 monclient: found mon.noname-c 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:11:26.801 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.794+0000 7fe173fff640 1 -- 10.20.193.51:0/2136648744 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17409eec0 con 0x7fe1740a3bb0 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe173fff640 1 -- 10.20.193.51:0/2136648744 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 msgr2=0x7fe17409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe173fff640 1 --2- 10.20.193.51:0/2136648744 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe17409dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe16002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cde778eef7e84aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 1 -- 10.20.193.51:0/2136648744 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16003c070 con 0x7fe1740a3bb0 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: dump: 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.809 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.810 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 5 monclient: authenticate success, global_id 314137 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 1 -- 10.20.193.51:0/2136648744 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16002fce0 con 0x7fe1740a3bb0 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 1 -- 10.20.193.51:0/2136648744 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160037660 con 0x7fe1740a3bb0 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 4 set_mon_vals no callback set 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe172ffd640 10 monclient: dump: 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.811 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 10 monclient: shutdown 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 -- 10.20.193.51:0/2136648744 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 msgr2=0x7fe17409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/2136648744 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe17409dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe16002ed80 comp rx=0 tx=0).stop 2026-02-17T12:11:26.812 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 -- 10.20.193.51:0/2136648744 shutdown_connections 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/2136648744 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe17409dac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 -- 10.20.193.51:0/2136648744 >> 10.20.193.51:0/2136648744 conn(0x7fe1740a30c0 msgr2=0x7fe1740a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 -- 10.20.193.51:0/2136648744 shutdown_connections 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.797+0000 7fe17a3bc640 1 -- 10.20.193.51:0/2136648744 wait complete. 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient: monmap: 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.813 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 Processor -- start 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 -- start start 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient: init 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.814 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-a con 0x7fe1740a0750 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe1741cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-b con 0x7fe1740a3bb0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe17413b760 0x7fe174090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): picked mon.noname-c con 0x7fe17413b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe1740a04b0 con 0x7fe1740a0750 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe17409c850 con 0x7fe1740a3bb0 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe17409e710 con 0x7fe17413b760 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe17a3bc640 10 monclient(hunting): authenticate will time out at 2174.417816s 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56840/0 (socket says 10.20.193.51:56840) 2026-02-17T12:11:26.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 1 -- 10.20.193.51:0/775063582 learned_addr learned my addr 10.20.193.51:0/775063582 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): get_auth_request con 0x7fe1740a0750 auth_method 0 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe17413b760 0x7fe174090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): get_auth_request con 0x7fe17413b760 auth_method 0 2026-02-17T12:11:26.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe173fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.798+0000 7fe178932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe178932640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe1737fe640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe1741cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe1737fe640 10 monclient(hunting): get_auth_request con 0x7fe1740a3bb0 auth_method 0 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe1737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe1737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe1737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 10 monclient(hunting): handle_auth_done global_id 274563 payload 824 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 -- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe17413b760 msgr2=0x7fe174090dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe17413b760 0x7fe174090dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 -- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 msgr2=0x7fe1741cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe1741cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 monclient: found mon.noname-a 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.799+0000 7fe173fff640 1 -- 10.20.193.51:0/775063582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174094600 con 0x7fe1740a0750 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe173fff640 1 -- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 msgr2=0x7fe1741cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe173fff640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe1600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160046070 con 0x7fe1740a0750 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: dump: 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 5 monclient: authenticate success, global_id 274563 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160041870 con 0x7fe1740a0750 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 monclient: _renew_subs 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1740948e0 con 0x7fe1740a0750 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16003c040 con 0x7fe1740a0750 2026-02-17T12:11:26.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe1727fc640 4 set_mon_vals no callback set 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe170ff9640 10 monclient: dump: 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.822 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 monclient: _renew_subs 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17409d7b0 con 0x7fe1740a0750 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.801+0000 7fe17a3bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe17a3bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1740a2490 con 0x7fe1740a0750 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe160041c60 con 0x7fe1740a0750 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe170ff9640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 0x7fe1440401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7fe160077d10 con 0x7fe1740a0750 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe1737fe640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 0x7fe1440401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.802+0000 7fe1737fe640 10 monclient: get_auth_request con 0x7fe14403dd10 auth_method 0 2026-02-17T12:11:26.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.804+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe160037e10 con 0x7fe1740a0750 2026-02-17T12:11:26.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.804+0000 7fe170ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:26.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.804+0000 7fe170ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:26.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.805+0000 7fe1737fe640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 0x7fe1440401d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe17413a050 tx=0x7fe164009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.890+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe17409dac0 con 0x7fe14403dd10 2026-02-17T12:11:26.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.890+0000 7fe170ff9640 1 -- 10.20.193.51:0/775063582 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe17409dac0 con 0x7fe14403dd10 2026-02-17T12:11:26.892 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 msgr2=0x7fe1440401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 0x7fe1440401d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe17413a050 tx=0x7fe164009040 comp rx=0 tx=0).stop 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 10 monclient: shutdown 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 msgr2=0x7fe1741cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe1600047c0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 shutdown_connections 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe14403dd10 0x7fe1440401d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.894 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe17413b760 0x7fe174090dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe1740a3bb0 0x7fe1741cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 --2- 10.20.193.51:0/775063582 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe1740a0750 0x7fe1741cdab0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 >> 10.20.193.51:0/775063582 conn(0x7fe1740a30c0 msgr2=0x7fe17413ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 shutdown_connections 2026-02-17T12:11:26.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.891+0000 7fe17a3bc640 1 -- 10.20.193.51:0/775063582 wait complete. 2026-02-17T12:11:26.900 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T12:11:26.901 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: get_monmap_and_config 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: monmap: 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:26.970224+0000 2026-02-17T12:11:26.974 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:26.970224+0000 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 Processor -- start 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 -- start start 2026-02-17T12:11:26.975 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: init 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fb40409fce0 0x7fb40406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-c con 0x7fb40409fce0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb40409ac60 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-b con 0x7fb40413b6f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb40409bcc0 con 0x7fb40409ac60 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb4040a00c0 con 0x7fb40409fce0 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.969+0000 7fb40aab7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.976 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40aab7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb40409b420 con 0x7fb40413b6f0 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40aab7640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40aab7640 10 monclient(hunting): authenticate will time out at 2174.589007s 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37062/0 (socket says 10.20.193.51:37062) 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 -- 10.20.193.51:0/3752906468 learned_addr learned my addr 10.20.193.51:0/3752906468 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): get_auth_request con 0x7fb40413b6f0 auth_method 0 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 1 --2- 10.20.193.51:0/3752906468 >> v2:10.20.193.142:3300/0 conn(0x7fb40409fce0 0x7fb40406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): get_auth_request con 0x7fb40409fce0 auth_method 0 2026-02-17T12:11:26.977 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient(hunting): handle_auth_done global_id 304289 payload 274 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 -- 10.20.193.51:0/3752906468 >> v2:10.20.193.142:3300/0 conn(0x7fb40409fce0 msgr2=0x7fb40406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 --2- 10.20.193.51:0/3752906468 >> v2:10.20.193.142:3300/0 conn(0x7fb40409fce0 0x7fb40406c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.978 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 -- 10.20.193.51:0/3752906468 >> v1:10.20.193.142:6789/0 conn(0x7fb40409ac60 legacy=0x7fb40406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 monclient: found mon.noname-b 2026-02-17T12:11:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.979 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.970+0000 7fb40902d640 1 -- 10.20.193.51:0/3752906468 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4040a0980 con 0x7fb40413b6f0 2026-02-17T12:11:26.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40902d640 1 -- 10.20.193.51:0/3752906468 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 msgr2=0x7fb40413dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40902d640 1 --2- 10.20.193.51:0/3752906468 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb400009e50 tx=0x7fb40002f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac0d653216aa9420 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 1 -- 10.20.193.51:0/3752906468 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000373f0 con 0x7fb40413b6f0 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: dump: 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.987 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 1 -- 10.20.193.51:0/3752906468 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400037590 con 0x7fb40413b6f0 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40aab7640 5 monclient: authenticate success, global_id 304289 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40aab7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40aab7640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 1 -- 10.20.193.51:0/3752906468 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400037960 con 0x7fb40413b6f0 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb40aab7640 4 set_mon_vals no callback set 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.972+0000 7fb3fb7fe640 10 monclient: dump: 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.989 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 10 monclient: shutdown 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- 10.20.193.51:0/3752906468 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 msgr2=0x7fb40413dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 --2- 10.20.193.51:0/3752906468 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb400009e50 tx=0x7fb40002f260 comp rx=0 tx=0).stop 2026-02-17T12:11:26.990 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- 10.20.193.51:0/3752906468 shutdown_connections 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 --2- 10.20.193.51:0/3752906468 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40413b6f0 0x7fb40413dae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 --2- 10.20.193.51:0/3752906468 >> v2:10.20.193.142:3300/0 conn(0x7fb40409fce0 0x7fb40406c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- 10.20.193.51:0/3752906468 >> 10.20.193.51:0/3752906468 conn(0x7fb4040a6550 msgr2=0x7fb4040a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- 10.20.193.51:0/3752906468 shutdown_connections 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- 10.20.193.51:0/3752906468 wait complete. 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 10 monclient: build_initial_monmap 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 10 monclient: monmap: 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:26.991 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 Processor -- start 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 1 -- start start 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.973+0000 7fb40aab7640 10 monclient: init 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 0x7fb404099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.992 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-c con 0x7fb40409ac60 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb40409fce0 0x7fb40409da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-a con 0x7fb40409fce0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb40413b6f0 0x7fb40409dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): picked mon.noname-b con 0x7fb40413b6f0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fb40409a5c0 con 0x7fb40409fce0 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb4040a06e0 con 0x7fb40413b6f0 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fb40406d520 con 0x7fb40409ac60 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:26.993 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40aab7640 10 monclient(hunting): authenticate will time out at 2174.593239s 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 0x7fb404099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb40409fce0 0x7fb40409da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 0x7fb404099fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37068/0 (socket says 10.20.193.51:37068) 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 -- 10.20.193.51:0/1308473844 learned_addr learned my addr 10.20.193.51:0/1308473844 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): get_auth_request con 0x7fb40409ac60 auth_method 0 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): get_auth_request con 0x7fb40409fce0 auth_method 0 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:26.994 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb3fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient(hunting): handle_auth_done global_id 304292 payload 824 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb40413b6f0 msgr2=0x7fb40409dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40902d640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb40413b6f0 0x7fb40409dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb40413b6f0 0x7fb40409dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb40409fce0 msgr2=0x7fb40409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:26.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fb40409fce0 0x7fb40409da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient: _finish_hunting 0 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 monclient: found mon.noname-c 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40882c640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404098070 con 0x7fb40409ac60 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40902d640 10 monclient: get_auth_request con 0x7fb40413b6f0 auth_method 0 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.974+0000 7fb40902d640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fb40413b6f0 0x7fb40409dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40882c640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 msgr2=0x7fb404099fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40882c640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 0x7fb404099fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400ebe0 tx=0x7fb3f400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4017070 con 0x7fb40409ac60 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:26.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: dump: 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: _finish_auth 0 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: _check_auth_tickets 2026-02-17T12:11:26.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f400ce50 con 0x7fb40409ac60 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 5 monclient: authenticate success, global_id 304292 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 10 monclient: _renew_subs 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb404097610 con 0x7fb40409ac60 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40136b0 con 0x7fb40409ac60 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3faffd640 4 set_mon_vals no callback set 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb3f97fa640 10 monclient: dump: 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:26.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 10 monclient: _renew_subs 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.976+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb404097d90 con 0x7fb40409ac60 2026-02-17T12:11:26.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb40aab7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb40406c8d0 con 0x7fb40409ac60 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fb3f4024060 con 0x7fb40409ac60 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb3d403dd10 0x7fb3d40401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7fb3f4052620 con 0x7fb40409ac60 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7fb3d4043b80 0x7fb3d4045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3f400ae50 con 0x7fb3d4043b80 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7fb3f4059050 con 0x7fb40409ac60 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3f97fa640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3fbfff640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb3d403dd10 0x7fb3d40401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.977+0000 7fb3fbfff640 10 monclient: get_auth_request con 0x7fb3d403dd10 auth_method 0 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.978+0000 7fb40902d640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7fb3d4043b80 0x7fb3d4045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.978+0000 7fb40902d640 10 monclient: get_auth_request con 0x7fb3d4043b80 auth_method 0 2026-02-17T12:11:27.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.980+0000 7fb3fbfff640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb3d403dd10 0x7fb3d40401d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb40413a840 tx=0x7fb3ec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.983+0000 7fb40902d640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7fb3d4043b80 0x7fb3d4045fa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.983+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== osd.3 v2:10.20.193.142:6802/3494201988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb3f400ae50 con 0x7fb3d4043b80 2026-02-17T12:11:27.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.989+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 --> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb404073e90 con 0x7fb3d4043b80 2026-02-17T12:11:27.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb3f97fa640 1 -- 10.20.193.51:0/1308473844 <== osd.3 v2:10.20.193.142:6802/3494201988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb404073e90 con 0x7fb3d4043b80 2026-02-17T12:11:27.002 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:27.002 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:27.002 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7fb3d4043b80 msgr2=0x7fb3d4045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6802/3494201988,v1:10.20.193.142:6803/3494201988] conn(0x7fb3d4043b80 0x7fb3d4045fa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb3d403dd10 msgr2=0x7fb3d40401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fb3d403dd10 0x7fb3d40401d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb40413a840 tx=0x7fb3ec009190 comp rx=0 tx=0).stop 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 10 monclient: shutdown 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 msgr2=0x7fb404099fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 --2- 10.20.193.51:0/1308473844 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fb40409ac60 0x7fb404099fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400ebe0 tx=0x7fb3f400c520 comp rx=0 tx=0).stop 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40902d640 1 -- 10.20.193.51:0/1308473844 reap_dead start 2026-02-17T12:11:27.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 shutdown_connections 2026-02-17T12:11:27.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 >> 10.20.193.51:0/1308473844 conn(0x7fb4040a6550 msgr2=0x7fb404072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 shutdown_connections 2026-02-17T12:11:27.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:26.990+0000 7fb40aab7640 1 -- 10.20.193.51:0/1308473844 wait complete. 2026-02-17T12:11:27.005 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T12:11:27.074 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.072+0000 7fe9076fd640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.072+0000 7fe9076fd640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.072+0000 7fe9076fd640 10 monclient: monmap: 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.073606+0000 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.073606+0000 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.075 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 Processor -- start 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 -- start start 2026-02-17T12:11:27.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient: init 2026-02-17T12:11:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2026-02-17T12:11:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fe900138490 0x7fe900138870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-c con 0x7fe900138490 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:27.084 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe900138db0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe9000a3680 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9000a4c10 con 0x7fe900138db0 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9000a4e50 con 0x7fe9000a3680 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe9000707b0 con 0x7fe900138490 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9076fd640 10 monclient(hunting): authenticate will time out at 2174.692418s 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe905efa640 1 --1- >> v1:10.20.193.51:6789/0 conn(0x7fe900138db0 0x7fe9000a2f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.51:6789/0 says I am v1:10.20.193.51:37966/0 (socket says 10.20.193.51:37966) 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe905efa640 1 -- 10.20.193.51:0/334639785 learned_addr learned my addr 10.20.193.51:0/334639785 (peer_addr_for_me v1:10.20.193.51:0/0) 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 1 --2- 10.20.193.51:0/334639785 >> v2:10.20.193.142:3300/0 conn(0x7fe900138490 0x7fe900138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): get_auth_request con 0x7fe900138490 auth_method 0 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.085 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient(hunting): handle_auth_done global_id 314146 payload 274 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 1 -- 10.20.193.51:0/334639785 >> v1:10.20.193.142:6789/0 conn(0x7fe9000a3680 legacy=0x7fe9000a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 1 -- 10.20.193.51:0/334639785 >> v1:10.20.193.51:6789/0 conn(0x7fe900138db0 legacy=0x7fe9000a2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 1 monclient: found mon.noname-c 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.142:3300/0 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.073+0000 7fe9066fb640 1 -- 10.20.193.51:0/334639785 --> v2:10.20.193.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90006fe80 con 0x7fe900138490 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9066fb640 1 -- 10.20.193.51:0/334639785 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138490 msgr2=0x7fe900138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.086 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9066fb640 1 --2- 10.20.193.51:0/334639785 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138490 0x7fe900138870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80098a0 tx=0x7fe8f802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f3f7b05c48b6e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 1 -- 10.20.193.51:0/334639785 <== mon.1 v2:10.20.193.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f803c070 con 0x7fe900138490 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: dump: 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.087 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9076fd640 5 monclient: authenticate success, global_id 314146 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9076fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 1 -- 10.20.193.51:0/334639785 <== mon.1 v2:10.20.193.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f802fce0 con 0x7fe900138490 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9076fd640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9076fd640 4 set_mon_vals no callback set 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 1 -- 10.20.193.51:0/334639785 <== mon.1 v2:10.20.193.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8037660 con 0x7fe900138490 2026-02-17T12:11:27.088 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.076+0000 7fe9056f9640 10 monclient: dump: 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.089 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: shutdown 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- 10.20.193.51:0/334639785 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138490 msgr2=0x7fe900138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 --2- 10.20.193.51:0/334639785 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138490 0x7fe900138870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80098a0 tx=0x7fe8f802ed80 comp rx=0 tx=0).stop 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- 10.20.193.51:0/334639785 shutdown_connections 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 --2- 10.20.193.51:0/334639785 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138490 0x7fe900138870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- 10.20.193.51:0/334639785 >> 10.20.193.51:0/334639785 conn(0x7fe9000a8570 msgr2=0x7fe9000a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- 10.20.193.51:0/334639785 shutdown_connections 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- 10.20.193.51:0/334639785 wait complete. 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: monmap: 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.090 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 Processor -- start 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 -- start start 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: init 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.091 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-a con 0x7fe9000a3680 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe900138490 0x7fe9001cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-c con 0x7fe900138490 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 0x7fe900124950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.077+0000 7fe9076fd640 10 monclient(hunting): picked mon.noname-b con 0x7fe900138db0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fe900074f50 con 0x7fe9000a3680 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe90009caa0 con 0x7fe900138db0 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fe9000750d0 con 0x7fe900138490 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9076fd640 10 monclient(hunting): authenticate will time out at 2174.697009s 2026-02-17T12:11:27.092 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe900138490 0x7fe9001cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56852/0 (socket says 10.20.193.51:56852) 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 -- 10.20.193.51:0/113797325 learned_addr learned my addr 10.20.193.51:0/113797325 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): get_auth_request con 0x7fe9000a3680 auth_method 0 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): get_auth_request con 0x7fe900138490 auth_method 0 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.093 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 0x7fe900124950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe905efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 10 monclient(hunting): get_auth_request con 0x7fe900138db0 auth_method 0 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient(hunting): handle_auth_done global_id 274569 payload 824 2026-02-17T12:11:27.094 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 -- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe900138490 msgr2=0x7fe9001cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe900138490 0x7fe9001cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 -- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 msgr2=0x7fe900124950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 0x7fe900124950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe9066fb640 1 -- 10.20.193.51:0/113797325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9001288e0 con 0x7fe9000a3680 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.078+0000 7fe906efc640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 0x7fe900124950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9066fb640 1 -- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 msgr2=0x7fe9001cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9066fb640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8002410 tx=0x7fe8f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.095 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f803c040 con 0x7fe9000a3680 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: dump: 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.096 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f8047070 con 0x7fe9000a3680 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 5 monclient: authenticate success, global_id 274569 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8040a40 con 0x7fe9000a3680 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe904ef8640 4 set_mon_vals no callback set 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe8eaffd640 10 monclient: dump: 2026-02-17T12:11:27.097 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 10 monclient: _renew_subs 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90009e0a0 con 0x7fe9000a3680 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 10 monclient: _renew_subs 2026-02-17T12:11:27.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.080+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe900128320 con 0x7fe9000a3680 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fe8f803f030 con 0x7fe9000a3680 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe9076fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe9076fd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe9076fd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9000a4320 con 0x7fe9000a3680 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe8eaffd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 0x7fe8d00401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7fe8f8077800 con 0x7fe9000a3680 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe905efa640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 0x7fe8d00401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.081+0000 7fe905efa640 10 monclient: get_auth_request con 0x7fe8d003dd10 auth_method 0 2026-02-17T12:11:27.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.083+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe8f80763b0 con 0x7fe9000a3680 2026-02-17T12:11:27.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.083+0000 7fe8eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.083+0000 7fe8eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:27.100 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.084+0000 7fe905efa640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 0x7fe8d00401d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007d90 tx=0x7fe8ec007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.167+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe900127150 con 0x7fe8d003dd10 2026-02-17T12:11:27.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.167+0000 7fe8eaffd640 1 -- 10.20.193.51:0/113797325 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe900127150 con 0x7fe8d003dd10 2026-02-17T12:11:27.170 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 msgr2=0x7fe8d00401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 0x7fe8d00401d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007d90 tx=0x7fe8ec007ce0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 10 monclient: shutdown 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 msgr2=0x7fe9001cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8002410 tx=0x7fe8f80047c0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 shutdown_connections 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fe8d003dd10 0x7fe8d00401d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fe900138db0 0x7fe900124950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fe900138490 0x7fe9001cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 --2- 10.20.193.51:0/113797325 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fe9000a3680 0x7fe9001cf5b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 >> 10.20.193.51:0/113797325 conn(0x7fe9000a8570 msgr2=0x7fe9000a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 shutdown_connections 2026-02-17T12:11:27.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.168+0000 7fe9076fd640 1 -- 10.20.193.51:0/113797325 wait complete. 2026-02-17T12:11:27.178 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T12:11:27.179 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: monmap: 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.249 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.248120+0000 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.248120+0000 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.250 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 1 Processor -- start 2026-02-17T12:11:27.259 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 1 -- start start 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: init 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7fd28c138470 0x7fd28c0a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.247+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-c con 0x7fd28c138470 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd28c06cb40 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd28c13d360 0x7fd28c13f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-a con 0x7fd28c13d360 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c138f60 con 0x7fd28c06cb40 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c06d580 con 0x7fd28c13d360 2026-02-17T12:11:27.260 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c0a22c0 con 0x7fd28c138470 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd293f7e640 10 monclient(hunting): authenticate will time out at 2174.867042s 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd28c13d360 0x7fd28c13f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7fd28c13d360 0x7fd28c13f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56864/0 (socket says 10.20.193.51:56864) 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 -- 10.20.193.51:0/1648360415 learned_addr learned my addr 10.20.193.51:0/1648360415 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): get_auth_request con 0x7fd28c13d360 auth_method 0 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.261 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd291cf3640 1 --2- 10.20.193.51:0/1648360415 >> v2:10.20.193.142:3300/0 conn(0x7fd28c138470 0x7fd28c0a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd291cf3640 10 monclient(hunting): get_auth_request con 0x7fd28c138470 auth_method 0 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd291cf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd291cf3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd291cf3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient(hunting): handle_auth_done global_id 274572 payload 274 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 -- 10.20.193.51:0/1648360415 >> v2:10.20.193.142:3300/0 conn(0x7fd28c138470 msgr2=0x7fd28c0a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 --2- 10.20.193.51:0/1648360415 >> v2:10.20.193.142:3300/0 conn(0x7fd28c138470 0x7fd28c0a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 -- 10.20.193.51:0/1648360415 >> v1:10.20.193.142:6789/0 conn(0x7fd28c06cb40 legacy=0x7fd28c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.262 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.248+0000 7fd2924f4640 1 -- 10.20.193.51:0/1648360415 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0a1fe0 con 0x7fd28c13d360 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd2924f4640 1 -- 10.20.193.51:0/1648360415 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 msgr2=0x7fd28c13f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd2924f4640 1 --2- 10.20.193.51:0/1648360415 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c13f750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0a73a0 tx=0x7fd28802f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0ca58a5e60262c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 1 -- 10.20.193.51:0/1648360415 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2880373f0 con 0x7fd28c13d360 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: dump: 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.263 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd293f7e640 5 monclient: authenticate success, global_id 274572 2026-02-17T12:11:27.264 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 1 -- 10.20.193.51:0/1648360415 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd288037590 con 0x7fd28c13d360 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd293f7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 1 -- 10.20.193.51:0/1648360415 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288037960 con 0x7fd28c13d360 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd293f7e640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd293f7e640 4 set_mon_vals no callback set 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.250+0000 7fd290cf1640 10 monclient: dump: 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.265 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 10 monclient: shutdown 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 -- 10.20.193.51:0/1648360415 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 msgr2=0x7fd28c13f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 --2- 10.20.193.51:0/1648360415 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c13f750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0a73a0 tx=0x7fd28802f260 comp rx=0 tx=0).stop 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 -- 10.20.193.51:0/1648360415 shutdown_connections 2026-02-17T12:11:27.266 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 --2- 10.20.193.51:0/1648360415 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c13f750 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 --2- 10.20.193.51:0/1648360415 >> v2:10.20.193.142:3300/0 conn(0x7fd28c138470 0x7fd28c0a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 -- 10.20.193.51:0/1648360415 >> 10.20.193.51:0/1648360415 conn(0x7fd28c0aa960 msgr2=0x7fd28c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 -- 10.20.193.51:0/1648360415 shutdown_connections 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 1 -- 10.20.193.51:0/1648360415 wait complete. 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.251+0000 7fd293f7e640 10 monclient: monmap: 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.267 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 Processor -- start 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 -- start start 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient: init 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd28c06cb40 0x7fd28c1cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-c con 0x7fd28c06cb40 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd28c138470 0x7fd28c137310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-b con 0x7fd28c138470 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): picked mon.noname-a con 0x7fd28c13d360 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c13fc90 con 0x7fd28c13d360 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c06cf50 con 0x7fd28c138470 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c13fe10 con 0x7fd28c06cb40 2026-02-17T12:11:27.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd293f7e640 10 monclient(hunting): authenticate will time out at 2174.871367s 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd28c06cb40 0x7fd28c1cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd28c06cb40 0x7fd28c1cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37092/0 (socket says 10.20.193.51:37092) 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 1 -- 10.20.193.51:0/2486689724 learned_addr learned my addr 10.20.193.51:0/2486689724 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): get_auth_request con 0x7fd28c06cb40 auth_method 0 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): get_auth_request con 0x7fd28c13d360 auth_method 0 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.270 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd291cf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient(hunting): handle_auth_done global_id 274575 payload 824 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd28c06cb40 msgr2=0x7fd28c1cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.271 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7fd28c06cb40 0x7fd28c1cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd28c138470 msgr2=0x7fd28c137310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7fd28c138470 0x7fd28c137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.272 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.252+0000 7fd2924f4640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c1cfd10 con 0x7fd28c13d360 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd2924f4640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 msgr2=0x7fd28c071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd2924f4640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c071a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd288035000 tx=0x7fd288004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288003a90 con 0x7fd28c13d360 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: dump: 2026-02-17T12:11:27.273 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.274 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd288003c50 con 0x7fd28c13d360 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 5 monclient: authenticate success, global_id 274575 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288041870 con 0x7fd28c13d360 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27a7fc640 10 monclient: dump: 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.275 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd27bfff640 4 set_mon_vals no callback set 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 10 monclient: _renew_subs 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c1219c0 con 0x7fd28c13d360 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 10 monclient: _renew_subs 2026-02-17T12:11:27.276 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.254+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c13f7f0 con 0x7fd28c13d360 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd293f7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd28c0a1b50 con 0x7fd28c13d360 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7fd288053060 con 0x7fd28c13d360 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 0x7fd25c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7fd288078300 con 0x7fd28c13d360 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd25c043b80 0x7fd25c045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd288037590 con 0x7fd25c043b80 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7fd28807f050 con 0x7fd28c13d360 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd27a7fc640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.255+0000 7fd291cf3640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 0x7fd25c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.277 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd291cf3640 10 monclient: get_auth_request con 0x7fd25c03dd10 auth_method 0 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd291cf3640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 msgr2=0x7fd25c0401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd291cf3640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 msgr2=0x7fd25c0401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd291cf3640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 0x7fd25c0401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd291cf3640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 0x7fd25c0401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd2914f2640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd25c043b80 0x7fd25c045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.278 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.256+0000 7fd2914f2640 10 monclient: get_auth_request con 0x7fd25c043b80 auth_method 0 2026-02-17T12:11:27.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.261+0000 7fd2914f2640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd25c043b80 0x7fd25c045fa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.261+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== osd.4 v2:10.20.193.142:6810/4031350650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd288037590 con 0x7fd25c043b80 2026-02-17T12:11:27.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.267+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 --> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd28c0a29c0 con 0x7fd25c043b80 2026-02-17T12:11:27.279 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.267+0000 7fd27a7fc640 1 -- 10.20.193.51:0/2486689724 <== osd.4 v2:10.20.193.142:6810/4031350650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd28c0a29c0 con 0x7fd25c043b80 2026-02-17T12:11:27.280 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:27.280 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:27.280 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd25c043b80 msgr2=0x7fd25c045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6810/4031350650,v1:10.20.193.142:6811/4031350650] conn(0x7fd25c043b80 0x7fd25c045fa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 msgr2=0x7fd25c0401d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7fd25c03dd10 0x7fd25c0401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 10 monclient: shutdown 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 msgr2=0x7fd28c071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 --2- 10.20.193.51:0/2486689724 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7fd28c13d360 0x7fd28c071a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd288035000 tx=0x7fd288004b40 comp rx=0 tx=0).stop 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd2924f4640 1 -- 10.20.193.51:0/2486689724 reap_dead start 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 shutdown_connections 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 >> 10.20.193.51:0/2486689724 conn(0x7fd28c0aa960 msgr2=0x7fd28c0a2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.282 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 shutdown_connections 2026-02-17T12:11:27.283 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.268+0000 7fd293f7e640 1 -- 10.20.193.51:0/2486689724 wait complete. 2026-02-17T12:11:27.283 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: monmap: 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.348182+0000 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.348182+0000 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.349 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 Processor -- start 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 -- start start 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: init 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 0x7f7e8409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-a con 0x7f7e840a3bb0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7e8409dac0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e8413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-b con 0x7f7e840a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8406e140 con 0x7f7e8409dac0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8409aed0 con 0x7f7e840a3bb0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8409caa0 con 0x7f7e840a0110 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e89698640 10 monclient(hunting): authenticate will time out at 2174.966916s 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.347+0000 7f7e82ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 0x7f7e8409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 0x7f7e8409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56876/0 (socket says 10.20.193.51:56876) 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 1 -- 10.20.193.51:0/3597038659 learned_addr learned my addr 10.20.193.51:0/3597038659 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 10 monclient(hunting): get_auth_request con 0x7f7e840a3bb0 auth_method 0 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.350 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e8413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): get_auth_request con 0x7f7e840a0110 auth_method 0 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient(hunting): handle_auth_done global_id 304301 payload 274 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 -- 10.20.193.51:0/3597038659 >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 msgr2=0x7f7e8409f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3597038659 >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 0x7f7e8409f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 -- 10.20.193.51:0/3597038659 >> v1:10.20.193.51:6789/0 conn(0x7f7e8409dac0 legacy=0x7f7e8409fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 monclient: found mon.noname-b 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:27.351 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.348+0000 7f7e837fe640 1 -- 10.20.193.51:0/3597038659 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8409ce60 con 0x7f7e840a0110 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e837fe640 1 -- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 msgr2=0x7f7e8413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e8413c760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009d90 tx=0x7f7e7402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab7e361f2838f72 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 1 -- 10.20.193.51:0/3597038659 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7403c070 con 0x7f7e840a0110 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:27.352 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: dump: 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 1 -- 10.20.193.51:0/3597038659 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e74037440 con 0x7f7e840a0110 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e89698640 5 monclient: authenticate success, global_id 304301 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e89698640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 1 -- 10.20.193.51:0/3597038659 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74037810 con 0x7f7e840a0110 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e81ffb640 10 monclient: dump: 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e89698640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.350+0000 7f7e89698640 4 set_mon_vals no callback set 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 10 monclient: shutdown 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.353 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 msgr2=0x7f7e8413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 --2- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e8413c760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009d90 tx=0x7f7e7402f190 comp rx=0 tx=0).stop 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- 10.20.193.51:0/3597038659 shutdown_connections 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 --2- 10.20.193.51:0/3597038659 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e8413c760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 --2- 10.20.193.51:0/3597038659 >> v2:10.20.193.51:3300/0 conn(0x7f7e840a3bb0 0x7f7e8409f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- 10.20.193.51:0/3597038659 >> 10.20.193.51:0/3597038659 conn(0x7f7e840a30c0 msgr2=0x7f7e840a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- 10.20.193.51:0/3597038659 shutdown_connections 2026-02-17T12:11:27.354 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- 10.20.193.51:0/3597038659 wait complete. 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 10 monclient: monmap: 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 Processor -- start 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 1 -- start start 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.351+0000 7f7e89698640 10 monclient: init 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e8409dac0 0x7f7e841ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-b con 0x7f7e8409dac0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-c con 0x7f7e840a0110 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 0x7f7e84099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): picked mon.noname-a con 0x7f7e840a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8409a880 con 0x7f7e840a3bb0 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7e840a0540 con 0x7f7e8409dac0 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8413cca0 con 0x7f7e840a0110 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e89698640 10 monclient(hunting): authenticate will time out at 2174.971197s 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 0x7f7e84099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.355 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37098/0 (socket says 10.20.193.51:37098) 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 1 -- 10.20.193.51:0/3323457348 learned_addr learned my addr 10.20.193.51:0/3323457348 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): get_auth_request con 0x7f7e840a3bb0 auth_method 0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): get_auth_request con 0x7f7e840a0110 auth_method 0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e82ffd640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e8409dac0 0x7f7e841ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e82ffd640 10 monclient(hunting): get_auth_request con 0x7f7e8409dac0 auth_method 0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient(hunting): handle_auth_done global_id 274581 payload 824 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 -- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 msgr2=0x7f7e84099780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 -- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e8409dac0 msgr2=0x7f7e841ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e8409dac0 0x7f7e841ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e837fe640 1 -- 10.20.193.51:0/3323457348 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e84093f30 con 0x7f7e840a3bb0 2026-02-17T12:11:27.356 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.352+0000 7f7e827fc640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e837fe640 1 -- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 msgr2=0x7f7e84099cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e837fe640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 0x7f7e84099cc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e74036000 tx=0x7f7e74004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7403c050 con 0x7f7e840a3bb0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: dump: 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e74048070 con 0x7f7e840a3bb0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74041c60 con 0x7f7e840a3bb0 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 5 monclient: authenticate success, global_id 274581 2026-02-17T12:11:27.357 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 10 monclient: _renew_subs 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e817fa640 4 set_mon_vals no callback set 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841cd270 con 0x7f7e840a3bb0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e637fe640 10 monclient: dump: 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 10 monclient: _renew_subs 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.354+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8409e4c0 con 0x7f7e840a3bb0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e89698640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e89698640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e89698640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8409f4c0 con 0x7f7e840a3bb0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f7e7404d460 con 0x7f7e840a3bb0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e637fe640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 0x7f7e500401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.355+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f7e74078270 con 0x7f7e840a3bb0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.356+0000 7f7e82ffd640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 0x7f7e500401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.358 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.356+0000 7f7e82ffd640 10 monclient: get_auth_request con 0x7f7e5003dd10 auth_method 0 2026-02-17T12:11:27.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.358+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7e74042cd0 con 0x7f7e840a3bb0 2026-02-17T12:11:27.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.358+0000 7f7e637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.359 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.358+0000 7f7e637fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:27.360 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.358+0000 7f7e82ffd640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 0x7f7e500401d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7e78006fd0 tx=0x7f7e78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.447 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.445+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7e84092ba0 con 0x7f7e5003dd10 2026-02-17T12:11:27.448 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.445+0000 7f7e637fe640 1 -- 10.20.193.51:0/3323457348 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e78009880 con 0x7f7e5003dd10 2026-02-17T12:11:27.448 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T12:11:27.449 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 msgr2=0x7f7e500401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 0x7f7e500401d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7e78006fd0 tx=0x7f7e78008040 comp rx=0 tx=0).stop 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 10 monclient: shutdown 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 msgr2=0x7f7e84099cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 0x7f7e84099cc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e74036000 tx=0x7f7e74004b40 comp rx=0 tx=0).stop 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 shutdown_connections 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f7e5003dd10 0x7f7e500401d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f7e840a3bb0 0x7f7e84099cc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f7e840a0110 0x7f7e84099780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.450 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 --2- 10.20.193.51:0/3323457348 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f7e8409dac0 0x7f7e841ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 >> 10.20.193.51:0/3323457348 conn(0x7f7e840a30c0 msgr2=0x7f7e8406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 shutdown_connections 2026-02-17T12:11:27.451 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.447+0000 7f7e89698640 1 -- 10.20.193.51:0/3323457348 wait complete. 2026-02-17T12:11:27.457 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T12:11:27.457 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:11:27.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.527 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 10 monclient: monmap: 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.523306+0000 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.523306+0000 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.528 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 1 Processor -- start 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 1 -- start start 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.522+0000 7effa9887640 10 monclient: init 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7effa409fce0 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7effa409ac60 0x7effa406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): picked mon.noname-c con 0x7effa409ac60 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:27.529 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7effa413b6f0 0x7effa413dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): picked mon.noname-a con 0x7effa413b6f0 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa409bcc0 con 0x7effa409fce0 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7effa40a00c0 con 0x7effa413b6f0 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7effa409b420 con 0x7effa409ac60 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa9887640 10 monclient(hunting): authenticate will time out at 2175.142108s 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7effa413b6f0 0x7effa413dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7effa413b6f0 0x7effa413dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56894/0 (socket says 10.20.193.51:56894) 2026-02-17T12:11:27.530 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 -- 10.20.193.51:0/2764811807 learned_addr learned my addr 10.20.193.51:0/2764811807 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): get_auth_request con 0x7effa413b6f0 auth_method 0 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa27fc640 1 --2- 10.20.193.51:0/2764811807 >> v2:10.20.193.142:3300/0 conn(0x7effa409ac60 0x7effa406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa27fc640 10 monclient(hunting): get_auth_request con 0x7effa409ac60 auth_method 0 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.531 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient(hunting): handle_auth_done global_id 274584 payload 274 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 -- 10.20.193.51:0/2764811807 >> v2:10.20.193.142:3300/0 conn(0x7effa409ac60 msgr2=0x7effa406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 --2- 10.20.193.51:0/2764811807 >> v2:10.20.193.142:3300/0 conn(0x7effa409ac60 0x7effa406cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 -- 10.20.193.51:0/2764811807 >> v1:10.20.193.142:6789/0 conn(0x7effa409fce0 legacy=0x7effa406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.532 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.523+0000 7effa37fe640 1 -- 10.20.193.51:0/2764811807 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa40a0980 con 0x7effa413b6f0 2026-02-17T12:11:27.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.525+0000 7effa37fe640 1 -- 10.20.193.51:0/2764811807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa413b6f0 msgr2=0x7effa413dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.525+0000 7effa37fe640 1 --2- 10.20.193.51:0/2764811807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa413b6f0 0x7effa413dae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7effa40743f0 tx=0x7eff9402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22ff4420bde2bb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.540 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 1 -- 10.20.193.51:0/2764811807 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940373f0 con 0x7effa413b6f0 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: dump: 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.541 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 1 -- 10.20.193.51:0/2764811807 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94037590 con 0x7effa413b6f0 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 5 monclient: authenticate success, global_id 274584 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:27.542 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 1 -- 10.20.193.51:0/2764811807 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94037960 con 0x7effa413b6f0 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa1ffb640 10 monclient: dump: 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.543 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 4 set_mon_vals no callback set 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 10 monclient: shutdown 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 -- 10.20.193.51:0/2764811807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa413b6f0 msgr2=0x7effa413dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 --2- 10.20.193.51:0/2764811807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa413b6f0 0x7effa413dae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7effa40743f0 tx=0x7eff9402f260 comp rx=0 tx=0).stop 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 -- 10.20.193.51:0/2764811807 shutdown_connections 2026-02-17T12:11:27.544 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 --2- 10.20.193.51:0/2764811807 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa413b6f0 0x7effa413dae0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 --2- 10.20.193.51:0/2764811807 >> v2:10.20.193.142:3300/0 conn(0x7effa409ac60 0x7effa406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 -- 10.20.193.51:0/2764811807 >> 10.20.193.51:0/2764811807 conn(0x7effa40a6550 msgr2=0x7effa40a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 -- 10.20.193.51:0/2764811807 shutdown_connections 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 1 -- 10.20.193.51:0/2764811807 wait complete. 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.526+0000 7effa9887640 10 monclient: monmap: 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.545 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 Processor -- start 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 -- start start 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient: init 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.546 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 0x7effa409da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): picked mon.noname-a con 0x7effa409ac60 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7effa409fce0 0x7effa409df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): picked mon.noname-b con 0x7effa409fce0 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7effa413b6f0 0x7effa409e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): picked mon.noname-c con 0x7effa413b6f0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7effa409a5c0 con 0x7effa409ac60 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7effa40a06e0 con 0x7effa409fce0 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.547 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7effa406d520 con 0x7effa413b6f0 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa9887640 10 monclient(hunting): authenticate will time out at 2175.146412s 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 0x7effa409da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 0x7effa409da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56898/0 (socket says 10.20.193.51:56898) 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 -- 10.20.193.51:0/3705818861 learned_addr learned my addr 10.20.193.51:0/3705818861 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): get_auth_request con 0x7effa409ac60 auth_method 0 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7effa413b6f0 0x7effa409e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.548 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): get_auth_request con 0x7effa413b6f0 auth_method 0 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa27fc640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7effa409fce0 0x7effa409df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa27fc640 10 monclient(hunting): get_auth_request con 0x7effa409fce0 auth_method 0 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.549 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient(hunting): handle_auth_done global_id 274587 payload 824 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7effa413b6f0 msgr2=0x7effa409e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7effa413b6f0 0x7effa409e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7effa409fce0 msgr2=0x7effa409df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7effa409fce0 0x7effa409df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa2ffd640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa406f460 con 0x7effa409ac60 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.527+0000 7effa37fe640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7effa413b6f0 0x7effa409e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:11:27.550 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa2ffd640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 msgr2=0x7effa409da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa2ffd640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 0x7effa409da50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c5d0 tx=0x7eff9800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98016020 con 0x7effa409ac60 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: dump: 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.551 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff98012a60 con 0x7effa409ac60 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa9887640 5 monclient: authenticate success, global_id 274587 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa9887640 10 monclient: _renew_subs 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa9887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa409d740 con 0x7effa409ac60 2026-02-17T12:11:27.552 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98012e50 con 0x7effa409ac60 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7eff7bfff640 10 monclient: dump: 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.553 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.529+0000 7effa17fa640 4 set_mon_vals no callback set 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7effa9887640 10 monclient: _renew_subs 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7effa9887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa4133c50 con 0x7effa409ac60 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7effa9887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effa406c8d0 con 0x7effa409ac60 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.530+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7eff9801b400 con 0x7effa409ac60 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7eff7403deb0 0x7eff74040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7eff980524a0 con 0x7effa409ac60 2026-02-17T12:11:27.554 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7eff74043cb0 0x7eff740460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff9801eeb0 con 0x7eff74043cb0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=933) ==== 24+0+0 (secure 0 0 0) 0x7eff98059050 con 0x7effa409ac60 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7eff7bfff640 10 monclient: handle_get_version_reply finishing 1 version 933 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7effa27fc640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7eff7403deb0 0x7eff74040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7effa27fc640 10 monclient: get_auth_request con 0x7eff7403deb0 auth_method 0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7effa37fe640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7eff74043cb0 0x7eff740460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.531+0000 7effa37fe640 10 monclient: get_auth_request con 0x7eff74043cb0 auth_method 0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.533+0000 7effa27fc640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7eff7403deb0 0x7eff74040370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effa409c250 tx=0x7eff8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.535+0000 7effa37fe640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7eff74043cb0 0x7eff740460d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.555 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.536+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== osd.5 v2:10.20.193.142:6818/1680143311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7eff9801eeb0 con 0x7eff74043cb0 2026-02-17T12:11:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 --> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7effa4132550 con 0x7eff74043cb0 2026-02-17T12:11:27.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7eff7bfff640 1 -- 10.20.193.51:0/3705818861 <== osd.5 v2:10.20.193.142:6818/1680143311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7effa4132550 con 0x7eff74043cb0 2026-02-17T12:11:27.557 INFO:teuthology.orchestra.run.trial051.stdout:{ 2026-02-17T12:11:27.557 INFO:teuthology.orchestra.run.trial051.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:11:27.557 INFO:teuthology.orchestra.run.trial051.stdout:} 2026-02-17T12:11:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7eff74043cb0 msgr2=0x7eff740460d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6818/1680143311,v1:10.20.193.142:6819/1680143311] conn(0x7eff74043cb0 0x7eff740460d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7eff7403deb0 msgr2=0x7eff74040370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7eff7403deb0 0x7eff74040370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effa409c250 tx=0x7eff8c008040 comp rx=0 tx=0).stop 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 10 monclient: shutdown 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 msgr2=0x7effa409da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 --2- 10.20.193.51:0/3705818861 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7effa409ac60 0x7effa409da50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c5d0 tx=0x7eff9800caa0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa37fe640 1 -- 10.20.193.51:0/3705818861 reap_dead start 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 shutdown_connections 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 >> 10.20.193.51:0/3705818861 conn(0x7effa40a6550 msgr2=0x7effa4138980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 shutdown_connections 2026-02-17T12:11:27.559 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.543+0000 7effa9887640 1 -- 10.20.193.51:0/3705818861 wait complete. 2026-02-17T12:11:27.560 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T12:11:27.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.624+0000 7ff342f14640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.624+0000 7ff342f14640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.626 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.624+0000 7ff342f14640 10 monclient: monmap: 2026-02-17T12:11:27.626 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.626 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.625630+0000 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.625630+0000 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.627 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 Processor -- start 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 -- start start 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient: init 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-b con 0x7ff33c0a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff33c0a0750 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 0x7ff33c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.636 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-a con 0x7ff33c13b760 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c06e140 con 0x7ff33c0a0750 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c09f910 con 0x7ff33c13b760 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c09ccd0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff342f14640 10 monclient(hunting): authenticate will time out at 2175.244413s 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 0x7ff33c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 0x7ff33c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56914/0 (socket says 10.20.193.51:56914) 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37112/0 (socket says 10.20.193.51:37112) 2026-02-17T12:11:27.637 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 1 -- 10.20.193.51:0/1978861445 learned_addr learned my addr 10.20.193.51:0/1978861445 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): get_auth_request con 0x7ff33c13b760 auth_method 0 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): get_auth_request con 0x7ff33c0a3bb0 auth_method 0 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.638 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient(hunting): handle_auth_done global_id 304310 payload 274 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 -- 10.20.193.51:0/1978861445 >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 msgr2=0x7ff33c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 --2- 10.20.193.51:0/1978861445 >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 0x7ff33c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 -- 10.20.193.51:0/1978861445 >> v1:10.20.193.51:6789/0 conn(0x7ff33c0a0750 legacy=0x7ff33c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 monclient: found mon.noname-b 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.625+0000 7ff340c89640 1 -- 10.20.193.51:0/1978861445 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c09eec0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.639 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff340c89640 1 -- 10.20.193.51:0/1978861445 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 msgr2=0x7ff33c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff340c89640 1 --2- 10.20.193.51:0/1978861445 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff33c09f230 tx=0x7ff32c02ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a204d4014df778b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 1 -- 10.20.193.51:0/1978861445 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c03c070 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: dump: 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.640 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 5 monclient: authenticate success, global_id 304310 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 1 -- 10.20.193.51:0/1978861445 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c02fbf0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 1 -- 10.20.193.51:0/1978861445 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c037440 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.641 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff3337fe640 10 monclient: dump: 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.642 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 4 set_mon_vals no callback set 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 10 monclient: shutdown 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 -- 10.20.193.51:0/1978861445 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 msgr2=0x7ff33c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 --2- 10.20.193.51:0/1978861445 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff33c09f230 tx=0x7ff32c02ed70 comp rx=0 tx=0).stop 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 -- 10.20.193.51:0/1978861445 shutdown_connections 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 --2- 10.20.193.51:0/1978861445 >> v2:10.20.193.51:3300/0 conn(0x7ff33c13b760 0x7ff33c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 --2- 10.20.193.51:0/1978861445 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c0a3bb0 0x7ff33c09dac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 -- 10.20.193.51:0/1978861445 >> 10.20.193.51:0/1978861445 conn(0x7ff33c0a30c0 msgr2=0x7ff33c0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 -- 10.20.193.51:0/1978861445 shutdown_connections 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.628+0000 7ff342f14640 1 -- 10.20.193.51:0/1978861445 wait complete. 2026-02-17T12:11:27.643 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient: monmap: 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 Processor -- start 2026-02-17T12:11:27.644 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 -- start start 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient: init 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff33c0a0750 0x7ff33c095280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-b con 0x7ff33c0a0750 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-a con 0x7ff33c0a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c13b760 0x7ff33c095d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): picked mon.noname-c con 0x7ff33c13b760 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0a04b0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.645 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c09c850 con 0x7ff33c0a0750 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c09e710 con 0x7ff33c13b760 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff342f14640 10 monclient(hunting): authenticate will time out at 2175.248774s 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56926/0 (socket says 10.20.193.51:56926) 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 1 -- 10.20.193.51:0/2614225015 learned_addr learned my addr 10.20.193.51:0/2614225015 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c13b760 0x7ff33c095d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): get_auth_request con 0x7ff33c0a3bb0 auth_method 0 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): get_auth_request con 0x7ff33c13b760 auth_method 0 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff340c89640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff33c0a0750 0x7ff33c095280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff34148a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff340c89640 10 monclient(hunting): get_auth_request con 0x7ff33c0a0750 auth_method 0 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff340c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff340c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff340c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 10 monclient(hunting): handle_auth_done global_id 274593 payload 824 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.629+0000 7ff333fff640 1 -- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c13b760 msgr2=0x7ff33c095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c13b760 0x7ff33c095d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 1 -- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff33c0a0750 msgr2=0x7ff33c095280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff33c0a0750 0x7ff33c095280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.648 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.630+0000 7ff333fff640 1 -- 10.20.193.51:0/2614225015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c09b9c0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff333fff640 1 -- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 msgr2=0x7ff33c0957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff333fff640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c500 tx=0x7ff32400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324012a40 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: dump: 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.649 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff324017070 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324012e40 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.650 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff332ffd640 4 set_mon_vals no callback set 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff3317fa640 10 monclient: dump: 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 5 monclient: authenticate success, global_id 274593 2026-02-17T12:11:27.651 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 10 monclient: _renew_subs 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c098d70 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 10 monclient: _renew_subs 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.632+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c0984d0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff342f14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff342f14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff342f14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7ff32401c460 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c139ab0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff3317fa640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 0x7ff30c0401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.652 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7ff324052270 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff340c89640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 0x7ff30c0401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.633+0000 7ff340c89640 10 monclient: get_auth_request con 0x7ff30c03dd10 auth_method 0 2026-02-17T12:11:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.635+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff33c139ab0 con 0x7ff33c0a3bb0 2026-02-17T12:11:27.653 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.635+0000 7ff3317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.635+0000 7ff3317fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:27.654 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.636+0000 7ff340c89640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 0x7ff30c0401d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff33c069d60 tx=0x7ff32c033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.721+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff33c096a10 con 0x7ff30c03dd10 2026-02-17T12:11:27.723 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.721+0000 7ff3317fa640 1 -- 10.20.193.51:0/2614225015 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff33c096a10 con 0x7ff30c03dd10 2026-02-17T12:11:27.723 INFO:teuthology.orchestra.run.trial051.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T12:11:27.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 msgr2=0x7ff30c0401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 0x7ff30c0401d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff33c069d60 tx=0x7ff32c033000 comp rx=0 tx=0).stop 2026-02-17T12:11:27.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 10 monclient: shutdown 2026-02-17T12:11:27.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.725 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 msgr2=0x7ff33c0957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c500 tx=0x7ff32400c9d0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 shutdown_connections 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7ff30c03dd10 0x7ff30c0401d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7ff33c13b760 0x7ff33c095d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7ff33c0a3bb0 0x7ff33c0957c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 --2- 10.20.193.51:0/2614225015 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7ff33c0a0750 0x7ff33c095280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.722+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 >> 10.20.193.51:0/2614225015 conn(0x7ff33c0a30c0 msgr2=0x7ff33c13a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.723+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 shutdown_connections 2026-02-17T12:11:27.726 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.723+0000 7ff342f14640 1 -- 10.20.193.51:0/2614225015 wait complete. 2026-02-17T12:11:27.732 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:27.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.798+0000 7f954821a640 10 monclient: get_monmap_and_config 2026-02-17T12:11:27.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.798+0000 7f954821a640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.803 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.798+0000 7f954821a640 10 monclient: monmap: 2026-02-17T12:11:27.803 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.803 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:27.799751+0000 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:27.799751+0000 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.804 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 Processor -- start 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 -- start start 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient: init 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954009cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): picked mon.noname-b con 0x7f95400a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 0x7f9540138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): picked mon.noname-a con 0x7f954009d270 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f95401385b0 addr v1:10.20.193.51:6789/0 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 -- --> v1:10.20.193.51:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9540135430 con 0x7f95401385b0 2026-02-17T12:11:27.805 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f954009a5c0 con 0x7f954009d270 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f954009b520 con 0x7f95400a3bb0 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954821a640 10 monclient(hunting): authenticate will time out at 2175.418559s 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 0x7f9540138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954009cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 0x7f9540138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:56934/0 (socket says 10.20.193.51:56934) 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 1 -- 10.20.193.51:0/3296422319 learned_addr learned my addr 10.20.193.51:0/3296422319 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 10 monclient(hunting): get_auth_request con 0x7f954009d270 auth_method 0 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.806 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f954578e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): get_auth_request con 0x7f95400a3bb0 auth_method 0 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient(hunting): handle_auth_done global_id 304316 payload 274 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 -- 10.20.193.51:0/3296422319 >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 msgr2=0x7f9540138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 --2- 10.20.193.51:0/3296422319 >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 0x7f9540138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 -- 10.20.193.51:0/3296422319 >> v1:10.20.193.51:6789/0 conn(0x7f95401385b0 legacy=0x7f954013f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:27.807 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 monclient: found mon.noname-b 2026-02-17T12:11:27.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:27.808 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.799+0000 7f9545f8f640 1 -- 10.20.193.51:0/3296422319 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954009af60 con 0x7f95400a3bb0 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9545f8f640 1 -- 10.20.193.51:0/3296422319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 msgr2=0x7f954009cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9545f8f640 1 --2- 10.20.193.51:0/3296422319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954009cd30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95300098a0 tx=0x7f953002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b946a776b635194 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 1 -- 10.20.193.51:0/3296422319 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953003c070 con 0x7f95400a3bb0 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: dump: 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.815 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 5 monclient: authenticate success, global_id 304316 2026-02-17T12:11:27.816 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 1 -- 10.20.193.51:0/3296422319 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953002fc00 con 0x7f95400a3bb0 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 1 -- 10.20.193.51:0/3296422319 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530037440 con 0x7f95400a3bb0 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f9544f8d640 10 monclient: dump: 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.817 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 4 set_mon_vals no callback set 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 10 monclient: shutdown 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 -- 10.20.193.51:0/3296422319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 msgr2=0x7f954009cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 --2- 10.20.193.51:0/3296422319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954009cd30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95300098a0 tx=0x7f953002ed80 comp rx=0 tx=0).stop 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 -- 10.20.193.51:0/3296422319 shutdown_connections 2026-02-17T12:11:27.818 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 --2- 10.20.193.51:0/3296422319 >> v2:10.20.193.51:3300/0 conn(0x7f954009d270 0x7f9540138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 --2- 10.20.193.51:0/3296422319 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954009cd30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 -- 10.20.193.51:0/3296422319 >> 10.20.193.51:0/3296422319 conn(0x7f95400a30c0 msgr2=0x7f95400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 -- 10.20.193.51:0/3296422319 shutdown_connections 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.802+0000 7f954821a640 1 -- 10.20.193.51:0/3296422319 wait complete. 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient: build_initial_monmap 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient: monmap: 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:27.819 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 Processor -- start 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 -- start start 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient: init 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): picked mon.noname-b con 0x7f954009d270 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:27.820 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954012d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): picked mon.noname-c con 0x7f95400a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 0x7f954012dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): picked mon.noname-a con 0x7f95401385b0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f9540074ac0 con 0x7f95401385b0 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95400a3f90 con 0x7f954009d270 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f9540135040 con 0x7f95400a3bb0 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954821a640 10 monclient(hunting): authenticate will time out at 2175.422628s 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954012d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.821 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 0x7f954012dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954012d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:37124/0 (socket says 10.20.193.51:37124) 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 1 -- 10.20.193.51:0/1953724899 learned_addr learned my addr 10.20.193.51:0/1953724899 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): get_auth_request con 0x7f95400a3bb0 auth_method 0 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): get_auth_request con 0x7f95401385b0 auth_method 0 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.822 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f954578e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9545f8f640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient(hunting): handle_auth_done global_id 274599 payload 824 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9545f8f640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 msgr2=0x7f954012d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9545f8f640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 msgr2=0x7f954012d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 msgr2=0x7f954012d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9545f8f640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954012d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.823 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 msgr2=0x7f954012d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9545f8f640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient: _finish_hunting 0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 monclient: found mon.noname-a 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.803+0000 7f9546790640 1 -- 10.20.193.51:0/1953724899 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954012f2d0 con 0x7f95401385b0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f9546790640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 msgr2=0x7f954012dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f9546790640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 0x7f954012dd60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f953c00cb20 tx=0x7f953c004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c016030 con 0x7f95401385b0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.824 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: dump: 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:11:27.825 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c00ac50 con 0x7f95401385b0 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c004a80 con 0x7f95401385b0 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 10 monclient: dump: 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:27.826 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952ffff640 4 set_mon_vals no callback set 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 5 monclient: authenticate success, global_id 274599 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _renew_subs 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9540130e40 con 0x7f95401385b0 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _renew_subs 2026-02-17T12:11:27.827 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9540130880 con 0x7f95401385b0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9540138070 con 0x7f95401385b0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f953c023060 con 0x7f95401385b0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 0x7f9510040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.806+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f953c052500 con 0x7f95401385b0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.807+0000 7f9545f8f640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 0x7f9510040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.807+0000 7f9545f8f640 10 monclient: get_auth_request con 0x7f951003dd60 auth_method 0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.809+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f953c01b410 con 0x7f95401385b0 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.809+0000 7f952e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:27.828 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.809+0000 7f952e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:27.829 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.809+0000 7f9545f8f640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 0x7f9510040220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f954006f3a0 tx=0x7f9530033000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:27.891 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.890+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f954012ee30 con 0x7f951003dd60 2026-02-17T12:11:27.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.891+0000 7f952e7fc640 1 -- 10.20.193.51:0/1953724899 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34137 (secure 0 0 0) 0x7f9530041460 con 0x7f951003dd60 2026-02-17T12:11:27.893 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 msgr2=0x7f9510040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 0x7f9510040220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f954006f3a0 tx=0x7f9530033000 comp rx=0 tx=0).stop 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 10 monclient: shutdown 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 msgr2=0x7f954012dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 0x7f954012dd60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f953c00cb20 tx=0x7f953c004a10 comp rx=0 tx=0).stop 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 shutdown_connections 2026-02-17T12:11:27.895 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f951003dd60 0x7f9510040220 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f95401385b0 0x7f954012dd60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f95400a3bb0 0x7f954012d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 --2- 10.20.193.51:0/1953724899 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f954009d270 0x7f954012d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 >> 10.20.193.51:0/1953724899 conn(0x7f95400a30c0 msgr2=0x7f954009c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 shutdown_connections 2026-02-17T12:11:27.896 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:27.892+0000 7f954821a640 1 -- 10.20.193.51:0/1953724899 wait complete. 2026-02-17T12:11:27.902 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1706,"stamp":"2026-02-17T12:11:26.042209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":339220,"kb_used_data":44192,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565891820,"statfs":{"total":579820584960,"available":579473223680,"internally_reserved":0,"allocated":45252608,"data_stored":20696740,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-271647475,"num_objects":-133,"num_object_clones":-86,"num_object_copies":-266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-133,"num_whiteouts":-13,"num_read":-7315,"num_read_kb":-7105799,"num_write":-5330,"num_write_kb":-2135917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.355035"},"pg_stats":[{"pgid":"1.0","version":"15'112","reported_seq":1964,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762164+0000","last_change":"2026-02-17T11:45:31.598694+0000","last_active":"2026-02-17T12:11:20.762164+0000","last_peered":"2026-02-17T12:11:20.762164+0000","last_clean":"2026-02-17T12:11:20.762164+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:20.762164+0000","last_undegraded":"2026-02-17T12:11:20.762164+0000","last_fullsized":"2026-02-17T12:11:20.762164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:30.088996+0000","last_clean_scrub_stamp":"2026-02-17T11:45:30.088996+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:47.385863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":1820,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747404+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:44:40.872136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762156+0000","last_change":"2026-02-17T11:45:37.744965+0000","last_active":"2026-02-17T12:11:20.762156+0000","last_peered":"2026-02-17T12:11:20.762156+0000","last_clean":"2026-02-17T12:11:20.762156+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:20.762156+0000","last_undegraded":"2026-02-17T12:11:20.762156+0000","last_fullsized":"2026-02-17T12:11:20.762156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:42:40.518118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1824,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442127+0000","last_change":"2026-02-17T11:45:37.935784+0000","last_active":"2026-02-17T12:11:22.442127+0000","last_peered":"2026-02-17T12:11:22.442127+0000","last_clean":"2026-02-17T12:11:22.442127+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:22.442127+0000","last_undegraded":"2026-02-17T12:11:22.442127+0000","last_fullsized":"2026-02-17T12:11:22.442127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:13:53.644425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":1821,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:22.442068+0000","last_change":"2026-02-17T11:45:37.747760+0000","last_active":"2026-02-17T12:11:22.442068+0000","last_peered":"2026-02-17T12:11:22.442068+0000","last_clean":"2026-02-17T12:11:22.442068+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:22.442068+0000","last_undegraded":"2026-02-17T12:11:22.442068+0000","last_fullsized":"2026-02-17T12:11:22.442068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:54.087053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1832,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762708+0000","last_change":"2026-02-17T11:45:37.745390+0000","last_active":"2026-02-17T12:11:20.762708+0000","last_peered":"2026-02-17T12:11:20.762708+0000","last_clean":"2026-02-17T12:11:20.762708+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:20.762708+0000","last_undegraded":"2026-02-17T12:11:20.762708+0000","last_fullsized":"2026-02-17T12:11:20.762708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:31.443995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1827,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762131+0000","last_change":"2026-02-17T11:45:37.745005+0000","last_active":"2026-02-17T12:11:20.762131+0000","last_peered":"2026-02-17T12:11:20.762131+0000","last_clean":"2026-02-17T12:11:20.762131+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:20.762131+0000","last_undegraded":"2026-02-17T12:11:20.762131+0000","last_fullsized":"2026-02-17T12:11:20.762131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:26.388974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1831,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762758+0000","last_change":"2026-02-17T11:45:37.745404+0000","last_active":"2026-02-17T12:11:20.762758+0000","last_peered":"2026-02-17T12:11:20.762758+0000","last_clean":"2026-02-17T12:11:20.762758+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:20.762758+0000","last_undegraded":"2026-02-17T12:11:20.762758+0000","last_fullsized":"2026-02-17T12:11:20.762758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:13.173650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1826,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:20.762203+0000","last_change":"2026-02-17T11:45:37.745288+0000","last_active":"2026-02-17T12:11:20.762203+0000","last_peered":"2026-02-17T12:11:20.762203+0000","last_clean":"2026-02-17T12:11:20.762203+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:20.762203+0000","last_undegraded":"2026-02-17T12:11:20.762203+0000","last_fullsized":"2026-02-17T12:11:20.762203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:34.733248+0000","last_clean_scrub_stamp":"2026-02-17T11:45:34.733248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:02:47.722737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56576,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315264,"statfs":{"total":96636764160,"available":96578830336,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60732,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640571,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56520,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315320,"statfs":{"total":96636764160,"available":96578887680,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:27.907 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T11:45:30.088996+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.907 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.907 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T11:45:34.733248+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=45, tm_sec=34, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=11, tm_sec=25, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:11:27.908 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T12:11:47.909 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.978+0000 7f4479a6f640 10 monclient: get_monmap_and_config 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.978+0000 7f4479a6f640 10 monclient: build_initial_monmap 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.978+0000 7f4479a6f640 10 monclient: monmap: 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:47.979568+0000 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:47.979568+0000 2026-02-17T12:11:47.983 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.978+0000 7f4479a6f640 1 Processor -- start 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 -- start start 2026-02-17T12:11:47.984 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient: init 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-b con 0x7f44740a3bb0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f44740a0750 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 0x7f447413db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-c con 0x7f447413b760 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447406e140 con 0x7f44740a0750 2026-02-17T12:11:47.985 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f447409f910 con 0x7f447413b760 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f447409ccd0 con 0x7f44740a3bb0 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4479a6f640 10 monclient(hunting): authenticate will time out at 2195.598348s 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51738/0 (socket says 10.20.193.51:51738) 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 -- 10.20.193.51:0/3649875414 learned_addr learned my addr 10.20.193.51:0/3649875414 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): get_auth_request con 0x7f44740a3bb0 auth_method 0 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:47.986 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 1 --2- 10.20.193.51:0/3649875414 >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 0x7f447413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 10 monclient(hunting): get_auth_request con 0x7f447413b760 auth_method 0 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient(hunting): handle_auth_done global_id 304322 payload 274 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 -- 10.20.193.51:0/3649875414 >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 msgr2=0x7f447413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 --2- 10.20.193.51:0/3649875414 >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 0x7f447413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:47.987 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 -- 10.20.193.51:0/3649875414 >> v1:10.20.193.142:6789/0 conn(0x7f44740a0750 legacy=0x7f447409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 monclient: found mon.noname-b 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.51:3301/0 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f4472ffd640 1 -- 10.20.193.51:0/3649875414 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447409eec0 con 0x7f44740a3bb0 2026-02-17T12:11:47.988 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.979+0000 7f44737fe640 1 --2- 10.20.193.51:0/3649875414 >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 0x7f447413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:11:47.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4472ffd640 1 -- 10.20.193.51:0/3649875414 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 msgr2=0x7f447409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:47.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4472ffd640 1 --2- 10.20.193.51:0/3649875414 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447409f230 tx=0x7f446802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea4edfbc1751fee server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:47.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 1 -- 10.20.193.51:0/3649875414 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446803c070 con 0x7f44740a3bb0 2026-02-17T12:11:47.995 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: dump: 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:47.996 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: _finish_auth 0 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 1 -- 10.20.193.51:0/3649875414 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446802fcc0 con 0x7f44740a3bb0 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 5 monclient: authenticate success, global_id 304322 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 1 -- 10.20.193.51:0/3649875414 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468037660 con 0x7f44740a3bb0 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 4 set_mon_vals no callback set 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:47.997 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4471ffb640 10 monclient: dump: 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:47.998 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 10 monclient: shutdown 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 -- 10.20.193.51:0/3649875414 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 msgr2=0x7f447409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 --2- 10.20.193.51:0/3649875414 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447409f230 tx=0x7f446802ee80 comp rx=0 tx=0).stop 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 -- 10.20.193.51:0/3649875414 shutdown_connections 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 --2- 10.20.193.51:0/3649875414 >> v2:10.20.193.142:3300/0 conn(0x7f447413b760 0x7f447413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 --2- 10.20.193.51:0/3649875414 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a3bb0 0x7f447409dac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 -- 10.20.193.51:0/3649875414 >> 10.20.193.51:0/3649875414 conn(0x7f44740a30c0 msgr2=0x7f44740a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 -- 10.20.193.51:0/3649875414 shutdown_connections 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.982+0000 7f4479a6f640 1 -- 10.20.193.51:0/3649875414 wait complete. 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient: build_initial_monmap 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient: monmap: 2026-02-17T12:11:47.999 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 Processor -- start 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 -- start start 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient: init 2026-02-17T12:11:48.000 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-c con 0x7f44740a0750 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44740a3bb0 0x7f44740909c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-a con 0x7f44740a3bb0 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f447413b760 0x7f4474090f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): picked mon.noname-b con 0x7f447413b760 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f44740a04b0 con 0x7f44740a3bb0 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f447409c850 con 0x7f447413b760 2026-02-17T12:11:48.001 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f447409e710 con 0x7f44740a0750 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4479a6f640 10 monclient(hunting): authenticate will time out at 2195.602555s 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3301/0 says I am v2:10.20.193.51:51740/0 (socket says 10.20.193.51:51740) 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 -- 10.20.193.51:0/1360577698 learned_addr learned my addr 10.20.193.51:0/1360577698 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): get_auth_request con 0x7f44740a0750 auth_method 0 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.002 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44740a3bb0 0x7f44740909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): get_auth_request con 0x7f44740a3bb0 auth_method 0 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f44727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient(hunting): handle_auth_done global_id 304325 payload 824 2026-02-17T12:11:48.003 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 -- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f447413b760 msgr2=0x7f4474090f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f447413b760 0x7f4474090f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 -- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44740a3bb0 msgr2=0x7f44740909c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44740a3bb0 0x7f44740909c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 monclient: found mon.noname-c 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.51:3301/0 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.983+0000 7f4472ffd640 1 -- 10.20.193.51:0/1360577698 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44740a2590 con 0x7f44740a0750 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.985+0000 7f4472ffd640 1 -- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 msgr2=0x7f447409a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.985+0000 7f4472ffd640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f446802f390 tx=0x7f4468004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468047070 con 0x7f44740a0750 2026-02-17T12:11:48.004 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: dump: 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.005 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: _finish_auth 0 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446803f790 con 0x7f44740a0750 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446803c040 con 0x7f44740a0750 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 5 monclient: authenticate success, global_id 304325 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f44717fa640 4 set_mon_vals no callback set 2026-02-17T12:11:48.006 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _renew_subs 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4474094850 con 0x7f44740a0750 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 10 monclient: dump: 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.007 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _renew_subs 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44740929a0 con 0x7f44740a0750 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f446803fbc0 con 0x7f44740a0750 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.51:3301/0 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44740938a0 con 0x7f44740a0750 2026-02-17T12:11:48.008 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 0x7f4444040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.986+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f4468077310 con 0x7f44740a0750 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.987+0000 7f44727fc640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 0x7f4444040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.987+0000 7f44727fc640 10 monclient: get_auth_request con 0x7f444403dd60 auth_method 0 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.989+0000 7f44727fc640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 0x7f4444040220 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f44740921e0 tx=0x7f445c007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.989+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mon.2 v2:10.20.193.51:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4468075ec0 con 0x7f44740a0750 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.989+0000 7f444bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.009 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:47.989+0000 7f444bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:48.075 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.073+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 --> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f447406f710 con 0x7f444403dd60 2026-02-17T12:11:48.076 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f444bfff640 1 -- 10.20.193.51:0/1360577698 <== mgr.4105 v2:10.20.193.142:6800/1631919410 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34028 (secure 0 0 0) 0x7f447406f710 con 0x7f444403dd60 2026-02-17T12:11:48.077 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-17T12:11:48.078 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 msgr2=0x7f4444040220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 0x7f4444040220 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f44740921e0 tx=0x7f445c007f30 comp rx=0 tx=0).stop 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 10 monclient: shutdown 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 msgr2=0x7f447409a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f446802f390 tx=0x7f4468004830 comp rx=0 tx=0).stop 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 shutdown_connections 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f444403dd60 0x7f4444040220 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f447413b760 0x7f4474090f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.079 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f44740a3bb0 0x7f44740909c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 --2- 10.20.193.51:0/1360577698 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f44740a0750 0x7f447409a010 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 >> 10.20.193.51:0/1360577698 conn(0x7f44740a30c0 msgr2=0x7f4474072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:48.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 shutdown_connections 2026-02-17T12:11:48.080 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.075+0000 7f4479a6f640 1 -- 10.20.193.51:0/1360577698 wait complete. 2026-02-17T12:11:48.085 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":1717,"stamp":"2026-02-17T12:11:48.044236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":339204,"kb_used_data":44192,"kb_used_omap":9,"kb_used_meta":294902,"kb_avail":565891836,"statfs":{"total":579820584960,"available":579473240064,"internally_reserved":0,"allocated":45252608,"data_stored":20696740,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9562,"internal_metadata":301980326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000989"},"pg_stats":[{"pgid":"1.0","version":"933'114","reported_seq":1976,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:27.261660+0000","last_change":"2026-02-17T12:11:27.261660+0000","last_active":"2026-02-17T12:11:27.261660+0000","last_peered":"2026-02-17T12:11:27.261660+0000","last_clean":"2026-02-17T12:11:27.261660+0000","last_became_active":"2026-02-17T11:45:31.598502+0000","last_became_peered":"2026-02-17T11:45:31.598502+0000","last_unstale":"2026-02-17T12:11:27.261660+0000","last_undegraded":"2026-02-17T12:11:27.261660+0000","last_fullsized":"2026-02-17T12:11:27.261660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"933'114","last_scrub_stamp":"2026-02-17T12:11:27.261618+0000","last_deep_scrub":"933'114","last_deep_scrub_stamp":"2026-02-17T12:11:27.261618+0000","last_clean_scrub_stamp":"2026-02-17T12:11:27.261618+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:07:15.954441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"933'2","reported_seq":1830,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:28.985686+0000","last_change":"2026-02-17T12:11:28.985720+0000","last_active":"2026-02-17T12:11:28.985686+0000","last_peered":"2026-02-17T12:11:28.985686+0000","last_clean":"2026-02-17T12:11:28.985686+0000","last_became_active":"2026-02-17T11:45:35.745866+0000","last_became_peered":"2026-02-17T11:45:35.745866+0000","last_unstale":"2026-02-17T12:11:28.985686+0000","last_undegraded":"2026-02-17T12:11:28.985686+0000","last_fullsized":"2026-02-17T12:11:28.985686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"933'2","last_scrub_stamp":"2026-02-17T12:11:28.985623+0000","last_deep_scrub":"933'2","last_deep_scrub_stamp":"2026-02-17T12:11:28.985623+0000","last_clean_scrub_stamp":"2026-02-17T12:11:28.985623+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:49:16.897375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041360700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1837,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:29.287188+0000","last_change":"2026-02-17T12:11:29.287188+0000","last_active":"2026-02-17T12:11:29.287188+0000","last_peered":"2026-02-17T12:11:29.287188+0000","last_clean":"2026-02-17T12:11:29.287188+0000","last_became_active":"2026-02-17T11:45:35.742083+0000","last_became_peered":"2026-02-17T11:45:35.742083+0000","last_unstale":"2026-02-17T12:11:29.287188+0000","last_undegraded":"2026-02-17T12:11:29.287188+0000","last_fullsized":"2026-02-17T12:11:29.287188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:29.287081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:29.287081+0000","last_clean_scrub_stamp":"2026-02-17T12:11:29.287081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:51:16.763280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046476200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1833,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:27.309784+0000","last_change":"2026-02-17T12:11:27.309798+0000","last_active":"2026-02-17T12:11:27.309784+0000","last_peered":"2026-02-17T12:11:27.309784+0000","last_clean":"2026-02-17T12:11:27.309784+0000","last_became_active":"2026-02-17T11:45:35.743614+0000","last_became_peered":"2026-02-17T11:45:35.743614+0000","last_unstale":"2026-02-17T12:11:27.309784+0000","last_undegraded":"2026-02-17T12:11:27.309784+0000","last_fullsized":"2026-02-17T12:11:27.309784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:27.309742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:27.309742+0000","last_clean_scrub_stamp":"2026-02-17T12:11:27.309742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:27:53.922949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000212535,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"933'3","reported_seq":1831,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:28.005477+0000","last_change":"2026-02-17T12:11:28.005488+0000","last_active":"2026-02-17T12:11:28.005477+0000","last_peered":"2026-02-17T12:11:28.005477+0000","last_clean":"2026-02-17T12:11:28.005477+0000","last_became_active":"2026-02-17T11:45:35.745970+0000","last_became_peered":"2026-02-17T11:45:35.745970+0000","last_unstale":"2026-02-17T12:11:28.005477+0000","last_undegraded":"2026-02-17T12:11:28.005477+0000","last_fullsized":"2026-02-17T12:11:28.005477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"933'3","last_scrub_stamp":"2026-02-17T12:11:28.005444+0000","last_deep_scrub":"933'3","last_deep_scrub_stamp":"2026-02-17T12:11:28.005444+0000","last_clean_scrub_stamp":"2026-02-17T12:11:28.005444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:55:12.847803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084047899999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1841,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:27.432564+0000","last_change":"2026-02-17T12:11:27.432586+0000","last_active":"2026-02-17T12:11:27.432564+0000","last_peered":"2026-02-17T12:11:27.432564+0000","last_clean":"2026-02-17T12:11:27.432564+0000","last_became_active":"2026-02-17T11:45:35.740790+0000","last_became_peered":"2026-02-17T11:45:35.740790+0000","last_unstale":"2026-02-17T12:11:27.432564+0000","last_undegraded":"2026-02-17T12:11:27.432564+0000","last_fullsized":"2026-02-17T12:11:27.432564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:27.432489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:27.432489+0000","last_clean_scrub_stamp":"2026-02-17T12:11:27.432489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:48:19.151301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1836,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:28.272775+0000","last_change":"2026-02-17T12:11:28.272784+0000","last_active":"2026-02-17T12:11:28.272775+0000","last_peered":"2026-02-17T12:11:28.272775+0000","last_clean":"2026-02-17T12:11:28.272775+0000","last_became_active":"2026-02-17T11:45:35.741796+0000","last_became_peered":"2026-02-17T11:45:35.741796+0000","last_unstale":"2026-02-17T12:11:28.272775+0000","last_undegraded":"2026-02-17T12:11:28.272775+0000","last_fullsized":"2026-02-17T12:11:28.272775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:28.272732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:28.272732+0000","last_clean_scrub_stamp":"2026-02-17T12:11:28.272732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:05:07.218663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052606599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1841,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:28.397276+0000","last_change":"2026-02-17T12:11:28.397276+0000","last_active":"2026-02-17T12:11:28.397276+0000","last_peered":"2026-02-17T12:11:28.397276+0000","last_clean":"2026-02-17T12:11:28.397276+0000","last_became_active":"2026-02-17T11:45:35.742298+0000","last_became_peered":"2026-02-17T11:45:35.742298+0000","last_unstale":"2026-02-17T12:11:28.397276+0000","last_undegraded":"2026-02-17T12:11:28.397276+0000","last_fullsized":"2026-02-17T12:11:28.397276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:28.397215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:28.397215+0000","last_clean_scrub_stamp":"2026-02-17T12:11:28.397215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:47:22.981571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1836,"reported_epoch":933,"state":"active+clean","last_fresh":"2026-02-17T12:11:30.290787+0000","last_change":"2026-02-17T12:11:30.290787+0000","last_active":"2026-02-17T12:11:30.290787+0000","last_peered":"2026-02-17T12:11:30.290787+0000","last_clean":"2026-02-17T12:11:30.290787+0000","last_became_active":"2026-02-17T11:45:35.742115+0000","last_became_peered":"2026-02-17T11:45:35.742115+0000","last_unstale":"2026-02-17T12:11:30.290787+0000","last_undegraded":"2026-02-17T12:11:30.290787+0000","last_fullsized":"2026-02-17T12:11:30.290787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:11:30.290707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:11:30.290707+0000","last_clean_scrub_stamp":"2026-02-17T12:11:30.290707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:05.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077482799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":64186,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60676,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311164,"statfs":{"total":96636764160,"available":96574631936,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52356,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319484,"statfs":{"total":96636764160,"available":96583151616,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56572,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315268,"statfs":{"total":96636764160,"available":96578834432,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52352,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":44990,"kb_avail":94319488,"statfs":{"total":96636764160,"available":96583155712,"internally_reserved":0,"allocated":7520256,"data_stored":3273141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46070214},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60732,"kb_used_data":7404,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":7581696,"data_stored":3802069,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640576,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56516,"kb_used_data":7348,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94315324,"statfs":{"total":96636764160,"available":96578891776,"internally_reserved":0,"allocated":7524352,"data_stored":3273160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":32093,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:11:48.087 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 10 monclient: get_monmap_and_config 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 10 monclient: build_initial_monmap 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 10 monclient: monmap: 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T12:11:48.152088+0000 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T12:11:48.152088+0000 2026-02-17T12:11:48.153 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:0: v1:10.20.193.51:6789/0 mon.noname-a-legacy 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:1: v1:10.20.193.142:6789/0 mon.noname-c-legacy 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-b 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:3: v2:10.20.193.51:3300/0 mon.noname-a 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr:4: v2:10.20.193.142:3300/0 mon.noname-c 2026-02-17T12:11:48.154 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 1 Processor -- start 2026-02-17T12:11:48.164 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 1 -- start start 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.151+0000 7f1412cdc640 10 monclient: init 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f140c0a0370 addr v1:10.20.193.142:6789/0 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f140c0a0e60 0x7f140c13d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-a con 0x7f140c0a0e60 addr v2:10.20.193.51:3300/0 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 1 --2- >> v2:10.20.193.142:3300/0 conn(0x7f140c13dab0 0x7f140c13fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-c con 0x7f140c13dab0 addr v2:10.20.193.142:3300/0 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 1 -- --> v1:10.20.193.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c0aa990 con 0x7f140c0a0370 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 1 -- --> v2:10.20.193.51:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0a2110 con 0x7f140c0a0e60 2026-02-17T12:11:48.165 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 1 -- --> v2:10.20.193.142:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0a1590 con 0x7f140c13dab0 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1412cdc640 10 monclient(hunting): authenticate will time out at 2195.771151s 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f140c0a0e60 0x7f140c13d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 --2- >> v2:10.20.193.51:3300/0 conn(0x7f140c0a0e60 0x7f140c13d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52018/0 (socket says 10.20.193.51:52018) 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 -- 10.20.193.51:0/2733364967 learned_addr learned my addr 10.20.193.51:0/2733364967 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): get_auth_request con 0x7f140c0a0e60 auth_method 0 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.166 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1411252640 1 --2- 10.20.193.51:0/2733364967 >> v2:10.20.193.142:3300/0 conn(0x7f140c13dab0 0x7f140c13fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1411252640 10 monclient(hunting): get_auth_request con 0x7f140c13dab0 auth_method 0 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1411252640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1411252640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1411252640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient(hunting): handle_auth_done global_id 274605 payload 274 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 -- 10.20.193.51:0/2733364967 >> v2:10.20.193.142:3300/0 conn(0x7f140c13dab0 msgr2=0x7f140c13fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 --2- 10.20.193.51:0/2733364967 >> v2:10.20.193.142:3300/0 conn(0x7f140c13dab0 0x7f140c13fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 -- 10.20.193.51:0/2733364967 >> v1:10.20.193.142:6789/0 conn(0x7f140c0a0370 legacy=0x7f140c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient: _finish_hunting 0 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 monclient: found mon.noname-a 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.152+0000 7f1403fff640 1 -- 10.20.193.51:0/2733364967 --> v2:10.20.193.51:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c0a29b0 con 0x7f140c0a0e60 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f1403fff640 1 -- 10.20.193.51:0/2733364967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0e60 msgr2=0x7f140c13d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f1403fff640 1 --2- 10.20.193.51:0/2733364967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0e60 0x7f140c13d570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f140c0765b0 tx=0x7f13f402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746fcdde5eac1d7f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 1 -- 10.20.193.51:0/2733364967 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f403c070 con 0x7f140c0a0e60 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: dump: 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.168 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: _finish_auth 0 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: _check_auth_tickets 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:48.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 1 -- 10.20.193.51:0/2733364967 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f402fca0 con 0x7f140c0a0e60 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 1 -- 10.20.193.51:0/2733364967 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4037660 con 0x7f140c0a0e60 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.154+0000 7f14037fe640 10 monclient: dump: 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.170 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 5 monclient: authenticate success, global_id 274605 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 10 monclient: get_monmap_and_config success 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 4 set_mon_vals no callback set 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 10 monclient: shutdown 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 -- 10.20.193.51:0/2733364967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0e60 msgr2=0x7f140c13d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 --2- 10.20.193.51:0/2733364967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0e60 0x7f140c13d570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f140c0765b0 tx=0x7f13f402ee60 comp rx=0 tx=0).stop 2026-02-17T12:11:48.171 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 -- 10.20.193.51:0/2733364967 shutdown_connections 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 --2- 10.20.193.51:0/2733364967 >> v2:10.20.193.142:3300/0 conn(0x7f140c13dab0 0x7f140c13fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 --2- 10.20.193.51:0/2733364967 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0e60 0x7f140c13d570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 -- 10.20.193.51:0/2733364967 >> 10.20.193.51:0/2733364967 conn(0x7f140c0a7670 msgr2=0x7f140c0a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 -- 10.20.193.51:0/2733364967 shutdown_connections 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 1 -- 10.20.193.51:0/2733364967 wait complete. 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 10 monclient: build_initial_monmap 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.155+0000 7f1412cdc640 10 monclient: monmap: 2026-02-17T12:11:48.172 INFO:teuthology.orchestra.run.trial051.stderr:epoch 0 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 0.000000 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:created 0.000000 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 0 (unknown) 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.noname-a 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.noname-b 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.noname-c 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 Processor -- start 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 -- start start 2026-02-17T12:11:48.173 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient: init 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient: _reopen_session rank -1 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-a con 0x7f140c0a0370 addr [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 --2- >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f140c0a0e60 0x7f140c1370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-b con 0x7f140c0a0e60 addr [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 --2- >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f140c13dab0 0x7f140c073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): picked mon.noname-c con 0x7f140c13dab0 addr [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 -- --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0a8580 con 0x7f140c0a0370 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.174 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 -- --> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0a8400 con 0x7f140c0a0e60 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 1 -- --> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] -- mon_getmap magic: 0 -- 0x7f140c0a3320 con 0x7f140c13dab0 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): _renew_subs 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1412cdc640 10 monclient(hunting): authenticate will time out at 2195.775469s 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 --2- >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.51:3300/0 says I am v2:10.20.193.51:52022/0 (socket says 10.20.193.51:52022) 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 -- 10.20.193.51:0/499443570 learned_addr learned my addr 10.20.193.51:0/499443570 (peer_addr_for_me v2:10.20.193.51:0/0) 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): get_auth_request con 0x7f140c0a0370 auth_method 0 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.175 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f140c13dab0 0x7f140c073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): get_auth_request con 0x7f140c13dab0 auth_method 0 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1403fff640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f140c0a0e60 0x7f140c1370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1411252640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:11:48.176 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1403fff640 10 monclient(hunting): get_auth_request con 0x7f140c0a0e60 auth_method 0 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1403fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1403fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient(hunting): handle_auth_done global_id 274608 payload 824 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 -- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f140c13dab0 msgr2=0x7f140c073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f140c13dab0 0x7f140c073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 -- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f140c0a0e60 msgr2=0x7f140c1370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f140c0a0e60 0x7f140c1370b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient: _finish_hunting 0 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 monclient: found mon.noname-a 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:11:48.177 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.156+0000 7f1410a51640 1 -- 10.20.193.51:0/499443570 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c121d90 con 0x7f140c0a0370 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1410a51640 1 -- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 msgr2=0x7f140c136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1410a51640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c5d0 tx=0x7f13fc00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc016020 con 0x7f140c0a0370 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: dump: 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.178 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: _finish_auth 0 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: _check_auth_tickets 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 5 monclient: authenticate success, global_id 274608 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc012a60 con 0x7f140c0a0370 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 10 monclient: _renew_subs 2026-02-17T12:11:48.179 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c123520 con 0x7f140c0a0370 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012e50 con 0x7f140c0a0370 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1402ffd640 4 set_mon_vals no callback set 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f14017fa640 10 monclient: dump: 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:epoch 1 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:fsid d196e788-97c6-436f-bedf-bc3cc9f7e94a 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:last_changed 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:created 2026-02-17T11:44:50.142292+0000 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:min_mon_release 19 (squid) 2026-02-17T12:11:48.180 INFO:teuthology.orchestra.run.trial051.stderr:election_strategy: 1 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:1: [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] mon.b 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2: [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] mon.c 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 10 monclient: _renew_subs 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.158+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c122f60 con 0x7f140c0a0370 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f1412cdc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f1412cdc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f1412cdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c06db60 con 0x7f140c0a0370 2026-02-17T12:11:48.181 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 4 ==== mgrmap(e 5) ==== 50260+0+0 (secure 0 0 0) 0x7f13fc01b400 con 0x7f140c0a0370 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.159+0000 7f14017fa640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 0x7f13dc0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.160+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 5 ==== osd_map(933..933 src has 816..933) ==== 4342+0+0 (secure 0 0 0) 0x7f13fc052430 con 0x7f140c0a0370 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.160+0000 7f1403fff640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 0x7f13dc0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.160+0000 7f1403fff640 10 monclient: get_auth_request con 0x7f13dc03df30 auth_method 0 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.162+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f13fc020030 con 0x7f140c0a0370 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.162+0000 7f14017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.162+0000 7f14017fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:11:48.182 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.162+0000 7f1403fff640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 0x7f13dc0403f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f13f4036000 tx=0x7f13f4039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:11:48.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.244+0000 7f1412cdc640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:11:48.246 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.244+0000 7f1412cdc640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:11:48.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.244+0000 7f1412cdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.51:3300/0 2026-02-17T12:11:48.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.244+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 --> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f140c121b10 con 0x7f140c0a0370 2026-02-17T12:11:48.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f13fc0520d0 con 0x7f140c0a0370 2026-02-17T12:11:48.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:11:48.248 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14017fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:11:48.249 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14017fa640 1 -- 10.20.193.51:0/499443570 <== mon.0 v2:10.20.193.51:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13fc01bbe0 con 0x7f140c0a0370 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14017fa640 10 monclient: handle_config config(1 keys) 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14027fc640 4 set_mon_vals no callback set 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.246+0000 7f14027fc640 10 set_mon_vals mon_health_to_clog = false 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 msgr2=0x7f13dc0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 0x7f13dc0403f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f13f4036000 tx=0x7f13f4039040 comp rx=0 tx=0).stop 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 10 monclient: shutdown 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 msgr2=0x7f140c136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c5d0 tx=0x7f13fc00caa0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.250 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 shutdown_connections 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:6800/1631919410,v1:10.20.193.142:6801/1631919410] conn(0x7f13dc03df30 0x7f13dc0403f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3301/0,v1:10.20.193.51:6790/0] conn(0x7f140c13dab0 0x7f140c073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.142:3300/0,v1:10.20.193.142:6789/0] conn(0x7f140c0a0e60 0x7f140c1370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 --2- 10.20.193.51:0/499443570 >> [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] conn(0x7f140c0a0370 0x7f140c136b70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 >> 10.20.193.51:0/499443570 conn(0x7f140c0a7670 msgr2=0x7f140c13bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 shutdown_connections 2026-02-17T12:11:48.251 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-17T12:11:48.247+0000 7f1412cdc640 1 -- 10.20.193.51:0/499443570 wait complete. 2026-02-17T12:11:48.257 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T12:11:48.257 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T12:11:48.258 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T12:11:48.258 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.295 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T12:11:48.295 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T12:11:48.296 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.372 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T12:11:48.373 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T12:11:48.373 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.451 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T12:11:48.451 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T12:11:48.451 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.485 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T12:11:48.485 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T12:11:48.485 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.560 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T12:11:48.560 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T12:11:48.560 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.636 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T12:11:48.637 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T12:11:48.637 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T12:11:48.637 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.713 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T12:11:48.713 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T12:11:48.713 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:11:48.714 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.727 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:11:48.728 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:11:48.728 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.780 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:11:48.780 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:11:48.780 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:11:48.791 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:11:48.791 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T12:11:48.792 DEBUG:teuthology.orchestra.run.trial051:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T12:11:48.849 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T12:11:48.849 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T12:11:48.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T12:11:48.926 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T12:11:49.004 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial051.front.sepia.ceph.com 2026-02-17T12:11:49.004 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T12:11:49.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T12:11:49.080 DEBUG:teuthology.orchestra.run.trial142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T12:11:49.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T12:11:49.120 DEBUG:teuthology.orchestra.run.trial142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T12:11:49.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial142.front.sepia.ceph.com 2026-02-17T12:11:49.191 DEBUG:teuthology.orchestra.run.trial142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T12:11:49.267 INFO:tasks.ceph:Archiving mon data... 2026-02-17T12:11:49.268 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/data/mon.a.tgz 2026-02-17T12:11:49.268 DEBUG:teuthology.orchestra.run.trial051:> mktemp 2026-02-17T12:11:49.286 INFO:teuthology.orchestra.run.trial051.stdout:/tmp/tmp.SaJQtWK4uI 2026-02-17T12:11:49.287 DEBUG:teuthology.orchestra.run.trial051:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SaJQtWK4uI 2026-02-17T12:11:49.446 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0666 /tmp/tmp.SaJQtWK4uI 2026-02-17T12:11:49.527 DEBUG:teuthology.orchestra.remote:trial051:/tmp/tmp.SaJQtWK4uI is 1009KB 2026-02-17T12:11:49.622 DEBUG:teuthology.orchestra.run.trial051:> rm -fr /tmp/tmp.SaJQtWK4uI 2026-02-17T12:11:49.639 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/data/mon.c.tgz 2026-02-17T12:11:49.639 DEBUG:teuthology.orchestra.run.trial051:> mktemp 2026-02-17T12:11:49.695 INFO:teuthology.orchestra.run.trial051.stdout:/tmp/tmp.C8bF3Ntp0B 2026-02-17T12:11:49.695 DEBUG:teuthology.orchestra.run.trial051:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.C8bF3Ntp0B 2026-02-17T12:11:49.852 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0666 /tmp/tmp.C8bF3Ntp0B 2026-02-17T12:11:49.935 DEBUG:teuthology.orchestra.remote:trial051:/tmp/tmp.C8bF3Ntp0B is 1008KB 2026-02-17T12:11:50.039 DEBUG:teuthology.orchestra.run.trial051:> rm -fr /tmp/tmp.C8bF3Ntp0B 2026-02-17T12:11:50.056 DEBUG:teuthology.misc:Transferring archived files from trial142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/data/mon.b.tgz 2026-02-17T12:11:50.056 DEBUG:teuthology.orchestra.run.trial142:> mktemp 2026-02-17T12:11:50.074 INFO:teuthology.orchestra.run.trial142.stdout:/tmp/tmp.R7XqaoIpGQ 2026-02-17T12:11:50.075 DEBUG:teuthology.orchestra.run.trial142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.R7XqaoIpGQ 2026-02-17T12:11:50.237 DEBUG:teuthology.orchestra.run.trial142:> sudo chmod 0666 /tmp/tmp.R7XqaoIpGQ 2026-02-17T12:11:50.318 DEBUG:teuthology.orchestra.remote:trial142:/tmp/tmp.R7XqaoIpGQ is 1008KB 2026-02-17T12:11:50.421 DEBUG:teuthology.orchestra.run.trial142:> rm -fr /tmp/tmp.R7XqaoIpGQ 2026-02-17T12:11:50.438 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T12:11:50.438 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:11:50.441 DEBUG:teuthology.orchestra.run.trial142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:11:50.520 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:11:50.557 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:11:50.557 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T12:11:50.560 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial051/crash 2026-02-17T12:11:50.561 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:11:50.586 DEBUG:teuthology.misc:Transferring archived files from trial142:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial142/crash 2026-02-17T12:11:50.588 DEBUG:teuthology.orchestra.run.trial142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:11:50.621 INFO:tasks.ceph:Compressing logs... 2026-02-17T12:11:50.622 DEBUG:teuthology.orchestra.run.trial051:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:11:50.632 DEBUG:teuthology.orchestra.run.trial142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:11:50.653 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50426.log 2026-02-17T12:11:50.690 INFO:teuthology.orchestra.run.trial142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42389.log 2026-02-17T12:11:50.700 INFO:teuthology.orchestra.run.trial142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2026-02-17T12:11:50.700 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42389.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T12:11:50.700 INFO:teuthology.orchestra.run.trial142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42389.log.gz 2026-02-17T12:11:50.700 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2026-02-17T12:11:50.700 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45205.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.0.45205.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42342.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42447.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-client.admin.42342.log: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:11:50.701 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph-mgr.x.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42342.log.gz 2026-02-17T12:11:50.708 INFO:teuthology.orchestra.run.trial142.stderr:/var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62680.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50426.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62680.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50426.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64182.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50884.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.62680.log.gz -5 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49299.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54370.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64182.log: /var/log/ceph/ceph-client.admin.49299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69627.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64182.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54370.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49299.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56040.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54370.log.gz 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49789.log 2026-02-17T12:11:50.725 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56040.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69627.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56040.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63496.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55368.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49789.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59588.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57406.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.63496.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63072.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55368.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62385.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59588.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63072.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57406.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62385.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63072.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56138.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47115.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62385.log.gzgzip 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48338.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:gzip/var/log/ceph/ceph-client.admin.56138.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57838.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65442.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56138.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59882.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48338.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68731.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.57838.log.gz 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2026-02-17T12:11:50.726 INFO:teuthology.orchestra.run.trial051.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.65442.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.59882.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57789.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.68731.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59179.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57789.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45797.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53732.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52931.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59179.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 89.3%/var/log/ceph/ceph-client.admin.53732.log: -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45797.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47581.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53732.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48649.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58836.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59686.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48649.log: /var/log/ceph/ceph-client.admin.58836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63643.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48649.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61962.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63643.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58836.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59686.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45801.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63643.log.gz 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65638.log 2026-02-17T12:11:50.727 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46844.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61962.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65032.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45801.log: /var/log/ceph/ceph-client.admin.65638.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57331.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45801.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65638.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48289.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55565.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65032.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66588.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57331.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58182.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.48289.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55565.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58182.log: gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-client.admin.71379.log -- replaced with /var/log/ceph/ceph-client.admin.66588.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.58182.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50835.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47482.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71379.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61913.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59784.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50835.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67095.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47482.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55942.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.61913.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42530.log 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67095.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59784.log.gz 2026-02-17T12:11:50.728 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56481.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67095.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57233.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55942.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5/var/log/ceph/ceph-client.admin.56481.log: --verbose -- /var/log/ceph/ceph-client.admin.66834.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.42530.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45802.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56481.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72214.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57233.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71232.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66834.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45802.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53242.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72214.log: /var/log/ceph/ceph-client.admin.71232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55270.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53242.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72214.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69971.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71232.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72312.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53242.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 88.8%/var/log/ceph/ceph-client.admin.69971.log: -- replaced with /var/log/ceph/ceph-client.admin.55270.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61011.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50377.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.69971.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61011.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72312.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69529.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61011.log.gz 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61472.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50377.log: /var/log/ceph/ceph-client.admin.69529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59735.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67684.log 2026-02-17T12:11:50.729 INFO:teuthology.orchestra.run.trial051.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50377.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.69529.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63594.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61472.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52449.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59735.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50622.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67684.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63692.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.63594.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67831.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52449.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50622.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71428.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63692.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67831.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71428.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71920.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56841.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49544.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67341.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71920.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71477.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56841.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67341.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2026-02-17T12:11:50.730 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71477.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67341.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56556.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51473.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71477.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68175.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56556.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53683.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68175.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56556.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63986.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.68175.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50083.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50132.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.53683.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50083.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63986.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55172.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50132.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50083.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55172.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50132.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70020.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55172.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53781.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70020.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72016.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49495.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70020.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51931.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71281.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72016.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60814.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71281.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51931.log.gz 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54936.log 2026-02-17T12:11:50.731 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60814.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.71281.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54076.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60814.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70380.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54076.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54936.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68927.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70380.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54076.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58493.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.70380.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68927.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68976.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.58493.log: -- /var/log/ceph/ceph-client.admin.61276.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61276.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68976.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58493.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61570.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50671.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61276.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61570.log: gzip 89.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz --verbose 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: -- /var/log/ceph/ceph-client.admin.67880.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-mon.c.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61570.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52882.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip/var/log/ceph/ceph-client.admin.67880.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63134.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72361.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63134.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52882.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.67880.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72361.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.63134.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55221.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54812.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72361.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55319.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55221.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72410.log 2026-02-17T12:11:50.732 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55319.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55221.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51080.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72410.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55319.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69431.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72410.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67978.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51080.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49838.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.69431.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52225.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67978.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50933.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71675.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67978.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50933.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52225.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57495.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71675.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50933.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71675.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50328.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57495.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53389.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip/var/log/ceph/ceph-client.admin.51375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68028.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68028.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.53389.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60912.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68028.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57642.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60912.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52323.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68567.log 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60912.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52323.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.57642.log.gz 2026-02-17T12:11:50.733 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67537.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68567.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52323.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63023.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67537.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68567.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63023.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.67537.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63023.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69333.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47433.log: /var/log/ceph/ceph-client.admin.46991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55991.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57282.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69333.log: /var/log/ceph/ceph-client.admin.55991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55991.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.69333.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip/var/log/ceph/ceph-client.admin.57282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57691.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51882.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57282.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62827.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57691.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72116.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51882.log.gz/var/log/ceph/ceph-client.admin.62827.log: 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72116.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.62827.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65785.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56890.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72116.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gz/var/log/ceph/ceph-client.admin.65785.log: 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53291.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46392.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65785.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64885.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr: 88.7%/var/log/ceph/ceph-client.admin.53291.log: -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72508.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53291.log.gz 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70938.log 2026-02-17T12:11:50.734 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72508.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64885.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58306.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70938.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72508.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64934.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54517.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.70938.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64934.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58306.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46097.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54517.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64934.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71624.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54517.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45799.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46097.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50786.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72459.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50786.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.54272.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71624.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72459.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.50786.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48141.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54272.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72459.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67292.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48141.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65834.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67292.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48141.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56694.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67292.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51636.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61619.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65834.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51636.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56694.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62140.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51636.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68616.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62140.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.61619.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55074.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68616.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62140.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55516.log 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55074.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.68616.log.gz 2026-02-17T12:11:50.735 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58689.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64738.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55074.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60765.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55516.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64738.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58689.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66539.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60765.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64738.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58035.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60765.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56285.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58035.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.66539.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69480.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56285.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58035.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59833.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56285.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52587.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.69480.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56383.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59833.log: /var/log/ceph/ceph-client.admin.52587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65883.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56383.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.59833.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48502.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50982.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.56383.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65883.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72704.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48502.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48796.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50982.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60618.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66735.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72704.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59130.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48796.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53977.log 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60618.log.gz 2026-02-17T12:11:50.736 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59130.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66735.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66343.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53977.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59130.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53977.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53487.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.66343.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50230.log/var/log/ceph/ceph-client.admin.53487.log: 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69025.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.53487.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54026.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50230.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67243.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69025.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59539.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54026.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67243.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67243.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64591.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59539.log: /var/log/ceph/ceph-client.admin.49936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72165.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59352.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59539.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64591.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59352.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72165.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67586.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58542.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46603.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59352.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49201.log 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2026-02-17T12:11:50.737 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55466.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67586.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55795.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55466.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58542.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69823.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49201.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58444.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55466.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60128.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55795.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61325.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69823.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60471.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57544.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60128.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.58444.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61325.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56939.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60471.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64787.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57544.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64689.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64787.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56939.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64689.log: 89.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.64787.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63741.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56645.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64689.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71773.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51326.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56645.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.63741.log.gz/var/log/ceph/ceph-client.admin.71773.log: 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58231.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72802.log 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71773.log.gz 91.0% 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56645.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51326.log.gz 2026-02-17T12:11:50.738 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47188.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58231.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70069.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56236.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72802.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58133.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47188.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70429.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.70069.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49985.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56236.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57037.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58133.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65491.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.70429.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49985.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65589.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57037.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67929.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65491.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65540.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67929.log: /var/log/ceph/ceph-client.admin.65540.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65589.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65540.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.67929.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47384.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz -5 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62533.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57887.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip/var/log/ceph/ceph-client.admin.62533.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2026-02-17T12:11:50.739 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65393.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.62533.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53879.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.57887.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56988.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46308.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53879.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.65393.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66294.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53879.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61521.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.56988.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66294.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46308.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59228.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.66294.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72606.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61521.log: /var/log/ceph/ceph-client.admin.59228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59980.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.61521.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63790.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59228.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62336.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59980.log: /var/log/ceph/ceph-client.admin.63790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68518.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72606.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62336.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.50181.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59980.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63790.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55614.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62336.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71724.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50181.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.68518.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72900.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55614.log: /var/log/ceph/ceph-client.admin.71724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70331.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50181.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55614.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71724.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52274.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72900.log.gz 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50279.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70331.log: /var/log/ceph/ceph-client.admin.52274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58084.log 2026-02-17T12:11:50.740 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.70331.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64133.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.52274.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50279.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64542.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58084.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52176.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64133.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57086.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48747.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64542.log: /var/log/ceph/ceph-client.admin.57086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65736.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48747.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.64542.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57086.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57740.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48747.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64345.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65736.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72753.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57740.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71871.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64345.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59441.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70674.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72753.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.71871.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59441.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51833.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.70674.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54223.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64444.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2026-02-17T12:11:50.741 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51833.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48092.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54223.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55893.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.64444.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65245.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48092.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55893.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54763.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68322.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65245.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54615.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57184.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54763.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59277.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68322.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71183.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54615.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59277.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57184.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54419.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64836.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67193.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71183.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63398.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54419.log.gz 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64395.log 2026-02-17T12:11:50.742 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64836.log.gz 2026-02-17T12:11:50.743 INFO:teuthology.orchestra.run.trial142.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.45205.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51735.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67193.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.63398.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66686.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64395.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63183.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51735.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63839.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2026-02-17T12:11:50.757 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66686.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61717.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63183.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- 90.1% /var/log/ceph/ceph-client.admin.67782.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63839.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56432.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69774.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67782.log: /var/log/ceph/ceph-client.admin.56432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61815.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61717.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.4%/var/log/ceph/ceph-client.admin.69774.log: -- replaced with /var/log/ceph/ceph-client.admin.67782.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61864.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56432.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47630.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.69774.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71134.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61815.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47630.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.61864.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62484.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47630.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65295.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71134.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62484.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63348.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65295.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72949.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58738.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72949.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63348.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59931.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72949.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59032.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58738.log: /var/log/ceph/ceph-client.admin.59931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61088.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59032.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.58738.log.gz --verbose 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: -- /var/log/ceph/ceph-client.admin.51129.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59931.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68829.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59032.log.gz 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61088.log: /var/log/ceph/ceph-client.admin.51129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68829.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.61088.log.gz /var/log/ceph/ceph-client.admin.48600.log 2026-02-17T12:11:50.758 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51129.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63447.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68829.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60569.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65081.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.7%/var/log/ceph/ceph-client.admin.63447.log: -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60569.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63447.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60569.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60029.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66194.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67733.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65081.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54321.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60029.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66194.log: /var/log/ceph/ceph-client.admin.67733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64257.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70144.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67733.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66194.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46092.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54321.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72655.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64257.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46092.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.70144.log.gz -- 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: /var/log/ceph/ceph-client.admin.46746.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50524.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72655.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49446.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46746.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63888.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55123.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50524.log: /var/log/ceph/ceph-client.admin.63888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60226.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67007.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50524.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63888.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61766.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55123.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60226.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67007.log.gz 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61227.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69074.log 2026-02-17T12:11:50.759 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61766.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69676.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62925.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61227.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55417.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69074.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72851.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.69676.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53193.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62925.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72851.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.55417.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71575.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72851.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68878.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.53193.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71575.log: /var/log/ceph/ceph-client.admin.68878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71330.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.71575.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57936.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.68878.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64084.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71330.log: /var/log/ceph/ceph-client.admin.57936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62189.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53928.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71330.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57936.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69382.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64640.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62189.log.gz -- replaced with /var/log/ceph/ceph-client.admin.64084.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54713.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53928.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69382.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64640.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70576.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54713.log.gz 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59490.log 2026-02-17T12:11:50.760 INFO:teuthology.orchestra.run.trial051.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71036.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54468.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70576.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62037.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59490.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60520.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.71036.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53340.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 90.4%/var/log/ceph/ceph-client.admin.60520.log: -- replaced with /var/log/ceph/ceph-client.admin.54468.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67144.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62037.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66441.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60520.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56089.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53340.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51548.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67144.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66441.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:gzip/var/log/ceph/ceph-client.admin.51548.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45619.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56089.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61374.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51548.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46096.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47944.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45619.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52029.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.61374.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49740.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46096.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60177.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47944.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60373.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52029.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62287.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49740.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69725.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60177.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57985.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60373.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66784.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62287.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63937.log 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69725.log.gz 2026-02-17T12:11:50.761 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68469.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57985.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63545.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66784.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63937.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58591.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.68469.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72263.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.63545.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.62876.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52980.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58591.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66932.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72263.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49397.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52980.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59081.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66932.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63260.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48190.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.63260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66244.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59081.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72998.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63260.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46795.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48190.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66030.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72998.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.66244.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46310.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.58787.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46795.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66030.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62974.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.66030.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68126.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58787.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60667.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62974.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66883.log 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2026-02-17T12:11:50.762 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68126.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69922.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.60667.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66883.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64493.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42801.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69922.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48042.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47237.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70282.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42801.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60716.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48042.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55744.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47237.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70282.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67635.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60716.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.57135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60422.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67635.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.55744.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66392.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60422.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67635.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68224.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60422.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68077.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66392.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70232.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.68224.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45361.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68077.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53438.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70232.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71822.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73047.log 2026-02-17T12:11:50.763 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45361.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53438.log: /var/log/ceph/ceph-client.admin.71822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53438.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.73047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71822.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58983.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73047.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48943.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60962.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52636.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58983.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.60962.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68420.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52636.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58640.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.68420.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46396.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64983.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.58640.log.gz 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70723.log 2026-02-17T12:11:50.764 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68273.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69172.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64983.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71526.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70723.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52127.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68273.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68780.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52127.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69172.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71526.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68780.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52127.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54566.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53078.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68780.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58934.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66637.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54566.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55024.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53078.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66637.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58934.log.gz 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69221.log 2026-02-17T12:11:50.770 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55844.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66637.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72065.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55024.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.55844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67390.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69221.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55844.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65344.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72065.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64035.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.67390.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70478.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.64035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65344.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70478.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64035.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70478.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51784.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62582.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61668.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60863.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51784.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46395.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62582.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52833.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61668.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66106.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60863.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47895.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.46395.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52833.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5/var/log/ceph/ceph-client.admin.66106.log: --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50475.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66106.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65687.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47895.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54861.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56334.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50475.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60324.log 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65687.log.gz 2026-02-17T12:11:50.771 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69123.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54861.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56334.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71085.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60324.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53830.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.69123.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53830.log: gzip -5 --verbose 89.6% -- -- replaced with /var/log/ceph/ceph-client.admin.71085.log.gz /var/log/ceph/ceph-client.admin.66490.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53830.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.46309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53585.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.66490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62729.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.53585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70772.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66490.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62729.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53585.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60079.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70821.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62729.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70527.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70772.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69872.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60079.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70527.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.49348.log -- replaced with /var/log/ceph/ceph-client.admin.70821.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59637.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70527.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65157.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69872.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.59637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48992.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51686.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59637.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72557.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65157.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60275.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48992.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.72557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67488.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51686.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.60275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61177.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72557.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.67488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58885.log 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60275.log.gz 2026-02-17T12:11:50.772 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61177.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67488.log.gz 2026-02-17T12:11:50.773 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70987.log 2026-02-17T12:11:50.773 INFO:teuthology.orchestra.run.trial051.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61177.log.gz 2026-02-17T12:11:50.773 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71967.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.58885.log: /var/log/ceph/ceph-client.admin.70987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.71967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69270.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70987.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.58885.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.51031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62238.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71967.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73094.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50573.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.69270.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.73094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69578.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62238.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57593.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73094.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.69578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70625.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50573.log.gz/var/log/ceph/ceph-client.admin.57593.log: 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56743.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69578.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.70625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62631.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57593.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.56743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65981.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70625.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.62631.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37748.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.56743.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68371.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62631.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.tmp-client.admin.37748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37748.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65981.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.68371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54174.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61423.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.68371.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.54174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.61423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54174.log.gz 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65932.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52078.log 2026-02-17T12:11:50.775 INFO:teuthology.orchestra.run.trial051.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61423.log.gz 2026-02-17T12:11:50.776 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.65932.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2026-02-17T12:11:50.776 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.52078.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65932.log.gz 2026-02-17T12:11:50.776 INFO:teuthology.orchestra.run.trial051.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52078.log.gz 2026-02-17T12:11:50.782 INFO:teuthology.orchestra.run.trial051.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:11:50.833 INFO:teuthology.orchestra.run.trial142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T12:11:50.951 INFO:teuthology.orchestra.run.trial051.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T12:11:51.070 INFO:teuthology.orchestra.run.trial142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T12:11:51.342 INFO:teuthology.orchestra.run.trial051.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T12:11:52.643 INFO:teuthology.orchestra.run.trial051.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T12:11:52.868 INFO:teuthology.orchestra.run.trial142.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T12:11:53.062 INFO:teuthology.orchestra.run.trial142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T12:11:53.128 INFO:teuthology.orchestra.run.trial142.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T12:11:53.130 INFO:teuthology.orchestra.run.trial142.stderr: 2026-02-17T12:11:53.130 INFO:teuthology.orchestra.run.trial142.stderr:real 0m2.449s 2026-02-17T12:11:53.130 INFO:teuthology.orchestra.run.trial142.stderr:user 0m7.199s 2026-02-17T12:11:53.130 INFO:teuthology.orchestra.run.trial142.stderr:sys 0m0.371s 2026-02-17T12:11:53.177 INFO:teuthology.orchestra.run.trial051.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T12:11:54.299 INFO:teuthology.orchestra.run.trial051.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T12:11:54.301 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-17T12:11:54.301 INFO:teuthology.orchestra.run.trial051.stderr:real 0m3.655s 2026-02-17T12:11:54.301 INFO:teuthology.orchestra.run.trial051.stderr:user 0m8.809s 2026-02-17T12:11:54.301 INFO:teuthology.orchestra.run.trial051.stderr:sys 0m0.659s 2026-02-17T12:11:54.302 INFO:tasks.ceph:Archiving logs... 2026-02-17T12:11:54.302 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial051/log 2026-02-17T12:11:54.303 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:11:55.393 DEBUG:teuthology.misc:Transferring archived files from trial142:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial142/log 2026-02-17T12:11:55.393 DEBUG:teuthology.orchestra.run.trial142:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:11:56.059 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:11:56.064 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:11:56.065 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:11:56.066 DEBUG:teuthology.orchestra.run.trial142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:11:56.229 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:11:56.240 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:11:56.240 DEBUG:teuthology.orchestra.run.trial051:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:11:56.242 DEBUG:teuthology.orchestra.run.trial142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:11:56.256 INFO:teuthology.orchestra.run.trial051.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:11:56.258 INFO:teuthology.orchestra.run.trial142.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:=============================================================================== 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:^+ arm1.maxhost.io 2 8 377 65 -545us[ -545us] +/- 55ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:^+ us-east-2.clearnet.pw 2 6 177 63 -520us[ -520us] +/- 70ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:^* s2-a.time.mci1.us.rozint> 2 7 377 68 +485us[ +469us] +/- 23ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial051.stdout:^- hc243.ips.PaulBunyan.net 2 8 377 64 +1098us[+1098us] +/- 58ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:=============================================================================== 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:^+ arm1.maxhost.io 2 7 377 129 -909us[ -892us] +/- 54ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:^+ us-east-2.clearnet.pw 2 7 377 194 -830us[ -812us] +/- 69ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:^* s2-a.time.mci1.us.rozint> 2 8 377 67 +182us[ +199us] +/- 23ms 2026-02-17T12:11:56.284 INFO:teuthology.orchestra.run.trial142.stdout:^+ hc243.ips.PaulBunyan.net 2 8 377 64 +801us[ +801us] +/- 57ms 2026-02-17T12:11:56.285 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:11:56.295 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:11:56.295 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:11:56.308 DEBUG:teuthology.orchestra.run.trial051:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:11:56.383 DEBUG:teuthology.orchestra.run.trial142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:11:56.438 DEBUG:teuthology.orchestra.run.trial051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:11:56.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:11:56.464 DEBUG:teuthology.orchestra.run.trial142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:11:56.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:11:56.491 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:11:56.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:11:56.523 INFO:teuthology.task.internal:Duration was 1861.904629 seconds 2026-02-17T12:11:56.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:11:56.538 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:11:56.538 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:11:56.541 DEBUG:teuthology.orchestra.run.trial142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:11:56.574 INFO:teuthology.orchestra.run.trial051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:11:56.576 INFO:teuthology.orchestra.run.trial142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:11:56.798 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:11:56.798 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial051.front.sepia.ceph.com 2026-02-17T12:11:56.799 DEBUG:teuthology.orchestra.run.trial051:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:11:56.856 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial142.front.sepia.ceph.com 2026-02-17T12:11:56.856 DEBUG:teuthology.orchestra.run.trial142:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:11:56.877 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:11:56.877 DEBUG:teuthology.orchestra.run.trial051:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:11:56.898 DEBUG:teuthology.orchestra.run.trial142:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:11:56.979 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:11:56.979 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:11:56.980 DEBUG:teuthology.orchestra.run.trial142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:11:57.001 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:11:57.001 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:11:57.001 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:11:57.002 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:11:57.002 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:11:57.003 INFO:teuthology.orchestra.run.trial142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:11:57.003 INFO:teuthology.orchestra.run.trial142.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:11:57.003 INFO:teuthology.orchestra.run.trial142.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip 0.0% -5 -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz --verbose 2026-02-17T12:11:57.003 INFO:teuthology.orchestra.run.trial142.stderr: -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:11:57.004 INFO:teuthology.orchestra.run.trial142.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:11:57.013 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 85.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:11:57.013 INFO:teuthology.orchestra.run.trial142.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:11:57.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:11:57.033 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:11:57.033 DEBUG:teuthology.orchestra.run.trial051:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:11:57.079 DEBUG:teuthology.orchestra.run.trial142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:11:57.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:11:57.122 DEBUG:teuthology.orchestra.run.trial051:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:11:57.125 DEBUG:teuthology.orchestra.run.trial142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:11:57.148 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern = core 2026-02-17T12:11:57.170 INFO:teuthology.orchestra.run.trial142.stdout:kernel.core_pattern = core 2026-02-17T12:11:57.184 DEBUG:teuthology.orchestra.run.trial051:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:11:57.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:11:57.216 DEBUG:teuthology.orchestra.run.trial142:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:11:57.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:11:57.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:11:57.258 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:11:57.259 DEBUG:teuthology.misc:Transferring archived files from trial051:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial051 2026-02-17T12:11:57.259 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:11:57.295 DEBUG:teuthology.misc:Transferring archived files from trial142:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51338/remote/trial142 2026-02-17T12:11:57.295 DEBUG:teuthology.orchestra.run.trial142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:11:57.330 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:11:57.330 DEBUG:teuthology.orchestra.run.trial051:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:11:57.333 DEBUG:teuthology.orchestra.run.trial142:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:11:57.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:11:57.397 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:11:57.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:11:57.413 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:11:57.413 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:11:57.416 DEBUG:teuthology.orchestra.run.trial142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:11:57.431 INFO:teuthology.orchestra.run.trial051.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:11 /home/ubuntu/cephtest 2026-02-17T12:11:57.437 INFO:teuthology.orchestra.run.trial142.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:11 /home/ubuntu/cephtest 2026-02-17T12:11:57.438 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:11:57.455 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:11:57.493 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} duration: 1861.9046294689178 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T12:11:57.493 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:11:57.618 INFO:teuthology.run:pass